2023-11-26T06:58:25.517 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-26T06:58:25.517 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467341 --name rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi --description fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone}} --verbose -- /home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467341/orig.config.yaml 2023-11-26T06:58:25.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-26T06:58:25.832 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467341 branch: rishabh-mgr-vol-misc description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone}} email: null first_in_suite: false job_id: '7467341' kernel: client: sha1: distro flavor: default kdb: true sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: rishabh-mgr-vol-misc ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 44c2237fe77713214148c1fd622c872f346f1b99 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 44c2237fe77713214148c1fd622c872f346f1b99 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rishabh-mgr-vol-misc sha1: 44c2237fe77713214148c1fd622c872f346f1b99 owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 1863 sha1: 44c2237fe77713214148c1fd622c872f346f1b99 sleep_before_teardown: 0 suite: fs:volumes suite_branch: rishabh-mgr-vol-misc suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 44c2237fe77713214148c1fd622c872f346f1b99 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi002.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi192.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 2442239d2653456406c25ae0c71b689c8f2657b6 timestamp: 2023-11-26_06:51:12 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-11-26T06:58:25.833 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa; will attempt to use it 2023-11-26T06:58:25.833 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa/tasks 2023-11-26T06:58:25.834 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-26T06:58:25.835 INFO:teuthology.task.internal:Checking packages... 2023-11-26T06:58:25.857 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '44c2237fe77713214148c1fd622c872f346f1b99' 2023-11-26T06:58:25.857 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-26T06:58:25.858 INFO:teuthology.packaging:ref: None 2023-11-26T06:58:25.858 INFO:teuthology.packaging:tag: None 2023-11-26T06:58:25.858 INFO:teuthology.packaging:branch: rishabh-mgr-vol-misc 2023-11-26T06:58:25.858 INFO:teuthology.packaging:sha1: 44c2237fe77713214148c1fd622c872f346f1b99 2023-11-26T06:58:25.858 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=rishabh-mgr-vol-misc 2023-11-26T06:58:26.128 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7484.g44c2237f 2023-11-26T06:58:26.128 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-26T06:58:26.135 INFO:teuthology.task.internal:no buildpackages task found 2023-11-26T06:58:26.135 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-26T06:58:26.147 INFO:teuthology.task.internal:Saving configuration 2023-11-26T06:58:26.164 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-26T06:58:26.170 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-26T06:58:26.195 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi002.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467341', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-26 06:52:33.739348', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-26T06:58:26.217 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi192.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467341', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-26 06:52:33.737605', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-26T06:58:26.217 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-26T06:58:26.223 INFO:teuthology.task.internal:roles: ubuntu@smithi002.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-11-26T06:58:26.223 INFO:teuthology.task.internal:roles: ubuntu@smithi192.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-11-26T06:58:26.224 INFO:teuthology.run_tasks:Running task console_log... 2023-11-26T06:58:26.291 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7efffdbe8b80>, signals=[15]) 2023-11-26T06:58:26.291 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-26T06:58:26.297 INFO:teuthology.task.internal:Opening connections... 2023-11-26T06:58:26.297 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi002.front.sepia.ceph.com 2023-11-26T06:58:26.299 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-26T06:58:26.366 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi192.front.sepia.ceph.com 2023-11-26T06:58:26.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-26T06:58:26.431 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-26T06:58:26.438 DEBUG:teuthology.orchestra.run.smithi002:> uname -m 2023-11-26T06:58:26.463 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64 2023-11-26T06:58:26.463 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2023-11-26T06:58:26.523 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="Red Hat Enterprise Linux" 2023-11-26T06:58:26.523 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="8.6 (Ootpa)" 2023-11-26T06:58:26.523 INFO:teuthology.orchestra.run.smithi002.stdout:ID="rhel" 2023-11-26T06:58:26.523 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="fedora" 2023-11-26T06:58:26.523 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="8.6" 2023-11-26T06:58:26.523 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el8" 2023-11-26T06:58:26.523 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-26T06:58:26.523 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31" 2023-11-26T06:58:26.523 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-26T06:58:26.523 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://www.redhat.com/" 2023-11-26T06:58:26.524 INFO:teuthology.orchestra.run.smithi002.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-26T06:58:26.524 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-26T06:58:26.524 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T06:58:26.524 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-26T06:58:26.524 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-26T06:58:26.524 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-26T06:58:26.524 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-26T06:58:26.525 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2023-11-26T06:58:26.559 DEBUG:teuthology.orchestra.run.smithi192:> uname -m 2023-11-26T06:58:26.577 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2023-11-26T06:58:26.577 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2023-11-26T06:58:26.632 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="Red Hat Enterprise Linux" 2023-11-26T06:58:26.632 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="8.6 (Ootpa)" 2023-11-26T06:58:26.632 INFO:teuthology.orchestra.run.smithi192.stdout:ID="rhel" 2023-11-26T06:58:26.633 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="fedora" 2023-11-26T06:58:26.633 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="8.6" 2023-11-26T06:58:26.633 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el8" 2023-11-26T06:58:26.633 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-26T06:58:26.633 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2023-11-26T06:58:26.633 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-26T06:58:26.633 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://www.redhat.com/" 2023-11-26T06:58:26.633 INFO:teuthology.orchestra.run.smithi192.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-26T06:58:26.633 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-26T06:58:26.633 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-26T06:58:26.633 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-26T06:58:26.633 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-26T06:58:26.633 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-26T06:58:26.634 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-26T06:58:26.634 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2023-11-26T06:58:26.659 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-26T06:58:26.668 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-26T06:58:26.674 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-26T06:58:26.674 DEBUG:teuthology.orchestra.run.smithi002:> test '!' -e /home/ubuntu/cephtest 2023-11-26T06:58:26.676 DEBUG:teuthology.orchestra.run.smithi192:> test '!' -e /home/ubuntu/cephtest 2023-11-26T06:58:26.693 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-26T06:58:26.699 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-26T06:58:26.699 DEBUG:teuthology.orchestra.run.smithi002:> test -z $(ls -A /var/lib/ceph) 2023-11-26T06:58:26.736 DEBUG:teuthology.orchestra.run.smithi192:> test -z $(ls -A /var/lib/ceph) 2023-11-26T06:58:26.767 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-26T06:58:26.822 INFO:teuthology.run_tasks:Running task kernel... 2023-11-26T06:58:26.835 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'} 2023-11-26T06:58:26.836 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-11-26T06:58:26.836 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-11-26T06:58:26.836 DEBUG:teuthology.orchestra.run.smithi002:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-26T06:58:26.837 DEBUG:teuthology.orchestra.run.smithi192:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-26T06:58:26.852 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T06:58:26.852 DEBUG:teuthology.orchestra.run.smithi192:> uname -r 2023-11-26T06:58:26.856 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T06:58:26.856 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2023-11-26T06:58:26.908 INFO:teuthology.orchestra.run.smithi192.stdout:4.18.0-372.9.1.el8.x86_64 2023-11-26T06:58:26.909 INFO:teuthology.task.kernel:Running kernel on smithi192: 4.18.0-372.9.1.el8.x86_64 2023-11-26T06:58:26.909 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum install -y kernel 2023-11-26T06:58:26.916 INFO:teuthology.orchestra.run.smithi002.stdout:4.18.0-372.9.1.el8.x86_64 2023-11-26T06:58:26.916 INFO:teuthology.task.kernel:Running kernel on smithi002: 4.18.0-372.9.1.el8.x86_64 2023-11-26T06:58:26.917 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum install -y kernel 2023-11-26T06:58:28.084 INFO:teuthology.orchestra.run.smithi192.stdout:Updating Subscription Management repositories. 2023-11-26T06:58:28.084 INFO:teuthology.orchestra.run.smithi192.stdout:Unable to read consumer identity 2023-11-26T06:58:28.169 INFO:teuthology.orchestra.run.smithi002.stdout:Updating Subscription Management repositories. 2023-11-26T06:58:28.170 INFO:teuthology.orchestra.run.smithi002.stdout:Unable to read consumer identity 2023-11-26T06:58:29.712 INFO:teuthology.orchestra.run.smithi002.stdout:Copr repo for python3-asyncssh owned by ceph 15 kB/s | 3.5 kB 00:00 2023-11-26T06:58:29.716 INFO:teuthology.orchestra.run.smithi192.stdout:Copr repo for python3-asyncssh owned by ceph 14 kB/s | 3.5 kB 00:00 2023-11-26T06:58:30.854 INFO:teuthology.orchestra.run.smithi002.stdout:Extra Packages for Enterprise Linux 14 MB/s | 16 MB 00:01 2023-11-26T06:58:31.184 INFO:teuthology.orchestra.run.smithi192.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2023-11-26T06:58:34.554 INFO:teuthology.orchestra.run.smithi002.stdout:lab-extras 442 kB/s | 24 kB 00:00 2023-11-26T06:58:34.651 INFO:teuthology.orchestra.run.smithi192.stdout:lab-extras 336 kB/s | 24 kB 00:00 2023-11-26T06:58:35.312 INFO:teuthology.orchestra.run.smithi192.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-11-26T06:58:35.332 INFO:teuthology.orchestra.run.smithi002.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-11-26T06:58:35.362 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-11-26T06:58:35.363 INFO:teuthology.orchestra.run.smithi192.stdout:Nothing to do. 2023-11-26T06:58:35.364 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-11-26T06:58:35.388 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2023-11-26T06:58:35.390 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2023-11-26T06:58:35.390 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2023-11-26T06:58:35.493 DEBUG:teuthology.orchestra.run.smithi192:> echo no | sudo yum reinstall kernel || true 2023-11-26T06:58:35.525 DEBUG:teuthology.orchestra.run.smithi002:> echo no | sudo yum reinstall kernel || true 2023-11-26T06:58:35.824 INFO:teuthology.orchestra.run.smithi192.stdout:Updating Subscription Management repositories. 2023-11-26T06:58:35.824 INFO:teuthology.orchestra.run.smithi192.stdout:Unable to read consumer identity 2023-11-26T06:58:35.875 INFO:teuthology.orchestra.run.smithi002.stdout:Updating Subscription Management repositories. 2023-11-26T06:58:35.875 INFO:teuthology.orchestra.run.smithi002.stdout:Unable to read consumer identity 2023-11-26T06:58:36.080 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:00:01 ago on Sun 26 Nov 2023 06:58:34 AM UTC. 2023-11-26T06:58:36.124 INFO:teuthology.orchestra.run.smithi192.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-11-26T06:58:36.147 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:00:02 ago on Sun 26 Nov 2023 06:58:34 AM UTC. 2023-11-26T06:58:36.153 INFO:teuthology.orchestra.run.smithi192.stderr:Error: No packages marked for reinstall. 2023-11-26T06:58:36.192 INFO:teuthology.orchestra.run.smithi002.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-11-26T06:58:36.199 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum reinstall -y kernel || true 2023-11-26T06:58:36.244 INFO:teuthology.orchestra.run.smithi002.stderr:Error: No packages marked for reinstall. 2023-11-26T06:58:36.291 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum reinstall -y kernel || true 2023-11-26T06:58:36.530 INFO:teuthology.orchestra.run.smithi192.stdout:Updating Subscription Management repositories. 2023-11-26T06:58:36.531 INFO:teuthology.orchestra.run.smithi192.stdout:Unable to read consumer identity 2023-11-26T06:58:36.644 INFO:teuthology.orchestra.run.smithi002.stdout:Updating Subscription Management repositories. 2023-11-26T06:58:36.645 INFO:teuthology.orchestra.run.smithi002.stdout:Unable to read consumer identity 2023-11-26T06:58:36.789 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:00:02 ago on Sun 26 Nov 2023 06:58:34 AM UTC. 2023-11-26T06:58:36.834 INFO:teuthology.orchestra.run.smithi192.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-11-26T06:58:36.866 INFO:teuthology.orchestra.run.smithi192.stderr:Error: No packages marked for reinstall. 2023-11-26T06:58:36.908 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:00:02 ago on Sun 26 Nov 2023 06:58:34 AM UTC. 2023-11-26T06:58:36.917 DEBUG:teuthology.orchestra.run.smithi192:> rpm -q kernel | sort -rV | head -n 1 2023-11-26T06:58:36.951 INFO:teuthology.orchestra.run.smithi002.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-11-26T06:58:36.988 INFO:teuthology.orchestra.run.smithi002.stderr:Error: No packages marked for reinstall. 2023-11-26T06:58:36.996 INFO:teuthology.orchestra.run.smithi192.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-11-26T06:58:36.997 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-11-26T06:58:36.997 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-11-26T06:58:36.997 DEBUG:teuthology.parallel:result is None 2023-11-26T06:58:37.034 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q kernel | sort -rV | head -n 1 2023-11-26T06:58:37.116 INFO:teuthology.orchestra.run.smithi002.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-11-26T06:58:37.117 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-11-26T06:58:37.117 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-11-26T06:58:37.117 DEBUG:teuthology.parallel:result is None 2023-11-26T06:58:37.117 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-26T06:58:37.125 INFO:teuthology.task.internal:Creating test directory... 2023-11-26T06:58:37.125 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-26T06:58:37.127 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-26T06:58:37.144 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-26T06:58:37.150 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-26T06:58:37.157 INFO:teuthology.task.internal:Creating archive directory... 2023-11-26T06:58:37.157 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-26T06:58:37.184 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-26T06:58:37.223 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-26T06:58:37.229 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-26T06:58:37.230 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-26T06:58:37.242 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-26T06:58:37.274 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-26T06:58:37.291 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-26T06:58:37.294 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-26T06:58:37.306 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-26T06:58:37.307 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-26T06:58:37.313 INFO:teuthology.task.internal:Configuring sudo... 2023-11-26T06:58:37.314 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-26T06:58:37.335 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-26T06:58:37.374 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-26T06:58:37.381 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-26T06:58:37.382 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-26T06:58:37.403 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-26T06:58:37.431 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-26T06:58:37.501 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-26T06:58:37.551 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-26T06:58:37.629 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-26T06:58:37.676 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T06:58:37.676 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-26T06:58:37.744 DEBUG:teuthology.orchestra.run.smithi192:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-26T06:58:37.789 DEBUG:teuthology.orchestra.run.smithi192:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-26T06:58:37.864 DEBUG:teuthology.orchestra.run.smithi192:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-26T06:58:37.909 DEBUG:teuthology.orchestra.run.smithi192:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-26T06:58:37.951 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T06:58:37.952 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-26T06:58:38.029 DEBUG:teuthology.orchestra.run.smithi002:> sudo service rsyslog restart 2023-11-26T06:58:38.031 DEBUG:teuthology.orchestra.run.smithi192:> sudo service rsyslog restart 2023-11-26T06:58:38.114 INFO:teuthology.orchestra.run.smithi002.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-26T06:58:38.123 INFO:teuthology.orchestra.run.smithi192.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-26T06:58:38.606 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-26T06:58:38.613 INFO:teuthology.task.internal:Starting timer... 2023-11-26T06:58:38.613 INFO:teuthology.run_tasks:Running task pcp... 2023-11-26T06:58:38.622 INFO:teuthology.run_tasks:Running task selinux... 2023-11-26T06:58:38.630 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-11-26T06:58:38.630 DEBUG:teuthology.orchestra.run.smithi002:> sudo service auditd rotate 2023-11-26T06:58:38.689 INFO:teuthology.orchestra.run.smithi002.stdout:Rotating logs: 2023-11-26T06:58:38.691 DEBUG:teuthology.orchestra.run.smithi192:> sudo service auditd rotate 2023-11-26T06:58:38.770 INFO:teuthology.orchestra.run.smithi192.stdout:Rotating logs: 2023-11-26T06:58:38.772 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-26T06:58:38.772 DEBUG:teuthology.orchestra.run.smithi002:> /usr/sbin/getenforce 2023-11-26T06:58:38.798 INFO:teuthology.orchestra.run.smithi002.stdout:Permissive 2023-11-26T06:58:38.798 DEBUG:teuthology.orchestra.run.smithi192:> /usr/sbin/getenforce 2023-11-26T06:58:38.820 INFO:teuthology.orchestra.run.smithi192.stdout:Permissive 2023-11-26T06:58:38.820 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi002.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi192.front.sepia.ceph.com': 'permissive'} 2023-11-26T06:58:38.820 DEBUG:teuthology.orchestra.run.smithi002:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-26T06:58:38.868 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T06:58:38.869 DEBUG:teuthology.orchestra.run.smithi192:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-26T06:58:38.895 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T06:58:38.896 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-26T06:58:38.896 DEBUG:teuthology.orchestra.run.smithi002:> sudo /usr/sbin/setenforce permissive 2023-11-26T06:58:38.936 DEBUG:teuthology.orchestra.run.smithi192:> sudo /usr/sbin/setenforce permissive 2023-11-26T06:58:38.962 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-26T06:58:38.971 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-11-26T06:58:38.971 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-26T06:58:38.985 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-26T06:58:38.986 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi002.front.sepia.ceph.com,smithi192.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-26T07:08:00.601 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi002.front.sepia.ceph.com'), Remote(name='ubuntu@smithi192.front.sepia.ceph.com')] 2023-11-26T07:08:00.602 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2023-11-26T07:08:00.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-26T07:08:00.671 DEBUG:teuthology.orchestra.run.smithi002:> true 2023-11-26T07:08:00.696 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2023-11-26T07:08:00.696 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-11-26T07:08:00.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-26T07:08:00.764 DEBUG:teuthology.orchestra.run.smithi192:> true 2023-11-26T07:08:00.831 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-11-26T07:08:00.832 INFO:teuthology.run_tasks:Running task clock... 2023-11-26T07:08:00.843 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-26T07:08:00.844 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-26T07:08:00.844 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-26T07:08:00.846 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-26T07:08:00.846 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-26T07:08:00.877 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-26T07:08:00.893 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-26T07:08:00.904 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-26T07:08:00.919 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-26T07:08:00.956 INFO:teuthology.orchestra.run.smithi002.stderr:sudo: ntpd: command not found 2023-11-26T07:08:00.968 INFO:teuthology.orchestra.run.smithi002.stdout:506 Cannot talk to daemon 2023-11-26T07:08:00.983 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-26T07:08:00.997 INFO:teuthology.orchestra.run.smithi192.stderr:sudo: ntpd: command not found 2023-11-26T07:08:00.998 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-26T07:08:01.009 INFO:teuthology.orchestra.run.smithi192.stdout:506 Cannot talk to daemon 2023-11-26T07:08:01.024 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-26T07:08:01.038 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-26T07:08:01.075 INFO:teuthology.orchestra.run.smithi002.stderr:bash: ntpq: command not found 2023-11-26T07:08:01.079 INFO:teuthology.orchestra.run.smithi002.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-26T07:08:01.079 INFO:teuthology.orchestra.run.smithi002.stdout:=============================================================================== 2023-11-26T07:08:01.079 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-26T07:08:01.079 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-26T07:08:01.079 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-26T07:08:01.079 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-26T07:08:01.105 INFO:teuthology.orchestra.run.smithi192.stderr:bash: ntpq: command not found 2023-11-26T07:08:01.109 INFO:teuthology.orchestra.run.smithi192.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-26T07:08:01.109 INFO:teuthology.orchestra.run.smithi192.stdout:=============================================================================== 2023-11-26T07:08:01.109 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-26T07:08:01.109 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-26T07:08:01.110 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-26T07:08:01.110 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-26T07:08:01.111 INFO:teuthology.run_tasks:Running task install... 2023-11-26T07:08:01.119 DEBUG:teuthology.task.install:project ceph 2023-11-26T07:08:01.120 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '44c2237fe77713214148c1fd622c872f346f1b99'}} 2023-11-26T07:08:01.120 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '44c2237fe77713214148c1fd622c872f346f1b99'} 2023-11-26T07:08:01.120 INFO:teuthology.task.install:Using flavor: default 2023-11-26T07:08:01.126 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-26T07:08:01.126 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-26T07:08:01.126 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '44c2237fe77713214148c1fd622c872f346f1b99', 'tag': None, 'wait_for_package': False} 2023-11-26T07:08:01.127 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=44c2237fe77713214148c1fd622c872f346f1b99 2023-11-26T07:08:01.129 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '44c2237fe77713214148c1fd622c872f346f1b99', 'tag': None, 'wait_for_package': False} 2023-11-26T07:08:01.129 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=44c2237fe77713214148c1fd622c872f346f1b99 2023-11-26T07:08:01.276 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/centos/8/flavors/default/ 2023-11-26T07:08:01.276 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7484.g44c2237f 2023-11-26T07:08:01.351 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/centos/8/flavors/default/ 2023-11-26T07:08:01.352 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7484.g44c2237f 2023-11-26T07:08:01.401 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-26T07:08:01.401 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:08:01.401 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-26T07:08:01.430 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-26T07:08:01.431 DEBUG:teuthology.orchestra.run.smithi002:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/44c2237fe77713214148c1fd622c872f346f1b99/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-26T07:08:01.500 DEBUG:teuthology.orchestra.run.smithi002:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-26T07:08:01.533 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-26T07:08:01.534 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:08:01.534 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-26T07:08:01.562 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-26T07:08:01.563 DEBUG:teuthology.orchestra.run.smithi192:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/44c2237fe77713214148c1fd622c872f346f1b99/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-26T07:08:01.578 DEBUG:teuthology.orchestra.run.smithi002:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-26T07:08:01.633 DEBUG:teuthology.orchestra.run.smithi192:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-26T07:08:01.645 INFO:teuthology.orchestra.run.smithi002.stdout:check_obsoletes = 1 2023-11-26T07:08:01.647 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum clean all 2023-11-26T07:08:01.709 DEBUG:teuthology.orchestra.run.smithi192:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-26T07:08:01.775 INFO:teuthology.orchestra.run.smithi192.stdout:check_obsoletes = 1 2023-11-26T07:08:01.777 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum clean all 2023-11-26T07:08:02.035 INFO:teuthology.orchestra.run.smithi002.stdout:Updating Subscription Management repositories. 2023-11-26T07:08:02.146 INFO:teuthology.orchestra.run.smithi192.stdout:Updating Subscription Management repositories. 2023-11-26T07:08:02.548 INFO:teuthology.orchestra.run.smithi002.stdout:44 files removed 2023-11-26T07:08:02.596 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-26T07:08:02.653 INFO:teuthology.orchestra.run.smithi192.stdout:44 files removed 2023-11-26T07:08:02.700 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-26T07:08:02.946 INFO:teuthology.orchestra.run.smithi002.stdout:Updating Subscription Management repositories. 2023-11-26T07:08:03.029 INFO:teuthology.orchestra.run.smithi192.stdout:Updating Subscription Management repositories. 2023-11-26T07:08:03.816 INFO:teuthology.orchestra.run.smithi192.stdout:ceph packages for x86_64 263 kB/s | 81 kB 00:00 2023-11-26T07:08:03.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph packages for x86_64 208 kB/s | 81 kB 00:00 2023-11-26T07:08:04.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph noarch packages 28 kB/s | 9.5 kB 00:00 2023-11-26T07:08:04.209 INFO:teuthology.orchestra.run.smithi192.stdout:ceph noarch packages 26 kB/s | 9.5 kB 00:00 2023-11-26T07:08:04.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph source packages 5.4 kB/s | 1.5 kB 00:00 2023-11-26T07:08:04.518 INFO:teuthology.orchestra.run.smithi192.stdout:ceph source packages 5.2 kB/s | 1.5 kB 00:00 2023-11-26T07:08:04.660 INFO:teuthology.orchestra.run.smithi192.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2023-11-26T07:08:04.676 INFO:teuthology.orchestra.run.smithi002.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2023-11-26T07:08:09.746 INFO:teuthology.orchestra.run.smithi002.stdout:Extra Packages for Enterprise Linux 3.2 MB/s | 16 MB 00:05 2023-11-26T07:08:11.897 INFO:teuthology.orchestra.run.smithi192.stdout:Extra Packages for Enterprise Linux 2.2 MB/s | 16 MB 00:07 2023-11-26T07:08:13.543 INFO:teuthology.orchestra.run.smithi002.stdout:lab-extras 460 kB/s | 24 kB 00:00 2023-11-26T07:08:14.545 INFO:teuthology.orchestra.run.smithi002.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 51 MB/s | 47 MB 00:00 2023-11-26T07:08:15.410 INFO:teuthology.orchestra.run.smithi192.stdout:lab-extras 392 kB/s | 24 kB 00:00 2023-11-26T07:08:16.354 INFO:teuthology.orchestra.run.smithi192.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 61 MB/s | 53 MB 00:00 2023-11-26T07:08:22.979 INFO:teuthology.orchestra.run.smithi002.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 60 MB/s | 53 MB 00:00 2023-11-26T07:08:24.413 INFO:teuthology.orchestra.run.smithi192.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 59 MB/s | 47 MB 00:00 2023-11-26T07:08:35.048 INFO:teuthology.orchestra.run.smithi002.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-11-26T07:08:35.049 INFO:teuthology.orchestra.run.smithi002.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-11-26T07:08:35.064 INFO:teuthology.orchestra.run.smithi002.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-11-26T07:08:35.065 INFO:teuthology.orchestra.run.smithi002.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-11-26T07:08:35.066 INFO:teuthology.orchestra.run.smithi002.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-11-26T07:08:35.068 INFO:teuthology.orchestra.run.smithi002.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-11-26T07:08:35.070 INFO:teuthology.orchestra.run.smithi002.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-11-26T07:08:35.073 INFO:teuthology.orchestra.run.smithi002.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-11-26T07:08:35.075 INFO:teuthology.orchestra.run.smithi002.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-11-26T07:08:35.218 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2023-11-26T07:08:35.231 INFO:teuthology.orchestra.run.smithi002.stdout:=========================================================================================================================== 2023-11-26T07:08:35.231 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2023-11-26T07:08:35.231 INFO:teuthology.orchestra.run.smithi002.stdout:=========================================================================================================================== 2023-11-26T07:08:35.232 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2023-11-26T07:08:35.232 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-11-26T07:08:35.232 INFO:teuthology.orchestra.run.smithi002.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-11-26T07:08:35.232 INFO:teuthology.orchestra.run.smithi002.stdout: ceph x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 6.4 k 2023-11-26T07:08:35.232 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 5.4 M 2023-11-26T07:08:35.232 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-fuse x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 919 k 2023-11-26T07:08:35.232 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 171 k 2023-11-26T07:08:35.233 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 1.6 M 2023-11-26T07:08:35.233 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7484.g44c2237f.el8 ceph-noarch 133 k 2023-11-26T07:08:35.233 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7484.g44c2237f.el8 ceph-noarch 1.8 M 2023-11-26T07:08:35.233 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7484.g44c2237f.el8 ceph-noarch 7.4 M 2023-11-26T07:08:35.233 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-rook noarch 2:18.0.0-7484.g44c2237f.el8 ceph-noarch 50 k 2023-11-26T07:08:35.233 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-radosgw x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 14 M 2023-11-26T07:08:35.233 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-test x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 49 M 2023-11-26T07:08:35.234 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-volume noarch 2:18.0.0-7484.g44c2237f.el8 ceph-noarch 262 k 2023-11-26T07:08:35.234 INFO:teuthology.orchestra.run.smithi002.stdout: cephadm noarch 2:18.0.0-7484.g44c2237f.el8 ceph-noarch 409 k 2023-11-26T07:08:35.234 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-mirror x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 263 k 2023-11-26T07:08:35.234 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-top noarch 2:18.0.0-7484.g44c2237f.el8 ceph-noarch 18 k 2023-11-26T07:08:35.234 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-11-26T07:08:35.234 INFO:teuthology.orchestra.run.smithi002.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-11-26T07:08:35.234 INFO:teuthology.orchestra.run.smithi002.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-11-26T07:08:35.234 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs-devel x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 31 k 2023-11-26T07:08:35.234 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs2 x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 838 k 2023-11-26T07:08:35.234 INFO:teuthology.orchestra.run.smithi002.stdout: librados-devel x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 139 k 2023-11-26T07:08:35.235 INFO:teuthology.orchestra.run.smithi002.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-11-26T07:08:35.235 INFO:teuthology.orchestra.run.smithi002.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-11-26T07:08:35.235 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-11-26T07:08:35.235 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-11-26T07:08:35.235 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-11-26T07:08:35.235 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-11-26T07:08:35.235 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cephfs x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 196 k 2023-11-26T07:08:35.235 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rados x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 371 k 2023-11-26T07:08:35.235 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rbd x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 365 k 2023-11-26T07:08:35.235 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rgw x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 107 k 2023-11-26T07:08:35.235 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-fuse x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 93 k 2023-11-26T07:08:35.235 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-mirror x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 3.6 M 2023-11-26T07:08:35.235 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-nbd x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 181 k 2023-11-26T07:08:35.236 INFO:teuthology.orchestra.run.smithi002.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-11-26T07:08:35.236 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrading: 2023-11-26T07:08:35.236 INFO:teuthology.orchestra.run.smithi002.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-11-26T07:08:35.236 INFO:teuthology.orchestra.run.smithi002.stdout: librados2 x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 3.8 M 2023-11-26T07:08:35.236 INFO:teuthology.orchestra.run.smithi002.stdout: librbd1 x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 3.7 M 2023-11-26T07:08:35.236 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2023-11-26T07:08:35.236 INFO:teuthology.orchestra.run.smithi002.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-11-26T07:08:35.236 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-common x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 23 M 2023-11-26T07:08:35.236 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7484.g44c2237f.el8 ceph-noarch 28 k 2023-11-26T07:08:35.236 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mds x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 2.3 M 2023-11-26T07:08:35.236 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7484.g44c2237f.el8 ceph-noarch 243 k 2023-11-26T07:08:35.236 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 4.6 M 2023-11-26T07:08:35.236 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-osd x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 18 M 2023-11-26T07:08:35.237 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7484.g44c2237f.el8 ceph-noarch 15 k 2023-11-26T07:08:35.237 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-selinux x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 24 k 2023-11-26T07:08:35.237 INFO:teuthology.orchestra.run.smithi002.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-11-26T07:08:35.237 INFO:teuthology.orchestra.run.smithi002.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-11-26T07:08:35.237 INFO:teuthology.orchestra.run.smithi002.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-11-26T07:08:35.237 INFO:teuthology.orchestra.run.smithi002.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-11-26T07:08:35.237 INFO:teuthology.orchestra.run.smithi002.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-11-26T07:08:35.237 INFO:teuthology.orchestra.run.smithi002.stdout: libcephsqlite x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 183 k 2023-11-26T07:08:35.237 INFO:teuthology.orchestra.run.smithi002.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-11-26T07:08:35.237 INFO:teuthology.orchestra.run.smithi002.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-11-26T07:08:35.237 INFO:teuthology.orchestra.run.smithi002.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-11-26T07:08:35.237 INFO:teuthology.orchestra.run.smithi002.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-11-26T07:08:35.237 INFO:teuthology.orchestra.run.smithi002.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-11-26T07:08:35.238 INFO:teuthology.orchestra.run.smithi002.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-11-26T07:08:35.238 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1 x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 517 k 2023-11-26T07:08:35.238 INFO:teuthology.orchestra.run.smithi002.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-11-26T07:08:35.238 INFO:teuthology.orchestra.run.smithi002.stdout: librgw2 x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 6.9 M 2023-11-26T07:08:35.238 INFO:teuthology.orchestra.run.smithi002.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-11-26T07:08:35.238 INFO:teuthology.orchestra.run.smithi002.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-11-26T07:08:35.238 INFO:teuthology.orchestra.run.smithi002.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-11-26T07:08:35.238 INFO:teuthology.orchestra.run.smithi002.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-11-26T07:08:35.239 INFO:teuthology.orchestra.run.smithi002.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-11-26T07:08:35.239 INFO:teuthology.orchestra.run.smithi002.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-11-26T07:08:35.239 INFO:teuthology.orchestra.run.smithi002.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-11-26T07:08:35.239 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-11-26T07:08:35.240 INFO:teuthology.orchestra.run.smithi002.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-11-26T07:08:35.240 INFO:teuthology.orchestra.run.smithi002.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-11-26T07:08:35.240 INFO:teuthology.orchestra.run.smithi002.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-11-26T07:08:35.240 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-11-26T07:08:35.240 INFO:teuthology.orchestra.run.smithi002.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-11-26T07:08:35.241 INFO:teuthology.orchestra.run.smithi002.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-11-26T07:08:35.241 INFO:teuthology.orchestra.run.smithi002.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-11-26T07:08:35.241 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-11-26T07:08:35.241 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 45 k 2023-11-26T07:08:35.242 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-common x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 128 k 2023-11-26T07:08:35.242 INFO:teuthology.orchestra.run.smithi002.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-11-26T07:08:35.242 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-11-26T07:08:35.242 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-11-26T07:08:35.242 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-11-26T07:08:35.243 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-11-26T07:08:35.243 INFO:teuthology.orchestra.run.smithi002.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-11-26T07:08:35.243 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-11-26T07:08:35.243 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-11-26T07:08:35.244 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-11-26T07:08:35.244 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-11-26T07:08:35.244 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-11-26T07:08:35.244 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-11-26T07:08:35.244 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-11-26T07:08:35.245 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-11-26T07:08:35.245 INFO:teuthology.orchestra.run.smithi002.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-11-26T07:08:35.245 INFO:teuthology.orchestra.run.smithi002.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-11-26T07:08:35.245 INFO:teuthology.orchestra.run.smithi002.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-11-26T07:08:35.246 INFO:teuthology.orchestra.run.smithi002.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-11-26T07:08:35.246 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-11-26T07:08:35.246 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-11-26T07:08:35.246 INFO:teuthology.orchestra.run.smithi002.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-11-26T07:08:35.246 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-11-26T07:08:35.247 INFO:teuthology.orchestra.run.smithi002.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-11-26T07:08:35.247 INFO:teuthology.orchestra.run.smithi002.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-11-26T07:08:35.247 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-11-26T07:08:35.247 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-11-26T07:08:35.248 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-11-26T07:08:35.248 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-11-26T07:08:35.248 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-11-26T07:08:35.248 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-11-26T07:08:35.248 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-11-26T07:08:35.249 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-11-26T07:08:35.249 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-11-26T07:08:35.249 INFO:teuthology.orchestra.run.smithi002.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-11-26T07:08:35.249 INFO:teuthology.orchestra.run.smithi002.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-11-26T07:08:35.250 INFO:teuthology.orchestra.run.smithi002.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-11-26T07:08:35.250 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-11-26T07:08:35.250 INFO:teuthology.orchestra.run.smithi002.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-11-26T07:08:35.250 INFO:teuthology.orchestra.run.smithi002.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-11-26T07:08:35.251 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-11-26T07:08:35.251 INFO:teuthology.orchestra.run.smithi002.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-11-26T07:08:35.251 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-11-26T07:08:35.251 INFO:teuthology.orchestra.run.smithi002.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-11-26T07:08:35.251 INFO:teuthology.orchestra.run.smithi002.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-11-26T07:08:35.252 INFO:teuthology.orchestra.run.smithi002.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-11-26T07:08:35.252 INFO:teuthology.orchestra.run.smithi002.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-11-26T07:08:35.252 INFO:teuthology.orchestra.run.smithi002.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-11-26T07:08:35.252 INFO:teuthology.orchestra.run.smithi002.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-11-26T07:08:35.253 INFO:teuthology.orchestra.run.smithi002.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-11-26T07:08:35.253 INFO:teuthology.orchestra.run.smithi002.stdout:Enabling module streams: 2023-11-26T07:08:35.253 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql 10 2023-11-26T07:08:35.253 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:08:35.254 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2023-11-26T07:08:35.254 INFO:teuthology.orchestra.run.smithi002.stdout:=========================================================================================================================== 2023-11-26T07:08:35.254 INFO:teuthology.orchestra.run.smithi002.stdout:Install 128 Packages 2023-11-26T07:08:35.254 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrade 3 Packages 2023-11-26T07:08:35.254 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:08:35.255 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 209 M 2023-11-26T07:08:35.255 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2023-11-26T07:08:35.303 INFO:teuthology.orchestra.run.smithi192.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-11-26T07:08:35.304 INFO:teuthology.orchestra.run.smithi192.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-11-26T07:08:35.319 INFO:teuthology.orchestra.run.smithi192.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-11-26T07:08:35.320 INFO:teuthology.orchestra.run.smithi192.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-11-26T07:08:35.321 INFO:teuthology.orchestra.run.smithi192.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-11-26T07:08:35.322 INFO:teuthology.orchestra.run.smithi192.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-11-26T07:08:35.324 INFO:teuthology.orchestra.run.smithi192.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-11-26T07:08:35.327 INFO:teuthology.orchestra.run.smithi192.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-11-26T07:08:35.328 INFO:teuthology.orchestra.run.smithi192.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-11-26T07:08:35.463 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-11-26T07:08:35.475 INFO:teuthology.orchestra.run.smithi192.stdout:=========================================================================================================================== 2023-11-26T07:08:35.476 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2023-11-26T07:08:35.476 INFO:teuthology.orchestra.run.smithi192.stdout:=========================================================================================================================== 2023-11-26T07:08:35.476 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2023-11-26T07:08:35.476 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-11-26T07:08:35.476 INFO:teuthology.orchestra.run.smithi192.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-11-26T07:08:35.476 INFO:teuthology.orchestra.run.smithi192.stdout: ceph x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 6.4 k 2023-11-26T07:08:35.476 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-base x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 5.4 M 2023-11-26T07:08:35.476 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-fuse x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 919 k 2023-11-26T07:08:35.476 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 171 k 2023-11-26T07:08:35.476 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 1.6 M 2023-11-26T07:08:35.477 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7484.g44c2237f.el8 ceph-noarch 133 k 2023-11-26T07:08:35.477 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7484.g44c2237f.el8 ceph-noarch 1.8 M 2023-11-26T07:08:35.477 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7484.g44c2237f.el8 ceph-noarch 7.4 M 2023-11-26T07:08:35.477 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-rook noarch 2:18.0.0-7484.g44c2237f.el8 ceph-noarch 50 k 2023-11-26T07:08:35.477 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-radosgw x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 14 M 2023-11-26T07:08:35.477 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-test x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 49 M 2023-11-26T07:08:35.477 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-volume noarch 2:18.0.0-7484.g44c2237f.el8 ceph-noarch 262 k 2023-11-26T07:08:35.477 INFO:teuthology.orchestra.run.smithi192.stdout: cephadm noarch 2:18.0.0-7484.g44c2237f.el8 ceph-noarch 409 k 2023-11-26T07:08:35.477 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-mirror x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 263 k 2023-11-26T07:08:35.477 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-top noarch 2:18.0.0-7484.g44c2237f.el8 ceph-noarch 18 k 2023-11-26T07:08:35.477 INFO:teuthology.orchestra.run.smithi192.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-11-26T07:08:35.478 INFO:teuthology.orchestra.run.smithi192.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-11-26T07:08:35.478 INFO:teuthology.orchestra.run.smithi192.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-11-26T07:08:35.478 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs-devel x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 31 k 2023-11-26T07:08:35.478 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs2 x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 838 k 2023-11-26T07:08:35.478 INFO:teuthology.orchestra.run.smithi192.stdout: librados-devel x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 139 k 2023-11-26T07:08:35.478 INFO:teuthology.orchestra.run.smithi192.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-11-26T07:08:35.478 INFO:teuthology.orchestra.run.smithi192.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-11-26T07:08:35.478 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-11-26T07:08:35.478 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-11-26T07:08:35.478 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-11-26T07:08:35.478 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-11-26T07:08:35.478 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cephfs x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 196 k 2023-11-26T07:08:35.479 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rados x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 371 k 2023-11-26T07:08:35.479 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rbd x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 365 k 2023-11-26T07:08:35.479 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rgw x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 107 k 2023-11-26T07:08:35.479 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-fuse x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 93 k 2023-11-26T07:08:35.479 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-mirror x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 3.6 M 2023-11-26T07:08:35.479 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-nbd x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 181 k 2023-11-26T07:08:35.479 INFO:teuthology.orchestra.run.smithi192.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-11-26T07:08:35.479 INFO:teuthology.orchestra.run.smithi192.stdout:Upgrading: 2023-11-26T07:08:35.479 INFO:teuthology.orchestra.run.smithi192.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-11-26T07:08:35.479 INFO:teuthology.orchestra.run.smithi192.stdout: librados2 x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 3.8 M 2023-11-26T07:08:35.479 INFO:teuthology.orchestra.run.smithi192.stdout: librbd1 x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 3.7 M 2023-11-26T07:08:35.479 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2023-11-26T07:08:35.479 INFO:teuthology.orchestra.run.smithi192.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-11-26T07:08:35.480 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-common x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 23 M 2023-11-26T07:08:35.480 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7484.g44c2237f.el8 ceph-noarch 28 k 2023-11-26T07:08:35.480 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mds x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 2.3 M 2023-11-26T07:08:35.480 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7484.g44c2237f.el8 ceph-noarch 243 k 2023-11-26T07:08:35.480 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mon x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 4.6 M 2023-11-26T07:08:35.480 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-osd x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 18 M 2023-11-26T07:08:35.480 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7484.g44c2237f.el8 ceph-noarch 15 k 2023-11-26T07:08:35.480 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-selinux x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 24 k 2023-11-26T07:08:35.480 INFO:teuthology.orchestra.run.smithi192.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-11-26T07:08:35.480 INFO:teuthology.orchestra.run.smithi192.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-11-26T07:08:35.480 INFO:teuthology.orchestra.run.smithi192.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-11-26T07:08:35.481 INFO:teuthology.orchestra.run.smithi192.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-11-26T07:08:35.481 INFO:teuthology.orchestra.run.smithi192.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-11-26T07:08:35.481 INFO:teuthology.orchestra.run.smithi192.stdout: libcephsqlite x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 183 k 2023-11-26T07:08:35.481 INFO:teuthology.orchestra.run.smithi192.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-11-26T07:08:35.481 INFO:teuthology.orchestra.run.smithi192.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-11-26T07:08:35.481 INFO:teuthology.orchestra.run.smithi192.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-11-26T07:08:35.481 INFO:teuthology.orchestra.run.smithi192.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-11-26T07:08:35.481 INFO:teuthology.orchestra.run.smithi192.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-11-26T07:08:35.481 INFO:teuthology.orchestra.run.smithi192.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-11-26T07:08:35.481 INFO:teuthology.orchestra.run.smithi192.stdout: libradosstriper1 x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 517 k 2023-11-26T07:08:35.481 INFO:teuthology.orchestra.run.smithi192.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-11-26T07:08:35.481 INFO:teuthology.orchestra.run.smithi192.stdout: librgw2 x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 6.9 M 2023-11-26T07:08:35.482 INFO:teuthology.orchestra.run.smithi192.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-11-26T07:08:35.482 INFO:teuthology.orchestra.run.smithi192.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-11-26T07:08:35.482 INFO:teuthology.orchestra.run.smithi192.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-11-26T07:08:35.482 INFO:teuthology.orchestra.run.smithi192.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-11-26T07:08:35.482 INFO:teuthology.orchestra.run.smithi192.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-11-26T07:08:35.482 INFO:teuthology.orchestra.run.smithi192.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-11-26T07:08:35.482 INFO:teuthology.orchestra.run.smithi192.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-11-26T07:08:35.482 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-11-26T07:08:35.482 INFO:teuthology.orchestra.run.smithi192.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-11-26T07:08:35.482 INFO:teuthology.orchestra.run.smithi192.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-11-26T07:08:35.482 INFO:teuthology.orchestra.run.smithi192.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-11-26T07:08:35.482 INFO:teuthology.orchestra.run.smithi192.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-11-26T07:08:35.483 INFO:teuthology.orchestra.run.smithi192.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-11-26T07:08:35.483 INFO:teuthology.orchestra.run.smithi192.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-11-26T07:08:35.483 INFO:teuthology.orchestra.run.smithi192.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-11-26T07:08:35.483 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-11-26T07:08:35.483 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-argparse x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 45 k 2023-11-26T07:08:35.483 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-common x86_64 2:18.0.0-7484.g44c2237f.el8 ceph 128 k 2023-11-26T07:08:35.483 INFO:teuthology.orchestra.run.smithi192.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-11-26T07:08:35.483 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-11-26T07:08:35.483 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-11-26T07:08:35.483 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-11-26T07:08:35.483 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-11-26T07:08:35.484 INFO:teuthology.orchestra.run.smithi192.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-11-26T07:08:35.484 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-11-26T07:08:35.484 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-11-26T07:08:35.484 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-11-26T07:08:35.484 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-11-26T07:08:35.484 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-11-26T07:08:35.484 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-11-26T07:08:35.484 INFO:teuthology.orchestra.run.smithi192.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-11-26T07:08:35.484 INFO:teuthology.orchestra.run.smithi192.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-11-26T07:08:35.484 INFO:teuthology.orchestra.run.smithi192.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-11-26T07:08:35.484 INFO:teuthology.orchestra.run.smithi192.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-11-26T07:08:35.484 INFO:teuthology.orchestra.run.smithi192.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-11-26T07:08:35.484 INFO:teuthology.orchestra.run.smithi192.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-11-26T07:08:35.485 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-11-26T07:08:35.485 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-11-26T07:08:35.485 INFO:teuthology.orchestra.run.smithi192.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-11-26T07:08:35.485 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-11-26T07:08:35.485 INFO:teuthology.orchestra.run.smithi192.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-11-26T07:08:35.485 INFO:teuthology.orchestra.run.smithi192.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-11-26T07:08:35.485 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-11-26T07:08:35.485 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-11-26T07:08:35.485 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-11-26T07:08:35.485 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-11-26T07:08:35.485 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-11-26T07:08:35.486 INFO:teuthology.orchestra.run.smithi192.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-11-26T07:08:35.486 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-11-26T07:08:35.486 INFO:teuthology.orchestra.run.smithi192.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-11-26T07:08:35.486 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-11-26T07:08:35.486 INFO:teuthology.orchestra.run.smithi192.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-11-26T07:08:35.486 INFO:teuthology.orchestra.run.smithi192.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-11-26T07:08:35.486 INFO:teuthology.orchestra.run.smithi192.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-11-26T07:08:35.486 INFO:teuthology.orchestra.run.smithi192.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-11-26T07:08:35.486 INFO:teuthology.orchestra.run.smithi192.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-11-26T07:08:35.486 INFO:teuthology.orchestra.run.smithi192.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-11-26T07:08:35.486 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-11-26T07:08:35.486 INFO:teuthology.orchestra.run.smithi192.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-11-26T07:08:35.487 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-11-26T07:08:35.487 INFO:teuthology.orchestra.run.smithi192.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-11-26T07:08:35.487 INFO:teuthology.orchestra.run.smithi192.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-11-26T07:08:35.487 INFO:teuthology.orchestra.run.smithi192.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-11-26T07:08:35.487 INFO:teuthology.orchestra.run.smithi192.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-11-26T07:08:35.487 INFO:teuthology.orchestra.run.smithi192.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-11-26T07:08:35.487 INFO:teuthology.orchestra.run.smithi192.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-11-26T07:08:35.487 INFO:teuthology.orchestra.run.smithi192.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-11-26T07:08:35.487 INFO:teuthology.orchestra.run.smithi192.stdout:Enabling module streams: 2023-11-26T07:08:35.487 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql 10 2023-11-26T07:08:35.487 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-26T07:08:35.487 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2023-11-26T07:08:35.488 INFO:teuthology.orchestra.run.smithi192.stdout:=========================================================================================================================== 2023-11-26T07:08:35.488 INFO:teuthology.orchestra.run.smithi192.stdout:Install 128 Packages 2023-11-26T07:08:35.488 INFO:teuthology.orchestra.run.smithi192.stdout:Upgrade 3 Packages 2023-11-26T07:08:35.488 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-26T07:08:35.488 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 209 M 2023-11-26T07:08:35.488 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2023-11-26T07:08:35.713 INFO:teuthology.orchestra.run.smithi002.stdout:(1/131): ceph-18.0.0-7484.g44c2237f.el8.x86_64. 22 kB/s | 6.4 kB 00:00 2023-11-26T07:08:36.164 INFO:teuthology.orchestra.run.smithi192.stdout:(1/131): ceph-18.0.0-7484.g44c2237f.el8.x86_64. 19 kB/s | 6.4 kB 00:00 2023-11-26T07:08:36.721 INFO:teuthology.orchestra.run.smithi002.stdout:(2/131): ceph-fuse-18.0.0-7484.g44c2237f.el8.x8 912 kB/s | 919 kB 00:01 2023-11-26T07:08:36.897 INFO:teuthology.orchestra.run.smithi002.stdout:(3/131): ceph-immutable-object-cache-18.0.0-748 978 kB/s | 171 kB 00:00 2023-11-26T07:08:37.172 INFO:teuthology.orchestra.run.smithi192.stdout:(2/131): ceph-fuse-18.0.0-7484.g44c2237f.el8.x8 912 kB/s | 919 kB 00:01 2023-11-26T07:08:37.348 INFO:teuthology.orchestra.run.smithi192.stdout:(3/131): ceph-immutable-object-cache-18.0.0-748 978 kB/s | 171 kB 00:00 2023-11-26T07:08:38.205 INFO:teuthology.orchestra.run.smithi002.stdout:(4/131): ceph-mds-18.0.0-7484.g44c2237f.el8.x86 1.8 MB/s | 2.3 MB 00:01 2023-11-26T07:08:38.530 INFO:teuthology.orchestra.run.smithi002.stdout:(5/131): ceph-base-18.0.0-7484.g44c2237f.el8.x8 1.7 MB/s | 5.4 MB 00:03 2023-11-26T07:08:38.773 INFO:teuthology.orchestra.run.smithi192.stdout:(4/131): ceph-base-18.0.0-7484.g44c2237f.el8.x8 1.8 MB/s | 5.4 MB 00:02 2023-11-26T07:08:38.847 INFO:teuthology.orchestra.run.smithi002.stdout:(6/131): ceph-mgr-18.0.0-7484.g44c2237f.el8.x86 2.5 MB/s | 1.6 MB 00:00 2023-11-26T07:08:39.081 INFO:teuthology.orchestra.run.smithi192.stdout:(5/131): ceph-mds-18.0.0-7484.g44c2237f.el8.x86 1.3 MB/s | 2.3 MB 00:01 2023-11-26T07:08:39.132 INFO:teuthology.orchestra.run.smithi192.stdout:(6/131): ceph-mgr-18.0.0-7484.g44c2237f.el8.x86 4.5 MB/s | 1.6 MB 00:00 2023-11-26T07:08:40.972 INFO:teuthology.orchestra.run.smithi002.stdout:(7/131): ceph-mon-18.0.0-7484.g44c2237f.el8.x86 1.9 MB/s | 4.6 MB 00:02 2023-11-26T07:08:41.923 INFO:teuthology.orchestra.run.smithi192.stdout:(7/131): ceph-mon-18.0.0-7484.g44c2237f.el8.x86 1.6 MB/s | 4.6 MB 00:02 2023-11-26T07:08:42.290 INFO:teuthology.orchestra.run.smithi192.stdout:(8/131): ceph-osd-18.0.0-7484.g44c2237f.el8.x86 5.7 MB/s | 18 MB 00:03 2023-11-26T07:08:42.399 INFO:teuthology.orchestra.run.smithi192.stdout:(9/131): ceph-selinux-18.0.0-7484.g44c2237f.el8 225 kB/s | 24 kB 00:00 2023-11-26T07:08:46.322 INFO:teuthology.orchestra.run.smithi002.stdout:(8/131): ceph-common-18.0.0-7484.g44c2237f.el8. 2.1 MB/s | 23 MB 00:10 2023-11-26T07:08:46.489 INFO:teuthology.orchestra.run.smithi002.stdout:(9/131): ceph-osd-18.0.0-7484.g44c2237f.el8.x86 2.4 MB/s | 18 MB 00:07 2023-11-26T07:08:46.506 INFO:teuthology.orchestra.run.smithi002.stdout:(10/131): ceph-selinux-18.0.0-7484.g44c2237f.el 133 kB/s | 24 kB 00:00 2023-11-26T07:08:47.115 INFO:teuthology.orchestra.run.smithi002.stdout:(11/131): ceph-radosgw-18.0.0-7484.g44c2237f.el 2.3 MB/s | 14 MB 00:06 2023-11-26T07:08:47.140 INFO:teuthology.orchestra.run.smithi002.stdout:(12/131): cephfs-mirror-18.0.0-7484.g44c2237f.e 415 kB/s | 263 kB 00:00 2023-11-26T07:08:47.190 INFO:teuthology.orchestra.run.smithi002.stdout:(13/131): libcephfs-devel-18.0.0-7484.g44c2237f 413 kB/s | 31 kB 00:00 2023-11-26T07:08:47.357 INFO:teuthology.orchestra.run.smithi002.stdout:(14/131): libcephsqlite-18.0.0-7484.g44c2237f.e 1.1 MB/s | 183 kB 00:00 2023-11-26T07:08:47.441 INFO:teuthology.orchestra.run.smithi002.stdout:(15/131): librados-devel-18.0.0-7484.g44c2237f. 1.6 MB/s | 139 kB 00:00 2023-11-26T07:08:47.674 INFO:teuthology.orchestra.run.smithi002.stdout:(16/131): libcephfs2-18.0.0-7484.g44c2237f.el8. 1.5 MB/s | 838 kB 00:00 2023-11-26T07:08:47.766 INFO:teuthology.orchestra.run.smithi002.stdout:(17/131): libradosstriper1-18.0.0-7484.g44c2237 1.6 MB/s | 517 kB 00:00 2023-11-26T07:08:47.850 INFO:teuthology.orchestra.run.smithi002.stdout:(18/131): python3-ceph-argparse-18.0.0-7484.g44 536 kB/s | 45 kB 00:00 2023-11-26T07:08:47.942 INFO:teuthology.orchestra.run.smithi002.stdout:(19/131): python3-ceph-common-18.0.0-7484.g44c2 1.4 MB/s | 128 kB 00:00 2023-11-26T07:08:48.075 INFO:teuthology.orchestra.run.smithi002.stdout:(20/131): python3-cephfs-18.0.0-7484.g44c2237f. 1.4 MB/s | 196 kB 00:00 2023-11-26T07:08:48.259 INFO:teuthology.orchestra.run.smithi002.stdout:(21/131): python3-rados-18.0.0-7484.g44c2237f.e 2.0 MB/s | 371 kB 00:00 2023-11-26T07:08:48.348 INFO:teuthology.orchestra.run.smithi192.stdout:(10/131): ceph-radosgw-18.0.0-7484.g44c2237f.el 2.2 MB/s | 14 MB 00:06 2023-11-26T07:08:48.442 INFO:teuthology.orchestra.run.smithi002.stdout:(22/131): python3-rbd-18.0.0-7484.g44c2237f.el8 1.9 MB/s | 365 kB 00:00 2023-11-26T07:08:48.490 INFO:teuthology.orchestra.run.smithi192.stdout:(11/131): cephfs-mirror-18.0.0-7484.g44c2237f.e 1.8 MB/s | 263 kB 00:00 2023-11-26T07:08:48.526 INFO:teuthology.orchestra.run.smithi002.stdout:(23/131): python3-rgw-18.0.0-7484.g44c2237f.el8 1.2 MB/s | 107 kB 00:00 2023-11-26T07:08:48.574 INFO:teuthology.orchestra.run.smithi192.stdout:(12/131): libcephfs-devel-18.0.0-7484.g44c2237f 372 kB/s | 31 kB 00:00 2023-11-26T07:08:48.618 INFO:teuthology.orchestra.run.smithi002.stdout:(24/131): rbd-fuse-18.0.0-7484.g44c2237f.el8.x8 1.0 MB/s | 93 kB 00:00 2023-11-26T07:08:48.983 INFO:teuthology.orchestra.run.smithi192.stdout:(13/131): libcephfs2-18.0.0-7484.g44c2237f.el8. 2.0 MB/s | 838 kB 00:00 2023-11-26T07:08:49.083 INFO:teuthology.orchestra.run.smithi192.stdout:(14/131): libcephsqlite-18.0.0-7484.g44c2237f.e 1.8 MB/s | 183 kB 00:00 2023-11-26T07:08:49.175 INFO:teuthology.orchestra.run.smithi192.stdout:(15/131): librados-devel-18.0.0-7484.g44c2237f. 1.5 MB/s | 139 kB 00:00 2023-11-26T07:08:49.400 INFO:teuthology.orchestra.run.smithi192.stdout:(16/131): libradosstriper1-18.0.0-7484.g44c2237 2.2 MB/s | 517 kB 00:00 2023-11-26T07:08:50.810 INFO:teuthology.orchestra.run.smithi002.stdout:(25/131): librgw2-18.0.0-7484.g44c2237f.el8.x86 2.2 MB/s | 6.9 MB 00:03 2023-11-26T07:08:50.877 INFO:teuthology.orchestra.run.smithi002.stdout:(26/131): rbd-mirror-18.0.0-7484.g44c2237f.el8. 1.6 MB/s | 3.6 MB 00:02 2023-11-26T07:08:50.961 INFO:teuthology.orchestra.run.smithi002.stdout:(27/131): ceph-grafana-dashboards-18.0.0-7484.g 336 kB/s | 28 kB 00:00 2023-11-26T07:08:50.986 INFO:teuthology.orchestra.run.smithi002.stdout:(28/131): rbd-nbd-18.0.0-7484.g44c2237f.el8.x86 1.0 MB/s | 181 kB 00:00 2023-11-26T07:08:51.061 INFO:teuthology.orchestra.run.smithi002.stdout:(29/131): ceph-mgr-cephadm-18.0.0-7484.g44c2237 1.3 MB/s | 133 kB 00:00 2023-11-26T07:08:51.942 INFO:teuthology.orchestra.run.smithi192.stdout:(17/131): ceph-test-18.0.0-7484.g44c2237f.el8.x 5.2 MB/s | 49 MB 00:09 2023-11-26T07:08:52.067 INFO:teuthology.orchestra.run.smithi192.stdout:(18/131): python3-ceph-argparse-18.0.0-7484.g44 358 kB/s | 45 kB 00:00 2023-11-26T07:08:52.165 INFO:teuthology.orchestra.run.smithi002.stdout:(30/131): ceph-mgr-dashboard-18.0.0-7484.g44c22 1.5 MB/s | 1.8 MB 00:01 2023-11-26T07:08:52.260 INFO:teuthology.orchestra.run.smithi192.stdout:(19/131): python3-ceph-common-18.0.0-7484.g44c2 671 kB/s | 128 kB 00:00 2023-11-26T07:08:52.395 INFO:teuthology.orchestra.run.smithi002.stdout:(31/131): ceph-mgr-modules-core-18.0.0-7484.g44 1.0 MB/s | 243 kB 00:00 2023-11-26T07:08:52.435 INFO:teuthology.orchestra.run.smithi192.stdout:(20/131): python3-cephfs-18.0.0-7484.g44c2237f. 1.1 MB/s | 196 kB 00:00 2023-11-26T07:08:52.487 INFO:teuthology.orchestra.run.smithi002.stdout:(32/131): ceph-mgr-rook-18.0.0-7484.g44c2237f.e 546 kB/s | 50 kB 00:00 2023-11-26T07:08:52.543 INFO:teuthology.orchestra.run.smithi192.stdout:(21/131): librgw2-18.0.0-7484.g44c2237f.el8.x86 2.2 MB/s | 6.9 MB 00:03 2023-11-26T07:08:52.579 INFO:teuthology.orchestra.run.smithi002.stdout:(33/131): ceph-prometheus-alerts-18.0.0-7484.g4 164 kB/s | 15 kB 00:00 2023-11-26T07:08:52.727 INFO:teuthology.orchestra.run.smithi192.stdout:(22/131): python3-rados-18.0.0-7484.g44c2237f.e 1.2 MB/s | 371 kB 00:00 2023-11-26T07:08:52.777 INFO:teuthology.orchestra.run.smithi192.stdout:(23/131): python3-rbd-18.0.0-7484.g44c2237f.el8 1.5 MB/s | 365 kB 00:00 2023-11-26T07:08:52.829 INFO:teuthology.orchestra.run.smithi002.stdout:(34/131): ceph-volume-18.0.0-7484.g44c2237f.el8 1.0 MB/s | 262 kB 00:00 2023-11-26T07:08:52.844 INFO:teuthology.orchestra.run.smithi192.stdout:(24/131): python3-rgw-18.0.0-7484.g44c2237f.el8 912 kB/s | 107 kB 00:00 2023-11-26T07:08:52.878 INFO:teuthology.orchestra.run.smithi192.stdout:(25/131): rbd-fuse-18.0.0-7484.g44c2237f.el8.x8 933 kB/s | 93 kB 00:00 2023-11-26T07:08:53.061 INFO:teuthology.orchestra.run.smithi192.stdout:(26/131): rbd-nbd-18.0.0-7484.g44c2237f.el8.x86 986 kB/s | 181 kB 00:00 2023-11-26T07:08:53.146 INFO:teuthology.orchestra.run.smithi002.stdout:(35/131): cephadm-18.0.0-7484.g44c2237f.el8.noa 1.3 MB/s | 409 kB 00:00 2023-11-26T07:08:53.162 INFO:teuthology.orchestra.run.smithi192.stdout:(27/131): ceph-grafana-dashboards-18.0.0-7484.g 279 kB/s | 28 kB 00:00 2023-11-26T07:08:53.238 INFO:teuthology.orchestra.run.smithi002.stdout:(36/131): cephfs-top-18.0.0-7484.g44c2237f.el8. 198 kB/s | 18 kB 00:00 2023-11-26T07:08:53.262 INFO:teuthology.orchestra.run.smithi192.stdout:(28/131): ceph-mgr-cephadm-18.0.0-7484.g44c2237 1.3 MB/s | 133 kB 00:00 2023-11-26T07:08:53.613 INFO:teuthology.orchestra.run.smithi002.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 817 kB/s | 306 kB 00:00 2023-11-26T07:08:53.755 INFO:teuthology.orchestra.run.smithi002.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 415 kB/s | 59 kB 00:00 2023-11-26T07:08:53.864 INFO:teuthology.orchestra.run.smithi002.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 693 kB/s | 75 kB 00:00 2023-11-26T07:08:54.056 INFO:teuthology.orchestra.run.smithi002.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.4 MB/s | 476 kB 00:00 2023-11-26T07:08:54.164 INFO:teuthology.orchestra.run.smithi002.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 403 kB/s | 44 kB 00:00 2023-11-26T07:08:54.170 INFO:teuthology.orchestra.run.smithi192.stdout:(29/131): ceph-mgr-dashboard-18.0.0-7484.g44c22 1.9 MB/s | 1.8 MB 00:00 2023-11-26T07:08:54.265 INFO:teuthology.orchestra.run.smithi002.stdout:(42/131): ceph-mgr-diskprediction-local-18.0.0- 2.3 MB/s | 7.4 MB 00:03 2023-11-26T07:08:54.315 INFO:teuthology.orchestra.run.smithi002.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.2 MB/s | 185 kB 00:00 2023-11-26T07:08:54.465 INFO:teuthology.orchestra.run.smithi002.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 109 kB/s | 16 kB 00:00 2023-11-26T07:08:54.491 INFO:teuthology.orchestra.run.smithi002.stdout:(45/131): python3-cachetools-3.1.1-4.el8.noarch 146 kB/s | 33 kB 00:00 2023-11-26T07:08:54.591 INFO:teuthology.orchestra.run.smithi002.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.3 MB/s | 173 kB 00:00 2023-11-26T07:08:54.683 INFO:teuthology.orchestra.run.smithi002.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 887 kB/s | 81 kB 00:00 2023-11-26T07:08:54.783 INFO:teuthology.orchestra.run.smithi002.stdout:(48/131): python3-cherrypy-18.4.0-1.el8.noarch. 1.3 MB/s | 384 kB 00:00 2023-11-26T07:08:54.800 INFO:teuthology.orchestra.run.smithi002.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 95 kB/s | 11 kB 00:00 2023-11-26T07:08:54.846 INFO:teuthology.orchestra.run.smithi192.stdout:(30/131): rbd-mirror-18.0.0-7484.g44c2237f.el8. 1.8 MB/s | 3.6 MB 00:02 2023-11-26T07:08:54.900 INFO:teuthology.orchestra.run.smithi002.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 150 kB/s | 18 kB 00:00 2023-11-26T07:08:54.992 INFO:teuthology.orchestra.run.smithi002.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 531 kB/s | 49 kB 00:00 2023-11-26T07:08:55.030 INFO:teuthology.orchestra.run.smithi192.stdout:(31/131): ceph-mgr-modules-core-18.0.0-7484.g44 1.3 MB/s | 243 kB 00:00 2023-11-26T07:08:55.034 INFO:teuthology.orchestra.run.smithi002.stdout:(52/131): python3-kubernetes-11.0.0-6.el8.noarc 5.0 MB/s | 1.2 MB 00:00 2023-11-26T07:08:55.085 INFO:teuthology.orchestra.run.smithi002.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 639 kB/s | 59 kB 00:00 2023-11-26T07:08:55.127 INFO:teuthology.orchestra.run.smithi002.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 656 kB/s | 60 kB 00:00 2023-11-26T07:08:55.130 INFO:teuthology.orchestra.run.smithi192.stdout:(32/131): ceph-mgr-rook-18.0.0-7484.g44c2237f.e 501 kB/s | 50 kB 00:00 2023-11-26T07:08:55.185 INFO:teuthology.orchestra.run.smithi002.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.8 MB/s | 283 kB 00:00 2023-11-26T07:08:55.236 INFO:teuthology.orchestra.run.smithi002.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 143 kB/s | 16 kB 00:00 2023-11-26T07:08:55.259 INFO:teuthology.orchestra.run.smithi192.stdout:(33/131): ceph-prometheus-alerts-18.0.0-7484.g4 116 kB/s | 15 kB 00:00 2023-11-26T07:08:55.286 INFO:teuthology.orchestra.run.smithi002.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 336 kB/s | 34 kB 00:00 2023-11-26T07:08:55.336 INFO:teuthology.orchestra.run.smithi002.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 1.9 MB/s | 196 kB 00:00 2023-11-26T07:08:55.378 INFO:teuthology.orchestra.run.smithi002.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 695 kB/s | 64 kB 00:00 2023-11-26T07:08:55.412 INFO:teuthology.orchestra.run.smithi002.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 249 kB/s | 19 kB 00:00 2023-11-26T07:08:55.447 INFO:teuthology.orchestra.run.smithi192.stdout:(34/131): ceph-volume-18.0.0-7484.g44c2237f.el8 1.4 MB/s | 262 kB 00:00 2023-11-26T07:08:55.487 INFO:teuthology.orchestra.run.smithi002.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 221 kB/s | 24 kB 00:00 2023-11-26T07:08:55.537 INFO:teuthology.orchestra.run.smithi002.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 233 kB/s | 29 kB 00:00 2023-11-26T07:08:55.588 INFO:teuthology.orchestra.run.smithi002.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 274 kB/s | 27 kB 00:00 2023-11-26T07:08:55.638 INFO:teuthology.orchestra.run.smithi002.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 2.5 MB/s | 255 kB 00:00 2023-11-26T07:08:55.688 INFO:teuthology.orchestra.run.smithi002.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.5 MB/s | 251 kB 00:00 2023-11-26T07:08:55.706 INFO:teuthology.orchestra.run.smithi192.stdout:(35/131): cephadm-18.0.0-7484.g44c2237f.el8.noa 1.5 MB/s | 409 kB 00:00 2023-11-26T07:08:55.730 INFO:teuthology.orchestra.run.smithi002.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 665 kB/s | 61 kB 00:00 2023-11-26T07:08:55.789 INFO:teuthology.orchestra.run.smithi002.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 852 kB/s | 85 kB 00:00 2023-11-26T07:08:55.806 INFO:teuthology.orchestra.run.smithi192.stdout:(36/131): cephfs-top-18.0.0-7484.g44c2237f.el8. 181 kB/s | 18 kB 00:00 2023-11-26T07:08:55.831 INFO:teuthology.orchestra.run.smithi002.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 229 kB/s | 23 kB 00:00 2023-11-26T07:08:55.856 INFO:teuthology.orchestra.run.smithi002.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-11-26T07:08:56.098 INFO:teuthology.orchestra.run.smithi002.stdout:(70/131): thrift-0.13.0-2.el8.x86_64.rpm 5.6 MB/s | 1.7 MB 00:00 2023-11-26T07:08:56.248 INFO:teuthology.orchestra.run.smithi002.stdout:(71/131): python3-scipy-1.0.0-21.module+el8.5.0 35 MB/s | 14 MB 00:00 2023-11-26T07:08:56.299 INFO:teuthology.orchestra.run.smithi002.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-11-26T07:08:56.316 INFO:teuthology.orchestra.run.smithi002.stdout:(73/131): python3-pyasn1-modules-0.3.7-6.el8.no 507 kB/s | 110 kB 00:00 2023-11-26T07:08:56.349 INFO:teuthology.orchestra.run.smithi002.stdout:(74/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.1 MB/s | 259 kB 00:00 2023-11-26T07:08:56.377 INFO:teuthology.orchestra.run.smithi002.stdout:(75/131): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-11-26T07:08:56.400 INFO:teuthology.orchestra.run.smithi002.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 772 kB/s | 39 kB 00:00 2023-11-26T07:08:56.433 INFO:teuthology.orchestra.run.smithi002.stdout:(77/131): bison-3.0.4-10.el8.x86_64.rpm 11 MB/s | 688 kB 00:00 2023-11-26T07:08:56.467 INFO:teuthology.orchestra.run.smithi002.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 7.8 MB/s | 538 kB 00:00 2023-11-26T07:08:56.492 INFO:teuthology.orchestra.run.smithi002.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-11-26T07:08:56.518 INFO:teuthology.orchestra.run.smithi002.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-11-26T07:08:56.551 INFO:teuthology.orchestra.run.smithi002.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2023-11-26T07:08:56.585 INFO:teuthology.orchestra.run.smithi002.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 799 kB/s | 27 kB 00:00 2023-11-26T07:08:56.627 INFO:teuthology.orchestra.run.smithi002.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-11-26T07:08:56.648 INFO:teuthology.orchestra.run.smithi192.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 364 kB/s | 306 kB 00:00 2023-11-26T07:08:56.660 INFO:teuthology.orchestra.run.smithi002.stdout:(84/131): python3-prettytable-0.7.2-14.el8.noar 1.3 MB/s | 44 kB 00:00 2023-11-26T07:08:56.727 INFO:teuthology.orchestra.run.smithi002.stdout:(85/131): python3-babel-2.5.1-7.el8.noarch.rpm 23 MB/s | 4.8 MB 00:00 2023-11-26T07:08:56.769 INFO:teuthology.orchestra.run.smithi002.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 11 MB/s | 457 kB 00:00 2023-11-26T07:08:56.773 INFO:teuthology.orchestra.run.smithi192.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 471 kB/s | 59 kB 00:00 2023-11-26T07:08:56.840 INFO:teuthology.orchestra.run.smithi002.stdout:(87/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 3.1 MB/s | 225 kB 00:00 2023-11-26T07:08:56.904 INFO:teuthology.orchestra.run.smithi002.stdout:(88/131): python3-numpy-1.14.3-10.el8.x86_64.rp 15 MB/s | 3.7 MB 00:00 2023-11-26T07:08:56.907 INFO:teuthology.orchestra.run.smithi192.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 564 kB/s | 75 kB 00:00 2023-11-26T07:08:56.929 INFO:teuthology.orchestra.run.smithi002.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 727 kB/s | 64 kB 00:00 2023-11-26T07:08:56.954 INFO:teuthology.orchestra.run.smithi002.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-11-26T07:08:56.971 INFO:teuthology.orchestra.run.smithi002.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 475 kB/s | 20 kB 00:00 2023-11-26T07:08:56.996 INFO:teuthology.orchestra.run.smithi002.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.4 MB/s | 103 kB 00:00 2023-11-26T07:08:57.030 INFO:teuthology.orchestra.run.smithi002.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 12 MB/s | 709 kB 00:00 2023-11-26T07:08:57.072 INFO:teuthology.orchestra.run.smithi002.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 4.6 MB/s | 198 kB 00:00 2023-11-26T07:08:57.189 INFO:teuthology.orchestra.run.smithi002.stdout:(95/131): openblas-threads-0.3.15-3.el8.x86_64. 25 MB/s | 4.9 MB 00:00 2023-11-26T07:08:57.231 INFO:teuthology.orchestra.run.smithi002.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-11-26T07:08:57.306 INFO:teuthology.orchestra.run.smithi002.stdout:(97/131): openblas-0.3.15-3.el8.x86_64.rpm 20 MB/s | 4.7 MB 00:00 2023-11-26T07:08:57.331 INFO:teuthology.orchestra.run.smithi002.stdout:(98/131): librdkafka-0.11.4-3.el8.x86_64.rpm 3.4 MB/s | 354 kB 00:00 2023-11-26T07:08:57.374 INFO:teuthology.orchestra.run.smithi192.stdout:(40/131): ceph-common-18.0.0-7484.g44c2237f.el8 1.0 MB/s | 23 MB 00:21 2023-11-26T07:08:57.381 INFO:teuthology.orchestra.run.smithi002.stdout:(99/131): postgresql-contrib-10.21-2.module+el8 16 MB/s | 808 kB 00:00 2023-11-26T07:08:57.457 INFO:teuthology.orchestra.run.smithi002.stdout:(100/131): postgresql-10.21-2.module+el8.6.0+15 20 MB/s | 1.5 MB 00:00 2023-11-26T07:08:57.524 INFO:teuthology.orchestra.run.smithi002.stdout:(101/131): postgresql-server-10.21-2.module+el8 23 MB/s | 5.1 MB 00:00 2023-11-26T07:08:57.549 INFO:teuthology.orchestra.run.smithi002.stdout:(102/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 509 kB/s | 47 kB 00:00 2023-11-26T07:08:57.549 INFO:teuthology.orchestra.run.smithi192.stdout:(41/131): ceph-mgr-diskprediction-local-18.0.0- 2.2 MB/s | 7.4 MB 00:03 2023-11-26T07:08:57.593 INFO:teuthology.orchestra.run.smithi002.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 2.8 MB/s | 200 kB 00:00 2023-11-26T07:08:57.616 INFO:teuthology.orchestra.run.smithi192.stdout:(42/131): python3-asyncssh-2.7.0-2.el8.noarch.r 671 kB/s | 476 kB 00:00 2023-11-26T07:08:57.625 INFO:teuthology.orchestra.run.smithi002.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 565 kB/s | 43 kB 00:00 2023-11-26T07:08:57.650 INFO:teuthology.orchestra.run.smithi002.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 3.8 MB/s | 220 kB 00:00 2023-11-26T07:08:57.675 INFO:teuthology.orchestra.run.smithi002.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 959 kB/s | 48 kB 00:00 2023-11-26T07:08:57.701 INFO:teuthology.orchestra.run.smithi002.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-11-26T07:08:57.726 INFO:teuthology.orchestra.run.smithi002.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 851 kB/s | 43 kB 00:00 2023-11-26T07:08:57.733 INFO:teuthology.orchestra.run.smithi192.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 283 kB/s | 33 kB 00:00 2023-11-26T07:08:57.751 INFO:teuthology.orchestra.run.smithi002.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.1 MB/s | 109 kB 00:00 2023-11-26T07:08:57.776 INFO:teuthology.orchestra.run.smithi002.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.4 MB/s | 229 kB 00:00 2023-11-26T07:08:57.810 INFO:teuthology.orchestra.run.smithi002.stdout:(111/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.3 MB/s | 560 kB 00:00 2023-11-26T07:08:57.833 INFO:teuthology.orchestra.run.smithi192.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 164 kB/s | 16 kB 00:00 2023-11-26T07:08:57.835 INFO:teuthology.orchestra.run.smithi002.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 319 kB/s | 19 kB 00:00 2023-11-26T07:08:57.860 INFO:teuthology.orchestra.run.smithi002.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.0 MB/s | 155 kB 00:00 2023-11-26T07:08:57.894 INFO:teuthology.orchestra.run.smithi002.stdout:(114/131): python3-cryptography-3.2.1-5.el8.x86 9.3 MB/s | 559 kB 00:00 2023-11-26T07:08:57.919 INFO:teuthology.orchestra.run.smithi002.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 305 kB/s | 18 kB 00:00 2023-11-26T07:08:57.953 INFO:teuthology.orchestra.run.smithi002.stdout:(116/131): pcre2-devel-10.32-2.el8.x86_64.rpm 10 MB/s | 605 kB 00:00 2023-11-26T07:08:57.970 INFO:teuthology.orchestra.run.smithi002.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.6 MB/s | 238 kB 00:00 2023-11-26T07:08:58.004 INFO:teuthology.orchestra.run.smithi002.stdout:(118/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 2.1 MB/s | 72 kB 00:00 2023-11-26T07:08:58.009 INFO:teuthology.orchestra.run.smithi192.stdout:(45/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 69 kB/s | 44 kB 00:00 2023-11-26T07:08:58.037 INFO:teuthology.orchestra.run.smithi002.stdout:(119/131): fuse-2.9.7-15.el8.x86_64.rpm 2.4 MB/s | 83 kB 00:00 2023-11-26T07:08:58.088 INFO:teuthology.orchestra.run.smithi002.stdout:(120/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 17 MB/s | 2.3 MB 00:00 2023-11-26T07:08:58.113 INFO:teuthology.orchestra.run.smithi002.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 795 kB/s | 60 kB 00:00 2023-11-26T07:08:58.126 INFO:teuthology.orchestra.run.smithi192.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 590 kB/s | 173 kB 00:00 2023-11-26T07:08:58.130 INFO:teuthology.orchestra.run.smithi002.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 2.3 MB/s | 98 kB 00:00 2023-11-26T07:08:58.155 INFO:teuthology.orchestra.run.smithi002.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.3 MB/s | 58 kB 00:00 2023-11-26T07:08:58.159 INFO:teuthology.orchestra.run.smithi192.stdout:(47/131): python3-beautifulsoup4-4.6.3-2.el8.1. 306 kB/s | 185 kB 00:00 2023-11-26T07:08:58.180 INFO:teuthology.orchestra.run.smithi002.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 770 kB/s | 39 kB 00:00 2023-11-26T07:08:58.222 INFO:teuthology.orchestra.run.smithi002.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 9.4 MB/s | 644 kB 00:00 2023-11-26T07:08:58.248 INFO:teuthology.orchestra.run.smithi002.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.5 MB/s | 171 kB 00:00 2023-11-26T07:08:58.265 INFO:teuthology.orchestra.run.smithi002.stdout:(127/131): NetworkManager-initscripts-updown-1. 3.2 MB/s | 138 kB 00:00 2023-11-26T07:08:58.284 INFO:teuthology.orchestra.run.smithi192.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 89 kB/s | 11 kB 00:00 2023-11-26T07:08:58.318 INFO:teuthology.orchestra.run.smithi192.stdout:(49/131): python3-google-auth-1.1.1-10.el8.noar 423 kB/s | 81 kB 00:00 2023-11-26T07:08:58.393 INFO:teuthology.orchestra.run.smithi192.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 162 kB/s | 18 kB 00:00 2023-11-26T07:08:58.502 INFO:teuthology.orchestra.run.smithi192.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 450 kB/s | 49 kB 00:00 2023-11-26T07:08:58.594 INFO:teuthology.orchestra.run.smithi192.stdout:(52/131): python3-cherrypy-18.4.0-1.el8.noarch. 657 kB/s | 384 kB 00:00 2023-11-26T07:08:58.653 INFO:teuthology.orchestra.run.smithi192.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 391 kB/s | 59 kB 00:00 2023-11-26T07:08:58.703 INFO:teuthology.orchestra.run.smithi192.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 555 kB/s | 60 kB 00:00 2023-11-26T07:08:58.811 INFO:teuthology.orchestra.run.smithi192.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 144 kB/s | 16 kB 00:00 2023-11-26T07:08:58.920 INFO:teuthology.orchestra.run.smithi192.stdout:(56/131): python3-repoze-lru-0.7-6.el8.noarch.r 311 kB/s | 34 kB 00:00 2023-11-26T07:08:59.029 INFO:teuthology.orchestra.run.smithi192.stdout:(57/131): python3-pecan-1.3.2-9.el8.noarch.rpm 752 kB/s | 283 kB 00:00 2023-11-26T07:08:59.137 INFO:teuthology.orchestra.run.smithi192.stdout:(58/131): python3-rsa-4.9-2.el8.noarch.rpm 593 kB/s | 64 kB 00:00 2023-11-26T07:08:59.213 INFO:teuthology.orchestra.run.smithi192.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 672 kB/s | 196 kB 00:00 2023-11-26T07:08:59.238 INFO:teuthology.orchestra.run.smithi192.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 186 kB/s | 19 kB 00:00 2023-11-26T07:08:59.322 INFO:teuthology.orchestra.run.smithi192.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 221 kB/s | 24 kB 00:00 2023-11-26T07:08:59.371 INFO:teuthology.orchestra.run.smithi192.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 220 kB/s | 29 kB 00:00 2023-11-26T07:08:59.439 INFO:teuthology.orchestra.run.smithi192.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 235 kB/s | 27 kB 00:00 2023-11-26T07:08:59.782 INFO:teuthology.orchestra.run.smithi002.stdout:(128/131): librbd1-18.0.0-7484.g44c2237f.el8.x8 2.4 MB/s | 3.7 MB 00:01 2023-11-26T07:08:59.814 INFO:teuthology.orchestra.run.smithi192.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 577 kB/s | 255 kB 00:00 2023-11-26T07:08:59.832 INFO:teuthology.orchestra.run.smithi002.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-11-26T07:08:59.848 INFO:teuthology.orchestra.run.smithi192.stdout:(65/131): python3-kubernetes-11.0.0-6.el8.noarc 780 kB/s | 1.2 MB 00:01 2023-11-26T07:08:59.873 INFO:teuthology.orchestra.run.smithi192.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 579 kB/s | 251 kB 00:00 2023-11-26T07:08:59.923 INFO:teuthology.orchestra.run.smithi192.stdout:(67/131): python3-websocket-client-0.56.0-5.el8 563 kB/s | 61 kB 00:00 2023-11-26T07:08:59.982 INFO:teuthology.orchestra.run.smithi192.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 212 kB/s | 23 kB 00:00 2023-11-26T07:09:00.007 INFO:teuthology.orchestra.run.smithi192.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-11-26T07:09:00.057 INFO:teuthology.orchestra.run.smithi192.stdout:(70/131): python3-webtest-2.0.33-1.el8.noarch.r 464 kB/s | 85 kB 00:00 2023-11-26T07:09:00.082 INFO:teuthology.orchestra.run.smithi192.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 625 kB/s | 47 kB 00:00 2023-11-26T07:09:00.123 INFO:teuthology.orchestra.run.smithi002.stdout:(130/131): librados2-18.0.0-7484.g44c2237f.el8. 2.0 MB/s | 3.8 MB 00:01 2023-11-26T07:09:00.124 INFO:teuthology.orchestra.run.smithi192.stdout:(72/131): python3-jwt-1.6.1-2.el8.noarch.rpm 1.2 MB/s | 43 kB 00:00 2023-11-26T07:09:00.175 INFO:teuthology.orchestra.run.smithi192.stdout:(73/131): libselinux-devel-2.9-5.el8.x86_64.rpm 1.7 MB/s | 200 kB 00:00 2023-11-26T07:09:00.200 INFO:teuthology.orchestra.run.smithi192.stdout:(74/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 2.9 MB/s | 220 kB 00:00 2023-11-26T07:09:00.225 INFO:teuthology.orchestra.run.smithi192.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 953 kB/s | 48 kB 00:00 2023-11-26T07:09:00.251 INFO:teuthology.orchestra.run.smithi192.stdout:(76/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-11-26T07:09:00.276 INFO:teuthology.orchestra.run.smithi192.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 848 kB/s | 43 kB 00:00 2023-11-26T07:09:00.301 INFO:teuthology.orchestra.run.smithi192.stdout:(78/131): python3-pycparser-2.14-14.el8.noarch. 2.1 MB/s | 109 kB 00:00 2023-11-26T07:09:00.327 INFO:teuthology.orchestra.run.smithi192.stdout:(79/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2023-11-26T07:09:00.369 INFO:teuthology.orchestra.run.smithi192.stdout:(80/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 8.2 MB/s | 560 kB 00:00 2023-11-26T07:09:00.394 INFO:teuthology.orchestra.run.smithi192.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 279 kB/s | 19 kB 00:00 2023-11-26T07:09:00.411 INFO:teuthology.orchestra.run.smithi192.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 3.6 MB/s | 155 kB 00:00 2023-11-26T07:09:00.444 INFO:teuthology.orchestra.run.smithi192.stdout:(83/131): python3-cryptography-3.2.1-5.el8.x86_ 11 MB/s | 559 kB 00:00 2023-11-26T07:09:00.470 INFO:teuthology.orchestra.run.smithi192.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 305 kB/s | 18 kB 00:00 2023-11-26T07:09:00.503 INFO:teuthology.orchestra.run.smithi192.stdout:(85/131): pcre2-devel-10.32-2.el8.x86_64.rpm 10 MB/s | 605 kB 00:00 2023-11-26T07:09:00.545 INFO:teuthology.orchestra.run.smithi192.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.1 MB/s | 238 kB 00:00 2023-11-26T07:09:00.587 INFO:teuthology.orchestra.run.smithi192.stdout:(87/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.7 MB/s | 72 kB 00:00 2023-11-26T07:09:00.638 INFO:teuthology.orchestra.run.smithi192.stdout:(88/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 17 MB/s | 2.3 MB 00:00 2023-11-26T07:09:00.663 INFO:teuthology.orchestra.run.smithi192.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 1.1 MB/s | 83 kB 00:00 2023-11-26T07:09:00.689 INFO:teuthology.orchestra.run.smithi192.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 1.2 MB/s | 60 kB 00:00 2023-11-26T07:09:00.713 INFO:teuthology.orchestra.run.smithi192.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.9 MB/s | 98 kB 00:00 2023-11-26T07:09:00.739 INFO:teuthology.orchestra.run.smithi192.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-11-26T07:09:00.756 INFO:teuthology.orchestra.run.smithi192.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 920 kB/s | 39 kB 00:00 2023-11-26T07:09:00.789 INFO:teuthology.orchestra.run.smithi192.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 13 MB/s | 644 kB 00:00 2023-11-26T07:09:00.814 INFO:teuthology.orchestra.run.smithi192.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.9 MB/s | 171 kB 00:00 2023-11-26T07:09:00.840 INFO:teuthology.orchestra.run.smithi192.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.7 MB/s | 138 kB 00:00 2023-11-26T07:09:00.915 INFO:teuthology.orchestra.run.smithi192.stdout:(97/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.4 MB/s | 110 kB 00:00 2023-11-26T07:09:00.949 INFO:teuthology.orchestra.run.smithi192.stdout:(98/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.6 MB/s | 54 kB 00:00 2023-11-26T07:09:00.991 INFO:teuthology.orchestra.run.smithi192.stdout:(99/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-11-26T07:09:01.033 INFO:teuthology.orchestra.run.smithi192.stdout:(100/131): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2023-11-26T07:09:01.066 INFO:teuthology.orchestra.run.smithi192.stdout:(101/131): python3-markupsafe-0.23-19.el8.x86_6 1.1 MB/s | 39 kB 00:00 2023-11-26T07:09:01.116 INFO:teuthology.orchestra.run.smithi192.stdout:(102/131): bison-3.0.4-10.el8.x86_64.rpm 13 MB/s | 688 kB 00:00 2023-11-26T07:09:01.158 INFO:teuthology.orchestra.run.smithi192.stdout:(103/131): python3-jinja2-2.10.1-3.el8.noarch.r 13 MB/s | 538 kB 00:00 2023-11-26T07:09:01.201 INFO:teuthology.orchestra.run.smithi192.stdout:(104/131): python3-mako-1.0.6-13.el8.noarch.rpm 3.7 MB/s | 157 kB 00:00 2023-11-26T07:09:01.242 INFO:teuthology.orchestra.run.smithi192.stdout:(105/131): oniguruma-6.8.2-2.el8.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2023-11-26T07:09:01.393 INFO:teuthology.orchestra.run.smithi192.stdout:(106/131): python3-scipy-1.0.0-21.module+el8.5. 24 MB/s | 14 MB 00:00 2023-11-26T07:09:01.426 INFO:teuthology.orchestra.run.smithi192.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 3.8 MB/s | 713 kB 00:00 2023-11-26T07:09:01.460 INFO:teuthology.orchestra.run.smithi192.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 799 kB/s | 27 kB 00:00 2023-11-26T07:09:01.502 INFO:teuthology.orchestra.run.smithi192.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-11-26T07:09:01.535 INFO:teuthology.orchestra.run.smithi192.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.3 MB/s | 44 kB 00:00 2023-11-26T07:09:01.603 INFO:teuthology.orchestra.run.smithi192.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 23 MB/s | 4.8 MB 00:00 2023-11-26T07:09:01.670 INFO:teuthology.orchestra.run.smithi192.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 6.7 MB/s | 457 kB 00:00 2023-11-26T07:09:01.711 INFO:teuthology.orchestra.run.smithi192.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 5.3 MB/s | 225 kB 00:00 2023-11-26T07:09:01.778 INFO:teuthology.orchestra.run.smithi192.stdout:(114/131): python3-numpy-1.14.3-10.el8.x86_64.r 15 MB/s | 3.7 MB 00:00 2023-11-26T07:09:01.804 INFO:teuthology.orchestra.run.smithi192.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 697 kB/s | 64 kB 00:00 2023-11-26T07:09:01.829 INFO:teuthology.orchestra.run.smithi192.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.5 MB/s | 126 kB 00:00 2023-11-26T07:09:01.854 INFO:teuthology.orchestra.run.smithi192.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 398 kB/s | 20 kB 00:00 2023-11-26T07:09:01.879 INFO:teuthology.orchestra.run.smithi192.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.0 MB/s | 103 kB 00:00 2023-11-26T07:09:01.913 INFO:teuthology.orchestra.run.smithi192.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 12 MB/s | 709 kB 00:00 2023-11-26T07:09:01.955 INFO:teuthology.orchestra.run.smithi192.stdout:(120/131): libpq-13.5-1.el8.x86_64.rpm 4.6 MB/s | 198 kB 00:00 2023-11-26T07:09:02.055 INFO:teuthology.orchestra.run.smithi192.stdout:(121/131): openblas-threads-0.3.15-3.el8.x86_64 28 MB/s | 4.9 MB 00:00 2023-11-26T07:09:02.089 INFO:teuthology.orchestra.run.smithi192.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 6.0 MB/s | 202 kB 00:00 2023-11-26T07:09:02.164 INFO:teuthology.orchestra.run.smithi192.stdout:(123/131): openblas-0.3.15-3.el8.x86_64.rpm 23 MB/s | 4.7 MB 00:00 2023-11-26T07:09:02.206 INFO:teuthology.orchestra.run.smithi192.stdout:(124/131): thrift-0.13.0-2.el8.x86_64.rpm 778 kB/s | 1.7 MB 00:02 2023-11-26T07:09:02.240 INFO:teuthology.orchestra.run.smithi192.stdout:(125/131): librdkafka-0.11.4-3.el8.x86_64.rpm 2.3 MB/s | 354 kB 00:00 2023-11-26T07:09:02.298 INFO:teuthology.orchestra.run.smithi192.stdout:(126/131): postgresql-contrib-10.21-2.module+el 8.6 MB/s | 808 kB 00:00 2023-11-26T07:09:02.340 INFO:teuthology.orchestra.run.smithi192.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 16 MB/s | 1.5 MB 00:00 2023-11-26T07:09:02.432 INFO:teuthology.orchestra.run.smithi192.stdout:(128/131): postgresql-server-10.21-2.module+el8 19 MB/s | 5.1 MB 00:00 2023-11-26T07:09:02.491 INFO:teuthology.orchestra.run.smithi192.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-11-26T07:09:03.488 INFO:teuthology.orchestra.run.smithi192.stdout:(130/131): librados2-18.0.0-7484.g44c2237f.el8. 3.2 MB/s | 3.8 MB 00:01 2023-11-26T07:09:03.857 INFO:teuthology.orchestra.run.smithi192.stdout:(131/131): librbd1-18.0.0-7484.g44c2237f.el8.x8 2.4 MB/s | 3.7 MB 00:01 2023-11-26T07:09:03.862 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2023-11-26T07:09:03.862 INFO:teuthology.orchestra.run.smithi192.stdout:Total 7.4 MB/s | 209 MB 00:28 2023-11-26T07:09:04.157 INFO:teuthology.orchestra.run.smithi002.stdout:(131/131): ceph-test-18.0.0-7484.g44c2237f.el8. 2.8 MB/s | 49 MB 00:17 2023-11-26T07:09:04.160 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2023-11-26T07:09:04.160 INFO:teuthology.orchestra.run.smithi002.stdout:Total 7.2 MB/s | 209 MB 00:28 2023-11-26T07:09:04.702 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2023-11-26T07:09:04.821 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2023-11-26T07:09:04.821 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2023-11-26T07:09:05.006 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2023-11-26T07:09:05.137 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2023-11-26T07:09:05.138 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2023-11-26T07:09:05.940 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2023-11-26T07:09:05.944 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2023-11-26T07:09:06.328 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2023-11-26T07:09:06.332 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2023-11-26T07:09:11.005 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2023-11-26T07:09:11.191 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-11-26T07:09:11.336 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2023-11-26T07:09:11.424 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-11-26T07:09:11.535 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-11-26T07:09:11.585 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-11-26T07:09:11.681 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-11-26T07:09:11.715 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-11-26T07:09:11.879 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-11-26T07:09:11.952 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-11-26T07:09:12.053 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-11-26T07:09:12.169 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-11-26T07:09:12.359 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-11-26T07:09:12.387 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-11-26T07:09:12.601 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : librados2-2:18.0.0-7484.g44c2237f.el8.x86_64 5/134 2023-11-26T07:09:12.803 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-11-26T07:09:13.016 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librados2-2:18.0.0-7484.g44c2237f.el8.x86_64 5/134 2023-11-26T07:09:13.037 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : librados2-2:18.0.0-7484.g44c2237f.el8.x86_64 6/134 2023-11-26T07:09:13.251 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : librbd1-2:18.0.0-7484.g44c2237f.el8.x86_64 6/134 2023-11-26T07:09:13.387 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librbd1-2:18.0.0-7484.g44c2237f.el8.x86_64 6/134 2023-11-26T07:09:13.469 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados2-2:18.0.0-7484.g44c2237f.el8.x86_64 6/134 2023-11-26T07:09:13.626 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephfs2-2:18.0.0-7484.g44c2237f.el8.x86_64 7/134 2023-11-26T07:09:13.661 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : librbd1-2:18.0.0-7484.g44c2237f.el8.x86_64 7/134 2023-11-26T07:09:13.712 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libcephfs2-2:18.0.0-7484.g44c2237f.el8.x86_64 7/134 2023-11-26T07:09:13.833 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librbd1-2:18.0.0-7484.g44c2237f.el8.x86_64 7/134 2023-11-26T07:09:13.873 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rados-2:18.0.0-7484.g44c2237f.el8.x86_64 8/134 2023-11-26T07:09:13.986 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephfs2-2:18.0.0-7484.g44c2237f.el8.x86_64 8/134 2023-11-26T07:09:14.077 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-11-26T07:09:14.089 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephfs2-2:18.0.0-7484.g44c2237f.el8.x86_64 8/134 2023-11-26T07:09:14.288 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rados-2:18.0.0-7484.g44c2237f.el8.x86_64 9/134 2023-11-26T07:09:14.321 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-11-26T07:09:14.543 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-11-26T07:09:14.571 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-11-26T07:09:14.748 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-11-26T07:09:15.013 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-11-26T07:09:15.170 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-11-26T07:09:15.291 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-11-26T07:09:15.480 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephsqlite-2:18.0.0-7484.g44c2237f.el8.x86_64 14/134 2023-11-26T07:09:15.485 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-11-26T07:09:15.581 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7484.g44c2237f.el8.x86_64 14/134 2023-11-26T07:09:15.686 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephsqlite-2:18.0.0-7484.g44c2237f.el8.x86_64 14/134 2023-11-26T07:09:15.751 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libradosstriper1-2:18.0.0-7484.g44c2237f.el8.x86 15/134 2023-11-26T07:09:15.809 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7484.g44c2237f.el8.x86_64 14/134 2023-11-26T07:09:15.878 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7484.g44c2237f.el8.x86 15/134 2023-11-26T07:09:15.978 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libradosstriper1-2:18.0.0-7484.g44c2237f.el8.x86 15/134 2023-11-26T07:09:16.071 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-11-26T07:09:16.091 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7484.g44c2237f.el8.x86 15/134 2023-11-26T07:09:16.202 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-11-26T07:09:16.290 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-11-26T07:09:16.343 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-11-26T07:09:16.469 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-11-26T07:09:16.470 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-11-26T07:09:16.626 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-11-26T07:09:16.767 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-11-26T07:09:16.909 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-11-26T07:09:17.130 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-11-26T07:09:17.302 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-11-26T07:09:17.559 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-11-26T07:09:17.759 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-11-26T07:09:17.936 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-11-26T07:09:18.110 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-11-26T07:09:18.359 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-11-26T07:09:18.584 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-11-26T07:09:18.855 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-11-26T07:09:19.157 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-11-26T07:09:19.298 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-11-26T07:09:19.376 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-11-26T07:09:19.565 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-11-26T07:09:19.582 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-11-26T07:09:19.743 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-11-26T07:09:19.798 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-11-26T07:09:19.990 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-11-26T07:09:20.044 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-11-26T07:09:20.207 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-ceph-common-2:18.0.0-7484.g44c2237f.el8. 26/134 2023-11-26T07:09:20.210 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-11-26T07:09:20.328 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-ceph-argparse-2:18.0.0-7484.g44c2237f.el 27/134 2023-11-26T07:09:20.384 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ceph-common-2:18.0.0-7484.g44c2237f.el8. 26/134 2023-11-26T07:09:20.515 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ceph-argparse-2:18.0.0-7484.g44c2237f.el 27/134 2023-11-26T07:09:20.571 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cephfs-2:18.0.0-7484.g44c2237f.el8.x86_6 28/134 2023-11-26T07:09:20.775 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-11-26T07:09:21.518 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cephfs-2:18.0.0-7484.g44c2237f.el8.x86_6 28/134 2023-11-26T07:09:21.832 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-11-26T07:09:22.082 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-11-26T07:09:22.362 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-11-26T07:09:22.531 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-11-26T07:09:22.543 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-11-26T07:09:23.569 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-11-26T07:09:23.904 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-11-26T07:09:24.201 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-11-26T07:09:24.421 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-11-26T07:09:24.429 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-11-26T07:09:24.628 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-11-26T07:09:24.772 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-11-26T07:09:24.877 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-11-26T07:09:24.984 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-11-26T07:09:25.055 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rbd-2:18.0.0-7484.g44c2237f.el8.x86_64 36/134 2023-11-26T07:09:25.182 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-11-26T07:09:25.231 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librados-devel-2:18.0.0-7484.g44c2237f.el8.x86_6 37/134 2023-11-26T07:09:25.373 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-11-26T07:09:25.383 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rbd-2:18.0.0-7484.g44c2237f.el8.x86_64 36/134 2023-11-26T07:09:25.525 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-11-26T07:09:25.531 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librados-devel-2:18.0.0-7484.g44c2237f.el8.x86_6 37/134 2023-11-26T07:09:25.714 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-11-26T07:09:25.732 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-11-26T07:09:25.806 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-11-26T07:09:25.871 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-11-26T07:09:26.062 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-11-26T07:09:26.198 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-11-26T07:09:26.360 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-11-26T07:09:26.385 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-11-26T07:09:26.578 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-11-26T07:09:26.594 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-11-26T07:09:26.758 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-11-26T07:09:26.840 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-11-26T07:09:26.944 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-11-26T07:09:27.037 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-11-26T07:09:27.220 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-11-26T07:09:27.230 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-11-26T07:09:27.395 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-11-26T07:09:27.445 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-11-26T07:09:27.593 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-11-26T07:09:27.700 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-11-26T07:09:27.760 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-11-26T07:09:27.915 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-11-26T07:09:27.920 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-11-26T07:09:28.107 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-11-26T07:09:28.209 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-11-26T07:09:28.364 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-11-26T07:09:28.468 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-11-26T07:09:28.661 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-11-26T07:09:28.702 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-11-26T07:09:28.884 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-11-26T07:09:29.009 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-11-26T07:09:29.041 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-11-26T07:09:29.219 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-11-26T07:09:29.230 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-11-26T07:09:29.490 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-11-26T07:09:29.560 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-11-26T07:09:29.747 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-11-26T07:09:29.824 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-11-26T07:09:30.059 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-11-26T07:09:30.072 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-11-26T07:09:30.274 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-11-26T07:09:30.281 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-11-26T07:09:30.475 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-11-26T07:09:30.503 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-11-26T07:09:30.670 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-11-26T07:09:30.695 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-11-26T07:09:30.825 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-11-26T07:09:30.889 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-11-26T07:09:30.896 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-11-26T07:09:31.052 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-11-26T07:09:31.118 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-11-26T07:09:31.288 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-11-26T07:09:31.381 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-11-26T07:09:31.459 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-11-26T07:09:31.526 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-11-26T07:09:31.695 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-11-26T07:09:31.775 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-11-26T07:09:31.927 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-11-26T07:09:31.928 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-11-26T07:09:32.093 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-11-26T07:09:32.191 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-11-26T07:09:32.308 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-11-26T07:09:32.373 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-11-26T07:09:32.535 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-11-26T07:09:32.614 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-11-26T07:09:32.825 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-11-26T07:09:32.835 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-11-26T07:09:32.997 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-11-26T07:09:33.089 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-11-26T07:09:33.154 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-11-26T07:09:33.219 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-11-26T07:09:33.330 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-11-26T07:09:33.351 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-11-26T07:09:33.507 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-11-26T07:09:33.567 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-11-26T07:09:33.680 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-11-26T07:09:33.769 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-11-26T07:09:33.853 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-11-26T07:09:34.002 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-11-26T07:09:34.006 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-11-26T07:09:34.193 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-11-26T07:09:34.218 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-11-26T07:09:34.346 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-11-26T07:09:34.414 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-11-26T07:09:34.619 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-11-26T07:09:34.623 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-11-26T07:09:34.827 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-11-26T07:09:34.879 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-11-26T07:09:35.037 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-11-26T07:09:35.099 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-11-26T07:09:35.301 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-11-26T07:09:35.311 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-11-26T07:09:35.525 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-11-26T07:09:35.531 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-11-26T07:09:35.738 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-11-26T07:09:35.934 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-11-26T07:09:36.674 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-11-26T07:09:36.956 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-11-26T07:09:37.050 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-11-26T07:09:37.184 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-11-26T07:09:37.310 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-11-26T07:09:37.485 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-11-26T07:09:37.547 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-11-26T07:09:37.840 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-11-26T07:09:38.041 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-11-26T07:09:38.113 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-11-26T07:09:38.224 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-11-26T07:09:38.290 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-11-26T07:09:39.144 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-11-26T07:09:39.242 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-11-26T07:09:39.314 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librgw2-2:18.0.0-7484.g44c2237f.el8.x86_64 92/134 2023-11-26T07:09:39.388 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librgw2-2:18.0.0-7484.g44c2237f.el8.x86_64 92/134 2023-11-26T07:09:39.407 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librgw2-2:18.0.0-7484.g44c2237f.el8.x86_64 92/134 2023-11-26T07:09:39.468 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librgw2-2:18.0.0-7484.g44c2237f.el8.x86_64 92/134 2023-11-26T07:09:39.589 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rgw-2:18.0.0-7484.g44c2237f.el8.x86_64 93/134 2023-11-26T07:09:39.650 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rgw-2:18.0.0-7484.g44c2237f.el8.x86_64 93/134 2023-11-26T07:09:43.314 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-common-2:18.0.0-7484.g44c2237f.el8.x86_64 94/134 2023-11-26T07:09:43.572 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-common-2:18.0.0-7484.g44c2237f.el8.x86_64 94/134 2023-11-26T07:09:43.609 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-common-2:18.0.0-7484.g44c2237f.el8.x86_64 94/134 2023-11-26T07:09:43.832 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-common-2:18.0.0-7484.g44c2237f.el8.x86_64 94/134 2023-11-26T07:09:44.168 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-common-2:18.0.0-7484.g44c2237f.el8.x86_64 94/134 2023-11-26T07:09:44.443 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-base-2:18.0.0-7484.g44c2237f.el8.x86_64 95/134 2023-11-26T07:09:44.460 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-common-2:18.0.0-7484.g44c2237f.el8.x86_64 94/134 2023-11-26T07:09:44.518 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-base-2:18.0.0-7484.g44c2237f.el8.x86_64 95/134 2023-11-26T07:09:44.679 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-selinux-2:18.0.0-7484.g44c2237f.el8.x86_64 96/134 2023-11-26T07:09:44.709 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-base-2:18.0.0-7484.g44c2237f.el8.x86_64 95/134 2023-11-26T07:09:44.797 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-base-2:18.0.0-7484.g44c2237f.el8.x86_64 95/134 2023-11-26T07:09:44.948 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-selinux-2:18.0.0-7484.g44c2237f.el8.x86_64 96/134 2023-11-26T07:10:03.415 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7484.g44c2237f.el8.x86_64 96/134 2023-11-26T07:10:03.415 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /sys 2023-11-26T07:10:03.415 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /proc 2023-11-26T07:10:03.415 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /dev 2023-11-26T07:10:03.415 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /run 2023-11-26T07:10:03.415 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /mnt 2023-11-26T07:10:03.415 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /var/tmp 2023-11-26T07:10:03.416 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /home 2023-11-26T07:10:03.416 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /tmp 2023-11-26T07:10:03.416 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /dev 2023-11-26T07:10:03.416 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-26T07:10:03.778 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-volume-2:18.0.0-7484.g44c2237f.el8.noarch 97/134 2023-11-26T07:10:04.546 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7484.g44c2237f.el8.x86_64 96/134 2023-11-26T07:10:04.546 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /sys 2023-11-26T07:10:04.546 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /proc 2023-11-26T07:10:04.546 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /dev 2023-11-26T07:10:04.546 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /run 2023-11-26T07:10:04.546 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /mnt 2023-11-26T07:10:04.546 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /var/tmp 2023-11-26T07:10:04.546 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /home 2023-11-26T07:10:04.546 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /tmp 2023-11-26T07:10:04.546 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /dev 2023-11-26T07:10:04.546 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:10:04.870 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-volume-2:18.0.0-7484.g44c2237f.el8.noarch 97/134 2023-11-26T07:10:05.370 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-volume-2:18.0.0-7484.g44c2237f.el8.noarch 97/134 2023-11-26T07:10:05.565 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-osd-2:18.0.0-7484.g44c2237f.el8.x86_64 98/134 2023-11-26T07:10:05.785 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-osd-2:18.0.0-7484.g44c2237f.el8.x86_64 98/134 2023-11-26T07:10:05.969 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mds-2:18.0.0-7484.g44c2237f.el8.x86_64 99/134 2023-11-26T07:10:06.424 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mds-2:18.0.0-7484.g44c2237f.el8.x86_64 99/134 2023-11-26T07:10:06.566 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-volume-2:18.0.0-7484.g44c2237f.el8.noarch 97/134 2023-11-26T07:10:06.602 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mon-2:18.0.0-7484.g44c2237f.el8.x86_64 100/134 2023-11-26T07:10:06.619 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mon-2:18.0.0-7484.g44c2237f.el8.x86_64 100/134 2023-11-26T07:10:06.714 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-osd-2:18.0.0-7484.g44c2237f.el8.x86_64 98/134 2023-11-26T07:10:06.947 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-osd-2:18.0.0-7484.g44c2237f.el8.x86_64 98/134 2023-11-26T07:10:07.095 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mds-2:18.0.0-7484.g44c2237f.el8.x86_64 99/134 2023-11-26T07:10:07.580 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mds-2:18.0.0-7484.g44c2237f.el8.x86_64 99/134 2023-11-26T07:10:07.803 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mon-2:18.0.0-7484.g44c2237f.el8.x86_64 100/134 2023-11-26T07:10:07.821 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mon-2:18.0.0-7484.g44c2237f.el8.x86_64 100/134 2023-11-26T07:10:08.406 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: cephadm-2:18.0.0-7484.g44c2237f.el8.noarch 101/134 2023-11-26T07:10:08.592 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : cephadm-2:18.0.0-7484.g44c2237f.el8.noarch 101/134 2023-11-26T07:10:08.717 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7484.g44c2237f.e 102/134 2023-11-26T07:10:08.901 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7484.g44c2237f. 103/134 2023-11-26T07:10:09.101 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7484.g44c2237f.el8.noa 104/134 2023-11-26T07:10:09.323 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7484.g44c2237f.el8.noa 104/134 2023-11-26T07:10:09.597 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7484.g44c2237f.el8.n 105/134 2023-11-26T07:10:09.794 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: cephadm-2:18.0.0-7484.g44c2237f.el8.noarch 101/134 2023-11-26T07:10:09.990 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephadm-2:18.0.0-7484.g44c2237f.el8.noarch 101/134 2023-11-26T07:10:10.144 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7484.g44c2237f.e 102/134 2023-11-26T07:10:10.329 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7484.g44c2237f. 103/134 2023-11-26T07:10:10.494 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7484.g44c2237f.el8.noa 104/134 2023-11-26T07:10:10.560 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7484.g44c2237f.el8.n 105/134 2023-11-26T07:10:10.718 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7484.g44c 106/134 2023-11-26T07:10:10.723 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7484.g44c2237f.el8.noa 104/134 2023-11-26T07:10:10.810 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7484.g44c 106/134 2023-11-26T07:10:11.013 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7484.g44c2237f.el8.n 105/134 2023-11-26T07:10:11.164 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7484.g44c2237f.el 107/134 2023-11-26T07:10:11.356 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-2:18.0.0-7484.g44c2237f.el8.x86_64 108/134 2023-11-26T07:10:11.393 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7484.g44c2237f.el8.x86_64 108/134 2023-11-26T07:10:11.601 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-rook-2:18.0.0-7484.g44c2237f.el8.noarch 109/134 2023-11-26T07:10:11.612 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7484.g44c2237f.el8.noarch 109/134 2023-11-26T07:10:12.035 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7484.g44c2237f.el8.n 105/134 2023-11-26T07:10:12.186 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7484.g44c 106/134 2023-11-26T07:10:12.283 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7484.g44c 106/134 2023-11-26T07:10:12.640 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7484.g44c2237f.el 107/134 2023-11-26T07:10:12.830 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-2:18.0.0-7484.g44c2237f.el8.x86_64 108/134 2023-11-26T07:10:12.868 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7484.g44c2237f.el8.x86_64 108/134 2023-11-26T07:10:12.943 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-2:18.0.0-7484.g44c2237f.el8.x86_64 110/134 2023-11-26T07:10:13.077 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-rook-2:18.0.0-7484.g44c2237f.el8.noarch 109/134 2023-11-26T07:10:13.089 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7484.g44c2237f.el8.noarch 109/134 2023-11-26T07:10:13.202 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-radosgw-2:18.0.0-7484.g44c2237f.el8.x86_64 111/134 2023-11-26T07:10:13.237 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7484.g44c2237f.el8.x86_64 111/134 2023-11-26T07:10:13.426 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7484.g44c22 112/134 2023-11-26T07:10:13.478 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7484.g44c22 112/134 2023-11-26T07:10:13.642 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : cephfs-mirror-2:18.0.0-7484.g44c2237f.el8.x86_64 113/134 2023-11-26T07:10:14.001 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7484.g44c2237f.el8.x86_64 113/134 2023-11-26T07:10:14.193 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-mirror-2:18.0.0-7484.g44c2237f.el8.x86_64 114/134 2023-11-26T07:10:14.499 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-2:18.0.0-7484.g44c2237f.el8.x86_64 110/134 2023-11-26T07:10:14.740 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-radosgw-2:18.0.0-7484.g44c2237f.el8.x86_64 111/134 2023-11-26T07:10:14.774 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7484.g44c2237f.el8.x86_64 111/134 2023-11-26T07:10:14.919 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7484.g44c22 112/134 2023-11-26T07:10:14.968 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7484.g44c22 112/134 2023-11-26T07:10:15.110 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephfs-mirror-2:18.0.0-7484.g44c2237f.el8.x86_64 113/134 2023-11-26T07:10:15.493 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7484.g44c2237f.el8.x86_64 113/134 2023-11-26T07:10:15.627 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-mirror-2:18.0.0-7484.g44c2237f.el8.x86_64 114/134 2023-11-26T07:10:18.873 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7484.g44c2237f.el8.x86_64 114/134 2023-11-26T07:10:19.752 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-test-2:18.0.0-7484.g44c2237f.el8.x86_64 115/134 2023-11-26T07:10:20.070 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-11-26T07:10:20.275 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-fuse-2:18.0.0-7484.g44c2237f.el8.x86_64 117/134 2023-11-26T07:10:20.542 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-11-26T07:10:20.621 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7484.g44c2237f.el8.x86_64 114/134 2023-11-26T07:10:20.716 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-11-26T07:10:20.906 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-11-26T07:10:20.915 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-test-2:18.0.0-7484.g44c2237f.el8.x86_64 115/134 2023-11-26T07:10:21.051 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-11-26T07:10:21.145 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-11-26T07:10:21.257 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-11-26T07:10:21.362 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephfs-devel-2:18.0.0-7484.g44c2237f.el8.x86_ 121/134 2023-11-26T07:10:21.517 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-11-26T07:10:22.250 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-11-26T07:10:22.593 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-11-26T07:10:22.766 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-fuse-2:18.0.0-7484.g44c2237f.el8.x86_64 119/134 2023-11-26T07:10:22.963 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-11-26T07:10:23.147 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephfs-devel-2:18.0.0-7484.g44c2237f.el8.x86_ 121/134 2023-11-26T07:10:23.285 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-11-26T07:10:23.783 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-11-26T07:10:24.041 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-11-26T07:10:24.058 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-11-26T07:10:24.339 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : cephfs-top-2:18.0.0-7484.g44c2237f.el8.noarch 124/134 2023-11-26T07:10:24.574 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-fuse-2:18.0.0-7484.g44c2237f.el8.x86_64 125/134 2023-11-26T07:10:24.880 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-nbd-2:18.0.0-7484.g44c2237f.el8.x86_64 126/134 2023-11-26T07:10:25.250 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-11-26T07:10:25.457 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-11-26T07:10:25.539 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-11-26T07:10:25.632 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-11-26T07:10:25.757 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-11-26T07:10:25.769 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-11-26T07:10:25.875 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-11-26T07:10:25.892 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-11-26T07:10:25.940 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-11-26T07:10:25.948 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-11-26T07:10:26.117 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-11-26T07:10:26.118 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-11-26T07:10:26.210 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephfs-top-2:18.0.0-7484.g44c2237f.el8.noarch 124/134 2023-11-26T07:10:26.277 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-11-26T07:10:26.277 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-11-26T07:10:26.409 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-fuse-2:18.0.0-7484.g44c2237f.el8.x86_64 125/134 2023-11-26T07:10:26.521 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-11-26T07:10:26.684 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-nbd-2:18.0.0-7484.g44c2237f.el8.x86_64 126/134 2023-11-26T07:10:26.697 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-11-26T07:10:27.002 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-11-26T07:10:27.150 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-11-26T07:10:27.159 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-11-26T07:10:27.248 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-11-26T07:10:27.249 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-2:18.0.0-7484.g44c2237f.el8.x86_64 1/134 2023-11-26T07:10:27.249 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-base-2:18.0.0-7484.g44c2237f.el8.x86_64 2/134 2023-11-26T07:10:27.249 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-common-2:18.0.0-7484.g44c2237f.el8.x86_64 3/134 2023-11-26T07:10:27.249 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-fuse-2:18.0.0-7484.g44c2237f.el8.x86_64 4/134 2023-11-26T07:10:27.249 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7484.g44c22 5/134 2023-11-26T07:10:27.249 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mds-2:18.0.0-7484.g44c2237f.el8.x86_64 6/134 2023-11-26T07:10:27.249 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-2:18.0.0-7484.g44c2237f.el8.x86_64 7/134 2023-11-26T07:10:27.249 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mon-2:18.0.0-7484.g44c2237f.el8.x86_64 8/134 2023-11-26T07:10:27.249 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-osd-2:18.0.0-7484.g44c2237f.el8.x86_64 9/134 2023-11-26T07:10:27.249 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-radosgw-2:18.0.0-7484.g44c2237f.el8.x86_64 10/134 2023-11-26T07:10:27.249 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-selinux-2:18.0.0-7484.g44c2237f.el8.x86_64 11/134 2023-11-26T07:10:27.250 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-test-2:18.0.0-7484.g44c2237f.el8.x86_64 12/134 2023-11-26T07:10:27.250 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : cephfs-mirror-2:18.0.0-7484.g44c2237f.el8.x86_64 13/134 2023-11-26T07:10:27.250 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephfs-devel-2:18.0.0-7484.g44c2237f.el8.x86_ 14/134 2023-11-26T07:10:27.250 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephfs2-2:18.0.0-7484.g44c2237f.el8.x86_64 15/134 2023-11-26T07:10:27.250 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephsqlite-2:18.0.0-7484.g44c2237f.el8.x86_64 16/134 2023-11-26T07:10:27.250 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados-devel-2:18.0.0-7484.g44c2237f.el8.x86_6 17/134 2023-11-26T07:10:27.250 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libradosstriper1-2:18.0.0-7484.g44c2237f.el8.x86 18/134 2023-11-26T07:10:27.250 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librgw2-2:18.0.0-7484.g44c2237f.el8.x86_64 19/134 2023-11-26T07:10:27.250 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7484.g44c2237f.el 20/134 2023-11-26T07:10:27.250 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-ceph-common-2:18.0.0-7484.g44c2237f.el8. 21/134 2023-11-26T07:10:27.250 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cephfs-2:18.0.0-7484.g44c2237f.el8.x86_6 22/134 2023-11-26T07:10:27.250 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rados-2:18.0.0-7484.g44c2237f.el8.x86_64 23/134 2023-11-26T07:10:27.251 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rbd-2:18.0.0-7484.g44c2237f.el8.x86_64 24/134 2023-11-26T07:10:27.251 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rgw-2:18.0.0-7484.g44c2237f.el8.x86_64 25/134 2023-11-26T07:10:27.260 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-fuse-2:18.0.0-7484.g44c2237f.el8.x86_64 26/134 2023-11-26T07:10:27.260 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-mirror-2:18.0.0-7484.g44c2237f.el8.x86_64 27/134 2023-11-26T07:10:27.260 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-nbd-2:18.0.0-7484.g44c2237f.el8.x86_64 28/134 2023-11-26T07:10:27.260 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7484.g44c2237f. 29/134 2023-11-26T07:10:27.261 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7484.g44c2237f.el8.noa 30/134 2023-11-26T07:10:27.261 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7484.g44c2237f.el8.n 31/134 2023-11-26T07:10:27.261 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7484.g44c 32/134 2023-11-26T07:10:27.261 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7484.g44c2237f.el 33/134 2023-11-26T07:10:27.261 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7484.g44c2237f.el8.noarch 34/134 2023-11-26T07:10:27.261 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7484.g44c2237f.e 35/134 2023-11-26T07:10:27.262 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-volume-2:18.0.0-7484.g44c2237f.el8.noarch 36/134 2023-11-26T07:10:27.262 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : cephadm-2:18.0.0-7484.g44c2237f.el8.noarch 37/134 2023-11-26T07:10:27.262 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : cephfs-top-2:18.0.0-7484.g44c2237f.el8.noarch 38/134 2023-11-26T07:10:27.262 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-11-26T07:10:27.262 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-11-26T07:10:27.262 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-11-26T07:10:27.262 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-11-26T07:10:27.262 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-11-26T07:10:27.262 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-11-26T07:10:27.262 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-11-26T07:10:27.262 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-11-26T07:10:27.262 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-11-26T07:10:27.262 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-11-26T07:10:27.263 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-11-26T07:10:27.263 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-11-26T07:10:27.263 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-11-26T07:10:27.263 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-11-26T07:10:27.263 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-11-26T07:10:27.263 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-11-26T07:10:27.263 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-11-26T07:10:27.263 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-11-26T07:10:27.263 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-11-26T07:10:27.263 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-11-26T07:10:27.263 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-11-26T07:10:27.263 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-11-26T07:10:27.263 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-11-26T07:10:27.263 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-11-26T07:10:27.264 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-11-26T07:10:27.264 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-11-26T07:10:27.264 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-11-26T07:10:27.264 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-11-26T07:10:27.264 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-11-26T07:10:27.264 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-11-26T07:10:27.264 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-11-26T07:10:27.264 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-11-26T07:10:27.264 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-11-26T07:10:27.264 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-11-26T07:10:27.264 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-11-26T07:10:27.264 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-11-26T07:10:27.264 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-11-26T07:10:27.265 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-11-26T07:10:27.265 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-11-26T07:10:27.265 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-11-26T07:10:27.265 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-11-26T07:10:27.265 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-11-26T07:10:27.265 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-11-26T07:10:27.265 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-11-26T07:10:27.265 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-11-26T07:10:27.265 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-11-26T07:10:27.265 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-11-26T07:10:27.265 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-11-26T07:10:27.265 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-11-26T07:10:27.265 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-11-26T07:10:27.266 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-11-26T07:10:27.266 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-11-26T07:10:27.266 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-11-26T07:10:27.266 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-11-26T07:10:27.266 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-11-26T07:10:27.266 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-11-26T07:10:27.266 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-11-26T07:10:27.266 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-11-26T07:10:27.266 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-11-26T07:10:27.266 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-11-26T07:10:27.266 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-11-26T07:10:27.266 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-11-26T07:10:27.266 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-11-26T07:10:27.267 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-11-26T07:10:27.267 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-11-26T07:10:27.267 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-11-26T07:10:27.267 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-11-26T07:10:27.267 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-11-26T07:10:27.267 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-11-26T07:10:27.267 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-11-26T07:10:27.267 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-11-26T07:10:27.267 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-11-26T07:10:27.267 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-11-26T07:10:27.267 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-11-26T07:10:27.267 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-11-26T07:10:27.267 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-11-26T07:10:27.267 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-11-26T07:10:27.268 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-11-26T07:10:27.268 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-11-26T07:10:27.268 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-11-26T07:10:27.268 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-11-26T07:10:27.268 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-11-26T07:10:27.268 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-11-26T07:10:27.268 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-11-26T07:10:27.268 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-11-26T07:10:27.268 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-11-26T07:10:27.268 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-11-26T07:10:27.268 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-11-26T07:10:27.268 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-11-26T07:10:27.268 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-11-26T07:10:27.269 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados2-2:18.0.0-7484.g44c2237f.el8.x86_64 129/134 2023-11-26T07:10:27.269 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-11-26T07:10:27.269 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librbd1-2:18.0.0-7484.g44c2237f.el8.x86_64 131/134 2023-11-26T07:10:27.269 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-11-26T07:10:27.269 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-11-26T07:10:27.338 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-11-26T07:10:27.508 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-11-26T07:10:27.592 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-11-26T07:10:27.842 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-11-26T07:10:27.855 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-11-26T07:10:27.855 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-11-26T07:10:28.062 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-11-26T07:10:28.062 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-11-26T07:10:28.298 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-11-26T07:10:28.491 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-11-26T07:10:29.019 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-11-26T07:10:29.019 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-2:18.0.0-7484.g44c2237f.el8.x86_64 1/134 2023-11-26T07:10:29.019 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-base-2:18.0.0-7484.g44c2237f.el8.x86_64 2/134 2023-11-26T07:10:29.019 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-common-2:18.0.0-7484.g44c2237f.el8.x86_64 3/134 2023-11-26T07:10:29.019 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-fuse-2:18.0.0-7484.g44c2237f.el8.x86_64 4/134 2023-11-26T07:10:29.019 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7484.g44c22 5/134 2023-11-26T07:10:29.019 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mds-2:18.0.0-7484.g44c2237f.el8.x86_64 6/134 2023-11-26T07:10:29.019 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-2:18.0.0-7484.g44c2237f.el8.x86_64 7/134 2023-11-26T07:10:29.019 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mon-2:18.0.0-7484.g44c2237f.el8.x86_64 8/134 2023-11-26T07:10:29.019 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-osd-2:18.0.0-7484.g44c2237f.el8.x86_64 9/134 2023-11-26T07:10:29.020 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-radosgw-2:18.0.0-7484.g44c2237f.el8.x86_64 10/134 2023-11-26T07:10:29.020 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-selinux-2:18.0.0-7484.g44c2237f.el8.x86_64 11/134 2023-11-26T07:10:29.020 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-test-2:18.0.0-7484.g44c2237f.el8.x86_64 12/134 2023-11-26T07:10:29.020 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephfs-mirror-2:18.0.0-7484.g44c2237f.el8.x86_64 13/134 2023-11-26T07:10:29.020 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephfs-devel-2:18.0.0-7484.g44c2237f.el8.x86_ 14/134 2023-11-26T07:10:29.020 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephfs2-2:18.0.0-7484.g44c2237f.el8.x86_64 15/134 2023-11-26T07:10:29.020 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephsqlite-2:18.0.0-7484.g44c2237f.el8.x86_64 16/134 2023-11-26T07:10:29.020 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados-devel-2:18.0.0-7484.g44c2237f.el8.x86_6 17/134 2023-11-26T07:10:29.020 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libradosstriper1-2:18.0.0-7484.g44c2237f.el8.x86 18/134 2023-11-26T07:10:29.020 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librgw2-2:18.0.0-7484.g44c2237f.el8.x86_64 19/134 2023-11-26T07:10:29.020 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7484.g44c2237f.el 20/134 2023-11-26T07:10:29.020 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ceph-common-2:18.0.0-7484.g44c2237f.el8. 21/134 2023-11-26T07:10:29.020 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cephfs-2:18.0.0-7484.g44c2237f.el8.x86_6 22/134 2023-11-26T07:10:29.021 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rados-2:18.0.0-7484.g44c2237f.el8.x86_64 23/134 2023-11-26T07:10:29.021 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rbd-2:18.0.0-7484.g44c2237f.el8.x86_64 24/134 2023-11-26T07:10:29.021 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rgw-2:18.0.0-7484.g44c2237f.el8.x86_64 25/134 2023-11-26T07:10:29.021 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-fuse-2:18.0.0-7484.g44c2237f.el8.x86_64 26/134 2023-11-26T07:10:29.021 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-mirror-2:18.0.0-7484.g44c2237f.el8.x86_64 27/134 2023-11-26T07:10:29.030 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-nbd-2:18.0.0-7484.g44c2237f.el8.x86_64 28/134 2023-11-26T07:10:29.031 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7484.g44c2237f. 29/134 2023-11-26T07:10:29.031 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7484.g44c2237f.el8.noa 30/134 2023-11-26T07:10:29.031 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7484.g44c2237f.el8.n 31/134 2023-11-26T07:10:29.031 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7484.g44c 32/134 2023-11-26T07:10:29.031 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7484.g44c2237f.el 33/134 2023-11-26T07:10:29.031 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7484.g44c2237f.el8.noarch 34/134 2023-11-26T07:10:29.031 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7484.g44c2237f.e 35/134 2023-11-26T07:10:29.031 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-volume-2:18.0.0-7484.g44c2237f.el8.noarch 36/134 2023-11-26T07:10:29.031 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephadm-2:18.0.0-7484.g44c2237f.el8.noarch 37/134 2023-11-26T07:10:29.031 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephfs-top-2:18.0.0-7484.g44c2237f.el8.noarch 38/134 2023-11-26T07:10:29.031 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-11-26T07:10:29.031 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-11-26T07:10:29.032 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-11-26T07:10:29.032 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-11-26T07:10:29.032 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-11-26T07:10:29.032 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-11-26T07:10:29.032 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-11-26T07:10:29.032 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-11-26T07:10:29.032 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-11-26T07:10:29.032 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-11-26T07:10:29.032 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-11-26T07:10:29.032 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-11-26T07:10:29.032 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-11-26T07:10:29.032 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-11-26T07:10:29.032 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-11-26T07:10:29.033 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-11-26T07:10:29.033 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-11-26T07:10:29.033 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-11-26T07:10:29.033 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-11-26T07:10:29.033 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-11-26T07:10:29.033 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-11-26T07:10:29.033 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-11-26T07:10:29.033 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-11-26T07:10:29.033 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-11-26T07:10:29.033 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-11-26T07:10:29.033 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-11-26T07:10:29.033 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-11-26T07:10:29.034 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-11-26T07:10:29.034 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-11-26T07:10:29.034 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-11-26T07:10:29.034 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-11-26T07:10:29.034 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-11-26T07:10:29.034 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-11-26T07:10:29.034 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-11-26T07:10:29.034 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-11-26T07:10:29.034 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-11-26T07:10:29.035 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-11-26T07:10:29.035 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-11-26T07:10:29.035 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-11-26T07:10:29.035 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-11-26T07:10:29.035 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-11-26T07:10:29.035 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-11-26T07:10:29.035 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-11-26T07:10:29.035 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-11-26T07:10:29.035 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-11-26T07:10:29.035 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-11-26T07:10:29.035 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-11-26T07:10:29.035 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-11-26T07:10:29.036 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-11-26T07:10:29.036 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-11-26T07:10:29.036 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-11-26T07:10:29.036 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-11-26T07:10:29.036 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-11-26T07:10:29.036 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-11-26T07:10:29.036 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-11-26T07:10:29.036 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-11-26T07:10:29.036 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-11-26T07:10:29.036 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-11-26T07:10:29.036 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-11-26T07:10:29.036 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-11-26T07:10:29.037 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-11-26T07:10:29.037 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-11-26T07:10:29.037 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-11-26T07:10:29.037 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-11-26T07:10:29.037 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-11-26T07:10:29.037 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-11-26T07:10:29.037 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-11-26T07:10:29.037 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-11-26T07:10:29.037 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-11-26T07:10:29.037 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-11-26T07:10:29.037 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-11-26T07:10:29.037 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-11-26T07:10:29.038 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-11-26T07:10:29.038 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-11-26T07:10:29.038 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-11-26T07:10:29.038 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-11-26T07:10:29.038 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-11-26T07:10:29.038 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-11-26T07:10:29.038 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-11-26T07:10:29.038 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-11-26T07:10:29.038 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-11-26T07:10:29.038 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-11-26T07:10:29.038 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-11-26T07:10:29.039 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-11-26T07:10:29.039 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-11-26T07:10:29.039 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-11-26T07:10:29.039 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-11-26T07:10:29.039 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-11-26T07:10:29.039 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-11-26T07:10:29.039 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-11-26T07:10:29.039 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados2-2:18.0.0-7484.g44c2237f.el8.x86_64 129/134 2023-11-26T07:10:29.039 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-11-26T07:10:29.039 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librbd1-2:18.0.0-7484.g44c2237f.el8.x86_64 131/134 2023-11-26T07:10:29.039 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-11-26T07:10:29.039 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-11-26T07:10:30.081 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-11-26T07:10:30.082 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:02:07 ago on Sun 26 Nov 2023 07:08:23 AM UTC. 2023-11-26T07:10:31.646 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-11-26T07:10:31.646 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:02:09 ago on Sun 26 Nov 2023 07:08:22 AM UTC. 2023-11-26T07:10:32.634 INFO:teuthology.orchestra.run.smithi192.stdout:Installed products updated. 2023-11-26T07:10:32.861 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-26T07:10:32.862 INFO:teuthology.orchestra.run.smithi192.stdout:Upgraded: 2023-11-26T07:10:32.862 INFO:teuthology.orchestra.run.smithi192.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-11-26T07:10:32.862 INFO:teuthology.orchestra.run.smithi192.stdout: librados2-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:32.862 INFO:teuthology.orchestra.run.smithi192.stdout: librbd1-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:32.862 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2023-11-26T07:10:32.862 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-11-26T07:10:32.862 INFO:teuthology.orchestra.run.smithi192.stdout: automake-1.16.1-7.el8.noarch 2023-11-26T07:10:32.862 INFO:teuthology.orchestra.run.smithi192.stdout: bison-3.0.4-10.el8.x86_64 2023-11-26T07:10:32.862 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:32.862 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-base-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:32.862 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-common-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:32.863 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-fuse-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:32.863 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-grafana-dashboards-2:18.0.0-7484.g44c2237f.el8.noarch 2023-11-26T07:10:32.863 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-immutable-object-cache-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:32.863 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mds-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:32.863 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:32.863 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-cephadm-2:18.0.0-7484.g44c2237f.el8.noarch 2023-11-26T07:10:32.863 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-dashboard-2:18.0.0-7484.g44c2237f.el8.noarch 2023-11-26T07:10:32.863 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7484.g44c2237f.el8.noarch 2023-11-26T07:10:32.863 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-modules-core-2:18.0.0-7484.g44c2237f.el8.noarch 2023-11-26T07:10:32.863 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-rook-2:18.0.0-7484.g44c2237f.el8.noarch 2023-11-26T07:10:32.863 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mon-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:32.863 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-osd-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:32.863 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-prometheus-alerts-2:18.0.0-7484.g44c2237f.el8.noarch 2023-11-26T07:10:32.864 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-radosgw-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:32.864 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-selinux-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:32.864 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-test-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:32.864 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-volume-2:18.0.0-7484.g44c2237f.el8.noarch 2023-11-26T07:10:32.864 INFO:teuthology.orchestra.run.smithi192.stdout: cephadm-2:18.0.0-7484.g44c2237f.el8.noarch 2023-11-26T07:10:32.864 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-mirror-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:32.864 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-top-2:18.0.0-7484.g44c2237f.el8.noarch 2023-11-26T07:10:32.864 INFO:teuthology.orchestra.run.smithi192.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-11-26T07:10:32.864 INFO:teuthology.orchestra.run.smithi192.stdout: flex-2.6.1-9.el8.x86_64 2023-11-26T07:10:32.864 INFO:teuthology.orchestra.run.smithi192.stdout: fuse-2.9.7-15.el8.x86_64 2023-11-26T07:10:32.864 INFO:teuthology.orchestra.run.smithi192.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-11-26T07:10:32.864 INFO:teuthology.orchestra.run.smithi192.stdout: jq-1.6-3.el8.x86_64 2023-11-26T07:10:32.864 INFO:teuthology.orchestra.run.smithi192.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-11-26T07:10:32.865 INFO:teuthology.orchestra.run.smithi192.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-11-26T07:10:32.865 INFO:teuthology.orchestra.run.smithi192.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-11-26T07:10:32.865 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs-devel-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:32.865 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs2-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:32.865 INFO:teuthology.orchestra.run.smithi192.stdout: libcephsqlite-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:32.865 INFO:teuthology.orchestra.run.smithi192.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-11-26T07:10:32.865 INFO:teuthology.orchestra.run.smithi192.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-11-26T07:10:32.865 INFO:teuthology.orchestra.run.smithi192.stdout: liboath-2.6.2-3.el8.x86_64 2023-11-26T07:10:32.865 INFO:teuthology.orchestra.run.smithi192.stdout: libpq-13.5-1.el8.x86_64 2023-11-26T07:10:32.865 INFO:teuthology.orchestra.run.smithi192.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-11-26T07:10:32.865 INFO:teuthology.orchestra.run.smithi192.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-11-26T07:10:32.865 INFO:teuthology.orchestra.run.smithi192.stdout: librados-devel-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:32.865 INFO:teuthology.orchestra.run.smithi192.stdout: libradosstriper1-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:32.866 INFO:teuthology.orchestra.run.smithi192.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-11-26T07:10:32.866 INFO:teuthology.orchestra.run.smithi192.stdout: librgw2-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:32.866 INFO:teuthology.orchestra.run.smithi192.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-11-26T07:10:32.866 INFO:teuthology.orchestra.run.smithi192.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-11-26T07:10:32.869 INFO:teuthology.orchestra.run.smithi192.stdout: libtool-2.4.6-25.el8.x86_64 2023-11-26T07:10:32.869 INFO:teuthology.orchestra.run.smithi192.stdout: libunwind-1.3.1-3.el8.x86_64 2023-11-26T07:10:32.869 INFO:teuthology.orchestra.run.smithi192.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-11-26T07:10:32.869 INFO:teuthology.orchestra.run.smithi192.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-11-26T07:10:32.869 INFO:teuthology.orchestra.run.smithi192.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-11-26T07:10:32.869 INFO:teuthology.orchestra.run.smithi192.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-11-26T07:10:32.869 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-0.3.15-3.el8.x86_64 2023-11-26T07:10:32.869 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-11-26T07:10:32.870 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-11-26T07:10:32.870 INFO:teuthology.orchestra.run.smithi192.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-11-26T07:10:32.870 INFO:teuthology.orchestra.run.smithi192.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-11-26T07:10:32.870 INFO:teuthology.orchestra.run.smithi192.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-11-26T07:10:32.870 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-11-26T07:10:32.870 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-11-26T07:10:32.870 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-11-26T07:10:32.870 INFO:teuthology.orchestra.run.smithi192.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-11-26T07:10:32.870 INFO:teuthology.orchestra.run.smithi192.stdout: python3-babel-2.5.1-7.el8.noarch 2023-11-26T07:10:32.870 INFO:teuthology.orchestra.run.smithi192.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-11-26T07:10:32.870 INFO:teuthology.orchestra.run.smithi192.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-11-26T07:10:32.871 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-11-26T07:10:32.871 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-argparse-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:32.871 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-common-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:32.871 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cephfs-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:32.871 INFO:teuthology.orchestra.run.smithi192.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-11-26T07:10:32.871 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-11-26T07:10:32.871 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-11-26T07:10:32.871 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-11-26T07:10:32.871 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-11-26T07:10:32.871 INFO:teuthology.orchestra.run.smithi192.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-11-26T07:10:32.871 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-6.2-6.el8.noarch 2023-11-26T07:10:32.871 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-11-26T07:10:32.871 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-11-26T07:10:32.872 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-11-26T07:10:32.872 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-11-26T07:10:32.872 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-11-26T07:10:32.872 INFO:teuthology.orchestra.run.smithi192.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-11-26T07:10:32.872 INFO:teuthology.orchestra.run.smithi192.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-11-26T07:10:32.872 INFO:teuthology.orchestra.run.smithi192.stdout: python3-mako-1.0.6-13.el8.noarch 2023-11-26T07:10:32.872 INFO:teuthology.orchestra.run.smithi192.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-11-26T07:10:32.872 INFO:teuthology.orchestra.run.smithi192.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-11-26T07:10:32.872 INFO:teuthology.orchestra.run.smithi192.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-11-26T07:10:32.872 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-11-26T07:10:32.872 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-11-26T07:10:32.872 INFO:teuthology.orchestra.run.smithi192.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-11-26T07:10:32.872 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-11-26T07:10:32.873 INFO:teuthology.orchestra.run.smithi192.stdout: python3-portend-2.6-1.el8.noarch 2023-11-26T07:10:32.873 INFO:teuthology.orchestra.run.smithi192.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-11-26T07:10:32.873 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-11-26T07:10:32.873 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-11-26T07:10:32.873 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-11-26T07:10:32.873 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pycparser-2.14-14.el8.noarch 2023-11-26T07:10:32.873 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pytz-2017.2-9.el8.noarch 2023-11-26T07:10:32.873 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rados-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:32.873 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rbd-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:32.873 INFO:teuthology.orchestra.run.smithi192.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-11-26T07:10:32.873 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-11-26T07:10:32.873 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rgw-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:32.873 INFO:teuthology.orchestra.run.smithi192.stdout: python3-routes-2.4.1-12.el8.noarch 2023-11-26T07:10:32.874 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rsa-4.9-2.el8.noarch 2023-11-26T07:10:32.874 INFO:teuthology.orchestra.run.smithi192.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-11-26T07:10:32.874 INFO:teuthology.orchestra.run.smithi192.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-11-26T07:10:32.874 INFO:teuthology.orchestra.run.smithi192.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-11-26T07:10:32.874 INFO:teuthology.orchestra.run.smithi192.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-11-26T07:10:32.874 INFO:teuthology.orchestra.run.smithi192.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-11-26T07:10:32.874 INFO:teuthology.orchestra.run.smithi192.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-11-26T07:10:32.874 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-11-26T07:10:32.874 INFO:teuthology.orchestra.run.smithi192.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-11-26T07:10:32.874 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-11-26T07:10:32.874 INFO:teuthology.orchestra.run.smithi192.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-11-26T07:10:32.874 INFO:teuthology.orchestra.run.smithi192.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-11-26T07:10:32.874 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-fuse-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:32.875 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-mirror-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:32.875 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-nbd-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:32.875 INFO:teuthology.orchestra.run.smithi192.stdout: socat-1.7.4.1-1.el8.x86_64 2023-11-26T07:10:32.875 INFO:teuthology.orchestra.run.smithi192.stdout: thrift-0.13.0-2.el8.x86_64 2023-11-26T07:10:32.875 INFO:teuthology.orchestra.run.smithi192.stdout: uuid-1.6.2-43.el8.x86_64 2023-11-26T07:10:32.875 INFO:teuthology.orchestra.run.smithi192.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-11-26T07:10:32.875 INFO:teuthology.orchestra.run.smithi192.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-11-26T07:10:32.875 INFO:teuthology.orchestra.run.smithi192.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-11-26T07:10:32.876 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-26T07:10:32.876 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-11-26T07:10:33.143 DEBUG:teuthology.parallel:result is None 2023-11-26T07:10:34.329 INFO:teuthology.orchestra.run.smithi002.stdout:Installed products updated. 2023-11-26T07:10:34.597 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:10:34.597 INFO:teuthology.orchestra.run.smithi002.stdout:Upgraded: 2023-11-26T07:10:34.597 INFO:teuthology.orchestra.run.smithi002.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-11-26T07:10:34.597 INFO:teuthology.orchestra.run.smithi002.stdout: librados2-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:34.597 INFO:teuthology.orchestra.run.smithi002.stdout: librbd1-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:34.597 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2023-11-26T07:10:34.597 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-11-26T07:10:34.597 INFO:teuthology.orchestra.run.smithi002.stdout: automake-1.16.1-7.el8.noarch 2023-11-26T07:10:34.598 INFO:teuthology.orchestra.run.smithi002.stdout: bison-3.0.4-10.el8.x86_64 2023-11-26T07:10:34.598 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:34.598 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:34.598 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-common-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:34.598 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-fuse-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:34.598 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-grafana-dashboards-2:18.0.0-7484.g44c2237f.el8.noarch 2023-11-26T07:10:34.598 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-immutable-object-cache-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:34.598 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mds-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:34.598 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:34.598 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-cephadm-2:18.0.0-7484.g44c2237f.el8.noarch 2023-11-26T07:10:34.598 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard-2:18.0.0-7484.g44c2237f.el8.noarch 2023-11-26T07:10:34.598 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7484.g44c2237f.el8.noarch 2023-11-26T07:10:34.599 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-modules-core-2:18.0.0-7484.g44c2237f.el8.noarch 2023-11-26T07:10:34.599 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-rook-2:18.0.0-7484.g44c2237f.el8.noarch 2023-11-26T07:10:34.599 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:34.599 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-osd-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:34.599 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-prometheus-alerts-2:18.0.0-7484.g44c2237f.el8.noarch 2023-11-26T07:10:34.599 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-radosgw-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:34.599 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-selinux-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:34.599 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-test-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:34.599 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-volume-2:18.0.0-7484.g44c2237f.el8.noarch 2023-11-26T07:10:34.599 INFO:teuthology.orchestra.run.smithi002.stdout: cephadm-2:18.0.0-7484.g44c2237f.el8.noarch 2023-11-26T07:10:34.599 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-mirror-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:34.599 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-top-2:18.0.0-7484.g44c2237f.el8.noarch 2023-11-26T07:10:34.599 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-11-26T07:10:34.600 INFO:teuthology.orchestra.run.smithi002.stdout: flex-2.6.1-9.el8.x86_64 2023-11-26T07:10:34.600 INFO:teuthology.orchestra.run.smithi002.stdout: fuse-2.9.7-15.el8.x86_64 2023-11-26T07:10:34.600 INFO:teuthology.orchestra.run.smithi002.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-11-26T07:10:34.600 INFO:teuthology.orchestra.run.smithi002.stdout: jq-1.6-3.el8.x86_64 2023-11-26T07:10:34.600 INFO:teuthology.orchestra.run.smithi002.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-11-26T07:10:34.600 INFO:teuthology.orchestra.run.smithi002.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-11-26T07:10:34.600 INFO:teuthology.orchestra.run.smithi002.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-11-26T07:10:34.600 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs-devel-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:34.600 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs2-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:34.600 INFO:teuthology.orchestra.run.smithi002.stdout: libcephsqlite-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:34.600 INFO:teuthology.orchestra.run.smithi002.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-11-26T07:10:34.600 INFO:teuthology.orchestra.run.smithi002.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-11-26T07:10:34.600 INFO:teuthology.orchestra.run.smithi002.stdout: liboath-2.6.2-3.el8.x86_64 2023-11-26T07:10:34.600 INFO:teuthology.orchestra.run.smithi002.stdout: libpq-13.5-1.el8.x86_64 2023-11-26T07:10:34.601 INFO:teuthology.orchestra.run.smithi002.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-11-26T07:10:34.601 INFO:teuthology.orchestra.run.smithi002.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-11-26T07:10:34.601 INFO:teuthology.orchestra.run.smithi002.stdout: librados-devel-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:34.601 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:34.601 INFO:teuthology.orchestra.run.smithi002.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-11-26T07:10:34.601 INFO:teuthology.orchestra.run.smithi002.stdout: librgw2-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:34.601 INFO:teuthology.orchestra.run.smithi002.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-11-26T07:10:34.601 INFO:teuthology.orchestra.run.smithi002.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-11-26T07:10:34.601 INFO:teuthology.orchestra.run.smithi002.stdout: libtool-2.4.6-25.el8.x86_64 2023-11-26T07:10:34.601 INFO:teuthology.orchestra.run.smithi002.stdout: libunwind-1.3.1-3.el8.x86_64 2023-11-26T07:10:34.601 INFO:teuthology.orchestra.run.smithi002.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-11-26T07:10:34.601 INFO:teuthology.orchestra.run.smithi002.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-11-26T07:10:34.601 INFO:teuthology.orchestra.run.smithi002.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-11-26T07:10:34.601 INFO:teuthology.orchestra.run.smithi002.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-11-26T07:10:34.601 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-0.3.15-3.el8.x86_64 2023-11-26T07:10:34.602 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-11-26T07:10:34.602 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-11-26T07:10:34.602 INFO:teuthology.orchestra.run.smithi002.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-11-26T07:10:34.602 INFO:teuthology.orchestra.run.smithi002.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-11-26T07:10:34.602 INFO:teuthology.orchestra.run.smithi002.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-11-26T07:10:34.602 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-11-26T07:10:34.602 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-11-26T07:10:34.602 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-11-26T07:10:34.602 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-11-26T07:10:34.602 INFO:teuthology.orchestra.run.smithi002.stdout: python3-babel-2.5.1-7.el8.noarch 2023-11-26T07:10:34.602 INFO:teuthology.orchestra.run.smithi002.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-11-26T07:10:34.602 INFO:teuthology.orchestra.run.smithi002.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-11-26T07:10:34.602 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-11-26T07:10:34.603 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:34.603 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-common-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:34.603 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cephfs-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:34.603 INFO:teuthology.orchestra.run.smithi002.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-11-26T07:10:34.603 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-11-26T07:10:34.603 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-11-26T07:10:34.603 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-11-26T07:10:34.603 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-11-26T07:10:34.603 INFO:teuthology.orchestra.run.smithi002.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-11-26T07:10:34.603 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-6.2-6.el8.noarch 2023-11-26T07:10:34.603 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-11-26T07:10:34.604 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-11-26T07:10:34.604 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-11-26T07:10:34.604 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-11-26T07:10:34.604 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-11-26T07:10:34.604 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-11-26T07:10:34.604 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-11-26T07:10:34.604 INFO:teuthology.orchestra.run.smithi002.stdout: python3-mako-1.0.6-13.el8.noarch 2023-11-26T07:10:34.604 INFO:teuthology.orchestra.run.smithi002.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-11-26T07:10:34.604 INFO:teuthology.orchestra.run.smithi002.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-11-26T07:10:34.604 INFO:teuthology.orchestra.run.smithi002.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-11-26T07:10:34.604 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-11-26T07:10:34.604 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-11-26T07:10:34.604 INFO:teuthology.orchestra.run.smithi002.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-11-26T07:10:34.605 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-11-26T07:10:34.605 INFO:teuthology.orchestra.run.smithi002.stdout: python3-portend-2.6-1.el8.noarch 2023-11-26T07:10:34.605 INFO:teuthology.orchestra.run.smithi002.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-11-26T07:10:34.605 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-11-26T07:10:34.605 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-11-26T07:10:34.605 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-11-26T07:10:34.605 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pycparser-2.14-14.el8.noarch 2023-11-26T07:10:34.605 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytz-2017.2-9.el8.noarch 2023-11-26T07:10:34.605 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rados-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:34.605 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rbd-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:34.605 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-11-26T07:10:34.605 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-11-26T07:10:34.605 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rgw-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:34.606 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes-2.4.1-12.el8.noarch 2023-11-26T07:10:34.606 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rsa-4.9-2.el8.noarch 2023-11-26T07:10:34.606 INFO:teuthology.orchestra.run.smithi002.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-11-26T07:10:34.606 INFO:teuthology.orchestra.run.smithi002.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-11-26T07:10:34.606 INFO:teuthology.orchestra.run.smithi002.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-11-26T07:10:34.606 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-11-26T07:10:34.606 INFO:teuthology.orchestra.run.smithi002.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-11-26T07:10:34.606 INFO:teuthology.orchestra.run.smithi002.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-11-26T07:10:34.606 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-11-26T07:10:34.606 INFO:teuthology.orchestra.run.smithi002.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-11-26T07:10:34.606 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-11-26T07:10:34.606 INFO:teuthology.orchestra.run.smithi002.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-11-26T07:10:34.607 INFO:teuthology.orchestra.run.smithi002.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-11-26T07:10:34.607 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-fuse-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:34.607 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-mirror-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:34.607 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-nbd-2:18.0.0-7484.g44c2237f.el8.x86_64 2023-11-26T07:10:34.607 INFO:teuthology.orchestra.run.smithi002.stdout: socat-1.7.4.1-1.el8.x86_64 2023-11-26T07:10:34.607 INFO:teuthology.orchestra.run.smithi002.stdout: thrift-0.13.0-2.el8.x86_64 2023-11-26T07:10:34.607 INFO:teuthology.orchestra.run.smithi002.stdout: uuid-1.6.2-43.el8.x86_64 2023-11-26T07:10:34.607 INFO:teuthology.orchestra.run.smithi002.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-11-26T07:10:34.607 INFO:teuthology.orchestra.run.smithi002.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-11-26T07:10:34.608 INFO:teuthology.orchestra.run.smithi002.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-11-26T07:10:34.608 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:10:34.608 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2023-11-26T07:10:34.880 DEBUG:teuthology.parallel:result is None 2023-11-26T07:10:34.880 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=44c2237fe77713214148c1fd622c872f346f1b99 2023-11-26T07:10:35.100 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-26T07:10:35.123 INFO:teuthology.orchestra.run.smithi002.stdout:18.0.0-7484.g44c2237f.el8 2023-11-26T07:10:35.124 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7484.g44c2237f.el8 2023-11-26T07:10:35.124 INFO:teuthology.task.install:The correct ceph version 18.0.0-7484.g44c2237f is installed. 2023-11-26T07:10:35.124 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=44c2237fe77713214148c1fd622c872f346f1b99 2023-11-26T07:10:35.344 DEBUG:teuthology.orchestra.run.smithi192:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-26T07:10:35.372 INFO:teuthology.orchestra.run.smithi192.stdout:18.0.0-7484.g44c2237f.el8 2023-11-26T07:10:35.373 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7484.g44c2237f.el8 2023-11-26T07:10:35.373 INFO:teuthology.task.install:The correct ceph version 18.0.0-7484.g44c2237f is installed. 2023-11-26T07:10:35.373 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-26T07:10:35.373 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:10:35.373 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-26T07:10:35.417 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:10:35.418 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-26T07:10:35.464 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-26T07:10:35.464 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:10:35.464 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/daemon-helper 2023-11-26T07:10:35.492 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-26T07:10:35.559 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:10:35.559 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/daemon-helper 2023-11-26T07:10:35.589 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-26T07:10:35.657 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-26T07:10:35.658 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:10:35.658 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-26T07:10:35.685 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-26T07:10:35.752 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:10:35.752 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-26T07:10:35.780 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-26T07:10:35.847 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-26T07:10:35.847 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:10:35.848 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/stdin-killer 2023-11-26T07:10:35.874 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-26T07:10:35.941 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:10:35.941 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/stdin-killer 2023-11-26T07:10:35.968 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-26T07:10:36.035 INFO:teuthology.run_tasks:Running task ceph... 2023-11-26T07:10:36.095 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-26T07:10:36.095 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 777 /var/log/ceph 2023-11-26T07:10:36.097 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 777 /var/log/ceph 2023-11-26T07:10:36.124 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-26T07:10:36.124 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-26T07:10:36.165 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-26T07:10:36.191 INFO:tasks.ceph:Creating extra log directories... 2023-11-26T07:10:36.191 DEBUG:teuthology.orchestra.run.smithi002:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-26T07:10:36.232 DEBUG:teuthology.orchestra.run.smithi192:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-26T07:10:36.263 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-26T07:10:36.264 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-26T07:10:36.264 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-26T07:10:36.264 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:10:36.264 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-26T07:10:36.313 DEBUG:teuthology.orchestra.run.smithi002:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-26T07:10:36.457 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-26T07:10:36.484 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:10:36.484 DEBUG:teuthology.orchestra.run.smithi192:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-26T07:10:36.501 DEBUG:teuthology.orchestra.run.smithi192:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-26T07:10:36.635 DEBUG:teuthology.orchestra.run.smithi192:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-26T07:10:36.668 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-26T07:10:36.668 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-26T07:10:36.668 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467341', 'branch': 'rishabh-mgr-vol-misc', 'description': 'fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone}}', 'email': None, 'first_in_suite': False, 'job_id': '7467341', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'rishabh-mgr-vol-misc'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '44c2237fe77713214148c1fd622c872f346f1b99'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '44c2237fe77713214148c1fd622c872f346f1b99'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'rishabh-mgr-vol-misc', 'sha1': '44c2237fe77713214148c1fd622c872f346f1b99'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 1863, 'sha1': '44c2237fe77713214148c1fd622c872f346f1b99', 'sleep_before_teardown': 0, 'suite': 'fs:volumes', 'suite_branch': 'rishabh-mgr-vol-misc', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '44c2237fe77713214148c1fd622c872f346f1b99', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi002.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', 'smithi192.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '44c2237fe77713214148c1fd622c872f346f1b99'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '44c2237fe77713214148c1fd622c872f346f1b99', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '2442239d2653456406c25ae0c71b689c8f2657b6', 'timestamp': '2023-11-26_06:51:12', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-11-26T07:10:36.669 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-26T07:10:36.671 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-26T07:10:36.719 DEBUG:teuthology.orchestra.run.smithi002:> sudo install -d -m0777 -- /var/run/ceph 2023-11-26T07:10:36.728 DEBUG:teuthology.orchestra.run.smithi192:> sudo install -d -m0777 -- /var/run/ceph 2023-11-26T07:10:36.784 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:10:36.784 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/scratch_devs of=/dev/stdout 2023-11-26T07:10:36.810 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-26T07:10:36.810 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_1 2023-11-26T07:10:36.867 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-26T07:10:36.868 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-26T07:10:36.868 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 6h/6d Inode: 383895 Links: 1 2023-11-26T07:10:36.868 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-26T07:10:36.868 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2023-11-26T07:10:36.868 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2023-11-26 07:10:28.705491369 +0000 2023-11-26T07:10:36.868 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2023-11-26 07:07:29.647154323 +0000 2023-11-26T07:10:36.868 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2023-11-26 07:07:29.647154323 +0000 2023-11-26T07:10:36.868 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: - 2023-11-26T07:10:36.868 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-26T07:10:36.933 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:10:36.934 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:10:36.934 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000121537 s, 4.2 MB/s 2023-11-26T07:10:36.935 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-26T07:10:36.993 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_2 2023-11-26T07:10:37.051 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-26T07:10:37.051 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-26T07:10:37.051 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 6h/6d Inode: 388030 Links: 1 2023-11-26T07:10:37.052 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-26T07:10:37.052 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2023-11-26T07:10:37.052 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2023-11-26 07:10:28.705491369 +0000 2023-11-26T07:10:37.052 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2023-11-26 07:07:30.166142202 +0000 2023-11-26T07:10:37.052 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2023-11-26 07:07:30.166142202 +0000 2023-11-26T07:10:37.052 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: - 2023-11-26T07:10:37.052 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-26T07:10:37.116 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:10:37.117 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:10:37.117 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000112296 s, 4.6 MB/s 2023-11-26T07:10:37.118 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-26T07:10:37.175 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_3 2023-11-26T07:10:37.232 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-26T07:10:37.233 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-26T07:10:37.233 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 6h/6d Inode: 395290 Links: 1 2023-11-26T07:10:37.233 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-26T07:10:37.233 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2023-11-26T07:10:37.233 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2023-11-26 07:10:28.705491369 +0000 2023-11-26T07:10:37.233 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2023-11-26 07:07:30.689129986 +0000 2023-11-26T07:10:37.233 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2023-11-26 07:07:30.689129986 +0000 2023-11-26T07:10:37.233 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: - 2023-11-26T07:10:37.233 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-26T07:10:37.298 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:10:37.298 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:10:37.298 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000109151 s, 4.7 MB/s 2023-11-26T07:10:37.299 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-26T07:10:37.357 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_4 2023-11-26T07:10:37.414 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-26T07:10:37.415 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-26T07:10:37.415 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 6h/6d Inode: 389655 Links: 1 2023-11-26T07:10:37.415 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-26T07:10:37.415 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2023-11-26T07:10:37.415 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2023-11-26 07:10:28.705491369 +0000 2023-11-26T07:10:37.415 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2023-11-26 07:07:31.207117888 +0000 2023-11-26T07:10:37.415 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2023-11-26 07:07:31.207117888 +0000 2023-11-26T07:10:37.415 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: - 2023-11-26T07:10:37.415 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-26T07:10:37.480 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:10:37.480 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:10:37.480 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 9.5503e-05 s, 5.4 MB/s 2023-11-26T07:10:37.481 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-26T07:10:37.539 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-26T07:10:37.539 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:10:37.539 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/scratch_devs of=/dev/stdout 2023-11-26T07:10:37.558 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-26T07:10:37.558 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_1 2023-11-26T07:10:37.617 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-26T07:10:37.617 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-26T07:10:37.617 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 6h/6d Inode: 388479 Links: 1 2023-11-26T07:10:37.617 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-26T07:10:37.617 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2023-11-26T07:10:37.617 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2023-11-26 07:10:26.947582085 +0000 2023-11-26T07:10:37.617 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2023-11-26 07:07:19.213594539 +0000 2023-11-26T07:10:37.618 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2023-11-26 07:07:19.213594539 +0000 2023-11-26T07:10:37.618 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: - 2023-11-26T07:10:37.618 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-26T07:10:37.685 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2023-11-26T07:10:37.685 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2023-11-26T07:10:37.685 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000242098 s, 2.1 MB/s 2023-11-26T07:10:37.686 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-26T07:10:37.745 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_2 2023-11-26T07:10:37.804 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-26T07:10:37.804 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-26T07:10:37.804 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 6h/6d Inode: 386929 Links: 1 2023-11-26T07:10:37.804 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-26T07:10:37.804 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2023-11-26T07:10:37.804 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2023-11-26 07:10:26.947582085 +0000 2023-11-26T07:10:37.804 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2023-11-26 07:07:19.706593808 +0000 2023-11-26T07:10:37.804 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2023-11-26 07:07:19.706593808 +0000 2023-11-26T07:10:37.804 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: - 2023-11-26T07:10:37.805 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-26T07:10:37.871 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2023-11-26T07:10:37.871 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2023-11-26T07:10:37.871 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000317438 s, 1.6 MB/s 2023-11-26T07:10:37.872 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-26T07:10:37.931 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_3 2023-11-26T07:10:37.990 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-26T07:10:37.990 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-26T07:10:37.990 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 6h/6d Inode: 383547 Links: 1 2023-11-26T07:10:37.990 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-26T07:10:37.991 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2023-11-26T07:10:37.991 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2023-11-26 07:10:26.947582085 +0000 2023-11-26T07:10:37.991 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2023-11-26 07:07:20.242593012 +0000 2023-11-26T07:10:37.991 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2023-11-26 07:07:20.242593012 +0000 2023-11-26T07:10:37.991 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: - 2023-11-26T07:10:37.992 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-26T07:10:38.056 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2023-11-26T07:10:38.057 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2023-11-26T07:10:38.057 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000217525 s, 2.4 MB/s 2023-11-26T07:10:38.058 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-26T07:10:38.118 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_4 2023-11-26T07:10:38.175 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-26T07:10:38.175 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-26T07:10:38.175 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 6h/6d Inode: 395363 Links: 1 2023-11-26T07:10:38.175 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-26T07:10:38.175 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2023-11-26T07:10:38.175 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2023-11-26 07:10:26.947582085 +0000 2023-11-26T07:10:38.175 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2023-11-26 07:07:20.745592266 +0000 2023-11-26T07:10:38.175 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2023-11-26 07:07:20.745592266 +0000 2023-11-26T07:10:38.176 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: - 2023-11-26T07:10:38.176 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-26T07:10:38.241 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2023-11-26T07:10:38.241 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2023-11-26T07:10:38.241 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.00021448 s, 2.4 MB/s 2023-11-26T07:10:38.242 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-26T07:10:38.300 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-26T07:10:38.300 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi002.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi192.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-26T07:10:38.300 INFO:tasks.ceph:Generating config... 2023-11-26T07:10:38.301 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-26T07:10:38.301 INFO:tasks.ceph:[client] debug client = 20 2023-11-26T07:10:38.301 INFO:tasks.ceph:[client] debug ms = 1 2023-11-26T07:10:38.301 INFO:tasks.ceph:[client] pid file = 2023-11-26T07:10:38.301 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-26T07:10:38.301 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-26T07:10:38.302 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-11-26T07:10:38.302 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-26T07:10:38.302 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-26T07:10:38.302 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-26T07:10:38.302 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-26T07:10:38.302 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-26T07:10:38.302 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-26T07:10:38.302 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-26T07:10:38.302 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-26T07:10:38.302 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-26T07:10:38.302 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-26T07:10:38.302 INFO:tasks.ceph:[mgr] debug client = 20 2023-11-26T07:10:38.303 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-11-26T07:10:38.303 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-26T07:10:38.303 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-26T07:10:38.303 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-26T07:10:38.303 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-26T07:10:38.303 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-26T07:10:38.303 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-26T07:10:38.303 INFO:tasks.ceph:[osd] bdev async discard = True 2023-11-26T07:10:38.303 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-11-26T07:10:38.303 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-11-26T07:10:38.303 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-26T07:10:38.303 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-26T07:10:38.303 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-11-26T07:10:38.303 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-11-26T07:10:38.304 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-26T07:10:38.304 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-26T07:10:38.304 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-11-26T07:10:38.304 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-26T07:10:38.304 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-26T07:10:38.304 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-26T07:10:38.304 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-26T07:10:38.304 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-26T07:10:38.304 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-26T07:10:38.304 INFO:tasks.ceph:Setting up mon.a... 2023-11-26T07:10:38.304 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-26T07:10:38.369 INFO:teuthology.orchestra.run.smithi002.stdout:creating /etc/ceph/ceph.keyring 2023-11-26T07:10:38.372 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-26T07:10:38.423 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-26T07:10:38.451 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.2'), ('mon.b', '172.21.15.192'), ('mon.c', '[v2:172.21.15.192:3301,v1:172.21.15.192:6790]')] 2023-11-26T07:10:38.451 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.2,172.21.15.192,[v2:172.21.15.192:3301,v1:172.21.15.192:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-26T07:10:38.452 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:10:38.452 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-26T07:10:38.509 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.2 --add b 172.21.15.192 --addv c '[v2:172.21.15.192:3301,v1:172.21.15.192:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-26T07:10:38.598 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-26T07:10:38.598 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool: generated fsid cb9817c7-f1ed-4745-9395-2760a3bb9712 2023-11-26T07:10:38.598 INFO:teuthology.orchestra.run.smithi002.stdout:setting min_mon_release = pacific 2023-11-26T07:10:38.598 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 0 2023-11-26T07:10:38.599 INFO:teuthology.orchestra.run.smithi002.stdout:fsid cb9817c7-f1ed-4745-9395-2760a3bb9712 2023-11-26T07:10:38.599 INFO:teuthology.orchestra.run.smithi002.stdout:last_changed 2023-11-26T07:10:38.597735+0000 2023-11-26T07:10:38.599 INFO:teuthology.orchestra.run.smithi002.stdout:created 2023-11-26T07:10:38.597735+0000 2023-11-26T07:10:38.599 INFO:teuthology.orchestra.run.smithi002.stdout:min_mon_release 16 (pacific) 2023-11-26T07:10:38.599 INFO:teuthology.orchestra.run.smithi002.stdout:election_strategy: 1 2023-11-26T07:10:38.599 INFO:teuthology.orchestra.run.smithi002.stdout:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2023-11-26T07:10:38.599 INFO:teuthology.orchestra.run.smithi002.stdout:1: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.b 2023-11-26T07:10:38.599 INFO:teuthology.orchestra.run.smithi002.stdout:2: [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] mon.c 2023-11-26T07:10:38.599 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-26T07:10:38.600 DEBUG:teuthology.orchestra.run.smithi002:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-26T07:10:38.617 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID cb9817c7-f1ed-4745-9395-2760a3bb9712... 2023-11-26T07:10:38.618 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-26T07:10:38.660 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-26T07:10:38.704 INFO:teuthology.orchestra.run.smithi002.stdout:[global] 2023-11-26T07:10:38.704 INFO:teuthology.orchestra.run.smithi002.stdout: chdir = "" 2023-11-26T07:10:38.704 INFO:teuthology.orchestra.run.smithi002.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-26T07:10:38.704 INFO:teuthology.orchestra.run.smithi002.stdout: auth supported = cephx 2023-11-26T07:10:38.704 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:10:38.704 INFO:teuthology.orchestra.run.smithi002.stdout: filestore xattr use omap = true 2023-11-26T07:10:38.705 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:10:38.705 INFO:teuthology.orchestra.run.smithi002.stdout: mon clock drift allowed = 1.000 2023-11-26T07:10:38.705 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:10:38.705 INFO:teuthology.orchestra.run.smithi002.stdout: osd crush chooseleaf type = 0 2023-11-26T07:10:38.705 INFO:teuthology.orchestra.run.smithi002.stdout: auth debug = true 2023-11-26T07:10:38.705 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:10:38.706 INFO:teuthology.orchestra.run.smithi002.stdout: ms die on old message = true 2023-11-26T07:10:38.706 INFO:teuthology.orchestra.run.smithi002.stdout: ms die on bug = true 2023-11-26T07:10:38.706 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:10:38.706 INFO:teuthology.orchestra.run.smithi002.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-26T07:10:38.706 INFO:teuthology.orchestra.run.smithi002.stdout: mon pg warn max object skew = 0 2023-11-26T07:10:38.706 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:10:38.706 INFO:teuthology.orchestra.run.smithi002.stdout: # disable pg_autoscaler by default for new pools 2023-11-26T07:10:38.707 INFO:teuthology.orchestra.run.smithi002.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-26T07:10:38.707 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:10:38.707 INFO:teuthology.orchestra.run.smithi002.stdout: osd pool default size = 2 2023-11-26T07:10:38.707 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:10:38.707 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd allow primary affinity = true 2023-11-26T07:10:38.707 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd allow pg remap = true 2023-11-26T07:10:38.707 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on legacy crush tunables = false 2023-11-26T07:10:38.708 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on crush straw calc version zero = false 2023-11-26T07:10:38.708 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on no sortbitwise = false 2023-11-26T07:10:38.708 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on osd down out interval zero = false 2023-11-26T07:10:38.708 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on too few osds = false 2023-11-26T07:10:38.708 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-26T07:10:38.708 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-26T07:10:38.708 INFO:teuthology.orchestra.run.smithi002.stdout: mon_allow_pool_size_one = true 2023-11-26T07:10:38.709 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:10:38.709 INFO:teuthology.orchestra.run.smithi002.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-26T07:10:38.709 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:10:38.709 INFO:teuthology.orchestra.run.smithi002.stdout: osd default data pool replay window = 5 2023-11-26T07:10:38.709 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:10:38.709 INFO:teuthology.orchestra.run.smithi002.stdout: mon allow pool delete = true 2023-11-26T07:10:38.709 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:10:38.709 INFO:teuthology.orchestra.run.smithi002.stdout: mon cluster log file level = debug 2023-11-26T07:10:38.710 INFO:teuthology.orchestra.run.smithi002.stdout: debug asserts on shutdown = true 2023-11-26T07:10:38.710 INFO:teuthology.orchestra.run.smithi002.stdout: mon health detail to clog = false 2023-11-26T07:10:38.710 INFO:teuthology.orchestra.run.smithi002.stdout: mon host = "172.21.15.2,172.21.15.192,[v2:172.21.15.192:3301,v1:172.21.15.192:6790]" 2023-11-26T07:10:38.710 INFO:teuthology.orchestra.run.smithi002.stdout: ms die on skipped message = False 2023-11-26T07:10:38.710 INFO:teuthology.orchestra.run.smithi002.stdout: fsid = cb9817c7-f1ed-4745-9395-2760a3bb9712 2023-11-26T07:10:38.710 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:10:38.711 INFO:teuthology.orchestra.run.smithi002.stdout:[osd] 2023-11-26T07:10:38.711 INFO:teuthology.orchestra.run.smithi002.stdout: osd journal size = 100 2023-11-26T07:10:38.711 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:10:38.711 INFO:teuthology.orchestra.run.smithi002.stdout: osd scrub load threshold = 5.0 2023-11-26T07:10:38.711 INFO:teuthology.orchestra.run.smithi002.stdout: osd scrub max interval = 600 2023-11-26T07:10:38.711 INFO:teuthology.orchestra.run.smithi002.stdout: osd mclock profile = high_recovery_ops 2023-11-26T07:10:38.711 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:10:38.712 INFO:teuthology.orchestra.run.smithi002.stdout: osd recover clone overlap = true 2023-11-26T07:10:38.712 INFO:teuthology.orchestra.run.smithi002.stdout: osd recovery max chunk = 1048576 2023-11-26T07:10:38.712 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:10:38.712 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug shutdown = true 2023-11-26T07:10:38.712 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug op order = true 2023-11-26T07:10:38.712 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug verify stray on activate = true 2023-11-26T07:10:38.712 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug trim objects = true 2023-11-26T07:10:38.713 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:10:38.713 INFO:teuthology.orchestra.run.smithi002.stdout: osd open classes on start = true 2023-11-26T07:10:38.713 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug pg log writeout = true 2023-11-26T07:10:38.713 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:10:38.713 INFO:teuthology.orchestra.run.smithi002.stdout: osd deep scrub update digest min age = 30 2023-11-26T07:10:38.713 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:10:38.713 INFO:teuthology.orchestra.run.smithi002.stdout: osd map max advance = 10 2023-11-26T07:10:38.714 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:10:38.714 INFO:teuthology.orchestra.run.smithi002.stdout: journal zero on create = true 2023-11-26T07:10:38.714 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:10:38.714 INFO:teuthology.orchestra.run.smithi002.stdout: filestore ondisk finisher threads = 3 2023-11-26T07:10:38.714 INFO:teuthology.orchestra.run.smithi002.stdout: filestore apply finisher threads = 3 2023-11-26T07:10:38.714 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:10:38.714 INFO:teuthology.orchestra.run.smithi002.stdout: bdev debug aio = true 2023-11-26T07:10:38.715 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug misdirected ops = true 2023-11-26T07:10:38.715 INFO:teuthology.orchestra.run.smithi002.stdout: bdev async discard = True 2023-11-26T07:10:38.715 INFO:teuthology.orchestra.run.smithi002.stdout: bdev enable discard = True 2023-11-26T07:10:38.715 INFO:teuthology.orchestra.run.smithi002.stdout: bluestore allocator = bitmap 2023-11-26T07:10:38.716 INFO:teuthology.orchestra.run.smithi002.stdout: bluestore block size = 96636764160 2023-11-26T07:10:38.716 INFO:teuthology.orchestra.run.smithi002.stdout: bluestore fsck on mount = True 2023-11-26T07:10:38.716 INFO:teuthology.orchestra.run.smithi002.stdout: debug bluefs = 1/20 2023-11-26T07:10:38.716 INFO:teuthology.orchestra.run.smithi002.stdout: debug bluestore = 1/20 2023-11-26T07:10:38.716 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2023-11-26T07:10:38.716 INFO:teuthology.orchestra.run.smithi002.stdout: debug osd = 20 2023-11-26T07:10:38.716 INFO:teuthology.orchestra.run.smithi002.stdout: debug rocksdb = 4/10 2023-11-26T07:10:38.717 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd backfillfull_ratio = 0.85 2023-11-26T07:10:38.717 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd full ratio = 0.9 2023-11-26T07:10:38.717 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd nearfull ratio = 0.8 2023-11-26T07:10:38.717 INFO:teuthology.orchestra.run.smithi002.stdout: osd failsafe full ratio = 0.95 2023-11-26T07:10:38.717 INFO:teuthology.orchestra.run.smithi002.stdout: osd objectstore = bluestore 2023-11-26T07:10:38.717 INFO:teuthology.orchestra.run.smithi002.stdout: osd op complaint time = 180 2023-11-26T07:10:38.717 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:10:38.718 INFO:teuthology.orchestra.run.smithi002.stdout:[mgr] 2023-11-26T07:10:38.718 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2023-11-26T07:10:38.718 INFO:teuthology.orchestra.run.smithi002.stdout: debug mgr = 20 2023-11-26T07:10:38.718 INFO:teuthology.orchestra.run.smithi002.stdout: debug mon = 20 2023-11-26T07:10:38.718 INFO:teuthology.orchestra.run.smithi002.stdout: debug auth = 20 2023-11-26T07:10:38.718 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min pgs per osd = 4 2023-11-26T07:10:38.719 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min bytes per osd = 10 2023-11-26T07:10:38.719 INFO:teuthology.orchestra.run.smithi002.stdout: mgr/telemetry/nag = false 2023-11-26T07:10:38.719 INFO:teuthology.orchestra.run.smithi002.stdout: debug client = 20 2023-11-26T07:10:38.719 INFO:teuthology.orchestra.run.smithi002.stdout: debug finisher = 20 2023-11-26T07:10:38.719 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:10:38.719 INFO:teuthology.orchestra.run.smithi002.stdout:[mon] 2023-11-26T07:10:38.719 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2023-11-26T07:10:38.720 INFO:teuthology.orchestra.run.smithi002.stdout: debug mon = 20 2023-11-26T07:10:38.720 INFO:teuthology.orchestra.run.smithi002.stdout: debug paxos = 20 2023-11-26T07:10:38.720 INFO:teuthology.orchestra.run.smithi002.stdout: debug auth = 20 2023-11-26T07:10:38.720 INFO:teuthology.orchestra.run.smithi002.stdout: mon data avail warn = 5 2023-11-26T07:10:38.720 INFO:teuthology.orchestra.run.smithi002.stdout: mon mgr mkfs grace = 240 2023-11-26T07:10:38.720 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min pgs per osd = 4 2023-11-26T07:10:38.720 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd reporter subtree level = osd 2023-11-26T07:10:38.721 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd prime pg temp = true 2023-11-26T07:10:38.721 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min bytes per osd = 10 2023-11-26T07:10:38.721 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:10:38.721 INFO:teuthology.orchestra.run.smithi002.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-26T07:10:38.721 INFO:teuthology.orchestra.run.smithi002.stdout: auth mon ticket ttl = 660 # 11m 2023-11-26T07:10:38.721 INFO:teuthology.orchestra.run.smithi002.stdout: auth service ticket ttl = 240 # 4m 2023-11-26T07:10:38.721 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:10:38.722 INFO:teuthology.orchestra.run.smithi002.stdout: # don't complain about insecure global_id in the test suite 2023-11-26T07:10:38.722 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-26T07:10:38.722 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-26T07:10:38.722 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:10:38.722 INFO:teuthology.orchestra.run.smithi002.stdout: # 1m isn't quite enough 2023-11-26T07:10:38.722 INFO:teuthology.orchestra.run.smithi002.stdout: mon_down_mkfs_grace = 2m 2023-11-26T07:10:38.722 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:10:38.723 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_filestore_osds = false 2023-11-26T07:10:38.723 INFO:teuthology.orchestra.run.smithi002.stdout: mon op complaint time = 120 2023-11-26T07:10:38.723 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:10:38.723 INFO:teuthology.orchestra.run.smithi002.stdout:[client] 2023-11-26T07:10:38.723 INFO:teuthology.orchestra.run.smithi002.stdout: rgw cache enabled = true 2023-11-26T07:10:38.723 INFO:teuthology.orchestra.run.smithi002.stdout: rgw enable ops log = true 2023-11-26T07:10:38.723 INFO:teuthology.orchestra.run.smithi002.stdout: rgw enable usage log = true 2023-11-26T07:10:38.723 INFO:teuthology.orchestra.run.smithi002.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-26T07:10:38.723 INFO:teuthology.orchestra.run.smithi002.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-26T07:10:38.723 INFO:teuthology.orchestra.run.smithi002.stdout: client mount timeout = 600 2023-11-26T07:10:38.723 INFO:teuthology.orchestra.run.smithi002.stdout: debug client = 20 2023-11-26T07:10:38.723 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2023-11-26T07:10:38.723 INFO:teuthology.orchestra.run.smithi002.stdout: pid file = "" 2023-11-26T07:10:38.723 INFO:teuthology.orchestra.run.smithi002.stdout: rados mon op timeout = 900 2023-11-26T07:10:38.724 INFO:teuthology.orchestra.run.smithi002.stdout: rados osd op timeout = 900 2023-11-26T07:10:38.724 INFO:teuthology.orchestra.run.smithi002.stdout:[mon.a] 2023-11-26T07:10:38.724 INFO:teuthology.orchestra.run.smithi002.stdout:[mon.b] 2023-11-26T07:10:38.724 INFO:teuthology.orchestra.run.smithi002.stdout:[mon.c] 2023-11-26T07:10:38.724 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.a] 2023-11-26T07:10:38.724 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.c] 2023-11-26T07:10:38.724 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.b] 2023-11-26T07:10:38.724 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.d] 2023-11-26T07:10:38.724 INFO:teuthology.orchestra.run.smithi002.stdout:[mds] 2023-11-26T07:10:38.724 INFO:teuthology.orchestra.run.smithi002.stdout: debug mds = 20 2023-11-26T07:10:38.724 INFO:teuthology.orchestra.run.smithi002.stdout: debug mds balancer = 20 2023-11-26T07:10:38.724 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2023-11-26T07:10:38.724 INFO:teuthology.orchestra.run.smithi002.stdout: mds debug frag = True 2023-11-26T07:10:38.724 INFO:teuthology.orchestra.run.smithi002.stdout: mds debug scatterstat = True 2023-11-26T07:10:38.725 INFO:teuthology.orchestra.run.smithi002.stdout: mds op complaint time = 180 2023-11-26T07:10:38.725 INFO:teuthology.orchestra.run.smithi002.stdout: mds verify scatter = True 2023-11-26T07:10:38.725 INFO:teuthology.orchestra.run.smithi002.stdout: osd op complaint time = 180 2023-11-26T07:10:38.725 INFO:teuthology.orchestra.run.smithi002.stdout: rados mon op timeout = 900 2023-11-26T07:10:38.725 INFO:teuthology.orchestra.run.smithi002.stdout: rados osd op timeout = 900 2023-11-26T07:10:38.727 INFO:teuthology.orchestra.run.smithi192.stdout:[global] 2023-11-26T07:10:38.727 INFO:teuthology.orchestra.run.smithi192.stdout: chdir = "" 2023-11-26T07:10:38.727 INFO:teuthology.orchestra.run.smithi192.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-26T07:10:38.727 INFO:teuthology.orchestra.run.smithi192.stdout: auth supported = cephx 2023-11-26T07:10:38.727 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-26T07:10:38.727 INFO:teuthology.orchestra.run.smithi192.stdout: filestore xattr use omap = true 2023-11-26T07:10:38.727 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-26T07:10:38.727 INFO:teuthology.orchestra.run.smithi192.stdout: mon clock drift allowed = 1.000 2023-11-26T07:10:38.727 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-26T07:10:38.727 INFO:teuthology.orchestra.run.smithi192.stdout: osd crush chooseleaf type = 0 2023-11-26T07:10:38.727 INFO:teuthology.orchestra.run.smithi192.stdout: auth debug = true 2023-11-26T07:10:38.727 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-26T07:10:38.728 INFO:teuthology.orchestra.run.smithi192.stdout: ms die on old message = true 2023-11-26T07:10:38.728 INFO:teuthology.orchestra.run.smithi192.stdout: ms die on bug = true 2023-11-26T07:10:38.728 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-26T07:10:38.728 INFO:teuthology.orchestra.run.smithi192.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-26T07:10:38.728 INFO:teuthology.orchestra.run.smithi192.stdout: mon pg warn max object skew = 0 2023-11-26T07:10:38.728 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-26T07:10:38.728 INFO:teuthology.orchestra.run.smithi192.stdout: # disable pg_autoscaler by default for new pools 2023-11-26T07:10:38.728 INFO:teuthology.orchestra.run.smithi192.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-26T07:10:38.728 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-26T07:10:38.728 INFO:teuthology.orchestra.run.smithi192.stdout: osd pool default size = 2 2023-11-26T07:10:38.728 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-26T07:10:38.728 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd allow primary affinity = true 2023-11-26T07:10:38.728 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd allow pg remap = true 2023-11-26T07:10:38.728 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on legacy crush tunables = false 2023-11-26T07:10:38.728 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on crush straw calc version zero = false 2023-11-26T07:10:38.729 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on no sortbitwise = false 2023-11-26T07:10:38.729 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on osd down out interval zero = false 2023-11-26T07:10:38.729 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on too few osds = false 2023-11-26T07:10:38.729 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-26T07:10:38.729 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-26T07:10:38.729 INFO:teuthology.orchestra.run.smithi192.stdout: mon_allow_pool_size_one = true 2023-11-26T07:10:38.729 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-26T07:10:38.729 INFO:teuthology.orchestra.run.smithi192.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-26T07:10:38.729 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-26T07:10:38.729 INFO:teuthology.orchestra.run.smithi192.stdout: osd default data pool replay window = 5 2023-11-26T07:10:38.729 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-26T07:10:38.729 INFO:teuthology.orchestra.run.smithi192.stdout: mon allow pool delete = true 2023-11-26T07:10:38.729 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-26T07:10:38.729 INFO:teuthology.orchestra.run.smithi192.stdout: mon cluster log file level = debug 2023-11-26T07:10:38.729 INFO:teuthology.orchestra.run.smithi192.stdout: debug asserts on shutdown = true 2023-11-26T07:10:38.730 INFO:teuthology.orchestra.run.smithi192.stdout: mon health detail to clog = false 2023-11-26T07:10:38.730 INFO:teuthology.orchestra.run.smithi192.stdout: mon host = "172.21.15.2,172.21.15.192,[v2:172.21.15.192:3301,v1:172.21.15.192:6790]" 2023-11-26T07:10:38.730 INFO:teuthology.orchestra.run.smithi192.stdout: ms die on skipped message = False 2023-11-26T07:10:38.730 INFO:teuthology.orchestra.run.smithi192.stdout: fsid = cb9817c7-f1ed-4745-9395-2760a3bb9712 2023-11-26T07:10:38.730 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-26T07:10:38.730 INFO:teuthology.orchestra.run.smithi192.stdout:[osd] 2023-11-26T07:10:38.730 INFO:teuthology.orchestra.run.smithi192.stdout: osd journal size = 100 2023-11-26T07:10:38.730 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-26T07:10:38.730 INFO:teuthology.orchestra.run.smithi192.stdout: osd scrub load threshold = 5.0 2023-11-26T07:10:38.730 INFO:teuthology.orchestra.run.smithi192.stdout: osd scrub max interval = 600 2023-11-26T07:10:38.730 INFO:teuthology.orchestra.run.smithi192.stdout: osd mclock profile = high_recovery_ops 2023-11-26T07:10:38.730 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-26T07:10:38.730 INFO:teuthology.orchestra.run.smithi192.stdout: osd recover clone overlap = true 2023-11-26T07:10:38.730 INFO:teuthology.orchestra.run.smithi192.stdout: osd recovery max chunk = 1048576 2023-11-26T07:10:38.730 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-26T07:10:38.731 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug shutdown = true 2023-11-26T07:10:38.731 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug op order = true 2023-11-26T07:10:38.731 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug verify stray on activate = true 2023-11-26T07:10:38.731 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug trim objects = true 2023-11-26T07:10:38.731 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-26T07:10:38.731 INFO:teuthology.orchestra.run.smithi192.stdout: osd open classes on start = true 2023-11-26T07:10:38.731 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug pg log writeout = true 2023-11-26T07:10:38.731 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-26T07:10:38.731 INFO:teuthology.orchestra.run.smithi192.stdout: osd deep scrub update digest min age = 30 2023-11-26T07:10:38.731 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-26T07:10:38.731 INFO:teuthology.orchestra.run.smithi192.stdout: osd map max advance = 10 2023-11-26T07:10:38.732 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-26T07:10:38.732 INFO:teuthology.orchestra.run.smithi192.stdout: journal zero on create = true 2023-11-26T07:10:38.732 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-26T07:10:38.732 INFO:teuthology.orchestra.run.smithi192.stdout: filestore ondisk finisher threads = 3 2023-11-26T07:10:38.732 INFO:teuthology.orchestra.run.smithi192.stdout: filestore apply finisher threads = 3 2023-11-26T07:10:38.732 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-26T07:10:38.732 INFO:teuthology.orchestra.run.smithi192.stdout: bdev debug aio = true 2023-11-26T07:10:38.732 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug misdirected ops = true 2023-11-26T07:10:38.732 INFO:teuthology.orchestra.run.smithi192.stdout: bdev async discard = True 2023-11-26T07:10:38.732 INFO:teuthology.orchestra.run.smithi192.stdout: bdev enable discard = True 2023-11-26T07:10:38.732 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore allocator = bitmap 2023-11-26T07:10:38.732 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore block size = 96636764160 2023-11-26T07:10:38.733 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore fsck on mount = True 2023-11-26T07:10:38.733 INFO:teuthology.orchestra.run.smithi192.stdout: debug bluefs = 1/20 2023-11-26T07:10:38.733 INFO:teuthology.orchestra.run.smithi192.stdout: debug bluestore = 1/20 2023-11-26T07:10:38.733 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2023-11-26T07:10:38.733 INFO:teuthology.orchestra.run.smithi192.stdout: debug osd = 20 2023-11-26T07:10:38.733 INFO:teuthology.orchestra.run.smithi192.stdout: debug rocksdb = 4/10 2023-11-26T07:10:38.733 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd backfillfull_ratio = 0.85 2023-11-26T07:10:38.733 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd full ratio = 0.9 2023-11-26T07:10:38.733 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd nearfull ratio = 0.8 2023-11-26T07:10:38.733 INFO:teuthology.orchestra.run.smithi192.stdout: osd failsafe full ratio = 0.95 2023-11-26T07:10:38.733 INFO:teuthology.orchestra.run.smithi192.stdout: osd objectstore = bluestore 2023-11-26T07:10:38.733 INFO:teuthology.orchestra.run.smithi192.stdout: osd op complaint time = 180 2023-11-26T07:10:38.733 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-26T07:10:38.733 INFO:teuthology.orchestra.run.smithi192.stdout:[mgr] 2023-11-26T07:10:38.734 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2023-11-26T07:10:38.734 INFO:teuthology.orchestra.run.smithi192.stdout: debug mgr = 20 2023-11-26T07:10:38.734 INFO:teuthology.orchestra.run.smithi192.stdout: debug mon = 20 2023-11-26T07:10:38.734 INFO:teuthology.orchestra.run.smithi192.stdout: debug auth = 20 2023-11-26T07:10:38.734 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min pgs per osd = 4 2023-11-26T07:10:38.734 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min bytes per osd = 10 2023-11-26T07:10:38.734 INFO:teuthology.orchestra.run.smithi192.stdout: mgr/telemetry/nag = false 2023-11-26T07:10:38.734 INFO:teuthology.orchestra.run.smithi192.stdout: debug client = 20 2023-11-26T07:10:38.734 INFO:teuthology.orchestra.run.smithi192.stdout: debug finisher = 20 2023-11-26T07:10:38.734 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-26T07:10:38.734 INFO:teuthology.orchestra.run.smithi192.stdout:[mon] 2023-11-26T07:10:38.734 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2023-11-26T07:10:38.734 INFO:teuthology.orchestra.run.smithi192.stdout: debug mon = 20 2023-11-26T07:10:38.734 INFO:teuthology.orchestra.run.smithi192.stdout: debug paxos = 20 2023-11-26T07:10:38.734 INFO:teuthology.orchestra.run.smithi192.stdout: debug auth = 20 2023-11-26T07:10:38.735 INFO:teuthology.orchestra.run.smithi192.stdout: mon data avail warn = 5 2023-11-26T07:10:38.735 INFO:teuthology.orchestra.run.smithi192.stdout: mon mgr mkfs grace = 240 2023-11-26T07:10:38.735 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min pgs per osd = 4 2023-11-26T07:10:38.735 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd reporter subtree level = osd 2023-11-26T07:10:38.735 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd prime pg temp = true 2023-11-26T07:10:38.735 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min bytes per osd = 10 2023-11-26T07:10:38.735 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-26T07:10:38.735 INFO:teuthology.orchestra.run.smithi192.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-26T07:10:38.735 INFO:teuthology.orchestra.run.smithi192.stdout: auth mon ticket ttl = 660 # 11m 2023-11-26T07:10:38.735 INFO:teuthology.orchestra.run.smithi192.stdout: auth service ticket ttl = 240 # 4m 2023-11-26T07:10:38.735 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-26T07:10:38.735 INFO:teuthology.orchestra.run.smithi192.stdout: # don't complain about insecure global_id in the test suite 2023-11-26T07:10:38.735 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-26T07:10:38.735 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-26T07:10:38.735 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-26T07:10:38.736 INFO:teuthology.orchestra.run.smithi192.stdout: # 1m isn't quite enough 2023-11-26T07:10:38.736 INFO:teuthology.orchestra.run.smithi192.stdout: mon_down_mkfs_grace = 2m 2023-11-26T07:10:38.736 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-26T07:10:38.736 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_filestore_osds = false 2023-11-26T07:10:38.736 INFO:teuthology.orchestra.run.smithi192.stdout: mon op complaint time = 120 2023-11-26T07:10:38.736 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-11-26T07:10:38.736 INFO:teuthology.orchestra.run.smithi192.stdout:[client] 2023-11-26T07:10:38.736 INFO:teuthology.orchestra.run.smithi192.stdout: rgw cache enabled = true 2023-11-26T07:10:38.736 INFO:teuthology.orchestra.run.smithi192.stdout: rgw enable ops log = true 2023-11-26T07:10:38.736 INFO:teuthology.orchestra.run.smithi192.stdout: rgw enable usage log = true 2023-11-26T07:10:38.736 INFO:teuthology.orchestra.run.smithi192.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-26T07:10:38.736 INFO:teuthology.orchestra.run.smithi192.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-26T07:10:38.736 INFO:teuthology.orchestra.run.smithi192.stdout: client mount timeout = 600 2023-11-26T07:10:38.736 INFO:teuthology.orchestra.run.smithi192.stdout: debug client = 20 2023-11-26T07:10:38.737 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2023-11-26T07:10:38.737 INFO:teuthology.orchestra.run.smithi192.stdout: pid file = "" 2023-11-26T07:10:38.737 INFO:teuthology.orchestra.run.smithi192.stdout: rados mon op timeout = 900 2023-11-26T07:10:38.737 INFO:teuthology.orchestra.run.smithi192.stdout: rados osd op timeout = 900 2023-11-26T07:10:38.737 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.a] 2023-11-26T07:10:38.737 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.b] 2023-11-26T07:10:38.737 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.c] 2023-11-26T07:10:38.737 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.a] 2023-11-26T07:10:38.737 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.c] 2023-11-26T07:10:38.737 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.b] 2023-11-26T07:10:38.737 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.d] 2023-11-26T07:10:38.737 INFO:teuthology.orchestra.run.smithi192.stdout:[mds] 2023-11-26T07:10:38.737 INFO:teuthology.orchestra.run.smithi192.stdout: debug mds = 20 2023-11-26T07:10:38.737 INFO:teuthology.orchestra.run.smithi192.stdout: debug mds balancer = 20 2023-11-26T07:10:38.738 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2023-11-26T07:10:38.738 INFO:teuthology.orchestra.run.smithi192.stdout: mds debug frag = True 2023-11-26T07:10:38.738 INFO:teuthology.orchestra.run.smithi192.stdout: mds debug scatterstat = True 2023-11-26T07:10:38.738 INFO:teuthology.orchestra.run.smithi192.stdout: mds op complaint time = 180 2023-11-26T07:10:38.738 INFO:teuthology.orchestra.run.smithi192.stdout: mds verify scatter = True 2023-11-26T07:10:38.738 INFO:teuthology.orchestra.run.smithi192.stdout: osd op complaint time = 180 2023-11-26T07:10:38.738 INFO:teuthology.orchestra.run.smithi192.stdout: rados mon op timeout = 900 2023-11-26T07:10:38.738 INFO:teuthology.orchestra.run.smithi192.stdout: rados osd op timeout = 900 2023-11-26T07:10:38.738 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-26T07:10:38.738 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-26T07:10:38.825 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-26T07:10:38.825 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:10:38.825 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-26T07:10:38.841 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:10:38.841 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-26T07:10:38.898 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi002.front.sepia.ceph.com 2023-11-26T07:10:38.898 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:10:38.898 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-26T07:10:38.899 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-26T07:10:38.976 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:10:38.976 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-26T07:10:39.034 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi192.front.sepia.ceph.com 2023-11-26T07:10:39.034 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:10:39.034 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-26T07:10:39.034 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-26T07:10:39.077 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:10:39.077 DEBUG:teuthology.orchestra.run.smithi192:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-26T07:10:39.135 INFO:tasks.ceph:Setting up mon nodes... 2023-11-26T07:10:39.135 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-26T07:10:39.136 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-26T07:10:39.191 INFO:teuthology.orchestra.run.smithi002.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-26T07:10:39.193 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-26T07:10:39.259 INFO:teuthology.orchestra.run.smithi192.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-26T07:10:39.262 INFO:tasks.ceph:Setting up mds nodes... 2023-11-26T07:10:39.262 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-26T07:10:39.317 INFO:teuthology.orchestra.run.smithi002.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-26T07:10:39.320 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-26T07:10:39.346 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-26T07:10:39.441 INFO:teuthology.orchestra.run.smithi002.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-26T07:10:39.444 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-26T07:10:39.470 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-26T07:10:39.527 INFO:teuthology.orchestra.run.smithi192.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-26T07:10:39.529 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-26T07:10:39.556 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-26T07:10:39.650 INFO:teuthology.orchestra.run.smithi192.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-26T07:10:39.652 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-26T07:10:39.678 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-26T07:10:39.678 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-26T07:10:39.723 INFO:teuthology.orchestra.run.smithi002.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-26T07:10:39.736 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-11-26T07:10:39.779 INFO:teuthology.orchestra.run.smithi002.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-11-26T07:10:39.793 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-26T07:10:39.836 INFO:teuthology.orchestra.run.smithi192.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-26T07:10:39.849 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-11-26T07:10:39.931 INFO:teuthology.orchestra.run.smithi192.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-11-26T07:10:39.944 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-26T07:10:39.944 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi002.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi192.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-26T07:10:39.945 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-26T07:10:39.972 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-26T07:10:39.972 INFO:tasks.ceph:role: osd.0 2023-11-26T07:10:39.973 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi002.front.sepia.ceph.com 2023-11-26T07:10:39.973 DEBUG:teuthology.orchestra.run.smithi002:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-26T07:10:40.040 INFO:teuthology.orchestra.run.smithi002.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-26T07:10:40.040 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-26T07:10:40.040 INFO:teuthology.orchestra.run.smithi002.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-26T07:10:40.041 INFO:teuthology.orchestra.run.smithi002.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-26T07:10:40.041 INFO:teuthology.orchestra.run.smithi002.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-26T07:10:40.041 INFO:teuthology.orchestra.run.smithi002.stdout: = sunit=0 swidth=0 blks 2023-11-26T07:10:40.041 INFO:teuthology.orchestra.run.smithi002.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-26T07:10:40.041 INFO:teuthology.orchestra.run.smithi002.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-26T07:10:40.041 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-26T07:10:40.041 INFO:teuthology.orchestra.run.smithi002.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-26T07:10:40.066 INFO:teuthology.orchestra.run.smithi002.stdout:Discarding blocks...Done. 2023-11-26T07:10:40.067 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi002.front.sepia.ceph.com -o noatime 2023-11-26T07:10:40.067 DEBUG:teuthology.orchestra.run.smithi002:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-26T07:10:40.149 DEBUG:teuthology.orchestra.run.smithi002:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-26T07:10:40.220 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-26T07:10:40.287 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-26T07:10:40.287 INFO:tasks.ceph:role: osd.1 2023-11-26T07:10:40.287 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi002.front.sepia.ceph.com 2023-11-26T07:10:40.287 DEBUG:teuthology.orchestra.run.smithi002:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-26T07:10:40.354 INFO:teuthology.orchestra.run.smithi002.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-26T07:10:40.354 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-26T07:10:40.355 INFO:teuthology.orchestra.run.smithi002.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-26T07:10:40.355 INFO:teuthology.orchestra.run.smithi002.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-26T07:10:40.355 INFO:teuthology.orchestra.run.smithi002.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-26T07:10:40.355 INFO:teuthology.orchestra.run.smithi002.stdout: = sunit=0 swidth=0 blks 2023-11-26T07:10:40.355 INFO:teuthology.orchestra.run.smithi002.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-26T07:10:40.355 INFO:teuthology.orchestra.run.smithi002.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-26T07:10:40.356 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-26T07:10:40.356 INFO:teuthology.orchestra.run.smithi002.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-26T07:10:40.380 INFO:teuthology.orchestra.run.smithi002.stdout:Discarding blocks...Done. 2023-11-26T07:10:40.381 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi002.front.sepia.ceph.com -o noatime 2023-11-26T07:10:40.381 DEBUG:teuthology.orchestra.run.smithi002:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-26T07:10:40.461 DEBUG:teuthology.orchestra.run.smithi002:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-26T07:10:40.532 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-26T07:10:40.600 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-26T07:10:40.600 INFO:tasks.ceph:role: osd.2 2023-11-26T07:10:40.600 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi002.front.sepia.ceph.com 2023-11-26T07:10:40.600 DEBUG:teuthology.orchestra.run.smithi002:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-26T07:10:40.666 INFO:teuthology.orchestra.run.smithi002.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-26T07:10:40.666 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-26T07:10:40.666 INFO:teuthology.orchestra.run.smithi002.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-26T07:10:40.666 INFO:teuthology.orchestra.run.smithi002.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-26T07:10:40.667 INFO:teuthology.orchestra.run.smithi002.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-26T07:10:40.667 INFO:teuthology.orchestra.run.smithi002.stdout: = sunit=0 swidth=0 blks 2023-11-26T07:10:40.667 INFO:teuthology.orchestra.run.smithi002.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-26T07:10:40.667 INFO:teuthology.orchestra.run.smithi002.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-26T07:10:40.667 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-26T07:10:40.667 INFO:teuthology.orchestra.run.smithi002.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-26T07:10:40.690 INFO:teuthology.orchestra.run.smithi002.stdout:Discarding blocks...Done. 2023-11-26T07:10:40.692 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi002.front.sepia.ceph.com -o noatime 2023-11-26T07:10:40.693 DEBUG:teuthology.orchestra.run.smithi002:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-26T07:10:40.773 DEBUG:teuthology.orchestra.run.smithi002:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-26T07:10:40.845 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-26T07:10:40.912 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-26T07:10:40.912 INFO:tasks.ceph:role: osd.3 2023-11-26T07:10:40.912 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi002.front.sepia.ceph.com 2023-11-26T07:10:40.912 DEBUG:teuthology.orchestra.run.smithi002:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-26T07:10:40.979 INFO:teuthology.orchestra.run.smithi002.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-26T07:10:40.979 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-26T07:10:40.979 INFO:teuthology.orchestra.run.smithi002.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-26T07:10:40.979 INFO:teuthology.orchestra.run.smithi002.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-26T07:10:40.979 INFO:teuthology.orchestra.run.smithi002.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-26T07:10:40.980 INFO:teuthology.orchestra.run.smithi002.stdout: = sunit=0 swidth=0 blks 2023-11-26T07:10:40.980 INFO:teuthology.orchestra.run.smithi002.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-26T07:10:40.980 INFO:teuthology.orchestra.run.smithi002.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-26T07:10:40.980 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-26T07:10:40.980 INFO:teuthology.orchestra.run.smithi002.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-26T07:10:41.004 INFO:teuthology.orchestra.run.smithi002.stdout:Discarding blocks...Done. 2023-11-26T07:10:41.006 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi002.front.sepia.ceph.com -o noatime 2023-11-26T07:10:41.006 DEBUG:teuthology.orchestra.run.smithi002:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-26T07:10:41.087 DEBUG:teuthology.orchestra.run.smithi002:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-26T07:10:41.157 DEBUG:teuthology.orchestra.run.smithi002:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-26T07:10:41.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:10:41.379+0000 7f943eef2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-26T07:10:41.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:10:41.379+0000 7f943eef2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-26T07:10:41.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:10:41.379+0000 7f943eef2640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-26T07:10:41.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:10:41.379+0000 7f943eef2640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-26T07:10:41.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:10:41.379+0000 7f943eef2640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-26T07:10:41.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:10:41.380+0000 7f943eef2640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-26T07:10:44.248 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-26T07:10:44.280 DEBUG:teuthology.orchestra.run.smithi002:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-26T07:10:44.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:10:44.372+0000 7f82b2188640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-26T07:10:44.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:10:44.372+0000 7f82b2188640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-26T07:10:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:10:44.372+0000 7f82b2188640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-26T07:10:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:10:44.372+0000 7f82b2188640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-26T07:10:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:10:44.372+0000 7f82b2188640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-26T07:10:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:10:44.373+0000 7f82b2188640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-26T07:10:47.247 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-26T07:10:47.279 DEBUG:teuthology.orchestra.run.smithi002:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-26T07:10:47.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:10:47.371+0000 7fbee0139640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-26T07:10:47.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:10:47.371+0000 7fbee0139640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-26T07:10:47.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:10:47.371+0000 7fbee0139640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-26T07:10:47.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:10:47.371+0000 7fbee0139640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-26T07:10:47.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:10:47.371+0000 7fbee0139640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-26T07:10:47.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:10:47.371+0000 7fbee0139640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-26T07:10:50.240 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-26T07:10:50.273 DEBUG:teuthology.orchestra.run.smithi002:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-26T07:10:50.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:10:50.363+0000 7fbc61f0d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-26T07:10:50.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:10:50.364+0000 7fbc61f0d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-26T07:10:50.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:10:50.364+0000 7fbc61f0d640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-26T07:10:50.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:10:50.364+0000 7fbc61f0d640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-26T07:10:50.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:10:50.364+0000 7fbc61f0d640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-26T07:10:50.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:10:50.364+0000 7fbc61f0d640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-26T07:10:53.229 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-26T07:10:53.262 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-26T07:10:53.295 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-26T07:10:53.295 INFO:tasks.ceph:role: osd.4 2023-11-26T07:10:53.295 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi192.front.sepia.ceph.com 2023-11-26T07:10:53.295 DEBUG:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-26T07:10:53.372 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-26T07:10:53.372 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-26T07:10:53.373 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-26T07:10:53.373 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-26T07:10:53.373 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-26T07:10:53.373 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2023-11-26T07:10:53.373 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-26T07:10:53.373 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-26T07:10:53.373 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-26T07:10:53.373 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-26T07:10:53.810 INFO:teuthology.orchestra.run.smithi192.stdout:Discarding blocks...Done. 2023-11-26T07:10:53.811 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2023-11-26T07:10:53.812 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-26T07:10:53.987 DEBUG:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-26T07:10:54.024 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-26T07:10:54.093 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-26T07:10:54.093 INFO:tasks.ceph:role: osd.5 2023-11-26T07:10:54.094 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi192.front.sepia.ceph.com 2023-11-26T07:10:54.094 DEBUG:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-26T07:10:54.168 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-26T07:10:54.168 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-26T07:10:54.168 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-26T07:10:54.168 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-26T07:10:54.168 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-26T07:10:54.168 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2023-11-26T07:10:54.169 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-26T07:10:54.169 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-26T07:10:54.169 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-26T07:10:54.169 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-26T07:10:54.596 INFO:teuthology.orchestra.run.smithi192.stdout:Discarding blocks...Done. 2023-11-26T07:10:54.598 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2023-11-26T07:10:54.598 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-26T07:10:54.709 DEBUG:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-26T07:10:54.740 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-26T07:10:54.808 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-26T07:10:54.808 INFO:tasks.ceph:role: osd.6 2023-11-26T07:10:54.808 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi192.front.sepia.ceph.com 2023-11-26T07:10:54.808 DEBUG:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-26T07:10:54.883 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-26T07:10:54.883 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-26T07:10:54.883 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-26T07:10:54.883 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-26T07:10:54.883 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-26T07:10:54.883 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2023-11-26T07:10:54.884 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-26T07:10:54.884 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-26T07:10:54.884 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-26T07:10:54.884 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-26T07:10:55.330 INFO:teuthology.orchestra.run.smithi192.stdout:Discarding blocks...Done. 2023-11-26T07:10:55.331 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2023-11-26T07:10:55.331 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-26T07:10:55.508 DEBUG:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-26T07:10:55.540 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-26T07:10:55.608 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-26T07:10:55.608 INFO:tasks.ceph:role: osd.7 2023-11-26T07:10:55.609 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi192.front.sepia.ceph.com 2023-11-26T07:10:55.609 DEBUG:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-26T07:10:55.682 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-26T07:10:55.683 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-26T07:10:55.683 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-26T07:10:55.683 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-26T07:10:55.683 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-26T07:10:55.683 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2023-11-26T07:10:55.683 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-26T07:10:55.683 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-26T07:10:55.683 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-26T07:10:55.683 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-26T07:10:56.121 INFO:teuthology.orchestra.run.smithi192.stdout:Discarding blocks...Done. 2023-11-26T07:10:56.123 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2023-11-26T07:10:56.123 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-26T07:10:56.303 DEBUG:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-26T07:10:56.338 DEBUG:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-26T07:10:56.439 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:10:56.437+0000 7f9d33876640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-26T07:10:56.439 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:10:56.437+0000 7f9d33876640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-26T07:10:56.439 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:10:56.437+0000 7f9d33876640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-26T07:10:56.439 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:10:56.437+0000 7f9d33876640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-26T07:10:56.439 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:10:56.437+0000 7f9d33876640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-26T07:10:56.440 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:10:56.437+0000 7f9d33876640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-26T07:10:59.311 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-26T07:10:59.343 DEBUG:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-26T07:10:59.433 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:10:59.431+0000 7f0a94d63640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-26T07:10:59.433 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:10:59.431+0000 7f0a94d63640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-26T07:10:59.433 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:10:59.431+0000 7f0a94d63640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-26T07:10:59.433 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:10:59.431+0000 7f0a94d63640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-26T07:10:59.433 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:10:59.431+0000 7f0a94d63640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-26T07:10:59.434 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:10:59.432+0000 7f0a94d63640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-26T07:11:02.298 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-26T07:11:02.329 DEBUG:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-26T07:11:02.420 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:02.418+0000 7f69ff3a2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-26T07:11:02.420 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:02.419+0000 7f69ff3a2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-26T07:11:02.421 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:02.419+0000 7f69ff3a2640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-26T07:11:02.421 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:02.419+0000 7f69ff3a2640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-26T07:11:02.421 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:02.419+0000 7f69ff3a2640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-26T07:11:02.421 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:02.419+0000 7f69ff3a2640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-26T07:11:05.297 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-26T07:11:05.329 DEBUG:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-26T07:11:05.421 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:05.419+0000 7f17ac7eb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-26T07:11:05.421 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:05.419+0000 7f17ac7eb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-26T07:11:05.421 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:05.419+0000 7f17ac7eb640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-26T07:11:05.421 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:05.419+0000 7f17ac7eb640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-26T07:11:05.421 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:05.419+0000 7f17ac7eb640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-26T07:11:05.422 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:05.420+0000 7f17ac7eb640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-26T07:11:06.669 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:11:06.673 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:11:08.318 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-26T07:11:08.349 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-26T07:11:08.350 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:11:08.350 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-26T07:11:08.383 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:11:08.383 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-26T07:11:08.455 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:11:08.455 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-26T07:11:08.527 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:11:08.527 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-26T07:11:08.596 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:11:08.596 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-26T07:11:08.666 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:11:08.666 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-26T07:11:08.736 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:11:08.736 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-26T07:11:08.805 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:11:08.805 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-26T07:11:08.836 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:11:08.837 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-26T07:11:08.906 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:11:08.907 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-26T07:11:08.975 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:11:08.975 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-26T07:11:09.046 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:11:09.046 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-26T07:11:09.115 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:11:09.116 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-26T07:11:09.182 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:11:09.183 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-26T07:11:09.249 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:11:09.249 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-26T07:11:09.270 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:11:09.270 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-11-26T07:11:09.330 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:11:09.331 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-26T07:11:09.348 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:11:09.348 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-11-26T07:11:09.405 INFO:tasks.ceph:Adding keys to all mons... 2023-11-26T07:11:09.406 DEBUG:teuthology.orchestra.run.smithi002:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-26T07:11:09.408 DEBUG:teuthology.orchestra.run.smithi192:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-26T07:11:09.449 INFO:teuthology.orchestra.run.smithi002.stdout:[mgr.y] 2023-11-26T07:11:09.449 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBv72Jl5jZZCxAANtm1EyG6Goa1xfuH6Mcy2g== 2023-11-26T07:11:09.449 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.a] 2023-11-26T07:11:09.449 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBv72JlhmTiEhAA/g3oblyy8oWp0Ha83rXvJw== 2023-11-26T07:11:09.449 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.c] 2023-11-26T07:11:09.449 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBv72Jl5jJFGhAAni1U32wc8K7h2w2Uri/P1Q== 2023-11-26T07:11:09.449 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.0] 2023-11-26T07:11:09.449 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBx72JlnIatFhAAQQkaBQT0iVGJLFeE3ITlAQ== 2023-11-26T07:11:09.449 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.1] 2023-11-26T07:11:09.449 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQB072JlXBpBFhAAAEeTzgDMWrtz6OM1Xt6AQg== 2023-11-26T07:11:09.449 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.2] 2023-11-26T07:11:09.450 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQB372Jl4nopFhAAYua4b0EX2F1ldmd/00FcUA== 2023-11-26T07:11:09.450 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.3] 2023-11-26T07:11:09.450 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQB672Jl73zLFRAATTzBUJUAS8/WHwoQZWQX1w== 2023-11-26T07:11:09.450 INFO:teuthology.orchestra.run.smithi002.stdout:[mgr.x] 2023-11-26T07:11:09.450 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBv72Jlq5FrDxAAoovK02XkZdaKmOAgVyJKWw== 2023-11-26T07:11:09.450 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.b] 2023-11-26T07:11:09.450 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBv72Jlq7BeHxAAOcHBt+2M+s3xqG9k14Oong== 2023-11-26T07:11:09.450 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.d] 2023-11-26T07:11:09.450 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBv72JlhpKzJhAAp75J2TEPTop+Zj8ziajW1w== 2023-11-26T07:11:09.450 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.4] 2023-11-26T07:11:09.450 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQCA72JlEqEZGhAAp//g7ZC8YUXoQhoKZKtcDA== 2023-11-26T07:11:09.450 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.5] 2023-11-26T07:11:09.451 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQCD72JlGuu/GRAAQb5WygMoPJ7mjB2fR8N3+g== 2023-11-26T07:11:09.451 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.6] 2023-11-26T07:11:09.451 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQCG72JlLHYCGRAAEDOtGcsGAVuKMSaXdJdgXg== 2023-11-26T07:11:09.451 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.7] 2023-11-26T07:11:09.451 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQCJ72JlKmUJGRAAG7LL7Ath8gv2/HwbKsXYbg== 2023-11-26T07:11:09.451 INFO:teuthology.orchestra.run.smithi002.stdout:[client.0] 2023-11-26T07:11:09.451 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBv72JlaEgQKxAA4cVx4nUFgqn0HvVBJdVHVg== 2023-11-26T07:11:09.451 INFO:teuthology.orchestra.run.smithi002.stdout:[client.2] 2023-11-26T07:11:09.451 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBv72Jl859vLhAAX9K4SuB6kAi/thy6EVKwWA== 2023-11-26T07:11:09.451 INFO:teuthology.orchestra.run.smithi002.stdout:[client.1] 2023-11-26T07:11:09.451 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBv72Jl/WHJMRAAcXuo1XInXpAErMaGOhvpBA== 2023-11-26T07:11:09.451 INFO:teuthology.orchestra.run.smithi002.stdout:[client.3] 2023-11-26T07:11:09.451 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBv72JlRDh9NxAAgWUYNNwgFOantC7zH0fC8g== 2023-11-26T07:11:09.471 INFO:teuthology.orchestra.run.smithi192.stdout:[mgr.y] 2023-11-26T07:11:09.471 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBv72Jl5jZZCxAANtm1EyG6Goa1xfuH6Mcy2g== 2023-11-26T07:11:09.471 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.a] 2023-11-26T07:11:09.471 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBv72JlhmTiEhAA/g3oblyy8oWp0Ha83rXvJw== 2023-11-26T07:11:09.471 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.c] 2023-11-26T07:11:09.471 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBv72Jl5jJFGhAAni1U32wc8K7h2w2Uri/P1Q== 2023-11-26T07:11:09.471 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.0] 2023-11-26T07:11:09.471 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBx72JlnIatFhAAQQkaBQT0iVGJLFeE3ITlAQ== 2023-11-26T07:11:09.471 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.1] 2023-11-26T07:11:09.472 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQB072JlXBpBFhAAAEeTzgDMWrtz6OM1Xt6AQg== 2023-11-26T07:11:09.472 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.2] 2023-11-26T07:11:09.472 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQB372Jl4nopFhAAYua4b0EX2F1ldmd/00FcUA== 2023-11-26T07:11:09.472 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.3] 2023-11-26T07:11:09.472 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQB672Jl73zLFRAATTzBUJUAS8/WHwoQZWQX1w== 2023-11-26T07:11:09.472 INFO:teuthology.orchestra.run.smithi192.stdout:[mgr.x] 2023-11-26T07:11:09.472 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBv72Jlq5FrDxAAoovK02XkZdaKmOAgVyJKWw== 2023-11-26T07:11:09.472 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.b] 2023-11-26T07:11:09.472 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBv72Jlq7BeHxAAOcHBt+2M+s3xqG9k14Oong== 2023-11-26T07:11:09.472 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.d] 2023-11-26T07:11:09.472 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBv72JlhpKzJhAAp75J2TEPTop+Zj8ziajW1w== 2023-11-26T07:11:09.472 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.4] 2023-11-26T07:11:09.472 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCA72JlEqEZGhAAp//g7ZC8YUXoQhoKZKtcDA== 2023-11-26T07:11:09.473 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.5] 2023-11-26T07:11:09.473 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCD72JlGuu/GRAAQb5WygMoPJ7mjB2fR8N3+g== 2023-11-26T07:11:09.473 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.6] 2023-11-26T07:11:09.473 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCG72JlLHYCGRAAEDOtGcsGAVuKMSaXdJdgXg== 2023-11-26T07:11:09.473 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.7] 2023-11-26T07:11:09.473 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCJ72JlKmUJGRAAG7LL7Ath8gv2/HwbKsXYbg== 2023-11-26T07:11:09.473 INFO:teuthology.orchestra.run.smithi192.stdout:[client.0] 2023-11-26T07:11:09.473 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBv72JlaEgQKxAA4cVx4nUFgqn0HvVBJdVHVg== 2023-11-26T07:11:09.473 INFO:teuthology.orchestra.run.smithi192.stdout:[client.2] 2023-11-26T07:11:09.473 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBv72Jl859vLhAAX9K4SuB6kAi/thy6EVKwWA== 2023-11-26T07:11:09.473 INFO:teuthology.orchestra.run.smithi192.stdout:[client.1] 2023-11-26T07:11:09.473 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBv72Jl/WHJMRAAcXuo1XInXpAErMaGOhvpBA== 2023-11-26T07:11:09.474 INFO:teuthology.orchestra.run.smithi192.stdout:[client.3] 2023-11-26T07:11:09.474 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBv72JlRDh9NxAAgWUYNNwgFOantC7zH0fC8g== 2023-11-26T07:11:09.475 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-26T07:11:09.495 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-26T07:11:09.568 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-26T07:11:09.570 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-26T07:11:09.628 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-26T07:11:09.630 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-26T07:11:09.687 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:11:09.689 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:11:09.741 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:11:09.744 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:11:09.796 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:11:09.799 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:11:09.852 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:11:09.854 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:11:09.907 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-26T07:11:09.909 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-26T07:11:09.962 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-26T07:11:09.964 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-26T07:11:10.020 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-26T07:11:10.022 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-26T07:11:10.078 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:11:10.080 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:11:10.133 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:11:10.136 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:11:10.189 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:11:10.192 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:11:10.246 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:11:10.248 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:11:10.302 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-26T07:11:10.304 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-26T07:11:10.360 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-26T07:11:10.362 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-26T07:11:10.419 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-26T07:11:10.421 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-26T07:11:10.477 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-26T07:11:10.479 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-26T07:11:10.536 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-26T07:11:10.536 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-26T07:11:10.563 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-26T07:11:10.663 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-26T07:11:10.689 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-26T07:11:10.716 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-26T07:11:10.815 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-26T07:11:10.840 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-26T07:11:10.907 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-26T07:11:11.005 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-26T07:11:11.032 DEBUG:teuthology.orchestra.run.smithi002:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-26T07:11:11.034 DEBUG:teuthology.orchestra.run.smithi192:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-26T07:11:11.089 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-26T07:11:11.089 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-26T07:11:11.090 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-26T07:11:11.092 INFO:tasks.ceph.mon.a:Started 2023-11-26T07:11:11.092 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-26T07:11:11.092 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-26T07:11:11.132 INFO:tasks.ceph.mon.b:Started 2023-11-26T07:11:11.132 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-26T07:11:11.132 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-26T07:11:11.134 INFO:tasks.ceph.mon.c:Started 2023-11-26T07:11:11.134 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-26T07:11:11.134 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-26T07:11:11.134 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-26T07:11:11.136 INFO:tasks.ceph.mgr.y:Started 2023-11-26T07:11:11.137 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-26T07:11:11.137 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-26T07:11:11.138 INFO:tasks.ceph.mgr.x:Started 2023-11-26T07:11:11.139 INFO:tasks.ceph:Setting crush tunables to default 2023-11-26T07:11:11.139 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --cluster ceph osd crush tunables default 2023-11-26T07:11:11.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.264+0000 7f8572436700 1 Processor -- start 2023-11-26T07:11:11.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.264+0000 7f8572436700 1 -- start start 2023-11-26T07:11:11.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.265+0000 7f8572436700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f856c15e1c0 0x7f856c06eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:11.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.265+0000 7f8572436700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f856c0b0e90 0x7f856c06f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:11.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.265+0000 7f8572436700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f856c06fa80 0x7f856c161d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:11.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.265+0000 7f8572436700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f856c06ff10 con 0x7f856c15e1c0 2023-11-26T07:11:11.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.265+0000 7f8572436700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f856c0d1230 con 0x7f856c06fa80 2023-11-26T07:11:11.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.265+0000 7f8572436700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f856c0d0c70 con 0x7f856c0b0e90 2023-11-26T07:11:11.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.265+0000 7f856bfff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f856c15e1c0 0x7f856c06eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:11.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.265+0000 7f856bfff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f856c15e1c0 0x7f856c06eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38268/0 (socket says 172.21.15.2:38268) 2023-11-26T07:11:11.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.265+0000 7f856bfff700 1 -- 172.21.15.2:0/981224627 learned_addr learned my addr 172.21.15.2:0/981224627 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:11.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.265+0000 7f856bfff700 1 -- 172.21.15.2:0/981224627 >> v2:172.21.15.2:3300/0 conn(0x7f856c15e1c0 msgr2=0x7f856c06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-26T07:11:11.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.265+0000 7f856bfff700 1 -- 172.21.15.2:0/981224627 >> v2:172.21.15.2:3300/0 conn(0x7f856c15e1c0 msgr2=0x7f856c06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-26T07:11:11.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.265+0000 7f856bfff700 1 --2- 172.21.15.2:0/981224627 >> v2:172.21.15.2:3300/0 conn(0x7f856c15e1c0 0x7f856c06eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-26T07:11:11.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.265+0000 7f856bfff700 1 --2- 172.21.15.2:0/981224627 >> v2:172.21.15.2:3300/0 conn(0x7f856c15e1c0 0x7f856c06eef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-26T07:11:11.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.265+0000 7f85709d3700 1 --2- 172.21.15.2:0/981224627 >> v2:172.21.15.192:3300/0 conn(0x7f856c06fa80 0x7f856c161d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:11.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.265+0000 7f856b7fe700 1 --2- 172.21.15.2:0/981224627 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f856c0b0e90 0x7f856c06f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:11.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.265+0000 7f85709d3700 1 -- 172.21.15.2:0/981224627 >> v2:172.21.15.192:3300/0 conn(0x7f856c06fa80 msgr2=0x7f856c161d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-26T07:11:11.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.265+0000 7f85709d3700 1 -- 172.21.15.2:0/981224627 >> v2:172.21.15.192:3300/0 conn(0x7f856c06fa80 msgr2=0x7f856c161d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-26T07:11:11.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.265+0000 7f85709d3700 1 --2- 172.21.15.2:0/981224627 >> v2:172.21.15.192:3300/0 conn(0x7f856c06fa80 0x7f856c161d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-26T07:11:11.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.265+0000 7f85709d3700 1 --2- 172.21.15.2:0/981224627 >> v2:172.21.15.192:3300/0 conn(0x7f856c06fa80 0x7f856c161d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-26T07:11:11.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.265+0000 7f856b7fe700 1 -- 172.21.15.2:0/981224627 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f856c0b0e90 msgr2=0x7f856c06f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-26T07:11:11.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.265+0000 7f856b7fe700 1 -- 172.21.15.2:0/981224627 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f856c0b0e90 msgr2=0x7f856c06f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-26T07:11:11.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.265+0000 7f856b7fe700 1 --2- 172.21.15.2:0/981224627 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f856c0b0e90 0x7f856c06f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-26T07:11:11.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.265+0000 7f856b7fe700 1 --2- 172.21.15.2:0/981224627 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f856c0b0e90 0x7f856c06f540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-26T07:11:11.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.466+0000 7f856bfff700 1 --2- 172.21.15.2:0/981224627 >> v2:172.21.15.2:3300/0 conn(0x7f856c15e1c0 0x7f856c06eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:11.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.466+0000 7f856bfff700 1 -- 172.21.15.2:0/981224627 >> v2:172.21.15.2:3300/0 conn(0x7f856c15e1c0 msgr2=0x7f856c06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-26T07:11:11.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.466+0000 7f856bfff700 1 -- 172.21.15.2:0/981224627 >> v2:172.21.15.2:3300/0 conn(0x7f856c15e1c0 msgr2=0x7f856c06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-26T07:11:11.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.466+0000 7f856bfff700 1 --2- 172.21.15.2:0/981224627 >> v2:172.21.15.2:3300/0 conn(0x7f856c15e1c0 0x7f856c06eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-26T07:11:11.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.466+0000 7f856bfff700 1 --2- 172.21.15.2:0/981224627 >> v2:172.21.15.2:3300/0 conn(0x7f856c15e1c0 0x7f856c06eef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-26T07:11:11.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.466+0000 7f856b7fe700 1 --2- 172.21.15.2:0/981224627 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f856c0b0e90 0x7f856c06f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:11.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.466+0000 7f85709d3700 1 --2- 172.21.15.2:0/981224627 >> v2:172.21.15.192:3300/0 conn(0x7f856c06fa80 0x7f856c161d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:11.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.466+0000 7f85709d3700 1 -- 172.21.15.2:0/981224627 >> v2:172.21.15.192:3300/0 conn(0x7f856c06fa80 msgr2=0x7f856c161d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-26T07:11:11.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.466+0000 7f85709d3700 1 -- 172.21.15.2:0/981224627 >> v2:172.21.15.192:3300/0 conn(0x7f856c06fa80 msgr2=0x7f856c161d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-26T07:11:11.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.466+0000 7f856b7fe700 1 -- 172.21.15.2:0/981224627 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f856c0b0e90 msgr2=0x7f856c06f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-26T07:11:11.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.466+0000 7f85709d3700 1 --2- 172.21.15.2:0/981224627 >> v2:172.21.15.192:3300/0 conn(0x7f856c06fa80 0x7f856c161d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-26T07:11:11.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.466+0000 7f856b7fe700 1 -- 172.21.15.2:0/981224627 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f856c0b0e90 msgr2=0x7f856c06f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-26T07:11:11.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.466+0000 7f856b7fe700 1 --2- 172.21.15.2:0/981224627 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f856c0b0e90 0x7f856c06f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-26T07:11:11.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.466+0000 7f85709d3700 1 --2- 172.21.15.2:0/981224627 >> v2:172.21.15.192:3300/0 conn(0x7f856c06fa80 0x7f856c161d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-26T07:11:11.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.466+0000 7f856b7fe700 1 --2- 172.21.15.2:0/981224627 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f856c0b0e90 0x7f856c06f540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-26T07:11:11.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.867+0000 7f856bfff700 1 --2- 172.21.15.2:0/981224627 >> v2:172.21.15.2:3300/0 conn(0x7f856c15e1c0 0x7f856c06eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:11.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.867+0000 7f856bfff700 1 -- 172.21.15.2:0/981224627 >> v2:172.21.15.2:3300/0 conn(0x7f856c15e1c0 msgr2=0x7f856c06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-26T07:11:11.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.867+0000 7f856bfff700 1 -- 172.21.15.2:0/981224627 >> v2:172.21.15.2:3300/0 conn(0x7f856c15e1c0 msgr2=0x7f856c06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-26T07:11:11.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.867+0000 7f856bfff700 1 --2- 172.21.15.2:0/981224627 >> v2:172.21.15.2:3300/0 conn(0x7f856c15e1c0 0x7f856c06eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-26T07:11:11.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.867+0000 7f856bfff700 1 --2- 172.21.15.2:0/981224627 >> v2:172.21.15.2:3300/0 conn(0x7f856c15e1c0 0x7f856c06eef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-26T07:11:11.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.867+0000 7f856b7fe700 1 --2- 172.21.15.2:0/981224627 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f856c0b0e90 0x7f856c06f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:11.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.867+0000 7f85709d3700 1 --2- 172.21.15.2:0/981224627 >> v2:172.21.15.192:3300/0 conn(0x7f856c06fa80 0x7f856c161d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:11.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.867+0000 7f856b7fe700 1 -- 172.21.15.2:0/981224627 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f856c0b0e90 msgr2=0x7f856c06f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-26T07:11:11.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.867+0000 7f856b7fe700 1 -- 172.21.15.2:0/981224627 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f856c0b0e90 msgr2=0x7f856c06f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-26T07:11:11.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.867+0000 7f856b7fe700 1 --2- 172.21.15.2:0/981224627 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f856c0b0e90 0x7f856c06f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-26T07:11:11.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.867+0000 7f85709d3700 1 -- 172.21.15.2:0/981224627 >> v2:172.21.15.192:3300/0 conn(0x7f856c06fa80 msgr2=0x7f856c161d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-26T07:11:11.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.867+0000 7f85709d3700 1 -- 172.21.15.2:0/981224627 >> v2:172.21.15.192:3300/0 conn(0x7f856c06fa80 msgr2=0x7f856c161d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-26T07:11:11.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.867+0000 7f85709d3700 1 --2- 172.21.15.2:0/981224627 >> v2:172.21.15.192:3300/0 conn(0x7f856c06fa80 0x7f856c161d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-26T07:11:11.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.867+0000 7f856b7fe700 1 --2- 172.21.15.2:0/981224627 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f856c0b0e90 0x7f856c06f540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-26T07:11:11.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:11.867+0000 7f85709d3700 1 --2- 172.21.15.2:0/981224627 >> v2:172.21.15.192:3300/0 conn(0x7f856c06fa80 0x7f856c161d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-26T07:11:12.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:12.668+0000 7f856bfff700 1 --2- 172.21.15.2:0/981224627 >> v2:172.21.15.2:3300/0 conn(0x7f856c15e1c0 0x7f856c06eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:12.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:12.668+0000 7f856bfff700 1 -- 172.21.15.2:0/981224627 >> v2:172.21.15.2:3300/0 conn(0x7f856c15e1c0 msgr2=0x7f856c06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-26T07:11:12.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:12.668+0000 7f856bfff700 1 -- 172.21.15.2:0/981224627 >> v2:172.21.15.2:3300/0 conn(0x7f856c15e1c0 msgr2=0x7f856c06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-26T07:11:12.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:12.668+0000 7f856bfff700 1 --2- 172.21.15.2:0/981224627 >> v2:172.21.15.2:3300/0 conn(0x7f856c15e1c0 0x7f856c06eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-26T07:11:12.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:12.668+0000 7f856bfff700 1 --2- 172.21.15.2:0/981224627 >> v2:172.21.15.2:3300/0 conn(0x7f856c15e1c0 0x7f856c06eef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-26T07:11:12.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:12.668+0000 7f856b7fe700 1 --2- 172.21.15.2:0/981224627 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f856c0b0e90 0x7f856c06f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:12.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:12.668+0000 7f85709d3700 1 --2- 172.21.15.2:0/981224627 >> v2:172.21.15.192:3300/0 conn(0x7f856c06fa80 0x7f856c161d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:12.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:12.668+0000 7f856b7fe700 1 -- 172.21.15.2:0/981224627 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f856c0b0e90 msgr2=0x7f856c06f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-26T07:11:12.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:12.668+0000 7f856b7fe700 1 -- 172.21.15.2:0/981224627 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f856c0b0e90 msgr2=0x7f856c06f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-26T07:11:12.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:12.668+0000 7f856b7fe700 1 --2- 172.21.15.2:0/981224627 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f856c0b0e90 0x7f856c06f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-26T07:11:12.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:12.668+0000 7f856b7fe700 1 --2- 172.21.15.2:0/981224627 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f856c0b0e90 0x7f856c06f540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-26T07:11:12.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:12.668+0000 7f85709d3700 1 -- 172.21.15.2:0/981224627 >> v2:172.21.15.192:3300/0 conn(0x7f856c06fa80 msgr2=0x7f856c161d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-26T07:11:12.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:12.668+0000 7f85709d3700 1 -- 172.21.15.2:0/981224627 >> v2:172.21.15.192:3300/0 conn(0x7f856c06fa80 msgr2=0x7f856c161d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-26T07:11:12.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:12.668+0000 7f85709d3700 1 --2- 172.21.15.2:0/981224627 >> v2:172.21.15.192:3300/0 conn(0x7f856c06fa80 0x7f856c161d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-26T07:11:12.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:12.668+0000 7f85709d3700 1 --2- 172.21.15.2:0/981224627 >> v2:172.21.15.192:3300/0 conn(0x7f856c06fa80 0x7f856c161d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-26T07:11:14.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:14.265+0000 7f8569ffb700 1 -- 172.21.15.2:0/981224627 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f856c0b0e90 msgr2=0x7f856c06f540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-26T07:11:14.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:14.265+0000 7f8569ffb700 1 --2- 172.21.15.2:0/981224627 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f856c0b0e90 0x7f856c06f540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:14.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:14.265+0000 7f8569ffb700 1 -- 172.21.15.2:0/981224627 >> v2:172.21.15.192:3300/0 conn(0x7f856c06fa80 msgr2=0x7f856c161d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-26T07:11:14.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:14.265+0000 7f8569ffb700 1 --2- 172.21.15.2:0/981224627 >> v2:172.21.15.192:3300/0 conn(0x7f856c06fa80 0x7f856c161d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:14.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:14.265+0000 7f8569ffb700 1 -- 172.21.15.2:0/981224627 >> v2:172.21.15.2:3300/0 conn(0x7f856c15e1c0 msgr2=0x7f856c06eef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-26T07:11:14.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:14.265+0000 7f8569ffb700 1 --2- 172.21.15.2:0/981224627 >> v2:172.21.15.2:3300/0 conn(0x7f856c15e1c0 0x7f856c06eef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:14.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:14.265+0000 7f8569ffb700 1 -- 172.21.15.2:0/981224627 --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f856c0d0f50 con 0x7f8554003740 2023-11-26T07:11:14.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:14.265+0000 7f8569ffb700 1 -- 172.21.15.2:0/981224627 --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f855400c110 con 0x7f85540073b0 2023-11-26T07:11:16.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.487+0000 7f856affd700 1 -- 172.21.15.2:0/981224627 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1687319850 0 0) 0x7f855400c110 con 0x7f85540073b0 2023-11-26T07:11:16.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.487+0000 7f856affd700 1 -- 172.21.15.2:0/981224627 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85580035b0 con 0x7f85540073b0 2023-11-26T07:11:16.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.487+0000 7f856affd700 1 -- 172.21.15.2:0/981224627 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1463252362 0 0) 0x7f856c0d0f50 con 0x7f8554003740 2023-11-26T07:11:16.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.487+0000 7f856affd700 1 -- 172.21.15.2:0/981224627 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f855400c110 con 0x7f8554003740 2023-11-26T07:11:16.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.487+0000 7f856affd700 1 -- 172.21.15.2:0/981224627 <== mon.1 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1719779122 0 0) 0x7f85580035b0 con 0x7f85540073b0 2023-11-26T07:11:16.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.487+0000 7f856affd700 1 -- 172.21.15.2:0/981224627 >> v1:172.21.15.2:6789/0 conn(0x7f8554003740 legacy=0x7f8554005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:16.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.487+0000 7f856affd700 1 -- 172.21.15.2:0/981224627 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f855400d310 con 0x7f85540073b0 2023-11-26T07:11:16.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.487+0000 7f856affd700 1 -- 172.21.15.2:0/981224627 <== mon.1 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f856000e590 con 0x7f85540073b0 2023-11-26T07:11:16.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.488+0000 7f856affd700 1 -- 172.21.15.2:0/981224627 >> v1:172.21.15.192:6789/0 conn(0x7f85540073b0 legacy=0x7f8554009850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:16.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.488+0000 7f856affd700 1 --2- 172.21.15.2:0/981224627 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8558003c30 0x7f8558004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:16.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.488+0000 7f85709d3700 1 -- 172.21.15.2:0/981224627 reap_dead start 2023-11-26T07:11:16.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.488+0000 7f856affd700 1 --2- 172.21.15.2:0/981224627 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8558004850 0x7f8558004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:16.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.488+0000 7f856affd700 1 --2- 172.21.15.2:0/981224627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8558009a00 0x7f855800bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:16.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.488+0000 7f856bfff700 1 --2- 172.21.15.2:0/981224627 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8558003c30 0x7f8558004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:16.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.488+0000 7f856affd700 1 -- 172.21.15.2:0/981224627 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855800c3e0 con 0x7f8558003c30 2023-11-26T07:11:16.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.488+0000 7f856affd700 1 -- 172.21.15.2:0/981224627 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855800c520 con 0x7f8558009a00 2023-11-26T07:11:16.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.488+0000 7f856affd700 1 -- 172.21.15.2:0/981224627 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f855800c6e0 con 0x7f8558004850 2023-11-26T07:11:16.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.488+0000 7f85709d3700 1 --2- 172.21.15.2:0/981224627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8558009a00 0x7f855800bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:16.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.488+0000 7f856b7fe700 1 --2- 172.21.15.2:0/981224627 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8558004850 0x7f8558004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:16.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.488+0000 7f856bfff700 1 -- 172.21.15.2:0/981224627 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8558004850 msgr2=0x7f8558004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:16.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.488+0000 7f856bfff700 1 --2- 172.21.15.2:0/981224627 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8558004850 0x7f8558004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:16.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.488+0000 7f856bfff700 1 -- 172.21.15.2:0/981224627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8558009a00 msgr2=0x7f855800bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:16.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.488+0000 7f856bfff700 1 --2- 172.21.15.2:0/981224627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8558009a00 0x7f855800bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:16.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.489+0000 7f856bfff700 1 -- 172.21.15.2:0/981224627 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85580035b0 con 0x7f8558003c30 2023-11-26T07:11:16.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.489+0000 7f856bfff700 1 --2- 172.21.15.2:0/981224627 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8558003c30 0x7f8558004010 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f855c012ae0 tx=0x7f8558005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd90f3ebf8bc1c73 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:16.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.489+0000 7f856affd700 1 -- 172.21.15.2:0/981224627 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855c004220 con 0x7f8558003c30 2023-11-26T07:11:16.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.489+0000 7f856affd700 1 -- 172.21.15.2:0/981224627 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f855c00c040 con 0x7f8558003c30 2023-11-26T07:11:16.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.489+0000 7f856affd700 1 -- 172.21.15.2:0/981224627 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855c0126a0 con 0x7f8558003c30 2023-11-26T07:11:16.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.490+0000 7f8572436700 1 -- 172.21.15.2:0/981224627 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8558003c30 msgr2=0x7f8558004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:16.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.490+0000 7f8572436700 1 --2- 172.21.15.2:0/981224627 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8558003c30 0x7f8558004010 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f855c012ae0 tx=0x7f8558005880 comp rx=0 tx=0).stop 2023-11-26T07:11:16.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.490+0000 7f8572436700 1 -- 172.21.15.2:0/981224627 shutdown_connections 2023-11-26T07:11:16.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.490+0000 7f8572436700 1 --2- 172.21.15.2:0/981224627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8558009a00 0x7f855800bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:16.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.490+0000 7f8572436700 1 --2- 172.21.15.2:0/981224627 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8558004850 0x7f8558004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:16.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.490+0000 7f8572436700 1 --2- 172.21.15.2:0/981224627 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8558003c30 0x7f8558004010 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:16.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.490+0000 7f8572436700 1 -- 172.21.15.2:0/981224627 >> 172.21.15.2:0/981224627 conn(0x7f856c0b3720 msgr2=0x7f856c0b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:16.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.490+0000 7f8572436700 1 -- 172.21.15.2:0/981224627 shutdown_connections 2023-11-26T07:11:16.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.490+0000 7f8572436700 1 -- 172.21.15.2:0/981224627 wait complete. 2023-11-26T07:11:16.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.492+0000 7f8572436700 1 Processor -- start 2023-11-26T07:11:16.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.492+0000 7f8572436700 1 -- start start 2023-11-26T07:11:16.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.493+0000 7f8572436700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8558003c30 0x7f856c1f5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:16.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.493+0000 7f8572436700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8558004850 0x7f856c0b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:16.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.493+0000 7f8572436700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8558009a00 0x7f856c0b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:16.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.493+0000 7f8572436700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856c0b6690 con 0x7f8558009a00 2023-11-26T07:11:16.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.493+0000 7f8572436700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856c0b6970 con 0x7f8558003c30 2023-11-26T07:11:16.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.493+0000 7f8572436700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f856c0b6c50 con 0x7f8558004850 2023-11-26T07:11:16.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.493+0000 7f85709d3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8558009a00 0x7f856c0b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:16.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.493+0000 7f85709d3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8558009a00 0x7f856c0b29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38342/0 (socket says 172.21.15.2:38342) 2023-11-26T07:11:16.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.493+0000 7f85709d3700 1 -- 172.21.15.2:0/2875035388 learned_addr learned my addr 172.21.15.2:0/2875035388 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:16.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.493+0000 7f856bfff700 1 --2- 172.21.15.2:0/2875035388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8558003c30 0x7f856c1f5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:16.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.493+0000 7f856b7fe700 1 --2- 172.21.15.2:0/2875035388 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8558004850 0x7f856c0b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:16.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.494+0000 7f85709d3700 1 -- 172.21.15.2:0/2875035388 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8558004850 msgr2=0x7f856c0b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:16.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.494+0000 7f85709d3700 1 --2- 172.21.15.2:0/2875035388 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8558004850 0x7f856c0b48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:16.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.494+0000 7f85709d3700 1 -- 172.21.15.2:0/2875035388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8558003c30 msgr2=0x7f856c1f5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:16.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.494+0000 7f85709d3700 1 --2- 172.21.15.2:0/2875035388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8558003c30 0x7f856c1f5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:16.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.494+0000 7f85709d3700 1 -- 172.21.15.2:0/2875035388 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f856c0b6f30 con 0x7f8558009a00 2023-11-26T07:11:16.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.494+0000 7f85709d3700 1 --2- 172.21.15.2:0/2875035388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8558009a00 0x7f856c0b29e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8554007320 tx=0x7f85640045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:16.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.496+0000 7f8568ff9700 1 -- 172.21.15.2:0/2875035388 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85640178e0 con 0x7f8558009a00 2023-11-26T07:11:16.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.496+0000 7f8568ff9700 1 -- 172.21.15.2:0/2875035388 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856400f040 con 0x7f8558009a00 2023-11-26T07:11:16.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.496+0000 7f8568ff9700 1 -- 172.21.15.2:0/2875035388 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8564017ca0 con 0x7f8558009a00 2023-11-26T07:11:16.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.496+0000 7f8572436700 1 -- 172.21.15.2:0/2875035388 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f856c0b7210 con 0x7f8558009a00 2023-11-26T07:11:16.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.496+0000 7f8572436700 1 -- 172.21.15.2:0/2875035388 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f856c1f6530 con 0x7f8558009a00 2023-11-26T07:11:16.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.496+0000 7f8568ff9700 1 -- 172.21.15.2:0/2875035388 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f856401f700 con 0x7f8558009a00 2023-11-26T07:11:16.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.496+0000 7f8568ff9700 1 -- 172.21.15.2:0/2875035388 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f85640168f0 con 0x7f8558009a00 2023-11-26T07:11:16.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.497+0000 7f8572436700 1 -- 172.21.15.2:0/2875035388 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f856c0b7580 con 0x7f8558009a00 2023-11-26T07:11:16.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.502+0000 7f8568ff9700 1 -- 172.21.15.2:0/2875035388 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f8564024060 con 0x7f8558009a00 2023-11-26T07:11:16.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.584+0000 7f8572436700 1 -- 172.21.15.2:0/2875035388 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f856c06c4b0 con 0x7f8558009a00 2023-11-26T07:11:16.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.585+0000 7f8568ff9700 1 -- 172.21.15.2:0/2875035388 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f856402f090 con 0x7f8558009a00 2023-11-26T07:11:16.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.586+0000 7f8572436700 1 -- 172.21.15.2:0/2875035388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8558009a00 msgr2=0x7f856c0b29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:16.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.586+0000 7f8572436700 1 --2- 172.21.15.2:0/2875035388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8558009a00 0x7f856c0b29e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8554007320 tx=0x7f85640045e0 comp rx=0 tx=0).stop 2023-11-26T07:11:16.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.586+0000 7f8572436700 1 -- 172.21.15.2:0/2875035388 shutdown_connections 2023-11-26T07:11:16.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.586+0000 7f8572436700 1 --2- 172.21.15.2:0/2875035388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8558009a00 0x7f856c0b29e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:16.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.586+0000 7f8572436700 1 --2- 172.21.15.2:0/2875035388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8558003c30 0x7f856c1f5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:16.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.586+0000 7f8572436700 1 --2- 172.21.15.2:0/2875035388 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8558004850 0x7f856c0b48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:16.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.586+0000 7f8572436700 1 -- 172.21.15.2:0/2875035388 >> 172.21.15.2:0/2875035388 conn(0x7f856c0b3720 msgr2=0x7f856c0b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:16.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.586+0000 7f8572436700 1 -- 172.21.15.2:0/2875035388 shutdown_connections 2023-11-26T07:11:16.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:16.586+0000 7f8572436700 1 -- 172.21.15.2:0/2875035388 wait complete. 2023-11-26T07:11:16.589 INFO:teuthology.orchestra.run.smithi002.stderr:adjusted tunables profile to default 2023-11-26T07:11:16.601 INFO:tasks.ceph:check_enable_crimson: False 2023-11-26T07:11:16.601 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-26T07:11:16.602 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:11:16.602 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-26T07:11:16.616 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:11:16.614+0000 7f8e31361200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-26T07:11:16.625 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-26T07:11:16.623+0000 7f8e0c58d200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-26T07:11:16.629 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:11:16.629 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-26T07:11:16.680 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:11:16.679+0000 7f8e31361200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-26T07:11:16.695 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-26T07:11:16.694+0000 7f8e0c58d200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-26T07:11:16.696 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:11:16.697 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-26T07:11:16.755 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:11:16.754+0000 7f8e31361200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-26T07:11:16.764 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:11:16.764 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-26T07:11:16.777 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-26T07:11:16.775+0000 7f8e0c58d200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-26T07:11:16.804 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:11:16.804 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-26T07:11:16.830 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:11:16.830 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-26T07:11:16.835 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:11:16.833+0000 7f8e31361200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-26T07:11:16.859 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:11:16.859 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-26T07:11:16.862 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-26T07:11:16.860+0000 7f8e0c58d200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-26T07:11:16.925 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:11:16.925 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-26T07:11:16.984 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:11:16.982+0000 7f8e31361200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-26T07:11:16.991 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 7863edba-a3b9-4ba9-bed1-3990aad97f59 0 2023-11-26T07:11:17.011 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-26T07:11:17.009+0000 7f8e0c58d200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-26T07:11:17.152 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.150+0000 7ff051105700 1 Processor -- start 2023-11-26T07:11:17.152 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.150+0000 7ff051105700 1 -- start start 2023-11-26T07:11:17.154 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.151+0000 7ff051105700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff04c0d06b0 0x7ff04c06ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:17.154 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.151+0000 7ff051105700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff04c0b05f0 con 0x7ff04c15a820 2023-11-26T07:11:17.154 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.151+0000 7ff051105700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff04c15f080 con 0x7ff04c15a440 2023-11-26T07:11:17.154 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.151+0000 7ff051105700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c0afd50 con 0x7ff04c0d06b0 2023-11-26T07:11:17.154 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.151+0000 7ff04b59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff04c0d06b0 0x7ff04c06ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:17.155 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.151+0000 7ff04ad9d700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7ff04c15a440 0x7ff04c0cffa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:42328/0 (socket says 172.21.15.192:42328) 2023-11-26T07:11:17.155 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.151+0000 7ff04ad9d700 1 -- 172.21.15.192:0/515273662 learned_addr learned my addr 172.21.15.192:0/515273662 (peer_addr_for_me v1:172.21.15.192:0/0) 2023-11-26T07:11:17.155 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.151+0000 7ff04b59e700 1 -- 172.21.15.192:0/515273662 >> v1:172.21.15.192:6789/0 conn(0x7ff04c15a440 legacy=0x7ff04c0cffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:17.155 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.151+0000 7ff049d9b700 1 -- 172.21.15.192:0/515273662 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1233291650 0 0) 0x7ff04c15f080 con 0x7ff04c15a440 2023-11-26T07:11:17.155 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.151+0000 7ff04b59e700 1 -- 172.21.15.192:0/515273662 >> v1:172.21.15.2:6789/0 conn(0x7ff04c15a820 legacy=0x7ff04c06b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:17.155 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.151+0000 7ff04b59e700 1 -- 172.21.15.192:0/515273662 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff04c0b0030 con 0x7ff04c0d06b0 2023-11-26T07:11:17.155 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.152+0000 7ff04b59e700 1 --2- 172.21.15.192:0/515273662 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff04c0d06b0 0x7ff04c06ba50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff044009dc0 tx=0x7ff04400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=493fffc7ec64998c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:17.155 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.152+0000 7ff049d9b700 1 -- 172.21.15.192:0/515273662 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04400bdd0 con 0x7ff04c0d06b0 2023-11-26T07:11:17.155 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.152+0000 7ff049d9b700 1 -- 172.21.15.192:0/515273662 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff044010480 con 0x7ff04c0d06b0 2023-11-26T07:11:17.155 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.152+0000 7ff049d9b700 1 -- 172.21.15.192:0/515273662 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff044010830 con 0x7ff04c0d06b0 2023-11-26T07:11:17.155 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.152+0000 7ff051105700 1 -- 172.21.15.192:0/515273662 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff04c0d06b0 msgr2=0x7ff04c06ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:17.155 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.152+0000 7ff051105700 1 --2- 172.21.15.192:0/515273662 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff04c0d06b0 0x7ff04c06ba50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff044009dc0 tx=0x7ff04400b330 comp rx=0 tx=0).stop 2023-11-26T07:11:17.156 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.152+0000 7ff051105700 1 -- 172.21.15.192:0/515273662 shutdown_connections 2023-11-26T07:11:17.156 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.152+0000 7ff051105700 1 --2- 172.21.15.192:0/515273662 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff04c0d06b0 0x7ff04c06ba50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:17.156 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.152+0000 7ff051105700 1 -- 172.21.15.192:0/515273662 >> 172.21.15.192:0/515273662 conn(0x7ff04c0b5070 msgr2=0x7ff04c0b5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:17.156 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.152+0000 7ff051105700 1 -- 172.21.15.192:0/515273662 shutdown_connections 2023-11-26T07:11:17.156 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.152+0000 7ff051105700 1 -- 172.21.15.192:0/515273662 wait complete. 2023-11-26T07:11:17.158 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.154+0000 7ff051105700 1 Processor -- start 2023-11-26T07:11:17.158 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.154+0000 7ff051105700 1 -- start start 2023-11-26T07:11:17.158 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.155+0000 7ff051105700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff04c0d06b0 0x7ff04c1f4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:17.158 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.155+0000 7ff051105700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff04c15a440 0x7ff04c15ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:17.159 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.155+0000 7ff051105700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff04c06b8c0 0x7ff04c0ae7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:17.159 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.155+0000 7ff051105700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c0cc050 con 0x7ff04c0d06b0 2023-11-26T07:11:17.159 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.155+0000 7ff051105700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c0cfb10 con 0x7ff04c15a440 2023-11-26T07:11:17.159 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.155+0000 7ff051105700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c0cf830 con 0x7ff04c06b8c0 2023-11-26T07:11:17.159 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.155+0000 7ff04b59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff04c06b8c0 0x7ff04c0ae7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:17.159 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.155+0000 7ff04a59c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff04c15a440 0x7ff04c15ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:17.159 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.155+0000 7ff04b59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff04c06b8c0 0x7ff04c0ae7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:53648/0 (socket says 172.21.15.192:53648) 2023-11-26T07:11:17.159 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.155+0000 7ff04a59c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff04c15a440 0x7ff04c15ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33092/0 (socket says 172.21.15.192:33092) 2023-11-26T07:11:17.159 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.155+0000 7ff04b59e700 1 -- 172.21.15.192:0/1896043393 learned_addr learned my addr 172.21.15.192:0/1896043393 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-11-26T07:11:17.159 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.155+0000 7ff04ad9d700 1 --2- 172.21.15.192:0/1896043393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff04c0d06b0 0x7ff04c1f4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:17.159 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.155+0000 7ff04b59e700 1 -- 172.21.15.192:0/1896043393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff04c15a440 msgr2=0x7ff04c15ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:17.159 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.155+0000 7ff04b59e700 1 --2- 172.21.15.192:0/1896043393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff04c15a440 0x7ff04c15ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:17.160 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.155+0000 7ff04b59e700 1 -- 172.21.15.192:0/1896043393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff04c0d06b0 msgr2=0x7ff04c1f4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:17.160 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.155+0000 7ff04b59e700 1 --2- 172.21.15.192:0/1896043393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff04c0d06b0 0x7ff04c1f4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:17.160 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.155+0000 7ff04b59e700 1 -- 172.21.15.192:0/1896043393 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff044009a70 con 0x7ff04c06b8c0 2023-11-26T07:11:17.160 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.155+0000 7ff04a59c700 1 --2- 172.21.15.192:0/1896043393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff04c15a440 0x7ff04c15ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:11:17.160 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.155+0000 7ff04ad9d700 1 --2- 172.21.15.192:0/1896043393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff04c0d06b0 0x7ff04c1f4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:11:17.160 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.155+0000 7ff04b59e700 1 --2- 172.21.15.192:0/1896043393 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff04c06b8c0 0x7ff04c0ae7e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff04c0737f0 tx=0x7ff044004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:17.160 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.155+0000 7ff0337fe700 1 -- 172.21.15.192:0/1896043393 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04401d040 con 0x7ff04c06b8c0 2023-11-26T07:11:17.160 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.155+0000 7ff0337fe700 1 -- 172.21.15.192:0/1896043393 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff044010df0 con 0x7ff04c06b8c0 2023-11-26T07:11:17.160 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.155+0000 7ff051105700 1 -- 172.21.15.192:0/1896043393 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff04c0cbd70 con 0x7ff04c06b8c0 2023-11-26T07:11:17.160 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.155+0000 7ff0337fe700 1 -- 172.21.15.192:0/1896043393 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff044004280 con 0x7ff04c06b8c0 2023-11-26T07:11:17.160 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.156+0000 7ff051105700 1 -- 172.21.15.192:0/1896043393 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff04c0cf430 con 0x7ff04c06b8c0 2023-11-26T07:11:17.160 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.156+0000 7ff0337fe700 1 -- 172.21.15.192:0/1896043393 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff0440046e0 con 0x7ff04c06b8c0 2023-11-26T07:11:17.161 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.156+0000 7ff0337fe700 1 -- 172.21.15.192:0/1896043393 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff04400e040 con 0x7ff04c06b8c0 2023-11-26T07:11:17.161 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.156+0000 7ff051105700 1 -- 172.21.15.192:0/1896043393 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff04c0cf5c0 con 0x7ff04c06b8c0 2023-11-26T07:11:17.161 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.159+0000 7ff0337fe700 1 -- 172.21.15.192:0/1896043393 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7ff044031060 con 0x7ff04c06b8c0 2023-11-26T07:11:17.244 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.243+0000 7ff051105700 1 -- 172.21.15.192:0/1896043393 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7863edba-a3b9-4ba9-bed1-3990aad97f59", "id": 0} v 0) v1 -- 0x7ff04c06b6c0 con 0x7ff04c06b8c0 2023-11-26T07:11:17.248 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.246+0000 7ff0337fe700 1 -- 172.21.15.192:0/1896043393 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7863edba-a3b9-4ba9-bed1-3990aad97f59", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff044022440 con 0x7ff04c06b8c0 2023-11-26T07:11:17.248 INFO:teuthology.orchestra.run.smithi192.stdout:0 2023-11-26T07:11:17.249 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.247+0000 7ff051105700 1 -- 172.21.15.192:0/1896043393 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff04c06b8c0 msgr2=0x7ff04c0ae7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:17.249 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.247+0000 7ff051105700 1 --2- 172.21.15.192:0/1896043393 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff04c06b8c0 0x7ff04c0ae7e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff04c0737f0 tx=0x7ff044004ad0 comp rx=0 tx=0).stop 2023-11-26T07:11:17.249 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.247+0000 7ff051105700 1 -- 172.21.15.192:0/1896043393 shutdown_connections 2023-11-26T07:11:17.249 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.247+0000 7ff051105700 1 --2- 172.21.15.192:0/1896043393 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff04c06b8c0 0x7ff04c0ae7e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:17.249 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.247+0000 7ff051105700 1 --2- 172.21.15.192:0/1896043393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff04c0d06b0 0x7ff04c1f4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:17.250 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.247+0000 7ff051105700 1 --2- 172.21.15.192:0/1896043393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff04c15a440 0x7ff04c15ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:17.250 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.247+0000 7ff051105700 1 -- 172.21.15.192:0/1896043393 >> 172.21.15.192:0/1896043393 conn(0x7ff04c0b5070 msgr2=0x7ff04c150670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:17.250 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.247+0000 7ff051105700 1 -- 172.21.15.192:0/1896043393 shutdown_connections 2023-11-26T07:11:17.250 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.247+0000 7ff051105700 1 -- 172.21.15.192:0/1896043393 wait complete. 2023-11-26T07:11:17.261 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 9cdfa5be-c35c-45f7-971a-72fc638dcbe6 1 2023-11-26T07:11:17.382 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.380+0000 7fe56ccaa700 1 Processor -- start 2023-11-26T07:11:17.382 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.380+0000 7fe56ccaa700 1 -- start start 2023-11-26T07:11:17.384 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.381+0000 7fe56ccaa700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe568143ae0 0x7fe5680b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:17.385 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.381+0000 7fe56ccaa700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe5680722c0 0x7fe56806e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:17.385 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.381+0000 7fe56ccaa700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe568143ec0 con 0x7fe5681440f0 2023-11-26T07:11:17.385 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.381+0000 7fe56ccaa700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5680b40a0 con 0x7fe568143ae0 2023-11-26T07:11:17.385 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.381+0000 7fe56ccaa700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5680b3ae0 con 0x7fe5680722c0 2023-11-26T07:11:17.385 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.381+0000 7fe566d9d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe5680722c0 0x7fe56806e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:17.385 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.381+0000 7fe566d9d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe5680722c0 0x7fe56806e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33100/0 (socket says 172.21.15.192:33100) 2023-11-26T07:11:17.385 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.381+0000 7fe566d9d700 1 -- 172.21.15.192:0/2950951971 learned_addr learned my addr 172.21.15.192:0/2950951971 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-11-26T07:11:17.385 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.381+0000 7fe56659c700 1 --2- 172.21.15.192:0/2950951971 >> v2:172.21.15.2:3300/0 conn(0x7fe568143ae0 0x7fe5680b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:17.385 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.382+0000 7fe566d9d700 1 -- 172.21.15.192:0/2950951971 >> v2:172.21.15.2:3300/0 conn(0x7fe568143ae0 msgr2=0x7fe5680b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:17.385 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.382+0000 7fe566d9d700 1 --2- 172.21.15.192:0/2950951971 >> v2:172.21.15.2:3300/0 conn(0x7fe568143ae0 0x7fe5680b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:17.385 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.382+0000 7fe566d9d700 1 -- 172.21.15.192:0/2950951971 >> v1:172.21.15.2:6789/0 conn(0x7fe5681440f0 legacy=0x7fe568071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:17.385 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.382+0000 7fe566d9d700 1 -- 172.21.15.192:0/2950951971 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5680b3dc0 con 0x7fe5680722c0 2023-11-26T07:11:17.385 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.382+0000 7fe566d9d700 1 --2- 172.21.15.192:0/2950951971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5680722c0 0x7fe56806e510 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe5680747c0 tx=0x7fe56000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=556ca2da48be40e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:17.386 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.382+0000 7fe56559a700 1 -- 172.21.15.192:0/2950951971 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56000e070 con 0x7fe5680722c0 2023-11-26T07:11:17.386 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.382+0000 7fe56559a700 1 -- 172.21.15.192:0/2950951971 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe56000b910 con 0x7fe5680722c0 2023-11-26T07:11:17.386 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.382+0000 7fe56559a700 1 -- 172.21.15.192:0/2950951971 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56000bcc0 con 0x7fe5680722c0 2023-11-26T07:11:17.386 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.382+0000 7fe56ccaa700 1 -- 172.21.15.192:0/2950951971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5680722c0 msgr2=0x7fe56806e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:17.386 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.382+0000 7fe56ccaa700 1 --2- 172.21.15.192:0/2950951971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5680722c0 0x7fe56806e510 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe5680747c0 tx=0x7fe56000b330 comp rx=0 tx=0).stop 2023-11-26T07:11:17.386 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.383+0000 7fe56ccaa700 1 -- 172.21.15.192:0/2950951971 shutdown_connections 2023-11-26T07:11:17.386 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.383+0000 7fe56ccaa700 1 --2- 172.21.15.192:0/2950951971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5680722c0 0x7fe56806e510 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:17.386 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.383+0000 7fe56ccaa700 1 --2- 172.21.15.192:0/2950951971 >> v2:172.21.15.2:3300/0 conn(0x7fe568143ae0 0x7fe5680b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:17.386 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.383+0000 7fe56ccaa700 1 -- 172.21.15.192:0/2950951971 >> 172.21.15.192:0/2950951971 conn(0x7fe5680b2740 msgr2=0x7fe5680b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:17.386 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.383+0000 7fe56ccaa700 1 -- 172.21.15.192:0/2950951971 shutdown_connections 2023-11-26T07:11:17.386 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.383+0000 7fe56ccaa700 1 -- 172.21.15.192:0/2950951971 wait complete. 2023-11-26T07:11:17.389 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.384+0000 7fe56ccaa700 1 Processor -- start 2023-11-26T07:11:17.389 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.384+0000 7fe56ccaa700 1 -- start start 2023-11-26T07:11:17.389 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.385+0000 7fe56ccaa700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5680722c0 0x7fe568155920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:17.389 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.385+0000 7fe56ccaa700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe568143ae0 0x7fe5680cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:17.389 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.385+0000 7fe56ccaa700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5681440f0 0x7fe568159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:17.389 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.385+0000 7fe56ccaa700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5680ccd50 con 0x7fe5681440f0 2023-11-26T07:11:17.389 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.385+0000 7fe56ccaa700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5680cca70 con 0x7fe5680722c0 2023-11-26T07:11:17.389 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.385+0000 7fe56ccaa700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe568156130 con 0x7fe568143ae0 2023-11-26T07:11:17.389 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.385+0000 7fe56659c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5680722c0 0x7fe568155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:17.389 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.385+0000 7fe56659c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5680722c0 0x7fe568155920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33102/0 (socket says 172.21.15.192:33102) 2023-11-26T07:11:17.390 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.385+0000 7fe56659c700 1 -- 172.21.15.192:0/1720971720 learned_addr learned my addr 172.21.15.192:0/1720971720 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-11-26T07:11:17.390 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.385+0000 7fe565d9b700 1 --2- 172.21.15.192:0/1720971720 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe568143ae0 0x7fe5680cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:17.390 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.385+0000 7fe566d9d700 1 --2- 172.21.15.192:0/1720971720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5681440f0 0x7fe568159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:17.390 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.385+0000 7fe565d9b700 1 -- 172.21.15.192:0/1720971720 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5680722c0 msgr2=0x7fe568155920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:17.390 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.385+0000 7fe565d9b700 1 --2- 172.21.15.192:0/1720971720 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5680722c0 0x7fe568155920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:17.390 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.385+0000 7fe565d9b700 1 -- 172.21.15.192:0/1720971720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5681440f0 msgr2=0x7fe568159bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:17.390 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.385+0000 7fe565d9b700 1 --2- 172.21.15.192:0/1720971720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5681440f0 0x7fe568159bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:17.390 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.385+0000 7fe565d9b700 1 -- 172.21.15.192:0/1720971720 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe560009b30 con 0x7fe568143ae0 2023-11-26T07:11:17.390 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.385+0000 7fe56659c700 1 --2- 172.21.15.192:0/1720971720 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5680722c0 0x7fe568155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:11:17.390 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.385+0000 7fe565d9b700 1 --2- 172.21.15.192:0/1720971720 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe568143ae0 0x7fe5680cbfa0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe55c000f60 tx=0x7fe55c00c6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:17.390 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.385+0000 7fe556ffd700 1 -- 172.21.15.192:0/1720971720 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c0052d0 con 0x7fe568143ae0 2023-11-26T07:11:17.390 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.385+0000 7fe556ffd700 1 -- 172.21.15.192:0/1720971720 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55c005430 con 0x7fe568143ae0 2023-11-26T07:11:17.390 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.385+0000 7fe56ccaa700 1 -- 172.21.15.192:0/1720971720 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe568156410 con 0x7fe568143ae0 2023-11-26T07:11:17.390 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.386+0000 7fe556ffd700 1 -- 172.21.15.192:0/1720971720 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c0038c0 con 0x7fe568143ae0 2023-11-26T07:11:17.391 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.386+0000 7fe56ccaa700 1 -- 172.21.15.192:0/1720971720 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5680cb2f0 con 0x7fe568143ae0 2023-11-26T07:11:17.391 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.386+0000 7fe556ffd700 1 -- 172.21.15.192:0/1720971720 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe55c01c440 con 0x7fe568143ae0 2023-11-26T07:11:17.391 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.386+0000 7fe556ffd700 1 -- 172.21.15.192:0/1720971720 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fe55c012420 con 0x7fe568143ae0 2023-11-26T07:11:17.391 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.386+0000 7fe56ccaa700 1 -- 172.21.15.192:0/1720971720 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe568156a60 con 0x7fe568143ae0 2023-11-26T07:11:17.391 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:11:17.388+0000 7f8e31361200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-26T07:11:17.391 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.389+0000 7fe556ffd700 1 -- 172.21.15.192:0/1720971720 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fe55c017070 con 0x7fe568143ae0 2023-11-26T07:11:17.410 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-26T07:11:17.408+0000 7f8e0c58d200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-26T07:11:17.474 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.473+0000 7fe56ccaa700 1 -- 172.21.15.192:0/1720971720 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9cdfa5be-c35c-45f7-971a-72fc638dcbe6", "id": 1} v 0) v1 -- 0x7fe568144830 con 0x7fe568143ae0 2023-11-26T07:11:17.478 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.476+0000 7fe556ffd700 1 -- 172.21.15.192:0/1720971720 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9cdfa5be-c35c-45f7-971a-72fc638dcbe6", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe55c01c880 con 0x7fe568143ae0 2023-11-26T07:11:17.478 INFO:teuthology.orchestra.run.smithi192.stdout:1 2023-11-26T07:11:17.479 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.477+0000 7fe56ccaa700 1 -- 172.21.15.192:0/1720971720 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe568143ae0 msgr2=0x7fe5680cbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:17.479 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.477+0000 7fe56ccaa700 1 --2- 172.21.15.192:0/1720971720 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe568143ae0 0x7fe5680cbfa0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe55c000f60 tx=0x7fe55c00c6e0 comp rx=0 tx=0).stop 2023-11-26T07:11:17.479 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.477+0000 7fe56ccaa700 1 -- 172.21.15.192:0/1720971720 shutdown_connections 2023-11-26T07:11:17.479 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.477+0000 7fe56ccaa700 1 --2- 172.21.15.192:0/1720971720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5681440f0 0x7fe568159bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:17.479 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.477+0000 7fe56ccaa700 1 --2- 172.21.15.192:0/1720971720 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5680722c0 0x7fe568155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:17.479 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.477+0000 7fe56ccaa700 1 --2- 172.21.15.192:0/1720971720 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe568143ae0 0x7fe5680cbfa0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:17.479 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.477+0000 7fe56ccaa700 1 -- 172.21.15.192:0/1720971720 >> 172.21.15.192:0/1720971720 conn(0x7fe5680b2740 msgr2=0x7fe56806ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:17.479 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.477+0000 7fe56ccaa700 1 -- 172.21.15.192:0/1720971720 shutdown_connections 2023-11-26T07:11:17.480 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.477+0000 7fe56ccaa700 1 -- 172.21.15.192:0/1720971720 wait complete. 2023-11-26T07:11:17.492 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 6fa77818-2fc2-41c1-9e88-8806f025944c 2 2023-11-26T07:11:17.515 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:11:17.513+0000 7f8e31361200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-26T07:11:17.531 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-26T07:11:17.529+0000 7f8e0c58d200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-26T07:11:17.612 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:11:17.610+0000 7f8e31361200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-26T07:11:17.613 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.612+0000 7f7ef78d8700 1 Processor -- start 2023-11-26T07:11:17.613 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.612+0000 7f7ef78d8700 1 -- start start 2023-11-26T07:11:17.616 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.613+0000 7f7ef78d8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ef015bde0 0x7f7ef015c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:17.616 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.613+0000 7f7ef78d8700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7ef00ce5c0 0x7f7ef00cea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:17.616 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.613+0000 7f7ef78d8700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef00d0a90 con 0x7f7ef00cf2b0 2023-11-26T07:11:17.616 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.613+0000 7f7ef78d8700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef00cef90 con 0x7f7ef00ce5c0 2023-11-26T07:11:17.616 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.613+0000 7f7ef78d8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef006ee10 con 0x7f7ef015bde0 2023-11-26T07:11:17.616 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.613+0000 7f7ef5e75700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7ef00ce5c0 0x7f7ef00cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:17.616 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.613+0000 7f7ef5674700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ef015bde0 0x7f7ef015c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:17.617 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.613+0000 7f7ef4e73700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f7ef00cf2b0 0x7f7ef00d01b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:42352/0 (socket says 172.21.15.192:42352) 2023-11-26T07:11:17.617 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.613+0000 7f7ef4e73700 1 -- 172.21.15.192:0/2541852626 learned_addr learned my addr 172.21.15.192:0/2541852626 (peer_addr_for_me v1:172.21.15.192:0/0) 2023-11-26T07:11:17.617 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.614+0000 7f7ef5e75700 1 -- 172.21.15.192:0/2541852626 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ef015bde0 msgr2=0x7f7ef015c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:17.617 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.614+0000 7f7ef5e75700 1 --2- 172.21.15.192:0/2541852626 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ef015bde0 0x7f7ef015c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:17.617 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.614+0000 7f7ef5e75700 1 -- 172.21.15.192:0/2541852626 >> v1:172.21.15.192:6789/0 conn(0x7f7ef00cf2b0 legacy=0x7f7ef00d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:17.617 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.614+0000 7f7ef5e75700 1 -- 172.21.15.192:0/2541852626 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef006f0f0 con 0x7f7ef00ce5c0 2023-11-26T07:11:17.617 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.614+0000 7f7ee7fff700 1 -- 172.21.15.192:0/2541852626 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1751223337 0 0) 0x7f7ef00d0a90 con 0x7f7ef00cf2b0 2023-11-26T07:11:17.617 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.614+0000 7f7ef5674700 1 --2- 172.21.15.192:0/2541852626 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ef015bde0 0x7f7ef015c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:11:17.617 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.614+0000 7f7ef5e75700 1 --2- 172.21.15.192:0/2541852626 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ef00ce5c0 0x7f7ef00cea50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8009d90 tx=0x7f7ee800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e109e61f1dab14a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:17.617 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.614+0000 7f7ee7fff700 1 -- 172.21.15.192:0/2541852626 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee800e070 con 0x7f7ef00ce5c0 2023-11-26T07:11:17.617 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.614+0000 7f7ee7fff700 1 -- 172.21.15.192:0/2541852626 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee800bb20 con 0x7f7ef00ce5c0 2023-11-26T07:11:17.617 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.614+0000 7f7ee7fff700 1 -- 172.21.15.192:0/2541852626 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee8012430 con 0x7f7ef00ce5c0 2023-11-26T07:11:17.618 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.615+0000 7f7ef78d8700 1 -- 172.21.15.192:0/2541852626 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ef00ce5c0 msgr2=0x7f7ef00cea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:17.618 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.615+0000 7f7ef78d8700 1 --2- 172.21.15.192:0/2541852626 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ef00ce5c0 0x7f7ef00cea50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8009d90 tx=0x7f7ee800b330 comp rx=0 tx=0).stop 2023-11-26T07:11:17.619 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.615+0000 7f7ef78d8700 1 -- 172.21.15.192:0/2541852626 shutdown_connections 2023-11-26T07:11:17.619 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.615+0000 7f7ef78d8700 1 --2- 172.21.15.192:0/2541852626 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ef00ce5c0 0x7f7ef00cea50 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:17.619 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.615+0000 7f7ef78d8700 1 --2- 172.21.15.192:0/2541852626 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ef015bde0 0x7f7ef015c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:17.619 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.615+0000 7f7ef78d8700 1 -- 172.21.15.192:0/2541852626 >> 172.21.15.192:0/2541852626 conn(0x7f7ef00b3720 msgr2=0x7f7ef00b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:17.619 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.615+0000 7f7ef78d8700 1 -- 172.21.15.192:0/2541852626 shutdown_connections 2023-11-26T07:11:17.619 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.615+0000 7f7ef78d8700 1 -- 172.21.15.192:0/2541852626 wait complete. 2023-11-26T07:11:17.619 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.616+0000 7f7ef78d8700 1 Processor -- start 2023-11-26T07:11:17.619 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.617+0000 7f7ef78d8700 1 -- start start 2023-11-26T07:11:17.621 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.617+0000 7f7ef78d8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ef00ce5c0 0x7f7ef015a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:17.621 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.617+0000 7f7ef78d8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ef00cf2b0 0x7f7ef00c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:17.622 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.617+0000 7f7ef78d8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ef015bde0 0x7f7ef00ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:17.622 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.617+0000 7f7ef78d8700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef015aaf0 con 0x7f7ef00cf2b0 2023-11-26T07:11:17.622 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.617+0000 7f7ef78d8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef00c9610 con 0x7f7ef015bde0 2023-11-26T07:11:17.622 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.617+0000 7f7ef78d8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef00c98f0 con 0x7f7ef00ce5c0 2023-11-26T07:11:17.622 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.618+0000 7f7ef5674700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ef00ce5c0 0x7f7ef015a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:17.622 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.618+0000 7f7ef5674700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ef00ce5c0 0x7f7ef015a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:53666/0 (socket says 172.21.15.192:53666) 2023-11-26T07:11:17.622 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.618+0000 7f7ef5674700 1 -- 172.21.15.192:0/1996753168 learned_addr learned my addr 172.21.15.192:0/1996753168 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-11-26T07:11:17.622 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.618+0000 7f7ef5e75700 1 --2- 172.21.15.192:0/1996753168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ef015bde0 0x7f7ef00ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:17.622 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.618+0000 7f7ef4e73700 1 --2- 172.21.15.192:0/1996753168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ef00cf2b0 0x7f7ef00c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:17.622 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.618+0000 7f7ef5674700 1 -- 172.21.15.192:0/1996753168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ef015bde0 msgr2=0x7f7ef00ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:17.622 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.618+0000 7f7ef5674700 1 --2- 172.21.15.192:0/1996753168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ef015bde0 0x7f7ef00ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:17.622 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.618+0000 7f7ef5674700 1 -- 172.21.15.192:0/1996753168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ef00cf2b0 msgr2=0x7f7ef00c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:17.622 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.618+0000 7f7ef5674700 1 --2- 172.21.15.192:0/1996753168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ef00cf2b0 0x7f7ef00c8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:17.623 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.618+0000 7f7ef5674700 1 -- 172.21.15.192:0/1996753168 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eec0094a0 con 0x7f7ef00ce5c0 2023-11-26T07:11:17.623 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.618+0000 7f7ef5e75700 1 --2- 172.21.15.192:0/1996753168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ef015bde0 0x7f7ef00ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:11:17.623 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.618+0000 7f7ef5674700 1 --2- 172.21.15.192:0/1996753168 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ef00ce5c0 0x7f7ef015a5b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7eec00ebe0 tx=0x7f7eec00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:17.623 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.618+0000 7f7ee5ffb700 1 -- 172.21.15.192:0/1996753168 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec009800 con 0x7f7ef00ce5c0 2023-11-26T07:11:17.623 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.618+0000 7f7ee5ffb700 1 -- 172.21.15.192:0/1996753168 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eec00c910 con 0x7f7ef00ce5c0 2023-11-26T07:11:17.623 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.618+0000 7f7ef78d8700 1 -- 172.21.15.192:0/1996753168 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee8009a70 con 0x7f7ef00ce5c0 2023-11-26T07:11:17.623 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.618+0000 7f7ee5ffb700 1 -- 172.21.15.192:0/1996753168 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec00cc80 con 0x7f7ef00ce5c0 2023-11-26T07:11:17.623 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.618+0000 7f7ef78d8700 1 -- 172.21.15.192:0/1996753168 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef00c9eb0 con 0x7f7ef00ce5c0 2023-11-26T07:11:17.623 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.619+0000 7f7ee5ffb700 1 -- 172.21.15.192:0/1996753168 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7eec005d20 con 0x7f7ef00ce5c0 2023-11-26T07:11:17.623 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.619+0000 7f7ee5ffb700 1 -- 172.21.15.192:0/1996753168 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f7eec0068e0 con 0x7f7ef00ce5c0 2023-11-26T07:11:17.623 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.619+0000 7f7ef78d8700 1 -- 172.21.15.192:0/1996753168 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ef0075480 con 0x7f7ef00ce5c0 2023-11-26T07:11:17.624 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.622+0000 7f7ee5ffb700 1 -- 172.21.15.192:0/1996753168 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f7eec021060 con 0x7f7ef00ce5c0 2023-11-26T07:11:17.626 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-26T07:11:17.624+0000 7f8e0c58d200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-26T07:11:17.697 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:11:17.695+0000 7f8e31361200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-26T07:11:17.708 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.706+0000 7f7ef78d8700 1 -- 172.21.15.192:0/1996753168 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6fa77818-2fc2-41c1-9e88-8806f025944c", "id": 2} v 0) v1 -- 0x7f7ef00c4e20 con 0x7f7ef00ce5c0 2023-11-26T07:11:17.711 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-26T07:11:17.709+0000 7f8e0c58d200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-26T07:11:17.711 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.709+0000 7f7ee5ffb700 1 -- 172.21.15.192:0/1996753168 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6fa77818-2fc2-41c1-9e88-8806f025944c", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7eec017070 con 0x7f7ef00ce5c0 2023-11-26T07:11:17.711 INFO:teuthology.orchestra.run.smithi192.stdout:2 2023-11-26T07:11:17.712 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.710+0000 7f7ef78d8700 1 -- 172.21.15.192:0/1996753168 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ef00ce5c0 msgr2=0x7f7ef015a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:17.712 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.710+0000 7f7ef78d8700 1 --2- 172.21.15.192:0/1996753168 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ef00ce5c0 0x7f7ef015a5b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7eec00ebe0 tx=0x7f7eec00eef0 comp rx=0 tx=0).stop 2023-11-26T07:11:17.713 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.710+0000 7f7ef78d8700 1 -- 172.21.15.192:0/1996753168 shutdown_connections 2023-11-26T07:11:17.713 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.710+0000 7f7ef78d8700 1 --2- 172.21.15.192:0/1996753168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ef015bde0 0x7f7ef00ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:17.713 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.710+0000 7f7ef78d8700 1 --2- 172.21.15.192:0/1996753168 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ef00ce5c0 0x7f7ef015a5b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:17.713 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.710+0000 7f7ef78d8700 1 --2- 172.21.15.192:0/1996753168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ef00cf2b0 0x7f7ef00c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:17.713 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.710+0000 7f7ef78d8700 1 -- 172.21.15.192:0/1996753168 >> 172.21.15.192:0/1996753168 conn(0x7f7ef00b3720 msgr2=0x7f7ef00aed00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:17.713 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.710+0000 7f7ef78d8700 1 -- 172.21.15.192:0/1996753168 shutdown_connections 2023-11-26T07:11:17.713 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.711+0000 7f7ef78d8700 1 -- 172.21.15.192:0/1996753168 wait complete. 2023-11-26T07:11:17.724 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 941db088-aa06-421b-8a75-10beef13de2a 3 2023-11-26T07:11:17.888 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.886+0000 7f24e04c1700 1 Processor -- start 2023-11-26T07:11:17.888 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.886+0000 7f24e04c1700 1 -- start start 2023-11-26T07:11:17.890 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.887+0000 7f24e04c1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24d806f700 0x7f24d815eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:17.890 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.887+0000 7f24e04c1700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24d806e9d0 con 0x7f24d80d1100 2023-11-26T07:11:17.890 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.887+0000 7f24e04c1700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24d806f270 con 0x7f24d8144610 2023-11-26T07:11:17.890 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.887+0000 7f24e04c1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d81449f0 con 0x7f24d806f700 2023-11-26T07:11:17.891 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.887+0000 7f24de25d700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f24d8144610 0x7f24d80d09f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:42362/0 (socket says 172.21.15.192:42362) 2023-11-26T07:11:17.891 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.887+0000 7f24de25d700 1 -- 172.21.15.192:0/149642816 learned_addr learned my addr 172.21.15.192:0/149642816 (peer_addr_for_me v1:172.21.15.192:0/0) 2023-11-26T07:11:17.891 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.887+0000 7f24dea5e700 1 --2- 172.21.15.192:0/149642816 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24d806f700 0x7f24d815eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:17.891 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.887+0000 7f24dd25b700 1 -- 172.21.15.192:0/149642816 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4085978640 0 0) 0x7f24d806f270 con 0x7f24d8144610 2023-11-26T07:11:17.891 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.887+0000 7f24dd25b700 1 -- 172.21.15.192:0/149642816 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24c40035b0 con 0x7f24d8144610 2023-11-26T07:11:17.891 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.887+0000 7f24dea5e700 1 -- 172.21.15.192:0/149642816 >> v1:172.21.15.192:6789/0 conn(0x7f24d8144610 legacy=0x7f24d80d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:17.891 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.887+0000 7f24dea5e700 1 -- 172.21.15.192:0/149642816 >> v1:172.21.15.2:6789/0 conn(0x7f24d80d1100 legacy=0x7f24d815e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:17.891 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.887+0000 7f24dea5e700 1 -- 172.21.15.192:0/149642816 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d815f530 con 0x7f24d806f700 2023-11-26T07:11:17.891 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.888+0000 7f24dea5e700 1 --2- 172.21.15.192:0/149642816 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24d806f700 0x7f24d815eed0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f24d0009dc0 tx=0x7f24d000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36afa46fafeb93c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:17.891 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.888+0000 7f24dd25b700 1 -- 172.21.15.192:0/149642816 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d000e070 con 0x7f24d806f700 2023-11-26T07:11:17.891 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.888+0000 7f24dd25b700 1 -- 172.21.15.192:0/149642816 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d000bb20 con 0x7f24d806f700 2023-11-26T07:11:17.891 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.888+0000 7f24dd25b700 1 -- 172.21.15.192:0/149642816 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d0012430 con 0x7f24d806f700 2023-11-26T07:11:17.892 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.888+0000 7f24e04c1700 1 -- 172.21.15.192:0/149642816 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24d806f700 msgr2=0x7f24d815eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:17.892 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.888+0000 7f24e04c1700 1 --2- 172.21.15.192:0/149642816 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24d806f700 0x7f24d815eed0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f24d0009dc0 tx=0x7f24d000b330 comp rx=0 tx=0).stop 2023-11-26T07:11:17.892 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.888+0000 7f24e04c1700 1 -- 172.21.15.192:0/149642816 shutdown_connections 2023-11-26T07:11:17.892 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.888+0000 7f24e04c1700 1 --2- 172.21.15.192:0/149642816 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24d806f700 0x7f24d815eed0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:17.892 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.889+0000 7f24e04c1700 1 -- 172.21.15.192:0/149642816 >> 172.21.15.192:0/149642816 conn(0x7f24d80b2740 msgr2=0x7f24d80b2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:17.892 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.889+0000 7f24e04c1700 1 -- 172.21.15.192:0/149642816 shutdown_connections 2023-11-26T07:11:17.892 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.889+0000 7f24e04c1700 1 -- 172.21.15.192:0/149642816 wait complete. 2023-11-26T07:11:17.894 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.890+0000 7f24e04c1700 1 Processor -- start 2023-11-26T07:11:17.894 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.890+0000 7f24e04c1700 1 -- start start 2023-11-26T07:11:17.894 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.891+0000 7f24e04c1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24d806f700 0x7f24d81574b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:17.894 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.891+0000 7f24e04c1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24d80d1100 0x7f24d8142060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:17.894 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.891+0000 7f24e04c1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24d8144610 0x7f24d81425a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:17.895 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.891+0000 7f24e04c1700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d81435a0 con 0x7f24d8144610 2023-11-26T07:11:17.895 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.891+0000 7f24e04c1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d815b130 con 0x7f24d806f700 2023-11-26T07:11:17.895 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.891+0000 7f24e04c1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d815b410 con 0x7f24d80d1100 2023-11-26T07:11:17.895 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.891+0000 7f24de25d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24d806f700 0x7f24d81574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:17.895 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.891+0000 7f24de25d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24d806f700 0x7f24d81574b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33122/0 (socket says 172.21.15.192:33122) 2023-11-26T07:11:17.895 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.891+0000 7f24de25d700 1 -- 172.21.15.192:0/507654311 learned_addr learned my addr 172.21.15.192:0/507654311 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-11-26T07:11:17.895 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.891+0000 7f24dda5c700 1 --2- 172.21.15.192:0/507654311 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24d80d1100 0x7f24d8142060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:17.895 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.891+0000 7f24dea5e700 1 --2- 172.21.15.192:0/507654311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24d8144610 0x7f24d81425a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:17.895 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.891+0000 7f24de25d700 1 -- 172.21.15.192:0/507654311 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24d80d1100 msgr2=0x7f24d8142060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:17.895 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.891+0000 7f24de25d700 1 --2- 172.21.15.192:0/507654311 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24d80d1100 0x7f24d8142060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:17.895 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.891+0000 7f24de25d700 1 -- 172.21.15.192:0/507654311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24d8144610 msgr2=0x7f24d81425a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:17.895 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.891+0000 7f24de25d700 1 --2- 172.21.15.192:0/507654311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24d8144610 0x7f24d81425a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:17.896 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.891+0000 7f24de25d700 1 -- 172.21.15.192:0/507654311 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d0009a70 con 0x7f24d806f700 2023-11-26T07:11:17.896 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.892+0000 7f24de25d700 1 --2- 172.21.15.192:0/507654311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24d806f700 0x7f24d81574b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f24d400c700 tx=0x7f24d400ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:17.896 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.892+0000 7f24ceffd700 1 -- 172.21.15.192:0/507654311 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d4005d70 con 0x7f24d806f700 2023-11-26T07:11:17.896 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.892+0000 7f24ceffd700 1 -- 172.21.15.192:0/507654311 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d40070d0 con 0x7f24d806f700 2023-11-26T07:11:17.896 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.892+0000 7f24ceffd700 1 -- 172.21.15.192:0/507654311 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d4007460 con 0x7f24d806f700 2023-11-26T07:11:17.896 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.892+0000 7f24e04c1700 1 -- 172.21.15.192:0/507654311 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24d81417a0 con 0x7f24d806f700 2023-11-26T07:11:17.896 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.892+0000 7f24e04c1700 1 -- 172.21.15.192:0/507654311 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24d815e3e0 con 0x7f24d806f700 2023-11-26T07:11:17.896 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.892+0000 7f24ceffd700 1 -- 172.21.15.192:0/507654311 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f24d401c440 con 0x7f24d806f700 2023-11-26T07:11:17.896 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.892+0000 7f24ceffd700 1 -- 172.21.15.192:0/507654311 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f24d4012890 con 0x7f24d806f700 2023-11-26T07:11:17.897 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.893+0000 7f24e04c1700 1 -- 172.21.15.192:0/507654311 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24d8141cc0 con 0x7f24d806f700 2023-11-26T07:11:17.897 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.895+0000 7f24ceffd700 1 -- 172.21.15.192:0/507654311 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f24d4017070 con 0x7f24d806f700 2023-11-26T07:11:17.982 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.981+0000 7f24e04c1700 1 -- 172.21.15.192:0/507654311 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd new", "uuid": "941db088-aa06-421b-8a75-10beef13de2a", "id": 3} v 0) v1 -- 0x7f24d8075480 con 0x7f24d806f700 2023-11-26T07:11:17.988 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.986+0000 7f24ceffd700 1 -- 172.21.15.192:0/507654311 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "941db088-aa06-421b-8a75-10beef13de2a", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f24d40124d0 con 0x7f24d806f700 2023-11-26T07:11:17.988 INFO:teuthology.orchestra.run.smithi192.stdout:3 2023-11-26T07:11:17.989 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.987+0000 7f24e04c1700 1 -- 172.21.15.192:0/507654311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24d806f700 msgr2=0x7f24d81574b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:17.989 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.987+0000 7f24e04c1700 1 --2- 172.21.15.192:0/507654311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24d806f700 0x7f24d81574b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f24d400c700 tx=0x7f24d400ca10 comp rx=0 tx=0).stop 2023-11-26T07:11:17.990 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.987+0000 7f24e04c1700 1 -- 172.21.15.192:0/507654311 shutdown_connections 2023-11-26T07:11:17.990 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.987+0000 7f24e04c1700 1 --2- 172.21.15.192:0/507654311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24d8144610 0x7f24d81425a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:17.990 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.987+0000 7f24e04c1700 1 --2- 172.21.15.192:0/507654311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24d806f700 0x7f24d81574b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:17.990 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.987+0000 7f24e04c1700 1 --2- 172.21.15.192:0/507654311 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24d80d1100 0x7f24d8142060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:17.990 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.987+0000 7f24e04c1700 1 -- 172.21.15.192:0/507654311 >> 172.21.15.192:0/507654311 conn(0x7f24d80b2740 msgr2=0x7f24d80b19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:17.990 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.988+0000 7f24e04c1700 1 -- 172.21.15.192:0/507654311 shutdown_connections 2023-11-26T07:11:17.990 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:17.988+0000 7f24e04c1700 1 -- 172.21.15.192:0/507654311 wait complete. 2023-11-26T07:11:18.001 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 4149f273-5910-417d-84e3-ed20681df1fc 4 2023-11-26T07:11:18.122 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.120+0000 7fb3fe7a9700 1 Processor -- start 2023-11-26T07:11:18.123 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.121+0000 7fb3fe7a9700 1 -- start start 2023-11-26T07:11:18.125 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.121+0000 7fb3fe7a9700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb3f80b21d0 0x7fb3f80b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:18.126 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.121+0000 7fb3fe7a9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3f80d0ff0 0x7fb3f80cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:18.126 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.121+0000 7fb3fe7a9700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3f806caf0 con 0x7fb3f80b28a0 2023-11-26T07:11:18.126 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.121+0000 7fb3fe7a9700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3f80cf250 con 0x7fb3f80b21d0 2023-11-26T07:11:18.126 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.121+0000 7fb3fe7a9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f806cdb0 con 0x7fb3f80d0ff0 2023-11-26T07:11:18.126 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.121+0000 7fb3fcd46700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3f80d0ff0 0x7fb3f80cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:18.126 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.122+0000 7fb3fcd46700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3f80d0ff0 0x7fb3f80cebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:53686/0 (socket says 172.21.15.192:53686) 2023-11-26T07:11:18.126 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.122+0000 7fb3fcd46700 1 -- 172.21.15.192:0/3257899582 learned_addr learned my addr 172.21.15.192:0/3257899582 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-11-26T07:11:18.126 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.122+0000 7fb3f7fff700 1 --2- 172.21.15.192:0/3257899582 >> v2:172.21.15.2:3300/0 conn(0x7fb3f80b21d0 0x7fb3f80b2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:18.126 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.122+0000 7fb3fcd46700 1 -- 172.21.15.192:0/3257899582 >> v2:172.21.15.2:3300/0 conn(0x7fb3f80b21d0 msgr2=0x7fb3f80b2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:18.126 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.122+0000 7fb3fcd46700 1 --2- 172.21.15.192:0/3257899582 >> v2:172.21.15.2:3300/0 conn(0x7fb3f80b21d0 0x7fb3f80b2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:18.126 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.122+0000 7fb3fcd46700 1 -- 172.21.15.192:0/3257899582 >> v1:172.21.15.2:6789/0 conn(0x7fb3f80b28a0 legacy=0x7fb3f80ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:18.127 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.122+0000 7fb3fcd46700 1 -- 172.21.15.192:0/3257899582 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f806d090 con 0x7fb3f80d0ff0 2023-11-26T07:11:18.127 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.122+0000 7fb3fcd46700 1 --2- 172.21.15.192:0/3257899582 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3f80d0ff0 0x7fb3f80cebe0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0009e50 tx=0x7fb3f000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=823e0fd3e80c1ec6 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:18.127 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.122+0000 7fb3f6ffd700 1 -- 172.21.15.192:0/3257899582 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f000e070 con 0x7fb3f80d0ff0 2023-11-26T07:11:18.127 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.122+0000 7fb3f6ffd700 1 -- 172.21.15.192:0/3257899582 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f000b910 con 0x7fb3f80d0ff0 2023-11-26T07:11:18.127 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.122+0000 7fb3f6ffd700 1 -- 172.21.15.192:0/3257899582 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f000bcc0 con 0x7fb3f80d0ff0 2023-11-26T07:11:18.127 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.123+0000 7fb3fe7a9700 1 -- 172.21.15.192:0/3257899582 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3f80d0ff0 msgr2=0x7fb3f80cebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:18.127 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.123+0000 7fb3fe7a9700 1 --2- 172.21.15.192:0/3257899582 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3f80d0ff0 0x7fb3f80cebe0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0009e50 tx=0x7fb3f000b330 comp rx=0 tx=0).stop 2023-11-26T07:11:18.127 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.123+0000 7fb3fe7a9700 1 -- 172.21.15.192:0/3257899582 shutdown_connections 2023-11-26T07:11:18.127 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.123+0000 7fb3fe7a9700 1 --2- 172.21.15.192:0/3257899582 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3f80d0ff0 0x7fb3f80cebe0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:18.127 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.123+0000 7fb3fe7a9700 1 --2- 172.21.15.192:0/3257899582 >> v2:172.21.15.2:3300/0 conn(0x7fb3f80b21d0 0x7fb3f80b2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:18.128 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.123+0000 7fb3fe7a9700 1 -- 172.21.15.192:0/3257899582 >> 172.21.15.192:0/3257899582 conn(0x7fb3f80b3800 msgr2=0x7fb3f80b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:18.128 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.123+0000 7fb3fe7a9700 1 -- 172.21.15.192:0/3257899582 shutdown_connections 2023-11-26T07:11:18.128 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.123+0000 7fb3fe7a9700 1 -- 172.21.15.192:0/3257899582 wait complete. 2023-11-26T07:11:18.130 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.124+0000 7fb3fe7a9700 1 Processor -- start 2023-11-26T07:11:18.130 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.125+0000 7fb3fe7a9700 1 -- start start 2023-11-26T07:11:18.130 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.125+0000 7fb3fe7a9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3f80b21d0 0x7fb3f80c90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:18.130 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.125+0000 7fb3fe7a9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3f80d0ff0 0x7fb3f80ca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:18.131 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.125+0000 7fb3fe7a9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3f8152b30 0x7fb3f81f2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:18.131 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.125+0000 7fb3fe7a9700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f80c9620 con 0x7fb3f80b21d0 2023-11-26T07:11:18.131 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.125+0000 7fb3fe7a9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f80cb2c0 con 0x7fb3f8152b30 2023-11-26T07:11:18.131 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.125+0000 7fb3fe7a9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f80cb5a0 con 0x7fb3f80d0ff0 2023-11-26T07:11:18.131 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.126+0000 7fb3f77fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3f80d0ff0 0x7fb3f80ca9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:18.131 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.126+0000 7fb3fcd46700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3f8152b30 0x7fb3f81f2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:18.131 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.126+0000 7fb3f7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3f80b21d0 0x7fb3f80c90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:18.131 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.126+0000 7fb3fcd46700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3f8152b30 0x7fb3f81f2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33138/0 (socket says 172.21.15.192:33138) 2023-11-26T07:11:18.131 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.126+0000 7fb3fcd46700 1 -- 172.21.15.192:0/148945413 learned_addr learned my addr 172.21.15.192:0/148945413 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-11-26T07:11:18.131 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.126+0000 7fb3f77fe700 1 -- 172.21.15.192:0/148945413 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3f8152b30 msgr2=0x7fb3f81f2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:18.132 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.126+0000 7fb3f77fe700 1 --2- 172.21.15.192:0/148945413 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3f8152b30 0x7fb3f81f2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:18.132 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.126+0000 7fb3f77fe700 1 -- 172.21.15.192:0/148945413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3f80b21d0 msgr2=0x7fb3f80c90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:18.132 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.126+0000 7fb3f77fe700 1 --2- 172.21.15.192:0/148945413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3f80b21d0 0x7fb3f80c90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:18.132 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.126+0000 7fb3f77fe700 1 -- 172.21.15.192:0/148945413 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f0009b30 con 0x7fb3f80d0ff0 2023-11-26T07:11:18.132 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.126+0000 7fb3f7fff700 1 --2- 172.21.15.192:0/148945413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3f80b21d0 0x7fb3f80c90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:11:18.132 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.126+0000 7fb3fcd46700 1 --2- 172.21.15.192:0/148945413 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3f8152b30 0x7fb3f81f2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:11:18.132 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.126+0000 7fb3f77fe700 1 --2- 172.21.15.192:0/148945413 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3f80d0ff0 0x7fb3f80ca9e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec000f60 tx=0x7fb3ec00c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:18.132 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.126+0000 7fb3f4ff9700 1 -- 172.21.15.192:0/148945413 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec0052d0 con 0x7fb3f80d0ff0 2023-11-26T07:11:18.132 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.126+0000 7fb3f4ff9700 1 -- 172.21.15.192:0/148945413 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3ec005430 con 0x7fb3f80d0ff0 2023-11-26T07:11:18.132 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.126+0000 7fb3fe7a9700 1 -- 172.21.15.192:0/148945413 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3f80cb880 con 0x7fb3f80d0ff0 2023-11-26T07:11:18.132 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.126+0000 7fb3f4ff9700 1 -- 172.21.15.192:0/148945413 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec0038c0 con 0x7fb3f80d0ff0 2023-11-26T07:11:18.132 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.126+0000 7fb3fe7a9700 1 -- 172.21.15.192:0/148945413 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3f80caf20 con 0x7fb3f80d0ff0 2023-11-26T07:11:18.133 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.127+0000 7fb3f4ff9700 1 -- 172.21.15.192:0/148945413 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb3ec003d20 con 0x7fb3f80d0ff0 2023-11-26T07:11:18.133 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.127+0000 7fb3f4ff9700 1 -- 172.21.15.192:0/148945413 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fb3ec011d10 con 0x7fb3f80d0ff0 2023-11-26T07:11:18.133 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.128+0000 7fb3fe7a9700 1 -- 172.21.15.192:0/148945413 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3f80cbda0 con 0x7fb3f80d0ff0 2023-11-26T07:11:18.133 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.130+0000 7fb3f4ff9700 1 -- 172.21.15.192:0/148945413 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fb3ec017070 con 0x7fb3f80d0ff0 2023-11-26T07:11:18.152 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:11:18.151+0000 7f8e31361200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-26T07:11:18.161 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-26T07:11:18.160+0000 7f8e0c58d200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-26T07:11:18.216 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.214+0000 7fb3fe7a9700 1 -- 172.21.15.192:0/148945413 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4149f273-5910-417d-84e3-ed20681df1fc", "id": 4} v 0) v1 -- 0x7fb3f8075480 con 0x7fb3f80d0ff0 2023-11-26T07:11:18.223 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.222+0000 7fb3f4ff9700 1 -- 172.21.15.192:0/148945413 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4149f273-5910-417d-84e3-ed20681df1fc", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb3ec00ce30 con 0x7fb3f80d0ff0 2023-11-26T07:11:18.224 INFO:teuthology.orchestra.run.smithi192.stdout:4 2023-11-26T07:11:18.225 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.223+0000 7fb3fe7a9700 1 -- 172.21.15.192:0/148945413 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3f80d0ff0 msgr2=0x7fb3f80ca9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:18.225 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.223+0000 7fb3fe7a9700 1 --2- 172.21.15.192:0/148945413 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3f80d0ff0 0x7fb3f80ca9e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec000f60 tx=0x7fb3ec00c730 comp rx=0 tx=0).stop 2023-11-26T07:11:18.225 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.223+0000 7fb3fe7a9700 1 -- 172.21.15.192:0/148945413 shutdown_connections 2023-11-26T07:11:18.225 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.223+0000 7fb3fe7a9700 1 --2- 172.21.15.192:0/148945413 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3f8152b30 0x7fb3f81f2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:18.225 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.223+0000 7fb3fe7a9700 1 --2- 172.21.15.192:0/148945413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3f80b21d0 0x7fb3f80c90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:18.225 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.223+0000 7fb3fe7a9700 1 --2- 172.21.15.192:0/148945413 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3f80d0ff0 0x7fb3f80ca9e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:18.225 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.223+0000 7fb3fe7a9700 1 -- 172.21.15.192:0/148945413 >> 172.21.15.192:0/148945413 conn(0x7fb3f80b3800 msgr2=0x7fb3f80d1400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:18.225 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.223+0000 7fb3fe7a9700 1 -- 172.21.15.192:0/148945413 shutdown_connections 2023-11-26T07:11:18.226 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.223+0000 7fb3fe7a9700 1 -- 172.21.15.192:0/148945413 wait complete. 2023-11-26T07:11:18.236 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new f72b407a-33b3-4562-a5c9-0f611f286b88 5 2023-11-26T07:11:18.357 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.355+0000 7f2a77ce8700 1 Processor -- start 2023-11-26T07:11:18.357 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.356+0000 7f2a77ce8700 1 -- start start 2023-11-26T07:11:18.360 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.357+0000 7f2a77ce8700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2a7006b620 0x7f2a700b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:18.360 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.357+0000 7f2a77ce8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a7006ee60 0x7f2a700b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:18.360 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.357+0000 7f2a77ce8700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a70071f50 con 0x7f2a700b5ab0 2023-11-26T07:11:18.360 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.357+0000 7f2a77ce8700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a70072230 con 0x7f2a7006b620 2023-11-26T07:11:18.360 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.357+0000 7f2a77ce8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a70072510 con 0x7f2a7006ee60 2023-11-26T07:11:18.361 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.357+0000 7f2a76285700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a7006ee60 0x7f2a700b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:18.361 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.357+0000 7f2a76285700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a7006ee60 0x7f2a700b3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:53698/0 (socket says 172.21.15.192:53698) 2023-11-26T07:11:18.361 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.357+0000 7f2a76285700 1 -- 172.21.15.192:0/1691470027 learned_addr learned my addr 172.21.15.192:0/1691470027 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-11-26T07:11:18.361 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.357+0000 7f2a75a84700 1 --2- 172.21.15.192:0/1691470027 >> v2:172.21.15.2:3300/0 conn(0x7f2a7006b620 0x7f2a700b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:18.361 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.357+0000 7f2a76285700 1 -- 172.21.15.192:0/1691470027 >> v2:172.21.15.2:3300/0 conn(0x7f2a7006b620 msgr2=0x7f2a700b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:18.361 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.357+0000 7f2a76285700 1 --2- 172.21.15.192:0/1691470027 >> v2:172.21.15.2:3300/0 conn(0x7f2a7006b620 0x7f2a700b3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:18.361 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.357+0000 7f2a76285700 1 -- 172.21.15.192:0/1691470027 >> v1:172.21.15.2:6789/0 conn(0x7f2a700b5ab0 legacy=0x7f2a70161ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:18.361 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.357+0000 7f2a76285700 1 -- 172.21.15.192:0/1691470027 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a700727f0 con 0x7f2a7006ee60 2023-11-26T07:11:18.361 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.357+0000 7f2a76285700 1 --2- 172.21.15.192:0/1691470027 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a7006ee60 0x7f2a700b3f80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2a68009e50 tx=0x7f2a6800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96315ad2abc09f99 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:18.362 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.357+0000 7f2a74a82700 1 -- 172.21.15.192:0/1691470027 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6800e070 con 0x7f2a7006ee60 2023-11-26T07:11:18.362 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.357+0000 7f2a74a82700 1 -- 172.21.15.192:0/1691470027 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a6800b910 con 0x7f2a7006ee60 2023-11-26T07:11:18.362 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.358+0000 7f2a74a82700 1 -- 172.21.15.192:0/1691470027 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6800bcc0 con 0x7f2a7006ee60 2023-11-26T07:11:18.362 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.358+0000 7f2a77ce8700 1 -- 172.21.15.192:0/1691470027 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a7006ee60 msgr2=0x7f2a700b3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:18.362 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.358+0000 7f2a77ce8700 1 --2- 172.21.15.192:0/1691470027 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a7006ee60 0x7f2a700b3f80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2a68009e50 tx=0x7f2a6800b330 comp rx=0 tx=0).stop 2023-11-26T07:11:18.362 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.358+0000 7f2a77ce8700 1 -- 172.21.15.192:0/1691470027 shutdown_connections 2023-11-26T07:11:18.362 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.358+0000 7f2a77ce8700 1 --2- 172.21.15.192:0/1691470027 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a7006ee60 0x7f2a700b3f80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:18.362 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.358+0000 7f2a77ce8700 1 --2- 172.21.15.192:0/1691470027 >> v2:172.21.15.2:3300/0 conn(0x7f2a7006b620 0x7f2a700b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:18.362 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.358+0000 7f2a77ce8700 1 -- 172.21.15.192:0/1691470027 >> 172.21.15.192:0/1691470027 conn(0x7f2a700b2740 msgr2=0x7f2a700b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:18.362 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.358+0000 7f2a77ce8700 1 -- 172.21.15.192:0/1691470027 shutdown_connections 2023-11-26T07:11:18.363 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.358+0000 7f2a77ce8700 1 -- 172.21.15.192:0/1691470027 wait complete. 2023-11-26T07:11:18.365 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.359+0000 7f2a77ce8700 1 Processor -- start 2023-11-26T07:11:18.365 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.359+0000 7f2a77ce8700 1 -- start start 2023-11-26T07:11:18.365 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.360+0000 7f2a77ce8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a7006b620 0x7f2a70134e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:18.366 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.360+0000 7f2a77ce8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a7006ee60 0x7f2a701e4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:18.366 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.360+0000 7f2a77ce8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a700b5ab0 0x7f2a700c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:18.366 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.360+0000 7f2a77ce8700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a700c7250 con 0x7f2a700b5ab0 2023-11-26T07:11:18.366 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.360+0000 7f2a77ce8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a700c6640 con 0x7f2a7006b620 2023-11-26T07:11:18.366 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.360+0000 7f2a77ce8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a700c6920 con 0x7f2a7006ee60 2023-11-26T07:11:18.366 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.360+0000 7f2a75a84700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a7006b620 0x7f2a70134e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:18.366 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.360+0000 7f2a75283700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a7006ee60 0x7f2a701e4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:18.366 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.360+0000 7f2a75a84700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a7006b620 0x7f2a70134e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33146/0 (socket says 172.21.15.192:33146) 2023-11-26T07:11:18.366 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.360+0000 7f2a75a84700 1 -- 172.21.15.192:0/335226582 learned_addr learned my addr 172.21.15.192:0/335226582 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-11-26T07:11:18.367 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.360+0000 7f2a76285700 1 --2- 172.21.15.192:0/335226582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a700b5ab0 0x7f2a700c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:18.367 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.360+0000 7f2a75a84700 1 -- 172.21.15.192:0/335226582 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a7006ee60 msgr2=0x7f2a701e4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:18.367 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.360+0000 7f2a75a84700 1 --2- 172.21.15.192:0/335226582 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a7006ee60 0x7f2a701e4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:18.367 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.360+0000 7f2a75a84700 1 -- 172.21.15.192:0/335226582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a700b5ab0 msgr2=0x7f2a700c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:18.367 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.360+0000 7f2a75a84700 1 --2- 172.21.15.192:0/335226582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a700b5ab0 0x7f2a700c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:18.367 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.360+0000 7f2a75a84700 1 -- 172.21.15.192:0/335226582 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a68009b30 con 0x7f2a7006b620 2023-11-26T07:11:18.367 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.361+0000 7f2a75a84700 1 --2- 172.21.15.192:0/335226582 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a7006b620 0x7f2a70134e80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c00e9b0 tx=0x7f2a6c00ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:18.367 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.361+0000 7f2a667fc700 1 -- 172.21.15.192:0/335226582 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c009710 con 0x7f2a7006b620 2023-11-26T07:11:18.367 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.361+0000 7f2a667fc700 1 -- 172.21.15.192:0/335226582 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a6c00ee50 con 0x7f2a7006b620 2023-11-26T07:11:18.367 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.361+0000 7f2a77ce8700 1 -- 172.21.15.192:0/335226582 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a700c6c00 con 0x7f2a7006b620 2023-11-26T07:11:18.368 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.361+0000 7f2a667fc700 1 -- 172.21.15.192:0/335226582 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c00ca50 con 0x7f2a7006b620 2023-11-26T07:11:18.368 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.361+0000 7f2a77ce8700 1 -- 172.21.15.192:0/335226582 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a701e4bc0 con 0x7f2a7006b620 2023-11-26T07:11:18.368 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.361+0000 7f2a667fc700 1 -- 172.21.15.192:0/335226582 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2a6c005a20 con 0x7f2a7006b620 2023-11-26T07:11:18.368 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.361+0000 7f2a667fc700 1 -- 172.21.15.192:0/335226582 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f2a6c006810 con 0x7f2a7006b620 2023-11-26T07:11:18.368 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.362+0000 7f2a77ce8700 1 -- 172.21.15.192:0/335226582 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a70075480 con 0x7f2a7006b620 2023-11-26T07:11:18.368 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.364+0000 7f2a667fc700 1 -- 172.21.15.192:0/335226582 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f2a6c021060 con 0x7f2a7006b620 2023-11-26T07:11:18.451 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.449+0000 7f2a77ce8700 1 -- 172.21.15.192:0/335226582 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f72b407a-33b3-4562-a5c9-0f611f286b88", "id": 5} v 0) v1 -- 0x7f2a7006bd40 con 0x7f2a7006b620 2023-11-26T07:11:18.459 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.457+0000 7f2a667fc700 1 -- 172.21.15.192:0/335226582 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f72b407a-33b3-4562-a5c9-0f611f286b88", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2a6c017070 con 0x7f2a7006b620 2023-11-26T07:11:18.459 INFO:teuthology.orchestra.run.smithi192.stdout:5 2023-11-26T07:11:18.460 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.458+0000 7f2a77ce8700 1 -- 172.21.15.192:0/335226582 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a7006b620 msgr2=0x7f2a70134e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:18.460 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.458+0000 7f2a77ce8700 1 --2- 172.21.15.192:0/335226582 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a7006b620 0x7f2a70134e80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c00e9b0 tx=0x7f2a6c00ecc0 comp rx=0 tx=0).stop 2023-11-26T07:11:18.461 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.458+0000 7f2a77ce8700 1 -- 172.21.15.192:0/335226582 shutdown_connections 2023-11-26T07:11:18.461 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.458+0000 7f2a77ce8700 1 --2- 172.21.15.192:0/335226582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a700b5ab0 0x7f2a700c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:18.461 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.458+0000 7f2a77ce8700 1 --2- 172.21.15.192:0/335226582 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a7006b620 0x7f2a70134e80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:18.461 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.458+0000 7f2a77ce8700 1 --2- 172.21.15.192:0/335226582 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a7006ee60 0x7f2a701e4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:18.461 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.458+0000 7f2a77ce8700 1 -- 172.21.15.192:0/335226582 >> 172.21.15.192:0/335226582 conn(0x7f2a700b2740 msgr2=0x7f2a70146440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:18.461 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.458+0000 7f2a77ce8700 1 -- 172.21.15.192:0/335226582 shutdown_connections 2023-11-26T07:11:18.461 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.458+0000 7f2a77ce8700 1 -- 172.21.15.192:0/335226582 wait complete. 2023-11-26T07:11:18.472 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 99c3d197-5913-4211-b3e1-89be841f56f7 6 2023-11-26T07:11:18.620 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.618+0000 7f0ceebdc700 1 Processor -- start 2023-11-26T07:11:18.620 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.618+0000 7f0ceebdc700 1 -- start start 2023-11-26T07:11:18.623 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.619+0000 7f0ceebdc700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0ce806b620 0x7f0ce80b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:18.623 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.619+0000 7f0ceebdc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0ce80b5ab0 0x7f0ce80b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:18.623 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.619+0000 7f0ceebdc700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ce8071f50 con 0x7f0ce81478c0 2023-11-26T07:11:18.623 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.619+0000 7f0ceebdc700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce8072230 con 0x7f0ce80b5ab0 2023-11-26T07:11:18.623 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.619+0000 7f0ceebdc700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce8072510 con 0x7f0ce806b620 2023-11-26T07:11:18.623 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.619+0000 7f0cec978700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0ce806b620 0x7f0ce80b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:18.623 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.619+0000 7f0cec978700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0ce806b620 0x7f0ce80b3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33152/0 (socket says 172.21.15.192:33152) 2023-11-26T07:11:18.624 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.619+0000 7f0cec978700 1 -- 172.21.15.192:0/667826864 learned_addr learned my addr 172.21.15.192:0/667826864 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-11-26T07:11:18.624 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.620+0000 7f0ce7fff700 1 --2- 172.21.15.192:0/667826864 >> v2:172.21.15.2:3300/0 conn(0x7f0ce80b5ab0 0x7f0ce80b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:18.624 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.620+0000 7f0cec978700 1 -- 172.21.15.192:0/667826864 >> v2:172.21.15.2:3300/0 conn(0x7f0ce80b5ab0 msgr2=0x7f0ce80b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:18.624 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.620+0000 7f0cec978700 1 --2- 172.21.15.192:0/667826864 >> v2:172.21.15.2:3300/0 conn(0x7f0ce80b5ab0 0x7f0ce80b3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:18.624 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.620+0000 7f0cec978700 1 -- 172.21.15.192:0/667826864 >> v1:172.21.15.2:6789/0 conn(0x7f0ce81478c0 legacy=0x7f0ce8161ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:18.624 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.620+0000 7f0cec978700 1 -- 172.21.15.192:0/667826864 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce80727f0 con 0x7f0ce806b620 2023-11-26T07:11:18.624 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.620+0000 7f0cec978700 1 --2- 172.21.15.192:0/667826864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ce806b620 0x7f0ce80b3a40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0ce806d2e0 tx=0x7f0cdc009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7046dae3367f2a07 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:18.624 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.620+0000 7f0ce77fe700 1 -- 172.21.15.192:0/667826864 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc00b870 con 0x7f0ce806b620 2023-11-26T07:11:18.624 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.620+0000 7f0ce77fe700 1 -- 172.21.15.192:0/667826864 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cdc00b9d0 con 0x7f0ce806b620 2023-11-26T07:11:18.624 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.620+0000 7f0ce77fe700 1 -- 172.21.15.192:0/667826864 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc00bd60 con 0x7f0ce806b620 2023-11-26T07:11:18.625 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.621+0000 7f0ceebdc700 1 -- 172.21.15.192:0/667826864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ce806b620 msgr2=0x7f0ce80b3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:18.625 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.621+0000 7f0ceebdc700 1 --2- 172.21.15.192:0/667826864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ce806b620 0x7f0ce80b3a40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0ce806d2e0 tx=0x7f0cdc009bd0 comp rx=0 tx=0).stop 2023-11-26T07:11:18.625 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.621+0000 7f0ceebdc700 1 -- 172.21.15.192:0/667826864 shutdown_connections 2023-11-26T07:11:18.625 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.621+0000 7f0ceebdc700 1 --2- 172.21.15.192:0/667826864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ce806b620 0x7f0ce80b3a40 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:18.625 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.621+0000 7f0ceebdc700 1 --2- 172.21.15.192:0/667826864 >> v2:172.21.15.2:3300/0 conn(0x7f0ce80b5ab0 0x7f0ce80b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:18.625 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.621+0000 7f0ceebdc700 1 -- 172.21.15.192:0/667826864 >> 172.21.15.192:0/667826864 conn(0x7f0ce80b2740 msgr2=0x7f0ce80b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:18.625 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.621+0000 7f0ceebdc700 1 -- 172.21.15.192:0/667826864 shutdown_connections 2023-11-26T07:11:18.625 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.621+0000 7f0ceebdc700 1 -- 172.21.15.192:0/667826864 wait complete. 2023-11-26T07:11:18.628 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.622+0000 7f0ceebdc700 1 Processor -- start 2023-11-26T07:11:18.628 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.622+0000 7f0ceebdc700 1 -- start start 2023-11-26T07:11:18.628 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.623+0000 7f0ceebdc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ce806b620 0x7f0ce8143590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:18.628 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.623+0000 7f0ceebdc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ce80b5ab0 0x7f0ce80ad860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:18.628 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.623+0000 7f0ceebdc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ce81478c0 0x7f0ce80adda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:18.628 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.623+0000 7f0ceebdc700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce81e4070 con 0x7f0ce80b5ab0 2023-11-26T07:11:18.628 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.623+0000 7f0ceebdc700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce81e3740 con 0x7f0ce81478c0 2023-11-26T07:11:18.629 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.623+0000 7f0ceebdc700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce806eb60 con 0x7f0ce806b620 2023-11-26T07:11:18.629 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.623+0000 7f0ced179700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ce81478c0 0x7f0ce80adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:18.629 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.623+0000 7f0ced179700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ce81478c0 0x7f0ce80adda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33162/0 (socket says 172.21.15.192:33162) 2023-11-26T07:11:18.629 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.623+0000 7f0ced179700 1 -- 172.21.15.192:0/926768243 learned_addr learned my addr 172.21.15.192:0/926768243 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-11-26T07:11:18.629 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.623+0000 7f0cec978700 1 --2- 172.21.15.192:0/926768243 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ce806b620 0x7f0ce8143590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:18.629 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.623+0000 7f0ce7fff700 1 --2- 172.21.15.192:0/926768243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ce80b5ab0 0x7f0ce80ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:18.629 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.624+0000 7f0ced179700 1 -- 172.21.15.192:0/926768243 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ce806b620 msgr2=0x7f0ce8143590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:18.629 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.624+0000 7f0ced179700 1 --2- 172.21.15.192:0/926768243 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ce806b620 0x7f0ce8143590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:18.629 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.624+0000 7f0ced179700 1 -- 172.21.15.192:0/926768243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ce80b5ab0 msgr2=0x7f0ce80ad860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:18.629 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.624+0000 7f0ced179700 1 --2- 172.21.15.192:0/926768243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ce80b5ab0 0x7f0ce80ad860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:18.629 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.624+0000 7f0ced179700 1 -- 172.21.15.192:0/926768243 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cdc009550 con 0x7f0ce81478c0 2023-11-26T07:11:18.629 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.624+0000 7f0ced179700 1 --2- 172.21.15.192:0/926768243 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ce81478c0 0x7f0ce80adda0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0ce000cb50 tx=0x7f0ce000ce60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:18.630 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.624+0000 7f0ce57fa700 1 -- 172.21.15.192:0/926768243 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce0003c00 con 0x7f0ce81478c0 2023-11-26T07:11:18.630 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.624+0000 7f0ce57fa700 1 -- 172.21.15.192:0/926768243 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce0003d60 con 0x7f0ce81478c0 2023-11-26T07:11:18.630 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.624+0000 7f0ceebdc700 1 -- 172.21.15.192:0/926768243 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ce81e39b0 con 0x7f0ce81478c0 2023-11-26T07:11:18.630 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.624+0000 7f0ce57fa700 1 -- 172.21.15.192:0/926768243 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce000aa20 con 0x7f0ce81478c0 2023-11-26T07:11:18.630 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.624+0000 7f0ceebdc700 1 -- 172.21.15.192:0/926768243 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ce81f3ce0 con 0x7f0ce81478c0 2023-11-26T07:11:18.630 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.624+0000 7f0ce57fa700 1 -- 172.21.15.192:0/926768243 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0ce00050d0 con 0x7f0ce81478c0 2023-11-26T07:11:18.630 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.624+0000 7f0ce57fa700 1 -- 172.21.15.192:0/926768243 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f0ce0012ba0 con 0x7f0ce81478c0 2023-11-26T07:11:18.630 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.625+0000 7f0ceebdc700 1 -- 172.21.15.192:0/926768243 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ce81e41b0 con 0x7f0ce81478c0 2023-11-26T07:11:18.631 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.627+0000 7f0ce57fa700 1 -- 172.21.15.192:0/926768243 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f0ce81e41b0 con 0x7f0ce81478c0 2023-11-26T07:11:18.713 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.712+0000 7f0ceebdc700 1 -- 172.21.15.192:0/926768243 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd new", "uuid": "99c3d197-5913-4211-b3e1-89be841f56f7", "id": 6} v 0) v1 -- 0x7f0ce8075480 con 0x7f0ce81478c0 2023-11-26T07:11:18.719 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.717+0000 7f0ce57fa700 1 -- 172.21.15.192:0/926768243 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "99c3d197-5913-4211-b3e1-89be841f56f7", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0ce0012e00 con 0x7f0ce81478c0 2023-11-26T07:11:18.719 INFO:teuthology.orchestra.run.smithi192.stdout:6 2023-11-26T07:11:18.720 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.718+0000 7f0ceebdc700 1 -- 172.21.15.192:0/926768243 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ce81478c0 msgr2=0x7f0ce80adda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:18.721 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.718+0000 7f0ceebdc700 1 --2- 172.21.15.192:0/926768243 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ce81478c0 0x7f0ce80adda0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0ce000cb50 tx=0x7f0ce000ce60 comp rx=0 tx=0).stop 2023-11-26T07:11:18.721 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.719+0000 7f0ceebdc700 1 -- 172.21.15.192:0/926768243 shutdown_connections 2023-11-26T07:11:18.721 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.719+0000 7f0ceebdc700 1 --2- 172.21.15.192:0/926768243 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ce81478c0 0x7f0ce80adda0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:18.721 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.719+0000 7f0ceebdc700 1 --2- 172.21.15.192:0/926768243 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ce806b620 0x7f0ce8143590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:18.721 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.719+0000 7f0ceebdc700 1 --2- 172.21.15.192:0/926768243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ce80b5ab0 0x7f0ce80ad860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:18.722 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.719+0000 7f0ceebdc700 1 -- 172.21.15.192:0/926768243 >> 172.21.15.192:0/926768243 conn(0x7f0ce80b2740 msgr2=0x7f0ce81464d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:18.722 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.719+0000 7f0ceebdc700 1 -- 172.21.15.192:0/926768243 shutdown_connections 2023-11-26T07:11:18.722 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.719+0000 7f0ceebdc700 1 -- 172.21.15.192:0/926768243 wait complete. 2023-11-26T07:11:18.733 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70 7 2023-11-26T07:11:18.817 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:11:18.816+0000 7f8e31361200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-26T07:11:18.836 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-26T07:11:18.835+0000 7f8e0c58d200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-26T07:11:18.856 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.854+0000 7f6fa6548700 1 Processor -- start 2023-11-26T07:11:18.856 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.854+0000 7f6fa6548700 1 -- start start 2023-11-26T07:11:18.860 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.855+0000 7f6fa6548700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6fa006b620 0x7f6fa00b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:18.860 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.855+0000 7f6fa6548700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6fa006ee60 0x7f6fa00b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:18.860 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.855+0000 7f6fa6548700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fa0071f50 con 0x7f6fa00b5ab0 2023-11-26T07:11:18.860 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.855+0000 7f6fa6548700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fa0072230 con 0x7f6fa006b620 2023-11-26T07:11:18.861 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.855+0000 7f6fa6548700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fa0072510 con 0x7f6fa006ee60 2023-11-26T07:11:18.861 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.855+0000 7f6fa4ae5700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6fa006ee60 0x7f6fa00b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:18.861 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.855+0000 7f6f9f7fe700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f6fa00b5ab0 0x7f6fa0161ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:42410/0 (socket says 172.21.15.192:42410) 2023-11-26T07:11:18.861 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.855+0000 7f6f9f7fe700 1 -- 172.21.15.192:0/2293842218 learned_addr learned my addr 172.21.15.192:0/2293842218 (peer_addr_for_me v1:172.21.15.192:0/0) 2023-11-26T07:11:18.862 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.855+0000 7f6f9ffff700 1 --2- 172.21.15.192:0/2293842218 >> v2:172.21.15.2:3300/0 conn(0x7f6fa006b620 0x7f6fa00b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:18.862 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.855+0000 7f6fa4ae5700 1 -- 172.21.15.192:0/2293842218 >> v2:172.21.15.2:3300/0 conn(0x7f6fa006b620 msgr2=0x7f6fa00b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:18.862 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.855+0000 7f6fa4ae5700 1 --2- 172.21.15.192:0/2293842218 >> v2:172.21.15.2:3300/0 conn(0x7f6fa006b620 0x7f6fa00b3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:18.862 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.855+0000 7f6fa4ae5700 1 -- 172.21.15.192:0/2293842218 >> v1:172.21.15.192:6789/0 conn(0x7f6fa00b5ab0 legacy=0x7f6fa0161ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:18.862 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.855+0000 7f6f9effd700 1 -- 172.21.15.192:0/2293842218 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 829500301 0 0) 0x7f6fa0071f50 con 0x7f6fa00b5ab0 2023-11-26T07:11:18.863 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.855+0000 7f6fa4ae5700 1 -- 172.21.15.192:0/2293842218 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa00727f0 con 0x7f6fa006ee60 2023-11-26T07:11:18.863 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.856+0000 7f6fa4ae5700 1 --2- 172.21.15.192:0/2293842218 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fa006ee60 0x7f6fa00b3f80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6fa00b0660 tx=0x7f6f9800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47ab6f2c7173387a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:18.863 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.856+0000 7f6f9effd700 1 -- 172.21.15.192:0/2293842218 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9800e070 con 0x7f6fa006ee60 2023-11-26T07:11:18.863 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.856+0000 7f6f9effd700 1 -- 172.21.15.192:0/2293842218 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f9800bb20 con 0x7f6fa006ee60 2023-11-26T07:11:18.863 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.856+0000 7f6f9effd700 1 -- 172.21.15.192:0/2293842218 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f98012430 con 0x7f6fa006ee60 2023-11-26T07:11:18.864 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.856+0000 7f6fa6548700 1 -- 172.21.15.192:0/2293842218 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fa006ee60 msgr2=0x7f6fa00b3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:18.864 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.856+0000 7f6fa6548700 1 --2- 172.21.15.192:0/2293842218 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fa006ee60 0x7f6fa00b3f80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6fa00b0660 tx=0x7f6f9800b330 comp rx=0 tx=0).stop 2023-11-26T07:11:18.864 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.856+0000 7f6fa6548700 1 -- 172.21.15.192:0/2293842218 shutdown_connections 2023-11-26T07:11:18.864 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.856+0000 7f6fa6548700 1 --2- 172.21.15.192:0/2293842218 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fa006ee60 0x7f6fa00b3f80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:18.864 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.856+0000 7f6fa6548700 1 --2- 172.21.15.192:0/2293842218 >> v2:172.21.15.2:3300/0 conn(0x7f6fa006b620 0x7f6fa00b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:18.864 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.856+0000 7f6fa6548700 1 -- 172.21.15.192:0/2293842218 >> 172.21.15.192:0/2293842218 conn(0x7f6fa00b2740 msgr2=0x7f6fa00b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:18.865 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.856+0000 7f6fa6548700 1 -- 172.21.15.192:0/2293842218 shutdown_connections 2023-11-26T07:11:18.865 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.856+0000 7f6fa6548700 1 -- 172.21.15.192:0/2293842218 wait complete. 2023-11-26T07:11:18.865 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.858+0000 7f6fa6548700 1 Processor -- start 2023-11-26T07:11:18.865 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.858+0000 7f6fa6548700 1 -- start start 2023-11-26T07:11:18.868 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.859+0000 7f6fa6548700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6fa006b620 0x7f6fa00d0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:18.868 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.859+0000 7f6fa6548700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fa006ee60 0x7f6fa00d0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:18.868 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.859+0000 7f6fa6548700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fa00b5ab0 0x7f6fa00c6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:18.868 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.859+0000 7f6fa6548700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa00cf870 con 0x7f6fa00b5ab0 2023-11-26T07:11:18.868 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.859+0000 7f6fa6548700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa00c8840 con 0x7f6fa006ee60 2023-11-26T07:11:18.868 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.859+0000 7f6fa6548700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa00c77a0 con 0x7f6fa006b620 2023-11-26T07:11:18.869 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.859+0000 7f6f9ffff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6fa006b620 0x7f6fa00d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:18.869 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.859+0000 7f6f9f7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fa006ee60 0x7f6fa00d0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:18.869 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.859+0000 7f6f9ffff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6fa006b620 0x7f6fa00d0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:53724/0 (socket says 172.21.15.192:53724) 2023-11-26T07:11:18.869 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.859+0000 7f6f9ffff700 1 -- 172.21.15.192:0/2589421611 learned_addr learned my addr 172.21.15.192:0/2589421611 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-11-26T07:11:18.869 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.859+0000 7f6fa4ae5700 1 --2- 172.21.15.192:0/2589421611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fa00b5ab0 0x7f6fa00c6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:18.869 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.859+0000 7f6f9ffff700 1 -- 172.21.15.192:0/2589421611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fa006ee60 msgr2=0x7f6fa00d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:18.870 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.859+0000 7f6f9ffff700 1 --2- 172.21.15.192:0/2589421611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fa006ee60 0x7f6fa00d0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:18.870 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.859+0000 7f6f9ffff700 1 -- 172.21.15.192:0/2589421611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fa00b5ab0 msgr2=0x7f6fa00c6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:18.870 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.859+0000 7f6f9ffff700 1 --2- 172.21.15.192:0/2589421611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fa00b5ab0 0x7f6fa00c6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:18.870 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.859+0000 7f6f9ffff700 1 -- 172.21.15.192:0/2589421611 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f98009a70 con 0x7f6fa006b620 2023-11-26T07:11:18.870 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.859+0000 7f6fa4ae5700 1 --2- 172.21.15.192:0/2589421611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fa00b5ab0 0x7f6fa00c6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:11:18.870 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.859+0000 7f6f9f7fe700 1 --2- 172.21.15.192:0/2589421611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fa006ee60 0x7f6fa00d0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:11:18.871 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.859+0000 7f6f9ffff700 1 --2- 172.21.15.192:0/2589421611 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6fa006b620 0x7f6fa00d0820 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6f9000e9e0 tx=0x7f6f9000ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:18.871 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.859+0000 7f6f9cff9700 1 -- 172.21.15.192:0/2589421611 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f90009710 con 0x7f6fa006b620 2023-11-26T07:11:18.871 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.859+0000 7f6f9cff9700 1 -- 172.21.15.192:0/2589421611 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f9000ee80 con 0x7f6fa006b620 2023-11-26T07:11:18.871 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.859+0000 7f6fa6548700 1 -- 172.21.15.192:0/2589421611 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fa00c7a80 con 0x7f6fa006b620 2023-11-26T07:11:18.871 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.859+0000 7f6f9cff9700 1 -- 172.21.15.192:0/2589421611 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9000ca50 con 0x7f6fa006b620 2023-11-26T07:11:18.871 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.859+0000 7f6fa6548700 1 -- 172.21.15.192:0/2589421611 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa00c8040 con 0x7f6fa006b620 2023-11-26T07:11:18.872 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.860+0000 7f6f9cff9700 1 -- 172.21.15.192:0/2589421611 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6f90005a20 con 0x7f6fa006b620 2023-11-26T07:11:18.872 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.860+0000 7f6f9cff9700 1 -- 172.21.15.192:0/2589421611 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f6f900066b0 con 0x7f6fa006b620 2023-11-26T07:11:18.872 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.860+0000 7f6fa6548700 1 -- 172.21.15.192:0/2589421611 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fa0075480 con 0x7f6fa006b620 2023-11-26T07:11:18.872 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.862+0000 7f6f9cff9700 1 -- 172.21.15.192:0/2589421611 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f6f90021060 con 0x7f6fa006b620 2023-11-26T07:11:18.890 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:11:18.888+0000 7f8e31361200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-26T07:11:18.908 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-26T07:11:18.906+0000 7f8e0c58d200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-26T07:11:18.950 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.948+0000 7f6fa6548700 1 -- 172.21.15.192:0/2589421611 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70", "id": 7} v 0) v1 -- 0x7f6fa006bd40 con 0x7f6fa006b620 2023-11-26T07:11:18.955 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.954+0000 7f6f9cff9700 1 -- 172.21.15.192:0/2589421611 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6f90017070 con 0x7f6fa006b620 2023-11-26T07:11:18.956 INFO:teuthology.orchestra.run.smithi192.stdout:7 2023-11-26T07:11:18.957 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.955+0000 7f6fa6548700 1 -- 172.21.15.192:0/2589421611 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6fa006b620 msgr2=0x7f6fa00d0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:18.957 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.955+0000 7f6fa6548700 1 --2- 172.21.15.192:0/2589421611 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6fa006b620 0x7f6fa00d0820 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6f9000e9e0 tx=0x7f6f9000ecf0 comp rx=0 tx=0).stop 2023-11-26T07:11:18.957 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.955+0000 7f6fa6548700 1 -- 172.21.15.192:0/2589421611 shutdown_connections 2023-11-26T07:11:18.957 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.955+0000 7f6fa6548700 1 --2- 172.21.15.192:0/2589421611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fa00b5ab0 0x7f6fa00c6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:18.957 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.955+0000 7f6fa6548700 1 --2- 172.21.15.192:0/2589421611 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6fa006b620 0x7f6fa00d0820 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:18.958 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.955+0000 7f6fa6548700 1 --2- 172.21.15.192:0/2589421611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fa006ee60 0x7f6fa00d0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:18.958 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.955+0000 7f6fa6548700 1 -- 172.21.15.192:0/2589421611 >> 172.21.15.192:0/2589421611 conn(0x7f6fa00b2740 msgr2=0x7f6fa006f480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:18.958 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.955+0000 7f6fa6548700 1 -- 172.21.15.192:0/2589421611 shutdown_connections 2023-11-26T07:11:18.958 INFO:teuthology.orchestra.run.smithi192.stderr:2023-11-26T07:11:18.955+0000 7f6fa6548700 1 -- 172.21.15.192:0/2589421611 wait complete. 2023-11-26T07:11:18.968 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-26T07:11:18.969 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-26T07:11:18.971 INFO:tasks.ceph.osd.0:Started 2023-11-26T07:11:18.971 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-26T07:11:18.971 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-26T07:11:18.973 INFO:tasks.ceph.osd.1:Started 2023-11-26T07:11:18.973 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-26T07:11:18.974 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-26T07:11:18.976 INFO:tasks.ceph.osd.2:Started 2023-11-26T07:11:18.976 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-26T07:11:18.976 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-26T07:11:18.978 INFO:tasks.ceph.osd.3:Started 2023-11-26T07:11:18.979 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-26T07:11:18.979 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-26T07:11:18.981 INFO:tasks.ceph.osd.4:Started 2023-11-26T07:11:18.981 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-26T07:11:18.982 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-26T07:11:18.983 INFO:tasks.ceph.osd.5:Started 2023-11-26T07:11:18.984 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-26T07:11:18.984 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-26T07:11:18.986 INFO:tasks.ceph.osd.6:Started 2023-11-26T07:11:18.986 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-26T07:11:18.987 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-26T07:11:18.989 INFO:tasks.ceph.osd.7:Started 2023-11-26T07:11:18.990 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:11:19.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.165+0000 7f1a45b9d700 1 Processor -- start 2023-11-26T07:11:19.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.165+0000 7f1a45b9d700 1 -- start start 2023-11-26T07:11:19.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.165+0000 7f1a45b9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1a401448b0 0x7f1a4006ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:19.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.165+0000 7f1a45b9d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a4006f990 0x7f1a400ce2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:19.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.166+0000 7f1a45b9d700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a40144c90 con 0x7f1a400b44c0 2023-11-26T07:11:19.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.166+0000 7f1a45b9d700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a400b4c80 con 0x7f1a401448b0 2023-11-26T07:11:19.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.166+0000 7f1a45b9d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a400b4f60 con 0x7f1a4006f990 2023-11-26T07:11:19.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.166+0000 7f1a3f7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1a401448b0 0x7f1a4006ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:19.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.166+0000 7f1a3f7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1a401448b0 0x7f1a4006ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38368/0 (socket says 172.21.15.2:38368) 2023-11-26T07:11:19.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.166+0000 7f1a3f7fe700 1 -- 172.21.15.2:0/1037694749 learned_addr learned my addr 172.21.15.2:0/1037694749 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:19.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.166+0000 7f1a3ffff700 1 --2- 172.21.15.2:0/1037694749 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a4006f990 0x7f1a400ce2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:19.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.166+0000 7f1a3f7fe700 1 -- 172.21.15.2:0/1037694749 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a4006f990 msgr2=0x7f1a400ce2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:19.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.166+0000 7f1a3f7fe700 1 --2- 172.21.15.2:0/1037694749 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a4006f990 0x7f1a400ce2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:19.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.166+0000 7f1a3f7fe700 1 -- 172.21.15.2:0/1037694749 >> v1:172.21.15.192:6789/0 conn(0x7f1a400b44c0 legacy=0x7f1a4006f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:19.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.166+0000 7f1a3f7fe700 1 -- 172.21.15.2:0/1037694749 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a400b5240 con 0x7f1a401448b0 2023-11-26T07:11:19.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.166+0000 7f1a3f7fe700 1 --2- 172.21.15.2:0/1037694749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a401448b0 0x7f1a4006ec70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1a300098f0 tx=0x7f1a30009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b5ac75f7c453678 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:19.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.166+0000 7f1a3e7fc700 1 -- 172.21.15.2:0/1037694749 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a30011830 con 0x7f1a401448b0 2023-11-26T07:11:19.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.166+0000 7f1a3e7fc700 1 -- 172.21.15.2:0/1037694749 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a30011990 con 0x7f1a401448b0 2023-11-26T07:11:19.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.166+0000 7f1a3e7fc700 1 -- 172.21.15.2:0/1037694749 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a30011d20 con 0x7f1a401448b0 2023-11-26T07:11:19.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.167+0000 7f1a45b9d700 1 -- 172.21.15.2:0/1037694749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a401448b0 msgr2=0x7f1a4006ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:19.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.167+0000 7f1a45b9d700 1 --2- 172.21.15.2:0/1037694749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a401448b0 0x7f1a4006ec70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1a300098f0 tx=0x7f1a30009c00 comp rx=0 tx=0).stop 2023-11-26T07:11:19.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.167+0000 7f1a45b9d700 1 -- 172.21.15.2:0/1037694749 shutdown_connections 2023-11-26T07:11:19.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.167+0000 7f1a45b9d700 1 --2- 172.21.15.2:0/1037694749 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a4006f990 0x7f1a400ce2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:19.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.167+0000 7f1a45b9d700 1 --2- 172.21.15.2:0/1037694749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a401448b0 0x7f1a4006ec70 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:19.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.167+0000 7f1a45b9d700 1 -- 172.21.15.2:0/1037694749 >> 172.21.15.2:0/1037694749 conn(0x7f1a400d0bc0 msgr2=0x7f1a400d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:19.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.167+0000 7f1a45b9d700 1 -- 172.21.15.2:0/1037694749 shutdown_connections 2023-11-26T07:11:19.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.167+0000 7f1a45b9d700 1 -- 172.21.15.2:0/1037694749 wait complete. 2023-11-26T07:11:19.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.169+0000 7f1a45b9d700 1 Processor -- start 2023-11-26T07:11:19.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.169+0000 7f1a45b9d700 1 -- start start 2023-11-26T07:11:19.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.170+0000 7f1a45b9d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a4006f990 0x7f1a40154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:19.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.170+0000 7f1a45b9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a400b44c0 0x7f1a4015b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:19.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.170+0000 7f1a45b9d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a401448b0 0x7f1a4006afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:19.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.170+0000 7f1a45b9d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a400cafd0 con 0x7f1a400b44c0 2023-11-26T07:11:19.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.170+0000 7f1a45b9d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4015bb30 con 0x7f1a4006f990 2023-11-26T07:11:19.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.170+0000 7f1a45b9d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4015aba0 con 0x7f1a401448b0 2023-11-26T07:11:19.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.170+0000 7f1a3effd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a400b44c0 0x7f1a4015b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:19.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.170+0000 7f1a3f7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a4006f990 0x7f1a40154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:19.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.170+0000 7f1a3effd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a400b44c0 0x7f1a4015b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38376/0 (socket says 172.21.15.2:38376) 2023-11-26T07:11:19.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.170+0000 7f1a3effd700 1 -- 172.21.15.2:0/81621920 learned_addr learned my addr 172.21.15.2:0/81621920 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:19.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.170+0000 7f1a3ffff700 1 --2- 172.21.15.2:0/81621920 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a401448b0 0x7f1a4006afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:19.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.171+0000 7f1a3effd700 1 -- 172.21.15.2:0/81621920 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a401448b0 msgr2=0x7f1a4006afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:19.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.171+0000 7f1a3effd700 1 --2- 172.21.15.2:0/81621920 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a401448b0 0x7f1a4006afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:19.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.171+0000 7f1a3effd700 1 -- 172.21.15.2:0/81621920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a4006f990 msgr2=0x7f1a40154990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:19.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.171+0000 7f1a3effd700 1 --2- 172.21.15.2:0/81621920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a4006f990 0x7f1a40154990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:19.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.171+0000 7f1a3effd700 1 -- 172.21.15.2:0/81621920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a30009550 con 0x7f1a400b44c0 2023-11-26T07:11:19.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.171+0000 7f1a3f7fe700 1 --2- 172.21.15.2:0/81621920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a4006f990 0x7f1a40154990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:11:19.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.171+0000 7f1a3effd700 1 --2- 172.21.15.2:0/81621920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a400b44c0 0x7f1a4015b5f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1a3400c510 tx=0x7f1a3400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:19.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.171+0000 7f1a27fff700 1 -- 172.21.15.2:0/81621920 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a340052d0 con 0x7f1a400b44c0 2023-11-26T07:11:19.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.171+0000 7f1a27fff700 1 -- 172.21.15.2:0/81621920 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a34005430 con 0x7f1a400b44c0 2023-11-26T07:11:19.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.171+0000 7f1a45b9d700 1 -- 172.21.15.2:0/81621920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a401f4230 con 0x7f1a400b44c0 2023-11-26T07:11:19.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.171+0000 7f1a27fff700 1 -- 172.21.15.2:0/81621920 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a340038c0 con 0x7f1a400b44c0 2023-11-26T07:11:19.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.171+0000 7f1a45b9d700 1 -- 172.21.15.2:0/81621920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a401f47f0 con 0x7f1a400b44c0 2023-11-26T07:11:19.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.172+0000 7f1a27fff700 1 -- 172.21.15.2:0/81621920 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1a34003d20 con 0x7f1a400b44c0 2023-11-26T07:11:19.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.172+0000 7f1a27fff700 1 -- 172.21.15.2:0/81621920 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f1a34011d60 con 0x7f1a400b44c0 2023-11-26T07:11:19.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.172+0000 7f1a45b9d700 1 -- 172.21.15.2:0/81621920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a40068670 con 0x7f1a400b44c0 2023-11-26T07:11:19.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.175+0000 7f1a27fff700 1 -- 172.21.15.2:0/81621920 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f1a34017070 con 0x7f1a400b44c0 2023-11-26T07:11:19.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.246+0000 7f1a45b9d700 1 -- 172.21.15.2:0/81621920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a400670b0 con 0x7f1a400b44c0 2023-11-26T07:11:19.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.247+0000 7f1a27fff700 1 -- 172.21.15.2:0/81621920 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f1a34011590 con 0x7f1a400b44c0 2023-11-26T07:11:19.249 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:11:19.249 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":10,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:11:18.950310+0000","last_up_change":"0.000000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:11:19.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.248+0000 7f1a45b9d700 1 -- 172.21.15.2:0/81621920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a400b44c0 msgr2=0x7f1a4015b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:19.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.248+0000 7f1a45b9d700 1 --2- 172.21.15.2:0/81621920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a400b44c0 0x7f1a4015b5f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1a3400c510 tx=0x7f1a3400c820 comp rx=0 tx=0).stop 2023-11-26T07:11:19.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.248+0000 7f1a45b9d700 1 -- 172.21.15.2:0/81621920 shutdown_connections 2023-11-26T07:11:19.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.248+0000 7f1a45b9d700 1 --2- 172.21.15.2:0/81621920 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a401448b0 0x7f1a4006afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:19.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.248+0000 7f1a45b9d700 1 --2- 172.21.15.2:0/81621920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a4006f990 0x7f1a40154990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:19.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.248+0000 7f1a45b9d700 1 --2- 172.21.15.2:0/81621920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a400b44c0 0x7f1a4015b5f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:19.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.248+0000 7f1a45b9d700 1 -- 172.21.15.2:0/81621920 >> 172.21.15.2:0/81621920 conn(0x7f1a400d0bc0 msgr2=0x7f1a400b1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:19.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.248+0000 7f1a45b9d700 1 -- 172.21.15.2:0/81621920 shutdown_connections 2023-11-26T07:11:19.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:19.248+0000 7f1a45b9d700 1 -- 172.21.15.2:0/81621920 wait complete. 2023-11-26T07:11:19.261 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-26T07:11:19.262 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-26T07:11:19.345 INFO:tasks.ceph.osd.1.smithi002.stderr:2023-11-26T07:11:19.343+0000 7f5bc5256640 -1 Falling back to public interface 2023-11-26T07:11:19.591 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-11-26T07:11:19.589+0000 7fcc7f90a640 -1 Falling back to public interface 2023-11-26T07:11:19.597 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-11-26T07:11:19.594+0000 7feabacf9640 -1 Falling back to public interface 2023-11-26T07:11:19.602 INFO:tasks.ceph.osd.2.smithi002.stderr:2023-11-26T07:11:19.601+0000 7f1f39259640 -1 Falling back to public interface 2023-11-26T07:11:19.607 INFO:tasks.ceph.osd.0.smithi002.stderr:2023-11-26T07:11:19.605+0000 7f3890e54640 -1 Falling back to public interface 2023-11-26T07:11:19.609 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-11-26T07:11:19.607+0000 7f8e6fde2640 -1 Falling back to public interface 2023-11-26T07:11:19.611 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:11:19.610+0000 7f8e31361200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-26T07:11:19.612 INFO:tasks.ceph.osd.3.smithi002.stderr:2023-11-26T07:11:19.610+0000 7f007e243640 -1 Falling back to public interface 2023-11-26T07:11:19.613 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-11-26T07:11:19.611+0000 7f78e2b2d640 -1 Falling back to public interface 2023-11-26T07:11:19.690 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:11:19.688+0000 7f8e31361200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-26T07:11:19.701 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-26T07:11:19.699+0000 7f8e0c58d200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-26T07:11:19.782 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-26T07:11:19.780+0000 7f8e0c58d200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-26T07:11:19.833 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:11:19.830+0000 7f8e31361200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-26T07:11:19.929 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-26T07:11:19.927+0000 7f8e0c58d200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-26T07:11:20.067 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-26T07:11:20.070 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:11:20.069+0000 7f8e31361200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-26T07:11:20.179 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-26T07:11:20.177+0000 7f8e0c58d200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-26T07:11:20.183 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.181+0000 7f26924e7700 1 Processor -- start 2023-11-26T07:11:20.183 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.182+0000 7f26924e7700 1 -- start start 2023-11-26T07:11:20.187 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.183+0000 7f26924e7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f268c0722c0 0x7f268c0b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:20.187 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.183+0000 7f26924e7700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f268c1440f0 0x7f268c06e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:20.187 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.183+0000 7f26924e7700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f268c143ec0 con 0x7f268c143ae0 2023-11-26T07:11:20.187 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.183+0000 7f26924e7700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f268c0b40a0 con 0x7f268c1440f0 2023-11-26T07:11:20.187 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.183+0000 7f26924e7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f268c0b3ae0 con 0x7f268c0722c0 2023-11-26T07:11:20.187 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.183+0000 7f268bfff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f268c143ae0 0x7f268c071bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:57822/0 (socket says 172.21.15.2:57822) 2023-11-26T07:11:20.187 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.183+0000 7f268bfff700 1 -- 172.21.15.2:0/1782904500 learned_addr learned my addr 172.21.15.2:0/1782904500 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:11:20.187 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.183+0000 7f268b7fe700 1 --2- 172.21.15.2:0/1782904500 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f268c0722c0 0x7f268c0b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:20.187 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.183+0000 7f2690a84700 1 --2- 172.21.15.2:0/1782904500 >> v2:172.21.15.192:3300/0 conn(0x7f268c1440f0 0x7f268c06e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:20.188 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.183+0000 7f268affd700 1 -- 172.21.15.2:0/1782904500 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1859596491 0 0) 0x7f268c143ec0 con 0x7f268c143ae0 2023-11-26T07:11:20.188 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.183+0000 7f268affd700 1 -- 172.21.15.2:0/1782904500 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26740035b0 con 0x7f268c143ae0 2023-11-26T07:11:20.188 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.184+0000 7f268affd700 1 -- 172.21.15.2:0/1782904500 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2721861419 0 0) 0x7f26740035b0 con 0x7f268c143ae0 2023-11-26T07:11:20.188 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.184+0000 7f2690a84700 1 -- 172.21.15.2:0/1782904500 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f268c0722c0 msgr2=0x7f268c0b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:20.188 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.184+0000 7f2690a84700 1 --2- 172.21.15.2:0/1782904500 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f268c0722c0 0x7f268c0b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:20.188 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.184+0000 7f2690a84700 1 -- 172.21.15.2:0/1782904500 >> v1:172.21.15.2:6789/0 conn(0x7f268c143ae0 legacy=0x7f268c071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:20.188 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.184+0000 7f2690a84700 1 -- 172.21.15.2:0/1782904500 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f268c0b3dc0 con 0x7f268c1440f0 2023-11-26T07:11:20.189 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.184+0000 7f268b7fe700 1 --2- 172.21.15.2:0/1782904500 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f268c0722c0 0x7f268c0b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:11:20.189 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.184+0000 7f2690a84700 1 --2- 172.21.15.2:0/1782904500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f268c1440f0 0x7f268c06e510 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2684009d90 tx=0x7f268400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a058611c134017c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:20.189 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.184+0000 7f268affd700 1 -- 172.21.15.2:0/1782904500 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268400e070 con 0x7f268c1440f0 2023-11-26T07:11:20.189 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.184+0000 7f268affd700 1 -- 172.21.15.2:0/1782904500 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2684003a20 con 0x7f268c1440f0 2023-11-26T07:11:20.189 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.184+0000 7f268affd700 1 -- 172.21.15.2:0/1782904500 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267c001670 con 0x7f268c1440f0 2023-11-26T07:11:20.189 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.185+0000 7f26924e7700 1 -- 172.21.15.2:0/1782904500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f268c1440f0 msgr2=0x7f268c06e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:20.189 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.185+0000 7f26924e7700 1 --2- 172.21.15.2:0/1782904500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f268c1440f0 0x7f268c06e510 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2684009d90 tx=0x7f268400b330 comp rx=0 tx=0).stop 2023-11-26T07:11:20.189 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.185+0000 7f26924e7700 1 -- 172.21.15.2:0/1782904500 shutdown_connections 2023-11-26T07:11:20.189 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.185+0000 7f26924e7700 1 --2- 172.21.15.2:0/1782904500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f268c1440f0 0x7f268c06e510 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:20.189 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.185+0000 7f26924e7700 1 --2- 172.21.15.2:0/1782904500 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f268c0722c0 0x7f268c0b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:20.189 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.185+0000 7f26924e7700 1 -- 172.21.15.2:0/1782904500 >> 172.21.15.2:0/1782904500 conn(0x7f268c0b2740 msgr2=0x7f268c0b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:20.189 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.185+0000 7f26924e7700 1 -- 172.21.15.2:0/1782904500 shutdown_connections 2023-11-26T07:11:20.190 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.185+0000 7f26924e7700 1 -- 172.21.15.2:0/1782904500 wait complete. 2023-11-26T07:11:20.192 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.186+0000 7f26924e7700 1 Processor -- start 2023-11-26T07:11:20.192 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.186+0000 7f26924e7700 1 -- start start 2023-11-26T07:11:20.192 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.187+0000 7f26924e7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f268c0722c0 0x7f268c166e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:20.192 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.187+0000 7f26924e7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f268c143ae0 0x7f268c15bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:20.192 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.187+0000 7f26924e7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f268c1440f0 0x7f268c15c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:20.192 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.187+0000 7f26924e7700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268c15fab0 con 0x7f268c0722c0 2023-11-26T07:11:20.192 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.187+0000 7f26924e7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268c15baa0 con 0x7f268c143ae0 2023-11-26T07:11:20.192 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.187+0000 7f26924e7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f268c15b470 con 0x7f268c1440f0 2023-11-26T07:11:20.192 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.187+0000 7f268bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f268c0722c0 0x7f268c166e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:20.192 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.187+0000 7f268bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f268c0722c0 0x7f268c166e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38386/0 (socket says 172.21.15.2:38386) 2023-11-26T07:11:20.193 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.187+0000 7f268bfff700 1 -- 172.21.15.2:0/3456206133 learned_addr learned my addr 172.21.15.2:0/3456206133 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:20.193 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.187+0000 7f2690a84700 1 --2- 172.21.15.2:0/3456206133 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f268c1440f0 0x7f268c15c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:20.193 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.187+0000 7f268b7fe700 1 --2- 172.21.15.2:0/3456206133 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f268c143ae0 0x7f268c15bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:20.193 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.187+0000 7f268bfff700 1 -- 172.21.15.2:0/3456206133 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f268c1440f0 msgr2=0x7f268c15c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:20.193 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.187+0000 7f268bfff700 1 --2- 172.21.15.2:0/3456206133 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f268c1440f0 0x7f268c15c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:20.193 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.187+0000 7f268bfff700 1 -- 172.21.15.2:0/3456206133 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f268c143ae0 msgr2=0x7f268c15bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:20.193 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.187+0000 7f268bfff700 1 --2- 172.21.15.2:0/3456206133 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f268c143ae0 0x7f268c15bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:20.193 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.187+0000 7f268bfff700 1 -- 172.21.15.2:0/3456206133 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26800094a0 con 0x7f268c0722c0 2023-11-26T07:11:20.193 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.187+0000 7f268b7fe700 1 --2- 172.21.15.2:0/3456206133 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f268c143ae0 0x7f268c15bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:11:20.193 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.187+0000 7f268bfff700 1 --2- 172.21.15.2:0/3456206133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f268c0722c0 0x7f268c166e60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f267c00c780 tx=0x7f267c00ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:20.193 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.188+0000 7f2688ff9700 1 -- 172.21.15.2:0/3456206133 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267c004c80 con 0x7f268c0722c0 2023-11-26T07:11:20.193 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.188+0000 7f2688ff9700 1 -- 172.21.15.2:0/3456206133 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f267c004de0 con 0x7f268c0722c0 2023-11-26T07:11:20.193 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.188+0000 7f26924e7700 1 -- 172.21.15.2:0/3456206133 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2684009a70 con 0x7f268c0722c0 2023-11-26T07:11:20.194 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.188+0000 7f2688ff9700 1 -- 172.21.15.2:0/3456206133 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267c0072f0 con 0x7f268c0722c0 2023-11-26T07:11:20.194 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.188+0000 7f26924e7700 1 -- 172.21.15.2:0/3456206133 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f268c15b730 con 0x7f268c0722c0 2023-11-26T07:11:20.194 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.189+0000 7f2688ff9700 1 -- 172.21.15.2:0/3456206133 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f267c012400 con 0x7f268c0722c0 2023-11-26T07:11:20.194 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.189+0000 7f26924e7700 1 -- 172.21.15.2:0/3456206133 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f268c0b4c00 con 0x7f268c0722c0 2023-11-26T07:11:20.194 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.189+0000 7f2688ff9700 1 -- 172.21.15.2:0/3456206133 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f267c012d80 con 0x7f268c0722c0 2023-11-26T07:11:20.194 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.191+0000 7f2688ff9700 1 -- 172.21.15.2:0/3456206133 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f267c018070 con 0x7f268c0722c0 2023-11-26T07:11:20.264 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.262+0000 7f26924e7700 1 -- 172.21.15.2:0/3456206133 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f268c075480 con 0x7f268c0722c0 2023-11-26T07:11:20.265 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.263+0000 7f2688ff9700 1 -- 172.21.15.2:0/3456206133 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f267c012760 con 0x7f268c0722c0 2023-11-26T07:11:20.265 INFO:teuthology.misc.health.smithi002.stdout: 2023-11-26T07:11:20.265 INFO:teuthology.misc.health.smithi002.stdout:{"epoch":10,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:11:18.950310+0000","last_up_change":"0.000000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:11:20.266 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.264+0000 7f26924e7700 1 -- 172.21.15.2:0/3456206133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f268c0722c0 msgr2=0x7f268c166e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:20.266 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.264+0000 7f26924e7700 1 --2- 172.21.15.2:0/3456206133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f268c0722c0 0x7f268c166e60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f267c00c780 tx=0x7f267c00ca90 comp rx=0 tx=0).stop 2023-11-26T07:11:20.266 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.264+0000 7f26924e7700 1 -- 172.21.15.2:0/3456206133 shutdown_connections 2023-11-26T07:11:20.266 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.264+0000 7f26924e7700 1 --2- 172.21.15.2:0/3456206133 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f268c1440f0 0x7f268c15c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:20.266 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.264+0000 7f26924e7700 1 --2- 172.21.15.2:0/3456206133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f268c0722c0 0x7f268c166e60 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:20.266 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.264+0000 7f26924e7700 1 --2- 172.21.15.2:0/3456206133 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f268c143ae0 0x7f268c15bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:20.267 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.264+0000 7f26924e7700 1 -- 172.21.15.2:0/3456206133 >> 172.21.15.2:0/3456206133 conn(0x7f268c0b2740 msgr2=0x7f268c06afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:20.267 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.264+0000 7f26924e7700 1 -- 172.21.15.2:0/3456206133 shutdown_connections 2023-11-26T07:11:20.267 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:20.264+0000 7f26924e7700 1 -- 172.21.15.2:0/3456206133 wait complete. 2023-11-26T07:11:20.277 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-26T07:11:20.290 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:11:20.288+0000 7f8e31361200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-26T07:11:20.401 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-26T07:11:20.399+0000 7f8e0c58d200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-26T07:11:20.423 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:11:20.421+0000 7f8e31361200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-26T07:11:20.540 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-26T07:11:20.539+0000 7f8e0c58d200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-26T07:11:20.643 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:11:20.642+0000 7f8e31361200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-26T07:11:20.769 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-26T07:11:20.768+0000 7f8e0c58d200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-26T07:11:20.802 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:11:20.800+0000 7f8e31361200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-26T07:11:20.915 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:11:20.913+0000 7f8e31361200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-26T07:11:20.931 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-26T07:11:20.930+0000 7f8e0c58d200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-26T07:11:21.053 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-26T07:11:21.051+0000 7f8e0c58d200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-26T07:11:21.242 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:11:21.241+0000 7f8e31361200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-26T07:11:21.342 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:11:21.340+0000 7f8e31361200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-26T07:11:21.387 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-26T07:11:21.385+0000 7f8e0c58d200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-26T07:11:21.491 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-26T07:11:21.490+0000 7f8e0c58d200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-26T07:11:21.529 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:11:21.527+0000 7f8e31361200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-26T07:11:21.687 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-26T07:11:21.685+0000 7f8e0c58d200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-26T07:11:22.131 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:11:22.129+0000 7f8e31361200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-26T07:11:22.344 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-26T07:11:22.342+0000 7f8e0c58d200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-26T07:11:22.850 INFO:tasks.ceph.osd.1.smithi002.stderr:2023-11-26T07:11:22.848+0000 7f5bc5256640 -1 osd.1 0 log_to_monitors true 2023-11-26T07:11:23.081 INFO:tasks.ceph.osd.0.smithi002.stderr:2023-11-26T07:11:23.080+0000 7f3890e54640 -1 osd.0 0 log_to_monitors true 2023-11-26T07:11:23.098 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-11-26T07:11:23.096+0000 7fcc7f90a640 -1 osd.4 0 log_to_monitors true 2023-11-26T07:11:23.111 INFO:tasks.ceph.osd.3.smithi002.stderr:2023-11-26T07:11:23.109+0000 7f007e243640 -1 osd.3 0 log_to_monitors true 2023-11-26T07:11:23.121 INFO:tasks.ceph.osd.2.smithi002.stderr:2023-11-26T07:11:23.119+0000 7f1f39259640 -1 osd.2 0 log_to_monitors true 2023-11-26T07:11:23.125 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-11-26T07:11:23.124+0000 7feabacf9640 -1 osd.7 0 log_to_monitors true 2023-11-26T07:11:23.130 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-11-26T07:11:23.128+0000 7f8e6fde2640 -1 osd.5 0 log_to_monitors true 2023-11-26T07:11:23.148 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-11-26T07:11:23.146+0000 7f78e2b2d640 -1 osd.6 0 log_to_monitors true 2023-11-26T07:11:23.158 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:11:23.156+0000 7f8de92b6700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-26T07:11:23.158 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:11:23.156+0000 7f8de92b6700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-26T07:11:25.562 INFO:tasks.ceph.osd.3.smithi002.stderr:2023-11-26T07:11:25.560+0000 7f0071dfa700 -1 osd.3 0 waiting for initial osdmap 2023-11-26T07:11:25.573 INFO:tasks.ceph.osd.3.smithi002.stderr:2023-11-26T07:11:25.572+0000 7f006a1da700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-26T07:11:25.580 INFO:tasks.ceph.osd.0.smithi002.stderr:2023-11-26T07:11:25.579+0000 7f3884a0b700 -1 osd.0 0 waiting for initial osdmap 2023-11-26T07:11:25.584 INFO:tasks.ceph.osd.2.smithi002.stderr:2023-11-26T07:11:25.583+0000 7f1f2ce10700 -1 osd.2 0 waiting for initial osdmap 2023-11-26T07:11:25.595 INFO:tasks.ceph.osd.0.smithi002.stderr:2023-11-26T07:11:25.594+0000 7f387cdeb700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-26T07:11:25.600 INFO:tasks.ceph.osd.2.smithi002.stderr:2023-11-26T07:11:25.599+0000 7f1f251f0700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-26T07:11:25.736 INFO:tasks.ceph.osd.1.smithi002.stderr:2023-11-26T07:11:25.734+0000 7f5bb8e0d700 -1 osd.1 0 waiting for initial osdmap 2023-11-26T07:11:25.746 INFO:tasks.ceph.osd.1.smithi002.stderr:2023-11-26T07:11:25.745+0000 7f5bb11ed700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-26T07:11:26.029 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-11-26T07:11:26.027+0000 7feaae8b0700 -1 osd.7 0 waiting for initial osdmap 2023-11-26T07:11:26.046 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-11-26T07:11:26.045+0000 7feaa6c90700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-26T07:11:26.187 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-11-26T07:11:26.185+0000 7f78d66e4700 -1 osd.6 0 waiting for initial osdmap 2023-11-26T07:11:26.199 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-11-26T07:11:26.198+0000 7f78ceac4700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-26T07:11:26.214 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-11-26T07:11:26.213+0000 7fcc734c1700 -1 osd.4 0 waiting for initial osdmap 2023-11-26T07:11:26.231 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-11-26T07:11:26.230+0000 7fcc6b8a1700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-26T07:11:26.235 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-11-26T07:11:26.233+0000 7f8e63999700 -1 osd.5 0 waiting for initial osdmap 2023-11-26T07:11:26.247 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-11-26T07:11:26.246+0000 7f8e5bd79700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-26T07:11:27.083 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-26T07:11:27.211 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.209+0000 7f49f610d700 1 Processor -- start 2023-11-26T07:11:27.211 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.209+0000 7f49f610d700 1 -- start start 2023-11-26T07:11:27.213 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.210+0000 7f49f610d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f49f00b5ab0 0x7f49f006e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:27.214 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.210+0000 7f49f610d700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49f0071f50 con 0x7f49f00b4150 2023-11-26T07:11:27.214 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.210+0000 7f49f610d700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49f0072230 con 0x7f49f006b620 2023-11-26T07:11:27.214 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.210+0000 7f49f610d700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49f0072510 con 0x7f49f00b5ab0 2023-11-26T07:11:27.214 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.210+0000 7f49effff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f49f00b5ab0 0x7f49f006e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:27.214 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.210+0000 7f49eeffd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f49f00b4150 0x7f49f006de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58032/0 (socket says 172.21.15.2:58032) 2023-11-26T07:11:27.214 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.210+0000 7f49eeffd700 1 -- 172.21.15.2:0/3058270943 learned_addr learned my addr 172.21.15.2:0/3058270943 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:11:27.214 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.210+0000 7f49effff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f49f00b5ab0 0x7f49f006e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38592/0 (socket says 172.21.15.2:38592) 2023-11-26T07:11:27.214 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.210+0000 7f49ee7fc700 1 -- 172.21.15.2:0/3058270943 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1165735618 0 0) 0x7f49f0071f50 con 0x7f49f00b4150 2023-11-26T07:11:27.214 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.211+0000 7f49ee7fc700 1 -- 172.21.15.2:0/3058270943 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49d80035b0 con 0x7f49f00b4150 2023-11-26T07:11:27.214 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.211+0000 7f49effff700 1 -- 172.21.15.2:0/3058270943 >> v1:172.21.15.192:6789/0 conn(0x7f49f006b620 legacy=0x7f49f00b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:27.214 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.211+0000 7f49ee7fc700 1 -- 172.21.15.2:0/3058270943 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3359050065 0 0) 0x7f49f0072230 con 0x7f49f006b620 2023-11-26T07:11:27.215 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.211+0000 7f49effff700 1 -- 172.21.15.2:0/3058270943 >> v1:172.21.15.2:6789/0 conn(0x7f49f00b4150 legacy=0x7f49f006de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:27.215 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.211+0000 7f49effff700 1 -- 172.21.15.2:0/3058270943 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f00727f0 con 0x7f49f00b5ab0 2023-11-26T07:11:27.215 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.211+0000 7f49effff700 1 --2- 172.21.15.2:0/3058270943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49f00b5ab0 0x7f49f006e560 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f49e8009d90 tx=0x7f49e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30a86b663fa53457 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:27.215 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.211+0000 7f49ee7fc700 1 -- 172.21.15.2:0/3058270943 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e800e070 con 0x7f49f00b5ab0 2023-11-26T07:11:27.215 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.211+0000 7f49ee7fc700 1 -- 172.21.15.2:0/3058270943 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e800bb20 con 0x7f49f00b5ab0 2023-11-26T07:11:27.215 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.211+0000 7f49ee7fc700 1 -- 172.21.15.2:0/3058270943 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e800bed0 con 0x7f49f00b5ab0 2023-11-26T07:11:27.215 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.212+0000 7f49f610d700 1 -- 172.21.15.2:0/3058270943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49f00b5ab0 msgr2=0x7f49f006e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:27.215 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.212+0000 7f49f610d700 1 --2- 172.21.15.2:0/3058270943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49f00b5ab0 0x7f49f006e560 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f49e8009d90 tx=0x7f49e800b330 comp rx=0 tx=0).stop 2023-11-26T07:11:27.215 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.212+0000 7f49f610d700 1 -- 172.21.15.2:0/3058270943 shutdown_connections 2023-11-26T07:11:27.215 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.212+0000 7f49f610d700 1 --2- 172.21.15.2:0/3058270943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49f00b5ab0 0x7f49f006e560 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:27.215 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.212+0000 7f49f610d700 1 -- 172.21.15.2:0/3058270943 >> 172.21.15.2:0/3058270943 conn(0x7f49f00b2740 msgr2=0x7f49f00b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:27.215 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.212+0000 7f49f610d700 1 -- 172.21.15.2:0/3058270943 shutdown_connections 2023-11-26T07:11:27.215 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.212+0000 7f49f610d700 1 -- 172.21.15.2:0/3058270943 wait complete. 2023-11-26T07:11:27.218 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.213+0000 7f49f610d700 1 Processor -- start 2023-11-26T07:11:27.218 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.213+0000 7f49f610d700 1 -- start start 2023-11-26T07:11:27.218 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.214+0000 7f49f610d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49f006b620 0x7f49f00c59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:27.218 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.214+0000 7f49f610d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49f00b4150 0x7f49f00c8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:27.218 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.214+0000 7f49f610d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49f00b5ab0 0x7f49f01f6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:27.218 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.214+0000 7f49f610d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f00c6020 con 0x7f49f00b5ab0 2023-11-26T07:11:27.218 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.214+0000 7f49f610d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f00c6300 con 0x7f49f00b4150 2023-11-26T07:11:27.218 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.214+0000 7f49f610d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f00c65e0 con 0x7f49f006b620 2023-11-26T07:11:27.218 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.214+0000 7f49effff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49f00b5ab0 0x7f49f01f6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:27.218 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.214+0000 7f49effff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49f00b5ab0 0x7f49f01f6880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38598/0 (socket says 172.21.15.2:38598) 2023-11-26T07:11:27.218 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.214+0000 7f49effff700 1 -- 172.21.15.2:0/1783805103 learned_addr learned my addr 172.21.15.2:0/1783805103 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:27.219 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.214+0000 7f49eeffd700 1 --2- 172.21.15.2:0/1783805103 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49f00b4150 0x7f49f00c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:27.219 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.214+0000 7f49ef7fe700 1 --2- 172.21.15.2:0/1783805103 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49f006b620 0x7f49f00c59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:27.219 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.214+0000 7f49effff700 1 -- 172.21.15.2:0/1783805103 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49f006b620 msgr2=0x7f49f00c59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:27.219 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.214+0000 7f49effff700 1 --2- 172.21.15.2:0/1783805103 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49f006b620 0x7f49f00c59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:27.219 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.214+0000 7f49effff700 1 -- 172.21.15.2:0/1783805103 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49f00b4150 msgr2=0x7f49f00c8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:27.219 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.214+0000 7f49effff700 1 --2- 172.21.15.2:0/1783805103 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49f00b4150 0x7f49f00c8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:27.219 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.214+0000 7f49effff700 1 -- 172.21.15.2:0/1783805103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e8009a70 con 0x7f49f00b5ab0 2023-11-26T07:11:27.219 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.215+0000 7f49effff700 1 --2- 172.21.15.2:0/1783805103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49f00b5ab0 0x7f49f01f6880 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f49f00d1bd0 tx=0x7f49e8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:27.219 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.215+0000 7f49d7fff700 1 -- 172.21.15.2:0/1783805103 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e8003ea0 con 0x7f49f00b5ab0 2023-11-26T07:11:27.219 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.215+0000 7f49f610d700 1 -- 172.21.15.2:0/1783805103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49f00c68c0 con 0x7f49f00b5ab0 2023-11-26T07:11:27.219 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.215+0000 7f49d7fff700 1 -- 172.21.15.2:0/1783805103 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e8020070 con 0x7f49f00b5ab0 2023-11-26T07:11:27.219 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.215+0000 7f49d7fff700 1 -- 172.21.15.2:0/1783805103 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e80098f0 con 0x7f49f00b5ab0 2023-11-26T07:11:27.219 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.215+0000 7f49f610d700 1 -- 172.21.15.2:0/1783805103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49f00c89d0 con 0x7f49f00b5ab0 2023-11-26T07:11:27.219 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.216+0000 7f49f610d700 1 -- 172.21.15.2:0/1783805103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49f0075480 con 0x7f49f00b5ab0 2023-11-26T07:11:27.220 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.218+0000 7f49d7fff700 1 -- 172.21.15.2:0/1783805103 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f49e8031430 con 0x7f49f00b5ab0 2023-11-26T07:11:27.220 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.218+0000 7f49d7fff700 1 --2- 172.21.15.2:0/1783805103 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f49dc06ae70 0x7f49dc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:27.220 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.218+0000 7f49d7fff700 1 -- 172.21.15.2:0/1783805103 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f49e8022070 con 0x7f49f00b5ab0 2023-11-26T07:11:27.221 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.218+0000 7f49ef7fe700 1 --2- 172.21.15.2:0/1783805103 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f49dc06ae70 0x7f49dc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:27.221 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.219+0000 7f49ef7fe700 1 --2- 172.21.15.2:0/1783805103 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f49dc06ae70 0x7f49dc06d330 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f49e0000f60 tx=0x7f49e0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:27.223 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.222+0000 7f49d7fff700 1 -- 172.21.15.2:0/1783805103 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f49e8056940 con 0x7f49f00b5ab0 2023-11-26T07:11:27.427 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.425+0000 7f49f610d700 1 -- 172.21.15.2:0/1783805103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49f006bd40 con 0x7f49f00b5ab0 2023-11-26T07:11:27.428 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.426+0000 7f49d7fff700 1 -- 172.21.15.2:0/1783805103 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10860 (secure 0 0 0) 0x7f49e802c020 con 0x7f49f00b5ab0 2023-11-26T07:11:27.428 INFO:teuthology.misc.health.smithi002.stdout: 2023-11-26T07:11:27.428 INFO:teuthology.misc.health.smithi002.stdout:{"epoch":13,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:11:26.583110+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:11:27.430 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.428+0000 7f49f610d700 1 -- 172.21.15.2:0/1783805103 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f49dc06ae70 msgr2=0x7f49dc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:27.430 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.428+0000 7f49f610d700 1 --2- 172.21.15.2:0/1783805103 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f49dc06ae70 0x7f49dc06d330 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f49e0000f60 tx=0x7f49e0009040 comp rx=0 tx=0).stop 2023-11-26T07:11:27.430 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.428+0000 7f49f610d700 1 -- 172.21.15.2:0/1783805103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49f00b5ab0 msgr2=0x7f49f01f6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:27.430 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.428+0000 7f49f610d700 1 --2- 172.21.15.2:0/1783805103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49f00b5ab0 0x7f49f01f6880 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f49f00d1bd0 tx=0x7f49e8004ad0 comp rx=0 tx=0).stop 2023-11-26T07:11:27.431 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.428+0000 7f49f610d700 1 -- 172.21.15.2:0/1783805103 shutdown_connections 2023-11-26T07:11:27.431 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.428+0000 7f49f610d700 1 --2- 172.21.15.2:0/1783805103 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f49dc06ae70 0x7f49dc06d330 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:27.431 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.428+0000 7f49f610d700 1 --2- 172.21.15.2:0/1783805103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49f00b5ab0 0x7f49f01f6880 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:27.431 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.428+0000 7f49f610d700 1 --2- 172.21.15.2:0/1783805103 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49f006b620 0x7f49f00c59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:27.431 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.428+0000 7f49f610d700 1 --2- 172.21.15.2:0/1783805103 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49f00b4150 0x7f49f00c8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:27.431 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.428+0000 7f49f610d700 1 -- 172.21.15.2:0/1783805103 >> 172.21.15.2:0/1783805103 conn(0x7f49f00b2740 msgr2=0x7f49f0146360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:27.431 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.428+0000 7f49f610d700 1 -- 172.21.15.2:0/1783805103 shutdown_connections 2023-11-26T07:11:27.431 INFO:teuthology.misc.health.smithi002.stderr:2023-11-26T07:11:27.428+0000 7f49f610d700 1 -- 172.21.15.2:0/1783805103 wait complete. 2023-11-26T07:11:27.441 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-26T07:11:27.441 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-26T07:11:27.442 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-26T07:11:27.442 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-26T07:11:27.444 INFO:tasks.ceph.mds.a:Started 2023-11-26T07:11:27.444 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-26T07:11:27.444 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-26T07:11:27.446 INFO:tasks.ceph.mds.c:Started 2023-11-26T07:11:27.446 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-26T07:11:27.446 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-26T07:11:27.449 INFO:tasks.ceph.mds.b:Started 2023-11-26T07:11:27.449 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-26T07:11:27.449 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-26T07:11:27.452 INFO:tasks.ceph.mds.d:Started 2023-11-26T07:11:27.452 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-26T07:11:27.452 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:11:27.526 INFO:tasks.ceph.mds.c.smithi002.stdout:starting mds.c at 2023-11-26T07:11:27.527 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2023-11-26T07:11:27.539 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2023-11-26T07:11:27.540 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2023-11-26T07:11:27.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.583+0000 7f6d1750a700 1 Processor -- start 2023-11-26T07:11:27.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.583+0000 7f6d1750a700 1 -- start start 2023-11-26T07:11:27.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.584+0000 7f6d1750a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6d1006b620 0x7f6d100b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:27.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.584+0000 7f6d1750a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6d100b5ab0 0x7f6d100b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:27.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.584+0000 7f6d1750a700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d10071f50 con 0x7f6d101478c0 2023-11-26T07:11:27.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.584+0000 7f6d1750a700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d10072230 con 0x7f6d1006b620 2023-11-26T07:11:27.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.584+0000 7f6d1750a700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d10072510 con 0x7f6d100b5ab0 2023-11-26T07:11:27.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.584+0000 7f6d152a6700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6d1006b620 0x7f6d100b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:27.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.584+0000 7f6d152a6700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6d1006b620 0x7f6d100b3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38628/0 (socket says 172.21.15.2:38628) 2023-11-26T07:11:27.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.584+0000 7f6d152a6700 1 -- 172.21.15.2:0/2012792804 learned_addr learned my addr 172.21.15.2:0/2012792804 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:27.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.584+0000 7f6d14aa5700 1 --2- 172.21.15.2:0/2012792804 >> v2:172.21.15.192:3300/0 conn(0x7f6d100b5ab0 0x7f6d100b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:27.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.584+0000 7f6d15aa7700 1 --1- 172.21.15.2:0/2012792804 >> v1:172.21.15.2:6789/0 conn(0x7f6d101478c0 0x7f6d10161ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58070/0 (socket says 172.21.15.2:58070) 2023-11-26T07:11:27.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.585+0000 7f6d152a6700 1 -- 172.21.15.2:0/2012792804 >> v2:172.21.15.192:3300/0 conn(0x7f6d100b5ab0 msgr2=0x7f6d100b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:27.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.585+0000 7f6d152a6700 1 --2- 172.21.15.2:0/2012792804 >> v2:172.21.15.192:3300/0 conn(0x7f6d100b5ab0 0x7f6d100b3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:27.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.585+0000 7f6d152a6700 1 -- 172.21.15.2:0/2012792804 >> v1:172.21.15.2:6789/0 conn(0x7f6d101478c0 legacy=0x7f6d10161ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:27.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.585+0000 7f6d07fff700 1 -- 172.21.15.2:0/2012792804 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2875625738 0 0) 0x7f6d10071f50 con 0x7f6d101478c0 2023-11-26T07:11:27.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.585+0000 7f6d152a6700 1 -- 172.21.15.2:0/2012792804 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d100727f0 con 0x7f6d1006b620 2023-11-26T07:11:27.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.585+0000 7f6d152a6700 1 --2- 172.21.15.2:0/2012792804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d1006b620 0x7f6d100b3a40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6d1006d6f0 tx=0x7f6d00009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee2664b87ca74d40 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:27.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.588+0000 7f6d07fff700 1 -- 172.21.15.2:0/2012792804 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d00011830 con 0x7f6d1006b620 2023-11-26T07:11:27.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.588+0000 7f6d07fff700 1 -- 172.21.15.2:0/2012792804 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d00011990 con 0x7f6d1006b620 2023-11-26T07:11:27.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.588+0000 7f6d07fff700 1 -- 172.21.15.2:0/2012792804 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d00011d20 con 0x7f6d1006b620 2023-11-26T07:11:27.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.588+0000 7f6d1750a700 1 -- 172.21.15.2:0/2012792804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d1006b620 msgr2=0x7f6d100b3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:27.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.588+0000 7f6d1750a700 1 --2- 172.21.15.2:0/2012792804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d1006b620 0x7f6d100b3a40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6d1006d6f0 tx=0x7f6d00009bd0 comp rx=0 tx=0).stop 2023-11-26T07:11:27.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.588+0000 7f6d1750a700 1 -- 172.21.15.2:0/2012792804 shutdown_connections 2023-11-26T07:11:27.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.588+0000 7f6d1750a700 1 --2- 172.21.15.2:0/2012792804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d1006b620 0x7f6d100b3a40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:27.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.588+0000 7f6d1750a700 1 --2- 172.21.15.2:0/2012792804 >> v2:172.21.15.192:3300/0 conn(0x7f6d100b5ab0 0x7f6d100b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:27.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.588+0000 7f6d1750a700 1 -- 172.21.15.2:0/2012792804 >> 172.21.15.2:0/2012792804 conn(0x7f6d100b2740 msgr2=0x7f6d100b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:27.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.589+0000 7f6d1750a700 1 -- 172.21.15.2:0/2012792804 shutdown_connections 2023-11-26T07:11:27.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.589+0000 7f6d1750a700 1 -- 172.21.15.2:0/2012792804 wait complete. 2023-11-26T07:11:27.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.590+0000 7f6d1750a700 1 Processor -- start 2023-11-26T07:11:27.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.590+0000 7f6d1750a700 1 -- start start 2023-11-26T07:11:27.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.591+0000 7f6d1750a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d1006b620 0x7f6d1013eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:27.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.591+0000 7f6d1750a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d100b5ab0 0x7f6d100c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:27.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.591+0000 7f6d1750a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d101478c0 0x7f6d101f7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:27.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.591+0000 7f6d1750a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d100c5f60 con 0x7f6d101478c0 2023-11-26T07:11:27.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.591+0000 7f6d1750a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1013cd00 con 0x7f6d100b5ab0 2023-11-26T07:11:27.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.591+0000 7f6d1750a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1013cf50 con 0x7f6d1006b620 2023-11-26T07:11:27.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.591+0000 7f6d15aa7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d101478c0 0x7f6d101f7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:27.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.591+0000 7f6d152a6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d1006b620 0x7f6d1013eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:27.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.591+0000 7f6d15aa7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d101478c0 0x7f6d101f7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38638/0 (socket says 172.21.15.2:38638) 2023-11-26T07:11:27.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.591+0000 7f6d15aa7700 1 -- 172.21.15.2:0/3960356134 learned_addr learned my addr 172.21.15.2:0/3960356134 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:27.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.591+0000 7f6d14aa5700 1 --2- 172.21.15.2:0/3960356134 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d100b5ab0 0x7f6d100c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:27.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.592+0000 7f6d15aa7700 1 -- 172.21.15.2:0/3960356134 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d1006b620 msgr2=0x7f6d1013eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:27.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.592+0000 7f6d15aa7700 1 --2- 172.21.15.2:0/3960356134 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d1006b620 0x7f6d1013eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:27.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.592+0000 7f6d15aa7700 1 -- 172.21.15.2:0/3960356134 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d100b5ab0 msgr2=0x7f6d100c5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:27.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.592+0000 7f6d15aa7700 1 --2- 172.21.15.2:0/3960356134 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d100b5ab0 0x7f6d100c5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:27.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.592+0000 7f6d15aa7700 1 -- 172.21.15.2:0/3960356134 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d00009550 con 0x7f6d101478c0 2023-11-26T07:11:27.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.592+0000 7f6d15aa7700 1 --2- 172.21.15.2:0/3960356134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d101478c0 0x7f6d101f7b60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6d0800cba0 tx=0x7f6d0800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:27.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.592+0000 7f6d05ffb700 1 -- 172.21.15.2:0/3960356134 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0800aaa0 con 0x7f6d101478c0 2023-11-26T07:11:27.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.592+0000 7f6d05ffb700 1 -- 172.21.15.2:0/3960356134 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d0800ac20 con 0x7f6d101478c0 2023-11-26T07:11:27.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.592+0000 7f6d1750a700 1 -- 172.21.15.2:0/3960356134 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d1013d230 con 0x7f6d101478c0 2023-11-26T07:11:27.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.592+0000 7f6d05ffb700 1 -- 172.21.15.2:0/3960356134 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d080070d0 con 0x7f6d101478c0 2023-11-26T07:11:27.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.592+0000 7f6d1750a700 1 -- 172.21.15.2:0/3960356134 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d1013d7f0 con 0x7f6d101478c0 2023-11-26T07:11:27.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.593+0000 7f6d1750a700 1 -- 172.21.15.2:0/3960356134 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d1013d9b0 con 0x7f6d101478c0 2023-11-26T07:11:27.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.593+0000 7f6d05ffb700 1 -- 172.21.15.2:0/3960356134 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f6d08007230 con 0x7f6d101478c0 2023-11-26T07:11:27.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.594+0000 7f6d05ffb700 1 --2- 172.21.15.2:0/3960356134 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6cf406ae40 0x7f6cf406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:27.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.594+0000 7f6d05ffb700 1 -- 172.21.15.2:0/3960356134 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f6d08088d10 con 0x7f6d101478c0 2023-11-26T07:11:27.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.594+0000 7f6d152a6700 1 --2- 172.21.15.2:0/3960356134 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6cf406ae40 0x7f6cf406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:27.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.595+0000 7f6d152a6700 1 --2- 172.21.15.2:0/3960356134 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6cf406ae40 0x7f6cf406d300 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6d00009c10 tx=0x7f6d00008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:27.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.599+0000 7f6d05ffb700 1 -- 172.21.15.2:0/3960356134 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6d08054370 con 0x7f6d101478c0 2023-11-26T07:11:27.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.802+0000 7f6d1750a700 1 -- 172.21.15.2:0/3960356134 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d100b2b20 con 0x7f6d101478c0 2023-11-26T07:11:27.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.802+0000 7f6d05ffb700 1 -- 172.21.15.2:0/3960356134 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+11044 (secure 0 0 0) 0x7f6d08018090 con 0x7f6d101478c0 2023-11-26T07:11:27.804 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:11:27.804 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":14,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:11:27.585036+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:11:27.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.805+0000 7f6d1750a700 1 -- 172.21.15.2:0/3960356134 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6cf406ae40 msgr2=0x7f6cf406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:27.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.805+0000 7f6d1750a700 1 --2- 172.21.15.2:0/3960356134 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6cf406ae40 0x7f6cf406d300 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6d00009c10 tx=0x7f6d00008030 comp rx=0 tx=0).stop 2023-11-26T07:11:27.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.805+0000 7f6d1750a700 1 -- 172.21.15.2:0/3960356134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d101478c0 msgr2=0x7f6d101f7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:27.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.805+0000 7f6d1750a700 1 --2- 172.21.15.2:0/3960356134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d101478c0 0x7f6d101f7b60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6d0800cba0 tx=0x7f6d0800ceb0 comp rx=0 tx=0).stop 2023-11-26T07:11:27.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.805+0000 7f6d1750a700 1 -- 172.21.15.2:0/3960356134 shutdown_connections 2023-11-26T07:11:27.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.805+0000 7f6d1750a700 1 --2- 172.21.15.2:0/3960356134 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6cf406ae40 0x7f6cf406d300 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:27.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.805+0000 7f6d1750a700 1 --2- 172.21.15.2:0/3960356134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d101478c0 0x7f6d101f7b60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:27.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.805+0000 7f6d1750a700 1 --2- 172.21.15.2:0/3960356134 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d1006b620 0x7f6d1013eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:27.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.805+0000 7f6d1750a700 1 --2- 172.21.15.2:0/3960356134 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d100b5ab0 0x7f6d100c5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:27.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.805+0000 7f6d1750a700 1 -- 172.21.15.2:0/3960356134 >> 172.21.15.2:0/3960356134 conn(0x7f6d100b2740 msgr2=0x7f6d100adec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:27.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.805+0000 7f6d1750a700 1 -- 172.21.15.2:0/3960356134 shutdown_connections 2023-11-26T07:11:27.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.805+0000 7f6d1750a700 1 -- 172.21.15.2:0/3960356134 wait complete. 2023-11-26T07:11:27.819 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2023-11-26T07:11:27.819 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:11:27.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.942+0000 7f848e9b9700 1 Processor -- start 2023-11-26T07:11:27.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.942+0000 7f848e9b9700 1 -- start start 2023-11-26T07:11:27.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.943+0000 7f848e9b9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8488144c10 0x7f848806afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:27.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.943+0000 7f848e9b9700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8488145650 0x7f848806b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:27.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.943+0000 7f848e9b9700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f848806eb80 con 0x7f8488145100 2023-11-26T07:11:27.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.943+0000 7f848e9b9700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f848806f500 con 0x7f8488145650 2023-11-26T07:11:27.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.943+0000 7f848e9b9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84880cd610 con 0x7f8488144c10 2023-11-26T07:11:27.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.944+0000 7f8487fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8488144c10 0x7f848806afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:27.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.944+0000 7f848cf56700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8488145650 0x7f848806b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:27.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.944+0000 7f8487fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8488144c10 0x7f848806afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.2:36736/0 (socket says 172.21.15.2:36736) 2023-11-26T07:11:27.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.944+0000 7f8487fff700 1 -- 172.21.15.2:0/369888849 learned_addr learned my addr 172.21.15.2:0/369888849 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:27.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.944+0000 7f84877fe700 1 --1- 172.21.15.2:0/369888849 >> v1:172.21.15.192:6789/0 conn(0x7f8488145100 0x7f8488071bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.2:37236/0 (socket says 172.21.15.2:37236) 2023-11-26T07:11:27.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.944+0000 7f8487fff700 1 -- 172.21.15.2:0/369888849 >> v2:172.21.15.192:3300/0 conn(0x7f8488145650 msgr2=0x7f848806b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:27.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.944+0000 7f8487fff700 1 --2- 172.21.15.2:0/369888849 >> v2:172.21.15.192:3300/0 conn(0x7f8488145650 0x7f848806b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:27.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.944+0000 7f8487fff700 1 -- 172.21.15.2:0/369888849 >> v1:172.21.15.192:6789/0 conn(0x7f8488145100 legacy=0x7f8488071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:27.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.944+0000 7f8487fff700 1 -- 172.21.15.2:0/369888849 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8488160720 con 0x7f8488144c10 2023-11-26T07:11:27.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.944+0000 7f848cf56700 1 --2- 172.21.15.2:0/369888849 >> v2:172.21.15.192:3300/0 conn(0x7f8488145650 0x7f848806b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:11:27.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.944+0000 7f8486ffd700 1 -- 172.21.15.2:0/369888849 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2168552602 0 0) 0x7f848806eb80 con 0x7f8488145100 2023-11-26T07:11:27.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.944+0000 7f8487fff700 1 --2- 172.21.15.2:0/369888849 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8488144c10 0x7f848806afd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f84780098f0 tx=0x7f8478009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cea318e7b0e70ddd server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:27.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.944+0000 7f8486ffd700 1 -- 172.21.15.2:0/369888849 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8478011830 con 0x7f8488144c10 2023-11-26T07:11:27.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.945+0000 7f8486ffd700 1 -- 172.21.15.2:0/369888849 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8478011990 con 0x7f8488144c10 2023-11-26T07:11:27.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.945+0000 7f8486ffd700 1 -- 172.21.15.2:0/369888849 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8478011d20 con 0x7f8488144c10 2023-11-26T07:11:27.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.945+0000 7f848e9b9700 1 -- 172.21.15.2:0/369888849 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8488144c10 msgr2=0x7f848806afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:27.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.945+0000 7f848e9b9700 1 --2- 172.21.15.2:0/369888849 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8488144c10 0x7f848806afd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f84780098f0 tx=0x7f8478009c00 comp rx=0 tx=0).stop 2023-11-26T07:11:27.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.945+0000 7f848e9b9700 1 -- 172.21.15.2:0/369888849 shutdown_connections 2023-11-26T07:11:27.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.945+0000 7f848e9b9700 1 --2- 172.21.15.2:0/369888849 >> v2:172.21.15.192:3300/0 conn(0x7f8488145650 0x7f848806b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:27.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.945+0000 7f848e9b9700 1 --2- 172.21.15.2:0/369888849 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8488144c10 0x7f848806afd0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:27.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.945+0000 7f848e9b9700 1 -- 172.21.15.2:0/369888849 >> 172.21.15.2:0/369888849 conn(0x7f84880b2740 msgr2=0x7f84880b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:27.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.945+0000 7f848e9b9700 1 -- 172.21.15.2:0/369888849 shutdown_connections 2023-11-26T07:11:27.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.945+0000 7f848e9b9700 1 -- 172.21.15.2:0/369888849 wait complete. 2023-11-26T07:11:27.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.946+0000 7f848e9b9700 1 Processor -- start 2023-11-26T07:11:27.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.947+0000 7f848e9b9700 1 -- start start 2023-11-26T07:11:27.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.947+0000 7f848e9b9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8488144c10 0x7f8488143b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:27.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.947+0000 7f848e9b9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8488145100 0x7f84880acd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:27.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.947+0000 7f848e9b9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8488145650 0x7f84880ad280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:27.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.947+0000 7f848e9b9700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84881428a0 con 0x7f8488144c10 2023-11-26T07:11:27.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.947+0000 7f848e9b9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8488142af0 con 0x7f8488145100 2023-11-26T07:11:27.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.947+0000 7f848e9b9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8488142dd0 con 0x7f8488145650 2023-11-26T07:11:27.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.947+0000 7f8487fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8488144c10 0x7f8488143b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:27.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.947+0000 7f8487fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8488144c10 0x7f8488143b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38662/0 (socket says 172.21.15.2:38662) 2023-11-26T07:11:27.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.947+0000 7f8487fff700 1 -- 172.21.15.2:0/315612208 learned_addr learned my addr 172.21.15.2:0/315612208 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:27.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.947+0000 7f848cf56700 1 --2- 172.21.15.2:0/315612208 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8488145650 0x7f84880ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:27.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.948+0000 7f84877fe700 1 --2- 172.21.15.2:0/315612208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8488145100 0x7f84880acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:27.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.948+0000 7f8487fff700 1 -- 172.21.15.2:0/315612208 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8488145650 msgr2=0x7f84880ad280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:27.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.948+0000 7f8487fff700 1 --2- 172.21.15.2:0/315612208 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8488145650 0x7f84880ad280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:27.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.948+0000 7f8487fff700 1 -- 172.21.15.2:0/315612208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8488145100 msgr2=0x7f84880acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:27.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.948+0000 7f8487fff700 1 --2- 172.21.15.2:0/315612208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8488145100 0x7f84880acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:27.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.948+0000 7f8487fff700 1 -- 172.21.15.2:0/315612208 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8480009a70 con 0x7f8488144c10 2023-11-26T07:11:27.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.948+0000 7f848cf56700 1 --2- 172.21.15.2:0/315612208 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8488145650 0x7f84880ad280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:11:27.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.948+0000 7f84877fe700 1 --2- 172.21.15.2:0/315612208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8488145100 0x7f84880acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:11:27.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.948+0000 7f8487fff700 1 --2- 172.21.15.2:0/315612208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8488144c10 0x7f8488143b90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8478009c40 tx=0x7f8478004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:27.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.948+0000 7f8484ff9700 1 -- 172.21.15.2:0/315612208 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8478004300 con 0x7f8488144c10 2023-11-26T07:11:27.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.948+0000 7f8484ff9700 1 -- 172.21.15.2:0/315612208 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f847801f070 con 0x7f8488144c10 2023-11-26T07:11:27.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.948+0000 7f848e9b9700 1 -- 172.21.15.2:0/315612208 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8478009550 con 0x7f8488144c10 2023-11-26T07:11:27.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.948+0000 7f8484ff9700 1 -- 172.21.15.2:0/315612208 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84780036a0 con 0x7f8488144c10 2023-11-26T07:11:27.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.948+0000 7f848e9b9700 1 -- 172.21.15.2:0/315612208 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8488143390 con 0x7f8488144c10 2023-11-26T07:11:27.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.949+0000 7f848e9b9700 1 -- 172.21.15.2:0/315612208 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84880cd330 con 0x7f8488144c10 2023-11-26T07:11:27.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.949+0000 7f8484ff9700 1 -- 172.21.15.2:0/315612208 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f8478021030 con 0x7f8488144c10 2023-11-26T07:11:27.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.950+0000 7f8484ff9700 1 --2- 172.21.15.2:0/315612208 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f847406ae40 0x7f847406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:27.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.950+0000 7f8484ff9700 1 -- 172.21.15.2:0/315612208 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f847808a450 con 0x7f8488144c10 2023-11-26T07:11:27.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.950+0000 7f84877fe700 1 --2- 172.21.15.2:0/315612208 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f847406ae40 0x7f847406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:27.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.950+0000 7f84877fe700 1 --2- 172.21.15.2:0/315612208 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f847406ae40 0x7f847406d300 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f84881f5080 tx=0x7f847c007ca0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:27.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:27.954+0000 7f8484ff9700 1 -- 172.21.15.2:0/315612208 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8478055bd0 con 0x7f8488144c10 2023-11-26T07:11:28.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:28.200+0000 7f848e9b9700 1 -- 172.21.15.2:0/315612208 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84880cda40 con 0x7f8488144c10 2023-11-26T07:11:28.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:28.205+0000 7f8484ff9700 1 -- 172.21.15.2:0/315612208 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1318 (secure 0 0 0) 0x7f84880cda40 con 0x7f8488144c10 2023-11-26T07:11:28.207 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:11:28.207 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/953933423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":953933423},{"type":"v1","addr":"172.21.15.2:6835","nonce":953933423}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-11-26T07:11:28.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:28.207+0000 7f848e9b9700 1 -- 172.21.15.2:0/315612208 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f847406ae40 msgr2=0x7f847406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:28.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:28.207+0000 7f848e9b9700 1 --2- 172.21.15.2:0/315612208 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f847406ae40 0x7f847406d300 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f84881f5080 tx=0x7f847c007ca0 comp rx=0 tx=0).stop 2023-11-26T07:11:28.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:28.207+0000 7f848e9b9700 1 -- 172.21.15.2:0/315612208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8488144c10 msgr2=0x7f8488143b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:28.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:28.207+0000 7f848e9b9700 1 --2- 172.21.15.2:0/315612208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8488144c10 0x7f8488143b90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8478009c40 tx=0x7f8478004750 comp rx=0 tx=0).stop 2023-11-26T07:11:28.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:28.207+0000 7f848e9b9700 1 -- 172.21.15.2:0/315612208 shutdown_connections 2023-11-26T07:11:28.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:28.207+0000 7f848e9b9700 1 --2- 172.21.15.2:0/315612208 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f847406ae40 0x7f847406d300 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:28.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:28.207+0000 7f848e9b9700 1 --2- 172.21.15.2:0/315612208 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8488145650 0x7f84880ad280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:28.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:28.207+0000 7f848e9b9700 1 --2- 172.21.15.2:0/315612208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8488144c10 0x7f8488143b90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:28.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:28.207+0000 7f848e9b9700 1 --2- 172.21.15.2:0/315612208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8488145100 0x7f84880acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:28.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:28.207+0000 7f848e9b9700 1 -- 172.21.15.2:0/315612208 >> 172.21.15.2:0/315612208 conn(0x7f84880b2740 msgr2=0x7f84880b1140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:28.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:28.207+0000 7f848e9b9700 1 -- 172.21.15.2:0/315612208 shutdown_connections 2023-11-26T07:11:28.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:28.207+0000 7f848e9b9700 1 -- 172.21.15.2:0/315612208 wait complete. 2023-11-26T07:11:28.211 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 2 2023-11-26T07:11:30.222 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:11:30.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.350+0000 7fa35a88f700 1 Processor -- start 2023-11-26T07:11:30.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.350+0000 7fa35a88f700 1 -- start start 2023-11-26T07:11:30.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.350+0000 7fa35a88f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa3540b4230 0x7fa3540d1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:30.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.350+0000 7fa35a88f700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3540b5da0 con 0x7fa35406afd0 2023-11-26T07:11:30.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.350+0000 7fa35a88f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa35415f440 con 0x7fa35415ec20 2023-11-26T07:11:30.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.350+0000 7fa35a88f700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3540d18c0 con 0x7fa3540b4230 2023-11-26T07:11:30.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.351+0000 7fa3537fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa35406afd0 0x7fa35415e510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58134/0 (socket says 172.21.15.2:58134) 2023-11-26T07:11:30.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.351+0000 7fa3537fe700 1 -- 172.21.15.2:0/1718960583 learned_addr learned my addr 172.21.15.2:0/1718960583 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:11:30.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.351+0000 7fa353fff700 1 --2- 172.21.15.2:0/1718960583 >> v2:172.21.15.192:3300/0 conn(0x7fa3540b4230 0x7fa3540d1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:30.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.351+0000 7fa352ffd700 1 -- 172.21.15.2:0/1718960583 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 881591361 0 0) 0x7fa3540b5da0 con 0x7fa35406afd0 2023-11-26T07:11:30.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.351+0000 7fa352ffd700 1 -- 172.21.15.2:0/1718960583 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa33c0035b0 con 0x7fa35406afd0 2023-11-26T07:11:30.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.351+0000 7fa353fff700 1 -- 172.21.15.2:0/1718960583 >> v1:172.21.15.192:6789/0 conn(0x7fa35415ec20 legacy=0x7fa35406db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:30.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.351+0000 7fa352ffd700 1 -- 172.21.15.2:0/1718960583 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 558039127 0 0) 0x7fa35415f440 con 0x7fa35415ec20 2023-11-26T07:11:30.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.351+0000 7fa353fff700 1 -- 172.21.15.2:0/1718960583 >> v1:172.21.15.2:6789/0 conn(0x7fa35406afd0 legacy=0x7fa35415e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:30.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.351+0000 7fa353fff700 1 -- 172.21.15.2:0/1718960583 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3540d0ef0 con 0x7fa3540b4230 2023-11-26T07:11:30.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.351+0000 7fa353fff700 1 --2- 172.21.15.2:0/1718960583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3540b4230 0x7fa3540d1380 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa344009840 tx=0x7fa344009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f69ae1e78a629282 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:30.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.352+0000 7fa352ffd700 1 -- 172.21.15.2:0/1718960583 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa344011830 con 0x7fa3540b4230 2023-11-26T07:11:30.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.352+0000 7fa352ffd700 1 -- 172.21.15.2:0/1718960583 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa344011990 con 0x7fa3540b4230 2023-11-26T07:11:30.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.352+0000 7fa352ffd700 1 -- 172.21.15.2:0/1718960583 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa344011d20 con 0x7fa3540b4230 2023-11-26T07:11:30.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.352+0000 7fa35a88f700 1 -- 172.21.15.2:0/1718960583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3540b4230 msgr2=0x7fa3540d1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:30.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.352+0000 7fa35a88f700 1 --2- 172.21.15.2:0/1718960583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3540b4230 0x7fa3540d1380 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa344009840 tx=0x7fa344009b50 comp rx=0 tx=0).stop 2023-11-26T07:11:30.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.352+0000 7fa35a88f700 1 -- 172.21.15.2:0/1718960583 shutdown_connections 2023-11-26T07:11:30.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.352+0000 7fa35a88f700 1 --2- 172.21.15.2:0/1718960583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3540b4230 0x7fa3540d1380 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:30.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.352+0000 7fa35a88f700 1 -- 172.21.15.2:0/1718960583 >> 172.21.15.2:0/1718960583 conn(0x7fa35406c0e0 msgr2=0x7fa35406c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:30.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.352+0000 7fa35a88f700 1 -- 172.21.15.2:0/1718960583 shutdown_connections 2023-11-26T07:11:30.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.352+0000 7fa35a88f700 1 -- 172.21.15.2:0/1718960583 wait complete. 2023-11-26T07:11:30.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.353+0000 7fa35a88f700 1 Processor -- start 2023-11-26T07:11:30.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.354+0000 7fa35a88f700 1 -- start start 2023-11-26T07:11:30.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.354+0000 7fa35a88f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa35406afd0 0x7fa354145eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:30.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.354+0000 7fa35a88f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3540b4230 0x7fa35415d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:30.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.354+0000 7fa35a88f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa35415ec20 0x7fa35415d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:30.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.354+0000 7fa35a88f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa354146800 con 0x7fa35406afd0 2023-11-26T07:11:30.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.354+0000 7fa35a88f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa354146a50 con 0x7fa3540b4230 2023-11-26T07:11:30.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.354+0000 7fa35a88f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa354146d30 con 0x7fa35415ec20 2023-11-26T07:11:30.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.354+0000 7fa353fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa35406afd0 0x7fa354145eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:30.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.354+0000 7fa353fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa35406afd0 0x7fa354145eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38696/0 (socket says 172.21.15.2:38696) 2023-11-26T07:11:30.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.354+0000 7fa353fff700 1 -- 172.21.15.2:0/1245116701 learned_addr learned my addr 172.21.15.2:0/1245116701 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:30.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.355+0000 7fa358e2c700 1 --2- 172.21.15.2:0/1245116701 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa35415ec20 0x7fa35415d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:30.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.355+0000 7fa3537fe700 1 --2- 172.21.15.2:0/1245116701 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3540b4230 0x7fa35415d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:30.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.355+0000 7fa353fff700 1 -- 172.21.15.2:0/1245116701 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa35415ec20 msgr2=0x7fa35415d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:30.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.355+0000 7fa353fff700 1 --2- 172.21.15.2:0/1245116701 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa35415ec20 0x7fa35415d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:30.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.355+0000 7fa353fff700 1 -- 172.21.15.2:0/1245116701 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3540b4230 msgr2=0x7fa35415d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:30.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.355+0000 7fa353fff700 1 --2- 172.21.15.2:0/1245116701 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3540b4230 0x7fa35415d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:30.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.355+0000 7fa353fff700 1 -- 172.21.15.2:0/1245116701 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3440094a0 con 0x7fa35406afd0 2023-11-26T07:11:30.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.355+0000 7fa3537fe700 1 --2- 172.21.15.2:0/1245116701 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3540b4230 0x7fa35415d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:11:30.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.355+0000 7fa353fff700 1 --2- 172.21.15.2:0/1245116701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa35406afd0 0x7fa354145eb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa3440090b0 tx=0x7fa344004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:30.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.355+0000 7fa350ff9700 1 -- 172.21.15.2:0/1245116701 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34401a860 con 0x7fa35406afd0 2023-11-26T07:11:30.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.355+0000 7fa350ff9700 1 -- 172.21.15.2:0/1245116701 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa34401a9c0 con 0x7fa35406afd0 2023-11-26T07:11:30.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.355+0000 7fa350ff9700 1 -- 172.21.15.2:0/1245116701 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34401ad30 con 0x7fa35406afd0 2023-11-26T07:11:30.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.355+0000 7fa35a88f700 1 -- 172.21.15.2:0/1245116701 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa354147010 con 0x7fa35406afd0 2023-11-26T07:11:30.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.355+0000 7fa35a88f700 1 -- 172.21.15.2:0/1245116701 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3541463f0 con 0x7fa35406afd0 2023-11-26T07:11:30.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.356+0000 7fa35a88f700 1 -- 172.21.15.2:0/1245116701 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa354068670 con 0x7fa35406afd0 2023-11-26T07:11:30.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.357+0000 7fa350ff9700 1 -- 172.21.15.2:0/1245116701 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7fa344022070 con 0x7fa35406afd0 2023-11-26T07:11:30.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.357+0000 7fa350ff9700 1 --2- 172.21.15.2:0/1245116701 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa34006ae40 0x7fa34006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:30.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.357+0000 7fa350ff9700 1 -- 172.21.15.2:0/1245116701 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa34408a6d0 con 0x7fa35406afd0 2023-11-26T07:11:30.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.357+0000 7fa3537fe700 1 --2- 172.21.15.2:0/1245116701 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa34006ae40 0x7fa34006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:30.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.358+0000 7fa3537fe700 1 --2- 172.21.15.2:0/1245116701 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa34006ae40 0x7fa34006d300 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa3541f6d30 tx=0x7fa348009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:30.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.369+0000 7fa350ff9700 1 -- 172.21.15.2:0/1245116701 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa344055cd0 con 0x7fa35406afd0 2023-11-26T07:11:30.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.624+0000 7fa35a88f700 1 -- 172.21.15.2:0/1245116701 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa354072670 con 0x7fa35406afd0 2023-11-26T07:11:30.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.624+0000 7fa350ff9700 1 -- 172.21.15.2:0/1245116701 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3691 (secure 0 0 0) 0x7fa3440592f0 con 0x7fa35406afd0 2023-11-26T07:11:30.627 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:11:30.627 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/3693634219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3693634219},{"type":"v1","addr":"172.21.15.2:6834","nonce":3693634219}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/953933423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":953933423},{"type":"v1","addr":"172.21.15.2:6835","nonce":953933423}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1000951065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1000951065},{"type":"v1","addr":"172.21.15.192:6836","nonce":1000951065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/4032661989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4032661989},{"type":"v1","addr":"172.21.15.192:6837","nonce":4032661989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-11-26T07:11:30.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.627+0000 7fa35a88f700 1 -- 172.21.15.2:0/1245116701 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa34006ae40 msgr2=0x7fa34006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:30.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.627+0000 7fa35a88f700 1 --2- 172.21.15.2:0/1245116701 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa34006ae40 0x7fa34006d300 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa3541f6d30 tx=0x7fa348009040 comp rx=0 tx=0).stop 2023-11-26T07:11:30.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.627+0000 7fa35a88f700 1 -- 172.21.15.2:0/1245116701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa35406afd0 msgr2=0x7fa354145eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:30.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.627+0000 7fa35a88f700 1 --2- 172.21.15.2:0/1245116701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa35406afd0 0x7fa354145eb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa3440090b0 tx=0x7fa344004750 comp rx=0 tx=0).stop 2023-11-26T07:11:30.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.627+0000 7fa35a88f700 1 -- 172.21.15.2:0/1245116701 shutdown_connections 2023-11-26T07:11:30.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.627+0000 7fa35a88f700 1 --2- 172.21.15.2:0/1245116701 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa34006ae40 0x7fa34006d300 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:30.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.627+0000 7fa35a88f700 1 --2- 172.21.15.2:0/1245116701 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa35415ec20 0x7fa35415d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:30.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.627+0000 7fa35a88f700 1 --2- 172.21.15.2:0/1245116701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa35406afd0 0x7fa354145eb0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:30.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.627+0000 7fa35a88f700 1 --2- 172.21.15.2:0/1245116701 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3540b4230 0x7fa35415d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:30.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.627+0000 7fa35a88f700 1 -- 172.21.15.2:0/1245116701 >> 172.21.15.2:0/1245116701 conn(0x7fa35406c0e0 msgr2=0x7fa35406db60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:30.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.627+0000 7fa35a88f700 1 -- 172.21.15.2:0/1245116701 shutdown_connections 2023-11-26T07:11:30.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.627+0000 7fa35a88f700 1 -- 172.21.15.2:0/1245116701 wait complete. 2023-11-26T07:11:30.630 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 3 2023-11-26T07:11:30.641 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:11:30.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.765+0000 7fde7e4c9700 1 Processor -- start 2023-11-26T07:11:30.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.765+0000 7fde7e4c9700 1 -- start start 2023-11-26T07:11:30.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.766+0000 7fde7e4c9700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fde7815a820 0x7fde7806b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:30.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.766+0000 7fde7e4c9700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fde780d06b0 0x7fde7806b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:30.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.766+0000 7fde7e4c9700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde780b05f0 con 0x7fde7815a440 2023-11-26T07:11:30.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.766+0000 7fde7e4c9700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde7815f080 con 0x7fde7815a820 2023-11-26T07:11:30.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.766+0000 7fde7e4c9700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde780afd50 con 0x7fde780d06b0 2023-11-26T07:11:30.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.766+0000 7fde7ca66700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fde780d06b0 0x7fde7806b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:30.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.767+0000 7fde77fff700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fde7815a440 0x7fde780cffa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.2:37284/0 (socket says 172.21.15.2:37284) 2023-11-26T07:11:30.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.767+0000 7fde7ca66700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fde780d06b0 0x7fde7806b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.2:47294/0 (socket says 172.21.15.2:47294) 2023-11-26T07:11:30.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.767+0000 7fde77fff700 1 -- 172.21.15.2:0/2404904583 learned_addr learned my addr 172.21.15.2:0/2404904583 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:11:30.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.767+0000 7fde777fe700 1 --2- 172.21.15.2:0/2404904583 >> v2:172.21.15.2:3300/0 conn(0x7fde7815a820 0x7fde7806b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:30.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.767+0000 7fde7ca66700 1 -- 172.21.15.2:0/2404904583 >> v2:172.21.15.2:3300/0 conn(0x7fde7815a820 msgr2=0x7fde7806b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:30.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.767+0000 7fde7ca66700 1 --2- 172.21.15.2:0/2404904583 >> v2:172.21.15.2:3300/0 conn(0x7fde7815a820 0x7fde7806b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:30.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.767+0000 7fde7ca66700 1 -- 172.21.15.2:0/2404904583 >> v1:172.21.15.192:6789/0 conn(0x7fde7815a440 legacy=0x7fde780cffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:30.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.767+0000 7fde7ca66700 1 -- 172.21.15.2:0/2404904583 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde780b0030 con 0x7fde780d06b0 2023-11-26T07:11:30.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.767+0000 7fde76ffd700 1 -- 172.21.15.2:0/2404904583 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 550417296 0 0) 0x7fde780b05f0 con 0x7fde7815a440 2023-11-26T07:11:30.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.767+0000 7fde7ca66700 1 --2- 172.21.15.2:0/2404904583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde780d06b0 0x7fde7806b880 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fde780b0800 tx=0x7fde7000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41a4a228b892e323 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:30.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.767+0000 7fde76ffd700 1 -- 172.21.15.2:0/2404904583 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7000e070 con 0x7fde780d06b0 2023-11-26T07:11:30.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.767+0000 7fde76ffd700 1 -- 172.21.15.2:0/2404904583 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7000bb20 con 0x7fde780d06b0 2023-11-26T07:11:30.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.767+0000 7fde76ffd700 1 -- 172.21.15.2:0/2404904583 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde70012430 con 0x7fde780d06b0 2023-11-26T07:11:30.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.768+0000 7fde7e4c9700 1 -- 172.21.15.2:0/2404904583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde780d06b0 msgr2=0x7fde7806b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:30.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.768+0000 7fde7e4c9700 1 --2- 172.21.15.2:0/2404904583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde780d06b0 0x7fde7806b880 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fde780b0800 tx=0x7fde7000b330 comp rx=0 tx=0).stop 2023-11-26T07:11:30.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.768+0000 7fde7e4c9700 1 -- 172.21.15.2:0/2404904583 shutdown_connections 2023-11-26T07:11:30.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.768+0000 7fde7e4c9700 1 --2- 172.21.15.2:0/2404904583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde780d06b0 0x7fde7806b880 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:30.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.768+0000 7fde7e4c9700 1 --2- 172.21.15.2:0/2404904583 >> v2:172.21.15.2:3300/0 conn(0x7fde7815a820 0x7fde7806b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:30.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.768+0000 7fde7e4c9700 1 -- 172.21.15.2:0/2404904583 >> 172.21.15.2:0/2404904583 conn(0x7fde780b5070 msgr2=0x7fde780b5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:30.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.768+0000 7fde7e4c9700 1 -- 172.21.15.2:0/2404904583 shutdown_connections 2023-11-26T07:11:30.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.768+0000 7fde7e4c9700 1 -- 172.21.15.2:0/2404904583 wait complete. 2023-11-26T07:11:30.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.769+0000 7fde7e4c9700 1 Processor -- start 2023-11-26T07:11:30.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.769+0000 7fde7e4c9700 1 -- start start 2023-11-26T07:11:30.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.770+0000 7fde7e4c9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde780d06b0 0x7fde7815ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:30.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.770+0000 7fde7e4c9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde7815a440 0x7fde781570d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:30.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.770+0000 7fde7e4c9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde781505f0 0x7fde780cef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:30.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.770+0000 7fde7e4c9700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7815b6b0 con 0x7fde780d06b0 2023-11-26T07:11:30.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.770+0000 7fde7e4c9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7815c2a0 con 0x7fde7815a440 2023-11-26T07:11:30.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.770+0000 7fde7e4c9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde7815d060 con 0x7fde781505f0 2023-11-26T07:11:30.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.770+0000 7fde77fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde780d06b0 0x7fde7815ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:30.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.770+0000 7fde77fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde780d06b0 0x7fde7815ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38710/0 (socket says 172.21.15.2:38710) 2023-11-26T07:11:30.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.770+0000 7fde77fff700 1 -- 172.21.15.2:0/3715090461 learned_addr learned my addr 172.21.15.2:0/3715090461 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:30.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.770+0000 7fde777fe700 1 --2- 172.21.15.2:0/3715090461 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde7815a440 0x7fde781570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:30.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.770+0000 7fde7ca66700 1 --2- 172.21.15.2:0/3715090461 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde781505f0 0x7fde780cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:30.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.771+0000 7fde77fff700 1 -- 172.21.15.2:0/3715090461 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde781505f0 msgr2=0x7fde780cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:30.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.771+0000 7fde77fff700 1 --2- 172.21.15.2:0/3715090461 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde781505f0 0x7fde780cef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:30.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.771+0000 7fde77fff700 1 -- 172.21.15.2:0/3715090461 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde7815a440 msgr2=0x7fde781570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:30.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.771+0000 7fde77fff700 1 --2- 172.21.15.2:0/3715090461 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde7815a440 0x7fde781570d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:30.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.771+0000 7fde77fff700 1 -- 172.21.15.2:0/3715090461 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde70009a70 con 0x7fde780d06b0 2023-11-26T07:11:30.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.771+0000 7fde7ca66700 1 --2- 172.21.15.2:0/3715090461 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde781505f0 0x7fde780cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:11:30.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.771+0000 7fde77fff700 1 --2- 172.21.15.2:0/3715090461 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde780d06b0 0x7fde7815ca80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fde6800c520 tx=0x7fde6800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:30.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.816+0000 7fde74ff9700 1 -- 172.21.15.2:0/3715090461 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde68004c80 con 0x7fde780d06b0 2023-11-26T07:11:30.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.816+0000 7fde74ff9700 1 -- 172.21.15.2:0/3715090461 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde68004de0 con 0x7fde780d06b0 2023-11-26T07:11:30.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.816+0000 7fde74ff9700 1 -- 172.21.15.2:0/3715090461 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde68007310 con 0x7fde780d06b0 2023-11-26T07:11:30.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.816+0000 7fde7e4c9700 1 -- 172.21.15.2:0/3715090461 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde7815d340 con 0x7fde780d06b0 2023-11-26T07:11:30.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.816+0000 7fde7e4c9700 1 -- 172.21.15.2:0/3715090461 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde7815d900 con 0x7fde780d06b0 2023-11-26T07:11:30.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.817+0000 7fde7e4c9700 1 -- 172.21.15.2:0/3715090461 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde7815db20 con 0x7fde780d06b0 2023-11-26T07:11:30.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.818+0000 7fde74ff9700 1 -- 172.21.15.2:0/3715090461 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7fde68007470 con 0x7fde780d06b0 2023-11-26T07:11:30.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.818+0000 7fde74ff9700 1 --2- 172.21.15.2:0/3715090461 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fde6406ae40 0x7fde6406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:30.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.818+0000 7fde74ff9700 1 -- 172.21.15.2:0/3715090461 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fde68088d60 con 0x7fde780d06b0 2023-11-26T07:11:30.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.818+0000 7fde777fe700 1 --2- 172.21.15.2:0/3715090461 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fde6406ae40 0x7fde6406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:30.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.819+0000 7fde777fe700 1 --2- 172.21.15.2:0/3715090461 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fde6406ae40 0x7fde6406d300 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fde78071740 tx=0x7fde6c009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:30.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:30.823+0000 7fde74ff9700 1 -- 172.21.15.2:0/3715090461 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fde680542d0 con 0x7fde780d06b0 2023-11-26T07:11:31.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.027+0000 7fde7e4c9700 1 -- 172.21.15.2:0/3715090461 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde7806b320 con 0x7fde780d06b0 2023-11-26T07:11:31.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.028+0000 7fde74ff9700 1 -- 172.21.15.2:0/3715090461 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12802 (secure 0 0 0) 0x7fde680578f0 con 0x7fde780d06b0 2023-11-26T07:11:31.030 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:11:31.030 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":17,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:11:30.606077+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:11:31.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.030+0000 7fde7e4c9700 1 -- 172.21.15.2:0/3715090461 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fde6406ae40 msgr2=0x7fde6406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:31.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.030+0000 7fde7e4c9700 1 --2- 172.21.15.2:0/3715090461 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fde6406ae40 0x7fde6406d300 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fde78071740 tx=0x7fde6c009210 comp rx=0 tx=0).stop 2023-11-26T07:11:31.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.030+0000 7fde7e4c9700 1 -- 172.21.15.2:0/3715090461 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde780d06b0 msgr2=0x7fde7815ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:31.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.030+0000 7fde7e4c9700 1 --2- 172.21.15.2:0/3715090461 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde780d06b0 0x7fde7815ca80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fde6800c520 tx=0x7fde6800c830 comp rx=0 tx=0).stop 2023-11-26T07:11:31.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.030+0000 7fde7e4c9700 1 -- 172.21.15.2:0/3715090461 shutdown_connections 2023-11-26T07:11:31.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.030+0000 7fde7e4c9700 1 --2- 172.21.15.2:0/3715090461 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fde6406ae40 0x7fde6406d300 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:31.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.030+0000 7fde7e4c9700 1 --2- 172.21.15.2:0/3715090461 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde781505f0 0x7fde780cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:31.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.030+0000 7fde7e4c9700 1 --2- 172.21.15.2:0/3715090461 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde780d06b0 0x7fde7815ca80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:31.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.030+0000 7fde7e4c9700 1 --2- 172.21.15.2:0/3715090461 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde7815a440 0x7fde781570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:31.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.030+0000 7fde7e4c9700 1 -- 172.21.15.2:0/3715090461 >> 172.21.15.2:0/3715090461 conn(0x7fde780b5070 msgr2=0x7fde780b5710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:31.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.031+0000 7fde7e4c9700 1 -- 172.21.15.2:0/3715090461 shutdown_connections 2023-11-26T07:11:31.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.031+0000 7fde7e4c9700 1 -- 172.21.15.2:0/3715090461 wait complete. 2023-11-26T07:11:31.045 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:11:28.205739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:11:31.045 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:11:31.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.174+0000 7fd2a60f4700 1 Processor -- start 2023-11-26T07:11:31.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.174+0000 7fd2a60f4700 1 -- start start 2023-11-26T07:11:31.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.174+0000 7fd2a60f4700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd2a006afd0 0x7fd2a006b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:31.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.174+0000 7fd2a60f4700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2a006ea20 con 0x7fd2a00b3ab0 2023-11-26T07:11:31.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.174+0000 7fd2a60f4700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2a006b8f0 con 0x7fd2a006deb0 2023-11-26T07:11:31.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.174+0000 7fd2a60f4700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2a00af590 con 0x7fd2a006afd0 2023-11-26T07:11:31.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.175+0000 7fd29ffff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd2a00b3ab0 0x7fd2a00b3ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58164/0 (socket says 172.21.15.2:58164) 2023-11-26T07:11:31.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.175+0000 7fd29ffff700 1 -- 172.21.15.2:0/1307338538 learned_addr learned my addr 172.21.15.2:0/1307338538 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:11:31.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.175+0000 7fd29f7fe700 1 --2- 172.21.15.2:0/1307338538 >> v2:172.21.15.192:3300/0 conn(0x7fd2a006afd0 0x7fd2a006b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:31.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.175+0000 7fd29e7fc700 1 -- 172.21.15.2:0/1307338538 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3718538296 0 0) 0x7fd2a006ea20 con 0x7fd2a00b3ab0 2023-11-26T07:11:31.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.175+0000 7fd29e7fc700 1 -- 172.21.15.2:0/1307338538 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd28c0035b0 con 0x7fd2a00b3ab0 2023-11-26T07:11:31.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.175+0000 7fd29e7fc700 1 -- 172.21.15.2:0/1307338538 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 466299517 0 0) 0x7fd28c0035b0 con 0x7fd2a00b3ab0 2023-11-26T07:11:31.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.175+0000 7fd29e7fc700 1 -- 172.21.15.2:0/1307338538 >> v2:172.21.15.192:3300/0 conn(0x7fd2a006afd0 msgr2=0x7fd2a006b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:31.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.175+0000 7fd29e7fc700 1 --2- 172.21.15.2:0/1307338538 >> v2:172.21.15.192:3300/0 conn(0x7fd2a006afd0 0x7fd2a006b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:31.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.175+0000 7fd29e7fc700 1 -- 172.21.15.2:0/1307338538 >> v1:172.21.15.192:6789/0 conn(0x7fd2a006deb0 legacy=0x7fd2a006e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:31.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.175+0000 7fd29e7fc700 1 -- 172.21.15.2:0/1307338538 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a015e650 con 0x7fd2a00b3ab0 2023-11-26T07:11:31.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.175+0000 7fd29e7fc700 1 -- 172.21.15.2:0/1307338538 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7fd2980019f0 con 0x7fd2a00b3ab0 2023-11-26T07:11:31.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.175+0000 7fd29e7fc700 1 -- 172.21.15.2:0/1307338538 >> v1:172.21.15.2:6789/0 conn(0x7fd2a00b3ab0 legacy=0x7fd2a00b3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:31.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.175+0000 7fd29e7fc700 1 --2- 172.21.15.2:0/1307338538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd28c003a00 0x7fd28c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:31.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.175+0000 7fd29e7fc700 1 --2- 172.21.15.2:0/1307338538 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd28c004850 0x7fd28c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:31.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.175+0000 7fd29e7fc700 1 --2- 172.21.15.2:0/1307338538 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd28c005210 0x7fd28c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:31.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.175+0000 7fd29e7fc700 1 -- 172.21.15.2:0/1307338538 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a00af590 con 0x7fd28c003a00 2023-11-26T07:11:31.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.175+0000 7fd29e7fc700 1 -- 172.21.15.2:0/1307338538 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c00c1b0 con 0x7fd28c005210 2023-11-26T07:11:31.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.175+0000 7fd29e7fc700 1 -- 172.21.15.2:0/1307338538 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c00c370 con 0x7fd28c004850 2023-11-26T07:11:31.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.175+0000 7fd29f7fe700 1 --2- 172.21.15.2:0/1307338538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd28c003a00 0x7fd28c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:31.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.175+0000 7fd29effd700 1 --2- 172.21.15.2:0/1307338538 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd28c004850 0x7fd28c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:31.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.175+0000 7fd29ffff700 1 --2- 172.21.15.2:0/1307338538 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd28c005210 0x7fd28c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:31.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.176+0000 7fd29f7fe700 1 -- 172.21.15.2:0/1307338538 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd28c004850 msgr2=0x7fd28c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:31.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.176+0000 7fd29f7fe700 1 --2- 172.21.15.2:0/1307338538 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd28c004850 0x7fd28c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:31.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.176+0000 7fd29f7fe700 1 -- 172.21.15.2:0/1307338538 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd28c005210 msgr2=0x7fd28c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:31.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.176+0000 7fd29f7fe700 1 --2- 172.21.15.2:0/1307338538 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd28c005210 0x7fd28c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:31.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.176+0000 7fd29ffff700 1 -- 172.21.15.2:0/1307338538 reap_dead start 2023-11-26T07:11:31.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.176+0000 7fd29f7fe700 1 -- 172.21.15.2:0/1307338538 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd28c0035b0 con 0x7fd28c003a00 2023-11-26T07:11:31.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.176+0000 7fd29f7fe700 1 --2- 172.21.15.2:0/1307338538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd28c003a00 0x7fd28c003e20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd290009b60 tx=0x7fd28c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f499626731bded8 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:31.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.176+0000 7fd29e7fc700 1 -- 172.21.15.2:0/1307338538 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29000e6c0 con 0x7fd28c003a00 2023-11-26T07:11:31.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.176+0000 7fd29e7fc700 1 -- 172.21.15.2:0/1307338538 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29000e820 con 0x7fd28c003a00 2023-11-26T07:11:31.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.176+0000 7fd29e7fc700 1 -- 172.21.15.2:0/1307338538 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29000eb90 con 0x7fd28c003a00 2023-11-26T07:11:31.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.176+0000 7fd2a60f4700 1 -- 172.21.15.2:0/1307338538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd28c003a00 msgr2=0x7fd28c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:31.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.176+0000 7fd2a60f4700 1 --2- 172.21.15.2:0/1307338538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd28c003a00 0x7fd28c003e20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd290009b60 tx=0x7fd28c005880 comp rx=0 tx=0).stop 2023-11-26T07:11:31.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.177+0000 7fd2a60f4700 1 -- 172.21.15.2:0/1307338538 shutdown_connections 2023-11-26T07:11:31.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.177+0000 7fd2a60f4700 1 --2- 172.21.15.2:0/1307338538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd28c003a00 0x7fd28c003e20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:31.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.177+0000 7fd2a60f4700 1 -- 172.21.15.2:0/1307338538 >> 172.21.15.2:0/1307338538 conn(0x7fd2a00b27b0 msgr2=0x7fd2a00b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:31.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.177+0000 7fd2a60f4700 1 -- 172.21.15.2:0/1307338538 shutdown_connections 2023-11-26T07:11:31.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.177+0000 7fd2a60f4700 1 -- 172.21.15.2:0/1307338538 wait complete. 2023-11-26T07:11:31.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.178+0000 7fd2a60f4700 1 Processor -- start 2023-11-26T07:11:31.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.178+0000 7fd2a60f4700 1 -- start start 2023-11-26T07:11:31.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.179+0000 7fd2a60f4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd28c003a00 0x7fd2a01f2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:31.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.179+0000 7fd2a60f4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2a01f6c10 0x7fd2a00b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:31.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.179+0000 7fd2a60f4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2a01f7090 0x7fd2a00b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:31.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.179+0000 7fd2a60f4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a00c5f10 con 0x7fd2a01f6c10 2023-11-26T07:11:31.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.179+0000 7fd2a60f4700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a01f3480 con 0x7fd2a01f7090 2023-11-26T07:11:31.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.179+0000 7fd2a60f4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a01f7660 con 0x7fd28c003a00 2023-11-26T07:11:31.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.179+0000 7fd29effd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2a01f6c10 0x7fd2a00b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:31.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.179+0000 7fd29effd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2a01f6c10 0x7fd2a00b0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38732/0 (socket says 172.21.15.2:38732) 2023-11-26T07:11:31.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.179+0000 7fd29effd700 1 -- 172.21.15.2:0/3852548927 learned_addr learned my addr 172.21.15.2:0/3852548927 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:31.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.179+0000 7fd29ffff700 1 --2- 172.21.15.2:0/3852548927 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2a01f7090 0x7fd2a00b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:31.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.179+0000 7fd29f7fe700 1 --2- 172.21.15.2:0/3852548927 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd28c003a00 0x7fd2a01f2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:31.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.179+0000 7fd29effd700 1 -- 172.21.15.2:0/3852548927 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd28c003a00 msgr2=0x7fd2a01f2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:31.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.179+0000 7fd29effd700 1 --2- 172.21.15.2:0/3852548927 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd28c003a00 0x7fd2a01f2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:31.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.179+0000 7fd29effd700 1 -- 172.21.15.2:0/3852548927 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2a01f7090 msgr2=0x7fd2a00b10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:31.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.179+0000 7fd29effd700 1 --2- 172.21.15.2:0/3852548927 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2a01f7090 0x7fd2a00b10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:31.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.179+0000 7fd29effd700 1 -- 172.21.15.2:0/3852548927 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a01f7940 con 0x7fd2a01f6c10 2023-11-26T07:11:31.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.179+0000 7fd29effd700 1 --2- 172.21.15.2:0/3852548927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2a01f6c10 0x7fd2a00b0b70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd28800f7f0 tx=0x7fd28800fb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:31.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.179+0000 7fd297fff700 1 -- 172.21.15.2:0/3852548927 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2880052e0 con 0x7fd2a01f6c10 2023-11-26T07:11:31.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.179+0000 7fd297fff700 1 -- 172.21.15.2:0/3852548927 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd288005440 con 0x7fd2a01f6c10 2023-11-26T07:11:31.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.179+0000 7fd2a60f4700 1 -- 172.21.15.2:0/3852548927 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2a00c5ba0 con 0x7fd2a01f6c10 2023-11-26T07:11:31.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.179+0000 7fd297fff700 1 -- 172.21.15.2:0/3852548927 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2880038c0 con 0x7fd2a01f6c10 2023-11-26T07:11:31.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.179+0000 7fd2a60f4700 1 -- 172.21.15.2:0/3852548927 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2a015f530 con 0x7fd2a01f6c10 2023-11-26T07:11:31.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.180+0000 7fd2a60f4700 1 -- 172.21.15.2:0/3852548927 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2a0068150 con 0x7fd2a01f6c10 2023-11-26T07:11:31.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.181+0000 7fd297fff700 1 -- 172.21.15.2:0/3852548927 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd288003a20 con 0x7fd2a01f6c10 2023-11-26T07:11:31.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.181+0000 7fd297fff700 1 --2- 172.21.15.2:0/3852548927 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd28006aed0 0x7fd28006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:31.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.181+0000 7fd297fff700 1 -- 172.21.15.2:0/3852548927 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd288088ea0 con 0x7fd2a01f6c10 2023-11-26T07:11:31.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.181+0000 7fd29f7fe700 1 --2- 172.21.15.2:0/3852548927 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd28006aed0 0x7fd28006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:31.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.182+0000 7fd29f7fe700 1 --2- 172.21.15.2:0/3852548927 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd28006aed0 0x7fd28006d390 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd2900090b0 tx=0x7fd29001f040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:31.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.186+0000 7fd297fff700 1 -- 172.21.15.2:0/3852548927 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd2880543e0 con 0x7fd2a01f6c10 2023-11-26T07:11:31.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.388+0000 7fd2a60f4700 1 -- 172.21.15.2:0/3852548927 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd2a0075480 con 0x7fd2a01f6c10 2023-11-26T07:11:31.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.389+0000 7fd297fff700 1 -- 172.21.15.2:0/3852548927 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd288057a00 con 0x7fd2a01f6c10 2023-11-26T07:11:31.391 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-26T07:11:31.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.390+0000 7fd2a60f4700 1 -- 172.21.15.2:0/3852548927 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd28006aed0 msgr2=0x7fd28006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:31.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.390+0000 7fd2a60f4700 1 --2- 172.21.15.2:0/3852548927 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd28006aed0 0x7fd28006d390 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd2900090b0 tx=0x7fd29001f040 comp rx=0 tx=0).stop 2023-11-26T07:11:31.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.390+0000 7fd2a60f4700 1 -- 172.21.15.2:0/3852548927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2a01f6c10 msgr2=0x7fd2a00b0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:31.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.390+0000 7fd2a60f4700 1 --2- 172.21.15.2:0/3852548927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2a01f6c10 0x7fd2a00b0b70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd28800f7f0 tx=0x7fd28800fb00 comp rx=0 tx=0).stop 2023-11-26T07:11:31.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.390+0000 7fd2a60f4700 1 -- 172.21.15.2:0/3852548927 shutdown_connections 2023-11-26T07:11:31.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.390+0000 7fd2a60f4700 1 --2- 172.21.15.2:0/3852548927 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd28006aed0 0x7fd28006d390 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:31.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.390+0000 7fd2a60f4700 1 --2- 172.21.15.2:0/3852548927 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2a01f7090 0x7fd2a00b10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:31.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.390+0000 7fd2a60f4700 1 --2- 172.21.15.2:0/3852548927 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd28c003a00 0x7fd2a01f2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:31.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.390+0000 7fd2a60f4700 1 --2- 172.21.15.2:0/3852548927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2a01f6c10 0x7fd2a00b0b70 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:31.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.390+0000 7fd2a60f4700 1 -- 172.21.15.2:0/3852548927 >> 172.21.15.2:0/3852548927 conn(0x7fd2a00b27b0 msgr2=0x7fd2a00b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:31.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.391+0000 7fd2a60f4700 1 -- 172.21.15.2:0/3852548927 shutdown_connections 2023-11-26T07:11:31.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.391+0000 7fd2a60f4700 1 -- 172.21.15.2:0/3852548927 wait complete. 2023-11-26T07:11:31.405 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-26T07:11:31.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.527+0000 7f84c6eb2700 1 Processor -- start 2023-11-26T07:11:31.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.528+0000 7f84c6eb2700 1 -- start start 2023-11-26T07:11:31.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.528+0000 7f84c6eb2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84c015abb0 0x7f84c00b4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:31.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.528+0000 7f84c6eb2700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f84c00b4d50 0x7f84c0071d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:31.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.528+0000 7f84c6eb2700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84c0072760 con 0x7f84c00722d0 2023-11-26T07:11:31.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.528+0000 7f84c6eb2700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84c00b51d0 con 0x7f84c00b4d50 2023-11-26T07:11:31.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.528+0000 7f84c6eb2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84c006e550 con 0x7f84c015abb0 2023-11-26T07:11:31.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.528+0000 7f84bffff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f84c00b4d50 0x7f84c0071d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:31.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.529+0000 7f84c544f700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f84c00722d0 0x7f84c015e760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58184/0 (socket says 172.21.15.2:58184) 2023-11-26T07:11:31.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.529+0000 7f84c544f700 1 -- 172.21.15.2:0/2270393245 learned_addr learned my addr 172.21.15.2:0/2270393245 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:11:31.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.529+0000 7f84c4c4e700 1 --2- 172.21.15.2:0/2270393245 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84c015abb0 0x7f84c00b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:31.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.529+0000 7f84bf7fe700 1 -- 172.21.15.2:0/2270393245 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 910421696 0 0) 0x7f84b8001490 con 0x7f84c00722d0 2023-11-26T07:11:31.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.529+0000 7f84bf7fe700 1 -- 172.21.15.2:0/2270393245 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84b00035b0 con 0x7f84c00722d0 2023-11-26T07:11:31.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.529+0000 7f84bffff700 1 -- 172.21.15.2:0/2270393245 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84c015abb0 msgr2=0x7f84c00b4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:31.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.529+0000 7f84bffff700 1 --2- 172.21.15.2:0/2270393245 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84c015abb0 0x7f84c00b4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:31.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.529+0000 7f84bffff700 1 -- 172.21.15.2:0/2270393245 >> v1:172.21.15.2:6789/0 conn(0x7f84c00722d0 legacy=0x7f84c015e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:31.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.529+0000 7f84bffff700 1 -- 172.21.15.2:0/2270393245 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c006f3b0 con 0x7f84c00b4d50 2023-11-26T07:11:31.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.529+0000 7f84bffff700 1 --2- 172.21.15.2:0/2270393245 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84c00b4d50 0x7f84c0071d90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f84ac009840 tx=0x7f84ac009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a26604e7260c123 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:31.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.529+0000 7f84bf7fe700 1 -- 172.21.15.2:0/2270393245 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac011830 con 0x7f84c00b4d50 2023-11-26T07:11:31.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.529+0000 7f84bf7fe700 1 -- 172.21.15.2:0/2270393245 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84ac011990 con 0x7f84c00b4d50 2023-11-26T07:11:31.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.529+0000 7f84bf7fe700 1 -- 172.21.15.2:0/2270393245 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac011d20 con 0x7f84c00b4d50 2023-11-26T07:11:31.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.530+0000 7f84c6eb2700 1 -- 172.21.15.2:0/2270393245 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84c00b4d50 msgr2=0x7f84c0071d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:31.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.530+0000 7f84c6eb2700 1 --2- 172.21.15.2:0/2270393245 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84c00b4d50 0x7f84c0071d90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f84ac009840 tx=0x7f84ac009b50 comp rx=0 tx=0).stop 2023-11-26T07:11:31.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.530+0000 7f84c6eb2700 1 -- 172.21.15.2:0/2270393245 shutdown_connections 2023-11-26T07:11:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.530+0000 7f84c6eb2700 1 --2- 172.21.15.2:0/2270393245 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84c015abb0 0x7f84c00b4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.530+0000 7f84c6eb2700 1 --2- 172.21.15.2:0/2270393245 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84c00b4d50 0x7f84c0071d90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.530+0000 7f84c6eb2700 1 -- 172.21.15.2:0/2270393245 >> 172.21.15.2:0/2270393245 conn(0x7f84c00d0aa0 msgr2=0x7f84c00d0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.530+0000 7f84c6eb2700 1 -- 172.21.15.2:0/2270393245 shutdown_connections 2023-11-26T07:11:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.530+0000 7f84c6eb2700 1 -- 172.21.15.2:0/2270393245 wait complete. 2023-11-26T07:11:31.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.531+0000 7f84c6eb2700 1 Processor -- start 2023-11-26T07:11:31.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.531+0000 7f84c6eb2700 1 -- start start 2023-11-26T07:11:31.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.532+0000 7f84c6eb2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84c00722d0 0x7f84c0155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:31.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.532+0000 7f84c6eb2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84c00b4d50 0x7f84c0159090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:31.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.532+0000 7f84c6eb2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84c015abb0 0x7f84c01595d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:31.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.532+0000 7f84c6eb2700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c015ca80 con 0x7f84c00b4d50 2023-11-26T07:11:31.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.532+0000 7f84c6eb2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c01f3d50 con 0x7f84c00722d0 2023-11-26T07:11:31.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.532+0000 7f84c6eb2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84c015be00 con 0x7f84c015abb0 2023-11-26T07:11:31.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.532+0000 7f84bffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84c00b4d50 0x7f84c0159090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:31.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.532+0000 7f84bffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84c00b4d50 0x7f84c0159090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38746/0 (socket says 172.21.15.2:38746) 2023-11-26T07:11:31.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.532+0000 7f84bffff700 1 -- 172.21.15.2:0/3825305873 learned_addr learned my addr 172.21.15.2:0/3825305873 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:31.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.532+0000 7f84c544f700 1 --2- 172.21.15.2:0/3825305873 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84c015abb0 0x7f84c01595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:31.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.532+0000 7f84c4c4e700 1 --2- 172.21.15.2:0/3825305873 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84c00722d0 0x7f84c0155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:31.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.532+0000 7f84bffff700 1 -- 172.21.15.2:0/3825305873 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84c015abb0 msgr2=0x7f84c01595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:31.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.532+0000 7f84bffff700 1 --2- 172.21.15.2:0/3825305873 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84c015abb0 0x7f84c01595d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:31.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.532+0000 7f84bffff700 1 -- 172.21.15.2:0/3825305873 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84c00722d0 msgr2=0x7f84c0155680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:31.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.532+0000 7f84bffff700 1 --2- 172.21.15.2:0/3825305873 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84c00722d0 0x7f84c0155680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:31.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.532+0000 7f84bffff700 1 -- 172.21.15.2:0/3825305873 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84ac0094a0 con 0x7f84c00b4d50 2023-11-26T07:11:31.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.533+0000 7f84bffff700 1 --2- 172.21.15.2:0/3825305873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84c00b4d50 0x7f84c0159090 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f84ac0090b0 tx=0x7f84ac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:31.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.533+0000 7f84bd7fa700 1 -- 172.21.15.2:0/3825305873 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac0036a0 con 0x7f84c00b4d50 2023-11-26T07:11:31.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.533+0000 7f84bd7fa700 1 -- 172.21.15.2:0/3825305873 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84ac01f070 con 0x7f84c00b4d50 2023-11-26T07:11:31.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.533+0000 7f84c6eb2700 1 -- 172.21.15.2:0/3825305873 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84c015c0e0 con 0x7f84c00b4d50 2023-11-26T07:11:31.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.533+0000 7f84bd7fa700 1 -- 172.21.15.2:0/3825305873 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac003a40 con 0x7f84c00b4d50 2023-11-26T07:11:31.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.533+0000 7f84c6eb2700 1 -- 172.21.15.2:0/3825305873 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84c015c6a0 con 0x7f84c00b4d50 2023-11-26T07:11:31.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.534+0000 7f84c6eb2700 1 -- 172.21.15.2:0/3825305873 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84c0068670 con 0x7f84c00b4d50 2023-11-26T07:11:31.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.534+0000 7f84bd7fa700 1 -- 172.21.15.2:0/3825305873 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f84ac003ba0 con 0x7f84c00b4d50 2023-11-26T07:11:31.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.535+0000 7f84bd7fa700 1 --2- 172.21.15.2:0/3825305873 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f84a406aed0 0x7f84a406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:31.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.535+0000 7f84bd7fa700 1 -- 172.21.15.2:0/3825305873 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f84ac021070 con 0x7f84c00b4d50 2023-11-26T07:11:31.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.535+0000 7f84c4c4e700 1 --2- 172.21.15.2:0/3825305873 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f84a406aed0 0x7f84a406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:31.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.535+0000 7f84c4c4e700 1 --2- 172.21.15.2:0/3825305873 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f84a406aed0 0x7f84a406d390 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f84b4009ad0 tx=0x7f84b4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:31.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.539+0000 7f84bd7fa700 1 -- 172.21.15.2:0/3825305873 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f84ac055ec0 con 0x7f84c00b4d50 2023-11-26T07:11:31.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.744+0000 7f84c6eb2700 1 -- 172.21.15.2:0/3825305873 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f84c00ce180 con 0x7f84c00b4d50 2023-11-26T07:11:31.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.744+0000 7f84bd7fa700 1 -- 172.21.15.2:0/3825305873 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f84ac02b090 con 0x7f84c00b4d50 2023-11-26T07:11:31.746 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:11:31.746 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2023-11-26T07:11:31.746 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:11:31.746 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 1, 2023-11-26T07:11:31.746 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": ".mgr" 2023-11-26T07:11:31.747 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:11:31.747 INFO:teuthology.orchestra.run.smithi002.stdout:] 2023-11-26T07:11:31.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.746+0000 7f84c6eb2700 1 -- 172.21.15.2:0/3825305873 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f84a406aed0 msgr2=0x7f84a406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:31.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.746+0000 7f84c6eb2700 1 --2- 172.21.15.2:0/3825305873 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f84a406aed0 0x7f84a406d390 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f84b4009ad0 tx=0x7f84b4008040 comp rx=0 tx=0).stop 2023-11-26T07:11:31.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.746+0000 7f84c6eb2700 1 -- 172.21.15.2:0/3825305873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84c00b4d50 msgr2=0x7f84c0159090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:31.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.746+0000 7f84c6eb2700 1 --2- 172.21.15.2:0/3825305873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84c00b4d50 0x7f84c0159090 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f84ac0090b0 tx=0x7f84ac004750 comp rx=0 tx=0).stop 2023-11-26T07:11:31.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.746+0000 7f84c6eb2700 1 -- 172.21.15.2:0/3825305873 shutdown_connections 2023-11-26T07:11:31.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.746+0000 7f84c6eb2700 1 --2- 172.21.15.2:0/3825305873 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f84a406aed0 0x7f84a406d390 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:31.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.746+0000 7f84c6eb2700 1 --2- 172.21.15.2:0/3825305873 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84c015abb0 0x7f84c01595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:31.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.746+0000 7f84c6eb2700 1 --2- 172.21.15.2:0/3825305873 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84c00722d0 0x7f84c0155680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:31.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.746+0000 7f84c6eb2700 1 --2- 172.21.15.2:0/3825305873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84c00b4d50 0x7f84c0159090 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:31.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.746+0000 7f84c6eb2700 1 -- 172.21.15.2:0/3825305873 >> 172.21.15.2:0/3825305873 conn(0x7f84c00d0aa0 msgr2=0x7f84c00d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:31.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.746+0000 7f84c6eb2700 1 -- 172.21.15.2:0/3825305873 shutdown_connections 2023-11-26T07:11:31.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.746+0000 7f84c6eb2700 1 -- 172.21.15.2:0/3825305873 wait complete. 2023-11-26T07:11:31.760 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-26T07:11:31.760 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-26T07:11:31.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.887+0000 7faf3fc9e700 1 Processor -- start 2023-11-26T07:11:31.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.888+0000 7faf3fc9e700 1 -- start start 2023-11-26T07:11:31.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.888+0000 7faf3fc9e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faf381447a0 0x7faf38071b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:31.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.888+0000 7faf3fc9e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf3806f070 0x7faf380720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:31.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.888+0000 7faf3fc9e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf3806dbd0 con 0x7faf38072ab0 2023-11-26T07:11:31.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.888+0000 7faf3fc9e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf3815b700 con 0x7faf381447a0 2023-11-26T07:11:31.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.888+0000 7faf3fc9e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3815b9e0 con 0x7faf3806f070 2023-11-26T07:11:31.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.888+0000 7faf3da3a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faf381447a0 0x7faf38071b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:31.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.888+0000 7faf3d239700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7faf38072ab0 0x7faf3815e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58196/0 (socket says 172.21.15.2:58196) 2023-11-26T07:11:31.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.889+0000 7faf3da3a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faf381447a0 0x7faf38071b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38752/0 (socket says 172.21.15.2:38752) 2023-11-26T07:11:31.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.889+0000 7faf3da3a700 1 -- 172.21.15.2:0/2096979105 learned_addr learned my addr 172.21.15.2:0/2096979105 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:31.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.889+0000 7faf3e23b700 1 --2- 172.21.15.2:0/2096979105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf3806f070 0x7faf380720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:31.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.889+0000 7faf3da3a700 1 -- 172.21.15.2:0/2096979105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf3806f070 msgr2=0x7faf380720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:31.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.889+0000 7faf3da3a700 1 --2- 172.21.15.2:0/2096979105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf3806f070 0x7faf380720d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:31.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.889+0000 7faf3da3a700 1 -- 172.21.15.2:0/2096979105 >> v1:172.21.15.2:6789/0 conn(0x7faf38072ab0 legacy=0x7faf3815e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:31.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.889+0000 7faf3da3a700 1 -- 172.21.15.2:0/2096979105 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3815bcc0 con 0x7faf381447a0 2023-11-26T07:11:31.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.889+0000 7faf3ca38700 1 -- 172.21.15.2:0/2096979105 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3150568974 0 0) 0x7faf3806dbd0 con 0x7faf38072ab0 2023-11-26T07:11:31.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.889+0000 7faf3e23b700 1 --2- 172.21.15.2:0/2096979105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf3806f070 0x7faf380720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:11:31.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.889+0000 7faf3da3a700 1 --2- 172.21.15.2:0/2096979105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf381447a0 0x7faf38071b90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7faf2800bb90 tx=0x7faf2800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b5edd42f4a7a948 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:31.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.889+0000 7faf3ca38700 1 -- 172.21.15.2:0/2096979105 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2800dd50 con 0x7faf381447a0 2023-11-26T07:11:31.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.889+0000 7faf3ca38700 1 -- 172.21.15.2:0/2096979105 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf28010470 con 0x7faf381447a0 2023-11-26T07:11:31.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.889+0000 7faf3ca38700 1 -- 172.21.15.2:0/2096979105 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf28010800 con 0x7faf381447a0 2023-11-26T07:11:31.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.890+0000 7faf3fc9e700 1 -- 172.21.15.2:0/2096979105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf381447a0 msgr2=0x7faf38071b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:31.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.890+0000 7faf3fc9e700 1 --2- 172.21.15.2:0/2096979105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf381447a0 0x7faf38071b90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7faf2800bb90 tx=0x7faf2800bea0 comp rx=0 tx=0).stop 2023-11-26T07:11:31.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.890+0000 7faf3fc9e700 1 -- 172.21.15.2:0/2096979105 shutdown_connections 2023-11-26T07:11:31.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.890+0000 7faf3fc9e700 1 --2- 172.21.15.2:0/2096979105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf3806f070 0x7faf380720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:31.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.890+0000 7faf3fc9e700 1 --2- 172.21.15.2:0/2096979105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf381447a0 0x7faf38071b90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:31.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.890+0000 7faf3fc9e700 1 -- 172.21.15.2:0/2096979105 >> 172.21.15.2:0/2096979105 conn(0x7faf380b2760 msgr2=0x7faf380b2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:31.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.890+0000 7faf3fc9e700 1 -- 172.21.15.2:0/2096979105 shutdown_connections 2023-11-26T07:11:31.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.890+0000 7faf3fc9e700 1 -- 172.21.15.2:0/2096979105 wait complete. 2023-11-26T07:11:31.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.891+0000 7faf3fc9e700 1 Processor -- start 2023-11-26T07:11:31.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.892+0000 7faf3fc9e700 1 -- start start 2023-11-26T07:11:31.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.892+0000 7faf3fc9e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf3806f070 0x7faf3815c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:31.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.892+0000 7faf3fc9e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf38072ab0 0x7faf3815a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:31.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.892+0000 7faf3fc9e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf381447a0 0x7faf3815a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:31.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.892+0000 7faf3fc9e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3813afa0 con 0x7faf381447a0 2023-11-26T07:11:31.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.892+0000 7faf3fc9e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3815ac50 con 0x7faf38072ab0 2023-11-26T07:11:31.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.892+0000 7faf3fc9e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf381359d0 con 0x7faf3806f070 2023-11-26T07:11:31.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.893+0000 7faf3e23b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf381447a0 0x7faf3815a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:31.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.893+0000 7faf3e23b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf381447a0 0x7faf3815a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38762/0 (socket says 172.21.15.2:38762) 2023-11-26T07:11:31.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.893+0000 7faf3e23b700 1 -- 172.21.15.2:0/479214852 learned_addr learned my addr 172.21.15.2:0/479214852 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:31.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.893+0000 7faf3da3a700 1 --2- 172.21.15.2:0/479214852 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf3806f070 0x7faf3815c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:31.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.893+0000 7faf3d239700 1 --2- 172.21.15.2:0/479214852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf38072ab0 0x7faf3815a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:31.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.893+0000 7faf3e23b700 1 -- 172.21.15.2:0/479214852 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf3806f070 msgr2=0x7faf3815c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:31.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.893+0000 7faf3e23b700 1 --2- 172.21.15.2:0/479214852 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf3806f070 0x7faf3815c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:31.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.893+0000 7faf3e23b700 1 -- 172.21.15.2:0/479214852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf38072ab0 msgr2=0x7faf3815a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:31.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.893+0000 7faf3e23b700 1 --2- 172.21.15.2:0/479214852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf38072ab0 0x7faf3815a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:31.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.893+0000 7faf3e23b700 1 -- 172.21.15.2:0/479214852 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2800b7f0 con 0x7faf381447a0 2023-11-26T07:11:31.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.893+0000 7faf3da3a700 1 --2- 172.21.15.2:0/479214852 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf3806f070 0x7faf3815c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:11:31.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.893+0000 7faf3e23b700 1 --2- 172.21.15.2:0/479214852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf381447a0 0x7faf3815a710 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faf3000cea0 tx=0x7faf3000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:31.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.893+0000 7faf2e7fc700 1 -- 172.21.15.2:0/479214852 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3000ae50 con 0x7faf381447a0 2023-11-26T07:11:31.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.893+0000 7faf2e7fc700 1 -- 172.21.15.2:0/479214852 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf30003a20 con 0x7faf381447a0 2023-11-26T07:11:31.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.893+0000 7faf3fc9e700 1 -- 172.21.15.2:0/479214852 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf38135cb0 con 0x7faf381447a0 2023-11-26T07:11:31.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.893+0000 7faf2e7fc700 1 -- 172.21.15.2:0/479214852 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf30003dd0 con 0x7faf381447a0 2023-11-26T07:11:31.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.893+0000 7faf3fc9e700 1 -- 172.21.15.2:0/479214852 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf38136270 con 0x7faf381447a0 2023-11-26T07:11:31.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.894+0000 7faf3fc9e700 1 -- 172.21.15.2:0/479214852 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf38068670 con 0x7faf381447a0 2023-11-26T07:11:31.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.895+0000 7faf2e7fc700 1 -- 172.21.15.2:0/479214852 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faf30003f30 con 0x7faf381447a0 2023-11-26T07:11:31.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.895+0000 7faf2e7fc700 1 --2- 172.21.15.2:0/479214852 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7faf1c06aed0 0x7faf1c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:31.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.895+0000 7faf2e7fc700 1 -- 172.21.15.2:0/479214852 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7faf30089640 con 0x7faf381447a0 2023-11-26T07:11:31.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.895+0000 7faf3da3a700 1 --2- 172.21.15.2:0/479214852 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7faf1c06aed0 0x7faf1c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:31.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.896+0000 7faf3da3a700 1 --2- 172.21.15.2:0/479214852 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7faf1c06aed0 0x7faf1c06d390 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faf2800b340 tx=0x7faf28013000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:31.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:31.899+0000 7faf2e7fc700 1 -- 172.21.15.2:0/479214852 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faf30054ad0 con 0x7faf381447a0 2023-11-26T07:11:32.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.098+0000 7faf3fc9e700 1 -- 172.21.15.2:0/479214852 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7faf38136490 con 0x7faf381447a0 2023-11-26T07:11:32.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.614+0000 7faf2e7fc700 1 -- 172.21.15.2:0/479214852 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7faf300580f0 con 0x7faf381447a0 2023-11-26T07:11:32.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.618+0000 7faf3fc9e700 1 -- 172.21.15.2:0/479214852 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7faf1c06aed0 msgr2=0x7faf1c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:32.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.618+0000 7faf3fc9e700 1 --2- 172.21.15.2:0/479214852 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7faf1c06aed0 0x7faf1c06d390 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faf2800b340 tx=0x7faf28013000 comp rx=0 tx=0).stop 2023-11-26T07:11:32.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.618+0000 7faf3fc9e700 1 -- 172.21.15.2:0/479214852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf381447a0 msgr2=0x7faf3815a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:32.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.618+0000 7faf3fc9e700 1 --2- 172.21.15.2:0/479214852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf381447a0 0x7faf3815a710 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faf3000cea0 tx=0x7faf3000cf80 comp rx=0 tx=0).stop 2023-11-26T07:11:32.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.619+0000 7faf3fc9e700 1 -- 172.21.15.2:0/479214852 shutdown_connections 2023-11-26T07:11:32.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.619+0000 7faf3fc9e700 1 --2- 172.21.15.2:0/479214852 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7faf1c06aed0 0x7faf1c06d390 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:32.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.619+0000 7faf3fc9e700 1 --2- 172.21.15.2:0/479214852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf381447a0 0x7faf3815a710 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:32.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.619+0000 7faf3fc9e700 1 --2- 172.21.15.2:0/479214852 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf3806f070 0x7faf3815c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:32.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.619+0000 7faf3fc9e700 1 --2- 172.21.15.2:0/479214852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf38072ab0 0x7faf3815a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:32.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.619+0000 7faf3fc9e700 1 -- 172.21.15.2:0/479214852 >> 172.21.15.2:0/479214852 conn(0x7faf380b2760 msgr2=0x7faf38074080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:32.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.619+0000 7faf3fc9e700 1 -- 172.21.15.2:0/479214852 shutdown_connections 2023-11-26T07:11:32.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.620+0000 7faf3fc9e700 1 -- 172.21.15.2:0/479214852 wait complete. 2023-11-26T07:11:32.624 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' created 2023-11-26T07:11:32.640 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-26T07:11:32.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.775+0000 7f599091e700 1 Processor -- start 2023-11-26T07:11:32.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.776+0000 7f599091e700 1 -- start start 2023-11-26T07:11:32.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.777+0000 7f599091e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f598c0cf2b0 0x7f598c15c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:32.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.777+0000 7f599091e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f598c0d0a90 con 0x7f598c0ce5c0 2023-11-26T07:11:32.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.777+0000 7f599091e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f598c06ee10 con 0x7f598c15bde0 2023-11-26T07:11:32.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.777+0000 7f599091e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f598c06f0f0 con 0x7f598c0cf2b0 2023-11-26T07:11:32.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.777+0000 7f5989d9b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f598c0cf2b0 0x7f598c15c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:32.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.777+0000 7f5989d9b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f598c0cf2b0 0x7f598c15c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38768/0 (socket says 172.21.15.2:38768) 2023-11-26T07:11:32.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.777+0000 7f598ad9d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f598c0ce5c0 0x7f598c06fbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58212/0 (socket says 172.21.15.2:58212) 2023-11-26T07:11:32.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.777+0000 7f5989d9b700 1 -- 172.21.15.2:0/3161184724 learned_addr learned my addr 172.21.15.2:0/3161184724 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:32.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.777+0000 7f5989d9b700 1 -- 172.21.15.2:0/3161184724 >> v1:172.21.15.192:6789/0 conn(0x7f598c15bde0 legacy=0x7f598c0d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:32.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.777+0000 7f5989d9b700 1 -- 172.21.15.2:0/3161184724 >> v1:172.21.15.2:6789/0 conn(0x7f598c0ce5c0 legacy=0x7f598c06fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:32.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.777+0000 7f5989d9b700 1 -- 172.21.15.2:0/3161184724 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f598c06f3d0 con 0x7f598c0cf2b0 2023-11-26T07:11:32.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.778+0000 7f5989d9b700 1 --2- 172.21.15.2:0/3161184724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f598c0cf2b0 0x7f598c15c1c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f59740098f0 tx=0x7f5974009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9447972cff101da6 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:32.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.778+0000 7f598959a700 1 -- 172.21.15.2:0/3161184724 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597400b8a0 con 0x7f598c0cf2b0 2023-11-26T07:11:32.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.778+0000 7f598959a700 1 -- 172.21.15.2:0/3161184724 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597400ba00 con 0x7f598c0cf2b0 2023-11-26T07:11:32.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.778+0000 7f598959a700 1 -- 172.21.15.2:0/3161184724 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597400bd90 con 0x7f598c0cf2b0 2023-11-26T07:11:32.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.778+0000 7f599091e700 1 -- 172.21.15.2:0/3161184724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f598c0cf2b0 msgr2=0x7f598c15c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:32.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.778+0000 7f599091e700 1 --2- 172.21.15.2:0/3161184724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f598c0cf2b0 0x7f598c15c1c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f59740098f0 tx=0x7f5974009c00 comp rx=0 tx=0).stop 2023-11-26T07:11:32.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.778+0000 7f599091e700 1 -- 172.21.15.2:0/3161184724 shutdown_connections 2023-11-26T07:11:32.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.778+0000 7f599091e700 1 --2- 172.21.15.2:0/3161184724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f598c0cf2b0 0x7f598c15c1c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:32.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.778+0000 7f599091e700 1 -- 172.21.15.2:0/3161184724 >> 172.21.15.2:0/3161184724 conn(0x7f598c0b3720 msgr2=0x7f598c0b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:32.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.778+0000 7f599091e700 1 -- 172.21.15.2:0/3161184724 shutdown_connections 2023-11-26T07:11:32.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.778+0000 7f599091e700 1 -- 172.21.15.2:0/3161184724 wait complete. 2023-11-26T07:11:32.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.780+0000 7f599091e700 1 Processor -- start 2023-11-26T07:11:32.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.780+0000 7f599091e700 1 -- start start 2023-11-26T07:11:32.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.781+0000 7f599091e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f598c0ce5c0 0x7f598c0b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:32.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.781+0000 7f599091e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f598c0cf2b0 0x7f598c15dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:32.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.781+0000 7f599091e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f598c15bde0 0x7f598c158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:32.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.781+0000 7f599091e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f598c06c4d0 con 0x7f598c15bde0 2023-11-26T07:11:32.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.781+0000 7f599091e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f598c15e160 con 0x7f598c0ce5c0 2023-11-26T07:11:32.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.781+0000 7f599091e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f598c1589a0 con 0x7f598c0cf2b0 2023-11-26T07:11:32.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.781+0000 7f598ad9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f598c15bde0 0x7f598c158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:32.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.781+0000 7f598ad9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f598c15bde0 0x7f598c158460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38776/0 (socket says 172.21.15.2:38776) 2023-11-26T07:11:32.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.781+0000 7f598ad9d700 1 -- 172.21.15.2:0/2928141351 learned_addr learned my addr 172.21.15.2:0/2928141351 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:32.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.781+0000 7f598a59c700 1 --2- 172.21.15.2:0/2928141351 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f598c0ce5c0 0x7f598c0b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:32.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.781+0000 7f5989d9b700 1 --2- 172.21.15.2:0/2928141351 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f598c0cf2b0 0x7f598c15dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:32.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.781+0000 7f598ad9d700 1 -- 172.21.15.2:0/2928141351 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f598c0cf2b0 msgr2=0x7f598c15dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:32.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.781+0000 7f598ad9d700 1 --2- 172.21.15.2:0/2928141351 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f598c0cf2b0 0x7f598c15dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:32.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.781+0000 7f598ad9d700 1 -- 172.21.15.2:0/2928141351 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f598c0ce5c0 msgr2=0x7f598c0b71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:32.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.781+0000 7f598ad9d700 1 --2- 172.21.15.2:0/2928141351 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f598c0ce5c0 0x7f598c0b71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:32.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.781+0000 7f598ad9d700 1 -- 172.21.15.2:0/2928141351 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5974009550 con 0x7f598c15bde0 2023-11-26T07:11:32.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.781+0000 7f598ad9d700 1 --2- 172.21.15.2:0/2928141351 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f598c15bde0 0x7f598c158460 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f598400cbd0 tx=0x7f598400cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:32.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.781+0000 7f5982ffd700 1 -- 172.21.15.2:0/2928141351 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598400aaa0 con 0x7f598c15bde0 2023-11-26T07:11:32.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.781+0000 7f5982ffd700 1 -- 172.21.15.2:0/2928141351 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f598400ac00 con 0x7f598c15bde0 2023-11-26T07:11:32.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.781+0000 7f599091e700 1 -- 172.21.15.2:0/2928141351 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f598c15e400 con 0x7f598c15bde0 2023-11-26T07:11:32.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.781+0000 7f5982ffd700 1 -- 172.21.15.2:0/2928141351 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5984007070 con 0x7f598c15bde0 2023-11-26T07:11:32.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.781+0000 7f599091e700 1 -- 172.21.15.2:0/2928141351 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f598c15e9c0 con 0x7f598c15bde0 2023-11-26T07:11:32.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.782+0000 7f599091e700 1 -- 172.21.15.2:0/2928141351 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f598c06ca90 con 0x7f598c15bde0 2023-11-26T07:11:32.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.783+0000 7f5982ffd700 1 -- 172.21.15.2:0/2928141351 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f59840071d0 con 0x7f598c15bde0 2023-11-26T07:11:32.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.783+0000 7f5982ffd700 1 --2- 172.21.15.2:0/2928141351 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f596c06aed0 0x7f596c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:32.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.783+0000 7f5982ffd700 1 -- 172.21.15.2:0/2928141351 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f5984088f30 con 0x7f598c15bde0 2023-11-26T07:11:32.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.784+0000 7f598a59c700 1 --2- 172.21.15.2:0/2928141351 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f596c06aed0 0x7f596c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:32.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.784+0000 7f598a59c700 1 --2- 172.21.15.2:0/2928141351 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f596c06aed0 0x7f596c06d390 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f597c007fd0 tx=0x7f597c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:32.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.788+0000 7f5982ffd700 1 -- 172.21.15.2:0/2928141351 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5984054300 con 0x7f598c15bde0 2023-11-26T07:11:32.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:32.988+0000 7f599091e700 1 -- 172.21.15.2:0/2928141351 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f598c15ebb0 con 0x7f598c15bde0 2023-11-26T07:11:33.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.619+0000 7f5982ffd700 1 -- 172.21.15.2:0/2928141351 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5984017020 con 0x7f598c15bde0 2023-11-26T07:11:33.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.623+0000 7f599091e700 1 -- 172.21.15.2:0/2928141351 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f596c06aed0 msgr2=0x7f596c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:33.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.623+0000 7f599091e700 1 --2- 172.21.15.2:0/2928141351 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f596c06aed0 0x7f596c06d390 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f597c007fd0 tx=0x7f597c009040 comp rx=0 tx=0).stop 2023-11-26T07:11:33.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.623+0000 7f599091e700 1 -- 172.21.15.2:0/2928141351 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f598c15bde0 msgr2=0x7f598c158460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:33.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.623+0000 7f599091e700 1 --2- 172.21.15.2:0/2928141351 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f598c15bde0 0x7f598c158460 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f598400cbd0 tx=0x7f598400cee0 comp rx=0 tx=0).stop 2023-11-26T07:11:33.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.623+0000 7f599091e700 1 -- 172.21.15.2:0/2928141351 shutdown_connections 2023-11-26T07:11:33.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.623+0000 7f599091e700 1 --2- 172.21.15.2:0/2928141351 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f596c06aed0 0x7f596c06d390 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:33.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.623+0000 7f599091e700 1 --2- 172.21.15.2:0/2928141351 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f598c15bde0 0x7f598c158460 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:33.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.623+0000 7f599091e700 1 --2- 172.21.15.2:0/2928141351 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f598c0ce5c0 0x7f598c0b71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:33.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.624+0000 7f599091e700 1 --2- 172.21.15.2:0/2928141351 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f598c0cf2b0 0x7f598c15dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:33.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.624+0000 7f599091e700 1 -- 172.21.15.2:0/2928141351 >> 172.21.15.2:0/2928141351 conn(0x7f598c0b3720 msgr2=0x7f598c070340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:33.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.624+0000 7f599091e700 1 -- 172.21.15.2:0/2928141351 shutdown_connections 2023-11-26T07:11:33.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.624+0000 7f599091e700 1 -- 172.21.15.2:0/2928141351 wait complete. 2023-11-26T07:11:33.640 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' created 2023-11-26T07:11:33.655 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-26T07:11:33.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.785+0000 7f3d9f4d4700 1 Processor -- start 2023-11-26T07:11:33.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.785+0000 7f3d9f4d4700 1 -- start start 2023-11-26T07:11:33.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.786+0000 7f3d9f4d4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d98143ae0 0x7f3d980b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:33.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.786+0000 7f3d9f4d4700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3d981440f0 0x7f3d98071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:33.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.786+0000 7f3d9f4d4700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3d980720f0 0x7f3d9815e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:33.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.786+0000 7f3d9f4d4700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d980b40a0 con 0x7f3d981440f0 2023-11-26T07:11:33.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.786+0000 7f3d9f4d4700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d98072580 con 0x7f3d980720f0 2023-11-26T07:11:33.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.786+0000 7f3d9f4d4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d98143ec0 con 0x7f3d98143ae0 2023-11-26T07:11:33.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.786+0000 7f3d9ca6f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3d981440f0 0x7f3d98071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:33.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.786+0000 7f3d9ca6f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3d981440f0 0x7f3d98071bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38782/0 (socket says 172.21.15.2:38782) 2023-11-26T07:11:33.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.786+0000 7f3d9ca6f700 1 -- 172.21.15.2:0/1163564909 learned_addr learned my addr 172.21.15.2:0/1163564909 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:33.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.786+0000 7f3d9da71700 1 --2- 172.21.15.2:0/1163564909 >> v2:172.21.15.192:3300/0 conn(0x7f3d980720f0 0x7f3d9815e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:33.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.786+0000 7f3d9ca6f700 1 -- 172.21.15.2:0/1163564909 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d98143ae0 msgr2=0x7f3d980b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:33.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.786+0000 7f3d9d270700 1 --2- 172.21.15.2:0/1163564909 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d98143ae0 0x7f3d980b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:33.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.786+0000 7f3d9ca6f700 1 --2- 172.21.15.2:0/1163564909 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d98143ae0 0x7f3d980b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:33.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.786+0000 7f3d9ca6f700 1 -- 172.21.15.2:0/1163564909 >> v2:172.21.15.192:3300/0 conn(0x7f3d980720f0 msgr2=0x7f3d9815e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:33.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.786+0000 7f3d9ca6f700 1 --2- 172.21.15.2:0/1163564909 >> v2:172.21.15.192:3300/0 conn(0x7f3d980720f0 0x7f3d9815e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:33.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.786+0000 7f3d9ca6f700 1 -- 172.21.15.2:0/1163564909 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d980b3ae0 con 0x7f3d981440f0 2023-11-26T07:11:33.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.786+0000 7f3d9da71700 1 --2- 172.21.15.2:0/1163564909 >> v2:172.21.15.192:3300/0 conn(0x7f3d980720f0 0x7f3d9815e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:11:33.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.786+0000 7f3d9d270700 1 --2- 172.21.15.2:0/1163564909 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d98143ae0 0x7f3d980b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:11:33.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.786+0000 7f3d9ca6f700 1 --2- 172.21.15.2:0/1163564909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d981440f0 0x7f3d98071bb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3d980706c0 tx=0x7f3d88009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3001d7a2d21ae3f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:33.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.786+0000 7f3d8ffff700 1 -- 172.21.15.2:0/1163564909 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8800b870 con 0x7f3d981440f0 2023-11-26T07:11:33.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.786+0000 7f3d8ffff700 1 -- 172.21.15.2:0/1163564909 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8800b9d0 con 0x7f3d981440f0 2023-11-26T07:11:33.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.787+0000 7f3d8ffff700 1 -- 172.21.15.2:0/1163564909 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8800bd60 con 0x7f3d981440f0 2023-11-26T07:11:33.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.787+0000 7f3d9f4d4700 1 -- 172.21.15.2:0/1163564909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d981440f0 msgr2=0x7f3d98071bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:33.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.787+0000 7f3d9f4d4700 1 --2- 172.21.15.2:0/1163564909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d981440f0 0x7f3d98071bb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3d980706c0 tx=0x7f3d88009bd0 comp rx=0 tx=0).stop 2023-11-26T07:11:33.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.787+0000 7f3d9f4d4700 1 -- 172.21.15.2:0/1163564909 shutdown_connections 2023-11-26T07:11:33.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.787+0000 7f3d9f4d4700 1 --2- 172.21.15.2:0/1163564909 >> v2:172.21.15.192:3300/0 conn(0x7f3d980720f0 0x7f3d9815e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:33.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.787+0000 7f3d9f4d4700 1 --2- 172.21.15.2:0/1163564909 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d98143ae0 0x7f3d980b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:33.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.787+0000 7f3d9f4d4700 1 --2- 172.21.15.2:0/1163564909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d981440f0 0x7f3d98071bb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:33.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.787+0000 7f3d9f4d4700 1 -- 172.21.15.2:0/1163564909 >> 172.21.15.2:0/1163564909 conn(0x7f3d980b2740 msgr2=0x7f3d980b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:33.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.787+0000 7f3d9f4d4700 1 -- 172.21.15.2:0/1163564909 shutdown_connections 2023-11-26T07:11:33.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.787+0000 7f3d9f4d4700 1 -- 172.21.15.2:0/1163564909 wait complete. 2023-11-26T07:11:33.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.788+0000 7f3d9f4d4700 1 Processor -- start 2023-11-26T07:11:33.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.788+0000 7f3d9f4d4700 1 -- start start 2023-11-26T07:11:33.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.789+0000 7f3d9f4d4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d980720f0 0x7f3d981edde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:33.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.789+0000 7f3d9f4d4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d98143ae0 0x7f3d981f4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:33.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.789+0000 7f3d9f4d4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d981440f0 0x7f3d980cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:33.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.789+0000 7f3d9f4d4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9815e6b0 con 0x7f3d98143ae0 2023-11-26T07:11:33.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.789+0000 7f3d9f4d4700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d981f3d50 con 0x7f3d981440f0 2023-11-26T07:11:33.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.789+0000 7f3d9f4d4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d981f3ff0 con 0x7f3d980720f0 2023-11-26T07:11:33.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.789+0000 7f3d9ca6f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d98143ae0 0x7f3d981f4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:33.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.789+0000 7f3d9ca6f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d98143ae0 0x7f3d981f4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38790/0 (socket says 172.21.15.2:38790) 2023-11-26T07:11:33.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.789+0000 7f3d9ca6f700 1 -- 172.21.15.2:0/3014479266 learned_addr learned my addr 172.21.15.2:0/3014479266 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:33.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.789+0000 7f3d9da71700 1 --2- 172.21.15.2:0/3014479266 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d981440f0 0x7f3d980cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:33.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.789+0000 7f3d9d270700 1 --2- 172.21.15.2:0/3014479266 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d980720f0 0x7f3d981edde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:33.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.789+0000 7f3d9ca6f700 1 -- 172.21.15.2:0/3014479266 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d980720f0 msgr2=0x7f3d981edde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:33.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.789+0000 7f3d9ca6f700 1 --2- 172.21.15.2:0/3014479266 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d980720f0 0x7f3d981edde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:33.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.789+0000 7f3d9ca6f700 1 -- 172.21.15.2:0/3014479266 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d981440f0 msgr2=0x7f3d980cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:33.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.790+0000 7f3d9ca6f700 1 --2- 172.21.15.2:0/3014479266 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d981440f0 0x7f3d980cbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:33.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.790+0000 7f3d9ca6f700 1 -- 172.21.15.2:0/3014479266 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d88009550 con 0x7f3d98143ae0 2023-11-26T07:11:33.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.790+0000 7f3d9ca6f700 1 --2- 172.21.15.2:0/3014479266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d98143ae0 0x7f3d981f4480 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3d980d1bd0 tx=0x7f3d88004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:33.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.790+0000 7f3d8dffb700 1 -- 172.21.15.2:0/3014479266 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d88004310 con 0x7f3d98143ae0 2023-11-26T07:11:33.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.790+0000 7f3d8dffb700 1 -- 172.21.15.2:0/3014479266 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8801f070 con 0x7f3d98143ae0 2023-11-26T07:11:33.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.790+0000 7f3d8dffb700 1 -- 172.21.15.2:0/3014479266 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d880036a0 con 0x7f3d98143ae0 2023-11-26T07:11:33.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.790+0000 7f3d9f4d4700 1 -- 172.21.15.2:0/3014479266 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d9815db30 con 0x7f3d98143ae0 2023-11-26T07:11:33.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.790+0000 7f3d9f4d4700 1 -- 172.21.15.2:0/3014479266 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d9815e0f0 con 0x7f3d98143ae0 2023-11-26T07:11:33.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.791+0000 7f3d9f4d4700 1 -- 172.21.15.2:0/3014479266 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d980b36a0 con 0x7f3d98143ae0 2023-11-26T07:11:33.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.792+0000 7f3d8dffb700 1 -- 172.21.15.2:0/3014479266 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3d88021030 con 0x7f3d98143ae0 2023-11-26T07:11:33.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.792+0000 7f3d8dffb700 1 --2- 172.21.15.2:0/3014479266 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3d7c06aed0 0x7f3d7c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:33.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.792+0000 7f3d8dffb700 1 -- 172.21.15.2:0/3014479266 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f3d8808a7b0 con 0x7f3d98143ae0 2023-11-26T07:11:33.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.792+0000 7f3d9d270700 1 --2- 172.21.15.2:0/3014479266 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3d7c06aed0 0x7f3d7c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:33.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.793+0000 7f3d9d270700 1 --2- 172.21.15.2:0/3014479266 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3d7c06aed0 0x7f3d7c06d390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3d980cc9f0 tx=0x7f3d94008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:33.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:33.797+0000 7f3d8dffb700 1 -- 172.21.15.2:0/3014479266 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3d88055a70 con 0x7f3d98143ae0 2023-11-26T07:11:34.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.048+0000 7f3d9f4d4700 1 -- 172.21.15.2:0/3014479266 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3d98144830 con 0x7f3d98143ae0 2023-11-26T07:11:34.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.636+0000 7f3d8dffb700 1 -- 172.21.15.2:0/3014479266 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f3d88059090 con 0x7f3d98143ae0 2023-11-26T07:11:34.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.643+0000 7f3d9f4d4700 1 -- 172.21.15.2:0/3014479266 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3d7c06aed0 msgr2=0x7f3d7c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:34.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.643+0000 7f3d9f4d4700 1 --2- 172.21.15.2:0/3014479266 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3d7c06aed0 0x7f3d7c06d390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3d980cc9f0 tx=0x7f3d94008040 comp rx=0 tx=0).stop 2023-11-26T07:11:34.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.643+0000 7f3d9f4d4700 1 -- 172.21.15.2:0/3014479266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d98143ae0 msgr2=0x7f3d981f4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:34.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.643+0000 7f3d9f4d4700 1 --2- 172.21.15.2:0/3014479266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d98143ae0 0x7f3d981f4480 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3d980d1bd0 tx=0x7f3d88004750 comp rx=0 tx=0).stop 2023-11-26T07:11:34.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.644+0000 7f3d9f4d4700 1 -- 172.21.15.2:0/3014479266 shutdown_connections 2023-11-26T07:11:34.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.644+0000 7f3d9f4d4700 1 --2- 172.21.15.2:0/3014479266 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3d7c06aed0 0x7f3d7c06d390 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:34.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.644+0000 7f3d9f4d4700 1 --2- 172.21.15.2:0/3014479266 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d981440f0 0x7f3d980cbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:34.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.644+0000 7f3d9f4d4700 1 --2- 172.21.15.2:0/3014479266 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d980720f0 0x7f3d981edde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:34.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.644+0000 7f3d9f4d4700 1 --2- 172.21.15.2:0/3014479266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d98143ae0 0x7f3d981f4480 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:34.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.644+0000 7f3d9f4d4700 1 -- 172.21.15.2:0/3014479266 >> 172.21.15.2:0/3014479266 conn(0x7f3d980b2740 msgr2=0x7f3d9806afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:34.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.647+0000 7f3d9f4d4700 1 -- 172.21.15.2:0/3014479266 shutdown_connections 2023-11-26T07:11:34.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.647+0000 7f3d9f4d4700 1 -- 172.21.15.2:0/3014479266 wait complete. 2023-11-26T07:11:34.657 INFO:teuthology.orchestra.run.smithi002.stderr:new fs with metadata pool 2 and data pool 3 2023-11-26T07:11:34.671 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:11:34.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.799+0000 7fd980449700 1 Processor -- start 2023-11-26T07:11:34.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.799+0000 7fd980449700 1 -- start start 2023-11-26T07:11:34.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.800+0000 7fd980449700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd97806b620 0x7fd9780b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:34.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.800+0000 7fd980449700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9780b5ab0 0x7fd9780b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:34.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.800+0000 7fd980449700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd978071f50 con 0x7fd9781478c0 2023-11-26T07:11:34.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.800+0000 7fd980449700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd978072230 con 0x7fd97806b620 2023-11-26T07:11:34.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.800+0000 7fd980449700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd978072510 con 0x7fd9780b5ab0 2023-11-26T07:11:34.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.800+0000 7fd97e1e5700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd97806b620 0x7fd9780b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:34.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.800+0000 7fd97e1e5700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd97806b620 0x7fd9780b3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38794/0 (socket says 172.21.15.2:38794) 2023-11-26T07:11:34.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.800+0000 7fd97e1e5700 1 -- 172.21.15.2:0/3155309338 learned_addr learned my addr 172.21.15.2:0/3155309338 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:34.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.800+0000 7fd97d9e4700 1 --2- 172.21.15.2:0/3155309338 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9780b5ab0 0x7fd9780b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:34.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.800+0000 7fd97e1e5700 1 -- 172.21.15.2:0/3155309338 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9780b5ab0 msgr2=0x7fd9780b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:34.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.800+0000 7fd97e1e5700 1 --2- 172.21.15.2:0/3155309338 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9780b5ab0 0x7fd9780b3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:34.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.800+0000 7fd97e1e5700 1 -- 172.21.15.2:0/3155309338 >> v1:172.21.15.192:6789/0 conn(0x7fd9781478c0 legacy=0x7fd978161ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:34.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.800+0000 7fd97e1e5700 1 -- 172.21.15.2:0/3155309338 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9780727f0 con 0x7fd97806b620 2023-11-26T07:11:34.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.800+0000 7fd97e1e5700 1 --2- 172.21.15.2:0/3155309338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd97806b620 0x7fd9780b3a40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd9740098f0 tx=0x7fd974009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=595611e2de09b6da server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:34.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.800+0000 7fd97d1e3700 1 -- 172.21.15.2:0/3155309338 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd974011830 con 0x7fd97806b620 2023-11-26T07:11:34.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.800+0000 7fd97d1e3700 1 -- 172.21.15.2:0/3155309338 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd974011990 con 0x7fd97806b620 2023-11-26T07:11:34.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.800+0000 7fd97d1e3700 1 -- 172.21.15.2:0/3155309338 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd974011d20 con 0x7fd97806b620 2023-11-26T07:11:34.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.801+0000 7fd980449700 1 -- 172.21.15.2:0/3155309338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd97806b620 msgr2=0x7fd9780b3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:34.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.801+0000 7fd980449700 1 --2- 172.21.15.2:0/3155309338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd97806b620 0x7fd9780b3a40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd9740098f0 tx=0x7fd974009c00 comp rx=0 tx=0).stop 2023-11-26T07:11:34.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.801+0000 7fd980449700 1 -- 172.21.15.2:0/3155309338 shutdown_connections 2023-11-26T07:11:34.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.801+0000 7fd980449700 1 --2- 172.21.15.2:0/3155309338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd97806b620 0x7fd9780b3a40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:34.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.801+0000 7fd980449700 1 --2- 172.21.15.2:0/3155309338 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9780b5ab0 0x7fd9780b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:34.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.801+0000 7fd980449700 1 -- 172.21.15.2:0/3155309338 >> 172.21.15.2:0/3155309338 conn(0x7fd9780b2740 msgr2=0x7fd9780b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:34.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.801+0000 7fd980449700 1 -- 172.21.15.2:0/3155309338 shutdown_connections 2023-11-26T07:11:34.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.801+0000 7fd980449700 1 -- 172.21.15.2:0/3155309338 wait complete. 2023-11-26T07:11:34.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.802+0000 7fd980449700 1 Processor -- start 2023-11-26T07:11:34.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.802+0000 7fd980449700 1 -- start start 2023-11-26T07:11:34.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.803+0000 7fd980449700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd97806b620 0x7fd9781f3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:34.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.803+0000 7fd980449700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9780b5ab0 0x7fd9780cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:34.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.803+0000 7fd980449700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9781478c0 0x7fd9780cf300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:34.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.803+0000 7fd980449700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9780cf910 con 0x7fd97806b620 2023-11-26T07:11:34.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.803+0000 7fd980449700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9780cfbf0 con 0x7fd9780b5ab0 2023-11-26T07:11:34.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.803+0000 7fd980449700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9780cfed0 con 0x7fd9781478c0 2023-11-26T07:11:34.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.803+0000 7fd97e1e5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd97806b620 0x7fd9781f3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:34.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.803+0000 7fd97e1e5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd97806b620 0x7fd9781f3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38800/0 (socket says 172.21.15.2:38800) 2023-11-26T07:11:34.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.803+0000 7fd97e1e5700 1 -- 172.21.15.2:0/4074255664 learned_addr learned my addr 172.21.15.2:0/4074255664 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:34.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.803+0000 7fd97e9e6700 1 --2- 172.21.15.2:0/4074255664 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9781478c0 0x7fd9780cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:34.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.803+0000 7fd97e1e5700 1 -- 172.21.15.2:0/4074255664 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9781478c0 msgr2=0x7fd9780cf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:34.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.803+0000 7fd97d9e4700 1 --2- 172.21.15.2:0/4074255664 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9780b5ab0 0x7fd9780cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:34.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.803+0000 7fd97e1e5700 1 --2- 172.21.15.2:0/4074255664 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9781478c0 0x7fd9780cf300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:34.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.803+0000 7fd97e1e5700 1 -- 172.21.15.2:0/4074255664 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9780b5ab0 msgr2=0x7fd9780cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:34.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.803+0000 7fd97e1e5700 1 --2- 172.21.15.2:0/4074255664 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9780b5ab0 0x7fd9780cedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:34.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.803+0000 7fd97e1e5700 1 -- 172.21.15.2:0/4074255664 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd974009550 con 0x7fd97806b620 2023-11-26T07:11:34.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.804+0000 7fd97e1e5700 1 --2- 172.21.15.2:0/4074255664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd97806b620 0x7fd9781f3590 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd974009c40 tx=0x7fd974004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:34.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.804+0000 7fd96effd700 1 -- 172.21.15.2:0/4074255664 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9740045b0 con 0x7fd97806b620 2023-11-26T07:11:34.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.804+0000 7fd96effd700 1 -- 172.21.15.2:0/4074255664 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd97401f070 con 0x7fd97806b620 2023-11-26T07:11:34.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.804+0000 7fd980449700 1 -- 172.21.15.2:0/4074255664 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9780d01b0 con 0x7fd97806b620 2023-11-26T07:11:34.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.804+0000 7fd96effd700 1 -- 172.21.15.2:0/4074255664 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9740038e0 con 0x7fd97806b620 2023-11-26T07:11:34.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.804+0000 7fd980449700 1 -- 172.21.15.2:0/4074255664 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9781f3ad0 con 0x7fd97806b620 2023-11-26T07:11:34.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.805+0000 7fd980449700 1 -- 172.21.15.2:0/4074255664 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9781f3cc0 con 0x7fd97806b620 2023-11-26T07:11:34.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.805+0000 7fd96effd700 1 -- 172.21.15.2:0/4074255664 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd974021030 con 0x7fd97806b620 2023-11-26T07:11:34.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.806+0000 7fd96effd700 1 --2- 172.21.15.2:0/4074255664 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd95c06aed0 0x7fd95c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:34.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.806+0000 7fd96effd700 1 -- 172.21.15.2:0/4074255664 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd97408aa40 con 0x7fd97806b620 2023-11-26T07:11:34.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.806+0000 7fd97d9e4700 1 --2- 172.21.15.2:0/4074255664 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd95c06aed0 0x7fd95c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:34.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.806+0000 7fd97d9e4700 1 --2- 172.21.15.2:0/4074255664 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd95c06aed0 0x7fd95c06d390 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd978147520 tx=0x7fd968008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:34.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:34.810+0000 7fd96effd700 1 -- 172.21.15.2:0/4074255664 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd97408ce60 con 0x7fd97806b620 2023-11-26T07:11:35.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.011+0000 7fd980449700 1 -- 172.21.15.2:0/4074255664 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd978068670 con 0x7fd97806b620 2023-11-26T07:11:35.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.012+0000 7fd96effd700 1 -- 172.21.15.2:0/4074255664 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16470 (secure 0 0 0) 0x7fd974015020 con 0x7fd97806b620 2023-11-26T07:11:35.015 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:11:35.016 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":20,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:11:34.050953+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:11:32.129474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:11:33.019837+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:11:35.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.014+0000 7fd980449700 1 -- 172.21.15.2:0/4074255664 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd95c06aed0 msgr2=0x7fd95c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:35.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.014+0000 7fd980449700 1 --2- 172.21.15.2:0/4074255664 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd95c06aed0 0x7fd95c06d390 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd978147520 tx=0x7fd968008040 comp rx=0 tx=0).stop 2023-11-26T07:11:35.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.014+0000 7fd980449700 1 -- 172.21.15.2:0/4074255664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd97806b620 msgr2=0x7fd9781f3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:35.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.014+0000 7fd980449700 1 --2- 172.21.15.2:0/4074255664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd97806b620 0x7fd9781f3590 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd974009c40 tx=0x7fd974004750 comp rx=0 tx=0).stop 2023-11-26T07:11:35.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.014+0000 7fd980449700 1 -- 172.21.15.2:0/4074255664 shutdown_connections 2023-11-26T07:11:35.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.014+0000 7fd980449700 1 --2- 172.21.15.2:0/4074255664 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd95c06aed0 0x7fd95c06d390 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:35.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.014+0000 7fd980449700 1 --2- 172.21.15.2:0/4074255664 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9781478c0 0x7fd9780cf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:35.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.014+0000 7fd980449700 1 --2- 172.21.15.2:0/4074255664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd97806b620 0x7fd9781f3590 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:35.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.014+0000 7fd980449700 1 --2- 172.21.15.2:0/4074255664 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9780b5ab0 0x7fd9780cedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:35.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.014+0000 7fd980449700 1 -- 172.21.15.2:0/4074255664 >> 172.21.15.2:0/4074255664 conn(0x7fd9780b2740 msgr2=0x7fd9780b1980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:35.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.014+0000 7fd980449700 1 -- 172.21.15.2:0/4074255664 shutdown_connections 2023-11-26T07:11:35.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.015+0000 7fd980449700 1 -- 172.21.15.2:0/4074255664 wait complete. 2023-11-26T07:11:35.030 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:11:35.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.151+0000 7fabab739700 1 Processor -- start 2023-11-26T07:11:35.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.151+0000 7fabab739700 1 -- start start 2023-11-26T07:11:35.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.152+0000 7fabab739700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7faba40b5ab0 0x7faba406e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:35.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.152+0000 7fabab739700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faba4071f50 con 0x7faba406b620 2023-11-26T07:11:35.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.152+0000 7fabab739700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faba4072230 con 0x7faba40b4150 2023-11-26T07:11:35.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.152+0000 7fabab739700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faba4072510 con 0x7faba40b5ab0 2023-11-26T07:11:35.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.152+0000 7faba94d5700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7faba406b620 0x7faba40b3a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58250/0 (socket says 172.21.15.2:58250) 2023-11-26T07:11:35.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.152+0000 7faba94d5700 1 -- 172.21.15.2:0/3593831184 learned_addr learned my addr 172.21.15.2:0/3593831184 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:11:35.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.152+0000 7faba9cd6700 1 --2- 172.21.15.2:0/3593831184 >> v2:172.21.15.192:3300/0 conn(0x7faba40b5ab0 0x7faba406e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:35.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.152+0000 7fab9bfff700 1 -- 172.21.15.2:0/3593831184 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3222402422 0 0) 0x7faba4071f50 con 0x7faba406b620 2023-11-26T07:11:35.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.152+0000 7fab9bfff700 1 -- 172.21.15.2:0/3593831184 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab900035b0 con 0x7faba406b620 2023-11-26T07:11:35.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.152+0000 7fab9bfff700 1 -- 172.21.15.2:0/3593831184 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3335551888 0 0) 0x7fab900035b0 con 0x7faba406b620 2023-11-26T07:11:35.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.152+0000 7fab9bfff700 1 -- 172.21.15.2:0/3593831184 >> v2:172.21.15.192:3300/0 conn(0x7faba40b5ab0 msgr2=0x7faba406e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:35.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.152+0000 7fab9bfff700 1 --2- 172.21.15.2:0/3593831184 >> v2:172.21.15.192:3300/0 conn(0x7faba40b5ab0 0x7faba406e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:35.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.152+0000 7fab9bfff700 1 -- 172.21.15.2:0/3593831184 >> v1:172.21.15.192:6789/0 conn(0x7faba40b4150 legacy=0x7faba406de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:35.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.153+0000 7fab9bfff700 1 -- 172.21.15.2:0/3593831184 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba40727f0 con 0x7faba406b620 2023-11-26T07:11:35.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.153+0000 7fab9bfff700 1 -- 172.21.15.2:0/3593831184 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7faba0001670 con 0x7faba406b620 2023-11-26T07:11:35.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.153+0000 7fab9bfff700 1 -- 172.21.15.2:0/3593831184 >> v1:172.21.15.2:6789/0 conn(0x7faba406b620 legacy=0x7faba40b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:35.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.153+0000 7fab9bfff700 1 --2- 172.21.15.2:0/3593831184 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fab90003a00 0x7fab90003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:35.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.153+0000 7fab9bfff700 1 --2- 172.21.15.2:0/3593831184 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab90004850 0x7fab90004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:35.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.153+0000 7fab9bfff700 1 --2- 172.21.15.2:0/3593831184 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab90005210 0x7fab9000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:35.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.153+0000 7fab9bfff700 1 -- 172.21.15.2:0/3593831184 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba4072510 con 0x7fab90005210 2023-11-26T07:11:35.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.153+0000 7fab9bfff700 1 -- 172.21.15.2:0/3593831184 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9000c0b0 con 0x7fab90004850 2023-11-26T07:11:35.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.153+0000 7fab9bfff700 1 -- 172.21.15.2:0/3593831184 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab9000c270 con 0x7fab90003a00 2023-11-26T07:11:35.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.153+0000 7faba9cd6700 1 --2- 172.21.15.2:0/3593831184 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab90005210 0x7fab9000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:35.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.153+0000 7faba94d5700 1 --2- 172.21.15.2:0/3593831184 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fab90003a00 0x7fab90003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:35.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.153+0000 7faba8cd4700 1 --2- 172.21.15.2:0/3593831184 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab90004850 0x7fab90004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:35.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.153+0000 7faba9cd6700 1 -- 172.21.15.2:0/3593831184 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fab90003a00 msgr2=0x7fab90003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:35.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.153+0000 7faba9cd6700 1 --2- 172.21.15.2:0/3593831184 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fab90003a00 0x7fab90003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:35.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.153+0000 7faba9cd6700 1 -- 172.21.15.2:0/3593831184 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab90004850 msgr2=0x7fab90004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:35.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.153+0000 7faba9cd6700 1 --2- 172.21.15.2:0/3593831184 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab90004850 0x7fab90004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:35.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.153+0000 7faba9cd6700 1 -- 172.21.15.2:0/3593831184 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab900035b0 con 0x7fab90005210 2023-11-26T07:11:35.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.153+0000 7faba9cd6700 1 -- 172.21.15.2:0/3593831184 reap_dead start 2023-11-26T07:11:35.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.153+0000 7faba9cd6700 1 --2- 172.21.15.2:0/3593831184 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab90005210 0x7fab9000ba10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fab9c009fc0 tx=0x7fab90005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b615265474bd19e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:35.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.153+0000 7fab9bfff700 1 -- 172.21.15.2:0/3593831184 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9c003a20 con 0x7fab90005210 2023-11-26T07:11:35.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.153+0000 7fab9bfff700 1 -- 172.21.15.2:0/3593831184 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab9c00f040 con 0x7fab90005210 2023-11-26T07:11:35.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.153+0000 7fab9bfff700 1 -- 172.21.15.2:0/3593831184 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9c003da0 con 0x7fab90005210 2023-11-26T07:11:35.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.154+0000 7fabab739700 1 -- 172.21.15.2:0/3593831184 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab90005210 msgr2=0x7fab9000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:35.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.154+0000 7fabab739700 1 --2- 172.21.15.2:0/3593831184 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab90005210 0x7fab9000ba10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fab9c009fc0 tx=0x7fab90005880 comp rx=0 tx=0).stop 2023-11-26T07:11:35.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.154+0000 7fabab739700 1 -- 172.21.15.2:0/3593831184 shutdown_connections 2023-11-26T07:11:35.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.154+0000 7fabab739700 1 --2- 172.21.15.2:0/3593831184 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab90005210 0x7fab9000ba10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:35.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.154+0000 7fabab739700 1 -- 172.21.15.2:0/3593831184 >> 172.21.15.2:0/3593831184 conn(0x7faba40b2740 msgr2=0x7faba40b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:35.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.154+0000 7fabab739700 1 -- 172.21.15.2:0/3593831184 shutdown_connections 2023-11-26T07:11:35.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.154+0000 7fabab739700 1 -- 172.21.15.2:0/3593831184 wait complete. 2023-11-26T07:11:35.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.156+0000 7fabab739700 1 Processor -- start 2023-11-26T07:11:35.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.156+0000 7fabab739700 1 -- start start 2023-11-26T07:11:35.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.157+0000 7fabab739700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab90005210 0x7faba41e3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:35.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.157+0000 7fabab739700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faba41f4ea0 0x7faba40ae5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:35.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.157+0000 7fabab739700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faba40aeae0 0x7faba41f3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:35.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.157+0000 7fabab739700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba40aef90 con 0x7faba40aeae0 2023-11-26T07:11:35.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.157+0000 7fabab739700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba41f4d20 con 0x7fab90005210 2023-11-26T07:11:35.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.157+0000 7fabab739700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba41e4440 con 0x7faba41f4ea0 2023-11-26T07:11:35.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.157+0000 7faba9cd6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faba40aeae0 0x7faba41f3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:35.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.157+0000 7faba9cd6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faba40aeae0 0x7faba41f3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38824/0 (socket says 172.21.15.2:38824) 2023-11-26T07:11:35.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.157+0000 7faba9cd6700 1 -- 172.21.15.2:0/787692521 learned_addr learned my addr 172.21.15.2:0/787692521 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:35.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.157+0000 7faba94d5700 1 --2- 172.21.15.2:0/787692521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab90005210 0x7faba41e3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:35.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.157+0000 7faba8cd4700 1 --2- 172.21.15.2:0/787692521 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faba41f4ea0 0x7faba40ae5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:35.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.157+0000 7faba9cd6700 1 -- 172.21.15.2:0/787692521 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faba41f4ea0 msgr2=0x7faba40ae5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:35.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.157+0000 7faba9cd6700 1 --2- 172.21.15.2:0/787692521 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faba41f4ea0 0x7faba40ae5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:35.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.157+0000 7faba9cd6700 1 -- 172.21.15.2:0/787692521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab90005210 msgr2=0x7faba41e3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:35.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.157+0000 7faba9cd6700 1 --2- 172.21.15.2:0/787692521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab90005210 0x7faba41e3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:35.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.157+0000 7faba9cd6700 1 -- 172.21.15.2:0/787692521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba40c5c50 con 0x7faba40aeae0 2023-11-26T07:11:35.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.157+0000 7faba8cd4700 1 --2- 172.21.15.2:0/787692521 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faba41f4ea0 0x7faba40ae5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:11:35.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.157+0000 7faba9cd6700 1 --2- 172.21.15.2:0/787692521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faba40aeae0 0x7faba41f3ff0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fab9c00e700 tx=0x7fab9c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:35.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.157+0000 7fab99ffb700 1 -- 172.21.15.2:0/787692521 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9c003e10 con 0x7faba40aeae0 2023-11-26T07:11:35.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.157+0000 7fab99ffb700 1 -- 172.21.15.2:0/787692521 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab9c004250 con 0x7faba40aeae0 2023-11-26T07:11:35.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.157+0000 7fabab739700 1 -- 172.21.15.2:0/787692521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba40c5f30 con 0x7faba40aeae0 2023-11-26T07:11:35.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.157+0000 7fab99ffb700 1 -- 172.21.15.2:0/787692521 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9c004600 con 0x7faba40aeae0 2023-11-26T07:11:35.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.158+0000 7fabab739700 1 -- 172.21.15.2:0/787692521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba40c64f0 con 0x7faba40aeae0 2023-11-26T07:11:35.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.159+0000 7fabab739700 1 -- 172.21.15.2:0/787692521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faba40c66b0 con 0x7faba40aeae0 2023-11-26T07:11:35.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.159+0000 7fab99ffb700 1 -- 172.21.15.2:0/787692521 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fab9c004760 con 0x7faba40aeae0 2023-11-26T07:11:35.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.159+0000 7fab99ffb700 1 --2- 172.21.15.2:0/787692521 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fab8806aed0 0x7fab8806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:35.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.159+0000 7fab99ffb700 1 -- 172.21.15.2:0/787692521 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab9c08a790 con 0x7faba40aeae0 2023-11-26T07:11:35.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.160+0000 7faba94d5700 1 --2- 172.21.15.2:0/787692521 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fab8806aed0 0x7fab8806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:35.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.160+0000 7faba94d5700 1 --2- 172.21.15.2:0/787692521 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fab8806aed0 0x7fab8806d390 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faba0000c00 tx=0x7faba0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:35.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.164+0000 7fab99ffb700 1 -- 172.21.15.2:0/787692521 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fab9c055830 con 0x7faba40aeae0 2023-11-26T07:11:35.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.363+0000 7fabab739700 1 -- 172.21.15.2:0/787692521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faba4068670 con 0x7faba40aeae0 2023-11-26T07:11:35.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.364+0000 7fab99ffb700 1 -- 172.21.15.2:0/787692521 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16470 (secure 0 0 0) 0x7fab9c018090 con 0x7faba40aeae0 2023-11-26T07:11:35.367 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:11:35.368 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":20,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:11:34.050953+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:11:32.129474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:11:33.019837+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:11:35.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.366+0000 7fabab739700 1 -- 172.21.15.2:0/787692521 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fab8806aed0 msgr2=0x7fab8806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:35.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.366+0000 7fabab739700 1 --2- 172.21.15.2:0/787692521 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fab8806aed0 0x7fab8806d390 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faba0000c00 tx=0x7faba0009040 comp rx=0 tx=0).stop 2023-11-26T07:11:35.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.366+0000 7fabab739700 1 -- 172.21.15.2:0/787692521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faba40aeae0 msgr2=0x7faba41f3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:35.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.366+0000 7fabab739700 1 --2- 172.21.15.2:0/787692521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faba40aeae0 0x7faba41f3ff0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fab9c00e700 tx=0x7fab9c009750 comp rx=0 tx=0).stop 2023-11-26T07:11:35.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.366+0000 7fabab739700 1 -- 172.21.15.2:0/787692521 shutdown_connections 2023-11-26T07:11:35.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.366+0000 7fabab739700 1 --2- 172.21.15.2:0/787692521 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fab8806aed0 0x7fab8806d390 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:35.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.366+0000 7fabab739700 1 --2- 172.21.15.2:0/787692521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faba40aeae0 0x7faba41f3ff0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:35.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.366+0000 7fabab739700 1 --2- 172.21.15.2:0/787692521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab90005210 0x7faba41e3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:35.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.366+0000 7fabab739700 1 --2- 172.21.15.2:0/787692521 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faba41f4ea0 0x7faba40ae5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:35.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.366+0000 7fabab739700 1 -- 172.21.15.2:0/787692521 >> 172.21.15.2:0/787692521 conn(0x7faba40b2740 msgr2=0x7faba40b0690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:35.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.366+0000 7fabab739700 1 -- 172.21.15.2:0/787692521 shutdown_connections 2023-11-26T07:11:35.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.366+0000 7fabab739700 1 -- 172.21.15.2:0/787692521 wait complete. 2023-11-26T07:11:35.382 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-26T07:11:35.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.507+0000 7f578e407700 1 Processor -- start 2023-11-26T07:11:35.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.507+0000 7f578e407700 1 -- start start 2023-11-26T07:11:35.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.508+0000 7f578e407700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5788143ae0 0x7f57880b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:35.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.508+0000 7f578e407700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f57881440f0 0x7f5788071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:35.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.508+0000 7f578e407700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5788143ec0 con 0x7f57880720f0 2023-11-26T07:11:35.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.508+0000 7f578e407700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57880b40a0 con 0x7f57881440f0 2023-11-26T07:11:35.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.508+0000 7f578e407700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5788072580 con 0x7f5788143ae0 2023-11-26T07:11:35.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.508+0000 7f57877fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f57881440f0 0x7f5788071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:35.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.508+0000 7f57877fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f57881440f0 0x7f5788071bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38828/0 (socket says 172.21.15.2:38828) 2023-11-26T07:11:35.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.508+0000 7f57877fe700 1 -- 172.21.15.2:0/413751275 learned_addr learned my addr 172.21.15.2:0/413751275 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:35.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.508+0000 7f5787fff700 1 --2- 172.21.15.2:0/413751275 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5788143ae0 0x7f57880b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:35.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.509+0000 7f57877fe700 1 -- 172.21.15.2:0/413751275 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5788143ae0 msgr2=0x7f57880b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:35.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.509+0000 7f57877fe700 1 --2- 172.21.15.2:0/413751275 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5788143ae0 0x7f57880b51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:35.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.509+0000 7f57877fe700 1 -- 172.21.15.2:0/413751275 >> v1:172.21.15.192:6789/0 conn(0x7f57880720f0 legacy=0x7f578815e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:35.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.509+0000 7f57877fe700 1 -- 172.21.15.2:0/413751275 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57880b3ae0 con 0x7f57881440f0 2023-11-26T07:11:35.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.509+0000 7f57877fe700 1 --2- 172.21.15.2:0/413751275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57881440f0 0x7f5788071bb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f577000bb90 tx=0x7f577000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc8aef20588a339b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:35.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.509+0000 7f5786ffd700 1 -- 172.21.15.2:0/413751275 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577000dd10 con 0x7f57881440f0 2023-11-26T07:11:35.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.509+0000 7f5786ffd700 1 -- 172.21.15.2:0/413751275 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f577000de70 con 0x7f57881440f0 2023-11-26T07:11:35.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.509+0000 7f5786ffd700 1 -- 172.21.15.2:0/413751275 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5770004230 con 0x7f57881440f0 2023-11-26T07:11:35.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.509+0000 7f578e407700 1 -- 172.21.15.2:0/413751275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57881440f0 msgr2=0x7f5788071bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:35.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.509+0000 7f578e407700 1 --2- 172.21.15.2:0/413751275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57881440f0 0x7f5788071bb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f577000bb90 tx=0x7f577000bea0 comp rx=0 tx=0).stop 2023-11-26T07:11:35.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.509+0000 7f578e407700 1 -- 172.21.15.2:0/413751275 shutdown_connections 2023-11-26T07:11:35.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.509+0000 7f578e407700 1 --2- 172.21.15.2:0/413751275 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5788143ae0 0x7f57880b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:35.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.509+0000 7f578e407700 1 --2- 172.21.15.2:0/413751275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57881440f0 0x7f5788071bb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:35.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.509+0000 7f578e407700 1 -- 172.21.15.2:0/413751275 >> 172.21.15.2:0/413751275 conn(0x7f57880b2740 msgr2=0x7f57880b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:35.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.509+0000 7f578e407700 1 -- 172.21.15.2:0/413751275 shutdown_connections 2023-11-26T07:11:35.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.509+0000 7f578e407700 1 -- 172.21.15.2:0/413751275 wait complete. 2023-11-26T07:11:35.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.511+0000 7f578e407700 1 Processor -- start 2023-11-26T07:11:35.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.511+0000 7f578e407700 1 -- start start 2023-11-26T07:11:35.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.512+0000 7f578e407700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57880720f0 0x7f57881f3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:35.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.512+0000 7f578e407700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5788143ae0 0x7f5788153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:35.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.512+0000 7f578e407700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57881440f0 0x7f57881543c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:35.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.512+0000 7f578e407700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5788155830 con 0x7f57881440f0 2023-11-26T07:11:35.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.512+0000 7f578e407700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5788154c20 con 0x7f57880720f0 2023-11-26T07:11:35.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.512+0000 7f578e407700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5788154f00 con 0x7f5788143ae0 2023-11-26T07:11:35.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.512+0000 7f578c9a4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57881440f0 0x7f57881543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:35.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.512+0000 7f578c9a4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57881440f0 0x7f57881543c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38838/0 (socket says 172.21.15.2:38838) 2023-11-26T07:11:35.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.512+0000 7f578c9a4700 1 -- 172.21.15.2:0/2026730970 learned_addr learned my addr 172.21.15.2:0/2026730970 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:35.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.512+0000 7f5787fff700 1 --2- 172.21.15.2:0/2026730970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57880720f0 0x7f57881f3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:35.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.512+0000 7f57877fe700 1 --2- 172.21.15.2:0/2026730970 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5788143ae0 0x7f5788153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:35.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.512+0000 7f578c9a4700 1 -- 172.21.15.2:0/2026730970 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5788143ae0 msgr2=0x7f5788153e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:35.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.512+0000 7f578c9a4700 1 --2- 172.21.15.2:0/2026730970 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5788143ae0 0x7f5788153e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:35.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.512+0000 7f578c9a4700 1 -- 172.21.15.2:0/2026730970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57880720f0 msgr2=0x7f57881f3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:35.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.512+0000 7f578c9a4700 1 --2- 172.21.15.2:0/2026730970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57880720f0 0x7f57881f3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:35.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.512+0000 7f578c9a4700 1 -- 172.21.15.2:0/2026730970 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f577000b7f0 con 0x7f57881440f0 2023-11-26T07:11:35.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.512+0000 7f578c9a4700 1 --2- 172.21.15.2:0/2026730970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57881440f0 0x7f57881543c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f578000b970 tx=0x7f578000bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:35.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.512+0000 7f5784ff9700 1 -- 172.21.15.2:0/2026730970 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578000d860 con 0x7f57881440f0 2023-11-26T07:11:35.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.512+0000 7f5784ff9700 1 -- 172.21.15.2:0/2026730970 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578000d9c0 con 0x7f57881440f0 2023-11-26T07:11:35.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.512+0000 7f578e407700 1 -- 172.21.15.2:0/2026730970 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57881551e0 con 0x7f57881440f0 2023-11-26T07:11:35.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.512+0000 7f5784ff9700 1 -- 172.21.15.2:0/2026730970 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578000dd70 con 0x7f57881440f0 2023-11-26T07:11:35.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.513+0000 7f578e407700 1 -- 172.21.15.2:0/2026730970 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5788154900 con 0x7f57881440f0 2023-11-26T07:11:35.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.513+0000 7f578e407700 1 -- 172.21.15.2:0/2026730970 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57881559a0 con 0x7f57881440f0 2023-11-26T07:11:35.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.514+0000 7f5784ff9700 1 -- 172.21.15.2:0/2026730970 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f578000e430 con 0x7f57881440f0 2023-11-26T07:11:35.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.514+0000 7f5784ff9700 1 --2- 172.21.15.2:0/2026730970 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f576806aed0 0x7f576806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:35.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.514+0000 7f5784ff9700 1 -- 172.21.15.2:0/2026730970 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5780089780 con 0x7f57881440f0 2023-11-26T07:11:35.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.514+0000 7f5787fff700 1 --2- 172.21.15.2:0/2026730970 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f576806aed0 0x7f576806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:35.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.515+0000 7f5787fff700 1 --2- 172.21.15.2:0/2026730970 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f576806aed0 0x7f576806d390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f577800ab60 tx=0x7f5778008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:35.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.519+0000 7f5784ff9700 1 -- 172.21.15.2:0/2026730970 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5780054790 con 0x7f57881440f0 2023-11-26T07:11:35.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:35.769+0000 7f578e407700 1 -- 172.21.15.2:0/2026730970 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5788144830 con 0x7f57881440f0 2023-11-26T07:11:36.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.646+0000 7f5784ff9700 1 -- 172.21.15.2:0/2026730970 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f578000ded0 con 0x7f57881440f0 2023-11-26T07:11:36.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.650+0000 7f578e407700 1 -- 172.21.15.2:0/2026730970 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f576806aed0 msgr2=0x7f576806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:36.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.650+0000 7f578e407700 1 --2- 172.21.15.2:0/2026730970 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f576806aed0 0x7f576806d390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f577800ab60 tx=0x7f5778008040 comp rx=0 tx=0).stop 2023-11-26T07:11:36.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.650+0000 7f578e407700 1 -- 172.21.15.2:0/2026730970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57881440f0 msgr2=0x7f57881543c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:36.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.650+0000 7f578e407700 1 --2- 172.21.15.2:0/2026730970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57881440f0 0x7f57881543c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f578000b970 tx=0x7f578000bc80 comp rx=0 tx=0).stop 2023-11-26T07:11:36.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.650+0000 7f578e407700 1 -- 172.21.15.2:0/2026730970 shutdown_connections 2023-11-26T07:11:36.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.650+0000 7f578e407700 1 --2- 172.21.15.2:0/2026730970 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f576806aed0 0x7f576806d390 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:36.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.650+0000 7f578e407700 1 --2- 172.21.15.2:0/2026730970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57881440f0 0x7f57881543c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:36.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.650+0000 7f578e407700 1 --2- 172.21.15.2:0/2026730970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57880720f0 0x7f57881f3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:36.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.650+0000 7f578e407700 1 --2- 172.21.15.2:0/2026730970 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5788143ae0 0x7f5788153e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:36.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.650+0000 7f578e407700 1 -- 172.21.15.2:0/2026730970 >> 172.21.15.2:0/2026730970 conn(0x7f57880b2740 msgr2=0x7f578815a080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:36.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.650+0000 7f578e407700 1 -- 172.21.15.2:0/2026730970 shutdown_connections 2023-11-26T07:11:36.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.650+0000 7f578e407700 1 -- 172.21.15.2:0/2026730970 wait complete. 2023-11-26T07:11:36.668 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-26T07:11:36.668 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-26T07:11:36.759 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:11:36.762 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:11:36.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.801+0000 7fe4d9fa0700 1 Processor -- start 2023-11-26T07:11:36.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.801+0000 7fe4d9fa0700 1 -- start start 2023-11-26T07:11:36.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.802+0000 7fe4d9fa0700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe4d406b6e0 0x7fe4d40d0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:36.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.802+0000 7fe4d9fa0700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4d40cf5f0 con 0x7fe4d41459a0 2023-11-26T07:11:36.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.802+0000 7fe4d9fa0700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4d406ea80 con 0x7fe4d4142810 2023-11-26T07:11:36.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.802+0000 7fe4d9fa0700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4d406ed60 con 0x7fe4d406b6e0 2023-11-26T07:11:36.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.802+0000 7fe4d2ffd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe4d41459a0 0x7fe4d40cfa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58286/0 (socket says 172.21.15.2:58286) 2023-11-26T07:11:36.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.802+0000 7fe4d2ffd700 1 -- 172.21.15.2:0/2826789481 learned_addr learned my addr 172.21.15.2:0/2826789481 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:11:36.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.802+0000 7fe4d3fff700 1 --2- 172.21.15.2:0/2826789481 >> v2:172.21.15.192:3300/0 conn(0x7fe4d406b6e0 0x7fe4d40d0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:36.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.802+0000 7fe4d27fc700 1 -- 172.21.15.2:0/2826789481 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4021740116 0 0) 0x7fe4d40cf5f0 con 0x7fe4d41459a0 2023-11-26T07:11:36.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.802+0000 7fe4d27fc700 1 -- 172.21.15.2:0/2826789481 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4bc0035b0 con 0x7fe4d41459a0 2023-11-26T07:11:36.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.803+0000 7fe4d27fc700 1 -- 172.21.15.2:0/2826789481 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1460364830 0 0) 0x7fe4d406ea80 con 0x7fe4d4142810 2023-11-26T07:11:36.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.803+0000 7fe4d27fc700 1 -- 172.21.15.2:0/2826789481 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4d40cf5f0 con 0x7fe4d4142810 2023-11-26T07:11:36.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.803+0000 7fe4d27fc700 1 -- 172.21.15.2:0/2826789481 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2314007198 0 0) 0x7fe4bc0035b0 con 0x7fe4d41459a0 2023-11-26T07:11:36.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.803+0000 7fe4d27fc700 1 -- 172.21.15.2:0/2826789481 >> v2:172.21.15.192:3300/0 conn(0x7fe4d406b6e0 msgr2=0x7fe4d40d0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:36.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.803+0000 7fe4d27fc700 1 --2- 172.21.15.2:0/2826789481 >> v2:172.21.15.192:3300/0 conn(0x7fe4d406b6e0 0x7fe4d40d0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:36.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.803+0000 7fe4d27fc700 1 -- 172.21.15.2:0/2826789481 >> v1:172.21.15.192:6789/0 conn(0x7fe4d4142810 legacy=0x7fe4d406afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:36.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.803+0000 7fe4d27fc700 1 -- 172.21.15.2:0/2826789481 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d406f040 con 0x7fe4d41459a0 2023-11-26T07:11:36.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.803+0000 7fe4d27fc700 1 -- 172.21.15.2:0/2826789481 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7fe4c8001670 con 0x7fe4d41459a0 2023-11-26T07:11:36.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.803+0000 7fe4d27fc700 1 -- 172.21.15.2:0/2826789481 >> v1:172.21.15.2:6789/0 conn(0x7fe4d41459a0 legacy=0x7fe4d40cfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:36.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.803+0000 7fe4d27fc700 1 --2- 172.21.15.2:0/2826789481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4bc003b90 0x7fe4bc003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:36.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.803+0000 7fe4d27fc700 1 --2- 172.21.15.2:0/2826789481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4bc004850 0x7fe4bc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:36.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.803+0000 7fe4d27fc700 1 --2- 172.21.15.2:0/2826789481 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe4bc005210 0x7fe4bc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:36.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.803+0000 7fe4d27fc700 1 -- 172.21.15.2:0/2826789481 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d406ed60 con 0x7fe4bc004850 2023-11-26T07:11:36.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.803+0000 7fe4d27fc700 1 -- 172.21.15.2:0/2826789481 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4bc00c140 con 0x7fe4bc003b90 2023-11-26T07:11:36.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.803+0000 7fe4d27fc700 1 -- 172.21.15.2:0/2826789481 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4bc00c300 con 0x7fe4bc005210 2023-11-26T07:11:36.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.803+0000 7fe4d2ffd700 1 --2- 172.21.15.2:0/2826789481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4bc004850 0x7fe4bc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:36.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.803+0000 7fe4d37fe700 1 --2- 172.21.15.2:0/2826789481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4bc003b90 0x7fe4bc003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:36.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.803+0000 7fe4d3fff700 1 --2- 172.21.15.2:0/2826789481 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe4bc005210 0x7fe4bc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:36.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.803+0000 7fe4d2ffd700 1 -- 172.21.15.2:0/2826789481 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe4bc005210 msgr2=0x7fe4bc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:36.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.803+0000 7fe4d2ffd700 1 --2- 172.21.15.2:0/2826789481 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe4bc005210 0x7fe4bc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:36.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.803+0000 7fe4d2ffd700 1 -- 172.21.15.2:0/2826789481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4bc003b90 msgr2=0x7fe4bc003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:36.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.803+0000 7fe4d2ffd700 1 --2- 172.21.15.2:0/2826789481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4bc003b90 0x7fe4bc003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:36.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.803+0000 7fe4d2ffd700 1 -- 172.21.15.2:0/2826789481 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4bc0035b0 con 0x7fe4bc004850 2023-11-26T07:11:36.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.803+0000 7fe4d3fff700 1 -- 172.21.15.2:0/2826789481 reap_dead start 2023-11-26T07:11:36.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.803+0000 7fe4d2ffd700 1 --2- 172.21.15.2:0/2826789481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4bc004850 0x7fe4bc004cd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe4c800c210 tx=0x7fe4bc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3642c3ed598fe61c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:36.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.803+0000 7fe4d27fc700 1 -- 172.21.15.2:0/2826789481 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c800cd50 con 0x7fe4bc004850 2023-11-26T07:11:36.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.804+0000 7fe4d27fc700 1 -- 172.21.15.2:0/2826789481 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c8005960 con 0x7fe4bc004850 2023-11-26T07:11:36.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.804+0000 7fe4d27fc700 1 -- 172.21.15.2:0/2826789481 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c8005d10 con 0x7fe4bc004850 2023-11-26T07:11:36.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.804+0000 7fe4d9fa0700 1 -- 172.21.15.2:0/2826789481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4bc004850 msgr2=0x7fe4bc004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:36.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.804+0000 7fe4d9fa0700 1 --2- 172.21.15.2:0/2826789481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4bc004850 0x7fe4bc004cd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe4c800c210 tx=0x7fe4bc005880 comp rx=0 tx=0).stop 2023-11-26T07:11:36.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.804+0000 7fe4d9fa0700 1 -- 172.21.15.2:0/2826789481 shutdown_connections 2023-11-26T07:11:36.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.804+0000 7fe4d9fa0700 1 --2- 172.21.15.2:0/2826789481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4bc004850 0x7fe4bc004cd0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:36.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.804+0000 7fe4d9fa0700 1 -- 172.21.15.2:0/2826789481 >> 172.21.15.2:0/2826789481 conn(0x7fe4d40b2740 msgr2=0x7fe4d40b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:36.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.804+0000 7fe4d9fa0700 1 -- 172.21.15.2:0/2826789481 shutdown_connections 2023-11-26T07:11:36.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.804+0000 7fe4d9fa0700 1 -- 172.21.15.2:0/2826789481 wait complete. 2023-11-26T07:11:36.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.806+0000 7fe4d9fa0700 1 Processor -- start 2023-11-26T07:11:36.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.806+0000 7fe4d9fa0700 1 -- start start 2023-11-26T07:11:36.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.806+0000 7fe4d9fa0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe4bc004850 0x7fe4d413e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:36.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.806+0000 7fe4d9fa0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4d415b170 0x7fe4d415b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:36.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.807+0000 7fe4d9fa0700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4d415eec0 0x7fe4d415f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:36.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.807+0000 7fe4d9fa0700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d415bb10 con 0x7fe4d415b170 2023-11-26T07:11:36.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.807+0000 7fe4d9fa0700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d415f880 con 0x7fe4d415eec0 2023-11-26T07:11:36.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.807+0000 7fe4d9fa0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d415d730 con 0x7fe4bc004850 2023-11-26T07:11:36.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.807+0000 7fe4d2ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4d415b170 0x7fe4d415b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:36.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.807+0000 7fe4d2ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4d415b170 0x7fe4d415b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38856/0 (socket says 172.21.15.2:38856) 2023-11-26T07:11:36.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.807+0000 7fe4d2ffd700 1 -- 172.21.15.2:0/647938330 learned_addr learned my addr 172.21.15.2:0/647938330 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:36.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.807+0000 7fe4d37fe700 1 --2- 172.21.15.2:0/647938330 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe4bc004850 0x7fe4d413e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:36.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.807+0000 7fe4d3fff700 1 --2- 172.21.15.2:0/647938330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4d415eec0 0x7fe4d415f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:36.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.807+0000 7fe4d2ffd700 1 -- 172.21.15.2:0/647938330 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe4bc004850 msgr2=0x7fe4d413e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:36.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.807+0000 7fe4d2ffd700 1 --2- 172.21.15.2:0/647938330 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe4bc004850 0x7fe4d413e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:36.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.807+0000 7fe4d2ffd700 1 -- 172.21.15.2:0/647938330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4d415eec0 msgr2=0x7fe4d415f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:36.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.807+0000 7fe4d2ffd700 1 --2- 172.21.15.2:0/647938330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4d415eec0 0x7fe4d415f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:36.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.807+0000 7fe4d2ffd700 1 -- 172.21.15.2:0/647938330 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d415da10 con 0x7fe4d415b170 2023-11-26T07:11:36.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.807+0000 7fe4d3fff700 1 --2- 172.21.15.2:0/647938330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4d415eec0 0x7fe4d415f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:11:36.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.807+0000 7fe4d2ffd700 1 --2- 172.21.15.2:0/647938330 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4d415b170 0x7fe4d415b5d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe4c800c800 tx=0x7fe4c8001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:36.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.807+0000 7fe4bbfff700 1 -- 172.21.15.2:0/647938330 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c8004870 con 0x7fe4d415b170 2023-11-26T07:11:36.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.807+0000 7fe4bbfff700 1 -- 172.21.15.2:0/647938330 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c80049d0 con 0x7fe4d415b170 2023-11-26T07:11:36.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.807+0000 7fe4d9fa0700 1 -- 172.21.15.2:0/647938330 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4d415dcf0 con 0x7fe4d415b170 2023-11-26T07:11:36.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.807+0000 7fe4bbfff700 1 -- 172.21.15.2:0/647938330 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c8004d80 con 0x7fe4d415b170 2023-11-26T07:11:36.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.807+0000 7fe4d9fa0700 1 -- 172.21.15.2:0/647938330 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4d415e2b0 con 0x7fe4d415b170 2023-11-26T07:11:36.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.808+0000 7fe4d9fa0700 1 -- 172.21.15.2:0/647938330 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4d415e440 con 0x7fe4d415b170 2023-11-26T07:11:36.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.809+0000 7fe4bbfff700 1 -- 172.21.15.2:0/647938330 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe4c80070d0 con 0x7fe4d415b170 2023-11-26T07:11:36.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.809+0000 7fe4bbfff700 1 --2- 172.21.15.2:0/647938330 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe4c006aed0 0x7fe4c006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:36.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.809+0000 7fe4bbfff700 1 -- 172.21.15.2:0/647938330 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe4c8089fa0 con 0x7fe4d415b170 2023-11-26T07:11:36.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.809+0000 7fe4d37fe700 1 --2- 172.21.15.2:0/647938330 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe4c006aed0 0x7fe4c006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:36.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.810+0000 7fe4d37fe700 1 --2- 172.21.15.2:0/647938330 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe4c006aed0 0x7fe4c006d390 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc012460 tx=0x7fe4cc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:36.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:36.814+0000 7fe4bbfff700 1 -- 172.21.15.2:0/647938330 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe4c80bce90 con 0x7fe4d415b170 2023-11-26T07:11:37.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.065+0000 7fe4d9fa0700 1 -- 172.21.15.2:0/647938330 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe4d4075480 con 0x7fe4d415b170 2023-11-26T07:11:37.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.647+0000 7fe4bbfff700 1 -- 172.21.15.2:0/647938330 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe4c80550e0 con 0x7fe4d415b170 2023-11-26T07:11:37.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.650+0000 7fe4d9fa0700 1 -- 172.21.15.2:0/647938330 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe4c006aed0 msgr2=0x7fe4c006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:37.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.650+0000 7fe4d9fa0700 1 --2- 172.21.15.2:0/647938330 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe4c006aed0 0x7fe4c006d390 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc012460 tx=0x7fe4cc009040 comp rx=0 tx=0).stop 2023-11-26T07:11:37.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.650+0000 7fe4d9fa0700 1 -- 172.21.15.2:0/647938330 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4d415b170 msgr2=0x7fe4d415b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:37.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.650+0000 7fe4d9fa0700 1 --2- 172.21.15.2:0/647938330 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4d415b170 0x7fe4d415b5d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe4c800c800 tx=0x7fe4c8001980 comp rx=0 tx=0).stop 2023-11-26T07:11:37.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.650+0000 7fe4d9fa0700 1 -- 172.21.15.2:0/647938330 shutdown_connections 2023-11-26T07:11:37.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.650+0000 7fe4d9fa0700 1 --2- 172.21.15.2:0/647938330 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe4c006aed0 0x7fe4c006d390 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:37.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.650+0000 7fe4d9fa0700 1 --2- 172.21.15.2:0/647938330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4d415eec0 0x7fe4d415f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:37.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.650+0000 7fe4d9fa0700 1 --2- 172.21.15.2:0/647938330 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe4bc004850 0x7fe4d413e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:37.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.650+0000 7fe4d9fa0700 1 --2- 172.21.15.2:0/647938330 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4d415b170 0x7fe4d415b5d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:37.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.650+0000 7fe4d9fa0700 1 -- 172.21.15.2:0/647938330 >> 172.21.15.2:0/647938330 conn(0x7fe4d40b2740 msgr2=0x7fe4d4141160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:37.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.651+0000 7fe4d9fa0700 1 -- 172.21.15.2:0/647938330 shutdown_connections 2023-11-26T07:11:37.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.651+0000 7fe4d9fa0700 1 -- 172.21.15.2:0/647938330 wait complete. 2023-11-26T07:11:37.668 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-26T07:11:37.668 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:11:37.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.840+0000 7f1b40d93700 1 Processor -- start 2023-11-26T07:11:37.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.840+0000 7f1b40d93700 1 -- start start 2023-11-26T07:11:37.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.842+0000 7f1b40d93700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1b3c0b03b0 0x7f1b3c0b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:37.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.842+0000 7f1b40d93700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1b3c0adda0 0x7f1b3c06b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:37.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.842+0000 7f1b40d93700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b3c0b0ec0 con 0x7f1b3c15ae00 2023-11-26T07:11:37.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.842+0000 7f1b40d93700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b3c073610 con 0x7f1b3c0b03b0 2023-11-26T07:11:37.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.842+0000 7f1b40d93700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c15b1e0 con 0x7f1b3c0adda0 2023-11-26T07:11:37.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.842+0000 7f1b3ad9d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1b3c0adda0 0x7f1b3c06b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:37.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.842+0000 7f1b39d9b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1b3c0b03b0 0x7f1b3c0b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:37.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.842+0000 7f1b3a59c700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f1b3c15ae00 0x7f1b3c0ad690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.2:37442/0 (socket says 172.21.15.2:37442) 2023-11-26T07:11:37.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.842+0000 7f1b3ad9d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1b3c0adda0 0x7f1b3c06b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.2:36946/0 (socket says 172.21.15.2:36946) 2023-11-26T07:11:37.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.842+0000 7f1b3a59c700 1 -- 172.21.15.2:0/2315728747 learned_addr learned my addr 172.21.15.2:0/2315728747 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:11:37.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.842+0000 7f1b39d9b700 1 -- 172.21.15.2:0/2315728747 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1b3c0adda0 msgr2=0x7f1b3c06b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:37.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.842+0000 7f1b39d9b700 1 --2- 172.21.15.2:0/2315728747 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1b3c0adda0 0x7f1b3c06b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:37.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.842+0000 7f1b39d9b700 1 -- 172.21.15.2:0/2315728747 >> v1:172.21.15.192:6789/0 conn(0x7f1b3c15ae00 legacy=0x7f1b3c0ad690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:37.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.843+0000 7f1b39d9b700 1 -- 172.21.15.2:0/2315728747 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b3c0b0900 con 0x7f1b3c0b03b0 2023-11-26T07:11:37.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.842+0000 7f1b3959a700 1 -- 172.21.15.2:0/2315728747 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 963116591 0 0) 0x7f1b3c0b0ec0 con 0x7f1b3c15ae00 2023-11-26T07:11:37.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.843+0000 7f1b39d9b700 1 --2- 172.21.15.2:0/2315728747 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b3c0b03b0 0x7f1b3c0b5e40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1b24009840 tx=0x7f1b24009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0ca281bccf952c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:37.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.843+0000 7f1b3959a700 1 -- 172.21.15.2:0/2315728747 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b24011830 con 0x7f1b3c0b03b0 2023-11-26T07:11:37.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.843+0000 7f1b3959a700 1 -- 172.21.15.2:0/2315728747 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b24011990 con 0x7f1b3c0b03b0 2023-11-26T07:11:37.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.843+0000 7f1b3959a700 1 -- 172.21.15.2:0/2315728747 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b24011d20 con 0x7f1b3c0b03b0 2023-11-26T07:11:37.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.843+0000 7f1b40d93700 1 -- 172.21.15.2:0/2315728747 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b3c0b03b0 msgr2=0x7f1b3c0b5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:37.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.843+0000 7f1b40d93700 1 --2- 172.21.15.2:0/2315728747 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b3c0b03b0 0x7f1b3c0b5e40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1b24009840 tx=0x7f1b24009b50 comp rx=0 tx=0).stop 2023-11-26T07:11:37.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.843+0000 7f1b40d93700 1 -- 172.21.15.2:0/2315728747 shutdown_connections 2023-11-26T07:11:37.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.843+0000 7f1b40d93700 1 --2- 172.21.15.2:0/2315728747 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1b3c0adda0 0x7f1b3c06b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:37.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.843+0000 7f1b40d93700 1 --2- 172.21.15.2:0/2315728747 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b3c0b03b0 0x7f1b3c0b5e40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:37.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.843+0000 7f1b40d93700 1 -- 172.21.15.2:0/2315728747 >> 172.21.15.2:0/2315728747 conn(0x7f1b3c0b5070 msgr2=0x7f1b3c0b5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:37.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.844+0000 7f1b40d93700 1 -- 172.21.15.2:0/2315728747 shutdown_connections 2023-11-26T07:11:37.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.844+0000 7f1b40d93700 1 -- 172.21.15.2:0/2315728747 wait complete. 2023-11-26T07:11:37.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.845+0000 7f1b40d93700 1 Processor -- start 2023-11-26T07:11:37.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.845+0000 7f1b40d93700 1 -- start start 2023-11-26T07:11:37.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.846+0000 7f1b40d93700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b3c0adda0 0x7f1b3c1f3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:37.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.846+0000 7f1b40d93700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1b3c0b03b0 0x7f1b3c15b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:37.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.846+0000 7f1b40d93700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b3c15ae00 0x7f1b3c1558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:37.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.846+0000 7f1b40d93700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c15c8a0 con 0x7f1b3c15ae00 2023-11-26T07:11:37.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.846+0000 7f1b40d93700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c15bc90 con 0x7f1b3c0adda0 2023-11-26T07:11:37.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.846+0000 7f1b40d93700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c15bf70 con 0x7f1b3c0b03b0 2023-11-26T07:11:37.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.846+0000 7f1b3ad9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b3c15ae00 0x7f1b3c1558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:37.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.846+0000 7f1b3ad9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b3c15ae00 0x7f1b3c1558d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38872/0 (socket says 172.21.15.2:38872) 2023-11-26T07:11:37.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.846+0000 7f1b3ad9d700 1 -- 172.21.15.2:0/1415526208 learned_addr learned my addr 172.21.15.2:0/1415526208 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:37.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.846+0000 7f1b3a59c700 1 --2- 172.21.15.2:0/1415526208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b3c0adda0 0x7f1b3c1f3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:37.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.846+0000 7f1b39d9b700 1 --2- 172.21.15.2:0/1415526208 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1b3c0b03b0 0x7f1b3c15b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:37.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.846+0000 7f1b3ad9d700 1 -- 172.21.15.2:0/1415526208 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1b3c0b03b0 msgr2=0x7f1b3c15b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:37.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.846+0000 7f1b3ad9d700 1 --2- 172.21.15.2:0/1415526208 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1b3c0b03b0 0x7f1b3c15b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:37.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.846+0000 7f1b3ad9d700 1 -- 172.21.15.2:0/1415526208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b3c0adda0 msgr2=0x7f1b3c1f3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:37.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.846+0000 7f1b3ad9d700 1 --2- 172.21.15.2:0/1415526208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b3c0adda0 0x7f1b3c1f3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:37.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.846+0000 7f1b3ad9d700 1 -- 172.21.15.2:0/1415526208 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b240094a0 con 0x7f1b3c15ae00 2023-11-26T07:11:37.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.846+0000 7f1b3ad9d700 1 --2- 172.21.15.2:0/1415526208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b3c15ae00 0x7f1b3c1558d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1b3400efc0 tx=0x7f1b3400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:37.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.846+0000 7f1b32ffd700 1 -- 172.21.15.2:0/1415526208 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b34009ea0 con 0x7f1b3c15ae00 2023-11-26T07:11:37.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.847+0000 7f1b32ffd700 1 -- 172.21.15.2:0/1415526208 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b3400f040 con 0x7f1b3c15ae00 2023-11-26T07:11:37.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.847+0000 7f1b40d93700 1 -- 172.21.15.2:0/1415526208 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b3c15c250 con 0x7f1b3c15ae00 2023-11-26T07:11:37.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.847+0000 7f1b32ffd700 1 -- 172.21.15.2:0/1415526208 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3400ced0 con 0x7f1b3c15ae00 2023-11-26T07:11:37.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.847+0000 7f1b40d93700 1 -- 172.21.15.2:0/1415526208 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b3c15b860 con 0x7f1b3c15ae00 2023-11-26T07:11:37.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.848+0000 7f1b40d93700 1 -- 172.21.15.2:0/1415526208 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b3c15ba50 con 0x7f1b3c15ae00 2023-11-26T07:11:37.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.848+0000 7f1b32ffd700 1 -- 172.21.15.2:0/1415526208 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1b34014480 con 0x7f1b3c15ae00 2023-11-26T07:11:37.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.849+0000 7f1b32ffd700 1 --2- 172.21.15.2:0/1415526208 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f1b1c06aed0 0x7f1b1c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:37.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.849+0000 7f1b32ffd700 1 -- 172.21.15.2:0/1415526208 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b34089ed0 con 0x7f1b3c15ae00 2023-11-26T07:11:37.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.849+0000 7f1b3a59c700 1 --2- 172.21.15.2:0/1415526208 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f1b1c06aed0 0x7f1b1c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:37.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.849+0000 7f1b3a59c700 1 --2- 172.21.15.2:0/1415526208 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f1b1c06aed0 0x7f1b1c06d390 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c000f60 tx=0x7f1b2c007e70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:37.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:37.853+0000 7f1b32ffd700 1 -- 172.21.15.2:0/1415526208 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1b3c15ba50 con 0x7f1b3c15ae00 2023-11-26T07:11:38.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.096+0000 7f1b40d93700 1 -- 172.21.15.2:0/1415526208 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b3c1586e0 con 0x7f1b3c15ae00 2023-11-26T07:11:38.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.097+0000 7f1b32ffd700 1 -- 172.21.15.2:0/1415526208 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7f1b3c1586e0 con 0x7f1b3c15ae00 2023-11-26T07:11:38.100 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:11:38.100 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/3693634219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3693634219},{"type":"v1","addr":"172.21.15.2:6834","nonce":3693634219}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/953933423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":953933423},{"type":"v1","addr":"172.21.15.2:6835","nonce":953933423}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1000951065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1000951065},{"type":"v1","addr":"172.21.15.192:6836","nonce":1000951065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:11:34.051331+0000","modified":"2023-11-26T07:11:37.067662+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/4032661989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4032661989},{"type":"v1","addr":"172.21.15.192:6837","nonce":4032661989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-26T07:11:38.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.099+0000 7f1b40d93700 1 -- 172.21.15.2:0/1415526208 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f1b1c06aed0 msgr2=0x7f1b1c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:38.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.099+0000 7f1b40d93700 1 --2- 172.21.15.2:0/1415526208 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f1b1c06aed0 0x7f1b1c06d390 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c000f60 tx=0x7f1b2c007e70 comp rx=0 tx=0).stop 2023-11-26T07:11:38.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.099+0000 7f1b40d93700 1 -- 172.21.15.2:0/1415526208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b3c15ae00 msgr2=0x7f1b3c1558d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:38.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.099+0000 7f1b40d93700 1 --2- 172.21.15.2:0/1415526208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b3c15ae00 0x7f1b3c1558d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1b3400efc0 tx=0x7f1b3400c3a0 comp rx=0 tx=0).stop 2023-11-26T07:11:38.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.099+0000 7f1b40d93700 1 -- 172.21.15.2:0/1415526208 shutdown_connections 2023-11-26T07:11:38.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.099+0000 7f1b40d93700 1 --2- 172.21.15.2:0/1415526208 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f1b1c06aed0 0x7f1b1c06d390 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:38.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.099+0000 7f1b40d93700 1 --2- 172.21.15.2:0/1415526208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b3c15ae00 0x7f1b3c1558d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:38.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.099+0000 7f1b40d93700 1 --2- 172.21.15.2:0/1415526208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b3c0adda0 0x7f1b3c1f3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:38.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.099+0000 7f1b40d93700 1 --2- 172.21.15.2:0/1415526208 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1b3c0b03b0 0x7f1b3c15b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:38.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.099+0000 7f1b40d93700 1 -- 172.21.15.2:0/1415526208 >> 172.21.15.2:0/1415526208 conn(0x7f1b3c0b5070 msgr2=0x7f1b3c0b2370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:38.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.099+0000 7f1b40d93700 1 -- 172.21.15.2:0/1415526208 shutdown_connections 2023-11-26T07:11:38.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.099+0000 7f1b40d93700 1 -- 172.21.15.2:0/1415526208 wait complete. 2023-11-26T07:11:38.103 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 8 2023-11-26T07:11:38.114 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:11:38.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.235+0000 7f8ea86b8700 1 Processor -- start 2023-11-26T07:11:38.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.235+0000 7f8ea86b8700 1 -- start start 2023-11-26T07:11:38.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.236+0000 7f8ea86b8700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8ea015e1c0 0x7f8ea006eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:38.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.236+0000 7f8ea86b8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ea00b0e90 0x7f8ea006f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:38.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.236+0000 7f8ea86b8700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8ea006fa80 0x7f8ea0161d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:38.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.236+0000 7f8ea86b8700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea006ff10 con 0x7f8ea006fa80 2023-11-26T07:11:38.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.236+0000 7f8ea86b8700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea00d1230 con 0x7f8ea015e1c0 2023-11-26T07:11:38.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.236+0000 7f8ea86b8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea00d0c70 con 0x7f8ea00b0e90 2023-11-26T07:11:38.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.236+0000 7f8ea6c55700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8ea006fa80 0x7f8ea0161d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:38.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.236+0000 7f8ea6c55700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8ea006fa80 0x7f8ea0161d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38878/0 (socket says 172.21.15.2:38878) 2023-11-26T07:11:38.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.236+0000 7f8ea6c55700 1 -- 172.21.15.2:0/3607312554 learned_addr learned my addr 172.21.15.2:0/3607312554 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:38.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.236+0000 7f8ea5c53700 1 --2- 172.21.15.2:0/3607312554 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ea00b0e90 0x7f8ea006f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:38.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.236+0000 7f8ea6454700 1 --2- 172.21.15.2:0/3607312554 >> v2:172.21.15.192:3300/0 conn(0x7f8ea015e1c0 0x7f8ea006eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:38.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.236+0000 7f8ea6c55700 1 -- 172.21.15.2:0/3607312554 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ea00b0e90 msgr2=0x7f8ea006f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:38.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.236+0000 7f8ea6c55700 1 --2- 172.21.15.2:0/3607312554 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ea00b0e90 0x7f8ea006f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:38.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.236+0000 7f8ea6c55700 1 -- 172.21.15.2:0/3607312554 >> v2:172.21.15.192:3300/0 conn(0x7f8ea015e1c0 msgr2=0x7f8ea006eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:38.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.236+0000 7f8ea6c55700 1 --2- 172.21.15.2:0/3607312554 >> v2:172.21.15.192:3300/0 conn(0x7f8ea015e1c0 0x7f8ea006eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:38.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.236+0000 7f8ea6c55700 1 -- 172.21.15.2:0/3607312554 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea00d0f50 con 0x7f8ea006fa80 2023-11-26T07:11:38.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.237+0000 7f8ea6c55700 1 --2- 172.21.15.2:0/3607312554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ea006fa80 0x7f8ea0161d90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0071990 tx=0x7f8e9800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ad367548efccb27 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:38.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.237+0000 7f8ea5452700 1 -- 172.21.15.2:0/3607312554 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9800e070 con 0x7f8ea006fa80 2023-11-26T07:11:38.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.237+0000 7f8ea5452700 1 -- 172.21.15.2:0/3607312554 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9800b910 con 0x7f8ea006fa80 2023-11-26T07:11:38.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.237+0000 7f8ea5452700 1 -- 172.21.15.2:0/3607312554 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9800bcc0 con 0x7f8ea006fa80 2023-11-26T07:11:38.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.237+0000 7f8ea86b8700 1 -- 172.21.15.2:0/3607312554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ea006fa80 msgr2=0x7f8ea0161d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:38.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.237+0000 7f8ea86b8700 1 --2- 172.21.15.2:0/3607312554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ea006fa80 0x7f8ea0161d90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0071990 tx=0x7f8e9800b330 comp rx=0 tx=0).stop 2023-11-26T07:11:38.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.237+0000 7f8ea86b8700 1 -- 172.21.15.2:0/3607312554 shutdown_connections 2023-11-26T07:11:38.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.237+0000 7f8ea86b8700 1 --2- 172.21.15.2:0/3607312554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ea006fa80 0x7f8ea0161d90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:38.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.237+0000 7f8ea86b8700 1 --2- 172.21.15.2:0/3607312554 >> v2:172.21.15.192:3300/0 conn(0x7f8ea015e1c0 0x7f8ea006eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:38.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.237+0000 7f8ea86b8700 1 --2- 172.21.15.2:0/3607312554 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ea00b0e90 0x7f8ea006f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:38.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.237+0000 7f8ea86b8700 1 -- 172.21.15.2:0/3607312554 >> 172.21.15.2:0/3607312554 conn(0x7f8ea00b3720 msgr2=0x7f8ea00b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:38.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.238+0000 7f8ea86b8700 1 -- 172.21.15.2:0/3607312554 shutdown_connections 2023-11-26T07:11:38.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.238+0000 7f8ea86b8700 1 -- 172.21.15.2:0/3607312554 wait complete. 2023-11-26T07:11:38.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.239+0000 7f8ea86b8700 1 Processor -- start 2023-11-26T07:11:38.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.239+0000 7f8ea86b8700 1 -- start start 2023-11-26T07:11:38.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.239+0000 7f8ea86b8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ea006fa80 0x7f8ea00c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:38.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.239+0000 7f8ea86b8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ea00b0e90 0x7f8ea01f2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:38.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.239+0000 7f8ea86b8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ea015e1c0 0x7f8ea01f33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:38.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.239+0000 7f8ea86b8700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea01f38f0 con 0x7f8ea006fa80 2023-11-26T07:11:38.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.239+0000 7f8ea86b8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea01610c0 con 0x7f8ea00b0e90 2023-11-26T07:11:38.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.239+0000 7f8ea86b8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea014da70 con 0x7f8ea015e1c0 2023-11-26T07:11:38.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.240+0000 7f8ea6454700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ea006fa80 0x7f8ea00c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:38.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.240+0000 7f8ea6454700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ea006fa80 0x7f8ea00c8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38880/0 (socket says 172.21.15.2:38880) 2023-11-26T07:11:38.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.240+0000 7f8ea6454700 1 -- 172.21.15.2:0/316637543 learned_addr learned my addr 172.21.15.2:0/316637543 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:38.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.240+0000 7f8ea5c53700 1 --2- 172.21.15.2:0/316637543 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ea00b0e90 0x7f8ea01f2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:38.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.240+0000 7f8ea6c55700 1 --2- 172.21.15.2:0/316637543 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ea015e1c0 0x7f8ea01f33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:38.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.240+0000 7f8ea6454700 1 -- 172.21.15.2:0/316637543 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ea015e1c0 msgr2=0x7f8ea01f33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:38.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.240+0000 7f8ea6454700 1 --2- 172.21.15.2:0/316637543 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ea015e1c0 0x7f8ea01f33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:38.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.240+0000 7f8ea6454700 1 -- 172.21.15.2:0/316637543 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ea00b0e90 msgr2=0x7f8ea01f2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:38.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.240+0000 7f8ea6454700 1 --2- 172.21.15.2:0/316637543 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ea00b0e90 0x7f8ea01f2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:38.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.240+0000 7f8ea6454700 1 -- 172.21.15.2:0/316637543 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e98009b30 con 0x7f8ea006fa80 2023-11-26T07:11:38.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.240+0000 7f8ea6454700 1 --2- 172.21.15.2:0/316637543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ea006fa80 0x7f8ea00c8f10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8e9000e870 tx=0x7f8e9000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:38.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.240+0000 7f8e96ffd700 1 -- 172.21.15.2:0/316637543 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e90009590 con 0x7f8ea006fa80 2023-11-26T07:11:38.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.240+0000 7f8e96ffd700 1 -- 172.21.15.2:0/316637543 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e90013680 con 0x7f8ea006fa80 2023-11-26T07:11:38.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.240+0000 7f8ea86b8700 1 -- 172.21.15.2:0/316637543 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea014dd50 con 0x7f8ea006fa80 2023-11-26T07:11:38.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.240+0000 7f8e96ffd700 1 -- 172.21.15.2:0/316637543 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e900139f0 con 0x7f8ea006fa80 2023-11-26T07:11:38.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.240+0000 7f8ea86b8700 1 -- 172.21.15.2:0/316637543 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea014e310 con 0x7f8ea006fa80 2023-11-26T07:11:38.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.241+0000 7f8ea86b8700 1 -- 172.21.15.2:0/316637543 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea0068670 con 0x7f8ea006fa80 2023-11-26T07:11:38.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.242+0000 7f8e96ffd700 1 -- 172.21.15.2:0/316637543 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8e90013b50 con 0x7f8ea006fa80 2023-11-26T07:11:38.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.242+0000 7f8e96ffd700 1 --2- 172.21.15.2:0/316637543 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8e8406aed0 0x7f8e8406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:38.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.242+0000 7f8e96ffd700 1 -- 172.21.15.2:0/316637543 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8e90089390 con 0x7f8ea006fa80 2023-11-26T07:11:38.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.242+0000 7f8ea5c53700 1 --2- 172.21.15.2:0/316637543 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8e8406aed0 0x7f8e8406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:38.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.243+0000 7f8ea5c53700 1 --2- 172.21.15.2:0/316637543 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8e8406aed0 0x7f8e8406d390 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8ea006e1f0 tx=0x7f8e9c009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:38.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.246+0000 7f8e96ffd700 1 -- 172.21.15.2:0/316637543 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8e90054440 con 0x7f8ea006fa80 2023-11-26T07:11:38.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.449+0000 7f8ea86b8700 1 -- 172.21.15.2:0/316637543 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ea00b4240 con 0x7f8ea006fa80 2023-11-26T07:11:38.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.450+0000 7f8e96ffd700 1 -- 172.21.15.2:0/316637543 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f8e90057a60 con 0x7f8ea006fa80 2023-11-26T07:11:38.454 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:11:38.454 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:11:35.634747+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:11:32.129474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:11:33.019837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:11:38.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.452+0000 7f8ea86b8700 1 -- 172.21.15.2:0/316637543 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8e8406aed0 msgr2=0x7f8e8406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:38.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.453+0000 7f8ea86b8700 1 --2- 172.21.15.2:0/316637543 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8e8406aed0 0x7f8e8406d390 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8ea006e1f0 tx=0x7f8e9c009210 comp rx=0 tx=0).stop 2023-11-26T07:11:38.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.453+0000 7f8ea86b8700 1 -- 172.21.15.2:0/316637543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ea006fa80 msgr2=0x7f8ea00c8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:38.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.453+0000 7f8ea86b8700 1 --2- 172.21.15.2:0/316637543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ea006fa80 0x7f8ea00c8f10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8e9000e870 tx=0x7f8e9000eb80 comp rx=0 tx=0).stop 2023-11-26T07:11:38.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.453+0000 7f8ea86b8700 1 -- 172.21.15.2:0/316637543 shutdown_connections 2023-11-26T07:11:38.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.453+0000 7f8ea86b8700 1 --2- 172.21.15.2:0/316637543 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8e8406aed0 0x7f8e8406d390 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:38.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.453+0000 7f8ea86b8700 1 --2- 172.21.15.2:0/316637543 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ea015e1c0 0x7f8ea01f33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:38.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.453+0000 7f8ea86b8700 1 --2- 172.21.15.2:0/316637543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ea006fa80 0x7f8ea00c8f10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:38.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.453+0000 7f8ea86b8700 1 --2- 172.21.15.2:0/316637543 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ea00b0e90 0x7f8ea01f2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:38.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.453+0000 7f8ea86b8700 1 -- 172.21.15.2:0/316637543 >> 172.21.15.2:0/316637543 conn(0x7f8ea00b3720 msgr2=0x7f8ea015c920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:38.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.453+0000 7f8ea86b8700 1 -- 172.21.15.2:0/316637543 shutdown_connections 2023-11-26T07:11:38.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.453+0000 7f8ea86b8700 1 -- 172.21.15.2:0/316637543 wait complete. 2023-11-26T07:11:38.468 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-26T07:11:38.468 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:11:38.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.590+0000 7f52e04bb700 1 Processor -- start 2023-11-26T07:11:38.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.590+0000 7f52e04bb700 1 -- start start 2023-11-26T07:11:38.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.591+0000 7f52e04bb700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52d81448b0 0x7f52d806ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:38.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.591+0000 7f52e04bb700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f52d806f990 0x7f52d80ce2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:38.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.591+0000 7f52e04bb700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d8144c90 con 0x7f52d80b44c0 2023-11-26T07:11:38.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.591+0000 7f52e04bb700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d80b4c80 con 0x7f52d806f990 2023-11-26T07:11:38.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.591+0000 7f52e04bb700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d80b4f60 con 0x7f52d81448b0 2023-11-26T07:11:38.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.591+0000 7f52dea58700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f52d806f990 0x7f52d80ce2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:38.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.591+0000 7f52dea58700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f52d806f990 0x7f52d80ce2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38892/0 (socket says 172.21.15.2:38892) 2023-11-26T07:11:38.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.591+0000 7f52dda56700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f52d80b44c0 0x7f52d806f280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58330/0 (socket says 172.21.15.2:58330) 2023-11-26T07:11:38.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.591+0000 7f52dea58700 1 -- 172.21.15.2:0/3957607764 learned_addr learned my addr 172.21.15.2:0/3957607764 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:38.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.591+0000 7f52de257700 1 --2- 172.21.15.2:0/3957607764 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52d81448b0 0x7f52d806ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:38.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.591+0000 7f52dea58700 1 -- 172.21.15.2:0/3957607764 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52d81448b0 msgr2=0x7f52d806ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:38.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.591+0000 7f52dea58700 1 --2- 172.21.15.2:0/3957607764 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52d81448b0 0x7f52d806ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:38.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.591+0000 7f52dea58700 1 -- 172.21.15.2:0/3957607764 >> v1:172.21.15.2:6789/0 conn(0x7f52d80b44c0 legacy=0x7f52d806f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:38.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.591+0000 7f52dea58700 1 -- 172.21.15.2:0/3957607764 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d80b5240 con 0x7f52d806f990 2023-11-26T07:11:38.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.591+0000 7f52dd255700 1 -- 172.21.15.2:0/3957607764 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3884891649 0 0) 0x7f52d8144c90 con 0x7f52d80b44c0 2023-11-26T07:11:38.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.591+0000 7f52dea58700 1 --2- 172.21.15.2:0/3957607764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d806f990 0x7f52d80ce2a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f52d000d150 tx=0x7f52d000d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ced805a8d55a8283 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:38.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.591+0000 7f52dd255700 1 -- 172.21.15.2:0/3957607764 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d0010070 con 0x7f52d806f990 2023-11-26T07:11:38.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.591+0000 7f52dd255700 1 -- 172.21.15.2:0/3957607764 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d000ddc0 con 0x7f52d806f990 2023-11-26T07:11:38.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.591+0000 7f52dd255700 1 -- 172.21.15.2:0/3957607764 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d000b310 con 0x7f52d806f990 2023-11-26T07:11:38.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.592+0000 7f52e04bb700 1 -- 172.21.15.2:0/3957607764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d806f990 msgr2=0x7f52d80ce2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:38.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.592+0000 7f52e04bb700 1 --2- 172.21.15.2:0/3957607764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d806f990 0x7f52d80ce2a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f52d000d150 tx=0x7f52d000d460 comp rx=0 tx=0).stop 2023-11-26T07:11:38.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.592+0000 7f52e04bb700 1 -- 172.21.15.2:0/3957607764 shutdown_connections 2023-11-26T07:11:38.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.592+0000 7f52e04bb700 1 --2- 172.21.15.2:0/3957607764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d806f990 0x7f52d80ce2a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:38.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.592+0000 7f52e04bb700 1 --2- 172.21.15.2:0/3957607764 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52d81448b0 0x7f52d806ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:38.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.592+0000 7f52e04bb700 1 -- 172.21.15.2:0/3957607764 >> 172.21.15.2:0/3957607764 conn(0x7f52d80d0bc0 msgr2=0x7f52d80d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:38.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.592+0000 7f52e04bb700 1 -- 172.21.15.2:0/3957607764 shutdown_connections 2023-11-26T07:11:38.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.592+0000 7f52e04bb700 1 -- 172.21.15.2:0/3957607764 wait complete. 2023-11-26T07:11:38.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.593+0000 7f52e04bb700 1 Processor -- start 2023-11-26T07:11:38.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.593+0000 7f52e04bb700 1 -- start start 2023-11-26T07:11:38.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.594+0000 7f52e04bb700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52d806f990 0x7f52d80cc740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:38.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.594+0000 7f52e04bb700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52d80b44c0 0x7f52d80d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:38.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.594+0000 7f52e04bb700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d81448b0 0x7f52d8072050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:38.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.594+0000 7f52e04bb700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d81f5920 con 0x7f52d81448b0 2023-11-26T07:11:38.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.594+0000 7f52e04bb700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d80ccc80 con 0x7f52d806f990 2023-11-26T07:11:38.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.594+0000 7f52e04bb700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d81f4ca0 con 0x7f52d80b44c0 2023-11-26T07:11:38.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.594+0000 7f52dea58700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d81448b0 0x7f52d8072050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:38.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.594+0000 7f52dea58700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d81448b0 0x7f52d8072050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38898/0 (socket says 172.21.15.2:38898) 2023-11-26T07:11:38.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.594+0000 7f52dea58700 1 -- 172.21.15.2:0/3471114695 learned_addr learned my addr 172.21.15.2:0/3471114695 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:38.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.594+0000 7f52dda56700 1 --2- 172.21.15.2:0/3471114695 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52d80b44c0 0x7f52d80d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:38.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.594+0000 7f52de257700 1 --2- 172.21.15.2:0/3471114695 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52d806f990 0x7f52d80cc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:38.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.594+0000 7f52dea58700 1 -- 172.21.15.2:0/3471114695 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52d80b44c0 msgr2=0x7f52d80d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:38.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.594+0000 7f52dea58700 1 --2- 172.21.15.2:0/3471114695 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52d80b44c0 0x7f52d80d12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:38.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.594+0000 7f52dea58700 1 -- 172.21.15.2:0/3471114695 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52d806f990 msgr2=0x7f52d80cc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:38.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.594+0000 7f52dea58700 1 --2- 172.21.15.2:0/3471114695 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52d806f990 0x7f52d80cc740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:38.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.594+0000 7f52dea58700 1 -- 172.21.15.2:0/3471114695 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d000bd40 con 0x7f52d81448b0 2023-11-26T07:11:38.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.594+0000 7f52dda56700 1 --2- 172.21.15.2:0/3471114695 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52d80b44c0 0x7f52d80d12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:11:38.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.595+0000 7f52dea58700 1 --2- 172.21.15.2:0/3471114695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d81448b0 0x7f52d8072050 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f52d80676b0 tx=0x7f52d0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:38.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.595+0000 7f52ceffd700 1 -- 172.21.15.2:0/3471114695 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d0009a10 con 0x7f52d81448b0 2023-11-26T07:11:38.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.595+0000 7f52ceffd700 1 -- 172.21.15.2:0/3471114695 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d0009b70 con 0x7f52d81448b0 2023-11-26T07:11:38.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.595+0000 7f52e04bb700 1 -- 172.21.15.2:0/3471114695 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d81f4f80 con 0x7f52d81448b0 2023-11-26T07:11:38.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.595+0000 7f52ceffd700 1 -- 172.21.15.2:0/3471114695 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d000b4c0 con 0x7f52d81448b0 2023-11-26T07:11:38.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.595+0000 7f52e04bb700 1 -- 172.21.15.2:0/3471114695 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d81f5540 con 0x7f52d81448b0 2023-11-26T07:11:38.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.596+0000 7f52e04bb700 1 -- 172.21.15.2:0/3471114695 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d81f5a60 con 0x7f52d81448b0 2023-11-26T07:11:38.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.596+0000 7f52ceffd700 1 -- 172.21.15.2:0/3471114695 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f52d0004040 con 0x7f52d81448b0 2023-11-26T07:11:38.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.596+0000 7f52ceffd700 1 --2- 172.21.15.2:0/3471114695 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f52bc06aed0 0x7f52bc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:38.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.597+0000 7f52ceffd700 1 -- 172.21.15.2:0/3471114695 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f52d008afe0 con 0x7f52d81448b0 2023-11-26T07:11:38.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.597+0000 7f52de257700 1 --2- 172.21.15.2:0/3471114695 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f52bc06aed0 0x7f52bc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:38.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.597+0000 7f52de257700 1 --2- 172.21.15.2:0/3471114695 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f52bc06aed0 0x7f52bc06d390 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f52d815e1d0 tx=0x7f52d4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:38.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.601+0000 7f52ceffd700 1 -- 172.21.15.2:0/3471114695 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f52d81f5a60 con 0x7f52d81448b0 2023-11-26T07:11:38.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.801+0000 7f52e04bb700 1 -- 172.21.15.2:0/3471114695 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f52d80b4940 con 0x7f52bc06aed0 2023-11-26T07:11:38.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.809+0000 7f52ceffd700 1 -- 172.21.15.2:0/3471114695 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264709 (secure 0 0 0) 0x7f52d400b5c0 con 0x7f52bc06aed0 2023-11-26T07:11:38.815 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:11:38.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.812+0000 7f52e04bb700 1 -- 172.21.15.2:0/3471114695 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f52bc06aed0 msgr2=0x7f52bc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:38.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.812+0000 7f52e04bb700 1 --2- 172.21.15.2:0/3471114695 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f52bc06aed0 0x7f52bc06d390 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f52d815e1d0 tx=0x7f52d4008040 comp rx=0 tx=0).stop 2023-11-26T07:11:38.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.812+0000 7f52e04bb700 1 -- 172.21.15.2:0/3471114695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d81448b0 msgr2=0x7f52d8072050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:38.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.812+0000 7f52e04bb700 1 --2- 172.21.15.2:0/3471114695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d81448b0 0x7f52d8072050 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f52d80676b0 tx=0x7f52d0004ad0 comp rx=0 tx=0).stop 2023-11-26T07:11:38.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.812+0000 7f52e04bb700 1 -- 172.21.15.2:0/3471114695 shutdown_connections 2023-11-26T07:11:38.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.812+0000 7f52e04bb700 1 --2- 172.21.15.2:0/3471114695 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f52bc06aed0 0x7f52bc06d390 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:38.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.812+0000 7f52e04bb700 1 --2- 172.21.15.2:0/3471114695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d81448b0 0x7f52d8072050 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:38.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.812+0000 7f52e04bb700 1 --2- 172.21.15.2:0/3471114695 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52d806f990 0x7f52d80cc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:38.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.812+0000 7f52e04bb700 1 --2- 172.21.15.2:0/3471114695 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52d80b44c0 0x7f52d80d12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:38.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.812+0000 7f52e04bb700 1 -- 172.21.15.2:0/3471114695 >> 172.21.15.2:0/3471114695 conn(0x7f52d80d0bc0 msgr2=0x7f52d8141370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:38.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.812+0000 7f52e04bb700 1 -- 172.21.15.2:0/3471114695 shutdown_connections 2023-11-26T07:11:38.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.812+0000 7f52e04bb700 1 -- 172.21.15.2:0/3471114695 wait complete. 2023-11-26T07:11:38.818 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-26T07:11:38.827 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-11-26T07:11:38.153261+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":151,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219032,"kb_used_data":2860,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755688,"statfs":{"total":773094113280,"available":772869824512,"internally_reserved":0,"allocated":2928640,"data_stored":1758704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.536604"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.655448+0000","last_change":"2023-11-26T07:11:34.649320+0000","last_active":"2023-11-26T07:11:34.655448+0000","last_peered":"2023-11-26T07:11:34.655448+0000","last_clean":"2023-11-26T07:11:34.655448+0000","last_became_active":"2023-11-26T07:11:34.649061+0000","last_became_peered":"2023-11-26T07:11:34.649061+0000","last_unstale":"2023-11-26T07:11:34.655448+0000","last_undegraded":"2023-11-26T07:11:34.655448+0000","last_fullsized":"2023-11-26T07:11:34.655448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:09:14.653647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.640072+0000","last_change":"2023-11-26T07:11:34.635586+0000","last_active":"2023-11-26T07:11:34.640072+0000","last_peered":"2023-11-26T07:11:34.640072+0000","last_clean":"2023-11-26T07:11:34.640072+0000","last_became_active":"2023-11-26T07:11:34.635093+0000","last_became_peered":"2023-11-26T07:11:34.635093+0000","last_unstale":"2023-11-26T07:11:34.640072+0000","last_undegraded":"2023-11-26T07:11:34.640072+0000","last_fullsized":"2023-11-26T07:11:34.640072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:54:56.361323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.987146+0000","last_change":"2023-11-26T07:11:34.637021+0000","last_active":"2023-11-26T07:11:36.987146+0000","last_peered":"2023-11-26T07:11:36.987146+0000","last_clean":"2023-11-26T07:11:36.987146+0000","last_became_active":"2023-11-26T07:11:34.636666+0000","last_became_peered":"2023-11-26T07:11:34.636666+0000","last_unstale":"2023-11-26T07:11:36.987146+0000","last_undegraded":"2023-11-26T07:11:36.987146+0000","last_fullsized":"2023-11-26T07:11:36.987146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:07:08.839200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.639275+0000","last_change":"2023-11-26T07:11:34.647792+0000","last_active":"2023-11-26T07:11:35.639275+0000","last_peered":"2023-11-26T07:11:35.639275+0000","last_clean":"2023-11-26T07:11:35.639275+0000","last_became_active":"2023-11-26T07:11:34.647409+0000","last_became_peered":"2023-11-26T07:11:34.647409+0000","last_unstale":"2023-11-26T07:11:35.639275+0000","last_undegraded":"2023-11-26T07:11:35.639275+0000","last_fullsized":"2023-11-26T07:11:35.639275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:41:41.780777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.652921+0000","last_change":"2023-11-26T07:11:34.645909+0000","last_active":"2023-11-26T07:11:34.652921+0000","last_peered":"2023-11-26T07:11:34.652921+0000","last_clean":"2023-11-26T07:11:34.652921+0000","last_became_active":"2023-11-26T07:11:34.645102+0000","last_became_peered":"2023-11-26T07:11:34.645102+0000","last_unstale":"2023-11-26T07:11:34.652921+0000","last_undegraded":"2023-11-26T07:11:34.652921+0000","last_fullsized":"2023-11-26T07:11:34.652921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:54:56.361323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.638941+0000","last_change":"2023-11-26T07:11:34.648690+0000","last_active":"2023-11-26T07:11:35.638941+0000","last_peered":"2023-11-26T07:11:35.638941+0000","last_clean":"2023-11-26T07:11:35.638941+0000","last_became_active":"2023-11-26T07:11:34.648021+0000","last_became_peered":"2023-11-26T07:11:34.648021+0000","last_unstale":"2023-11-26T07:11:35.638941+0000","last_undegraded":"2023-11-26T07:11:35.638941+0000","last_fullsized":"2023-11-26T07:11:35.638941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:32:03.590472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.643007+0000","last_change":"2023-11-26T07:11:34.635808+0000","last_active":"2023-11-26T07:11:34.643007+0000","last_peered":"2023-11-26T07:11:34.643007+0000","last_clean":"2023-11-26T07:11:34.643007+0000","last_became_active":"2023-11-26T07:11:34.635521+0000","last_became_peered":"2023-11-26T07:11:34.635521+0000","last_unstale":"2023-11-26T07:11:34.643007+0000","last_undegraded":"2023-11-26T07:11:34.643007+0000","last_fullsized":"2023-11-26T07:11:34.643007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:23:13.396432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.014983+0000","last_change":"2023-11-26T07:11:34.649016+0000","last_active":"2023-11-26T07:11:37.014983+0000","last_peered":"2023-11-26T07:11:37.014983+0000","last_clean":"2023-11-26T07:11:37.014983+0000","last_became_active":"2023-11-26T07:11:34.648684+0000","last_became_peered":"2023-11-26T07:11:34.648684+0000","last_unstale":"2023-11-26T07:11:37.014983+0000","last_undegraded":"2023-11-26T07:11:37.014983+0000","last_fullsized":"2023-11-26T07:11:37.014983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:34:27.129920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.652847+0000","last_change":"2023-11-26T07:11:34.647310+0000","last_active":"2023-11-26T07:11:34.652847+0000","last_peered":"2023-11-26T07:11:34.652847+0000","last_clean":"2023-11-26T07:11:34.652847+0000","last_became_active":"2023-11-26T07:11:34.646750+0000","last_became_peered":"2023-11-26T07:11:34.646750+0000","last_unstale":"2023-11-26T07:11:34.652847+0000","last_undegraded":"2023-11-26T07:11:34.652847+0000","last_fullsized":"2023-11-26T07:11:34.652847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:44:14.102458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052935+0000","last_change":"2023-11-26T07:11:34.648387+0000","last_active":"2023-11-26T07:11:37.052935+0000","last_peered":"2023-11-26T07:11:37.052935+0000","last_clean":"2023-11-26T07:11:37.052935+0000","last_became_active":"2023-11-26T07:11:34.646866+0000","last_became_peered":"2023-11-26T07:11:34.646866+0000","last_unstale":"2023-11-26T07:11:37.052935+0000","last_undegraded":"2023-11-26T07:11:37.052935+0000","last_fullsized":"2023-11-26T07:11:37.052935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:32:03.590472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052752+0000","last_change":"2023-11-26T07:11:34.648155+0000","last_active":"2023-11-26T07:11:37.052752+0000","last_peered":"2023-11-26T07:11:37.052752+0000","last_clean":"2023-11-26T07:11:37.052752+0000","last_became_active":"2023-11-26T07:11:34.647811+0000","last_became_peered":"2023-11-26T07:11:34.647811+0000","last_unstale":"2023-11-26T07:11:37.052752+0000","last_undegraded":"2023-11-26T07:11:37.052752+0000","last_fullsized":"2023-11-26T07:11:37.052752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:03:49.221463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.641148+0000","last_change":"2023-11-26T07:11:34.655197+0000","last_active":"2023-11-26T07:11:35.641148+0000","last_peered":"2023-11-26T07:11:35.641148+0000","last_clean":"2023-11-26T07:11:35.641148+0000","last_became_active":"2023-11-26T07:11:34.654929+0000","last_became_peered":"2023-11-26T07:11:34.654929+0000","last_unstale":"2023-11-26T07:11:35.641148+0000","last_undegraded":"2023-11-26T07:11:35.641148+0000","last_fullsized":"2023-11-26T07:11:35.641148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:13:11.105677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015134+0000","last_change":"2023-11-26T07:11:34.649022+0000","last_active":"2023-11-26T07:11:37.015134+0000","last_peered":"2023-11-26T07:11:37.015134+0000","last_clean":"2023-11-26T07:11:37.015134+0000","last_became_active":"2023-11-26T07:11:34.648395+0000","last_became_peered":"2023-11-26T07:11:34.648395+0000","last_unstale":"2023-11-26T07:11:37.015134+0000","last_undegraded":"2023-11-26T07:11:37.015134+0000","last_fullsized":"2023-11-26T07:11:37.015134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:00:10.960837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.986910+0000","last_change":"2023-11-26T07:11:34.637714+0000","last_active":"2023-11-26T07:11:36.986910+0000","last_peered":"2023-11-26T07:11:36.986910+0000","last_clean":"2023-11-26T07:11:36.986910+0000","last_became_active":"2023-11-26T07:11:34.637398+0000","last_became_peered":"2023-11-26T07:11:34.637398+0000","last_unstale":"2023-11-26T07:11:36.986910+0000","last_undegraded":"2023-11-26T07:11:36.986910+0000","last_fullsized":"2023-11-26T07:11:36.986910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:27:38.431121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.654866+0000","last_change":"2023-11-26T07:11:34.653279+0000","last_active":"2023-11-26T07:11:34.654866+0000","last_peered":"2023-11-26T07:11:34.654866+0000","last_clean":"2023-11-26T07:11:34.654866+0000","last_became_active":"2023-11-26T07:11:34.652965+0000","last_became_peered":"2023-11-26T07:11:34.652965+0000","last_unstale":"2023-11-26T07:11:34.654866+0000","last_undegraded":"2023-11-26T07:11:34.654866+0000","last_fullsized":"2023-11-26T07:11:34.654866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:54:31.334401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.638623+0000","last_change":"2023-11-26T07:11:34.644467+0000","last_active":"2023-11-26T07:11:35.638623+0000","last_peered":"2023-11-26T07:11:35.638623+0000","last_clean":"2023-11-26T07:11:35.638623+0000","last_became_active":"2023-11-26T07:11:34.644215+0000","last_became_peered":"2023-11-26T07:11:34.644215+0000","last_unstale":"2023-11-26T07:11:35.638623+0000","last_undegraded":"2023-11-26T07:11:35.638623+0000","last_fullsized":"2023-11-26T07:11:35.638623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:09:14.653647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.639493+0000","last_change":"2023-11-26T07:11:34.646080+0000","last_active":"2023-11-26T07:11:35.639493+0000","last_peered":"2023-11-26T07:11:35.639493+0000","last_clean":"2023-11-26T07:11:35.639493+0000","last_became_active":"2023-11-26T07:11:34.645810+0000","last_became_peered":"2023-11-26T07:11:34.645810+0000","last_unstale":"2023-11-26T07:11:35.639493+0000","last_undegraded":"2023-11-26T07:11:35.639493+0000","last_fullsized":"2023-11-26T07:11:35.639493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:03:47.829221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.655822+0000","last_change":"2023-11-26T07:11:34.650792+0000","last_active":"2023-11-26T07:11:34.655822+0000","last_peered":"2023-11-26T07:11:34.655822+0000","last_clean":"2023-11-26T07:11:34.655822+0000","last_became_active":"2023-11-26T07:11:34.650453+0000","last_became_peered":"2023-11-26T07:11:34.650453+0000","last_unstale":"2023-11-26T07:11:34.655822+0000","last_undegraded":"2023-11-26T07:11:34.655822+0000","last_fullsized":"2023-11-26T07:11:34.655822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:49:34.044448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.645600+0000","last_change":"2023-11-26T07:11:34.642316+0000","last_active":"2023-11-26T07:11:34.645600+0000","last_peered":"2023-11-26T07:11:34.645600+0000","last_clean":"2023-11-26T07:11:34.645600+0000","last_became_active":"2023-11-26T07:11:34.641966+0000","last_became_peered":"2023-11-26T07:11:34.641966+0000","last_unstale":"2023-11-26T07:11:34.645600+0000","last_undegraded":"2023-11-26T07:11:34.645600+0000","last_fullsized":"2023-11-26T07:11:34.645600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:37:23.214446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.987157+0000","last_change":"2023-11-26T07:11:33.642542+0000","last_active":"2023-11-26T07:11:36.987157+0000","last_peered":"2023-11-26T07:11:36.987157+0000","last_clean":"2023-11-26T07:11:36.987157+0000","last_became_active":"2023-11-26T07:11:33.642294+0000","last_became_peered":"2023-11-26T07:11:33.642294+0000","last_unstale":"2023-11-26T07:11:36.987157+0000","last_undegraded":"2023-11-26T07:11:36.987157+0000","last_fullsized":"2023-11-26T07:11:36.987157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:54:30.329113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015525+0000","last_change":"2023-11-26T07:11:34.649717+0000","last_active":"2023-11-26T07:11:37.015525+0000","last_peered":"2023-11-26T07:11:37.015525+0000","last_clean":"2023-11-26T07:11:37.015525+0000","last_became_active":"2023-11-26T07:11:34.649477+0000","last_became_peered":"2023-11-26T07:11:34.649477+0000","last_unstale":"2023-11-26T07:11:37.015525+0000","last_undegraded":"2023-11-26T07:11:37.015525+0000","last_fullsized":"2023-11-26T07:11:37.015525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:38:10.530811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015483+0000","last_change":"2023-11-26T07:11:33.645915+0000","last_active":"2023-11-26T07:11:37.015483+0000","last_peered":"2023-11-26T07:11:37.015483+0000","last_clean":"2023-11-26T07:11:37.015483+0000","last_became_active":"2023-11-26T07:11:33.645603+0000","last_became_peered":"2023-11-26T07:11:33.645603+0000","last_unstale":"2023-11-26T07:11:37.015483+0000","last_undegraded":"2023-11-26T07:11:37.015483+0000","last_fullsized":"2023-11-26T07:11:37.015483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:54:30.329113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.987052+0000","last_change":"2023-11-26T07:11:34.648199+0000","last_active":"2023-11-26T07:11:36.987052+0000","last_peered":"2023-11-26T07:11:36.987052+0000","last_clean":"2023-11-26T07:11:36.987052+0000","last_became_active":"2023-11-26T07:11:34.647906+0000","last_became_peered":"2023-11-26T07:11:34.647906+0000","last_unstale":"2023-11-26T07:11:36.987052+0000","last_undegraded":"2023-11-26T07:11:36.987052+0000","last_fullsized":"2023-11-26T07:11:36.987052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:34:27.129920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.658335+0000","last_change":"2023-11-26T07:11:33.643750+0000","last_active":"2023-11-26T07:11:34.658335+0000","last_peered":"2023-11-26T07:11:34.658335+0000","last_clean":"2023-11-26T07:11:34.658335+0000","last_became_active":"2023-11-26T07:11:33.643485+0000","last_became_peered":"2023-11-26T07:11:33.643485+0000","last_unstale":"2023-11-26T07:11:34.658335+0000","last_undegraded":"2023-11-26T07:11:34.658335+0000","last_fullsized":"2023-11-26T07:11:34.658335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:00:09.955548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.639381+0000","last_change":"2023-11-26T07:11:34.654171+0000","last_active":"2023-11-26T07:11:35.639381+0000","last_peered":"2023-11-26T07:11:35.639381+0000","last_clean":"2023-11-26T07:11:35.639381+0000","last_became_active":"2023-11-26T07:11:34.653773+0000","last_became_peered":"2023-11-26T07:11:34.653773+0000","last_unstale":"2023-11-26T07:11:35.639381+0000","last_undegraded":"2023-11-26T07:11:35.639381+0000","last_fullsized":"2023-11-26T07:11:35.639381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:16:17.444687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.657329+0000","last_change":"2023-11-26T07:11:33.643355+0000","last_active":"2023-11-26T07:11:34.657329+0000","last_peered":"2023-11-26T07:11:34.657329+0000","last_clean":"2023-11-26T07:11:34.657329+0000","last_became_active":"2023-11-26T07:11:33.643024+0000","last_became_peered":"2023-11-26T07:11:33.643024+0000","last_unstale":"2023-11-26T07:11:34.657329+0000","last_undegraded":"2023-11-26T07:11:34.657329+0000","last_fullsized":"2023-11-26T07:11:34.657329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:35:23.512252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.639894+0000","last_change":"2023-11-26T07:11:34.645965+0000","last_active":"2023-11-26T07:11:35.639894+0000","last_peered":"2023-11-26T07:11:35.639894+0000","last_clean":"2023-11-26T07:11:35.639894+0000","last_became_active":"2023-11-26T07:11:34.645636+0000","last_became_peered":"2023-11-26T07:11:34.645636+0000","last_unstale":"2023-11-26T07:11:35.639894+0000","last_undegraded":"2023-11-26T07:11:35.639894+0000","last_fullsized":"2023-11-26T07:11:35.639894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:42:53.462266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015241+0000","last_change":"2023-11-26T07:11:33.637866+0000","last_active":"2023-11-26T07:11:37.015241+0000","last_peered":"2023-11-26T07:11:37.015241+0000","last_clean":"2023-11-26T07:11:37.015241+0000","last_became_active":"2023-11-26T07:11:33.637478+0000","last_became_peered":"2023-11-26T07:11:33.637478+0000","last_unstale":"2023-11-26T07:11:37.015241+0000","last_undegraded":"2023-11-26T07:11:37.015241+0000","last_fullsized":"2023-11-26T07:11:37.015241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:46:01.876918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.640773+0000","last_change":"2023-11-26T07:11:34.636381+0000","last_active":"2023-11-26T07:11:35.640773+0000","last_peered":"2023-11-26T07:11:35.640773+0000","last_clean":"2023-11-26T07:11:35.640773+0000","last_became_active":"2023-11-26T07:11:34.636118+0000","last_became_peered":"2023-11-26T07:11:34.636118+0000","last_unstale":"2023-11-26T07:11:35.640773+0000","last_undegraded":"2023-11-26T07:11:35.640773+0000","last_fullsized":"2023-11-26T07:11:35.640773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:15:28.976045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052636+0000","last_change":"2023-11-26T07:11:33.638305+0000","last_active":"2023-11-26T07:11:37.052636+0000","last_peered":"2023-11-26T07:11:37.052636+0000","last_clean":"2023-11-26T07:11:37.052636+0000","last_became_active":"2023-11-26T07:11:33.637988+0000","last_became_peered":"2023-11-26T07:11:33.637988+0000","last_unstale":"2023-11-26T07:11:37.052636+0000","last_undegraded":"2023-11-26T07:11:37.052636+0000","last_fullsized":"2023-11-26T07:11:37.052636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:13:10.100388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.987409+0000","last_change":"2023-11-26T07:11:34.656184+0000","last_active":"2023-11-26T07:11:36.987409+0000","last_peered":"2023-11-26T07:11:36.987409+0000","last_clean":"2023-11-26T07:11:36.987409+0000","last_became_active":"2023-11-26T07:11:34.655583+0000","last_became_peered":"2023-11-26T07:11:34.655583+0000","last_unstale":"2023-11-26T07:11:36.987409+0000","last_undegraded":"2023-11-26T07:11:36.987409+0000","last_fullsized":"2023-11-26T07:11:36.987409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:32:03.590472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015050+0000","last_change":"2023-11-26T07:11:33.644381+0000","last_active":"2023-11-26T07:11:37.015050+0000","last_peered":"2023-11-26T07:11:37.015050+0000","last_clean":"2023-11-26T07:11:37.015050+0000","last_became_active":"2023-11-26T07:11:33.643634+0000","last_became_peered":"2023-11-26T07:11:33.643634+0000","last_unstale":"2023-11-26T07:11:37.015050+0000","last_undegraded":"2023-11-26T07:11:37.015050+0000","last_fullsized":"2023-11-26T07:11:37.015050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:37:22.209157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015147+0000","last_change":"2023-11-26T07:11:34.643595+0000","last_active":"2023-11-26T07:11:37.015147+0000","last_peered":"2023-11-26T07:11:37.015147+0000","last_clean":"2023-11-26T07:11:37.015147+0000","last_became_active":"2023-11-26T07:11:34.642017+0000","last_became_peered":"2023-11-26T07:11:34.642017+0000","last_unstale":"2023-11-26T07:11:37.015147+0000","last_undegraded":"2023-11-26T07:11:37.015147+0000","last_fullsized":"2023-11-26T07:11:37.015147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:09:14.653647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.638837+0000","last_change":"2023-11-26T07:11:33.634859+0000","last_active":"2023-11-26T07:11:35.638837+0000","last_peered":"2023-11-26T07:11:35.638837+0000","last_clean":"2023-11-26T07:11:35.638837+0000","last_became_active":"2023-11-26T07:11:33.634445+0000","last_became_peered":"2023-11-26T07:11:33.634445+0000","last_unstale":"2023-11-26T07:11:35.638837+0000","last_undegraded":"2023-11-26T07:11:35.638837+0000","last_fullsized":"2023-11-26T07:11:35.638837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:27:37.425832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.643523+0000","last_change":"2023-11-26T07:11:34.641077+0000","last_active":"2023-11-26T07:11:34.643523+0000","last_peered":"2023-11-26T07:11:34.643523+0000","last_clean":"2023-11-26T07:11:34.643523+0000","last_became_active":"2023-11-26T07:11:34.640778+0000","last_became_peered":"2023-11-26T07:11:34.640778+0000","last_unstale":"2023-11-26T07:11:34.643523+0000","last_undegraded":"2023-11-26T07:11:34.643523+0000","last_fullsized":"2023-11-26T07:11:34.643523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:44:14.102458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052858+0000","last_change":"2023-11-26T07:11:33.643806+0000","last_active":"2023-11-26T07:11:37.052858+0000","last_peered":"2023-11-26T07:11:37.052858+0000","last_clean":"2023-11-26T07:11:37.052858+0000","last_became_active":"2023-11-26T07:11:33.643066+0000","last_became_peered":"2023-11-26T07:11:33.643066+0000","last_unstale":"2023-11-26T07:11:37.052858+0000","last_undegraded":"2023-11-26T07:11:37.052858+0000","last_fullsized":"2023-11-26T07:11:37.052858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:54:30.329113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.639314+0000","last_change":"2023-11-26T07:11:34.642427+0000","last_active":"2023-11-26T07:11:35.639314+0000","last_peered":"2023-11-26T07:11:35.639314+0000","last_clean":"2023-11-26T07:11:35.639314+0000","last_became_active":"2023-11-26T07:11:34.642161+0000","last_became_peered":"2023-11-26T07:11:34.642161+0000","last_unstale":"2023-11-26T07:11:35.639314+0000","last_undegraded":"2023-11-26T07:11:35.639314+0000","last_fullsized":"2023-11-26T07:11:35.639314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:38:10.530811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.639263+0000","last_change":"2023-11-26T07:11:33.638930+0000","last_active":"2023-11-26T07:11:35.639263+0000","last_peered":"2023-11-26T07:11:35.639263+0000","last_clean":"2023-11-26T07:11:35.639263+0000","last_became_active":"2023-11-26T07:11:33.638636+0000","last_became_peered":"2023-11-26T07:11:33.638636+0000","last_unstale":"2023-11-26T07:11:35.639263+0000","last_undegraded":"2023-11-26T07:11:35.639263+0000","last_fullsized":"2023-11-26T07:11:35.639263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:54:30.329113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.987164+0000","last_change":"2023-11-26T07:11:34.648049+0000","last_active":"2023-11-26T07:11:36.987164+0000","last_peered":"2023-11-26T07:11:36.987164+0000","last_clean":"2023-11-26T07:11:36.987164+0000","last_became_active":"2023-11-26T07:11:34.647530+0000","last_became_peered":"2023-11-26T07:11:34.647530+0000","last_unstale":"2023-11-26T07:11:36.987164+0000","last_undegraded":"2023-11-26T07:11:36.987164+0000","last_fullsized":"2023-11-26T07:11:36.987164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:00:10.960837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.657580+0000","last_change":"2023-11-26T07:11:33.641284+0000","last_active":"2023-11-26T07:11:34.657580+0000","last_peered":"2023-11-26T07:11:34.657580+0000","last_clean":"2023-11-26T07:11:34.657580+0000","last_became_active":"2023-11-26T07:11:33.640977+0000","last_became_peered":"2023-11-26T07:11:33.640977+0000","last_unstale":"2023-11-26T07:11:34.657580+0000","last_undegraded":"2023-11-26T07:11:34.657580+0000","last_fullsized":"2023-11-26T07:11:34.657580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:27:37.425832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.641110+0000","last_change":"2023-11-26T07:11:34.655028+0000","last_active":"2023-11-26T07:11:35.641110+0000","last_peered":"2023-11-26T07:11:35.641110+0000","last_clean":"2023-11-26T07:11:35.641110+0000","last_became_active":"2023-11-26T07:11:34.654675+0000","last_became_peered":"2023-11-26T07:11:34.654675+0000","last_unstale":"2023-11-26T07:11:35.641110+0000","last_undegraded":"2023-11-26T07:11:35.641110+0000","last_fullsized":"2023-11-26T07:11:35.641110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:57:30.265272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052750+0000","last_change":"2023-11-26T07:11:33.640407+0000","last_active":"2023-11-26T07:11:37.052750+0000","last_peered":"2023-11-26T07:11:37.052750+0000","last_clean":"2023-11-26T07:11:37.052750+0000","last_became_active":"2023-11-26T07:11:33.640092+0000","last_became_peered":"2023-11-26T07:11:33.640092+0000","last_unstale":"2023-11-26T07:11:37.052750+0000","last_undegraded":"2023-11-26T07:11:37.052750+0000","last_fullsized":"2023-11-26T07:11:37.052750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:37:22.209157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.652832+0000","last_change":"2023-11-26T07:11:34.645251+0000","last_active":"2023-11-26T07:11:34.652832+0000","last_peered":"2023-11-26T07:11:34.652832+0000","last_clean":"2023-11-26T07:11:34.652832+0000","last_became_active":"2023-11-26T07:11:34.644995+0000","last_became_peered":"2023-11-26T07:11:34.644995+0000","last_unstale":"2023-11-26T07:11:34.652832+0000","last_undegraded":"2023-11-26T07:11:34.652832+0000","last_fullsized":"2023-11-26T07:11:34.652832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:27:38.431121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.987292+0000","last_change":"2023-11-26T07:11:33.639952+0000","last_active":"2023-11-26T07:11:36.987292+0000","last_peered":"2023-11-26T07:11:36.987292+0000","last_clean":"2023-11-26T07:11:36.987292+0000","last_became_active":"2023-11-26T07:11:33.639660+0000","last_became_peered":"2023-11-26T07:11:33.639660+0000","last_unstale":"2023-11-26T07:11:36.987292+0000","last_undegraded":"2023-11-26T07:11:36.987292+0000","last_fullsized":"2023-11-26T07:11:36.987292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:35:23.512252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.986952+0000","last_change":"2023-11-26T07:11:34.642918+0000","last_active":"2023-11-26T07:11:36.986952+0000","last_peered":"2023-11-26T07:11:36.986952+0000","last_clean":"2023-11-26T07:11:36.986952+0000","last_became_active":"2023-11-26T07:11:34.642455+0000","last_became_peered":"2023-11-26T07:11:34.642455+0000","last_unstale":"2023-11-26T07:11:36.986952+0000","last_undegraded":"2023-11-26T07:11:36.986952+0000","last_fullsized":"2023-11-26T07:11:36.986952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:44:14.102458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.639215+0000","last_change":"2023-11-26T07:11:33.643793+0000","last_active":"2023-11-26T07:11:35.639215+0000","last_peered":"2023-11-26T07:11:35.639215+0000","last_clean":"2023-11-26T07:11:35.639215+0000","last_became_active":"2023-11-26T07:11:33.643494+0000","last_became_peered":"2023-11-26T07:11:33.643494+0000","last_unstale":"2023-11-26T07:11:35.639215+0000","last_undegraded":"2023-11-26T07:11:35.639215+0000","last_fullsized":"2023-11-26T07:11:35.639215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:00:09.955548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.658535+0000","last_change":"2023-11-26T07:11:34.655763+0000","last_active":"2023-11-26T07:11:34.658535+0000","last_peered":"2023-11-26T07:11:34.658535+0000","last_clean":"2023-11-26T07:11:34.658535+0000","last_became_active":"2023-11-26T07:11:34.655507+0000","last_became_peered":"2023-11-26T07:11:34.655507+0000","last_unstale":"2023-11-26T07:11:34.658535+0000","last_undegraded":"2023-11-26T07:11:34.658535+0000","last_fullsized":"2023-11-26T07:11:34.658535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:54:31.334401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052504+0000","last_change":"2023-11-26T07:11:33.635838+0000","last_active":"2023-11-26T07:11:37.052504+0000","last_peered":"2023-11-26T07:11:37.052504+0000","last_clean":"2023-11-26T07:11:37.052504+0000","last_became_active":"2023-11-26T07:11:33.635540+0000","last_became_peered":"2023-11-26T07:11:33.635540+0000","last_unstale":"2023-11-26T07:11:37.052504+0000","last_undegraded":"2023-11-26T07:11:37.052504+0000","last_fullsized":"2023-11-26T07:11:37.052504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:54:55.356034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052841+0000","last_change":"2023-11-26T07:11:34.648800+0000","last_active":"2023-11-26T07:11:37.052841+0000","last_peered":"2023-11-26T07:11:37.052841+0000","last_clean":"2023-11-26T07:11:37.052841+0000","last_became_active":"2023-11-26T07:11:34.648164+0000","last_became_peered":"2023-11-26T07:11:34.648164+0000","last_unstale":"2023-11-26T07:11:37.052841+0000","last_undegraded":"2023-11-26T07:11:37.052841+0000","last_fullsized":"2023-11-26T07:11:37.052841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:09:14.653647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.656368+0000","last_change":"2023-11-26T07:11:33.638974+0000","last_active":"2023-11-26T07:11:34.656368+0000","last_peered":"2023-11-26T07:11:34.656368+0000","last_clean":"2023-11-26T07:11:34.656368+0000","last_became_active":"2023-11-26T07:11:33.638589+0000","last_became_peered":"2023-11-26T07:11:33.638589+0000","last_unstale":"2023-11-26T07:11:34.656368+0000","last_undegraded":"2023-11-26T07:11:34.656368+0000","last_fullsized":"2023-11-26T07:11:34.656368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:15:27.970756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.645499+0000","last_change":"2023-11-26T07:11:34.642385+0000","last_active":"2023-11-26T07:11:34.645499+0000","last_peered":"2023-11-26T07:11:34.645499+0000","last_clean":"2023-11-26T07:11:34.645499+0000","last_became_active":"2023-11-26T07:11:34.642090+0000","last_became_peered":"2023-11-26T07:11:34.642090+0000","last_unstale":"2023-11-26T07:11:34.645499+0000","last_undegraded":"2023-11-26T07:11:34.645499+0000","last_fullsized":"2023-11-26T07:11:34.645499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:57:30.265272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.641145+0000","last_change":"2023-11-26T07:11:33.637520+0000","last_active":"2023-11-26T07:11:35.641145+0000","last_peered":"2023-11-26T07:11:35.641145+0000","last_clean":"2023-11-26T07:11:35.641145+0000","last_became_active":"2023-11-26T07:11:33.637255+0000","last_became_peered":"2023-11-26T07:11:33.637255+0000","last_unstale":"2023-11-26T07:11:35.641145+0000","last_undegraded":"2023-11-26T07:11:35.641145+0000","last_fullsized":"2023-11-26T07:11:35.641145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:49:33.039159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.645467+0000","last_change":"2023-11-26T07:11:34.642552+0000","last_active":"2023-11-26T07:11:34.645467+0000","last_peered":"2023-11-26T07:11:34.645467+0000","last_clean":"2023-11-26T07:11:34.645467+0000","last_became_active":"2023-11-26T07:11:34.642252+0000","last_became_peered":"2023-11-26T07:11:34.642252+0000","last_unstale":"2023-11-26T07:11:34.645467+0000","last_undegraded":"2023-11-26T07:11:34.645467+0000","last_fullsized":"2023-11-26T07:11:34.645467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:13:11.105677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.625622+0000","last_change":"2023-11-26T07:11:33.645907+0000","last_active":"2023-11-26T07:11:34.625622+0000","last_peered":"2023-11-26T07:11:34.625622+0000","last_clean":"2023-11-26T07:11:34.625622+0000","last_became_active":"2023-11-26T07:11:33.645612+0000","last_became_peered":"2023-11-26T07:11:33.645612+0000","last_unstale":"2023-11-26T07:11:34.625622+0000","last_undegraded":"2023-11-26T07:11:34.625622+0000","last_fullsized":"2023-11-26T07:11:34.625622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:15:27.970756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.639689+0000","last_change":"2023-11-26T07:11:34.646582+0000","last_active":"2023-11-26T07:11:35.639689+0000","last_peered":"2023-11-26T07:11:35.639689+0000","last_clean":"2023-11-26T07:11:35.639689+0000","last_became_active":"2023-11-26T07:11:34.646107+0000","last_became_peered":"2023-11-26T07:11:34.646107+0000","last_unstale":"2023-11-26T07:11:35.639689+0000","last_undegraded":"2023-11-26T07:11:35.639689+0000","last_fullsized":"2023-11-26T07:11:35.639689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:36:07.899873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.639090+0000","last_change":"2023-11-26T07:11:33.635282+0000","last_active":"2023-11-26T07:11:35.639090+0000","last_peered":"2023-11-26T07:11:35.639090+0000","last_clean":"2023-11-26T07:11:35.639090+0000","last_became_active":"2023-11-26T07:11:33.634993+0000","last_became_peered":"2023-11-26T07:11:33.634993+0000","last_unstale":"2023-11-26T07:11:35.639090+0000","last_undegraded":"2023-11-26T07:11:35.639090+0000","last_fullsized":"2023-11-26T07:11:35.639090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:07:07.833911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.641041+0000","last_change":"2023-11-26T07:11:34.642107+0000","last_active":"2023-11-26T07:11:35.641041+0000","last_peered":"2023-11-26T07:11:35.641041+0000","last_clean":"2023-11-26T07:11:35.641041+0000","last_became_active":"2023-11-26T07:11:34.641849+0000","last_became_peered":"2023-11-26T07:11:34.641849+0000","last_unstale":"2023-11-26T07:11:35.641041+0000","last_undegraded":"2023-11-26T07:11:35.641041+0000","last_fullsized":"2023-11-26T07:11:35.641041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:35:24.517541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.641664+0000","last_change":"2023-11-26T07:11:34.637097+0000","last_active":"2023-11-26T07:11:34.641664+0000","last_peered":"2023-11-26T07:11:34.641664+0000","last_clean":"2023-11-26T07:11:34.641664+0000","last_became_active":"2023-11-26T07:11:34.636788+0000","last_became_peered":"2023-11-26T07:11:34.636788+0000","last_unstale":"2023-11-26T07:11:34.641664+0000","last_undegraded":"2023-11-26T07:11:34.641664+0000","last_fullsized":"2023-11-26T07:11:34.641664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:13:11.105677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.631676+0000","last_change":"2023-11-26T07:11:33.641738+0000","last_active":"2023-11-26T07:11:34.631676+0000","last_peered":"2023-11-26T07:11:34.631676+0000","last_clean":"2023-11-26T07:11:34.631676+0000","last_became_active":"2023-11-26T07:11:33.641410+0000","last_became_peered":"2023-11-26T07:11:33.641410+0000","last_unstale":"2023-11-26T07:11:34.631676+0000","last_undegraded":"2023-11-26T07:11:34.631676+0000","last_fullsized":"2023-11-26T07:11:34.631676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:17:54.783415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015213+0000","last_change":"2023-11-26T07:11:34.652603+0000","last_active":"2023-11-26T07:11:37.015213+0000","last_peered":"2023-11-26T07:11:37.015213+0000","last_clean":"2023-11-26T07:11:37.015213+0000","last_became_active":"2023-11-26T07:11:34.652141+0000","last_became_peered":"2023-11-26T07:11:34.652141+0000","last_unstale":"2023-11-26T07:11:37.015213+0000","last_undegraded":"2023-11-26T07:11:37.015213+0000","last_fullsized":"2023-11-26T07:11:37.015213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:06:28.926253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.638715+0000","last_change":"2023-11-26T07:11:33.634157+0000","last_active":"2023-11-26T07:11:35.638715+0000","last_peered":"2023-11-26T07:11:35.638715+0000","last_clean":"2023-11-26T07:11:35.638715+0000","last_became_active":"2023-11-26T07:11:33.633464+0000","last_became_peered":"2023-11-26T07:11:33.633464+0000","last_unstale":"2023-11-26T07:11:35.638715+0000","last_undegraded":"2023-11-26T07:11:35.638715+0000","last_fullsized":"2023-11-26T07:11:35.638715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:15:27.970756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:11:33.635572+0000","last_change":"2023-11-26T07:11:29.855919+0000","last_active":"2023-11-26T07:11:33.635572+0000","last_peered":"2023-11-26T07:11:33.635572+0000","last_clean":"2023-11-26T07:11:33.635572+0000","last_became_active":"2023-11-26T07:11:29.854903+0000","last_became_peered":"2023-11-26T07:11:29.854903+0000","last_unstale":"2023-11-26T07:11:33.635572+0000","last_undegraded":"2023-11-26T07:11:33.635572+0000","last_fullsized":"2023-11-26T07:11:33.635572+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:28.594252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:28.594252+0000","last_clean_scrub_stamp":"2023-11-26T07:11:28.594252+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:33:34.642696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.986872+0000","last_change":"2023-11-26T07:11:34.655445+0000","last_active":"2023-11-26T07:11:36.986872+0000","last_peered":"2023-11-26T07:11:36.986872+0000","last_clean":"2023-11-26T07:11:36.986872+0000","last_became_active":"2023-11-26T07:11:34.655111+0000","last_became_peered":"2023-11-26T07:11:34.655111+0000","last_unstale":"2023-11-26T07:11:36.986872+0000","last_undegraded":"2023-11-26T07:11:36.986872+0000","last_fullsized":"2023-11-26T07:11:36.986872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:54:56.361323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.630923+0000","last_change":"2023-11-26T07:11:33.640738+0000","last_active":"2023-11-26T07:11:34.630923+0000","last_peered":"2023-11-26T07:11:34.630923+0000","last_clean":"2023-11-26T07:11:34.630923+0000","last_became_active":"2023-11-26T07:11:33.640515+0000","last_became_peered":"2023-11-26T07:11:33.640515+0000","last_unstale":"2023-11-26T07:11:34.630923+0000","last_undegraded":"2023-11-26T07:11:34.630923+0000","last_fullsized":"2023-11-26T07:11:34.630923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:46:01.876918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.632528+0000","last_change":"2023-11-26T07:11:33.643235+0000","last_active":"2023-11-26T07:11:34.632528+0000","last_peered":"2023-11-26T07:11:34.632528+0000","last_clean":"2023-11-26T07:11:34.632528+0000","last_became_active":"2023-11-26T07:11:33.642977+0000","last_became_peered":"2023-11-26T07:11:33.642977+0000","last_unstale":"2023-11-26T07:11:34.632528+0000","last_undegraded":"2023-11-26T07:11:34.632528+0000","last_fullsized":"2023-11-26T07:11:34.632528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:03:48.216174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.641724+0000","last_change":"2023-11-26T07:11:34.636261+0000","last_active":"2023-11-26T07:11:34.641724+0000","last_peered":"2023-11-26T07:11:34.641724+0000","last_clean":"2023-11-26T07:11:34.641724+0000","last_became_active":"2023-11-26T07:11:34.635958+0000","last_became_peered":"2023-11-26T07:11:34.635958+0000","last_unstale":"2023-11-26T07:11:34.641724+0000","last_undegraded":"2023-11-26T07:11:34.641724+0000","last_fullsized":"2023-11-26T07:11:34.641724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:23:13.396432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.625767+0000","last_change":"2023-11-26T07:11:33.643565+0000","last_active":"2023-11-26T07:11:34.625767+0000","last_peered":"2023-11-26T07:11:34.625767+0000","last_clean":"2023-11-26T07:11:34.625767+0000","last_became_active":"2023-11-26T07:11:33.643189+0000","last_became_peered":"2023-11-26T07:11:33.643189+0000","last_unstale":"2023-11-26T07:11:34.625767+0000","last_undegraded":"2023-11-26T07:11:34.625767+0000","last_fullsized":"2023-11-26T07:11:34.625767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:57:29.259984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015485+0000","last_change":"2023-11-26T07:11:34.645591+0000","last_active":"2023-11-26T07:11:37.015485+0000","last_peered":"2023-11-26T07:11:37.015485+0000","last_clean":"2023-11-26T07:11:37.015485+0000","last_became_active":"2023-11-26T07:11:34.645274+0000","last_became_peered":"2023-11-26T07:11:34.645274+0000","last_unstale":"2023-11-26T07:11:37.015485+0000","last_undegraded":"2023-11-26T07:11:37.015485+0000","last_fullsized":"2023-11-26T07:11:37.015485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:41:41.780777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052771+0000","last_change":"2023-11-26T07:11:33.638999+0000","last_active":"2023-11-26T07:11:37.052771+0000","last_peered":"2023-11-26T07:11:37.052771+0000","last_clean":"2023-11-26T07:11:37.052771+0000","last_became_active":"2023-11-26T07:11:33.638743+0000","last_became_peered":"2023-11-26T07:11:33.638743+0000","last_unstale":"2023-11-26T07:11:37.052771+0000","last_undegraded":"2023-11-26T07:11:37.052771+0000","last_fullsized":"2023-11-26T07:11:37.052771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:46:01.876918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.987081+0000","last_change":"2023-11-26T07:11:34.637617+0000","last_active":"2023-11-26T07:11:36.987081+0000","last_peered":"2023-11-26T07:11:36.987081+0000","last_clean":"2023-11-26T07:11:36.987081+0000","last_became_active":"2023-11-26T07:11:34.637260+0000","last_became_peered":"2023-11-26T07:11:34.637260+0000","last_unstale":"2023-11-26T07:11:36.987081+0000","last_undegraded":"2023-11-26T07:11:36.987081+0000","last_fullsized":"2023-11-26T07:11:36.987081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:03:49.221463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.628283+0000","last_change":"2023-11-26T07:11:33.642201+0000","last_active":"2023-11-26T07:11:34.628283+0000","last_peered":"2023-11-26T07:11:34.628283+0000","last_clean":"2023-11-26T07:11:34.628283+0000","last_became_active":"2023-11-26T07:11:33.641913+0000","last_became_peered":"2023-11-26T07:11:33.641913+0000","last_unstale":"2023-11-26T07:11:34.628283+0000","last_undegraded":"2023-11-26T07:11:34.628283+0000","last_fullsized":"2023-11-26T07:11:34.628283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:15:27.970756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.640871+0000","last_change":"2023-11-26T07:11:34.641773+0000","last_active":"2023-11-26T07:11:35.640871+0000","last_peered":"2023-11-26T07:11:35.640871+0000","last_clean":"2023-11-26T07:11:35.640871+0000","last_became_active":"2023-11-26T07:11:34.641501+0000","last_became_peered":"2023-11-26T07:11:34.641501+0000","last_unstale":"2023-11-26T07:11:35.640871+0000","last_undegraded":"2023-11-26T07:11:35.640871+0000","last_fullsized":"2023-11-26T07:11:35.640871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:23:13.396432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.625482+0000","last_change":"2023-11-26T07:11:33.637842+0000","last_active":"2023-11-26T07:11:34.625482+0000","last_peered":"2023-11-26T07:11:34.625482+0000","last_clean":"2023-11-26T07:11:34.625482+0000","last_became_active":"2023-11-26T07:11:33.637534+0000","last_became_peered":"2023-11-26T07:11:33.637534+0000","last_unstale":"2023-11-26T07:11:34.625482+0000","last_undegraded":"2023-11-26T07:11:34.625482+0000","last_fullsized":"2023-11-26T07:11:34.625482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:18:52.359254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015004+0000","last_change":"2023-11-26T07:11:34.640101+0000","last_active":"2023-11-26T07:11:37.015004+0000","last_peered":"2023-11-26T07:11:37.015004+0000","last_clean":"2023-11-26T07:11:37.015004+0000","last_became_active":"2023-11-26T07:11:34.639741+0000","last_became_peered":"2023-11-26T07:11:34.639741+0000","last_unstale":"2023-11-26T07:11:37.015004+0000","last_undegraded":"2023-11-26T07:11:37.015004+0000","last_fullsized":"2023-11-26T07:11:37.015004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:03:49.221463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.625771+0000","last_change":"2023-11-26T07:11:33.644068+0000","last_active":"2023-11-26T07:11:34.625771+0000","last_peered":"2023-11-26T07:11:34.625771+0000","last_clean":"2023-11-26T07:11:34.625771+0000","last_became_active":"2023-11-26T07:11:33.643725+0000","last_became_peered":"2023-11-26T07:11:33.643725+0000","last_unstale":"2023-11-26T07:11:34.625771+0000","last_undegraded":"2023-11-26T07:11:34.625771+0000","last_fullsized":"2023-11-26T07:11:34.625771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:35:23.512252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015299+0000","last_change":"2023-11-26T07:11:34.639960+0000","last_active":"2023-11-26T07:11:37.015299+0000","last_peered":"2023-11-26T07:11:37.015299+0000","last_clean":"2023-11-26T07:11:37.015299+0000","last_became_active":"2023-11-26T07:11:34.639582+0000","last_became_peered":"2023-11-26T07:11:34.639582+0000","last_unstale":"2023-11-26T07:11:37.015299+0000","last_undegraded":"2023-11-26T07:11:37.015299+0000","last_fullsized":"2023-11-26T07:11:37.015299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:32:03.590472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.659287+0000","last_change":"2023-11-26T07:11:33.640210+0000","last_active":"2023-11-26T07:11:34.659287+0000","last_peered":"2023-11-26T07:11:34.659287+0000","last_clean":"2023-11-26T07:11:34.659287+0000","last_became_active":"2023-11-26T07:11:33.639920+0000","last_became_peered":"2023-11-26T07:11:33.639920+0000","last_unstale":"2023-11-26T07:11:34.659287+0000","last_undegraded":"2023-11-26T07:11:34.659287+0000","last_fullsized":"2023-11-26T07:11:34.659287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:34:26.124632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052803+0000","last_change":"2023-11-26T07:11:34.654053+0000","last_active":"2023-11-26T07:11:37.052803+0000","last_peered":"2023-11-26T07:11:37.052803+0000","last_clean":"2023-11-26T07:11:37.052803+0000","last_became_active":"2023-11-26T07:11:34.653682+0000","last_became_peered":"2023-11-26T07:11:34.653682+0000","last_unstale":"2023-11-26T07:11:37.052803+0000","last_undegraded":"2023-11-26T07:11:37.052803+0000","last_fullsized":"2023-11-26T07:11:37.052803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:00:10.960837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.633167+0000","last_change":"2023-11-26T07:11:33.641257+0000","last_active":"2023-11-26T07:11:34.633167+0000","last_peered":"2023-11-26T07:11:34.633167+0000","last_clean":"2023-11-26T07:11:34.633167+0000","last_became_active":"2023-11-26T07:11:33.640986+0000","last_became_peered":"2023-11-26T07:11:33.640986+0000","last_unstale":"2023-11-26T07:11:34.633167+0000","last_undegraded":"2023-11-26T07:11:34.633167+0000","last_fullsized":"2023-11-26T07:11:34.633167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:23:12.391144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.655448+0000","last_change":"2023-11-26T07:11:34.648421+0000","last_active":"2023-11-26T07:11:34.655448+0000","last_peered":"2023-11-26T07:11:34.655448+0000","last_clean":"2023-11-26T07:11:34.655448+0000","last_became_active":"2023-11-26T07:11:34.648144+0000","last_became_peered":"2023-11-26T07:11:34.648144+0000","last_unstale":"2023-11-26T07:11:34.655448+0000","last_undegraded":"2023-11-26T07:11:34.655448+0000","last_fullsized":"2023-11-26T07:11:34.655448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:07:08.839200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.659120+0000","last_change":"2023-11-26T07:11:33.635219+0000","last_active":"2023-11-26T07:11:34.659120+0000","last_peered":"2023-11-26T07:11:34.659120+0000","last_clean":"2023-11-26T07:11:34.659120+0000","last_became_active":"2023-11-26T07:11:33.634823+0000","last_became_peered":"2023-11-26T07:11:33.634823+0000","last_unstale":"2023-11-26T07:11:34.659120+0000","last_undegraded":"2023-11-26T07:11:34.659120+0000","last_fullsized":"2023-11-26T07:11:34.659120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:46:01.876918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.639554+0000","last_change":"2023-11-26T07:11:34.647738+0000","last_active":"2023-11-26T07:11:35.639554+0000","last_peered":"2023-11-26T07:11:35.639554+0000","last_clean":"2023-11-26T07:11:35.639554+0000","last_became_active":"2023-11-26T07:11:34.647392+0000","last_became_peered":"2023-11-26T07:11:34.647392+0000","last_unstale":"2023-11-26T07:11:35.639554+0000","last_undegraded":"2023-11-26T07:11:35.639554+0000","last_fullsized":"2023-11-26T07:11:35.639554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:47:06.786241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.657218+0000","last_change":"2023-11-26T07:11:33.640058+0000","last_active":"2023-11-26T07:11:34.657218+0000","last_peered":"2023-11-26T07:11:34.657218+0000","last_clean":"2023-11-26T07:11:34.657218+0000","last_became_active":"2023-11-26T07:11:33.639705+0000","last_became_peered":"2023-11-26T07:11:33.639705+0000","last_unstale":"2023-11-26T07:11:34.657218+0000","last_undegraded":"2023-11-26T07:11:34.657218+0000","last_fullsized":"2023-11-26T07:11:34.657218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:35:23.512252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.646764+0000","last_change":"2023-11-26T07:11:34.644169+0000","last_active":"2023-11-26T07:11:34.646764+0000","last_peered":"2023-11-26T07:11:34.646764+0000","last_clean":"2023-11-26T07:11:34.646764+0000","last_became_active":"2023-11-26T07:11:34.643368+0000","last_became_peered":"2023-11-26T07:11:34.643368+0000","last_unstale":"2023-11-26T07:11:34.646764+0000","last_undegraded":"2023-11-26T07:11:34.646764+0000","last_fullsized":"2023-11-26T07:11:34.646764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:06:28.926253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052532+0000","last_change":"2023-11-26T07:11:34.647950+0000","last_active":"2023-11-26T07:11:37.052532+0000","last_peered":"2023-11-26T07:11:37.052532+0000","last_clean":"2023-11-26T07:11:37.052532+0000","last_became_active":"2023-11-26T07:11:34.647506+0000","last_became_peered":"2023-11-26T07:11:34.647506+0000","last_unstale":"2023-11-26T07:11:37.052532+0000","last_undegraded":"2023-11-26T07:11:37.052532+0000","last_fullsized":"2023-11-26T07:11:37.052532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:34:27.129920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.650494+0000","last_change":"2023-11-26T07:11:34.646505+0000","last_active":"2023-11-26T07:11:34.650494+0000","last_peered":"2023-11-26T07:11:34.650494+0000","last_clean":"2023-11-26T07:11:34.650494+0000","last_became_active":"2023-11-26T07:11:34.646188+0000","last_became_peered":"2023-11-26T07:11:34.646188+0000","last_unstale":"2023-11-26T07:11:34.650494+0000","last_undegraded":"2023-11-26T07:11:34.650494+0000","last_fullsized":"2023-11-26T07:11:34.650494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:18:53.364543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.639195+0000","last_change":"2023-11-26T07:11:34.648874+0000","last_active":"2023-11-26T07:11:35.639195+0000","last_peered":"2023-11-26T07:11:35.639195+0000","last_clean":"2023-11-26T07:11:35.639195+0000","last_became_active":"2023-11-26T07:11:34.648306+0000","last_became_peered":"2023-11-26T07:11:34.648306+0000","last_unstale":"2023-11-26T07:11:35.639195+0000","last_undegraded":"2023-11-26T07:11:35.639195+0000","last_fullsized":"2023-11-26T07:11:35.639195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:25:36.494823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.987274+0000","last_change":"2023-11-26T07:11:34.644678+0000","last_active":"2023-11-26T07:11:36.987274+0000","last_peered":"2023-11-26T07:11:36.987274+0000","last_clean":"2023-11-26T07:11:36.987274+0000","last_became_active":"2023-11-26T07:11:34.644208+0000","last_became_peered":"2023-11-26T07:11:34.644208+0000","last_unstale":"2023-11-26T07:11:36.987274+0000","last_undegraded":"2023-11-26T07:11:36.987274+0000","last_fullsized":"2023-11-26T07:11:36.987274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:06:28.926253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015420+0000","last_change":"2023-11-26T07:11:34.654093+0000","last_active":"2023-11-26T07:11:37.015420+0000","last_peered":"2023-11-26T07:11:37.015420+0000","last_clean":"2023-11-26T07:11:37.015420+0000","last_became_active":"2023-11-26T07:11:34.653772+0000","last_became_peered":"2023-11-26T07:11:34.653772+0000","last_unstale":"2023-11-26T07:11:37.015420+0000","last_undegraded":"2023-11-26T07:11:37.015420+0000","last_fullsized":"2023-11-26T07:11:37.015420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:25:36.494823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.643829+0000","last_change":"2023-11-26T07:11:34.641180+0000","last_active":"2023-11-26T07:11:34.643829+0000","last_peered":"2023-11-26T07:11:34.643829+0000","last_clean":"2023-11-26T07:11:34.643829+0000","last_became_active":"2023-11-26T07:11:34.640883+0000","last_became_peered":"2023-11-26T07:11:34.640883+0000","last_unstale":"2023-11-26T07:11:34.643829+0000","last_undegraded":"2023-11-26T07:11:34.643829+0000","last_fullsized":"2023-11-26T07:11:34.643829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:37:23.214446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052794+0000","last_change":"2023-11-26T07:11:34.649166+0000","last_active":"2023-11-26T07:11:37.052794+0000","last_peered":"2023-11-26T07:11:37.052794+0000","last_clean":"2023-11-26T07:11:37.052794+0000","last_became_active":"2023-11-26T07:11:34.647969+0000","last_became_peered":"2023-11-26T07:11:34.647969+0000","last_unstale":"2023-11-26T07:11:37.052794+0000","last_undegraded":"2023-11-26T07:11:37.052794+0000","last_fullsized":"2023-11-26T07:11:37.052794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:07:08.839200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015324+0000","last_change":"2023-11-26T07:11:34.642588+0000","last_active":"2023-11-26T07:11:37.015324+0000","last_peered":"2023-11-26T07:11:37.015324+0000","last_clean":"2023-11-26T07:11:37.015324+0000","last_became_active":"2023-11-26T07:11:34.642248+0000","last_became_peered":"2023-11-26T07:11:34.642248+0000","last_unstale":"2023-11-26T07:11:37.015324+0000","last_undegraded":"2023-11-26T07:11:37.015324+0000","last_fullsized":"2023-11-26T07:11:37.015324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:32:36.834153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.638896+0000","last_change":"2023-11-26T07:11:34.647562+0000","last_active":"2023-11-26T07:11:35.638896+0000","last_peered":"2023-11-26T07:11:35.638896+0000","last_clean":"2023-11-26T07:11:35.638896+0000","last_became_active":"2023-11-26T07:11:34.647274+0000","last_became_peered":"2023-11-26T07:11:34.647274+0000","last_unstale":"2023-11-26T07:11:35.638896+0000","last_undegraded":"2023-11-26T07:11:35.638896+0000","last_fullsized":"2023-11-26T07:11:35.638896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:06:28.926253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015070+0000","last_change":"2023-11-26T07:11:34.644535+0000","last_active":"2023-11-26T07:11:37.015070+0000","last_peered":"2023-11-26T07:11:37.015070+0000","last_clean":"2023-11-26T07:11:37.015070+0000","last_became_active":"2023-11-26T07:11:34.644188+0000","last_became_peered":"2023-11-26T07:11:34.644188+0000","last_unstale":"2023-11-26T07:11:37.015070+0000","last_undegraded":"2023-11-26T07:11:37.015070+0000","last_fullsized":"2023-11-26T07:11:37.015070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:07:08.839200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.638979+0000","last_change":"2023-11-26T07:11:34.650901+0000","last_active":"2023-11-26T07:11:35.638979+0000","last_peered":"2023-11-26T07:11:35.638979+0000","last_clean":"2023-11-26T07:11:35.638979+0000","last_became_active":"2023-11-26T07:11:34.647833+0000","last_became_peered":"2023-11-26T07:11:34.647833+0000","last_unstale":"2023-11-26T07:11:35.638979+0000","last_undegraded":"2023-11-26T07:11:35.638979+0000","last_fullsized":"2023-11-26T07:11:35.638979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:32:36.834153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.987234+0000","last_change":"2023-11-26T07:11:34.646704+0000","last_active":"2023-11-26T07:11:36.987234+0000","last_peered":"2023-11-26T07:11:36.987234+0000","last_clean":"2023-11-26T07:11:36.987234+0000","last_became_active":"2023-11-26T07:11:34.646178+0000","last_became_peered":"2023-11-26T07:11:34.646178+0000","last_unstale":"2023-11-26T07:11:36.987234+0000","last_undegraded":"2023-11-26T07:11:36.987234+0000","last_fullsized":"2023-11-26T07:11:36.987234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:09:14.653647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052917+0000","last_change":"2023-11-26T07:11:34.657780+0000","last_active":"2023-11-26T07:11:37.052917+0000","last_peered":"2023-11-26T07:11:37.052917+0000","last_clean":"2023-11-26T07:11:37.052917+0000","last_became_active":"2023-11-26T07:11:34.657459+0000","last_became_peered":"2023-11-26T07:11:34.657459+0000","last_unstale":"2023-11-26T07:11:37.052917+0000","last_undegraded":"2023-11-26T07:11:37.052917+0000","last_fullsized":"2023-11-26T07:11:37.052917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:06:28.926253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":660231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":70893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":69441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":823296,"data_stored":666587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":69281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":70893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":75707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:11:38.833 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:11:38.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.989+0000 7f5064f79700 1 Processor -- start 2023-11-26T07:11:38.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.989+0000 7f5064f79700 1 -- start start 2023-11-26T07:11:38.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.990+0000 7f5064f79700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5060144c10 0x7f506006afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:38.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.990+0000 7f5064f79700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5060145100 0x7f506006b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:38.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.990+0000 7f5064f79700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f506006eb80 con 0x7f5060145650 2023-11-26T07:11:38.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.990+0000 7f5064f79700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f506006f500 con 0x7f5060144c10 2023-11-26T07:11:38.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.990+0000 7f5064f79700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50600cd610 con 0x7f5060145100 2023-11-26T07:11:38.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.991+0000 7f505e59c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5060144c10 0x7f506006afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:38.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.991+0000 7f505e59c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5060144c10 0x7f506006afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38902/0 (socket says 172.21.15.2:38902) 2023-11-26T07:11:38.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.991+0000 7f505e59c700 1 -- 172.21.15.2:0/2059818759 learned_addr learned my addr 172.21.15.2:0/2059818759 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:38.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.991+0000 7f505dd9b700 1 --2- 172.21.15.2:0/2059818759 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5060145100 0x7f506006b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:38.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.991+0000 7f505e59c700 1 -- 172.21.15.2:0/2059818759 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5060145100 msgr2=0x7f506006b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:38.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.991+0000 7f505e59c700 1 --2- 172.21.15.2:0/2059818759 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5060145100 0x7f506006b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:38.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.991+0000 7f505e59c700 1 -- 172.21.15.2:0/2059818759 >> v1:172.21.15.192:6789/0 conn(0x7f5060145650 legacy=0x7f5060071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:38.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.991+0000 7f505e59c700 1 -- 172.21.15.2:0/2059818759 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5060160720 con 0x7f5060144c10 2023-11-26T07:11:38.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.991+0000 7f505dd9b700 1 --2- 172.21.15.2:0/2059818759 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5060145100 0x7f506006b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:11:38.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.991+0000 7f505e59c700 1 --2- 172.21.15.2:0/2059818759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5060144c10 0x7f506006afd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f50480098f0 tx=0x7f5048009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c6dc59de3dc5f14 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:38.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.991+0000 7f505d59a700 1 -- 172.21.15.2:0/2059818759 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5048004230 con 0x7f5060144c10 2023-11-26T07:11:38.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.991+0000 7f505d59a700 1 -- 172.21.15.2:0/2059818759 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5048004390 con 0x7f5060144c10 2023-11-26T07:11:38.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.991+0000 7f505d59a700 1 -- 172.21.15.2:0/2059818759 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50480036a0 con 0x7f5060144c10 2023-11-26T07:11:38.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.992+0000 7f5064f79700 1 -- 172.21.15.2:0/2059818759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5060144c10 msgr2=0x7f506006afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:38.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.992+0000 7f5064f79700 1 --2- 172.21.15.2:0/2059818759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5060144c10 0x7f506006afd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f50480098f0 tx=0x7f5048009c00 comp rx=0 tx=0).stop 2023-11-26T07:11:38.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.992+0000 7f5064f79700 1 -- 172.21.15.2:0/2059818759 shutdown_connections 2023-11-26T07:11:38.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.992+0000 7f5064f79700 1 --2- 172.21.15.2:0/2059818759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5060144c10 0x7f506006afd0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:38.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.992+0000 7f5064f79700 1 --2- 172.21.15.2:0/2059818759 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5060145100 0x7f506006b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:38.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.992+0000 7f5064f79700 1 -- 172.21.15.2:0/2059818759 >> 172.21.15.2:0/2059818759 conn(0x7f50600b2740 msgr2=0x7f50600b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:38.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.992+0000 7f5064f79700 1 -- 172.21.15.2:0/2059818759 shutdown_connections 2023-11-26T07:11:38.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.992+0000 7f5064f79700 1 -- 172.21.15.2:0/2059818759 wait complete. 2023-11-26T07:11:39.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.993+0000 7f5064f79700 1 Processor -- start 2023-11-26T07:11:39.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.993+0000 7f5064f79700 1 -- start start 2023-11-26T07:11:39.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.994+0000 7f5064f79700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5060144c10 0x7f506013b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:39.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.994+0000 7f5064f79700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5060145100 0x7f506015c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:39.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.994+0000 7f5064f79700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5060145650 0x7f506015a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:39.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.994+0000 7f5064f79700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50601f1880 con 0x7f5060145650 2023-11-26T07:11:39.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.994+0000 7f5064f79700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506013cd20 con 0x7f5060145100 2023-11-26T07:11:39.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.994+0000 7f5064f79700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506013b810 con 0x7f5060144c10 2023-11-26T07:11:39.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.994+0000 7f505ed9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5060145650 0x7f506015a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:39.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.994+0000 7f505ed9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5060145650 0x7f506015a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38912/0 (socket says 172.21.15.2:38912) 2023-11-26T07:11:39.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.994+0000 7f505ed9d700 1 -- 172.21.15.2:0/3749313090 learned_addr learned my addr 172.21.15.2:0/3749313090 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:39.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.994+0000 7f505dd9b700 1 --2- 172.21.15.2:0/3749313090 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5060145100 0x7f506015c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:39.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.994+0000 7f505e59c700 1 --2- 172.21.15.2:0/3749313090 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5060144c10 0x7f506013b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:39.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.994+0000 7f505ed9d700 1 -- 172.21.15.2:0/3749313090 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5060144c10 msgr2=0x7f506013b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:39.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.994+0000 7f505ed9d700 1 --2- 172.21.15.2:0/3749313090 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5060144c10 0x7f506013b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:39.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.994+0000 7f505ed9d700 1 -- 172.21.15.2:0/3749313090 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5060145100 msgr2=0x7f506015c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:39.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.994+0000 7f505ed9d700 1 --2- 172.21.15.2:0/3749313090 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5060145100 0x7f506015c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:39.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.994+0000 7f505ed9d700 1 -- 172.21.15.2:0/3749313090 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5048009550 con 0x7f5060145650 2023-11-26T07:11:39.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.994+0000 7f505dd9b700 1 --2- 172.21.15.2:0/3749313090 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5060145100 0x7f506015c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:11:39.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.994+0000 7f505ed9d700 1 --2- 172.21.15.2:0/3749313090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5060145650 0x7f506015a920 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f505800b970 tx=0x7f505800bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:39.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.995+0000 7f5056ffd700 1 -- 172.21.15.2:0/3749313090 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505800c9b0 con 0x7f5060145650 2023-11-26T07:11:39.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.995+0000 7f5056ffd700 1 -- 172.21.15.2:0/3749313090 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f505800cb10 con 0x7f5060145650 2023-11-26T07:11:39.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.995+0000 7f5064f79700 1 -- 172.21.15.2:0/3749313090 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f506013baf0 con 0x7f5060145650 2023-11-26T07:11:39.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.995+0000 7f5056ffd700 1 -- 172.21.15.2:0/3749313090 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5058014440 con 0x7f5060145650 2023-11-26T07:11:39.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.995+0000 7f5064f79700 1 -- 172.21.15.2:0/3749313090 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50601e67d0 con 0x7f5060145650 2023-11-26T07:11:39.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.996+0000 7f5064f79700 1 -- 172.21.15.2:0/3749313090 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50600cda40 con 0x7f5060145650 2023-11-26T07:11:39.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.996+0000 7f5056ffd700 1 -- 172.21.15.2:0/3749313090 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f505801d3b0 con 0x7f5060145650 2023-11-26T07:11:39.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.997+0000 7f5056ffd700 1 --2- 172.21.15.2:0/3749313090 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f504006aed0 0x7f504006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:39.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.997+0000 7f5056ffd700 1 -- 172.21.15.2:0/3749313090 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5058089210 con 0x7f5060145650 2023-11-26T07:11:39.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.997+0000 7f505e59c700 1 --2- 172.21.15.2:0/3749313090 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f504006aed0 0x7f504006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:39.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:38.997+0000 7f505e59c700 1 --2- 172.21.15.2:0/3749313090 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f504006aed0 0x7f504006d390 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5048009840 tx=0x7f5048008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:39.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.001+0000 7f5056ffd700 1 -- 172.21.15.2:0/3749313090 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f50600cda40 con 0x7f5060145650 2023-11-26T07:11:39.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.198+0000 7f5064f79700 1 -- 172.21.15.2:0/3749313090 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f50601603b0 con 0x7f504006aed0 2023-11-26T07:11:39.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.206+0000 7f5056ffd700 1 -- 172.21.15.2:0/3749313090 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264709 (secure 0 0 0) 0x7f50480036a0 con 0x7f504006aed0 2023-11-26T07:11:39.211 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:11:39.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.209+0000 7f5064f79700 1 -- 172.21.15.2:0/3749313090 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f504006aed0 msgr2=0x7f504006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:39.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.209+0000 7f5064f79700 1 --2- 172.21.15.2:0/3749313090 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f504006aed0 0x7f504006d390 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5048009840 tx=0x7f5048008030 comp rx=0 tx=0).stop 2023-11-26T07:11:39.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.209+0000 7f5064f79700 1 -- 172.21.15.2:0/3749313090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5060145650 msgr2=0x7f506015a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:39.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.209+0000 7f5064f79700 1 --2- 172.21.15.2:0/3749313090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5060145650 0x7f506015a920 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f505800b970 tx=0x7f505800bd30 comp rx=0 tx=0).stop 2023-11-26T07:11:39.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.209+0000 7f5064f79700 1 -- 172.21.15.2:0/3749313090 shutdown_connections 2023-11-26T07:11:39.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.209+0000 7f5064f79700 1 --2- 172.21.15.2:0/3749313090 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f504006aed0 0x7f504006d390 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:39.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.209+0000 7f5064f79700 1 --2- 172.21.15.2:0/3749313090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5060145650 0x7f506015a920 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:39.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.209+0000 7f5064f79700 1 --2- 172.21.15.2:0/3749313090 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5060144c10 0x7f506013b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:39.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.209+0000 7f5064f79700 1 --2- 172.21.15.2:0/3749313090 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5060145100 0x7f506015c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:39.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.209+0000 7f5064f79700 1 -- 172.21.15.2:0/3749313090 >> 172.21.15.2:0/3749313090 conn(0x7f50600b2740 msgr2=0x7f50600d12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:39.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.209+0000 7f5064f79700 1 -- 172.21.15.2:0/3749313090 shutdown_connections 2023-11-26T07:11:39.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.209+0000 7f5064f79700 1 -- 172.21.15.2:0/3749313090 wait complete. 2023-11-26T07:11:39.215 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-26T07:11:39.224 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-11-26T07:11:38.153261+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":151,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219032,"kb_used_data":2860,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755688,"statfs":{"total":773094113280,"available":772869824512,"internally_reserved":0,"allocated":2928640,"data_stored":1758704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.536604"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.655448+0000","last_change":"2023-11-26T07:11:34.649320+0000","last_active":"2023-11-26T07:11:34.655448+0000","last_peered":"2023-11-26T07:11:34.655448+0000","last_clean":"2023-11-26T07:11:34.655448+0000","last_became_active":"2023-11-26T07:11:34.649061+0000","last_became_peered":"2023-11-26T07:11:34.649061+0000","last_unstale":"2023-11-26T07:11:34.655448+0000","last_undegraded":"2023-11-26T07:11:34.655448+0000","last_fullsized":"2023-11-26T07:11:34.655448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:09:14.653647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.640072+0000","last_change":"2023-11-26T07:11:34.635586+0000","last_active":"2023-11-26T07:11:34.640072+0000","last_peered":"2023-11-26T07:11:34.640072+0000","last_clean":"2023-11-26T07:11:34.640072+0000","last_became_active":"2023-11-26T07:11:34.635093+0000","last_became_peered":"2023-11-26T07:11:34.635093+0000","last_unstale":"2023-11-26T07:11:34.640072+0000","last_undegraded":"2023-11-26T07:11:34.640072+0000","last_fullsized":"2023-11-26T07:11:34.640072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:54:56.361323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.987146+0000","last_change":"2023-11-26T07:11:34.637021+0000","last_active":"2023-11-26T07:11:36.987146+0000","last_peered":"2023-11-26T07:11:36.987146+0000","last_clean":"2023-11-26T07:11:36.987146+0000","last_became_active":"2023-11-26T07:11:34.636666+0000","last_became_peered":"2023-11-26T07:11:34.636666+0000","last_unstale":"2023-11-26T07:11:36.987146+0000","last_undegraded":"2023-11-26T07:11:36.987146+0000","last_fullsized":"2023-11-26T07:11:36.987146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:07:08.839200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.639275+0000","last_change":"2023-11-26T07:11:34.647792+0000","last_active":"2023-11-26T07:11:35.639275+0000","last_peered":"2023-11-26T07:11:35.639275+0000","last_clean":"2023-11-26T07:11:35.639275+0000","last_became_active":"2023-11-26T07:11:34.647409+0000","last_became_peered":"2023-11-26T07:11:34.647409+0000","last_unstale":"2023-11-26T07:11:35.639275+0000","last_undegraded":"2023-11-26T07:11:35.639275+0000","last_fullsized":"2023-11-26T07:11:35.639275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:41:41.780777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.652921+0000","last_change":"2023-11-26T07:11:34.645909+0000","last_active":"2023-11-26T07:11:34.652921+0000","last_peered":"2023-11-26T07:11:34.652921+0000","last_clean":"2023-11-26T07:11:34.652921+0000","last_became_active":"2023-11-26T07:11:34.645102+0000","last_became_peered":"2023-11-26T07:11:34.645102+0000","last_unstale":"2023-11-26T07:11:34.652921+0000","last_undegraded":"2023-11-26T07:11:34.652921+0000","last_fullsized":"2023-11-26T07:11:34.652921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:54:56.361323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.638941+0000","last_change":"2023-11-26T07:11:34.648690+0000","last_active":"2023-11-26T07:11:35.638941+0000","last_peered":"2023-11-26T07:11:35.638941+0000","last_clean":"2023-11-26T07:11:35.638941+0000","last_became_active":"2023-11-26T07:11:34.648021+0000","last_became_peered":"2023-11-26T07:11:34.648021+0000","last_unstale":"2023-11-26T07:11:35.638941+0000","last_undegraded":"2023-11-26T07:11:35.638941+0000","last_fullsized":"2023-11-26T07:11:35.638941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:32:03.590472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.643007+0000","last_change":"2023-11-26T07:11:34.635808+0000","last_active":"2023-11-26T07:11:34.643007+0000","last_peered":"2023-11-26T07:11:34.643007+0000","last_clean":"2023-11-26T07:11:34.643007+0000","last_became_active":"2023-11-26T07:11:34.635521+0000","last_became_peered":"2023-11-26T07:11:34.635521+0000","last_unstale":"2023-11-26T07:11:34.643007+0000","last_undegraded":"2023-11-26T07:11:34.643007+0000","last_fullsized":"2023-11-26T07:11:34.643007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:23:13.396432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.014983+0000","last_change":"2023-11-26T07:11:34.649016+0000","last_active":"2023-11-26T07:11:37.014983+0000","last_peered":"2023-11-26T07:11:37.014983+0000","last_clean":"2023-11-26T07:11:37.014983+0000","last_became_active":"2023-11-26T07:11:34.648684+0000","last_became_peered":"2023-11-26T07:11:34.648684+0000","last_unstale":"2023-11-26T07:11:37.014983+0000","last_undegraded":"2023-11-26T07:11:37.014983+0000","last_fullsized":"2023-11-26T07:11:37.014983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:34:27.129920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.652847+0000","last_change":"2023-11-26T07:11:34.647310+0000","last_active":"2023-11-26T07:11:34.652847+0000","last_peered":"2023-11-26T07:11:34.652847+0000","last_clean":"2023-11-26T07:11:34.652847+0000","last_became_active":"2023-11-26T07:11:34.646750+0000","last_became_peered":"2023-11-26T07:11:34.646750+0000","last_unstale":"2023-11-26T07:11:34.652847+0000","last_undegraded":"2023-11-26T07:11:34.652847+0000","last_fullsized":"2023-11-26T07:11:34.652847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:44:14.102458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052935+0000","last_change":"2023-11-26T07:11:34.648387+0000","last_active":"2023-11-26T07:11:37.052935+0000","last_peered":"2023-11-26T07:11:37.052935+0000","last_clean":"2023-11-26T07:11:37.052935+0000","last_became_active":"2023-11-26T07:11:34.646866+0000","last_became_peered":"2023-11-26T07:11:34.646866+0000","last_unstale":"2023-11-26T07:11:37.052935+0000","last_undegraded":"2023-11-26T07:11:37.052935+0000","last_fullsized":"2023-11-26T07:11:37.052935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:32:03.590472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052752+0000","last_change":"2023-11-26T07:11:34.648155+0000","last_active":"2023-11-26T07:11:37.052752+0000","last_peered":"2023-11-26T07:11:37.052752+0000","last_clean":"2023-11-26T07:11:37.052752+0000","last_became_active":"2023-11-26T07:11:34.647811+0000","last_became_peered":"2023-11-26T07:11:34.647811+0000","last_unstale":"2023-11-26T07:11:37.052752+0000","last_undegraded":"2023-11-26T07:11:37.052752+0000","last_fullsized":"2023-11-26T07:11:37.052752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:03:49.221463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.641148+0000","last_change":"2023-11-26T07:11:34.655197+0000","last_active":"2023-11-26T07:11:35.641148+0000","last_peered":"2023-11-26T07:11:35.641148+0000","last_clean":"2023-11-26T07:11:35.641148+0000","last_became_active":"2023-11-26T07:11:34.654929+0000","last_became_peered":"2023-11-26T07:11:34.654929+0000","last_unstale":"2023-11-26T07:11:35.641148+0000","last_undegraded":"2023-11-26T07:11:35.641148+0000","last_fullsized":"2023-11-26T07:11:35.641148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:13:11.105677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015134+0000","last_change":"2023-11-26T07:11:34.649022+0000","last_active":"2023-11-26T07:11:37.015134+0000","last_peered":"2023-11-26T07:11:37.015134+0000","last_clean":"2023-11-26T07:11:37.015134+0000","last_became_active":"2023-11-26T07:11:34.648395+0000","last_became_peered":"2023-11-26T07:11:34.648395+0000","last_unstale":"2023-11-26T07:11:37.015134+0000","last_undegraded":"2023-11-26T07:11:37.015134+0000","last_fullsized":"2023-11-26T07:11:37.015134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:00:10.960837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.986910+0000","last_change":"2023-11-26T07:11:34.637714+0000","last_active":"2023-11-26T07:11:36.986910+0000","last_peered":"2023-11-26T07:11:36.986910+0000","last_clean":"2023-11-26T07:11:36.986910+0000","last_became_active":"2023-11-26T07:11:34.637398+0000","last_became_peered":"2023-11-26T07:11:34.637398+0000","last_unstale":"2023-11-26T07:11:36.986910+0000","last_undegraded":"2023-11-26T07:11:36.986910+0000","last_fullsized":"2023-11-26T07:11:36.986910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:27:38.431121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.654866+0000","last_change":"2023-11-26T07:11:34.653279+0000","last_active":"2023-11-26T07:11:34.654866+0000","last_peered":"2023-11-26T07:11:34.654866+0000","last_clean":"2023-11-26T07:11:34.654866+0000","last_became_active":"2023-11-26T07:11:34.652965+0000","last_became_peered":"2023-11-26T07:11:34.652965+0000","last_unstale":"2023-11-26T07:11:34.654866+0000","last_undegraded":"2023-11-26T07:11:34.654866+0000","last_fullsized":"2023-11-26T07:11:34.654866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:54:31.334401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.638623+0000","last_change":"2023-11-26T07:11:34.644467+0000","last_active":"2023-11-26T07:11:35.638623+0000","last_peered":"2023-11-26T07:11:35.638623+0000","last_clean":"2023-11-26T07:11:35.638623+0000","last_became_active":"2023-11-26T07:11:34.644215+0000","last_became_peered":"2023-11-26T07:11:34.644215+0000","last_unstale":"2023-11-26T07:11:35.638623+0000","last_undegraded":"2023-11-26T07:11:35.638623+0000","last_fullsized":"2023-11-26T07:11:35.638623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:09:14.653647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.639493+0000","last_change":"2023-11-26T07:11:34.646080+0000","last_active":"2023-11-26T07:11:35.639493+0000","last_peered":"2023-11-26T07:11:35.639493+0000","last_clean":"2023-11-26T07:11:35.639493+0000","last_became_active":"2023-11-26T07:11:34.645810+0000","last_became_peered":"2023-11-26T07:11:34.645810+0000","last_unstale":"2023-11-26T07:11:35.639493+0000","last_undegraded":"2023-11-26T07:11:35.639493+0000","last_fullsized":"2023-11-26T07:11:35.639493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:03:47.829221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.655822+0000","last_change":"2023-11-26T07:11:34.650792+0000","last_active":"2023-11-26T07:11:34.655822+0000","last_peered":"2023-11-26T07:11:34.655822+0000","last_clean":"2023-11-26T07:11:34.655822+0000","last_became_active":"2023-11-26T07:11:34.650453+0000","last_became_peered":"2023-11-26T07:11:34.650453+0000","last_unstale":"2023-11-26T07:11:34.655822+0000","last_undegraded":"2023-11-26T07:11:34.655822+0000","last_fullsized":"2023-11-26T07:11:34.655822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:49:34.044448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.645600+0000","last_change":"2023-11-26T07:11:34.642316+0000","last_active":"2023-11-26T07:11:34.645600+0000","last_peered":"2023-11-26T07:11:34.645600+0000","last_clean":"2023-11-26T07:11:34.645600+0000","last_became_active":"2023-11-26T07:11:34.641966+0000","last_became_peered":"2023-11-26T07:11:34.641966+0000","last_unstale":"2023-11-26T07:11:34.645600+0000","last_undegraded":"2023-11-26T07:11:34.645600+0000","last_fullsized":"2023-11-26T07:11:34.645600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:37:23.214446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.987157+0000","last_change":"2023-11-26T07:11:33.642542+0000","last_active":"2023-11-26T07:11:36.987157+0000","last_peered":"2023-11-26T07:11:36.987157+0000","last_clean":"2023-11-26T07:11:36.987157+0000","last_became_active":"2023-11-26T07:11:33.642294+0000","last_became_peered":"2023-11-26T07:11:33.642294+0000","last_unstale":"2023-11-26T07:11:36.987157+0000","last_undegraded":"2023-11-26T07:11:36.987157+0000","last_fullsized":"2023-11-26T07:11:36.987157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:54:30.329113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015525+0000","last_change":"2023-11-26T07:11:34.649717+0000","last_active":"2023-11-26T07:11:37.015525+0000","last_peered":"2023-11-26T07:11:37.015525+0000","last_clean":"2023-11-26T07:11:37.015525+0000","last_became_active":"2023-11-26T07:11:34.649477+0000","last_became_peered":"2023-11-26T07:11:34.649477+0000","last_unstale":"2023-11-26T07:11:37.015525+0000","last_undegraded":"2023-11-26T07:11:37.015525+0000","last_fullsized":"2023-11-26T07:11:37.015525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:38:10.530811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015483+0000","last_change":"2023-11-26T07:11:33.645915+0000","last_active":"2023-11-26T07:11:37.015483+0000","last_peered":"2023-11-26T07:11:37.015483+0000","last_clean":"2023-11-26T07:11:37.015483+0000","last_became_active":"2023-11-26T07:11:33.645603+0000","last_became_peered":"2023-11-26T07:11:33.645603+0000","last_unstale":"2023-11-26T07:11:37.015483+0000","last_undegraded":"2023-11-26T07:11:37.015483+0000","last_fullsized":"2023-11-26T07:11:37.015483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:54:30.329113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.987052+0000","last_change":"2023-11-26T07:11:34.648199+0000","last_active":"2023-11-26T07:11:36.987052+0000","last_peered":"2023-11-26T07:11:36.987052+0000","last_clean":"2023-11-26T07:11:36.987052+0000","last_became_active":"2023-11-26T07:11:34.647906+0000","last_became_peered":"2023-11-26T07:11:34.647906+0000","last_unstale":"2023-11-26T07:11:36.987052+0000","last_undegraded":"2023-11-26T07:11:36.987052+0000","last_fullsized":"2023-11-26T07:11:36.987052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:34:27.129920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.658335+0000","last_change":"2023-11-26T07:11:33.643750+0000","last_active":"2023-11-26T07:11:34.658335+0000","last_peered":"2023-11-26T07:11:34.658335+0000","last_clean":"2023-11-26T07:11:34.658335+0000","last_became_active":"2023-11-26T07:11:33.643485+0000","last_became_peered":"2023-11-26T07:11:33.643485+0000","last_unstale":"2023-11-26T07:11:34.658335+0000","last_undegraded":"2023-11-26T07:11:34.658335+0000","last_fullsized":"2023-11-26T07:11:34.658335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:00:09.955548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.639381+0000","last_change":"2023-11-26T07:11:34.654171+0000","last_active":"2023-11-26T07:11:35.639381+0000","last_peered":"2023-11-26T07:11:35.639381+0000","last_clean":"2023-11-26T07:11:35.639381+0000","last_became_active":"2023-11-26T07:11:34.653773+0000","last_became_peered":"2023-11-26T07:11:34.653773+0000","last_unstale":"2023-11-26T07:11:35.639381+0000","last_undegraded":"2023-11-26T07:11:35.639381+0000","last_fullsized":"2023-11-26T07:11:35.639381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:16:17.444687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.657329+0000","last_change":"2023-11-26T07:11:33.643355+0000","last_active":"2023-11-26T07:11:34.657329+0000","last_peered":"2023-11-26T07:11:34.657329+0000","last_clean":"2023-11-26T07:11:34.657329+0000","last_became_active":"2023-11-26T07:11:33.643024+0000","last_became_peered":"2023-11-26T07:11:33.643024+0000","last_unstale":"2023-11-26T07:11:34.657329+0000","last_undegraded":"2023-11-26T07:11:34.657329+0000","last_fullsized":"2023-11-26T07:11:34.657329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:35:23.512252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.639894+0000","last_change":"2023-11-26T07:11:34.645965+0000","last_active":"2023-11-26T07:11:35.639894+0000","last_peered":"2023-11-26T07:11:35.639894+0000","last_clean":"2023-11-26T07:11:35.639894+0000","last_became_active":"2023-11-26T07:11:34.645636+0000","last_became_peered":"2023-11-26T07:11:34.645636+0000","last_unstale":"2023-11-26T07:11:35.639894+0000","last_undegraded":"2023-11-26T07:11:35.639894+0000","last_fullsized":"2023-11-26T07:11:35.639894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:42:53.462266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015241+0000","last_change":"2023-11-26T07:11:33.637866+0000","last_active":"2023-11-26T07:11:37.015241+0000","last_peered":"2023-11-26T07:11:37.015241+0000","last_clean":"2023-11-26T07:11:37.015241+0000","last_became_active":"2023-11-26T07:11:33.637478+0000","last_became_peered":"2023-11-26T07:11:33.637478+0000","last_unstale":"2023-11-26T07:11:37.015241+0000","last_undegraded":"2023-11-26T07:11:37.015241+0000","last_fullsized":"2023-11-26T07:11:37.015241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:46:01.876918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.640773+0000","last_change":"2023-11-26T07:11:34.636381+0000","last_active":"2023-11-26T07:11:35.640773+0000","last_peered":"2023-11-26T07:11:35.640773+0000","last_clean":"2023-11-26T07:11:35.640773+0000","last_became_active":"2023-11-26T07:11:34.636118+0000","last_became_peered":"2023-11-26T07:11:34.636118+0000","last_unstale":"2023-11-26T07:11:35.640773+0000","last_undegraded":"2023-11-26T07:11:35.640773+0000","last_fullsized":"2023-11-26T07:11:35.640773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:15:28.976045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052636+0000","last_change":"2023-11-26T07:11:33.638305+0000","last_active":"2023-11-26T07:11:37.052636+0000","last_peered":"2023-11-26T07:11:37.052636+0000","last_clean":"2023-11-26T07:11:37.052636+0000","last_became_active":"2023-11-26T07:11:33.637988+0000","last_became_peered":"2023-11-26T07:11:33.637988+0000","last_unstale":"2023-11-26T07:11:37.052636+0000","last_undegraded":"2023-11-26T07:11:37.052636+0000","last_fullsized":"2023-11-26T07:11:37.052636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:13:10.100388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.987409+0000","last_change":"2023-11-26T07:11:34.656184+0000","last_active":"2023-11-26T07:11:36.987409+0000","last_peered":"2023-11-26T07:11:36.987409+0000","last_clean":"2023-11-26T07:11:36.987409+0000","last_became_active":"2023-11-26T07:11:34.655583+0000","last_became_peered":"2023-11-26T07:11:34.655583+0000","last_unstale":"2023-11-26T07:11:36.987409+0000","last_undegraded":"2023-11-26T07:11:36.987409+0000","last_fullsized":"2023-11-26T07:11:36.987409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:32:03.590472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015050+0000","last_change":"2023-11-26T07:11:33.644381+0000","last_active":"2023-11-26T07:11:37.015050+0000","last_peered":"2023-11-26T07:11:37.015050+0000","last_clean":"2023-11-26T07:11:37.015050+0000","last_became_active":"2023-11-26T07:11:33.643634+0000","last_became_peered":"2023-11-26T07:11:33.643634+0000","last_unstale":"2023-11-26T07:11:37.015050+0000","last_undegraded":"2023-11-26T07:11:37.015050+0000","last_fullsized":"2023-11-26T07:11:37.015050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:37:22.209157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015147+0000","last_change":"2023-11-26T07:11:34.643595+0000","last_active":"2023-11-26T07:11:37.015147+0000","last_peered":"2023-11-26T07:11:37.015147+0000","last_clean":"2023-11-26T07:11:37.015147+0000","last_became_active":"2023-11-26T07:11:34.642017+0000","last_became_peered":"2023-11-26T07:11:34.642017+0000","last_unstale":"2023-11-26T07:11:37.015147+0000","last_undegraded":"2023-11-26T07:11:37.015147+0000","last_fullsized":"2023-11-26T07:11:37.015147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:09:14.653647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.638837+0000","last_change":"2023-11-26T07:11:33.634859+0000","last_active":"2023-11-26T07:11:35.638837+0000","last_peered":"2023-11-26T07:11:35.638837+0000","last_clean":"2023-11-26T07:11:35.638837+0000","last_became_active":"2023-11-26T07:11:33.634445+0000","last_became_peered":"2023-11-26T07:11:33.634445+0000","last_unstale":"2023-11-26T07:11:35.638837+0000","last_undegraded":"2023-11-26T07:11:35.638837+0000","last_fullsized":"2023-11-26T07:11:35.638837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:27:37.425832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.643523+0000","last_change":"2023-11-26T07:11:34.641077+0000","last_active":"2023-11-26T07:11:34.643523+0000","last_peered":"2023-11-26T07:11:34.643523+0000","last_clean":"2023-11-26T07:11:34.643523+0000","last_became_active":"2023-11-26T07:11:34.640778+0000","last_became_peered":"2023-11-26T07:11:34.640778+0000","last_unstale":"2023-11-26T07:11:34.643523+0000","last_undegraded":"2023-11-26T07:11:34.643523+0000","last_fullsized":"2023-11-26T07:11:34.643523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:44:14.102458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052858+0000","last_change":"2023-11-26T07:11:33.643806+0000","last_active":"2023-11-26T07:11:37.052858+0000","last_peered":"2023-11-26T07:11:37.052858+0000","last_clean":"2023-11-26T07:11:37.052858+0000","last_became_active":"2023-11-26T07:11:33.643066+0000","last_became_peered":"2023-11-26T07:11:33.643066+0000","last_unstale":"2023-11-26T07:11:37.052858+0000","last_undegraded":"2023-11-26T07:11:37.052858+0000","last_fullsized":"2023-11-26T07:11:37.052858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:54:30.329113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.639314+0000","last_change":"2023-11-26T07:11:34.642427+0000","last_active":"2023-11-26T07:11:35.639314+0000","last_peered":"2023-11-26T07:11:35.639314+0000","last_clean":"2023-11-26T07:11:35.639314+0000","last_became_active":"2023-11-26T07:11:34.642161+0000","last_became_peered":"2023-11-26T07:11:34.642161+0000","last_unstale":"2023-11-26T07:11:35.639314+0000","last_undegraded":"2023-11-26T07:11:35.639314+0000","last_fullsized":"2023-11-26T07:11:35.639314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:38:10.530811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.639263+0000","last_change":"2023-11-26T07:11:33.638930+0000","last_active":"2023-11-26T07:11:35.639263+0000","last_peered":"2023-11-26T07:11:35.639263+0000","last_clean":"2023-11-26T07:11:35.639263+0000","last_became_active":"2023-11-26T07:11:33.638636+0000","last_became_peered":"2023-11-26T07:11:33.638636+0000","last_unstale":"2023-11-26T07:11:35.639263+0000","last_undegraded":"2023-11-26T07:11:35.639263+0000","last_fullsized":"2023-11-26T07:11:35.639263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:54:30.329113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.987164+0000","last_change":"2023-11-26T07:11:34.648049+0000","last_active":"2023-11-26T07:11:36.987164+0000","last_peered":"2023-11-26T07:11:36.987164+0000","last_clean":"2023-11-26T07:11:36.987164+0000","last_became_active":"2023-11-26T07:11:34.647530+0000","last_became_peered":"2023-11-26T07:11:34.647530+0000","last_unstale":"2023-11-26T07:11:36.987164+0000","last_undegraded":"2023-11-26T07:11:36.987164+0000","last_fullsized":"2023-11-26T07:11:36.987164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:00:10.960837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.657580+0000","last_change":"2023-11-26T07:11:33.641284+0000","last_active":"2023-11-26T07:11:34.657580+0000","last_peered":"2023-11-26T07:11:34.657580+0000","last_clean":"2023-11-26T07:11:34.657580+0000","last_became_active":"2023-11-26T07:11:33.640977+0000","last_became_peered":"2023-11-26T07:11:33.640977+0000","last_unstale":"2023-11-26T07:11:34.657580+0000","last_undegraded":"2023-11-26T07:11:34.657580+0000","last_fullsized":"2023-11-26T07:11:34.657580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:27:37.425832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.641110+0000","last_change":"2023-11-26T07:11:34.655028+0000","last_active":"2023-11-26T07:11:35.641110+0000","last_peered":"2023-11-26T07:11:35.641110+0000","last_clean":"2023-11-26T07:11:35.641110+0000","last_became_active":"2023-11-26T07:11:34.654675+0000","last_became_peered":"2023-11-26T07:11:34.654675+0000","last_unstale":"2023-11-26T07:11:35.641110+0000","last_undegraded":"2023-11-26T07:11:35.641110+0000","last_fullsized":"2023-11-26T07:11:35.641110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:57:30.265272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052750+0000","last_change":"2023-11-26T07:11:33.640407+0000","last_active":"2023-11-26T07:11:37.052750+0000","last_peered":"2023-11-26T07:11:37.052750+0000","last_clean":"2023-11-26T07:11:37.052750+0000","last_became_active":"2023-11-26T07:11:33.640092+0000","last_became_peered":"2023-11-26T07:11:33.640092+0000","last_unstale":"2023-11-26T07:11:37.052750+0000","last_undegraded":"2023-11-26T07:11:37.052750+0000","last_fullsized":"2023-11-26T07:11:37.052750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:37:22.209157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.652832+0000","last_change":"2023-11-26T07:11:34.645251+0000","last_active":"2023-11-26T07:11:34.652832+0000","last_peered":"2023-11-26T07:11:34.652832+0000","last_clean":"2023-11-26T07:11:34.652832+0000","last_became_active":"2023-11-26T07:11:34.644995+0000","last_became_peered":"2023-11-26T07:11:34.644995+0000","last_unstale":"2023-11-26T07:11:34.652832+0000","last_undegraded":"2023-11-26T07:11:34.652832+0000","last_fullsized":"2023-11-26T07:11:34.652832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:27:38.431121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.987292+0000","last_change":"2023-11-26T07:11:33.639952+0000","last_active":"2023-11-26T07:11:36.987292+0000","last_peered":"2023-11-26T07:11:36.987292+0000","last_clean":"2023-11-26T07:11:36.987292+0000","last_became_active":"2023-11-26T07:11:33.639660+0000","last_became_peered":"2023-11-26T07:11:33.639660+0000","last_unstale":"2023-11-26T07:11:36.987292+0000","last_undegraded":"2023-11-26T07:11:36.987292+0000","last_fullsized":"2023-11-26T07:11:36.987292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:35:23.512252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.986952+0000","last_change":"2023-11-26T07:11:34.642918+0000","last_active":"2023-11-26T07:11:36.986952+0000","last_peered":"2023-11-26T07:11:36.986952+0000","last_clean":"2023-11-26T07:11:36.986952+0000","last_became_active":"2023-11-26T07:11:34.642455+0000","last_became_peered":"2023-11-26T07:11:34.642455+0000","last_unstale":"2023-11-26T07:11:36.986952+0000","last_undegraded":"2023-11-26T07:11:36.986952+0000","last_fullsized":"2023-11-26T07:11:36.986952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:44:14.102458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.639215+0000","last_change":"2023-11-26T07:11:33.643793+0000","last_active":"2023-11-26T07:11:35.639215+0000","last_peered":"2023-11-26T07:11:35.639215+0000","last_clean":"2023-11-26T07:11:35.639215+0000","last_became_active":"2023-11-26T07:11:33.643494+0000","last_became_peered":"2023-11-26T07:11:33.643494+0000","last_unstale":"2023-11-26T07:11:35.639215+0000","last_undegraded":"2023-11-26T07:11:35.639215+0000","last_fullsized":"2023-11-26T07:11:35.639215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:00:09.955548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.658535+0000","last_change":"2023-11-26T07:11:34.655763+0000","last_active":"2023-11-26T07:11:34.658535+0000","last_peered":"2023-11-26T07:11:34.658535+0000","last_clean":"2023-11-26T07:11:34.658535+0000","last_became_active":"2023-11-26T07:11:34.655507+0000","last_became_peered":"2023-11-26T07:11:34.655507+0000","last_unstale":"2023-11-26T07:11:34.658535+0000","last_undegraded":"2023-11-26T07:11:34.658535+0000","last_fullsized":"2023-11-26T07:11:34.658535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:54:31.334401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052504+0000","last_change":"2023-11-26T07:11:33.635838+0000","last_active":"2023-11-26T07:11:37.052504+0000","last_peered":"2023-11-26T07:11:37.052504+0000","last_clean":"2023-11-26T07:11:37.052504+0000","last_became_active":"2023-11-26T07:11:33.635540+0000","last_became_peered":"2023-11-26T07:11:33.635540+0000","last_unstale":"2023-11-26T07:11:37.052504+0000","last_undegraded":"2023-11-26T07:11:37.052504+0000","last_fullsized":"2023-11-26T07:11:37.052504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:54:55.356034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052841+0000","last_change":"2023-11-26T07:11:34.648800+0000","last_active":"2023-11-26T07:11:37.052841+0000","last_peered":"2023-11-26T07:11:37.052841+0000","last_clean":"2023-11-26T07:11:37.052841+0000","last_became_active":"2023-11-26T07:11:34.648164+0000","last_became_peered":"2023-11-26T07:11:34.648164+0000","last_unstale":"2023-11-26T07:11:37.052841+0000","last_undegraded":"2023-11-26T07:11:37.052841+0000","last_fullsized":"2023-11-26T07:11:37.052841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:09:14.653647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.656368+0000","last_change":"2023-11-26T07:11:33.638974+0000","last_active":"2023-11-26T07:11:34.656368+0000","last_peered":"2023-11-26T07:11:34.656368+0000","last_clean":"2023-11-26T07:11:34.656368+0000","last_became_active":"2023-11-26T07:11:33.638589+0000","last_became_peered":"2023-11-26T07:11:33.638589+0000","last_unstale":"2023-11-26T07:11:34.656368+0000","last_undegraded":"2023-11-26T07:11:34.656368+0000","last_fullsized":"2023-11-26T07:11:34.656368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:15:27.970756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.645499+0000","last_change":"2023-11-26T07:11:34.642385+0000","last_active":"2023-11-26T07:11:34.645499+0000","last_peered":"2023-11-26T07:11:34.645499+0000","last_clean":"2023-11-26T07:11:34.645499+0000","last_became_active":"2023-11-26T07:11:34.642090+0000","last_became_peered":"2023-11-26T07:11:34.642090+0000","last_unstale":"2023-11-26T07:11:34.645499+0000","last_undegraded":"2023-11-26T07:11:34.645499+0000","last_fullsized":"2023-11-26T07:11:34.645499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:57:30.265272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.641145+0000","last_change":"2023-11-26T07:11:33.637520+0000","last_active":"2023-11-26T07:11:35.641145+0000","last_peered":"2023-11-26T07:11:35.641145+0000","last_clean":"2023-11-26T07:11:35.641145+0000","last_became_active":"2023-11-26T07:11:33.637255+0000","last_became_peered":"2023-11-26T07:11:33.637255+0000","last_unstale":"2023-11-26T07:11:35.641145+0000","last_undegraded":"2023-11-26T07:11:35.641145+0000","last_fullsized":"2023-11-26T07:11:35.641145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:49:33.039159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.645467+0000","last_change":"2023-11-26T07:11:34.642552+0000","last_active":"2023-11-26T07:11:34.645467+0000","last_peered":"2023-11-26T07:11:34.645467+0000","last_clean":"2023-11-26T07:11:34.645467+0000","last_became_active":"2023-11-26T07:11:34.642252+0000","last_became_peered":"2023-11-26T07:11:34.642252+0000","last_unstale":"2023-11-26T07:11:34.645467+0000","last_undegraded":"2023-11-26T07:11:34.645467+0000","last_fullsized":"2023-11-26T07:11:34.645467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:13:11.105677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.625622+0000","last_change":"2023-11-26T07:11:33.645907+0000","last_active":"2023-11-26T07:11:34.625622+0000","last_peered":"2023-11-26T07:11:34.625622+0000","last_clean":"2023-11-26T07:11:34.625622+0000","last_became_active":"2023-11-26T07:11:33.645612+0000","last_became_peered":"2023-11-26T07:11:33.645612+0000","last_unstale":"2023-11-26T07:11:34.625622+0000","last_undegraded":"2023-11-26T07:11:34.625622+0000","last_fullsized":"2023-11-26T07:11:34.625622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:15:27.970756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.639689+0000","last_change":"2023-11-26T07:11:34.646582+0000","last_active":"2023-11-26T07:11:35.639689+0000","last_peered":"2023-11-26T07:11:35.639689+0000","last_clean":"2023-11-26T07:11:35.639689+0000","last_became_active":"2023-11-26T07:11:34.646107+0000","last_became_peered":"2023-11-26T07:11:34.646107+0000","last_unstale":"2023-11-26T07:11:35.639689+0000","last_undegraded":"2023-11-26T07:11:35.639689+0000","last_fullsized":"2023-11-26T07:11:35.639689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:36:07.899873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.639090+0000","last_change":"2023-11-26T07:11:33.635282+0000","last_active":"2023-11-26T07:11:35.639090+0000","last_peered":"2023-11-26T07:11:35.639090+0000","last_clean":"2023-11-26T07:11:35.639090+0000","last_became_active":"2023-11-26T07:11:33.634993+0000","last_became_peered":"2023-11-26T07:11:33.634993+0000","last_unstale":"2023-11-26T07:11:35.639090+0000","last_undegraded":"2023-11-26T07:11:35.639090+0000","last_fullsized":"2023-11-26T07:11:35.639090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:07:07.833911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.641041+0000","last_change":"2023-11-26T07:11:34.642107+0000","last_active":"2023-11-26T07:11:35.641041+0000","last_peered":"2023-11-26T07:11:35.641041+0000","last_clean":"2023-11-26T07:11:35.641041+0000","last_became_active":"2023-11-26T07:11:34.641849+0000","last_became_peered":"2023-11-26T07:11:34.641849+0000","last_unstale":"2023-11-26T07:11:35.641041+0000","last_undegraded":"2023-11-26T07:11:35.641041+0000","last_fullsized":"2023-11-26T07:11:35.641041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:35:24.517541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.641664+0000","last_change":"2023-11-26T07:11:34.637097+0000","last_active":"2023-11-26T07:11:34.641664+0000","last_peered":"2023-11-26T07:11:34.641664+0000","last_clean":"2023-11-26T07:11:34.641664+0000","last_became_active":"2023-11-26T07:11:34.636788+0000","last_became_peered":"2023-11-26T07:11:34.636788+0000","last_unstale":"2023-11-26T07:11:34.641664+0000","last_undegraded":"2023-11-26T07:11:34.641664+0000","last_fullsized":"2023-11-26T07:11:34.641664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:13:11.105677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.631676+0000","last_change":"2023-11-26T07:11:33.641738+0000","last_active":"2023-11-26T07:11:34.631676+0000","last_peered":"2023-11-26T07:11:34.631676+0000","last_clean":"2023-11-26T07:11:34.631676+0000","last_became_active":"2023-11-26T07:11:33.641410+0000","last_became_peered":"2023-11-26T07:11:33.641410+0000","last_unstale":"2023-11-26T07:11:34.631676+0000","last_undegraded":"2023-11-26T07:11:34.631676+0000","last_fullsized":"2023-11-26T07:11:34.631676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:17:54.783415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015213+0000","last_change":"2023-11-26T07:11:34.652603+0000","last_active":"2023-11-26T07:11:37.015213+0000","last_peered":"2023-11-26T07:11:37.015213+0000","last_clean":"2023-11-26T07:11:37.015213+0000","last_became_active":"2023-11-26T07:11:34.652141+0000","last_became_peered":"2023-11-26T07:11:34.652141+0000","last_unstale":"2023-11-26T07:11:37.015213+0000","last_undegraded":"2023-11-26T07:11:37.015213+0000","last_fullsized":"2023-11-26T07:11:37.015213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:06:28.926253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.638715+0000","last_change":"2023-11-26T07:11:33.634157+0000","last_active":"2023-11-26T07:11:35.638715+0000","last_peered":"2023-11-26T07:11:35.638715+0000","last_clean":"2023-11-26T07:11:35.638715+0000","last_became_active":"2023-11-26T07:11:33.633464+0000","last_became_peered":"2023-11-26T07:11:33.633464+0000","last_unstale":"2023-11-26T07:11:35.638715+0000","last_undegraded":"2023-11-26T07:11:35.638715+0000","last_fullsized":"2023-11-26T07:11:35.638715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:15:27.970756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-26T07:11:33.635572+0000","last_change":"2023-11-26T07:11:29.855919+0000","last_active":"2023-11-26T07:11:33.635572+0000","last_peered":"2023-11-26T07:11:33.635572+0000","last_clean":"2023-11-26T07:11:33.635572+0000","last_became_active":"2023-11-26T07:11:29.854903+0000","last_became_peered":"2023-11-26T07:11:29.854903+0000","last_unstale":"2023-11-26T07:11:33.635572+0000","last_undegraded":"2023-11-26T07:11:33.635572+0000","last_fullsized":"2023-11-26T07:11:33.635572+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:28.594252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:28.594252+0000","last_clean_scrub_stamp":"2023-11-26T07:11:28.594252+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:33:34.642696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.986872+0000","last_change":"2023-11-26T07:11:34.655445+0000","last_active":"2023-11-26T07:11:36.986872+0000","last_peered":"2023-11-26T07:11:36.986872+0000","last_clean":"2023-11-26T07:11:36.986872+0000","last_became_active":"2023-11-26T07:11:34.655111+0000","last_became_peered":"2023-11-26T07:11:34.655111+0000","last_unstale":"2023-11-26T07:11:36.986872+0000","last_undegraded":"2023-11-26T07:11:36.986872+0000","last_fullsized":"2023-11-26T07:11:36.986872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:54:56.361323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.630923+0000","last_change":"2023-11-26T07:11:33.640738+0000","last_active":"2023-11-26T07:11:34.630923+0000","last_peered":"2023-11-26T07:11:34.630923+0000","last_clean":"2023-11-26T07:11:34.630923+0000","last_became_active":"2023-11-26T07:11:33.640515+0000","last_became_peered":"2023-11-26T07:11:33.640515+0000","last_unstale":"2023-11-26T07:11:34.630923+0000","last_undegraded":"2023-11-26T07:11:34.630923+0000","last_fullsized":"2023-11-26T07:11:34.630923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:46:01.876918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.632528+0000","last_change":"2023-11-26T07:11:33.643235+0000","last_active":"2023-11-26T07:11:34.632528+0000","last_peered":"2023-11-26T07:11:34.632528+0000","last_clean":"2023-11-26T07:11:34.632528+0000","last_became_active":"2023-11-26T07:11:33.642977+0000","last_became_peered":"2023-11-26T07:11:33.642977+0000","last_unstale":"2023-11-26T07:11:34.632528+0000","last_undegraded":"2023-11-26T07:11:34.632528+0000","last_fullsized":"2023-11-26T07:11:34.632528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:03:48.216174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.641724+0000","last_change":"2023-11-26T07:11:34.636261+0000","last_active":"2023-11-26T07:11:34.641724+0000","last_peered":"2023-11-26T07:11:34.641724+0000","last_clean":"2023-11-26T07:11:34.641724+0000","last_became_active":"2023-11-26T07:11:34.635958+0000","last_became_peered":"2023-11-26T07:11:34.635958+0000","last_unstale":"2023-11-26T07:11:34.641724+0000","last_undegraded":"2023-11-26T07:11:34.641724+0000","last_fullsized":"2023-11-26T07:11:34.641724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:23:13.396432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.625767+0000","last_change":"2023-11-26T07:11:33.643565+0000","last_active":"2023-11-26T07:11:34.625767+0000","last_peered":"2023-11-26T07:11:34.625767+0000","last_clean":"2023-11-26T07:11:34.625767+0000","last_became_active":"2023-11-26T07:11:33.643189+0000","last_became_peered":"2023-11-26T07:11:33.643189+0000","last_unstale":"2023-11-26T07:11:34.625767+0000","last_undegraded":"2023-11-26T07:11:34.625767+0000","last_fullsized":"2023-11-26T07:11:34.625767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:57:29.259984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015485+0000","last_change":"2023-11-26T07:11:34.645591+0000","last_active":"2023-11-26T07:11:37.015485+0000","last_peered":"2023-11-26T07:11:37.015485+0000","last_clean":"2023-11-26T07:11:37.015485+0000","last_became_active":"2023-11-26T07:11:34.645274+0000","last_became_peered":"2023-11-26T07:11:34.645274+0000","last_unstale":"2023-11-26T07:11:37.015485+0000","last_undegraded":"2023-11-26T07:11:37.015485+0000","last_fullsized":"2023-11-26T07:11:37.015485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:41:41.780777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052771+0000","last_change":"2023-11-26T07:11:33.638999+0000","last_active":"2023-11-26T07:11:37.052771+0000","last_peered":"2023-11-26T07:11:37.052771+0000","last_clean":"2023-11-26T07:11:37.052771+0000","last_became_active":"2023-11-26T07:11:33.638743+0000","last_became_peered":"2023-11-26T07:11:33.638743+0000","last_unstale":"2023-11-26T07:11:37.052771+0000","last_undegraded":"2023-11-26T07:11:37.052771+0000","last_fullsized":"2023-11-26T07:11:37.052771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:46:01.876918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.987081+0000","last_change":"2023-11-26T07:11:34.637617+0000","last_active":"2023-11-26T07:11:36.987081+0000","last_peered":"2023-11-26T07:11:36.987081+0000","last_clean":"2023-11-26T07:11:36.987081+0000","last_became_active":"2023-11-26T07:11:34.637260+0000","last_became_peered":"2023-11-26T07:11:34.637260+0000","last_unstale":"2023-11-26T07:11:36.987081+0000","last_undegraded":"2023-11-26T07:11:36.987081+0000","last_fullsized":"2023-11-26T07:11:36.987081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:03:49.221463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.628283+0000","last_change":"2023-11-26T07:11:33.642201+0000","last_active":"2023-11-26T07:11:34.628283+0000","last_peered":"2023-11-26T07:11:34.628283+0000","last_clean":"2023-11-26T07:11:34.628283+0000","last_became_active":"2023-11-26T07:11:33.641913+0000","last_became_peered":"2023-11-26T07:11:33.641913+0000","last_unstale":"2023-11-26T07:11:34.628283+0000","last_undegraded":"2023-11-26T07:11:34.628283+0000","last_fullsized":"2023-11-26T07:11:34.628283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:15:27.970756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.640871+0000","last_change":"2023-11-26T07:11:34.641773+0000","last_active":"2023-11-26T07:11:35.640871+0000","last_peered":"2023-11-26T07:11:35.640871+0000","last_clean":"2023-11-26T07:11:35.640871+0000","last_became_active":"2023-11-26T07:11:34.641501+0000","last_became_peered":"2023-11-26T07:11:34.641501+0000","last_unstale":"2023-11-26T07:11:35.640871+0000","last_undegraded":"2023-11-26T07:11:35.640871+0000","last_fullsized":"2023-11-26T07:11:35.640871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:23:13.396432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.625482+0000","last_change":"2023-11-26T07:11:33.637842+0000","last_active":"2023-11-26T07:11:34.625482+0000","last_peered":"2023-11-26T07:11:34.625482+0000","last_clean":"2023-11-26T07:11:34.625482+0000","last_became_active":"2023-11-26T07:11:33.637534+0000","last_became_peered":"2023-11-26T07:11:33.637534+0000","last_unstale":"2023-11-26T07:11:34.625482+0000","last_undegraded":"2023-11-26T07:11:34.625482+0000","last_fullsized":"2023-11-26T07:11:34.625482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:18:52.359254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015004+0000","last_change":"2023-11-26T07:11:34.640101+0000","last_active":"2023-11-26T07:11:37.015004+0000","last_peered":"2023-11-26T07:11:37.015004+0000","last_clean":"2023-11-26T07:11:37.015004+0000","last_became_active":"2023-11-26T07:11:34.639741+0000","last_became_peered":"2023-11-26T07:11:34.639741+0000","last_unstale":"2023-11-26T07:11:37.015004+0000","last_undegraded":"2023-11-26T07:11:37.015004+0000","last_fullsized":"2023-11-26T07:11:37.015004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:03:49.221463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.625771+0000","last_change":"2023-11-26T07:11:33.644068+0000","last_active":"2023-11-26T07:11:34.625771+0000","last_peered":"2023-11-26T07:11:34.625771+0000","last_clean":"2023-11-26T07:11:34.625771+0000","last_became_active":"2023-11-26T07:11:33.643725+0000","last_became_peered":"2023-11-26T07:11:33.643725+0000","last_unstale":"2023-11-26T07:11:34.625771+0000","last_undegraded":"2023-11-26T07:11:34.625771+0000","last_fullsized":"2023-11-26T07:11:34.625771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:35:23.512252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015299+0000","last_change":"2023-11-26T07:11:34.639960+0000","last_active":"2023-11-26T07:11:37.015299+0000","last_peered":"2023-11-26T07:11:37.015299+0000","last_clean":"2023-11-26T07:11:37.015299+0000","last_became_active":"2023-11-26T07:11:34.639582+0000","last_became_peered":"2023-11-26T07:11:34.639582+0000","last_unstale":"2023-11-26T07:11:37.015299+0000","last_undegraded":"2023-11-26T07:11:37.015299+0000","last_fullsized":"2023-11-26T07:11:37.015299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:32:03.590472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.659287+0000","last_change":"2023-11-26T07:11:33.640210+0000","last_active":"2023-11-26T07:11:34.659287+0000","last_peered":"2023-11-26T07:11:34.659287+0000","last_clean":"2023-11-26T07:11:34.659287+0000","last_became_active":"2023-11-26T07:11:33.639920+0000","last_became_peered":"2023-11-26T07:11:33.639920+0000","last_unstale":"2023-11-26T07:11:34.659287+0000","last_undegraded":"2023-11-26T07:11:34.659287+0000","last_fullsized":"2023-11-26T07:11:34.659287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:34:26.124632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052803+0000","last_change":"2023-11-26T07:11:34.654053+0000","last_active":"2023-11-26T07:11:37.052803+0000","last_peered":"2023-11-26T07:11:37.052803+0000","last_clean":"2023-11-26T07:11:37.052803+0000","last_became_active":"2023-11-26T07:11:34.653682+0000","last_became_peered":"2023-11-26T07:11:34.653682+0000","last_unstale":"2023-11-26T07:11:37.052803+0000","last_undegraded":"2023-11-26T07:11:37.052803+0000","last_fullsized":"2023-11-26T07:11:37.052803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:00:10.960837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.633167+0000","last_change":"2023-11-26T07:11:33.641257+0000","last_active":"2023-11-26T07:11:34.633167+0000","last_peered":"2023-11-26T07:11:34.633167+0000","last_clean":"2023-11-26T07:11:34.633167+0000","last_became_active":"2023-11-26T07:11:33.640986+0000","last_became_peered":"2023-11-26T07:11:33.640986+0000","last_unstale":"2023-11-26T07:11:34.633167+0000","last_undegraded":"2023-11-26T07:11:34.633167+0000","last_fullsized":"2023-11-26T07:11:34.633167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:23:12.391144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.655448+0000","last_change":"2023-11-26T07:11:34.648421+0000","last_active":"2023-11-26T07:11:34.655448+0000","last_peered":"2023-11-26T07:11:34.655448+0000","last_clean":"2023-11-26T07:11:34.655448+0000","last_became_active":"2023-11-26T07:11:34.648144+0000","last_became_peered":"2023-11-26T07:11:34.648144+0000","last_unstale":"2023-11-26T07:11:34.655448+0000","last_undegraded":"2023-11-26T07:11:34.655448+0000","last_fullsized":"2023-11-26T07:11:34.655448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:07:08.839200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.659120+0000","last_change":"2023-11-26T07:11:33.635219+0000","last_active":"2023-11-26T07:11:34.659120+0000","last_peered":"2023-11-26T07:11:34.659120+0000","last_clean":"2023-11-26T07:11:34.659120+0000","last_became_active":"2023-11-26T07:11:33.634823+0000","last_became_peered":"2023-11-26T07:11:33.634823+0000","last_unstale":"2023-11-26T07:11:34.659120+0000","last_undegraded":"2023-11-26T07:11:34.659120+0000","last_fullsized":"2023-11-26T07:11:34.659120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:46:01.876918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.639554+0000","last_change":"2023-11-26T07:11:34.647738+0000","last_active":"2023-11-26T07:11:35.639554+0000","last_peered":"2023-11-26T07:11:35.639554+0000","last_clean":"2023-11-26T07:11:35.639554+0000","last_became_active":"2023-11-26T07:11:34.647392+0000","last_became_peered":"2023-11-26T07:11:34.647392+0000","last_unstale":"2023-11-26T07:11:35.639554+0000","last_undegraded":"2023-11-26T07:11:35.639554+0000","last_fullsized":"2023-11-26T07:11:35.639554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:47:06.786241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.657218+0000","last_change":"2023-11-26T07:11:33.640058+0000","last_active":"2023-11-26T07:11:34.657218+0000","last_peered":"2023-11-26T07:11:34.657218+0000","last_clean":"2023-11-26T07:11:34.657218+0000","last_became_active":"2023-11-26T07:11:33.639705+0000","last_became_peered":"2023-11-26T07:11:33.639705+0000","last_unstale":"2023-11-26T07:11:34.657218+0000","last_undegraded":"2023-11-26T07:11:34.657218+0000","last_fullsized":"2023-11-26T07:11:34.657218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:35:23.512252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.646764+0000","last_change":"2023-11-26T07:11:34.644169+0000","last_active":"2023-11-26T07:11:34.646764+0000","last_peered":"2023-11-26T07:11:34.646764+0000","last_clean":"2023-11-26T07:11:34.646764+0000","last_became_active":"2023-11-26T07:11:34.643368+0000","last_became_peered":"2023-11-26T07:11:34.643368+0000","last_unstale":"2023-11-26T07:11:34.646764+0000","last_undegraded":"2023-11-26T07:11:34.646764+0000","last_fullsized":"2023-11-26T07:11:34.646764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:06:28.926253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052532+0000","last_change":"2023-11-26T07:11:34.647950+0000","last_active":"2023-11-26T07:11:37.052532+0000","last_peered":"2023-11-26T07:11:37.052532+0000","last_clean":"2023-11-26T07:11:37.052532+0000","last_became_active":"2023-11-26T07:11:34.647506+0000","last_became_peered":"2023-11-26T07:11:34.647506+0000","last_unstale":"2023-11-26T07:11:37.052532+0000","last_undegraded":"2023-11-26T07:11:37.052532+0000","last_fullsized":"2023-11-26T07:11:37.052532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:34:27.129920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.650494+0000","last_change":"2023-11-26T07:11:34.646505+0000","last_active":"2023-11-26T07:11:34.650494+0000","last_peered":"2023-11-26T07:11:34.650494+0000","last_clean":"2023-11-26T07:11:34.650494+0000","last_became_active":"2023-11-26T07:11:34.646188+0000","last_became_peered":"2023-11-26T07:11:34.646188+0000","last_unstale":"2023-11-26T07:11:34.650494+0000","last_undegraded":"2023-11-26T07:11:34.650494+0000","last_fullsized":"2023-11-26T07:11:34.650494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:18:53.364543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.639195+0000","last_change":"2023-11-26T07:11:34.648874+0000","last_active":"2023-11-26T07:11:35.639195+0000","last_peered":"2023-11-26T07:11:35.639195+0000","last_clean":"2023-11-26T07:11:35.639195+0000","last_became_active":"2023-11-26T07:11:34.648306+0000","last_became_peered":"2023-11-26T07:11:34.648306+0000","last_unstale":"2023-11-26T07:11:35.639195+0000","last_undegraded":"2023-11-26T07:11:35.639195+0000","last_fullsized":"2023-11-26T07:11:35.639195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:25:36.494823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.987274+0000","last_change":"2023-11-26T07:11:34.644678+0000","last_active":"2023-11-26T07:11:36.987274+0000","last_peered":"2023-11-26T07:11:36.987274+0000","last_clean":"2023-11-26T07:11:36.987274+0000","last_became_active":"2023-11-26T07:11:34.644208+0000","last_became_peered":"2023-11-26T07:11:34.644208+0000","last_unstale":"2023-11-26T07:11:36.987274+0000","last_undegraded":"2023-11-26T07:11:36.987274+0000","last_fullsized":"2023-11-26T07:11:36.987274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:06:28.926253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015420+0000","last_change":"2023-11-26T07:11:34.654093+0000","last_active":"2023-11-26T07:11:37.015420+0000","last_peered":"2023-11-26T07:11:37.015420+0000","last_clean":"2023-11-26T07:11:37.015420+0000","last_became_active":"2023-11-26T07:11:34.653772+0000","last_became_peered":"2023-11-26T07:11:34.653772+0000","last_unstale":"2023-11-26T07:11:37.015420+0000","last_undegraded":"2023-11-26T07:11:37.015420+0000","last_fullsized":"2023-11-26T07:11:37.015420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:25:36.494823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.643829+0000","last_change":"2023-11-26T07:11:34.641180+0000","last_active":"2023-11-26T07:11:34.643829+0000","last_peered":"2023-11-26T07:11:34.643829+0000","last_clean":"2023-11-26T07:11:34.643829+0000","last_became_active":"2023-11-26T07:11:34.640883+0000","last_became_peered":"2023-11-26T07:11:34.640883+0000","last_unstale":"2023-11-26T07:11:34.643829+0000","last_undegraded":"2023-11-26T07:11:34.643829+0000","last_fullsized":"2023-11-26T07:11:34.643829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:37:23.214446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052794+0000","last_change":"2023-11-26T07:11:34.649166+0000","last_active":"2023-11-26T07:11:37.052794+0000","last_peered":"2023-11-26T07:11:37.052794+0000","last_clean":"2023-11-26T07:11:37.052794+0000","last_became_active":"2023-11-26T07:11:34.647969+0000","last_became_peered":"2023-11-26T07:11:34.647969+0000","last_unstale":"2023-11-26T07:11:37.052794+0000","last_undegraded":"2023-11-26T07:11:37.052794+0000","last_fullsized":"2023-11-26T07:11:37.052794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:07:08.839200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015324+0000","last_change":"2023-11-26T07:11:34.642588+0000","last_active":"2023-11-26T07:11:37.015324+0000","last_peered":"2023-11-26T07:11:37.015324+0000","last_clean":"2023-11-26T07:11:37.015324+0000","last_became_active":"2023-11-26T07:11:34.642248+0000","last_became_peered":"2023-11-26T07:11:34.642248+0000","last_unstale":"2023-11-26T07:11:37.015324+0000","last_undegraded":"2023-11-26T07:11:37.015324+0000","last_fullsized":"2023-11-26T07:11:37.015324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:32:36.834153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.638896+0000","last_change":"2023-11-26T07:11:34.647562+0000","last_active":"2023-11-26T07:11:35.638896+0000","last_peered":"2023-11-26T07:11:35.638896+0000","last_clean":"2023-11-26T07:11:35.638896+0000","last_became_active":"2023-11-26T07:11:34.647274+0000","last_became_peered":"2023-11-26T07:11:34.647274+0000","last_unstale":"2023-11-26T07:11:35.638896+0000","last_undegraded":"2023-11-26T07:11:35.638896+0000","last_fullsized":"2023-11-26T07:11:35.638896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:06:28.926253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015070+0000","last_change":"2023-11-26T07:11:34.644535+0000","last_active":"2023-11-26T07:11:37.015070+0000","last_peered":"2023-11-26T07:11:37.015070+0000","last_clean":"2023-11-26T07:11:37.015070+0000","last_became_active":"2023-11-26T07:11:34.644188+0000","last_became_peered":"2023-11-26T07:11:34.644188+0000","last_unstale":"2023-11-26T07:11:37.015070+0000","last_undegraded":"2023-11-26T07:11:37.015070+0000","last_fullsized":"2023-11-26T07:11:37.015070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:07:08.839200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.638979+0000","last_change":"2023-11-26T07:11:34.650901+0000","last_active":"2023-11-26T07:11:35.638979+0000","last_peered":"2023-11-26T07:11:35.638979+0000","last_clean":"2023-11-26T07:11:35.638979+0000","last_became_active":"2023-11-26T07:11:34.647833+0000","last_became_peered":"2023-11-26T07:11:34.647833+0000","last_unstale":"2023-11-26T07:11:35.638979+0000","last_undegraded":"2023-11-26T07:11:35.638979+0000","last_fullsized":"2023-11-26T07:11:35.638979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:32:36.834153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.987234+0000","last_change":"2023-11-26T07:11:34.646704+0000","last_active":"2023-11-26T07:11:36.987234+0000","last_peered":"2023-11-26T07:11:36.987234+0000","last_clean":"2023-11-26T07:11:36.987234+0000","last_became_active":"2023-11-26T07:11:34.646178+0000","last_became_peered":"2023-11-26T07:11:34.646178+0000","last_unstale":"2023-11-26T07:11:36.987234+0000","last_undegraded":"2023-11-26T07:11:36.987234+0000","last_fullsized":"2023-11-26T07:11:36.987234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:09:14.653647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052917+0000","last_change":"2023-11-26T07:11:34.657780+0000","last_active":"2023-11-26T07:11:37.052917+0000","last_peered":"2023-11-26T07:11:37.052917+0000","last_clean":"2023-11-26T07:11:37.052917+0000","last_became_active":"2023-11-26T07:11:34.657459+0000","last_became_peered":"2023-11-26T07:11:34.657459+0000","last_unstale":"2023-11-26T07:11:37.052917+0000","last_undegraded":"2023-11-26T07:11:37.052917+0000","last_fullsized":"2023-11-26T07:11:37.052917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:06:28.926253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":660231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":70893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":69441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":823296,"data_stored":666587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":69281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":70893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":75707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:11:39.228 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-26T07:11:39.228 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-26T07:11:39.228 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-26T07:11:39.228 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-26T07:11:39.229 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-26T07:11:39.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.386+0000 7f0778436700 1 Processor -- start 2023-11-26T07:11:39.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.386+0000 7f0778436700 1 -- start start 2023-11-26T07:11:39.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.387+0000 7f0778436700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f077015e1e0 0x7f07700b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:39.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.387+0000 7f0778436700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07700734c0 con 0x7f077006b400 2023-11-26T07:11:39.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.387+0000 7f0778436700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077006bb80 con 0x7f07700b5e40 2023-11-26T07:11:39.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.387+0000 7f0778436700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f077006be20 con 0x7f077015e1e0 2023-11-26T07:11:39.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.387+0000 7f07759d1700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f077006b400 0x7f07700726a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58358/0 (socket says 172.21.15.2:58358) 2023-11-26T07:11:39.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.387+0000 7f07759d1700 1 -- 172.21.15.2:0/3079672034 learned_addr learned my addr 172.21.15.2:0/3079672034 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:11:39.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.388+0000 7f07761d2700 1 --2- 172.21.15.2:0/3079672034 >> v2:172.21.15.192:3300/0 conn(0x7f077015e1e0 0x7f07700b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:39.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.388+0000 7f07751d0700 1 -- 172.21.15.2:0/3079672034 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2672923310 0 0) 0x7f07700734c0 con 0x7f077006b400 2023-11-26T07:11:39.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.388+0000 7f07751d0700 1 -- 172.21.15.2:0/3079672034 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f075c0035b0 con 0x7f077006b400 2023-11-26T07:11:39.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.388+0000 7f07751d0700 1 -- 172.21.15.2:0/3079672034 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 489318384 0 0) 0x7f075c0035b0 con 0x7f077006b400 2023-11-26T07:11:39.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.388+0000 7f07751d0700 1 -- 172.21.15.2:0/3079672034 >> v2:172.21.15.192:3300/0 conn(0x7f077015e1e0 msgr2=0x7f07700b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:39.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.388+0000 7f07751d0700 1 --2- 172.21.15.2:0/3079672034 >> v2:172.21.15.192:3300/0 conn(0x7f077015e1e0 0x7f07700b12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:39.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.388+0000 7f07751d0700 1 -- 172.21.15.2:0/3079672034 >> v1:172.21.15.192:6789/0 conn(0x7f07700b5e40 legacy=0x7f0770072db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:39.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.388+0000 7f07751d0700 1 -- 172.21.15.2:0/3079672034 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f077006c100 con 0x7f077006b400 2023-11-26T07:11:39.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.388+0000 7f07751d0700 1 -- 172.21.15.2:0/3079672034 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f076c001670 con 0x7f077006b400 2023-11-26T07:11:39.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.388+0000 7f07751d0700 1 -- 172.21.15.2:0/3079672034 >> v1:172.21.15.2:6789/0 conn(0x7f077006b400 legacy=0x7f07700726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:39.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.388+0000 7f07751d0700 1 --2- 172.21.15.2:0/3079672034 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f075c003a00 0x7f075c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:39.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.388+0000 7f07751d0700 1 --2- 172.21.15.2:0/3079672034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f075c004850 0x7f075c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:39.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.388+0000 7f07751d0700 1 --2- 172.21.15.2:0/3079672034 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f075c005210 0x7f075c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:39.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.388+0000 7f07751d0700 1 -- 172.21.15.2:0/3079672034 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077006be20 con 0x7f075c004850 2023-11-26T07:11:39.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.388+0000 7f07751d0700 1 -- 172.21.15.2:0/3079672034 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075c00c0b0 con 0x7f075c005210 2023-11-26T07:11:39.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.388+0000 7f07751d0700 1 -- 172.21.15.2:0/3079672034 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f075c00c270 con 0x7f075c003a00 2023-11-26T07:11:39.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.388+0000 7f07759d1700 1 --2- 172.21.15.2:0/3079672034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f075c004850 0x7f075c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:39.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.388+0000 7f07761d2700 1 --2- 172.21.15.2:0/3079672034 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f075c003a00 0x7f075c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:39.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.388+0000 7f07769d3700 1 --2- 172.21.15.2:0/3079672034 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f075c005210 0x7f075c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:39.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.388+0000 7f07759d1700 1 -- 172.21.15.2:0/3079672034 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f075c003a00 msgr2=0x7f075c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:39.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.388+0000 7f07759d1700 1 --2- 172.21.15.2:0/3079672034 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f075c003a00 0x7f075c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:39.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.388+0000 7f07759d1700 1 -- 172.21.15.2:0/3079672034 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f075c005210 msgr2=0x7f075c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:39.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.388+0000 7f07759d1700 1 --2- 172.21.15.2:0/3079672034 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f075c005210 0x7f075c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:39.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.388+0000 7f07759d1700 1 -- 172.21.15.2:0/3079672034 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f075c0035b0 con 0x7f075c004850 2023-11-26T07:11:39.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.388+0000 7f07769d3700 1 --2- 172.21.15.2:0/3079672034 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f075c005210 0x7f075c00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:11:39.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.388+0000 7f07761d2700 1 --2- 172.21.15.2:0/3079672034 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f075c003a00 0x7f075c003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:11:39.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.388+0000 7f07769d3700 1 -- 172.21.15.2:0/3079672034 reap_dead start 2023-11-26T07:11:39.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.388+0000 7f07759d1700 1 --2- 172.21.15.2:0/3079672034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f075c004850 0x7f075c004cd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f076c00c210 tx=0x7f075c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce20e664eb6bac1f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:39.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.389+0000 7f07751d0700 1 -- 172.21.15.2:0/3079672034 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076c007c10 con 0x7f075c004850 2023-11-26T07:11:39.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.389+0000 7f07751d0700 1 -- 172.21.15.2:0/3079672034 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076c00cdd0 con 0x7f075c004850 2023-11-26T07:11:39.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.389+0000 7f07751d0700 1 -- 172.21.15.2:0/3079672034 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076c005ba0 con 0x7f075c004850 2023-11-26T07:11:39.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.389+0000 7f0778436700 1 -- 172.21.15.2:0/3079672034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f075c004850 msgr2=0x7f075c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:39.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.389+0000 7f0778436700 1 --2- 172.21.15.2:0/3079672034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f075c004850 0x7f075c004cd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f076c00c210 tx=0x7f075c005880 comp rx=0 tx=0).stop 2023-11-26T07:11:39.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.389+0000 7f0778436700 1 -- 172.21.15.2:0/3079672034 shutdown_connections 2023-11-26T07:11:39.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.389+0000 7f0778436700 1 --2- 172.21.15.2:0/3079672034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f075c004850 0x7f075c004cd0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:39.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.389+0000 7f0778436700 1 -- 172.21.15.2:0/3079672034 >> 172.21.15.2:0/3079672034 conn(0x7f07700b5070 msgr2=0x7f07700b5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:39.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.389+0000 7f0778436700 1 -- 172.21.15.2:0/3079672034 shutdown_connections 2023-11-26T07:11:39.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.389+0000 7f0778436700 1 -- 172.21.15.2:0/3079672034 wait complete. 2023-11-26T07:11:39.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.391+0000 7f0778436700 1 Processor -- start 2023-11-26T07:11:39.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.391+0000 7f0778436700 1 -- start start 2023-11-26T07:11:39.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.392+0000 7f0778436700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f075c004850 0x7f0770155630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:39.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.392+0000 7f0778436700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07700b2180 0x7f07701f72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:39.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.392+0000 7f0778436700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07700b2600 0x7f0770154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:39.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.392+0000 7f0778436700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07701f82d0 con 0x7f075c004850 2023-11-26T07:11:39.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.392+0000 7f0778436700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07701f7d10 con 0x7f07700b2180 2023-11-26T07:11:39.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.392+0000 7f0778436700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07701f7ff0 con 0x7f07700b2600 2023-11-26T07:11:39.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.392+0000 7f07761d2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f075c004850 0x7f0770155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:39.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.392+0000 7f07761d2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f075c004850 0x7f0770155630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38928/0 (socket says 172.21.15.2:38928) 2023-11-26T07:11:39.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.392+0000 7f07761d2700 1 -- 172.21.15.2:0/1037625529 learned_addr learned my addr 172.21.15.2:0/1037625529 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:39.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.392+0000 7f07769d3700 1 --2- 172.21.15.2:0/1037625529 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07700b2600 0x7f0770154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:39.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.392+0000 7f07759d1700 1 --2- 172.21.15.2:0/1037625529 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07700b2180 0x7f07701f72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:39.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.392+0000 7f07761d2700 1 -- 172.21.15.2:0/1037625529 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07700b2600 msgr2=0x7f0770154070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:39.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.392+0000 7f07761d2700 1 --2- 172.21.15.2:0/1037625529 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07700b2600 0x7f0770154070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:39.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.392+0000 7f07761d2700 1 -- 172.21.15.2:0/1037625529 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07700b2180 msgr2=0x7f07701f72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:39.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.392+0000 7f07761d2700 1 --2- 172.21.15.2:0/1037625529 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07700b2180 0x7f07701f72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:39.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.392+0000 7f07761d2700 1 -- 172.21.15.2:0/1037625529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0770154e30 con 0x7f075c004850 2023-11-26T07:11:39.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.392+0000 7f07769d3700 1 --2- 172.21.15.2:0/1037625529 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07700b2600 0x7f0770154070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:11:39.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.393+0000 7f07761d2700 1 --2- 172.21.15.2:0/1037625529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f075c004850 0x7f0770155630 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0760011590 tx=0x7f07600118a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:39.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.393+0000 7f0766ffd700 1 -- 172.21.15.2:0/1037625529 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0760004220 con 0x7f075c004850 2023-11-26T07:11:39.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.393+0000 7f0766ffd700 1 -- 172.21.15.2:0/1037625529 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0760004380 con 0x7f075c004850 2023-11-26T07:11:39.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.393+0000 7f0778436700 1 -- 172.21.15.2:0/1037625529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0770155110 con 0x7f075c004850 2023-11-26T07:11:39.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.393+0000 7f0766ffd700 1 -- 172.21.15.2:0/1037625529 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07600036a0 con 0x7f075c004850 2023-11-26T07:11:39.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.393+0000 7f0778436700 1 -- 172.21.15.2:0/1037625529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0770159470 con 0x7f075c004850 2023-11-26T07:11:39.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.394+0000 7f0778436700 1 -- 172.21.15.2:0/1037625529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0770154c90 con 0x7f075c004850 2023-11-26T07:11:39.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.394+0000 7f0766ffd700 1 -- 172.21.15.2:0/1037625529 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0760003800 con 0x7f075c004850 2023-11-26T07:11:39.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.394+0000 7f0766ffd700 1 --2- 172.21.15.2:0/1037625529 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f075406aed0 0x7f075406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:39.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.395+0000 7f0766ffd700 1 -- 172.21.15.2:0/1037625529 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0760089880 con 0x7f075c004850 2023-11-26T07:11:39.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.395+0000 7f07759d1700 1 --2- 172.21.15.2:0/1037625529 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f075406aed0 0x7f075406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:39.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.395+0000 7f07759d1700 1 --2- 172.21.15.2:0/1037625529 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f075406aed0 0x7f075406d390 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f076c001930 tx=0x7f076c007000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:39.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.399+0000 7f0766ffd700 1 -- 172.21.15.2:0/1037625529 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0770154c90 con 0x7f075c004850 2023-11-26T07:11:39.542 INFO:tasks.ceph.mds.d.smithi192.stderr:2023-11-26T07:11:39.540+0000 7fbaee3d6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-26T07:11:39.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.661+0000 7f0778436700 1 -- 172.21.15.2:0/1037625529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f0770154c90 con 0x7f075c004850 2023-11-26T07:11:39.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.664+0000 7f0766ffd700 1 -- 172.21.15.2:0/1037625529 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171039 (secure 0 0 0) 0x7f0770154c90 con 0x7f075c004850 2023-11-26T07:11:39.669 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:11:39.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.667+0000 7f0778436700 1 -- 172.21.15.2:0/1037625529 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f075406aed0 msgr2=0x7f075406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:39.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.667+0000 7f0778436700 1 --2- 172.21.15.2:0/1037625529 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f075406aed0 0x7f075406d390 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f076c001930 tx=0x7f076c007000 comp rx=0 tx=0).stop 2023-11-26T07:11:39.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.667+0000 7f0778436700 1 -- 172.21.15.2:0/1037625529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f075c004850 msgr2=0x7f0770155630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:39.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.667+0000 7f0778436700 1 --2- 172.21.15.2:0/1037625529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f075c004850 0x7f0770155630 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0760011590 tx=0x7f07600118a0 comp rx=0 tx=0).stop 2023-11-26T07:11:39.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.667+0000 7f0778436700 1 -- 172.21.15.2:0/1037625529 shutdown_connections 2023-11-26T07:11:39.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.667+0000 7f0778436700 1 --2- 172.21.15.2:0/1037625529 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f075406aed0 0x7f075406d390 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:39.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.667+0000 7f0778436700 1 --2- 172.21.15.2:0/1037625529 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07700b2600 0x7f0770154070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:39.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.667+0000 7f0778436700 1 --2- 172.21.15.2:0/1037625529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f075c004850 0x7f0770155630 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:39.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.667+0000 7f0778436700 1 --2- 172.21.15.2:0/1037625529 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07700b2180 0x7f07701f72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:39.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.667+0000 7f0778436700 1 -- 172.21.15.2:0/1037625529 >> 172.21.15.2:0/1037625529 conn(0x7f07700b5070 msgr2=0x7f0770072df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:39.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.667+0000 7f0778436700 1 -- 172.21.15.2:0/1037625529 shutdown_connections 2023-11-26T07:11:39.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.667+0000 7f0778436700 1 -- 172.21.15.2:0/1037625529 wait complete. 2023-11-26T07:11:39.682 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":5,"active_gid":4106,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1147935632},{"type":"v1","addr":"172.21.15.192:6833","nonce":1147935632}]},"active_addr":"172.21.15.192:6833/1147935632","active_change":"2023-11-26T07:11:22.144723+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4108,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.192:0","nonce":3589805976}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.192:0","nonce":2347785320}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.192:0","nonce":3411410358}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.192:0","nonce":1107184321}]}]} 2023-11-26T07:11:39.685 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-26T07:11:39.685 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-26T07:11:39.686 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:11:39.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.807+0000 7f22085b4700 1 Processor -- start 2023-11-26T07:11:39.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.807+0000 7f22085b4700 1 -- start start 2023-11-26T07:11:39.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.808+0000 7f22085b4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f22000d0080 0x7f22000b5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:39.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.808+0000 7f22085b4700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2200071bb0 0x7f220006afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:39.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.808+0000 7f22085b4700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2200147bb0 con 0x7f220006b510 2023-11-26T07:11:39.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.808+0000 7f22085b4700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2200072cd0 con 0x7f2200071bb0 2023-11-26T07:11:39.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.808+0000 7f22085b4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f220006b9a0 con 0x7f22000d0080 2023-11-26T07:11:39.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.808+0000 7f2205b4f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2200071bb0 0x7f220006afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:39.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.808+0000 7f2205b4f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2200071bb0 0x7f220006afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38936/0 (socket says 172.21.15.2:38936) 2023-11-26T07:11:39.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.808+0000 7f2205b4f700 1 -- 172.21.15.2:0/1648594059 learned_addr learned my addr 172.21.15.2:0/1648594059 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:39.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.808+0000 7f2206350700 1 --2- 172.21.15.2:0/1648594059 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f22000d0080 0x7f22000b5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:39.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.808+0000 7f2205b4f700 1 -- 172.21.15.2:0/1648594059 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f22000d0080 msgr2=0x7f22000b5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:39.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.808+0000 7f2205b4f700 1 --2- 172.21.15.2:0/1648594059 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f22000d0080 0x7f22000b5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:39.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.808+0000 7f2205b4f700 1 -- 172.21.15.2:0/1648594059 >> v1:172.21.15.192:6789/0 conn(0x7f220006b510 legacy=0x7f2200161b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:39.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.808+0000 7f2205b4f700 1 -- 172.21.15.2:0/1648594059 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22000b5dd0 con 0x7f2200071bb0 2023-11-26T07:11:39.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.808+0000 7f2205b4f700 1 --2- 172.21.15.2:0/1648594059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2200071bb0 0x7f220006afd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f21fc0098f0 tx=0x7f21fc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b731ebd980eeab server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:39.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.809+0000 7f220534e700 1 -- 172.21.15.2:0/1648594059 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc011830 con 0x7f2200071bb0 2023-11-26T07:11:39.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.809+0000 7f220534e700 1 -- 172.21.15.2:0/1648594059 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21fc011990 con 0x7f2200071bb0 2023-11-26T07:11:39.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.809+0000 7f220534e700 1 -- 172.21.15.2:0/1648594059 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc011d20 con 0x7f2200071bb0 2023-11-26T07:11:39.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.809+0000 7f22085b4700 1 -- 172.21.15.2:0/1648594059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2200071bb0 msgr2=0x7f220006afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:39.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.809+0000 7f22085b4700 1 --2- 172.21.15.2:0/1648594059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2200071bb0 0x7f220006afd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f21fc0098f0 tx=0x7f21fc009c00 comp rx=0 tx=0).stop 2023-11-26T07:11:39.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.809+0000 7f22085b4700 1 -- 172.21.15.2:0/1648594059 shutdown_connections 2023-11-26T07:11:39.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.809+0000 7f22085b4700 1 --2- 172.21.15.2:0/1648594059 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f22000d0080 0x7f22000b5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:39.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.809+0000 7f22085b4700 1 --2- 172.21.15.2:0/1648594059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2200071bb0 0x7f220006afd0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:39.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.809+0000 7f22085b4700 1 -- 172.21.15.2:0/1648594059 >> 172.21.15.2:0/1648594059 conn(0x7f22000b27d0 msgr2=0x7f22000b2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:39.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.809+0000 7f22085b4700 1 -- 172.21.15.2:0/1648594059 shutdown_connections 2023-11-26T07:11:39.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.809+0000 7f22085b4700 1 -- 172.21.15.2:0/1648594059 wait complete. 2023-11-26T07:11:39.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.811+0000 7f22085b4700 1 Processor -- start 2023-11-26T07:11:39.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.811+0000 7f22085b4700 1 -- start start 2023-11-26T07:11:39.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.811+0000 7f22085b4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f220006b510 0x7f22000b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:39.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.811+0000 7f22085b4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2200071bb0 0x7f22000ae760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:39.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.811+0000 7f22085b4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22000d0080 0x7f220013c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:39.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.811+0000 7f22085b4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22000aeca0 con 0x7f2200071bb0 2023-11-26T07:11:39.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.811+0000 7f22085b4700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220013cea0 con 0x7f22000d0080 2023-11-26T07:11:39.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.811+0000 7f22085b4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22000b12f0 con 0x7f220006b510 2023-11-26T07:11:39.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.811+0000 7f2205b4f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2200071bb0 0x7f22000ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:39.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.811+0000 7f2205b4f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2200071bb0 0x7f22000ae760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38944/0 (socket says 172.21.15.2:38944) 2023-11-26T07:11:39.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.811+0000 7f2205b4f700 1 -- 172.21.15.2:0/3405652847 learned_addr learned my addr 172.21.15.2:0/3405652847 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:39.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.812+0000 7f2206b51700 1 --2- 172.21.15.2:0/3405652847 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22000d0080 0x7f220013c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:39.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.812+0000 7f2206350700 1 --2- 172.21.15.2:0/3405652847 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f220006b510 0x7f22000b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:39.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.812+0000 7f2205b4f700 1 -- 172.21.15.2:0/3405652847 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f220006b510 msgr2=0x7f22000b0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:39.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.812+0000 7f2205b4f700 1 --2- 172.21.15.2:0/3405652847 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f220006b510 0x7f22000b0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:39.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.812+0000 7f2205b4f700 1 -- 172.21.15.2:0/3405652847 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22000d0080 msgr2=0x7f220013c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:39.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.812+0000 7f2205b4f700 1 --2- 172.21.15.2:0/3405652847 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22000d0080 0x7f220013c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:39.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.812+0000 7f2205b4f700 1 -- 172.21.15.2:0/3405652847 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21fc009550 con 0x7f2200071bb0 2023-11-26T07:11:39.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.812+0000 7f2206b51700 1 --2- 172.21.15.2:0/3405652847 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22000d0080 0x7f220013c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:11:39.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.812+0000 7f2205b4f700 1 --2- 172.21.15.2:0/3405652847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2200071bb0 0x7f22000ae760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f21fc000c00 tx=0x7f21fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:39.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.812+0000 7f21f6ffd700 1 -- 172.21.15.2:0/3405652847 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc004570 con 0x7f2200071bb0 2023-11-26T07:11:39.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.812+0000 7f21f6ffd700 1 -- 172.21.15.2:0/3405652847 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21fc01f070 con 0x7f2200071bb0 2023-11-26T07:11:39.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.812+0000 7f22085b4700 1 -- 172.21.15.2:0/3405652847 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2200141d10 con 0x7f2200071bb0 2023-11-26T07:11:39.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.812+0000 7f21f6ffd700 1 -- 172.21.15.2:0/3405652847 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc0038c0 con 0x7f2200071bb0 2023-11-26T07:11:39.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.812+0000 7f22085b4700 1 -- 172.21.15.2:0/3405652847 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22001422d0 con 0x7f2200071bb0 2023-11-26T07:11:39.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.813+0000 7f22085b4700 1 -- 172.21.15.2:0/3405652847 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2200142640 con 0x7f2200071bb0 2023-11-26T07:11:39.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.813+0000 7f21f6ffd700 1 -- 172.21.15.2:0/3405652847 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f21fc021030 con 0x7f2200071bb0 2023-11-26T07:11:39.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.814+0000 7f21f6ffd700 1 --2- 172.21.15.2:0/3405652847 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f21e406aed0 0x7f21e406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:39.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.814+0000 7f21f6ffd700 1 -- 172.21.15.2:0/3405652847 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21fc08aa40 con 0x7f2200071bb0 2023-11-26T07:11:39.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.814+0000 7f2206350700 1 --2- 172.21.15.2:0/3405652847 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f21e406aed0 0x7f21e406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:39.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.815+0000 7f2206350700 1 --2- 172.21.15.2:0/3405652847 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f21e406aed0 0x7f21e406d390 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f21f0009a10 tx=0x7f21f0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:39.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:39.818+0000 7f21f6ffd700 1 -- 172.21.15.2:0/3405652847 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f21fc08ce60 con 0x7f2200071bb0 2023-11-26T07:11:40.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.020+0000 7f22085b4700 1 -- 172.21.15.2:0/3405652847 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2200141b70 con 0x7f2200071bb0 2023-11-26T07:11:40.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.021+0000 7f21f6ffd700 1 -- 172.21.15.2:0/3405652847 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f2200141b70 con 0x7f2200071bb0 2023-11-26T07:11:40.024 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:11:40.024 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:11:35.634747+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:11:32.129474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:11:33.019837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:11:40.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.023+0000 7f22085b4700 1 -- 172.21.15.2:0/3405652847 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f21e406aed0 msgr2=0x7f21e406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.023+0000 7f22085b4700 1 --2- 172.21.15.2:0/3405652847 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f21e406aed0 0x7f21e406d390 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f21f0009a10 tx=0x7f21f0008040 comp rx=0 tx=0).stop 2023-11-26T07:11:40.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.023+0000 7f22085b4700 1 -- 172.21.15.2:0/3405652847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2200071bb0 msgr2=0x7f22000ae760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.023+0000 7f22085b4700 1 --2- 172.21.15.2:0/3405652847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2200071bb0 0x7f22000ae760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f21fc000c00 tx=0x7f21fc004750 comp rx=0 tx=0).stop 2023-11-26T07:11:40.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.023+0000 7f22085b4700 1 -- 172.21.15.2:0/3405652847 shutdown_connections 2023-11-26T07:11:40.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.023+0000 7f22085b4700 1 --2- 172.21.15.2:0/3405652847 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f21e406aed0 0x7f21e406d390 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.023+0000 7f22085b4700 1 --2- 172.21.15.2:0/3405652847 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22000d0080 0x7f220013c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.023+0000 7f22085b4700 1 --2- 172.21.15.2:0/3405652847 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f220006b510 0x7f22000b0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.023+0000 7f22085b4700 1 --2- 172.21.15.2:0/3405652847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2200071bb0 0x7f22000ae760 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.023+0000 7f22085b4700 1 -- 172.21.15.2:0/3405652847 >> 172.21.15.2:0/3405652847 conn(0x7f22000b27d0 msgr2=0x7f220015eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:40.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.023+0000 7f22085b4700 1 -- 172.21.15.2:0/3405652847 shutdown_connections 2023-11-26T07:11:40.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.023+0000 7f22085b4700 1 -- 172.21.15.2:0/3405652847 wait complete. 2023-11-26T07:11:40.038 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-26T07:11:40.039 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:11:40.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.160+0000 7eff37de4700 1 Processor -- start 2023-11-26T07:11:40.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.160+0000 7eff37de4700 1 -- start start 2023-11-26T07:11:40.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.161+0000 7eff37de4700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7eff30144c10 0x7eff3006afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.161+0000 7eff37de4700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7eff30145650 0x7eff3006b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.161+0000 7eff37de4700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff3006eb80 con 0x7eff30145100 2023-11-26T07:11:40.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.161+0000 7eff37de4700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff3006f500 con 0x7eff30144c10 2023-11-26T07:11:40.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.161+0000 7eff37de4700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff300cd610 con 0x7eff30145650 2023-11-26T07:11:40.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.161+0000 7eff35b80700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7eff30144c10 0x7eff3006afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.161+0000 7eff35b80700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7eff30144c10 0x7eff3006afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38950/0 (socket says 172.21.15.2:38950) 2023-11-26T07:11:40.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.161+0000 7eff35b80700 1 -- 172.21.15.2:0/2252346240 learned_addr learned my addr 172.21.15.2:0/2252346240 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:40.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.162+0000 7eff36381700 1 --2- 172.21.15.2:0/2252346240 >> v2:172.21.15.192:3300/0 conn(0x7eff30145650 0x7eff3006b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.162+0000 7eff35b80700 1 -- 172.21.15.2:0/2252346240 >> v2:172.21.15.192:3300/0 conn(0x7eff30145650 msgr2=0x7eff3006b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:40.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.162+0000 7eff35b80700 1 --2- 172.21.15.2:0/2252346240 >> v2:172.21.15.192:3300/0 conn(0x7eff30145650 0x7eff3006b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.162+0000 7eff35b80700 1 -- 172.21.15.2:0/2252346240 >> v1:172.21.15.192:6789/0 conn(0x7eff30145100 legacy=0x7eff30071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:40.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.162+0000 7eff35b80700 1 -- 172.21.15.2:0/2252346240 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff30160720 con 0x7eff30144c10 2023-11-26T07:11:40.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.162+0000 7eff35b80700 1 --2- 172.21.15.2:0/2252346240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff30144c10 0x7eff3006afd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7eff30073800 tx=0x7eff24009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d6e1293b55535c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.162+0000 7eff34b7e700 1 -- 172.21.15.2:0/2252346240 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff24004230 con 0x7eff30144c10 2023-11-26T07:11:40.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.162+0000 7eff34b7e700 1 -- 172.21.15.2:0/2252346240 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff24004390 con 0x7eff30144c10 2023-11-26T07:11:40.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.162+0000 7eff34b7e700 1 -- 172.21.15.2:0/2252346240 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff240036a0 con 0x7eff30144c10 2023-11-26T07:11:40.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.162+0000 7eff37de4700 1 -- 172.21.15.2:0/2252346240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff30144c10 msgr2=0x7eff3006afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.162+0000 7eff37de4700 1 --2- 172.21.15.2:0/2252346240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff30144c10 0x7eff3006afd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7eff30073800 tx=0x7eff24009bd0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.163+0000 7eff37de4700 1 -- 172.21.15.2:0/2252346240 shutdown_connections 2023-11-26T07:11:40.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.163+0000 7eff37de4700 1 --2- 172.21.15.2:0/2252346240 >> v2:172.21.15.192:3300/0 conn(0x7eff30145650 0x7eff3006b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.163+0000 7eff37de4700 1 --2- 172.21.15.2:0/2252346240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff30144c10 0x7eff3006afd0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.163+0000 7eff37de4700 1 -- 172.21.15.2:0/2252346240 >> 172.21.15.2:0/2252346240 conn(0x7eff300b2740 msgr2=0x7eff300b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:40.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.163+0000 7eff37de4700 1 -- 172.21.15.2:0/2252346240 shutdown_connections 2023-11-26T07:11:40.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.163+0000 7eff37de4700 1 -- 172.21.15.2:0/2252346240 wait complete. 2023-11-26T07:11:40.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.164+0000 7eff37de4700 1 Processor -- start 2023-11-26T07:11:40.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.164+0000 7eff37de4700 1 -- start start 2023-11-26T07:11:40.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.165+0000 7eff37de4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff30144c10 0x7eff30143a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.165+0000 7eff37de4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff30145100 0x7eff301f1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.165+0000 7eff37de4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff30145650 0x7eff301f2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.165+0000 7eff37de4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff301435f0 con 0x7eff30145100 2023-11-26T07:11:40.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.165+0000 7eff37de4700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff301429e0 con 0x7eff30145650 2023-11-26T07:11:40.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.165+0000 7eff37de4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff30142cc0 con 0x7eff30144c10 2023-11-26T07:11:40.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.165+0000 7eff3537f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff30145100 0x7eff301f1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.165+0000 7eff3537f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff30145100 0x7eff301f1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38958/0 (socket says 172.21.15.2:38958) 2023-11-26T07:11:40.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.165+0000 7eff3537f700 1 -- 172.21.15.2:0/1796025841 learned_addr learned my addr 172.21.15.2:0/1796025841 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:40.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.165+0000 7eff35b80700 1 --2- 172.21.15.2:0/1796025841 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff30144c10 0x7eff30143a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.165+0000 7eff36381700 1 --2- 172.21.15.2:0/1796025841 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff30145650 0x7eff301f2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.165+0000 7eff3537f700 1 -- 172.21.15.2:0/1796025841 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff30144c10 msgr2=0x7eff30143a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.165+0000 7eff3537f700 1 --2- 172.21.15.2:0/1796025841 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff30144c10 0x7eff30143a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.165+0000 7eff3537f700 1 -- 172.21.15.2:0/1796025841 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff30145650 msgr2=0x7eff301f2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.165+0000 7eff3537f700 1 --2- 172.21.15.2:0/1796025841 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff30145650 0x7eff301f2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.165+0000 7eff3537f700 1 -- 172.21.15.2:0/1796025841 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff24009550 con 0x7eff30145100 2023-11-26T07:11:40.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.165+0000 7eff3537f700 1 --2- 172.21.15.2:0/1796025841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff30145100 0x7eff301f1e80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7eff2c00c4a0 tx=0x7eff2c00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.165+0000 7eff227fc700 1 -- 172.21.15.2:0/1796025841 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2c011790 con 0x7eff30145100 2023-11-26T07:11:40.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.165+0000 7eff227fc700 1 -- 172.21.15.2:0/1796025841 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2c0118f0 con 0x7eff30145100 2023-11-26T07:11:40.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.165+0000 7eff227fc700 1 -- 172.21.15.2:0/1796025841 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2c011ca0 con 0x7eff30145100 2023-11-26T07:11:40.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.165+0000 7eff37de4700 1 -- 172.21.15.2:0/1796025841 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff30142fa0 con 0x7eff30145100 2023-11-26T07:11:40.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.165+0000 7eff37de4700 1 -- 172.21.15.2:0/1796025841 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff30142670 con 0x7eff30145100 2023-11-26T07:11:40.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.166+0000 7eff37de4700 1 -- 172.21.15.2:0/1796025841 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff300cda40 con 0x7eff30145100 2023-11-26T07:11:40.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.167+0000 7eff227fc700 1 -- 172.21.15.2:0/1796025841 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7eff2c01c460 con 0x7eff30145100 2023-11-26T07:11:40.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.167+0000 7eff227fc700 1 --2- 172.21.15.2:0/1796025841 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7eff1406aed0 0x7eff1406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.167+0000 7eff227fc700 1 -- 172.21.15.2:0/1796025841 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7eff2c089280 con 0x7eff30145100 2023-11-26T07:11:40.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.167+0000 7eff35b80700 1 --2- 172.21.15.2:0/1796025841 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7eff1406aed0 0x7eff1406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.168+0000 7eff35b80700 1 --2- 172.21.15.2:0/1796025841 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7eff1406aed0 0x7eff1406d390 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7eff24009130 tx=0x7eff24008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.172+0000 7eff227fc700 1 -- 172.21.15.2:0/1796025841 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7eff300cda40 con 0x7eff30145100 2023-11-26T07:11:40.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.372+0000 7eff37de4700 1 -- 172.21.15.2:0/1796025841 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff300cda40 con 0x7eff30145100 2023-11-26T07:11:40.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.373+0000 7eff227fc700 1 -- 172.21.15.2:0/1796025841 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16457 (secure 0 0 0) 0x7eff300cda40 con 0x7eff30145100 2023-11-26T07:11:40.376 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:11:40.376 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:11:35.634747+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:11:32.129474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:11:33.019837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:11:40.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.375+0000 7eff37de4700 1 -- 172.21.15.2:0/1796025841 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7eff1406aed0 msgr2=0x7eff1406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.375+0000 7eff37de4700 1 --2- 172.21.15.2:0/1796025841 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7eff1406aed0 0x7eff1406d390 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7eff24009130 tx=0x7eff24008030 comp rx=0 tx=0).stop 2023-11-26T07:11:40.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.375+0000 7eff37de4700 1 -- 172.21.15.2:0/1796025841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff30145100 msgr2=0x7eff301f1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.375+0000 7eff37de4700 1 --2- 172.21.15.2:0/1796025841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff30145100 0x7eff301f1e80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7eff2c00c4a0 tx=0x7eff2c00c7b0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.375+0000 7eff37de4700 1 -- 172.21.15.2:0/1796025841 shutdown_connections 2023-11-26T07:11:40.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.375+0000 7eff37de4700 1 --2- 172.21.15.2:0/1796025841 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7eff1406aed0 0x7eff1406d390 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.375+0000 7eff37de4700 1 --2- 172.21.15.2:0/1796025841 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff30145650 0x7eff301f2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.375+0000 7eff37de4700 1 --2- 172.21.15.2:0/1796025841 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff30144c10 0x7eff30143a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.375+0000 7eff37de4700 1 --2- 172.21.15.2:0/1796025841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff30145100 0x7eff301f1e80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.375+0000 7eff37de4700 1 -- 172.21.15.2:0/1796025841 >> 172.21.15.2:0/1796025841 conn(0x7eff300b2740 msgr2=0x7eff3015f650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:40.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.375+0000 7eff37de4700 1 -- 172.21.15.2:0/1796025841 shutdown_connections 2023-11-26T07:11:40.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.375+0000 7eff37de4700 1 -- 172.21.15.2:0/1796025841 wait complete. 2023-11-26T07:11:40.391 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-26T07:11:40.391 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-26T07:11:40.392 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-26T07:11:40.392 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-26T07:11:40.392 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-26T07:11:40.393 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-26T07:11:40.393 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-26T07:11:40.393 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-26T07:11:40.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.610+0000 7fd3c246a700 1 Processor -- start 2023-11-26T07:11:40.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.610+0000 7fd3c246a700 1 -- start start 2023-11-26T07:11:40.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.612+0000 7fd3c246a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3bc0b3330 0x7fd3bc147ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.612+0000 7fd3c246a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd3bc06afd0 0x7fd3bc06b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.612+0000 7fd3c246a700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3bc1489e0 con 0x7fd3bc0b4190 2023-11-26T07:11:40.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.612+0000 7fd3c246a700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3bc06b9c0 con 0x7fd3bc06afd0 2023-11-26T07:11:40.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.612+0000 7fd3c246a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc1457a0 con 0x7fd3bc0b3330 2023-11-26T07:11:40.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.612+0000 7fd3bb7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3bc0b3330 0x7fd3bc147ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.612+0000 7fd3bb7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3bc0b3330 0x7fd3bc147ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.2:37052/0 (socket says 172.21.15.2:37052) 2023-11-26T07:11:40.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.612+0000 7fd3bb7fe700 1 -- 172.21.15.2:0/1263826964 learned_addr learned my addr 172.21.15.2:0/1263826964 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:40.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.610+0000 7f5eebd34700 1 Processor -- start 2023-11-26T07:11:40.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.610+0000 7f5eebd34700 1 -- start start 2023-11-26T07:11:40.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.611+0000 7f5eebd34700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5ee4158010 0x7f5ee40b3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.611+0000 7f5eebd34700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ee40b4ab0 0x7f5ee40cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.611+0000 7f5eebd34700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5ee406bfe0 0x7f5ee406c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.611+0000 7f5eebd34700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ee406c990 con 0x7f5ee4158010 2023-11-26T07:11:40.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.611+0000 7f5eebd34700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ee40b3a30 con 0x7f5ee406bfe0 2023-11-26T07:11:40.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.611+0000 7f5eebd34700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee40b4f30 con 0x7f5ee40b4ab0 2023-11-26T07:11:40.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.613+0000 7f8ba9551700 1 Processor -- start 2023-11-26T07:11:40.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.613+0000 7f8ba9551700 1 -- start start 2023-11-26T07:11:40.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.614+0000 7f8ba9551700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8ba414bf10 0x7f8ba4070a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.614+0000 7f8ba9551700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ba40cbb80 0x7f8ba406cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.614+0000 7f8ba9551700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ba40cc080 con 0x7f8ba4165f70 2023-11-26T07:11:40.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.614+0000 7f8ba9551700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ba40cdf60 con 0x7f8ba414bf10 2023-11-26T07:11:40.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.614+0000 7f8ba9551700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba406e950 con 0x7f8ba40cbb80 2023-11-26T07:11:40.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.614+0000 7f8ba2ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8ba414bf10 0x7f8ba4070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.614+0000 7f8ba2ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8ba414bf10 0x7f8ba4070a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38976/0 (socket says 172.21.15.2:38976) 2023-11-26T07:11:40.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.614+0000 7f8ba2ffd700 1 -- 172.21.15.2:0/855168969 learned_addr learned my addr 172.21.15.2:0/855168969 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:40.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.615+0000 7f8ba27fc700 1 --2- 172.21.15.2:0/855168969 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ba40cbb80 0x7f8ba406cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.613+0000 7fd3bb7fe700 1 -- 172.21.15.2:0/1263826964 >> v2:172.21.15.2:3300/0 conn(0x7fd3bc06afd0 msgr2=0x7fd3bc06b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:40.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.613+0000 7fd3bb7fe700 1 --2- 172.21.15.2:0/1263826964 >> v2:172.21.15.2:3300/0 conn(0x7fd3bc06afd0 0x7fd3bc06b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.613+0000 7fd3bb7fe700 1 -- 172.21.15.2:0/1263826964 >> v1:172.21.15.2:6789/0 conn(0x7fd3bc0b4190 legacy=0x7fd3bc166870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:40.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.613+0000 7fd3bb7fe700 1 -- 172.21.15.2:0/1263826964 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3bc148420 con 0x7fd3bc0b3330 2023-11-26T07:11:40.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.613+0000 7fd3bb7fe700 1 --2- 172.21.15.2:0/1263826964 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3bc0b3330 0x7fd3bc147ab0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0098f0 tx=0x7fd3ac009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2caac05449efc9e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.613+0000 7fd3baffd700 1 -- 172.21.15.2:0/1263826964 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac004230 con 0x7fd3bc0b3330 2023-11-26T07:11:40.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.613+0000 7fd3baffd700 1 -- 172.21.15.2:0/1263826964 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3ac004390 con 0x7fd3bc0b3330 2023-11-26T07:11:40.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.613+0000 7fd3baffd700 1 -- 172.21.15.2:0/1263826964 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac0036a0 con 0x7fd3bc0b3330 2023-11-26T07:11:40.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.612+0000 7f5ee92cf700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ee40b4ab0 0x7f5ee40cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.612+0000 7f5ee92cf700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ee40b4ab0 0x7f5ee40cc8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.2:37048/0 (socket says 172.21.15.2:37048) 2023-11-26T07:11:40.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.612+0000 7f5ee92cf700 1 -- 172.21.15.2:0/3609577262 learned_addr learned my addr 172.21.15.2:0/3609577262 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:40.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.612+0000 7f5ee92cf700 1 -- 172.21.15.2:0/3609577262 >> v2:172.21.15.192:3300/0 conn(0x7f5ee406bfe0 msgr2=0x7f5ee406c450 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-26T07:11:40.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.612+0000 7f5ee92cf700 1 --2- 172.21.15.2:0/3609577262 >> v2:172.21.15.192:3300/0 conn(0x7f5ee406bfe0 0x7f5ee406c450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.612+0000 7f5ee92cf700 1 -- 172.21.15.2:0/3609577262 >> v2:172.21.15.2:3300/0 conn(0x7f5ee4158010 msgr2=0x7f5ee40b3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:40.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.612+0000 7f5ee92cf700 1 --2- 172.21.15.2:0/3609577262 >> v2:172.21.15.2:3300/0 conn(0x7f5ee4158010 0x7f5ee40b3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.612+0000 7f5ee92cf700 1 -- 172.21.15.2:0/3609577262 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee40cce00 con 0x7f5ee40b4ab0 2023-11-26T07:11:40.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.613+0000 7f5ee92cf700 1 --2- 172.21.15.2:0/3609577262 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ee40b4ab0 0x7f5ee40cc8c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5ee406cc10 tx=0x7f5ee0010f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d38addd0b5a97ae5 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.613+0000 7f5ee8ace700 1 -- 172.21.15.2:0/3609577262 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee0009030 con 0x7f5ee40b4ab0 2023-11-26T07:11:40.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.613+0000 7f5ee8ace700 1 -- 172.21.15.2:0/3609577262 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee0010390 con 0x7f5ee40b4ab0 2023-11-26T07:11:40.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.613+0000 7f5ee8ace700 1 -- 172.21.15.2:0/3609577262 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee000be30 con 0x7f5ee40b4ab0 2023-11-26T07:11:40.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.614+0000 7f5eebd34700 1 -- 172.21.15.2:0/3609577262 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ee40b4ab0 msgr2=0x7f5ee40cc8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.614+0000 7f5eebd34700 1 --2- 172.21.15.2:0/3609577262 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ee40b4ab0 0x7f5ee40cc8c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5ee406cc10 tx=0x7f5ee0010f90 comp rx=0 tx=0).stop 2023-11-26T07:11:40.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.615+0000 7f5eebd34700 1 -- 172.21.15.2:0/3609577262 shutdown_connections 2023-11-26T07:11:40.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.615+0000 7f5eebd34700 1 --2- 172.21.15.2:0/3609577262 >> v2:172.21.15.192:3300/0 conn(0x7f5ee406bfe0 0x7f5ee406c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.615+0000 7f5eebd34700 1 --2- 172.21.15.2:0/3609577262 >> v2:172.21.15.2:3300/0 conn(0x7f5ee4158010 0x7f5ee40b3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.615+0000 7f5eebd34700 1 --2- 172.21.15.2:0/3609577262 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ee40b4ab0 0x7f5ee40cc8c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.615+0000 7f5eebd34700 1 -- 172.21.15.2:0/3609577262 >> 172.21.15.2:0/3609577262 conn(0x7f5ee4071390 msgr2=0x7f5ee40717a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:40.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.615+0000 7f8ba2ffd700 1 -- 172.21.15.2:0/855168969 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ba40cbb80 msgr2=0x7f8ba406cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:40.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.615+0000 7f8ba2ffd700 1 --2- 172.21.15.2:0/855168969 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ba40cbb80 0x7f8ba406cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.615+0000 7f8ba2ffd700 1 -- 172.21.15.2:0/855168969 >> v1:172.21.15.2:6789/0 conn(0x7f8ba4165f70 legacy=0x7f8ba40ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.615+0000 7f8ba2ffd700 1 -- 172.21.15.2:0/855168969 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba406ec30 con 0x7f8ba414bf10 2023-11-26T07:11:40.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.615+0000 7f5eebd34700 1 -- 172.21.15.2:0/3609577262 shutdown_connections 2023-11-26T07:11:40.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.615+0000 7f8ba2ffd700 1 --2- 172.21.15.2:0/855168969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ba414bf10 0x7f8ba4070a80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8b980098f0 tx=0x7f8b98009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4c8439bbc7f25b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.615+0000 7f5eebd34700 1 -- 172.21.15.2:0/3609577262 wait complete. 2023-11-26T07:11:40.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.616+0000 7f8ba1ffb700 1 -- 172.21.15.2:0/855168969 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b98011830 con 0x7f8ba414bf10 2023-11-26T07:11:40.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.616+0000 7f8ba1ffb700 1 -- 172.21.15.2:0/855168969 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b98011990 con 0x7f8ba414bf10 2023-11-26T07:11:40.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.616+0000 7f8ba1ffb700 1 -- 172.21.15.2:0/855168969 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b98011d20 con 0x7f8ba414bf10 2023-11-26T07:11:40.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.616+0000 7fd3c246a700 1 -- 172.21.15.2:0/1263826964 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3bc0b3330 msgr2=0x7fd3bc147ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.616+0000 7fd3c246a700 1 --2- 172.21.15.2:0/1263826964 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3bc0b3330 0x7fd3bc147ab0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0098f0 tx=0x7fd3ac009c00 comp rx=0 tx=0).stop 2023-11-26T07:11:40.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.616+0000 7f8ba9551700 1 -- 172.21.15.2:0/855168969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ba414bf10 msgr2=0x7f8ba4070a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.616+0000 7f8ba9551700 1 --2- 172.21.15.2:0/855168969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ba414bf10 0x7f8ba4070a80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8b980098f0 tx=0x7f8b98009c00 comp rx=0 tx=0).stop 2023-11-26T07:11:40.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.616+0000 7f8ba9551700 1 -- 172.21.15.2:0/855168969 shutdown_connections 2023-11-26T07:11:40.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.616+0000 7f8ba9551700 1 --2- 172.21.15.2:0/855168969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ba414bf10 0x7f8ba4070a80 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8b980098f0 tx=0x7f8b98009c00 comp rx=0 tx=0).stop 2023-11-26T07:11:40.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.616+0000 7f8ba9551700 1 --2- 172.21.15.2:0/855168969 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ba40cbb80 0x7f8ba406cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.616+0000 7f8ba9551700 1 -- 172.21.15.2:0/855168969 >> 172.21.15.2:0/855168969 conn(0x7f8ba40cf980 msgr2=0x7f8ba40cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:40.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.617+0000 7fd3c246a700 1 -- 172.21.15.2:0/1263826964 shutdown_connections 2023-11-26T07:11:40.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.617+0000 7fd3c246a700 1 --2- 172.21.15.2:0/1263826964 >> v2:172.21.15.2:3300/0 conn(0x7fd3bc06afd0 0x7fd3bc06b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.617+0000 7fd3c246a700 1 --2- 172.21.15.2:0/1263826964 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3bc0b3330 0x7fd3bc147ab0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.617+0000 7fd3c246a700 1 -- 172.21.15.2:0/1263826964 >> 172.21.15.2:0/1263826964 conn(0x7fd3bc0b2740 msgr2=0x7fd3bc0b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:40.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.617+0000 7f5eebd34700 1 Processor -- start 2023-11-26T07:11:40.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.617+0000 7f8ba9551700 1 -- 172.21.15.2:0/855168969 shutdown_connections 2023-11-26T07:11:40.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.618+0000 7fd3c246a700 1 -- 172.21.15.2:0/1263826964 shutdown_connections 2023-11-26T07:11:40.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.617+0000 7f5eebd34700 1 -- start start 2023-11-26T07:11:40.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.618+0000 7f5eebd34700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ee406bfe0 0x7f5ee413da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.618+0000 7f5eebd34700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ee40b4ab0 0x7f5ee41e3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.618+0000 7f5eebd34700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ee4158010 0x7f5ee4158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.618+0000 7f5eebd34700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee41e5360 con 0x7f5ee4158010 2023-11-26T07:11:40.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.618+0000 7f5eebd34700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee41e4750 con 0x7f5ee406bfe0 2023-11-26T07:11:40.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.618+0000 7f5eebd34700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee41e4a30 con 0x7f5ee40b4ab0 2023-11-26T07:11:40.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.618+0000 7f5ee9ad0700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ee406bfe0 0x7f5ee413da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.618+0000 7f5ee9ad0700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ee406bfe0 0x7f5ee413da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.2:47568/0 (socket says 172.21.15.2:47568) 2023-11-26T07:11:40.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.618+0000 7f5eea2d1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ee4158010 0x7f5ee4158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.618+0000 7f5ee9ad0700 1 -- 172.21.15.2:0/3810838367 learned_addr learned my addr 172.21.15.2:0/3810838367 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:40.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.618+0000 7f5ee92cf700 1 --2- 172.21.15.2:0/3810838367 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ee40b4ab0 0x7f5ee41e3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.619+0000 7f48ab9e1700 1 Processor -- start 2023-11-26T07:11:40.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.619+0000 7f5eea2d1700 1 -- 172.21.15.2:0/3810838367 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ee40b4ab0 msgr2=0x7f5ee41e3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.619+0000 7f5eea2d1700 1 --2- 172.21.15.2:0/3810838367 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ee40b4ab0 0x7f5ee41e3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.619+0000 7f5eea2d1700 1 -- 172.21.15.2:0/3810838367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ee406bfe0 msgr2=0x7f5ee413da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.619+0000 7f5eea2d1700 1 --2- 172.21.15.2:0/3810838367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ee406bfe0 0x7f5ee413da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.619+0000 7f5eea2d1700 1 -- 172.21.15.2:0/3810838367 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee0010910 con 0x7f5ee4158010 2023-11-26T07:11:40.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.618+0000 7fd3c246a700 1 -- 172.21.15.2:0/1263826964 wait complete. 2023-11-26T07:11:40.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.619+0000 7fd3c246a700 1 Processor -- start 2023-11-26T07:11:40.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.619+0000 7f48ab9e1700 1 -- start start 2023-11-26T07:11:40.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.620+0000 7f48ab9e1700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f48a415a820 0x7f48a406b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.620+0000 7f48ab9e1700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48a40b05f0 con 0x7f48a40d06b0 2023-11-26T07:11:40.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.620+0000 7f48ab9e1700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48a415f080 con 0x7f48a415a440 2023-11-26T07:11:40.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.620+0000 7f48ab9e1700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48a40afd50 con 0x7f48a415a820 2023-11-26T07:11:40.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.620+0000 7f48a977d700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f48a415a440 0x7f48a40cffa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.2:37568/0 (socket says 172.21.15.2:37568) 2023-11-26T07:11:40.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.620+0000 7f48a977d700 1 -- 172.21.15.2:0/676476646 learned_addr learned my addr 172.21.15.2:0/676476646 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:11:40.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.619+0000 7f8ba9551700 1 -- 172.21.15.2:0/855168969 wait complete. 2023-11-26T07:11:40.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.619+0000 7fd3c246a700 1 -- start start 2023-11-26T07:11:40.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.620+0000 7fd3c246a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3bc06afd0 0x7fd3bc0affa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.620+0000 7fd3c246a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3bc0b3330 0x7fd3bc142f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.620+0000 7fd3c246a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3bc0b4190 0x7fd3bc14ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.621+0000 7fd3c246a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc1394a0 con 0x7fd3bc0b3330 2023-11-26T07:11:40.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.621+0000 7fd3c246a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc1436a0 con 0x7fd3bc06afd0 2023-11-26T07:11:40.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.621+0000 7fd3c246a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc144500 con 0x7fd3bc0b4190 2023-11-26T07:11:40.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.621+0000 7f489bfff700 1 -- 172.21.15.2:0/676476646 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1055863523 0 0) 0x7f48a415f080 con 0x7f48a415a440 2023-11-26T07:11:40.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.621+0000 7f489bfff700 1 -- 172.21.15.2:0/676476646 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48900035b0 con 0x7f48a415a440 2023-11-26T07:11:40.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.621+0000 7fd3c0a07700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3bc0b4190 0x7fd3bc14ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.621+0000 7f489bfff700 1 -- 172.21.15.2:0/676476646 <== mon.1 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3734163039 0 0) 0x7f48900035b0 con 0x7f48a415a440 2023-11-26T07:11:40.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.621+0000 7f489bfff700 1 -- 172.21.15.2:0/676476646 >> v2:172.21.15.2:3300/0 conn(0x7f48a415a820 msgr2=0x7f48a406b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:40.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.621+0000 7f489bfff700 1 --2- 172.21.15.2:0/676476646 >> v2:172.21.15.2:3300/0 conn(0x7f48a415a820 0x7f48a406b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.621+0000 7f489bfff700 1 -- 172.21.15.2:0/676476646 >> v1:172.21.15.2:6789/0 conn(0x7f48a40d06b0 legacy=0x7f48a406b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:40.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.621+0000 7f489bfff700 1 -- 172.21.15.2:0/676476646 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a40b0030 con 0x7f48a415a440 2023-11-26T07:11:40.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.621+0000 7f489bfff700 1 -- 172.21.15.2:0/676476646 <== mon.1 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f48a0001670 con 0x7f48a415a440 2023-11-26T07:11:40.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.621+0000 7f489bfff700 1 -- 172.21.15.2:0/676476646 >> v1:172.21.15.192:6789/0 conn(0x7f48a415a440 legacy=0x7f48a40cffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.621+0000 7f489bfff700 1 --2- 172.21.15.2:0/676476646 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4890003a00 0x7f4890003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.621+0000 7f489bfff700 1 --2- 172.21.15.2:0/676476646 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4890004850 0x7f4890004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.621+0000 7f489bfff700 1 --2- 172.21.15.2:0/676476646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4890005410 0x7f489000ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.621+0000 7f489bfff700 1 -- 172.21.15.2:0/676476646 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a40afd50 con 0x7f4890005410 2023-11-26T07:11:40.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.621+0000 7f489bfff700 1 -- 172.21.15.2:0/676476646 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489000c350 con 0x7f4890004850 2023-11-26T07:11:40.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.621+0000 7f489bfff700 1 -- 172.21.15.2:0/676476646 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f489000c510 con 0x7f4890003a00 2023-11-26T07:11:40.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.621+0000 7f48a8f7c700 1 --2- 172.21.15.2:0/676476646 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4890004850 0x7f4890004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.621+0000 7fd3c0a07700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3bc0b4190 0x7fd3bc14ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.2:37074/0 (socket says 172.21.15.2:37074) 2023-11-26T07:11:40.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.621+0000 7fd3c0a07700 1 -- 172.21.15.2:0/239991108 learned_addr learned my addr 172.21.15.2:0/239991108 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:40.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.621+0000 7fd3bbfff700 1 --2- 172.21.15.2:0/239991108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3bc06afd0 0x7fd3bc0affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.621+0000 7fd3bb7fe700 1 --2- 172.21.15.2:0/239991108 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3bc0b3330 0x7fd3bc142f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.621+0000 7feca1af1700 1 Processor -- start 2023-11-26T07:11:40.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.621+0000 7f8ba9551700 1 Processor -- start 2023-11-26T07:11:40.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.621+0000 7f48a977d700 1 --2- 172.21.15.2:0/676476646 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4890003a00 0x7f4890003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.621+0000 7fd3c0a07700 1 -- 172.21.15.2:0/239991108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3bc06afd0 msgr2=0x7fd3bc0affa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.621+0000 7fd3c0a07700 1 --2- 172.21.15.2:0/239991108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3bc06afd0 0x7fd3bc0affa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.621+0000 7fd3c0a07700 1 -- 172.21.15.2:0/239991108 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3bc0b3330 msgr2=0x7fd3bc142f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.621+0000 7fd3c0a07700 1 --2- 172.21.15.2:0/239991108 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3bc0b3330 0x7fd3bc142f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.621+0000 7fd3c0a07700 1 -- 172.21.15.2:0/239991108 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ac009550 con 0x7fd3bc0b4190 2023-11-26T07:11:40.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.622+0000 7f48a9f7e700 1 --2- 172.21.15.2:0/676476646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4890005410 0x7f489000ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.622+0000 7f48a8f7c700 1 -- 172.21.15.2:0/676476646 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4890003a00 msgr2=0x7f4890003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:40.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.622+0000 7f48a8f7c700 1 --2- 172.21.15.2:0/676476646 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4890003a00 0x7f4890003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.622+0000 7f48a8f7c700 1 -- 172.21.15.2:0/676476646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4890005410 msgr2=0x7f489000ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:40.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.622+0000 7f48a8f7c700 1 --2- 172.21.15.2:0/676476646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4890005410 0x7f489000ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.622+0000 7f48a8f7c700 1 -- 172.21.15.2:0/676476646 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a40b0030 con 0x7f4890004850 2023-11-26T07:11:40.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.622+0000 7f48a9f7e700 1 -- 172.21.15.2:0/676476646 reap_dead start 2023-11-26T07:11:40.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.623+0000 7f48a8f7c700 1 --2- 172.21.15.2:0/676476646 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4890004850 0x7f4890004cd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f48940098e0 tx=0x7f4890005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0002dfbf7990729 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.621+0000 7f8ba9551700 1 -- start start 2023-11-26T07:11:40.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.623+0000 7f8ba9551700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ba40cbb80 0x7f8ba40aff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.623+0000 7f8ba9551700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ba4165f70 0x7f8ba40b0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.623+0000 7f8ba9551700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ba4136630 0x7f8ba4164970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.623+0000 7f8ba9551700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba4165740 con 0x7f8ba4165f70 2023-11-26T07:11:40.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.623+0000 7f8ba9551700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba4138010 con 0x7f8ba40cbb80 2023-11-26T07:11:40.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.623+0000 7f8ba9551700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba41382d0 con 0x7f8ba4136630 2023-11-26T07:11:40.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.623+0000 7f489bfff700 1 -- 172.21.15.2:0/676476646 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4894004230 con 0x7f4890004850 2023-11-26T07:11:40.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.623+0000 7f489bfff700 1 -- 172.21.15.2:0/676476646 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48940043b0 con 0x7f4890004850 2023-11-26T07:11:40.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.623+0000 7f489bfff700 1 -- 172.21.15.2:0/676476646 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48940038c0 con 0x7f4890004850 2023-11-26T07:11:40.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.623+0000 7fd3c0a07700 1 --2- 172.21.15.2:0/239991108 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3bc0b4190 0x7fd3bc14ac70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd3b400b9a0 tx=0x7fd3b400bcb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.621+0000 7feca1af1700 1 -- start start 2023-11-26T07:11:40.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.623+0000 7feca1af1700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fec9c162490 0x7fec9c166a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.623+0000 7feca1af1700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fec9c0b4eb0 0x7fec9c165e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.623+0000 7feca1af1700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec9c1667c0 con 0x7fec9c1663b0 2023-11-26T07:11:40.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.623+0000 7feca1af1700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec9c0afa10 con 0x7fec9c0b4eb0 2023-11-26T07:11:40.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.623+0000 7feca1af1700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec9c0afcb0 con 0x7fec9c162490 2023-11-26T07:11:40.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.623+0000 7fec9affd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fec9c0b4eb0 0x7fec9c165e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.623+0000 7fec9affd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fec9c0b4eb0 0x7fec9c165e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39012/0 (socket says 172.21.15.2:39012) 2023-11-26T07:11:40.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.623+0000 7fec9affd700 1 -- 172.21.15.2:0/1512834021 learned_addr learned my addr 172.21.15.2:0/1512834021 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:40.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.623+0000 7fec9b7fe700 1 --2- 172.21.15.2:0/1512834021 >> v2:172.21.15.192:3300/0 conn(0x7fec9c162490 0x7fec9c166a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.624+0000 7fec9affd700 1 -- 172.21.15.2:0/1512834021 >> v2:172.21.15.192:3300/0 conn(0x7fec9c162490 msgr2=0x7fec9c166a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:40.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.624+0000 7fec9affd700 1 --2- 172.21.15.2:0/1512834021 >> v2:172.21.15.192:3300/0 conn(0x7fec9c162490 0x7fec9c166a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.624+0000 7fec9affd700 1 -- 172.21.15.2:0/1512834021 >> v1:172.21.15.2:6789/0 conn(0x7fec9c1663b0 legacy=0x7fec9c0b3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.624+0000 7fec9affd700 1 -- 172.21.15.2:0/1512834021 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec9c06d460 con 0x7fec9c0b4eb0 2023-11-26T07:11:40.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.624+0000 7fec9affd700 1 --2- 172.21.15.2:0/1512834021 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec9c0b4eb0 0x7fec9c165e70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fec9c06ca10 tx=0x7fec8c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8f36390e251bc00 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.623+0000 7f247fac7700 1 Processor -- start 2023-11-26T07:11:40.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.624+0000 7f247fac7700 1 -- start start 2023-11-26T07:11:40.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.624+0000 7f48ab9e1700 1 -- 172.21.15.2:0/676476646 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4890004850 msgr2=0x7f4890004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.624+0000 7f48ab9e1700 1 --2- 172.21.15.2:0/676476646 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4890004850 0x7f4890004cd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f48940098e0 tx=0x7f4890005880 comp rx=0 tx=0).stop 2023-11-26T07:11:40.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.624+0000 7f48ab9e1700 1 -- 172.21.15.2:0/676476646 shutdown_connections 2023-11-26T07:11:40.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.624+0000 7f48ab9e1700 1 --2- 172.21.15.2:0/676476646 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4890004850 0x7f4890004cd0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.624+0000 7f48ab9e1700 1 -- 172.21.15.2:0/676476646 >> 172.21.15.2:0/676476646 conn(0x7f48a40b5070 msgr2=0x7f48a40b5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:40.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.624+0000 7f48ab9e1700 1 -- 172.21.15.2:0/676476646 shutdown_connections 2023-11-26T07:11:40.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.624+0000 7f48ab9e1700 1 -- 172.21.15.2:0/676476646 wait complete. 2023-11-26T07:11:40.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.622+0000 7f5eea2d1700 1 --2- 172.21.15.2:0/3810838367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ee4158010 0x7f5ee4158e20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5edc00bb00 tx=0x7f5edc00bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.623+0000 7f5eda7fc700 1 -- 172.21.15.2:0/3810838367 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc00cae0 con 0x7f5ee4158010 2023-11-26T07:11:40.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.623+0000 7f5eda7fc700 1 -- 172.21.15.2:0/3810838367 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5edc00cc40 con 0x7f5ee4158010 2023-11-26T07:11:40.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.623+0000 7f5eda7fc700 1 -- 172.21.15.2:0/3810838367 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc014440 con 0x7f5ee4158010 2023-11-26T07:11:40.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.624+0000 7fb1b34bd700 1 Processor -- start 2023-11-26T07:11:40.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.623+0000 7f8ba2ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ba40cbb80 0x7f8ba40aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.623+0000 7f8ba2ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ba40cbb80 0x7f8ba40aff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.2:47592/0 (socket says 172.21.15.2:47592) 2023-11-26T07:11:40.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.623+0000 7f8ba2ffd700 1 -- 172.21.15.2:0/3284726987 learned_addr learned my addr 172.21.15.2:0/3284726987 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:40.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.623+0000 7f8ba27fc700 1 --2- 172.21.15.2:0/3284726987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ba4165f70 0x7f8ba40b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.623+0000 7f8ba27fc700 1 -- 172.21.15.2:0/3284726987 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ba4136630 msgr2=0x7f8ba4164970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.623+0000 7f8ba27fc700 1 --2- 172.21.15.2:0/3284726987 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ba4136630 0x7f8ba4164970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.623+0000 7f8ba27fc700 1 -- 172.21.15.2:0/3284726987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ba40cbb80 msgr2=0x7f8ba40aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.623+0000 7f8ba27fc700 1 --2- 172.21.15.2:0/3284726987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ba40cbb80 0x7f8ba40aff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.623+0000 7f8ba27fc700 1 -- 172.21.15.2:0/3284726987 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b98009550 con 0x7f8ba4165f70 2023-11-26T07:11:40.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.625+0000 7fec9a7fc700 1 -- 172.21.15.2:0/1512834021 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8c00b870 con 0x7fec9c0b4eb0 2023-11-26T07:11:40.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.625+0000 7f247fac7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2478163a90 0x7f2478165e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.625+0000 7f247fac7700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24780c9fd0 con 0x7f247806e450 2023-11-26T07:11:40.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.625+0000 7f247fac7700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24780ca2b0 con 0x7f24780724f0 2023-11-26T07:11:40.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.625+0000 7f247fac7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f247815f530 con 0x7f2478163a90 2023-11-26T07:11:40.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.625+0000 7fec9a7fc700 1 -- 172.21.15.2:0/1512834021 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8c00b9d0 con 0x7fec9c0b4eb0 2023-11-26T07:11:40.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.625+0000 7fec9a7fc700 1 -- 172.21.15.2:0/1512834021 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8c00bd60 con 0x7fec9c0b4eb0 2023-11-26T07:11:40.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.625+0000 7f8ba27fc700 1 --2- 172.21.15.2:0/3284726987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ba4165f70 0x7f8ba40b0440 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8b9400e900 tx=0x7f8b9400ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.625+0000 7f247d863700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f24780724f0 0x7f247815e710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.2:37598/0 (socket says 172.21.15.2:37598) 2023-11-26T07:11:40.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.625+0000 7f247d863700 1 -- 172.21.15.2:0/4220555251 learned_addr learned my addr 172.21.15.2:0/4220555251 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:11:40.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.625+0000 7f247e064700 1 --2- 172.21.15.2:0/4220555251 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2478163a90 0x7f2478165e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.625+0000 7f5eebd34700 1 -- 172.21.15.2:0/3810838367 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee41e4d10 con 0x7f5ee4158010 2023-11-26T07:11:40.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.625+0000 7f5eebd34700 1 -- 172.21.15.2:0/3810838367 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee413df90 con 0x7f5ee4158010 2023-11-26T07:11:40.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.626+0000 7feca1af1700 1 -- 172.21.15.2:0/1512834021 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec9c0b4eb0 msgr2=0x7fec9c165e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.626+0000 7feca1af1700 1 --2- 172.21.15.2:0/1512834021 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec9c0b4eb0 0x7fec9c165e70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fec9c06ca10 tx=0x7fec8c009bd0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.626+0000 7f247e064700 1 -- 172.21.15.2:0/4220555251 >> v1:172.21.15.192:6789/0 conn(0x7f24780724f0 legacy=0x7f247815e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.626+0000 7f247e064700 1 -- 172.21.15.2:0/4220555251 >> v1:172.21.15.2:6789/0 conn(0x7f247806e450 legacy=0x7f247815ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:40.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.626+0000 7f247e064700 1 -- 172.21.15.2:0/4220555251 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f247806ebc0 con 0x7f2478163a90 2023-11-26T07:11:40.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.626+0000 7f8b8b7fe700 1 -- 172.21.15.2:0/3284726987 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9400ee50 con 0x7f8ba4165f70 2023-11-26T07:11:40.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.626+0000 7f8b8b7fe700 1 -- 172.21.15.2:0/3284726987 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b9400c850 con 0x7f8ba4165f70 2023-11-26T07:11:40.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.626+0000 7f8b8b7fe700 1 -- 172.21.15.2:0/3284726987 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9400cbc0 con 0x7f8ba4165f70 2023-11-26T07:11:40.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.626+0000 7f8ba9551700 1 -- 172.21.15.2:0/3284726987 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ba41385b0 con 0x7f8ba4165f70 2023-11-26T07:11:40.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.626+0000 7f8ba9551700 1 -- 172.21.15.2:0/3284726987 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ba4138db0 con 0x7f8ba4165f70 2023-11-26T07:11:40.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.626+0000 7f247e064700 1 --2- 172.21.15.2:0/4220555251 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2478163a90 0x7f2478165e80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f247000bfd0 tx=0x7f247000d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3968f34a4cd63139 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.625+0000 7fb1b34bd700 1 -- start start 2023-11-26T07:11:40.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.626+0000 7fb1b34bd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb1ac0d2490 0x7fb1ac0d28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.626+0000 7fb1b34bd700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac0d2e30 con 0x7fb1ac0c8330 2023-11-26T07:11:40.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.626+0000 7fb1b34bd700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac0cfde0 con 0x7fb1ac15e130 2023-11-26T07:11:40.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.626+0000 7fb1b34bd700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1ac0c7ea0 con 0x7fb1ac0d2490 2023-11-26T07:11:40.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.626+0000 7fb1b1259700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fb1ac15e130 0x7fb1ac0d1c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.2:37604/0 (socket says 172.21.15.2:37604) 2023-11-26T07:11:40.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.626+0000 7fb1b1259700 1 -- 172.21.15.2:0/1345926394 learned_addr learned my addr 172.21.15.2:0/1345926394 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:11:40.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.626+0000 7f48ab9e1700 1 Processor -- start 2023-11-26T07:11:40.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.626+0000 7f247c861700 1 -- 172.21.15.2:0/4220555251 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2470010070 con 0x7f2478163a90 2023-11-26T07:11:40.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.626+0000 7fb1b0a58700 1 --2- 172.21.15.2:0/1345926394 >> v2:172.21.15.192:3300/0 conn(0x7fb1ac0d2490 0x7fb1ac0d28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.627+0000 7fb1b0a58700 1 -- 172.21.15.2:0/1345926394 >> v1:172.21.15.192:6789/0 conn(0x7fb1ac15e130 legacy=0x7fb1ac0d1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.627+0000 7fb1b0a58700 1 -- 172.21.15.2:0/1345926394 >> v1:172.21.15.2:6789/0 conn(0x7fb1ac0c8330 legacy=0x7fb1ac0c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.627+0000 7fb1b0a58700 1 -- 172.21.15.2:0/1345926394 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1ac0cf820 con 0x7fb1ac0d2490 2023-11-26T07:11:40.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.627+0000 7feca1af1700 1 -- 172.21.15.2:0/1512834021 shutdown_connections 2023-11-26T07:11:40.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.627+0000 7feca1af1700 1 --2- 172.21.15.2:0/1512834021 >> v2:172.21.15.192:3300/0 conn(0x7fec9c162490 0x7fec9c166a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.627+0000 7feca1af1700 1 --2- 172.21.15.2:0/1512834021 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec9c0b4eb0 0x7fec9c165e70 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.627+0000 7feca1af1700 1 -- 172.21.15.2:0/1512834021 >> 172.21.15.2:0/1512834021 conn(0x7fec9c0722b0 msgr2=0x7fec9c06afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:40.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.627+0000 7f8ba9551700 1 -- 172.21.15.2:0/3284726987 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8ba406f490 con 0x7f8ba4165f70 2023-11-26T07:11:40.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.628+0000 7f48ab9e1700 1 -- start start 2023-11-26T07:11:40.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.629+0000 7f48ab9e1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4890004850 0x7f48a40cf830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.629+0000 7f48ab9e1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48a41506f0 0x7f48a415b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.629+0000 7f48ab9e1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48a41585d0 0x7f48a4158a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.629+0000 7f48ab9e1700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a4158f90 con 0x7f4890004850 2023-11-26T07:11:40.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.629+0000 7f48ab9e1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a40ce790 con 0x7f48a41506f0 2023-11-26T07:11:40.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.629+0000 7f48ab9e1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a40cea70 con 0x7f48a41585d0 2023-11-26T07:11:40.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.629+0000 7f48a977d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4890004850 0x7f48a40cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.629+0000 7f48a977d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4890004850 0x7f48a40cf830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39030/0 (socket says 172.21.15.2:39030) 2023-11-26T07:11:40.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.629+0000 7f48a977d700 1 -- 172.21.15.2:0/1078449571 learned_addr learned my addr 172.21.15.2:0/1078449571 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:40.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.627+0000 7feca1af1700 1 -- 172.21.15.2:0/1512834021 shutdown_connections 2023-11-26T07:11:40.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.627+0000 7feca1af1700 1 -- 172.21.15.2:0/1512834021 wait complete. 2023-11-26T07:11:40.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.626+0000 7f247c861700 1 -- 172.21.15.2:0/4220555251 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f247000b2e0 con 0x7f2478163a90 2023-11-26T07:11:40.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.627+0000 7f247c861700 1 -- 172.21.15.2:0/4220555251 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2470003c40 con 0x7f2478163a90 2023-11-26T07:11:40.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.627+0000 7f247fac7700 1 -- 172.21.15.2:0/4220555251 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2478163a90 msgr2=0x7f2478165e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.627+0000 7f247fac7700 1 --2- 172.21.15.2:0/4220555251 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2478163a90 0x7f2478165e80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f247000bfd0 tx=0x7f247000d330 comp rx=0 tx=0).stop 2023-11-26T07:11:40.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.628+0000 7f5eebd34700 1 -- 172.21.15.2:0/3810838367 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5ee40b5490 con 0x7f5ee4158010 2023-11-26T07:11:40.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.628+0000 7fb1b0a58700 1 --2- 172.21.15.2:0/1345926394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1ac0d2490 0x7fb1ac0d28f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4009d90 tx=0x7fb1a400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20617c293eb7835d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.628+0000 7fb1a3fff700 1 -- 172.21.15.2:0/1345926394 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a400e070 con 0x7fb1ac0d2490 2023-11-26T07:11:40.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.628+0000 7fb1a3fff700 1 -- 172.21.15.2:0/1345926394 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a400bad0 con 0x7fb1ac0d2490 2023-11-26T07:11:40.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.628+0000 7fb1a3fff700 1 -- 172.21.15.2:0/1345926394 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a400be80 con 0x7fb1ac0d2490 2023-11-26T07:11:40.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.629+0000 7feca1af1700 1 Processor -- start 2023-11-26T07:11:40.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.629+0000 7f247fac7700 1 -- 172.21.15.2:0/4220555251 shutdown_connections 2023-11-26T07:11:40.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.629+0000 7f247fac7700 1 --2- 172.21.15.2:0/4220555251 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2478163a90 0x7f2478165e80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.629+0000 7f247fac7700 1 -- 172.21.15.2:0/4220555251 >> 172.21.15.2:0/4220555251 conn(0x7f24780cf980 msgr2=0x7f24780cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:40.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.629+0000 7f48a8f7c700 1 --2- 172.21.15.2:0/1078449571 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48a41506f0 0x7f48a415b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.629+0000 7f48a9f7e700 1 --2- 172.21.15.2:0/1078449571 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48a41585d0 0x7f48a4158a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.629+0000 7f48a977d700 1 -- 172.21.15.2:0/1078449571 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48a41585d0 msgr2=0x7f48a4158a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.629+0000 7f48a977d700 1 --2- 172.21.15.2:0/1078449571 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48a41585d0 0x7f48a4158a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.629+0000 7f48a977d700 1 -- 172.21.15.2:0/1078449571 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48a41506f0 msgr2=0x7f48a415b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.629+0000 7f48a977d700 1 --2- 172.21.15.2:0/1078449571 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48a41506f0 0x7f48a415b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.629+0000 7fb1b34bd700 1 -- 172.21.15.2:0/1345926394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1ac0d2490 msgr2=0x7fb1ac0d28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.629+0000 7fb1b34bd700 1 --2- 172.21.15.2:0/1345926394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1ac0d2490 0x7fb1ac0d28f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4009d90 tx=0x7fb1a400b330 comp rx=0 tx=0).stop 2023-11-26T07:11:40.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.629+0000 7fb1b34bd700 1 -- 172.21.15.2:0/1345926394 shutdown_connections 2023-11-26T07:11:40.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.629+0000 7fb1b34bd700 1 --2- 172.21.15.2:0/1345926394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1ac0d2490 0x7fb1ac0d28f0 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4009d90 tx=0x7fb1a400b330 comp rx=0 tx=0).stop 2023-11-26T07:11:40.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.629+0000 7fb1b34bd700 1 -- 172.21.15.2:0/1345926394 >> 172.21.15.2:0/1345926394 conn(0x7fb1ac0d3eb0 msgr2=0x7fb1ac0d42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:40.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.629+0000 7f48a977d700 1 -- 172.21.15.2:0/1078449571 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a40ced50 con 0x7f4890004850 2023-11-26T07:11:40.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.628+0000 7f5eda7fc700 1 -- 172.21.15.2:0/3810838367 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5edc01d3b0 con 0x7f5ee4158010 2023-11-26T07:11:40.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.629+0000 7f5eda7fc700 1 --2- 172.21.15.2:0/3810838367 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5ec806aed0 0x7f5ec806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.629+0000 7f5eda7fc700 1 -- 172.21.15.2:0/3810838367 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5edc089410 con 0x7f5ee4158010 2023-11-26T07:11:40.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.629+0000 7f5eda7fc700 1 --2- 172.21.15.2:0/3810838367 >> [v2:172.21.15.192:6816/1249076734,v1:172.21.15.192:6817/1249076734] conn(0x7f5ec8073070 0x7f5ec8075490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.629+0000 7f5eda7fc700 1 -- 172.21.15.2:0/3810838367 --> [v2:172.21.15.192:6816/1249076734,v1:172.21.15.192:6817/1249076734] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5ec8075b40 con 0x7f5ec8073070 2023-11-26T07:11:40.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.629+0000 7f5eda7fc700 1 -- 172.21.15.2:0/3810838367 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5edc08bad0 con 0x7f5ee4158010 2023-11-26T07:11:40.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.629+0000 7f8b8b7fe700 1 -- 172.21.15.2:0/3284726987 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8b9400cd20 con 0x7f8ba4165f70 2023-11-26T07:11:40.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.629+0000 7fb1b34bd700 1 -- 172.21.15.2:0/1345926394 shutdown_connections 2023-11-26T07:11:40.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.629+0000 7f247fac7700 1 -- 172.21.15.2:0/4220555251 shutdown_connections 2023-11-26T07:11:40.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.630+0000 7f48a977d700 1 --2- 172.21.15.2:0/1078449571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4890004850 0x7f48a40cf830 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f48a000e820 tx=0x7f48a000eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.630+0000 7feca1af1700 1 -- start start 2023-11-26T07:11:40.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.630+0000 7f8b8b7fe700 1 --2- 172.21.15.2:0/3284726987 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8b9006aed0 0x7f8b9006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.630+0000 7f8b8b7fe700 1 -- 172.21.15.2:0/3284726987 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8b940899b0 con 0x7f8ba4165f70 2023-11-26T07:11:40.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.630+0000 7f8ba2ffd700 1 --2- 172.21.15.2:0/3284726987 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8b9006aed0 0x7f8b9006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.630+0000 7f8b8b7fe700 1 --2- 172.21.15.2:0/3284726987 >> [v2:172.21.15.2:6816/2852728003,v1:172.21.15.2:6817/2852728003] conn(0x7f8b900730f0 0x7f8b90075510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.630+0000 7f8b8b7fe700 1 -- 172.21.15.2:0/3284726987 --> [v2:172.21.15.2:6816/2852728003,v1:172.21.15.2:6817/2852728003] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8b90075bc0 con 0x7f8b900730f0 2023-11-26T07:11:40.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.630+0000 7f8b8b7fe700 1 -- 172.21.15.2:0/3284726987 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b94089d60 con 0x7f8ba4165f70 2023-11-26T07:11:40.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.631+0000 7f8ba37fe700 1 --2- 172.21.15.2:0/3284726987 >> [v2:172.21.15.2:6816/2852728003,v1:172.21.15.2:6817/2852728003] conn(0x7f8b900730f0 0x7f8b90075510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.631+0000 7feca1af1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec9c0b4eb0 0x7fec9c13bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.631+0000 7feca1af1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec9c162490 0x7fec9c13a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.631+0000 7feca1af1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec9c1663b0 0x7fec9c141210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.631+0000 7feca1af1700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9c13a540 con 0x7fec9c162490 2023-11-26T07:11:40.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.631+0000 7feca1af1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9c13a8c0 con 0x7fec9c1663b0 2023-11-26T07:11:40.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.631+0000 7feca1af1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec9c13aba0 con 0x7fec9c0b4eb0 2023-11-26T07:11:40.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.629+0000 7fb1b34bd700 1 -- 172.21.15.2:0/1345926394 wait complete. 2023-11-26T07:11:40.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.631+0000 7f8ba2ffd700 1 --2- 172.21.15.2:0/3284726987 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8b9006aed0 0x7f8b9006d390 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8b98009130 tx=0x7f8b98008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.630+0000 7f4899ffb700 1 -- 172.21.15.2:0/1078449571 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a0012590 con 0x7f4890004850 2023-11-26T07:11:40.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.630+0000 7f4899ffb700 1 -- 172.21.15.2:0/1078449571 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a0012710 con 0x7f4890004850 2023-11-26T07:11:40.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.630+0000 7f4899ffb700 1 -- 172.21.15.2:0/1078449571 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a0012ac0 con 0x7f4890004850 2023-11-26T07:11:40.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.631+0000 7f48ab9e1700 1 -- 172.21.15.2:0/1078449571 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48a40cf030 con 0x7f4890004850 2023-11-26T07:11:40.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.631+0000 7f48ab9e1700 1 -- 172.21.15.2:0/1078449571 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48a415bb30 con 0x7f4890004850 2023-11-26T07:11:40.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.631+0000 7fec9b7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec9c0b4eb0 0x7fec9c13bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.631+0000 7fec9b7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec9c0b4eb0 0x7fec9c13bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.2:37124/0 (socket says 172.21.15.2:37124) 2023-11-26T07:11:40.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.631+0000 7fec9b7fe700 1 -- 172.21.15.2:0/1188963177 learned_addr learned my addr 172.21.15.2:0/1188963177 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:40.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.631+0000 7fec9bfff700 1 --2- 172.21.15.2:0/1188963177 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec9c1663b0 0x7fec9c141210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.630+0000 7f247fac7700 1 -- 172.21.15.2:0/4220555251 wait complete. 2023-11-26T07:11:40.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.631+0000 7f247fac7700 1 Processor -- start 2023-11-26T07:11:40.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.631+0000 7f5ee92cf700 1 --2- 172.21.15.2:0/3810838367 >> [v2:172.21.15.192:6816/1249076734,v1:172.21.15.192:6817/1249076734] conn(0x7f5ec8073070 0x7f5ec8075490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.631+0000 7f5ee9ad0700 1 --2- 172.21.15.2:0/3810838367 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5ec806aed0 0x7f5ec806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.631+0000 7fec9affd700 1 --2- 172.21.15.2:0/1188963177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec9c162490 0x7fec9c13a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.632+0000 7fec9b7fe700 1 -- 172.21.15.2:0/1188963177 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec9c1663b0 msgr2=0x7fec9c141210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.632+0000 7fec9b7fe700 1 --2- 172.21.15.2:0/1188963177 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec9c1663b0 0x7fec9c141210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.632+0000 7fec9b7fe700 1 -- 172.21.15.2:0/1188963177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec9c162490 msgr2=0x7fec9c13a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.632+0000 7fec9b7fe700 1 --2- 172.21.15.2:0/1188963177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec9c162490 0x7fec9c13a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.632+0000 7fec9b7fe700 1 -- 172.21.15.2:0/1188963177 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec8c009550 con 0x7fec9c0b4eb0 2023-11-26T07:11:40.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.632+0000 7fec9b7fe700 1 --2- 172.21.15.2:0/1188963177 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec9c0b4eb0 0x7fec9c13bc80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fec9000e810 tx=0x7fec9000eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.632+0000 7f8ba37fe700 1 --2- 172.21.15.2:0/3284726987 >> [v2:172.21.15.2:6816/2852728003,v1:172.21.15.2:6817/2852728003] conn(0x7f8b900730f0 0x7f8b90075510 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.632+0000 7f5ee9ad0700 1 --2- 172.21.15.2:0/3810838367 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5ec806aed0 0x7f5ec806d390 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4006fd0 tx=0x7f5ed4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.632+0000 7fb1b34bd700 1 Processor -- start 2023-11-26T07:11:40.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.632+0000 7fb1b34bd700 1 -- start start 2023-11-26T07:11:40.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.632+0000 7f5ee92cf700 1 --2- 172.21.15.2:0/3810838367 >> [v2:172.21.15.192:6816/1249076734,v1:172.21.15.192:6817/1249076734] conn(0x7f5ec8073070 0x7f5ec8075490 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.633+0000 7f247fac7700 1 -- start start 2023-11-26T07:11:40.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.632+0000 7f48ab9e1700 1 -- 172.21.15.2:0/1078449571 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4884000fb0 con 0x7f4890004850 2023-11-26T07:11:40.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.633+0000 7f4899ffb700 1 -- 172.21.15.2:0/1078449571 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f48a0012c20 con 0x7f4890004850 2023-11-26T07:11:40.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.633+0000 7f8b8b7fe700 1 -- 172.21.15.2:0/3284726987 <== osd.0 v2:172.21.15.2:6816/2852728003 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f8b90075bc0 con 0x7f8b900730f0 2023-11-26T07:11:40.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.633+0000 7f5eda7fc700 1 -- 172.21.15.2:0/3810838367 <== osd.5 v2:172.21.15.192:6816/1249076734 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f5ec8075b40 con 0x7f5ec8073070 2023-11-26T07:11:40.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.633+0000 7f4899ffb700 1 --2- 172.21.15.2:0/1078449571 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f488806aed0 0x7f488806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.633+0000 7f4899ffb700 1 -- 172.21.15.2:0/1078449571 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f48a00892d0 con 0x7f4890004850 2023-11-26T07:11:40.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.634+0000 7f48a8f7c700 1 --2- 172.21.15.2:0/1078449571 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f488806aed0 0x7f488806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.634+0000 7f4899ffb700 1 --2- 172.21.15.2:0/1078449571 >> [v2:172.21.15.2:6800/3414405195,v1:172.21.15.2:6801/3414405195] conn(0x7f4888073070 0x7f4888075490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.634+0000 7f4899ffb700 1 -- 172.21.15.2:0/1078449571 --> [v2:172.21.15.2:6800/3414405195,v1:172.21.15.2:6801/3414405195] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4888075b40 con 0x7f4888073070 2023-11-26T07:11:40.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.634+0000 7f4899ffb700 1 -- 172.21.15.2:0/1078449571 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f48a008b990 con 0x7f4890004850 2023-11-26T07:11:40.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.634+0000 7f48a8f7c700 1 --2- 172.21.15.2:0/1078449571 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f488806aed0 0x7f488806d390 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4894007fd0 tx=0x7f489401d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.644+0000 7f48a9f7e700 1 --2- 172.21.15.2:0/1078449571 >> [v2:172.21.15.2:6800/3414405195,v1:172.21.15.2:6801/3414405195] conn(0x7f4888073070 0x7f4888075490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.635+0000 7fd3b8ff9700 1 -- 172.21.15.2:0/239991108 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b400d850 con 0x7fd3bc0b4190 2023-11-26T07:11:40.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.635+0000 7fd3b8ff9700 1 -- 172.21.15.2:0/239991108 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b400d9d0 con 0x7fd3bc0b4190 2023-11-26T07:11:40.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.635+0000 7fd3b8ff9700 1 -- 172.21.15.2:0/239991108 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b400dd80 con 0x7fd3bc0b4190 2023-11-26T07:11:40.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.636+0000 7fd3c246a700 1 -- 172.21.15.2:0/239991108 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3bc1434c0 con 0x7fd3bc0b4190 2023-11-26T07:11:40.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.636+0000 7fd3c246a700 1 -- 172.21.15.2:0/239991108 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3bc143bd0 con 0x7fd3bc0b4190 2023-11-26T07:11:40.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.639+0000 7fd3b8ff9700 1 -- 172.21.15.2:0/239991108 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd3b40203f0 con 0x7fd3bc0b4190 2023-11-26T07:11:40.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.639+0000 7fd3c246a700 1 -- 172.21.15.2:0/239991108 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd3bc068180 con 0x7fd3bc0b4190 2023-11-26T07:11:40.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.639+0000 7fd3b8ff9700 1 --2- 172.21.15.2:0/239991108 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd3a806af20 0x7fd3a806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.639+0000 7fd3b8ff9700 1 -- 172.21.15.2:0/239991108 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd3b4089720 con 0x7fd3bc0b4190 2023-11-26T07:11:40.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.639+0000 7fd3bbfff700 1 --2- 172.21.15.2:0/239991108 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd3a806af20 0x7fd3a806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.639+0000 7fd3b8ff9700 1 --2- 172.21.15.2:0/239991108 >> [v2:172.21.15.2:6808/1275933713,v1:172.21.15.2:6809/1275933713] conn(0x7fd3a8073140 0x7fd3a8075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.639+0000 7fd3b8ff9700 1 -- 172.21.15.2:0/239991108 --> [v2:172.21.15.2:6808/1275933713,v1:172.21.15.2:6809/1275933713] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd3a8075c10 con 0x7fd3a8073140 2023-11-26T07:11:40.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.640+0000 7fd3b8ff9700 1 -- 172.21.15.2:0/239991108 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd3b408bd00 con 0x7fd3bc0b4190 2023-11-26T07:11:40.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.640+0000 7fd3bb7fe700 1 --2- 172.21.15.2:0/239991108 >> [v2:172.21.15.2:6808/1275933713,v1:172.21.15.2:6809/1275933713] conn(0x7fd3a8073140 0x7fd3a8075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.640+0000 7fd3bbfff700 1 --2- 172.21.15.2:0/239991108 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd3a806af20 0x7fd3a806d3e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0007fd0 tx=0x7fd3b0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.640+0000 7fd3bb7fe700 1 --2- 172.21.15.2:0/239991108 >> [v2:172.21.15.2:6808/1275933713,v1:172.21.15.2:6809/1275933713] conn(0x7fd3a8073140 0x7fd3a8075560 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.642+0000 7fd3b8ff9700 1 -- 172.21.15.2:0/239991108 <== osd.2 v2:172.21.15.2:6808/1275933713 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fd3a8075c10 con 0x7fd3a8073140 2023-11-26T07:11:40.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.636+0000 7fec83fff700 1 -- 172.21.15.2:0/1188963177 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec90013610 con 0x7fec9c0b4eb0 2023-11-26T07:11:40.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.636+0000 7fec83fff700 1 -- 172.21.15.2:0/1188963177 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec90013770 con 0x7fec9c0b4eb0 2023-11-26T07:11:40.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.636+0000 7fec83fff700 1 -- 172.21.15.2:0/1188963177 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec90013b00 con 0x7fec9c0b4eb0 2023-11-26T07:11:40.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.637+0000 7feca1af1700 1 -- 172.21.15.2:0/1188963177 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec9c13ae80 con 0x7fec9c0b4eb0 2023-11-26T07:11:40.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.637+0000 7feca1af1700 1 -- 172.21.15.2:0/1188963177 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec9c141750 con 0x7fec9c0b4eb0 2023-11-26T07:11:40.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.638+0000 7feca1af1700 1 -- 172.21.15.2:0/1188963177 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fec9c13aa30 con 0x7fec9c0b4eb0 2023-11-26T07:11:40.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.639+0000 7fec83fff700 1 -- 172.21.15.2:0/1188963177 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fec90013c60 con 0x7fec9c0b4eb0 2023-11-26T07:11:40.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.640+0000 7fec83fff700 1 --2- 172.21.15.2:0/1188963177 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fec8806afa0 0x7fec8806d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.640+0000 7fec83fff700 1 -- 172.21.15.2:0/1188963177 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec90088f20 con 0x7fec9c0b4eb0 2023-11-26T07:11:40.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.640+0000 7fec83fff700 1 --2- 172.21.15.2:0/1188963177 >> [v2:172.21.15.2:6824/3168701171,v1:172.21.15.2:6825/3168701171] conn(0x7fec880731c0 0x7fec880755e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.640+0000 7fec83fff700 1 -- 172.21.15.2:0/1188963177 --> [v2:172.21.15.2:6824/3168701171,v1:172.21.15.2:6825/3168701171] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fec88075c90 con 0x7fec880731c0 2023-11-26T07:11:40.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.640+0000 7fec83fff700 1 -- 172.21.15.2:0/1188963177 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fec90036ea0 con 0x7fec9c0b4eb0 2023-11-26T07:11:40.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.640+0000 7fec9bfff700 1 --2- 172.21.15.2:0/1188963177 >> [v2:172.21.15.2:6824/3168701171,v1:172.21.15.2:6825/3168701171] conn(0x7fec880731c0 0x7fec880755e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.640+0000 7fec9affd700 1 --2- 172.21.15.2:0/1188963177 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fec8806afa0 0x7fec8806d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.641+0000 7fec9affd700 1 --2- 172.21.15.2:0/1188963177 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fec8806afa0 0x7fec8806d460 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fec8c000c00 tx=0x7fec8c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.641+0000 7fec9bfff700 1 --2- 172.21.15.2:0/1188963177 >> [v2:172.21.15.2:6824/3168701171,v1:172.21.15.2:6825/3168701171] conn(0x7fec880731c0 0x7fec880755e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.642+0000 7fec83fff700 1 -- 172.21.15.2:0/1188963177 <== osd.3 v2:172.21.15.2:6824/3168701171 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fec88075c90 con 0x7fec880731c0 2023-11-26T07:11:40.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.634+0000 7f247fac7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f247806e450 0x7f247815a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.634+0000 7f247fac7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24780724f0 0x7f247815dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.634+0000 7f247fac7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2478163a90 0x7f24780caab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.634+0000 7f247fac7700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247815aa00 con 0x7f24780724f0 2023-11-26T07:11:40.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.634+0000 7f247fac7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247815c460 con 0x7f247806e450 2023-11-26T07:11:40.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.634+0000 7f247fac7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f247815c740 con 0x7f2478163a90 2023-11-26T07:11:40.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.634+0000 7f247d863700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f247806e450 0x7f247815a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.634+0000 7f247d863700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f247806e450 0x7f247815a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.2:47644/0 (socket says 172.21.15.2:47644) 2023-11-26T07:11:40.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.634+0000 7f247d863700 1 -- 172.21.15.2:0/2162469577 learned_addr learned my addr 172.21.15.2:0/2162469577 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:40.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.634+0000 7f247e064700 1 --2- 172.21.15.2:0/2162469577 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2478163a90 0x7f24780caab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.634+0000 7f247e064700 1 -- 172.21.15.2:0/2162469577 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f247806e450 msgr2=0x7f247815a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.634+0000 7f247e064700 1 --2- 172.21.15.2:0/2162469577 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f247806e450 0x7f247815a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.634+0000 7f247e064700 1 -- 172.21.15.2:0/2162469577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24780724f0 msgr2=0x7f247815dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.634+0000 7f247e064700 1 --2- 172.21.15.2:0/2162469577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24780724f0 0x7f247815dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.635+0000 7f247e064700 1 -- 172.21.15.2:0/2162469577 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f247000bc80 con 0x7f2478163a90 2023-11-26T07:11:40.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.635+0000 7f247d863700 1 --2- 172.21.15.2:0/2162469577 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f247806e450 0x7f247815a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:11:40.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.635+0000 7f247e064700 1 --2- 172.21.15.2:0/2162469577 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2478163a90 0x7f24780caab0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2470015000 tx=0x7f2470004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.635+0000 7f246e7fc700 1 -- 172.21.15.2:0/2162469577 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2470004440 con 0x7f2478163a90 2023-11-26T07:11:40.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.635+0000 7f246e7fc700 1 -- 172.21.15.2:0/2162469577 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24700045c0 con 0x7f2478163a90 2023-11-26T07:11:40.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.635+0000 7f247fac7700 1 -- 172.21.15.2:0/2162469577 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f247815ca20 con 0x7f2478163a90 2023-11-26T07:11:40.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.635+0000 7f246e7fc700 1 -- 172.21.15.2:0/2162469577 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2470004970 con 0x7f2478163a90 2023-11-26T07:11:40.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.635+0000 7f247fac7700 1 -- 172.21.15.2:0/2162469577 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24780caff0 con 0x7f2478163a90 2023-11-26T07:11:40.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.638+0000 7f246e7fc700 1 -- 172.21.15.2:0/2162469577 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2470014430 con 0x7f2478163a90 2023-11-26T07:11:40.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.638+0000 7f246e7fc700 1 --2- 172.21.15.2:0/2162469577 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f246406b130 0x7f246406d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.638+0000 7f246e7fc700 1 -- 172.21.15.2:0/2162469577 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f247008aff0 con 0x7f2478163a90 2023-11-26T07:11:40.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.638+0000 7f247d863700 1 --2- 172.21.15.2:0/2162469577 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f246406b130 0x7f246406d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.639+0000 7f247d863700 1 --2- 172.21.15.2:0/2162469577 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f246406b130 0x7f246406d5f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2474007ce0 tx=0x7f2474007c30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.643+0000 7f247fac7700 1 --2- 172.21.15.2:0/2162469577 >> [v2:172.21.15.192:6800/1194580107,v1:172.21.15.192:6801/1194580107] conn(0x7f24600015d0 0x7f2460003a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.643+0000 7f247fac7700 1 -- 172.21.15.2:0/2162469577 --> [v2:172.21.15.192:6800/1194580107,v1:172.21.15.192:6801/1194580107] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2460006bc0 con 0x7f24600015d0 2023-11-26T07:11:40.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.633+0000 7fb1b34bd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1ac0c8330 0x7fb1ac154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.633+0000 7fb1b34bd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1ac15e130 0x7fb1ac1f46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.633+0000 7fb1b34bd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1ac0b6ad0 0x7fb1ac0b6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.633+0000 7fb1b34bd700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac155450 con 0x7fb1ac0b6ad0 2023-11-26T07:11:40.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.633+0000 7fb1b34bd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac0b74c0 con 0x7fb1ac0c8330 2023-11-26T07:11:40.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.633+0000 7fb1b34bd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac1f4c30 con 0x7fb1ac15e130 2023-11-26T07:11:40.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.634+0000 7fb1b1259700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1ac0c8330 0x7fb1ac154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.634+0000 7fb1b1259700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1ac0c8330 0x7fb1ac154f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.2:47638/0 (socket says 172.21.15.2:47638) 2023-11-26T07:11:40.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.634+0000 7fb1b1259700 1 -- 172.21.15.2:0/2647335150 learned_addr learned my addr 172.21.15.2:0/2647335150 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:40.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.634+0000 7fb1b1259700 1 -- 172.21.15.2:0/2647335150 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1ac15e130 msgr2=0x7fb1ac1f46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.634+0000 7fb1b1259700 1 --2- 172.21.15.2:0/2647335150 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1ac15e130 0x7fb1ac1f46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.634+0000 7fb1b1259700 1 -- 172.21.15.2:0/2647335150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1ac0b6ad0 msgr2=0x7fb1ac0b6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.634+0000 7fb1b1259700 1 --2- 172.21.15.2:0/2647335150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1ac0b6ad0 0x7fb1ac0b6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.634+0000 7fb1b1259700 1 -- 172.21.15.2:0/2647335150 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a4009a70 con 0x7fb1ac0c8330 2023-11-26T07:11:40.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.634+0000 7fb1b1259700 1 --2- 172.21.15.2:0/2647335150 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1ac0c8330 0x7fb1ac154f10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb19c00c7b0 tx=0x7fb19c00cb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.634+0000 7fb1a1ffb700 1 -- 172.21.15.2:0/2647335150 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c004c80 con 0x7fb1ac0c8330 2023-11-26T07:11:40.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.635+0000 7fb1a1ffb700 1 -- 172.21.15.2:0/2647335150 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb19c004de0 con 0x7fb1ac0c8330 2023-11-26T07:11:40.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.635+0000 7fb1b34bd700 1 -- 172.21.15.2:0/2647335150 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1ac0b9330 con 0x7fb1ac0c8330 2023-11-26T07:11:40.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.635+0000 7fb1a1ffb700 1 -- 172.21.15.2:0/2647335150 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c0072d0 con 0x7fb1ac0c8330 2023-11-26T07:11:40.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.635+0000 7fb1b34bd700 1 -- 172.21.15.2:0/2647335150 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1ac0b8720 con 0x7fb1ac0c8330 2023-11-26T07:11:40.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.636+0000 7fb1b34bd700 1 -- 172.21.15.2:0/2647335150 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb1ac0d2990 con 0x7fb1ac0c8330 2023-11-26T07:11:40.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.637+0000 7fb1a1ffb700 1 -- 172.21.15.2:0/2647335150 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb19c007430 con 0x7fb1ac0c8330 2023-11-26T07:11:40.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.637+0000 7fb1a1ffb700 1 --2- 172.21.15.2:0/2647335150 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb19006aed0 0x7fb19006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.637+0000 7fb1a1ffb700 1 -- 172.21.15.2:0/2647335150 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb19c089400 con 0x7fb1ac0c8330 2023-11-26T07:11:40.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.637+0000 7fb1b0a58700 1 --2- 172.21.15.2:0/2647335150 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb19006aed0 0x7fb19006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.638+0000 7fb1a1ffb700 1 --2- 172.21.15.2:0/2647335150 >> [v2:172.21.15.192:6824/610652339,v1:172.21.15.192:6825/610652339] conn(0x7fb1900730f0 0x7fb190075510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.638+0000 7fb1a1ffb700 1 -- 172.21.15.2:0/2647335150 --> [v2:172.21.15.192:6824/610652339,v1:172.21.15.192:6825/610652339] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb190075bc0 con 0x7fb1900730f0 2023-11-26T07:11:40.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.638+0000 7fb1a1ffb700 1 -- 172.21.15.2:0/2647335150 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb19c08ba20 con 0x7fb1ac0c8330 2023-11-26T07:11:40.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.638+0000 7fb1b1a5a700 1 --2- 172.21.15.2:0/2647335150 >> [v2:172.21.15.192:6824/610652339,v1:172.21.15.192:6825/610652339] conn(0x7fb1900730f0 0x7fb190075510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.638+0000 7fb1b0a58700 1 --2- 172.21.15.2:0/2647335150 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb19006aed0 0x7fb19006d390 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac069530 tx=0x7fb1a4010000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.638+0000 7fb1b1a5a700 1 --2- 172.21.15.2:0/2647335150 >> [v2:172.21.15.192:6824/610652339,v1:172.21.15.192:6825/610652339] conn(0x7fb1900730f0 0x7fb190075510 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.639+0000 7fb1a1ffb700 1 -- 172.21.15.2:0/2647335150 <== osd.6 v2:172.21.15.192:6824/610652339 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fb190075bc0 con 0x7fb1900730f0 2023-11-26T07:11:40.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.639+0000 7f2e21c0f700 1 Processor -- start 2023-11-26T07:11:40.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.639+0000 7f2e21c0f700 1 -- start start 2023-11-26T07:11:40.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.640+0000 7f2e21c0f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2e1c070a80 0x7f2e1c070e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.640+0000 7f2e21c0f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2e1c0ceb50 0x7f2e1c0cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.640+0000 7f2e21c0f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e1c0cab10 con 0x7f2e1c06cae0 2023-11-26T07:11:40.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.640+0000 7f2e21c0f700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e1c0c9fd0 con 0x7f2e1c070a80 2023-11-26T07:11:40.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.640+0000 7f2e21c0f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c0713a0 con 0x7f2e1c0ceb50 2023-11-26T07:11:40.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.640+0000 7f2e1b7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2e1c070a80 0x7f2e1c070e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.640+0000 7f2e1b7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2e1c070a80 0x7f2e1c070e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39074/0 (socket says 172.21.15.2:39074) 2023-11-26T07:11:40.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.640+0000 7f2e1b7fe700 1 -- 172.21.15.2:0/779931173 learned_addr learned my addr 172.21.15.2:0/779931173 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:40.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.641+0000 7f2e1bfff700 1 --2- 172.21.15.2:0/779931173 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2e1c0ceb50 0x7f2e1c0cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.641+0000 7f2e1b7fe700 1 -- 172.21.15.2:0/779931173 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2e1c0ceb50 msgr2=0x7f2e1c0cafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:40.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.641+0000 7f2e1b7fe700 1 --2- 172.21.15.2:0/779931173 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2e1c0ceb50 0x7f2e1c0cafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.641+0000 7f2e1b7fe700 1 -- 172.21.15.2:0/779931173 >> v1:172.21.15.192:6789/0 conn(0x7f2e1c06cae0 legacy=0x7f2e1c0ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.641+0000 7f2e1b7fe700 1 -- 172.21.15.2:0/779931173 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e1c0cd7e0 con 0x7f2e1c070a80 2023-11-26T07:11:40.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.641+0000 7f2e1b7fe700 1 --2- 172.21.15.2:0/779931173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e1c070a80 0x7f2e1c070e60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0098f0 tx=0x7f2e0c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da61e4c6b8616705 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.642+0000 7f2e1a7fc700 1 -- 172.21.15.2:0/779931173 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c00b8a0 con 0x7f2e1c070a80 2023-11-26T07:11:40.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.642+0000 7f2e1a7fc700 1 -- 172.21.15.2:0/779931173 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0c00ba00 con 0x7f2e1c070a80 2023-11-26T07:11:40.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.642+0000 7f2e1a7fc700 1 -- 172.21.15.2:0/779931173 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c00bd90 con 0x7f2e1c070a80 2023-11-26T07:11:40.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.643+0000 7f2e21c0f700 1 -- 172.21.15.2:0/779931173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e1c070a80 msgr2=0x7f2e1c070e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.643+0000 7f2e21c0f700 1 --2- 172.21.15.2:0/779931173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e1c070a80 0x7f2e1c070e60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0098f0 tx=0x7f2e0c009c00 comp rx=0 tx=0).stop 2023-11-26T07:11:40.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.644+0000 7f247d062700 1 --2- 172.21.15.2:0/2162469577 >> [v2:172.21.15.192:6800/1194580107,v1:172.21.15.192:6801/1194580107] conn(0x7f24600015d0 0x7f2460003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.644+0000 7f48a9f7e700 1 --2- 172.21.15.2:0/1078449571 >> [v2:172.21.15.2:6800/3414405195,v1:172.21.15.2:6801/3414405195] conn(0x7f4888073070 0x7f4888075490 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.644+0000 7f247d062700 1 --2- 172.21.15.2:0/2162469577 >> [v2:172.21.15.192:6800/1194580107,v1:172.21.15.192:6801/1194580107] conn(0x7f24600015d0 0x7f2460003a90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.645+0000 7f246e7fc700 1 -- 172.21.15.2:0/2162469577 <== osd.4 v2:172.21.15.192:6800/1194580107 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f2460006bc0 con 0x7f24600015d0 2023-11-26T07:11:40.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.645+0000 7f4899ffb700 1 -- 172.21.15.2:0/1078449571 <== osd.1 v2:172.21.15.2:6800/3414405195 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f4888075b40 con 0x7f4888073070 2023-11-26T07:11:40.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.652+0000 7f2e21c0f700 1 -- 172.21.15.2:0/779931173 shutdown_connections 2023-11-26T07:11:40.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.652+0000 7f2e21c0f700 1 --2- 172.21.15.2:0/779931173 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2e1c0ceb50 0x7f2e1c0cafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.652+0000 7f2e21c0f700 1 --2- 172.21.15.2:0/779931173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e1c070a80 0x7f2e1c070e60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.652+0000 7f2e21c0f700 1 -- 172.21.15.2:0/779931173 >> 172.21.15.2:0/779931173 conn(0x7f2e1c0cf980 msgr2=0x7f2e1c0cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:40.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.653+0000 7f2e21c0f700 1 -- 172.21.15.2:0/779931173 shutdown_connections 2023-11-26T07:11:40.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.655+0000 7f2e21c0f700 1 -- 172.21.15.2:0/779931173 wait complete. 2023-11-26T07:11:40.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.656+0000 7f2e21c0f700 1 Processor -- start 2023-11-26T07:11:40.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.657+0000 7f2e21c0f700 1 -- start start 2023-11-26T07:11:40.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.658+0000 7f2e21c0f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e1c06cae0 0x7f2e1c06ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.658+0000 7f2e21c0f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e1c070a80 0x7f2e1c0b3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.658+0000 7f2e21c0f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2e1c0b3cd0 0x7f2e1c2041c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.658+0000 7f2e21c0f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c155780 con 0x7f2e1c070a80 2023-11-26T07:11:40.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.658+0000 7f2e21c0f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c0b4140 con 0x7f2e1c06cae0 2023-11-26T07:11:40.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.658+0000 7f2e21c0f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c0b43e0 con 0x7f2e1c0b3cd0 2023-11-26T07:11:40.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.658+0000 7f2e1affd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e1c070a80 0x7f2e1c0b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.658+0000 7f2e1affd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e1c070a80 0x7f2e1c0b3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39090/0 (socket says 172.21.15.2:39090) 2023-11-26T07:11:40.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.658+0000 7f2e1affd700 1 -- 172.21.15.2:0/3765407624 learned_addr learned my addr 172.21.15.2:0/3765407624 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:40.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.658+0000 7f5eebd34700 1 -- 172.21.15.2:0/3810838367 --> [v2:172.21.15.192:6816/1249076734,v1:172.21.15.192:6817/1249076734] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5ee41583f0 con 0x7f5ec8073070 2023-11-26T07:11:40.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.659+0000 7f2e1bfff700 1 --2- 172.21.15.2:0/3765407624 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2e1c0b3cd0 0x7f2e1c2041c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.659+0000 7f2e1affd700 1 -- 172.21.15.2:0/3765407624 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2e1c0b3cd0 msgr2=0x7f2e1c2041c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.659+0000 7f2e1affd700 1 --2- 172.21.15.2:0/3765407624 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2e1c0b3cd0 0x7f2e1c2041c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.659+0000 7f2e1affd700 1 -- 172.21.15.2:0/3765407624 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e1c06cae0 msgr2=0x7f2e1c06ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.659+0000 7f2e1affd700 1 --2- 172.21.15.2:0/3765407624 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e1c06cae0 0x7f2e1c06ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.659+0000 7f2e1affd700 1 -- 172.21.15.2:0/3765407624 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e0c009550 con 0x7f2e1c070a80 2023-11-26T07:11:40.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.659+0000 7f2e1affd700 1 --2- 172.21.15.2:0/3765407624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e1c070a80 0x7f2e1c0b3790 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2e1000c4b0 tx=0x7f2e1000c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.664+0000 7f5eda7fc700 1 -- 172.21.15.2:0/3810838367 <== osd.5 v2:172.21.15.192:6816/1249076734 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5ee000a040 con 0x7f5ec8073070 2023-11-26T07:11:40.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.664+0000 7f5eebd34700 1 -- 172.21.15.2:0/3810838367 >> [v2:172.21.15.192:6816/1249076734,v1:172.21.15.192:6817/1249076734] conn(0x7f5ec8073070 msgr2=0x7f5ec8075490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.664+0000 7f5eebd34700 1 --2- 172.21.15.2:0/3810838367 >> [v2:172.21.15.192:6816/1249076734,v1:172.21.15.192:6817/1249076734] conn(0x7f5ec8073070 0x7f5ec8075490 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.664+0000 7f5eebd34700 1 -- 172.21.15.2:0/3810838367 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5ec806aed0 msgr2=0x7f5ec806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.664+0000 7f5eebd34700 1 --2- 172.21.15.2:0/3810838367 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5ec806aed0 0x7f5ec806d390 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4006fd0 tx=0x7f5ed4008040 comp rx=0 tx=0).stop 2023-11-26T07:11:40.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.664+0000 7f5eebd34700 1 -- 172.21.15.2:0/3810838367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ee4158010 msgr2=0x7f5ee4158e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.664+0000 7f5eebd34700 1 --2- 172.21.15.2:0/3810838367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ee4158010 0x7f5ee4158e20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5edc00bb00 tx=0x7f5edc00bec0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.664+0000 7f5eea2d1700 1 -- 172.21.15.2:0/3810838367 reap_dead start 2023-11-26T07:11:40.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.664+0000 7f5eebd34700 1 -- 172.21.15.2:0/3810838367 shutdown_connections 2023-11-26T07:11:40.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.664+0000 7f5eebd34700 1 -- 172.21.15.2:0/3810838367 >> 172.21.15.2:0/3810838367 conn(0x7f5ee4071390 msgr2=0x7f5ee415e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:40.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.665+0000 7f5eebd34700 1 -- 172.21.15.2:0/3810838367 shutdown_connections 2023-11-26T07:11:40.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.665+0000 7f5eebd34700 1 -- 172.21.15.2:0/3810838367 wait complete. 2023-11-26T07:11:40.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.666+0000 7fb1b34bd700 1 -- 172.21.15.2:0/2647335150 --> [v2:172.21.15.192:6824/610652339,v1:172.21.15.192:6825/610652339] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb1ac0d4c70 con 0x7fb1900730f0 2023-11-26T07:11:40.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.666+0000 7fb1a1ffb700 1 -- 172.21.15.2:0/2647335150 <== osd.6 v2:172.21.15.192:6824/610652339 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb1a8001190 con 0x7fb1900730f0 2023-11-26T07:11:40.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.669+0000 7f8ba9551700 1 -- 172.21.15.2:0/3284726987 --> [v2:172.21.15.2:6816/2852728003,v1:172.21.15.2:6817/2852728003] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8ba4166400 con 0x7f8b900730f0 2023-11-26T07:11:40.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.671+0000 7fb1b34bd700 1 -- 172.21.15.2:0/2647335150 >> [v2:172.21.15.192:6824/610652339,v1:172.21.15.192:6825/610652339] conn(0x7fb1900730f0 msgr2=0x7fb190075510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.671+0000 7fb1b34bd700 1 --2- 172.21.15.2:0/2647335150 >> [v2:172.21.15.192:6824/610652339,v1:172.21.15.192:6825/610652339] conn(0x7fb1900730f0 0x7fb190075510 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.671+0000 7fb1b34bd700 1 -- 172.21.15.2:0/2647335150 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb19006aed0 msgr2=0x7fb19006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.671+0000 7fb1b34bd700 1 --2- 172.21.15.2:0/2647335150 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb19006aed0 0x7fb19006d390 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac069530 tx=0x7fb1a4010000 comp rx=0 tx=0).stop 2023-11-26T07:11:40.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.671+0000 7fb1b34bd700 1 -- 172.21.15.2:0/2647335150 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1ac0c8330 msgr2=0x7fb1ac154f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.671+0000 7fb1b34bd700 1 --2- 172.21.15.2:0/2647335150 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1ac0c8330 0x7fb1ac154f10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb19c00c7b0 tx=0x7fb19c00cb70 comp rx=0 tx=0).stop 2023-11-26T07:11:40.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.671+0000 7fb1b1a5a700 1 -- 172.21.15.2:0/2647335150 reap_dead start 2023-11-26T07:11:40.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.672+0000 7fb1b34bd700 1 -- 172.21.15.2:0/2647335150 shutdown_connections 2023-11-26T07:11:40.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.672+0000 7fb1b34bd700 1 -- 172.21.15.2:0/2647335150 >> 172.21.15.2:0/2647335150 conn(0x7fb1ac0d3eb0 msgr2=0x7fb1ac0b50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:40.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.672+0000 7fb1b34bd700 1 -- 172.21.15.2:0/2647335150 shutdown_connections 2023-11-26T07:11:40.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.672+0000 7fb1b34bd700 1 -- 172.21.15.2:0/2647335150 wait complete. 2023-11-26T07:11:40.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.674+0000 7f8b8b7fe700 1 -- 172.21.15.2:0/3284726987 <== osd.0 v2:172.21.15.2:6816/2852728003 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8b9c001d30 con 0x7f8b900730f0 2023-11-26T07:11:40.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.675+0000 7f48ab9e1700 1 -- 172.21.15.2:0/1078449571 --> [v2:172.21.15.2:6800/3414405195,v1:172.21.15.2:6801/3414405195] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4884002d30 con 0x7f4888073070 2023-11-26T07:11:40.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.675+0000 7f4899ffb700 1 -- 172.21.15.2:0/1078449571 <== osd.1 v2:172.21.15.2:6800/3414405195 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4884002d30 con 0x7f4888073070 2023-11-26T07:11:40.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.675+0000 7f48ab9e1700 1 -- 172.21.15.2:0/1078449571 >> [v2:172.21.15.2:6800/3414405195,v1:172.21.15.2:6801/3414405195] conn(0x7f4888073070 msgr2=0x7f4888075490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.675+0000 7f48ab9e1700 1 --2- 172.21.15.2:0/1078449571 >> [v2:172.21.15.2:6800/3414405195,v1:172.21.15.2:6801/3414405195] conn(0x7f4888073070 0x7f4888075490 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.676+0000 7f8ba9551700 1 -- 172.21.15.2:0/3284726987 >> [v2:172.21.15.2:6816/2852728003,v1:172.21.15.2:6817/2852728003] conn(0x7f8b900730f0 msgr2=0x7f8b90075510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.676+0000 7f8ba9551700 1 --2- 172.21.15.2:0/3284726987 >> [v2:172.21.15.2:6816/2852728003,v1:172.21.15.2:6817/2852728003] conn(0x7f8b900730f0 0x7f8b90075510 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.676+0000 7f8ba9551700 1 -- 172.21.15.2:0/3284726987 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8b9006aed0 msgr2=0x7f8b9006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.676+0000 7f8ba9551700 1 --2- 172.21.15.2:0/3284726987 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8b9006aed0 0x7f8b9006d390 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8b98009130 tx=0x7f8b98008030 comp rx=0 tx=0).stop 2023-11-26T07:11:40.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.676+0000 7f8ba9551700 1 -- 172.21.15.2:0/3284726987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ba4165f70 msgr2=0x7f8ba40b0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.676+0000 7f8ba9551700 1 --2- 172.21.15.2:0/3284726987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ba4165f70 0x7f8ba40b0440 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8b9400e900 tx=0x7f8b9400ec10 comp rx=0 tx=0).stop 2023-11-26T07:11:40.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.676+0000 7f8ba37fe700 1 -- 172.21.15.2:0/3284726987 reap_dead start 2023-11-26T07:11:40.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.676+0000 7f48ab9e1700 1 -- 172.21.15.2:0/1078449571 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f488806aed0 msgr2=0x7f488806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.676+0000 7f48ab9e1700 1 --2- 172.21.15.2:0/1078449571 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f488806aed0 0x7f488806d390 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4894007fd0 tx=0x7f489401d040 comp rx=0 tx=0).stop 2023-11-26T07:11:40.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.676+0000 7f48ab9e1700 1 -- 172.21.15.2:0/1078449571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4890004850 msgr2=0x7f48a40cf830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.676+0000 7f48ab9e1700 1 --2- 172.21.15.2:0/1078449571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4890004850 0x7f48a40cf830 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f48a000e820 tx=0x7f48a000eb30 comp rx=0 tx=0).stop 2023-11-26T07:11:40.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.676+0000 7feca1af1700 1 -- 172.21.15.2:0/1188963177 --> [v2:172.21.15.2:6824/3168701171,v1:172.21.15.2:6825/3168701171] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fec9c0b5310 con 0x7fec880731c0 2023-11-26T07:11:40.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.676+0000 7f48a9f7e700 1 -- 172.21.15.2:0/1078449571 reap_dead start 2023-11-26T07:11:40.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.677+0000 7f48ab9e1700 1 -- 172.21.15.2:0/1078449571 shutdown_connections 2023-11-26T07:11:40.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.677+0000 7f48ab9e1700 1 -- 172.21.15.2:0/1078449571 >> 172.21.15.2:0/1078449571 conn(0x7f48a40b5070 msgr2=0x7f48a406d650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:40.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.677+0000 7f48ab9e1700 1 -- 172.21.15.2:0/1078449571 shutdown_connections 2023-11-26T07:11:40.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.677+0000 7f48ab9e1700 1 -- 172.21.15.2:0/1078449571 wait complete. 2023-11-26T07:11:40.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.666+0000 7f2e0bfff700 1 -- 172.21.15.2:0/3765407624 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e100052d0 con 0x7f2e1c070a80 2023-11-26T07:11:40.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.666+0000 7f2e0bfff700 1 -- 172.21.15.2:0/3765407624 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e10005430 con 0x7f2e1c070a80 2023-11-26T07:11:40.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.666+0000 7f2e21c0f700 1 -- 172.21.15.2:0/3765407624 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e1c0b46c0 con 0x7f2e1c070a80 2023-11-26T07:11:40.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.666+0000 7f2e21c0f700 1 -- 172.21.15.2:0/3765407624 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e1c155cb0 con 0x7f2e1c070a80 2023-11-26T07:11:40.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.667+0000 7f2e0bfff700 1 -- 172.21.15.2:0/3765407624 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e10011a30 con 0x7f2e1c070a80 2023-11-26T07:11:40.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.669+0000 7f2e0bfff700 1 -- 172.21.15.2:0/3765407624 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2e10011b90 con 0x7f2e1c070a80 2023-11-26T07:11:40.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.669+0000 7f2e0bfff700 1 --2- 172.21.15.2:0/3765407624 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f2e000737b0 0x7f2e00075c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.670+0000 7f2e0bfff700 1 -- 172.21.15.2:0/3765407624 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e10088890 con 0x7f2e1c070a80 2023-11-26T07:11:40.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.670+0000 7f2e1b7fe700 1 --2- 172.21.15.2:0/3765407624 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f2e000737b0 0x7f2e00075c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.670+0000 7f2e1b7fe700 1 --2- 172.21.15.2:0/3765407624 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f2e000737b0 0x7f2e00075c70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c009c40 tx=0x7f2e0c011000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.671+0000 7f2e21c0f700 1 --2- 172.21.15.2:0/3765407624 >> [v2:172.21.15.192:6808/2129584711,v1:172.21.15.192:6809/2129584711] conn(0x7f2df80015d0 0x7f2df8003a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.671+0000 7f2e21c0f700 1 -- 172.21.15.2:0/3765407624 --> [v2:172.21.15.192:6808/2129584711,v1:172.21.15.192:6809/2129584711] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2df8006bc0 con 0x7f2df80015d0 2023-11-26T07:11:40.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.671+0000 7f2e1bfff700 1 --2- 172.21.15.2:0/3765407624 >> [v2:172.21.15.192:6808/2129584711,v1:172.21.15.192:6809/2129584711] conn(0x7f2df80015d0 0x7f2df8003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.672+0000 7f2e1bfff700 1 --2- 172.21.15.2:0/3765407624 >> [v2:172.21.15.192:6808/2129584711,v1:172.21.15.192:6809/2129584711] conn(0x7f2df80015d0 0x7f2df8003a90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.672+0000 7f2e0bfff700 1 -- 172.21.15.2:0/3765407624 <== osd.7 v2:172.21.15.192:6808/2129584711 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f2df8006bc0 con 0x7f2df80015d0 2023-11-26T07:11:40.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.678+0000 7fec83fff700 1 -- 172.21.15.2:0/1188963177 <== osd.3 v2:172.21.15.2:6824/3168701171 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fec94001f20 con 0x7fec880731c0 2023-11-26T07:11:40.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.678+0000 7feca1af1700 1 -- 172.21.15.2:0/1188963177 >> [v2:172.21.15.2:6824/3168701171,v1:172.21.15.2:6825/3168701171] conn(0x7fec880731c0 msgr2=0x7fec880755e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.678+0000 7feca1af1700 1 --2- 172.21.15.2:0/1188963177 >> [v2:172.21.15.2:6824/3168701171,v1:172.21.15.2:6825/3168701171] conn(0x7fec880731c0 0x7fec880755e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.678+0000 7feca1af1700 1 -- 172.21.15.2:0/1188963177 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fec8806afa0 msgr2=0x7fec8806d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.678+0000 7feca1af1700 1 --2- 172.21.15.2:0/1188963177 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fec8806afa0 0x7fec8806d460 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fec8c000c00 tx=0x7fec8c008030 comp rx=0 tx=0).stop 2023-11-26T07:11:40.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.678+0000 7feca1af1700 1 -- 172.21.15.2:0/1188963177 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec9c0b4eb0 msgr2=0x7fec9c13bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.678+0000 7feca1af1700 1 --2- 172.21.15.2:0/1188963177 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec9c0b4eb0 0x7fec9c13bc80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fec9000e810 tx=0x7fec9000eb20 comp rx=0 tx=0).stop 2023-11-26T07:11:40.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.678+0000 7fec9bfff700 1 -- 172.21.15.2:0/1188963177 reap_dead start 2023-11-26T07:11:40.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.679+0000 7feca1af1700 1 -- 172.21.15.2:0/1188963177 shutdown_connections 2023-11-26T07:11:40.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.679+0000 7feca1af1700 1 -- 172.21.15.2:0/1188963177 >> 172.21.15.2:0/1188963177 conn(0x7fec9c0722b0 msgr2=0x7fec9c0b3280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:40.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.679+0000 7feca1af1700 1 -- 172.21.15.2:0/1188963177 shutdown_connections 2023-11-26T07:11:40.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.679+0000 7feca1af1700 1 -- 172.21.15.2:0/1188963177 wait complete. 2023-11-26T07:11:40.700 INFO:teuthology.orchestra.run.smithi002.stdout:55834574855 2023-11-26T07:11:40.700 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-26T07:11:40.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.682+0000 7f247fac7700 1 -- 172.21.15.2:0/2162469577 --> [v2:172.21.15.192:6800/1194580107,v1:172.21.15.192:6801/1194580107] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2460005ca0 con 0x7f24600015d0 2023-11-26T07:11:40.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.683+0000 7f8ba9551700 1 -- 172.21.15.2:0/3284726987 shutdown_connections 2023-11-26T07:11:40.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.683+0000 7f8ba9551700 1 -- 172.21.15.2:0/3284726987 >> 172.21.15.2:0/3284726987 conn(0x7f8ba40cf980 msgr2=0x7f8ba40c9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:40.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.676+0000 7fd3c246a700 1 -- 172.21.15.2:0/239991108 --> [v2:172.21.15.2:6808/1275933713,v1:172.21.15.2:6809/1275933713] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd3bc166350 con 0x7fd3a8073140 2023-11-26T07:11:40.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.677+0000 7fd3b8ff9700 1 -- 172.21.15.2:0/239991108 <== osd.2 v2:172.21.15.2:6808/1275933713 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd3ac0045e0 con 0x7fd3a8073140 2023-11-26T07:11:40.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.677+0000 7fd3c246a700 1 -- 172.21.15.2:0/239991108 >> [v2:172.21.15.2:6808/1275933713,v1:172.21.15.2:6809/1275933713] conn(0x7fd3a8073140 msgr2=0x7fd3a8075560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.677+0000 7fd3c246a700 1 --2- 172.21.15.2:0/239991108 >> [v2:172.21.15.2:6808/1275933713,v1:172.21.15.2:6809/1275933713] conn(0x7fd3a8073140 0x7fd3a8075560 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.677+0000 7fd3c246a700 1 -- 172.21.15.2:0/239991108 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd3a806af20 msgr2=0x7fd3a806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.677+0000 7fd3c246a700 1 --2- 172.21.15.2:0/239991108 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd3a806af20 0x7fd3a806d3e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0007fd0 tx=0x7fd3b0009040 comp rx=0 tx=0).stop 2023-11-26T07:11:40.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.677+0000 7fd3c246a700 1 -- 172.21.15.2:0/239991108 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3bc0b4190 msgr2=0x7fd3bc14ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.677+0000 7fd3c246a700 1 --2- 172.21.15.2:0/239991108 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3bc0b4190 0x7fd3bc14ac70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd3b400b9a0 tx=0x7fd3b400bcb0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.677+0000 7fd3c0a07700 1 -- 172.21.15.2:0/239991108 reap_dead start 2023-11-26T07:11:40.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.680+0000 7fd3c246a700 1 -- 172.21.15.2:0/239991108 shutdown_connections 2023-11-26T07:11:40.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.680+0000 7fd3c246a700 1 -- 172.21.15.2:0/239991108 >> 172.21.15.2:0/239991108 conn(0x7fd3bc0b2740 msgr2=0x7fd3bc06dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:40.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.683+0000 7f246e7fc700 1 -- 172.21.15.2:0/2162469577 <== osd.4 v2:172.21.15.192:6800/1194580107 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2460005ca0 con 0x7f24600015d0 2023-11-26T07:11:40.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.683+0000 7f8ba9551700 1 -- 172.21.15.2:0/3284726987 shutdown_connections 2023-11-26T07:11:40.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.683+0000 7f8ba9551700 1 -- 172.21.15.2:0/3284726987 wait complete. 2023-11-26T07:11:40.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.691+0000 7fd3c246a700 1 -- 172.21.15.2:0/239991108 shutdown_connections 2023-11-26T07:11:40.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.691+0000 7fd3c246a700 1 -- 172.21.15.2:0/239991108 wait complete. 2023-11-26T07:11:40.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.691+0000 7f247fac7700 1 -- 172.21.15.2:0/2162469577 >> [v2:172.21.15.192:6800/1194580107,v1:172.21.15.192:6801/1194580107] conn(0x7f24600015d0 msgr2=0x7f2460003a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.691+0000 7f247fac7700 1 --2- 172.21.15.2:0/2162469577 >> [v2:172.21.15.192:6800/1194580107,v1:172.21.15.192:6801/1194580107] conn(0x7f24600015d0 0x7f2460003a90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.691+0000 7f247fac7700 1 -- 172.21.15.2:0/2162469577 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f246406b130 msgr2=0x7f246406d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.691+0000 7f247fac7700 1 --2- 172.21.15.2:0/2162469577 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f246406b130 0x7f246406d5f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2474007ce0 tx=0x7f2474007c30 comp rx=0 tx=0).stop 2023-11-26T07:11:40.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.691+0000 7f247fac7700 1 -- 172.21.15.2:0/2162469577 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2478163a90 msgr2=0x7f24780caab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.691+0000 7f247fac7700 1 --2- 172.21.15.2:0/2162469577 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2478163a90 0x7f24780caab0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2470015000 tx=0x7f2470004ad0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.691+0000 7f247e064700 1 -- 172.21.15.2:0/2162469577 reap_dead start 2023-11-26T07:11:40.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.691+0000 7f247fac7700 1 -- 172.21.15.2:0/2162469577 shutdown_connections 2023-11-26T07:11:40.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.691+0000 7f247fac7700 1 -- 172.21.15.2:0/2162469577 >> 172.21.15.2:0/2162469577 conn(0x7f24780cf980 msgr2=0x7f24780ce2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:40.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.693+0000 7f247fac7700 1 -- 172.21.15.2:0/2162469577 shutdown_connections 2023-11-26T07:11:40.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.693+0000 7f247fac7700 1 -- 172.21.15.2:0/2162469577 wait complete. 2023-11-26T07:11:40.706 INFO:teuthology.orchestra.run.smithi002.stdout:55834574854 2023-11-26T07:11:40.707 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-26T07:11:40.707 INFO:teuthology.orchestra.run.smithi002.stdout:55834574854 2023-11-26T07:11:40.708 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-26T07:11:40.708 INFO:teuthology.orchestra.run.smithi002.stdout:55834574855 2023-11-26T07:11:40.709 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-26T07:11:40.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.704+0000 7f2e21c0f700 1 -- 172.21.15.2:0/3765407624 --> [v2:172.21.15.192:6808/2129584711,v1:172.21.15.192:6809/2129584711] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2df8005ca0 con 0x7f2df80015d0 2023-11-26T07:11:40.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.705+0000 7f2e0bfff700 1 -- 172.21.15.2:0/3765407624 <== osd.7 v2:172.21.15.192:6808/2129584711 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2df8005ca0 con 0x7f2df80015d0 2023-11-26T07:11:40.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.706+0000 7f2e21c0f700 1 -- 172.21.15.2:0/3765407624 >> [v2:172.21.15.192:6808/2129584711,v1:172.21.15.192:6809/2129584711] conn(0x7f2df80015d0 msgr2=0x7f2df8003a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.706+0000 7f2e21c0f700 1 --2- 172.21.15.2:0/3765407624 >> [v2:172.21.15.192:6808/2129584711,v1:172.21.15.192:6809/2129584711] conn(0x7f2df80015d0 0x7f2df8003a90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.706+0000 7f2e21c0f700 1 -- 172.21.15.2:0/3765407624 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f2e000737b0 msgr2=0x7f2e00075c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.706+0000 7f2e21c0f700 1 --2- 172.21.15.2:0/3765407624 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f2e000737b0 0x7f2e00075c70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c009c40 tx=0x7f2e0c011000 comp rx=0 tx=0).stop 2023-11-26T07:11:40.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.706+0000 7f2e21c0f700 1 -- 172.21.15.2:0/3765407624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e1c070a80 msgr2=0x7f2e1c0b3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.706+0000 7f2e21c0f700 1 --2- 172.21.15.2:0/3765407624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e1c070a80 0x7f2e1c0b3790 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2e1000c4b0 tx=0x7f2e1000c870 comp rx=0 tx=0).stop 2023-11-26T07:11:40.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.706+0000 7f2e1bfff700 1 -- 172.21.15.2:0/3765407624 reap_dead start 2023-11-26T07:11:40.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.706+0000 7f2e21c0f700 1 -- 172.21.15.2:0/3765407624 shutdown_connections 2023-11-26T07:11:40.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.706+0000 7f2e21c0f700 1 -- 172.21.15.2:0/3765407624 >> 172.21.15.2:0/3765407624 conn(0x7f2e1c0cf980 msgr2=0x7f2e1c0cafa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:40.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.707+0000 7f2e21c0f700 1 -- 172.21.15.2:0/3765407624 shutdown_connections 2023-11-26T07:11:40.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.707+0000 7f2e21c0f700 1 -- 172.21.15.2:0/3765407624 wait complete. 2023-11-26T07:11:40.713 INFO:teuthology.orchestra.run.smithi002.stdout:55834574853 2023-11-26T07:11:40.713 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-26T07:11:40.719 INFO:teuthology.orchestra.run.smithi002.stdout:55834574854 2023-11-26T07:11:40.719 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-26T07:11:40.725 INFO:teuthology.orchestra.run.smithi002.stdout:55834574853 2023-11-26T07:11:40.725 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-26T07:11:40.732 INFO:teuthology.orchestra.run.smithi002.stdout:55834574855 2023-11-26T07:11:40.732 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-26T07:11:40.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.891+0000 7f12a95b2700 1 Processor -- start 2023-11-26T07:11:40.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.892+0000 7f12a95b2700 1 -- start start 2023-11-26T07:11:40.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.893+0000 7f12a95b2700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f12a415db10 0x7f12a415def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.893+0000 7f12a95b2700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f12a4071390 0x7f12a415e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.893+0000 7f12a95b2700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12a40ce000 con 0x7f12a415a520 2023-11-26T07:11:40.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.893+0000 7f12a95b2700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12a40cb2d0 con 0x7f12a415db10 2023-11-26T07:11:40.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.893+0000 7f12a95b2700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12a40ce2c0 con 0x7f12a4071390 2023-11-26T07:11:40.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.895+0000 7f12a2ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f12a415db10 0x7f12a415def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.895+0000 7f12a2ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f12a415db10 0x7f12a415def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39098/0 (socket says 172.21.15.2:39098) 2023-11-26T07:11:40.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.895+0000 7f12a2ffd700 1 -- 172.21.15.2:0/4118023730 learned_addr learned my addr 172.21.15.2:0/4118023730 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:40.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.896+0000 7f12a27fc700 1 --2- 172.21.15.2:0/4118023730 >> v2:172.21.15.192:3300/0 conn(0x7f12a4071390 0x7f12a415e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.896+0000 7f12a2ffd700 1 -- 172.21.15.2:0/4118023730 >> v2:172.21.15.192:3300/0 conn(0x7f12a4071390 msgr2=0x7f12a415e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:40.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.896+0000 7f12a2ffd700 1 --2- 172.21.15.2:0/4118023730 >> v2:172.21.15.192:3300/0 conn(0x7f12a4071390 0x7f12a415e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.896+0000 7f12a2ffd700 1 -- 172.21.15.2:0/4118023730 >> v1:172.21.15.2:6789/0 conn(0x7f12a415a520 legacy=0x7f12a415a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:40.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.896+0000 7f12a2ffd700 1 -- 172.21.15.2:0/4118023730 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a40ce5a0 con 0x7f12a415db10 2023-11-26T07:11:40.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.896+0000 7f12a2ffd700 1 --2- 172.21.15.2:0/4118023730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12a415db10 0x7f12a415def0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f12a4072e00 tx=0x7f129c00d650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7adf706ddb209014 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.897+0000 7f12a1ffb700 1 -- 172.21.15.2:0/4118023730 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c010070 con 0x7f12a415db10 2023-11-26T07:11:40.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.897+0000 7f12a1ffb700 1 -- 172.21.15.2:0/4118023730 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f129c00dca0 con 0x7f12a415db10 2023-11-26T07:11:40.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.897+0000 7f12a1ffb700 1 -- 172.21.15.2:0/4118023730 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c007d50 con 0x7f12a415db10 2023-11-26T07:11:40.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.898+0000 7f12a95b2700 1 -- 172.21.15.2:0/4118023730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12a415db10 msgr2=0x7f12a415def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.898+0000 7f12a95b2700 1 --2- 172.21.15.2:0/4118023730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12a415db10 0x7f12a415def0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f12a4072e00 tx=0x7f129c00d650 comp rx=0 tx=0).stop 2023-11-26T07:11:40.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.899+0000 7f12a95b2700 1 -- 172.21.15.2:0/4118023730 shutdown_connections 2023-11-26T07:11:40.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.899+0000 7f12a95b2700 1 --2- 172.21.15.2:0/4118023730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12a415db10 0x7f12a415def0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.899+0000 7f12a95b2700 1 --2- 172.21.15.2:0/4118023730 >> v2:172.21.15.192:3300/0 conn(0x7f12a4071390 0x7f12a415e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.899+0000 7f12a95b2700 1 -- 172.21.15.2:0/4118023730 >> 172.21.15.2:0/4118023730 conn(0x7f12a40cf980 msgr2=0x7f12a40cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:40.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.899+0000 7f12a95b2700 1 -- 172.21.15.2:0/4118023730 shutdown_connections 2023-11-26T07:11:40.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.899+0000 7f12a95b2700 1 -- 172.21.15.2:0/4118023730 wait complete. 2023-11-26T07:11:40.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.901+0000 7f12a95b2700 1 Processor -- start 2023-11-26T07:11:40.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.901+0000 7f12a95b2700 1 -- start start 2023-11-26T07:11:40.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.902+0000 7f12a95b2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12a4071390 0x7f12a4156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.902+0000 7f12a95b2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12a415a520 0x7f12a40b2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.902+0000 7f12a95b2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12a415db10 0x7f12a4138620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.902+0000 7f12a95b2700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a40b34c0 con 0x7f12a4071390 2023-11-26T07:11:40.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.902+0000 7f12a95b2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a4142690 con 0x7f12a415db10 2023-11-26T07:11:40.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.902+0000 7f12a95b2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12a40b31e0 con 0x7f12a415a520 2023-11-26T07:11:40.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.903+0000 7f12a2ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12a4071390 0x7f12a4156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.903+0000 7f12a2ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12a4071390 0x7f12a4156ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39104/0 (socket says 172.21.15.2:39104) 2023-11-26T07:11:40.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.903+0000 7f12a2ffd700 1 -- 172.21.15.2:0/2247613409 learned_addr learned my addr 172.21.15.2:0/2247613409 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:40.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.903+0000 7f12a2ffd700 1 -- 172.21.15.2:0/2247613409 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12a415a520 msgr2=0x7f12a40b2740 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-26T07:11:40.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.903+0000 7f12a2ffd700 1 --2- 172.21.15.2:0/2247613409 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12a415a520 0x7f12a40b2740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.903+0000 7f12a2ffd700 1 -- 172.21.15.2:0/2247613409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12a415db10 msgr2=0x7f12a4138620 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-26T07:11:40.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.903+0000 7f12a2ffd700 1 --2- 172.21.15.2:0/2247613409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12a415db10 0x7f12a4138620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.903+0000 7f12a2ffd700 1 -- 172.21.15.2:0/2247613409 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f129c00d050 con 0x7f12a4071390 2023-11-26T07:11:40.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.903+0000 7f12a2ffd700 1 --2- 172.21.15.2:0/2247613409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12a4071390 0x7f12a4156ec0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f129c018040 tx=0x7f129c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.905+0000 7f128b7fe700 1 -- 172.21.15.2:0/2247613409 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c024070 con 0x7f12a4071390 2023-11-26T07:11:40.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.905+0000 7f128b7fe700 1 -- 172.21.15.2:0/2247613409 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f129c004310 con 0x7f12a4071390 2023-11-26T07:11:40.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.905+0000 7f128b7fe700 1 -- 172.21.15.2:0/2247613409 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c0046a0 con 0x7f12a4071390 2023-11-26T07:11:40.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.905+0000 7f12a95b2700 1 -- 172.21.15.2:0/2247613409 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12a40b48f0 con 0x7f12a4071390 2023-11-26T07:11:40.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.905+0000 7f12a95b2700 1 -- 172.21.15.2:0/2247613409 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12a40b4eb0 con 0x7f12a4071390 2023-11-26T07:11:40.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.910+0000 7f128b7fe700 1 -- 172.21.15.2:0/2247613409 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f129c004800 con 0x7f12a4071390 2023-11-26T07:11:40.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.910+0000 7f128b7fe700 1 --2- 172.21.15.2:0/2247613409 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f129006afa0 0x7f129006d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.910+0000 7f128b7fe700 1 -- 172.21.15.2:0/2247613409 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f129c08ae70 con 0x7f12a4071390 2023-11-26T07:11:40.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.912+0000 7f12a95b2700 1 -- 172.21.15.2:0/2247613409 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12840052e0 con 0x7f12a4071390 2023-11-26T07:11:40.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.912+0000 7f12a27fc700 1 --2- 172.21.15.2:0/2247613409 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f129006afa0 0x7f129006d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.913+0000 7f19690d1700 1 Processor -- start 2023-11-26T07:11:40.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.913+0000 7f19690d1700 1 -- start start 2023-11-26T07:11:40.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.914+0000 7f19690d1700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f196415db10 0x7f196415def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.914+0000 7f19690d1700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f19640ca2c0 0x7f19640ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.914+0000 7f19690d1700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19640ce000 con 0x7f1964071390 2023-11-26T07:11:40.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.914+0000 7f19690d1700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19640ce2c0 con 0x7f196415db10 2023-11-26T07:11:40.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.914+0000 7f19690d1700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19640ce5a0 con 0x7f19640ca2c0 2023-11-26T07:11:40.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.914+0000 7f1962d9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f196415db10 0x7f196415def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.914+0000 7f1962d9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f196415db10 0x7f196415def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39112/0 (socket says 172.21.15.2:39112) 2023-11-26T07:11:40.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.914+0000 7f1962d9d700 1 -- 172.21.15.2:0/1649492969 learned_addr learned my addr 172.21.15.2:0/1649492969 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:40.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.914+0000 7f1962d9d700 1 -- 172.21.15.2:0/1649492969 >> v2:172.21.15.192:3300/0 conn(0x7f19640ca2c0 msgr2=0x7f19640ca6d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-26T07:11:40.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.914+0000 7f1962d9d700 1 --2- 172.21.15.2:0/1649492969 >> v2:172.21.15.192:3300/0 conn(0x7f19640ca2c0 0x7f19640ca6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.914+0000 7f1962d9d700 1 -- 172.21.15.2:0/1649492969 >> v1:172.21.15.2:6789/0 conn(0x7f1964071390 legacy=0x7f196415e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:40.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.915+0000 7f1962d9d700 1 -- 172.21.15.2:0/1649492969 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19640ce880 con 0x7f196415db10 2023-11-26T07:11:40.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.915+0000 7f1962d9d700 1 --2- 172.21.15.2:0/1649492969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f196415db10 0x7f196415def0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1964070ea0 tx=0x7f195c007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abe350ba820782ea server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.915+0000 7f12a27fc700 1 --2- 172.21.15.2:0/2247613409 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f129006afa0 0x7f129006d460 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f12a413f560 tx=0x7f1294008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.921+0000 7f1961d9b700 1 -- 172.21.15.2:0/1649492969 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195c003a20 con 0x7f196415db10 2023-11-26T07:11:40.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.921+0000 7f1961d9b700 1 -- 172.21.15.2:0/1649492969 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f195c003b80 con 0x7f196415db10 2023-11-26T07:11:40.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.921+0000 7f1961d9b700 1 -- 172.21.15.2:0/1649492969 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195c004030 con 0x7f196415db10 2023-11-26T07:11:40.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.921+0000 7f128b7fe700 1 -- 172.21.15.2:0/2247613409 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f129c0560b0 con 0x7f12a4071390 2023-11-26T07:11:40.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.922+0000 7f19690d1700 1 -- 172.21.15.2:0/1649492969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f196415db10 msgr2=0x7f196415def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.922+0000 7f19690d1700 1 --2- 172.21.15.2:0/1649492969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f196415db10 0x7f196415def0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1964070ea0 tx=0x7f195c007a10 comp rx=0 tx=0).stop 2023-11-26T07:11:40.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.922+0000 7f19690d1700 1 -- 172.21.15.2:0/1649492969 shutdown_connections 2023-11-26T07:11:40.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.922+0000 7f19690d1700 1 --2- 172.21.15.2:0/1649492969 >> v2:172.21.15.192:3300/0 conn(0x7f19640ca2c0 0x7f19640ca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.922+0000 7f19690d1700 1 --2- 172.21.15.2:0/1649492969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f196415db10 0x7f196415def0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.922+0000 7f19690d1700 1 -- 172.21.15.2:0/1649492969 >> 172.21.15.2:0/1649492969 conn(0x7f19640cf980 msgr2=0x7f19640cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:40.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.923+0000 7f19690d1700 1 -- 172.21.15.2:0/1649492969 shutdown_connections 2023-11-26T07:11:40.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.923+0000 7f19690d1700 1 -- 172.21.15.2:0/1649492969 wait complete. 2023-11-26T07:11:40.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.925+0000 7f19690d1700 1 Processor -- start 2023-11-26T07:11:40.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.925+0000 7f19690d1700 1 -- start start 2023-11-26T07:11:40.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.926+0000 7f19690d1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1964071390 0x7f1964141010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.926+0000 7f19690d1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19640ca2c0 0x7f1964159640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.926+0000 7f19690d1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f196415db10 0x7f1964139690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.926+0000 7f19690d1700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1964159b80 con 0x7f196415db10 2023-11-26T07:11:40.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.926+0000 7f19690d1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196413ff70 con 0x7f19640ca2c0 2023-11-26T07:11:40.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.926+0000 7f19690d1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1964140250 con 0x7f1964071390 2023-11-26T07:11:40.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.926+0000 7f196359e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f196415db10 0x7f1964139690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.926+0000 7f196359e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f196415db10 0x7f1964139690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39120/0 (socket says 172.21.15.2:39120) 2023-11-26T07:11:40.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.926+0000 7f196359e700 1 -- 172.21.15.2:0/3267740717 learned_addr learned my addr 172.21.15.2:0/3267740717 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:40.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.927+0000 7f1962d9d700 1 --2- 172.21.15.2:0/3267740717 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1964071390 0x7f1964141010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.927+0000 7f196259c700 1 --2- 172.21.15.2:0/3267740717 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19640ca2c0 0x7f1964159640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.927+0000 7f1962d9d700 1 -- 172.21.15.2:0/3267740717 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19640ca2c0 msgr2=0x7f1964159640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.927+0000 7f1962d9d700 1 --2- 172.21.15.2:0/3267740717 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19640ca2c0 0x7f1964159640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.927+0000 7f1962d9d700 1 -- 172.21.15.2:0/3267740717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f196415db10 msgr2=0x7f1964139690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.927+0000 7f1962d9d700 1 --2- 172.21.15.2:0/3267740717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f196415db10 0x7f1964139690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.927+0000 7f1962d9d700 1 -- 172.21.15.2:0/3267740717 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f195c007390 con 0x7f1964071390 2023-11-26T07:11:40.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.928+0000 7f1962d9d700 1 --2- 172.21.15.2:0/3267740717 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1964071390 0x7f1964141010 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f195c016000 tx=0x7f195c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.928+0000 7f194b7fe700 1 -- 172.21.15.2:0/3267740717 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195c003a20 con 0x7f1964071390 2023-11-26T07:11:40.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.928+0000 7f194b7fe700 1 -- 172.21.15.2:0/3267740717 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f195c00d240 con 0x7f1964071390 2023-11-26T07:11:40.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.928+0000 7f194b7fe700 1 -- 172.21.15.2:0/3267740717 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195c0228d0 con 0x7f1964071390 2023-11-26T07:11:40.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.928+0000 7f19690d1700 1 -- 172.21.15.2:0/3267740717 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1964140530 con 0x7f1964071390 2023-11-26T07:11:40.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.928+0000 7f19690d1700 1 -- 172.21.15.2:0/3267740717 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1964140af0 con 0x7f1964071390 2023-11-26T07:11:40.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.930+0000 7f19690d1700 1 -- 172.21.15.2:0/3267740717 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1964140ce0 con 0x7f1964071390 2023-11-26T07:11:40.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.931+0000 7f194b7fe700 1 -- 172.21.15.2:0/3267740717 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f195c022a30 con 0x7f1964071390 2023-11-26T07:11:40.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.932+0000 7f194b7fe700 1 --2- 172.21.15.2:0/3267740717 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f194c06b080 0x7f194c06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.932+0000 7f194b7fe700 1 -- 172.21.15.2:0/3267740717 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f195c08ffe0 con 0x7f1964071390 2023-11-26T07:11:40.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.933+0000 7f4042ba0700 1 Processor -- start 2023-11-26T07:11:40.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.933+0000 7f3a50008700 1 Processor -- start 2023-11-26T07:11:40.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.933+0000 7f3a50008700 1 -- start start 2023-11-26T07:11:40.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.934+0000 7f3a50008700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3a4806f0c0 0x7f3a48070e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.934+0000 7f3a50008700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a480cd550 con 0x7f3a48145700 2023-11-26T07:11:40.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.934+0000 7f3a50008700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a48071bc0 con 0x7f3a48071390 2023-11-26T07:11:40.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.934+0000 7f3a50008700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a48071ea0 con 0x7f3a4806f0c0 2023-11-26T07:11:40.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.933+0000 7f4042ba0700 1 -- start start 2023-11-26T07:11:40.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.934+0000 7f4042ba0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f403c15c9a0 0x7f403c0b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.934+0000 7f4042ba0700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f403c0b4c80 0x7f403c16c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.934+0000 7f4042ba0700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f403c162640 con 0x7f403c0b2d40 2023-11-26T07:11:40.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.934+0000 7f4042ba0700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f403c163250 con 0x7f403c0b4c80 2023-11-26T07:11:40.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.934+0000 7f4042ba0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f403c163670 con 0x7f403c15c9a0 2023-11-26T07:11:40.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.935+0000 7f3a4d5a3700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3a4806f0c0 0x7f3a48070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.935+0000 7f3a4d5a3700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3a4806f0c0 0x7f3a48070e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39132/0 (socket says 172.21.15.2:39132) 2023-11-26T07:11:40.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.935+0000 7f3a4dda4700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f3a48145700 0x7f3a4806e9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58570/0 (socket says 172.21.15.2:58570) 2023-11-26T07:11:40.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.935+0000 7f3a4d5a3700 1 -- 172.21.15.2:0/3038921926 learned_addr learned my addr 172.21.15.2:0/3038921926 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:40.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.935+0000 7f3a4cda2700 1 -- 172.21.15.2:0/3038921926 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4115314405 0 0) 0x7f3a480cd550 con 0x7f3a48145700 2023-11-26T07:11:40.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.935+0000 7f3a4cda2700 1 -- 172.21.15.2:0/3038921926 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a340035b0 con 0x7f3a48145700 2023-11-26T07:11:40.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.935+0000 7f3a4d5a3700 1 -- 172.21.15.2:0/3038921926 >> v1:172.21.15.192:6789/0 conn(0x7f3a48071390 legacy=0x7f3a480cd9e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-26T07:11:40.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.935+0000 7f3a4d5a3700 1 -- 172.21.15.2:0/3038921926 >> v1:172.21.15.2:6789/0 conn(0x7f3a48145700 legacy=0x7f3a4806e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.935+0000 7f3a4d5a3700 1 -- 172.21.15.2:0/3038921926 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a48072180 con 0x7f3a4806f0c0 2023-11-26T07:11:40.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.934+0000 7f5996cd1700 1 Processor -- start 2023-11-26T07:11:40.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.934+0000 7f5996cd1700 1 -- start start 2023-11-26T07:11:40.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.935+0000 7f5996cd1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5990070a80 0x7f5990070e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.935+0000 7f5996cd1700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5990145870 0x7f5990165ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.935+0000 7f5996cd1700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59900ca8e0 con 0x7f5990166430 2023-11-26T07:11:40.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.935+0000 7f5996cd1700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59900713a0 con 0x7f5990145870 2023-11-26T07:11:40.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.935+0000 7f5996cd1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59900c9fd0 con 0x7f5990070a80 2023-11-26T07:11:40.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.936+0000 7f3a4d5a3700 1 --2- 172.21.15.2:0/3038921926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a4806f0c0 0x7f3a48070e50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3a380098f0 tx=0x7f3a38009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87cb8f386b23a6ab server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.936+0000 7f599526e700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f5990166430 0x7f59900cad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58578/0 (socket says 172.21.15.2:58578) 2023-11-26T07:11:40.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.936+0000 7f599526e700 1 -- 172.21.15.2:0/1278091499 learned_addr learned my addr 172.21.15.2:0/1278091499 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:11:40.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.936+0000 7f5994a6d700 1 --2- 172.21.15.2:0/1278091499 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5990070a80 0x7f5990070e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.936+0000 7f598ffff700 1 --2- 172.21.15.2:0/1278091499 >> v2:172.21.15.192:3300/0 conn(0x7f5990145870 0x7f5990165ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.936+0000 7f194b7fe700 1 -- 172.21.15.2:0/3267740717 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f195c05b1a0 con 0x7f1964071390 2023-11-26T07:11:40.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.936+0000 7f5994a6d700 1 -- 172.21.15.2:0/1278091499 >> v2:172.21.15.192:3300/0 conn(0x7f5990145870 msgr2=0x7f5990165ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:40.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.936+0000 7f5994a6d700 1 --2- 172.21.15.2:0/1278091499 >> v2:172.21.15.192:3300/0 conn(0x7f5990145870 0x7f5990165ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.936+0000 7f5994a6d700 1 -- 172.21.15.2:0/1278091499 >> v1:172.21.15.2:6789/0 conn(0x7f5990166430 legacy=0x7f59900cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.936+0000 7f598f7fe700 1 -- 172.21.15.2:0/1278091499 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2845225867 0 0) 0x7f59900ca8e0 con 0x7f5990166430 2023-11-26T07:11:40.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.936+0000 7f5994a6d700 1 -- 172.21.15.2:0/1278091499 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5990166c60 con 0x7f5990070a80 2023-11-26T07:11:40.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.936+0000 7f5994a6d700 1 --2- 172.21.15.2:0/1278091499 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5990070a80 0x7f5990070e60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5984009840 tx=0x7f5984009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b8a67ff893a8eba server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.936+0000 7f404239f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f403c0b4c80 0x7f403c16c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.936+0000 7f404239f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f403c0b4c80 0x7f403c16c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39134/0 (socket says 172.21.15.2:39134) 2023-11-26T07:11:40.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.936+0000 7f404239f700 1 -- 172.21.15.2:0/1742026615 learned_addr learned my addr 172.21.15.2:0/1742026615 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:40.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.936+0000 7f404239f700 1 -- 172.21.15.2:0/1742026615 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f403c15c9a0 msgr2=0x7f403c0b4740 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-26T07:11:40.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.936+0000 7f404239f700 1 --2- 172.21.15.2:0/1742026615 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f403c15c9a0 0x7f403c0b4740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.936+0000 7f404239f700 1 -- 172.21.15.2:0/1742026615 >> v1:172.21.15.192:6789/0 conn(0x7f403c0b2d40 legacy=0x7f403c0b3120 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-26T07:11:40.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.936+0000 7f404239f700 1 -- 172.21.15.2:0/1742026615 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f403c06eb60 con 0x7f403c0b4c80 2023-11-26T07:11:40.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.936+0000 7f404239f700 1 --2- 172.21.15.2:0/1742026615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f403c0b4c80 0x7f403c16c040 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4034009e50 tx=0x7f403400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e7a9f43cef39fa3 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.937+0000 7f4040b9c700 1 -- 172.21.15.2:0/1742026615 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403400e070 con 0x7f403c0b4c80 2023-11-26T07:11:40.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.937+0000 7f4040b9c700 1 -- 172.21.15.2:0/1742026615 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4034003a20 con 0x7f403c0b4c80 2023-11-26T07:11:40.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.937+0000 7f4040b9c700 1 -- 172.21.15.2:0/1742026615 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4034003dd0 con 0x7f403c0b4c80 2023-11-26T07:11:40.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.936+0000 7f3a4cda2700 1 -- 172.21.15.2:0/3038921926 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a38004230 con 0x7f3a4806f0c0 2023-11-26T07:11:40.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.936+0000 7f3a4cda2700 1 -- 172.21.15.2:0/3038921926 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a38004390 con 0x7f3a4806f0c0 2023-11-26T07:11:40.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.936+0000 7f3a4cda2700 1 -- 172.21.15.2:0/3038921926 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a380036a0 con 0x7f3a4806f0c0 2023-11-26T07:11:40.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.937+0000 7f3a50008700 1 -- 172.21.15.2:0/3038921926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a4806f0c0 msgr2=0x7f3a48070e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.937+0000 7f3a50008700 1 --2- 172.21.15.2:0/3038921926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a4806f0c0 0x7f3a48070e50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3a380098f0 tx=0x7f3a38009c00 comp rx=0 tx=0).stop 2023-11-26T07:11:40.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.938+0000 7f598f7fe700 1 -- 172.21.15.2:0/1278091499 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5984011830 con 0x7f5990070a80 2023-11-26T07:11:40.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.938+0000 7f598f7fe700 1 -- 172.21.15.2:0/1278091499 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5984011990 con 0x7f5990070a80 2023-11-26T07:11:40.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.938+0000 7f598f7fe700 1 -- 172.21.15.2:0/1278091499 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5984011d00 con 0x7f5990070a80 2023-11-26T07:11:40.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.938+0000 7f5996cd1700 1 -- 172.21.15.2:0/1278091499 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5990070a80 msgr2=0x7f5990070e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.938+0000 7f5996cd1700 1 --2- 172.21.15.2:0/1278091499 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5990070a80 0x7f5990070e60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5984009840 tx=0x7f5984009b50 comp rx=0 tx=0).stop 2023-11-26T07:11:40.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.941+0000 7f5996cd1700 1 -- 172.21.15.2:0/1278091499 shutdown_connections 2023-11-26T07:11:40.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.941+0000 7f5996cd1700 1 --2- 172.21.15.2:0/1278091499 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5990070a80 0x7f5990070e60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.941+0000 7f5996cd1700 1 --2- 172.21.15.2:0/1278091499 >> v2:172.21.15.192:3300/0 conn(0x7f5990145870 0x7f5990165ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.941+0000 7f5996cd1700 1 -- 172.21.15.2:0/1278091499 >> 172.21.15.2:0/1278091499 conn(0x7f59900cf980 msgr2=0x7f59900cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:40.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.942+0000 7f4042ba0700 1 -- 172.21.15.2:0/1742026615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f403c0b4c80 msgr2=0x7f403c16c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.942+0000 7f4042ba0700 1 --2- 172.21.15.2:0/1742026615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f403c0b4c80 0x7f403c16c040 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4034009e50 tx=0x7f403400b330 comp rx=0 tx=0).stop 2023-11-26T07:11:40.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.943+0000 7f196259c700 1 --2- 172.21.15.2:0/3267740717 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f194c06b080 0x7f194c06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.943+0000 7f4042ba0700 1 -- 172.21.15.2:0/1742026615 shutdown_connections 2023-11-26T07:11:40.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.943+0000 7f4042ba0700 1 --2- 172.21.15.2:0/1742026615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f403c0b4c80 0x7f403c16c040 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.943+0000 7f4042ba0700 1 --2- 172.21.15.2:0/1742026615 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f403c15c9a0 0x7f403c0b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.943+0000 7f4042ba0700 1 -- 172.21.15.2:0/1742026615 >> 172.21.15.2:0/1742026615 conn(0x7f403c0b1a40 msgr2=0x7f403c0b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:40.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.943+0000 7fb1af1d5700 1 Processor -- start 2023-11-26T07:11:40.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.943+0000 7f3a50008700 1 -- 172.21.15.2:0/3038921926 shutdown_connections 2023-11-26T07:11:40.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.943+0000 7f3a50008700 1 --2- 172.21.15.2:0/3038921926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a4806f0c0 0x7f3a48070e50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.943+0000 7f3a50008700 1 -- 172.21.15.2:0/3038921926 >> 172.21.15.2:0/3038921926 conn(0x7f3a480cf980 msgr2=0x7f3a480cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:40.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.943+0000 7f4042ba0700 1 -- 172.21.15.2:0/1742026615 shutdown_connections 2023-11-26T07:11:40.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.943+0000 7fb1af1d5700 1 -- start start 2023-11-26T07:11:40.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.944+0000 7f196259c700 1 --2- 172.21.15.2:0/3267740717 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f194c06b080 0x7f194c06d540 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f19641f3670 tx=0x7f1954008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.944+0000 7fb1af1d5700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb1a8143ae0 0x7fb1a80b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.944+0000 7f4042ba0700 1 -- 172.21.15.2:0/1742026615 wait complete. 2023-11-26T07:11:40.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.944+0000 7fb1af1d5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1a80722c0 0x7fb1a806e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.944+0000 7fb1af1d5700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a8143ec0 con 0x7fb1a81440f0 2023-11-26T07:11:40.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.944+0000 7fb1af1d5700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1a80b40a0 con 0x7fb1a8143ae0 2023-11-26T07:11:40.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.944+0000 7fb1af1d5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a80b3ae0 con 0x7fb1a80722c0 2023-11-26T07:11:40.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.945+0000 7fb1a7fff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb1a81440f0 0x7fb1a8071bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58586/0 (socket says 172.21.15.2:58586) 2023-11-26T07:11:40.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.945+0000 7fb1a7fff700 1 -- 172.21.15.2:0/4212744084 learned_addr learned my addr 172.21.15.2:0/4212744084 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:11:40.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.945+0000 7fb1acf71700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb1a8143ae0 0x7fb1a80b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.945+0000 7fb1acf71700 1 -- 172.21.15.2:0/4212744084 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1a80722c0 msgr2=0x7fb1a806e510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-26T07:11:40.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.945+0000 7fb1a77fe700 1 -- 172.21.15.2:0/4212744084 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4038638067 0 0) 0x7fb1a8143ec0 con 0x7fb1a81440f0 2023-11-26T07:11:40.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.945+0000 7fb1acf71700 1 --2- 172.21.15.2:0/4212744084 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1a80722c0 0x7fb1a806e510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.945+0000 7fb1acf71700 1 -- 172.21.15.2:0/4212744084 >> v1:172.21.15.2:6789/0 conn(0x7fb1a81440f0 legacy=0x7fb1a8071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.945+0000 7fb1acf71700 1 -- 172.21.15.2:0/4212744084 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a80b3dc0 con 0x7fb1a8143ae0 2023-11-26T07:11:40.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.945+0000 7fb1acf71700 1 --2- 172.21.15.2:0/4212744084 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1a8143ae0 0x7fb1a80b51b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0009840 tx=0x7fb1a0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a01357ecab982140 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.945+0000 7fb1a77fe700 1 -- 172.21.15.2:0/4212744084 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a0011830 con 0x7fb1a8143ae0 2023-11-26T07:11:40.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.946+0000 7fb1a77fe700 1 -- 172.21.15.2:0/4212744084 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a0011990 con 0x7fb1a8143ae0 2023-11-26T07:11:40.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.946+0000 7fb1a77fe700 1 -- 172.21.15.2:0/4212744084 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a0011d20 con 0x7fb1a8143ae0 2023-11-26T07:11:40.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.946+0000 7f4042ba0700 1 Processor -- start 2023-11-26T07:11:40.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.947+0000 7fb1af1d5700 1 -- 172.21.15.2:0/4212744084 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1a8143ae0 msgr2=0x7fb1a80b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.947+0000 7fb1af1d5700 1 --2- 172.21.15.2:0/4212744084 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1a8143ae0 0x7fb1a80b51b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0009840 tx=0x7fb1a0009b50 comp rx=0 tx=0).stop 2023-11-26T07:11:40.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.947+0000 7f3a50008700 1 -- 172.21.15.2:0/3038921926 shutdown_connections 2023-11-26T07:11:40.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.947+0000 7fb1af1d5700 1 -- 172.21.15.2:0/4212744084 shutdown_connections 2023-11-26T07:11:40.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.947+0000 7fb1af1d5700 1 --2- 172.21.15.2:0/4212744084 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1a80722c0 0x7fb1a806e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.947+0000 7fb1af1d5700 1 --2- 172.21.15.2:0/4212744084 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1a8143ae0 0x7fb1a80b51b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.947+0000 7fb1af1d5700 1 -- 172.21.15.2:0/4212744084 >> 172.21.15.2:0/4212744084 conn(0x7fb1a80b2740 msgr2=0x7fb1a80b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:40.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.946+0000 7f4042ba0700 1 -- start start 2023-11-26T07:11:40.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.947+0000 7f4042ba0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f403c0b4c80 0x7f403c15bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.947+0000 7f4042ba0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f403c15c9a0 0x7f403c0b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.947+0000 7f4042ba0700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f403c0ae520 0x7f403c14ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.947+0000 7f4042ba0700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f403c14dc60 con 0x7f403c15c9a0 2023-11-26T07:11:40.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.947+0000 7f4042ba0700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f403c0aea70 con 0x7f403c0ae520 2023-11-26T07:11:40.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.947+0000 7f4042ba0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f403c0aed50 con 0x7f403c0b4c80 2023-11-26T07:11:40.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.948+0000 7f404139d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f403c15c9a0 0x7f403c0b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.948+0000 7f404239f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f403c0ae520 0x7f403c14ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.948+0000 7f404139d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f403c15c9a0 0x7f403c0b0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39148/0 (socket says 172.21.15.2:39148) 2023-11-26T07:11:40.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.948+0000 7f404139d700 1 -- 172.21.15.2:0/2980148023 learned_addr learned my addr 172.21.15.2:0/2980148023 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:40.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.948+0000 7fb1af1d5700 1 -- 172.21.15.2:0/4212744084 shutdown_connections 2023-11-26T07:11:40.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.948+0000 7fb1af1d5700 1 -- 172.21.15.2:0/4212744084 wait complete. 2023-11-26T07:11:40.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.948+0000 7f404239f700 1 -- 172.21.15.2:0/2980148023 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f403c0b4c80 msgr2=0x7f403c15bf00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-26T07:11:40.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.948+0000 7f404239f700 1 --2- 172.21.15.2:0/2980148023 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f403c0b4c80 0x7f403c15bf00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.948+0000 7f404239f700 1 -- 172.21.15.2:0/2980148023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f403c15c9a0 msgr2=0x7f403c0b0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.948+0000 7f404239f700 1 --2- 172.21.15.2:0/2980148023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f403c15c9a0 0x7f403c0b0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.948+0000 7f404239f700 1 -- 172.21.15.2:0/2980148023 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4034009b30 con 0x7f403c0ae520 2023-11-26T07:11:40.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.948+0000 7f404239f700 1 --2- 172.21.15.2:0/2980148023 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f403c0ae520 0x7f403c14ed00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4034014000 tx=0x7f4034004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.949+0000 7f3a50008700 1 -- 172.21.15.2:0/3038921926 wait complete. 2023-11-26T07:11:40.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.950+0000 7fb1af1d5700 1 Processor -- start 2023-11-26T07:11:40.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.950+0000 7fb1af1d5700 1 -- start start 2023-11-26T07:11:40.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.950+0000 7f3a50008700 1 Processor -- start 2023-11-26T07:11:40.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.950+0000 7f3a50008700 1 -- start start 2023-11-26T07:11:40.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.951+0000 7f3a50008700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a4806f0c0 0x7f3a480b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.951+0000 7f3a50008700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3a48071390 0x7f3a480c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.951+0000 7f3a50008700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a48145700 0x7f3a480c5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.951+0000 7f3a50008700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a480c7160 con 0x7f3a48145700 2023-11-26T07:11:40.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.951+0000 7f3a50008700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a480c5290 con 0x7f3a4806f0c0 2023-11-26T07:11:40.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.951+0000 7f3a50008700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a480c7390 con 0x7f3a48071390 2023-11-26T07:11:40.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.951+0000 7f3a4dda4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a4806f0c0 0x7f3a480b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.951+0000 7f3a4dda4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a4806f0c0 0x7f3a480b4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.2:47738/0 (socket says 172.21.15.2:47738) 2023-11-26T07:11:40.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.951+0000 7f3a4dda4700 1 -- 172.21.15.2:0/3670312369 learned_addr learned my addr 172.21.15.2:0/3670312369 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:40.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.951+0000 7fb1af1d5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1a80722c0 0x7fb1a813f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.951+0000 7fb1af1d5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1a8143ae0 0x7fb1a81f6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.951+0000 7fb1af1d5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1a81440f0 0x7fb1a8142100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.951+0000 7fb1af1d5700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a81f5b60 con 0x7fb1a80722c0 2023-11-26T07:11:40.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.951+0000 7fb1af1d5700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a81f5e40 con 0x7fb1a81440f0 2023-11-26T07:11:40.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.951+0000 7fb1af1d5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a81f6120 con 0x7fb1a8143ae0 2023-11-26T07:11:40.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.951+0000 7fb1acf71700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1a80722c0 0x7fb1a813f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.951+0000 7fb1a7fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1a8143ae0 0x7fb1a81f6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.951+0000 7fb1acf71700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1a80722c0 0x7fb1a813f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39158/0 (socket says 172.21.15.2:39158) 2023-11-26T07:11:40.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.951+0000 7fb1acf71700 1 -- 172.21.15.2:0/3493532557 learned_addr learned my addr 172.21.15.2:0/3493532557 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:40.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.951+0000 7fb1a7fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1a8143ae0 0x7fb1a81f6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.2:37240/0 (socket says 172.21.15.2:37240) 2023-11-26T07:11:40.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.951+0000 7fb1ad772700 1 --2- 172.21.15.2:0/3493532557 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1a81440f0 0x7fb1a8142100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.951+0000 7f3a4e5a5700 1 --2- 172.21.15.2:0/3670312369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a48145700 0x7f3a480c5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.952+0000 7fb1acf71700 1 -- 172.21.15.2:0/3493532557 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1a8143ae0 msgr2=0x7fb1a81f6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.952+0000 7fb1acf71700 1 --2- 172.21.15.2:0/3493532557 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1a8143ae0 0x7fb1a81f6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.952+0000 7fb1acf71700 1 -- 172.21.15.2:0/3493532557 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1a81440f0 msgr2=0x7fb1a8142100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.952+0000 7fb1acf71700 1 --2- 172.21.15.2:0/3493532557 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1a81440f0 0x7fb1a8142100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.952+0000 7fb1acf71700 1 -- 172.21.15.2:0/3493532557 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a00094a0 con 0x7fb1a80722c0 2023-11-26T07:11:40.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.952+0000 7fb1a7fff700 1 --2- 172.21.15.2:0/3493532557 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1a8143ae0 0x7fb1a81f6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:11:40.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.952+0000 7fb1ad772700 1 --2- 172.21.15.2:0/3493532557 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1a81440f0 0x7fb1a8142100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:11:40.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.952+0000 7f3a4e5a5700 1 -- 172.21.15.2:0/3670312369 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3a48071390 msgr2=0x7f3a480c6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.952+0000 7f3a4e5a5700 1 --2- 172.21.15.2:0/3670312369 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3a48071390 0x7f3a480c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.952+0000 7f3a4e5a5700 1 -- 172.21.15.2:0/3670312369 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a4806f0c0 msgr2=0x7f3a480b4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.952+0000 7f3a4e5a5700 1 --2- 172.21.15.2:0/3670312369 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a4806f0c0 0x7f3a480b4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.952+0000 7f3a4e5a5700 1 -- 172.21.15.2:0/3670312369 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a38009550 con 0x7f3a48145700 2023-11-26T07:11:40.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.952+0000 7f3a4dda4700 1 --2- 172.21.15.2:0/3670312369 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a4806f0c0 0x7f3a480b4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:11:40.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.952+0000 7fb1acf71700 1 --2- 172.21.15.2:0/3493532557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1a80722c0 0x7fb1a813f3b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb1a00090b0 tx=0x7fb1a0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.952+0000 7f3a4e5a5700 1 --2- 172.21.15.2:0/3670312369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a48145700 0x7f3a480c5720 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3a4400b3c0 tx=0x7f3a4400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.952+0000 7f3a3e7fc700 1 -- 172.21.15.2:0/3670312369 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a44011830 con 0x7f3a48145700 2023-11-26T07:11:40.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.952+0000 7f3a3e7fc700 1 -- 172.21.15.2:0/3670312369 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a440119b0 con 0x7f3a48145700 2023-11-26T07:11:40.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.952+0000 7f3a3e7fc700 1 -- 172.21.15.2:0/3670312369 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a44011d60 con 0x7f3a48145700 2023-11-26T07:11:40.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.953+0000 7f3a50008700 1 -- 172.21.15.2:0/3670312369 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a480c4960 con 0x7f3a48145700 2023-11-26T07:11:40.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.953+0000 7f3a50008700 1 -- 172.21.15.2:0/3670312369 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a480c4f20 con 0x7f3a48145700 2023-11-26T07:11:40.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.954+0000 7f3a50008700 1 -- 172.21.15.2:0/3670312369 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a480c5440 con 0x7f3a48145700 2023-11-26T07:11:40.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.954+0000 7f3a3e7fc700 1 -- 172.21.15.2:0/3670312369 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3a4401a400 con 0x7f3a48145700 2023-11-26T07:11:40.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.955+0000 7f3a3e7fc700 1 --2- 172.21.15.2:0/3670312369 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3a2c06aed0 0x7f3a2c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.955+0000 7f5996cd1700 1 -- 172.21.15.2:0/1278091499 shutdown_connections 2023-11-26T07:11:40.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.955+0000 7f5996cd1700 1 -- 172.21.15.2:0/1278091499 wait complete. 2023-11-26T07:11:40.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.957+0000 7f5996cd1700 1 Processor -- start 2023-11-26T07:11:40.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.957+0000 7f5996cd1700 1 -- start start 2023-11-26T07:11:40.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.957+0000 7f3a3e7fc700 1 -- 172.21.15.2:0/3670312369 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a4400e260 con 0x7f3a48145700 2023-11-26T07:11:40.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.958+0000 7f5996cd1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5990070a80 0x7f599006d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.958+0000 7f5996cd1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5990145870 0x7f5990144aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.958+0000 7f5996cd1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5990166430 0x7f5990133690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.958+0000 7f5996cd1700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5990134000 con 0x7f5990145870 2023-11-26T07:11:40.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.958+0000 7f5996cd1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59900b3d00 con 0x7f5990166430 2023-11-26T07:11:40.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.958+0000 7f5996cd1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59900b3fe0 con 0x7f5990070a80 2023-11-26T07:11:40.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.959+0000 7f5994a6d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5990070a80 0x7f599006d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.959+0000 7f5994a6d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5990070a80 0x7f599006d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.2:37246/0 (socket says 172.21.15.2:37246) 2023-11-26T07:11:40.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.959+0000 7f5994a6d700 1 -- 172.21.15.2:0/731378742 learned_addr learned my addr 172.21.15.2:0/731378742 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:40.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.959+0000 7f599526e700 1 --2- 172.21.15.2:0/731378742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5990166430 0x7f5990133690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.959+0000 7f598ffff700 1 --2- 172.21.15.2:0/731378742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5990145870 0x7f5990144aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.959+0000 7f5994a6d700 1 -- 172.21.15.2:0/731378742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5990166430 msgr2=0x7f5990133690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.959+0000 7f5994a6d700 1 --2- 172.21.15.2:0/731378742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5990166430 0x7f5990133690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.959+0000 7f5994a6d700 1 -- 172.21.15.2:0/731378742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5990145870 msgr2=0x7f5990144aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:40.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.959+0000 7f5994a6d700 1 --2- 172.21.15.2:0/731378742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5990145870 0x7f5990144aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:40.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.959+0000 7f5994a6d700 1 -- 172.21.15.2:0/731378742 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59840094a0 con 0x7f5990070a80 2023-11-26T07:11:40.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.959+0000 7f3a4dda4700 1 --2- 172.21.15.2:0/3670312369 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3a2c06aed0 0x7f3a2c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.959+0000 7f5994a6d700 1 --2- 172.21.15.2:0/731378742 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5990070a80 0x7f599006d050 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f59840090b0 tx=0x7f5984004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.960+0000 7f598d7fa700 1 -- 172.21.15.2:0/731378742 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5984004510 con 0x7f5990070a80 2023-11-26T07:11:40.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.960+0000 7f598d7fa700 1 -- 172.21.15.2:0/731378742 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f598401f070 con 0x7f5990070a80 2023-11-26T07:11:40.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.960+0000 7f598d7fa700 1 -- 172.21.15.2:0/731378742 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59840038a0 con 0x7f5990070a80 2023-11-26T07:11:40.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.960+0000 7f5996cd1700 1 -- 172.21.15.2:0/731378742 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59900b42c0 con 0x7f5990070a80 2023-11-26T07:11:40.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.960+0000 7f5996cd1700 1 -- 172.21.15.2:0/731378742 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f599006d590 con 0x7f5990070a80 2023-11-26T07:11:40.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.960+0000 7f3a4dda4700 1 --2- 172.21.15.2:0/3670312369 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3a2c06aed0 0x7f3a2c06d390 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3a40002230 tx=0x7f3a40001b70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.961+0000 7f3a3e7fc700 1 -- 172.21.15.2:0/3670312369 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3a480c5440 con 0x7f3a48145700 2023-11-26T07:11:40.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.961+0000 7f5996cd1700 1 -- 172.21.15.2:0/731378742 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5990067f60 con 0x7f5990070a80 2023-11-26T07:11:40.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.962+0000 7f598d7fa700 1 -- 172.21.15.2:0/731378742 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5984003a00 con 0x7f5990070a80 2023-11-26T07:11:40.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.962+0000 7f598d7fa700 1 --2- 172.21.15.2:0/731378742 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f597406aed0 0x7f597406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.963+0000 7f598d7fa700 1 -- 172.21.15.2:0/731378742 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5984021070 con 0x7f5990070a80 2023-11-26T07:11:40.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.963+0000 7f598ffff700 1 --2- 172.21.15.2:0/731378742 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f597406aed0 0x7f597406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.963+0000 7f598ffff700 1 --2- 172.21.15.2:0/731378742 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f597406aed0 0x7f597406d390 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5990135060 tx=0x7f597c009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.966+0000 7f40327fc700 1 -- 172.21.15.2:0/2980148023 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4034004240 con 0x7f403c0ae520 2023-11-26T07:11:40.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.966+0000 7f40327fc700 1 -- 172.21.15.2:0/2980148023 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40340043a0 con 0x7f403c0ae520 2023-11-26T07:11:40.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.966+0000 7f40327fc700 1 -- 172.21.15.2:0/2980148023 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4034004750 con 0x7f403c0ae520 2023-11-26T07:11:40.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.966+0000 7f4042ba0700 1 -- 172.21.15.2:0/2980148023 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f403c0af030 con 0x7f403c0ae520 2023-11-26T07:11:40.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.966+0000 7f4042ba0700 1 -- 172.21.15.2:0/2980148023 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f403c15c440 con 0x7f403c0ae520 2023-11-26T07:11:40.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.966+0000 7fb1a57fa700 1 -- 172.21.15.2:0/3493532557 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a00036a0 con 0x7fb1a80722c0 2023-11-26T07:11:40.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.966+0000 7fb1a57fa700 1 -- 172.21.15.2:0/3493532557 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a001f070 con 0x7fb1a80722c0 2023-11-26T07:11:40.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.966+0000 7fb1a57fa700 1 -- 172.21.15.2:0/3493532557 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a0003a20 con 0x7fb1a80722c0 2023-11-26T07:11:40.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.967+0000 7f598d7fa700 1 -- 172.21.15.2:0/731378742 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5984055e40 con 0x7f5990070a80 2023-11-26T07:11:40.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.968+0000 7f4042ba0700 1 -- 172.21.15.2:0/2980148023 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f403c075300 con 0x7f403c0ae520 2023-11-26T07:11:40.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.966+0000 7fb1af1d5700 1 -- 172.21.15.2:0/3493532557 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1a81f6400 con 0x7fb1a80722c0 2023-11-26T07:11:40.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.966+0000 7fb1af1d5700 1 -- 172.21.15.2:0/3493532557 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1a81e4fc0 con 0x7fb1a80722c0 2023-11-26T07:11:40.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.973+0000 7f40327fc700 1 -- 172.21.15.2:0/2980148023 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4034019070 con 0x7f403c0ae520 2023-11-26T07:11:40.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.973+0000 7f40327fc700 1 --2- 172.21.15.2:0/2980148023 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f402006af50 0x7f402006d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.973+0000 7f40327fc700 1 -- 172.21.15.2:0/2980148023 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f403408a390 con 0x7f403c0ae520 2023-11-26T07:11:40.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.977+0000 7f4041b9e700 1 --2- 172.21.15.2:0/2980148023 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f402006af50 0x7f402006d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.968+0000 7fb1af1d5700 1 -- 172.21.15.2:0/3493532557 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb18c0052e0 con 0x7fb1a80722c0 2023-11-26T07:11:40.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.969+0000 7fb1a57fa700 1 -- 172.21.15.2:0/3493532557 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb1a0003b80 con 0x7fb1a80722c0 2023-11-26T07:11:40.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.969+0000 7fb1a57fa700 1 --2- 172.21.15.2:0/3493532557 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb18806af20 0x7fb18806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:40.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.969+0000 7fb1a57fa700 1 -- 172.21.15.2:0/3493532557 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb1a0021070 con 0x7fb1a80722c0 2023-11-26T07:11:40.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.969+0000 7fb1a7fff700 1 --2- 172.21.15.2:0/3493532557 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb18806af20 0x7fb18806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:40.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.970+0000 7fb1a7fff700 1 --2- 172.21.15.2:0/3493532557 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb18806af20 0x7fb18806d3e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb1a815a2a0 tx=0x7fb190007e70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.978+0000 7f4041b9e700 1 --2- 172.21.15.2:0/2980148023 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f402006af50 0x7f402006d410 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f403c0d0d20 tx=0x7f402c006c60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:40.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.978+0000 7fb1a57fa700 1 -- 172.21.15.2:0/3493532557 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb1a0056020 con 0x7fb1a80722c0 2023-11-26T07:11:40.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:40.979+0000 7f40327fc700 1 -- 172.21.15.2:0/2980148023 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4034059040 con 0x7f403c0ae520 2023-11-26T07:11:41.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.016+0000 7f8a64e9b700 1 Processor -- start 2023-11-26T07:11:41.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.017+0000 7f8a64e9b700 1 -- start start 2023-11-26T07:11:41.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.018+0000 7f8a64e9b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8a6015e600 0x7f8a600ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:41.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.018+0000 7f8a64e9b700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a600ce000 con 0x7f8a60071390 2023-11-26T07:11:41.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.018+0000 7f8a64e9b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a6015ea10 con 0x7f8a6015db10 2023-11-26T07:11:41.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.018+0000 7f8a64e9b700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a600ce2c0 con 0x7f8a6015e600 2023-11-26T07:11:41.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.019+0000 7f8a5ed9d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8a6015e600 0x7f8a600ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:41.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.019+0000 7f8a5e59c700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f8a6015db10 0x7f8a6015def0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.2:37762/0 (socket says 172.21.15.2:37762) 2023-11-26T07:11:41.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.019+0000 7f8a5e59c700 1 -- 172.21.15.2:0/3507034127 learned_addr learned my addr 172.21.15.2:0/3507034127 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:11:41.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.019+0000 7f8a5ed9d700 1 -- 172.21.15.2:0/3507034127 >> v1:172.21.15.192:6789/0 conn(0x7f8a6015db10 legacy=0x7f8a6015def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:41.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.019+0000 7f8a5ed9d700 1 -- 172.21.15.2:0/3507034127 >> v1:172.21.15.2:6789/0 conn(0x7f8a60071390 legacy=0x7f8a600ca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:41.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.019+0000 7f8a5ed9d700 1 -- 172.21.15.2:0/3507034127 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a600ce5a0 con 0x7f8a6015e600 2023-11-26T07:11:41.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.020+0000 7f8a5ed9d700 1 --2- 172.21.15.2:0/3507034127 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a6015e600 0x7f8a600ca9d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8a5800c2e0 tx=0x7f8a5800c5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7702fea9ef305d76 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:41.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.020+0000 7f8a5d59a700 1 -- 172.21.15.2:0/3507034127 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a58007ce0 con 0x7f8a6015e600 2023-11-26T07:11:41.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.020+0000 7f8a5d59a700 1 -- 172.21.15.2:0/3507034127 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a58007e40 con 0x7f8a6015e600 2023-11-26T07:11:41.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.020+0000 7f8a5d59a700 1 -- 172.21.15.2:0/3507034127 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a58003c20 con 0x7f8a6015e600 2023-11-26T07:11:41.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.021+0000 7f8a64e9b700 1 -- 172.21.15.2:0/3507034127 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a6015e600 msgr2=0x7f8a600ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:41.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.021+0000 7f8a64e9b700 1 --2- 172.21.15.2:0/3507034127 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a6015e600 0x7f8a600ca9d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8a5800c2e0 tx=0x7f8a5800c5f0 comp rx=0 tx=0).stop 2023-11-26T07:11:41.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.022+0000 7f8a64e9b700 1 -- 172.21.15.2:0/3507034127 shutdown_connections 2023-11-26T07:11:41.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.022+0000 7f8a64e9b700 1 --2- 172.21.15.2:0/3507034127 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a6015e600 0x7f8a600ca9d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:41.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.022+0000 7f8a64e9b700 1 -- 172.21.15.2:0/3507034127 >> 172.21.15.2:0/3507034127 conn(0x7f8a600cf980 msgr2=0x7f8a600cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:41.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.022+0000 7f8a64e9b700 1 -- 172.21.15.2:0/3507034127 shutdown_connections 2023-11-26T07:11:41.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.022+0000 7f8a64e9b700 1 -- 172.21.15.2:0/3507034127 wait complete. 2023-11-26T07:11:41.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.024+0000 7f8a64e9b700 1 Processor -- start 2023-11-26T07:11:41.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.024+0000 7f8a64e9b700 1 -- start start 2023-11-26T07:11:41.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.025+0000 7f8a64e9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a60071390 0x7f8a60140d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:41.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.025+0000 7f8a64e9b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a6015db10 0x7f8a60159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:41.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.025+0000 7f8a64e9b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a6015e600 0x7f8a601597b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:41.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.025+0000 7f8a64e9b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a60141280 con 0x7f8a60071390 2023-11-26T07:11:41.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.025+0000 7f8a64e9b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a600b5880 con 0x7f8a6015db10 2023-11-26T07:11:41.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.025+0000 7f8a64e9b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a600b3d60 con 0x7f8a6015e600 2023-11-26T07:11:41.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.026+0000 7f8a5dd9b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a6015db10 0x7f8a60159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:41.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.026+0000 7f8a5ed9d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a6015e600 0x7f8a601597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:41.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.026+0000 7f8a5dd9b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a6015db10 0x7f8a60159270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.2:47770/0 (socket says 172.21.15.2:47770) 2023-11-26T07:11:41.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.026+0000 7f8a5dd9b700 1 -- 172.21.15.2:0/839938671 learned_addr learned my addr 172.21.15.2:0/839938671 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:41.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.026+0000 7f8a5e59c700 1 --2- 172.21.15.2:0/839938671 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a60071390 0x7f8a60140d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:41.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.027+0000 7f8a5e59c700 1 -- 172.21.15.2:0/839938671 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a6015e600 msgr2=0x7f8a601597b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:41.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.027+0000 7f8a5e59c700 1 --2- 172.21.15.2:0/839938671 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a6015e600 0x7f8a601597b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:41.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.027+0000 7f8a5e59c700 1 -- 172.21.15.2:0/839938671 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a6015db10 msgr2=0x7f8a60159270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:41.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.027+0000 7f8a5e59c700 1 --2- 172.21.15.2:0/839938671 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a6015db10 0x7f8a60159270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:41.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.027+0000 7f8a5e59c700 1 -- 172.21.15.2:0/839938671 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a5800c050 con 0x7f8a60071390 2023-11-26T07:11:41.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.027+0000 7f8a5e59c700 1 --2- 172.21.15.2:0/839938671 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a60071390 0x7f8a60140d40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8a5400c780 tx=0x7f8a5400ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:41.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.029+0000 7f5fc5b87700 1 Processor -- start 2023-11-26T07:11:41.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.030+0000 7f8a4effd700 1 -- 172.21.15.2:0/839938671 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a54004c80 con 0x7f8a60071390 2023-11-26T07:11:41.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.030+0000 7f8a4effd700 1 -- 172.21.15.2:0/839938671 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a54004de0 con 0x7f8a60071390 2023-11-26T07:11:41.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.030+0000 7f8a4effd700 1 -- 172.21.15.2:0/839938671 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a540072f0 con 0x7f8a60071390 2023-11-26T07:11:41.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.030+0000 7f8a64e9b700 1 -- 172.21.15.2:0/839938671 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a600b4040 con 0x7f8a60071390 2023-11-26T07:11:41.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.030+0000 7f8a64e9b700 1 -- 172.21.15.2:0/839938671 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a60200ff0 con 0x7f8a60071390 2023-11-26T07:11:41.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.030+0000 7f5fc5b87700 1 -- start start 2023-11-26T07:11:41.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.032+0000 7f5fc5b87700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fc0071390 0x7f5fc015e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:41.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.032+0000 7f5fc5b87700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5fc00ca2c0 0x7f5fc00ca750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:41.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.032+0000 7f5fc5b87700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fc00ce000 con 0x7f5fc015db10 2023-11-26T07:11:41.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.032+0000 7f5fc5b87700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fc00ce2c0 con 0x7f5fc00ca2c0 2023-11-26T07:11:41.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.032+0000 7f5fc5b87700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc00ce5a0 con 0x7f5fc0071390 2023-11-26T07:11:41.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.032+0000 7f5fbf7fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f5fc015db10 0x7f5fc015def0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58636/0 (socket says 172.21.15.2:58636) 2023-11-26T07:11:41.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.032+0000 7f5fbf7fe700 1 -- 172.21.15.2:0/159342204 learned_addr learned my addr 172.21.15.2:0/159342204 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:11:41.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.033+0000 7f5fbeffd700 1 --2- 172.21.15.2:0/159342204 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fc0071390 0x7f5fc015e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:41.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.033+0000 7f5fbffff700 1 --2- 172.21.15.2:0/159342204 >> v2:172.21.15.2:3300/0 conn(0x7f5fc00ca2c0 0x7f5fc00ca750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:41.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.033+0000 7f5fbe7fc700 1 -- 172.21.15.2:0/159342204 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2424576905 0 0) 0x7f5fc00ce000 con 0x7f5fc015db10 2023-11-26T07:11:41.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.033+0000 7f5fbe7fc700 1 -- 172.21.15.2:0/159342204 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fa80057c0 con 0x7f5fc015db10 2023-11-26T07:11:41.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.033+0000 7f5fbffff700 1 -- 172.21.15.2:0/159342204 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fc0071390 msgr2=0x7f5fc015e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:41.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.033+0000 7f5fbffff700 1 --2- 172.21.15.2:0/159342204 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fc0071390 0x7f5fc015e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:41.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.033+0000 7f5fbffff700 1 -- 172.21.15.2:0/159342204 >> v1:172.21.15.2:6789/0 conn(0x7f5fc015db10 legacy=0x7f5fc015def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:41.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.033+0000 7f5fbffff700 1 -- 172.21.15.2:0/159342204 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc00ce880 con 0x7f5fc00ca2c0 2023-11-26T07:11:41.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.034+0000 7f5fbffff700 1 --2- 172.21.15.2:0/159342204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fc00ca2c0 0x7f5fc00ca750 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5fb800aea0 tx=0x7f5fb800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bed55a45d6e0bb2c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:41.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.034+0000 7f5fbe7fc700 1 -- 172.21.15.2:0/159342204 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb800a2d0 con 0x7f5fc00ca2c0 2023-11-26T07:11:41.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.034+0000 7f5fbe7fc700 1 -- 172.21.15.2:0/159342204 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb800c910 con 0x7f5fc00ca2c0 2023-11-26T07:11:41.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.034+0000 7f5fbe7fc700 1 -- 172.21.15.2:0/159342204 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb800ccc0 con 0x7f5fc00ca2c0 2023-11-26T07:11:41.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.035+0000 7f5fc5b87700 1 -- 172.21.15.2:0/159342204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fc00ca2c0 msgr2=0x7f5fc00ca750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:41.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.035+0000 7f5fc5b87700 1 --2- 172.21.15.2:0/159342204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fc00ca2c0 0x7f5fc00ca750 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5fb800aea0 tx=0x7f5fb800c330 comp rx=0 tx=0).stop 2023-11-26T07:11:41.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.035+0000 7f8a4effd700 1 -- 172.21.15.2:0/839938671 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8a54007450 con 0x7f8a60071390 2023-11-26T07:11:41.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.035+0000 7f8a4effd700 1 --2- 172.21.15.2:0/839938671 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8a4006afa0 0x7f8a4006d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:41.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.035+0000 7f8a4effd700 1 -- 172.21.15.2:0/839938671 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a540892c0 con 0x7f8a60071390 2023-11-26T07:11:41.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.036+0000 7f8a64e9b700 1 -- 172.21.15.2:0/839938671 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a440052e0 con 0x7f8a60071390 2023-11-26T07:11:41.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.036+0000 7f8a5dd9b700 1 --2- 172.21.15.2:0/839938671 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8a4006afa0 0x7f8a4006d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:41.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.037+0000 7f8a5dd9b700 1 --2- 172.21.15.2:0/839938671 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8a4006afa0 0x7f8a4006d460 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8a600cd8e0 tx=0x7f8a50009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:41.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.046+0000 7f5fc5b87700 1 -- 172.21.15.2:0/159342204 shutdown_connections 2023-11-26T07:11:41.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.046+0000 7f5fc5b87700 1 --2- 172.21.15.2:0/159342204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fc00ca2c0 0x7f5fc00ca750 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:41.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.046+0000 7f5fc5b87700 1 --2- 172.21.15.2:0/159342204 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fc0071390 0x7f5fc015e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:41.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.046+0000 7f5fc5b87700 1 -- 172.21.15.2:0/159342204 >> 172.21.15.2:0/159342204 conn(0x7f5fc00cf980 msgr2=0x7f5fc00cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:41.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.046+0000 7f8a4effd700 1 -- 172.21.15.2:0/839938671 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8a54054350 con 0x7f8a60071390 2023-11-26T07:11:41.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.046+0000 7f5fc5b87700 1 -- 172.21.15.2:0/159342204 shutdown_connections 2023-11-26T07:11:41.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.046+0000 7f5fc5b87700 1 -- 172.21.15.2:0/159342204 wait complete. 2023-11-26T07:11:41.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.048+0000 7f5fc5b87700 1 Processor -- start 2023-11-26T07:11:41.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.048+0000 7f5fc5b87700 1 -- start start 2023-11-26T07:11:41.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.050+0000 7f5fc5b87700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fc0071390 0x7f5fc013d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:41.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.050+0000 7f5fc5b87700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fc00ca2c0 0x7f5fc00b47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:41.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.050+0000 7f5fc5b87700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fc015db10 0x7f5fc0159590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:41.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.050+0000 7f5fc5b87700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc013dba0 con 0x7f5fc0071390 2023-11-26T07:11:41.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.050+0000 7f5fc5b87700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc00b36a0 con 0x7f5fc00ca2c0 2023-11-26T07:11:41.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.050+0000 7f5fc5b87700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc00b28e0 con 0x7f5fc015db10 2023-11-26T07:11:41.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.050+0000 7f5fbf7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fc0071390 0x7f5fc013d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:41.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.051+0000 7f5fbf7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fc0071390 0x7f5fc013d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39198/0 (socket says 172.21.15.2:39198) 2023-11-26T07:11:41.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.051+0000 7f5fbf7fe700 1 -- 172.21.15.2:0/3515605529 learned_addr learned my addr 172.21.15.2:0/3515605529 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:41.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.051+0000 7f5fbffff700 1 --2- 172.21.15.2:0/3515605529 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fc015db10 0x7f5fc0159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:41.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.051+0000 7f5fbeffd700 1 --2- 172.21.15.2:0/3515605529 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fc00ca2c0 0x7f5fc00b47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:41.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.051+0000 7f5fbf7fe700 1 -- 172.21.15.2:0/3515605529 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fc015db10 msgr2=0x7f5fc0159590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:41.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.051+0000 7f5fbf7fe700 1 --2- 172.21.15.2:0/3515605529 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fc015db10 0x7f5fc0159590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:41.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.051+0000 7f5fbf7fe700 1 -- 172.21.15.2:0/3515605529 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fc00ca2c0 msgr2=0x7f5fc00b47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:41.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.051+0000 7f5fbf7fe700 1 --2- 172.21.15.2:0/3515605529 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fc00ca2c0 0x7f5fc00b47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:41.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.051+0000 7f5fbf7fe700 1 -- 172.21.15.2:0/3515605529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb800ab80 con 0x7f5fc0071390 2023-11-26T07:11:41.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.052+0000 7f5fbf7fe700 1 --2- 172.21.15.2:0/3515605529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fc0071390 0x7f5fc013d5c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5fb400d940 tx=0x7f5fb400dc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:41.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.059+0000 7f5faffff700 1 -- 172.21.15.2:0/3515605529 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb4008980 con 0x7f5fc0071390 2023-11-26T07:11:41.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.059+0000 7f5faffff700 1 -- 172.21.15.2:0/3515605529 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb4008ae0 con 0x7f5fc0071390 2023-11-26T07:11:41.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.059+0000 7f5faffff700 1 -- 172.21.15.2:0/3515605529 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb4008e90 con 0x7f5fc0071390 2023-11-26T07:11:41.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.059+0000 7f5fc5b87700 1 -- 172.21.15.2:0/3515605529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fc00b2bc0 con 0x7f5fc0071390 2023-11-26T07:11:41.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.059+0000 7f5fc5b87700 1 -- 172.21.15.2:0/3515605529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fc00b3180 con 0x7f5fc0071390 2023-11-26T07:11:41.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.061+0000 7f5faffff700 1 -- 172.21.15.2:0/3515605529 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5fb400a030 con 0x7f5fc0071390 2023-11-26T07:11:41.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.062+0000 7f5faffff700 1 --2- 172.21.15.2:0/3515605529 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5fa806b3f0 0x7f5fa806d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:41.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.062+0000 7f5faffff700 1 -- 172.21.15.2:0/3515605529 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5fb40898a0 con 0x7f5fc0071390 2023-11-26T07:11:41.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.064+0000 7f5fbeffd700 1 --2- 172.21.15.2:0/3515605529 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5fa806b3f0 0x7f5fa806d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:41.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.064+0000 7f5fbeffd700 1 --2- 172.21.15.2:0/3515605529 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5fa806b3f0 0x7f5fa806d8b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5fc01423a0 tx=0x7f5fb0009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:41.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.076+0000 7f5fc5b87700 1 -- 172.21.15.2:0/3515605529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f9c0052e0 con 0x7f5fc0071390 2023-11-26T07:11:41.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.086+0000 7f5faffff700 1 -- 172.21.15.2:0/3515605529 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5fb40549b0 con 0x7f5fc0071390 2023-11-26T07:11:41.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.320+0000 7f12a95b2700 1 -- 172.21.15.2:0/2247613409 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1284005590 con 0x7f12a4071390 2023-11-26T07:11:41.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.322+0000 7f128b7fe700 1 -- 172.21.15.2:0/2247613409 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f129c0596d0 con 0x7f12a4071390 2023-11-26T07:11:41.327 INFO:teuthology.orchestra.run.smithi002.stdout:55834574854 2023-11-26T07:11:41.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.325+0000 7f12a95b2700 1 -- 172.21.15.2:0/2247613409 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f129006afa0 msgr2=0x7f129006d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:41.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.325+0000 7f12a95b2700 1 --2- 172.21.15.2:0/2247613409 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f129006afa0 0x7f129006d460 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f12a413f560 tx=0x7f1294008040 comp rx=0 tx=0).stop 2023-11-26T07:11:41.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.325+0000 7f12a95b2700 1 -- 172.21.15.2:0/2247613409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12a4071390 msgr2=0x7f12a4156ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:41.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.325+0000 7f12a95b2700 1 --2- 172.21.15.2:0/2247613409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12a4071390 0x7f12a4156ec0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f129c018040 tx=0x7f129c004ad0 comp rx=0 tx=0).stop 2023-11-26T07:11:41.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.326+0000 7f12a95b2700 1 -- 172.21.15.2:0/2247613409 shutdown_connections 2023-11-26T07:11:41.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.326+0000 7f12a95b2700 1 --2- 172.21.15.2:0/2247613409 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f129006afa0 0x7f129006d460 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:41.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.326+0000 7f12a95b2700 1 --2- 172.21.15.2:0/2247613409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12a415db10 0x7f12a4138620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:41.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.326+0000 7f12a95b2700 1 --2- 172.21.15.2:0/2247613409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12a4071390 0x7f12a4156ec0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:41.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.326+0000 7f12a95b2700 1 --2- 172.21.15.2:0/2247613409 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12a415a520 0x7f12a40b2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:41.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.326+0000 7f12a95b2700 1 -- 172.21.15.2:0/2247613409 >> 172.21.15.2:0/2247613409 conn(0x7f12a40cf980 msgr2=0x7f12a406cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:41.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.326+0000 7f12a95b2700 1 -- 172.21.15.2:0/2247613409 shutdown_connections 2023-11-26T07:11:41.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.326+0000 7f12a95b2700 1 -- 172.21.15.2:0/2247613409 wait complete. 2023-11-26T07:11:41.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.343+0000 7f19690d1700 1 -- 172.21.15.2:0/3267740717 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1964067f60 con 0x7f1964071390 2023-11-26T07:11:41.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.343+0000 7f194b7fe700 1 -- 172.21.15.2:0/3267740717 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f195c05e7c0 con 0x7f1964071390 2023-11-26T07:11:41.349 INFO:teuthology.orchestra.run.smithi002.stdout:55834574853 2023-11-26T07:11:41.355 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2023-11-26T07:11:41.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.352+0000 7f19690d1700 1 -- 172.21.15.2:0/3267740717 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f194c06b080 msgr2=0x7f194c06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:41.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.352+0000 7f19690d1700 1 --2- 172.21.15.2:0/3267740717 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f194c06b080 0x7f194c06d540 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f19641f3670 tx=0x7f1954008040 comp rx=0 tx=0).stop 2023-11-26T07:11:41.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.352+0000 7f19690d1700 1 -- 172.21.15.2:0/3267740717 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1964071390 msgr2=0x7f1964141010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:41.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.352+0000 7f19690d1700 1 --2- 172.21.15.2:0/3267740717 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1964071390 0x7f1964141010 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f195c016000 tx=0x7f195c004ad0 comp rx=0 tx=0).stop 2023-11-26T07:11:41.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.352+0000 7f19690d1700 1 -- 172.21.15.2:0/3267740717 shutdown_connections 2023-11-26T07:11:41.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.352+0000 7f19690d1700 1 --2- 172.21.15.2:0/3267740717 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f194c06b080 0x7f194c06d540 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f19641f3670 tx=0x7f1954008040 comp rx=0 tx=0).stop 2023-11-26T07:11:41.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.352+0000 7f19690d1700 1 --2- 172.21.15.2:0/3267740717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f196415db10 0x7f1964139690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:41.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.352+0000 7f19690d1700 1 --2- 172.21.15.2:0/3267740717 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1964071390 0x7f1964141010 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:41.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.352+0000 7f19690d1700 1 --2- 172.21.15.2:0/3267740717 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19640ca2c0 0x7f1964159640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:41.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.352+0000 7f19690d1700 1 -- 172.21.15.2:0/3267740717 >> 172.21.15.2:0/3267740717 conn(0x7f19640cf980 msgr2=0x7f196406dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:41.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.352+0000 7f19690d1700 1 -- 172.21.15.2:0/3267740717 shutdown_connections 2023-11-26T07:11:41.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.352+0000 7f19690d1700 1 -- 172.21.15.2:0/3267740717 wait complete. 2023-11-26T07:11:41.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.370+0000 7f3a50008700 1 -- 172.21.15.2:0/3670312369 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3a480c5400 con 0x7f3a48145700 2023-11-26T07:11:41.374 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2023-11-26T07:11:41.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.371+0000 7f3a3e7fc700 1 -- 172.21.15.2:0/3670312369 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3a44015070 con 0x7f3a48145700 2023-11-26T07:11:41.374 INFO:teuthology.orchestra.run.smithi002.stdout:55834574853 2023-11-26T07:11:41.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.374+0000 7f3a50008700 1 -- 172.21.15.2:0/3670312369 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3a2c06aed0 msgr2=0x7f3a2c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:41.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.374+0000 7f3a50008700 1 --2- 172.21.15.2:0/3670312369 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3a2c06aed0 0x7f3a2c06d390 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3a40002230 tx=0x7f3a40001b70 comp rx=0 tx=0).stop 2023-11-26T07:11:41.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.374+0000 7f3a50008700 1 -- 172.21.15.2:0/3670312369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a48145700 msgr2=0x7f3a480c5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:41.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.374+0000 7f3a50008700 1 --2- 172.21.15.2:0/3670312369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a48145700 0x7f3a480c5720 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3a4400b3c0 tx=0x7f3a4400b6d0 comp rx=0 tx=0).stop 2023-11-26T07:11:41.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.375+0000 7f3a50008700 1 -- 172.21.15.2:0/3670312369 shutdown_connections 2023-11-26T07:11:41.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.375+0000 7f3a50008700 1 --2- 172.21.15.2:0/3670312369 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3a2c06aed0 0x7f3a2c06d390 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:41.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.375+0000 7f3a50008700 1 --2- 172.21.15.2:0/3670312369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a48145700 0x7f3a480c5720 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:41.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.375+0000 7f3a50008700 1 --2- 172.21.15.2:0/3670312369 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a4806f0c0 0x7f3a480b4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:41.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.375+0000 7f3a50008700 1 --2- 172.21.15.2:0/3670312369 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3a48071390 0x7f3a480c6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:41.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.375+0000 7f3a50008700 1 -- 172.21.15.2:0/3670312369 >> 172.21.15.2:0/3670312369 conn(0x7f3a480cf980 msgr2=0x7f3a48132ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:41.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.376+0000 7f3a50008700 1 -- 172.21.15.2:0/3670312369 shutdown_connections 2023-11-26T07:11:41.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.377+0000 7fb1af1d5700 1 -- 172.21.15.2:0/3493532557 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb18c005860 con 0x7fb1a80722c0 2023-11-26T07:11:41.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.377+0000 7fb1a57fa700 1 -- 172.21.15.2:0/3493532557 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb1a0006cc0 con 0x7fb1a80722c0 2023-11-26T07:11:41.380 INFO:teuthology.orchestra.run.smithi002.stdout:55834574853 2023-11-26T07:11:41.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.379+0000 7fb1af1d5700 1 -- 172.21.15.2:0/3493532557 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb18806af20 msgr2=0x7fb18806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:41.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.379+0000 7fb1af1d5700 1 --2- 172.21.15.2:0/3493532557 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb18806af20 0x7fb18806d3e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb1a815a2a0 tx=0x7fb190007e70 comp rx=0 tx=0).stop 2023-11-26T07:11:41.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.379+0000 7fb1af1d5700 1 -- 172.21.15.2:0/3493532557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1a80722c0 msgr2=0x7fb1a813f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:41.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.379+0000 7fb1af1d5700 1 --2- 172.21.15.2:0/3493532557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1a80722c0 0x7fb1a813f3b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb1a00090b0 tx=0x7fb1a0004750 comp rx=0 tx=0).stop 2023-11-26T07:11:41.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.379+0000 7fb1af1d5700 1 -- 172.21.15.2:0/3493532557 shutdown_connections 2023-11-26T07:11:41.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.379+0000 7fb1af1d5700 1 --2- 172.21.15.2:0/3493532557 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb18806af20 0x7fb18806d3e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:41.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.379+0000 7fb1af1d5700 1 --2- 172.21.15.2:0/3493532557 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1a81440f0 0x7fb1a8142100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:41.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.379+0000 7fb1af1d5700 1 --2- 172.21.15.2:0/3493532557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1a80722c0 0x7fb1a813f3b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:41.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.379+0000 7fb1af1d5700 1 --2- 172.21.15.2:0/3493532557 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1a8143ae0 0x7fb1a81f6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:41.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.379+0000 7fb1af1d5700 1 -- 172.21.15.2:0/3493532557 >> 172.21.15.2:0/3493532557 conn(0x7fb1a80b2740 msgr2=0x7fb1a80cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:41.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.379+0000 7fb1af1d5700 1 -- 172.21.15.2:0/3493532557 shutdown_connections 2023-11-26T07:11:41.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.379+0000 7fb1af1d5700 1 -- 172.21.15.2:0/3493532557 wait complete. 2023-11-26T07:11:41.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.380+0000 7f3a50008700 1 -- 172.21.15.2:0/3670312369 wait complete. 2023-11-26T07:11:41.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.380+0000 7f4042ba0700 1 -- 172.21.15.2:0/2980148023 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f403c0cf680 con 0x7f403c0ae520 2023-11-26T07:11:41.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.381+0000 7f40327fc700 1 -- 172.21.15.2:0/2980148023 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4034020020 con 0x7f403c0ae520 2023-11-26T07:11:41.384 INFO:teuthology.orchestra.run.smithi002.stdout:55834574852 2023-11-26T07:11:41.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.385+0000 7f4042ba0700 1 -- 172.21.15.2:0/2980148023 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f402006af50 msgr2=0x7f402006d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:41.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.385+0000 7f4042ba0700 1 --2- 172.21.15.2:0/2980148023 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f402006af50 0x7f402006d410 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f403c0d0d20 tx=0x7f402c006c60 comp rx=0 tx=0).stop 2023-11-26T07:11:41.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.385+0000 7f4042ba0700 1 -- 172.21.15.2:0/2980148023 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f403c0ae520 msgr2=0x7f403c14ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:41.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.385+0000 7f4042ba0700 1 --2- 172.21.15.2:0/2980148023 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f403c0ae520 0x7f403c14ed00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4034014000 tx=0x7f4034004ad0 comp rx=0 tx=0).stop 2023-11-26T07:11:41.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.385+0000 7f4042ba0700 1 -- 172.21.15.2:0/2980148023 shutdown_connections 2023-11-26T07:11:41.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.385+0000 7f4042ba0700 1 --2- 172.21.15.2:0/2980148023 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f402006af50 0x7f402006d410 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f403c0d0d20 tx=0x7f402c006c60 comp rx=0 tx=0).stop 2023-11-26T07:11:41.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.385+0000 7f4042ba0700 1 --2- 172.21.15.2:0/2980148023 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f403c0ae520 0x7f403c14ed00 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:41.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.385+0000 7f4042ba0700 1 --2- 172.21.15.2:0/2980148023 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f403c0b4c80 0x7f403c15bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:41.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.385+0000 7f4042ba0700 1 --2- 172.21.15.2:0/2980148023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f403c15c9a0 0x7f403c0b0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:41.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.385+0000 7f4042ba0700 1 -- 172.21.15.2:0/2980148023 >> 172.21.15.2:0/2980148023 conn(0x7f403c0b1a40 msgr2=0x7f403c071a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:41.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.387+0000 7f4042ba0700 1 -- 172.21.15.2:0/2980148023 shutdown_connections 2023-11-26T07:11:41.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.389+0000 7f4042ba0700 1 -- 172.21.15.2:0/2980148023 wait complete. 2023-11-26T07:11:41.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.390+0000 7f5996cd1700 1 -- 172.21.15.2:0/731378742 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f59900cbf80 con 0x7f5990070a80 2023-11-26T07:11:41.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.390+0000 7f598d7fa700 1 -- 172.21.15.2:0/731378742 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5984015070 con 0x7f5990070a80 2023-11-26T07:11:41.396 INFO:teuthology.orchestra.run.smithi002.stdout:55834574854 2023-11-26T07:11:41.399 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2023-11-26T07:11:41.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.396+0000 7f5996cd1700 1 -- 172.21.15.2:0/731378742 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f597406aed0 msgr2=0x7f597406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:41.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.396+0000 7f5996cd1700 1 --2- 172.21.15.2:0/731378742 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f597406aed0 0x7f597406d390 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5990135060 tx=0x7f597c009210 comp rx=0 tx=0).stop 2023-11-26T07:11:41.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.396+0000 7f5996cd1700 1 -- 172.21.15.2:0/731378742 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5990070a80 msgr2=0x7f599006d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:41.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.397+0000 7f5996cd1700 1 --2- 172.21.15.2:0/731378742 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5990070a80 0x7f599006d050 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f59840090b0 tx=0x7f5984004750 comp rx=0 tx=0).stop 2023-11-26T07:11:41.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.398+0000 7f5996cd1700 1 -- 172.21.15.2:0/731378742 shutdown_connections 2023-11-26T07:11:41.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.398+0000 7f5996cd1700 1 --2- 172.21.15.2:0/731378742 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f597406aed0 0x7f597406d390 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:41.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.398+0000 7f5996cd1700 1 --2- 172.21.15.2:0/731378742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5990166430 0x7f5990133690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:41.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.398+0000 7f5996cd1700 1 --2- 172.21.15.2:0/731378742 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5990070a80 0x7f599006d050 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:41.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.398+0000 7f5996cd1700 1 --2- 172.21.15.2:0/731378742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5990145870 0x7f5990144aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:41.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.398+0000 7f5996cd1700 1 -- 172.21.15.2:0/731378742 >> 172.21.15.2:0/731378742 conn(0x7f59900cf980 msgr2=0x7f59900cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:41.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.398+0000 7f5996cd1700 1 -- 172.21.15.2:0/731378742 shutdown_connections 2023-11-26T07:11:41.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.398+0000 7f5996cd1700 1 -- 172.21.15.2:0/731378742 wait complete. 2023-11-26T07:11:41.409 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2023-11-26T07:11:41.409 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2023-11-26T07:11:41.415 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2023-11-26T07:11:41.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.432+0000 7f8a64e9b700 1 -- 172.21.15.2:0/839938671 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f8a44005590 con 0x7f8a60071390 2023-11-26T07:11:41.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.432+0000 7f8a4effd700 1 -- 172.21.15.2:0/839938671 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8a54057970 con 0x7f8a60071390 2023-11-26T07:11:41.435 INFO:teuthology.orchestra.run.smithi002.stdout:55834574852 2023-11-26T07:11:41.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.434+0000 7f8a64e9b700 1 -- 172.21.15.2:0/839938671 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8a4006afa0 msgr2=0x7f8a4006d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:41.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.434+0000 7f8a64e9b700 1 --2- 172.21.15.2:0/839938671 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8a4006afa0 0x7f8a4006d460 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8a600cd8e0 tx=0x7f8a50009040 comp rx=0 tx=0).stop 2023-11-26T07:11:41.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.434+0000 7f8a64e9b700 1 -- 172.21.15.2:0/839938671 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a60071390 msgr2=0x7f8a60140d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:41.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.434+0000 7f8a64e9b700 1 --2- 172.21.15.2:0/839938671 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a60071390 0x7f8a60140d40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8a5400c780 tx=0x7f8a5400ca90 comp rx=0 tx=0).stop 2023-11-26T07:11:41.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.434+0000 7f8a64e9b700 1 -- 172.21.15.2:0/839938671 shutdown_connections 2023-11-26T07:11:41.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.434+0000 7f8a64e9b700 1 --2- 172.21.15.2:0/839938671 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8a4006afa0 0x7f8a4006d460 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:41.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.434+0000 7f8a64e9b700 1 --2- 172.21.15.2:0/839938671 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a6015e600 0x7f8a601597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:41.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.434+0000 7f8a64e9b700 1 --2- 172.21.15.2:0/839938671 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a60071390 0x7f8a60140d40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:41.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.434+0000 7f8a64e9b700 1 --2- 172.21.15.2:0/839938671 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a6015db10 0x7f8a60159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:41.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.434+0000 7f8a64e9b700 1 -- 172.21.15.2:0/839938671 >> 172.21.15.2:0/839938671 conn(0x7f8a600cf980 msgr2=0x7f8a600af5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:41.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.434+0000 7f8a64e9b700 1 -- 172.21.15.2:0/839938671 shutdown_connections 2023-11-26T07:11:41.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.434+0000 7f8a64e9b700 1 -- 172.21.15.2:0/839938671 wait complete. 2023-11-26T07:11:41.449 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2023-11-26T07:11:41.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.449+0000 7f5fc5b87700 1 -- 172.21.15.2:0/3515605529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f5f9c005860 con 0x7f5fc0071390 2023-11-26T07:11:41.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.450+0000 7f5faffff700 1 -- 172.21.15.2:0/3515605529 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5fb4057fd0 con 0x7f5fc0071390 2023-11-26T07:11:41.453 INFO:teuthology.orchestra.run.smithi002.stdout:55834574854 2023-11-26T07:11:41.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.452+0000 7f5fc5b87700 1 -- 172.21.15.2:0/3515605529 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5fa806b3f0 msgr2=0x7f5fa806d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:41.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.452+0000 7f5fc5b87700 1 --2- 172.21.15.2:0/3515605529 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5fa806b3f0 0x7f5fa806d8b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5fc01423a0 tx=0x7f5fb0009210 comp rx=0 tx=0).stop 2023-11-26T07:11:41.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.452+0000 7f5fc5b87700 1 -- 172.21.15.2:0/3515605529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fc0071390 msgr2=0x7f5fc013d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:41.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.452+0000 7f5fc5b87700 1 --2- 172.21.15.2:0/3515605529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fc0071390 0x7f5fc013d5c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5fb400d940 tx=0x7f5fb400dc50 comp rx=0 tx=0).stop 2023-11-26T07:11:41.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.452+0000 7f5fc5b87700 1 -- 172.21.15.2:0/3515605529 shutdown_connections 2023-11-26T07:11:41.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.452+0000 7f5fc5b87700 1 --2- 172.21.15.2:0/3515605529 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5fa806b3f0 0x7f5fa806d8b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:41.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.452+0000 7f5fc5b87700 1 --2- 172.21.15.2:0/3515605529 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fc015db10 0x7f5fc0159590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:41.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.452+0000 7f5fc5b87700 1 --2- 172.21.15.2:0/3515605529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fc0071390 0x7f5fc013d5c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:41.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.452+0000 7f5fc5b87700 1 --2- 172.21.15.2:0/3515605529 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fc00ca2c0 0x7f5fc00b47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:41.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.452+0000 7f5fc5b87700 1 -- 172.21.15.2:0/3515605529 >> 172.21.15.2:0/3515605529 conn(0x7f5fc00cf980 msgr2=0x7f5fc00cc390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:41.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.452+0000 7f5fc5b87700 1 -- 172.21.15.2:0/3515605529 shutdown_connections 2023-11-26T07:11:41.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:41.452+0000 7f5fc5b87700 1 -- 172.21.15.2:0/3515605529 wait complete. 2023-11-26T07:11:41.467 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2023-11-26T07:11:42.355 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-26T07:11:42.375 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-26T07:11:42.400 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-26T07:11:42.410 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-26T07:11:42.410 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-26T07:11:42.416 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-26T07:11:42.450 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-26T07:11:42.468 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-26T07:11:42.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.528+0000 7ff811d2b700 1 Processor -- start 2023-11-26T07:11:42.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.529+0000 7ff811d2b700 1 -- start start 2023-11-26T07:11:42.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.530+0000 7ff811d2b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff80c071390 0x7ff80c15a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.530+0000 7ff811d2b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff80c0d04a0 0x7ff80c15aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.530+0000 7ff811d2b700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff80c0ce000 con 0x7ff80c15afa0 2023-11-26T07:11:42.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.530+0000 7ff811d2b700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff80c15b430 con 0x7ff80c071390 2023-11-26T07:11:42.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.530+0000 7ff811d2b700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff80c0cb2d0 con 0x7ff80c0d04a0 2023-11-26T07:11:42.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.530+0000 7ff80affd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff80c0d04a0 0x7ff80c15aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:42.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.530+0000 7ff80affd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff80c0d04a0 0x7ff80c15aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.2:47794/0 (socket says 172.21.15.2:47794) 2023-11-26T07:11:42.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.530+0000 7ff80affd700 1 -- 172.21.15.2:0/1284326052 learned_addr learned my addr 172.21.15.2:0/1284326052 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:42.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.530+0000 7ff80bfff700 1 --1- 172.21.15.2:0/1284326052 >> v1:172.21.15.2:6789/0 conn(0x7ff80c15afa0 0x7ff80c15db10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58652/0 (socket says 172.21.15.2:58652) 2023-11-26T07:11:42.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.531+0000 7ff80affd700 1 -- 172.21.15.2:0/1284326052 >> v2:172.21.15.2:3300/0 conn(0x7ff80c071390 msgr2=0x7ff80c15a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:42.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.531+0000 7ff80affd700 1 --2- 172.21.15.2:0/1284326052 >> v2:172.21.15.2:3300/0 conn(0x7ff80c071390 0x7ff80c15a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.531+0000 7ff80affd700 1 -- 172.21.15.2:0/1284326052 >> v1:172.21.15.2:6789/0 conn(0x7ff80c15afa0 legacy=0x7ff80c15db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:42.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.531+0000 7ff80affd700 1 -- 172.21.15.2:0/1284326052 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff80c0ce2c0 con 0x7ff80c0d04a0 2023-11-26T07:11:42.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.531+0000 7ff80affd700 1 --2- 172.21.15.2:0/1284326052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff80c0d04a0 0x7ff80c15aa60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc0098f0 tx=0x7ff7fc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b68d31748521b19e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:42.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.531+0000 7ff80a7fc700 1 -- 172.21.15.2:0/1284326052 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc00b860 con 0x7ff80c0d04a0 2023-11-26T07:11:42.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.531+0000 7ff80a7fc700 1 -- 172.21.15.2:0/1284326052 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7fc00b9c0 con 0x7ff80c0d04a0 2023-11-26T07:11:42.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.531+0000 7ff80a7fc700 1 -- 172.21.15.2:0/1284326052 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc00bd50 con 0x7ff80c0d04a0 2023-11-26T07:11:42.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.532+0000 7ff811d2b700 1 -- 172.21.15.2:0/1284326052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff80c0d04a0 msgr2=0x7ff80c15aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:42.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.532+0000 7ff811d2b700 1 --2- 172.21.15.2:0/1284326052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff80c0d04a0 0x7ff80c15aa60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc0098f0 tx=0x7ff7fc009c00 comp rx=0 tx=0).stop 2023-11-26T07:11:42.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.533+0000 7ff811d2b700 1 -- 172.21.15.2:0/1284326052 shutdown_connections 2023-11-26T07:11:42.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.533+0000 7ff811d2b700 1 --2- 172.21.15.2:0/1284326052 >> v2:172.21.15.2:3300/0 conn(0x7ff80c071390 0x7ff80c15a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.533+0000 7ff811d2b700 1 --2- 172.21.15.2:0/1284326052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff80c0d04a0 0x7ff80c15aa60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.533+0000 7ff811d2b700 1 -- 172.21.15.2:0/1284326052 >> 172.21.15.2:0/1284326052 conn(0x7ff80c0cf980 msgr2=0x7ff80c0cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:42.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.533+0000 7ff811d2b700 1 -- 172.21.15.2:0/1284326052 shutdown_connections 2023-11-26T07:11:42.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.533+0000 7ff811d2b700 1 -- 172.21.15.2:0/1284326052 wait complete. 2023-11-26T07:11:42.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.535+0000 7ff811d2b700 1 Processor -- start 2023-11-26T07:11:42.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.535+0000 7ff811d2b700 1 -- start start 2023-11-26T07:11:42.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.536+0000 7ff811d2b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff80c071390 0x7ff80c0c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.536+0000 7ff811d2b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff80c0d04a0 0x7ff80c1585d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.536+0000 7ff811d2b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff80c15afa0 0x7ff80c158b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.536+0000 7ff811d2b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80c167e60 con 0x7ff80c071390 2023-11-26T07:11:42.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.536+0000 7ff811d2b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80c168070 con 0x7ff80c0d04a0 2023-11-26T07:11:42.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.536+0000 7ff811d2b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff80c168350 con 0x7ff80c15afa0 2023-11-26T07:11:42.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.537+0000 7ff80b7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff80c071390 0x7ff80c0c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:42.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.537+0000 7ff80b7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff80c071390 0x7ff80c0c93d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39212/0 (socket says 172.21.15.2:39212) 2023-11-26T07:11:42.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.537+0000 7ff80b7fe700 1 -- 172.21.15.2:0/3321960474 learned_addr learned my addr 172.21.15.2:0/3321960474 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:42.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.537+0000 7ff80bfff700 1 --2- 172.21.15.2:0/3321960474 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff80c15afa0 0x7ff80c158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:42.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.537+0000 7ff80b7fe700 1 -- 172.21.15.2:0/3321960474 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff80c15afa0 msgr2=0x7ff80c158b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:42.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.537+0000 7ff80b7fe700 1 --2- 172.21.15.2:0/3321960474 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff80c15afa0 0x7ff80c158b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.537+0000 7ff80b7fe700 1 -- 172.21.15.2:0/3321960474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff80c0d04a0 msgr2=0x7ff80c1585d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-26T07:11:42.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.537+0000 7ff80b7fe700 1 --2- 172.21.15.2:0/3321960474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff80c0d04a0 0x7ff80c1585d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.537+0000 7ff80b7fe700 1 -- 172.21.15.2:0/3321960474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7fc009550 con 0x7ff80c071390 2023-11-26T07:11:42.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.538+0000 7ff80b7fe700 1 --2- 172.21.15.2:0/3321960474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff80c071390 0x7ff80c0c93d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff80000b4a0 tx=0x7ff80000b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:42.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.538+0000 7ff7f3fff700 1 -- 172.21.15.2:0/3321960474 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff800011830 con 0x7ff80c071390 2023-11-26T07:11:42.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.538+0000 7ff7f3fff700 1 -- 172.21.15.2:0/3321960474 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff800011990 con 0x7ff80c071390 2023-11-26T07:11:42.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.538+0000 7ff7f3fff700 1 -- 172.21.15.2:0/3321960474 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff800011d40 con 0x7ff80c071390 2023-11-26T07:11:42.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.538+0000 7ff811d2b700 1 -- 172.21.15.2:0/3321960474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff80c168630 con 0x7ff80c071390 2023-11-26T07:11:42.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.538+0000 7ff811d2b700 1 -- 172.21.15.2:0/3321960474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff80c168bf0 con 0x7ff80c071390 2023-11-26T07:11:42.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.540+0000 7ff811d2b700 1 -- 172.21.15.2:0/3321960474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7f80052e0 con 0x7ff80c071390 2023-11-26T07:11:42.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.541+0000 7ff7f3fff700 1 -- 172.21.15.2:0/3321960474 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff80001a400 con 0x7ff80c071390 2023-11-26T07:11:42.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.541+0000 7ff7f3fff700 1 --2- 172.21.15.2:0/3321960474 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff7f406b010 0x7ff7f406d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.542+0000 7ff7f3fff700 1 -- 172.21.15.2:0/3321960474 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff800089ab0 con 0x7ff80c071390 2023-11-26T07:11:42.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.542+0000 7ff80affd700 1 --2- 172.21.15.2:0/3321960474 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff7f406b010 0x7ff7f406d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:42.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.542+0000 7ff80affd700 1 --2- 172.21.15.2:0/3321960474 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff7f406b010 0x7ff7f406d4d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff80c16c4a0 tx=0x7ff7fc008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:42.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.550+0000 7ff7f3fff700 1 -- 172.21.15.2:0/3321960474 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff800054bf0 con 0x7ff80c071390 2023-11-26T07:11:42.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.592+0000 7fb351050700 1 Processor -- start 2023-11-26T07:11:42.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.592+0000 7fb351050700 1 -- start start 2023-11-26T07:11:42.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.594+0000 7fb351050700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb34c166680 0x7fb34c070a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.594+0000 7fb351050700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb34c06d1f0 con 0x7fb34c14bf10 2023-11-26T07:11:42.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.594+0000 7fb351050700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb34c0cc080 con 0x7fb34c0cbb80 2023-11-26T07:11:42.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.594+0000 7fb351050700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb34c0cdf60 con 0x7fb34c166680 2023-11-26T07:11:42.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.594+0000 7fb34a59c700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fb34c0cbb80 0x7fb34c165f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.2:37798/0 (socket says 172.21.15.2:37798) 2023-11-26T07:11:42.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.594+0000 7fb34a59c700 1 -- 172.21.15.2:0/2918568416 learned_addr learned my addr 172.21.15.2:0/2918568416 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:11:42.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.594+0000 7fb34b59e700 1 --2- 172.21.15.2:0/2918568416 >> v2:172.21.15.192:3300/0 conn(0x7fb34c166680 0x7fb34c070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:42.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.595+0000 7fb34b59e700 1 -- 172.21.15.2:0/2918568416 >> v1:172.21.15.192:6789/0 conn(0x7fb34c0cbb80 legacy=0x7fb34c165f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:42.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.595+0000 7fb34b59e700 1 -- 172.21.15.2:0/2918568416 >> v1:172.21.15.2:6789/0 conn(0x7fb34c14bf10 legacy=0x7fb34c06cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:42.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.595+0000 7fb34b59e700 1 -- 172.21.15.2:0/2918568416 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb34c06e950 con 0x7fb34c166680 2023-11-26T07:11:42.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.596+0000 7fb34b59e700 1 --2- 172.21.15.2:0/2918568416 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb34c166680 0x7fb34c070a80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb344009d90 tx=0x7fb34400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f7ae90cfecb73e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:42.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.597+0000 7f2a19c05700 1 Processor -- start 2023-11-26T07:11:42.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.597+0000 7f2a19c05700 1 -- start start 2023-11-26T07:11:42.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.598+0000 7fb349d9b700 1 -- 172.21.15.2:0/2918568416 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34400e070 con 0x7fb34c166680 2023-11-26T07:11:42.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.598+0000 7fb349d9b700 1 -- 172.21.15.2:0/2918568416 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34400bad0 con 0x7fb34c166680 2023-11-26T07:11:42.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.598+0000 7fb349d9b700 1 -- 172.21.15.2:0/2918568416 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34400be60 con 0x7fb34c166680 2023-11-26T07:11:42.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.598+0000 7f2a19c05700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2a14071190 0x7f2a1416dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.598+0000 7f2a19c05700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a140cab10 con 0x7f2a1406cae0 2023-11-26T07:11:42.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.598+0000 7f2a19c05700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a140ca1e0 con 0x7f2a140ceb50 2023-11-26T07:11:42.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.598+0000 7f2a19c05700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a140c9fd0 con 0x7f2a14071190 2023-11-26T07:11:42.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.598+0000 7f2a137fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2a1406cae0 0x7f2a140ce440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58666/0 (socket says 172.21.15.2:58666) 2023-11-26T07:11:42.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.598+0000 7f2a137fe700 1 -- 172.21.15.2:0/3607529042 learned_addr learned my addr 172.21.15.2:0/3607529042 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:11:42.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.598+0000 7f2a13fff700 1 --2- 172.21.15.2:0/3607529042 >> v2:172.21.15.192:3300/0 conn(0x7f2a14071190 0x7f2a1416dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:42.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.599+0000 7fb351050700 1 -- 172.21.15.2:0/2918568416 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb34c166680 msgr2=0x7fb34c070a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:42.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.599+0000 7fb351050700 1 --2- 172.21.15.2:0/2918568416 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb34c166680 0x7fb34c070a80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb344009d90 tx=0x7fb34400b330 comp rx=0 tx=0).stop 2023-11-26T07:11:42.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.599+0000 7f2a127fc700 1 -- 172.21.15.2:0/3607529042 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2079667399 0 0) 0x7f2a140cab10 con 0x7f2a1406cae0 2023-11-26T07:11:42.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.599+0000 7f2a13fff700 1 -- 172.21.15.2:0/3607529042 >> v1:172.21.15.192:6789/0 conn(0x7f2a140ceb50 legacy=0x7f2a14070a80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-26T07:11:42.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.599+0000 7f2a13fff700 1 -- 172.21.15.2:0/3607529042 >> v1:172.21.15.2:6789/0 conn(0x7f2a1406cae0 legacy=0x7f2a140ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:42.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.599+0000 7f2a13fff700 1 -- 172.21.15.2:0/3607529042 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a140ca4c0 con 0x7f2a14071190 2023-11-26T07:11:42.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.599+0000 7fb351050700 1 -- 172.21.15.2:0/2918568416 shutdown_connections 2023-11-26T07:11:42.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.599+0000 7fb351050700 1 --2- 172.21.15.2:0/2918568416 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb34c166680 0x7fb34c070a80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.599+0000 7fb351050700 1 -- 172.21.15.2:0/2918568416 >> 172.21.15.2:0/2918568416 conn(0x7fb34c0cf980 msgr2=0x7fb34c0cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:42.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.599+0000 7f2a13fff700 1 --2- 172.21.15.2:0/3607529042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a14071190 0x7f2a1416dfb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c009d90 tx=0x7f2a0c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7d5e3857744d508 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:42.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.599+0000 7fb351050700 1 -- 172.21.15.2:0/2918568416 shutdown_connections 2023-11-26T07:11:42.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.599+0000 7f2a127fc700 1 -- 172.21.15.2:0/3607529042 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c00e070 con 0x7f2a14071190 2023-11-26T07:11:42.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.600+0000 7f2a127fc700 1 -- 172.21.15.2:0/3607529042 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0c00bb90 con 0x7f2a14071190 2023-11-26T07:11:42.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.600+0000 7f2a127fc700 1 -- 172.21.15.2:0/3607529042 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c003a20 con 0x7f2a14071190 2023-11-26T07:11:42.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.601+0000 7f2a19c05700 1 -- 172.21.15.2:0/3607529042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a14071190 msgr2=0x7f2a1416dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:42.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.601+0000 7f2a19c05700 1 --2- 172.21.15.2:0/3607529042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a14071190 0x7f2a1416dfb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c009d90 tx=0x7f2a0c00b330 comp rx=0 tx=0).stop 2023-11-26T07:11:42.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.601+0000 7f2a19c05700 1 -- 172.21.15.2:0/3607529042 shutdown_connections 2023-11-26T07:11:42.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.601+0000 7f2a19c05700 1 --2- 172.21.15.2:0/3607529042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a14071190 0x7f2a1416dfb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.601+0000 7f2a19c05700 1 -- 172.21.15.2:0/3607529042 >> 172.21.15.2:0/3607529042 conn(0x7f2a140cf980 msgr2=0x7f2a140cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:42.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.601+0000 7f2a19c05700 1 -- 172.21.15.2:0/3607529042 shutdown_connections 2023-11-26T07:11:42.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.600+0000 7fb351050700 1 -- 172.21.15.2:0/2918568416 wait complete. 2023-11-26T07:11:42.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.602+0000 7fb351050700 1 Processor -- start 2023-11-26T07:11:42.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.601+0000 7f2a19c05700 1 -- 172.21.15.2:0/3607529042 wait complete. 2023-11-26T07:11:42.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.603+0000 7f2a19c05700 1 Processor -- start 2023-11-26T07:11:42.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.603+0000 7fb351050700 1 -- start start 2023-11-26T07:11:42.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.604+0000 7fb351050700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb34c0cbb80 0x7fb34c0b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.604+0000 7fb351050700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb34c14bf10 0x7fb34c141d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.604+0000 7fb351050700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb34c166680 0x7fb34c161ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.604+0000 7fb351050700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c0b5a50 con 0x7fb34c14bf10 2023-11-26T07:11:42.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.604+0000 7fb351050700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c0b4ed0 con 0x7fb34c0cbb80 2023-11-26T07:11:42.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.604+0000 7fb351050700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c0b51b0 con 0x7fb34c166680 2023-11-26T07:11:42.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.605+0000 7fb34a59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb34c14bf10 0x7fb34c141d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:42.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.605+0000 7fb34a59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb34c14bf10 0x7fb34c141d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39230/0 (socket says 172.21.15.2:39230) 2023-11-26T07:11:42.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.605+0000 7fb34a59c700 1 -- 172.21.15.2:0/65907385 learned_addr learned my addr 172.21.15.2:0/65907385 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:42.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.605+0000 7fb34b59e700 1 --2- 172.21.15.2:0/65907385 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb34c166680 0x7fb34c161ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:42.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.606+0000 7fb34ad9d700 1 --2- 172.21.15.2:0/65907385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb34c0cbb80 0x7fb34c0b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:42.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.606+0000 7fb34a59c700 1 -- 172.21.15.2:0/65907385 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb34c166680 msgr2=0x7fb34c161ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:42.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.606+0000 7fb34a59c700 1 --2- 172.21.15.2:0/65907385 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb34c166680 0x7fb34c161ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.606+0000 7fb34a59c700 1 -- 172.21.15.2:0/65907385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb34c0cbb80 msgr2=0x7fb34c0b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:42.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.606+0000 7fb34a59c700 1 --2- 172.21.15.2:0/65907385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb34c0cbb80 0x7fb34c0b48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.606+0000 7fb34a59c700 1 -- 172.21.15.2:0/65907385 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb344009a70 con 0x7fb34c14bf10 2023-11-26T07:11:42.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.606+0000 7fb34a59c700 1 --2- 172.21.15.2:0/65907385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb34c14bf10 0x7fb34c141d60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb33c01d780 tx=0x7fb33c01da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:42.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.603+0000 7f2a19c05700 1 -- start start 2023-11-26T07:11:42.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.605+0000 7f2a19c05700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a1406cae0 0x7f2a1415c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.605+0000 7f2a19c05700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a14071190 0x7f2a140b31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.605+0000 7f2a19c05700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a140b4e30 0x7f2a1415f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.605+0000 7f2a19c05700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a14160a60 con 0x7f2a1406cae0 2023-11-26T07:11:42.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.605+0000 7f2a19c05700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1415c9a0 con 0x7f2a140b4e30 2023-11-26T07:11:42.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.605+0000 7f2a19c05700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a140b52f0 con 0x7f2a14071190 2023-11-26T07:11:42.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.605+0000 7f2a137fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a1406cae0 0x7f2a1415c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:42.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.605+0000 7f2a137fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a1406cae0 0x7f2a1415c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39236/0 (socket says 172.21.15.2:39236) 2023-11-26T07:11:42.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.605+0000 7f2a137fe700 1 -- 172.21.15.2:0/184529549 learned_addr learned my addr 172.21.15.2:0/184529549 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:42.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.605+0000 7f2a13fff700 1 --2- 172.21.15.2:0/184529549 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a140b4e30 0x7f2a1415f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:42.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.606+0000 7f2a13fff700 1 -- 172.21.15.2:0/184529549 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a14071190 msgr2=0x7f2a140b31a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-26T07:11:42.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.606+0000 7f2a13fff700 1 --2- 172.21.15.2:0/184529549 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a14071190 0x7f2a140b31a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.606+0000 7f2a13fff700 1 -- 172.21.15.2:0/184529549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a1406cae0 msgr2=0x7f2a1415c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:42.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.606+0000 7f2a13fff700 1 --2- 172.21.15.2:0/184529549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a1406cae0 0x7f2a1415c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.606+0000 7f2a13fff700 1 -- 172.21.15.2:0/184529549 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a0c009a70 con 0x7f2a140b4e30 2023-11-26T07:11:42.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.607+0000 7fb3337fe700 1 -- 172.21.15.2:0/65907385 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c015c90 con 0x7fb34c14bf10 2023-11-26T07:11:42.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.607+0000 7fb3337fe700 1 -- 172.21.15.2:0/65907385 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb33c015df0 con 0x7fb34c14bf10 2023-11-26T07:11:42.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.607+0000 7fb3337fe700 1 -- 172.21.15.2:0/65907385 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c0182f0 con 0x7fb34c14bf10 2023-11-26T07:11:42.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.607+0000 7f2a13fff700 1 --2- 172.21.15.2:0/184529549 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a140b4e30 0x7f2a1415f9c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c015000 tx=0x7f2a0c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:42.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.607+0000 7fb351050700 1 -- 172.21.15.2:0/65907385 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb34c0b5490 con 0x7fb34c14bf10 2023-11-26T07:11:42.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.607+0000 7fb351050700 1 -- 172.21.15.2:0/65907385 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb34c0b2800 con 0x7fb34c14bf10 2023-11-26T07:11:42.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.607+0000 7f29fbfff700 1 -- 172.21.15.2:0/184529549 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c012630 con 0x7f2a140b4e30 2023-11-26T07:11:42.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.607+0000 7f29fbfff700 1 -- 172.21.15.2:0/184529549 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0c0127b0 con 0x7f2a140b4e30 2023-11-26T07:11:42.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.607+0000 7f29fbfff700 1 -- 172.21.15.2:0/184529549 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c012b60 con 0x7f2a140b4e30 2023-11-26T07:11:42.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.609+0000 7fb351050700 1 -- 172.21.15.2:0/65907385 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb32c0052e0 con 0x7fb34c14bf10 2023-11-26T07:11:42.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.615+0000 7fb3337fe700 1 -- 172.21.15.2:0/65907385 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb33c018450 con 0x7fb34c14bf10 2023-11-26T07:11:42.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.616+0000 7fb3337fe700 1 --2- 172.21.15.2:0/65907385 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb33806afa0 0x7fb33806d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.616+0000 7fb3337fe700 1 -- 172.21.15.2:0/65907385 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb33c09a930 con 0x7fb34c14bf10 2023-11-26T07:11:42.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.615+0000 7f2a19c05700 1 -- 172.21.15.2:0/184529549 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a140b55d0 con 0x7f2a140b4e30 2023-11-26T07:11:42.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.615+0000 7f2a19c05700 1 -- 172.21.15.2:0/184529549 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a140b5b90 con 0x7f2a140b4e30 2023-11-26T07:11:42.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.617+0000 7fb34ad9d700 1 --2- 172.21.15.2:0/65907385 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb33806afa0 0x7fb33806d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:42.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.617+0000 7fb34ad9d700 1 --2- 172.21.15.2:0/65907385 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb33806afa0 0x7fb33806d460 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb3400017b0 tx=0x7fb340009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:42.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.618+0000 7f29fbfff700 1 -- 172.21.15.2:0/184529549 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2a0c012cc0 con 0x7f2a140b4e30 2023-11-26T07:11:42.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.619+0000 7fb3337fe700 1 -- 172.21.15.2:0/65907385 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb33c065a70 con 0x7fb34c14bf10 2023-11-26T07:11:42.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.619+0000 7f29fbfff700 1 --2- 172.21.15.2:0/184529549 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f2a0006af20 0x7f2a0006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.619+0000 7f29fbfff700 1 -- 172.21.15.2:0/184529549 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a0c0adc40 con 0x7f2a140b4e30 2023-11-26T07:11:42.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.619+0000 7f2a137fe700 1 --2- 172.21.15.2:0/184529549 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f2a0006af20 0x7f2a0006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:42.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.620+0000 7f2a137fe700 1 --2- 172.21.15.2:0/184529549 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f2a0006af20 0x7f2a0006d3e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2a08000f60 tx=0x7f2a08007ea0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:42.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.632+0000 7f2a19c05700 1 -- 172.21.15.2:0/184529549 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a14160bd0 con 0x7f2a140b4e30 2023-11-26T07:11:42.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.632+0000 7fc7bf42c700 1 Processor -- start 2023-11-26T07:11:42.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.632+0000 7fc7bf42c700 1 -- start start 2023-11-26T07:11:42.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.633+0000 7fc7bf42c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc7b814b350 0x7fc7b80b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.633+0000 7fc7bf42c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc7b81668c0 0x7fc7b80cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.633+0000 7fc7bf42c700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7b80cd520 con 0x7fc7b814b730 2023-11-26T07:11:42.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.633+0000 7fc7bf42c700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7b80cdb30 con 0x7fc7b814b350 2023-11-26T07:11:42.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.633+0000 7fc7bf42c700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7b814bf50 con 0x7fc7b81668c0 2023-11-26T07:11:42.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.633+0000 7fc7bd1c8700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc7b814b350 0x7fc7b80b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:42.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.634+0000 7fc7bd1c8700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc7b814b350 0x7fc7b80b49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39244/0 (socket says 172.21.15.2:39244) 2023-11-26T07:11:42.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.634+0000 7fc7bd1c8700 1 -- 172.21.15.2:0/978264316 learned_addr learned my addr 172.21.15.2:0/978264316 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:42.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.634+0000 7fc7bd1c8700 1 -- 172.21.15.2:0/978264316 >> v2:172.21.15.192:3300/0 conn(0x7fc7b81668c0 msgr2=0x7fc7b80cdf50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-26T07:11:42.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.634+0000 7fc7bd1c8700 1 --2- 172.21.15.2:0/978264316 >> v2:172.21.15.192:3300/0 conn(0x7fc7b81668c0 0x7fc7b80cdf50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.634+0000 7fc7bd1c8700 1 -- 172.21.15.2:0/978264316 >> v1:172.21.15.2:6789/0 conn(0x7fc7b814b730 legacy=0x7fc7b81661b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:42.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.634+0000 7fc7bd1c8700 1 -- 172.21.15.2:0/978264316 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b81670f0 con 0x7fc7b814b350 2023-11-26T07:11:42.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.635+0000 7fc7bd1c8700 1 --2- 172.21.15.2:0/978264316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7b814b350 0x7fc7b80b49e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc7b80cfec0 tx=0x7fc7b4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c384f94d9029b72 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:42.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.641+0000 7f29fbfff700 1 -- 172.21.15.2:0/184529549 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2a0c078d80 con 0x7f2a140b4e30 2023-11-26T07:11:42.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.652+0000 7fc7affff700 1 -- 172.21.15.2:0/978264316 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b4004230 con 0x7fc7b814b350 2023-11-26T07:11:42.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.652+0000 7fc7affff700 1 -- 172.21.15.2:0/978264316 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b4004390 con 0x7fc7b814b350 2023-11-26T07:11:42.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.652+0000 7fc7affff700 1 -- 172.21.15.2:0/978264316 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b40036a0 con 0x7fc7b814b350 2023-11-26T07:11:42.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.654+0000 7fc7bf42c700 1 -- 172.21.15.2:0/978264316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7b814b350 msgr2=0x7fc7b80b49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:42.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.654+0000 7fc7bf42c700 1 --2- 172.21.15.2:0/978264316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7b814b350 0x7fc7b80b49e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc7b80cfec0 tx=0x7fc7b4009bd0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.655+0000 7fc7bf42c700 1 -- 172.21.15.2:0/978264316 shutdown_connections 2023-11-26T07:11:42.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.655+0000 7fc7bf42c700 1 --2- 172.21.15.2:0/978264316 >> v2:172.21.15.192:3300/0 conn(0x7fc7b81668c0 0x7fc7b80cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.655+0000 7fc7bf42c700 1 --2- 172.21.15.2:0/978264316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7b814b350 0x7fc7b80b49e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.655+0000 7fc7bf42c700 1 -- 172.21.15.2:0/978264316 >> 172.21.15.2:0/978264316 conn(0x7fc7b80b1cc0 msgr2=0x7fc7b80b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:42.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.655+0000 7fc7bf42c700 1 -- 172.21.15.2:0/978264316 shutdown_connections 2023-11-26T07:11:42.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.659+0000 7fc7bf42c700 1 -- 172.21.15.2:0/978264316 wait complete. 2023-11-26T07:11:42.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.659+0000 7fb60d7bf700 1 Processor -- start 2023-11-26T07:11:42.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.660+0000 7fc7bf42c700 1 Processor -- start 2023-11-26T07:11:42.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.660+0000 7fb60d7bf700 1 -- start start 2023-11-26T07:11:42.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.661+0000 7fb60d7bf700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb608070a80 0x7fb608070e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.661+0000 7fb60d7bf700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb608145870 0x7fb608165ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.661+0000 7fb60d7bf700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6080ca8e0 con 0x7fb608166430 2023-11-26T07:11:42.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.661+0000 7fb60d7bf700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6080713a0 con 0x7fb608070a80 2023-11-26T07:11:42.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.661+0000 7fb60d7bf700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6080c9fd0 con 0x7fb608145870 2023-11-26T07:11:42.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.661+0000 7fb606ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb608070a80 0x7fb608070e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:42.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.661+0000 7fb606ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb608070a80 0x7fb608070e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39250/0 (socket says 172.21.15.2:39250) 2023-11-26T07:11:42.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.661+0000 7fb606ffd700 1 -- 172.21.15.2:0/1622604359 learned_addr learned my addr 172.21.15.2:0/1622604359 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:42.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.662+0000 7fb6067fc700 1 --2- 172.21.15.2:0/1622604359 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb608145870 0x7fb608165ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:42.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.662+0000 7fb606ffd700 1 -- 172.21.15.2:0/1622604359 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb608145870 msgr2=0x7fb608165ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:42.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.662+0000 7fb606ffd700 1 --2- 172.21.15.2:0/1622604359 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb608145870 0x7fb608165ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.662+0000 7fb606ffd700 1 -- 172.21.15.2:0/1622604359 >> v1:172.21.15.192:6789/0 conn(0x7fb608166430 legacy=0x7fb6080cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:42.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.662+0000 7fb606ffd700 1 -- 172.21.15.2:0/1622604359 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb608166c60 con 0x7fb608070a80 2023-11-26T07:11:42.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.662+0000 7fb606ffd700 1 --2- 172.21.15.2:0/1622604359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb608070a80 0x7fb608070e60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb5f80098f0 tx=0x7fb5f8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2adeb07dd8b02db2 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:42.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.660+0000 7fc7bf42c700 1 -- start start 2023-11-26T07:11:42.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.662+0000 7fc7bf42c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7b814b350 0x7fc7b80b2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.662+0000 7fc7bf42c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc7b814b730 0x7fc7b8164ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.662+0000 7fc7bf42c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc7b81668c0 0x7fc7b8164ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.662+0000 7fc7bf42c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b81657c0 con 0x7fc7b814b350 2023-11-26T07:11:42.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.662+0000 7fc7bf42c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b8163070 con 0x7fc7b81668c0 2023-11-26T07:11:42.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.662+0000 7fc7bf42c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b8163bb0 con 0x7fc7b814b730 2023-11-26T07:11:42.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.662+0000 7fc7bd9c9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc7b81668c0 0x7fc7b8164ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:42.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.662+0000 7fc7bd9c9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc7b81668c0 0x7fc7b8164ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.2:47846/0 (socket says 172.21.15.2:47846) 2023-11-26T07:11:42.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.662+0000 7fc7bd9c9700 1 -- 172.21.15.2:0/224646737 learned_addr learned my addr 172.21.15.2:0/224646737 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:42.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.664+0000 7fc7bc9c7700 1 --2- 172.21.15.2:0/224646737 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc7b814b730 0x7fc7b8164ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:42.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.664+0000 7fc7bc9c7700 1 -- 172.21.15.2:0/224646737 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc7b81668c0 msgr2=0x7fc7b8164ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:42.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.664+0000 7fc7bc9c7700 1 --2- 172.21.15.2:0/224646737 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc7b81668c0 0x7fc7b8164ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.664+0000 7fc7bc9c7700 1 -- 172.21.15.2:0/224646737 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7b814b350 msgr2=0x7fc7b80b2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:42.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.664+0000 7fc7bc9c7700 1 --2- 172.21.15.2:0/224646737 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7b814b350 0x7fc7b80b2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.664+0000 7fc7bc9c7700 1 -- 172.21.15.2:0/224646737 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b4009550 con 0x7fc7b814b730 2023-11-26T07:11:42.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.664+0000 7fc7bc9c7700 1 --2- 172.21.15.2:0/224646737 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc7b814b730 0x7fc7b8164ab0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc7a800c410 tx=0x7fc7a800c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:42.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.664+0000 7fc7adffb700 1 -- 172.21.15.2:0/224646737 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a80054e0 con 0x7fc7b814b730 2023-11-26T07:11:42.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.665+0000 7fc7adffb700 1 -- 172.21.15.2:0/224646737 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a8003680 con 0x7fc7b814b730 2023-11-26T07:11:42.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.665+0000 7fc7adffb700 1 -- 172.21.15.2:0/224646737 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a8003a30 con 0x7fc7b814b730 2023-11-26T07:11:42.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.668+0000 7fb605ffb700 1 -- 172.21.15.2:0/1622604359 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8004230 con 0x7fb608070a80 2023-11-26T07:11:42.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.668+0000 7fb605ffb700 1 -- 172.21.15.2:0/1622604359 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f8004390 con 0x7fb608070a80 2023-11-26T07:11:42.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.668+0000 7fb605ffb700 1 -- 172.21.15.2:0/1622604359 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f80036a0 con 0x7fb608070a80 2023-11-26T07:11:42.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.669+0000 7fb60d7bf700 1 -- 172.21.15.2:0/1622604359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb608070a80 msgr2=0x7fb608070e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:42.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.669+0000 7fb60d7bf700 1 --2- 172.21.15.2:0/1622604359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb608070a80 0x7fb608070e60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb5f80098f0 tx=0x7fb5f8009c00 comp rx=0 tx=0).stop 2023-11-26T07:11:42.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.669+0000 7fb60d7bf700 1 -- 172.21.15.2:0/1622604359 shutdown_connections 2023-11-26T07:11:42.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.669+0000 7fb60d7bf700 1 --2- 172.21.15.2:0/1622604359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb608070a80 0x7fb608070e60 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.669+0000 7fb60d7bf700 1 --2- 172.21.15.2:0/1622604359 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb608145870 0x7fb608165ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.669+0000 7fb60d7bf700 1 -- 172.21.15.2:0/1622604359 >> 172.21.15.2:0/1622604359 conn(0x7fb6080cf980 msgr2=0x7fb6080cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:42.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.670+0000 7fb60d7bf700 1 -- 172.21.15.2:0/1622604359 shutdown_connections 2023-11-26T07:11:42.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.670+0000 7fb60d7bf700 1 -- 172.21.15.2:0/1622604359 wait complete. 2023-11-26T07:11:42.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.672+0000 7fc7bf42c700 1 -- 172.21.15.2:0/224646737 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7b8165530 con 0x7fc7b814b730 2023-11-26T07:11:42.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.672+0000 7fb60d7bf700 1 Processor -- start 2023-11-26T07:11:42.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.672+0000 7fc7bf42c700 1 -- 172.21.15.2:0/224646737 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7b8163560 con 0x7fc7b814b730 2023-11-26T07:11:42.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.672+0000 7fb60d7bf700 1 -- start start 2023-11-26T07:11:42.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.673+0000 7fb60d7bf700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb608070a80 0x7fb608134930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.673+0000 7fb60d7bf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb608145870 0x7fb60815b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.673+0000 7fb60d7bf700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb608166430 0x7fb60815b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.673+0000 7fb60d7bf700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60815acd0 con 0x7fb608145870 2023-11-26T07:11:42.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.673+0000 7fb60d7bf700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb608159c50 con 0x7fb608070a80 2023-11-26T07:11:42.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.673+0000 7fb60d7bf700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb608159f30 con 0x7fb608166430 2023-11-26T07:11:42.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.673+0000 7fb6067fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb608145870 0x7fb60815b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:42.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.673+0000 7fb6067fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb608145870 0x7fb60815b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39266/0 (socket says 172.21.15.2:39266) 2023-11-26T07:11:42.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.673+0000 7fb6067fc700 1 -- 172.21.15.2:0/3633196981 learned_addr learned my addr 172.21.15.2:0/3633196981 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:42.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.673+0000 7fb606ffd700 1 --2- 172.21.15.2:0/3633196981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb608070a80 0x7fb608134930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:42.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.673+0000 7fb6077fe700 1 --2- 172.21.15.2:0/3633196981 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb608166430 0x7fb60815b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:42.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.674+0000 7ff2246b3700 1 Processor -- start 2023-11-26T07:11:42.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.674+0000 7fb606ffd700 1 -- 172.21.15.2:0/3633196981 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb608166430 msgr2=0x7fb60815b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:42.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.674+0000 7fb606ffd700 1 --2- 172.21.15.2:0/3633196981 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb608166430 0x7fb60815b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.674+0000 7fb606ffd700 1 -- 172.21.15.2:0/3633196981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb608145870 msgr2=0x7fb60815b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:42.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.674+0000 7fb606ffd700 1 --2- 172.21.15.2:0/3633196981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb608145870 0x7fb60815b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.674+0000 7fb606ffd700 1 -- 172.21.15.2:0/3633196981 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f8009550 con 0x7fb608070a80 2023-11-26T07:11:42.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.674+0000 7fb606ffd700 1 --2- 172.21.15.2:0/3633196981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb608070a80 0x7fb608134930 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8015000 tx=0x7fb5f8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:42.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.674+0000 7fc7adffb700 1 -- 172.21.15.2:0/224646737 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc7a8003b90 con 0x7fc7b814b730 2023-11-26T07:11:42.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.675+0000 7fc7adffb700 1 --2- 172.21.15.2:0/224646737 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc79c08cee0 0x7fc79c08f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.675+0000 7fc7adffb700 1 -- 172.21.15.2:0/224646737 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc7a80885a0 con 0x7fc7b814b730 2023-11-26T07:11:42.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.675+0000 7fb5ef7fe700 1 -- 172.21.15.2:0/3633196981 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8003e60 con 0x7fb608070a80 2023-11-26T07:11:42.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.675+0000 7fb5ef7fe700 1 -- 172.21.15.2:0/3633196981 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f80045d0 con 0x7fb608070a80 2023-11-26T07:11:42.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.675+0000 7fb5ef7fe700 1 -- 172.21.15.2:0/3633196981 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f800b8a0 con 0x7fb608070a80 2023-11-26T07:11:42.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.675+0000 7fb60d7bf700 1 -- 172.21.15.2:0/3633196981 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb60815a210 con 0x7fb608070a80 2023-11-26T07:11:42.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.676+0000 7fb60d7bf700 1 -- 172.21.15.2:0/3633196981 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb60815a7d0 con 0x7fb608070a80 2023-11-26T07:11:42.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.674+0000 7ff2246b3700 1 -- start start 2023-11-26T07:11:42.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.675+0000 7ff2246b3700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff21c15db10 0x7ff21c15def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.676+0000 7ff2246b3700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff21c071390 0x7ff21c15e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.676+0000 7ff2246b3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff21c15a520 0x7ff21c15a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.676+0000 7ff2246b3700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff21c0ce000 con 0x7ff21c15db10 2023-11-26T07:11:42.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.676+0000 7ff2246b3700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff21c0ce2c0 con 0x7ff21c071390 2023-11-26T07:11:42.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.676+0000 7ff2246b3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff21c0ce5a0 con 0x7ff21c15a520 2023-11-26T07:11:42.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.676+0000 7ff221c4e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff21c071390 0x7ff21c15e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:42.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.676+0000 7ff221c4e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff21c071390 0x7ff21c15e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.2:47856/0 (socket says 172.21.15.2:47856) 2023-11-26T07:11:42.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.676+0000 7ff221c4e700 1 -- 172.21.15.2:0/4061217805 learned_addr learned my addr 172.21.15.2:0/4061217805 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:42.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.678+0000 7fb5ef7fe700 1 -- 172.21.15.2:0/3633196981 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb5f8022070 con 0x7fb608070a80 2023-11-26T07:11:42.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.678+0000 7fb5ef7fe700 1 --2- 172.21.15.2:0/3633196981 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb5f406af20 0x7fb5f406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.678+0000 7fb5ef7fe700 1 -- 172.21.15.2:0/3633196981 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb5f808aea0 con 0x7fb608070a80 2023-11-26T07:11:42.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.679+0000 7fc7bd1c8700 1 --2- 172.21.15.2:0/224646737 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc79c08cee0 0x7fc79c08f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:42.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.679+0000 7fb60d7bf700 1 -- 172.21.15.2:0/3633196981 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb608067f60 con 0x7fb608070a80 2023-11-26T07:11:42.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.679+0000 7fc7bd1c8700 1 --2- 172.21.15.2:0/224646737 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc79c08cee0 0x7fc79c08f3a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4009c10 tx=0x7fc7b4010000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:42.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.680+0000 7fc7bf42c700 1 -- 172.21.15.2:0/224646737 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7b8163f20 con 0x7fc7b814b730 2023-11-26T07:11:42.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.681+0000 7fb6067fc700 1 --2- 172.21.15.2:0/3633196981 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb5f406af20 0x7fb5f406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:42.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.681+0000 7fb6067fc700 1 --2- 172.21.15.2:0/3633196981 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb5f406af20 0x7fb5f406d3e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc009a90 tx=0x7fb5fc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:42.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.676+0000 7ff222c50700 1 --2- 172.21.15.2:0/4061217805 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff21c15a520 0x7ff21c15a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:42.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.676+0000 7ff221c4e700 1 -- 172.21.15.2:0/4061217805 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff21c15a520 msgr2=0x7ff21c15a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:42.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.676+0000 7ff221c4e700 1 --2- 172.21.15.2:0/4061217805 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff21c15a520 0x7ff21c15a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.676+0000 7ff221c4e700 1 -- 172.21.15.2:0/4061217805 >> v2:172.21.15.2:3300/0 conn(0x7ff21c15db10 msgr2=0x7ff21c15def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:42.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.676+0000 7ff221c4e700 1 --2- 172.21.15.2:0/4061217805 >> v2:172.21.15.2:3300/0 conn(0x7ff21c15db10 0x7ff21c15def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.676+0000 7ff221c4e700 1 -- 172.21.15.2:0/4061217805 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff21c0ce880 con 0x7ff21c071390 2023-11-26T07:11:42.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.676+0000 7ff222c50700 1 --2- 172.21.15.2:0/4061217805 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff21c15a520 0x7ff21c15a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:11:42.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.676+0000 7ff221c4e700 1 --2- 172.21.15.2:0/4061217805 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff21c071390 0x7ff21c15e430 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff21c072e00 tx=0x7ff20c00d330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc6d983d0c9bdfe server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:42.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.684+0000 7fb5ef7fe700 1 -- 172.21.15.2:0/3633196981 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb5f80560c0 con 0x7fb608070a80 2023-11-26T07:11:42.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.684+0000 7ff22144d700 1 -- 172.21.15.2:0/4061217805 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c010070 con 0x7ff21c071390 2023-11-26T07:11:42.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.684+0000 7ff22144d700 1 -- 172.21.15.2:0/4061217805 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20c00da80 con 0x7ff21c071390 2023-11-26T07:11:42.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.684+0000 7ff22144d700 1 -- 172.21.15.2:0/4061217805 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c00de10 con 0x7ff21c071390 2023-11-26T07:11:42.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.685+0000 7ff2246b3700 1 -- 172.21.15.2:0/4061217805 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff21c071390 msgr2=0x7ff21c15e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:42.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.685+0000 7ff2246b3700 1 --2- 172.21.15.2:0/4061217805 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff21c071390 0x7ff21c15e430 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff21c072e00 tx=0x7ff20c00d330 comp rx=0 tx=0).stop 2023-11-26T07:11:42.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.685+0000 7fc7adffb700 1 -- 172.21.15.2:0/224646737 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc7b8163f20 con 0x7fc7b814b730 2023-11-26T07:11:42.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.690+0000 7ff2246b3700 1 -- 172.21.15.2:0/4061217805 shutdown_connections 2023-11-26T07:11:42.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.690+0000 7ff2246b3700 1 --2- 172.21.15.2:0/4061217805 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff21c15a520 0x7ff21c15a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.690+0000 7ff2246b3700 1 --2- 172.21.15.2:0/4061217805 >> v2:172.21.15.2:3300/0 conn(0x7ff21c15db10 0x7ff21c15def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.690+0000 7ff2246b3700 1 --2- 172.21.15.2:0/4061217805 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff21c071390 0x7ff21c15e430 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.690+0000 7ff2246b3700 1 -- 172.21.15.2:0/4061217805 >> 172.21.15.2:0/4061217805 conn(0x7ff21c0cf980 msgr2=0x7ff21c0cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:42.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.695+0000 7ff2246b3700 1 -- 172.21.15.2:0/4061217805 shutdown_connections 2023-11-26T07:11:42.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.695+0000 7ff2246b3700 1 -- 172.21.15.2:0/4061217805 wait complete. 2023-11-26T07:11:42.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.697+0000 7ff2246b3700 1 Processor -- start 2023-11-26T07:11:42.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.698+0000 7ff2246b3700 1 -- start start 2023-11-26T07:11:42.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.699+0000 7ff2246b3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff21c071390 0x7ff21c1f86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.699+0000 7ff2246b3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff21c15a520 0x7ff21c159320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.699+0000 7ff2246b3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff21c15db10 0x7ff21c0b3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.699+0000 7ff2246b3700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21c159860 con 0x7ff21c15a520 2023-11-26T07:11:42.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.699+0000 7ff2246b3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21c13e630 con 0x7ff21c15db10 2023-11-26T07:11:42.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.699+0000 7ff2246b3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff21c13da20 con 0x7ff21c071390 2023-11-26T07:11:42.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.700+0000 7ff221c4e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff21c15a520 0x7ff21c159320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:42.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.700+0000 7ff221c4e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff21c15a520 0x7ff21c159320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39278/0 (socket says 172.21.15.2:39278) 2023-11-26T07:11:42.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.700+0000 7ff221c4e700 1 -- 172.21.15.2:0/3687553255 learned_addr learned my addr 172.21.15.2:0/3687553255 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:42.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.700+0000 7ff221c4e700 1 -- 172.21.15.2:0/3687553255 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff21c071390 msgr2=0x7ff21c1f86a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-26T07:11:42.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.701+0000 7ff221c4e700 1 --2- 172.21.15.2:0/3687553255 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff21c071390 0x7ff21c1f86a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.701+0000 7ff221c4e700 1 -- 172.21.15.2:0/3687553255 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff21c15db10 msgr2=0x7ff21c0b3150 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-26T07:11:42.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.701+0000 7ff221c4e700 1 --2- 172.21.15.2:0/3687553255 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff21c15db10 0x7ff21c0b3150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.701+0000 7ff221c4e700 1 -- 172.21.15.2:0/3687553255 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff20c0085d0 con 0x7ff21c15a520 2023-11-26T07:11:42.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.701+0000 7ff221c4e700 1 --2- 172.21.15.2:0/3687553255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff21c15a520 0x7ff21c159320 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff21c0ce400 tx=0x7ff20c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:42.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.703+0000 7ff212ffd700 1 -- 172.21.15.2:0/3687553255 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c0036a0 con 0x7ff21c15a520 2023-11-26T07:11:42.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.703+0000 7ff212ffd700 1 -- 172.21.15.2:0/3687553255 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20c003800 con 0x7ff21c15a520 2023-11-26T07:11:42.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.703+0000 7ff212ffd700 1 -- 172.21.15.2:0/3687553255 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c003b90 con 0x7ff21c15a520 2023-11-26T07:11:42.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.703+0000 7ff2246b3700 1 -- 172.21.15.2:0/3687553255 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff21c13dd00 con 0x7ff21c15a520 2023-11-26T07:11:42.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.703+0000 7ff2246b3700 1 -- 172.21.15.2:0/3687553255 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff21c13e2c0 con 0x7ff21c15a520 2023-11-26T07:11:42.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.708+0000 7ff212ffd700 1 -- 172.21.15.2:0/3687553255 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff20c003cf0 con 0x7ff21c15a520 2023-11-26T07:11:42.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.708+0000 7ff212ffd700 1 --2- 172.21.15.2:0/3687553255 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff20806b150 0x7ff20806d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.709+0000 7ff212ffd700 1 -- 172.21.15.2:0/3687553255 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff20c08afa0 con 0x7ff21c15a520 2023-11-26T07:11:42.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.709+0000 7ff2246b3700 1 -- 172.21.15.2:0/3687553255 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2040052e0 con 0x7ff21c15a520 2023-11-26T07:11:42.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.710+0000 7ff22244f700 1 --2- 172.21.15.2:0/3687553255 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff20806b150 0x7ff20806d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:42.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.715+0000 7ff22244f700 1 --2- 172.21.15.2:0/3687553255 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff20806b150 0x7ff20806d610 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff21c0b3010 tx=0x7ff218006c10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:42.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.719+0000 7ff212ffd700 1 -- 172.21.15.2:0/3687553255 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff20c056100 con 0x7ff21c15a520 2023-11-26T07:11:42.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.737+0000 7f5496e77700 1 Processor -- start 2023-11-26T07:11:42.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.737+0000 7f5496e77700 1 -- start start 2023-11-26T07:11:42.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.738+0000 7f5496e77700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5490070a80 0x7f5490070e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.738+0000 7f5496e77700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f549006cae0 0x7f54900ce440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.738+0000 7f5496e77700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54900cab10 con 0x7f54900ce980 2023-11-26T07:11:42.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.738+0000 7f5496e77700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54900cedf0 con 0x7f5490070a80 2023-11-26T07:11:42.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.738+0000 7f5496e77700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54900c9fd0 con 0x7f549006cae0 2023-11-26T07:11:42.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.740+0000 7f5494c13700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5490070a80 0x7f5490070e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:42.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.740+0000 7f5494c13700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5490070a80 0x7f5490070e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39288/0 (socket says 172.21.15.2:39288) 2023-11-26T07:11:42.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.740+0000 7f5494c13700 1 -- 172.21.15.2:0/2489174704 learned_addr learned my addr 172.21.15.2:0/2489174704 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:42.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.741+0000 7f548ffff700 1 --2- 172.21.15.2:0/2489174704 >> v2:172.21.15.192:3300/0 conn(0x7f549006cae0 0x7f54900ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:42.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.742+0000 7f5494c13700 1 -- 172.21.15.2:0/2489174704 >> v2:172.21.15.192:3300/0 conn(0x7f549006cae0 msgr2=0x7f54900ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:42.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.742+0000 7f5494c13700 1 --2- 172.21.15.2:0/2489174704 >> v2:172.21.15.192:3300/0 conn(0x7f549006cae0 0x7f54900ce440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.742+0000 7f5494c13700 1 -- 172.21.15.2:0/2489174704 >> v1:172.21.15.2:6789/0 conn(0x7f54900ce980 legacy=0x7f549016e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:42.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.742+0000 7f5494c13700 1 -- 172.21.15.2:0/2489174704 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54900713a0 con 0x7f5490070a80 2023-11-26T07:11:42.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.743+0000 7f5494c13700 1 --2- 172.21.15.2:0/2489174704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5490070a80 0x7f5490070e60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f54900695d0 tx=0x7f5480008c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d5cde76c2b0fc3c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:42.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.741+0000 7f548f7fe700 1 -- 172.21.15.2:0/2489174704 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 825327083 0 0) 0x7f54900cab10 con 0x7f54900ce980 2023-11-26T07:11:42.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.743+0000 7f548f7fe700 1 -- 172.21.15.2:0/2489174704 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5480018c60 con 0x7f5490070a80 2023-11-26T07:11:42.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.743+0000 7f548f7fe700 1 -- 172.21.15.2:0/2489174704 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5480018dc0 con 0x7f5490070a80 2023-11-26T07:11:42.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.743+0000 7f548f7fe700 1 -- 172.21.15.2:0/2489174704 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548000b890 con 0x7f5490070a80 2023-11-26T07:11:42.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.744+0000 7f5496e77700 1 -- 172.21.15.2:0/2489174704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5490070a80 msgr2=0x7f5490070e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:42.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.744+0000 7f5496e77700 1 --2- 172.21.15.2:0/2489174704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5490070a80 0x7f5490070e60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f54900695d0 tx=0x7f5480008c50 comp rx=0 tx=0).stop 2023-11-26T07:11:42.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.744+0000 7f5496e77700 1 -- 172.21.15.2:0/2489174704 shutdown_connections 2023-11-26T07:11:42.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.744+0000 7f5496e77700 1 --2- 172.21.15.2:0/2489174704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5490070a80 0x7f5490070e60 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.744+0000 7f5496e77700 1 --2- 172.21.15.2:0/2489174704 >> v2:172.21.15.192:3300/0 conn(0x7f549006cae0 0x7f54900ce440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.744+0000 7f5496e77700 1 -- 172.21.15.2:0/2489174704 >> 172.21.15.2:0/2489174704 conn(0x7f54900cf980 msgr2=0x7f54900cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:42.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.745+0000 7f5496e77700 1 -- 172.21.15.2:0/2489174704 shutdown_connections 2023-11-26T07:11:42.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.745+0000 7f5496e77700 1 -- 172.21.15.2:0/2489174704 wait complete. 2023-11-26T07:11:42.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.747+0000 7f5496e77700 1 Processor -- start 2023-11-26T07:11:42.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.747+0000 7f5496e77700 1 -- start start 2023-11-26T07:11:42.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.748+0000 7f5496e77700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5490070a80 0x7f549008a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.748+0000 7f5496e77700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54900ce980 0x7f549015d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.748+0000 7f5496e77700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f549015d5a0 0x7f54900c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.748+0000 7f5496e77700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549015db20 con 0x7f5490070a80 2023-11-26T07:11:42.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.748+0000 7f5496e77700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549015de00 con 0x7f54900ce980 2023-11-26T07:11:42.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.748+0000 7f5496e77700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54900b4380 con 0x7f549015d5a0 2023-11-26T07:11:42.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.749+0000 7f5494c13700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5490070a80 0x7f549008a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:42.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.749+0000 7f5494c13700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5490070a80 0x7f549008a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39292/0 (socket says 172.21.15.2:39292) 2023-11-26T07:11:42.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.749+0000 7f5494c13700 1 -- 172.21.15.2:0/1941299289 learned_addr learned my addr 172.21.15.2:0/1941299289 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:42.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.749+0000 7f5495414700 1 --2- 172.21.15.2:0/1941299289 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f549015d5a0 0x7f54900c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:42.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.749+0000 7f548ffff700 1 --2- 172.21.15.2:0/1941299289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54900ce980 0x7f549015d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:42.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.749+0000 7f5494c13700 1 -- 172.21.15.2:0/1941299289 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f549015d5a0 msgr2=0x7f54900c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:42.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.749+0000 7f5494c13700 1 --2- 172.21.15.2:0/1941299289 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f549015d5a0 0x7f54900c48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.749+0000 7f5494c13700 1 -- 172.21.15.2:0/1941299289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54900ce980 msgr2=0x7f549015d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:42.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.749+0000 7f5494c13700 1 --2- 172.21.15.2:0/1941299289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54900ce980 0x7f549015d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.749+0000 7f5494c13700 1 -- 172.21.15.2:0/1941299289 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54800085d0 con 0x7f5490070a80 2023-11-26T07:11:42.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.750+0000 7f5494c13700 1 --2- 172.21.15.2:0/1941299289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5490070a80 0x7f549008a8a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5480008c90 tx=0x7f5480004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:42.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.750+0000 7f548d7fa700 1 -- 172.21.15.2:0/1941299289 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54800183d0 con 0x7f5490070a80 2023-11-26T07:11:42.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.750+0000 7f548d7fa700 1 -- 172.21.15.2:0/1941299289 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5480018530 con 0x7f5490070a80 2023-11-26T07:11:42.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.750+0000 7f548d7fa700 1 -- 172.21.15.2:0/1941299289 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5480003b30 con 0x7f5490070a80 2023-11-26T07:11:42.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.750+0000 7f5496e77700 1 -- 172.21.15.2:0/1941299289 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54900b4660 con 0x7f5490070a80 2023-11-26T07:11:42.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.750+0000 7f5496e77700 1 -- 172.21.15.2:0/1941299289 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54900b3d90 con 0x7f5490070a80 2023-11-26T07:11:42.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.754+0000 7f548d7fa700 1 -- 172.21.15.2:0/1941299289 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5480012040 con 0x7f5490070a80 2023-11-26T07:11:42.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.754+0000 7f548d7fa700 1 --2- 172.21.15.2:0/1941299289 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f547807c0f0 0x7f547807e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.755+0000 7f548d7fa700 1 -- 172.21.15.2:0/1941299289 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f548008a1a0 con 0x7f5490070a80 2023-11-26T07:11:42.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.756+0000 7f5496e77700 1 -- 172.21.15.2:0/1941299289 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f546c0052e0 con 0x7f5490070a80 2023-11-26T07:11:42.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.766+0000 7f548ffff700 1 --2- 172.21.15.2:0/1941299289 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f547807c0f0 0x7f547807e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:42.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.766+0000 7f548d7fa700 1 -- 172.21.15.2:0/1941299289 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5480018030 con 0x7f5490070a80 2023-11-26T07:11:42.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.775+0000 7f548ffff700 1 --2- 172.21.15.2:0/1941299289 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f547807c0f0 0x7f547807e5b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f54902050b0 tx=0x7f5484008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:42.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.803+0000 7fe5c0249700 1 Processor -- start 2023-11-26T07:11:42.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.803+0000 7fe5c0249700 1 -- start start 2023-11-26T07:11:42.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.806+0000 7fe5c0249700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe5b8070a80 0x7fe5b8070e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.806+0000 7fe5c0249700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe5b806cae0 0x7fe5b80ce440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.806+0000 7fe5c0249700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe5b80ce980 0x7fe5b816e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.806+0000 7fe5c0249700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5b80c9fd0 con 0x7fe5b806cae0 2023-11-26T07:11:42.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.806+0000 7fe5c0249700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5b80cab10 con 0x7fe5b8070a80 2023-11-26T07:11:42.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.806+0000 7fe5c0249700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b80713a0 con 0x7fe5b80ce980 2023-11-26T07:11:42.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.806+0000 7fe5bd7e4700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe5b806cae0 0x7fe5b80ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:42.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.806+0000 7fe5bd7e4700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe5b806cae0 0x7fe5b80ce440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39304/0 (socket says 172.21.15.2:39304) 2023-11-26T07:11:42.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.806+0000 7fe5bd7e4700 1 -- 172.21.15.2:0/2617289689 learned_addr learned my addr 172.21.15.2:0/2617289689 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:42.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.806+0000 7fe5bdfe5700 1 --2- 172.21.15.2:0/2617289689 >> v2:172.21.15.192:3300/0 conn(0x7fe5b8070a80 0x7fe5b8070e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:42.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.806+0000 7fe5be7e6700 1 --2- 172.21.15.2:0/2617289689 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe5b80ce980 0x7fe5b816e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:42.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.808+0000 7fe5bd7e4700 1 -- 172.21.15.2:0/2617289689 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe5b80ce980 msgr2=0x7fe5b816e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:42.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.808+0000 7fe5bd7e4700 1 --2- 172.21.15.2:0/2617289689 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe5b80ce980 0x7fe5b816e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.808+0000 7fe5bd7e4700 1 -- 172.21.15.2:0/2617289689 >> v2:172.21.15.192:3300/0 conn(0x7fe5b8070a80 msgr2=0x7fe5b8070e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:42.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.808+0000 7fe5bd7e4700 1 --2- 172.21.15.2:0/2617289689 >> v2:172.21.15.192:3300/0 conn(0x7fe5b8070a80 0x7fe5b8070e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.808+0000 7fe5bd7e4700 1 -- 172.21.15.2:0/2617289689 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b80cd7e0 con 0x7fe5b806cae0 2023-11-26T07:11:42.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.808+0000 7fe5bd7e4700 1 --2- 172.21.15.2:0/2617289689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5b806cae0 0x7fe5b80ce440 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe5b80731e0 tx=0x7fe5a800cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c8a5c792d5156f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:42.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.808+0000 7fe5bcfe3700 1 -- 172.21.15.2:0/2617289689 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8015e00 con 0x7fe5b806cae0 2023-11-26T07:11:42.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.808+0000 7fe5bcfe3700 1 -- 172.21.15.2:0/2617289689 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a801e470 con 0x7fe5b806cae0 2023-11-26T07:11:42.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.808+0000 7fe5bcfe3700 1 -- 172.21.15.2:0/2617289689 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a801e800 con 0x7fe5b806cae0 2023-11-26T07:11:42.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.810+0000 7fe5c0249700 1 -- 172.21.15.2:0/2617289689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5b806cae0 msgr2=0x7fe5b80ce440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:42.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.810+0000 7fe5c0249700 1 --2- 172.21.15.2:0/2617289689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5b806cae0 0x7fe5b80ce440 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe5b80731e0 tx=0x7fe5a800cb40 comp rx=0 tx=0).stop 2023-11-26T07:11:42.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.811+0000 7fe5c0249700 1 -- 172.21.15.2:0/2617289689 shutdown_connections 2023-11-26T07:11:42.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.811+0000 7fe5c0249700 1 --2- 172.21.15.2:0/2617289689 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe5b80ce980 0x7fe5b816e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.811+0000 7fe5c0249700 1 --2- 172.21.15.2:0/2617289689 >> v2:172.21.15.192:3300/0 conn(0x7fe5b8070a80 0x7fe5b8070e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.811+0000 7fe5c0249700 1 --2- 172.21.15.2:0/2617289689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5b806cae0 0x7fe5b80ce440 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.811+0000 7fe5c0249700 1 -- 172.21.15.2:0/2617289689 >> 172.21.15.2:0/2617289689 conn(0x7fe5b80cf980 msgr2=0x7fe5b80cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:42.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.811+0000 7fe5c0249700 1 -- 172.21.15.2:0/2617289689 shutdown_connections 2023-11-26T07:11:42.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.811+0000 7fe5c0249700 1 -- 172.21.15.2:0/2617289689 wait complete. 2023-11-26T07:11:42.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.812+0000 7fe5c0249700 1 Processor -- start 2023-11-26T07:11:42.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.812+0000 7fe5c0249700 1 -- start start 2023-11-26T07:11:42.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.814+0000 7fe5c0249700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe5b806cae0 0x7fe5b815c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.814+0000 7fe5c0249700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5b8070a80 0x7fe5b80b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.814+0000 7fe5c0249700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5b80ce980 0x7fe5b80b4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.814+0000 7fe5c0249700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b815ca30 con 0x7fe5b8070a80 2023-11-26T07:11:42.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.814+0000 7fe5c0249700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b816b6d0 con 0x7fe5b80ce980 2023-11-26T07:11:42.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.814+0000 7fe5c0249700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b816b9b0 con 0x7fe5b806cae0 2023-11-26T07:11:42.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.814+0000 7fe5bdfe5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe5b806cae0 0x7fe5b815c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:42.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.814+0000 7fe5be7e6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5b80ce980 0x7fe5b80b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:42.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.814+0000 7fe5bdfe5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe5b806cae0 0x7fe5b815c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.2:37386/0 (socket says 172.21.15.2:37386) 2023-11-26T07:11:42.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.814+0000 7fe5bdfe5700 1 -- 172.21.15.2:0/860074684 learned_addr learned my addr 172.21.15.2:0/860074684 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:42.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.814+0000 7fe5bd7e4700 1 --2- 172.21.15.2:0/860074684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5b8070a80 0x7fe5b80b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:42.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.814+0000 7fe5bd7e4700 1 -- 172.21.15.2:0/860074684 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe5b806cae0 msgr2=0x7fe5b815c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:42.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.814+0000 7fe5bd7e4700 1 --2- 172.21.15.2:0/860074684 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe5b806cae0 0x7fe5b815c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.814+0000 7fe5bd7e4700 1 -- 172.21.15.2:0/860074684 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5b80ce980 msgr2=0x7fe5b80b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:42.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.814+0000 7fe5bd7e4700 1 --2- 172.21.15.2:0/860074684 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5b80ce980 0x7fe5b80b4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.814+0000 7fe5bd7e4700 1 -- 172.21.15.2:0/860074684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a800c550 con 0x7fe5b8070a80 2023-11-26T07:11:42.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.816+0000 7fe5bd7e4700 1 --2- 172.21.15.2:0/860074684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5b8070a80 0x7fe5b80b0dc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe5a801d000 tx=0x7fe5a8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:42.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.833+0000 7fe5ae7fc700 1 -- 172.21.15.2:0/860074684 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8066070 con 0x7fe5b8070a80 2023-11-26T07:11:42.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.833+0000 7fe5ae7fc700 1 -- 172.21.15.2:0/860074684 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a8010040 con 0x7fe5b8070a80 2023-11-26T07:11:42.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.833+0000 7fe5ae7fc700 1 -- 172.21.15.2:0/860074684 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a800f030 con 0x7fe5b8070a80 2023-11-26T07:11:42.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.833+0000 7fe5c0249700 1 -- 172.21.15.2:0/860074684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5b816bc90 con 0x7fe5b8070a80 2023-11-26T07:11:42.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.833+0000 7fe5c0249700 1 -- 172.21.15.2:0/860074684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5b816c250 con 0x7fe5b8070a80 2023-11-26T07:11:42.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.836+0000 7fe5ae7fc700 1 -- 172.21.15.2:0/860074684 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe5a8069070 con 0x7fe5b8070a80 2023-11-26T07:11:42.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.836+0000 7fe5ae7fc700 1 --2- 172.21.15.2:0/860074684 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe59c06afa0 0x7fe59c06d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:42.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.837+0000 7fe5ae7fc700 1 -- 172.21.15.2:0/860074684 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe5a80ce6d0 con 0x7fe5b8070a80 2023-11-26T07:11:42.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.838+0000 7fe5bdfe5700 1 --2- 172.21.15.2:0/860074684 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe59c06afa0 0x7fe59c06d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:42.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.838+0000 7fe5c0249700 1 -- 172.21.15.2:0/860074684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5a00052e0 con 0x7fe5b8070a80 2023-11-26T07:11:42.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.848+0000 7fe5ae7fc700 1 -- 172.21.15.2:0/860074684 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe5a8099830 con 0x7fe5b8070a80 2023-11-26T07:11:42.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.848+0000 7fe5bdfe5700 1 --2- 172.21.15.2:0/860074684 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe59c06afa0 0x7fe59c06d460 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe5b000d950 tx=0x7fe5b000d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:42.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.960+0000 7ff811d2b700 1 -- 172.21.15.2:0/3321960474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7ff7f8005860 con 0x7ff80c071390 2023-11-26T07:11:42.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.964+0000 7ff7f3fff700 1 -- 172.21.15.2:0/3321960474 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff800015090 con 0x7ff80c071390 2023-11-26T07:11:42.969 INFO:teuthology.orchestra.run.smithi002.stdout:55834574855 2023-11-26T07:11:42.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.967+0000 7ff811d2b700 1 -- 172.21.15.2:0/3321960474 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff7f406b010 msgr2=0x7ff7f406d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:42.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.968+0000 7ff811d2b700 1 --2- 172.21.15.2:0/3321960474 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff7f406b010 0x7ff7f406d4d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff80c16c4a0 tx=0x7ff7fc008030 comp rx=0 tx=0).stop 2023-11-26T07:11:42.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.968+0000 7ff811d2b700 1 -- 172.21.15.2:0/3321960474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff80c071390 msgr2=0x7ff80c0c93d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:42.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.968+0000 7ff811d2b700 1 --2- 172.21.15.2:0/3321960474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff80c071390 0x7ff80c0c93d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff80000b4a0 tx=0x7ff80000b7b0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.968+0000 7ff811d2b700 1 -- 172.21.15.2:0/3321960474 shutdown_connections 2023-11-26T07:11:42.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.968+0000 7ff811d2b700 1 --2- 172.21.15.2:0/3321960474 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff7f406b010 0x7ff7f406d4d0 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff80c16c4a0 tx=0x7ff7fc008030 comp rx=0 tx=0).stop 2023-11-26T07:11:42.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.968+0000 7ff811d2b700 1 --2- 172.21.15.2:0/3321960474 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff80c15afa0 0x7ff80c158b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.968+0000 7ff811d2b700 1 --2- 172.21.15.2:0/3321960474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff80c071390 0x7ff80c0c93d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.968+0000 7ff811d2b700 1 --2- 172.21.15.2:0/3321960474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff80c0d04a0 0x7ff80c1585d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:42.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.968+0000 7ff811d2b700 1 -- 172.21.15.2:0/3321960474 >> 172.21.15.2:0/3321960474 conn(0x7ff80c0cf980 msgr2=0x7ff80c0afed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:42.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.968+0000 7ff811d2b700 1 -- 172.21.15.2:0/3321960474 shutdown_connections 2023-11-26T07:11:42.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:42.968+0000 7ff811d2b700 1 -- 172.21.15.2:0/3321960474 wait complete. 2023-11-26T07:11:42.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2023-11-26T07:11:42.989 DEBUG:teuthology.parallel:result is None 2023-11-26T07:11:43.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.033+0000 7fb351050700 1 -- 172.21.15.2:0/65907385 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb32c005860 con 0x7fb34c14bf10 2023-11-26T07:11:43.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.034+0000 7fb3337fe700 1 -- 172.21.15.2:0/65907385 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb33c069090 con 0x7fb34c14bf10 2023-11-26T07:11:43.036 INFO:teuthology.orchestra.run.smithi002.stdout:55834574854 2023-11-26T07:11:43.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.037+0000 7fb351050700 1 -- 172.21.15.2:0/65907385 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb33806afa0 msgr2=0x7fb33806d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:43.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.037+0000 7fb351050700 1 --2- 172.21.15.2:0/65907385 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb33806afa0 0x7fb33806d460 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb3400017b0 tx=0x7fb340009040 comp rx=0 tx=0).stop 2023-11-26T07:11:43.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.037+0000 7fb351050700 1 -- 172.21.15.2:0/65907385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb34c14bf10 msgr2=0x7fb34c141d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:43.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.037+0000 7fb351050700 1 --2- 172.21.15.2:0/65907385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb34c14bf10 0x7fb34c141d60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb33c01d780 tx=0x7fb33c01da90 comp rx=0 tx=0).stop 2023-11-26T07:11:43.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.037+0000 7fb351050700 1 -- 172.21.15.2:0/65907385 shutdown_connections 2023-11-26T07:11:43.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.037+0000 7fb351050700 1 --2- 172.21.15.2:0/65907385 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb33806afa0 0x7fb33806d460 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.037+0000 7fb351050700 1 --2- 172.21.15.2:0/65907385 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb34c166680 0x7fb34c161ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.037+0000 7fb351050700 1 --2- 172.21.15.2:0/65907385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb34c0cbb80 0x7fb34c0b48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.037+0000 7fb351050700 1 --2- 172.21.15.2:0/65907385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb34c14bf10 0x7fb34c141d60 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.037+0000 7fb351050700 1 -- 172.21.15.2:0/65907385 >> 172.21.15.2:0/65907385 conn(0x7fb34c0cf980 msgr2=0x7fb34c0cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:43.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.037+0000 7fb351050700 1 -- 172.21.15.2:0/65907385 shutdown_connections 2023-11-26T07:11:43.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.038+0000 7fb351050700 1 -- 172.21.15.2:0/65907385 wait complete. 2023-11-26T07:11:43.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.047+0000 7f2a19c05700 1 -- 172.21.15.2:0/184529549 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2a14067f60 con 0x7f2a140b4e30 2023-11-26T07:11:43.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.047+0000 7f29fbfff700 1 -- 172.21.15.2:0/184529549 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2a0c07c3a0 con 0x7f2a140b4e30 2023-11-26T07:11:43.050 INFO:teuthology.orchestra.run.smithi002.stdout:55834574854 2023-11-26T07:11:43.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.052+0000 7f2a19c05700 1 -- 172.21.15.2:0/184529549 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f2a0006af20 msgr2=0x7f2a0006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:43.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.052+0000 7f2a19c05700 1 --2- 172.21.15.2:0/184529549 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f2a0006af20 0x7f2a0006d3e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2a08000f60 tx=0x7f2a08007ea0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.052+0000 7f2a19c05700 1 -- 172.21.15.2:0/184529549 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a140b4e30 msgr2=0x7f2a1415f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:43.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.052+0000 7f2a19c05700 1 --2- 172.21.15.2:0/184529549 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a140b4e30 0x7f2a1415f9c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c015000 tx=0x7f2a0c004ad0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.053+0000 7f2a19c05700 1 -- 172.21.15.2:0/184529549 shutdown_connections 2023-11-26T07:11:43.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.053+0000 7f2a19c05700 1 --2- 172.21.15.2:0/184529549 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f2a0006af20 0x7f2a0006d3e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.053+0000 7f2a19c05700 1 --2- 172.21.15.2:0/184529549 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a140b4e30 0x7f2a1415f9c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.053+0000 7f2a19c05700 1 --2- 172.21.15.2:0/184529549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a1406cae0 0x7f2a1415c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.053+0000 7f2a19c05700 1 --2- 172.21.15.2:0/184529549 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a14071190 0x7f2a140b31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.053+0000 7f2a19c05700 1 -- 172.21.15.2:0/184529549 >> 172.21.15.2:0/184529549 conn(0x7f2a140cf980 msgr2=0x7f2a140cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:43.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.053+0000 7f2a19c05700 1 -- 172.21.15.2:0/184529549 shutdown_connections 2023-11-26T07:11:43.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.053+0000 7f2a19c05700 1 -- 172.21.15.2:0/184529549 wait complete. 2023-11-26T07:11:43.058 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2023-11-26T07:11:43.059 DEBUG:teuthology.parallel:result is None 2023-11-26T07:11:43.073 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2023-11-26T07:11:43.073 DEBUG:teuthology.parallel:result is None 2023-11-26T07:11:43.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.075+0000 7fb60d7bf700 1 -- 172.21.15.2:0/3633196981 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fb60815a070 con 0x7fb608070a80 2023-11-26T07:11:43.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.076+0000 7fb5ef7fe700 1 -- 172.21.15.2:0/3633196981 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb60815a070 con 0x7fb608070a80 2023-11-26T07:11:43.078 INFO:teuthology.orchestra.run.smithi002.stdout:55834574855 2023-11-26T07:11:43.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.079+0000 7fb60d7bf700 1 -- 172.21.15.2:0/3633196981 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb5f406af20 msgr2=0x7fb5f406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:43.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.079+0000 7fb60d7bf700 1 --2- 172.21.15.2:0/3633196981 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb5f406af20 0x7fb5f406d3e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc009a90 tx=0x7fb5fc008040 comp rx=0 tx=0).stop 2023-11-26T07:11:43.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.079+0000 7fb60d7bf700 1 -- 172.21.15.2:0/3633196981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb608070a80 msgr2=0x7fb608134930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:43.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.079+0000 7fb60d7bf700 1 --2- 172.21.15.2:0/3633196981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb608070a80 0x7fb608134930 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8015000 tx=0x7fb5f8004750 comp rx=0 tx=0).stop 2023-11-26T07:11:43.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.079+0000 7fb60d7bf700 1 -- 172.21.15.2:0/3633196981 shutdown_connections 2023-11-26T07:11:43.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.079+0000 7fb60d7bf700 1 --2- 172.21.15.2:0/3633196981 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb5f406af20 0x7fb5f406d3e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.079+0000 7fb60d7bf700 1 --2- 172.21.15.2:0/3633196981 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb608166430 0x7fb60815b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.079+0000 7fb60d7bf700 1 --2- 172.21.15.2:0/3633196981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb608070a80 0x7fb608134930 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.079+0000 7fb60d7bf700 1 --2- 172.21.15.2:0/3633196981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb608145870 0x7fb60815b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.079+0000 7fb60d7bf700 1 -- 172.21.15.2:0/3633196981 >> 172.21.15.2:0/3633196981 conn(0x7fb6080cf980 msgr2=0x7fb6081478e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:43.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.079+0000 7fb60d7bf700 1 -- 172.21.15.2:0/3633196981 shutdown_connections 2023-11-26T07:11:43.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.079+0000 7fb60d7bf700 1 -- 172.21.15.2:0/3633196981 wait complete. 2023-11-26T07:11:43.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.092+0000 7fc7bf42c700 1 -- 172.21.15.2:0/224646737 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc7b8163f20 con 0x7fc7b814b730 2023-11-26T07:11:43.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.092+0000 7fc7adffb700 1 -- 172.21.15.2:0/224646737 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc7b8163f20 con 0x7fc7b814b730 2023-11-26T07:11:43.094 INFO:teuthology.orchestra.run.smithi002.stdout:55834574854 2023-11-26T07:11:43.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.094+0000 7fc7bf42c700 1 -- 172.21.15.2:0/224646737 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc79c08cee0 msgr2=0x7fc79c08f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:43.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.094+0000 7fc7bf42c700 1 --2- 172.21.15.2:0/224646737 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc79c08cee0 0x7fc79c08f3a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4009c10 tx=0x7fc7b4010000 comp rx=0 tx=0).stop 2023-11-26T07:11:43.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.094+0000 7fc7bf42c700 1 -- 172.21.15.2:0/224646737 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc7b814b730 msgr2=0x7fc7b8164ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:43.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.094+0000 7fc7bf42c700 1 --2- 172.21.15.2:0/224646737 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc7b814b730 0x7fc7b8164ab0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc7a800c410 tx=0x7fc7a800c7d0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.095+0000 7fc7bf42c700 1 -- 172.21.15.2:0/224646737 shutdown_connections 2023-11-26T07:11:43.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.095+0000 7fc7bf42c700 1 --2- 172.21.15.2:0/224646737 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc79c08cee0 0x7fc79c08f3a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.095+0000 7fc7bf42c700 1 --2- 172.21.15.2:0/224646737 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc7b81668c0 0x7fc7b8164ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.095+0000 7fc7bf42c700 1 --2- 172.21.15.2:0/224646737 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7b814b350 0x7fc7b80b2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.095+0000 7fc7bf42c700 1 --2- 172.21.15.2:0/224646737 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc7b814b730 0x7fc7b8164ab0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.095+0000 7fc7bf42c700 1 -- 172.21.15.2:0/224646737 >> 172.21.15.2:0/224646737 conn(0x7fc7b80b1cc0 msgr2=0x7fc7b80b4780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:43.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.095+0000 7fc7bf42c700 1 -- 172.21.15.2:0/224646737 shutdown_connections 2023-11-26T07:11:43.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.095+0000 7fc7bf42c700 1 -- 172.21.15.2:0/224646737 wait complete. 2023-11-26T07:11:43.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.095+0000 7f5496e77700 1 -- 172.21.15.2:0/1941299289 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f546c005590 con 0x7f5490070a80 2023-11-26T07:11:43.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.096+0000 7f548d7fa700 1 -- 172.21.15.2:0/1941299289 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f54800554d0 con 0x7f5490070a80 2023-11-26T07:11:43.098 INFO:teuthology.orchestra.run.smithi002.stdout:55834574855 2023-11-26T07:11:43.099 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2023-11-26T07:11:43.099 DEBUG:teuthology.parallel:result is None 2023-11-26T07:11:43.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.098+0000 7f5496e77700 1 -- 172.21.15.2:0/1941299289 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f547807c0f0 msgr2=0x7f547807e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:43.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.098+0000 7f5496e77700 1 --2- 172.21.15.2:0/1941299289 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f547807c0f0 0x7f547807e5b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f54902050b0 tx=0x7f5484008040 comp rx=0 tx=0).stop 2023-11-26T07:11:43.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.098+0000 7f5496e77700 1 -- 172.21.15.2:0/1941299289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5490070a80 msgr2=0x7f549008a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:43.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.098+0000 7f5496e77700 1 --2- 172.21.15.2:0/1941299289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5490070a80 0x7f549008a8a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5480008c90 tx=0x7f5480004750 comp rx=0 tx=0).stop 2023-11-26T07:11:43.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.098+0000 7f5496e77700 1 -- 172.21.15.2:0/1941299289 shutdown_connections 2023-11-26T07:11:43.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.098+0000 7f5496e77700 1 --2- 172.21.15.2:0/1941299289 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f547807c0f0 0x7f547807e5b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.098+0000 7f5496e77700 1 --2- 172.21.15.2:0/1941299289 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f549015d5a0 0x7f54900c48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.098+0000 7f5496e77700 1 --2- 172.21.15.2:0/1941299289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5490070a80 0x7f549008a8a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.098+0000 7f5496e77700 1 --2- 172.21.15.2:0/1941299289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54900ce980 0x7f549015d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.098+0000 7f5496e77700 1 -- 172.21.15.2:0/1941299289 >> 172.21.15.2:0/1941299289 conn(0x7f54900cf980 msgr2=0x7f54900b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:43.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.098+0000 7f5496e77700 1 -- 172.21.15.2:0/1941299289 shutdown_connections 2023-11-26T07:11:43.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.098+0000 7f5496e77700 1 -- 172.21.15.2:0/1941299289 wait complete. 2023-11-26T07:11:43.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.108+0000 7ff2246b3700 1 -- 172.21.15.2:0/3687553255 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff204005590 con 0x7ff21c15a520 2023-11-26T07:11:43.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.108+0000 7ff212ffd700 1 -- 172.21.15.2:0/3687553255 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff20c059720 con 0x7ff21c15a520 2023-11-26T07:11:43.110 INFO:teuthology.orchestra.run.smithi002.stdout:55834574853 2023-11-26T07:11:43.111 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2023-11-26T07:11:43.111 DEBUG:teuthology.parallel:result is None 2023-11-26T07:11:43.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.110+0000 7ff2246b3700 1 -- 172.21.15.2:0/3687553255 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff20806b150 msgr2=0x7ff20806d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:43.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.110+0000 7ff2246b3700 1 --2- 172.21.15.2:0/3687553255 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff20806b150 0x7ff20806d610 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff21c0b3010 tx=0x7ff218006c10 comp rx=0 tx=0).stop 2023-11-26T07:11:43.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.110+0000 7ff2246b3700 1 -- 172.21.15.2:0/3687553255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff21c15a520 msgr2=0x7ff21c159320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:43.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.110+0000 7ff2246b3700 1 --2- 172.21.15.2:0/3687553255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff21c15a520 0x7ff21c159320 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff21c0ce400 tx=0x7ff20c004750 comp rx=0 tx=0).stop 2023-11-26T07:11:43.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.110+0000 7ff2246b3700 1 -- 172.21.15.2:0/3687553255 shutdown_connections 2023-11-26T07:11:43.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.110+0000 7ff2246b3700 1 --2- 172.21.15.2:0/3687553255 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff20806b150 0x7ff20806d610 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.110+0000 7ff2246b3700 1 --2- 172.21.15.2:0/3687553255 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff21c15db10 0x7ff21c0b3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.110+0000 7ff2246b3700 1 --2- 172.21.15.2:0/3687553255 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff21c071390 0x7ff21c1f86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.110+0000 7ff2246b3700 1 --2- 172.21.15.2:0/3687553255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff21c15a520 0x7ff21c159320 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.110+0000 7ff2246b3700 1 -- 172.21.15.2:0/3687553255 >> 172.21.15.2:0/3687553255 conn(0x7ff21c0cf980 msgr2=0x7ff21c06dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:43.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.111+0000 7ff2246b3700 1 -- 172.21.15.2:0/3687553255 shutdown_connections 2023-11-26T07:11:43.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.111+0000 7ff2246b3700 1 -- 172.21.15.2:0/3687553255 wait complete. 2023-11-26T07:11:43.114 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2023-11-26T07:11:43.114 DEBUG:teuthology.parallel:result is None 2023-11-26T07:11:43.125 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2023-11-26T07:11:43.125 DEBUG:teuthology.parallel:result is None 2023-11-26T07:11:43.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.180+0000 7fe5c0249700 1 -- 172.21.15.2:0/860074684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fe5a0005590 con 0x7fe5b8070a80 2023-11-26T07:11:43.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.180+0000 7fe5ae7fc700 1 -- 172.21.15.2:0/860074684 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe5a8070070 con 0x7fe5b8070a80 2023-11-26T07:11:43.182 INFO:teuthology.orchestra.run.smithi002.stdout:55834574853 2023-11-26T07:11:43.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.182+0000 7fe5c0249700 1 -- 172.21.15.2:0/860074684 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe59c06afa0 msgr2=0x7fe59c06d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:43.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.182+0000 7fe5c0249700 1 --2- 172.21.15.2:0/860074684 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe59c06afa0 0x7fe59c06d460 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe5b000d950 tx=0x7fe5b000d040 comp rx=0 tx=0).stop 2023-11-26T07:11:43.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.182+0000 7fe5c0249700 1 -- 172.21.15.2:0/860074684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5b8070a80 msgr2=0x7fe5b80b0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:43.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.182+0000 7fe5c0249700 1 --2- 172.21.15.2:0/860074684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5b8070a80 0x7fe5b80b0dc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe5a801d000 tx=0x7fe5a8004750 comp rx=0 tx=0).stop 2023-11-26T07:11:43.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.182+0000 7fe5c0249700 1 -- 172.21.15.2:0/860074684 shutdown_connections 2023-11-26T07:11:43.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.182+0000 7fe5c0249700 1 --2- 172.21.15.2:0/860074684 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe59c06afa0 0x7fe59c06d460 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.182+0000 7fe5c0249700 1 --2- 172.21.15.2:0/860074684 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5b80ce980 0x7fe5b80b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.182+0000 7fe5c0249700 1 --2- 172.21.15.2:0/860074684 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe5b806cae0 0x7fe5b815c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.182+0000 7fe5c0249700 1 --2- 172.21.15.2:0/860074684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5b8070a80 0x7fe5b80b0dc0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.182+0000 7fe5c0249700 1 -- 172.21.15.2:0/860074684 >> 172.21.15.2:0/860074684 conn(0x7fe5b80cf980 msgr2=0x7fe5b80ce040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:43.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.182+0000 7fe5c0249700 1 -- 172.21.15.2:0/860074684 shutdown_connections 2023-11-26T07:11:43.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.182+0000 7fe5c0249700 1 -- 172.21.15.2:0/860074684 wait complete. 2023-11-26T07:11:43.196 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2023-11-26T07:11:43.196 DEBUG:teuthology.parallel:result is None 2023-11-26T07:11:43.196 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-26T07:11:43.197 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:11:43.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.319+0000 7fbde8eee700 1 Processor -- start 2023-11-26T07:11:43.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.319+0000 7fbde8eee700 1 -- start start 2023-11-26T07:11:43.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.320+0000 7fbde8eee700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbde415a440 0x7fbde40cffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:43.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.320+0000 7fbde8eee700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbde415eb80 0x7fbde40d04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:43.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.320+0000 7fbde8eee700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbde40b05f0 con 0x7fbde415a820 2023-11-26T07:11:43.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.320+0000 7fbde8eee700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbde415f080 con 0x7fbde415eb80 2023-11-26T07:11:43.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.320+0000 7fbde8eee700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbde40afd50 con 0x7fbde415a440 2023-11-26T07:11:43.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.320+0000 7fbde1d9b700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fbde415a820 0x7fbde40726a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58756/0 (socket says 172.21.15.2:58756) 2023-11-26T07:11:43.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.320+0000 7fbde1d9b700 1 -- 172.21.15.2:0/4277571592 learned_addr learned my addr 172.21.15.2:0/4277571592 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:11:43.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.320+0000 7fbde2d9d700 1 --2- 172.21.15.2:0/4277571592 >> v2:172.21.15.192:3300/0 conn(0x7fbde415eb80 0x7fbde40d04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:43.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.320+0000 7fbde259c700 1 --2- 172.21.15.2:0/4277571592 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbde415a440 0x7fbde40cffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:43.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.320+0000 7fbde159a700 1 -- 172.21.15.2:0/4277571592 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2520679593 0 0) 0x7fbde40b05f0 con 0x7fbde415a820 2023-11-26T07:11:43.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.320+0000 7fbde159a700 1 -- 172.21.15.2:0/4277571592 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdcc0035b0 con 0x7fbde415a820 2023-11-26T07:11:43.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.320+0000 7fbde159a700 1 -- 172.21.15.2:0/4277571592 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3848987190 0 0) 0x7fbdcc0035b0 con 0x7fbde415a820 2023-11-26T07:11:43.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.320+0000 7fbde159a700 1 -- 172.21.15.2:0/4277571592 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbde415a440 msgr2=0x7fbde40cffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:43.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.321+0000 7fbde159a700 1 --2- 172.21.15.2:0/4277571592 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbde415a440 0x7fbde40cffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.321+0000 7fbde159a700 1 -- 172.21.15.2:0/4277571592 >> v2:172.21.15.192:3300/0 conn(0x7fbde415eb80 msgr2=0x7fbde40d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:43.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.321+0000 7fbde159a700 1 --2- 172.21.15.2:0/4277571592 >> v2:172.21.15.192:3300/0 conn(0x7fbde415eb80 0x7fbde40d04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.321+0000 7fbde159a700 1 -- 172.21.15.2:0/4277571592 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde40b0030 con 0x7fbde415a820 2023-11-26T07:11:43.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.321+0000 7fbde159a700 1 -- 172.21.15.2:0/4277571592 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7fbdd4001670 con 0x7fbde415a820 2023-11-26T07:11:43.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.321+0000 7fbde159a700 1 -- 172.21.15.2:0/4277571592 >> v1:172.21.15.2:6789/0 conn(0x7fbde415a820 legacy=0x7fbde40726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:43.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.321+0000 7fbde159a700 1 --2- 172.21.15.2:0/4277571592 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbde415a440 0x7fbdcc003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:43.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.321+0000 7fbde159a700 1 --2- 172.21.15.2:0/4277571592 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdcc003f80 0x7fbdcc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:43.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.321+0000 7fbde159a700 1 --2- 172.21.15.2:0/4277571592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdcc004d90 0x7fbdcc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:43.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.321+0000 7fbde159a700 1 -- 172.21.15.2:0/4277571592 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde415f080 con 0x7fbdcc004d90 2023-11-26T07:11:43.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.321+0000 7fbde159a700 1 -- 172.21.15.2:0/4277571592 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde40afd50 con 0x7fbdcc003f80 2023-11-26T07:11:43.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.321+0000 7fbde159a700 1 -- 172.21.15.2:0/4277571592 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdcc00baf0 con 0x7fbde415a440 2023-11-26T07:11:43.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.321+0000 7fbde2d9d700 1 --2- 172.21.15.2:0/4277571592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdcc004d90 0x7fbdcc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:43.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.321+0000 7fbde1d9b700 1 --2- 172.21.15.2:0/4277571592 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdcc003f80 0x7fbdcc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:43.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.321+0000 7fbde259c700 1 --2- 172.21.15.2:0/4277571592 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbde415a440 0x7fbdcc003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:43.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.321+0000 7fbde2d9d700 1 -- 172.21.15.2:0/4277571592 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbde415a440 msgr2=0x7fbdcc003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:43.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.321+0000 7fbde2d9d700 1 --2- 172.21.15.2:0/4277571592 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbde415a440 0x7fbdcc003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.321+0000 7fbde2d9d700 1 -- 172.21.15.2:0/4277571592 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdcc003f80 msgr2=0x7fbdcc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:43.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.321+0000 7fbde2d9d700 1 --2- 172.21.15.2:0/4277571592 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdcc003f80 0x7fbdcc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.321+0000 7fbde2d9d700 1 -- 172.21.15.2:0/4277571592 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdcc0035b0 con 0x7fbdcc004d90 2023-11-26T07:11:43.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.321+0000 7fbde2d9d700 1 --2- 172.21.15.2:0/4277571592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdcc004d90 0x7fbdcc005210 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbddc009fc0 tx=0x7fbdcc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=526b34faaf1adb0c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:43.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.321+0000 7fbde159a700 1 -- 172.21.15.2:0/4277571592 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbddc00ec30 con 0x7fbdcc004d90 2023-11-26T07:11:43.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.321+0000 7fbde159a700 1 -- 172.21.15.2:0/4277571592 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbddc00f040 con 0x7fbdcc004d90 2023-11-26T07:11:43.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.321+0000 7fbde159a700 1 -- 172.21.15.2:0/4277571592 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbddc014480 con 0x7fbdcc004d90 2023-11-26T07:11:43.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.322+0000 7fbde8eee700 1 -- 172.21.15.2:0/4277571592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdcc004d90 msgr2=0x7fbdcc005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:43.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.322+0000 7fbde8eee700 1 --2- 172.21.15.2:0/4277571592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdcc004d90 0x7fbdcc005210 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbddc009fc0 tx=0x7fbdcc005880 comp rx=0 tx=0).stop 2023-11-26T07:11:43.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.322+0000 7fbde2d9d700 1 -- 172.21.15.2:0/4277571592 reap_dead start 2023-11-26T07:11:43.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.322+0000 7fbde8eee700 1 -- 172.21.15.2:0/4277571592 shutdown_connections 2023-11-26T07:11:43.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.322+0000 7fbde8eee700 1 -- 172.21.15.2:0/4277571592 >> 172.21.15.2:0/4277571592 conn(0x7fbde40b5070 msgr2=0x7fbde40b5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:43.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.322+0000 7fbde8eee700 1 -- 172.21.15.2:0/4277571592 shutdown_connections 2023-11-26T07:11:43.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.322+0000 7fbde8eee700 1 -- 172.21.15.2:0/4277571592 wait complete. 2023-11-26T07:11:43.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.323+0000 7fbde8eee700 1 Processor -- start 2023-11-26T07:11:43.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.323+0000 7fbde8eee700 1 -- start start 2023-11-26T07:11:43.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.324+0000 7fbde8eee700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdcc004d90 0x7fbde4159250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:43.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.324+0000 7fbde8eee700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbde40ad1f0 0x7fbde4156da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:43.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.324+0000 7fbde8eee700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbde40ae9e0 0x7fbde40aee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:43.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.324+0000 7fbde8eee700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde40ad670 con 0x7fbdcc004d90 2023-11-26T07:11:43.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.324+0000 7fbde8eee700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde40ad940 con 0x7fbde40ae9e0 2023-11-26T07:11:43.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.324+0000 7fbde8eee700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbde40adc20 con 0x7fbde40ad1f0 2023-11-26T07:11:43.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.324+0000 7fbde259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdcc004d90 0x7fbde4159250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:43.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.324+0000 7fbde259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdcc004d90 0x7fbde4159250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39324/0 (socket says 172.21.15.2:39324) 2023-11-26T07:11:43.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.324+0000 7fbde259c700 1 -- 172.21.15.2:0/1971856758 learned_addr learned my addr 172.21.15.2:0/1971856758 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:43.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.324+0000 7fbde1d9b700 1 --2- 172.21.15.2:0/1971856758 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbde40ad1f0 0x7fbde4156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:43.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.324+0000 7fbde2d9d700 1 --2- 172.21.15.2:0/1971856758 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbde40ae9e0 0x7fbde40aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:43.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.325+0000 7fbde259c700 1 -- 172.21.15.2:0/1971856758 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbde40ad1f0 msgr2=0x7fbde4156da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:43.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.325+0000 7fbde259c700 1 --2- 172.21.15.2:0/1971856758 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbde40ad1f0 0x7fbde4156da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.325+0000 7fbde259c700 1 -- 172.21.15.2:0/1971856758 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbde40ae9e0 msgr2=0x7fbde40aee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:43.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.325+0000 7fbde259c700 1 --2- 172.21.15.2:0/1971856758 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbde40ae9e0 0x7fbde40aee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.325+0000 7fbde259c700 1 -- 172.21.15.2:0/1971856758 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde40adf00 con 0x7fbdcc004d90 2023-11-26T07:11:43.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.325+0000 7fbde1d9b700 1 --2- 172.21.15.2:0/1971856758 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbde40ad1f0 0x7fbde4156da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:11:43.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.325+0000 7fbde259c700 1 --2- 172.21.15.2:0/1971856758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdcc004d90 0x7fbde4159250 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8011aa0 tx=0x7fbdd8011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:43.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.325+0000 7fbdd2ffd700 1 -- 172.21.15.2:0/1971856758 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd800f940 con 0x7fbdcc004d90 2023-11-26T07:11:43.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.325+0000 7fbdd2ffd700 1 -- 172.21.15.2:0/1971856758 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdd800faa0 con 0x7fbdcc004d90 2023-11-26T07:11:43.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.325+0000 7fbde8eee700 1 -- 172.21.15.2:0/1971856758 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbde40ae1e0 con 0x7fbdcc004d90 2023-11-26T07:11:43.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.325+0000 7fbdd2ffd700 1 -- 172.21.15.2:0/1971856758 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd800fe50 con 0x7fbdcc004d90 2023-11-26T07:11:43.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.325+0000 7fbde8eee700 1 -- 172.21.15.2:0/1971856758 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbde41572e0 con 0x7fbdcc004d90 2023-11-26T07:11:43.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.326+0000 7fbde8eee700 1 -- 172.21.15.2:0/1971856758 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbde4068670 con 0x7fbdcc004d90 2023-11-26T07:11:43.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.326+0000 7fbdd2ffd700 1 -- 172.21.15.2:0/1971856758 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbdd8014440 con 0x7fbdcc004d90 2023-11-26T07:11:43.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.327+0000 7fbdd2ffd700 1 --2- 172.21.15.2:0/1971856758 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fbdc406aed0 0x7fbdc406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:43.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.327+0000 7fbdd2ffd700 1 -- 172.21.15.2:0/1971856758 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbdd8089d50 con 0x7fbdcc004d90 2023-11-26T07:11:43.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.327+0000 7fbde1d9b700 1 --2- 172.21.15.2:0/1971856758 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fbdc406aed0 0x7fbdc406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:43.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.327+0000 7fbde1d9b700 1 --2- 172.21.15.2:0/1971856758 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fbdc406aed0 0x7fbdc406d390 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbde415e480 tx=0x7fbdd4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:43.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.331+0000 7fbdd2ffd700 1 -- 172.21.15.2:0/1971856758 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbdd808d030 con 0x7fbdcc004d90 2023-11-26T07:11:43.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.525+0000 7fbde8eee700 1 -- 172.21.15.2:0/1971856758 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbde40add90 con 0x7fbdc406aed0 2023-11-26T07:11:43.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.533+0000 7fbdd2ffd700 1 -- 172.21.15.2:0/1971856758 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264613 (secure 0 0 0) 0x7fbde40add90 con 0x7fbdc406aed0 2023-11-26T07:11:43.538 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:11:43.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.536+0000 7fbde8eee700 1 -- 172.21.15.2:0/1971856758 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fbdc406aed0 msgr2=0x7fbdc406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:43.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.536+0000 7fbde8eee700 1 --2- 172.21.15.2:0/1971856758 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fbdc406aed0 0x7fbdc406d390 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbde415e480 tx=0x7fbdd4009040 comp rx=0 tx=0).stop 2023-11-26T07:11:43.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.536+0000 7fbde8eee700 1 -- 172.21.15.2:0/1971856758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdcc004d90 msgr2=0x7fbde4159250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:43.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.536+0000 7fbde8eee700 1 --2- 172.21.15.2:0/1971856758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdcc004d90 0x7fbde4159250 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8011aa0 tx=0x7fbdd8011db0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.536+0000 7fbde8eee700 1 -- 172.21.15.2:0/1971856758 shutdown_connections 2023-11-26T07:11:43.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.536+0000 7fbde8eee700 1 --2- 172.21.15.2:0/1971856758 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fbdc406aed0 0x7fbdc406d390 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.536+0000 7fbde8eee700 1 --2- 172.21.15.2:0/1971856758 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbde40ae9e0 0x7fbde40aee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.536+0000 7fbde8eee700 1 --2- 172.21.15.2:0/1971856758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdcc004d90 0x7fbde4159250 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.536+0000 7fbde8eee700 1 --2- 172.21.15.2:0/1971856758 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbde40ad1f0 0x7fbde4156da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.536+0000 7fbde8eee700 1 -- 172.21.15.2:0/1971856758 >> 172.21.15.2:0/1971856758 conn(0x7fbde40b5070 msgr2=0x7fbde406c410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:43.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.536+0000 7fbde8eee700 1 -- 172.21.15.2:0/1971856758 shutdown_connections 2023-11-26T07:11:43.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.536+0000 7fbde8eee700 1 -- 172.21.15.2:0/1971856758 wait complete. 2023-11-26T07:11:43.542 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-26T07:11:43.550 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-11-26T07:11:42.154420+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219100,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755620,"statfs":{"total":773094113280,"available":772869754880,"internally_reserved":0,"allocated":2990080,"data_stored":1790204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002073"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.602946+0000","last_change":"2023-11-26T07:11:34.649320+0000","last_active":"2023-11-26T07:11:37.602946+0000","last_peered":"2023-11-26T07:11:37.602946+0000","last_clean":"2023-11-26T07:11:37.602946+0000","last_became_active":"2023-11-26T07:11:34.649061+0000","last_became_peered":"2023-11-26T07:11:34.649061+0000","last_unstale":"2023-11-26T07:11:37.602946+0000","last_undegraded":"2023-11-26T07:11:37.602946+0000","last_fullsized":"2023-11-26T07:11:37.602946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:42:30.072326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.546323+0000","last_change":"2023-11-26T07:11:34.635586+0000","last_active":"2023-11-26T07:11:37.546323+0000","last_peered":"2023-11-26T07:11:37.546323+0000","last_clean":"2023-11-26T07:11:37.546323+0000","last_became_active":"2023-11-26T07:11:34.635093+0000","last_became_peered":"2023-11-26T07:11:34.635093+0000","last_unstale":"2023-11-26T07:11:37.546323+0000","last_undegraded":"2023-11-26T07:11:37.546323+0000","last_fullsized":"2023-11-26T07:11:37.546323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:06:28.926253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.987146+0000","last_change":"2023-11-26T07:11:34.637021+0000","last_active":"2023-11-26T07:11:36.987146+0000","last_peered":"2023-11-26T07:11:36.987146+0000","last_clean":"2023-11-26T07:11:36.987146+0000","last_became_active":"2023-11-26T07:11:34.636666+0000","last_became_peered":"2023-11-26T07:11:34.636666+0000","last_unstale":"2023-11-26T07:11:36.987146+0000","last_undegraded":"2023-11-26T07:11:36.987146+0000","last_fullsized":"2023-11-26T07:11:36.987146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:07:08.839200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.639275+0000","last_change":"2023-11-26T07:11:34.647792+0000","last_active":"2023-11-26T07:11:35.639275+0000","last_peered":"2023-11-26T07:11:35.639275+0000","last_clean":"2023-11-26T07:11:35.639275+0000","last_became_active":"2023-11-26T07:11:34.647409+0000","last_became_peered":"2023-11-26T07:11:34.647409+0000","last_unstale":"2023-11-26T07:11:35.639275+0000","last_undegraded":"2023-11-26T07:11:35.639275+0000","last_fullsized":"2023-11-26T07:11:35.639275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:41:41.780777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.602151+0000","last_change":"2023-11-26T07:11:34.645909+0000","last_active":"2023-11-26T07:11:37.602151+0000","last_peered":"2023-11-26T07:11:37.602151+0000","last_clean":"2023-11-26T07:11:37.602151+0000","last_became_active":"2023-11-26T07:11:34.645102+0000","last_became_peered":"2023-11-26T07:11:34.645102+0000","last_unstale":"2023-11-26T07:11:37.602151+0000","last_undegraded":"2023-11-26T07:11:37.602151+0000","last_fullsized":"2023-11-26T07:11:37.602151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:38:10.530811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.638941+0000","last_change":"2023-11-26T07:11:34.648690+0000","last_active":"2023-11-26T07:11:35.638941+0000","last_peered":"2023-11-26T07:11:35.638941+0000","last_clean":"2023-11-26T07:11:35.638941+0000","last_became_active":"2023-11-26T07:11:34.648021+0000","last_became_peered":"2023-11-26T07:11:34.648021+0000","last_unstale":"2023-11-26T07:11:35.638941+0000","last_undegraded":"2023-11-26T07:11:35.638941+0000","last_fullsized":"2023-11-26T07:11:35.638941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:32:03.590472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.601962+0000","last_change":"2023-11-26T07:11:34.635808+0000","last_active":"2023-11-26T07:11:37.601962+0000","last_peered":"2023-11-26T07:11:37.601962+0000","last_clean":"2023-11-26T07:11:37.601962+0000","last_became_active":"2023-11-26T07:11:34.635521+0000","last_became_peered":"2023-11-26T07:11:34.635521+0000","last_unstale":"2023-11-26T07:11:37.601962+0000","last_undegraded":"2023-11-26T07:11:37.601962+0000","last_fullsized":"2023-11-26T07:11:37.601962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:32:36.834153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.014983+0000","last_change":"2023-11-26T07:11:34.649016+0000","last_active":"2023-11-26T07:11:37.014983+0000","last_peered":"2023-11-26T07:11:37.014983+0000","last_clean":"2023-11-26T07:11:37.014983+0000","last_became_active":"2023-11-26T07:11:34.648684+0000","last_became_peered":"2023-11-26T07:11:34.648684+0000","last_unstale":"2023-11-26T07:11:37.014983+0000","last_undegraded":"2023-11-26T07:11:37.014983+0000","last_fullsized":"2023-11-26T07:11:37.014983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:34:27.129920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.602819+0000","last_change":"2023-11-26T07:11:34.647310+0000","last_active":"2023-11-26T07:11:37.602819+0000","last_peered":"2023-11-26T07:11:37.602819+0000","last_clean":"2023-11-26T07:11:37.602819+0000","last_became_active":"2023-11-26T07:11:34.646750+0000","last_became_peered":"2023-11-26T07:11:34.646750+0000","last_unstale":"2023-11-26T07:11:37.602819+0000","last_undegraded":"2023-11-26T07:11:37.602819+0000","last_fullsized":"2023-11-26T07:11:37.602819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:10:28.948434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052935+0000","last_change":"2023-11-26T07:11:34.648387+0000","last_active":"2023-11-26T07:11:37.052935+0000","last_peered":"2023-11-26T07:11:37.052935+0000","last_clean":"2023-11-26T07:11:37.052935+0000","last_became_active":"2023-11-26T07:11:34.646866+0000","last_became_peered":"2023-11-26T07:11:34.646866+0000","last_unstale":"2023-11-26T07:11:37.052935+0000","last_undegraded":"2023-11-26T07:11:37.052935+0000","last_fullsized":"2023-11-26T07:11:37.052935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:32:03.590472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052752+0000","last_change":"2023-11-26T07:11:34.648155+0000","last_active":"2023-11-26T07:11:37.052752+0000","last_peered":"2023-11-26T07:11:37.052752+0000","last_clean":"2023-11-26T07:11:37.052752+0000","last_became_active":"2023-11-26T07:11:34.647811+0000","last_became_peered":"2023-11-26T07:11:34.647811+0000","last_unstale":"2023-11-26T07:11:37.052752+0000","last_undegraded":"2023-11-26T07:11:37.052752+0000","last_fullsized":"2023-11-26T07:11:37.052752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:03:49.221463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.641148+0000","last_change":"2023-11-26T07:11:34.655197+0000","last_active":"2023-11-26T07:11:35.641148+0000","last_peered":"2023-11-26T07:11:35.641148+0000","last_clean":"2023-11-26T07:11:35.641148+0000","last_became_active":"2023-11-26T07:11:34.654929+0000","last_became_peered":"2023-11-26T07:11:34.654929+0000","last_unstale":"2023-11-26T07:11:35.641148+0000","last_undegraded":"2023-11-26T07:11:35.641148+0000","last_fullsized":"2023-11-26T07:11:35.641148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:13:11.105677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015134+0000","last_change":"2023-11-26T07:11:34.649022+0000","last_active":"2023-11-26T07:11:37.015134+0000","last_peered":"2023-11-26T07:11:37.015134+0000","last_clean":"2023-11-26T07:11:37.015134+0000","last_became_active":"2023-11-26T07:11:34.648395+0000","last_became_peered":"2023-11-26T07:11:34.648395+0000","last_unstale":"2023-11-26T07:11:37.015134+0000","last_undegraded":"2023-11-26T07:11:37.015134+0000","last_fullsized":"2023-11-26T07:11:37.015134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:00:10.960837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.986910+0000","last_change":"2023-11-26T07:11:34.637714+0000","last_active":"2023-11-26T07:11:36.986910+0000","last_peered":"2023-11-26T07:11:36.986910+0000","last_clean":"2023-11-26T07:11:36.986910+0000","last_became_active":"2023-11-26T07:11:34.637398+0000","last_became_peered":"2023-11-26T07:11:34.637398+0000","last_unstale":"2023-11-26T07:11:36.986910+0000","last_undegraded":"2023-11-26T07:11:36.986910+0000","last_fullsized":"2023-11-26T07:11:36.986910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:27:38.431121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.545912+0000","last_change":"2023-11-26T07:11:34.653279+0000","last_active":"2023-11-26T07:11:37.545912+0000","last_peered":"2023-11-26T07:11:37.545912+0000","last_clean":"2023-11-26T07:11:37.545912+0000","last_became_active":"2023-11-26T07:11:34.652965+0000","last_became_peered":"2023-11-26T07:11:34.652965+0000","last_unstale":"2023-11-26T07:11:37.545912+0000","last_undegraded":"2023-11-26T07:11:37.545912+0000","last_fullsized":"2023-11-26T07:11:37.545912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:03:49.221463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.638623+0000","last_change":"2023-11-26T07:11:34.644467+0000","last_active":"2023-11-26T07:11:35.638623+0000","last_peered":"2023-11-26T07:11:35.638623+0000","last_clean":"2023-11-26T07:11:35.638623+0000","last_became_active":"2023-11-26T07:11:34.644215+0000","last_became_peered":"2023-11-26T07:11:34.644215+0000","last_unstale":"2023-11-26T07:11:35.638623+0000","last_undegraded":"2023-11-26T07:11:35.638623+0000","last_fullsized":"2023-11-26T07:11:35.638623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:09:14.653647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.639493+0000","last_change":"2023-11-26T07:11:34.646080+0000","last_active":"2023-11-26T07:11:35.639493+0000","last_peered":"2023-11-26T07:11:35.639493+0000","last_clean":"2023-11-26T07:11:35.639493+0000","last_became_active":"2023-11-26T07:11:34.645810+0000","last_became_peered":"2023-11-26T07:11:34.645810+0000","last_unstale":"2023-11-26T07:11:35.639493+0000","last_undegraded":"2023-11-26T07:11:35.639493+0000","last_fullsized":"2023-11-26T07:11:35.639493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:03:47.829221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.602148+0000","last_change":"2023-11-26T07:11:34.650792+0000","last_active":"2023-11-26T07:11:37.602148+0000","last_peered":"2023-11-26T07:11:37.602148+0000","last_clean":"2023-11-26T07:11:37.602148+0000","last_became_active":"2023-11-26T07:11:34.650453+0000","last_became_peered":"2023-11-26T07:11:34.650453+0000","last_unstale":"2023-11-26T07:11:37.602148+0000","last_undegraded":"2023-11-26T07:11:37.602148+0000","last_fullsized":"2023-11-26T07:11:37.602148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:57:30.265272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.602290+0000","last_change":"2023-11-26T07:11:34.642316+0000","last_active":"2023-11-26T07:11:37.602290+0000","last_peered":"2023-11-26T07:11:37.602290+0000","last_clean":"2023-11-26T07:11:37.602290+0000","last_became_active":"2023-11-26T07:11:34.641966+0000","last_became_peered":"2023-11-26T07:11:34.641966+0000","last_unstale":"2023-11-26T07:11:37.602290+0000","last_undegraded":"2023-11-26T07:11:37.602290+0000","last_fullsized":"2023-11-26T07:11:37.602290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:03:47.829221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.987157+0000","last_change":"2023-11-26T07:11:33.642542+0000","last_active":"2023-11-26T07:11:36.987157+0000","last_peered":"2023-11-26T07:11:36.987157+0000","last_clean":"2023-11-26T07:11:36.987157+0000","last_became_active":"2023-11-26T07:11:33.642294+0000","last_became_peered":"2023-11-26T07:11:33.642294+0000","last_unstale":"2023-11-26T07:11:36.987157+0000","last_undegraded":"2023-11-26T07:11:36.987157+0000","last_fullsized":"2023-11-26T07:11:36.987157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:54:30.329113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015525+0000","last_change":"2023-11-26T07:11:34.649717+0000","last_active":"2023-11-26T07:11:37.015525+0000","last_peered":"2023-11-26T07:11:37.015525+0000","last_clean":"2023-11-26T07:11:37.015525+0000","last_became_active":"2023-11-26T07:11:34.649477+0000","last_became_peered":"2023-11-26T07:11:34.649477+0000","last_unstale":"2023-11-26T07:11:37.015525+0000","last_undegraded":"2023-11-26T07:11:37.015525+0000","last_fullsized":"2023-11-26T07:11:37.015525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:38:10.530811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015483+0000","last_change":"2023-11-26T07:11:33.645915+0000","last_active":"2023-11-26T07:11:37.015483+0000","last_peered":"2023-11-26T07:11:37.015483+0000","last_clean":"2023-11-26T07:11:37.015483+0000","last_became_active":"2023-11-26T07:11:33.645603+0000","last_became_peered":"2023-11-26T07:11:33.645603+0000","last_unstale":"2023-11-26T07:11:37.015483+0000","last_undegraded":"2023-11-26T07:11:37.015483+0000","last_fullsized":"2023-11-26T07:11:37.015483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:54:30.329113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.987052+0000","last_change":"2023-11-26T07:11:34.648199+0000","last_active":"2023-11-26T07:11:36.987052+0000","last_peered":"2023-11-26T07:11:36.987052+0000","last_clean":"2023-11-26T07:11:36.987052+0000","last_became_active":"2023-11-26T07:11:34.647906+0000","last_became_peered":"2023-11-26T07:11:34.647906+0000","last_unstale":"2023-11-26T07:11:36.987052+0000","last_undegraded":"2023-11-26T07:11:36.987052+0000","last_fullsized":"2023-11-26T07:11:36.987052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:34:27.129920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.209910+0000","last_change":"2023-11-26T07:11:33.643750+0000","last_active":"2023-11-26T07:11:37.209910+0000","last_peered":"2023-11-26T07:11:37.209910+0000","last_clean":"2023-11-26T07:11:37.209910+0000","last_became_active":"2023-11-26T07:11:33.643485+0000","last_became_peered":"2023-11-26T07:11:33.643485+0000","last_unstale":"2023-11-26T07:11:37.209910+0000","last_undegraded":"2023-11-26T07:11:37.209910+0000","last_fullsized":"2023-11-26T07:11:37.209910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:00:09.955548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.639381+0000","last_change":"2023-11-26T07:11:34.654171+0000","last_active":"2023-11-26T07:11:35.639381+0000","last_peered":"2023-11-26T07:11:35.639381+0000","last_clean":"2023-11-26T07:11:35.639381+0000","last_became_active":"2023-11-26T07:11:34.653773+0000","last_became_peered":"2023-11-26T07:11:34.653773+0000","last_unstale":"2023-11-26T07:11:35.639381+0000","last_undegraded":"2023-11-26T07:11:35.639381+0000","last_fullsized":"2023-11-26T07:11:35.639381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:16:17.444687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.209854+0000","last_change":"2023-11-26T07:11:33.643355+0000","last_active":"2023-11-26T07:11:37.209854+0000","last_peered":"2023-11-26T07:11:37.209854+0000","last_clean":"2023-11-26T07:11:37.209854+0000","last_became_active":"2023-11-26T07:11:33.643024+0000","last_became_peered":"2023-11-26T07:11:33.643024+0000","last_unstale":"2023-11-26T07:11:37.209854+0000","last_undegraded":"2023-11-26T07:11:37.209854+0000","last_fullsized":"2023-11-26T07:11:37.209854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:35:23.512252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.639894+0000","last_change":"2023-11-26T07:11:34.645965+0000","last_active":"2023-11-26T07:11:35.639894+0000","last_peered":"2023-11-26T07:11:35.639894+0000","last_clean":"2023-11-26T07:11:35.639894+0000","last_became_active":"2023-11-26T07:11:34.645636+0000","last_became_peered":"2023-11-26T07:11:34.645636+0000","last_unstale":"2023-11-26T07:11:35.639894+0000","last_undegraded":"2023-11-26T07:11:35.639894+0000","last_fullsized":"2023-11-26T07:11:35.639894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:42:53.462266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015241+0000","last_change":"2023-11-26T07:11:33.637866+0000","last_active":"2023-11-26T07:11:37.015241+0000","last_peered":"2023-11-26T07:11:37.015241+0000","last_clean":"2023-11-26T07:11:37.015241+0000","last_became_active":"2023-11-26T07:11:33.637478+0000","last_became_peered":"2023-11-26T07:11:33.637478+0000","last_unstale":"2023-11-26T07:11:37.015241+0000","last_undegraded":"2023-11-26T07:11:37.015241+0000","last_fullsized":"2023-11-26T07:11:37.015241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:46:01.876918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.640773+0000","last_change":"2023-11-26T07:11:34.636381+0000","last_active":"2023-11-26T07:11:35.640773+0000","last_peered":"2023-11-26T07:11:35.640773+0000","last_clean":"2023-11-26T07:11:35.640773+0000","last_became_active":"2023-11-26T07:11:34.636118+0000","last_became_peered":"2023-11-26T07:11:34.636118+0000","last_unstale":"2023-11-26T07:11:35.640773+0000","last_undegraded":"2023-11-26T07:11:35.640773+0000","last_fullsized":"2023-11-26T07:11:35.640773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:15:28.976045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052636+0000","last_change":"2023-11-26T07:11:33.638305+0000","last_active":"2023-11-26T07:11:37.052636+0000","last_peered":"2023-11-26T07:11:37.052636+0000","last_clean":"2023-11-26T07:11:37.052636+0000","last_became_active":"2023-11-26T07:11:33.637988+0000","last_became_peered":"2023-11-26T07:11:33.637988+0000","last_unstale":"2023-11-26T07:11:37.052636+0000","last_undegraded":"2023-11-26T07:11:37.052636+0000","last_fullsized":"2023-11-26T07:11:37.052636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:13:10.100388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.987409+0000","last_change":"2023-11-26T07:11:34.656184+0000","last_active":"2023-11-26T07:11:36.987409+0000","last_peered":"2023-11-26T07:11:36.987409+0000","last_clean":"2023-11-26T07:11:36.987409+0000","last_became_active":"2023-11-26T07:11:34.655583+0000","last_became_peered":"2023-11-26T07:11:34.655583+0000","last_unstale":"2023-11-26T07:11:36.987409+0000","last_undegraded":"2023-11-26T07:11:36.987409+0000","last_fullsized":"2023-11-26T07:11:36.987409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:32:03.590472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015050+0000","last_change":"2023-11-26T07:11:33.644381+0000","last_active":"2023-11-26T07:11:37.015050+0000","last_peered":"2023-11-26T07:11:37.015050+0000","last_clean":"2023-11-26T07:11:37.015050+0000","last_became_active":"2023-11-26T07:11:33.643634+0000","last_became_peered":"2023-11-26T07:11:33.643634+0000","last_unstale":"2023-11-26T07:11:37.015050+0000","last_undegraded":"2023-11-26T07:11:37.015050+0000","last_fullsized":"2023-11-26T07:11:37.015050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:37:22.209157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015147+0000","last_change":"2023-11-26T07:11:34.643595+0000","last_active":"2023-11-26T07:11:37.015147+0000","last_peered":"2023-11-26T07:11:37.015147+0000","last_clean":"2023-11-26T07:11:37.015147+0000","last_became_active":"2023-11-26T07:11:34.642017+0000","last_became_peered":"2023-11-26T07:11:34.642017+0000","last_unstale":"2023-11-26T07:11:37.015147+0000","last_undegraded":"2023-11-26T07:11:37.015147+0000","last_fullsized":"2023-11-26T07:11:37.015147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:09:14.653647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.638837+0000","last_change":"2023-11-26T07:11:33.634859+0000","last_active":"2023-11-26T07:11:35.638837+0000","last_peered":"2023-11-26T07:11:35.638837+0000","last_clean":"2023-11-26T07:11:35.638837+0000","last_became_active":"2023-11-26T07:11:33.634445+0000","last_became_peered":"2023-11-26T07:11:33.634445+0000","last_unstale":"2023-11-26T07:11:35.638837+0000","last_undegraded":"2023-11-26T07:11:35.638837+0000","last_fullsized":"2023-11-26T07:11:35.638837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:27:37.425832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.546094+0000","last_change":"2023-11-26T07:11:34.641077+0000","last_active":"2023-11-26T07:11:37.546094+0000","last_peered":"2023-11-26T07:11:37.546094+0000","last_clean":"2023-11-26T07:11:37.546094+0000","last_became_active":"2023-11-26T07:11:34.640778+0000","last_became_peered":"2023-11-26T07:11:34.640778+0000","last_unstale":"2023-11-26T07:11:37.546094+0000","last_undegraded":"2023-11-26T07:11:37.546094+0000","last_fullsized":"2023-11-26T07:11:37.546094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:07:08.839200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052858+0000","last_change":"2023-11-26T07:11:33.643806+0000","last_active":"2023-11-26T07:11:37.052858+0000","last_peered":"2023-11-26T07:11:37.052858+0000","last_clean":"2023-11-26T07:11:37.052858+0000","last_became_active":"2023-11-26T07:11:33.643066+0000","last_became_peered":"2023-11-26T07:11:33.643066+0000","last_unstale":"2023-11-26T07:11:37.052858+0000","last_undegraded":"2023-11-26T07:11:37.052858+0000","last_fullsized":"2023-11-26T07:11:37.052858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:54:30.329113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.639314+0000","last_change":"2023-11-26T07:11:34.642427+0000","last_active":"2023-11-26T07:11:35.639314+0000","last_peered":"2023-11-26T07:11:35.639314+0000","last_clean":"2023-11-26T07:11:35.639314+0000","last_became_active":"2023-11-26T07:11:34.642161+0000","last_became_peered":"2023-11-26T07:11:34.642161+0000","last_unstale":"2023-11-26T07:11:35.639314+0000","last_undegraded":"2023-11-26T07:11:35.639314+0000","last_fullsized":"2023-11-26T07:11:35.639314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:38:10.530811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.639263+0000","last_change":"2023-11-26T07:11:33.638930+0000","last_active":"2023-11-26T07:11:35.639263+0000","last_peered":"2023-11-26T07:11:35.639263+0000","last_clean":"2023-11-26T07:11:35.639263+0000","last_became_active":"2023-11-26T07:11:33.638636+0000","last_became_peered":"2023-11-26T07:11:33.638636+0000","last_unstale":"2023-11-26T07:11:35.639263+0000","last_undegraded":"2023-11-26T07:11:35.639263+0000","last_fullsized":"2023-11-26T07:11:35.639263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:54:30.329113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.987164+0000","last_change":"2023-11-26T07:11:34.648049+0000","last_active":"2023-11-26T07:11:36.987164+0000","last_peered":"2023-11-26T07:11:36.987164+0000","last_clean":"2023-11-26T07:11:36.987164+0000","last_became_active":"2023-11-26T07:11:34.647530+0000","last_became_peered":"2023-11-26T07:11:34.647530+0000","last_unstale":"2023-11-26T07:11:36.987164+0000","last_undegraded":"2023-11-26T07:11:36.987164+0000","last_fullsized":"2023-11-26T07:11:36.987164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:00:10.960837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.212139+0000","last_change":"2023-11-26T07:11:33.641284+0000","last_active":"2023-11-26T07:11:37.212139+0000","last_peered":"2023-11-26T07:11:37.212139+0000","last_clean":"2023-11-26T07:11:37.212139+0000","last_became_active":"2023-11-26T07:11:33.640977+0000","last_became_peered":"2023-11-26T07:11:33.640977+0000","last_unstale":"2023-11-26T07:11:37.212139+0000","last_undegraded":"2023-11-26T07:11:37.212139+0000","last_fullsized":"2023-11-26T07:11:37.212139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:27:37.425832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.641110+0000","last_change":"2023-11-26T07:11:34.655028+0000","last_active":"2023-11-26T07:11:35.641110+0000","last_peered":"2023-11-26T07:11:35.641110+0000","last_clean":"2023-11-26T07:11:35.641110+0000","last_became_active":"2023-11-26T07:11:34.654675+0000","last_became_peered":"2023-11-26T07:11:34.654675+0000","last_unstale":"2023-11-26T07:11:35.641110+0000","last_undegraded":"2023-11-26T07:11:35.641110+0000","last_fullsized":"2023-11-26T07:11:35.641110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:57:30.265272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052750+0000","last_change":"2023-11-26T07:11:33.640407+0000","last_active":"2023-11-26T07:11:37.052750+0000","last_peered":"2023-11-26T07:11:37.052750+0000","last_clean":"2023-11-26T07:11:37.052750+0000","last_became_active":"2023-11-26T07:11:33.640092+0000","last_became_peered":"2023-11-26T07:11:33.640092+0000","last_unstale":"2023-11-26T07:11:37.052750+0000","last_undegraded":"2023-11-26T07:11:37.052750+0000","last_fullsized":"2023-11-26T07:11:37.052750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:37:22.209157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.602271+0000","last_change":"2023-11-26T07:11:34.645251+0000","last_active":"2023-11-26T07:11:37.602271+0000","last_peered":"2023-11-26T07:11:37.602271+0000","last_clean":"2023-11-26T07:11:37.602271+0000","last_became_active":"2023-11-26T07:11:34.644995+0000","last_became_peered":"2023-11-26T07:11:34.644995+0000","last_unstale":"2023-11-26T07:11:37.602271+0000","last_undegraded":"2023-11-26T07:11:37.602271+0000","last_fullsized":"2023-11-26T07:11:37.602271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:16:17.444687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.987292+0000","last_change":"2023-11-26T07:11:33.639952+0000","last_active":"2023-11-26T07:11:36.987292+0000","last_peered":"2023-11-26T07:11:36.987292+0000","last_clean":"2023-11-26T07:11:36.987292+0000","last_became_active":"2023-11-26T07:11:33.639660+0000","last_became_peered":"2023-11-26T07:11:33.639660+0000","last_unstale":"2023-11-26T07:11:36.987292+0000","last_undegraded":"2023-11-26T07:11:36.987292+0000","last_fullsized":"2023-11-26T07:11:36.987292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:35:23.512252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.986952+0000","last_change":"2023-11-26T07:11:34.642918+0000","last_active":"2023-11-26T07:11:36.986952+0000","last_peered":"2023-11-26T07:11:36.986952+0000","last_clean":"2023-11-26T07:11:36.986952+0000","last_became_active":"2023-11-26T07:11:34.642455+0000","last_became_peered":"2023-11-26T07:11:34.642455+0000","last_unstale":"2023-11-26T07:11:36.986952+0000","last_undegraded":"2023-11-26T07:11:36.986952+0000","last_fullsized":"2023-11-26T07:11:36.986952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:44:14.102458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.639215+0000","last_change":"2023-11-26T07:11:33.643793+0000","last_active":"2023-11-26T07:11:35.639215+0000","last_peered":"2023-11-26T07:11:35.639215+0000","last_clean":"2023-11-26T07:11:35.639215+0000","last_became_active":"2023-11-26T07:11:33.643494+0000","last_became_peered":"2023-11-26T07:11:33.643494+0000","last_unstale":"2023-11-26T07:11:35.639215+0000","last_undegraded":"2023-11-26T07:11:35.639215+0000","last_fullsized":"2023-11-26T07:11:35.639215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:00:09.955548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.602224+0000","last_change":"2023-11-26T07:11:34.655763+0000","last_active":"2023-11-26T07:11:37.602224+0000","last_peered":"2023-11-26T07:11:37.602224+0000","last_clean":"2023-11-26T07:11:37.602224+0000","last_became_active":"2023-11-26T07:11:34.655507+0000","last_became_peered":"2023-11-26T07:11:34.655507+0000","last_unstale":"2023-11-26T07:11:37.602224+0000","last_undegraded":"2023-11-26T07:11:37.602224+0000","last_fullsized":"2023-11-26T07:11:37.602224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:41:41.780777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052504+0000","last_change":"2023-11-26T07:11:33.635838+0000","last_active":"2023-11-26T07:11:37.052504+0000","last_peered":"2023-11-26T07:11:37.052504+0000","last_clean":"2023-11-26T07:11:37.052504+0000","last_became_active":"2023-11-26T07:11:33.635540+0000","last_became_peered":"2023-11-26T07:11:33.635540+0000","last_unstale":"2023-11-26T07:11:37.052504+0000","last_undegraded":"2023-11-26T07:11:37.052504+0000","last_fullsized":"2023-11-26T07:11:37.052504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:54:55.356034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052841+0000","last_change":"2023-11-26T07:11:34.648800+0000","last_active":"2023-11-26T07:11:37.052841+0000","last_peered":"2023-11-26T07:11:37.052841+0000","last_clean":"2023-11-26T07:11:37.052841+0000","last_became_active":"2023-11-26T07:11:34.648164+0000","last_became_peered":"2023-11-26T07:11:34.648164+0000","last_unstale":"2023-11-26T07:11:37.052841+0000","last_undegraded":"2023-11-26T07:11:37.052841+0000","last_fullsized":"2023-11-26T07:11:37.052841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:09:14.653647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.210999+0000","last_change":"2023-11-26T07:11:33.638974+0000","last_active":"2023-11-26T07:11:37.210999+0000","last_peered":"2023-11-26T07:11:37.210999+0000","last_clean":"2023-11-26T07:11:37.210999+0000","last_became_active":"2023-11-26T07:11:33.638589+0000","last_became_peered":"2023-11-26T07:11:33.638589+0000","last_unstale":"2023-11-26T07:11:37.210999+0000","last_undegraded":"2023-11-26T07:11:37.210999+0000","last_fullsized":"2023-11-26T07:11:37.210999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:15:27.970756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.602107+0000","last_change":"2023-11-26T07:11:34.642385+0000","last_active":"2023-11-26T07:11:37.602107+0000","last_peered":"2023-11-26T07:11:37.602107+0000","last_clean":"2023-11-26T07:11:37.602107+0000","last_became_active":"2023-11-26T07:11:34.642090+0000","last_became_peered":"2023-11-26T07:11:34.642090+0000","last_unstale":"2023-11-26T07:11:37.602107+0000","last_undegraded":"2023-11-26T07:11:37.602107+0000","last_fullsized":"2023-11-26T07:11:37.602107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:25:36.494823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.641145+0000","last_change":"2023-11-26T07:11:33.637520+0000","last_active":"2023-11-26T07:11:35.641145+0000","last_peered":"2023-11-26T07:11:35.641145+0000","last_clean":"2023-11-26T07:11:35.641145+0000","last_became_active":"2023-11-26T07:11:33.637255+0000","last_became_peered":"2023-11-26T07:11:33.637255+0000","last_unstale":"2023-11-26T07:11:35.641145+0000","last_undegraded":"2023-11-26T07:11:35.641145+0000","last_fullsized":"2023-11-26T07:11:35.641145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:49:33.039159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.602407+0000","last_change":"2023-11-26T07:11:34.642552+0000","last_active":"2023-11-26T07:11:37.602407+0000","last_peered":"2023-11-26T07:11:37.602407+0000","last_clean":"2023-11-26T07:11:37.602407+0000","last_became_active":"2023-11-26T07:11:34.642252+0000","last_became_peered":"2023-11-26T07:11:34.642252+0000","last_unstale":"2023-11-26T07:11:37.602407+0000","last_undegraded":"2023-11-26T07:11:37.602407+0000","last_fullsized":"2023-11-26T07:11:37.602407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:47:06.786241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.212100+0000","last_change":"2023-11-26T07:11:33.645907+0000","last_active":"2023-11-26T07:11:37.212100+0000","last_peered":"2023-11-26T07:11:37.212100+0000","last_clean":"2023-11-26T07:11:37.212100+0000","last_became_active":"2023-11-26T07:11:33.645612+0000","last_became_peered":"2023-11-26T07:11:33.645612+0000","last_unstale":"2023-11-26T07:11:37.212100+0000","last_undegraded":"2023-11-26T07:11:37.212100+0000","last_fullsized":"2023-11-26T07:11:37.212100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:15:27.970756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.639689+0000","last_change":"2023-11-26T07:11:34.646582+0000","last_active":"2023-11-26T07:11:35.639689+0000","last_peered":"2023-11-26T07:11:35.639689+0000","last_clean":"2023-11-26T07:11:35.639689+0000","last_became_active":"2023-11-26T07:11:34.646107+0000","last_became_peered":"2023-11-26T07:11:34.646107+0000","last_unstale":"2023-11-26T07:11:35.639689+0000","last_undegraded":"2023-11-26T07:11:35.639689+0000","last_fullsized":"2023-11-26T07:11:35.639689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:36:07.899873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.639090+0000","last_change":"2023-11-26T07:11:33.635282+0000","last_active":"2023-11-26T07:11:35.639090+0000","last_peered":"2023-11-26T07:11:35.639090+0000","last_clean":"2023-11-26T07:11:35.639090+0000","last_became_active":"2023-11-26T07:11:33.634993+0000","last_became_peered":"2023-11-26T07:11:33.634993+0000","last_unstale":"2023-11-26T07:11:35.639090+0000","last_undegraded":"2023-11-26T07:11:35.639090+0000","last_fullsized":"2023-11-26T07:11:35.639090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:07:07.833911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.641041+0000","last_change":"2023-11-26T07:11:34.642107+0000","last_active":"2023-11-26T07:11:35.641041+0000","last_peered":"2023-11-26T07:11:35.641041+0000","last_clean":"2023-11-26T07:11:35.641041+0000","last_became_active":"2023-11-26T07:11:34.641849+0000","last_became_peered":"2023-11-26T07:11:34.641849+0000","last_unstale":"2023-11-26T07:11:35.641041+0000","last_undegraded":"2023-11-26T07:11:35.641041+0000","last_fullsized":"2023-11-26T07:11:35.641041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:35:24.517541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.545954+0000","last_change":"2023-11-26T07:11:34.637097+0000","last_active":"2023-11-26T07:11:37.545954+0000","last_peered":"2023-11-26T07:11:37.545954+0000","last_clean":"2023-11-26T07:11:37.545954+0000","last_became_active":"2023-11-26T07:11:34.636788+0000","last_became_peered":"2023-11-26T07:11:34.636788+0000","last_unstale":"2023-11-26T07:11:37.545954+0000","last_undegraded":"2023-11-26T07:11:37.545954+0000","last_fullsized":"2023-11-26T07:11:37.545954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:34:27.129920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.211022+0000","last_change":"2023-11-26T07:11:33.641738+0000","last_active":"2023-11-26T07:11:37.211022+0000","last_peered":"2023-11-26T07:11:37.211022+0000","last_clean":"2023-11-26T07:11:37.211022+0000","last_became_active":"2023-11-26T07:11:33.641410+0000","last_became_peered":"2023-11-26T07:11:33.641410+0000","last_unstale":"2023-11-26T07:11:37.211022+0000","last_undegraded":"2023-11-26T07:11:37.211022+0000","last_fullsized":"2023-11-26T07:11:37.211022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:17:54.783415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015213+0000","last_change":"2023-11-26T07:11:34.652603+0000","last_active":"2023-11-26T07:11:37.015213+0000","last_peered":"2023-11-26T07:11:37.015213+0000","last_clean":"2023-11-26T07:11:37.015213+0000","last_became_active":"2023-11-26T07:11:34.652141+0000","last_became_peered":"2023-11-26T07:11:34.652141+0000","last_unstale":"2023-11-26T07:11:37.015213+0000","last_undegraded":"2023-11-26T07:11:37.015213+0000","last_fullsized":"2023-11-26T07:11:37.015213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:06:28.926253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.638715+0000","last_change":"2023-11-26T07:11:33.634157+0000","last_active":"2023-11-26T07:11:35.638715+0000","last_peered":"2023-11-26T07:11:35.638715+0000","last_clean":"2023-11-26T07:11:35.638715+0000","last_became_active":"2023-11-26T07:11:33.633464+0000","last_became_peered":"2023-11-26T07:11:33.633464+0000","last_unstale":"2023-11-26T07:11:35.638715+0000","last_undegraded":"2023-11-26T07:11:35.638715+0000","last_fullsized":"2023-11-26T07:11:35.638715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:15:27.970756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.630056+0000","last_change":"2023-11-26T07:11:29.855919+0000","last_active":"2023-11-26T07:11:34.630056+0000","last_peered":"2023-11-26T07:11:34.630056+0000","last_clean":"2023-11-26T07:11:34.630056+0000","last_became_active":"2023-11-26T07:11:29.854903+0000","last_became_peered":"2023-11-26T07:11:29.854903+0000","last_unstale":"2023-11-26T07:11:34.630056+0000","last_undegraded":"2023-11-26T07:11:34.630056+0000","last_fullsized":"2023-11-26T07:11:34.630056+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:28.594252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:28.594252+0000","last_clean_scrub_stamp":"2023-11-26T07:11:28.594252+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:33:34.642696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.986872+0000","last_change":"2023-11-26T07:11:34.655445+0000","last_active":"2023-11-26T07:11:36.986872+0000","last_peered":"2023-11-26T07:11:36.986872+0000","last_clean":"2023-11-26T07:11:36.986872+0000","last_became_active":"2023-11-26T07:11:34.655111+0000","last_became_peered":"2023-11-26T07:11:34.655111+0000","last_unstale":"2023-11-26T07:11:36.986872+0000","last_undegraded":"2023-11-26T07:11:36.986872+0000","last_fullsized":"2023-11-26T07:11:36.986872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:54:56.361323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.209771+0000","last_change":"2023-11-26T07:11:33.640738+0000","last_active":"2023-11-26T07:11:37.209771+0000","last_peered":"2023-11-26T07:11:37.209771+0000","last_clean":"2023-11-26T07:11:37.209771+0000","last_became_active":"2023-11-26T07:11:33.640515+0000","last_became_peered":"2023-11-26T07:11:33.640515+0000","last_unstale":"2023-11-26T07:11:37.209771+0000","last_undegraded":"2023-11-26T07:11:37.209771+0000","last_fullsized":"2023-11-26T07:11:37.209771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:46:01.876918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.209900+0000","last_change":"2023-11-26T07:11:33.643235+0000","last_active":"2023-11-26T07:11:37.209900+0000","last_peered":"2023-11-26T07:11:37.209900+0000","last_clean":"2023-11-26T07:11:37.209900+0000","last_became_active":"2023-11-26T07:11:33.642977+0000","last_became_peered":"2023-11-26T07:11:33.642977+0000","last_unstale":"2023-11-26T07:11:37.209900+0000","last_undegraded":"2023-11-26T07:11:37.209900+0000","last_fullsized":"2023-11-26T07:11:37.209900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:03:48.216174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.546188+0000","last_change":"2023-11-26T07:11:34.636261+0000","last_active":"2023-11-26T07:11:37.546188+0000","last_peered":"2023-11-26T07:11:37.546188+0000","last_clean":"2023-11-26T07:11:37.546188+0000","last_became_active":"2023-11-26T07:11:34.635958+0000","last_became_peered":"2023-11-26T07:11:34.635958+0000","last_unstale":"2023-11-26T07:11:37.546188+0000","last_undegraded":"2023-11-26T07:11:37.546188+0000","last_fullsized":"2023-11-26T07:11:37.546188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:09:14.653647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.546172+0000","last_change":"2023-11-26T07:11:33.643565+0000","last_active":"2023-11-26T07:11:37.546172+0000","last_peered":"2023-11-26T07:11:37.546172+0000","last_clean":"2023-11-26T07:11:37.546172+0000","last_became_active":"2023-11-26T07:11:33.643189+0000","last_became_peered":"2023-11-26T07:11:33.643189+0000","last_unstale":"2023-11-26T07:11:37.546172+0000","last_undegraded":"2023-11-26T07:11:37.546172+0000","last_fullsized":"2023-11-26T07:11:37.546172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:57:29.259984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015485+0000","last_change":"2023-11-26T07:11:34.645591+0000","last_active":"2023-11-26T07:11:37.015485+0000","last_peered":"2023-11-26T07:11:37.015485+0000","last_clean":"2023-11-26T07:11:37.015485+0000","last_became_active":"2023-11-26T07:11:34.645274+0000","last_became_peered":"2023-11-26T07:11:34.645274+0000","last_unstale":"2023-11-26T07:11:37.015485+0000","last_undegraded":"2023-11-26T07:11:37.015485+0000","last_fullsized":"2023-11-26T07:11:37.015485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:41:41.780777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052771+0000","last_change":"2023-11-26T07:11:33.638999+0000","last_active":"2023-11-26T07:11:37.052771+0000","last_peered":"2023-11-26T07:11:37.052771+0000","last_clean":"2023-11-26T07:11:37.052771+0000","last_became_active":"2023-11-26T07:11:33.638743+0000","last_became_peered":"2023-11-26T07:11:33.638743+0000","last_unstale":"2023-11-26T07:11:37.052771+0000","last_undegraded":"2023-11-26T07:11:37.052771+0000","last_fullsized":"2023-11-26T07:11:37.052771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:46:01.876918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.987081+0000","last_change":"2023-11-26T07:11:34.637617+0000","last_active":"2023-11-26T07:11:36.987081+0000","last_peered":"2023-11-26T07:11:36.987081+0000","last_clean":"2023-11-26T07:11:36.987081+0000","last_became_active":"2023-11-26T07:11:34.637260+0000","last_became_peered":"2023-11-26T07:11:34.637260+0000","last_unstale":"2023-11-26T07:11:36.987081+0000","last_undegraded":"2023-11-26T07:11:36.987081+0000","last_fullsized":"2023-11-26T07:11:36.987081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:03:49.221463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.209732+0000","last_change":"2023-11-26T07:11:33.642201+0000","last_active":"2023-11-26T07:11:37.209732+0000","last_peered":"2023-11-26T07:11:37.209732+0000","last_clean":"2023-11-26T07:11:37.209732+0000","last_became_active":"2023-11-26T07:11:33.641913+0000","last_became_peered":"2023-11-26T07:11:33.641913+0000","last_unstale":"2023-11-26T07:11:37.209732+0000","last_undegraded":"2023-11-26T07:11:37.209732+0000","last_fullsized":"2023-11-26T07:11:37.209732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:15:27.970756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.640871+0000","last_change":"2023-11-26T07:11:34.641773+0000","last_active":"2023-11-26T07:11:35.640871+0000","last_peered":"2023-11-26T07:11:35.640871+0000","last_clean":"2023-11-26T07:11:35.640871+0000","last_became_active":"2023-11-26T07:11:34.641501+0000","last_became_peered":"2023-11-26T07:11:34.641501+0000","last_unstale":"2023-11-26T07:11:35.640871+0000","last_undegraded":"2023-11-26T07:11:35.640871+0000","last_fullsized":"2023-11-26T07:11:35.640871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:23:13.396432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.212059+0000","last_change":"2023-11-26T07:11:33.637842+0000","last_active":"2023-11-26T07:11:37.212059+0000","last_peered":"2023-11-26T07:11:37.212059+0000","last_clean":"2023-11-26T07:11:37.212059+0000","last_became_active":"2023-11-26T07:11:33.637534+0000","last_became_peered":"2023-11-26T07:11:33.637534+0000","last_unstale":"2023-11-26T07:11:37.212059+0000","last_undegraded":"2023-11-26T07:11:37.212059+0000","last_fullsized":"2023-11-26T07:11:37.212059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:18:52.359254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015004+0000","last_change":"2023-11-26T07:11:34.640101+0000","last_active":"2023-11-26T07:11:37.015004+0000","last_peered":"2023-11-26T07:11:37.015004+0000","last_clean":"2023-11-26T07:11:37.015004+0000","last_became_active":"2023-11-26T07:11:34.639741+0000","last_became_peered":"2023-11-26T07:11:34.639741+0000","last_unstale":"2023-11-26T07:11:37.015004+0000","last_undegraded":"2023-11-26T07:11:37.015004+0000","last_fullsized":"2023-11-26T07:11:37.015004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:03:49.221463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.212078+0000","last_change":"2023-11-26T07:11:33.644068+0000","last_active":"2023-11-26T07:11:37.212078+0000","last_peered":"2023-11-26T07:11:37.212078+0000","last_clean":"2023-11-26T07:11:37.212078+0000","last_became_active":"2023-11-26T07:11:33.643725+0000","last_became_peered":"2023-11-26T07:11:33.643725+0000","last_unstale":"2023-11-26T07:11:37.212078+0000","last_undegraded":"2023-11-26T07:11:37.212078+0000","last_fullsized":"2023-11-26T07:11:37.212078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:35:23.512252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015299+0000","last_change":"2023-11-26T07:11:34.639960+0000","last_active":"2023-11-26T07:11:37.015299+0000","last_peered":"2023-11-26T07:11:37.015299+0000","last_clean":"2023-11-26T07:11:37.015299+0000","last_became_active":"2023-11-26T07:11:34.639582+0000","last_became_peered":"2023-11-26T07:11:34.639582+0000","last_unstale":"2023-11-26T07:11:37.015299+0000","last_undegraded":"2023-11-26T07:11:37.015299+0000","last_fullsized":"2023-11-26T07:11:37.015299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:32:03.590472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.209841+0000","last_change":"2023-11-26T07:11:33.640210+0000","last_active":"2023-11-26T07:11:37.209841+0000","last_peered":"2023-11-26T07:11:37.209841+0000","last_clean":"2023-11-26T07:11:37.209841+0000","last_became_active":"2023-11-26T07:11:33.639920+0000","last_became_peered":"2023-11-26T07:11:33.639920+0000","last_unstale":"2023-11-26T07:11:37.209841+0000","last_undegraded":"2023-11-26T07:11:37.209841+0000","last_fullsized":"2023-11-26T07:11:37.209841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:34:26.124632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052803+0000","last_change":"2023-11-26T07:11:34.654053+0000","last_active":"2023-11-26T07:11:37.052803+0000","last_peered":"2023-11-26T07:11:37.052803+0000","last_clean":"2023-11-26T07:11:37.052803+0000","last_became_active":"2023-11-26T07:11:34.653682+0000","last_became_peered":"2023-11-26T07:11:34.653682+0000","last_unstale":"2023-11-26T07:11:37.052803+0000","last_undegraded":"2023-11-26T07:11:37.052803+0000","last_fullsized":"2023-11-26T07:11:37.052803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:00:10.960837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.211054+0000","last_change":"2023-11-26T07:11:33.641257+0000","last_active":"2023-11-26T07:11:37.211054+0000","last_peered":"2023-11-26T07:11:37.211054+0000","last_clean":"2023-11-26T07:11:37.211054+0000","last_became_active":"2023-11-26T07:11:33.640986+0000","last_became_peered":"2023-11-26T07:11:33.640986+0000","last_unstale":"2023-11-26T07:11:37.211054+0000","last_undegraded":"2023-11-26T07:11:37.211054+0000","last_fullsized":"2023-11-26T07:11:37.211054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:23:12.391144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.602456+0000","last_change":"2023-11-26T07:11:34.648421+0000","last_active":"2023-11-26T07:11:37.602456+0000","last_peered":"2023-11-26T07:11:37.602456+0000","last_clean":"2023-11-26T07:11:37.602456+0000","last_became_active":"2023-11-26T07:11:34.648144+0000","last_became_peered":"2023-11-26T07:11:34.648144+0000","last_unstale":"2023-11-26T07:11:37.602456+0000","last_undegraded":"2023-11-26T07:11:37.602456+0000","last_fullsized":"2023-11-26T07:11:37.602456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:36:07.899873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.212122+0000","last_change":"2023-11-26T07:11:33.635219+0000","last_active":"2023-11-26T07:11:37.212122+0000","last_peered":"2023-11-26T07:11:37.212122+0000","last_clean":"2023-11-26T07:11:37.212122+0000","last_became_active":"2023-11-26T07:11:33.634823+0000","last_became_peered":"2023-11-26T07:11:33.634823+0000","last_unstale":"2023-11-26T07:11:37.212122+0000","last_undegraded":"2023-11-26T07:11:37.212122+0000","last_fullsized":"2023-11-26T07:11:37.212122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:46:01.876918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.639554+0000","last_change":"2023-11-26T07:11:34.647738+0000","last_active":"2023-11-26T07:11:35.639554+0000","last_peered":"2023-11-26T07:11:35.639554+0000","last_clean":"2023-11-26T07:11:35.639554+0000","last_became_active":"2023-11-26T07:11:34.647392+0000","last_became_peered":"2023-11-26T07:11:34.647392+0000","last_unstale":"2023-11-26T07:11:35.639554+0000","last_undegraded":"2023-11-26T07:11:35.639554+0000","last_fullsized":"2023-11-26T07:11:35.639554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:47:06.786241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.211076+0000","last_change":"2023-11-26T07:11:33.640058+0000","last_active":"2023-11-26T07:11:37.211076+0000","last_peered":"2023-11-26T07:11:37.211076+0000","last_clean":"2023-11-26T07:11:37.211076+0000","last_became_active":"2023-11-26T07:11:33.639705+0000","last_became_peered":"2023-11-26T07:11:33.639705+0000","last_unstale":"2023-11-26T07:11:37.211076+0000","last_undegraded":"2023-11-26T07:11:37.211076+0000","last_fullsized":"2023-11-26T07:11:37.211076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:35:23.512252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.602601+0000","last_change":"2023-11-26T07:11:34.644169+0000","last_active":"2023-11-26T07:11:37.602601+0000","last_peered":"2023-11-26T07:11:37.602601+0000","last_clean":"2023-11-26T07:11:37.602601+0000","last_became_active":"2023-11-26T07:11:34.643368+0000","last_became_peered":"2023-11-26T07:11:34.643368+0000","last_unstale":"2023-11-26T07:11:37.602601+0000","last_undegraded":"2023-11-26T07:11:37.602601+0000","last_fullsized":"2023-11-26T07:11:37.602601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:42:53.462266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052532+0000","last_change":"2023-11-26T07:11:34.647950+0000","last_active":"2023-11-26T07:11:37.052532+0000","last_peered":"2023-11-26T07:11:37.052532+0000","last_clean":"2023-11-26T07:11:37.052532+0000","last_became_active":"2023-11-26T07:11:34.647506+0000","last_became_peered":"2023-11-26T07:11:34.647506+0000","last_unstale":"2023-11-26T07:11:37.052532+0000","last_undegraded":"2023-11-26T07:11:37.052532+0000","last_fullsized":"2023-11-26T07:11:37.052532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:34:27.129920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.602216+0000","last_change":"2023-11-26T07:11:34.646505+0000","last_active":"2023-11-26T07:11:37.602216+0000","last_peered":"2023-11-26T07:11:37.602216+0000","last_clean":"2023-11-26T07:11:37.602216+0000","last_became_active":"2023-11-26T07:11:34.646188+0000","last_became_peered":"2023-11-26T07:11:34.646188+0000","last_unstale":"2023-11-26T07:11:37.602216+0000","last_undegraded":"2023-11-26T07:11:37.602216+0000","last_fullsized":"2023-11-26T07:11:37.602216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:13:11.105677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.639195+0000","last_change":"2023-11-26T07:11:34.648874+0000","last_active":"2023-11-26T07:11:35.639195+0000","last_peered":"2023-11-26T07:11:35.639195+0000","last_clean":"2023-11-26T07:11:35.639195+0000","last_became_active":"2023-11-26T07:11:34.648306+0000","last_became_peered":"2023-11-26T07:11:34.648306+0000","last_unstale":"2023-11-26T07:11:35.639195+0000","last_undegraded":"2023-11-26T07:11:35.639195+0000","last_fullsized":"2023-11-26T07:11:35.639195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:25:36.494823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.987274+0000","last_change":"2023-11-26T07:11:34.644678+0000","last_active":"2023-11-26T07:11:36.987274+0000","last_peered":"2023-11-26T07:11:36.987274+0000","last_clean":"2023-11-26T07:11:36.987274+0000","last_became_active":"2023-11-26T07:11:34.644208+0000","last_became_peered":"2023-11-26T07:11:34.644208+0000","last_unstale":"2023-11-26T07:11:36.987274+0000","last_undegraded":"2023-11-26T07:11:36.987274+0000","last_fullsized":"2023-11-26T07:11:36.987274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:06:28.926253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015420+0000","last_change":"2023-11-26T07:11:34.654093+0000","last_active":"2023-11-26T07:11:37.015420+0000","last_peered":"2023-11-26T07:11:37.015420+0000","last_clean":"2023-11-26T07:11:37.015420+0000","last_became_active":"2023-11-26T07:11:34.653772+0000","last_became_peered":"2023-11-26T07:11:34.653772+0000","last_unstale":"2023-11-26T07:11:37.015420+0000","last_undegraded":"2023-11-26T07:11:37.015420+0000","last_fullsized":"2023-11-26T07:11:37.015420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:25:36.494823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.546128+0000","last_change":"2023-11-26T07:11:34.641180+0000","last_active":"2023-11-26T07:11:37.546128+0000","last_peered":"2023-11-26T07:11:37.546128+0000","last_clean":"2023-11-26T07:11:37.546128+0000","last_became_active":"2023-11-26T07:11:34.640883+0000","last_became_peered":"2023-11-26T07:11:34.640883+0000","last_unstale":"2023-11-26T07:11:37.546128+0000","last_undegraded":"2023-11-26T07:11:37.546128+0000","last_fullsized":"2023-11-26T07:11:37.546128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:00:10.960837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052794+0000","last_change":"2023-11-26T07:11:34.649166+0000","last_active":"2023-11-26T07:11:37.052794+0000","last_peered":"2023-11-26T07:11:37.052794+0000","last_clean":"2023-11-26T07:11:37.052794+0000","last_became_active":"2023-11-26T07:11:34.647969+0000","last_became_peered":"2023-11-26T07:11:34.647969+0000","last_unstale":"2023-11-26T07:11:37.052794+0000","last_undegraded":"2023-11-26T07:11:37.052794+0000","last_fullsized":"2023-11-26T07:11:37.052794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:07:08.839200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015324+0000","last_change":"2023-11-26T07:11:34.642588+0000","last_active":"2023-11-26T07:11:37.015324+0000","last_peered":"2023-11-26T07:11:37.015324+0000","last_clean":"2023-11-26T07:11:37.015324+0000","last_became_active":"2023-11-26T07:11:34.642248+0000","last_became_peered":"2023-11-26T07:11:34.642248+0000","last_unstale":"2023-11-26T07:11:37.015324+0000","last_undegraded":"2023-11-26T07:11:37.015324+0000","last_fullsized":"2023-11-26T07:11:37.015324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:32:36.834153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.638896+0000","last_change":"2023-11-26T07:11:34.647562+0000","last_active":"2023-11-26T07:11:35.638896+0000","last_peered":"2023-11-26T07:11:35.638896+0000","last_clean":"2023-11-26T07:11:35.638896+0000","last_became_active":"2023-11-26T07:11:34.647274+0000","last_became_peered":"2023-11-26T07:11:34.647274+0000","last_unstale":"2023-11-26T07:11:35.638896+0000","last_undegraded":"2023-11-26T07:11:35.638896+0000","last_fullsized":"2023-11-26T07:11:35.638896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:06:28.926253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015070+0000","last_change":"2023-11-26T07:11:34.644535+0000","last_active":"2023-11-26T07:11:37.015070+0000","last_peered":"2023-11-26T07:11:37.015070+0000","last_clean":"2023-11-26T07:11:37.015070+0000","last_became_active":"2023-11-26T07:11:34.644188+0000","last_became_peered":"2023-11-26T07:11:34.644188+0000","last_unstale":"2023-11-26T07:11:37.015070+0000","last_undegraded":"2023-11-26T07:11:37.015070+0000","last_fullsized":"2023-11-26T07:11:37.015070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:07:08.839200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.638979+0000","last_change":"2023-11-26T07:11:34.650901+0000","last_active":"2023-11-26T07:11:35.638979+0000","last_peered":"2023-11-26T07:11:35.638979+0000","last_clean":"2023-11-26T07:11:35.638979+0000","last_became_active":"2023-11-26T07:11:34.647833+0000","last_became_peered":"2023-11-26T07:11:34.647833+0000","last_unstale":"2023-11-26T07:11:35.638979+0000","last_undegraded":"2023-11-26T07:11:35.638979+0000","last_fullsized":"2023-11-26T07:11:35.638979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:32:36.834153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.987234+0000","last_change":"2023-11-26T07:11:34.646704+0000","last_active":"2023-11-26T07:11:36.987234+0000","last_peered":"2023-11-26T07:11:36.987234+0000","last_clean":"2023-11-26T07:11:36.987234+0000","last_became_active":"2023-11-26T07:11:34.646178+0000","last_became_peered":"2023-11-26T07:11:34.646178+0000","last_unstale":"2023-11-26T07:11:36.987234+0000","last_undegraded":"2023-11-26T07:11:36.987234+0000","last_fullsized":"2023-11-26T07:11:36.987234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:09:14.653647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052917+0000","last_change":"2023-11-26T07:11:34.657780+0000","last_active":"2023-11-26T07:11:37.052917+0000","last_peered":"2023-11-26T07:11:37.052917+0000","last_clean":"2023-11-26T07:11:37.052917+0000","last_became_active":"2023-11-26T07:11:34.657459+0000","last_became_peered":"2023-11-26T07:11:34.657459+0000","last_unstale":"2023-11-26T07:11:37.052917+0000","last_undegraded":"2023-11-26T07:11:37.052917+0000","last_fullsized":"2023-11-26T07:11:37.052917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:06:28.926253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":666531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4139999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.5600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.569}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6639999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":75741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":823296,"data_stored":666587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":75581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":75707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:11:43.556 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:11:43.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.713+0000 7f58497de700 1 Processor -- start 2023-11-26T07:11:43.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.713+0000 7f58497de700 1 -- start start 2023-11-26T07:11:43.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.714+0000 7f58497de700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f58440722c0 0x7f58440b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:43.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.714+0000 7f58497de700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f58441440f0 0x7f584406e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:43.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.714+0000 7f58497de700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5844143ec0 con 0x7f5844143ae0 2023-11-26T07:11:43.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.714+0000 7f58497de700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58440b40a0 con 0x7f58441440f0 2023-11-26T07:11:43.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.714+0000 7f58497de700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58440b3ae0 con 0x7f58440722c0 2023-11-26T07:11:43.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.714+0000 7f58437fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f58441440f0 0x7f584406e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:43.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.714+0000 7f58437fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f58441440f0 0x7f584406e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39336/0 (socket says 172.21.15.2:39336) 2023-11-26T07:11:43.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.714+0000 7f58437fe700 1 -- 172.21.15.2:0/3514015123 learned_addr learned my addr 172.21.15.2:0/3514015123 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:43.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.715+0000 7f58427fc700 1 --2- 172.21.15.2:0/3514015123 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f58440722c0 0x7f58440b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:43.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.715+0000 7f58437fe700 1 -- 172.21.15.2:0/3514015123 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f58440722c0 msgr2=0x7f58440b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:43.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.715+0000 7f58437fe700 1 --2- 172.21.15.2:0/3514015123 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f58440722c0 0x7f58440b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.715+0000 7f58437fe700 1 -- 172.21.15.2:0/3514015123 >> v1:172.21.15.192:6789/0 conn(0x7f5844143ae0 legacy=0x7f5844071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:43.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.715+0000 7f58437fe700 1 -- 172.21.15.2:0/3514015123 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58440b3dc0 con 0x7f58441440f0 2023-11-26T07:11:43.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.715+0000 7f58437fe700 1 --2- 172.21.15.2:0/3514015123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58441440f0 0x7f584406e510 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f583c009e50 tx=0x7f583c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1a16888312936d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:43.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.715+0000 7f5841ffb700 1 -- 172.21.15.2:0/3514015123 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583c00e070 con 0x7f58441440f0 2023-11-26T07:11:43.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.715+0000 7f5841ffb700 1 -- 172.21.15.2:0/3514015123 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f583c00b9c0 con 0x7f58441440f0 2023-11-26T07:11:43.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.715+0000 7f5841ffb700 1 -- 172.21.15.2:0/3514015123 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583c00bd70 con 0x7f58441440f0 2023-11-26T07:11:43.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.716+0000 7f58497de700 1 -- 172.21.15.2:0/3514015123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58441440f0 msgr2=0x7f584406e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:43.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.716+0000 7f58497de700 1 --2- 172.21.15.2:0/3514015123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58441440f0 0x7f584406e510 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f583c009e50 tx=0x7f583c00b330 comp rx=0 tx=0).stop 2023-11-26T07:11:43.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.716+0000 7f58497de700 1 -- 172.21.15.2:0/3514015123 shutdown_connections 2023-11-26T07:11:43.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.716+0000 7f58497de700 1 --2- 172.21.15.2:0/3514015123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58441440f0 0x7f584406e510 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.716+0000 7f58497de700 1 --2- 172.21.15.2:0/3514015123 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f58440722c0 0x7f58440b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.716+0000 7f58497de700 1 -- 172.21.15.2:0/3514015123 >> 172.21.15.2:0/3514015123 conn(0x7f58440b2740 msgr2=0x7f58440b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:43.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.716+0000 7f58497de700 1 -- 172.21.15.2:0/3514015123 shutdown_connections 2023-11-26T07:11:43.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.716+0000 7f58497de700 1 -- 172.21.15.2:0/3514015123 wait complete. 2023-11-26T07:11:43.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.717+0000 7f58497de700 1 Processor -- start 2023-11-26T07:11:43.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.717+0000 7f58497de700 1 -- start start 2023-11-26T07:11:43.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.718+0000 7f58497de700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58440722c0 0x7f58441f3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:43.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.718+0000 7f58497de700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5844143ae0 0x7f584406afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:43.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.718+0000 7f58497de700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58441440f0 0x7f58440c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:43.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.718+0000 7f58497de700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5844154e40 con 0x7f58441440f0 2023-11-26T07:11:43.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.718+0000 7f58497de700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58441f4180 con 0x7f58440722c0 2023-11-26T07:11:43.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.718+0000 7f58497de700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f584406ba20 con 0x7f5844143ae0 2023-11-26T07:11:43.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.718+0000 7f58437fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58441440f0 0x7f58440c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:43.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.718+0000 7f58437fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58441440f0 0x7f58440c9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39342/0 (socket says 172.21.15.2:39342) 2023-11-26T07:11:43.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.718+0000 7f58437fe700 1 -- 172.21.15.2:0/2031129453 learned_addr learned my addr 172.21.15.2:0/2031129453 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:43.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.718+0000 7f5842ffd700 1 --2- 172.21.15.2:0/2031129453 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58440722c0 0x7f58441f3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:43.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.718+0000 7f58427fc700 1 --2- 172.21.15.2:0/2031129453 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5844143ae0 0x7f584406afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:43.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.718+0000 7f58437fe700 1 -- 172.21.15.2:0/2031129453 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5844143ae0 msgr2=0x7f584406afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:43.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.718+0000 7f58437fe700 1 --2- 172.21.15.2:0/2031129453 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5844143ae0 0x7f584406afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.718+0000 7f58437fe700 1 -- 172.21.15.2:0/2031129453 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58440722c0 msgr2=0x7f58441f3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:43.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.718+0000 7f58437fe700 1 --2- 172.21.15.2:0/2031129453 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58440722c0 0x7f58441f3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.718+0000 7f58437fe700 1 -- 172.21.15.2:0/2031129453 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f583c009b30 con 0x7f58441440f0 2023-11-26T07:11:43.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.718+0000 7f58437fe700 1 --2- 172.21.15.2:0/2031129453 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58441440f0 0x7f58440c9dc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f58440d1bd0 tx=0x7f583c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:43.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.719+0000 7f583b7fe700 1 -- 172.21.15.2:0/2031129453 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583c004840 con 0x7f58441440f0 2023-11-26T07:11:43.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.719+0000 7f583b7fe700 1 -- 172.21.15.2:0/2031129453 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f583c0092e0 con 0x7f58441440f0 2023-11-26T07:11:43.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.719+0000 7f58497de700 1 -- 172.21.15.2:0/2031129453 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f584406bd00 con 0x7f58441440f0 2023-11-26T07:11:43.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.719+0000 7f583b7fe700 1 -- 172.21.15.2:0/2031129453 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583c01c660 con 0x7f58441440f0 2023-11-26T07:11:43.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.719+0000 7f58497de700 1 -- 172.21.15.2:0/2031129453 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5844155300 con 0x7f58441440f0 2023-11-26T07:11:43.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.720+0000 7f58497de700 1 -- 172.21.15.2:0/2031129453 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f584406bf40 con 0x7f58441440f0 2023-11-26T07:11:43.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.720+0000 7f583b7fe700 1 -- 172.21.15.2:0/2031129453 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f583c01c7c0 con 0x7f58441440f0 2023-11-26T07:11:43.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.721+0000 7f583b7fe700 1 --2- 172.21.15.2:0/2031129453 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f582406aed0 0x7f582406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:43.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.721+0000 7f583b7fe700 1 -- 172.21.15.2:0/2031129453 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f583c08b160 con 0x7f58441440f0 2023-11-26T07:11:43.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.721+0000 7f5842ffd700 1 --2- 172.21.15.2:0/2031129453 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f582406aed0 0x7f582406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:43.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.722+0000 7f5842ffd700 1 --2- 172.21.15.2:0/2031129453 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f582406aed0 0x7f582406d390 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f584413fbd0 tx=0x7f5834009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:43.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.725+0000 7f583b7fe700 1 -- 172.21.15.2:0/2031129453 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f584406bf40 con 0x7f58441440f0 2023-11-26T07:11:43.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.924+0000 7f58497de700 1 -- 172.21.15.2:0/2031129453 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f584415f560 con 0x7f582406aed0 2023-11-26T07:11:43.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.932+0000 7f583b7fe700 1 -- 172.21.15.2:0/2031129453 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264613 (secure 0 0 0) 0x7f584415f560 con 0x7f582406aed0 2023-11-26T07:11:43.937 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:11:43.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.935+0000 7f58497de700 1 -- 172.21.15.2:0/2031129453 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f582406aed0 msgr2=0x7f582406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:43.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.935+0000 7f58497de700 1 --2- 172.21.15.2:0/2031129453 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f582406aed0 0x7f582406d390 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f584413fbd0 tx=0x7f5834009040 comp rx=0 tx=0).stop 2023-11-26T07:11:43.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.935+0000 7f58497de700 1 -- 172.21.15.2:0/2031129453 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58441440f0 msgr2=0x7f58440c9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:43.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.935+0000 7f58497de700 1 --2- 172.21.15.2:0/2031129453 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58441440f0 0x7f58440c9dc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f58440d1bd0 tx=0x7f583c004ad0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.935+0000 7f58497de700 1 -- 172.21.15.2:0/2031129453 shutdown_connections 2023-11-26T07:11:43.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.935+0000 7f58497de700 1 --2- 172.21.15.2:0/2031129453 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f582406aed0 0x7f582406d390 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.935+0000 7f58497de700 1 --2- 172.21.15.2:0/2031129453 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58441440f0 0x7f58440c9dc0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.935+0000 7f58497de700 1 --2- 172.21.15.2:0/2031129453 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58440722c0 0x7f58441f3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.935+0000 7f58497de700 1 --2- 172.21.15.2:0/2031129453 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5844143ae0 0x7f584406afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:43.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.935+0000 7f58497de700 1 -- 172.21.15.2:0/2031129453 >> 172.21.15.2:0/2031129453 conn(0x7f58440b2740 msgr2=0x7f584406edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:43.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.935+0000 7f58497de700 1 -- 172.21.15.2:0/2031129453 shutdown_connections 2023-11-26T07:11:43.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:43.935+0000 7f58497de700 1 -- 172.21.15.2:0/2031129453 wait complete. 2023-11-26T07:11:43.941 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-26T07:11:43.949 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-11-26T07:11:42.154420+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219100,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755620,"statfs":{"total":773094113280,"available":772869754880,"internally_reserved":0,"allocated":2990080,"data_stored":1790204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002073"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.602946+0000","last_change":"2023-11-26T07:11:34.649320+0000","last_active":"2023-11-26T07:11:37.602946+0000","last_peered":"2023-11-26T07:11:37.602946+0000","last_clean":"2023-11-26T07:11:37.602946+0000","last_became_active":"2023-11-26T07:11:34.649061+0000","last_became_peered":"2023-11-26T07:11:34.649061+0000","last_unstale":"2023-11-26T07:11:37.602946+0000","last_undegraded":"2023-11-26T07:11:37.602946+0000","last_fullsized":"2023-11-26T07:11:37.602946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:42:30.072326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.546323+0000","last_change":"2023-11-26T07:11:34.635586+0000","last_active":"2023-11-26T07:11:37.546323+0000","last_peered":"2023-11-26T07:11:37.546323+0000","last_clean":"2023-11-26T07:11:37.546323+0000","last_became_active":"2023-11-26T07:11:34.635093+0000","last_became_peered":"2023-11-26T07:11:34.635093+0000","last_unstale":"2023-11-26T07:11:37.546323+0000","last_undegraded":"2023-11-26T07:11:37.546323+0000","last_fullsized":"2023-11-26T07:11:37.546323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:06:28.926253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.987146+0000","last_change":"2023-11-26T07:11:34.637021+0000","last_active":"2023-11-26T07:11:36.987146+0000","last_peered":"2023-11-26T07:11:36.987146+0000","last_clean":"2023-11-26T07:11:36.987146+0000","last_became_active":"2023-11-26T07:11:34.636666+0000","last_became_peered":"2023-11-26T07:11:34.636666+0000","last_unstale":"2023-11-26T07:11:36.987146+0000","last_undegraded":"2023-11-26T07:11:36.987146+0000","last_fullsized":"2023-11-26T07:11:36.987146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:07:08.839200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.639275+0000","last_change":"2023-11-26T07:11:34.647792+0000","last_active":"2023-11-26T07:11:35.639275+0000","last_peered":"2023-11-26T07:11:35.639275+0000","last_clean":"2023-11-26T07:11:35.639275+0000","last_became_active":"2023-11-26T07:11:34.647409+0000","last_became_peered":"2023-11-26T07:11:34.647409+0000","last_unstale":"2023-11-26T07:11:35.639275+0000","last_undegraded":"2023-11-26T07:11:35.639275+0000","last_fullsized":"2023-11-26T07:11:35.639275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:41:41.780777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.602151+0000","last_change":"2023-11-26T07:11:34.645909+0000","last_active":"2023-11-26T07:11:37.602151+0000","last_peered":"2023-11-26T07:11:37.602151+0000","last_clean":"2023-11-26T07:11:37.602151+0000","last_became_active":"2023-11-26T07:11:34.645102+0000","last_became_peered":"2023-11-26T07:11:34.645102+0000","last_unstale":"2023-11-26T07:11:37.602151+0000","last_undegraded":"2023-11-26T07:11:37.602151+0000","last_fullsized":"2023-11-26T07:11:37.602151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:38:10.530811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.638941+0000","last_change":"2023-11-26T07:11:34.648690+0000","last_active":"2023-11-26T07:11:35.638941+0000","last_peered":"2023-11-26T07:11:35.638941+0000","last_clean":"2023-11-26T07:11:35.638941+0000","last_became_active":"2023-11-26T07:11:34.648021+0000","last_became_peered":"2023-11-26T07:11:34.648021+0000","last_unstale":"2023-11-26T07:11:35.638941+0000","last_undegraded":"2023-11-26T07:11:35.638941+0000","last_fullsized":"2023-11-26T07:11:35.638941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:32:03.590472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.601962+0000","last_change":"2023-11-26T07:11:34.635808+0000","last_active":"2023-11-26T07:11:37.601962+0000","last_peered":"2023-11-26T07:11:37.601962+0000","last_clean":"2023-11-26T07:11:37.601962+0000","last_became_active":"2023-11-26T07:11:34.635521+0000","last_became_peered":"2023-11-26T07:11:34.635521+0000","last_unstale":"2023-11-26T07:11:37.601962+0000","last_undegraded":"2023-11-26T07:11:37.601962+0000","last_fullsized":"2023-11-26T07:11:37.601962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:32:36.834153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.014983+0000","last_change":"2023-11-26T07:11:34.649016+0000","last_active":"2023-11-26T07:11:37.014983+0000","last_peered":"2023-11-26T07:11:37.014983+0000","last_clean":"2023-11-26T07:11:37.014983+0000","last_became_active":"2023-11-26T07:11:34.648684+0000","last_became_peered":"2023-11-26T07:11:34.648684+0000","last_unstale":"2023-11-26T07:11:37.014983+0000","last_undegraded":"2023-11-26T07:11:37.014983+0000","last_fullsized":"2023-11-26T07:11:37.014983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:34:27.129920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.602819+0000","last_change":"2023-11-26T07:11:34.647310+0000","last_active":"2023-11-26T07:11:37.602819+0000","last_peered":"2023-11-26T07:11:37.602819+0000","last_clean":"2023-11-26T07:11:37.602819+0000","last_became_active":"2023-11-26T07:11:34.646750+0000","last_became_peered":"2023-11-26T07:11:34.646750+0000","last_unstale":"2023-11-26T07:11:37.602819+0000","last_undegraded":"2023-11-26T07:11:37.602819+0000","last_fullsized":"2023-11-26T07:11:37.602819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:10:28.948434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052935+0000","last_change":"2023-11-26T07:11:34.648387+0000","last_active":"2023-11-26T07:11:37.052935+0000","last_peered":"2023-11-26T07:11:37.052935+0000","last_clean":"2023-11-26T07:11:37.052935+0000","last_became_active":"2023-11-26T07:11:34.646866+0000","last_became_peered":"2023-11-26T07:11:34.646866+0000","last_unstale":"2023-11-26T07:11:37.052935+0000","last_undegraded":"2023-11-26T07:11:37.052935+0000","last_fullsized":"2023-11-26T07:11:37.052935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:32:03.590472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052752+0000","last_change":"2023-11-26T07:11:34.648155+0000","last_active":"2023-11-26T07:11:37.052752+0000","last_peered":"2023-11-26T07:11:37.052752+0000","last_clean":"2023-11-26T07:11:37.052752+0000","last_became_active":"2023-11-26T07:11:34.647811+0000","last_became_peered":"2023-11-26T07:11:34.647811+0000","last_unstale":"2023-11-26T07:11:37.052752+0000","last_undegraded":"2023-11-26T07:11:37.052752+0000","last_fullsized":"2023-11-26T07:11:37.052752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:03:49.221463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.641148+0000","last_change":"2023-11-26T07:11:34.655197+0000","last_active":"2023-11-26T07:11:35.641148+0000","last_peered":"2023-11-26T07:11:35.641148+0000","last_clean":"2023-11-26T07:11:35.641148+0000","last_became_active":"2023-11-26T07:11:34.654929+0000","last_became_peered":"2023-11-26T07:11:34.654929+0000","last_unstale":"2023-11-26T07:11:35.641148+0000","last_undegraded":"2023-11-26T07:11:35.641148+0000","last_fullsized":"2023-11-26T07:11:35.641148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:13:11.105677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015134+0000","last_change":"2023-11-26T07:11:34.649022+0000","last_active":"2023-11-26T07:11:37.015134+0000","last_peered":"2023-11-26T07:11:37.015134+0000","last_clean":"2023-11-26T07:11:37.015134+0000","last_became_active":"2023-11-26T07:11:34.648395+0000","last_became_peered":"2023-11-26T07:11:34.648395+0000","last_unstale":"2023-11-26T07:11:37.015134+0000","last_undegraded":"2023-11-26T07:11:37.015134+0000","last_fullsized":"2023-11-26T07:11:37.015134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:00:10.960837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.986910+0000","last_change":"2023-11-26T07:11:34.637714+0000","last_active":"2023-11-26T07:11:36.986910+0000","last_peered":"2023-11-26T07:11:36.986910+0000","last_clean":"2023-11-26T07:11:36.986910+0000","last_became_active":"2023-11-26T07:11:34.637398+0000","last_became_peered":"2023-11-26T07:11:34.637398+0000","last_unstale":"2023-11-26T07:11:36.986910+0000","last_undegraded":"2023-11-26T07:11:36.986910+0000","last_fullsized":"2023-11-26T07:11:36.986910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:27:38.431121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.545912+0000","last_change":"2023-11-26T07:11:34.653279+0000","last_active":"2023-11-26T07:11:37.545912+0000","last_peered":"2023-11-26T07:11:37.545912+0000","last_clean":"2023-11-26T07:11:37.545912+0000","last_became_active":"2023-11-26T07:11:34.652965+0000","last_became_peered":"2023-11-26T07:11:34.652965+0000","last_unstale":"2023-11-26T07:11:37.545912+0000","last_undegraded":"2023-11-26T07:11:37.545912+0000","last_fullsized":"2023-11-26T07:11:37.545912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:03:49.221463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.638623+0000","last_change":"2023-11-26T07:11:34.644467+0000","last_active":"2023-11-26T07:11:35.638623+0000","last_peered":"2023-11-26T07:11:35.638623+0000","last_clean":"2023-11-26T07:11:35.638623+0000","last_became_active":"2023-11-26T07:11:34.644215+0000","last_became_peered":"2023-11-26T07:11:34.644215+0000","last_unstale":"2023-11-26T07:11:35.638623+0000","last_undegraded":"2023-11-26T07:11:35.638623+0000","last_fullsized":"2023-11-26T07:11:35.638623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:09:14.653647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.639493+0000","last_change":"2023-11-26T07:11:34.646080+0000","last_active":"2023-11-26T07:11:35.639493+0000","last_peered":"2023-11-26T07:11:35.639493+0000","last_clean":"2023-11-26T07:11:35.639493+0000","last_became_active":"2023-11-26T07:11:34.645810+0000","last_became_peered":"2023-11-26T07:11:34.645810+0000","last_unstale":"2023-11-26T07:11:35.639493+0000","last_undegraded":"2023-11-26T07:11:35.639493+0000","last_fullsized":"2023-11-26T07:11:35.639493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:03:47.829221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.602148+0000","last_change":"2023-11-26T07:11:34.650792+0000","last_active":"2023-11-26T07:11:37.602148+0000","last_peered":"2023-11-26T07:11:37.602148+0000","last_clean":"2023-11-26T07:11:37.602148+0000","last_became_active":"2023-11-26T07:11:34.650453+0000","last_became_peered":"2023-11-26T07:11:34.650453+0000","last_unstale":"2023-11-26T07:11:37.602148+0000","last_undegraded":"2023-11-26T07:11:37.602148+0000","last_fullsized":"2023-11-26T07:11:37.602148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:57:30.265272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.602290+0000","last_change":"2023-11-26T07:11:34.642316+0000","last_active":"2023-11-26T07:11:37.602290+0000","last_peered":"2023-11-26T07:11:37.602290+0000","last_clean":"2023-11-26T07:11:37.602290+0000","last_became_active":"2023-11-26T07:11:34.641966+0000","last_became_peered":"2023-11-26T07:11:34.641966+0000","last_unstale":"2023-11-26T07:11:37.602290+0000","last_undegraded":"2023-11-26T07:11:37.602290+0000","last_fullsized":"2023-11-26T07:11:37.602290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:03:47.829221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.987157+0000","last_change":"2023-11-26T07:11:33.642542+0000","last_active":"2023-11-26T07:11:36.987157+0000","last_peered":"2023-11-26T07:11:36.987157+0000","last_clean":"2023-11-26T07:11:36.987157+0000","last_became_active":"2023-11-26T07:11:33.642294+0000","last_became_peered":"2023-11-26T07:11:33.642294+0000","last_unstale":"2023-11-26T07:11:36.987157+0000","last_undegraded":"2023-11-26T07:11:36.987157+0000","last_fullsized":"2023-11-26T07:11:36.987157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:54:30.329113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015525+0000","last_change":"2023-11-26T07:11:34.649717+0000","last_active":"2023-11-26T07:11:37.015525+0000","last_peered":"2023-11-26T07:11:37.015525+0000","last_clean":"2023-11-26T07:11:37.015525+0000","last_became_active":"2023-11-26T07:11:34.649477+0000","last_became_peered":"2023-11-26T07:11:34.649477+0000","last_unstale":"2023-11-26T07:11:37.015525+0000","last_undegraded":"2023-11-26T07:11:37.015525+0000","last_fullsized":"2023-11-26T07:11:37.015525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:38:10.530811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015483+0000","last_change":"2023-11-26T07:11:33.645915+0000","last_active":"2023-11-26T07:11:37.015483+0000","last_peered":"2023-11-26T07:11:37.015483+0000","last_clean":"2023-11-26T07:11:37.015483+0000","last_became_active":"2023-11-26T07:11:33.645603+0000","last_became_peered":"2023-11-26T07:11:33.645603+0000","last_unstale":"2023-11-26T07:11:37.015483+0000","last_undegraded":"2023-11-26T07:11:37.015483+0000","last_fullsized":"2023-11-26T07:11:37.015483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:54:30.329113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.987052+0000","last_change":"2023-11-26T07:11:34.648199+0000","last_active":"2023-11-26T07:11:36.987052+0000","last_peered":"2023-11-26T07:11:36.987052+0000","last_clean":"2023-11-26T07:11:36.987052+0000","last_became_active":"2023-11-26T07:11:34.647906+0000","last_became_peered":"2023-11-26T07:11:34.647906+0000","last_unstale":"2023-11-26T07:11:36.987052+0000","last_undegraded":"2023-11-26T07:11:36.987052+0000","last_fullsized":"2023-11-26T07:11:36.987052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:34:27.129920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.209910+0000","last_change":"2023-11-26T07:11:33.643750+0000","last_active":"2023-11-26T07:11:37.209910+0000","last_peered":"2023-11-26T07:11:37.209910+0000","last_clean":"2023-11-26T07:11:37.209910+0000","last_became_active":"2023-11-26T07:11:33.643485+0000","last_became_peered":"2023-11-26T07:11:33.643485+0000","last_unstale":"2023-11-26T07:11:37.209910+0000","last_undegraded":"2023-11-26T07:11:37.209910+0000","last_fullsized":"2023-11-26T07:11:37.209910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:00:09.955548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.639381+0000","last_change":"2023-11-26T07:11:34.654171+0000","last_active":"2023-11-26T07:11:35.639381+0000","last_peered":"2023-11-26T07:11:35.639381+0000","last_clean":"2023-11-26T07:11:35.639381+0000","last_became_active":"2023-11-26T07:11:34.653773+0000","last_became_peered":"2023-11-26T07:11:34.653773+0000","last_unstale":"2023-11-26T07:11:35.639381+0000","last_undegraded":"2023-11-26T07:11:35.639381+0000","last_fullsized":"2023-11-26T07:11:35.639381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:16:17.444687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.209854+0000","last_change":"2023-11-26T07:11:33.643355+0000","last_active":"2023-11-26T07:11:37.209854+0000","last_peered":"2023-11-26T07:11:37.209854+0000","last_clean":"2023-11-26T07:11:37.209854+0000","last_became_active":"2023-11-26T07:11:33.643024+0000","last_became_peered":"2023-11-26T07:11:33.643024+0000","last_unstale":"2023-11-26T07:11:37.209854+0000","last_undegraded":"2023-11-26T07:11:37.209854+0000","last_fullsized":"2023-11-26T07:11:37.209854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:35:23.512252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.639894+0000","last_change":"2023-11-26T07:11:34.645965+0000","last_active":"2023-11-26T07:11:35.639894+0000","last_peered":"2023-11-26T07:11:35.639894+0000","last_clean":"2023-11-26T07:11:35.639894+0000","last_became_active":"2023-11-26T07:11:34.645636+0000","last_became_peered":"2023-11-26T07:11:34.645636+0000","last_unstale":"2023-11-26T07:11:35.639894+0000","last_undegraded":"2023-11-26T07:11:35.639894+0000","last_fullsized":"2023-11-26T07:11:35.639894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:42:53.462266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015241+0000","last_change":"2023-11-26T07:11:33.637866+0000","last_active":"2023-11-26T07:11:37.015241+0000","last_peered":"2023-11-26T07:11:37.015241+0000","last_clean":"2023-11-26T07:11:37.015241+0000","last_became_active":"2023-11-26T07:11:33.637478+0000","last_became_peered":"2023-11-26T07:11:33.637478+0000","last_unstale":"2023-11-26T07:11:37.015241+0000","last_undegraded":"2023-11-26T07:11:37.015241+0000","last_fullsized":"2023-11-26T07:11:37.015241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:46:01.876918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.640773+0000","last_change":"2023-11-26T07:11:34.636381+0000","last_active":"2023-11-26T07:11:35.640773+0000","last_peered":"2023-11-26T07:11:35.640773+0000","last_clean":"2023-11-26T07:11:35.640773+0000","last_became_active":"2023-11-26T07:11:34.636118+0000","last_became_peered":"2023-11-26T07:11:34.636118+0000","last_unstale":"2023-11-26T07:11:35.640773+0000","last_undegraded":"2023-11-26T07:11:35.640773+0000","last_fullsized":"2023-11-26T07:11:35.640773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:15:28.976045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052636+0000","last_change":"2023-11-26T07:11:33.638305+0000","last_active":"2023-11-26T07:11:37.052636+0000","last_peered":"2023-11-26T07:11:37.052636+0000","last_clean":"2023-11-26T07:11:37.052636+0000","last_became_active":"2023-11-26T07:11:33.637988+0000","last_became_peered":"2023-11-26T07:11:33.637988+0000","last_unstale":"2023-11-26T07:11:37.052636+0000","last_undegraded":"2023-11-26T07:11:37.052636+0000","last_fullsized":"2023-11-26T07:11:37.052636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:13:10.100388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.987409+0000","last_change":"2023-11-26T07:11:34.656184+0000","last_active":"2023-11-26T07:11:36.987409+0000","last_peered":"2023-11-26T07:11:36.987409+0000","last_clean":"2023-11-26T07:11:36.987409+0000","last_became_active":"2023-11-26T07:11:34.655583+0000","last_became_peered":"2023-11-26T07:11:34.655583+0000","last_unstale":"2023-11-26T07:11:36.987409+0000","last_undegraded":"2023-11-26T07:11:36.987409+0000","last_fullsized":"2023-11-26T07:11:36.987409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:32:03.590472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015050+0000","last_change":"2023-11-26T07:11:33.644381+0000","last_active":"2023-11-26T07:11:37.015050+0000","last_peered":"2023-11-26T07:11:37.015050+0000","last_clean":"2023-11-26T07:11:37.015050+0000","last_became_active":"2023-11-26T07:11:33.643634+0000","last_became_peered":"2023-11-26T07:11:33.643634+0000","last_unstale":"2023-11-26T07:11:37.015050+0000","last_undegraded":"2023-11-26T07:11:37.015050+0000","last_fullsized":"2023-11-26T07:11:37.015050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:37:22.209157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015147+0000","last_change":"2023-11-26T07:11:34.643595+0000","last_active":"2023-11-26T07:11:37.015147+0000","last_peered":"2023-11-26T07:11:37.015147+0000","last_clean":"2023-11-26T07:11:37.015147+0000","last_became_active":"2023-11-26T07:11:34.642017+0000","last_became_peered":"2023-11-26T07:11:34.642017+0000","last_unstale":"2023-11-26T07:11:37.015147+0000","last_undegraded":"2023-11-26T07:11:37.015147+0000","last_fullsized":"2023-11-26T07:11:37.015147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:09:14.653647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.638837+0000","last_change":"2023-11-26T07:11:33.634859+0000","last_active":"2023-11-26T07:11:35.638837+0000","last_peered":"2023-11-26T07:11:35.638837+0000","last_clean":"2023-11-26T07:11:35.638837+0000","last_became_active":"2023-11-26T07:11:33.634445+0000","last_became_peered":"2023-11-26T07:11:33.634445+0000","last_unstale":"2023-11-26T07:11:35.638837+0000","last_undegraded":"2023-11-26T07:11:35.638837+0000","last_fullsized":"2023-11-26T07:11:35.638837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:27:37.425832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.546094+0000","last_change":"2023-11-26T07:11:34.641077+0000","last_active":"2023-11-26T07:11:37.546094+0000","last_peered":"2023-11-26T07:11:37.546094+0000","last_clean":"2023-11-26T07:11:37.546094+0000","last_became_active":"2023-11-26T07:11:34.640778+0000","last_became_peered":"2023-11-26T07:11:34.640778+0000","last_unstale":"2023-11-26T07:11:37.546094+0000","last_undegraded":"2023-11-26T07:11:37.546094+0000","last_fullsized":"2023-11-26T07:11:37.546094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:07:08.839200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052858+0000","last_change":"2023-11-26T07:11:33.643806+0000","last_active":"2023-11-26T07:11:37.052858+0000","last_peered":"2023-11-26T07:11:37.052858+0000","last_clean":"2023-11-26T07:11:37.052858+0000","last_became_active":"2023-11-26T07:11:33.643066+0000","last_became_peered":"2023-11-26T07:11:33.643066+0000","last_unstale":"2023-11-26T07:11:37.052858+0000","last_undegraded":"2023-11-26T07:11:37.052858+0000","last_fullsized":"2023-11-26T07:11:37.052858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:54:30.329113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.639314+0000","last_change":"2023-11-26T07:11:34.642427+0000","last_active":"2023-11-26T07:11:35.639314+0000","last_peered":"2023-11-26T07:11:35.639314+0000","last_clean":"2023-11-26T07:11:35.639314+0000","last_became_active":"2023-11-26T07:11:34.642161+0000","last_became_peered":"2023-11-26T07:11:34.642161+0000","last_unstale":"2023-11-26T07:11:35.639314+0000","last_undegraded":"2023-11-26T07:11:35.639314+0000","last_fullsized":"2023-11-26T07:11:35.639314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:38:10.530811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.639263+0000","last_change":"2023-11-26T07:11:33.638930+0000","last_active":"2023-11-26T07:11:35.639263+0000","last_peered":"2023-11-26T07:11:35.639263+0000","last_clean":"2023-11-26T07:11:35.639263+0000","last_became_active":"2023-11-26T07:11:33.638636+0000","last_became_peered":"2023-11-26T07:11:33.638636+0000","last_unstale":"2023-11-26T07:11:35.639263+0000","last_undegraded":"2023-11-26T07:11:35.639263+0000","last_fullsized":"2023-11-26T07:11:35.639263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:54:30.329113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.987164+0000","last_change":"2023-11-26T07:11:34.648049+0000","last_active":"2023-11-26T07:11:36.987164+0000","last_peered":"2023-11-26T07:11:36.987164+0000","last_clean":"2023-11-26T07:11:36.987164+0000","last_became_active":"2023-11-26T07:11:34.647530+0000","last_became_peered":"2023-11-26T07:11:34.647530+0000","last_unstale":"2023-11-26T07:11:36.987164+0000","last_undegraded":"2023-11-26T07:11:36.987164+0000","last_fullsized":"2023-11-26T07:11:36.987164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:00:10.960837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.212139+0000","last_change":"2023-11-26T07:11:33.641284+0000","last_active":"2023-11-26T07:11:37.212139+0000","last_peered":"2023-11-26T07:11:37.212139+0000","last_clean":"2023-11-26T07:11:37.212139+0000","last_became_active":"2023-11-26T07:11:33.640977+0000","last_became_peered":"2023-11-26T07:11:33.640977+0000","last_unstale":"2023-11-26T07:11:37.212139+0000","last_undegraded":"2023-11-26T07:11:37.212139+0000","last_fullsized":"2023-11-26T07:11:37.212139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:27:37.425832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.641110+0000","last_change":"2023-11-26T07:11:34.655028+0000","last_active":"2023-11-26T07:11:35.641110+0000","last_peered":"2023-11-26T07:11:35.641110+0000","last_clean":"2023-11-26T07:11:35.641110+0000","last_became_active":"2023-11-26T07:11:34.654675+0000","last_became_peered":"2023-11-26T07:11:34.654675+0000","last_unstale":"2023-11-26T07:11:35.641110+0000","last_undegraded":"2023-11-26T07:11:35.641110+0000","last_fullsized":"2023-11-26T07:11:35.641110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:57:30.265272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052750+0000","last_change":"2023-11-26T07:11:33.640407+0000","last_active":"2023-11-26T07:11:37.052750+0000","last_peered":"2023-11-26T07:11:37.052750+0000","last_clean":"2023-11-26T07:11:37.052750+0000","last_became_active":"2023-11-26T07:11:33.640092+0000","last_became_peered":"2023-11-26T07:11:33.640092+0000","last_unstale":"2023-11-26T07:11:37.052750+0000","last_undegraded":"2023-11-26T07:11:37.052750+0000","last_fullsized":"2023-11-26T07:11:37.052750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:37:22.209157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.602271+0000","last_change":"2023-11-26T07:11:34.645251+0000","last_active":"2023-11-26T07:11:37.602271+0000","last_peered":"2023-11-26T07:11:37.602271+0000","last_clean":"2023-11-26T07:11:37.602271+0000","last_became_active":"2023-11-26T07:11:34.644995+0000","last_became_peered":"2023-11-26T07:11:34.644995+0000","last_unstale":"2023-11-26T07:11:37.602271+0000","last_undegraded":"2023-11-26T07:11:37.602271+0000","last_fullsized":"2023-11-26T07:11:37.602271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:16:17.444687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.987292+0000","last_change":"2023-11-26T07:11:33.639952+0000","last_active":"2023-11-26T07:11:36.987292+0000","last_peered":"2023-11-26T07:11:36.987292+0000","last_clean":"2023-11-26T07:11:36.987292+0000","last_became_active":"2023-11-26T07:11:33.639660+0000","last_became_peered":"2023-11-26T07:11:33.639660+0000","last_unstale":"2023-11-26T07:11:36.987292+0000","last_undegraded":"2023-11-26T07:11:36.987292+0000","last_fullsized":"2023-11-26T07:11:36.987292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:35:23.512252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.986952+0000","last_change":"2023-11-26T07:11:34.642918+0000","last_active":"2023-11-26T07:11:36.986952+0000","last_peered":"2023-11-26T07:11:36.986952+0000","last_clean":"2023-11-26T07:11:36.986952+0000","last_became_active":"2023-11-26T07:11:34.642455+0000","last_became_peered":"2023-11-26T07:11:34.642455+0000","last_unstale":"2023-11-26T07:11:36.986952+0000","last_undegraded":"2023-11-26T07:11:36.986952+0000","last_fullsized":"2023-11-26T07:11:36.986952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:44:14.102458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.639215+0000","last_change":"2023-11-26T07:11:33.643793+0000","last_active":"2023-11-26T07:11:35.639215+0000","last_peered":"2023-11-26T07:11:35.639215+0000","last_clean":"2023-11-26T07:11:35.639215+0000","last_became_active":"2023-11-26T07:11:33.643494+0000","last_became_peered":"2023-11-26T07:11:33.643494+0000","last_unstale":"2023-11-26T07:11:35.639215+0000","last_undegraded":"2023-11-26T07:11:35.639215+0000","last_fullsized":"2023-11-26T07:11:35.639215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:00:09.955548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.602224+0000","last_change":"2023-11-26T07:11:34.655763+0000","last_active":"2023-11-26T07:11:37.602224+0000","last_peered":"2023-11-26T07:11:37.602224+0000","last_clean":"2023-11-26T07:11:37.602224+0000","last_became_active":"2023-11-26T07:11:34.655507+0000","last_became_peered":"2023-11-26T07:11:34.655507+0000","last_unstale":"2023-11-26T07:11:37.602224+0000","last_undegraded":"2023-11-26T07:11:37.602224+0000","last_fullsized":"2023-11-26T07:11:37.602224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:41:41.780777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052504+0000","last_change":"2023-11-26T07:11:33.635838+0000","last_active":"2023-11-26T07:11:37.052504+0000","last_peered":"2023-11-26T07:11:37.052504+0000","last_clean":"2023-11-26T07:11:37.052504+0000","last_became_active":"2023-11-26T07:11:33.635540+0000","last_became_peered":"2023-11-26T07:11:33.635540+0000","last_unstale":"2023-11-26T07:11:37.052504+0000","last_undegraded":"2023-11-26T07:11:37.052504+0000","last_fullsized":"2023-11-26T07:11:37.052504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:54:55.356034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052841+0000","last_change":"2023-11-26T07:11:34.648800+0000","last_active":"2023-11-26T07:11:37.052841+0000","last_peered":"2023-11-26T07:11:37.052841+0000","last_clean":"2023-11-26T07:11:37.052841+0000","last_became_active":"2023-11-26T07:11:34.648164+0000","last_became_peered":"2023-11-26T07:11:34.648164+0000","last_unstale":"2023-11-26T07:11:37.052841+0000","last_undegraded":"2023-11-26T07:11:37.052841+0000","last_fullsized":"2023-11-26T07:11:37.052841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:09:14.653647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.210999+0000","last_change":"2023-11-26T07:11:33.638974+0000","last_active":"2023-11-26T07:11:37.210999+0000","last_peered":"2023-11-26T07:11:37.210999+0000","last_clean":"2023-11-26T07:11:37.210999+0000","last_became_active":"2023-11-26T07:11:33.638589+0000","last_became_peered":"2023-11-26T07:11:33.638589+0000","last_unstale":"2023-11-26T07:11:37.210999+0000","last_undegraded":"2023-11-26T07:11:37.210999+0000","last_fullsized":"2023-11-26T07:11:37.210999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:15:27.970756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.602107+0000","last_change":"2023-11-26T07:11:34.642385+0000","last_active":"2023-11-26T07:11:37.602107+0000","last_peered":"2023-11-26T07:11:37.602107+0000","last_clean":"2023-11-26T07:11:37.602107+0000","last_became_active":"2023-11-26T07:11:34.642090+0000","last_became_peered":"2023-11-26T07:11:34.642090+0000","last_unstale":"2023-11-26T07:11:37.602107+0000","last_undegraded":"2023-11-26T07:11:37.602107+0000","last_fullsized":"2023-11-26T07:11:37.602107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:25:36.494823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.641145+0000","last_change":"2023-11-26T07:11:33.637520+0000","last_active":"2023-11-26T07:11:35.641145+0000","last_peered":"2023-11-26T07:11:35.641145+0000","last_clean":"2023-11-26T07:11:35.641145+0000","last_became_active":"2023-11-26T07:11:33.637255+0000","last_became_peered":"2023-11-26T07:11:33.637255+0000","last_unstale":"2023-11-26T07:11:35.641145+0000","last_undegraded":"2023-11-26T07:11:35.641145+0000","last_fullsized":"2023-11-26T07:11:35.641145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:49:33.039159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.602407+0000","last_change":"2023-11-26T07:11:34.642552+0000","last_active":"2023-11-26T07:11:37.602407+0000","last_peered":"2023-11-26T07:11:37.602407+0000","last_clean":"2023-11-26T07:11:37.602407+0000","last_became_active":"2023-11-26T07:11:34.642252+0000","last_became_peered":"2023-11-26T07:11:34.642252+0000","last_unstale":"2023-11-26T07:11:37.602407+0000","last_undegraded":"2023-11-26T07:11:37.602407+0000","last_fullsized":"2023-11-26T07:11:37.602407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:47:06.786241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.212100+0000","last_change":"2023-11-26T07:11:33.645907+0000","last_active":"2023-11-26T07:11:37.212100+0000","last_peered":"2023-11-26T07:11:37.212100+0000","last_clean":"2023-11-26T07:11:37.212100+0000","last_became_active":"2023-11-26T07:11:33.645612+0000","last_became_peered":"2023-11-26T07:11:33.645612+0000","last_unstale":"2023-11-26T07:11:37.212100+0000","last_undegraded":"2023-11-26T07:11:37.212100+0000","last_fullsized":"2023-11-26T07:11:37.212100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:15:27.970756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.639689+0000","last_change":"2023-11-26T07:11:34.646582+0000","last_active":"2023-11-26T07:11:35.639689+0000","last_peered":"2023-11-26T07:11:35.639689+0000","last_clean":"2023-11-26T07:11:35.639689+0000","last_became_active":"2023-11-26T07:11:34.646107+0000","last_became_peered":"2023-11-26T07:11:34.646107+0000","last_unstale":"2023-11-26T07:11:35.639689+0000","last_undegraded":"2023-11-26T07:11:35.639689+0000","last_fullsized":"2023-11-26T07:11:35.639689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:36:07.899873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.639090+0000","last_change":"2023-11-26T07:11:33.635282+0000","last_active":"2023-11-26T07:11:35.639090+0000","last_peered":"2023-11-26T07:11:35.639090+0000","last_clean":"2023-11-26T07:11:35.639090+0000","last_became_active":"2023-11-26T07:11:33.634993+0000","last_became_peered":"2023-11-26T07:11:33.634993+0000","last_unstale":"2023-11-26T07:11:35.639090+0000","last_undegraded":"2023-11-26T07:11:35.639090+0000","last_fullsized":"2023-11-26T07:11:35.639090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:07:07.833911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.641041+0000","last_change":"2023-11-26T07:11:34.642107+0000","last_active":"2023-11-26T07:11:35.641041+0000","last_peered":"2023-11-26T07:11:35.641041+0000","last_clean":"2023-11-26T07:11:35.641041+0000","last_became_active":"2023-11-26T07:11:34.641849+0000","last_became_peered":"2023-11-26T07:11:34.641849+0000","last_unstale":"2023-11-26T07:11:35.641041+0000","last_undegraded":"2023-11-26T07:11:35.641041+0000","last_fullsized":"2023-11-26T07:11:35.641041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:35:24.517541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.545954+0000","last_change":"2023-11-26T07:11:34.637097+0000","last_active":"2023-11-26T07:11:37.545954+0000","last_peered":"2023-11-26T07:11:37.545954+0000","last_clean":"2023-11-26T07:11:37.545954+0000","last_became_active":"2023-11-26T07:11:34.636788+0000","last_became_peered":"2023-11-26T07:11:34.636788+0000","last_unstale":"2023-11-26T07:11:37.545954+0000","last_undegraded":"2023-11-26T07:11:37.545954+0000","last_fullsized":"2023-11-26T07:11:37.545954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:34:27.129920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.211022+0000","last_change":"2023-11-26T07:11:33.641738+0000","last_active":"2023-11-26T07:11:37.211022+0000","last_peered":"2023-11-26T07:11:37.211022+0000","last_clean":"2023-11-26T07:11:37.211022+0000","last_became_active":"2023-11-26T07:11:33.641410+0000","last_became_peered":"2023-11-26T07:11:33.641410+0000","last_unstale":"2023-11-26T07:11:37.211022+0000","last_undegraded":"2023-11-26T07:11:37.211022+0000","last_fullsized":"2023-11-26T07:11:37.211022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:17:54.783415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015213+0000","last_change":"2023-11-26T07:11:34.652603+0000","last_active":"2023-11-26T07:11:37.015213+0000","last_peered":"2023-11-26T07:11:37.015213+0000","last_clean":"2023-11-26T07:11:37.015213+0000","last_became_active":"2023-11-26T07:11:34.652141+0000","last_became_peered":"2023-11-26T07:11:34.652141+0000","last_unstale":"2023-11-26T07:11:37.015213+0000","last_undegraded":"2023-11-26T07:11:37.015213+0000","last_fullsized":"2023-11-26T07:11:37.015213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:06:28.926253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.638715+0000","last_change":"2023-11-26T07:11:33.634157+0000","last_active":"2023-11-26T07:11:35.638715+0000","last_peered":"2023-11-26T07:11:35.638715+0000","last_clean":"2023-11-26T07:11:35.638715+0000","last_became_active":"2023-11-26T07:11:33.633464+0000","last_became_peered":"2023-11-26T07:11:33.633464+0000","last_unstale":"2023-11-26T07:11:35.638715+0000","last_undegraded":"2023-11-26T07:11:35.638715+0000","last_fullsized":"2023-11-26T07:11:35.638715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:15:27.970756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:34.630056+0000","last_change":"2023-11-26T07:11:29.855919+0000","last_active":"2023-11-26T07:11:34.630056+0000","last_peered":"2023-11-26T07:11:34.630056+0000","last_clean":"2023-11-26T07:11:34.630056+0000","last_became_active":"2023-11-26T07:11:29.854903+0000","last_became_peered":"2023-11-26T07:11:29.854903+0000","last_unstale":"2023-11-26T07:11:34.630056+0000","last_undegraded":"2023-11-26T07:11:34.630056+0000","last_fullsized":"2023-11-26T07:11:34.630056+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:28.594252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:28.594252+0000","last_clean_scrub_stamp":"2023-11-26T07:11:28.594252+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:33:34.642696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.986872+0000","last_change":"2023-11-26T07:11:34.655445+0000","last_active":"2023-11-26T07:11:36.986872+0000","last_peered":"2023-11-26T07:11:36.986872+0000","last_clean":"2023-11-26T07:11:36.986872+0000","last_became_active":"2023-11-26T07:11:34.655111+0000","last_became_peered":"2023-11-26T07:11:34.655111+0000","last_unstale":"2023-11-26T07:11:36.986872+0000","last_undegraded":"2023-11-26T07:11:36.986872+0000","last_fullsized":"2023-11-26T07:11:36.986872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:54:56.361323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.209771+0000","last_change":"2023-11-26T07:11:33.640738+0000","last_active":"2023-11-26T07:11:37.209771+0000","last_peered":"2023-11-26T07:11:37.209771+0000","last_clean":"2023-11-26T07:11:37.209771+0000","last_became_active":"2023-11-26T07:11:33.640515+0000","last_became_peered":"2023-11-26T07:11:33.640515+0000","last_unstale":"2023-11-26T07:11:37.209771+0000","last_undegraded":"2023-11-26T07:11:37.209771+0000","last_fullsized":"2023-11-26T07:11:37.209771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:46:01.876918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.209900+0000","last_change":"2023-11-26T07:11:33.643235+0000","last_active":"2023-11-26T07:11:37.209900+0000","last_peered":"2023-11-26T07:11:37.209900+0000","last_clean":"2023-11-26T07:11:37.209900+0000","last_became_active":"2023-11-26T07:11:33.642977+0000","last_became_peered":"2023-11-26T07:11:33.642977+0000","last_unstale":"2023-11-26T07:11:37.209900+0000","last_undegraded":"2023-11-26T07:11:37.209900+0000","last_fullsized":"2023-11-26T07:11:37.209900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:03:48.216174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.546188+0000","last_change":"2023-11-26T07:11:34.636261+0000","last_active":"2023-11-26T07:11:37.546188+0000","last_peered":"2023-11-26T07:11:37.546188+0000","last_clean":"2023-11-26T07:11:37.546188+0000","last_became_active":"2023-11-26T07:11:34.635958+0000","last_became_peered":"2023-11-26T07:11:34.635958+0000","last_unstale":"2023-11-26T07:11:37.546188+0000","last_undegraded":"2023-11-26T07:11:37.546188+0000","last_fullsized":"2023-11-26T07:11:37.546188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:09:14.653647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.546172+0000","last_change":"2023-11-26T07:11:33.643565+0000","last_active":"2023-11-26T07:11:37.546172+0000","last_peered":"2023-11-26T07:11:37.546172+0000","last_clean":"2023-11-26T07:11:37.546172+0000","last_became_active":"2023-11-26T07:11:33.643189+0000","last_became_peered":"2023-11-26T07:11:33.643189+0000","last_unstale":"2023-11-26T07:11:37.546172+0000","last_undegraded":"2023-11-26T07:11:37.546172+0000","last_fullsized":"2023-11-26T07:11:37.546172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:57:29.259984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015485+0000","last_change":"2023-11-26T07:11:34.645591+0000","last_active":"2023-11-26T07:11:37.015485+0000","last_peered":"2023-11-26T07:11:37.015485+0000","last_clean":"2023-11-26T07:11:37.015485+0000","last_became_active":"2023-11-26T07:11:34.645274+0000","last_became_peered":"2023-11-26T07:11:34.645274+0000","last_unstale":"2023-11-26T07:11:37.015485+0000","last_undegraded":"2023-11-26T07:11:37.015485+0000","last_fullsized":"2023-11-26T07:11:37.015485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:41:41.780777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052771+0000","last_change":"2023-11-26T07:11:33.638999+0000","last_active":"2023-11-26T07:11:37.052771+0000","last_peered":"2023-11-26T07:11:37.052771+0000","last_clean":"2023-11-26T07:11:37.052771+0000","last_became_active":"2023-11-26T07:11:33.638743+0000","last_became_peered":"2023-11-26T07:11:33.638743+0000","last_unstale":"2023-11-26T07:11:37.052771+0000","last_undegraded":"2023-11-26T07:11:37.052771+0000","last_fullsized":"2023-11-26T07:11:37.052771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:46:01.876918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.987081+0000","last_change":"2023-11-26T07:11:34.637617+0000","last_active":"2023-11-26T07:11:36.987081+0000","last_peered":"2023-11-26T07:11:36.987081+0000","last_clean":"2023-11-26T07:11:36.987081+0000","last_became_active":"2023-11-26T07:11:34.637260+0000","last_became_peered":"2023-11-26T07:11:34.637260+0000","last_unstale":"2023-11-26T07:11:36.987081+0000","last_undegraded":"2023-11-26T07:11:36.987081+0000","last_fullsized":"2023-11-26T07:11:36.987081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:03:49.221463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.209732+0000","last_change":"2023-11-26T07:11:33.642201+0000","last_active":"2023-11-26T07:11:37.209732+0000","last_peered":"2023-11-26T07:11:37.209732+0000","last_clean":"2023-11-26T07:11:37.209732+0000","last_became_active":"2023-11-26T07:11:33.641913+0000","last_became_peered":"2023-11-26T07:11:33.641913+0000","last_unstale":"2023-11-26T07:11:37.209732+0000","last_undegraded":"2023-11-26T07:11:37.209732+0000","last_fullsized":"2023-11-26T07:11:37.209732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:15:27.970756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.640871+0000","last_change":"2023-11-26T07:11:34.641773+0000","last_active":"2023-11-26T07:11:35.640871+0000","last_peered":"2023-11-26T07:11:35.640871+0000","last_clean":"2023-11-26T07:11:35.640871+0000","last_became_active":"2023-11-26T07:11:34.641501+0000","last_became_peered":"2023-11-26T07:11:34.641501+0000","last_unstale":"2023-11-26T07:11:35.640871+0000","last_undegraded":"2023-11-26T07:11:35.640871+0000","last_fullsized":"2023-11-26T07:11:35.640871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:23:13.396432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.212059+0000","last_change":"2023-11-26T07:11:33.637842+0000","last_active":"2023-11-26T07:11:37.212059+0000","last_peered":"2023-11-26T07:11:37.212059+0000","last_clean":"2023-11-26T07:11:37.212059+0000","last_became_active":"2023-11-26T07:11:33.637534+0000","last_became_peered":"2023-11-26T07:11:33.637534+0000","last_unstale":"2023-11-26T07:11:37.212059+0000","last_undegraded":"2023-11-26T07:11:37.212059+0000","last_fullsized":"2023-11-26T07:11:37.212059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:18:52.359254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015004+0000","last_change":"2023-11-26T07:11:34.640101+0000","last_active":"2023-11-26T07:11:37.015004+0000","last_peered":"2023-11-26T07:11:37.015004+0000","last_clean":"2023-11-26T07:11:37.015004+0000","last_became_active":"2023-11-26T07:11:34.639741+0000","last_became_peered":"2023-11-26T07:11:34.639741+0000","last_unstale":"2023-11-26T07:11:37.015004+0000","last_undegraded":"2023-11-26T07:11:37.015004+0000","last_fullsized":"2023-11-26T07:11:37.015004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:03:49.221463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.212078+0000","last_change":"2023-11-26T07:11:33.644068+0000","last_active":"2023-11-26T07:11:37.212078+0000","last_peered":"2023-11-26T07:11:37.212078+0000","last_clean":"2023-11-26T07:11:37.212078+0000","last_became_active":"2023-11-26T07:11:33.643725+0000","last_became_peered":"2023-11-26T07:11:33.643725+0000","last_unstale":"2023-11-26T07:11:37.212078+0000","last_undegraded":"2023-11-26T07:11:37.212078+0000","last_fullsized":"2023-11-26T07:11:37.212078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:35:23.512252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015299+0000","last_change":"2023-11-26T07:11:34.639960+0000","last_active":"2023-11-26T07:11:37.015299+0000","last_peered":"2023-11-26T07:11:37.015299+0000","last_clean":"2023-11-26T07:11:37.015299+0000","last_became_active":"2023-11-26T07:11:34.639582+0000","last_became_peered":"2023-11-26T07:11:34.639582+0000","last_unstale":"2023-11-26T07:11:37.015299+0000","last_undegraded":"2023-11-26T07:11:37.015299+0000","last_fullsized":"2023-11-26T07:11:37.015299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:32:03.590472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.209841+0000","last_change":"2023-11-26T07:11:33.640210+0000","last_active":"2023-11-26T07:11:37.209841+0000","last_peered":"2023-11-26T07:11:37.209841+0000","last_clean":"2023-11-26T07:11:37.209841+0000","last_became_active":"2023-11-26T07:11:33.639920+0000","last_became_peered":"2023-11-26T07:11:33.639920+0000","last_unstale":"2023-11-26T07:11:37.209841+0000","last_undegraded":"2023-11-26T07:11:37.209841+0000","last_fullsized":"2023-11-26T07:11:37.209841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:34:26.124632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052803+0000","last_change":"2023-11-26T07:11:34.654053+0000","last_active":"2023-11-26T07:11:37.052803+0000","last_peered":"2023-11-26T07:11:37.052803+0000","last_clean":"2023-11-26T07:11:37.052803+0000","last_became_active":"2023-11-26T07:11:34.653682+0000","last_became_peered":"2023-11-26T07:11:34.653682+0000","last_unstale":"2023-11-26T07:11:37.052803+0000","last_undegraded":"2023-11-26T07:11:37.052803+0000","last_fullsized":"2023-11-26T07:11:37.052803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:00:10.960837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.211054+0000","last_change":"2023-11-26T07:11:33.641257+0000","last_active":"2023-11-26T07:11:37.211054+0000","last_peered":"2023-11-26T07:11:37.211054+0000","last_clean":"2023-11-26T07:11:37.211054+0000","last_became_active":"2023-11-26T07:11:33.640986+0000","last_became_peered":"2023-11-26T07:11:33.640986+0000","last_unstale":"2023-11-26T07:11:37.211054+0000","last_undegraded":"2023-11-26T07:11:37.211054+0000","last_fullsized":"2023-11-26T07:11:37.211054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:23:12.391144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.602456+0000","last_change":"2023-11-26T07:11:34.648421+0000","last_active":"2023-11-26T07:11:37.602456+0000","last_peered":"2023-11-26T07:11:37.602456+0000","last_clean":"2023-11-26T07:11:37.602456+0000","last_became_active":"2023-11-26T07:11:34.648144+0000","last_became_peered":"2023-11-26T07:11:34.648144+0000","last_unstale":"2023-11-26T07:11:37.602456+0000","last_undegraded":"2023-11-26T07:11:37.602456+0000","last_fullsized":"2023-11-26T07:11:37.602456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:36:07.899873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.212122+0000","last_change":"2023-11-26T07:11:33.635219+0000","last_active":"2023-11-26T07:11:37.212122+0000","last_peered":"2023-11-26T07:11:37.212122+0000","last_clean":"2023-11-26T07:11:37.212122+0000","last_became_active":"2023-11-26T07:11:33.634823+0000","last_became_peered":"2023-11-26T07:11:33.634823+0000","last_unstale":"2023-11-26T07:11:37.212122+0000","last_undegraded":"2023-11-26T07:11:37.212122+0000","last_fullsized":"2023-11-26T07:11:37.212122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:46:01.876918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.639554+0000","last_change":"2023-11-26T07:11:34.647738+0000","last_active":"2023-11-26T07:11:35.639554+0000","last_peered":"2023-11-26T07:11:35.639554+0000","last_clean":"2023-11-26T07:11:35.639554+0000","last_became_active":"2023-11-26T07:11:34.647392+0000","last_became_peered":"2023-11-26T07:11:34.647392+0000","last_unstale":"2023-11-26T07:11:35.639554+0000","last_undegraded":"2023-11-26T07:11:35.639554+0000","last_fullsized":"2023-11-26T07:11:35.639554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:47:06.786241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.211076+0000","last_change":"2023-11-26T07:11:33.640058+0000","last_active":"2023-11-26T07:11:37.211076+0000","last_peered":"2023-11-26T07:11:37.211076+0000","last_clean":"2023-11-26T07:11:37.211076+0000","last_became_active":"2023-11-26T07:11:33.639705+0000","last_became_peered":"2023-11-26T07:11:33.639705+0000","last_unstale":"2023-11-26T07:11:37.211076+0000","last_undegraded":"2023-11-26T07:11:37.211076+0000","last_fullsized":"2023-11-26T07:11:37.211076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:32.610942+0000","last_clean_scrub_stamp":"2023-11-26T07:11:32.610942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:35:23.512252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.602601+0000","last_change":"2023-11-26T07:11:34.644169+0000","last_active":"2023-11-26T07:11:37.602601+0000","last_peered":"2023-11-26T07:11:37.602601+0000","last_clean":"2023-11-26T07:11:37.602601+0000","last_became_active":"2023-11-26T07:11:34.643368+0000","last_became_peered":"2023-11-26T07:11:34.643368+0000","last_unstale":"2023-11-26T07:11:37.602601+0000","last_undegraded":"2023-11-26T07:11:37.602601+0000","last_fullsized":"2023-11-26T07:11:37.602601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:42:53.462266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052532+0000","last_change":"2023-11-26T07:11:34.647950+0000","last_active":"2023-11-26T07:11:37.052532+0000","last_peered":"2023-11-26T07:11:37.052532+0000","last_clean":"2023-11-26T07:11:37.052532+0000","last_became_active":"2023-11-26T07:11:34.647506+0000","last_became_peered":"2023-11-26T07:11:34.647506+0000","last_unstale":"2023-11-26T07:11:37.052532+0000","last_undegraded":"2023-11-26T07:11:37.052532+0000","last_fullsized":"2023-11-26T07:11:37.052532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:34:27.129920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.602216+0000","last_change":"2023-11-26T07:11:34.646505+0000","last_active":"2023-11-26T07:11:37.602216+0000","last_peered":"2023-11-26T07:11:37.602216+0000","last_clean":"2023-11-26T07:11:37.602216+0000","last_became_active":"2023-11-26T07:11:34.646188+0000","last_became_peered":"2023-11-26T07:11:34.646188+0000","last_unstale":"2023-11-26T07:11:37.602216+0000","last_undegraded":"2023-11-26T07:11:37.602216+0000","last_fullsized":"2023-11-26T07:11:37.602216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:13:11.105677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.639195+0000","last_change":"2023-11-26T07:11:34.648874+0000","last_active":"2023-11-26T07:11:35.639195+0000","last_peered":"2023-11-26T07:11:35.639195+0000","last_clean":"2023-11-26T07:11:35.639195+0000","last_became_active":"2023-11-26T07:11:34.648306+0000","last_became_peered":"2023-11-26T07:11:34.648306+0000","last_unstale":"2023-11-26T07:11:35.639195+0000","last_undegraded":"2023-11-26T07:11:35.639195+0000","last_fullsized":"2023-11-26T07:11:35.639195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:25:36.494823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.987274+0000","last_change":"2023-11-26T07:11:34.644678+0000","last_active":"2023-11-26T07:11:36.987274+0000","last_peered":"2023-11-26T07:11:36.987274+0000","last_clean":"2023-11-26T07:11:36.987274+0000","last_became_active":"2023-11-26T07:11:34.644208+0000","last_became_peered":"2023-11-26T07:11:34.644208+0000","last_unstale":"2023-11-26T07:11:36.987274+0000","last_undegraded":"2023-11-26T07:11:36.987274+0000","last_fullsized":"2023-11-26T07:11:36.987274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:06:28.926253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015420+0000","last_change":"2023-11-26T07:11:34.654093+0000","last_active":"2023-11-26T07:11:37.015420+0000","last_peered":"2023-11-26T07:11:37.015420+0000","last_clean":"2023-11-26T07:11:37.015420+0000","last_became_active":"2023-11-26T07:11:34.653772+0000","last_became_peered":"2023-11-26T07:11:34.653772+0000","last_unstale":"2023-11-26T07:11:37.015420+0000","last_undegraded":"2023-11-26T07:11:37.015420+0000","last_fullsized":"2023-11-26T07:11:37.015420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:25:36.494823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.546128+0000","last_change":"2023-11-26T07:11:34.641180+0000","last_active":"2023-11-26T07:11:37.546128+0000","last_peered":"2023-11-26T07:11:37.546128+0000","last_clean":"2023-11-26T07:11:37.546128+0000","last_became_active":"2023-11-26T07:11:34.640883+0000","last_became_peered":"2023-11-26T07:11:34.640883+0000","last_unstale":"2023-11-26T07:11:37.546128+0000","last_undegraded":"2023-11-26T07:11:37.546128+0000","last_fullsized":"2023-11-26T07:11:37.546128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:00:10.960837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052794+0000","last_change":"2023-11-26T07:11:34.649166+0000","last_active":"2023-11-26T07:11:37.052794+0000","last_peered":"2023-11-26T07:11:37.052794+0000","last_clean":"2023-11-26T07:11:37.052794+0000","last_became_active":"2023-11-26T07:11:34.647969+0000","last_became_peered":"2023-11-26T07:11:34.647969+0000","last_unstale":"2023-11-26T07:11:37.052794+0000","last_undegraded":"2023-11-26T07:11:37.052794+0000","last_fullsized":"2023-11-26T07:11:37.052794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:07:08.839200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015324+0000","last_change":"2023-11-26T07:11:34.642588+0000","last_active":"2023-11-26T07:11:37.015324+0000","last_peered":"2023-11-26T07:11:37.015324+0000","last_clean":"2023-11-26T07:11:37.015324+0000","last_became_active":"2023-11-26T07:11:34.642248+0000","last_became_peered":"2023-11-26T07:11:34.642248+0000","last_unstale":"2023-11-26T07:11:37.015324+0000","last_undegraded":"2023-11-26T07:11:37.015324+0000","last_fullsized":"2023-11-26T07:11:37.015324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:32:36.834153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.638896+0000","last_change":"2023-11-26T07:11:34.647562+0000","last_active":"2023-11-26T07:11:35.638896+0000","last_peered":"2023-11-26T07:11:35.638896+0000","last_clean":"2023-11-26T07:11:35.638896+0000","last_became_active":"2023-11-26T07:11:34.647274+0000","last_became_peered":"2023-11-26T07:11:34.647274+0000","last_unstale":"2023-11-26T07:11:35.638896+0000","last_undegraded":"2023-11-26T07:11:35.638896+0000","last_fullsized":"2023-11-26T07:11:35.638896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:06:28.926253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.015070+0000","last_change":"2023-11-26T07:11:34.644535+0000","last_active":"2023-11-26T07:11:37.015070+0000","last_peered":"2023-11-26T07:11:37.015070+0000","last_clean":"2023-11-26T07:11:37.015070+0000","last_became_active":"2023-11-26T07:11:34.644188+0000","last_became_peered":"2023-11-26T07:11:34.644188+0000","last_unstale":"2023-11-26T07:11:37.015070+0000","last_undegraded":"2023-11-26T07:11:37.015070+0000","last_fullsized":"2023-11-26T07:11:37.015070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:07:08.839200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:35.638979+0000","last_change":"2023-11-26T07:11:34.650901+0000","last_active":"2023-11-26T07:11:35.638979+0000","last_peered":"2023-11-26T07:11:35.638979+0000","last_clean":"2023-11-26T07:11:35.638979+0000","last_became_active":"2023-11-26T07:11:34.647833+0000","last_became_peered":"2023-11-26T07:11:34.647833+0000","last_unstale":"2023-11-26T07:11:35.638979+0000","last_undegraded":"2023-11-26T07:11:35.638979+0000","last_fullsized":"2023-11-26T07:11:35.638979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:32:36.834153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:36.987234+0000","last_change":"2023-11-26T07:11:34.646704+0000","last_active":"2023-11-26T07:11:36.987234+0000","last_peered":"2023-11-26T07:11:36.987234+0000","last_clean":"2023-11-26T07:11:36.987234+0000","last_became_active":"2023-11-26T07:11:34.646178+0000","last_became_peered":"2023-11-26T07:11:34.646178+0000","last_unstale":"2023-11-26T07:11:36.987234+0000","last_undegraded":"2023-11-26T07:11:36.987234+0000","last_fullsized":"2023-11-26T07:11:36.987234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:09:14.653647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:11:37.052917+0000","last_change":"2023-11-26T07:11:34.657780+0000","last_active":"2023-11-26T07:11:37.052917+0000","last_peered":"2023-11-26T07:11:37.052917+0000","last_clean":"2023-11-26T07:11:37.052917+0000","last_became_active":"2023-11-26T07:11:34.657459+0000","last_became_peered":"2023-11-26T07:11:34.657459+0000","last_unstale":"2023-11-26T07:11:37.052917+0000","last_undegraded":"2023-11-26T07:11:37.052917+0000","last_fullsized":"2023-11-26T07:11:37.052917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:33.616230+0000","last_clean_scrub_stamp":"2023-11-26T07:11:33.616230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:06:28.926253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":666531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4139999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.5600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.569}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6639999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":75741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":823296,"data_stored":666587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":75581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":75707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:11:43.953 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-26T07:11:43.954 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-26T07:11:43.954 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-26T07:11:43.954 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-26T07:11:44.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.111+0000 7f79402a3700 1 Processor -- start 2023-11-26T07:11:44.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.111+0000 7f79402a3700 1 -- start start 2023-11-26T07:11:44.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.112+0000 7f79402a3700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f793806b620 0x7f79380b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:44.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.112+0000 7f79402a3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f793806ee60 0x7f79380b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:44.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.112+0000 7f79402a3700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7938071f50 con 0x7f79380b5ab0 2023-11-26T07:11:44.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.112+0000 7f79402a3700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7938072230 con 0x7f793806b620 2023-11-26T07:11:44.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.112+0000 7f79402a3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7938072510 con 0x7f793806ee60 2023-11-26T07:11:44.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.113+0000 7f793e840700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f793806ee60 0x7f79380b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:44.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.113+0000 7f793e03f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f793806b620 0x7f79380b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:44.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.113+0000 7f793d83e700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f79380b5ab0 0x7f7938161ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.2:37926/0 (socket says 172.21.15.2:37926) 2023-11-26T07:11:44.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.113+0000 7f793e840700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f793806ee60 0x7f79380b3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.2:37430/0 (socket says 172.21.15.2:37430) 2023-11-26T07:11:44.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.113+0000 7f793d83e700 1 -- 172.21.15.2:0/2965457047 learned_addr learned my addr 172.21.15.2:0/2965457047 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:11:44.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.113+0000 7f793e03f700 1 -- 172.21.15.2:0/2965457047 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f793806ee60 msgr2=0x7f79380b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:44.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.113+0000 7f793e03f700 1 --2- 172.21.15.2:0/2965457047 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f793806ee60 0x7f79380b3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:44.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.113+0000 7f793e03f700 1 -- 172.21.15.2:0/2965457047 >> v1:172.21.15.192:6789/0 conn(0x7f79380b5ab0 legacy=0x7f7938161ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:44.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.113+0000 7f793e03f700 1 -- 172.21.15.2:0/2965457047 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79380727f0 con 0x7f793806b620 2023-11-26T07:11:44.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.113+0000 7f793e840700 1 --2- 172.21.15.2:0/2965457047 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f793806ee60 0x7f79380b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:11:44.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.113+0000 7f793e03f700 1 --2- 172.21.15.2:0/2965457047 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f793806b620 0x7f79380b3a40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7934009840 tx=0x7f7934009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c91f7ae93f022124 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:44.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.113+0000 7f793d03d700 1 -- 172.21.15.2:0/2965457047 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7934011830 con 0x7f793806b620 2023-11-26T07:11:44.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.113+0000 7f793d03d700 1 -- 172.21.15.2:0/2965457047 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7934011990 con 0x7f793806b620 2023-11-26T07:11:44.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.113+0000 7f793d03d700 1 -- 172.21.15.2:0/2965457047 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7934011d20 con 0x7f793806b620 2023-11-26T07:11:44.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.114+0000 7f79402a3700 1 -- 172.21.15.2:0/2965457047 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f793806b620 msgr2=0x7f79380b3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:44.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.114+0000 7f79402a3700 1 --2- 172.21.15.2:0/2965457047 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f793806b620 0x7f79380b3a40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7934009840 tx=0x7f7934009b50 comp rx=0 tx=0).stop 2023-11-26T07:11:44.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.114+0000 7f79402a3700 1 -- 172.21.15.2:0/2965457047 shutdown_connections 2023-11-26T07:11:44.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.114+0000 7f79402a3700 1 --2- 172.21.15.2:0/2965457047 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f793806ee60 0x7f79380b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:44.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.114+0000 7f79402a3700 1 --2- 172.21.15.2:0/2965457047 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f793806b620 0x7f79380b3a40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:44.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.114+0000 7f79402a3700 1 -- 172.21.15.2:0/2965457047 >> 172.21.15.2:0/2965457047 conn(0x7f79380b2740 msgr2=0x7f79380b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:44.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.114+0000 7f79402a3700 1 -- 172.21.15.2:0/2965457047 shutdown_connections 2023-11-26T07:11:44.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.114+0000 7f79402a3700 1 -- 172.21.15.2:0/2965457047 wait complete. 2023-11-26T07:11:44.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.116+0000 7f79402a3700 1 Processor -- start 2023-11-26T07:11:44.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.116+0000 7f79402a3700 1 -- start start 2023-11-26T07:11:44.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.117+0000 7f79402a3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f793806b620 0x7f79381e6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:44.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.117+0000 7f79402a3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f793806ee60 0x7f79381f7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:44.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.117+0000 7f79402a3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79380b5ab0 0x7f79380c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:44.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.117+0000 7f79402a3700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79381e7e80 con 0x7f793806ee60 2023-11-26T07:11:44.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.117+0000 7f79402a3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79381f81f0 con 0x7f79380b5ab0 2023-11-26T07:11:44.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.117+0000 7f79402a3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79381e7270 con 0x7f793806b620 2023-11-26T07:11:44.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.117+0000 7f793d83e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f793806ee60 0x7f79381f7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:44.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.117+0000 7f793d83e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f793806ee60 0x7f79381f7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39354/0 (socket says 172.21.15.2:39354) 2023-11-26T07:11:44.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.117+0000 7f793d83e700 1 -- 172.21.15.2:0/353753992 learned_addr learned my addr 172.21.15.2:0/353753992 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:44.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.117+0000 7f793e03f700 1 --2- 172.21.15.2:0/353753992 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f793806b620 0x7f79381e6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:44.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.117+0000 7f793e840700 1 --2- 172.21.15.2:0/353753992 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79380b5ab0 0x7f79380c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:44.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.117+0000 7f793d83e700 1 -- 172.21.15.2:0/353753992 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f793806b620 msgr2=0x7f79381e6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:44.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.117+0000 7f793d83e700 1 --2- 172.21.15.2:0/353753992 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f793806b620 0x7f79381e6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:44.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.117+0000 7f793d83e700 1 -- 172.21.15.2:0/353753992 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79380b5ab0 msgr2=0x7f79380c8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:44.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.117+0000 7f793d83e700 1 --2- 172.21.15.2:0/353753992 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79380b5ab0 0x7f79380c8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:44.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.117+0000 7f793d83e700 1 -- 172.21.15.2:0/353753992 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7930009a70 con 0x7f793806ee60 2023-11-26T07:11:44.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.117+0000 7f793d83e700 1 --2- 172.21.15.2:0/353753992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f793806ee60 0x7f79381f7cb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f792c00c450 tx=0x7f792c00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:44.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.117+0000 7f792affd700 1 -- 172.21.15.2:0/353753992 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792c005d70 con 0x7f793806ee60 2023-11-26T07:11:44.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.117+0000 7f792affd700 1 -- 172.21.15.2:0/353753992 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f792c00ce60 con 0x7f793806ee60 2023-11-26T07:11:44.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.117+0000 7f79402a3700 1 -- 172.21.15.2:0/353753992 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79340094a0 con 0x7f793806ee60 2023-11-26T07:11:44.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.117+0000 7f792affd700 1 -- 172.21.15.2:0/353753992 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792c0072d0 con 0x7f793806ee60 2023-11-26T07:11:44.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.118+0000 7f79402a3700 1 -- 172.21.15.2:0/353753992 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79381e7830 con 0x7f793806ee60 2023-11-26T07:11:44.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.118+0000 7f79402a3700 1 -- 172.21.15.2:0/353753992 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79381e7ff0 con 0x7f793806ee60 2023-11-26T07:11:44.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.119+0000 7f792affd700 1 -- 172.21.15.2:0/353753992 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f792c007430 con 0x7f793806ee60 2023-11-26T07:11:44.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.119+0000 7f792affd700 1 --2- 172.21.15.2:0/353753992 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f791c06aed0 0x7f791c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:44.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.119+0000 7f792affd700 1 -- 172.21.15.2:0/353753992 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f792c088730 con 0x7f793806ee60 2023-11-26T07:11:44.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.120+0000 7f793e03f700 1 --2- 172.21.15.2:0/353753992 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f791c06aed0 0x7f791c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:44.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.120+0000 7f793e03f700 1 --2- 172.21.15.2:0/353753992 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f791c06aed0 0x7f791c06d390 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7934000c00 tx=0x7f7934008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:44.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.124+0000 7f792affd700 1 -- 172.21.15.2:0/353753992 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f792c053920 con 0x7f793806ee60 2023-11-26T07:11:44.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.374+0000 7f79402a3700 1 -- 172.21.15.2:0/353753992 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f7938068670 con 0x7f793806ee60 2023-11-26T07:11:44.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.374+0000 7f792affd700 1 -- 172.21.15.2:0/353753992 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f792c056f40 con 0x7f793806ee60 2023-11-26T07:11:44.376 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:11:44.377 INFO:teuthology.orchestra.run.smithi002.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-26T07:11:44.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.376+0000 7f79402a3700 1 -- 172.21.15.2:0/353753992 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f791c06aed0 msgr2=0x7f791c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:44.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.376+0000 7f79402a3700 1 --2- 172.21.15.2:0/353753992 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f791c06aed0 0x7f791c06d390 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7934000c00 tx=0x7f7934008030 comp rx=0 tx=0).stop 2023-11-26T07:11:44.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.376+0000 7f79402a3700 1 -- 172.21.15.2:0/353753992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f793806ee60 msgr2=0x7f79381f7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:44.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.376+0000 7f79402a3700 1 --2- 172.21.15.2:0/353753992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f793806ee60 0x7f79381f7cb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f792c00c450 tx=0x7f792c00c760 comp rx=0 tx=0).stop 2023-11-26T07:11:44.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.376+0000 7f79402a3700 1 -- 172.21.15.2:0/353753992 shutdown_connections 2023-11-26T07:11:44.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.376+0000 7f79402a3700 1 --2- 172.21.15.2:0/353753992 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f791c06aed0 0x7f791c06d390 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.376+0000 7f79402a3700 1 --2- 172.21.15.2:0/353753992 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79380b5ab0 0x7f79380c8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.376+0000 7f79402a3700 1 --2- 172.21.15.2:0/353753992 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f793806b620 0x7f79381e6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.376+0000 7f79402a3700 1 --2- 172.21.15.2:0/353753992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f793806ee60 0x7f79381f7cb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.376+0000 7f79402a3700 1 -- 172.21.15.2:0/353753992 >> 172.21.15.2:0/353753992 conn(0x7f79380b2740 msgr2=0x7f79381462b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.376+0000 7f79402a3700 1 -- 172.21.15.2:0/353753992 shutdown_connections 2023-11-26T07:11:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.376+0000 7f79402a3700 1 -- 172.21.15.2:0/353753992 wait complete. 2023-11-26T07:11:44.390 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-26T07:11:44.391 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:11:44.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.514+0000 7f5f5f8a2700 1 Processor -- start 2023-11-26T07:11:44.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.514+0000 7f5f5f8a2700 1 -- start start 2023-11-26T07:11:44.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.515+0000 7f5f5f8a2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f5815e1c0 0x7f5f5806eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:44.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.515+0000 7f5f5f8a2700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5f580b0e90 0x7f5f5806f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:44.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.515+0000 7f5f5f8a2700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f580d1230 con 0x7f5f5806fa80 2023-11-26T07:11:44.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.515+0000 7f5f5f8a2700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f5806ff10 con 0x7f5f580b0e90 2023-11-26T07:11:44.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.515+0000 7f5f5f8a2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f580d0c70 con 0x7f5f5815e1c0 2023-11-26T07:11:44.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.515+0000 7f5f5de3f700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f5f5806fa80 0x7f5f58161d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58806/0 (socket says 172.21.15.2:58806) 2023-11-26T07:11:44.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.515+0000 7f5f5de3f700 1 -- 172.21.15.2:0/3756939989 learned_addr learned my addr 172.21.15.2:0/3756939989 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:11:44.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.515+0000 7f5f5d63e700 1 --2- 172.21.15.2:0/3756939989 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f5815e1c0 0x7f5f5806eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:44.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.515+0000 7f5f5ce3d700 1 --2- 172.21.15.2:0/3756939989 >> v2:172.21.15.192:3300/0 conn(0x7f5f580b0e90 0x7f5f5806f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:44.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.515+0000 7f5f4ffff700 1 -- 172.21.15.2:0/3756939989 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2596179259 0 0) 0x7f5f580d1230 con 0x7f5f5806fa80 2023-11-26T07:11:44.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.515+0000 7f5f4ffff700 1 -- 172.21.15.2:0/3756939989 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f440035b0 con 0x7f5f5806fa80 2023-11-26T07:11:44.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.515+0000 7f5f4ffff700 1 -- 172.21.15.2:0/3756939989 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3486053171 0 0) 0x7f5f440035b0 con 0x7f5f5806fa80 2023-11-26T07:11:44.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.515+0000 7f5f4ffff700 1 -- 172.21.15.2:0/3756939989 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f5815e1c0 msgr2=0x7f5f5806eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:44.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.515+0000 7f5f4ffff700 1 --2- 172.21.15.2:0/3756939989 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f5815e1c0 0x7f5f5806eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:44.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.515+0000 7f5f4ffff700 1 -- 172.21.15.2:0/3756939989 >> v2:172.21.15.192:3300/0 conn(0x7f5f580b0e90 msgr2=0x7f5f5806f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:44.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.515+0000 7f5f4ffff700 1 --2- 172.21.15.2:0/3756939989 >> v2:172.21.15.192:3300/0 conn(0x7f5f580b0e90 0x7f5f5806f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:44.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.515+0000 7f5f4ffff700 1 -- 172.21.15.2:0/3756939989 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f580d0f50 con 0x7f5f5806fa80 2023-11-26T07:11:44.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.515+0000 7f5f4ffff700 1 -- 172.21.15.2:0/3756939989 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f5f500019f0 con 0x7f5f5806fa80 2023-11-26T07:11:44.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.515+0000 7f5f5ce3d700 1 --2- 172.21.15.2:0/3756939989 >> v2:172.21.15.192:3300/0 conn(0x7f5f580b0e90 0x7f5f5806f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:11:44.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.515+0000 7f5f4ffff700 1 -- 172.21.15.2:0/3756939989 >> v1:172.21.15.2:6789/0 conn(0x7f5f5806fa80 legacy=0x7f5f58161d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:44.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.515+0000 7f5f4ffff700 1 --2- 172.21.15.2:0/3756939989 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f44003a00 0x7f5f44003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:44.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.516+0000 7f5f4ffff700 1 --2- 172.21.15.2:0/3756939989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f44004850 0x7f5f44004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:44.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.516+0000 7f5f4ffff700 1 --2- 172.21.15.2:0/3756939989 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f5815e1c0 0x7f5f44005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:44.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.516+0000 7f5f4ffff700 1 -- 172.21.15.2:0/3756939989 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5806ff10 con 0x7f5f44004850 2023-11-26T07:11:44.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.516+0000 7f5f4ffff700 1 -- 172.21.15.2:0/3756939989 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f580d0c70 con 0x7f5f44003a00 2023-11-26T07:11:44.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.516+0000 7f5f4ffff700 1 -- 172.21.15.2:0/3756939989 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4400ba10 con 0x7f5f5815e1c0 2023-11-26T07:11:44.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.516+0000 7f5f5ce3d700 1 --2- 172.21.15.2:0/3756939989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f44004850 0x7f5f44004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:44.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.516+0000 7f5f5d63e700 1 --2- 172.21.15.2:0/3756939989 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f44003a00 0x7f5f44003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:44.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.516+0000 7f5f5de3f700 1 --2- 172.21.15.2:0/3756939989 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f5815e1c0 0x7f5f44005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:44.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.516+0000 7f5f5ce3d700 1 -- 172.21.15.2:0/3756939989 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f5815e1c0 msgr2=0x7f5f44005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:44.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.516+0000 7f5f5ce3d700 1 --2- 172.21.15.2:0/3756939989 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f5815e1c0 0x7f5f44005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:44.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.516+0000 7f5f5ce3d700 1 -- 172.21.15.2:0/3756939989 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f44003a00 msgr2=0x7f5f44003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:44.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.516+0000 7f5f5ce3d700 1 --2- 172.21.15.2:0/3756939989 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f44003a00 0x7f5f44003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:44.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.516+0000 7f5f5ce3d700 1 -- 172.21.15.2:0/3756939989 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f440035b0 con 0x7f5f44004850 2023-11-26T07:11:44.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.516+0000 7f5f5ce3d700 1 --2- 172.21.15.2:0/3756939989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f44004850 0x7f5f44004cd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5f48009d60 tx=0x7f5f44005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ea1b7551b90204a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:44.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.516+0000 7f5f4ffff700 1 -- 172.21.15.2:0/3756939989 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4800e9a0 con 0x7f5f44004850 2023-11-26T07:11:44.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.516+0000 7f5f4ffff700 1 -- 172.21.15.2:0/3756939989 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4800eb00 con 0x7f5f44004850 2023-11-26T07:11:44.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.516+0000 7f5f4ffff700 1 -- 172.21.15.2:0/3756939989 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4800eeb0 con 0x7f5f44004850 2023-11-26T07:11:44.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.517+0000 7f5f5f8a2700 1 -- 172.21.15.2:0/3756939989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f44004850 msgr2=0x7f5f44004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:44.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.517+0000 7f5f5f8a2700 1 --2- 172.21.15.2:0/3756939989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f44004850 0x7f5f44004cd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5f48009d60 tx=0x7f5f44005880 comp rx=0 tx=0).stop 2023-11-26T07:11:44.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.517+0000 7f5f5de3f700 1 -- 172.21.15.2:0/3756939989 reap_dead start 2023-11-26T07:11:44.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.517+0000 7f5f5f8a2700 1 -- 172.21.15.2:0/3756939989 shutdown_connections 2023-11-26T07:11:44.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.517+0000 7f5f5f8a2700 1 -- 172.21.15.2:0/3756939989 >> 172.21.15.2:0/3756939989 conn(0x7f5f580b3720 msgr2=0x7f5f580b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:44.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.517+0000 7f5f5f8a2700 1 -- 172.21.15.2:0/3756939989 shutdown_connections 2023-11-26T07:11:44.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.517+0000 7f5f5f8a2700 1 -- 172.21.15.2:0/3756939989 wait complete. 2023-11-26T07:11:44.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.518+0000 7f5f5f8a2700 1 Processor -- start 2023-11-26T07:11:44.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.518+0000 7f5f5f8a2700 1 -- start start 2023-11-26T07:11:44.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.519+0000 7f5f5f8a2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f44004850 0x7f5f58154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:44.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.519+0000 7f5f5f8a2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f580b4810 0x7f5f5815f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:44.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.519+0000 7f5f5f8a2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f5815f920 0x7f5f580b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:44.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.519+0000 7f5f5f8a2700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f58160110 con 0x7f5f5815f920 2023-11-26T07:11:44.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.519+0000 7f5f5f8a2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f58155190 con 0x7f5f44004850 2023-11-26T07:11:44.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.519+0000 7f5f5f8a2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f580c6ba0 con 0x7f5f580b4810 2023-11-26T07:11:44.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.519+0000 7f5f5de3f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f5815f920 0x7f5f580b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:44.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.519+0000 7f5f5de3f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f5815f920 0x7f5f580b6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39376/0 (socket says 172.21.15.2:39376) 2023-11-26T07:11:44.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.519+0000 7f5f5de3f700 1 -- 172.21.15.2:0/1168426621 learned_addr learned my addr 172.21.15.2:0/1168426621 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:44.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.519+0000 7f5f5ce3d700 1 --2- 172.21.15.2:0/1168426621 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f580b4810 0x7f5f5815f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:44.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.519+0000 7f5f5d63e700 1 --2- 172.21.15.2:0/1168426621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f44004850 0x7f5f58154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:44.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.519+0000 7f5f5de3f700 1 -- 172.21.15.2:0/1168426621 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f580b4810 msgr2=0x7f5f5815f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:44.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.519+0000 7f5f5de3f700 1 --2- 172.21.15.2:0/1168426621 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f580b4810 0x7f5f5815f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:44.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.519+0000 7f5f5de3f700 1 -- 172.21.15.2:0/1168426621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f44004850 msgr2=0x7f5f58154c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:44.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.519+0000 7f5f5de3f700 1 --2- 172.21.15.2:0/1168426621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f44004850 0x7f5f58154c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:44.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.519+0000 7f5f5de3f700 1 -- 172.21.15.2:0/1168426621 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f5815fe30 con 0x7f5f5815f920 2023-11-26T07:11:44.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.519+0000 7f5f5d63e700 1 --2- 172.21.15.2:0/1168426621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f44004850 0x7f5f58154c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:11:44.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.519+0000 7f5f5de3f700 1 --2- 172.21.15.2:0/1168426621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f5815f920 0x7f5f580b6d60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5f50000f80 tx=0x7f5f5000a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:44.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.520+0000 7f5f4dffb700 1 -- 172.21.15.2:0/1168426621 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5000ae10 con 0x7f5f5815f920 2023-11-26T07:11:44.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.520+0000 7f5f4dffb700 1 -- 172.21.15.2:0/1168426621 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f500133f0 con 0x7f5f5815f920 2023-11-26T07:11:44.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.520+0000 7f5f5f8a2700 1 -- 172.21.15.2:0/1168426621 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f580c6e60 con 0x7f5f5815f920 2023-11-26T07:11:44.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.520+0000 7f5f4dffb700 1 -- 172.21.15.2:0/1168426621 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f500137a0 con 0x7f5f5815f920 2023-11-26T07:11:44.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.520+0000 7f5f5f8a2700 1 -- 172.21.15.2:0/1168426621 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f58155500 con 0x7f5f5815f920 2023-11-26T07:11:44.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.521+0000 7f5f5f8a2700 1 -- 172.21.15.2:0/1168426621 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f58068670 con 0x7f5f5815f920 2023-11-26T07:11:44.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.521+0000 7f5f4dffb700 1 -- 172.21.15.2:0/1168426621 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5f50013900 con 0x7f5f5815f920 2023-11-26T07:11:44.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.522+0000 7f5f4dffb700 1 --2- 172.21.15.2:0/1168426621 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5f3c06af00 0x7f5f3c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:44.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.522+0000 7f5f4dffb700 1 -- 172.21.15.2:0/1168426621 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f50089fa0 con 0x7f5f5815f920 2023-11-26T07:11:44.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.522+0000 7f5f5d63e700 1 --2- 172.21.15.2:0/1168426621 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5f3c06af00 0x7f5f3c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:44.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.522+0000 7f5f5d63e700 1 --2- 172.21.15.2:0/1168426621 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5f3c06af00 0x7f5f3c06d3c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5f54006dd0 tx=0x7f5f54008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:44.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.526+0000 7f5f4dffb700 1 -- 172.21.15.2:0/1168426621 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5f50054fb0 con 0x7f5f5815f920 2023-11-26T07:11:44.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.727+0000 7f5f5f8a2700 1 -- 172.21.15.2:0/1168426621 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f580b3500 con 0x7f5f5815f920 2023-11-26T07:11:44.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.728+0000 7f5f4dffb700 1 -- 172.21.15.2:0/1168426621 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f5f500585d0 con 0x7f5f5815f920 2023-11-26T07:11:44.730 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:11:44.731 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:11:35.634747+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:11:32.129474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:11:33.019837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:11:44.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.730+0000 7f5f5f8a2700 1 -- 172.21.15.2:0/1168426621 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5f3c06af00 msgr2=0x7f5f3c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:44.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.730+0000 7f5f5f8a2700 1 --2- 172.21.15.2:0/1168426621 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5f3c06af00 0x7f5f3c06d3c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5f54006dd0 tx=0x7f5f54008040 comp rx=0 tx=0).stop 2023-11-26T07:11:44.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.730+0000 7f5f5f8a2700 1 -- 172.21.15.2:0/1168426621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f5815f920 msgr2=0x7f5f580b6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:44.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.730+0000 7f5f5f8a2700 1 --2- 172.21.15.2:0/1168426621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f5815f920 0x7f5f580b6d60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5f50000f80 tx=0x7f5f5000a640 comp rx=0 tx=0).stop 2023-11-26T07:11:44.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.730+0000 7f5f5f8a2700 1 -- 172.21.15.2:0/1168426621 shutdown_connections 2023-11-26T07:11:44.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.730+0000 7f5f5f8a2700 1 --2- 172.21.15.2:0/1168426621 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5f3c06af00 0x7f5f3c06d3c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:44.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.730+0000 7f5f5f8a2700 1 --2- 172.21.15.2:0/1168426621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f5815f920 0x7f5f580b6d60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:44.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.730+0000 7f5f5f8a2700 1 --2- 172.21.15.2:0/1168426621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f44004850 0x7f5f58154c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:44.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.730+0000 7f5f5f8a2700 1 --2- 172.21.15.2:0/1168426621 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f580b4810 0x7f5f5815f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:44.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.730+0000 7f5f5f8a2700 1 -- 172.21.15.2:0/1168426621 >> 172.21.15.2:0/1168426621 conn(0x7f5f580b3720 msgr2=0x7f5f58161d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:44.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.731+0000 7f5f5f8a2700 1 -- 172.21.15.2:0/1168426621 shutdown_connections 2023-11-26T07:11:44.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.731+0000 7f5f5f8a2700 1 -- 172.21.15.2:0/1168426621 wait complete. 2023-11-26T07:11:44.745 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:11:28.205739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:11:32.129474+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:11:33.019837+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:11:44.745 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:11:44.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.871+0000 7fd08d4a2700 1 Processor -- start 2023-11-26T07:11:44.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.871+0000 7fd08d4a2700 1 -- start start 2023-11-26T07:11:44.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.872+0000 7fd08d4a2700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd0880d0870 0x7fd0880d26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:44.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.872+0000 7fd08d4a2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0880d0c50 0x7fd0880d49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:44.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.872+0000 7fd08d4a2700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd0880cf860 0x7fd0880b6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:44.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.872+0000 7fd08d4a2700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0880d2f80 con 0x7fd0880cf860 2023-11-26T07:11:44.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.872+0000 7fd08d4a2700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0880b5370 con 0x7fd0880d0870 2023-11-26T07:11:44.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.872+0000 7fd08d4a2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0880ceae0 con 0x7fd0880d0c50 2023-11-26T07:11:44.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.872+0000 7fd0877fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd0880cf860 0x7fd0880b6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:44.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.872+0000 7fd0877fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd0880cf860 0x7fd0880b6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39384/0 (socket says 172.21.15.2:39384) 2023-11-26T07:11:44.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.872+0000 7fd0877fe700 1 -- 172.21.15.2:0/3857281420 learned_addr learned my addr 172.21.15.2:0/3857281420 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:44.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.872+0000 7fd0867fc700 1 --2- 172.21.15.2:0/3857281420 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0880d0c50 0x7fd0880d49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:44.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.872+0000 7fd086ffd700 1 --2- 172.21.15.2:0/3857281420 >> v2:172.21.15.192:3300/0 conn(0x7fd0880d0870 0x7fd0880d26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:44.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.872+0000 7fd0877fe700 1 -- 172.21.15.2:0/3857281420 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0880d0c50 msgr2=0x7fd0880d49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:44.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.872+0000 7fd0877fe700 1 --2- 172.21.15.2:0/3857281420 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0880d0c50 0x7fd0880d49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:44.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.872+0000 7fd0877fe700 1 -- 172.21.15.2:0/3857281420 >> v2:172.21.15.192:3300/0 conn(0x7fd0880d0870 msgr2=0x7fd0880d26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:44.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.872+0000 7fd0877fe700 1 --2- 172.21.15.2:0/3857281420 >> v2:172.21.15.192:3300/0 conn(0x7fd0880d0870 0x7fd0880d26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:44.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.872+0000 7fd0877fe700 1 -- 172.21.15.2:0/3857281420 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0880d2ca0 con 0x7fd0880cf860 2023-11-26T07:11:44.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.872+0000 7fd0877fe700 1 --2- 172.21.15.2:0/3857281420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0880cf860 0x7fd0880b6d20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd08808c560 tx=0x7fd08000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dbf9bca261d0ecc server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:44.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.872+0000 7fd085ffb700 1 -- 172.21.15.2:0/3857281420 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08000e070 con 0x7fd0880cf860 2023-11-26T07:11:44.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.872+0000 7fd085ffb700 1 -- 172.21.15.2:0/3857281420 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd08000b9c0 con 0x7fd0880cf860 2023-11-26T07:11:44.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.872+0000 7fd085ffb700 1 -- 172.21.15.2:0/3857281420 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08000bd70 con 0x7fd0880cf860 2023-11-26T07:11:44.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.873+0000 7fd08d4a2700 1 -- 172.21.15.2:0/3857281420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0880cf860 msgr2=0x7fd0880b6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:44.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.873+0000 7fd08d4a2700 1 --2- 172.21.15.2:0/3857281420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0880cf860 0x7fd0880b6d20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd08808c560 tx=0x7fd08000b330 comp rx=0 tx=0).stop 2023-11-26T07:11:44.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.873+0000 7fd08d4a2700 1 -- 172.21.15.2:0/3857281420 shutdown_connections 2023-11-26T07:11:44.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.873+0000 7fd08d4a2700 1 --2- 172.21.15.2:0/3857281420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0880cf860 0x7fd0880b6d20 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:44.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.873+0000 7fd08d4a2700 1 --2- 172.21.15.2:0/3857281420 >> v2:172.21.15.192:3300/0 conn(0x7fd0880d0870 0x7fd0880d26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:44.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.873+0000 7fd08d4a2700 1 --2- 172.21.15.2:0/3857281420 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0880d0c50 0x7fd0880d49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:44.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.873+0000 7fd08d4a2700 1 -- 172.21.15.2:0/3857281420 >> 172.21.15.2:0/3857281420 conn(0x7fd0880d3ed0 msgr2=0x7fd0880d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:44.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.873+0000 7fd08d4a2700 1 -- 172.21.15.2:0/3857281420 shutdown_connections 2023-11-26T07:11:44.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.873+0000 7fd08d4a2700 1 -- 172.21.15.2:0/3857281420 wait complete. 2023-11-26T07:11:44.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.875+0000 7fd08d4a2700 1 Processor -- start 2023-11-26T07:11:44.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.875+0000 7fd08d4a2700 1 -- start start 2023-11-26T07:11:44.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.876+0000 7fd08d4a2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd0880cf860 0x7fd088154390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:44.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.876+0000 7fd08d4a2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0880d0870 0x7fd088155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:44.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.876+0000 7fd08d4a2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0880d0c50 0x7fd088158760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:44.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.876+0000 7fd08d4a2700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd088158ca0 con 0x7fd0880d0c50 2023-11-26T07:11:44.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.876+0000 7fd08d4a2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd088154970 con 0x7fd0880cf860 2023-11-26T07:11:44.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.876+0000 7fd08d4a2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd088154c50 con 0x7fd0880d0870 2023-11-26T07:11:44.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.876+0000 7fd0877fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0880d0c50 0x7fd088158760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:44.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.876+0000 7fd0877fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0880d0c50 0x7fd088158760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39390/0 (socket says 172.21.15.2:39390) 2023-11-26T07:11:44.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.876+0000 7fd0877fe700 1 -- 172.21.15.2:0/3912576589 learned_addr learned my addr 172.21.15.2:0/3912576589 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:44.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.876+0000 7fd086ffd700 1 --2- 172.21.15.2:0/3912576589 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd0880cf860 0x7fd088154390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:44.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.876+0000 7fd0867fc700 1 --2- 172.21.15.2:0/3912576589 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0880d0870 0x7fd088155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:44.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.876+0000 7fd0877fe700 1 -- 172.21.15.2:0/3912576589 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0880d0870 msgr2=0x7fd088155a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:44.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.876+0000 7fd0877fe700 1 --2- 172.21.15.2:0/3912576589 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0880d0870 0x7fd088155a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:44.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.876+0000 7fd0877fe700 1 -- 172.21.15.2:0/3912576589 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd0880cf860 msgr2=0x7fd088154390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:44.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.876+0000 7fd0877fe700 1 --2- 172.21.15.2:0/3912576589 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd0880cf860 0x7fd088154390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:44.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.876+0000 7fd0877fe700 1 -- 172.21.15.2:0/3912576589 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd080009b30 con 0x7fd0880d0c50 2023-11-26T07:11:44.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.876+0000 7fd0877fe700 1 --2- 172.21.15.2:0/3912576589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0880d0c50 0x7fd088158760 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd08808c300 tx=0x7fd080004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:44.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.876+0000 7fd06f7fe700 1 -- 172.21.15.2:0/3912576589 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd080004250 con 0x7fd0880d0c50 2023-11-26T07:11:44.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.877+0000 7fd06f7fe700 1 -- 172.21.15.2:0/3912576589 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0800043d0 con 0x7fd0880d0c50 2023-11-26T07:11:44.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.877+0000 7fd08d4a2700 1 -- 172.21.15.2:0/3912576589 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd088154f30 con 0x7fd0880d0c50 2023-11-26T07:11:44.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.877+0000 7fd06f7fe700 1 -- 172.21.15.2:0/3912576589 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd080004780 con 0x7fd0880d0c50 2023-11-26T07:11:44.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.877+0000 7fd08d4a2700 1 -- 172.21.15.2:0/3912576589 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0881554f0 con 0x7fd0880d0c50 2023-11-26T07:11:44.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.878+0000 7fd08d4a2700 1 -- 172.21.15.2:0/3912576589 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0880b57c0 con 0x7fd0880d0c50 2023-11-26T07:11:44.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.878+0000 7fd06f7fe700 1 -- 172.21.15.2:0/3912576589 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd08001b430 con 0x7fd0880d0c50 2023-11-26T07:11:44.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.878+0000 7fd06f7fe700 1 --2- 172.21.15.2:0/3912576589 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd07406aed0 0x7fd07406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:44.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.879+0000 7fd06f7fe700 1 -- 172.21.15.2:0/3912576589 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd08008a7a0 con 0x7fd0880d0c50 2023-11-26T07:11:44.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.879+0000 7fd086ffd700 1 --2- 172.21.15.2:0/3912576589 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd07406aed0 0x7fd07406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:44.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.879+0000 7fd086ffd700 1 --2- 172.21.15.2:0/3912576589 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd07406aed0 0x7fd07406d390 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd07800ba10 tx=0x7fd078008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:44.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:44.883+0000 7fd06f7fe700 1 -- 172.21.15.2:0/3912576589 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd0800558e0 con 0x7fd0880d0c50 2023-11-26T07:11:45.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.081+0000 7fd08d4a2700 1 -- 172.21.15.2:0/3912576589 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd088067a20 con 0x7fd0880d0c50 2023-11-26T07:11:45.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.081+0000 7fd06f7fe700 1 -- 172.21.15.2:0/3912576589 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd08001f0a0 con 0x7fd0880d0c50 2023-11-26T07:11:45.084 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-26T07:11:45.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.083+0000 7fd08d4a2700 1 -- 172.21.15.2:0/3912576589 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd07406aed0 msgr2=0x7fd07406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:45.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.083+0000 7fd08d4a2700 1 --2- 172.21.15.2:0/3912576589 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd07406aed0 0x7fd07406d390 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd07800ba10 tx=0x7fd078008040 comp rx=0 tx=0).stop 2023-11-26T07:11:45.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.083+0000 7fd08d4a2700 1 -- 172.21.15.2:0/3912576589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0880d0c50 msgr2=0x7fd088158760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:45.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.083+0000 7fd08d4a2700 1 --2- 172.21.15.2:0/3912576589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0880d0c50 0x7fd088158760 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd08808c300 tx=0x7fd080004ad0 comp rx=0 tx=0).stop 2023-11-26T07:11:45.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.083+0000 7fd08d4a2700 1 -- 172.21.15.2:0/3912576589 shutdown_connections 2023-11-26T07:11:45.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.083+0000 7fd08d4a2700 1 --2- 172.21.15.2:0/3912576589 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd07406aed0 0x7fd07406d390 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:45.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.083+0000 7fd08d4a2700 1 --2- 172.21.15.2:0/3912576589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0880d0c50 0x7fd088158760 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:45.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.083+0000 7fd08d4a2700 1 --2- 172.21.15.2:0/3912576589 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd0880cf860 0x7fd088154390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:45.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.083+0000 7fd08d4a2700 1 --2- 172.21.15.2:0/3912576589 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0880d0870 0x7fd088155a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:45.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.083+0000 7fd08d4a2700 1 -- 172.21.15.2:0/3912576589 >> 172.21.15.2:0/3912576589 conn(0x7fd0880d3ed0 msgr2=0x7fd08815bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:45.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.084+0000 7fd08d4a2700 1 -- 172.21.15.2:0/3912576589 shutdown_connections 2023-11-26T07:11:45.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.084+0000 7fd08d4a2700 1 -- 172.21.15.2:0/3912576589 wait complete. 2023-11-26T07:11:45.098 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:11:45.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.224+0000 7f973e023700 1 Processor -- start 2023-11-26T07:11:45.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.224+0000 7f973e023700 1 -- start start 2023-11-26T07:11:45.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.225+0000 7f973e023700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9738143ae0 0x7f97380b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:45.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.225+0000 7f973e023700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f97380722c0 0x7f973806e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:45.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.225+0000 7f973e023700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9738143ec0 con 0x7f97381440f0 2023-11-26T07:11:45.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.225+0000 7f973e023700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97380b40a0 con 0x7f97380722c0 2023-11-26T07:11:45.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.225+0000 7f973e023700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97380b3ae0 con 0x7f9738143ae0 2023-11-26T07:11:45.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.225+0000 7f9737fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f97380722c0 0x7f973806e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:45.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.225+0000 7f9737fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f97380722c0 0x7f973806e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39398/0 (socket says 172.21.15.2:39398) 2023-11-26T07:11:45.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.225+0000 7f9737fff700 1 -- 172.21.15.2:0/12573425 learned_addr learned my addr 172.21.15.2:0/12573425 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:45.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.225+0000 7f97377fe700 1 --2- 172.21.15.2:0/12573425 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9738143ae0 0x7f97380b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:45.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.225+0000 7f9737fff700 1 -- 172.21.15.2:0/12573425 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9738143ae0 msgr2=0x7f97380b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:45.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.225+0000 7f9737fff700 1 --2- 172.21.15.2:0/12573425 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9738143ae0 0x7f97380b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:45.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.225+0000 7f9737fff700 1 -- 172.21.15.2:0/12573425 >> v1:172.21.15.192:6789/0 conn(0x7f97381440f0 legacy=0x7f9738071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:45.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.225+0000 7f9737fff700 1 -- 172.21.15.2:0/12573425 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97380b3dc0 con 0x7f97380722c0 2023-11-26T07:11:45.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.225+0000 7f9737fff700 1 --2- 172.21.15.2:0/12573425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97380722c0 0x7f973806e510 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f973000d150 tx=0x7f973000d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed2ae26e00478335 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:45.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.226+0000 7f97367fc700 1 -- 172.21.15.2:0/12573425 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9730010070 con 0x7f97380722c0 2023-11-26T07:11:45.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.226+0000 7f97367fc700 1 -- 172.21.15.2:0/12573425 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973000ddc0 con 0x7f97380722c0 2023-11-26T07:11:45.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.226+0000 7f97367fc700 1 -- 172.21.15.2:0/12573425 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973000b310 con 0x7f97380722c0 2023-11-26T07:11:45.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.226+0000 7f973e023700 1 -- 172.21.15.2:0/12573425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97380722c0 msgr2=0x7f973806e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:45.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.226+0000 7f973e023700 1 --2- 172.21.15.2:0/12573425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97380722c0 0x7f973806e510 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f973000d150 tx=0x7f973000d460 comp rx=0 tx=0).stop 2023-11-26T07:11:45.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.226+0000 7f973e023700 1 -- 172.21.15.2:0/12573425 shutdown_connections 2023-11-26T07:11:45.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.226+0000 7f973e023700 1 --2- 172.21.15.2:0/12573425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97380722c0 0x7f973806e510 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:45.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.226+0000 7f973e023700 1 --2- 172.21.15.2:0/12573425 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9738143ae0 0x7f97380b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:45.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.226+0000 7f973e023700 1 -- 172.21.15.2:0/12573425 >> 172.21.15.2:0/12573425 conn(0x7f97380b2740 msgr2=0x7f97380b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:45.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.226+0000 7f973e023700 1 -- 172.21.15.2:0/12573425 shutdown_connections 2023-11-26T07:11:45.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.226+0000 7f973e023700 1 -- 172.21.15.2:0/12573425 wait complete. 2023-11-26T07:11:45.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.227+0000 7f973e023700 1 Processor -- start 2023-11-26T07:11:45.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.228+0000 7f973e023700 1 -- start start 2023-11-26T07:11:45.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.228+0000 7f973e023700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97380722c0 0x7f973813c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:45.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.228+0000 7f973e023700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9738143ae0 0x7f9738154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:45.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.228+0000 7f973e023700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97381440f0 0x7f973815d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:45.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.228+0000 7f973e023700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97381542e0 con 0x7f97380722c0 2023-11-26T07:11:45.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.228+0000 7f973e023700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973815e100 con 0x7f9738143ae0 2023-11-26T07:11:45.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.228+0000 7f973e023700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973815de20 con 0x7f97381440f0 2023-11-26T07:11:45.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.228+0000 7f97377fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97380722c0 0x7f973813c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:45.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.228+0000 7f97377fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97380722c0 0x7f973813c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39400/0 (socket says 172.21.15.2:39400) 2023-11-26T07:11:45.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.228+0000 7f97377fe700 1 -- 172.21.15.2:0/54440642 learned_addr learned my addr 172.21.15.2:0/54440642 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:45.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.229+0000 7f9736ffd700 1 --2- 172.21.15.2:0/54440642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9738143ae0 0x7f9738154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:45.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.229+0000 7f9737fff700 1 --2- 172.21.15.2:0/54440642 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97381440f0 0x7f973815d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:45.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.229+0000 7f97377fe700 1 -- 172.21.15.2:0/54440642 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97381440f0 msgr2=0x7f973815d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:45.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.229+0000 7f97377fe700 1 --2- 172.21.15.2:0/54440642 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97381440f0 0x7f973815d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:45.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.229+0000 7f97377fe700 1 -- 172.21.15.2:0/54440642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9738143ae0 msgr2=0x7f9738154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:45.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.229+0000 7f97377fe700 1 --2- 172.21.15.2:0/54440642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9738143ae0 0x7f9738154770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:45.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.229+0000 7f97377fe700 1 -- 172.21.15.2:0/54440642 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973000bd40 con 0x7f97380722c0 2023-11-26T07:11:45.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.229+0000 7f9736ffd700 1 --2- 172.21.15.2:0/54440642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9738143ae0 0x7f9738154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:11:45.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.229+0000 7f97377fe700 1 --2- 172.21.15.2:0/54440642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97380722c0 0x7f973813c310 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f972800e810 tx=0x7f972800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:45.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.229+0000 7f972ffff700 1 -- 172.21.15.2:0/54440642 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9728013610 con 0x7f97380722c0 2023-11-26T07:11:45.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.229+0000 7f972ffff700 1 -- 172.21.15.2:0/54440642 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9728013770 con 0x7f97380722c0 2023-11-26T07:11:45.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.229+0000 7f972ffff700 1 -- 172.21.15.2:0/54440642 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9728013b20 con 0x7f97380722c0 2023-11-26T07:11:45.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.229+0000 7f973e023700 1 -- 172.21.15.2:0/54440642 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9738153c90 con 0x7f97380722c0 2023-11-26T07:11:45.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.229+0000 7f973e023700 1 -- 172.21.15.2:0/54440642 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f973813c850 con 0x7f97380722c0 2023-11-26T07:11:45.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.230+0000 7f973e023700 1 -- 172.21.15.2:0/54440642 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9738075480 con 0x7f97380722c0 2023-11-26T07:11:45.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.231+0000 7f972ffff700 1 -- 172.21.15.2:0/54440642 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9728013c80 con 0x7f97380722c0 2023-11-26T07:11:45.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.231+0000 7f972ffff700 1 --2- 172.21.15.2:0/54440642 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f971806aed0 0x7f971806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:45.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.231+0000 7f972ffff700 1 -- 172.21.15.2:0/54440642 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f97280892b0 con 0x7f97380722c0 2023-11-26T07:11:45.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.231+0000 7f9736ffd700 1 --2- 172.21.15.2:0/54440642 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f971806aed0 0x7f971806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:45.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.232+0000 7f9736ffd700 1 --2- 172.21.15.2:0/54440642 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f971806aed0 0x7f971806d390 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f973813f860 tx=0x7f9720009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:45.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.236+0000 7f972ffff700 1 -- 172.21.15.2:0/54440642 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f97280543f0 con 0x7f97380722c0 2023-11-26T07:11:45.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.438+0000 7f973e023700 1 -- 172.21.15.2:0/54440642 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f97380b5d20 con 0x7f97380722c0 2023-11-26T07:11:45.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.438+0000 7f972ffff700 1 -- 172.21.15.2:0/54440642 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9728057a10 con 0x7f97380722c0 2023-11-26T07:11:45.441 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-26T07:11:45.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.440+0000 7f973e023700 1 -- 172.21.15.2:0/54440642 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f971806aed0 msgr2=0x7f971806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:45.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.440+0000 7f973e023700 1 --2- 172.21.15.2:0/54440642 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f971806aed0 0x7f971806d390 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f973813f860 tx=0x7f9720009040 comp rx=0 tx=0).stop 2023-11-26T07:11:45.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.440+0000 7f973e023700 1 -- 172.21.15.2:0/54440642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97380722c0 msgr2=0x7f973813c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:45.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.440+0000 7f973e023700 1 --2- 172.21.15.2:0/54440642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97380722c0 0x7f973813c310 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f972800e810 tx=0x7f972800ebd0 comp rx=0 tx=0).stop 2023-11-26T07:11:45.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.440+0000 7f973e023700 1 -- 172.21.15.2:0/54440642 shutdown_connections 2023-11-26T07:11:45.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.440+0000 7f973e023700 1 --2- 172.21.15.2:0/54440642 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f971806aed0 0x7f971806d390 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:45.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.440+0000 7f973e023700 1 --2- 172.21.15.2:0/54440642 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97381440f0 0x7f973815d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:45.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.440+0000 7f973e023700 1 --2- 172.21.15.2:0/54440642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97380722c0 0x7f973813c310 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:45.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.440+0000 7f973e023700 1 --2- 172.21.15.2:0/54440642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9738143ae0 0x7f9738154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:45.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.440+0000 7f973e023700 1 -- 172.21.15.2:0/54440642 >> 172.21.15.2:0/54440642 conn(0x7f97380b2740 msgr2=0x7f97380cf540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:45.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.441+0000 7f973e023700 1 -- 172.21.15.2:0/54440642 shutdown_connections 2023-11-26T07:11:45.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.441+0000 7f973e023700 1 -- 172.21.15.2:0/54440642 wait complete. 2023-11-26T07:11:45.455 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:11:45.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.580+0000 7fce0fabf700 1 Processor -- start 2023-11-26T07:11:45.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.580+0000 7fce0fabf700 1 -- start start 2023-11-26T07:11:45.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.581+0000 7fce0fabf700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fce080722c0 0x7fce080b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:45.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.581+0000 7fce0fabf700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce081440f0 0x7fce0806e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:45.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.581+0000 7fce0fabf700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce08143ec0 con 0x7fce08143ae0 2023-11-26T07:11:45.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.581+0000 7fce0fabf700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce080b40a0 con 0x7fce080722c0 2023-11-26T07:11:45.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.581+0000 7fce0fabf700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce080b3ae0 con 0x7fce081440f0 2023-11-26T07:11:45.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.581+0000 7fce0d05a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fce080722c0 0x7fce080b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:45.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.581+0000 7fce0d05a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fce080722c0 0x7fce080b51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39410/0 (socket says 172.21.15.2:39410) 2023-11-26T07:11:45.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.581+0000 7fce0d85b700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fce08143ae0 0x7fce08071bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58850/0 (socket says 172.21.15.2:58850) 2023-11-26T07:11:45.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.581+0000 7fce0d05a700 1 -- 172.21.15.2:0/75996549 learned_addr learned my addr 172.21.15.2:0/75996549 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:45.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.582+0000 7fce0e05c700 1 --2- 172.21.15.2:0/75996549 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce081440f0 0x7fce0806e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:45.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.582+0000 7fce0d05a700 1 -- 172.21.15.2:0/75996549 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce081440f0 msgr2=0x7fce0806e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:45.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.582+0000 7fce0d05a700 1 --2- 172.21.15.2:0/75996549 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce081440f0 0x7fce0806e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:45.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.582+0000 7fce0d05a700 1 -- 172.21.15.2:0/75996549 >> v1:172.21.15.2:6789/0 conn(0x7fce08143ae0 legacy=0x7fce08071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:45.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.582+0000 7fce0d05a700 1 -- 172.21.15.2:0/75996549 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce080b3dc0 con 0x7fce080722c0 2023-11-26T07:11:45.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.582+0000 7fce0c859700 1 -- 172.21.15.2:0/75996549 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 918589408 0 0) 0x7fce08143ec0 con 0x7fce08143ae0 2023-11-26T07:11:45.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.582+0000 7fce0d05a700 1 --2- 172.21.15.2:0/75996549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce080722c0 0x7fce080b51b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fce040098f0 tx=0x7fce04009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e22d363283d763d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:45.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.582+0000 7fce0c859700 1 -- 172.21.15.2:0/75996549 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0400b8a0 con 0x7fce080722c0 2023-11-26T07:11:45.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.582+0000 7fce0c859700 1 -- 172.21.15.2:0/75996549 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce0400ba00 con 0x7fce080722c0 2023-11-26T07:11:45.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.582+0000 7fce0c859700 1 -- 172.21.15.2:0/75996549 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0400bd90 con 0x7fce080722c0 2023-11-26T07:11:45.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.583+0000 7fce0fabf700 1 -- 172.21.15.2:0/75996549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce080722c0 msgr2=0x7fce080b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:45.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.583+0000 7fce0fabf700 1 --2- 172.21.15.2:0/75996549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce080722c0 0x7fce080b51b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fce040098f0 tx=0x7fce04009c00 comp rx=0 tx=0).stop 2023-11-26T07:11:45.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.583+0000 7fce0fabf700 1 -- 172.21.15.2:0/75996549 shutdown_connections 2023-11-26T07:11:45.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.583+0000 7fce0fabf700 1 --2- 172.21.15.2:0/75996549 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce081440f0 0x7fce0806e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:45.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.583+0000 7fce0fabf700 1 --2- 172.21.15.2:0/75996549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce080722c0 0x7fce080b51b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:45.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.583+0000 7fce0fabf700 1 -- 172.21.15.2:0/75996549 >> 172.21.15.2:0/75996549 conn(0x7fce080b2740 msgr2=0x7fce080b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:45.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.583+0000 7fce0fabf700 1 -- 172.21.15.2:0/75996549 shutdown_connections 2023-11-26T07:11:45.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.583+0000 7fce0fabf700 1 -- 172.21.15.2:0/75996549 wait complete. 2023-11-26T07:11:45.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.584+0000 7fce0fabf700 1 Processor -- start 2023-11-26T07:11:45.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.584+0000 7fce0fabf700 1 -- start start 2023-11-26T07:11:45.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.585+0000 7fce0fabf700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce080722c0 0x7fce08156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:45.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.585+0000 7fce0fabf700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce08143ae0 0x7fce080ca540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:45.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.585+0000 7fce0fabf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce081440f0 0x7fce080caa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:45.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.585+0000 7fce0fabf700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce08156dc0 con 0x7fce081440f0 2023-11-26T07:11:45.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.585+0000 7fce0fabf700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce080cf090 con 0x7fce080722c0 2023-11-26T07:11:45.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.585+0000 7fce0fabf700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce080cf370 con 0x7fce08143ae0 2023-11-26T07:11:45.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.585+0000 7fce0e05c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce081440f0 0x7fce080caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:45.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.585+0000 7fce0e05c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce081440f0 0x7fce080caa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39418/0 (socket says 172.21.15.2:39418) 2023-11-26T07:11:45.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.585+0000 7fce0e05c700 1 -- 172.21.15.2:0/246593455 learned_addr learned my addr 172.21.15.2:0/246593455 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:45.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.585+0000 7fce0d85b700 1 --2- 172.21.15.2:0/246593455 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce080722c0 0x7fce08156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:45.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.585+0000 7fce0d05a700 1 --2- 172.21.15.2:0/246593455 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce08143ae0 0x7fce080ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:45.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.585+0000 7fce0e05c700 1 -- 172.21.15.2:0/246593455 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce08143ae0 msgr2=0x7fce080ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:45.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.585+0000 7fce0e05c700 1 --2- 172.21.15.2:0/246593455 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce08143ae0 0x7fce080ca540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:45.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.585+0000 7fce0e05c700 1 -- 172.21.15.2:0/246593455 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce080722c0 msgr2=0x7fce08156880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:45.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.585+0000 7fce0e05c700 1 --2- 172.21.15.2:0/246593455 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce080722c0 0x7fce08156880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:45.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.585+0000 7fce0e05c700 1 -- 172.21.15.2:0/246593455 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce04009550 con 0x7fce081440f0 2023-11-26T07:11:45.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.585+0000 7fce0d05a700 1 --2- 172.21.15.2:0/246593455 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce08143ae0 0x7fce080ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:11:45.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.585+0000 7fce0e05c700 1 --2- 172.21.15.2:0/246593455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce081440f0 0x7fce080caa80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fce00007e60 tx=0x7fce0000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:45.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.585+0000 7fcdfe7fc700 1 -- 172.21.15.2:0/246593455 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0000ede0 con 0x7fce081440f0 2023-11-26T07:11:45.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.585+0000 7fcdfe7fc700 1 -- 172.21.15.2:0/246593455 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce00014420 con 0x7fce081440f0 2023-11-26T07:11:45.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.585+0000 7fcdfe7fc700 1 -- 172.21.15.2:0/246593455 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce000147d0 con 0x7fce081440f0 2023-11-26T07:11:45.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.585+0000 7fce0fabf700 1 -- 172.21.15.2:0/246593455 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce080cf650 con 0x7fce081440f0 2023-11-26T07:11:45.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.586+0000 7fce0fabf700 1 -- 172.21.15.2:0/246593455 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce080cfc10 con 0x7fce081440f0 2023-11-26T07:11:45.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.586+0000 7fce0fabf700 1 -- 172.21.15.2:0/246593455 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce08075480 con 0x7fce081440f0 2023-11-26T07:11:45.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.587+0000 7fcdfe7fc700 1 -- 172.21.15.2:0/246593455 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fce00014930 con 0x7fce081440f0 2023-11-26T07:11:45.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.587+0000 7fcdfe7fc700 1 --2- 172.21.15.2:0/246593455 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fcdec06aed0 0x7fcdec06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:45.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.587+0000 7fcdfe7fc700 1 -- 172.21.15.2:0/246593455 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce00089ce0 con 0x7fce081440f0 2023-11-26T07:11:45.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.587+0000 7fce0d85b700 1 --2- 172.21.15.2:0/246593455 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fcdec06aed0 0x7fcdec06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:45.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.588+0000 7fce0d85b700 1 --2- 172.21.15.2:0/246593455 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fcdec06aed0 0x7fcdec06d390 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8007fd0 tx=0x7fcdf8007de0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:45.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.592+0000 7fcdfe7fc700 1 -- 172.21.15.2:0/246593455 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fce00054d90 con 0x7fce081440f0 2023-11-26T07:11:45.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.792+0000 7fce0fabf700 1 -- 172.21.15.2:0/246593455 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fce080cfe00 con 0x7fce081440f0 2023-11-26T07:11:45.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.793+0000 7fcdfe7fc700 1 -- 172.21.15.2:0/246593455 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fce000583b0 con 0x7fce081440f0 2023-11-26T07:11:45.795 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-26T07:11:45.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.795+0000 7fce0fabf700 1 -- 172.21.15.2:0/246593455 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fcdec06aed0 msgr2=0x7fcdec06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:45.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.795+0000 7fce0fabf700 1 --2- 172.21.15.2:0/246593455 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fcdec06aed0 0x7fcdec06d390 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8007fd0 tx=0x7fcdf8007de0 comp rx=0 tx=0).stop 2023-11-26T07:11:45.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.795+0000 7fce0fabf700 1 -- 172.21.15.2:0/246593455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce081440f0 msgr2=0x7fce080caa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:45.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.795+0000 7fce0fabf700 1 --2- 172.21.15.2:0/246593455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce081440f0 0x7fce080caa80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fce00007e60 tx=0x7fce0000e3c0 comp rx=0 tx=0).stop 2023-11-26T07:11:45.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.795+0000 7fce0fabf700 1 -- 172.21.15.2:0/246593455 shutdown_connections 2023-11-26T07:11:45.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.795+0000 7fce0fabf700 1 --2- 172.21.15.2:0/246593455 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fcdec06aed0 0x7fcdec06d390 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:45.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.795+0000 7fce0fabf700 1 --2- 172.21.15.2:0/246593455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce081440f0 0x7fce080caa80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:45.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.795+0000 7fce0fabf700 1 --2- 172.21.15.2:0/246593455 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce080722c0 0x7fce08156880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:45.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.795+0000 7fce0fabf700 1 --2- 172.21.15.2:0/246593455 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce08143ae0 0x7fce080ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:45.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.795+0000 7fce0fabf700 1 -- 172.21.15.2:0/246593455 >> 172.21.15.2:0/246593455 conn(0x7fce080b2740 msgr2=0x7fce08071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:45.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.795+0000 7fce0fabf700 1 -- 172.21.15.2:0/246593455 shutdown_connections 2023-11-26T07:11:45.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.795+0000 7fce0fabf700 1 -- 172.21.15.2:0/246593455 wait complete. 2023-11-26T07:11:45.809 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:11:45.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.932+0000 7f758e1c8700 1 Processor -- start 2023-11-26T07:11:45.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.932+0000 7f758e1c8700 1 -- start start 2023-11-26T07:11:45.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.932+0000 7f758e1c8700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f75880722c0 0x7f75880b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:45.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.932+0000 7f758e1c8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f75881440f0 0x7f758806e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:45.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.932+0000 7f758e1c8700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7588143ec0 con 0x7f7588143ae0 2023-11-26T07:11:45.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.932+0000 7f758e1c8700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75880b40a0 con 0x7f75880722c0 2023-11-26T07:11:45.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.932+0000 7f758e1c8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75880b3ae0 con 0x7f75881440f0 2023-11-26T07:11:45.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.933+0000 7f7586ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f75880722c0 0x7f75880b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:45.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.933+0000 7f7586ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f75880722c0 0x7f75880b51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39424/0 (socket says 172.21.15.2:39424) 2023-11-26T07:11:45.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.933+0000 7f7586ffd700 1 -- 172.21.15.2:0/1290558936 learned_addr learned my addr 172.21.15.2:0/1290558936 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:45.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.933+0000 7f7587fff700 1 --2- 172.21.15.2:0/1290558936 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f75881440f0 0x7f758806e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:45.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.933+0000 7f7586ffd700 1 -- 172.21.15.2:0/1290558936 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f75881440f0 msgr2=0x7f758806e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:45.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.933+0000 7f7586ffd700 1 --2- 172.21.15.2:0/1290558936 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f75881440f0 0x7f758806e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:45.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.933+0000 7f7586ffd700 1 -- 172.21.15.2:0/1290558936 >> v1:172.21.15.192:6789/0 conn(0x7f7588143ae0 legacy=0x7f7588071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:45.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.933+0000 7f7586ffd700 1 -- 172.21.15.2:0/1290558936 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75880b3dc0 con 0x7f75880722c0 2023-11-26T07:11:45.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.933+0000 7f7586ffd700 1 --2- 172.21.15.2:0/1290558936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75880722c0 0x7f75880b51b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f757c0098f0 tx=0x7f757c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91579b1657b1b8a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:45.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.933+0000 7f75867fc700 1 -- 172.21.15.2:0/1290558936 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757c00b8a0 con 0x7f75880722c0 2023-11-26T07:11:45.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.933+0000 7f75867fc700 1 -- 172.21.15.2:0/1290558936 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757c00ba00 con 0x7f75880722c0 2023-11-26T07:11:45.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.933+0000 7f75867fc700 1 -- 172.21.15.2:0/1290558936 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757c00bd90 con 0x7f75880722c0 2023-11-26T07:11:45.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.934+0000 7f758e1c8700 1 -- 172.21.15.2:0/1290558936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75880722c0 msgr2=0x7f75880b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:45.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.934+0000 7f758e1c8700 1 --2- 172.21.15.2:0/1290558936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75880722c0 0x7f75880b51b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f757c0098f0 tx=0x7f757c009c00 comp rx=0 tx=0).stop 2023-11-26T07:11:45.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.934+0000 7f758e1c8700 1 -- 172.21.15.2:0/1290558936 shutdown_connections 2023-11-26T07:11:45.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.934+0000 7f758e1c8700 1 --2- 172.21.15.2:0/1290558936 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f75881440f0 0x7f758806e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:45.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.934+0000 7f758e1c8700 1 --2- 172.21.15.2:0/1290558936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75880722c0 0x7f75880b51b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:45.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.934+0000 7f758e1c8700 1 -- 172.21.15.2:0/1290558936 >> 172.21.15.2:0/1290558936 conn(0x7f75880b2740 msgr2=0x7f75880b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:45.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.934+0000 7f758e1c8700 1 -- 172.21.15.2:0/1290558936 shutdown_connections 2023-11-26T07:11:45.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.934+0000 7f758e1c8700 1 -- 172.21.15.2:0/1290558936 wait complete. 2023-11-26T07:11:45.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.935+0000 7f758e1c8700 1 Processor -- start 2023-11-26T07:11:45.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.935+0000 7f758e1c8700 1 -- start start 2023-11-26T07:11:45.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.936+0000 7f758e1c8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f75880722c0 0x7f7588139f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:45.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.936+0000 7f758e1c8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7588143ae0 0x7f758813ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:45.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.936+0000 7f758e1c8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75881440f0 0x7f758813b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:45.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.936+0000 7f758e1c8700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7588155590 con 0x7f75881440f0 2023-11-26T07:11:45.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.936+0000 7f758e1c8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f758815d670 con 0x7f7588143ae0 2023-11-26T07:11:45.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.936+0000 7f758e1c8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7588154f10 con 0x7f75880722c0 2023-11-26T07:11:45.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.936+0000 7f7587fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75881440f0 0x7f758813b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:45.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.936+0000 7f7587fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75881440f0 0x7f758813b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39432/0 (socket says 172.21.15.2:39432) 2023-11-26T07:11:45.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.936+0000 7f7587fff700 1 -- 172.21.15.2:0/2965982665 learned_addr learned my addr 172.21.15.2:0/2965982665 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:45.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.936+0000 7f7586ffd700 1 --2- 172.21.15.2:0/2965982665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7588143ae0 0x7f758813ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:45.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.936+0000 7f75877fe700 1 --2- 172.21.15.2:0/2965982665 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f75880722c0 0x7f7588139f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:45.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.936+0000 7f7587fff700 1 -- 172.21.15.2:0/2965982665 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f75880722c0 msgr2=0x7f7588139f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:45.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.936+0000 7f7587fff700 1 --2- 172.21.15.2:0/2965982665 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f75880722c0 0x7f7588139f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:45.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.936+0000 7f7587fff700 1 -- 172.21.15.2:0/2965982665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7588143ae0 msgr2=0x7f758813ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:45.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.936+0000 7f7587fff700 1 --2- 172.21.15.2:0/2965982665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7588143ae0 0x7f758813ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:45.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.936+0000 7f7587fff700 1 -- 172.21.15.2:0/2965982665 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757c009550 con 0x7f75881440f0 2023-11-26T07:11:45.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.936+0000 7f7587fff700 1 --2- 172.21.15.2:0/2965982665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75881440f0 0x7f758813b280 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7580007e90 tx=0x7f758000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:45.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.937+0000 7f756ffff700 1 -- 172.21.15.2:0/2965982665 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758000ecd0 con 0x7f75881440f0 2023-11-26T07:11:45.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.937+0000 7f756ffff700 1 -- 172.21.15.2:0/2965982665 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f758000ee30 con 0x7f75881440f0 2023-11-26T07:11:45.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.937+0000 7f756ffff700 1 -- 172.21.15.2:0/2965982665 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7580014660 con 0x7f75881440f0 2023-11-26T07:11:45.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.937+0000 7f758e1c8700 1 -- 172.21.15.2:0/2965982665 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f758815d390 con 0x7f75881440f0 2023-11-26T07:11:45.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.937+0000 7f758e1c8700 1 -- 172.21.15.2:0/2965982665 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7588141f50 con 0x7f75881440f0 2023-11-26T07:11:45.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.938+0000 7f758e1c8700 1 -- 172.21.15.2:0/2965982665 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7588154d70 con 0x7f75881440f0 2023-11-26T07:11:45.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.938+0000 7f756ffff700 1 -- 172.21.15.2:0/2965982665 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f75800147c0 con 0x7f75881440f0 2023-11-26T07:11:45.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.939+0000 7f756ffff700 1 --2- 172.21.15.2:0/2965982665 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f757406aed0 0x7f757406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:45.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.939+0000 7f756ffff700 1 -- 172.21.15.2:0/2965982665 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7580089a90 con 0x7f75881440f0 2023-11-26T07:11:45.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.939+0000 7f75877fe700 1 --2- 172.21.15.2:0/2965982665 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f757406aed0 0x7f757406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:45.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.939+0000 7f75877fe700 1 --2- 172.21.15.2:0/2965982665 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f757406aed0 0x7f757406d390 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7578007fd0 tx=0x7f7578009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:45.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:45.943+0000 7f756ffff700 1 -- 172.21.15.2:0/2965982665 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7588154d70 con 0x7f75881440f0 2023-11-26T07:11:46.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.189+0000 7f758e1c8700 1 -- 172.21.15.2:0/2965982665 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75881556d0 con 0x7f75881440f0 2023-11-26T07:11:46.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.189+0000 7f756ffff700 1 -- 172.21.15.2:0/2965982665 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7f75881556d0 con 0x7f75881440f0 2023-11-26T07:11:46.191 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:11:46.191 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/3693634219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3693634219},{"type":"v1","addr":"172.21.15.2:6834","nonce":3693634219}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/953933423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":953933423},{"type":"v1","addr":"172.21.15.2:6835","nonce":953933423}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1000951065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1000951065},{"type":"v1","addr":"172.21.15.192:6836","nonce":1000951065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:11:34.051331+0000","modified":"2023-11-26T07:11:37.067662+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/4032661989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4032661989},{"type":"v1","addr":"172.21.15.192:6837","nonce":4032661989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-26T07:11:46.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.191+0000 7f758e1c8700 1 -- 172.21.15.2:0/2965982665 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f757406aed0 msgr2=0x7f757406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:46.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.191+0000 7f758e1c8700 1 --2- 172.21.15.2:0/2965982665 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f757406aed0 0x7f757406d390 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7578007fd0 tx=0x7f7578009040 comp rx=0 tx=0).stop 2023-11-26T07:11:46.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.191+0000 7f758e1c8700 1 -- 172.21.15.2:0/2965982665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75881440f0 msgr2=0x7f758813b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:46.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.191+0000 7f758e1c8700 1 --2- 172.21.15.2:0/2965982665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75881440f0 0x7f758813b280 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7580007e90 tx=0x7f758000e3c0 comp rx=0 tx=0).stop 2023-11-26T07:11:46.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.191+0000 7f758e1c8700 1 -- 172.21.15.2:0/2965982665 shutdown_connections 2023-11-26T07:11:46.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.191+0000 7f758e1c8700 1 --2- 172.21.15.2:0/2965982665 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f757406aed0 0x7f757406d390 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:46.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.191+0000 7f758e1c8700 1 --2- 172.21.15.2:0/2965982665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75881440f0 0x7f758813b280 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:46.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.191+0000 7f758e1c8700 1 --2- 172.21.15.2:0/2965982665 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f75880722c0 0x7f7588139f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:46.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.191+0000 7f758e1c8700 1 --2- 172.21.15.2:0/2965982665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7588143ae0 0x7f758813ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:46.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.191+0000 7f758e1c8700 1 -- 172.21.15.2:0/2965982665 >> 172.21.15.2:0/2965982665 conn(0x7f75880b2740 msgr2=0x7f75880b4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:46.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.191+0000 7f758e1c8700 1 -- 172.21.15.2:0/2965982665 shutdown_connections 2023-11-26T07:11:46.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.191+0000 7f758e1c8700 1 -- 172.21.15.2:0/2965982665 wait complete. 2023-11-26T07:11:46.194 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 8 2023-11-26T07:11:46.205 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:11:46.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.330+0000 7fc23f871700 1 Processor -- start 2023-11-26T07:11:46.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.330+0000 7fc23f871700 1 -- start start 2023-11-26T07:11:46.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.331+0000 7fc23f871700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc2381445f0 0x7fc2380cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:46.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.331+0000 7fc23f871700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2381449d0 con 0x7fc23806e480 2023-11-26T07:11:46.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.331+0000 7fc23f871700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc238071650 con 0x7fc23806cae0 2023-11-26T07:11:46.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.331+0000 7fc23f871700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc238072e00 con 0x7fc2381445f0 2023-11-26T07:11:46.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.331+0000 7fc23de0e700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc23806e480 0x7fc2380cd550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58882/0 (socket says 172.21.15.2:58882) 2023-11-26T07:11:46.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.331+0000 7fc23de0e700 1 -- 172.21.15.2:0/356144260 learned_addr learned my addr 172.21.15.2:0/356144260 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:11:46.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.332+0000 7fc23d60d700 1 --2- 172.21.15.2:0/356144260 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc2381445f0 0x7fc2380cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:46.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.332+0000 7fc22ffff700 1 -- 172.21.15.2:0/356144260 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4069760921 0 0) 0x7fc2381449d0 con 0x7fc23806e480 2023-11-26T07:11:46.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.332+0000 7fc22ffff700 1 -- 172.21.15.2:0/356144260 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2240035b0 con 0x7fc23806e480 2023-11-26T07:11:46.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.332+0000 7fc22ffff700 1 -- 172.21.15.2:0/356144260 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 679987397 0 0) 0x7fc2240035b0 con 0x7fc23806e480 2023-11-26T07:11:46.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.332+0000 7fc22ffff700 1 -- 172.21.15.2:0/356144260 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc2381445f0 msgr2=0x7fc2380cb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:46.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.332+0000 7fc22ffff700 1 --2- 172.21.15.2:0/356144260 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc2381445f0 0x7fc2380cb2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:46.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.332+0000 7fc22ffff700 1 -- 172.21.15.2:0/356144260 >> v1:172.21.15.192:6789/0 conn(0x7fc23806cae0 legacy=0x7fc2380726f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:46.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.332+0000 7fc22ffff700 1 -- 172.21.15.2:0/356144260 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc238071930 con 0x7fc23806e480 2023-11-26T07:11:46.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.332+0000 7fc22ffff700 1 -- 172.21.15.2:0/356144260 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7fc2300019f0 con 0x7fc23806e480 2023-11-26T07:11:46.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.332+0000 7fc22ffff700 1 -- 172.21.15.2:0/356144260 >> v1:172.21.15.2:6789/0 conn(0x7fc23806e480 legacy=0x7fc2380cd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:46.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.332+0000 7fc22ffff700 1 --2- 172.21.15.2:0/356144260 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc224003a30 0x7fc224003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:46.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.332+0000 7fc22ffff700 1 --2- 172.21.15.2:0/356144260 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc2381445f0 0x7fc224004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:46.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.332+0000 7fc22ffff700 1 --2- 172.21.15.2:0/356144260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc224004d90 0x7fc224005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:46.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.332+0000 7fc22ffff700 1 -- 172.21.15.2:0/356144260 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc238072e00 con 0x7fc224003a30 2023-11-26T07:11:46.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.332+0000 7fc22ffff700 1 -- 172.21.15.2:0/356144260 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22400ba10 con 0x7fc224004d90 2023-11-26T07:11:46.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.332+0000 7fc22ffff700 1 -- 172.21.15.2:0/356144260 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc22400bbd0 con 0x7fc2381445f0 2023-11-26T07:11:46.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.332+0000 7fc23d60d700 1 --2- 172.21.15.2:0/356144260 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc224003a30 0x7fc224003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:46.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.332+0000 7fc23ce0c700 1 --2- 172.21.15.2:0/356144260 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc2381445f0 0x7fc224004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:46.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.332+0000 7fc23de0e700 1 --2- 172.21.15.2:0/356144260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc224004d90 0x7fc224005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:46.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.332+0000 7fc23d60d700 1 -- 172.21.15.2:0/356144260 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc2381445f0 msgr2=0x7fc224004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:46.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.332+0000 7fc23d60d700 1 --2- 172.21.15.2:0/356144260 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc2381445f0 0x7fc224004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:46.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.332+0000 7fc23d60d700 1 -- 172.21.15.2:0/356144260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc224004d90 msgr2=0x7fc224005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:46.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.332+0000 7fc23d60d700 1 --2- 172.21.15.2:0/356144260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc224004d90 0x7fc224005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:46.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.332+0000 7fc23d60d700 1 -- 172.21.15.2:0/356144260 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2240035b0 con 0x7fc224003a30 2023-11-26T07:11:46.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.332+0000 7fc23d60d700 1 --2- 172.21.15.2:0/356144260 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc224003a30 0x7fc224003e10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc228009b60 tx=0x7fc224005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac8204fbe62522fc server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:46.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.333+0000 7fc22ffff700 1 -- 172.21.15.2:0/356144260 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22800e6c0 con 0x7fc224003a30 2023-11-26T07:11:46.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.333+0000 7fc22ffff700 1 -- 172.21.15.2:0/356144260 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22800e820 con 0x7fc224003a30 2023-11-26T07:11:46.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.333+0000 7fc22ffff700 1 -- 172.21.15.2:0/356144260 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22800eb90 con 0x7fc224003a30 2023-11-26T07:11:46.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.333+0000 7fc23f871700 1 -- 172.21.15.2:0/356144260 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc224003a30 msgr2=0x7fc224003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:46.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.333+0000 7fc23f871700 1 --2- 172.21.15.2:0/356144260 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc224003a30 0x7fc224003e10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc228009b60 tx=0x7fc224005880 comp rx=0 tx=0).stop 2023-11-26T07:11:46.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.333+0000 7fc23de0e700 1 -- 172.21.15.2:0/356144260 reap_dead start 2023-11-26T07:11:46.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.333+0000 7fc23f871700 1 -- 172.21.15.2:0/356144260 shutdown_connections 2023-11-26T07:11:46.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.333+0000 7fc23f871700 1 -- 172.21.15.2:0/356144260 >> 172.21.15.2:0/356144260 conn(0x7fc2380cf980 msgr2=0x7fc2380cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:46.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.333+0000 7fc23f871700 1 -- 172.21.15.2:0/356144260 shutdown_connections 2023-11-26T07:11:46.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.333+0000 7fc23f871700 1 -- 172.21.15.2:0/356144260 wait complete. 2023-11-26T07:11:46.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.335+0000 7fc23f871700 1 Processor -- start 2023-11-26T07:11:46.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.335+0000 7fc23f871700 1 -- start start 2023-11-26T07:11:46.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.335+0000 7fc23f871700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc224003a30 0x7fc23813ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:46.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.335+0000 7fc23f871700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2380c93f0 0x7fc2381f3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:46.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.335+0000 7fc23f871700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2380b45a0 0x7fc2380b4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:46.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.336+0000 7fc23f871700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2380b4f90 con 0x7fc2380b45a0 2023-11-26T07:11:46.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.336+0000 7fc23f871700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2381f4e20 con 0x7fc2380c93f0 2023-11-26T07:11:46.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.336+0000 7fc23f871700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2381f3fa0 con 0x7fc224003a30 2023-11-26T07:11:46.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.336+0000 7fc23de0e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2380b45a0 0x7fc2380b4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:46.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.336+0000 7fc23de0e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2380b45a0 0x7fc2380b4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39452/0 (socket says 172.21.15.2:39452) 2023-11-26T07:11:46.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.336+0000 7fc23de0e700 1 -- 172.21.15.2:0/3274405305 learned_addr learned my addr 172.21.15.2:0/3274405305 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:46.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.336+0000 7fc23ce0c700 1 --2- 172.21.15.2:0/3274405305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2380c93f0 0x7fc2381f3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:46.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.336+0000 7fc23d60d700 1 --2- 172.21.15.2:0/3274405305 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc224003a30 0x7fc23813ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:46.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.336+0000 7fc23de0e700 1 -- 172.21.15.2:0/3274405305 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc224003a30 msgr2=0x7fc23813ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:46.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.336+0000 7fc23de0e700 1 --2- 172.21.15.2:0/3274405305 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc224003a30 0x7fc23813ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:46.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.336+0000 7fc23de0e700 1 -- 172.21.15.2:0/3274405305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2380c93f0 msgr2=0x7fc2381f3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:46.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.336+0000 7fc23de0e700 1 --2- 172.21.15.2:0/3274405305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2380c93f0 0x7fc2381f3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:46.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.336+0000 7fc23de0e700 1 -- 172.21.15.2:0/3274405305 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2381f4a90 con 0x7fc2380b45a0 2023-11-26T07:11:46.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.336+0000 7fc23de0e700 1 --2- 172.21.15.2:0/3274405305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2380b45a0 0x7fc2380b4a50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc238071020 tx=0x7fc23000e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:46.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.336+0000 7fc22dffb700 1 -- 172.21.15.2:0/3274405305 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc230017070 con 0x7fc2380b45a0 2023-11-26T07:11:46.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.336+0000 7fc22dffb700 1 -- 172.21.15.2:0/3274405305 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc23000eb30 con 0x7fc2380b45a0 2023-11-26T07:11:46.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.336+0000 7fc23f871700 1 -- 172.21.15.2:0/3274405305 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2380b13c0 con 0x7fc2380b45a0 2023-11-26T07:11:46.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.336+0000 7fc22dffb700 1 -- 172.21.15.2:0/3274405305 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23000ece0 con 0x7fc2380b45a0 2023-11-26T07:11:46.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.336+0000 7fc23f871700 1 -- 172.21.15.2:0/3274405305 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2381f44d0 con 0x7fc2380b45a0 2023-11-26T07:11:46.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.337+0000 7fc23f871700 1 -- 172.21.15.2:0/3274405305 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc238067f60 con 0x7fc2380b45a0 2023-11-26T07:11:46.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.338+0000 7fc22dffb700 1 -- 172.21.15.2:0/3274405305 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc230013420 con 0x7fc2380b45a0 2023-11-26T07:11:46.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.338+0000 7fc22dffb700 1 --2- 172.21.15.2:0/3274405305 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc21c06aed0 0x7fc21c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:46.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.338+0000 7fc22dffb700 1 -- 172.21.15.2:0/3274405305 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc2300892a0 con 0x7fc2380b45a0 2023-11-26T07:11:46.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.338+0000 7fc23d60d700 1 --2- 172.21.15.2:0/3274405305 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc21c06aed0 0x7fc21c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:46.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.339+0000 7fc23d60d700 1 --2- 172.21.15.2:0/3274405305 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc21c06aed0 0x7fc21c06d390 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc2280090b0 tx=0x7fc228008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:46.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.343+0000 7fc22dffb700 1 -- 172.21.15.2:0/3274405305 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc230057de0 con 0x7fc2380b45a0 2023-11-26T07:11:46.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.544+0000 7fc23f871700 1 -- 172.21.15.2:0/3274405305 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2380731b0 con 0x7fc2380b45a0 2023-11-26T07:11:46.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.546+0000 7fc22dffb700 1 -- 172.21.15.2:0/3274405305 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16457 (secure 0 0 0) 0x7fc230057970 con 0x7fc2380b45a0 2023-11-26T07:11:46.548 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:11:46.548 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:11:35.634747+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:11:32.129474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:11:33.019837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:11:46.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.548+0000 7fc23f871700 1 -- 172.21.15.2:0/3274405305 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc21c06aed0 msgr2=0x7fc21c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:46.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.548+0000 7fc23f871700 1 --2- 172.21.15.2:0/3274405305 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc21c06aed0 0x7fc21c06d390 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc2280090b0 tx=0x7fc228008030 comp rx=0 tx=0).stop 2023-11-26T07:11:46.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.548+0000 7fc23f871700 1 -- 172.21.15.2:0/3274405305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2380b45a0 msgr2=0x7fc2380b4a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:46.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.548+0000 7fc23f871700 1 --2- 172.21.15.2:0/3274405305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2380b45a0 0x7fc2380b4a50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc238071020 tx=0x7fc23000e440 comp rx=0 tx=0).stop 2023-11-26T07:11:46.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.548+0000 7fc23f871700 1 -- 172.21.15.2:0/3274405305 shutdown_connections 2023-11-26T07:11:46.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.548+0000 7fc23f871700 1 --2- 172.21.15.2:0/3274405305 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc21c06aed0 0x7fc21c06d390 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:46.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.548+0000 7fc23f871700 1 --2- 172.21.15.2:0/3274405305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2380b45a0 0x7fc2380b4a50 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:46.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.548+0000 7fc23f871700 1 --2- 172.21.15.2:0/3274405305 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc224003a30 0x7fc23813ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:46.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.548+0000 7fc23f871700 1 --2- 172.21.15.2:0/3274405305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2380c93f0 0x7fc2381f3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:46.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.548+0000 7fc23f871700 1 -- 172.21.15.2:0/3274405305 >> 172.21.15.2:0/3274405305 conn(0x7fc2380cf980 msgr2=0x7fc2380cd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:46.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.548+0000 7fc23f871700 1 -- 172.21.15.2:0/3274405305 shutdown_connections 2023-11-26T07:11:46.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.548+0000 7fc23f871700 1 -- 172.21.15.2:0/3274405305 wait complete. 2023-11-26T07:11:46.562 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:11:28.205739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:11:32.129474+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:11:33.019837+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:11:46.562 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:11:46.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.689+0000 7ff3760b7700 1 Processor -- start 2023-11-26T07:11:46.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.689+0000 7ff3760b7700 1 -- start start 2023-11-26T07:11:46.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.690+0000 7ff3760b7700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff3701444b0 0x7ff370071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:46.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.690+0000 7ff3760b7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff37006e560 0x7ff3700cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:46.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.690+0000 7ff3760b7700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff37006f7d0 con 0x7ff3700720f0 2023-11-26T07:11:46.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.690+0000 7ff3760b7700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff37006fc60 con 0x7ff3701444b0 2023-11-26T07:11:46.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.690+0000 7ff3760b7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff37006e9a0 con 0x7ff37006e560 2023-11-26T07:11:46.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.690+0000 7ff36f7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff3701444b0 0x7ff370071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:46.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.690+0000 7ff36f7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff3701444b0 0x7ff370071bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39456/0 (socket says 172.21.15.2:39456) 2023-11-26T07:11:46.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.690+0000 7ff36f7fe700 1 -- 172.21.15.2:0/955731964 learned_addr learned my addr 172.21.15.2:0/955731964 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:46.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.690+0000 7ff36ffff700 1 --2- 172.21.15.2:0/955731964 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff37006e560 0x7ff3700cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:46.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.690+0000 7ff36f7fe700 1 -- 172.21.15.2:0/955731964 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff37006e560 msgr2=0x7ff3700cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:46.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.690+0000 7ff36f7fe700 1 --2- 172.21.15.2:0/955731964 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff37006e560 0x7ff3700cde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:46.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.690+0000 7ff36f7fe700 1 -- 172.21.15.2:0/955731964 >> v1:172.21.15.192:6789/0 conn(0x7ff3700720f0 legacy=0x7ff37006de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:46.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.690+0000 7ff36f7fe700 1 -- 172.21.15.2:0/955731964 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff370072530 con 0x7ff3701444b0 2023-11-26T07:11:46.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.691+0000 7ff36f7fe700 1 --2- 172.21.15.2:0/955731964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3701444b0 0x7ff370071bb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff35800bbc0 tx=0x7ff35800bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87eba1a1ddd4b425 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:46.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.691+0000 7ff36e7fc700 1 -- 172.21.15.2:0/955731964 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35800dd50 con 0x7ff3701444b0 2023-11-26T07:11:46.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.691+0000 7ff36e7fc700 1 -- 172.21.15.2:0/955731964 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff358010470 con 0x7ff3701444b0 2023-11-26T07:11:46.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.691+0000 7ff36e7fc700 1 -- 172.21.15.2:0/955731964 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff358010800 con 0x7ff3701444b0 2023-11-26T07:11:46.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.691+0000 7ff3760b7700 1 -- 172.21.15.2:0/955731964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3701444b0 msgr2=0x7ff370071bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:46.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.691+0000 7ff3760b7700 1 --2- 172.21.15.2:0/955731964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3701444b0 0x7ff370071bb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff35800bbc0 tx=0x7ff35800bed0 comp rx=0 tx=0).stop 2023-11-26T07:11:46.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.691+0000 7ff3760b7700 1 -- 172.21.15.2:0/955731964 shutdown_connections 2023-11-26T07:11:46.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.691+0000 7ff3760b7700 1 --2- 172.21.15.2:0/955731964 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff37006e560 0x7ff3700cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:46.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.691+0000 7ff3760b7700 1 --2- 172.21.15.2:0/955731964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3701444b0 0x7ff370071bb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:46.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.691+0000 7ff3760b7700 1 -- 172.21.15.2:0/955731964 >> 172.21.15.2:0/955731964 conn(0x7ff3700b27b0 msgr2=0x7ff3700b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:46.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.691+0000 7ff3760b7700 1 -- 172.21.15.2:0/955731964 shutdown_connections 2023-11-26T07:11:46.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.691+0000 7ff3760b7700 1 -- 172.21.15.2:0/955731964 wait complete. 2023-11-26T07:11:46.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.692+0000 7ff3760b7700 1 Processor -- start 2023-11-26T07:11:46.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.693+0000 7ff3760b7700 1 -- start start 2023-11-26T07:11:46.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.693+0000 7ff3760b7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff37006e560 0x7ff37013d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:46.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.693+0000 7ff3760b7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3700720f0 0x7ff3701f3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:46.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.693+0000 7ff3760b7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3701444b0 0x7ff3701f3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:46.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.693+0000 7ff3760b7700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff37015a600 con 0x7ff3701444b0 2023-11-26T07:11:46.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.693+0000 7ff3760b7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3701f3fe0 con 0x7ff3700720f0 2023-11-26T07:11:46.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.693+0000 7ff3760b7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3701f3d00 con 0x7ff37006e560 2023-11-26T07:11:46.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.694+0000 7ff36ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3701444b0 0x7ff3701f3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:46.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.694+0000 7ff36ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3701444b0 0x7ff3701f3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39466/0 (socket says 172.21.15.2:39466) 2023-11-26T07:11:46.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.694+0000 7ff36ffff700 1 -- 172.21.15.2:0/550254178 learned_addr learned my addr 172.21.15.2:0/550254178 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:46.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.694+0000 7ff36effd700 1 --2- 172.21.15.2:0/550254178 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3700720f0 0x7ff3701f3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:46.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.694+0000 7ff36f7fe700 1 --2- 172.21.15.2:0/550254178 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff37006e560 0x7ff37013d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:46.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.694+0000 7ff36ffff700 1 -- 172.21.15.2:0/550254178 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff37006e560 msgr2=0x7ff37013d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:46.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.694+0000 7ff36ffff700 1 --2- 172.21.15.2:0/550254178 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff37006e560 0x7ff37013d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:46.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.694+0000 7ff36ffff700 1 -- 172.21.15.2:0/550254178 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3700720f0 msgr2=0x7ff3701f3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:46.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.694+0000 7ff36ffff700 1 --2- 172.21.15.2:0/550254178 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3700720f0 0x7ff3701f3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:46.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.694+0000 7ff36ffff700 1 -- 172.21.15.2:0/550254178 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff35800b7f0 con 0x7ff3701444b0 2023-11-26T07:11:46.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.694+0000 7ff36ffff700 1 --2- 172.21.15.2:0/550254178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3701444b0 0x7ff3701f3660 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff368007e40 tx=0x7ff36800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:46.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.694+0000 7ff367fff700 1 -- 172.21.15.2:0/550254178 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36800ed30 con 0x7ff3701444b0 2023-11-26T07:11:46.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.694+0000 7ff367fff700 1 -- 172.21.15.2:0/550254178 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff368014420 con 0x7ff3701444b0 2023-11-26T07:11:46.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.694+0000 7ff367fff700 1 -- 172.21.15.2:0/550254178 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3680147d0 con 0x7ff3701444b0 2023-11-26T07:11:46.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.694+0000 7ff3760b7700 1 -- 172.21.15.2:0/550254178 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff370140a20 con 0x7ff3701444b0 2023-11-26T07:11:46.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.694+0000 7ff3760b7700 1 -- 172.21.15.2:0/550254178 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff370140fe0 con 0x7ff3701444b0 2023-11-26T07:11:46.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.695+0000 7ff3760b7700 1 -- 172.21.15.2:0/550254178 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff370075480 con 0x7ff3701444b0 2023-11-26T07:11:46.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.696+0000 7ff367fff700 1 -- 172.21.15.2:0/550254178 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff368014930 con 0x7ff3701444b0 2023-11-26T07:11:46.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.696+0000 7ff367fff700 1 --2- 172.21.15.2:0/550254178 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff35006aed0 0x7ff35006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:46.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.696+0000 7ff367fff700 1 -- 172.21.15.2:0/550254178 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff368089c80 con 0x7ff3701444b0 2023-11-26T07:11:46.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.696+0000 7ff36f7fe700 1 --2- 172.21.15.2:0/550254178 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff35006aed0 0x7ff35006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:46.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.697+0000 7ff36f7fe700 1 --2- 172.21.15.2:0/550254178 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff35006aed0 0x7ff35006d390 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff35800bf10 tx=0x7ff358013000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:46.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.701+0000 7ff367fff700 1 -- 172.21.15.2:0/550254178 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff368054d30 con 0x7ff3701444b0 2023-11-26T07:11:46.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.900+0000 7ff3760b7700 1 -- 172.21.15.2:0/550254178 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff370141200 con 0x7ff3701444b0 2023-11-26T07:11:46.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.901+0000 7ff367fff700 1 -- 172.21.15.2:0/550254178 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff368058350 con 0x7ff3701444b0 2023-11-26T07:11:46.903 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-26T07:11:46.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.903+0000 7ff3760b7700 1 -- 172.21.15.2:0/550254178 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff35006aed0 msgr2=0x7ff35006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:46.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.903+0000 7ff3760b7700 1 --2- 172.21.15.2:0/550254178 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff35006aed0 0x7ff35006d390 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff35800bf10 tx=0x7ff358013000 comp rx=0 tx=0).stop 2023-11-26T07:11:46.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.903+0000 7ff3760b7700 1 -- 172.21.15.2:0/550254178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3701444b0 msgr2=0x7ff3701f3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:46.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.903+0000 7ff3760b7700 1 --2- 172.21.15.2:0/550254178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3701444b0 0x7ff3701f3660 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff368007e40 tx=0x7ff36800e3c0 comp rx=0 tx=0).stop 2023-11-26T07:11:46.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.903+0000 7ff3760b7700 1 -- 172.21.15.2:0/550254178 shutdown_connections 2023-11-26T07:11:46.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.903+0000 7ff3760b7700 1 --2- 172.21.15.2:0/550254178 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff35006aed0 0x7ff35006d390 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:46.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.903+0000 7ff3760b7700 1 --2- 172.21.15.2:0/550254178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3701444b0 0x7ff3701f3660 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:46.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.903+0000 7ff3760b7700 1 --2- 172.21.15.2:0/550254178 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff37006e560 0x7ff37013d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:46.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.903+0000 7ff3760b7700 1 --2- 172.21.15.2:0/550254178 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3700720f0 0x7ff3701f3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:46.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.903+0000 7ff3760b7700 1 -- 172.21.15.2:0/550254178 >> 172.21.15.2:0/550254178 conn(0x7ff3700b27b0 msgr2=0x7ff37015ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:46.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.903+0000 7ff3760b7700 1 -- 172.21.15.2:0/550254178 shutdown_connections 2023-11-26T07:11:46.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:46.903+0000 7ff3760b7700 1 -- 172.21.15.2:0/550254178 wait complete. 2023-11-26T07:11:46.917 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:11:47.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.043+0000 7f143c6a1700 1 Processor -- start 2023-11-26T07:11:47.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.043+0000 7f143c6a1700 1 -- start start 2023-11-26T07:11:47.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.044+0000 7f143c6a1700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1434143ae0 0x7f14340b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:47.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.044+0000 7f143c6a1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14340722c0 0x7f143406e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:47.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.044+0000 7f143c6a1700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1434143ec0 con 0x7f14341440f0 2023-11-26T07:11:47.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.044+0000 7f143c6a1700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14340b40a0 con 0x7f1434143ae0 2023-11-26T07:11:47.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.044+0000 7f143c6a1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14340b3ae0 con 0x7f14340722c0 2023-11-26T07:11:47.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.044+0000 7f143ac3e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14340722c0 0x7f143406e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:47.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.044+0000 7f143a43d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1434143ae0 0x7f14340b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:47.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.044+0000 7f1439c3c700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f14341440f0 0x7f1434071bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.2:38052/0 (socket says 172.21.15.2:38052) 2023-11-26T07:11:47.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.044+0000 7f1439c3c700 1 -- 172.21.15.2:0/2446377245 learned_addr learned my addr 172.21.15.2:0/2446377245 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:11:47.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.044+0000 7f143ac3e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14340722c0 0x7f143406e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.2:37554/0 (socket says 172.21.15.2:37554) 2023-11-26T07:11:47.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.045+0000 7f143a43d700 1 -- 172.21.15.2:0/2446377245 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14340722c0 msgr2=0x7f143406e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:47.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.045+0000 7f143a43d700 1 --2- 172.21.15.2:0/2446377245 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14340722c0 0x7f143406e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:47.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.045+0000 7f143a43d700 1 -- 172.21.15.2:0/2446377245 >> v1:172.21.15.192:6789/0 conn(0x7f14341440f0 legacy=0x7f1434071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:47.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.045+0000 7f143a43d700 1 -- 172.21.15.2:0/2446377245 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14340b3dc0 con 0x7f1434143ae0 2023-11-26T07:11:47.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.045+0000 7f143943b700 1 -- 172.21.15.2:0/2446377245 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3103657251 0 0) 0x7f1434143ec0 con 0x7f14341440f0 2023-11-26T07:11:47.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.045+0000 7f143a43d700 1 --2- 172.21.15.2:0/2446377245 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1434143ae0 0x7f14340b51b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1424009840 tx=0x7f1424009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d975578967ba19cb server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:47.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.045+0000 7f143943b700 1 -- 172.21.15.2:0/2446377245 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1424011830 con 0x7f1434143ae0 2023-11-26T07:11:47.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.045+0000 7f143943b700 1 -- 172.21.15.2:0/2446377245 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1424011990 con 0x7f1434143ae0 2023-11-26T07:11:47.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.045+0000 7f143943b700 1 -- 172.21.15.2:0/2446377245 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1424011d20 con 0x7f1434143ae0 2023-11-26T07:11:47.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.046+0000 7f143c6a1700 1 -- 172.21.15.2:0/2446377245 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1434143ae0 msgr2=0x7f14340b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:47.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.046+0000 7f143c6a1700 1 --2- 172.21.15.2:0/2446377245 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1434143ae0 0x7f14340b51b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1424009840 tx=0x7f1424009b50 comp rx=0 tx=0).stop 2023-11-26T07:11:47.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.046+0000 7f143c6a1700 1 -- 172.21.15.2:0/2446377245 shutdown_connections 2023-11-26T07:11:47.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.046+0000 7f143c6a1700 1 --2- 172.21.15.2:0/2446377245 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14340722c0 0x7f143406e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:47.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.046+0000 7f143c6a1700 1 --2- 172.21.15.2:0/2446377245 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1434143ae0 0x7f14340b51b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:47.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.046+0000 7f143c6a1700 1 -- 172.21.15.2:0/2446377245 >> 172.21.15.2:0/2446377245 conn(0x7f14340b2740 msgr2=0x7f14340b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:47.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.046+0000 7f143c6a1700 1 -- 172.21.15.2:0/2446377245 shutdown_connections 2023-11-26T07:11:47.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.046+0000 7f143c6a1700 1 -- 172.21.15.2:0/2446377245 wait complete. 2023-11-26T07:11:47.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.047+0000 7f143c6a1700 1 Processor -- start 2023-11-26T07:11:47.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.047+0000 7f143c6a1700 1 -- start start 2023-11-26T07:11:47.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.048+0000 7f143c6a1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14340722c0 0x7f14341f7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:47.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.048+0000 7f143c6a1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1434143ae0 0x7f1434142140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:47.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.048+0000 7f143c6a1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14341440f0 0x7f1434159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:47.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.048+0000 7f143c6a1700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1434141000 con 0x7f1434143ae0 2023-11-26T07:11:47.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.048+0000 7f143c6a1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1434155ed0 con 0x7f14341440f0 2023-11-26T07:11:47.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.048+0000 7f143c6a1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14341f42b0 con 0x7f14340722c0 2023-11-26T07:11:47.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.048+0000 7f1439c3c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1434143ae0 0x7f1434142140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:47.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.048+0000 7f1439c3c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1434143ae0 0x7f1434142140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39478/0 (socket says 172.21.15.2:39478) 2023-11-26T07:11:47.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.048+0000 7f1439c3c700 1 -- 172.21.15.2:0/181984018 learned_addr learned my addr 172.21.15.2:0/181984018 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:47.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.048+0000 7f143a43d700 1 --2- 172.21.15.2:0/181984018 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14340722c0 0x7f14341f7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:47.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.048+0000 7f143ac3e700 1 --2- 172.21.15.2:0/181984018 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14341440f0 0x7f1434159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:47.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.048+0000 7f1439c3c700 1 -- 172.21.15.2:0/181984018 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14340722c0 msgr2=0x7f14341f7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:47.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.048+0000 7f1439c3c700 1 --2- 172.21.15.2:0/181984018 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14340722c0 0x7f14341f7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:47.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.048+0000 7f1439c3c700 1 -- 172.21.15.2:0/181984018 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14341440f0 msgr2=0x7f1434159c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:47.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.048+0000 7f1439c3c700 1 --2- 172.21.15.2:0/181984018 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14341440f0 0x7f1434159c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:47.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.048+0000 7f1439c3c700 1 -- 172.21.15.2:0/181984018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14240094a0 con 0x7f1434143ae0 2023-11-26T07:11:47.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.048+0000 7f143a43d700 1 --2- 172.21.15.2:0/181984018 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14340722c0 0x7f14341f7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:11:47.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.048+0000 7f1439c3c700 1 --2- 172.21.15.2:0/181984018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1434143ae0 0x7f1434142140 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f143000c550 tx=0x7f143000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:47.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.048+0000 7f142affd700 1 -- 172.21.15.2:0/181984018 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1430004c80 con 0x7f1434143ae0 2023-11-26T07:11:47.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.049+0000 7f142affd700 1 -- 172.21.15.2:0/181984018 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1430004e00 con 0x7f1434143ae0 2023-11-26T07:11:47.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.049+0000 7f143c6a1700 1 -- 172.21.15.2:0/181984018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14340cc120 con 0x7f1434143ae0 2023-11-26T07:11:47.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.049+0000 7f142affd700 1 -- 172.21.15.2:0/181984018 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1430007310 con 0x7f1434143ae0 2023-11-26T07:11:47.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.049+0000 7f143c6a1700 1 -- 172.21.15.2:0/181984018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14341426e0 con 0x7f1434143ae0 2023-11-26T07:11:47.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.050+0000 7f143c6a1700 1 -- 172.21.15.2:0/181984018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f143413f770 con 0x7f1434143ae0 2023-11-26T07:11:47.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.050+0000 7f142affd700 1 -- 172.21.15.2:0/181984018 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1430007470 con 0x7f1434143ae0 2023-11-26T07:11:47.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.050+0000 7f142affd700 1 --2- 172.21.15.2:0/181984018 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f141806aed0 0x7f141806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:47.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.051+0000 7f142affd700 1 -- 172.21.15.2:0/181984018 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1430089310 con 0x7f1434143ae0 2023-11-26T07:11:47.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.051+0000 7f143a43d700 1 --2- 172.21.15.2:0/181984018 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f141806aed0 0x7f141806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:47.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.051+0000 7f143a43d700 1 --2- 172.21.15.2:0/181984018 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f141806aed0 0x7f141806d390 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f14240090b0 tx=0x7f1424008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:47.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.055+0000 7f142affd700 1 -- 172.21.15.2:0/181984018 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1430054340 con 0x7f1434143ae0 2023-11-26T07:11:47.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.256+0000 7f143c6a1700 1 -- 172.21.15.2:0/181984018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1434075480 con 0x7f1434143ae0 2023-11-26T07:11:47.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.256+0000 7f142affd700 1 -- 172.21.15.2:0/181984018 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1430057960 con 0x7f1434143ae0 2023-11-26T07:11:47.258 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-26T07:11:47.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.258+0000 7f143c6a1700 1 -- 172.21.15.2:0/181984018 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f141806aed0 msgr2=0x7f141806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:47.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.258+0000 7f143c6a1700 1 --2- 172.21.15.2:0/181984018 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f141806aed0 0x7f141806d390 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f14240090b0 tx=0x7f1424008030 comp rx=0 tx=0).stop 2023-11-26T07:11:47.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.258+0000 7f143c6a1700 1 -- 172.21.15.2:0/181984018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1434143ae0 msgr2=0x7f1434142140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:47.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.258+0000 7f143c6a1700 1 --2- 172.21.15.2:0/181984018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1434143ae0 0x7f1434142140 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f143000c550 tx=0x7f143000c910 comp rx=0 tx=0).stop 2023-11-26T07:11:47.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.258+0000 7f143c6a1700 1 -- 172.21.15.2:0/181984018 shutdown_connections 2023-11-26T07:11:47.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.258+0000 7f143c6a1700 1 --2- 172.21.15.2:0/181984018 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f141806aed0 0x7f141806d390 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:47.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.258+0000 7f143c6a1700 1 --2- 172.21.15.2:0/181984018 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14341440f0 0x7f1434159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:47.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.258+0000 7f143c6a1700 1 --2- 172.21.15.2:0/181984018 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14340722c0 0x7f14341f7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:47.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.258+0000 7f143c6a1700 1 --2- 172.21.15.2:0/181984018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1434143ae0 0x7f1434142140 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:47.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.258+0000 7f143c6a1700 1 -- 172.21.15.2:0/181984018 >> 172.21.15.2:0/181984018 conn(0x7f14340b2740 msgr2=0x7f14340cf360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:47.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.259+0000 7f143c6a1700 1 -- 172.21.15.2:0/181984018 shutdown_connections 2023-11-26T07:11:47.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.259+0000 7f143c6a1700 1 -- 172.21.15.2:0/181984018 wait complete. 2023-11-26T07:11:47.273 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:11:47.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.398+0000 7f402c5b1700 1 Processor -- start 2023-11-26T07:11:47.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.398+0000 7f402c5b1700 1 -- start start 2023-11-26T07:11:47.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.399+0000 7f402c5b1700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f40240cf2b0 0x7f402415c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:47.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.399+0000 7f402c5b1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40240ce5c0 0x7f40240cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:47.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.399+0000 7f402c5b1700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40240d0a90 con 0x7f402415bde0 2023-11-26T07:11:47.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.399+0000 7f402c5b1700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40240cefb0 con 0x7f40240cf2b0 2023-11-26T07:11:47.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.399+0000 7f402c5b1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f402406ee10 con 0x7f40240ce5c0 2023-11-26T07:11:47.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.400+0000 7f4029b4c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f40240cf2b0 0x7f402415c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:47.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.400+0000 7f4029b4c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f40240cf2b0 0x7f402415c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39486/0 (socket says 172.21.15.2:39486) 2023-11-26T07:11:47.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.400+0000 7f4029b4c700 1 -- 172.21.15.2:0/3081776231 learned_addr learned my addr 172.21.15.2:0/3081776231 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:47.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.400+0000 7f402ab4e700 1 --2- 172.21.15.2:0/3081776231 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40240ce5c0 0x7f40240cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:47.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.400+0000 7f4029b4c700 1 -- 172.21.15.2:0/3081776231 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40240ce5c0 msgr2=0x7f40240cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:47.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.400+0000 7f4029b4c700 1 --2- 172.21.15.2:0/3081776231 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40240ce5c0 0x7f40240cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:47.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.400+0000 7f4029b4c700 1 -- 172.21.15.2:0/3081776231 >> v1:172.21.15.192:6789/0 conn(0x7f402415bde0 legacy=0x7f40240d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:47.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.400+0000 7f4029b4c700 1 -- 172.21.15.2:0/3081776231 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f402406f0f0 con 0x7f40240cf2b0 2023-11-26T07:11:47.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.400+0000 7f4029b4c700 1 --2- 172.21.15.2:0/3081776231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40240cf2b0 0x7f402415c1c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f40200098f0 tx=0x7f4020009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d2a8696112aff1c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:47.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.400+0000 7f402934b700 1 -- 172.21.15.2:0/3081776231 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4020011830 con 0x7f40240cf2b0 2023-11-26T07:11:47.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.400+0000 7f402934b700 1 -- 172.21.15.2:0/3081776231 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4020011990 con 0x7f40240cf2b0 2023-11-26T07:11:47.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.400+0000 7f402934b700 1 -- 172.21.15.2:0/3081776231 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4020011d20 con 0x7f40240cf2b0 2023-11-26T07:11:47.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.401+0000 7f402c5b1700 1 -- 172.21.15.2:0/3081776231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40240cf2b0 msgr2=0x7f402415c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:47.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.401+0000 7f402c5b1700 1 --2- 172.21.15.2:0/3081776231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40240cf2b0 0x7f402415c1c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f40200098f0 tx=0x7f4020009c00 comp rx=0 tx=0).stop 2023-11-26T07:11:47.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.401+0000 7f402c5b1700 1 -- 172.21.15.2:0/3081776231 shutdown_connections 2023-11-26T07:11:47.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.401+0000 7f402c5b1700 1 --2- 172.21.15.2:0/3081776231 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40240ce5c0 0x7f40240cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:47.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.401+0000 7f402c5b1700 1 --2- 172.21.15.2:0/3081776231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40240cf2b0 0x7f402415c1c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:47.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.401+0000 7f402c5b1700 1 -- 172.21.15.2:0/3081776231 >> 172.21.15.2:0/3081776231 conn(0x7f40240b3720 msgr2=0x7f40240b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:47.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.401+0000 7f402c5b1700 1 -- 172.21.15.2:0/3081776231 shutdown_connections 2023-11-26T07:11:47.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.401+0000 7f402c5b1700 1 -- 172.21.15.2:0/3081776231 wait complete. 2023-11-26T07:11:47.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.402+0000 7f402c5b1700 1 Processor -- start 2023-11-26T07:11:47.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.402+0000 7f402c5b1700 1 -- start start 2023-11-26T07:11:47.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.403+0000 7f402c5b1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40240ce5c0 0x7f402415ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:47.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.403+0000 7f402c5b1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40240cf2b0 0x7f4024150470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:47.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.403+0000 7f402c5b1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f402415bde0 0x7f40240b6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:47.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.403+0000 7f402c5b1700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40240b5220 con 0x7f40240cf2b0 2023-11-26T07:11:47.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.403+0000 7f402c5b1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40240b5500 con 0x7f40240ce5c0 2023-11-26T07:11:47.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.403+0000 7f402c5b1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40240b57e0 con 0x7f402415bde0 2023-11-26T07:11:47.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.403+0000 7f4029b4c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40240cf2b0 0x7f4024150470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:47.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.403+0000 7f4029b4c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40240cf2b0 0x7f4024150470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39494/0 (socket says 172.21.15.2:39494) 2023-11-26T07:11:47.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.403+0000 7f4029b4c700 1 -- 172.21.15.2:0/3486805452 learned_addr learned my addr 172.21.15.2:0/3486805452 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:47.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.403+0000 7f402a34d700 1 --2- 172.21.15.2:0/3486805452 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40240ce5c0 0x7f402415ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:47.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.403+0000 7f402ab4e700 1 --2- 172.21.15.2:0/3486805452 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f402415bde0 0x7f40240b6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:47.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.403+0000 7f4029b4c700 1 -- 172.21.15.2:0/3486805452 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f402415bde0 msgr2=0x7f40240b6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:47.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.403+0000 7f4029b4c700 1 --2- 172.21.15.2:0/3486805452 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f402415bde0 0x7f40240b6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:47.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.403+0000 7f4029b4c700 1 -- 172.21.15.2:0/3486805452 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40240ce5c0 msgr2=0x7f402415ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:47.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.403+0000 7f4029b4c700 1 --2- 172.21.15.2:0/3486805452 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40240ce5c0 0x7f402415ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:47.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.403+0000 7f4029b4c700 1 -- 172.21.15.2:0/3486805452 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4020009550 con 0x7f40240cf2b0 2023-11-26T07:11:47.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.403+0000 7f402a34d700 1 --2- 172.21.15.2:0/3486805452 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40240ce5c0 0x7f402415ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:11:47.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.403+0000 7f4029b4c700 1 --2- 172.21.15.2:0/3486805452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40240cf2b0 0x7f4024150470 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4020000c00 tx=0x7f4020004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:47.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.404+0000 7f401affd700 1 -- 172.21.15.2:0/3486805452 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4020004570 con 0x7f40240cf2b0 2023-11-26T07:11:47.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.404+0000 7f401affd700 1 -- 172.21.15.2:0/3486805452 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f402001f070 con 0x7f40240cf2b0 2023-11-26T07:11:47.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.404+0000 7f402c5b1700 1 -- 172.21.15.2:0/3486805452 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40240b5ac0 con 0x7f40240cf2b0 2023-11-26T07:11:47.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.404+0000 7f401affd700 1 -- 172.21.15.2:0/3486805452 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40200038c0 con 0x7f40240cf2b0 2023-11-26T07:11:47.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.404+0000 7f402c5b1700 1 -- 172.21.15.2:0/3486805452 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40241509b0 con 0x7f40240cf2b0 2023-11-26T07:11:47.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.405+0000 7f402c5b1700 1 -- 172.21.15.2:0/3486805452 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4024075480 con 0x7f40240cf2b0 2023-11-26T07:11:47.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.405+0000 7f401affd700 1 -- 172.21.15.2:0/3486805452 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4020021030 con 0x7f40240cf2b0 2023-11-26T07:11:47.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.405+0000 7f401affd700 1 --2- 172.21.15.2:0/3486805452 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f400806aed0 0x7f400806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:47.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.406+0000 7f401affd700 1 -- 172.21.15.2:0/3486805452 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f402008a9c0 con 0x7f40240cf2b0 2023-11-26T07:11:47.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.406+0000 7f402a34d700 1 --2- 172.21.15.2:0/3486805452 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f400806aed0 0x7f400806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:47.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.406+0000 7f402a34d700 1 --2- 172.21.15.2:0/3486805452 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f400806aed0 0x7f400806d390 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4014000f60 tx=0x7f4014009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:47.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.410+0000 7f401affd700 1 -- 172.21.15.2:0/3486805452 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4020055c20 con 0x7f40240cf2b0 2023-11-26T07:11:47.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.612+0000 7f402c5b1700 1 -- 172.21.15.2:0/3486805452 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f40240d1290 con 0x7f40240cf2b0 2023-11-26T07:11:47.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.612+0000 7f401affd700 1 -- 172.21.15.2:0/3486805452 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4020015020 con 0x7f40240cf2b0 2023-11-26T07:11:47.614 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-26T07:11:47.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.615+0000 7f402c5b1700 1 -- 172.21.15.2:0/3486805452 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f400806aed0 msgr2=0x7f400806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:47.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.615+0000 7f402c5b1700 1 --2- 172.21.15.2:0/3486805452 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f400806aed0 0x7f400806d390 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4014000f60 tx=0x7f4014009040 comp rx=0 tx=0).stop 2023-11-26T07:11:47.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.615+0000 7f402c5b1700 1 -- 172.21.15.2:0/3486805452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40240cf2b0 msgr2=0x7f4024150470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:47.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.615+0000 7f402c5b1700 1 --2- 172.21.15.2:0/3486805452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40240cf2b0 0x7f4024150470 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4020000c00 tx=0x7f4020004750 comp rx=0 tx=0).stop 2023-11-26T07:11:47.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.615+0000 7f402c5b1700 1 -- 172.21.15.2:0/3486805452 shutdown_connections 2023-11-26T07:11:47.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.615+0000 7f402c5b1700 1 --2- 172.21.15.2:0/3486805452 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f400806aed0 0x7f400806d390 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:47.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.615+0000 7f402c5b1700 1 --2- 172.21.15.2:0/3486805452 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f402415bde0 0x7f40240b6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:47.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.615+0000 7f402c5b1700 1 --2- 172.21.15.2:0/3486805452 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40240ce5c0 0x7f402415ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:47.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.615+0000 7f402c5b1700 1 --2- 172.21.15.2:0/3486805452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40240cf2b0 0x7f4024150470 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:47.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.615+0000 7f402c5b1700 1 -- 172.21.15.2:0/3486805452 >> 172.21.15.2:0/3486805452 conn(0x7f40240b3720 msgr2=0x7f40240cdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:47.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.615+0000 7f402c5b1700 1 -- 172.21.15.2:0/3486805452 shutdown_connections 2023-11-26T07:11:47.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.615+0000 7f402c5b1700 1 -- 172.21.15.2:0/3486805452 wait complete. 2023-11-26T07:11:47.629 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:11:47.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.751+0000 7f7b482a2700 1 Processor -- start 2023-11-26T07:11:47.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.751+0000 7f7b482a2700 1 -- start start 2023-11-26T07:11:47.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.752+0000 7f7b482a2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b4006b620 0x7f7b400b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:47.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.752+0000 7f7b482a2700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7b400b5ab0 0x7f7b400b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:47.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.752+0000 7f7b482a2700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7b401478c0 0x7f7b40161ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:47.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.752+0000 7f7b482a2700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b40071f50 con 0x7f7b401478c0 2023-11-26T07:11:47.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.752+0000 7f7b482a2700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b40072230 con 0x7f7b400b5ab0 2023-11-26T07:11:47.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.752+0000 7f7b482a2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b40072510 con 0x7f7b4006b620 2023-11-26T07:11:47.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.752+0000 7f7b4683f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7b401478c0 0x7f7b40161ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:47.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.752+0000 7f7b4683f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7b401478c0 0x7f7b40161ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39502/0 (socket says 172.21.15.2:39502) 2023-11-26T07:11:47.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.752+0000 7f7b4683f700 1 -- 172.21.15.2:0/3374640910 learned_addr learned my addr 172.21.15.2:0/3374640910 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:47.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.752+0000 7f7b4583d700 1 --2- 172.21.15.2:0/3374640910 >> v2:172.21.15.192:3300/0 conn(0x7f7b400b5ab0 0x7f7b400b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:47.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.752+0000 7f7b4603e700 1 --2- 172.21.15.2:0/3374640910 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b4006b620 0x7f7b400b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:47.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.753+0000 7f7b4683f700 1 -- 172.21.15.2:0/3374640910 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b4006b620 msgr2=0x7f7b400b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:47.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.753+0000 7f7b4683f700 1 --2- 172.21.15.2:0/3374640910 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b4006b620 0x7f7b400b3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:47.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.753+0000 7f7b4683f700 1 -- 172.21.15.2:0/3374640910 >> v2:172.21.15.192:3300/0 conn(0x7f7b400b5ab0 msgr2=0x7f7b400b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:47.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.753+0000 7f7b4683f700 1 --2- 172.21.15.2:0/3374640910 >> v2:172.21.15.192:3300/0 conn(0x7f7b400b5ab0 0x7f7b400b3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:47.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.753+0000 7f7b4683f700 1 -- 172.21.15.2:0/3374640910 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b400727f0 con 0x7f7b401478c0 2023-11-26T07:11:47.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.753+0000 7f7b4683f700 1 --2- 172.21.15.2:0/3374640910 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b401478c0 0x7f7b40161ba0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7b40069550 tx=0x7f7b3800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d6b75e79e663d4e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:47.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.753+0000 7f7b4503c700 1 -- 172.21.15.2:0/3374640910 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3800e070 con 0x7f7b401478c0 2023-11-26T07:11:47.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.753+0000 7f7b4503c700 1 -- 172.21.15.2:0/3374640910 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3800b910 con 0x7f7b401478c0 2023-11-26T07:11:47.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.753+0000 7f7b4503c700 1 -- 172.21.15.2:0/3374640910 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3800bcc0 con 0x7f7b401478c0 2023-11-26T07:11:47.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.753+0000 7f7b482a2700 1 -- 172.21.15.2:0/3374640910 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b401478c0 msgr2=0x7f7b40161ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:47.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.753+0000 7f7b482a2700 1 --2- 172.21.15.2:0/3374640910 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b401478c0 0x7f7b40161ba0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7b40069550 tx=0x7f7b3800b330 comp rx=0 tx=0).stop 2023-11-26T07:11:47.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.754+0000 7f7b482a2700 1 -- 172.21.15.2:0/3374640910 shutdown_connections 2023-11-26T07:11:47.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.754+0000 7f7b482a2700 1 --2- 172.21.15.2:0/3374640910 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b401478c0 0x7f7b40161ba0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:47.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.754+0000 7f7b482a2700 1 --2- 172.21.15.2:0/3374640910 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b4006b620 0x7f7b400b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:47.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.754+0000 7f7b482a2700 1 --2- 172.21.15.2:0/3374640910 >> v2:172.21.15.192:3300/0 conn(0x7f7b400b5ab0 0x7f7b400b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:47.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.754+0000 7f7b482a2700 1 -- 172.21.15.2:0/3374640910 >> 172.21.15.2:0/3374640910 conn(0x7f7b400b2740 msgr2=0x7f7b400b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:47.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.754+0000 7f7b482a2700 1 -- 172.21.15.2:0/3374640910 shutdown_connections 2023-11-26T07:11:47.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.754+0000 7f7b482a2700 1 -- 172.21.15.2:0/3374640910 wait complete. 2023-11-26T07:11:47.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.755+0000 7f7b482a2700 1 Processor -- start 2023-11-26T07:11:47.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.755+0000 7f7b482a2700 1 -- start start 2023-11-26T07:11:47.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.756+0000 7f7b482a2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b4006b620 0x7f7b400cc810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:47.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.756+0000 7f7b482a2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b400b5ab0 0x7f7b400c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:47.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.756+0000 7f7b482a2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b401478c0 0x7f7b400c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:47.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.756+0000 7f7b482a2700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b400c6350 con 0x7f7b400b5ab0 2023-11-26T07:11:47.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.756+0000 7f7b482a2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b400c9510 con 0x7f7b401478c0 2023-11-26T07:11:47.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.756+0000 7f7b482a2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b400c59b0 con 0x7f7b4006b620 2023-11-26T07:11:47.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.756+0000 7f7b4583d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b400b5ab0 0x7f7b400c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:47.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.756+0000 7f7b4583d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b400b5ab0 0x7f7b400c9a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39506/0 (socket says 172.21.15.2:39506) 2023-11-26T07:11:47.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.756+0000 7f7b4583d700 1 -- 172.21.15.2:0/3825595200 learned_addr learned my addr 172.21.15.2:0/3825595200 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:47.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.756+0000 7f7b4603e700 1 --2- 172.21.15.2:0/3825595200 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b4006b620 0x7f7b400cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:47.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.756+0000 7f7b4683f700 1 --2- 172.21.15.2:0/3825595200 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b401478c0 0x7f7b400c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:47.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.756+0000 7f7b4583d700 1 -- 172.21.15.2:0/3825595200 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b4006b620 msgr2=0x7f7b400cc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:47.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.756+0000 7f7b4583d700 1 --2- 172.21.15.2:0/3825595200 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b4006b620 0x7f7b400cc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:47.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.756+0000 7f7b4583d700 1 -- 172.21.15.2:0/3825595200 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b401478c0 msgr2=0x7f7b400c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:47.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.756+0000 7f7b4583d700 1 --2- 172.21.15.2:0/3825595200 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b401478c0 0x7f7b400c9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:47.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.756+0000 7f7b4583d700 1 -- 172.21.15.2:0/3825595200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b38009b30 con 0x7f7b400b5ab0 2023-11-26T07:11:47.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.756+0000 7f7b4583d700 1 --2- 172.21.15.2:0/3825595200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b400b5ab0 0x7f7b400c9a60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c00e980 tx=0x7f7b3c00ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:47.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.756+0000 7f7b36ffd700 1 -- 172.21.15.2:0/3825595200 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c009710 con 0x7f7b400b5ab0 2023-11-26T07:11:47.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.756+0000 7f7b36ffd700 1 -- 172.21.15.2:0/3825595200 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3c00c690 con 0x7f7b400b5ab0 2023-11-26T07:11:47.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.756+0000 7f7b482a2700 1 -- 172.21.15.2:0/3825595200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b400c5c90 con 0x7f7b400b5ab0 2023-11-26T07:11:47.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.756+0000 7f7b36ffd700 1 -- 172.21.15.2:0/3825595200 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c00ca40 con 0x7f7b400b5ab0 2023-11-26T07:11:47.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.756+0000 7f7b482a2700 1 -- 172.21.15.2:0/3825595200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b40145bb0 con 0x7f7b400b5ab0 2023-11-26T07:11:47.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.757+0000 7f7b482a2700 1 -- 172.21.15.2:0/3825595200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b400c6490 con 0x7f7b400b5ab0 2023-11-26T07:11:47.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.758+0000 7f7b36ffd700 1 -- 172.21.15.2:0/3825595200 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7b3c00cba0 con 0x7f7b400b5ab0 2023-11-26T07:11:47.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.758+0000 7f7b36ffd700 1 --2- 172.21.15.2:0/3825595200 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7b2406aed0 0x7f7b2406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:47.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.758+0000 7f7b36ffd700 1 -- 172.21.15.2:0/3825595200 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b3c0894e0 con 0x7f7b400b5ab0 2023-11-26T07:11:47.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.758+0000 7f7b4603e700 1 --2- 172.21.15.2:0/3825595200 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7b2406aed0 0x7f7b2406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:47.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.759+0000 7f7b4603e700 1 --2- 172.21.15.2:0/3825595200 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7b2406aed0 0x7f7b2406d390 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7b30009b60 tx=0x7f7b30009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:47.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:47.763+0000 7f7b36ffd700 1 -- 172.21.15.2:0/3825595200 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7b400c6490 con 0x7f7b400b5ab0 2023-11-26T07:11:48.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.007+0000 7f7b482a2700 1 -- 172.21.15.2:0/3825595200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b400c6490 con 0x7f7b400b5ab0 2023-11-26T07:11:48.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.008+0000 7f7b36ffd700 1 -- 172.21.15.2:0/3825595200 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7f7b400c6490 con 0x7f7b400b5ab0 2023-11-26T07:11:48.010 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:11:48.010 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/3693634219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3693634219},{"type":"v1","addr":"172.21.15.2:6834","nonce":3693634219}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/953933423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":953933423},{"type":"v1","addr":"172.21.15.2:6835","nonce":953933423}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1000951065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1000951065},{"type":"v1","addr":"172.21.15.192:6836","nonce":1000951065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:11:34.051331+0000","modified":"2023-11-26T07:11:37.067662+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/4032661989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4032661989},{"type":"v1","addr":"172.21.15.192:6837","nonce":4032661989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-26T07:11:48.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.009+0000 7f7b482a2700 1 -- 172.21.15.2:0/3825595200 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7b2406aed0 msgr2=0x7f7b2406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:48.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.010+0000 7f7b482a2700 1 --2- 172.21.15.2:0/3825595200 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7b2406aed0 0x7f7b2406d390 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7b30009b60 tx=0x7f7b30009210 comp rx=0 tx=0).stop 2023-11-26T07:11:48.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.010+0000 7f7b482a2700 1 -- 172.21.15.2:0/3825595200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b400b5ab0 msgr2=0x7f7b400c9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:48.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.010+0000 7f7b482a2700 1 --2- 172.21.15.2:0/3825595200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b400b5ab0 0x7f7b400c9a60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c00e980 tx=0x7f7b3c00ec90 comp rx=0 tx=0).stop 2023-11-26T07:11:48.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.010+0000 7f7b482a2700 1 -- 172.21.15.2:0/3825595200 shutdown_connections 2023-11-26T07:11:48.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.010+0000 7f7b482a2700 1 --2- 172.21.15.2:0/3825595200 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7b2406aed0 0x7f7b2406d390 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:48.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.010+0000 7f7b482a2700 1 --2- 172.21.15.2:0/3825595200 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b401478c0 0x7f7b400c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:48.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.010+0000 7f7b482a2700 1 --2- 172.21.15.2:0/3825595200 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b4006b620 0x7f7b400cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:48.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.010+0000 7f7b482a2700 1 --2- 172.21.15.2:0/3825595200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b400b5ab0 0x7f7b400c9a60 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:48.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.010+0000 7f7b482a2700 1 -- 172.21.15.2:0/3825595200 >> 172.21.15.2:0/3825595200 conn(0x7f7b400b2740 msgr2=0x7f7b400af120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:48.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.010+0000 7f7b482a2700 1 -- 172.21.15.2:0/3825595200 shutdown_connections 2023-11-26T07:11:48.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.010+0000 7f7b482a2700 1 -- 172.21.15.2:0/3825595200 wait complete. 2023-11-26T07:11:48.013 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 8 2023-11-26T07:11:48.024 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:11:48.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.147+0000 7f066f210700 1 Processor -- start 2023-11-26T07:11:48.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.147+0000 7f066f210700 1 -- start start 2023-11-26T07:11:48.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.148+0000 7f066f210700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0668143ae0 0x7f06680b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:48.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.148+0000 7f066f210700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f06681440f0 0x7f0668071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:48.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.148+0000 7f066f210700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0668143ec0 con 0x7f06680720f0 2023-11-26T07:11:48.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.148+0000 7f066f210700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06680b40a0 con 0x7f0668143ae0 2023-11-26T07:11:48.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.148+0000 7f066f210700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0668072560 con 0x7f06681440f0 2023-11-26T07:11:48.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.148+0000 7f066cfac700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0668143ae0 0x7f06680b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:48.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.148+0000 7f066cfac700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0668143ae0 0x7f06680b51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39512/0 (socket says 172.21.15.2:39512) 2023-11-26T07:11:48.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.148+0000 7f066d7ad700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f06680720f0 0x7f066815e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58956/0 (socket says 172.21.15.2:58956) 2023-11-26T07:11:48.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.148+0000 7f066cfac700 1 -- 172.21.15.2:0/947108180 learned_addr learned my addr 172.21.15.2:0/947108180 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:48.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.148+0000 7f0667fff700 1 --2- 172.21.15.2:0/947108180 >> v2:172.21.15.192:3300/0 conn(0x7f06681440f0 0x7f0668071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:48.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.148+0000 7f066cfac700 1 -- 172.21.15.2:0/947108180 >> v2:172.21.15.192:3300/0 conn(0x7f06681440f0 msgr2=0x7f0668071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:48.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.148+0000 7f066cfac700 1 --2- 172.21.15.2:0/947108180 >> v2:172.21.15.192:3300/0 conn(0x7f06681440f0 0x7f0668071bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:48.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.148+0000 7f066cfac700 1 -- 172.21.15.2:0/947108180 >> v1:172.21.15.2:6789/0 conn(0x7f06680720f0 legacy=0x7f066815e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:48.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.148+0000 7f06677fe700 1 -- 172.21.15.2:0/947108180 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4133416873 0 0) 0x7f0668143ec0 con 0x7f06680720f0 2023-11-26T07:11:48.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.148+0000 7f066cfac700 1 -- 172.21.15.2:0/947108180 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06680b3ae0 con 0x7f0668143ae0 2023-11-26T07:11:48.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.148+0000 7f0667fff700 1 --2- 172.21.15.2:0/947108180 >> v2:172.21.15.192:3300/0 conn(0x7f06681440f0 0x7f0668071bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:11:48.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.149+0000 7f066cfac700 1 --2- 172.21.15.2:0/947108180 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0668143ae0 0x7f06680b51b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f06680d1b00 tx=0x7f065c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec5ccdef5038da51 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:48.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.149+0000 7f06677fe700 1 -- 172.21.15.2:0/947108180 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065c00dd10 con 0x7f0668143ae0 2023-11-26T07:11:48.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.149+0000 7f06677fe700 1 -- 172.21.15.2:0/947108180 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f065c00de70 con 0x7f0668143ae0 2023-11-26T07:11:48.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.149+0000 7f06677fe700 1 -- 172.21.15.2:0/947108180 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065c010670 con 0x7f0668143ae0 2023-11-26T07:11:48.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.149+0000 7f066f210700 1 -- 172.21.15.2:0/947108180 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0668143ae0 msgr2=0x7f06680b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:48.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.149+0000 7f066f210700 1 --2- 172.21.15.2:0/947108180 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0668143ae0 0x7f06680b51b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f06680d1b00 tx=0x7f065c00bea0 comp rx=0 tx=0).stop 2023-11-26T07:11:48.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.149+0000 7f066f210700 1 -- 172.21.15.2:0/947108180 shutdown_connections 2023-11-26T07:11:48.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.149+0000 7f066f210700 1 --2- 172.21.15.2:0/947108180 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0668143ae0 0x7f06680b51b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:48.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.149+0000 7f066f210700 1 --2- 172.21.15.2:0/947108180 >> v2:172.21.15.192:3300/0 conn(0x7f06681440f0 0x7f0668071bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:48.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.149+0000 7f066f210700 1 -- 172.21.15.2:0/947108180 >> 172.21.15.2:0/947108180 conn(0x7f06680b2740 msgr2=0x7f06680b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:48.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.149+0000 7f066f210700 1 -- 172.21.15.2:0/947108180 shutdown_connections 2023-11-26T07:11:48.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.149+0000 7f066f210700 1 -- 172.21.15.2:0/947108180 wait complete. 2023-11-26T07:11:48.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.150+0000 7f066f210700 1 Processor -- start 2023-11-26T07:11:48.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.151+0000 7f066f210700 1 -- start start 2023-11-26T07:11:48.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.151+0000 7f066f210700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06680720f0 0x7f06680c5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:48.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.151+0000 7f066f210700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0668143ae0 0x7f0668154040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:48.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.151+0000 7f066f210700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06681440f0 0x7f0668157650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:48.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.151+0000 7f066f210700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06681571c0 con 0x7f06680720f0 2023-11-26T07:11:48.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.151+0000 7f066f210700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06681565b0 con 0x7f06681440f0 2023-11-26T07:11:48.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.151+0000 7f066f210700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0668156890 con 0x7f0668143ae0 2023-11-26T07:11:48.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.151+0000 7f066cfac700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06680720f0 0x7f06680c5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:48.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.151+0000 7f066cfac700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06680720f0 0x7f06680c5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39516/0 (socket says 172.21.15.2:39516) 2023-11-26T07:11:48.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.151+0000 7f066cfac700 1 -- 172.21.15.2:0/2557208464 learned_addr learned my addr 172.21.15.2:0/2557208464 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:48.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.152+0000 7f0667fff700 1 --2- 172.21.15.2:0/2557208464 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0668143ae0 0x7f0668154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:48.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.152+0000 7f066d7ad700 1 --2- 172.21.15.2:0/2557208464 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06681440f0 0x7f0668157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:48.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.152+0000 7f066cfac700 1 -- 172.21.15.2:0/2557208464 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0668143ae0 msgr2=0x7f0668154040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:48.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.152+0000 7f066cfac700 1 --2- 172.21.15.2:0/2557208464 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0668143ae0 0x7f0668154040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:48.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.152+0000 7f066cfac700 1 -- 172.21.15.2:0/2557208464 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06681440f0 msgr2=0x7f0668157650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:48.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.152+0000 7f066cfac700 1 --2- 172.21.15.2:0/2557208464 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06681440f0 0x7f0668157650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:48.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.152+0000 7f066cfac700 1 -- 172.21.15.2:0/2557208464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f065c00b7f0 con 0x7f06680720f0 2023-11-26T07:11:48.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.152+0000 7f0667fff700 1 --2- 172.21.15.2:0/2557208464 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0668143ae0 0x7f0668154040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:11:48.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.152+0000 7f066cfac700 1 --2- 172.21.15.2:0/2557208464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06680720f0 0x7f06680c5b00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f065c00bee0 tx=0x7f065c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:48.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.152+0000 7f06657fa700 1 -- 172.21.15.2:0/2557208464 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065c003cf0 con 0x7f06680720f0 2023-11-26T07:11:48.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.152+0000 7f06657fa700 1 -- 172.21.15.2:0/2557208464 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f065c003e50 con 0x7f06680720f0 2023-11-26T07:11:48.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.152+0000 7f066f210700 1 -- 172.21.15.2:0/2557208464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0668156b70 con 0x7f06680720f0 2023-11-26T07:11:48.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.152+0000 7f06657fa700 1 -- 172.21.15.2:0/2557208464 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065c010670 con 0x7f06680720f0 2023-11-26T07:11:48.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.152+0000 7f066f210700 1 -- 172.21.15.2:0/2557208464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06680c6040 con 0x7f06680720f0 2023-11-26T07:11:48.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.153+0000 7f066f210700 1 -- 172.21.15.2:0/2557208464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06681574a0 con 0x7f06680720f0 2023-11-26T07:11:48.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.154+0000 7f06657fa700 1 -- 172.21.15.2:0/2557208464 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f065c019400 con 0x7f06680720f0 2023-11-26T07:11:48.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.154+0000 7f06657fa700 1 --2- 172.21.15.2:0/2557208464 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f064c06aed0 0x7f064c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:48.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.154+0000 7f06657fa700 1 -- 172.21.15.2:0/2557208464 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f065c08ad10 con 0x7f06680720f0 2023-11-26T07:11:48.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.154+0000 7f0667fff700 1 --2- 172.21.15.2:0/2557208464 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f064c06aed0 0x7f064c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:48.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.155+0000 7f0667fff700 1 --2- 172.21.15.2:0/2557208464 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f064c06aed0 0x7f064c06d390 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f06680d0420 tx=0x7f0654008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:48.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.159+0000 7f06657fa700 1 -- 172.21.15.2:0/2557208464 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f065c055e50 con 0x7f06680720f0 2023-11-26T07:11:48.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.359+0000 7f066f210700 1 -- 172.21.15.2:0/2557208464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0668144830 con 0x7f06680720f0 2023-11-26T07:11:48.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.360+0000 7f06657fa700 1 -- 172.21.15.2:0/2557208464 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f065c059470 con 0x7f06680720f0 2023-11-26T07:11:48.363 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:11:48.363 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:11:35.634747+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:11:32.129474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:11:33.019837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:11:48.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.362+0000 7f066f210700 1 -- 172.21.15.2:0/2557208464 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f064c06aed0 msgr2=0x7f064c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:48.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.362+0000 7f066f210700 1 --2- 172.21.15.2:0/2557208464 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f064c06aed0 0x7f064c06d390 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f06680d0420 tx=0x7f0654008040 comp rx=0 tx=0).stop 2023-11-26T07:11:48.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.363+0000 7f066f210700 1 -- 172.21.15.2:0/2557208464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06680720f0 msgr2=0x7f06680c5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:48.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.363+0000 7f066f210700 1 --2- 172.21.15.2:0/2557208464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06680720f0 0x7f06680c5b00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f065c00bee0 tx=0x7f065c004750 comp rx=0 tx=0).stop 2023-11-26T07:11:48.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.363+0000 7f066f210700 1 -- 172.21.15.2:0/2557208464 shutdown_connections 2023-11-26T07:11:48.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.363+0000 7f066f210700 1 --2- 172.21.15.2:0/2557208464 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f064c06aed0 0x7f064c06d390 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:48.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.363+0000 7f066f210700 1 --2- 172.21.15.2:0/2557208464 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06681440f0 0x7f0668157650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:48.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.363+0000 7f066f210700 1 --2- 172.21.15.2:0/2557208464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06680720f0 0x7f06680c5b00 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:48.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.363+0000 7f066f210700 1 --2- 172.21.15.2:0/2557208464 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0668143ae0 0x7f0668154040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:48.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.363+0000 7f066f210700 1 -- 172.21.15.2:0/2557208464 >> 172.21.15.2:0/2557208464 conn(0x7f06680b2740 msgr2=0x7f066806e890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:48.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.363+0000 7f066f210700 1 -- 172.21.15.2:0/2557208464 shutdown_connections 2023-11-26T07:11:48.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.363+0000 7f066f210700 1 -- 172.21.15.2:0/2557208464 wait complete. 2023-11-26T07:11:48.377 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:11:48.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.501+0000 7ff85267d700 1 Processor -- start 2023-11-26T07:11:48.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.501+0000 7ff85267d700 1 -- start start 2023-11-26T07:11:48.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.502+0000 7ff85267d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff84c15e460 0x7ff84c0d49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:48.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.502+0000 7ff85267d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff84c0cf480 0x7ff84c0d2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:48.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.502+0000 7ff85267d700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff84c0b3370 con 0x7ff84c0d29d0 2023-11-26T07:11:48.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.502+0000 7ff85267d700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff84c0d2e60 con 0x7ff84c0cf480 2023-11-26T07:11:48.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.502+0000 7ff85267d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff84c0cfc40 con 0x7ff84c15e460 2023-11-26T07:11:48.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.502+0000 7ff850c1a700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff84c0d29d0 0x7ff84c0d0550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58970/0 (socket says 172.21.15.2:58970) 2023-11-26T07:11:48.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.502+0000 7ff850c1a700 1 -- 172.21.15.2:0/58657209 learned_addr learned my addr 172.21.15.2:0/58657209 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:11:48.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.502+0000 7ff84b7fe700 1 --2- 172.21.15.2:0/58657209 >> v2:172.21.15.192:3300/0 conn(0x7ff84c0cf480 0x7ff84c0d2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:48.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.502+0000 7ff84bfff700 1 --2- 172.21.15.2:0/58657209 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff84c15e460 0x7ff84c0d49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:48.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.502+0000 7ff84affd700 1 -- 172.21.15.2:0/58657209 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3384345105 0 0) 0x7ff84c0b3370 con 0x7ff84c0d29d0 2023-11-26T07:11:48.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.502+0000 7ff84affd700 1 -- 172.21.15.2:0/58657209 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8340035b0 con 0x7ff84c0d29d0 2023-11-26T07:11:48.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.502+0000 7ff84affd700 1 -- 172.21.15.2:0/58657209 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1198437424 0 0) 0x7ff8340035b0 con 0x7ff84c0d29d0 2023-11-26T07:11:48.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.502+0000 7ff84affd700 1 -- 172.21.15.2:0/58657209 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff84c15e460 msgr2=0x7ff84c0d49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:48.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.502+0000 7ff84affd700 1 --2- 172.21.15.2:0/58657209 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff84c15e460 0x7ff84c0d49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:48.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.503+0000 7ff84affd700 1 -- 172.21.15.2:0/58657209 >> v2:172.21.15.192:3300/0 conn(0x7ff84c0cf480 msgr2=0x7ff84c0d2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:48.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.503+0000 7ff84affd700 1 --2- 172.21.15.2:0/58657209 >> v2:172.21.15.192:3300/0 conn(0x7ff84c0cf480 0x7ff84c0d2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:48.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.503+0000 7ff84affd700 1 -- 172.21.15.2:0/58657209 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff84c0b35c0 con 0x7ff84c0d29d0 2023-11-26T07:11:48.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.503+0000 7ff84affd700 1 -- 172.21.15.2:0/58657209 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7ff8440019f0 con 0x7ff84c0d29d0 2023-11-26T07:11:48.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.503+0000 7ff84b7fe700 1 --2- 172.21.15.2:0/58657209 >> v2:172.21.15.192:3300/0 conn(0x7ff84c0cf480 0x7ff84c0d2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:11:48.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.503+0000 7ff84affd700 1 -- 172.21.15.2:0/58657209 >> v1:172.21.15.2:6789/0 conn(0x7ff84c0d29d0 legacy=0x7ff84c0d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:48.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.503+0000 7ff84affd700 1 --2- 172.21.15.2:0/58657209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff834003a00 0x7ff834003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:48.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.503+0000 7ff84affd700 1 --2- 172.21.15.2:0/58657209 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff84c15e460 0x7ff834004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:48.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.503+0000 7ff84affd700 1 --2- 172.21.15.2:0/58657209 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff834004d90 0x7ff834005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:48.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.503+0000 7ff84affd700 1 -- 172.21.15.2:0/58657209 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84c0d2e60 con 0x7ff834003a00 2023-11-26T07:11:48.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.503+0000 7ff84affd700 1 -- 172.21.15.2:0/58657209 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84c0cfc40 con 0x7ff834004d90 2023-11-26T07:11:48.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.503+0000 7ff84affd700 1 -- 172.21.15.2:0/58657209 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff83400ba10 con 0x7ff84c15e460 2023-11-26T07:11:48.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.503+0000 7ff84bfff700 1 --2- 172.21.15.2:0/58657209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff834003a00 0x7ff834003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:48.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.503+0000 7ff84b7fe700 1 --2- 172.21.15.2:0/58657209 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff84c15e460 0x7ff834004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:48.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.503+0000 7ff850c1a700 1 --2- 172.21.15.2:0/58657209 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff834004d90 0x7ff834005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:48.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.503+0000 7ff84bfff700 1 -- 172.21.15.2:0/58657209 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff84c15e460 msgr2=0x7ff834004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:48.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.503+0000 7ff84bfff700 1 --2- 172.21.15.2:0/58657209 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff84c15e460 0x7ff834004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:48.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.503+0000 7ff84bfff700 1 -- 172.21.15.2:0/58657209 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff834004d90 msgr2=0x7ff834005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:48.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.503+0000 7ff84bfff700 1 --2- 172.21.15.2:0/58657209 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff834004d90 0x7ff834005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:48.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.503+0000 7ff84bfff700 1 -- 172.21.15.2:0/58657209 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8340035b0 con 0x7ff834003a00 2023-11-26T07:11:48.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.503+0000 7ff84b7fe700 1 --2- 172.21.15.2:0/58657209 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff84c15e460 0x7ff834004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:11:48.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.503+0000 7ff84bfff700 1 --2- 172.21.15.2:0/58657209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff834003a00 0x7ff834003e20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009b60 tx=0x7ff834005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae13cd8bf3eace38 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:48.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.503+0000 7ff84affd700 1 -- 172.21.15.2:0/58657209 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c00e6c0 con 0x7ff834003a00 2023-11-26T07:11:48.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.503+0000 7ff84affd700 1 -- 172.21.15.2:0/58657209 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83c00e820 con 0x7ff834003a00 2023-11-26T07:11:48.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.503+0000 7ff84affd700 1 -- 172.21.15.2:0/58657209 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c00eb90 con 0x7ff834003a00 2023-11-26T07:11:48.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.504+0000 7ff85267d700 1 -- 172.21.15.2:0/58657209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff834003a00 msgr2=0x7ff834003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:48.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.504+0000 7ff85267d700 1 --2- 172.21.15.2:0/58657209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff834003a00 0x7ff834003e20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009b60 tx=0x7ff834005880 comp rx=0 tx=0).stop 2023-11-26T07:11:48.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.504+0000 7ff850c1a700 1 -- 172.21.15.2:0/58657209 reap_dead start 2023-11-26T07:11:48.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.504+0000 7ff85267d700 1 -- 172.21.15.2:0/58657209 shutdown_connections 2023-11-26T07:11:48.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.504+0000 7ff85267d700 1 -- 172.21.15.2:0/58657209 >> 172.21.15.2:0/58657209 conn(0x7ff84c0d3eb0 msgr2=0x7ff84c0d42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:48.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.504+0000 7ff85267d700 1 -- 172.21.15.2:0/58657209 shutdown_connections 2023-11-26T07:11:48.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.504+0000 7ff85267d700 1 -- 172.21.15.2:0/58657209 wait complete. 2023-11-26T07:11:48.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.505+0000 7ff85267d700 1 Processor -- start 2023-11-26T07:11:48.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.506+0000 7ff85267d700 1 -- start start 2023-11-26T07:11:48.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.507+0000 7ff85267d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff84c15bf80 0x7ff84c0c99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:48.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.507+0000 7ff85267d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff84c15c360 0x7ff84c0c9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:48.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.507+0000 7ff85267d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff84c0ccf90 0x7ff84c0cd420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:48.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.507+0000 7ff85267d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84c0cd960 con 0x7ff84c15bf80 2023-11-26T07:11:48.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.507+0000 7ff85267d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84c1f4610 con 0x7ff84c0ccf90 2023-11-26T07:11:48.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.507+0000 7ff85267d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff84c15fa30 con 0x7ff84c15c360 2023-11-26T07:11:48.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.507+0000 7ff84bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff84c15bf80 0x7ff84c0c99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:48.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.507+0000 7ff84bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff84c15bf80 0x7ff84c0c99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39536/0 (socket says 172.21.15.2:39536) 2023-11-26T07:11:48.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.507+0000 7ff84bfff700 1 -- 172.21.15.2:0/1561289113 learned_addr learned my addr 172.21.15.2:0/1561289113 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:48.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.507+0000 7ff84b7fe700 1 --2- 172.21.15.2:0/1561289113 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff84c15c360 0x7ff84c0c9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:48.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.507+0000 7ff850c1a700 1 --2- 172.21.15.2:0/1561289113 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff84c0ccf90 0x7ff84c0cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:48.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.507+0000 7ff84bfff700 1 -- 172.21.15.2:0/1561289113 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff84c15c360 msgr2=0x7ff84c0c9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:48.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.507+0000 7ff84bfff700 1 --2- 172.21.15.2:0/1561289113 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff84c15c360 0x7ff84c0c9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:48.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.507+0000 7ff84bfff700 1 -- 172.21.15.2:0/1561289113 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff84c0ccf90 msgr2=0x7ff84c0cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:48.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.507+0000 7ff84bfff700 1 --2- 172.21.15.2:0/1561289113 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff84c0ccf90 0x7ff84c0cd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:48.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.507+0000 7ff84bfff700 1 -- 172.21.15.2:0/1561289113 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff84c0ca570 con 0x7ff84c15bf80 2023-11-26T07:11:48.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.507+0000 7ff84bfff700 1 --2- 172.21.15.2:0/1561289113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff84c15bf80 0x7ff84c0c99e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff834004770 tx=0x7ff83c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:48.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.507+0000 7ff848ff9700 1 -- 172.21.15.2:0/1561289113 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c00e6c0 con 0x7ff84c15bf80 2023-11-26T07:11:48.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.507+0000 7ff848ff9700 1 -- 172.21.15.2:0/1561289113 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83c0038c0 con 0x7ff84c15bf80 2023-11-26T07:11:48.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.507+0000 7ff848ff9700 1 -- 172.21.15.2:0/1561289113 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c003c70 con 0x7ff84c15bf80 2023-11-26T07:11:48.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.507+0000 7ff85267d700 1 -- 172.21.15.2:0/1561289113 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff84c15fcd0 con 0x7ff84c15bf80 2023-11-26T07:11:48.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.507+0000 7ff85267d700 1 -- 172.21.15.2:0/1561289113 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff84c160290 con 0x7ff84c15bf80 2023-11-26T07:11:48.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.508+0000 7ff85267d700 1 -- 172.21.15.2:0/1561289113 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff84c0cd960 con 0x7ff84c15bf80 2023-11-26T07:11:48.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.509+0000 7ff848ff9700 1 -- 172.21.15.2:0/1561289113 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff83c013470 con 0x7ff84c15bf80 2023-11-26T07:11:48.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.509+0000 7ff848ff9700 1 --2- 172.21.15.2:0/1561289113 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff83806aed0 0x7ff83806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:48.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.509+0000 7ff848ff9700 1 -- 172.21.15.2:0/1561289113 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff83c08ad20 con 0x7ff84c15bf80 2023-11-26T07:11:48.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.509+0000 7ff84b7fe700 1 --2- 172.21.15.2:0/1561289113 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff83806aed0 0x7ff83806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:48.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.510+0000 7ff84b7fe700 1 --2- 172.21.15.2:0/1561289113 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff83806aed0 0x7ff83806d390 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff840009d20 tx=0x7ff840008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:48.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.514+0000 7ff848ff9700 1 -- 172.21.15.2:0/1561289113 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff83c055fa0 con 0x7ff84c15bf80 2023-11-26T07:11:48.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.762+0000 7ff85267d700 1 -- 172.21.15.2:0/1561289113 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff84c160420 con 0x7ff84c15bf80 2023-11-26T07:11:48.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.762+0000 7ff848ff9700 1 -- 172.21.15.2:0/1561289113 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7ff83c017090 con 0x7ff84c15bf80 2023-11-26T07:11:48.764 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:11:48.764 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/3693634219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3693634219},{"type":"v1","addr":"172.21.15.2:6834","nonce":3693634219}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/953933423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":953933423},{"type":"v1","addr":"172.21.15.2:6835","nonce":953933423}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1000951065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1000951065},{"type":"v1","addr":"172.21.15.192:6836","nonce":1000951065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:11:34.051331+0000","modified":"2023-11-26T07:11:37.067662+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/4032661989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4032661989},{"type":"v1","addr":"172.21.15.192:6837","nonce":4032661989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-26T07:11:48.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.764+0000 7ff85267d700 1 -- 172.21.15.2:0/1561289113 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff83806aed0 msgr2=0x7ff83806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:48.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.764+0000 7ff85267d700 1 --2- 172.21.15.2:0/1561289113 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff83806aed0 0x7ff83806d390 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff840009d20 tx=0x7ff840008040 comp rx=0 tx=0).stop 2023-11-26T07:11:48.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.764+0000 7ff85267d700 1 -- 172.21.15.2:0/1561289113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff84c15bf80 msgr2=0x7ff84c0c99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:48.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.764+0000 7ff85267d700 1 --2- 172.21.15.2:0/1561289113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff84c15bf80 0x7ff84c0c99e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff834004770 tx=0x7ff83c0047c0 comp rx=0 tx=0).stop 2023-11-26T07:11:48.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.764+0000 7ff85267d700 1 -- 172.21.15.2:0/1561289113 shutdown_connections 2023-11-26T07:11:48.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.764+0000 7ff85267d700 1 --2- 172.21.15.2:0/1561289113 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff83806aed0 0x7ff83806d390 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:48.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.764+0000 7ff85267d700 1 --2- 172.21.15.2:0/1561289113 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff84c0ccf90 0x7ff84c0cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:48.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.764+0000 7ff85267d700 1 --2- 172.21.15.2:0/1561289113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff84c15bf80 0x7ff84c0c99e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:48.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.764+0000 7ff85267d700 1 --2- 172.21.15.2:0/1561289113 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff84c15c360 0x7ff84c0c9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:48.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.764+0000 7ff85267d700 1 -- 172.21.15.2:0/1561289113 >> 172.21.15.2:0/1561289113 conn(0x7ff84c0d3eb0 msgr2=0x7ff84c0d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:48.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.764+0000 7ff85267d700 1 -- 172.21.15.2:0/1561289113 shutdown_connections 2023-11-26T07:11:48.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:48.764+0000 7ff85267d700 1 -- 172.21.15.2:0/1561289113 wait complete. 2023-11-26T07:11:48.768 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 8 2023-11-26T07:11:49.180 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-26T07:11:34.051331+0000', 'modified': '2023-11-26T07:11:37.067662+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4282}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4282': {'gid': 4282, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.192:6837/4032661989', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6835', 'nonce': 4032661989}, {'type': 'v1', 'addr': '172.21.15.192:6837', 'nonce': 4032661989}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-26T07:11:49.181 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-26T07:11:49.181 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-26T07:11:49.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.310+0000 7f03f4bf9700 1 Processor -- start 2023-11-26T07:11:49.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.310+0000 7f03f4bf9700 1 -- start start 2023-11-26T07:11:49.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.311+0000 7f03f4bf9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03f0143ae0 0x7f03f00b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:49.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.311+0000 7f03f4bf9700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f03f01440f0 0x7f03f0071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:49.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.311+0000 7f03f4bf9700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f0143ec0 con 0x7f03f00720f0 2023-11-26T07:11:49.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.311+0000 7f03f4bf9700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f00b40a0 con 0x7f03f01440f0 2023-11-26T07:11:49.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.311+0000 7f03f4bf9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f0072580 con 0x7f03f0143ae0 2023-11-26T07:11:49.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.311+0000 7f03eed9d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f03f00720f0 0x7f03f015e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58990/0 (socket says 172.21.15.2:58990) 2023-11-26T07:11:49.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.311+0000 7f03eed9d700 1 -- 172.21.15.2:0/2651368863 learned_addr learned my addr 172.21.15.2:0/2651368863 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:11:49.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.311+0000 7f03ee59c700 1 --2- 172.21.15.2:0/2651368863 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03f0143ae0 0x7f03f00b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:49.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.311+0000 7f03edd9b700 1 --2- 172.21.15.2:0/2651368863 >> v2:172.21.15.192:3300/0 conn(0x7f03f01440f0 0x7f03f0071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:49.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.311+0000 7f03ed59a700 1 -- 172.21.15.2:0/2651368863 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2059467947 0 0) 0x7f03f0143ec0 con 0x7f03f00720f0 2023-11-26T07:11:49.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.311+0000 7f03ed59a700 1 -- 172.21.15.2:0/2651368863 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03d80035b0 con 0x7f03f00720f0 2023-11-26T07:11:49.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.311+0000 7f03edd9b700 1 -- 172.21.15.2:0/2651368863 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03f0143ae0 msgr2=0x7f03f00b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:49.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.311+0000 7f03edd9b700 1 --2- 172.21.15.2:0/2651368863 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03f0143ae0 0x7f03f00b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:49.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.311+0000 7f03edd9b700 1 -- 172.21.15.2:0/2651368863 >> v1:172.21.15.2:6789/0 conn(0x7f03f00720f0 legacy=0x7f03f015e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:49.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.311+0000 7f03edd9b700 1 -- 172.21.15.2:0/2651368863 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f00b3ae0 con 0x7f03f01440f0 2023-11-26T07:11:49.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.311+0000 7f03ee59c700 1 --2- 172.21.15.2:0/2651368863 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03f0143ae0 0x7f03f00b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:11:49.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.312+0000 7f03edd9b700 1 --2- 172.21.15.2:0/2651368863 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03f01440f0 0x7f03f0071bb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f03e4009840 tx=0x7f03e4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=159382b2388576e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:49.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.312+0000 7f03ed59a700 1 -- 172.21.15.2:0/2651368863 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e4011830 con 0x7f03f01440f0 2023-11-26T07:11:49.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.312+0000 7f03ed59a700 1 -- 172.21.15.2:0/2651368863 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e4011990 con 0x7f03f01440f0 2023-11-26T07:11:49.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.312+0000 7f03ed59a700 1 -- 172.21.15.2:0/2651368863 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e4011d20 con 0x7f03f01440f0 2023-11-26T07:11:49.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.312+0000 7f03f4bf9700 1 -- 172.21.15.2:0/2651368863 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03f01440f0 msgr2=0x7f03f0071bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:49.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.312+0000 7f03f4bf9700 1 --2- 172.21.15.2:0/2651368863 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03f01440f0 0x7f03f0071bb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f03e4009840 tx=0x7f03e4009b50 comp rx=0 tx=0).stop 2023-11-26T07:11:49.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.312+0000 7f03f4bf9700 1 -- 172.21.15.2:0/2651368863 shutdown_connections 2023-11-26T07:11:49.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.312+0000 7f03f4bf9700 1 --2- 172.21.15.2:0/2651368863 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03f0143ae0 0x7f03f00b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:49.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.312+0000 7f03f4bf9700 1 --2- 172.21.15.2:0/2651368863 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03f01440f0 0x7f03f0071bb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:49.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.312+0000 7f03f4bf9700 1 -- 172.21.15.2:0/2651368863 >> 172.21.15.2:0/2651368863 conn(0x7f03f00b2740 msgr2=0x7f03f00b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:49.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.312+0000 7f03f4bf9700 1 -- 172.21.15.2:0/2651368863 shutdown_connections 2023-11-26T07:11:49.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.312+0000 7f03f4bf9700 1 -- 172.21.15.2:0/2651368863 wait complete. 2023-11-26T07:11:49.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.314+0000 7f03f4bf9700 1 Processor -- start 2023-11-26T07:11:49.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.314+0000 7f03f4bf9700 1 -- start start 2023-11-26T07:11:49.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.314+0000 7f03f4bf9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03f00720f0 0x7f03f015ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:49.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.314+0000 7f03f4bf9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03f0143ae0 0x7f03f00c7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:49.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.314+0000 7f03f4bf9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03f01440f0 0x7f03f00c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:49.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.315+0000 7f03f4bf9700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f00c6e70 con 0x7f03f01440f0 2023-11-26T07:11:49.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.315+0000 7f03f4bf9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f00c61f0 con 0x7f03f0143ae0 2023-11-26T07:11:49.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.315+0000 7f03f4bf9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f00c64d0 con 0x7f03f00720f0 2023-11-26T07:11:49.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.315+0000 7f03eed9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03f01440f0 0x7f03f00c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:49.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.315+0000 7f03eed9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03f01440f0 0x7f03f00c7c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39554/0 (socket says 172.21.15.2:39554) 2023-11-26T07:11:49.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.315+0000 7f03eed9d700 1 -- 172.21.15.2:0/3116776127 learned_addr learned my addr 172.21.15.2:0/3116776127 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:49.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.315+0000 7f03edd9b700 1 --2- 172.21.15.2:0/3116776127 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03f0143ae0 0x7f03f00c7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:49.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.315+0000 7f03ee59c700 1 --2- 172.21.15.2:0/3116776127 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03f00720f0 0x7f03f015ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:49.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.315+0000 7f03eed9d700 1 -- 172.21.15.2:0/3116776127 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03f00720f0 msgr2=0x7f03f015ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:49.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.315+0000 7f03eed9d700 1 --2- 172.21.15.2:0/3116776127 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03f00720f0 0x7f03f015ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:49.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.315+0000 7f03eed9d700 1 -- 172.21.15.2:0/3116776127 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03f0143ae0 msgr2=0x7f03f00c7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:49.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.315+0000 7f03eed9d700 1 --2- 172.21.15.2:0/3116776127 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03f0143ae0 0x7f03f00c7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:49.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.315+0000 7f03eed9d700 1 -- 172.21.15.2:0/3116776127 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e00094a0 con 0x7f03f01440f0 2023-11-26T07:11:49.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.315+0000 7f03eed9d700 1 --2- 172.21.15.2:0/3116776127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03f01440f0 0x7f03f00c7c00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f03e800caa0 tx=0x7f03e800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:49.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.315+0000 7f03deffd700 1 -- 172.21.15.2:0/3116776127 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e800a9e0 con 0x7f03f01440f0 2023-11-26T07:11:49.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.315+0000 7f03deffd700 1 -- 172.21.15.2:0/3116776127 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e800ab40 con 0x7f03f01440f0 2023-11-26T07:11:49.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.315+0000 7f03deffd700 1 -- 172.21.15.2:0/3116776127 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e8012400 con 0x7f03f01440f0 2023-11-26T07:11:49.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.315+0000 7f03f4bf9700 1 -- 172.21.15.2:0/3116776127 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03e40094a0 con 0x7f03f01440f0 2023-11-26T07:11:49.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.315+0000 7f03f4bf9700 1 -- 172.21.15.2:0/3116776127 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f00c6a90 con 0x7f03f01440f0 2023-11-26T07:11:49.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.317+0000 7f03deffd700 1 -- 172.21.15.2:0/3116776127 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f03e80113a0 con 0x7f03f01440f0 2023-11-26T07:11:49.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.317+0000 7f03deffd700 1 --2- 172.21.15.2:0/3116776127 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f03d006aed0 0x7f03d006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:49.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.317+0000 7f03deffd700 1 -- 172.21.15.2:0/3116776127 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f03e8089270 con 0x7f03f01440f0 2023-11-26T07:11:49.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.317+0000 7f03ee59c700 1 --2- 172.21.15.2:0/3116776127 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f03d006aed0 0x7f03d006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:49.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.318+0000 7f03ee59c700 1 --2- 172.21.15.2:0/3116776127 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f03d006aed0 0x7f03d006d390 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f03e0009d70 tx=0x7f03e0009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:49.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.319+0000 7f0400df2b80 1 Processor -- start 2023-11-26T07:11:49.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.319+0000 7f0400df2b80 1 -- start start 2023-11-26T07:11:49.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.320+0000 7f0400df2b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654f520f080 0x5654f5255840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:49.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.320+0000 7f0400df2b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5654f5224ed0 0x5654f5255d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:49.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.320+0000 7f0400df2b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5654f520c490 0x5654f5238e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:49.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.320+0000 7f0400df2b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654f5182770 con 0x5654f520f080 2023-11-26T07:11:49.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.320+0000 7f0400df2b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654f5169750 con 0x5654f520c490 2023-11-26T07:11:49.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.320+0000 7f0400df2b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x5654f5167070 con 0x5654f5224ed0 2023-11-26T07:11:49.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.320+0000 7f03ee59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654f520f080 0x5654f5255840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:49.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.320+0000 7f03ee59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654f520f080 0x5654f5255840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39558/0 (socket says 172.21.15.2:39558) 2023-11-26T07:11:49.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.320+0000 7f03ee59c700 1 -- 172.21.15.2:0/276719833 learned_addr learned my addr 172.21.15.2:0/276719833 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:49.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.320+0000 7f03edd9b700 1 --2- 172.21.15.2:0/276719833 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5654f5224ed0 0x5654f5255d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:49.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.320+0000 7f03eed9d700 1 --2- 172.21.15.2:0/276719833 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5654f520c490 0x5654f5238e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:49.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.320+0000 7f03ee59c700 1 -- 172.21.15.2:0/276719833 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5654f5224ed0 msgr2=0x5654f5255d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:49.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.320+0000 7f03ee59c700 1 --2- 172.21.15.2:0/276719833 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5654f5224ed0 0x5654f5255d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:49.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.320+0000 7f03ee59c700 1 -- 172.21.15.2:0/276719833 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5654f520c490 msgr2=0x5654f5238e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:49.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.320+0000 7f03ee59c700 1 --2- 172.21.15.2:0/276719833 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5654f520c490 0x5654f5238e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:49.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.320+0000 7f03ee59c700 1 -- 172.21.15.2:0/276719833 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654f4fdf5e0 con 0x5654f520f080 2023-11-26T07:11:49.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.320+0000 7f03ee59c700 1 --2- 172.21.15.2:0/276719833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654f520f080 0x5654f5255840 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f03e0011f90 tx=0x7f03e0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7122614dcbbcc6d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:49.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.321+0000 7f03cffff700 1 -- 172.21.15.2:0/276719833 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e0022070 con 0x5654f520f080 2023-11-26T07:11:49.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.321+0000 7f03cffff700 1 -- 172.21.15.2:0/276719833 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e0010ab0 con 0x5654f520f080 2023-11-26T07:11:49.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.321+0000 7f03cffff700 1 -- 172.21.15.2:0/276719833 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e0016070 con 0x5654f520f080 2023-11-26T07:11:49.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.321+0000 7f0400df2b80 1 -- 172.21.15.2:0/276719833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654f520f080 msgr2=0x5654f5255840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:49.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.321+0000 7f0400df2b80 1 --2- 172.21.15.2:0/276719833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654f520f080 0x5654f5255840 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f03e0011f90 tx=0x7f03e0016000 comp rx=0 tx=0).stop 2023-11-26T07:11:49.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.321+0000 7f0400df2b80 1 -- 172.21.15.2:0/276719833 shutdown_connections 2023-11-26T07:11:49.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.321+0000 7f0400df2b80 1 --2- 172.21.15.2:0/276719833 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5654f520c490 0x5654f5238e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:49.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.321+0000 7f0400df2b80 1 --2- 172.21.15.2:0/276719833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654f520f080 0x5654f5255840 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:49.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.321+0000 7f0400df2b80 1 --2- 172.21.15.2:0/276719833 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5654f5224ed0 0x5654f5255d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:49.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.321+0000 7f0400df2b80 1 -- 172.21.15.2:0/276719833 >> 172.21.15.2:0/276719833 conn(0x5654f513d310 msgr2=0x5654f5253e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:49.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.321+0000 7f0400df2b80 1 -- 172.21.15.2:0/276719833 shutdown_connections 2023-11-26T07:11:49.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.321+0000 7f0400df2b80 1 -- 172.21.15.2:0/276719833 wait complete. 2023-11-26T07:11:49.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.322+0000 7f0400df2b80 1 -- start start 2023-11-26T07:11:49.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.322+0000 7f0400df2b80 1 Processor -- start 2023-11-26T07:11:49.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.323+0000 7f0400df2b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654f520c490 0x5654f5239010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:49.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.323+0000 7f0400df2b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5654f520f080 0x5654f524ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:49.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.323+0000 7f0400df2b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5654f5224ed0 0x5654f5203330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:49.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.323+0000 7f0400df2b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654f5162960 con 0x5654f520c490 2023-11-26T07:11:49.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.323+0000 7f0400df2b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654f511c510 con 0x5654f5224ed0 2023-11-26T07:11:49.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.323+0000 7f0400df2b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x5654f511c1b0 con 0x5654f520f080 2023-11-26T07:11:49.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.323+0000 7f0400df2b80 10 client.0 _ll_register_callbacks cb 0x5654f5047a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-26T07:11:49.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.323+0000 7f03ee59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654f520c490 0x5654f5239010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:49.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.323+0000 7f03ee59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654f520c490 0x5654f5239010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39564/0 (socket says 172.21.15.2:39564) 2023-11-26T07:11:49.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.323+0000 7f03ee59c700 1 -- 172.21.15.2:0/81795207 learned_addr learned my addr 172.21.15.2:0/81795207 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:49.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.323+0000 7f03edd9b700 1 --2- 172.21.15.2:0/81795207 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5654f520f080 0x5654f524ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:49.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.323+0000 7f03eed9d700 1 --2- 172.21.15.2:0/81795207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5654f5224ed0 0x5654f5203330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:49.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.324+0000 7f03ee59c700 1 -- 172.21.15.2:0/81795207 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5654f520f080 msgr2=0x5654f524ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:49.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.324+0000 7f03ee59c700 1 --2- 172.21.15.2:0/81795207 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5654f520f080 0x5654f524ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:49.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.324+0000 7f03ee59c700 1 -- 172.21.15.2:0/81795207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5654f5224ed0 msgr2=0x5654f5203330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:49.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.324+0000 7f03ee59c700 1 --2- 172.21.15.2:0/81795207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5654f5224ed0 0x5654f5203330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:49.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.324+0000 7f03ee59c700 1 -- 172.21.15.2:0/81795207 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03e0011c70 con 0x5654f520c490 2023-11-26T07:11:49.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.324+0000 7f03ee59c700 1 --2- 172.21.15.2:0/81795207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654f520c490 0x5654f5239010 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f03e0010a00 tx=0x7f03e00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a586c15dcdfe3a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:49.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.324+0000 7f03cd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-26T07:11:49.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.324+0000 7f03cd7fa700 1 -- 172.21.15.2:0/81795207 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e0016070 con 0x5654f520c490 2023-11-26T07:11:49.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.324+0000 7f03cd7fa700 1 -- 172.21.15.2:0/81795207 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f03e00038a0 con 0x5654f520c490 2023-11-26T07:11:49.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.324+0000 7f0400df2b80 1 -- 172.21.15.2:0/81795207 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5654f5201a40 con 0x5654f520c490 2023-11-26T07:11:49.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.324+0000 7f03cd7fa700 1 -- 172.21.15.2:0/81795207 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f03e0003a60 con 0x5654f520c490 2023-11-26T07:11:49.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.324+0000 7f0400df2b80 10 client.4626 fetch_fsmap learned FSMap version 8 2023-11-26T07:11:49.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.324+0000 7f0400df2b80 1 -- 172.21.15.2:0/81795207 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5654f4f8bd90 con 0x5654f520c490 2023-11-26T07:11:49.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.324+0000 7f03cd7fa700 1 -- 172.21.15.2:0/81795207 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5654f5201a40 con 0x5654f520c490 2023-11-26T07:11:49.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.324+0000 7f03cd7fa700 1 -- 172.21.15.2:0/81795207 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f03e002e070 con 0x5654f520c490 2023-11-26T07:11:49.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.324+0000 7f0400df2b80 10 client.4626 fetch_fsmap finished waiting for FSMap version 8 2023-11-26T07:11:49.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.324+0000 7f0400df2b80 10 client.4626 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-26T07:11:49.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.324+0000 7f0400df2b80 20 client.4626 populate_metadata read hostname 'smithi002' 2023-11-26T07:11:49.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.324+0000 7f0400df2b80 1 --2- 172.21.15.2:0/81795207 >> [v2:172.21.15.192:6835/4032661989,v1:172.21.15.192:6837/4032661989] conn(0x5654f523b7c0 0x5654f524f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:49.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.324+0000 7f0400df2b80 4 client.4626 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-26T07:11:49.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.324+0000 7f0400df2b80 1 -- 172.21.15.2:0/81795207 --> [v2:172.21.15.192:6835/4032661989,v1:172.21.15.192:6837/4032661989] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5654f51dd840 con 0x5654f523b7c0 2023-11-26T07:11:49.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.325+0000 7f03edd9b700 1 --2- 172.21.15.2:0/81795207 >> [v2:172.21.15.192:6835/4032661989,v1:172.21.15.192:6837/4032661989] conn(0x5654f523b7c0 0x5654f524f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:49.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.325+0000 7f03cd7fa700 10 client.4626 ms_handle_connect on v2:172.21.15.192:6835/4032661989 2023-11-26T07:11:49.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.325+0000 7f03edd9b700 1 --2- 172.21.15.2:0/81795207 >> [v2:172.21.15.192:6835/4032661989,v1:172.21.15.192:6837/4032661989] conn(0x5654f523b7c0 0x5654f524f920 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc8559ddbb8c6955 server_cookie=459c52f21da31df4 in_seq=0 out_seq=0 2023-11-26T07:11:49.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.326+0000 7f03cd7fa700 1 -- 172.21.15.2:0/81795207 <== mds.0 v2:172.21.15.192:6835/4032661989 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5654f51dd840 con 0x5654f523b7c0 2023-11-26T07:11:49.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.326+0000 7f03cd7fa700 10 client.4626 handle_command_reply: tid=0 2023-11-26T07:11:49.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.326+0000 7f0400df2b80 1 client.4626 shutdown 2023-11-26T07:11:49.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.326+0000 7f0400df2b80 1 -- 172.21.15.2:0/81795207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654f520c490 msgr2=0x5654f5239010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:49.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.326+0000 7f0400df2b80 1 --2- 172.21.15.2:0/81795207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654f520c490 0x5654f5239010 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f03e0010a00 tx=0x7f03e00047c0 comp rx=0 tx=0).stop 2023-11-26T07:11:49.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.326+0000 7f0400df2b80 1 -- 172.21.15.2:0/81795207 shutdown_connections 2023-11-26T07:11:49.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.326+0000 7f0400df2b80 1 --2- 172.21.15.2:0/81795207 >> [v2:172.21.15.192:6835/4032661989,v1:172.21.15.192:6837/4032661989] conn(0x5654f523b7c0 0x5654f524f920 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:49.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.326+0000 7f0400df2b80 1 --2- 172.21.15.2:0/81795207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5654f5224ed0 0x5654f5203330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:49.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.326+0000 7f03cd7fa700 0 client.4626 ms_handle_reset on v2:172.21.15.192:6835/4032661989 2023-11-26T07:11:49.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.326+0000 7f0400df2b80 1 --2- 172.21.15.2:0/81795207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654f520c490 0x5654f5239010 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:49.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.326+0000 7f0400df2b80 1 --2- 172.21.15.2:0/81795207 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5654f520f080 0x5654f524ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:49.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.326+0000 7f0400df2b80 1 -- 172.21.15.2:0/81795207 >> 172.21.15.2:0/81795207 conn(0x5654f513d310 msgr2=0x5654f52095c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:49.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.326+0000 7f0400df2b80 1 -- 172.21.15.2:0/81795207 shutdown_connections 2023-11-26T07:11:49.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.326+0000 7f0400df2b80 1 -- 172.21.15.2:0/81795207 wait complete. 2023-11-26T07:11:49.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.326+0000 7f0400df2b80 20 client.4626 trim_cache size 0 max 16384 2023-11-26T07:11:49.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.345+0000 7f0400df2b80 1 Processor -- start 2023-11-26T07:11:49.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.345+0000 7f0400df2b80 1 -- start start 2023-11-26T07:11:49.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.346+0000 7f0400df2b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5654f520c490 0x5654f5266640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:49.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.346+0000 7f0400df2b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5654f520f080 0x5654f524edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:49.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.346+0000 7f0400df2b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654f5224ed0 0x5654f5253330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:49.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.346+0000 7f0400df2b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654f4fe18d0 con 0x5654f5224ed0 2023-11-26T07:11:49.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.346+0000 7f0400df2b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654f520b380 con 0x5654f520c490 2023-11-26T07:11:49.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.346+0000 7f0400df2b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x5654f520b150 con 0x5654f520f080 2023-11-26T07:11:49.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.346+0000 7f03eed9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654f5224ed0 0x5654f5253330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:49.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.346+0000 7f03eed9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654f5224ed0 0x5654f5253330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39576/0 (socket says 172.21.15.2:39576) 2023-11-26T07:11:49.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.346+0000 7f03eed9d700 1 -- 172.21.15.2:0/345250798 learned_addr learned my addr 172.21.15.2:0/345250798 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:49.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.346+0000 7f03ee59c700 1 --2- 172.21.15.2:0/345250798 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5654f520c490 0x5654f5266640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:49.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.346+0000 7f03edd9b700 1 --2- 172.21.15.2:0/345250798 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5654f520f080 0x5654f524edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:49.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.346+0000 7f03eed9d700 1 -- 172.21.15.2:0/345250798 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5654f520f080 msgr2=0x5654f524edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:49.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.346+0000 7f03eed9d700 1 --2- 172.21.15.2:0/345250798 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5654f520f080 0x5654f524edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:49.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.346+0000 7f03eed9d700 1 -- 172.21.15.2:0/345250798 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5654f520c490 msgr2=0x5654f5266640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:49.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.346+0000 7f03eed9d700 1 --2- 172.21.15.2:0/345250798 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5654f520c490 0x5654f5266640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:49.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.346+0000 7f03eed9d700 1 -- 172.21.15.2:0/345250798 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654f4f74c10 con 0x5654f5224ed0 2023-11-26T07:11:49.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.346+0000 7f03eed9d700 1 --2- 172.21.15.2:0/345250798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654f5224ed0 0x5654f5253330 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f03e8057fa0 tx=0x7f03e8089040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b9544c25b57d2db server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:49.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.346+0000 7f03dcff9700 1 -- 172.21.15.2:0/345250798 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e8058010 con 0x5654f5224ed0 2023-11-26T07:11:49.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.346+0000 7f03dcff9700 1 -- 172.21.15.2:0/345250798 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e805c160 con 0x5654f5224ed0 2023-11-26T07:11:49.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.346+0000 7f03dcff9700 1 -- 172.21.15.2:0/345250798 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e80603a0 con 0x5654f5224ed0 2023-11-26T07:11:49.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.347+0000 7f0400df2b80 1 -- 172.21.15.2:0/345250798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654f5224ed0 msgr2=0x5654f5253330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:49.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.347+0000 7f0400df2b80 1 --2- 172.21.15.2:0/345250798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654f5224ed0 0x5654f5253330 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f03e8057fa0 tx=0x7f03e8089040 comp rx=0 tx=0).stop 2023-11-26T07:11:49.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.347+0000 7f0400df2b80 1 -- 172.21.15.2:0/345250798 shutdown_connections 2023-11-26T07:11:49.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.347+0000 7f0400df2b80 1 --2- 172.21.15.2:0/345250798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654f5224ed0 0x5654f5253330 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:49.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.347+0000 7f0400df2b80 1 --2- 172.21.15.2:0/345250798 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5654f520c490 0x5654f5266640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:49.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.347+0000 7f0400df2b80 1 --2- 172.21.15.2:0/345250798 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5654f520f080 0x5654f524edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:49.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.347+0000 7f0400df2b80 1 -- 172.21.15.2:0/345250798 >> 172.21.15.2:0/345250798 conn(0x5654f513d310 msgr2=0x5654f5202d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:49.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.347+0000 7f0400df2b80 1 -- 172.21.15.2:0/345250798 shutdown_connections 2023-11-26T07:11:49.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.347+0000 7f0400df2b80 1 -- 172.21.15.2:0/345250798 wait complete. 2023-11-26T07:11:49.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.347+0000 7f0400df2b80 1 -- start start 2023-11-26T07:11:49.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.348+0000 7f0400df2b80 1 Processor -- start 2023-11-26T07:11:49.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.349+0000 7f0400df2b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5654f520c490 0x5654f526d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:49.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.349+0000 7f0400df2b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654f520f080 0x5654f5253c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:49.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.349+0000 7f0400df2b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5654f5224ed0 0x5654f5254180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:49.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.349+0000 7f0400df2b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654f5252c40 con 0x5654f520f080 2023-11-26T07:11:49.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.349+0000 7f0400df2b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654f52231f0 con 0x5654f5224ed0 2023-11-26T07:11:49.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.349+0000 7f0400df2b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x5654f5251e70 con 0x5654f520c490 2023-11-26T07:11:49.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.349+0000 7f0400df2b80 10 client.0 _ll_register_callbacks cb 0x5654f5047a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-26T07:11:49.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.349+0000 7f03edd9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654f520f080 0x5654f5253c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:49.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.349+0000 7f03edd9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654f520f080 0x5654f5253c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39580/0 (socket says 172.21.15.2:39580) 2023-11-26T07:11:49.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.349+0000 7f03edd9b700 1 -- 172.21.15.2:0/1153487574 learned_addr learned my addr 172.21.15.2:0/1153487574 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:49.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.349+0000 7f03eed9d700 1 --2- 172.21.15.2:0/1153487574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5654f5224ed0 0x5654f5254180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:49.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.349+0000 7f03ee59c700 1 --2- 172.21.15.2:0/1153487574 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5654f520c490 0x5654f526d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:49.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.349+0000 7f03edd9b700 1 -- 172.21.15.2:0/1153487574 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5654f520c490 msgr2=0x5654f526d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:49.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.349+0000 7f03edd9b700 1 --2- 172.21.15.2:0/1153487574 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5654f520c490 0x5654f526d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:49.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.349+0000 7f03edd9b700 1 -- 172.21.15.2:0/1153487574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5654f5224ed0 msgr2=0x5654f5254180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:49.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.349+0000 7f03edd9b700 1 --2- 172.21.15.2:0/1153487574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5654f5224ed0 0x5654f5254180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:49.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.349+0000 7f03edd9b700 1 -- 172.21.15.2:0/1153487574 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f00c6a90 con 0x5654f520f080 2023-11-26T07:11:49.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.350+0000 7f03edd9b700 1 --2- 172.21.15.2:0/1153487574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654f520f080 0x5654f5253c40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f03f00d1bd0 tx=0x7f03e40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=271137311a3bc66 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:49.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.350+0000 7f03cd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-26T07:11:49.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.350+0000 7f03cd7fa700 1 -- 172.21.15.2:0/1153487574 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e4020040 con 0x5654f520f080 2023-11-26T07:11:49.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.350+0000 7f03cd7fa700 1 -- 172.21.15.2:0/1153487574 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f03e4030070 con 0x5654f520f080 2023-11-26T07:11:49.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.350+0000 7f0400df2b80 1 -- 172.21.15.2:0/1153487574 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f03e0010ab0 con 0x5654f520f080 2023-11-26T07:11:49.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.350+0000 7f03cd7fa700 1 -- 172.21.15.2:0/1153487574 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f03e4004450 con 0x5654f520f080 2023-11-26T07:11:49.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.350+0000 7f0400df2b80 10 client.4632 fetch_fsmap learned FSMap version 8 2023-11-26T07:11:49.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.350+0000 7f0400df2b80 1 -- 172.21.15.2:0/1153487574 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5654f4fb2200 con 0x5654f520f080 2023-11-26T07:11:49.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.350+0000 7f03cd7fa700 1 -- 172.21.15.2:0/1153487574 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e0010ab0 con 0x5654f520f080 2023-11-26T07:11:49.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.350+0000 7f03cd7fa700 1 -- 172.21.15.2:0/1153487574 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f03e4009870 con 0x5654f520f080 2023-11-26T07:11:49.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.350+0000 7f0400df2b80 10 client.4632 fetch_fsmap finished waiting for FSMap version 8 2023-11-26T07:11:49.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.350+0000 7f0400df2b80 10 client.4632 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-26T07:11:49.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.350+0000 7f0400df2b80 20 client.4632 populate_metadata read hostname 'smithi002' 2023-11-26T07:11:49.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.350+0000 7f0400df2b80 1 --2- 172.21.15.2:0/1153487574 >> [v2:172.21.15.192:6835/4032661989,v1:172.21.15.192:6837/4032661989] conn(0x5654f524cd80 0x5654f524d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:49.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.350+0000 7f0400df2b80 4 client.4632 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-26T07:11:49.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.350+0000 7f0400df2b80 1 -- 172.21.15.2:0/1153487574 --> [v2:172.21.15.192:6835/4032661989,v1:172.21.15.192:6837/4032661989] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5654f5128f80 con 0x5654f524cd80 2023-11-26T07:11:49.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.350+0000 7f03ee59c700 1 --2- 172.21.15.2:0/1153487574 >> [v2:172.21.15.192:6835/4032661989,v1:172.21.15.192:6837/4032661989] conn(0x5654f524cd80 0x5654f524d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:49.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.351+0000 7f03cd7fa700 10 client.4632 ms_handle_connect on v2:172.21.15.192:6835/4032661989 2023-11-26T07:11:49.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.351+0000 7f03ee59c700 1 --2- 172.21.15.2:0/1153487574 >> [v2:172.21.15.192:6835/4032661989,v1:172.21.15.192:6837/4032661989] conn(0x5654f524cd80 0x5654f524d160 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8253f07b2054c5c8 server_cookie=4a43628772e72471 in_seq=0 out_seq=0 2023-11-26T07:11:49.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.351+0000 7f03cd7fa700 1 -- 172.21.15.2:0/1153487574 <== mds.0 v2:172.21.15.192:6835/4032661989 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5654f5128f80 con 0x5654f524cd80 2023-11-26T07:11:49.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.351+0000 7f03cd7fa700 10 client.4632 handle_command_reply: tid=0 2023-11-26T07:11:49.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.351+0000 7f0400df2b80 1 client.4632 shutdown 2023-11-26T07:11:49.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.351+0000 7f0400df2b80 1 -- 172.21.15.2:0/1153487574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654f520f080 msgr2=0x5654f5253c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:49.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.351+0000 7f0400df2b80 1 --2- 172.21.15.2:0/1153487574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654f520f080 0x5654f5253c40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f03f00d1bd0 tx=0x7f03e40047c0 comp rx=0 tx=0).stop 2023-11-26T07:11:49.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.351+0000 7f0400df2b80 1 -- 172.21.15.2:0/1153487574 shutdown_connections 2023-11-26T07:11:49.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.351+0000 7f0400df2b80 1 --2- 172.21.15.2:0/1153487574 >> [v2:172.21.15.192:6835/4032661989,v1:172.21.15.192:6837/4032661989] conn(0x5654f524cd80 0x5654f524d160 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:49.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.351+0000 7f0400df2b80 1 --2- 172.21.15.2:0/1153487574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5654f5224ed0 0x5654f5254180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:49.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.351+0000 7f03cd7fa700 0 client.4632 ms_handle_reset on v2:172.21.15.192:6835/4032661989 2023-11-26T07:11:49.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.351+0000 7f0400df2b80 1 --2- 172.21.15.2:0/1153487574 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5654f520c490 0x5654f526d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:49.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.351+0000 7f0400df2b80 1 --2- 172.21.15.2:0/1153487574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654f520f080 0x5654f5253c40 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:49.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.351+0000 7f0400df2b80 1 -- 172.21.15.2:0/1153487574 >> 172.21.15.2:0/1153487574 conn(0x5654f513d310 msgr2=0x5654f524ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:49.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.351+0000 7f0400df2b80 1 -- 172.21.15.2:0/1153487574 shutdown_connections 2023-11-26T07:11:49.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.351+0000 7f0400df2b80 1 -- 172.21.15.2:0/1153487574 wait complete. 2023-11-26T07:11:49.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.351+0000 7f0400df2b80 20 client.4632 trim_cache size 0 max 16384 2023-11-26T07:11:49.360 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-26T07:11:49.360 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "cb9817c7-f1ed-4745-9395-2760a3bb9712", 2023-11-26T07:11:49.360 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2023-11-26T07:11:49.360 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 4282, 2023-11-26T07:11:49.360 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2023-11-26T07:11:49.361 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2023-11-26T07:11:49.361 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2023-11-26T07:11:49.361 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 14.714933200999999, 2023-11-26T07:11:49.361 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 8, 2023-11-26T07:11:49.361 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 21, 2023-11-26T07:11:49.361 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 21, 2023-11-26T07:11:49.361 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 21.811154878 2023-11-26T07:11:49.361 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-26T07:11:49.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.352+0000 7f03f4bf9700 1 -- 172.21.15.2:0/3116776127 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f03d006aed0 msgr2=0x7f03d006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:49.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.352+0000 7f03f4bf9700 1 --2- 172.21.15.2:0/3116776127 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f03d006aed0 0x7f03d006d390 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f03e0009d70 tx=0x7f03e0009210 comp rx=0 tx=0).stop 2023-11-26T07:11:49.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.352+0000 7f03f4bf9700 1 -- 172.21.15.2:0/3116776127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03f01440f0 msgr2=0x7f03f00c7c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:49.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.352+0000 7f03f4bf9700 1 --2- 172.21.15.2:0/3116776127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03f01440f0 0x7f03f00c7c00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f03e800caa0 tx=0x7f03e800cdb0 comp rx=0 tx=0).stop 2023-11-26T07:11:49.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.352+0000 7f03f4bf9700 1 -- 172.21.15.2:0/3116776127 shutdown_connections 2023-11-26T07:11:49.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.352+0000 7f03f4bf9700 1 --2- 172.21.15.2:0/3116776127 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f03d006aed0 0x7f03d006d390 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:49.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.352+0000 7f03f4bf9700 1 --2- 172.21.15.2:0/3116776127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03f01440f0 0x7f03f00c7c00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:49.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.352+0000 7f03f4bf9700 1 --2- 172.21.15.2:0/3116776127 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03f00720f0 0x7f03f015ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:49.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.352+0000 7f03f4bf9700 1 --2- 172.21.15.2:0/3116776127 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03f0143ae0 0x7f03f00c7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:49.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.352+0000 7f03f4bf9700 1 -- 172.21.15.2:0/3116776127 >> 172.21.15.2:0/3116776127 conn(0x7f03f00b2740 msgr2=0x7f03f00b41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:49.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.352+0000 7f03f4bf9700 1 -- 172.21.15.2:0/3116776127 shutdown_connections 2023-11-26T07:11:49.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.352+0000 7f03f4bf9700 1 -- 172.21.15.2:0/3116776127 wait complete. 2023-11-26T07:11:49.366 INFO:teuthology.run_tasks:Running task kclient... 2023-11-26T07:11:49.387 INFO:tasks.kclient:Mounting kernel clients... 2023-11-26T07:11:49.387 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-11-26T07:11:49.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:49.388 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2023-11-26T07:11:49.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:49.405 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link delete ceph-brx 2023-11-26T07:11:49.477 INFO:teuthology.orchestra.run.smithi002.stderr:Cannot find device "ceph-brx" 2023-11-26T07:11:49.478 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T07:11:49.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:49.478 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2023-11-26T07:11:49.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:49.536 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link delete ceph-brx 2023-11-26T07:11:49.605 INFO:teuthology.orchestra.run.smithi002.stderr:Cannot find device "ceph-brx" 2023-11-26T07:11:49.606 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T07:11:49.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:49.606 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2023-11-26T07:11:49.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:49.627 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link delete ceph-brx 2023-11-26T07:11:49.701 INFO:teuthology.orchestra.run.smithi192.stderr:Cannot find device "ceph-brx" 2023-11-26T07:11:49.702 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T07:11:49.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:49.703 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2023-11-26T07:11:49.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:49.761 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link delete ceph-brx 2023-11-26T07:11:49.830 INFO:teuthology.orchestra.run.smithi192.stderr:Cannot find device "ceph-brx" 2023-11-26T07:11:49.831 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T07:11:49.832 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-11-26T07:11:49.832 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-26T07:11:49.832 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-26T07:11:49.832 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-26T07:11:49.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.956+0000 7fd70e034700 1 Processor -- start 2023-11-26T07:11:49.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.956+0000 7fd70e034700 1 -- start start 2023-11-26T07:11:49.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.956+0000 7fd70e034700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd70806b400 0x7fd70815e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:49.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.956+0000 7fd70e034700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd7080b5e40 0x7fd70815eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:49.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.956+0000 7fd70e034700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd70806bb80 con 0x7fd70815e1e0 2023-11-26T07:11:49.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.956+0000 7fd70e034700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd70806be20 con 0x7fd7080b5e40 2023-11-26T07:11:49.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.956+0000 7fd70e034700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70806c100 con 0x7fd70806b400 2023-11-26T07:11:49.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.957+0000 7fd706ffd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd70806b400 0x7fd70815e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:49.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.957+0000 7fd707fff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd7080b5e40 0x7fd70815eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:49.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.957+0000 7fd7077fe700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fd70815e1e0 0x7fd7080b12a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.2:38166/0 (socket says 172.21.15.2:38166) 2023-11-26T07:11:49.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.957+0000 7fd707fff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd7080b5e40 0x7fd70815eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.2:48176/0 (socket says 172.21.15.2:48176) 2023-11-26T07:11:49.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.957+0000 7fd706ffd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd70806b400 0x7fd70815e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.2:37668/0 (socket says 172.21.15.2:37668) 2023-11-26T07:11:49.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.957+0000 7fd7077fe700 1 -- 172.21.15.2:0/2659426114 learned_addr learned my addr 172.21.15.2:0/2659426114 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:11:49.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.957+0000 7fd706ffd700 1 -- 172.21.15.2:0/2659426114 >> v2:172.21.15.192:3300/0 conn(0x7fd7080b5e40 msgr2=0x7fd70815eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:49.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.957+0000 7fd706ffd700 1 --2- 172.21.15.2:0/2659426114 >> v2:172.21.15.192:3300/0 conn(0x7fd7080b5e40 0x7fd70815eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:49.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.957+0000 7fd706ffd700 1 -- 172.21.15.2:0/2659426114 >> v1:172.21.15.192:6789/0 conn(0x7fd70815e1e0 legacy=0x7fd7080b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:49.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.957+0000 7fd706ffd700 1 -- 172.21.15.2:0/2659426114 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd70806c3e0 con 0x7fd70806b400 2023-11-26T07:11:49.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.957+0000 7fd7067fc700 1 -- 172.21.15.2:0/2659426114 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2501892510 0 0) 0x7fd70806bb80 con 0x7fd70815e1e0 2023-11-26T07:11:49.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.957+0000 7fd707fff700 1 --2- 172.21.15.2:0/2659426114 >> v2:172.21.15.192:3300/0 conn(0x7fd7080b5e40 0x7fd70815eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:11:49.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.957+0000 7fd706ffd700 1 --2- 172.21.15.2:0/2659426114 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd70806b400 0x7fd70815e5c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0009840 tx=0x7fd6f0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f3b7c93f7f32710 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:49.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.957+0000 7fd7067fc700 1 -- 172.21.15.2:0/2659426114 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f0011830 con 0x7fd70806b400 2023-11-26T07:11:49.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.958+0000 7fd7067fc700 1 -- 172.21.15.2:0/2659426114 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f0011990 con 0x7fd70806b400 2023-11-26T07:11:49.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.958+0000 7fd7067fc700 1 -- 172.21.15.2:0/2659426114 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f0011d20 con 0x7fd70806b400 2023-11-26T07:11:49.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.958+0000 7fd70e034700 1 -- 172.21.15.2:0/2659426114 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd70806b400 msgr2=0x7fd70815e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:49.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.958+0000 7fd70e034700 1 --2- 172.21.15.2:0/2659426114 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd70806b400 0x7fd70815e5c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0009840 tx=0x7fd6f0009b50 comp rx=0 tx=0).stop 2023-11-26T07:11:49.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.958+0000 7fd70e034700 1 -- 172.21.15.2:0/2659426114 shutdown_connections 2023-11-26T07:11:49.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.958+0000 7fd70e034700 1 --2- 172.21.15.2:0/2659426114 >> v2:172.21.15.192:3300/0 conn(0x7fd7080b5e40 0x7fd70815eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:49.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.958+0000 7fd70e034700 1 --2- 172.21.15.2:0/2659426114 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd70806b400 0x7fd70815e5c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:49.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.958+0000 7fd70e034700 1 -- 172.21.15.2:0/2659426114 >> 172.21.15.2:0/2659426114 conn(0x7fd7080b5070 msgr2=0x7fd7080b5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:49.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.958+0000 7fd70e034700 1 -- 172.21.15.2:0/2659426114 shutdown_connections 2023-11-26T07:11:49.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.958+0000 7fd70e034700 1 -- 172.21.15.2:0/2659426114 wait complete. 2023-11-26T07:11:49.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.959+0000 7fd70e034700 1 Processor -- start 2023-11-26T07:11:49.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.960+0000 7fd70e034700 1 -- start start 2023-11-26T07:11:49.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.960+0000 7fd70e034700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd70806b400 0x7fd70814ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:49.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.960+0000 7fd70e034700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7080b5e40 0x7fd7080b1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:49.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.960+0000 7fd70e034700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd70815e1e0 0x7fd7080b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:49.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.960+0000 7fd70e034700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70814b340 con 0x7fd70815e1e0 2023-11-26T07:11:49.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.960+0000 7fd70e034700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70814b080 con 0x7fd7080b5e40 2023-11-26T07:11:49.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.960+0000 7fd70e034700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70814e830 con 0x7fd70806b400 2023-11-26T07:11:49.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.960+0000 7fd707fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd70815e1e0 0x7fd7080b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:49.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.960+0000 7fd706ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7080b5e40 0x7fd7080b1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:49.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.960+0000 7fd707fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd70815e1e0 0x7fd7080b23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39596/0 (socket says 172.21.15.2:39596) 2023-11-26T07:11:49.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.960+0000 7fd707fff700 1 -- 172.21.15.2:0/931187376 learned_addr learned my addr 172.21.15.2:0/931187376 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:49.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.960+0000 7fd7077fe700 1 --2- 172.21.15.2:0/931187376 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd70806b400 0x7fd70814ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:49.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.961+0000 7fd707fff700 1 -- 172.21.15.2:0/931187376 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd70806b400 msgr2=0x7fd70814ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:49.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.961+0000 7fd707fff700 1 --2- 172.21.15.2:0/931187376 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd70806b400 0x7fd70814ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:49.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.961+0000 7fd707fff700 1 -- 172.21.15.2:0/931187376 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7080b5e40 msgr2=0x7fd7080b1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:49.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.961+0000 7fd707fff700 1 --2- 172.21.15.2:0/931187376 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7080b5e40 0x7fd7080b1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:49.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.961+0000 7fd707fff700 1 -- 172.21.15.2:0/931187376 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd700009a70 con 0x7fd70815e1e0 2023-11-26T07:11:49.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.961+0000 7fd707fff700 1 --2- 172.21.15.2:0/931187376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd70815e1e0 0x7fd7080b23f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd70000efc0 tx=0x7fd70000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:49.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.961+0000 7fd6fffff700 1 -- 172.21.15.2:0/931187376 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70000ca90 con 0x7fd70815e1e0 2023-11-26T07:11:49.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.961+0000 7fd6fffff700 1 -- 172.21.15.2:0/931187376 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70000f040 con 0x7fd70815e1e0 2023-11-26T07:11:49.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.961+0000 7fd70e034700 1 -- 172.21.15.2:0/931187376 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f00094a0 con 0x7fd70815e1e0 2023-11-26T07:11:49.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.961+0000 7fd6fffff700 1 -- 172.21.15.2:0/931187376 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70000ce10 con 0x7fd70815e1e0 2023-11-26T07:11:49.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.961+0000 7fd70e034700 1 -- 172.21.15.2:0/931187376 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd70814b590 con 0x7fd70815e1e0 2023-11-26T07:11:49.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.962+0000 7fd70e034700 1 -- 172.21.15.2:0/931187376 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd708068670 con 0x7fd70815e1e0 2023-11-26T07:11:49.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.962+0000 7fd6fffff700 1 -- 172.21.15.2:0/931187376 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd700014480 con 0x7fd70815e1e0 2023-11-26T07:11:49.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.963+0000 7fd6fffff700 1 --2- 172.21.15.2:0/931187376 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd6e806aed0 0x7fd6e806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:49.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.963+0000 7fd6fffff700 1 -- 172.21.15.2:0/931187376 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd700089c30 con 0x7fd70815e1e0 2023-11-26T07:11:49.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.963+0000 7fd7077fe700 1 --2- 172.21.15.2:0/931187376 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd6e806aed0 0x7fd6e806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:49.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.964+0000 7fd7077fe700 1 --2- 172.21.15.2:0/931187376 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd6e806aed0 0x7fd6e806d390 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8000f60 tx=0x7fd6f8007e70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:49.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:49.968+0000 7fd6fffff700 1 -- 172.21.15.2:0/931187376 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd700054d70 con 0x7fd70815e1e0 2023-11-26T07:11:50.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:50.215+0000 7fd70e034700 1 -- 172.21.15.2:0/931187376 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd70806ece0 con 0x7fd70815e1e0 2023-11-26T07:11:50.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:50.215+0000 7fd6fffff700 1 -- 172.21.15.2:0/931187376 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd700009d70 con 0x7fd70815e1e0 2023-11-26T07:11:50.217 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-26T07:11:50.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:50.217+0000 7fd70e034700 1 -- 172.21.15.2:0/931187376 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd6e806aed0 msgr2=0x7fd6e806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:50.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:50.217+0000 7fd70e034700 1 --2- 172.21.15.2:0/931187376 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd6e806aed0 0x7fd6e806d390 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8000f60 tx=0x7fd6f8007e70 comp rx=0 tx=0).stop 2023-11-26T07:11:50.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:50.217+0000 7fd70e034700 1 -- 172.21.15.2:0/931187376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd70815e1e0 msgr2=0x7fd7080b23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:50.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:50.217+0000 7fd70e034700 1 --2- 172.21.15.2:0/931187376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd70815e1e0 0x7fd7080b23f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd70000efc0 tx=0x7fd70000c3a0 comp rx=0 tx=0).stop 2023-11-26T07:11:50.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:50.217+0000 7fd70e034700 1 -- 172.21.15.2:0/931187376 shutdown_connections 2023-11-26T07:11:50.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:50.217+0000 7fd70e034700 1 --2- 172.21.15.2:0/931187376 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd6e806aed0 0x7fd6e806d390 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:50.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:50.217+0000 7fd70e034700 1 --2- 172.21.15.2:0/931187376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd70815e1e0 0x7fd7080b23f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:50.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:50.217+0000 7fd70e034700 1 --2- 172.21.15.2:0/931187376 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd70806b400 0x7fd70814ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:50.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:50.217+0000 7fd70e034700 1 --2- 172.21.15.2:0/931187376 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7080b5e40 0x7fd7080b1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:50.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:50.217+0000 7fd70e034700 1 -- 172.21.15.2:0/931187376 >> 172.21.15.2:0/931187376 conn(0x7fd7080b5070 msgr2=0x7fd7080b2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:50.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:50.218+0000 7fd70e034700 1 -- 172.21.15.2:0/931187376 shutdown_connections 2023-11-26T07:11:50.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:50.218+0000 7fd70e034700 1 -- 172.21.15.2:0/931187376 wait complete. 2023-11-26T07:11:50.231 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-26T07:11:50.231 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-26T07:11:50.231 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2023-11-26T07:11:50.231 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-26T07:11:50.231 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-26T07:11:50.231 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-26T07:11:50.232 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-26T07:11:50.232 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-26T07:11:50.232 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-26T07:11:50.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:50.232 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2023-11-26T07:11:50.249 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:11:50.249 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:11:50.249 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:11:50.250 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:11:50.250 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2023-11-26T07:11:50.250 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:11:50.250 INFO:teuthology.orchestra.run.smithi002.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:11:50.250 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:11:50.250 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:11:50.250 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:11:50.250 INFO:teuthology.orchestra.run.smithi002.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-26T07:11:50.250 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:11:50.250 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-26T07:11:50.250 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 42313sec preferred_lft 42313sec 2023-11-26T07:11:50.251 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link 2023-11-26T07:11:50.251 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:11:50.251 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:11:50.251 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:11:50.251 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-26T07:11:50.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:50.251 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-11-26T07:11:50.252 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-11-26T07:11:50.252 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add name ceph-brx type bridge 2023-11-26T07:11:50.252 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr flush dev ceph-brx 2023-11-26T07:11:50.252 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set ceph-brx up 2023-11-26T07:11:50.252 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-26T07:11:50.252 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-11-26T07:11:50.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:50.412 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-26T07:11:50.439 INFO:teuthology.orchestra.run.smithi002.stdout:1 2023-11-26T07:11:50.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:50.440 DEBUG:teuthology.orchestra.run.smithi002:> route 2023-11-26T07:11:50.512 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2023-11-26T07:11:50.512 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-26T07:11:50.512 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-26T07:11:50.512 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-26T07:11:50.512 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-26T07:11:50.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:50.513 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-11-26T07:11:50.513 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-11-26T07:11:50.513 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-26T07:11:50.513 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-26T07:11:50.513 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-26T07:11:50.513 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-11-26T07:11:50.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:50.775 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2023-11-26T07:11:50.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:50.792 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list-id 2023-11-26T07:11:50.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:50.849 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-11-26T07:11:50.849 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-11-26T07:11:50.850 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:11:50.850 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-26T07:11:50.850 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-11-26T07:11:50.945 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-26T07:11:50.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:50.945 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-11-26T07:11:50.946 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-11-26T07:11:50.946 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-26T07:11:50.946 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-26T07:11:50.946 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-26T07:11:50.946 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-26T07:11:50.946 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-26T07:11:50.946 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-11-26T07:11:51.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:51.171 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-11-26T07:11:51.172 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-11-26T07:11:51.172 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 up 2023-11-26T07:11:51.172 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set dev brx.0 master ceph-brx 2023-11-26T07:11:51.172 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-11-26T07:11:51.278 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:11:51.278 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-26T07:11:51.300 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-26T07:11:51.300 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:11:51.300 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-26T07:11:51.358 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-26T07:11:51.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:51.359 DEBUG:teuthology.orchestra.run.smithi002:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-26T07:11:51.464 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-26T07:11:51.464 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-26T07:11:51.464 INFO:teuthology.orchestra.run.smithi002.stdout:invalid new device string format 2023-11-26T07:11:51.581 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-26T07:11:51.582 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-26T07:11:51.582 INFO:teuthology.orchestra.run.smithi002.stdout:invalid new device string format 2023-11-26T07:11:51.582 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-11-26T07:11:51.582 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:11:51.655 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-26T07:11:51.655 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-26T07:11:51.655 INFO:teuthology.orchestra.run.smithi002.stdout:invalid new device string format 2023-11-26T07:11:51.656 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-11-26T07:11:51.656 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:11:51.656 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: resolved to: "172.21.15.2:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-11-26T07:11:51.656 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.2:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-11-26T07:11:51.656 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=cb9817c7-f1ed-4745-9395-2760a3bb9712" will pass to kernel 2023-11-26T07:11:51.659 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-26T07:11:51.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:51.659 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-26T07:11:51.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:51.687 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-26T07:11:51.777 INFO:teuthology.orchestra.run.smithi002.stdout:client4493 2023-11-26T07:11:51.777 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:11:51.777 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:11:51.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:51.795 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-26T07:11:51.883 INFO:teuthology.orchestra.run.smithi002.stdout:client4493 2023-11-26T07:11:51.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:51.884 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-26T07:11:51.932 INFO:teuthology.orchestra.run.smithi002.stdout:client4493 2023-11-26T07:11:52.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:52.006 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/cb9817c7-f1ed-4745-9395-2760a3bb9712.client4493/status') 2023-11-26T07:11:52.060 INFO:teuthology.orchestra.run.smithi002.stdout:instance: client.4493 (3)172.21.15.2:0/4128176149 2023-11-26T07:11:52.060 INFO:teuthology.orchestra.run.smithi002.stdout:blocklisted: false 2023-11-26T07:11:52.060 INFO:teuthology.orchestra.run.smithi002.stderr:0+1 records in 2023-11-26T07:11:52.060 INFO:teuthology.orchestra.run.smithi002.stderr:0+1 records out 2023-11-26T07:11:52.061 INFO:teuthology.orchestra.run.smithi002.stderr:69 bytes copied, 2.4236e-05 s, 2.8 MB/s 2023-11-26T07:11:52.062 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-11-26T07:11:52.062 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-26T07:11:52.062 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-26T07:11:52.062 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-26T07:11:52.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.186+0000 7faa35e37700 1 Processor -- start 2023-11-26T07:11:52.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.186+0000 7faa35e37700 1 -- start start 2023-11-26T07:11:52.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.187+0000 7faa35e37700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7faa300722c0 0x7faa300b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:52.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.187+0000 7faa35e37700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa301440f0 0x7faa3006e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:52.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.187+0000 7faa35e37700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa30143ec0 con 0x7faa30143ae0 2023-11-26T07:11:52.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.187+0000 7faa35e37700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa300b40a0 con 0x7faa300722c0 2023-11-26T07:11:52.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.187+0000 7faa35e37700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa300b3ae0 con 0x7faa301440f0 2023-11-26T07:11:52.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.187+0000 7faa2ffff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa301440f0 0x7faa3006e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:52.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.187+0000 7faa2effd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7faa300722c0 0x7faa300b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:52.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.187+0000 7faa2ffff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa301440f0 0x7faa3006e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.2:37688/0 (socket says 172.21.15.2:37688) 2023-11-26T07:11:52.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.187+0000 7faa2effd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7faa300722c0 0x7faa300b51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.2:48192/0 (socket says 172.21.15.2:48192) 2023-11-26T07:11:52.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.187+0000 7faa2ffff700 1 -- 172.21.15.2:0/3805740981 learned_addr learned my addr 172.21.15.2:0/3805740981 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:52.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.187+0000 7faa2f7fe700 1 --1- 172.21.15.2:0/3805740981 >> v1:172.21.15.192:6789/0 conn(0x7faa30143ae0 0x7faa30071bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.2:38184/0 (socket says 172.21.15.2:38184) 2023-11-26T07:11:52.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.188+0000 7faa2effd700 1 -- 172.21.15.2:0/3805740981 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa301440f0 msgr2=0x7faa3006e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:52.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.188+0000 7faa2effd700 1 --2- 172.21.15.2:0/3805740981 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa301440f0 0x7faa3006e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:52.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.188+0000 7faa2effd700 1 -- 172.21.15.2:0/3805740981 >> v1:172.21.15.192:6789/0 conn(0x7faa30143ae0 legacy=0x7faa30071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:52.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.188+0000 7faa2effd700 1 -- 172.21.15.2:0/3805740981 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa300b3dc0 con 0x7faa300722c0 2023-11-26T07:11:52.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.188+0000 7faa2e7fc700 1 -- 172.21.15.2:0/3805740981 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 153776076 0 0) 0x7faa30143ec0 con 0x7faa30143ae0 2023-11-26T07:11:52.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.188+0000 7faa2ffff700 1 --2- 172.21.15.2:0/3805740981 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa301440f0 0x7faa3006e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:11:52.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.188+0000 7faa2effd700 1 --2- 172.21.15.2:0/3805740981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa300722c0 0x7faa300b51b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7faa2000bae0 tx=0x7faa2000bdf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc8ecacd53113aa1 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:52.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.188+0000 7faa2e7fc700 1 -- 172.21.15.2:0/3805740981 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2000dc70 con 0x7faa300722c0 2023-11-26T07:11:52.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.188+0000 7faa2e7fc700 1 -- 172.21.15.2:0/3805740981 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa2000ddd0 con 0x7faa300722c0 2023-11-26T07:11:52.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.188+0000 7faa2e7fc700 1 -- 172.21.15.2:0/3805740981 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa20010690 con 0x7faa300722c0 2023-11-26T07:11:52.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.188+0000 7faa35e37700 1 -- 172.21.15.2:0/3805740981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa300722c0 msgr2=0x7faa300b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:52.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.188+0000 7faa35e37700 1 --2- 172.21.15.2:0/3805740981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa300722c0 0x7faa300b51b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7faa2000bae0 tx=0x7faa2000bdf0 comp rx=0 tx=0).stop 2023-11-26T07:11:52.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.188+0000 7faa35e37700 1 -- 172.21.15.2:0/3805740981 shutdown_connections 2023-11-26T07:11:52.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.188+0000 7faa35e37700 1 --2- 172.21.15.2:0/3805740981 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa301440f0 0x7faa3006e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:52.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.188+0000 7faa35e37700 1 --2- 172.21.15.2:0/3805740981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa300722c0 0x7faa300b51b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:52.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.188+0000 7faa35e37700 1 -- 172.21.15.2:0/3805740981 >> 172.21.15.2:0/3805740981 conn(0x7faa300b2740 msgr2=0x7faa300b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:52.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.189+0000 7faa35e37700 1 -- 172.21.15.2:0/3805740981 shutdown_connections 2023-11-26T07:11:52.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.189+0000 7faa35e37700 1 -- 172.21.15.2:0/3805740981 wait complete. 2023-11-26T07:11:52.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.190+0000 7faa35e37700 1 Processor -- start 2023-11-26T07:11:52.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.190+0000 7faa35e37700 1 -- start start 2023-11-26T07:11:52.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.191+0000 7faa35e37700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa300722c0 0x7faa3015b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:52.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.191+0000 7faa35e37700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa30143ae0 0x7faa301f4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:52.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.191+0000 7faa35e37700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa301440f0 0x7faa3013f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:52.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.191+0000 7faa35e37700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa301f49b0 con 0x7faa300722c0 2023-11-26T07:11:52.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.191+0000 7faa35e37700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa3015c590 con 0x7faa30143ae0 2023-11-26T07:11:52.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.191+0000 7faa35e37700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa3015b980 con 0x7faa301440f0 2023-11-26T07:11:52.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.191+0000 7faa2f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa300722c0 0x7faa3015b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:52.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.191+0000 7faa2f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa300722c0 0x7faa3015b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39610/0 (socket says 172.21.15.2:39610) 2023-11-26T07:11:52.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.191+0000 7faa2f7fe700 1 -- 172.21.15.2:0/1348912194 learned_addr learned my addr 172.21.15.2:0/1348912194 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:52.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.191+0000 7faa2effd700 1 --2- 172.21.15.2:0/1348912194 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa30143ae0 0x7faa301f4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:52.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.191+0000 7faa2ffff700 1 --2- 172.21.15.2:0/1348912194 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa301440f0 0x7faa3013f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:52.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.191+0000 7faa2f7fe700 1 -- 172.21.15.2:0/1348912194 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa301440f0 msgr2=0x7faa3013f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:52.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.191+0000 7faa2f7fe700 1 --2- 172.21.15.2:0/1348912194 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa301440f0 0x7faa3013f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:52.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.191+0000 7faa2f7fe700 1 -- 172.21.15.2:0/1348912194 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa30143ae0 msgr2=0x7faa301f4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:52.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.191+0000 7faa2f7fe700 1 --2- 172.21.15.2:0/1348912194 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa30143ae0 0x7faa301f4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:52.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.191+0000 7faa2f7fe700 1 -- 172.21.15.2:0/1348912194 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa28009b30 con 0x7faa300722c0 2023-11-26T07:11:52.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.191+0000 7faa2effd700 1 --2- 172.21.15.2:0/1348912194 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa30143ae0 0x7faa301f4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:11:52.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.191+0000 7faa2f7fe700 1 --2- 172.21.15.2:0/1348912194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa300722c0 0x7faa3015b2f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7faa240011e0 tx=0x7faa2400ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:52.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.192+0000 7faa17fff700 1 -- 172.21.15.2:0/1348912194 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa24004c80 con 0x7faa300722c0 2023-11-26T07:11:52.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.192+0000 7faa17fff700 1 -- 172.21.15.2:0/1348912194 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa24004e00 con 0x7faa300722c0 2023-11-26T07:11:52.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.192+0000 7faa35e37700 1 -- 172.21.15.2:0/1348912194 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa2000b740 con 0x7faa300722c0 2023-11-26T07:11:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.192+0000 7faa17fff700 1 -- 172.21.15.2:0/1348912194 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa24007310 con 0x7faa300722c0 2023-11-26T07:11:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.192+0000 7faa35e37700 1 -- 172.21.15.2:0/1348912194 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa3015bf40 con 0x7faa300722c0 2023-11-26T07:11:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.193+0000 7faa35e37700 1 -- 172.21.15.2:0/1348912194 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa30068180 con 0x7faa300722c0 2023-11-26T07:11:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.193+0000 7faa17fff700 1 -- 172.21.15.2:0/1348912194 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faa24007470 con 0x7faa300722c0 2023-11-26T07:11:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.194+0000 7faa17fff700 1 --2- 172.21.15.2:0/1348912194 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7faa1c06aed0 0x7faa1c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.194+0000 7faa17fff700 1 -- 172.21.15.2:0/1348912194 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faa240892b0 con 0x7faa300722c0 2023-11-26T07:11:52.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.194+0000 7faa2effd700 1 --2- 172.21.15.2:0/1348912194 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7faa1c06aed0 0x7faa1c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:52.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.194+0000 7faa2effd700 1 --2- 172.21.15.2:0/1348912194 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7faa1c06aed0 0x7faa1c06d390 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7faa2000be30 tx=0x7faa20008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:52.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.199+0000 7faa17fff700 1 -- 172.21.15.2:0/1348912194 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faa240542c0 con 0x7faa300722c0 2023-11-26T07:11:52.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.446+0000 7faa35e37700 1 -- 172.21.15.2:0/1348912194 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7faa3015c6d0 con 0x7faa300722c0 2023-11-26T07:11:52.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.447+0000 7faa17fff700 1 -- 172.21.15.2:0/1348912194 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7faa3015c6d0 con 0x7faa300722c0 2023-11-26T07:11:52.449 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-26T07:11:52.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.448+0000 7faa35e37700 1 -- 172.21.15.2:0/1348912194 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7faa1c06aed0 msgr2=0x7faa1c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:52.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.448+0000 7faa35e37700 1 --2- 172.21.15.2:0/1348912194 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7faa1c06aed0 0x7faa1c06d390 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7faa2000be30 tx=0x7faa20008040 comp rx=0 tx=0).stop 2023-11-26T07:11:52.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.448+0000 7faa35e37700 1 -- 172.21.15.2:0/1348912194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa300722c0 msgr2=0x7faa3015b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:52.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.448+0000 7faa35e37700 1 --2- 172.21.15.2:0/1348912194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa300722c0 0x7faa3015b2f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7faa240011e0 tx=0x7faa2400ca30 comp rx=0 tx=0).stop 2023-11-26T07:11:52.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.449+0000 7faa35e37700 1 -- 172.21.15.2:0/1348912194 shutdown_connections 2023-11-26T07:11:52.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.449+0000 7faa35e37700 1 --2- 172.21.15.2:0/1348912194 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7faa1c06aed0 0x7faa1c06d390 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:52.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.449+0000 7faa35e37700 1 --2- 172.21.15.2:0/1348912194 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa301440f0 0x7faa3013f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:52.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.449+0000 7faa35e37700 1 --2- 172.21.15.2:0/1348912194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa300722c0 0x7faa3015b2f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:52.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.449+0000 7faa35e37700 1 --2- 172.21.15.2:0/1348912194 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa30143ae0 0x7faa301f4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:52.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.449+0000 7faa35e37700 1 -- 172.21.15.2:0/1348912194 >> 172.21.15.2:0/1348912194 conn(0x7faa300b2740 msgr2=0x7faa300b54e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:52.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.449+0000 7faa35e37700 1 -- 172.21.15.2:0/1348912194 shutdown_connections 2023-11-26T07:11:52.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:52.449+0000 7faa35e37700 1 -- 172.21.15.2:0/1348912194 wait complete. 2023-11-26T07:11:52.463 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-26T07:11:52.463 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-26T07:11:52.463 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2023-11-26T07:11:52.463 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-11-26T07:11:52.463 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-26T07:11:52.463 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-26T07:11:52.463 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-26T07:11:52.463 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-26T07:11:52.463 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-11-26T07:11:52.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:52.463 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2023-11-26T07:11:52.481 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:11:52.481 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:11:52.481 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:11:52.481 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:11:52.481 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2023-11-26T07:11:52.481 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:11:52.481 INFO:teuthology.orchestra.run.smithi002.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:11:52.481 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:11:52.481 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:11:52.481 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:11:52.482 INFO:teuthology.orchestra.run.smithi002.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-26T07:11:52.482 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:11:52.482 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-26T07:11:52.482 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 42311sec preferred_lft 42311sec 2023-11-26T07:11:52.482 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link 2023-11-26T07:11:52.482 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:11:52.482 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:11:52.482 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:11:52.482 INFO:teuthology.orchestra.run.smithi002.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-26T07:11:52.482 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0a:57:c2:51:2c:98 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:11:52.482 INFO:teuthology.orchestra.run.smithi002.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-26T07:11:52.482 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:11:52.483 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::60ae:c7ff:fe6a:97cb/64 scope link 2023-11-26T07:11:52.483 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:11:52.483 INFO:teuthology.orchestra.run.smithi002.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:11:52.483 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0a:57:c2:51:2c:98 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:11:52.483 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::857:c2ff:fe51:2c98/64 scope link tentative 2023-11-26T07:11:52.483 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:11:52.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:52.483 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-26T07:11:52.546 INFO:teuthology.orchestra.run.smithi002.stdout:1 2023-11-26T07:11:52.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:52.548 DEBUG:teuthology.orchestra.run.smithi002:> route 2023-11-26T07:11:52.607 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2023-11-26T07:11:52.607 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-26T07:11:52.607 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-26T07:11:52.607 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-26T07:11:52.607 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-26T07:11:52.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:52.608 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-11-26T07:11:52.609 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-11-26T07:11:52.609 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-26T07:11:52.609 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-26T07:11:52.609 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-26T07:11:52.609 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-11-26T07:11:52.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:52.715 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2023-11-26T07:11:52.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-26T07:11:52.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:52.732 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list-id 2023-11-26T07:11:52.789 INFO:teuthology.orchestra.run.smithi002.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-11-26T07:11:52.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:52.790 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-11-26T07:11:52.790 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-11-26T07:11:52.790 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-26T07:11:52.790 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-11-26T07:11:52.790 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-11-26T07:11:52.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:52.884 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-26T07:11:52.924 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:11:52.924 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:11:52.925 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:11:52.925 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:11:52.925 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2023-11-26T07:11:52.925 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:11:52.925 INFO:teuthology.orchestra.run.smithi002.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-26T07:11:52.925 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 56:e7:16:b6:9e:f9 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-26T07:11:52.925 INFO:teuthology.orchestra.run.smithi002.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-26T07:11:52.925 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:11:52.925 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::54e7:16ff:feb6:9ef9/64 scope link 2023-11-26T07:11:52.925 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:11:52.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:52.936 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-26T07:11:53.012 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:11:53.013 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:11:53.013 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:11:53.013 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:11:53.013 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2023-11-26T07:11:53.013 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:11:53.013 INFO:teuthology.orchestra.run.smithi002.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-26T07:11:53.013 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 56:e7:16:b6:9e:f9 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-26T07:11:53.013 INFO:teuthology.orchestra.run.smithi002.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-26T07:11:53.013 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:11:53.013 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::54e7:16ff:feb6:9ef9/64 scope link 2023-11-26T07:11:53.013 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:11:53.026 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-11-26T07:11:53.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:53.026 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-11-26T07:11:53.027 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-11-26T07:11:53.027 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-11-26T07:11:53.027 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-26T07:11:53.027 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-11-26T07:11:53.027 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-11-26T07:11:53.027 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-11-26T07:11:53.027 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-11-26T07:11:53.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:53.283 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-11-26T07:11:53.283 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-11-26T07:11:53.283 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.1 up 2023-11-26T07:11:53.284 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set dev brx.1 master ceph-brx 2023-11-26T07:11:53.284 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-11-26T07:11:53.402 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:11:53.402 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-11-26T07:11:53.423 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-11-26T07:11:53.423 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:11:53.423 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-11-26T07:11:53.479 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-26T07:11:53.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:53.479 DEBUG:teuthology.orchestra.run.smithi002:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-11-26T07:11:53.566 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-11-26T07:11:53.566 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-11-26T07:11:53.566 INFO:teuthology.orchestra.run.smithi002.stdout:invalid new device string format 2023-11-26T07:11:53.575 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-11-26T07:11:53.575 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-11-26T07:11:53.575 INFO:teuthology.orchestra.run.smithi002.stdout:invalid new device string format 2023-11-26T07:11:53.575 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-11-26T07:11:53.576 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:11:53.649 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-11-26T07:11:53.649 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-11-26T07:11:53.649 INFO:teuthology.orchestra.run.smithi002.stdout:invalid new device string format 2023-11-26T07:11:53.649 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-11-26T07:11:53.649 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:11:53.649 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: resolved to: "172.21.15.2:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-11-26T07:11:53.649 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.2:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-11-26T07:11:53.649 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=cb9817c7-f1ed-4745-9395-2760a3bb9712" will pass to kernel 2023-11-26T07:11:53.651 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-26T07:11:53.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:53.651 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-11-26T07:11:53.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:53.679 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-26T07:11:53.751 INFO:teuthology.orchestra.run.smithi002.stdout:client4642 2023-11-26T07:11:53.751 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:11:53.751 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:11:53.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:53.810 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-26T07:11:53.882 INFO:teuthology.orchestra.run.smithi002.stdout:client4642 2023-11-26T07:11:53.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:53.882 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-26T07:11:53.955 INFO:teuthology.orchestra.run.smithi002.stdout:client4642 2023-11-26T07:11:53.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:53.955 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/cb9817c7-f1ed-4745-9395-2760a3bb9712.client4642/status') 2023-11-26T07:11:54.036 INFO:teuthology.orchestra.run.smithi002.stdout:instance: client.4642 (3)172.21.15.2:0/1465905030 2023-11-26T07:11:54.037 INFO:teuthology.orchestra.run.smithi002.stdout:blocklisted: false 2023-11-26T07:11:54.037 INFO:teuthology.orchestra.run.smithi002.stderr:0+1 records in 2023-11-26T07:11:54.037 INFO:teuthology.orchestra.run.smithi002.stderr:0+1 records out 2023-11-26T07:11:54.037 INFO:teuthology.orchestra.run.smithi002.stderr:69 bytes copied, 2.4255e-05 s, 2.8 MB/s 2023-11-26T07:11:54.038 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-11-26T07:11:54.038 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-26T07:11:54.038 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-26T07:11:54.038 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-26T07:11:54.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.201+0000 7f0b1e20d700 1 Processor -- start 2023-11-26T07:11:54.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.201+0000 7f0b1e20d700 1 -- start start 2023-11-26T07:11:54.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.202+0000 7f0b1e20d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0b180b4150 0x7f0b1806de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:54.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.202+0000 7f0b1e20d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0b180b5ab0 0x7f0b1806e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:54.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.202+0000 7f0b1e20d700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b18071f50 con 0x7f0b1806b620 2023-11-26T07:11:54.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.202+0000 7f0b1e20d700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b18072230 con 0x7f0b180b5ab0 2023-11-26T07:11:54.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.202+0000 7f0b1e20d700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b18072510 con 0x7f0b180b4150 2023-11-26T07:11:54.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.202+0000 7f0b17fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0b180b5ab0 0x7f0b1806e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:54.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.203+0000 7f0b17fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0b180b5ab0 0x7f0b1806e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39622/0 (socket says 172.21.15.2:39622) 2023-11-26T07:11:54.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.203+0000 7f0b17fff700 1 -- 172.21.15.2:0/2224739264 learned_addr learned my addr 172.21.15.2:0/2224739264 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:54.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.203+0000 7f0b16ffd700 1 --2- 172.21.15.2:0/2224739264 >> v2:172.21.15.192:3300/0 conn(0x7f0b180b4150 0x7f0b1806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:54.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.203+0000 7f0b17fff700 1 -- 172.21.15.2:0/2224739264 >> v2:172.21.15.192:3300/0 conn(0x7f0b180b4150 msgr2=0x7f0b1806de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:54.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.203+0000 7f0b17fff700 1 --2- 172.21.15.2:0/2224739264 >> v2:172.21.15.192:3300/0 conn(0x7f0b180b4150 0x7f0b1806de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:54.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.203+0000 7f0b17fff700 1 -- 172.21.15.2:0/2224739264 >> v1:172.21.15.192:6789/0 conn(0x7f0b1806b620 legacy=0x7f0b180b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:54.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.203+0000 7f0b17fff700 1 -- 172.21.15.2:0/2224739264 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b180727f0 con 0x7f0b180b5ab0 2023-11-26T07:11:54.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.203+0000 7f0b17fff700 1 --2- 172.21.15.2:0/2224739264 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b180b5ab0 0x7f0b1806e390 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0b1806d6f0 tx=0x7f0b1000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dc8059d76b3a56a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:54.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.203+0000 7f0b167fc700 1 -- 172.21.15.2:0/2224739264 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1000e070 con 0x7f0b180b5ab0 2023-11-26T07:11:54.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.203+0000 7f0b167fc700 1 -- 172.21.15.2:0/2224739264 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b1000b910 con 0x7f0b180b5ab0 2023-11-26T07:11:54.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.203+0000 7f0b167fc700 1 -- 172.21.15.2:0/2224739264 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1000bcc0 con 0x7f0b180b5ab0 2023-11-26T07:11:54.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.204+0000 7f0b1e20d700 1 -- 172.21.15.2:0/2224739264 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b180b5ab0 msgr2=0x7f0b1806e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:54.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.204+0000 7f0b1e20d700 1 --2- 172.21.15.2:0/2224739264 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b180b5ab0 0x7f0b1806e390 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0b1806d6f0 tx=0x7f0b1000b330 comp rx=0 tx=0).stop 2023-11-26T07:11:54.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.204+0000 7f0b1e20d700 1 -- 172.21.15.2:0/2224739264 shutdown_connections 2023-11-26T07:11:54.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.204+0000 7f0b1e20d700 1 --2- 172.21.15.2:0/2224739264 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b180b5ab0 0x7f0b1806e390 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:54.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.204+0000 7f0b1e20d700 1 --2- 172.21.15.2:0/2224739264 >> v2:172.21.15.192:3300/0 conn(0x7f0b180b4150 0x7f0b1806de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:54.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.204+0000 7f0b1e20d700 1 -- 172.21.15.2:0/2224739264 >> 172.21.15.2:0/2224739264 conn(0x7f0b180b2740 msgr2=0x7f0b180b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:54.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.204+0000 7f0b1e20d700 1 -- 172.21.15.2:0/2224739264 shutdown_connections 2023-11-26T07:11:54.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.204+0000 7f0b1e20d700 1 -- 172.21.15.2:0/2224739264 wait complete. 2023-11-26T07:11:54.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.205+0000 7f0b1e20d700 1 Processor -- start 2023-11-26T07:11:54.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.206+0000 7f0b1e20d700 1 -- start start 2023-11-26T07:11:54.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.206+0000 7f0b1e20d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b1806b620 0x7f0b180c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:54.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.206+0000 7f0b1e20d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b180b4150 0x7f0b180c7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:54.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.206+0000 7f0b1e20d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b180b5ab0 0x7f0b180c9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:54.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.206+0000 7f0b1e20d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b180cfaf0 con 0x7f0b180b4150 2023-11-26T07:11:54.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.206+0000 7f0b1e20d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b180c79a0 con 0x7f0b180b5ab0 2023-11-26T07:11:54.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.206+0000 7f0b1e20d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b180c83f0 con 0x7f0b1806b620 2023-11-26T07:11:54.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.206+0000 7f0b16ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b180b4150 0x7f0b180c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:54.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.206+0000 7f0b16ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b180b4150 0x7f0b180c7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39630/0 (socket says 172.21.15.2:39630) 2023-11-26T07:11:54.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.207+0000 7f0b16ffd700 1 -- 172.21.15.2:0/1757947017 learned_addr learned my addr 172.21.15.2:0/1757947017 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:54.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.207+0000 7f0b17fff700 1 --2- 172.21.15.2:0/1757947017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b180b5ab0 0x7f0b180c9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:54.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.207+0000 7f0b177fe700 1 --2- 172.21.15.2:0/1757947017 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b1806b620 0x7f0b180c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:54.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.207+0000 7f0b16ffd700 1 -- 172.21.15.2:0/1757947017 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b1806b620 msgr2=0x7f0b180c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:54.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.207+0000 7f0b16ffd700 1 --2- 172.21.15.2:0/1757947017 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b1806b620 0x7f0b180c7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:54.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.207+0000 7f0b16ffd700 1 -- 172.21.15.2:0/1757947017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b180b5ab0 msgr2=0x7f0b180c9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:54.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.207+0000 7f0b16ffd700 1 --2- 172.21.15.2:0/1757947017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b180b5ab0 0x7f0b180c9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:54.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.207+0000 7f0b16ffd700 1 -- 172.21.15.2:0/1757947017 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b10009b30 con 0x7f0b180b4150 2023-11-26T07:11:54.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.207+0000 7f0b17fff700 1 --2- 172.21.15.2:0/1757947017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b180b5ab0 0x7f0b180c9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:11:54.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.207+0000 7f0b177fe700 1 --2- 172.21.15.2:0/1757947017 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b1806b620 0x7f0b180c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:11:54.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.207+0000 7f0b16ffd700 1 --2- 172.21.15.2:0/1757947017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b180b4150 0x7f0b180c7460 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c00e9b0 tx=0x7f0b0c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:54.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.207+0000 7f0afffff700 1 -- 172.21.15.2:0/1757947017 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c009710 con 0x7f0b180b4150 2023-11-26T07:11:54.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.207+0000 7f0afffff700 1 -- 172.21.15.2:0/1757947017 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0c00c850 con 0x7f0b180b4150 2023-11-26T07:11:54.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.207+0000 7f0afffff700 1 -- 172.21.15.2:0/1757947017 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c00cbc0 con 0x7f0b180b4150 2023-11-26T07:11:54.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.207+0000 7f0b1e20d700 1 -- 172.21.15.2:0/1757947017 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b180c86d0 con 0x7f0b180b4150 2023-11-26T07:11:54.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.207+0000 7f0b1e20d700 1 -- 172.21.15.2:0/1757947017 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b180c8c90 con 0x7f0b180b4150 2023-11-26T07:11:54.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.208+0000 7f0b1e20d700 1 -- 172.21.15.2:0/1757947017 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b18068670 con 0x7f0b180b4150 2023-11-26T07:11:54.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.209+0000 7f0afffff700 1 -- 172.21.15.2:0/1757947017 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0b0c00cd20 con 0x7f0b180b4150 2023-11-26T07:11:54.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.209+0000 7f0afffff700 1 --2- 172.21.15.2:0/1757947017 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0b0406aed0 0x7f0b0406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:54.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.209+0000 7f0afffff700 1 -- 172.21.15.2:0/1757947017 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0b0c0896c0 con 0x7f0b180b4150 2023-11-26T07:11:54.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.210+0000 7f0b177fe700 1 --2- 172.21.15.2:0/1757947017 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0b0406aed0 0x7f0b0406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:54.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.210+0000 7f0b177fe700 1 --2- 172.21.15.2:0/1757947017 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0b0406aed0 0x7f0b0406d390 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0b08000f60 tx=0x7f0b08009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:54.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.214+0000 7f0afffff700 1 -- 172.21.15.2:0/1757947017 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0b0c054780 con 0x7f0b180b4150 2023-11-26T07:11:54.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.463+0000 7f0b1e20d700 1 -- 172.21.15.2:0/1757947017 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0b1806bd40 con 0x7f0b180b4150 2023-11-26T07:11:54.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.463+0000 7f0afffff700 1 -- 172.21.15.2:0/1757947017 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0b0c057da0 con 0x7f0b180b4150 2023-11-26T07:11:54.465 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-26T07:11:54.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.465+0000 7f0b1e20d700 1 -- 172.21.15.2:0/1757947017 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0b0406aed0 msgr2=0x7f0b0406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:54.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.465+0000 7f0b1e20d700 1 --2- 172.21.15.2:0/1757947017 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0b0406aed0 0x7f0b0406d390 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0b08000f60 tx=0x7f0b08009040 comp rx=0 tx=0).stop 2023-11-26T07:11:54.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.465+0000 7f0b1e20d700 1 -- 172.21.15.2:0/1757947017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b180b4150 msgr2=0x7f0b180c7460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:54.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.465+0000 7f0b1e20d700 1 --2- 172.21.15.2:0/1757947017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b180b4150 0x7f0b180c7460 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c00e9b0 tx=0x7f0b0c00ed70 comp rx=0 tx=0).stop 2023-11-26T07:11:54.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.465+0000 7f0b1e20d700 1 -- 172.21.15.2:0/1757947017 shutdown_connections 2023-11-26T07:11:54.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.465+0000 7f0b1e20d700 1 --2- 172.21.15.2:0/1757947017 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0b0406aed0 0x7f0b0406d390 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:54.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.465+0000 7f0b1e20d700 1 --2- 172.21.15.2:0/1757947017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b180b5ab0 0x7f0b180c9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:54.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.465+0000 7f0b1e20d700 1 --2- 172.21.15.2:0/1757947017 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b1806b620 0x7f0b180c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:54.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.465+0000 7f0b1e20d700 1 --2- 172.21.15.2:0/1757947017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b180b4150 0x7f0b180c7460 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:54.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.465+0000 7f0b1e20d700 1 -- 172.21.15.2:0/1757947017 >> 172.21.15.2:0/1757947017 conn(0x7f0b180b2740 msgr2=0x7f0b1806f030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:54.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.465+0000 7f0b1e20d700 1 -- 172.21.15.2:0/1757947017 shutdown_connections 2023-11-26T07:11:54.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:54.465+0000 7f0b1e20d700 1 -- 172.21.15.2:0/1757947017 wait complete. 2023-11-26T07:11:54.480 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-26T07:11:54.480 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-26T07:11:54.481 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2023-11-26T07:11:54.481 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-26T07:11:54.481 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-26T07:11:54.481 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-26T07:11:54.481 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-26T07:11:54.481 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-26T07:11:54.481 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-26T07:11:54.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:54.482 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2023-11-26T07:11:54.503 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:11:54.503 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:11:54.503 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:11:54.503 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:11:54.503 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2023-11-26T07:11:54.503 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:11:54.503 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:11:54.503 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2023-11-26T07:11:54.503 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:11:54.504 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2023-11-26T07:11:54.504 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:11:54.504 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:11:54.504 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-26T07:11:54.504 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:11:54.504 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-26T07:11:54.504 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42387sec preferred_lft 42387sec 2023-11-26T07:11:54.504 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::4774:e26a:42bc:5f29/64 scope link noprefixroute 2023-11-26T07:11:54.504 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:11:54.504 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-26T07:11:54.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:54.505 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-11-26T07:11:54.505 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-11-26T07:11:54.505 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link add name ceph-brx type bridge 2023-11-26T07:11:54.505 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip addr flush dev ceph-brx 2023-11-26T07:11:54.505 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set ceph-brx up 2023-11-26T07:11:54.505 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-26T07:11:54.505 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-11-26T07:11:54.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:54.692 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-26T07:11:54.722 INFO:teuthology.orchestra.run.smithi192.stdout:1 2023-11-26T07:11:54.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:54.723 DEBUG:teuthology.orchestra.run.smithi192:> route 2023-11-26T07:11:54.797 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2023-11-26T07:11:54.798 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-26T07:11:54.798 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-26T07:11:54.798 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-26T07:11:54.798 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-26T07:11:54.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:54.799 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-11-26T07:11:54.799 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-11-26T07:11:54.799 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-26T07:11:54.799 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-26T07:11:54.799 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-26T07:11:54.800 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-11-26T07:11:55.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:55.087 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2023-11-26T07:11:55.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:55.104 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list-id 2023-11-26T07:11:55.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:55.161 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-11-26T07:11:55.161 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-11-26T07:11:55.161 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:11:55.161 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-26T07:11:55.161 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-11-26T07:11:55.254 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-26T07:11:55.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:55.254 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-11-26T07:11:55.254 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-11-26T07:11:55.255 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-26T07:11:55.255 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-26T07:11:55.255 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-26T07:11:55.255 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-26T07:11:55.255 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-26T07:11:55.255 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-11-26T07:11:55.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:55.478 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-11-26T07:11:55.478 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-11-26T07:11:55.479 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2023-11-26T07:11:55.479 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set dev brx.0 master ceph-brx 2023-11-26T07:11:55.479 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-11-26T07:11:55.587 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:11:55.587 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-26T07:11:55.607 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-26T07:11:55.608 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:11:55.608 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-26T07:11:55.663 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-26T07:11:55.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:55.664 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-26T07:11:55.754 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-26T07:11:55.754 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-26T07:11:55.754 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2023-11-26T07:11:55.894 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-26T07:11:55.894 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-26T07:11:55.894 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2023-11-26T07:11:55.894 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-11-26T07:11:55.894 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:11:55.924 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-26T07:11:55.924 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-26T07:11:55.925 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2023-11-26T07:11:55.925 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-11-26T07:11:55.925 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:11:55.925 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.2:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-11-26T07:11:55.925 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.2:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-11-26T07:11:55.925 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=cb9817c7-f1ed-4745-9395-2760a3bb9712" will pass to kernel 2023-11-26T07:11:55.928 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-26T07:11:55.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:55.928 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-26T07:11:55.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:55.956 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-26T07:11:56.030 INFO:teuthology.orchestra.run.smithi192.stdout:client4505 2023-11-26T07:11:56.030 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:11:56.030 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:11:56.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:56.087 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-26T07:11:56.159 INFO:teuthology.orchestra.run.smithi192.stdout:client4505 2023-11-26T07:11:56.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:56.159 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-26T07:11:56.230 INFO:teuthology.orchestra.run.smithi192.stdout:client4505 2023-11-26T07:11:56.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:56.233 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/cb9817c7-f1ed-4745-9395-2760a3bb9712.client4505/status') 2023-11-26T07:11:56.312 INFO:teuthology.orchestra.run.smithi192.stdout:instance: client.4505 (3)192.168.0.1:0/3113476571 2023-11-26T07:11:56.312 INFO:teuthology.orchestra.run.smithi192.stdout:blocklisted: false 2023-11-26T07:11:56.312 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records in 2023-11-26T07:11:56.312 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records out 2023-11-26T07:11:56.312 INFO:teuthology.orchestra.run.smithi192.stderr:69 bytes copied, 3.6151e-05 s, 1.9 MB/s 2023-11-26T07:11:56.313 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-11-26T07:11:56.313 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-26T07:11:56.313 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-26T07:11:56.313 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-26T07:11:56.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.453+0000 7f5c5c9bb700 1 Processor -- start 2023-11-26T07:11:56.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.453+0000 7f5c5c9bb700 1 -- start start 2023-11-26T07:11:56.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.454+0000 7f5c5c9bb700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5c58070a80 0x7f5c5815b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:56.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.454+0000 7f5c5c9bb700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5c580c9fd0 0x7f5c580ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:56.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.454+0000 7f5c5c9bb700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c58072d20 con 0x7f5c580cf1e0 2023-11-26T07:11:56.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.454+0000 7f5c5c9bb700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c5815ba10 con 0x7f5c58070a80 2023-11-26T07:11:56.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.454+0000 7f5c5c9bb700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c5806d1f0 con 0x7f5c580c9fd0 2023-11-26T07:11:56.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.454+0000 7f5c55d9b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5c58070a80 0x7f5c5815b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:56.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.454+0000 7f5c5659c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f5c580cf1e0 0x7f5c5806cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59078/0 (socket says 172.21.15.2:59078) 2023-11-26T07:11:56.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.454+0000 7f5c5659c700 1 -- 172.21.15.2:0/1651870247 learned_addr learned my addr 172.21.15.2:0/1651870247 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:11:56.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.454+0000 7f5c56d9d700 1 --2- 172.21.15.2:0/1651870247 >> v2:172.21.15.192:3300/0 conn(0x7f5c580c9fd0 0x7f5c580ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:56.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.454+0000 7f5c55d9b700 1 -- 172.21.15.2:0/1651870247 >> v2:172.21.15.192:3300/0 conn(0x7f5c580c9fd0 msgr2=0x7f5c580ca3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:56.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.454+0000 7f5c55d9b700 1 --2- 172.21.15.2:0/1651870247 >> v2:172.21.15.192:3300/0 conn(0x7f5c580c9fd0 0x7f5c580ca3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:56.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.454+0000 7f5c55d9b700 1 -- 172.21.15.2:0/1651870247 >> v1:172.21.15.2:6789/0 conn(0x7f5c580cf1e0 legacy=0x7f5c5806cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:56.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.454+0000 7f5c5559a700 1 -- 172.21.15.2:0/1651870247 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 418247540 0 0) 0x7f5c58072d20 con 0x7f5c580cf1e0 2023-11-26T07:11:56.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.454+0000 7f5c55d9b700 1 -- 172.21.15.2:0/1651870247 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c580ca910 con 0x7f5c58070a80 2023-11-26T07:11:56.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.455+0000 7f5c55d9b700 1 --2- 172.21.15.2:0/1651870247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c58070a80 0x7f5c5815b4d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5c580cd4a0 tx=0x7f5c48009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e12e0297a2abb0e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:56.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.455+0000 7f5c5559a700 1 -- 172.21.15.2:0/1651870247 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c48011830 con 0x7f5c58070a80 2023-11-26T07:11:56.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.455+0000 7f5c5559a700 1 -- 172.21.15.2:0/1651870247 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c48011990 con 0x7f5c58070a80 2023-11-26T07:11:56.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.455+0000 7f5c5559a700 1 -- 172.21.15.2:0/1651870247 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c48011d20 con 0x7f5c58070a80 2023-11-26T07:11:56.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.455+0000 7f5c5c9bb700 1 -- 172.21.15.2:0/1651870247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c58070a80 msgr2=0x7f5c5815b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:56.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.455+0000 7f5c5c9bb700 1 --2- 172.21.15.2:0/1651870247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c58070a80 0x7f5c5815b4d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5c580cd4a0 tx=0x7f5c48009b20 comp rx=0 tx=0).stop 2023-11-26T07:11:56.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.455+0000 7f5c5c9bb700 1 -- 172.21.15.2:0/1651870247 shutdown_connections 2023-11-26T07:11:56.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.455+0000 7f5c5c9bb700 1 --2- 172.21.15.2:0/1651870247 >> v2:172.21.15.192:3300/0 conn(0x7f5c580c9fd0 0x7f5c580ca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:56.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.455+0000 7f5c5c9bb700 1 --2- 172.21.15.2:0/1651870247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c58070a80 0x7f5c5815b4d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:56.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.455+0000 7f5c5c9bb700 1 -- 172.21.15.2:0/1651870247 >> 172.21.15.2:0/1651870247 conn(0x7f5c580cf980 msgr2=0x7f5c580cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:56.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.456+0000 7f5c5c9bb700 1 -- 172.21.15.2:0/1651870247 shutdown_connections 2023-11-26T07:11:56.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.456+0000 7f5c5c9bb700 1 -- 172.21.15.2:0/1651870247 wait complete. 2023-11-26T07:11:56.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.457+0000 7f5c5c9bb700 1 Processor -- start 2023-11-26T07:11:56.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.457+0000 7f5c5c9bb700 1 -- start start 2023-11-26T07:11:56.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.458+0000 7f5c5c9bb700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c58070a80 0x7f5c58159490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:56.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.458+0000 7f5c5c9bb700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5c580c9fd0 0x7f5c581440a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:56.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.458+0000 7f5c5c9bb700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c580cf1e0 0x7f5c581f75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:56.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.458+0000 7f5c5c9bb700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5814efb0 con 0x7f5c580cf1e0 2023-11-26T07:11:56.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.458+0000 7f5c5c9bb700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c58159a70 con 0x7f5c58070a80 2023-11-26T07:11:56.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.458+0000 7f5c5c9bb700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5814d420 con 0x7f5c580c9fd0 2023-11-26T07:11:56.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.458+0000 7f5c56d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c580cf1e0 0x7f5c581f75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:56.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.458+0000 7f5c56d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c580cf1e0 0x7f5c581f75f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39646/0 (socket says 172.21.15.2:39646) 2023-11-26T07:11:56.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.458+0000 7f5c56d9d700 1 -- 172.21.15.2:0/1498113536 learned_addr learned my addr 172.21.15.2:0/1498113536 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:56.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.458+0000 7f5c5659c700 1 --2- 172.21.15.2:0/1498113536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c58070a80 0x7f5c58159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:56.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.458+0000 7f5c55d9b700 1 --2- 172.21.15.2:0/1498113536 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5c580c9fd0 0x7f5c581440a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:56.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.458+0000 7f5c56d9d700 1 -- 172.21.15.2:0/1498113536 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5c580c9fd0 msgr2=0x7f5c581440a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:56.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.458+0000 7f5c56d9d700 1 --2- 172.21.15.2:0/1498113536 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5c580c9fd0 0x7f5c581440a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:56.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.458+0000 7f5c56d9d700 1 -- 172.21.15.2:0/1498113536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c58070a80 msgr2=0x7f5c58159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:56.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.458+0000 7f5c56d9d700 1 --2- 172.21.15.2:0/1498113536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c58070a80 0x7f5c58159490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:56.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.458+0000 7f5c56d9d700 1 -- 172.21.15.2:0/1498113536 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c480094a0 con 0x7f5c580cf1e0 2023-11-26T07:11:56.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.458+0000 7f5c56d9d700 1 --2- 172.21.15.2:0/1498113536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c580cf1e0 0x7f5c581f75f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5c50007d90 tx=0x7f5c5000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:56.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.458+0000 7f5c46ffd700 1 -- 172.21.15.2:0/1498113536 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5000ed30 con 0x7f5c580cf1e0 2023-11-26T07:11:56.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.459+0000 7f5c46ffd700 1 -- 172.21.15.2:0/1498113536 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c50014420 con 0x7f5c580cf1e0 2023-11-26T07:11:56.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.459+0000 7f5c5c9bb700 1 -- 172.21.15.2:0/1498113536 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c5814d700 con 0x7f5c580cf1e0 2023-11-26T07:11:56.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.459+0000 7f5c46ffd700 1 -- 172.21.15.2:0/1498113536 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c500147d0 con 0x7f5c580cf1e0 2023-11-26T07:11:56.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.459+0000 7f5c5c9bb700 1 -- 172.21.15.2:0/1498113536 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c581f7b30 con 0x7f5c580cf1e0 2023-11-26T07:11:56.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.460+0000 7f5c5c9bb700 1 -- 172.21.15.2:0/1498113536 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c581f7cc0 con 0x7f5c580cf1e0 2023-11-26T07:11:56.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.460+0000 7f5c46ffd700 1 -- 172.21.15.2:0/1498113536 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5c50014930 con 0x7f5c580cf1e0 2023-11-26T07:11:56.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.461+0000 7f5c46ffd700 1 --2- 172.21.15.2:0/1498113536 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5c3806aed0 0x7f5c3806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:56.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.461+0000 7f5c46ffd700 1 -- 172.21.15.2:0/1498113536 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5c50089b70 con 0x7f5c580cf1e0 2023-11-26T07:11:56.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.461+0000 7f5c5659c700 1 --2- 172.21.15.2:0/1498113536 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5c3806aed0 0x7f5c3806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:56.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.461+0000 7f5c5659c700 1 --2- 172.21.15.2:0/1498113536 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5c3806aed0 0x7f5c3806d390 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c000f60 tx=0x7f5c4c007e70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:56.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.465+0000 7f5c46ffd700 1 -- 172.21.15.2:0/1498113536 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5c50054cb0 con 0x7f5c580cf1e0 2023-11-26T07:11:56.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.714+0000 7f5c5c9bb700 1 -- 172.21.15.2:0/1498113536 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5c5814f0f0 con 0x7f5c580cf1e0 2023-11-26T07:11:56.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.714+0000 7f5c46ffd700 1 -- 172.21.15.2:0/1498113536 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5c500582d0 con 0x7f5c580cf1e0 2023-11-26T07:11:56.716 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-26T07:11:56.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.716+0000 7f5c5c9bb700 1 -- 172.21.15.2:0/1498113536 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5c3806aed0 msgr2=0x7f5c3806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:56.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.716+0000 7f5c5c9bb700 1 --2- 172.21.15.2:0/1498113536 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5c3806aed0 0x7f5c3806d390 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c000f60 tx=0x7f5c4c007e70 comp rx=0 tx=0).stop 2023-11-26T07:11:56.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.716+0000 7f5c5c9bb700 1 -- 172.21.15.2:0/1498113536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c580cf1e0 msgr2=0x7f5c581f75f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:56.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.716+0000 7f5c5c9bb700 1 --2- 172.21.15.2:0/1498113536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c580cf1e0 0x7f5c581f75f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5c50007d90 tx=0x7f5c5000e3c0 comp rx=0 tx=0).stop 2023-11-26T07:11:56.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.716+0000 7f5c5c9bb700 1 -- 172.21.15.2:0/1498113536 shutdown_connections 2023-11-26T07:11:56.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.716+0000 7f5c5c9bb700 1 --2- 172.21.15.2:0/1498113536 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5c3806aed0 0x7f5c3806d390 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:56.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.716+0000 7f5c5c9bb700 1 --2- 172.21.15.2:0/1498113536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c580cf1e0 0x7f5c581f75f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:56.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.716+0000 7f5c5c9bb700 1 --2- 172.21.15.2:0/1498113536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c58070a80 0x7f5c58159490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:56.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.716+0000 7f5c5c9bb700 1 --2- 172.21.15.2:0/1498113536 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5c580c9fd0 0x7f5c581440a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:56.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.716+0000 7f5c5c9bb700 1 -- 172.21.15.2:0/1498113536 >> 172.21.15.2:0/1498113536 conn(0x7f5c580cf980 msgr2=0x7f5c5815c230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:56.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.716+0000 7f5c5c9bb700 1 -- 172.21.15.2:0/1498113536 shutdown_connections 2023-11-26T07:11:56.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:56.716+0000 7f5c5c9bb700 1 -- 172.21.15.2:0/1498113536 wait complete. 2023-11-26T07:11:56.730 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-26T07:11:56.730 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-26T07:11:56.730 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2023-11-26T07:11:56.731 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-11-26T07:11:56.731 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-26T07:11:56.731 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-26T07:11:56.731 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-26T07:11:56.731 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-26T07:11:56.731 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-11-26T07:11:56.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:56.731 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2023-11-26T07:11:56.748 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:11:56.748 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:11:56.748 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:11:56.749 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:11:56.749 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2023-11-26T07:11:56.749 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:11:56.749 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:11:56.749 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2023-11-26T07:11:56.749 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:11:56.749 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2023-11-26T07:11:56.749 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:11:56.749 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:11:56.749 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-26T07:11:56.749 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:11:56.749 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-26T07:11:56.749 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42384sec preferred_lft 42384sec 2023-11-26T07:11:56.750 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::4774:e26a:42bc:5f29/64 scope link noprefixroute 2023-11-26T07:11:56.750 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:11:56.750 INFO:teuthology.orchestra.run.smithi192.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-26T07:11:56.750 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether a2:92:2e:43:f5:72 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:11:56.750 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-26T07:11:56.750 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:11:56.750 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::548b:6dff:fe7a:f7ca/64 scope link 2023-11-26T07:11:56.750 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:11:56.750 INFO:teuthology.orchestra.run.smithi192.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:11:56.750 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether a2:92:2e:43:f5:72 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:11:56.750 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::a092:2eff:fe43:f572/64 scope link tentative 2023-11-26T07:11:56.750 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:11:56.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:56.751 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-26T07:11:56.813 INFO:teuthology.orchestra.run.smithi192.stdout:1 2023-11-26T07:11:56.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:56.815 DEBUG:teuthology.orchestra.run.smithi192:> route 2023-11-26T07:11:56.874 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2023-11-26T07:11:56.874 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-26T07:11:56.874 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-26T07:11:56.874 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-26T07:11:56.874 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-26T07:11:56.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:56.875 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-11-26T07:11:56.875 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-11-26T07:11:56.875 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-26T07:11:56.875 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-26T07:11:56.875 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-26T07:11:56.875 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-11-26T07:11:56.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:56.979 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2023-11-26T07:11:56.995 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-26T07:11:56.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:56.996 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list-id 2023-11-26T07:11:57.052 INFO:teuthology.orchestra.run.smithi192.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-11-26T07:11:57.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:57.052 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-11-26T07:11:57.052 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-11-26T07:11:57.052 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-26T07:11:57.053 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-11-26T07:11:57.053 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-11-26T07:11:57.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:57.146 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-26T07:11:57.187 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:11:57.187 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:11:57.187 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:11:57.187 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:11:57.187 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2023-11-26T07:11:57.188 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:11:57.188 INFO:teuthology.orchestra.run.smithi192.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-26T07:11:57.188 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether da:c2:ba:43:ff:33 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-26T07:11:57.188 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-26T07:11:57.188 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:11:57.188 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::d8c2:baff:fe43:ff33/64 scope link tentative 2023-11-26T07:11:57.188 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:11:57.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:57.201 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-26T07:11:57.276 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:11:57.277 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:11:57.277 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:11:57.277 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:11:57.277 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2023-11-26T07:11:57.278 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:11:57.278 INFO:teuthology.orchestra.run.smithi192.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-26T07:11:57.278 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether da:c2:ba:43:ff:33 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-26T07:11:57.278 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-26T07:11:57.278 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:11:57.278 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::d8c2:baff:fe43:ff33/64 scope link tentative 2023-11-26T07:11:57.279 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:11:57.290 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-11-26T07:11:57.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:57.290 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-11-26T07:11:57.290 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-11-26T07:11:57.290 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-11-26T07:11:57.291 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-26T07:11:57.291 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-11-26T07:11:57.291 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-11-26T07:11:57.291 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-11-26T07:11:57.291 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-11-26T07:11:57.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:57.517 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-11-26T07:11:57.518 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-11-26T07:11:57.518 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.1 up 2023-11-26T07:11:57.518 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set dev brx.1 master ceph-brx 2023-11-26T07:11:57.518 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-11-26T07:11:57.626 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:11:57.626 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-11-26T07:11:57.647 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-11-26T07:11:57.647 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:11:57.647 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-11-26T07:11:57.703 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-26T07:11:57.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:57.703 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-11-26T07:11:57.789 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-11-26T07:11:57.789 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-11-26T07:11:57.789 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2023-11-26T07:11:57.797 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-11-26T07:11:57.798 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-11-26T07:11:57.798 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2023-11-26T07:11:57.798 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-11-26T07:11:57.798 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:11:57.873 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-11-26T07:11:57.874 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-11-26T07:11:57.874 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2023-11-26T07:11:57.874 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-11-26T07:11:57.874 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:11:57.874 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.2:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-11-26T07:11:57.874 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.2:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-11-26T07:11:57.874 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=cb9817c7-f1ed-4745-9395-2760a3bb9712" will pass to kernel 2023-11-26T07:11:57.875 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-26T07:11:57.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:57.875 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-11-26T07:11:57.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:57.901 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-26T07:11:57.973 INFO:teuthology.orchestra.run.smithi192.stdout:client4656 2023-11-26T07:11:57.974 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:11:57.974 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:11:58.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:58.031 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-26T07:11:58.103 INFO:teuthology.orchestra.run.smithi192.stdout:client4656 2023-11-26T07:11:58.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:58.103 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-26T07:11:58.176 INFO:teuthology.orchestra.run.smithi192.stdout:client4656 2023-11-26T07:11:58.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:11:58.176 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/cb9817c7-f1ed-4745-9395-2760a3bb9712.client4656/status') 2023-11-26T07:11:58.256 INFO:teuthology.orchestra.run.smithi192.stdout:instance: client.4656 (3)172.21.15.192:0/2560513279 2023-11-26T07:11:58.256 INFO:teuthology.orchestra.run.smithi192.stdout:blocklisted: false 2023-11-26T07:11:58.256 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records in 2023-11-26T07:11:58.256 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records out 2023-11-26T07:11:58.257 INFO:teuthology.orchestra.run.smithi192.stderr:71 bytes copied, 2.3199e-05 s, 3.1 MB/s 2023-11-26T07:11:58.257 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-26T07:11:58.272 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:11:58.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.408+0000 7efde2bcd700 1 Processor -- start 2023-11-26T07:11:58.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.408+0000 7efde2bcd700 1 -- start start 2023-11-26T07:11:58.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.409+0000 7efde2bcd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7efddc142810 0x7efddc06afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:58.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.409+0000 7efde2bcd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efddc1459a0 0x7efddc06b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:58.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.409+0000 7efde2bcd700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efddc0cf5f0 con 0x7efddc06e580 2023-11-26T07:11:58.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.409+0000 7efde2bcd700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efddc06ea80 con 0x7efddc142810 2023-11-26T07:11:58.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.409+0000 7efde2bcd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efddc06ed60 con 0x7efddc1459a0 2023-11-26T07:11:58.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.409+0000 7efde116a700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7efddc06e580 0x7efddc071bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59102/0 (socket says 172.21.15.2:59102) 2023-11-26T07:11:58.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.409+0000 7efde116a700 1 -- 172.21.15.2:0/3085745736 learned_addr learned my addr 172.21.15.2:0/3085745736 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:11:58.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.409+0000 7efde0969700 1 --2- 172.21.15.2:0/3085745736 >> v2:172.21.15.192:3300/0 conn(0x7efddc142810 0x7efddc06afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:58.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.409+0000 7efddbfff700 1 --2- 172.21.15.2:0/3085745736 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efddc1459a0 0x7efddc06b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:58.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.409+0000 7efddb7fe700 1 -- 172.21.15.2:0/3085745736 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4196267033 0 0) 0x7efddc0cf5f0 con 0x7efddc06e580 2023-11-26T07:11:58.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.409+0000 7efddb7fe700 1 -- 172.21.15.2:0/3085745736 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdcc0035b0 con 0x7efddc06e580 2023-11-26T07:11:58.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.410+0000 7efddb7fe700 1 -- 172.21.15.2:0/3085745736 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1527632702 0 0) 0x7efdcc0035b0 con 0x7efddc06e580 2023-11-26T07:11:58.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.410+0000 7efddb7fe700 1 -- 172.21.15.2:0/3085745736 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efddc1459a0 msgr2=0x7efddc06b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:58.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.410+0000 7efddb7fe700 1 --2- 172.21.15.2:0/3085745736 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efddc1459a0 0x7efddc06b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:58.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.410+0000 7efddb7fe700 1 -- 172.21.15.2:0/3085745736 >> v2:172.21.15.192:3300/0 conn(0x7efddc142810 msgr2=0x7efddc06afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:58.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.410+0000 7efddb7fe700 1 --2- 172.21.15.2:0/3085745736 >> v2:172.21.15.192:3300/0 conn(0x7efddc142810 0x7efddc06afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:58.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.410+0000 7efddb7fe700 1 -- 172.21.15.2:0/3085745736 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efddc06f040 con 0x7efddc06e580 2023-11-26T07:11:58.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.410+0000 7efddb7fe700 1 -- 172.21.15.2:0/3085745736 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7efdd40019f0 con 0x7efddc06e580 2023-11-26T07:11:58.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.410+0000 7efddb7fe700 1 -- 172.21.15.2:0/3085745736 >> v1:172.21.15.2:6789/0 conn(0x7efddc06e580 legacy=0x7efddc071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:58.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.410+0000 7efddb7fe700 1 --2- 172.21.15.2:0/3085745736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdcc003a00 0x7efdcc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:58.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.410+0000 7efddb7fe700 1 --2- 172.21.15.2:0/3085745736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efdcc004850 0x7efdcc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:58.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.410+0000 7efddb7fe700 1 --2- 172.21.15.2:0/3085745736 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efddc1459a0 0x7efdcc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:58.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.410+0000 7efddb7fe700 1 -- 172.21.15.2:0/3085745736 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efddc06ea80 con 0x7efdcc003a00 2023-11-26T07:11:58.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.410+0000 7efddb7fe700 1 -- 172.21.15.2:0/3085745736 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efddc06ed60 con 0x7efdcc004850 2023-11-26T07:11:58.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.410+0000 7efddb7fe700 1 -- 172.21.15.2:0/3085745736 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdcc00ba10 con 0x7efddc1459a0 2023-11-26T07:11:58.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.410+0000 7efde0969700 1 --2- 172.21.15.2:0/3085745736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdcc003a00 0x7efdcc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:58.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.410+0000 7efde116a700 1 --2- 172.21.15.2:0/3085745736 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efddc1459a0 0x7efdcc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:58.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.410+0000 7efddbfff700 1 --2- 172.21.15.2:0/3085745736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efdcc004850 0x7efdcc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:58.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.410+0000 7efde0969700 1 -- 172.21.15.2:0/3085745736 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efddc1459a0 msgr2=0x7efdcc005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:58.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.410+0000 7efde0969700 1 --2- 172.21.15.2:0/3085745736 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efddc1459a0 0x7efdcc005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:58.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.410+0000 7efde0969700 1 -- 172.21.15.2:0/3085745736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efdcc004850 msgr2=0x7efdcc004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:58.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.410+0000 7efde0969700 1 --2- 172.21.15.2:0/3085745736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efdcc004850 0x7efdcc004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:58.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.410+0000 7efde0969700 1 -- 172.21.15.2:0/3085745736 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdcc0035b0 con 0x7efdcc003a00 2023-11-26T07:11:58.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.410+0000 7efde0969700 1 --2- 172.21.15.2:0/3085745736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdcc003a00 0x7efdcc003e20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efdd0009b90 tx=0x7efdcc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99615a8d277cfe47 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:58.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.411+0000 7efddb7fe700 1 -- 172.21.15.2:0/3085745736 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd000e6c0 con 0x7efdcc003a00 2023-11-26T07:11:58.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.411+0000 7efddb7fe700 1 -- 172.21.15.2:0/3085745736 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd000e820 con 0x7efdcc003a00 2023-11-26T07:11:58.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.411+0000 7efddb7fe700 1 -- 172.21.15.2:0/3085745736 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd000eb90 con 0x7efdcc003a00 2023-11-26T07:11:58.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.411+0000 7efde2bcd700 1 -- 172.21.15.2:0/3085745736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdcc003a00 msgr2=0x7efdcc003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:58.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.411+0000 7efde2bcd700 1 --2- 172.21.15.2:0/3085745736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdcc003a00 0x7efdcc003e20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efdd0009b90 tx=0x7efdcc005880 comp rx=0 tx=0).stop 2023-11-26T07:11:58.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.411+0000 7efde116a700 1 -- 172.21.15.2:0/3085745736 reap_dead start 2023-11-26T07:11:58.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.411+0000 7efde2bcd700 1 -- 172.21.15.2:0/3085745736 shutdown_connections 2023-11-26T07:11:58.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.411+0000 7efde2bcd700 1 -- 172.21.15.2:0/3085745736 >> 172.21.15.2:0/3085745736 conn(0x7efddc0b2740 msgr2=0x7efddc0b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:58.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.411+0000 7efde2bcd700 1 -- 172.21.15.2:0/3085745736 shutdown_connections 2023-11-26T07:11:58.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.411+0000 7efde2bcd700 1 -- 172.21.15.2:0/3085745736 wait complete. 2023-11-26T07:11:58.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.412+0000 7efde2bcd700 1 Processor -- start 2023-11-26T07:11:58.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.413+0000 7efde2bcd700 1 -- start start 2023-11-26T07:11:58.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.413+0000 7efde2bcd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdcc003a00 0x7efddc1f13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:58.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.413+0000 7efde2bcd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efddc1e51c0 0x7efddc1e5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:58.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.413+0000 7efde2bcd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efddc143c60 0x7efddc1440e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:58.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.413+0000 7efde2bcd700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efddc145510 con 0x7efdcc003a00 2023-11-26T07:11:58.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.413+0000 7efde2bcd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efddc1e5b80 con 0x7efddc143c60 2023-11-26T07:11:58.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.413+0000 7efde2bcd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efddc144990 con 0x7efddc1e51c0 2023-11-26T07:11:58.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.414+0000 7efde0969700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdcc003a00 0x7efddc1f13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:58.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.414+0000 7efde0969700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdcc003a00 0x7efddc1f13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39668/0 (socket says 172.21.15.2:39668) 2023-11-26T07:11:58.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.414+0000 7efde0969700 1 -- 172.21.15.2:0/849824104 learned_addr learned my addr 172.21.15.2:0/849824104 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:58.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.414+0000 7efddbfff700 1 --2- 172.21.15.2:0/849824104 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efddc1e51c0 0x7efddc1e5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:58.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.414+0000 7efde116a700 1 --2- 172.21.15.2:0/849824104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efddc143c60 0x7efddc1440e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:58.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.414+0000 7efde0969700 1 -- 172.21.15.2:0/849824104 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efddc1e51c0 msgr2=0x7efddc1e5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:58.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.414+0000 7efde0969700 1 --2- 172.21.15.2:0/849824104 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efddc1e51c0 0x7efddc1e5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:58.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.414+0000 7efde0969700 1 -- 172.21.15.2:0/849824104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efddc143c60 msgr2=0x7efddc1440e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:58.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.414+0000 7efde0969700 1 --2- 172.21.15.2:0/849824104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efddc143c60 0x7efddc1440e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:58.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.414+0000 7efde0969700 1 -- 172.21.15.2:0/849824104 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efddc144c70 con 0x7efdcc003a00 2023-11-26T07:11:58.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.414+0000 7efde0969700 1 --2- 172.21.15.2:0/849824104 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdcc003a00 0x7efddc1f13a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7efdcc004740 tx=0x7efdd00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:58.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.414+0000 7efdd97fa700 1 -- 172.21.15.2:0/849824104 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd000e6c0 con 0x7efdcc003a00 2023-11-26T07:11:58.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.414+0000 7efdd97fa700 1 -- 172.21.15.2:0/849824104 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd0003ad0 con 0x7efdcc003a00 2023-11-26T07:11:58.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.414+0000 7efde2bcd700 1 -- 172.21.15.2:0/849824104 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efddc144f50 con 0x7efdcc003a00 2023-11-26T07:11:58.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.414+0000 7efdd97fa700 1 -- 172.21.15.2:0/849824104 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd0003e80 con 0x7efdcc003a00 2023-11-26T07:11:58.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.414+0000 7efde2bcd700 1 -- 172.21.15.2:0/849824104 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efddc1f18e0 con 0x7efdcc003a00 2023-11-26T07:11:58.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.415+0000 7efde2bcd700 1 -- 172.21.15.2:0/849824104 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efddc068670 con 0x7efdcc003a00 2023-11-26T07:11:58.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.416+0000 7efdd97fa700 1 -- 172.21.15.2:0/849824104 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efdd0013470 con 0x7efdcc003a00 2023-11-26T07:11:58.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.416+0000 7efdd97fa700 1 --2- 172.21.15.2:0/849824104 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7efdc006af00 0x7efdc006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:58.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.416+0000 7efdd97fa700 1 -- 172.21.15.2:0/849824104 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efdd008afe0 con 0x7efdcc003a00 2023-11-26T07:11:58.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.416+0000 7efddbfff700 1 --2- 172.21.15.2:0/849824104 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7efdc006af00 0x7efdc006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:58.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.417+0000 7efddbfff700 1 --2- 172.21.15.2:0/849824104 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7efdc006af00 0x7efdc006d3c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efddc15d590 tx=0x7efdc8009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:58.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.421+0000 7efdd97fa700 1 -- 172.21.15.2:0/849824104 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efdd0056240 con 0x7efdcc003a00 2023-11-26T07:11:58.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.622+0000 7efde2bcd700 1 -- 172.21.15.2:0/849824104 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efddc06bd30 con 0x7efdcc003a00 2023-11-26T07:11:58.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.623+0000 7efdd97fa700 1 -- 172.21.15.2:0/849824104 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16457 (secure 0 0 0) 0x7efdd0026350 con 0x7efdcc003a00 2023-11-26T07:11:58.625 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:11:58.626 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:11:35.634747+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:11:32.129474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:11:33.019837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:11:58.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.625+0000 7efde2bcd700 1 -- 172.21.15.2:0/849824104 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7efdc006af00 msgr2=0x7efdc006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:58.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.625+0000 7efde2bcd700 1 --2- 172.21.15.2:0/849824104 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7efdc006af00 0x7efdc006d3c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efddc15d590 tx=0x7efdc8009210 comp rx=0 tx=0).stop 2023-11-26T07:11:58.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.625+0000 7efde2bcd700 1 -- 172.21.15.2:0/849824104 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdcc003a00 msgr2=0x7efddc1f13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:58.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.625+0000 7efde2bcd700 1 --2- 172.21.15.2:0/849824104 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdcc003a00 0x7efddc1f13a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7efdcc004740 tx=0x7efdd00047c0 comp rx=0 tx=0).stop 2023-11-26T07:11:58.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.625+0000 7efde2bcd700 1 -- 172.21.15.2:0/849824104 shutdown_connections 2023-11-26T07:11:58.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.625+0000 7efde2bcd700 1 --2- 172.21.15.2:0/849824104 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7efdc006af00 0x7efdc006d3c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:58.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.625+0000 7efde2bcd700 1 --2- 172.21.15.2:0/849824104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efddc143c60 0x7efddc1440e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:58.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.625+0000 7efde2bcd700 1 --2- 172.21.15.2:0/849824104 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdcc003a00 0x7efddc1f13a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:58.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.625+0000 7efde2bcd700 1 --2- 172.21.15.2:0/849824104 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efddc1e51c0 0x7efddc1e5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:58.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.625+0000 7efde2bcd700 1 -- 172.21.15.2:0/849824104 >> 172.21.15.2:0/849824104 conn(0x7efddc0b2740 msgr2=0x7efddc06f260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:58.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.625+0000 7efde2bcd700 1 -- 172.21.15.2:0/849824104 shutdown_connections 2023-11-26T07:11:58.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.625+0000 7efde2bcd700 1 -- 172.21.15.2:0/849824104 wait complete. 2023-11-26T07:11:58.640 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:11:28.205739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:11:32.129474+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:11:33.019837+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:11:58.640 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:11:58.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.767+0000 7f0501c1a700 1 Processor -- start 2023-11-26T07:11:58.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.767+0000 7f0501c1a700 1 -- start start 2023-11-26T07:11:58.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.768+0000 7f0501c1a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f04fc0b4150 0x7f04fc06de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:58.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.768+0000 7f0501c1a700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04fc071f50 con 0x7f04fc0b5ab0 2023-11-26T07:11:58.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.768+0000 7f0501c1a700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04fc072230 con 0x7f04fc06b620 2023-11-26T07:11:58.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.768+0000 7f0501c1a700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04fc072510 con 0x7f04fc0b4150 2023-11-26T07:11:58.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.768+0000 7f04faffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f04fc0b4150 0x7f04fc06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:58.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.769+0000 7f04fbfff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f04fc0b5ab0 0x7f04fc06e390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59128/0 (socket says 172.21.15.2:59128) 2023-11-26T07:11:58.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.769+0000 7f04faffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f04fc0b4150 0x7f04fc06de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39684/0 (socket says 172.21.15.2:39684) 2023-11-26T07:11:58.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.769+0000 7f04fbfff700 1 -- 172.21.15.2:0/889939681 learned_addr learned my addr 172.21.15.2:0/889939681 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:11:58.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.769+0000 7f04faffd700 1 -- 172.21.15.2:0/889939681 >> v1:172.21.15.192:6789/0 conn(0x7f04fc06b620 legacy=0x7f04fc0b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:58.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.769+0000 7f04faffd700 1 -- 172.21.15.2:0/889939681 >> v1:172.21.15.2:6789/0 conn(0x7f04fc0b5ab0 legacy=0x7f04fc06e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:58.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.769+0000 7f04faffd700 1 -- 172.21.15.2:0/889939681 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04fc0727f0 con 0x7f04fc0b4150 2023-11-26T07:11:58.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.769+0000 7f04faffd700 1 --2- 172.21.15.2:0/889939681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04fc0b4150 0x7f04fc06de50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f04e4009840 tx=0x7f04e4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3187d412d2f2c46 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:58.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.769+0000 7f04fa7fc700 1 -- 172.21.15.2:0/889939681 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e4004230 con 0x7f04fc0b4150 2023-11-26T07:11:58.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.769+0000 7f04fa7fc700 1 -- 172.21.15.2:0/889939681 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e4004390 con 0x7f04fc0b4150 2023-11-26T07:11:58.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.769+0000 7f04fa7fc700 1 -- 172.21.15.2:0/889939681 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e40036a0 con 0x7f04fc0b4150 2023-11-26T07:11:58.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.770+0000 7f0501c1a700 1 -- 172.21.15.2:0/889939681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04fc0b4150 msgr2=0x7f04fc06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:58.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.770+0000 7f0501c1a700 1 --2- 172.21.15.2:0/889939681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04fc0b4150 0x7f04fc06de50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f04e4009840 tx=0x7f04e4009b50 comp rx=0 tx=0).stop 2023-11-26T07:11:58.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.770+0000 7f0501c1a700 1 -- 172.21.15.2:0/889939681 shutdown_connections 2023-11-26T07:11:58.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.770+0000 7f0501c1a700 1 --2- 172.21.15.2:0/889939681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04fc0b4150 0x7f04fc06de50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:58.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.770+0000 7f0501c1a700 1 -- 172.21.15.2:0/889939681 >> 172.21.15.2:0/889939681 conn(0x7f04fc0b2740 msgr2=0x7f04fc0b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:58.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.770+0000 7f0501c1a700 1 -- 172.21.15.2:0/889939681 shutdown_connections 2023-11-26T07:11:58.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.770+0000 7f0501c1a700 1 -- 172.21.15.2:0/889939681 wait complete. 2023-11-26T07:11:58.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.771+0000 7f0501c1a700 1 Processor -- start 2023-11-26T07:11:58.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.771+0000 7f0501c1a700 1 -- start start 2023-11-26T07:11:58.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.772+0000 7f0501c1a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04fc06b620 0x7f04fc1447f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:58.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.772+0000 7f0501c1a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04fc0b4150 0x7f04fc06f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:58.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.772+0000 7f0501c1a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04fc0b5ab0 0x7f04fc1e3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:58.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.772+0000 7f0501c1a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04fc1f7fb0 con 0x7f04fc0b4150 2023-11-26T07:11:58.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.772+0000 7f0501c1a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04fc1f70e0 con 0x7f04fc0b5ab0 2023-11-26T07:11:58.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.772+0000 7f0501c1a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04fc1f7330 con 0x7f04fc06b620 2023-11-26T07:11:58.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.772+0000 7f04faffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04fc0b4150 0x7f04fc06f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:58.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.772+0000 7f04faffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04fc0b4150 0x7f04fc06f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39690/0 (socket says 172.21.15.2:39690) 2023-11-26T07:11:58.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.772+0000 7f04faffd700 1 -- 172.21.15.2:0/1279260718 learned_addr learned my addr 172.21.15.2:0/1279260718 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:58.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.772+0000 7f04fb7fe700 1 --2- 172.21.15.2:0/1279260718 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04fc06b620 0x7f04fc1447f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:58.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.772+0000 7f04faffd700 1 -- 172.21.15.2:0/1279260718 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04fc06b620 msgr2=0x7f04fc1447f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:58.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.772+0000 7f04faffd700 1 --2- 172.21.15.2:0/1279260718 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04fc06b620 0x7f04fc1447f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:58.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.772+0000 7f04fbfff700 1 --2- 172.21.15.2:0/1279260718 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04fc0b5ab0 0x7f04fc1e3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:58.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.772+0000 7f04faffd700 1 -- 172.21.15.2:0/1279260718 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04fc0b5ab0 msgr2=0x7f04fc1e3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:58.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.772+0000 7f04faffd700 1 --2- 172.21.15.2:0/1279260718 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04fc0b5ab0 0x7f04fc1e3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:58.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.772+0000 7f04faffd700 1 -- 172.21.15.2:0/1279260718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e40094a0 con 0x7f04fc0b4150 2023-11-26T07:11:58.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.773+0000 7f04faffd700 1 --2- 172.21.15.2:0/1279260718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04fc0b4150 0x7f04fc06f010 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f04e40090b0 tx=0x7f04e4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:58.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.773+0000 7f04f3fff700 1 -- 172.21.15.2:0/1279260718 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e4011830 con 0x7f04fc0b4150 2023-11-26T07:11:58.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.773+0000 7f04f3fff700 1 -- 172.21.15.2:0/1279260718 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e401e070 con 0x7f04fc0b4150 2023-11-26T07:11:58.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.773+0000 7f0501c1a700 1 -- 172.21.15.2:0/1279260718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04fc1f7610 con 0x7f04fc0b4150 2023-11-26T07:11:58.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.773+0000 7f04f3fff700 1 -- 172.21.15.2:0/1279260718 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e4011bf0 con 0x7f04fc0b4150 2023-11-26T07:11:58.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.773+0000 7f0501c1a700 1 -- 172.21.15.2:0/1279260718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04fc1f7bd0 con 0x7f04fc0b4150 2023-11-26T07:11:58.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.774+0000 7f0501c1a700 1 -- 172.21.15.2:0/1279260718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04fc075480 con 0x7f04fc0b4150 2023-11-26T07:11:58.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.774+0000 7f04f3fff700 1 -- 172.21.15.2:0/1279260718 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f04e4011d50 con 0x7f04fc0b4150 2023-11-26T07:11:58.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.774+0000 7f04f3fff700 1 --2- 172.21.15.2:0/1279260718 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f04dc06aed0 0x7f04dc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:58.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.775+0000 7f04f3fff700 1 -- 172.21.15.2:0/1279260718 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f04e408a980 con 0x7f04fc0b4150 2023-11-26T07:11:58.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.775+0000 7f04fb7fe700 1 --2- 172.21.15.2:0/1279260718 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f04dc06aed0 0x7f04dc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:58.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.775+0000 7f04fb7fe700 1 --2- 172.21.15.2:0/1279260718 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f04dc06aed0 0x7f04dc06d390 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f04ec00a7d0 tx=0x7f04ec008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:58.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.779+0000 7f04f3fff700 1 -- 172.21.15.2:0/1279260718 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f04e4055a40 con 0x7f04fc0b4150 2023-11-26T07:11:58.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.979+0000 7f0501c1a700 1 -- 172.21.15.2:0/1279260718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f04fc06bd40 con 0x7f04fc0b4150 2023-11-26T07:11:58.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.980+0000 7f04f3fff700 1 -- 172.21.15.2:0/1279260718 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f04e4059060 con 0x7f04fc0b4150 2023-11-26T07:11:58.982 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-26T07:11:58.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.982+0000 7f0501c1a700 1 -- 172.21.15.2:0/1279260718 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f04dc06aed0 msgr2=0x7f04dc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:58.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.982+0000 7f0501c1a700 1 --2- 172.21.15.2:0/1279260718 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f04dc06aed0 0x7f04dc06d390 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f04ec00a7d0 tx=0x7f04ec008040 comp rx=0 tx=0).stop 2023-11-26T07:11:58.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.982+0000 7f0501c1a700 1 -- 172.21.15.2:0/1279260718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04fc0b4150 msgr2=0x7f04fc06f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:58.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.982+0000 7f0501c1a700 1 --2- 172.21.15.2:0/1279260718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04fc0b4150 0x7f04fc06f010 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f04e40090b0 tx=0x7f04e4004750 comp rx=0 tx=0).stop 2023-11-26T07:11:58.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.982+0000 7f0501c1a700 1 -- 172.21.15.2:0/1279260718 shutdown_connections 2023-11-26T07:11:58.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.982+0000 7f0501c1a700 1 --2- 172.21.15.2:0/1279260718 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f04dc06aed0 0x7f04dc06d390 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:58.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.982+0000 7f0501c1a700 1 --2- 172.21.15.2:0/1279260718 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04fc0b5ab0 0x7f04fc1e3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:58.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.982+0000 7f0501c1a700 1 --2- 172.21.15.2:0/1279260718 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04fc06b620 0x7f04fc1447f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:58.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.982+0000 7f0501c1a700 1 --2- 172.21.15.2:0/1279260718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04fc0b4150 0x7f04fc06f010 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:58.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.982+0000 7f0501c1a700 1 -- 172.21.15.2:0/1279260718 >> 172.21.15.2:0/1279260718 conn(0x7f04fc0b2740 msgr2=0x7f04fc1462d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:58.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.982+0000 7f0501c1a700 1 -- 172.21.15.2:0/1279260718 shutdown_connections 2023-11-26T07:11:58.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:58.982+0000 7f0501c1a700 1 -- 172.21.15.2:0/1279260718 wait complete. 2023-11-26T07:11:58.995 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:11:59.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.122+0000 7f85d3014700 1 Processor -- start 2023-11-26T07:11:59.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.122+0000 7f85d3014700 1 -- start start 2023-11-26T07:11:59.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.122+0000 7f85d3014700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f85cc15e1e0 0x7f85cc0b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:59.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.122+0000 7f85d3014700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f85cc0b5e40 0x7f85cc15f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:59.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.122+0000 7f85d3014700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85cc06bb80 con 0x7f85cc06b400 2023-11-26T07:11:59.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.122+0000 7f85d3014700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85cc06be20 con 0x7f85cc0b5e40 2023-11-26T07:11:59.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.122+0000 7f85d3014700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85cc06c100 con 0x7f85cc15e1e0 2023-11-26T07:11:59.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.123+0000 7f85d15b1700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f85cc0b5e40 0x7f85cc15f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:59.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.123+0000 7f85cbfff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f85cc06b400 0x7f85cc0726a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59138/0 (socket says 172.21.15.2:59138) 2023-11-26T07:11:59.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.123+0000 7f85d15b1700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f85cc0b5e40 0x7f85cc15f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39700/0 (socket says 172.21.15.2:39700) 2023-11-26T07:11:59.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.123+0000 7f85d15b1700 1 -- 172.21.15.2:0/2835424838 learned_addr learned my addr 172.21.15.2:0/2835424838 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:59.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.123+0000 7f85d0db0700 1 --2- 172.21.15.2:0/2835424838 >> v2:172.21.15.192:3300/0 conn(0x7f85cc15e1e0 0x7f85cc0b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:59.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.123+0000 7f85d15b1700 1 -- 172.21.15.2:0/2835424838 >> v2:172.21.15.192:3300/0 conn(0x7f85cc15e1e0 msgr2=0x7f85cc0b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:59.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.123+0000 7f85d15b1700 1 --2- 172.21.15.2:0/2835424838 >> v2:172.21.15.192:3300/0 conn(0x7f85cc15e1e0 0x7f85cc0b12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:59.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.123+0000 7f85d15b1700 1 -- 172.21.15.2:0/2835424838 >> v1:172.21.15.2:6789/0 conn(0x7f85cc06b400 legacy=0x7f85cc0726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:59.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.123+0000 7f85d15b1700 1 -- 172.21.15.2:0/2835424838 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85cc06c3e0 con 0x7f85cc0b5e40 2023-11-26T07:11:59.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.123+0000 7f85d15b1700 1 --2- 172.21.15.2:0/2835424838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85cc0b5e40 0x7f85cc15f5d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f85cc0737c0 tx=0x7f85c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a9465935ee09686 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:59.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.123+0000 7f85cb7fe700 1 -- 172.21.15.2:0/2835424838 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c400e070 con 0x7f85cc0b5e40 2023-11-26T07:11:59.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.123+0000 7f85cb7fe700 1 -- 172.21.15.2:0/2835424838 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c400b9c0 con 0x7f85cc0b5e40 2023-11-26T07:11:59.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.123+0000 7f85cb7fe700 1 -- 172.21.15.2:0/2835424838 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c400bd70 con 0x7f85cc0b5e40 2023-11-26T07:11:59.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.124+0000 7f85d3014700 1 -- 172.21.15.2:0/2835424838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85cc0b5e40 msgr2=0x7f85cc15f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:59.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.124+0000 7f85d3014700 1 --2- 172.21.15.2:0/2835424838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85cc0b5e40 0x7f85cc15f5d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f85cc0737c0 tx=0x7f85c400b330 comp rx=0 tx=0).stop 2023-11-26T07:11:59.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.124+0000 7f85d3014700 1 -- 172.21.15.2:0/2835424838 shutdown_connections 2023-11-26T07:11:59.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.124+0000 7f85d3014700 1 --2- 172.21.15.2:0/2835424838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85cc0b5e40 0x7f85cc15f5d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:59.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.124+0000 7f85d3014700 1 --2- 172.21.15.2:0/2835424838 >> v2:172.21.15.192:3300/0 conn(0x7f85cc15e1e0 0x7f85cc0b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:59.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.124+0000 7f85d3014700 1 -- 172.21.15.2:0/2835424838 >> 172.21.15.2:0/2835424838 conn(0x7f85cc0b5070 msgr2=0x7f85cc0b5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:59.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.124+0000 7f85d3014700 1 -- 172.21.15.2:0/2835424838 shutdown_connections 2023-11-26T07:11:59.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.124+0000 7f85d3014700 1 -- 172.21.15.2:0/2835424838 wait complete. 2023-11-26T07:11:59.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.125+0000 7f85d3014700 1 Processor -- start 2023-11-26T07:11:59.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.125+0000 7f85d3014700 1 -- start start 2023-11-26T07:11:59.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.126+0000 7f85d3014700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85cc06b400 0x7f85cc09ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:59.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.126+0000 7f85d3014700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85cc0b5e40 0x7f85cc09c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:59.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.126+0000 7f85d3014700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85cc15e1e0 0x7f85cc14b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:59.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.126+0000 7f85d3014700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85cc09a730 con 0x7f85cc06b400 2023-11-26T07:11:59.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.126+0000 7f85d3014700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85cc09aa10 con 0x7f85cc0b5e40 2023-11-26T07:11:59.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.126+0000 7f85d3014700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85cc09acf0 con 0x7f85cc15e1e0 2023-11-26T07:11:59.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.126+0000 7f85d0db0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85cc06b400 0x7f85cc09ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:59.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.126+0000 7f85d0db0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85cc06b400 0x7f85cc09ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39702/0 (socket says 172.21.15.2:39702) 2023-11-26T07:11:59.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.126+0000 7f85d0db0700 1 -- 172.21.15.2:0/3743403216 learned_addr learned my addr 172.21.15.2:0/3743403216 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:59.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.126+0000 7f85cbfff700 1 --2- 172.21.15.2:0/3743403216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85cc0b5e40 0x7f85cc09c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:59.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.126+0000 7f85d15b1700 1 --2- 172.21.15.2:0/3743403216 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85cc15e1e0 0x7f85cc14b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:59.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.126+0000 7f85d0db0700 1 -- 172.21.15.2:0/3743403216 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85cc15e1e0 msgr2=0x7f85cc14b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:59.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.126+0000 7f85d0db0700 1 --2- 172.21.15.2:0/3743403216 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85cc15e1e0 0x7f85cc14b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:59.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.126+0000 7f85d0db0700 1 -- 172.21.15.2:0/3743403216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85cc0b5e40 msgr2=0x7f85cc09c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:59.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.126+0000 7f85d0db0700 1 --2- 172.21.15.2:0/3743403216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85cc0b5e40 0x7f85cc09c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:59.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.126+0000 7f85d0db0700 1 -- 172.21.15.2:0/3743403216 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c4009b30 con 0x7f85cc06b400 2023-11-26T07:11:59.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.126+0000 7f85cbfff700 1 --2- 172.21.15.2:0/3743403216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85cc0b5e40 0x7f85cc09c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:11:59.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.127+0000 7f85d0db0700 1 --2- 172.21.15.2:0/3743403216 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85cc06b400 0x7f85cc09ddc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f85c000d800 tx=0x7f85c000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:59.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.127+0000 7f85c97fa700 1 -- 172.21.15.2:0/3743403216 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c00125f0 con 0x7f85cc06b400 2023-11-26T07:11:59.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.127+0000 7f85c97fa700 1 -- 172.21.15.2:0/3743403216 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c0012750 con 0x7f85cc06b400 2023-11-26T07:11:59.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.127+0000 7f85d3014700 1 -- 172.21.15.2:0/3743403216 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85cc09afd0 con 0x7f85cc06b400 2023-11-26T07:11:59.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.127+0000 7f85c97fa700 1 -- 172.21.15.2:0/3743403216 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c0012b00 con 0x7f85cc06b400 2023-11-26T07:11:59.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.127+0000 7f85d3014700 1 -- 172.21.15.2:0/3743403216 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85cc14f110 con 0x7f85cc06b400 2023-11-26T07:11:59.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.128+0000 7f85d3014700 1 -- 172.21.15.2:0/3743403216 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85cc075480 con 0x7f85cc06b400 2023-11-26T07:11:59.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.128+0000 7f85c97fa700 1 -- 172.21.15.2:0/3743403216 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f85c0012c60 con 0x7f85cc06b400 2023-11-26T07:11:59.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.128+0000 7f85c97fa700 1 --2- 172.21.15.2:0/3743403216 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f85b006aed0 0x7f85b006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:59.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.129+0000 7f85c97fa700 1 -- 172.21.15.2:0/3743403216 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f85c00899a0 con 0x7f85cc06b400 2023-11-26T07:11:59.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.129+0000 7f85cbfff700 1 --2- 172.21.15.2:0/3743403216 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f85b006aed0 0x7f85b006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:59.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.129+0000 7f85cbfff700 1 --2- 172.21.15.2:0/3743403216 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f85b006aed0 0x7f85b006d390 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f85cc157e20 tx=0x7f85b8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:59.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.133+0000 7f85c97fa700 1 -- 172.21.15.2:0/3743403216 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f85c0054a50 con 0x7f85cc06b400 2023-11-26T07:11:59.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.335+0000 7f85d3014700 1 -- 172.21.15.2:0/3743403216 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f85cc0b30f0 con 0x7f85cc06b400 2023-11-26T07:11:59.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.335+0000 7f85c97fa700 1 -- 172.21.15.2:0/3743403216 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f85c0058070 con 0x7f85cc06b400 2023-11-26T07:11:59.337 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-26T07:11:59.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.337+0000 7f85d3014700 1 -- 172.21.15.2:0/3743403216 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f85b006aed0 msgr2=0x7f85b006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:59.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.337+0000 7f85d3014700 1 --2- 172.21.15.2:0/3743403216 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f85b006aed0 0x7f85b006d390 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f85cc157e20 tx=0x7f85b8009040 comp rx=0 tx=0).stop 2023-11-26T07:11:59.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.337+0000 7f85d3014700 1 -- 172.21.15.2:0/3743403216 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85cc06b400 msgr2=0x7f85cc09ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:59.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.337+0000 7f85d3014700 1 --2- 172.21.15.2:0/3743403216 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85cc06b400 0x7f85cc09ddc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f85c000d800 tx=0x7f85c000dbc0 comp rx=0 tx=0).stop 2023-11-26T07:11:59.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.337+0000 7f85d3014700 1 -- 172.21.15.2:0/3743403216 shutdown_connections 2023-11-26T07:11:59.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.337+0000 7f85d3014700 1 --2- 172.21.15.2:0/3743403216 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f85b006aed0 0x7f85b006d390 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:59.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.337+0000 7f85d3014700 1 --2- 172.21.15.2:0/3743403216 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85cc15e1e0 0x7f85cc14b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:59.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.337+0000 7f85d3014700 1 --2- 172.21.15.2:0/3743403216 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85cc06b400 0x7f85cc09ddc0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:59.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.337+0000 7f85d3014700 1 --2- 172.21.15.2:0/3743403216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85cc0b5e40 0x7f85cc09c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:59.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.337+0000 7f85d3014700 1 -- 172.21.15.2:0/3743403216 >> 172.21.15.2:0/3743403216 conn(0x7f85cc0b5070 msgr2=0x7f85cc0b5610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:59.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.337+0000 7f85d3014700 1 -- 172.21.15.2:0/3743403216 shutdown_connections 2023-11-26T07:11:59.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.337+0000 7f85d3014700 1 -- 172.21.15.2:0/3743403216 wait complete. 2023-11-26T07:11:59.351 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:11:59.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.477+0000 7f08841ae700 1 Processor -- start 2023-11-26T07:11:59.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.478+0000 7f08841ae700 1 -- start start 2023-11-26T07:11:59.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.478+0000 7f08841ae700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f087c15bde0 0x7f087c15c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:59.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.478+0000 7f08841ae700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f087c0cf2b0 0x7f087c0d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:59.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.478+0000 7f08841ae700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f087c0d0a90 con 0x7f087c0ce5c0 2023-11-26T07:11:59.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.478+0000 7f08841ae700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f087c06ee10 con 0x7f087c0cf2b0 2023-11-26T07:11:59.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.478+0000 7f08841ae700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f087c06f0f0 con 0x7f087c15bde0 2023-11-26T07:11:59.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.478+0000 7f088274b700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f087c0ce5c0 0x7f087c0cc670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59156/0 (socket says 172.21.15.2:59156) 2023-11-26T07:11:59.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.478+0000 7f088274b700 1 -- 172.21.15.2:0/1650557908 learned_addr learned my addr 172.21.15.2:0/1650557908 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:11:59.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.479+0000 7f0881749700 1 --2- 172.21.15.2:0/1650557908 >> v2:172.21.15.192:3300/0 conn(0x7f087c0cf2b0 0x7f087c0d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:59.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.479+0000 7f0881f4a700 1 --2- 172.21.15.2:0/1650557908 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f087c15bde0 0x7f087c15c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:59.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.479+0000 7f0880f48700 1 -- 172.21.15.2:0/1650557908 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4000704846 0 0) 0x7f087c0d0a90 con 0x7f087c0ce5c0 2023-11-26T07:11:59.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.479+0000 7f0880f48700 1 -- 172.21.15.2:0/1650557908 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08680035b0 con 0x7f087c0ce5c0 2023-11-26T07:11:59.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.479+0000 7f0880f48700 1 -- 172.21.15.2:0/1650557908 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3975979861 0 0) 0x7f08680035b0 con 0x7f087c0ce5c0 2023-11-26T07:11:59.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.479+0000 7f0880f48700 1 -- 172.21.15.2:0/1650557908 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f087c15bde0 msgr2=0x7f087c15c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:59.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.479+0000 7f0880f48700 1 --2- 172.21.15.2:0/1650557908 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f087c15bde0 0x7f087c15c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:59.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.479+0000 7f0880f48700 1 -- 172.21.15.2:0/1650557908 >> v2:172.21.15.192:3300/0 conn(0x7f087c0cf2b0 msgr2=0x7f087c0d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:59.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.479+0000 7f0880f48700 1 --2- 172.21.15.2:0/1650557908 >> v2:172.21.15.192:3300/0 conn(0x7f087c0cf2b0 0x7f087c0d01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:59.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.479+0000 7f0880f48700 1 -- 172.21.15.2:0/1650557908 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f087c06f3d0 con 0x7f087c0ce5c0 2023-11-26T07:11:59.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.479+0000 7f0880f48700 1 -- 172.21.15.2:0/1650557908 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f08740019f0 con 0x7f087c0ce5c0 2023-11-26T07:11:59.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.479+0000 7f0880f48700 1 -- 172.21.15.2:0/1650557908 >> v1:172.21.15.2:6789/0 conn(0x7f087c0ce5c0 legacy=0x7f087c0cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:59.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.479+0000 7f0880f48700 1 --2- 172.21.15.2:0/1650557908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0868003a00 0x7f0868003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:59.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.479+0000 7f0880f48700 1 --2- 172.21.15.2:0/1650557908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0868004850 0x7f0868004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:59.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.479+0000 7f0880f48700 1 --2- 172.21.15.2:0/1650557908 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f087c15bde0 0x7f0868005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:59.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.479+0000 7f0880f48700 1 -- 172.21.15.2:0/1650557908 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087c06ee10 con 0x7f0868003a00 2023-11-26T07:11:59.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.479+0000 7f0880f48700 1 -- 172.21.15.2:0/1650557908 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087c06f0f0 con 0x7f0868004850 2023-11-26T07:11:59.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.479+0000 7f0880f48700 1 -- 172.21.15.2:0/1650557908 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086800ba10 con 0x7f087c15bde0 2023-11-26T07:11:59.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.479+0000 7f0881f4a700 1 --2- 172.21.15.2:0/1650557908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0868003a00 0x7f0868003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:59.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.479+0000 7f088274b700 1 --2- 172.21.15.2:0/1650557908 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f087c15bde0 0x7f0868005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:59.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.479+0000 7f0881749700 1 --2- 172.21.15.2:0/1650557908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0868004850 0x7f0868004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:59.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.480+0000 7f0881f4a700 1 -- 172.21.15.2:0/1650557908 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f087c15bde0 msgr2=0x7f0868005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:59.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.480+0000 7f0881f4a700 1 --2- 172.21.15.2:0/1650557908 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f087c15bde0 0x7f0868005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:59.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.480+0000 7f0881f4a700 1 -- 172.21.15.2:0/1650557908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0868004850 msgr2=0x7f0868004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:59.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.480+0000 7f0881f4a700 1 --2- 172.21.15.2:0/1650557908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0868004850 0x7f0868004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:59.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.480+0000 7f0881f4a700 1 -- 172.21.15.2:0/1650557908 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08680035b0 con 0x7f0868003a00 2023-11-26T07:11:59.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.480+0000 7f0881749700 1 --2- 172.21.15.2:0/1650557908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0868004850 0x7f0868004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:11:59.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.480+0000 7f0881f4a700 1 --2- 172.21.15.2:0/1650557908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0868003a00 0x7f0868003e20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f086c009b90 tx=0x7f0868005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98e441bc7fa0de5c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:59.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.480+0000 7f0880f48700 1 -- 172.21.15.2:0/1650557908 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086c00e6c0 con 0x7f0868003a00 2023-11-26T07:11:59.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.480+0000 7f0880f48700 1 -- 172.21.15.2:0/1650557908 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086c00e820 con 0x7f0868003a00 2023-11-26T07:11:59.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.480+0000 7f0880f48700 1 -- 172.21.15.2:0/1650557908 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086c00eb90 con 0x7f0868003a00 2023-11-26T07:11:59.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.480+0000 7f08841ae700 1 -- 172.21.15.2:0/1650557908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0868003a00 msgr2=0x7f0868003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:59.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.480+0000 7f08841ae700 1 --2- 172.21.15.2:0/1650557908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0868003a00 0x7f0868003e20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f086c009b90 tx=0x7f0868005880 comp rx=0 tx=0).stop 2023-11-26T07:11:59.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.480+0000 7f088274b700 1 -- 172.21.15.2:0/1650557908 reap_dead start 2023-11-26T07:11:59.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.480+0000 7f08841ae700 1 -- 172.21.15.2:0/1650557908 shutdown_connections 2023-11-26T07:11:59.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.480+0000 7f08841ae700 1 -- 172.21.15.2:0/1650557908 >> 172.21.15.2:0/1650557908 conn(0x7f087c0b3720 msgr2=0x7f087c0b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:59.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.481+0000 7f08841ae700 1 -- 172.21.15.2:0/1650557908 shutdown_connections 2023-11-26T07:11:59.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.481+0000 7f08841ae700 1 -- 172.21.15.2:0/1650557908 wait complete. 2023-11-26T07:11:59.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.482+0000 7f08841ae700 1 Processor -- start 2023-11-26T07:11:59.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.482+0000 7f08841ae700 1 -- start start 2023-11-26T07:11:59.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.482+0000 7f08841ae700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0868003a00 0x7f087c0b75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:59.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.482+0000 7f08841ae700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f087c0c9c60 0x7f087c1f4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:59.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.482+0000 7f08841ae700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f087c1f5210 0x7f087c1ee6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:59.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.482+0000 7f08841ae700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087c1f56a0 con 0x7f0868003a00 2023-11-26T07:11:59.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.482+0000 7f08841ae700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087c0cace0 con 0x7f087c0c9c60 2023-11-26T07:11:59.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.482+0000 7f08841ae700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f087c0ca440 con 0x7f087c1f5210 2023-11-26T07:11:59.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.483+0000 7f0881f4a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0868003a00 0x7f087c0b75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:59.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.483+0000 7f0881f4a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0868003a00 0x7f087c0b75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39722/0 (socket says 172.21.15.2:39722) 2023-11-26T07:11:59.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.483+0000 7f0881f4a700 1 -- 172.21.15.2:0/113882835 learned_addr learned my addr 172.21.15.2:0/113882835 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:59.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.483+0000 7f0881749700 1 --2- 172.21.15.2:0/113882835 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f087c0c9c60 0x7f087c1f4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:59.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.483+0000 7f088274b700 1 --2- 172.21.15.2:0/113882835 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f087c1f5210 0x7f087c1ee6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:59.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.483+0000 7f0881f4a700 1 -- 172.21.15.2:0/113882835 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f087c1f5210 msgr2=0x7f087c1ee6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:59.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.483+0000 7f0881f4a700 1 --2- 172.21.15.2:0/113882835 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f087c1f5210 0x7f087c1ee6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:59.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.483+0000 7f0881f4a700 1 -- 172.21.15.2:0/113882835 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f087c0c9c60 msgr2=0x7f087c1f4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:59.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.483+0000 7f0881f4a700 1 --2- 172.21.15.2:0/113882835 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f087c0c9c60 0x7f087c1f4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:59.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.483+0000 7f0881f4a700 1 -- 172.21.15.2:0/113882835 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f087c0ca720 con 0x7f0868003a00 2023-11-26T07:11:59.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.483+0000 7f0881f4a700 1 --2- 172.21.15.2:0/113882835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0868003a00 0x7f087c0b75b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f086c0090b0 tx=0x7f086c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:59.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.483+0000 7f08727fc700 1 -- 172.21.15.2:0/113882835 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086c021070 con 0x7f0868003a00 2023-11-26T07:11:59.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.483+0000 7f08727fc700 1 -- 172.21.15.2:0/113882835 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086c0036a0 con 0x7f0868003a00 2023-11-26T07:11:59.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.483+0000 7f08841ae700 1 -- 172.21.15.2:0/113882835 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f087c0caa00 con 0x7f0868003a00 2023-11-26T07:11:59.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.483+0000 7f08727fc700 1 -- 172.21.15.2:0/113882835 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086c00e6c0 con 0x7f0868003a00 2023-11-26T07:11:59.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.483+0000 7f08841ae700 1 -- 172.21.15.2:0/113882835 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f087c0ca0c0 con 0x7f0868003a00 2023-11-26T07:11:59.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.484+0000 7f08841ae700 1 -- 172.21.15.2:0/113882835 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f087c1f27f0 con 0x7f0868003a00 2023-11-26T07:11:59.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.485+0000 7f08727fc700 1 -- 172.21.15.2:0/113882835 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f086c025070 con 0x7f0868003a00 2023-11-26T07:11:59.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.485+0000 7f08727fc700 1 --2- 172.21.15.2:0/113882835 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f086006aed0 0x7f086006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:59.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.485+0000 7f08727fc700 1 -- 172.21.15.2:0/113882835 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f086c08ad60 con 0x7f0868003a00 2023-11-26T07:11:59.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.485+0000 7f0881749700 1 --2- 172.21.15.2:0/113882835 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f086006aed0 0x7f086006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:59.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.486+0000 7f0881749700 1 --2- 172.21.15.2:0/113882835 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f086006aed0 0x7f086006d390 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f087c0cf710 tx=0x7f0878008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:59.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.490+0000 7f08727fc700 1 -- 172.21.15.2:0/113882835 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f086c059a50 con 0x7f0868003a00 2023-11-26T07:11:59.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.693+0000 7f08841ae700 1 -- 172.21.15.2:0/113882835 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f087c1f2bf0 con 0x7f0868003a00 2023-11-26T07:11:59.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.694+0000 7f08727fc700 1 -- 172.21.15.2:0/113882835 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f087c1f2bf0 con 0x7f0868003a00 2023-11-26T07:11:59.696 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-26T07:11:59.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.696+0000 7f08841ae700 1 -- 172.21.15.2:0/113882835 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f086006aed0 msgr2=0x7f086006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:59.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.696+0000 7f08841ae700 1 --2- 172.21.15.2:0/113882835 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f086006aed0 0x7f086006d390 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f087c0cf710 tx=0x7f0878008040 comp rx=0 tx=0).stop 2023-11-26T07:11:59.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.696+0000 7f08841ae700 1 -- 172.21.15.2:0/113882835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0868003a00 msgr2=0x7f087c0b75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:59.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.696+0000 7f08841ae700 1 --2- 172.21.15.2:0/113882835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0868003a00 0x7f087c0b75b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f086c0090b0 tx=0x7f086c0047c0 comp rx=0 tx=0).stop 2023-11-26T07:11:59.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.696+0000 7f08841ae700 1 -- 172.21.15.2:0/113882835 shutdown_connections 2023-11-26T07:11:59.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.696+0000 7f08841ae700 1 --2- 172.21.15.2:0/113882835 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f086006aed0 0x7f086006d390 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:59.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.696+0000 7f08841ae700 1 --2- 172.21.15.2:0/113882835 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f087c1f5210 0x7f087c1ee6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:59.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.696+0000 7f08841ae700 1 --2- 172.21.15.2:0/113882835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0868003a00 0x7f087c0b75b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:59.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.696+0000 7f08841ae700 1 --2- 172.21.15.2:0/113882835 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f087c0c9c60 0x7f087c1f4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:59.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.696+0000 7f08841ae700 1 -- 172.21.15.2:0/113882835 >> 172.21.15.2:0/113882835 conn(0x7f087c0b3720 msgr2=0x7f087c0b18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:59.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.696+0000 7f08841ae700 1 -- 172.21.15.2:0/113882835 shutdown_connections 2023-11-26T07:11:59.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.696+0000 7f08841ae700 1 -- 172.21.15.2:0/113882835 wait complete. 2023-11-26T07:11:59.711 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:11:59.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.834+0000 7f844871f700 1 Processor -- start 2023-11-26T07:11:59.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.834+0000 7f844871f700 1 -- start start 2023-11-26T07:11:59.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.835+0000 7f844871f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f84401447b0 0x7f844015b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:59.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.835+0000 7f844871f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84400b3c80 0x7f84400b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:59.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.835+0000 7f844871f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f844015bbf0 con 0x7f84400b4f50 2023-11-26T07:11:59.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.835+0000 7f844871f700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84400b53e0 con 0x7f84401447b0 2023-11-26T07:11:59.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.835+0000 7f844871f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f844015bed0 con 0x7f84400b3c80 2023-11-26T07:11:59.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.835+0000 7f84464bb700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f84401447b0 0x7f844015b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:59.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.835+0000 7f8445cba700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84400b3c80 0x7f84400b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:59.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.836+0000 7f84464bb700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f84401447b0 0x7f844015b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.2:48316/0 (socket says 172.21.15.2:48316) 2023-11-26T07:11:59.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.836+0000 7f84464bb700 1 -- 172.21.15.2:0/96525532 learned_addr learned my addr 172.21.15.2:0/96525532 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:59.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.836+0000 7f8446cbc700 1 --1- 172.21.15.2:0/96525532 >> v1:172.21.15.192:6789/0 conn(0x7f84400b4f50 0x7f844015e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.2:38314/0 (socket says 172.21.15.2:38314) 2023-11-26T07:11:59.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.836+0000 7f84464bb700 1 -- 172.21.15.2:0/96525532 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84400b3c80 msgr2=0x7f84400b4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:11:59.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.836+0000 7f84464bb700 1 --2- 172.21.15.2:0/96525532 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84400b3c80 0x7f84400b4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:59.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.836+0000 7f84464bb700 1 -- 172.21.15.2:0/96525532 >> v1:172.21.15.192:6789/0 conn(0x7f84400b4f50 legacy=0x7f844015e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:59.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.836+0000 7f84464bb700 1 -- 172.21.15.2:0/96525532 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f844015c1b0 con 0x7f84401447b0 2023-11-26T07:11:59.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.836+0000 7f84454b9700 1 -- 172.21.15.2:0/96525532 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 93777951 0 0) 0x7f844015bbf0 con 0x7f84400b4f50 2023-11-26T07:11:59.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.836+0000 7f84464bb700 1 --2- 172.21.15.2:0/96525532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84401447b0 0x7f844015b350 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f84300098f0 tx=0x7f8430009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a199dc1c721ea70b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:59.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.836+0000 7f84454b9700 1 -- 172.21.15.2:0/96525532 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8430011830 con 0x7f84401447b0 2023-11-26T07:11:59.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.836+0000 7f84454b9700 1 -- 172.21.15.2:0/96525532 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8430011990 con 0x7f84401447b0 2023-11-26T07:11:59.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.836+0000 7f84454b9700 1 -- 172.21.15.2:0/96525532 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8430011d20 con 0x7f84401447b0 2023-11-26T07:11:59.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.837+0000 7f844871f700 1 -- 172.21.15.2:0/96525532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84401447b0 msgr2=0x7f844015b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:59.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.837+0000 7f844871f700 1 --2- 172.21.15.2:0/96525532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84401447b0 0x7f844015b350 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f84300098f0 tx=0x7f8430009c00 comp rx=0 tx=0).stop 2023-11-26T07:11:59.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.837+0000 7f844871f700 1 -- 172.21.15.2:0/96525532 shutdown_connections 2023-11-26T07:11:59.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.837+0000 7f844871f700 1 --2- 172.21.15.2:0/96525532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84401447b0 0x7f844015b350 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:59.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.837+0000 7f844871f700 1 --2- 172.21.15.2:0/96525532 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84400b3c80 0x7f84400b4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:59.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.837+0000 7f844871f700 1 -- 172.21.15.2:0/96525532 >> 172.21.15.2:0/96525532 conn(0x7f84400b27d0 msgr2=0x7f84400b2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:11:59.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.837+0000 7f844871f700 1 -- 172.21.15.2:0/96525532 shutdown_connections 2023-11-26T07:11:59.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.837+0000 7f844871f700 1 -- 172.21.15.2:0/96525532 wait complete. 2023-11-26T07:11:59.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.838+0000 7f844871f700 1 Processor -- start 2023-11-26T07:11:59.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.838+0000 7f844871f700 1 -- start start 2023-11-26T07:11:59.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.839+0000 7f844871f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84400b3c80 0x7f84400aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:59.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.839+0000 7f844871f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84400b4f50 0x7f844006b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:59.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.839+0000 7f844871f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84401447b0 0x7f84400c5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:59.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.839+0000 7f844871f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84400aa4b0 con 0x7f84400b3c80 2023-11-26T07:11:59.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.839+0000 7f844871f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84400a9830 con 0x7f84400b4f50 2023-11-26T07:11:59.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.839+0000 7f844871f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84400a9b10 con 0x7f84401447b0 2023-11-26T07:11:59.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.839+0000 7f84464bb700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84400b3c80 0x7f84400aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:59.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.839+0000 7f84464bb700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84400b3c80 0x7f84400aa8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39736/0 (socket says 172.21.15.2:39736) 2023-11-26T07:11:59.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.839+0000 7f84464bb700 1 -- 172.21.15.2:0/1898456724 learned_addr learned my addr 172.21.15.2:0/1898456724 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:11:59.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.839+0000 7f8445cba700 1 --2- 172.21.15.2:0/1898456724 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84400b4f50 0x7f844006b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:59.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.839+0000 7f84464bb700 1 -- 172.21.15.2:0/1898456724 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84401447b0 msgr2=0x7f84400c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:59.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.839+0000 7f84464bb700 1 --2- 172.21.15.2:0/1898456724 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84401447b0 0x7f84400c5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:59.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.839+0000 7f84464bb700 1 -- 172.21.15.2:0/1898456724 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84400b4f50 msgr2=0x7f844006b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:11:59.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.839+0000 7f84464bb700 1 --2- 172.21.15.2:0/1898456724 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84400b4f50 0x7f844006b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:11:59.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.839+0000 7f84464bb700 1 -- 172.21.15.2:0/1898456724 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8430009550 con 0x7f84400b3c80 2023-11-26T07:11:59.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.839+0000 7f8445cba700 1 --2- 172.21.15.2:0/1898456724 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84400b4f50 0x7f844006b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:11:59.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.839+0000 7f84464bb700 1 --2- 172.21.15.2:0/1898456724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84400b3c80 0x7f84400aa8d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8430009c40 tx=0x7f8430004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:59.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.840+0000 7f8436ffd700 1 -- 172.21.15.2:0/1898456724 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84300045d0 con 0x7f84400b3c80 2023-11-26T07:11:59.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.840+0000 7f8436ffd700 1 -- 172.21.15.2:0/1898456724 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f843001e070 con 0x7f84400b3c80 2023-11-26T07:11:59.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.840+0000 7f844871f700 1 -- 172.21.15.2:0/1898456724 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84400a9df0 con 0x7f84400b3c80 2023-11-26T07:11:59.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.840+0000 7f8436ffd700 1 -- 172.21.15.2:0/1898456724 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84300038e0 con 0x7f84400b3c80 2023-11-26T07:11:59.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.840+0000 7f844871f700 1 -- 172.21.15.2:0/1898456724 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84400a9450 con 0x7f84400b3c80 2023-11-26T07:11:59.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.841+0000 7f844871f700 1 -- 172.21.15.2:0/1898456724 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84400b5de0 con 0x7f84400b3c80 2023-11-26T07:11:59.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.842+0000 7f8436ffd700 1 -- 172.21.15.2:0/1898456724 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8430003a40 con 0x7f84400b3c80 2023-11-26T07:11:59.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.842+0000 7f8436ffd700 1 --2- 172.21.15.2:0/1898456724 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f842406aed0 0x7f842406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:11:59.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.842+0000 7f8436ffd700 1 -- 172.21.15.2:0/1898456724 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f843008a900 con 0x7f84400b3c80 2023-11-26T07:11:59.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.842+0000 7f8445cba700 1 --2- 172.21.15.2:0/1898456724 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f842406aed0 0x7f842406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:11:59.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.843+0000 7f8445cba700 1 --2- 172.21.15.2:0/1898456724 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f842406aed0 0x7f842406d390 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f84400d0110 tx=0x7f843c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:11:59.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:11:59.846+0000 7f8436ffd700 1 -- 172.21.15.2:0/1898456724 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8430055b20 con 0x7f84400b3c80 2023-11-26T07:12:00.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.047+0000 7f844871f700 1 -- 172.21.15.2:0/1898456724 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84400aa5f0 con 0x7f84400b3c80 2023-11-26T07:12:00.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.048+0000 7f8436ffd700 1 -- 172.21.15.2:0/1898456724 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f84400aa5f0 con 0x7f84400b3c80 2023-11-26T07:12:00.050 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:12:00.051 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:11:35.634747+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:11:32.129474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:11:33.019837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:12:00.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.051+0000 7f844871f700 1 -- 172.21.15.2:0/1898456724 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f842406aed0 msgr2=0x7f842406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:00.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.051+0000 7f844871f700 1 --2- 172.21.15.2:0/1898456724 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f842406aed0 0x7f842406d390 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f84400d0110 tx=0x7f843c008040 comp rx=0 tx=0).stop 2023-11-26T07:12:00.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.051+0000 7f844871f700 1 -- 172.21.15.2:0/1898456724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84400b3c80 msgr2=0x7f84400aa8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:00.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.051+0000 7f844871f700 1 --2- 172.21.15.2:0/1898456724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84400b3c80 0x7f84400aa8d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8430009c40 tx=0x7f8430004750 comp rx=0 tx=0).stop 2023-11-26T07:12:00.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.051+0000 7f844871f700 1 -- 172.21.15.2:0/1898456724 shutdown_connections 2023-11-26T07:12:00.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.051+0000 7f844871f700 1 --2- 172.21.15.2:0/1898456724 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f842406aed0 0x7f842406d390 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:00.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.051+0000 7f844871f700 1 --2- 172.21.15.2:0/1898456724 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84401447b0 0x7f84400c5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:00.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.051+0000 7f844871f700 1 --2- 172.21.15.2:0/1898456724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84400b3c80 0x7f84400aa8d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:00.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.051+0000 7f844871f700 1 --2- 172.21.15.2:0/1898456724 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84400b4f50 0x7f844006b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:00.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.051+0000 7f844871f700 1 -- 172.21.15.2:0/1898456724 >> 172.21.15.2:0/1898456724 conn(0x7f84400b27d0 msgr2=0x7f8440143a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:00.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.051+0000 7f844871f700 1 -- 172.21.15.2:0/1898456724 shutdown_connections 2023-11-26T07:12:00.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.051+0000 7f844871f700 1 -- 172.21.15.2:0/1898456724 wait complete. 2023-11-26T07:12:00.065 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:11:28.205739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:11:32.129474+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:11:33.019837+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:12:00.065 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:12:00.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.191+0000 7efc59e1f700 1 Processor -- start 2023-11-26T07:12:00.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.191+0000 7efc59e1f700 1 -- start start 2023-11-26T07:12:00.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.192+0000 7efc59e1f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efc5406b620 0x7efc540b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:00.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.192+0000 7efc59e1f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7efc540b5ab0 0x7efc540b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:00.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.192+0000 7efc59e1f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc54071f50 con 0x7efc541478c0 2023-11-26T07:12:00.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.192+0000 7efc59e1f700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc54072230 con 0x7efc5406b620 2023-11-26T07:12:00.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.192+0000 7efc59e1f700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc54072510 con 0x7efc540b5ab0 2023-11-26T07:12:00.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.192+0000 7efc537fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efc5406b620 0x7efc540b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:00.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.192+0000 7efc537fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efc5406b620 0x7efc540b3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39744/0 (socket says 172.21.15.2:39744) 2023-11-26T07:12:00.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.192+0000 7efc537fe700 1 -- 172.21.15.2:0/2530638862 learned_addr learned my addr 172.21.15.2:0/2530638862 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:00.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.192+0000 7efc52ffd700 1 --2- 172.21.15.2:0/2530638862 >> v2:172.21.15.192:3300/0 conn(0x7efc540b5ab0 0x7efc540b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:00.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.192+0000 7efc537fe700 1 -- 172.21.15.2:0/2530638862 >> v2:172.21.15.192:3300/0 conn(0x7efc540b5ab0 msgr2=0x7efc540b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:00.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.192+0000 7efc537fe700 1 --2- 172.21.15.2:0/2530638862 >> v2:172.21.15.192:3300/0 conn(0x7efc540b5ab0 0x7efc540b3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:00.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.192+0000 7efc537fe700 1 -- 172.21.15.2:0/2530638862 >> v1:172.21.15.192:6789/0 conn(0x7efc541478c0 legacy=0x7efc54161ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:00.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.192+0000 7efc537fe700 1 -- 172.21.15.2:0/2530638862 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc540727f0 con 0x7efc5406b620 2023-11-26T07:12:00.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.193+0000 7efc537fe700 1 --2- 172.21.15.2:0/2530638862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc5406b620 0x7efc540b3a40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efc5406d6f0 tx=0x7efc3c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3db679d537183ad1 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:00.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.193+0000 7efc527fc700 1 -- 172.21.15.2:0/2530638862 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3c011830 con 0x7efc5406b620 2023-11-26T07:12:00.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.193+0000 7efc527fc700 1 -- 172.21.15.2:0/2530638862 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3c011990 con 0x7efc5406b620 2023-11-26T07:12:00.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.193+0000 7efc527fc700 1 -- 172.21.15.2:0/2530638862 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3c011d20 con 0x7efc5406b620 2023-11-26T07:12:00.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.193+0000 7efc59e1f700 1 -- 172.21.15.2:0/2530638862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc5406b620 msgr2=0x7efc540b3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:00.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.193+0000 7efc59e1f700 1 --2- 172.21.15.2:0/2530638862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc5406b620 0x7efc540b3a40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efc5406d6f0 tx=0x7efc3c009bd0 comp rx=0 tx=0).stop 2023-11-26T07:12:00.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.193+0000 7efc59e1f700 1 -- 172.21.15.2:0/2530638862 shutdown_connections 2023-11-26T07:12:00.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.193+0000 7efc59e1f700 1 --2- 172.21.15.2:0/2530638862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc5406b620 0x7efc540b3a40 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:00.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.193+0000 7efc59e1f700 1 --2- 172.21.15.2:0/2530638862 >> v2:172.21.15.192:3300/0 conn(0x7efc540b5ab0 0x7efc540b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:00.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.193+0000 7efc59e1f700 1 -- 172.21.15.2:0/2530638862 >> 172.21.15.2:0/2530638862 conn(0x7efc540b2740 msgr2=0x7efc540b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:00.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.193+0000 7efc59e1f700 1 -- 172.21.15.2:0/2530638862 shutdown_connections 2023-11-26T07:12:00.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.193+0000 7efc59e1f700 1 -- 172.21.15.2:0/2530638862 wait complete. 2023-11-26T07:12:00.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.195+0000 7efc59e1f700 1 Processor -- start 2023-11-26T07:12:00.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.195+0000 7efc59e1f700 1 -- start start 2023-11-26T07:12:00.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.195+0000 7efc59e1f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc5406b620 0x7efc541e2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:00.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.195+0000 7efc59e1f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc540b5ab0 0x7efc541df170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:00.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.195+0000 7efc59e1f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc541478c0 0x7efc541e3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:00.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.195+0000 7efc59e1f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc541df6b0 con 0x7efc541478c0 2023-11-26T07:12:00.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.195+0000 7efc59e1f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc541e3ad0 con 0x7efc540b5ab0 2023-11-26T07:12:00.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.196+0000 7efc59e1f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc541e3d00 con 0x7efc5406b620 2023-11-26T07:12:00.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.196+0000 7efc53fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc541478c0 0x7efc541e3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:00.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.196+0000 7efc53fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc541478c0 0x7efc541e3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39752/0 (socket says 172.21.15.2:39752) 2023-11-26T07:12:00.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.196+0000 7efc53fff700 1 -- 172.21.15.2:0/2574859346 learned_addr learned my addr 172.21.15.2:0/2574859346 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:00.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.196+0000 7efc537fe700 1 --2- 172.21.15.2:0/2574859346 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc5406b620 0x7efc541e2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:00.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.196+0000 7efc52ffd700 1 --2- 172.21.15.2:0/2574859346 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc540b5ab0 0x7efc541df170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:00.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.196+0000 7efc53fff700 1 -- 172.21.15.2:0/2574859346 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc5406b620 msgr2=0x7efc541e2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:00.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.196+0000 7efc53fff700 1 --2- 172.21.15.2:0/2574859346 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc5406b620 0x7efc541e2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:00.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.196+0000 7efc53fff700 1 -- 172.21.15.2:0/2574859346 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc540b5ab0 msgr2=0x7efc541df170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:00.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.196+0000 7efc53fff700 1 --2- 172.21.15.2:0/2574859346 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc540b5ab0 0x7efc541df170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:00.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.196+0000 7efc53fff700 1 -- 172.21.15.2:0/2574859346 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc3c009550 con 0x7efc541478c0 2023-11-26T07:12:00.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.196+0000 7efc52ffd700 1 --2- 172.21.15.2:0/2574859346 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc540b5ab0 0x7efc541df170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:00.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.196+0000 7efc53fff700 1 --2- 172.21.15.2:0/2574859346 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc541478c0 0x7efc541e3590 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7efc4c00cb50 tx=0x7efc4c00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:00.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.196+0000 7efc4bfff700 1 -- 172.21.15.2:0/2574859346 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c003c00 con 0x7efc541478c0 2023-11-26T07:12:00.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.196+0000 7efc4bfff700 1 -- 172.21.15.2:0/2574859346 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4c003d60 con 0x7efc541478c0 2023-11-26T07:12:00.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.196+0000 7efc59e1f700 1 -- 172.21.15.2:0/2574859346 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc541e3fe0 con 0x7efc541478c0 2023-11-26T07:12:00.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.196+0000 7efc4bfff700 1 -- 172.21.15.2:0/2574859346 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c00aac0 con 0x7efc541478c0 2023-11-26T07:12:00.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.196+0000 7efc59e1f700 1 -- 172.21.15.2:0/2574859346 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc541e45a0 con 0x7efc541478c0 2023-11-26T07:12:00.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.197+0000 7efc59e1f700 1 -- 172.21.15.2:0/2574859346 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc54075480 con 0x7efc541478c0 2023-11-26T07:12:00.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.198+0000 7efc4bfff700 1 -- 172.21.15.2:0/2574859346 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efc4c00ac20 con 0x7efc541478c0 2023-11-26T07:12:00.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.199+0000 7efc4bfff700 1 --2- 172.21.15.2:0/2574859346 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7efc3406aed0 0x7efc3406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:00.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.199+0000 7efc4bfff700 1 -- 172.21.15.2:0/2574859346 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc4c089f30 con 0x7efc541478c0 2023-11-26T07:12:00.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.199+0000 7efc537fe700 1 --2- 172.21.15.2:0/2574859346 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7efc3406aed0 0x7efc3406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:00.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.199+0000 7efc537fe700 1 --2- 172.21.15.2:0/2574859346 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7efc3406aed0 0x7efc3406d390 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efc3c009c10 tx=0x7efc3c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:00.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.202+0000 7efc4bfff700 1 -- 172.21.15.2:0/2574859346 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efc4c055150 con 0x7efc541478c0 2023-11-26T07:12:00.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.401+0000 7efc59e1f700 1 -- 172.21.15.2:0/2574859346 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efc5406bd40 con 0x7efc541478c0 2023-11-26T07:12:00.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.401+0000 7efc4bfff700 1 -- 172.21.15.2:0/2574859346 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7efc4c058770 con 0x7efc541478c0 2023-11-26T07:12:00.403 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-26T07:12:00.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.403+0000 7efc59e1f700 1 -- 172.21.15.2:0/2574859346 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7efc3406aed0 msgr2=0x7efc3406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:00.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.403+0000 7efc59e1f700 1 --2- 172.21.15.2:0/2574859346 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7efc3406aed0 0x7efc3406d390 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efc3c009c10 tx=0x7efc3c008030 comp rx=0 tx=0).stop 2023-11-26T07:12:00.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.403+0000 7efc59e1f700 1 -- 172.21.15.2:0/2574859346 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc541478c0 msgr2=0x7efc541e3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:00.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.403+0000 7efc59e1f700 1 --2- 172.21.15.2:0/2574859346 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc541478c0 0x7efc541e3590 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7efc4c00cb50 tx=0x7efc4c00ce60 comp rx=0 tx=0).stop 2023-11-26T07:12:00.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.403+0000 7efc59e1f700 1 -- 172.21.15.2:0/2574859346 shutdown_connections 2023-11-26T07:12:00.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.403+0000 7efc59e1f700 1 --2- 172.21.15.2:0/2574859346 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7efc3406aed0 0x7efc3406d390 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:00.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.403+0000 7efc59e1f700 1 --2- 172.21.15.2:0/2574859346 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc541478c0 0x7efc541e3590 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:00.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.403+0000 7efc59e1f700 1 --2- 172.21.15.2:0/2574859346 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc5406b620 0x7efc541e2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:00.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.403+0000 7efc59e1f700 1 --2- 172.21.15.2:0/2574859346 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc540b5ab0 0x7efc541df170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:00.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.403+0000 7efc59e1f700 1 -- 172.21.15.2:0/2574859346 >> 172.21.15.2:0/2574859346 conn(0x7efc540b2740 msgr2=0x7efc54146e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:00.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.403+0000 7efc59e1f700 1 -- 172.21.15.2:0/2574859346 shutdown_connections 2023-11-26T07:12:00.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.403+0000 7efc59e1f700 1 -- 172.21.15.2:0/2574859346 wait complete. 2023-11-26T07:12:00.417 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:12:00.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.544+0000 7f6644487700 1 Processor -- start 2023-11-26T07:12:00.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.544+0000 7f6644487700 1 -- start start 2023-11-26T07:12:00.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.545+0000 7f6644487700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f663c15ad70 0x7f663c0b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:00.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.545+0000 7f6644487700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f663c0adda0 0x7f663c06b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:00.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.545+0000 7f6644487700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f663c15b150 con 0x7f663c0b03b0 2023-11-26T07:12:00.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.545+0000 7f6644487700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f663c073610 con 0x7f663c0adda0 2023-11-26T07:12:00.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.545+0000 7f6644487700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f663c0b6380 con 0x7f663c15ad70 2023-11-26T07:12:00.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.545+0000 7f6641a22700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f663c0b03b0 0x7f663c0ad690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59200/0 (socket says 172.21.15.2:59200) 2023-11-26T07:12:00.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.545+0000 7f6641a22700 1 -- 172.21.15.2:0/3727417420 learned_addr learned my addr 172.21.15.2:0/3727417420 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:00.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.545+0000 7f6642223700 1 --2- 172.21.15.2:0/3727417420 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f663c15ad70 0x7f663c0b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:00.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.545+0000 7f6642a24700 1 --2- 172.21.15.2:0/3727417420 >> v2:172.21.15.192:3300/0 conn(0x7f663c0adda0 0x7f663c06b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:00.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.545+0000 7f6641221700 1 -- 172.21.15.2:0/3727417420 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 699096879 0 0) 0x7f663c15b150 con 0x7f663c0b03b0 2023-11-26T07:12:00.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.545+0000 7f6641221700 1 -- 172.21.15.2:0/3727417420 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66280035b0 con 0x7f663c0b03b0 2023-11-26T07:12:00.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.546+0000 7f6641221700 1 -- 172.21.15.2:0/3727417420 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 698211037 0 0) 0x7f66280035b0 con 0x7f663c0b03b0 2023-11-26T07:12:00.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.546+0000 7f6641221700 1 -- 172.21.15.2:0/3727417420 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f663c15ad70 msgr2=0x7f663c0b5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:00.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.546+0000 7f6641221700 1 --2- 172.21.15.2:0/3727417420 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f663c15ad70 0x7f663c0b5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:00.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.546+0000 7f6641221700 1 -- 172.21.15.2:0/3727417420 >> v2:172.21.15.192:3300/0 conn(0x7f663c0adda0 msgr2=0x7f663c06b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:00.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.546+0000 7f6641221700 1 --2- 172.21.15.2:0/3727417420 >> v2:172.21.15.192:3300/0 conn(0x7f663c0adda0 0x7f663c06b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:00.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.546+0000 7f6641221700 1 -- 172.21.15.2:0/3727417420 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f663c0b0ec0 con 0x7f663c0b03b0 2023-11-26T07:12:00.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.546+0000 7f6641221700 1 -- 172.21.15.2:0/3727417420 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f6638001670 con 0x7f663c0b03b0 2023-11-26T07:12:00.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.546+0000 7f6641221700 1 -- 172.21.15.2:0/3727417420 >> v1:172.21.15.2:6789/0 conn(0x7f663c0b03b0 legacy=0x7f663c0ad690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:00.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.546+0000 7f6641221700 1 --2- 172.21.15.2:0/3727417420 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f663c15ad70 0x7f6628003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:00.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.546+0000 7f6641221700 1 --2- 172.21.15.2:0/3727417420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6628003f80 0x7f6628004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:00.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.546+0000 7f6641221700 1 --2- 172.21.15.2:0/3727417420 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6628004d90 0x7f6628005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:00.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.546+0000 7f6641221700 1 -- 172.21.15.2:0/3727417420 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663c073610 con 0x7f6628003f80 2023-11-26T07:12:00.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.546+0000 7f6641221700 1 -- 172.21.15.2:0/3727417420 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663c0b6380 con 0x7f6628004d90 2023-11-26T07:12:00.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.546+0000 7f6641221700 1 -- 172.21.15.2:0/3727417420 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f662800dc20 con 0x7f663c15ad70 2023-11-26T07:12:00.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.546+0000 7f6641a22700 1 --2- 172.21.15.2:0/3727417420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6628003f80 0x7f6628004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:00.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.546+0000 7f6642223700 1 --2- 172.21.15.2:0/3727417420 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f663c15ad70 0x7f6628003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:00.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.546+0000 7f6642a24700 1 --2- 172.21.15.2:0/3727417420 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6628004d90 0x7f6628005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:00.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.546+0000 7f6641a22700 1 -- 172.21.15.2:0/3727417420 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f663c15ad70 msgr2=0x7f6628003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:00.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.546+0000 7f6641a22700 1 --2- 172.21.15.2:0/3727417420 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f663c15ad70 0x7f6628003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:00.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.546+0000 7f6641a22700 1 -- 172.21.15.2:0/3727417420 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6628004d90 msgr2=0x7f6628005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:00.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.546+0000 7f6641a22700 1 --2- 172.21.15.2:0/3727417420 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6628004d90 0x7f6628005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:00.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.546+0000 7f6641a22700 1 -- 172.21.15.2:0/3727417420 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66280035b0 con 0x7f6628003f80 2023-11-26T07:12:00.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.546+0000 7f6642a24700 1 --2- 172.21.15.2:0/3727417420 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6628004d90 0x7f6628005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:00.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.546+0000 7f6641a22700 1 --2- 172.21.15.2:0/3727417420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6628003f80 0x7f6628004850 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f663c0b0830 tx=0x7f6628005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=207f472a86614e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:00.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.546+0000 7f6641221700 1 -- 172.21.15.2:0/3727417420 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663800cda0 con 0x7f6628003f80 2023-11-26T07:12:00.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.547+0000 7f6641221700 1 -- 172.21.15.2:0/3727417420 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6638005960 con 0x7f6628003f80 2023-11-26T07:12:00.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.547+0000 7f6641221700 1 -- 172.21.15.2:0/3727417420 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6638005d10 con 0x7f6628003f80 2023-11-26T07:12:00.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.547+0000 7f6644487700 1 -- 172.21.15.2:0/3727417420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6628003f80 msgr2=0x7f6628004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:00.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.547+0000 7f6644487700 1 --2- 172.21.15.2:0/3727417420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6628003f80 0x7f6628004850 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f663c0b0830 tx=0x7f6628005880 comp rx=0 tx=0).stop 2023-11-26T07:12:00.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.547+0000 7f6642a24700 1 -- 172.21.15.2:0/3727417420 reap_dead start 2023-11-26T07:12:00.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.547+0000 7f6644487700 1 -- 172.21.15.2:0/3727417420 shutdown_connections 2023-11-26T07:12:00.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.547+0000 7f6644487700 1 -- 172.21.15.2:0/3727417420 >> 172.21.15.2:0/3727417420 conn(0x7f663c0b5070 msgr2=0x7f663c0b5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:00.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.547+0000 7f6644487700 1 -- 172.21.15.2:0/3727417420 shutdown_connections 2023-11-26T07:12:00.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.547+0000 7f6644487700 1 -- 172.21.15.2:0/3727417420 wait complete. 2023-11-26T07:12:00.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.548+0000 7f6644487700 1 Processor -- start 2023-11-26T07:12:00.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.548+0000 7f6644487700 1 -- start start 2023-11-26T07:12:00.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.549+0000 7f6644487700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6628003f80 0x7f663c06ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:00.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.549+0000 7f6644487700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f663c06e8c0 0x7f663c1516e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:00.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.549+0000 7f6644487700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f663c15da00 0x7f663c0726a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:00.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.549+0000 7f6644487700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663c1579f0 con 0x7f6628003f80 2023-11-26T07:12:00.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.549+0000 7f6644487700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663c157cd0 con 0x7f663c06e8c0 2023-11-26T07:12:00.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.549+0000 7f6644487700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f663c157fb0 con 0x7f663c15da00 2023-11-26T07:12:00.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.549+0000 7f6642223700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6628003f80 0x7f663c06ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:00.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.549+0000 7f6642223700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6628003f80 0x7f663c06ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39770/0 (socket says 172.21.15.2:39770) 2023-11-26T07:12:00.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.549+0000 7f6642223700 1 -- 172.21.15.2:0/1180336284 learned_addr learned my addr 172.21.15.2:0/1180336284 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:00.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.549+0000 7f6642a24700 1 --2- 172.21.15.2:0/1180336284 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f663c15da00 0x7f663c0726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:00.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.549+0000 7f6641a22700 1 --2- 172.21.15.2:0/1180336284 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f663c06e8c0 0x7f663c1516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:00.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.550+0000 7f6642223700 1 -- 172.21.15.2:0/1180336284 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f663c15da00 msgr2=0x7f663c0726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:00.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.550+0000 7f6642223700 1 --2- 172.21.15.2:0/1180336284 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f663c15da00 0x7f663c0726a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:00.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.550+0000 7f6642223700 1 -- 172.21.15.2:0/1180336284 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f663c06e8c0 msgr2=0x7f663c1516e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:00.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.550+0000 7f6642223700 1 --2- 172.21.15.2:0/1180336284 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f663c06e8c0 0x7f663c1516e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:00.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.550+0000 7f6642223700 1 -- 172.21.15.2:0/1180336284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f663c158290 con 0x7f6628003f80 2023-11-26T07:12:00.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.550+0000 7f6642223700 1 --2- 172.21.15.2:0/1180336284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6628003f80 0x7f663c06ed80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f662c011aa0 tx=0x7f662c011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:00.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.550+0000 7f6632ffd700 1 -- 172.21.15.2:0/1180336284 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c00f900 con 0x7f6628003f80 2023-11-26T07:12:00.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.550+0000 7f6632ffd700 1 -- 172.21.15.2:0/1180336284 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662c00fa60 con 0x7f6628003f80 2023-11-26T07:12:00.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.550+0000 7f6644487700 1 -- 172.21.15.2:0/1180336284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f663c15d4e0 con 0x7f6628003f80 2023-11-26T07:12:00.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.550+0000 7f6632ffd700 1 -- 172.21.15.2:0/1180336284 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c00fe10 con 0x7f6628003f80 2023-11-26T07:12:00.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.550+0000 7f6644487700 1 -- 172.21.15.2:0/1180336284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f663c151c20 con 0x7f6628003f80 2023-11-26T07:12:00.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.551+0000 7f6644487700 1 -- 172.21.15.2:0/1180336284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f663c15d850 con 0x7f6628003f80 2023-11-26T07:12:00.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.551+0000 7f6632ffd700 1 -- 172.21.15.2:0/1180336284 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f662c014440 con 0x7f6628003f80 2023-11-26T07:12:00.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.552+0000 7f6632ffd700 1 --2- 172.21.15.2:0/1180336284 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f662006af00 0x7f662006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:00.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.552+0000 7f6632ffd700 1 -- 172.21.15.2:0/1180336284 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f662c089c90 con 0x7f6628003f80 2023-11-26T07:12:00.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.552+0000 7f6641a22700 1 --2- 172.21.15.2:0/1180336284 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f662006af00 0x7f662006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:00.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.553+0000 7f6641a22700 1 --2- 172.21.15.2:0/1180336284 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f662006af00 0x7f662006d3c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6638000c00 tx=0x7f663800a000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:00.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.556+0000 7f6632ffd700 1 -- 172.21.15.2:0/1180336284 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f662c054e00 con 0x7f6628003f80 2023-11-26T07:12:00.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.758+0000 7f6644487700 1 -- 172.21.15.2:0/1180336284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f663c075480 con 0x7f6628003f80 2023-11-26T07:12:00.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.758+0000 7f6632ffd700 1 -- 172.21.15.2:0/1180336284 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f662c058420 con 0x7f6628003f80 2023-11-26T07:12:00.760 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-26T07:12:00.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.760+0000 7f6644487700 1 -- 172.21.15.2:0/1180336284 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f662006af00 msgr2=0x7f662006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:00.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.760+0000 7f6644487700 1 --2- 172.21.15.2:0/1180336284 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f662006af00 0x7f662006d3c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6638000c00 tx=0x7f663800a000 comp rx=0 tx=0).stop 2023-11-26T07:12:00.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.760+0000 7f6644487700 1 -- 172.21.15.2:0/1180336284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6628003f80 msgr2=0x7f663c06ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:00.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.760+0000 7f6644487700 1 --2- 172.21.15.2:0/1180336284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6628003f80 0x7f663c06ed80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f662c011aa0 tx=0x7f662c011e60 comp rx=0 tx=0).stop 2023-11-26T07:12:00.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.760+0000 7f6644487700 1 -- 172.21.15.2:0/1180336284 shutdown_connections 2023-11-26T07:12:00.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.760+0000 7f6644487700 1 --2- 172.21.15.2:0/1180336284 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f662006af00 0x7f662006d3c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:00.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.760+0000 7f6644487700 1 --2- 172.21.15.2:0/1180336284 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f663c15da00 0x7f663c0726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:00.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.760+0000 7f6644487700 1 --2- 172.21.15.2:0/1180336284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6628003f80 0x7f663c06ed80 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:00.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.760+0000 7f6644487700 1 --2- 172.21.15.2:0/1180336284 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f663c06e8c0 0x7f663c1516e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:00.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.760+0000 7f6644487700 1 -- 172.21.15.2:0/1180336284 >> 172.21.15.2:0/1180336284 conn(0x7f663c0b5070 msgr2=0x7f663c156280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:00.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.761+0000 7f6644487700 1 -- 172.21.15.2:0/1180336284 shutdown_connections 2023-11-26T07:12:00.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.761+0000 7f6644487700 1 -- 172.21.15.2:0/1180336284 wait complete. 2023-11-26T07:12:00.774 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:12:00.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.900+0000 7fad412f3700 1 Processor -- start 2023-11-26T07:12:00.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.901+0000 7fad412f3700 1 -- start start 2023-11-26T07:12:00.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.901+0000 7fad412f3700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fad3c0d0c50 0x7fad3c0d26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:00.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.901+0000 7fad412f3700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad3c0d4e20 con 0x7fad3c0d49f0 2023-11-26T07:12:00.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.901+0000 7fad412f3700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad3c0b5370 con 0x7fad3c0d0870 2023-11-26T07:12:00.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.901+0000 7fad412f3700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad3c0d2f80 con 0x7fad3c0d0c50 2023-11-26T07:12:00.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.901+0000 7fad3a7fc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fad3c0d0c50 0x7fad3c0d26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:00.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.901+0000 7fad3b7fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fad3c0d49f0 0x7fad3c0b6d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59224/0 (socket says 172.21.15.2:59224) 2023-11-26T07:12:00.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.902+0000 7fad3b7fe700 1 -- 172.21.15.2:0/2948117935 learned_addr learned my addr 172.21.15.2:0/2948117935 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:00.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.902+0000 7fad3a7fc700 1 -- 172.21.15.2:0/2948117935 >> v1:172.21.15.192:6789/0 conn(0x7fad3c0d0870 legacy=0x7fad3c0cf860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:00.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.902+0000 7fad3a7fc700 1 -- 172.21.15.2:0/2948117935 >> v1:172.21.15.2:6789/0 conn(0x7fad3c0d49f0 legacy=0x7fad3c0b6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:00.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.902+0000 7fad3a7fc700 1 -- 172.21.15.2:0/2948117935 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad3c0ceae0 con 0x7fad3c0d0c50 2023-11-26T07:12:00.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.902+0000 7fad39ffb700 1 -- 172.21.15.2:0/2948117935 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2649734037 0 0) 0x7fad3c0d4e20 con 0x7fad3c0d49f0 2023-11-26T07:12:00.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.902+0000 7fad3a7fc700 1 --2- 172.21.15.2:0/2948117935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad3c0d0c50 0x7fad3c0d26c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fad2c009840 tx=0x7fad2c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=723aa09d8524c371 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:00.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.902+0000 7fad39ffb700 1 -- 172.21.15.2:0/2948117935 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2c004230 con 0x7fad3c0d0c50 2023-11-26T07:12:00.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.902+0000 7fad39ffb700 1 -- 172.21.15.2:0/2948117935 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad2c004390 con 0x7fad3c0d0c50 2023-11-26T07:12:00.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.902+0000 7fad39ffb700 1 -- 172.21.15.2:0/2948117935 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2c0036a0 con 0x7fad3c0d0c50 2023-11-26T07:12:00.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.903+0000 7fad412f3700 1 -- 172.21.15.2:0/2948117935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad3c0d0c50 msgr2=0x7fad3c0d26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:00.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.903+0000 7fad412f3700 1 --2- 172.21.15.2:0/2948117935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad3c0d0c50 0x7fad3c0d26c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fad2c009840 tx=0x7fad2c009b50 comp rx=0 tx=0).stop 2023-11-26T07:12:00.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.903+0000 7fad412f3700 1 -- 172.21.15.2:0/2948117935 shutdown_connections 2023-11-26T07:12:00.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.903+0000 7fad412f3700 1 --2- 172.21.15.2:0/2948117935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad3c0d0c50 0x7fad3c0d26c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:00.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.903+0000 7fad412f3700 1 -- 172.21.15.2:0/2948117935 >> 172.21.15.2:0/2948117935 conn(0x7fad3c0d3ed0 msgr2=0x7fad3c0d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:00.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.903+0000 7fad412f3700 1 -- 172.21.15.2:0/2948117935 shutdown_connections 2023-11-26T07:12:00.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.903+0000 7fad412f3700 1 -- 172.21.15.2:0/2948117935 wait complete. 2023-11-26T07:12:00.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.904+0000 7fad412f3700 1 Processor -- start 2023-11-26T07:12:00.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.905+0000 7fad412f3700 1 -- start start 2023-11-26T07:12:00.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.905+0000 7fad412f3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad3c0d0870 0x7fad3c15bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:00.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.905+0000 7fad412f3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fad3c0d0c50 0x7fad3c15c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:00.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.905+0000 7fad412f3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad3c0d49f0 0x7fad3c14a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:00.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.905+0000 7fad412f3700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad3c0cff70 con 0x7fad3c0d0870 2023-11-26T07:12:00.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.905+0000 7fad412f3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad3c09f690 con 0x7fad3c0d49f0 2023-11-26T07:12:00.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.905+0000 7fad412f3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad3c09dc10 con 0x7fad3c0d0c50 2023-11-26T07:12:00.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.906+0000 7fad3affd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad3c0d0870 0x7fad3c15bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:00.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.906+0000 7fad3affd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad3c0d0870 0x7fad3c15bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39784/0 (socket says 172.21.15.2:39784) 2023-11-26T07:12:00.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.906+0000 7fad3affd700 1 -- 172.21.15.2:0/3888129085 learned_addr learned my addr 172.21.15.2:0/3888129085 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:00.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.906+0000 7fad3a7fc700 1 --2- 172.21.15.2:0/3888129085 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fad3c0d0c50 0x7fad3c15c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:00.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.906+0000 7fad3b7fe700 1 --2- 172.21.15.2:0/3888129085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad3c0d49f0 0x7fad3c14a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:00.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.906+0000 7fad3affd700 1 -- 172.21.15.2:0/3888129085 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fad3c0d0c50 msgr2=0x7fad3c15c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:00.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.906+0000 7fad3affd700 1 --2- 172.21.15.2:0/3888129085 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fad3c0d0c50 0x7fad3c15c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:00.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.906+0000 7fad3affd700 1 -- 172.21.15.2:0/3888129085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad3c0d49f0 msgr2=0x7fad3c14a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:00.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.906+0000 7fad3affd700 1 --2- 172.21.15.2:0/3888129085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad3c0d49f0 0x7fad3c14a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:00.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.906+0000 7fad3affd700 1 -- 172.21.15.2:0/3888129085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad2c0094a0 con 0x7fad3c0d0870 2023-11-26T07:12:00.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.906+0000 7fad3a7fc700 1 --2- 172.21.15.2:0/3888129085 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fad3c0d0c50 0x7fad3c15c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:12:00.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.906+0000 7fad3b7fe700 1 --2- 172.21.15.2:0/3888129085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad3c0d49f0 0x7fad3c14a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:12:00.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.906+0000 7fad3affd700 1 --2- 172.21.15.2:0/3888129085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad3c0d0870 0x7fad3c15bd00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fad3000c4d0 tx=0x7fad3000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:00.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.906+0000 7fad237fe700 1 -- 172.21.15.2:0/3888129085 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad30011790 con 0x7fad3c0d0870 2023-11-26T07:12:00.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.906+0000 7fad237fe700 1 -- 172.21.15.2:0/3888129085 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad300118f0 con 0x7fad3c0d0870 2023-11-26T07:12:00.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.906+0000 7fad412f3700 1 -- 172.21.15.2:0/3888129085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad3c09deb0 con 0x7fad3c0d0870 2023-11-26T07:12:00.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.906+0000 7fad237fe700 1 -- 172.21.15.2:0/3888129085 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad30011ca0 con 0x7fad3c0d0870 2023-11-26T07:12:00.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.906+0000 7fad412f3700 1 -- 172.21.15.2:0/3888129085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad3c148800 con 0x7fad3c0d0870 2023-11-26T07:12:00.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.907+0000 7fad412f3700 1 -- 172.21.15.2:0/3888129085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad3c148e50 con 0x7fad3c0d0870 2023-11-26T07:12:00.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.908+0000 7fad237fe700 1 -- 172.21.15.2:0/3888129085 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fad3001c460 con 0x7fad3c0d0870 2023-11-26T07:12:00.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.908+0000 7fad237fe700 1 --2- 172.21.15.2:0/3888129085 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fad2806aed0 0x7fad2806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:00.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.908+0000 7fad237fe700 1 -- 172.21.15.2:0/3888129085 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fad300893b0 con 0x7fad3c0d0870 2023-11-26T07:12:00.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.908+0000 7fad3a7fc700 1 --2- 172.21.15.2:0/3888129085 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fad2806aed0 0x7fad2806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:00.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.909+0000 7fad3a7fc700 1 --2- 172.21.15.2:0/3888129085 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fad2806aed0 0x7fad2806d390 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fad2c009840 tx=0x7fad2c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:00.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:00.913+0000 7fad237fe700 1 -- 172.21.15.2:0/3888129085 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fad300544f0 con 0x7fad3c0d0870 2023-11-26T07:12:01.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.115+0000 7fad412f3700 1 -- 172.21.15.2:0/3888129085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fad3c0b57c0 con 0x7fad3c0d0870 2023-11-26T07:12:01.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.115+0000 7fad237fe700 1 -- 172.21.15.2:0/3888129085 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fad30057b10 con 0x7fad3c0d0870 2023-11-26T07:12:01.117 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-26T07:12:01.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.117+0000 7fad412f3700 1 -- 172.21.15.2:0/3888129085 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fad2806aed0 msgr2=0x7fad2806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:01.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.117+0000 7fad412f3700 1 --2- 172.21.15.2:0/3888129085 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fad2806aed0 0x7fad2806d390 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fad2c009840 tx=0x7fad2c008030 comp rx=0 tx=0).stop 2023-11-26T07:12:01.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.117+0000 7fad412f3700 1 -- 172.21.15.2:0/3888129085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad3c0d0870 msgr2=0x7fad3c15bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:01.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.117+0000 7fad412f3700 1 --2- 172.21.15.2:0/3888129085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad3c0d0870 0x7fad3c15bd00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fad3000c4d0 tx=0x7fad3000c890 comp rx=0 tx=0).stop 2023-11-26T07:12:01.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.117+0000 7fad412f3700 1 -- 172.21.15.2:0/3888129085 shutdown_connections 2023-11-26T07:12:01.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.117+0000 7fad412f3700 1 --2- 172.21.15.2:0/3888129085 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fad2806aed0 0x7fad2806d390 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:01.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.117+0000 7fad412f3700 1 --2- 172.21.15.2:0/3888129085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad3c0d49f0 0x7fad3c14a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:01.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.117+0000 7fad412f3700 1 --2- 172.21.15.2:0/3888129085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad3c0d0870 0x7fad3c15bd00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:01.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.117+0000 7fad412f3700 1 --2- 172.21.15.2:0/3888129085 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fad3c0d0c50 0x7fad3c15c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:01.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.117+0000 7fad412f3700 1 -- 172.21.15.2:0/3888129085 >> 172.21.15.2:0/3888129085 conn(0x7fad3c0d3ed0 msgr2=0x7fad3c0cde10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:01.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.117+0000 7fad412f3700 1 -- 172.21.15.2:0/3888129085 shutdown_connections 2023-11-26T07:12:01.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.117+0000 7fad412f3700 1 -- 172.21.15.2:0/3888129085 wait complete. 2023-11-26T07:12:01.131 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:12:01.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.255+0000 7fcfd4145700 1 Processor -- start 2023-11-26T07:12:01.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.255+0000 7fcfd4145700 1 -- start start 2023-11-26T07:12:01.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.256+0000 7fcfd4145700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfcc15ad70 0x7fcfcc0b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:01.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.256+0000 7fcfd4145700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfcc15b150 con 0x7fcfcc0b03b0 2023-11-26T07:12:01.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.256+0000 7fcfd4145700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfcc0b0ec0 con 0x7fcfcc0adda0 2023-11-26T07:12:01.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.256+0000 7fcfd4145700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc073610 con 0x7fcfcc15ad70 2023-11-26T07:12:01.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.256+0000 7fcfd16e0700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fcfcc0b03b0 0x7fcfcc0ad690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59234/0 (socket says 172.21.15.2:59234) 2023-11-26T07:12:01.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.256+0000 7fcfd16e0700 1 -- 172.21.15.2:0/2644666194 learned_addr learned my addr 172.21.15.2:0/2644666194 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:01.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.256+0000 7fcfd1ee1700 1 --2- 172.21.15.2:0/2644666194 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfcc15ad70 0x7fcfcc0b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:01.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.256+0000 7fcfd0edf700 1 -- 172.21.15.2:0/2644666194 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 521165762 0 0) 0x7fcfcc15b150 con 0x7fcfcc0b03b0 2023-11-26T07:12:01.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.256+0000 7fcfd0edf700 1 -- 172.21.15.2:0/2644666194 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfb80035b0 con 0x7fcfcc0b03b0 2023-11-26T07:12:01.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.256+0000 7fcfd0edf700 1 -- 172.21.15.2:0/2644666194 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2969232903 0 0) 0x7fcfcc0b0ec0 con 0x7fcfcc0adda0 2023-11-26T07:12:01.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.256+0000 7fcfd0edf700 1 -- 172.21.15.2:0/2644666194 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfcc15b150 con 0x7fcfcc0adda0 2023-11-26T07:12:01.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.256+0000 7fcfd1ee1700 1 -- 172.21.15.2:0/2644666194 >> v1:172.21.15.192:6789/0 conn(0x7fcfcc0adda0 legacy=0x7fcfcc06b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:01.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.256+0000 7fcfd1ee1700 1 -- 172.21.15.2:0/2644666194 >> v1:172.21.15.2:6789/0 conn(0x7fcfcc0b03b0 legacy=0x7fcfcc0ad690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:01.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.256+0000 7fcfd1ee1700 1 -- 172.21.15.2:0/2644666194 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfcc0b0900 con 0x7fcfcc15ad70 2023-11-26T07:12:01.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.257+0000 7fcfd1ee1700 1 --2- 172.21.15.2:0/2644666194 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfcc15ad70 0x7fcfcc0b5e40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8009870 tx=0x7fcfc8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6d21bfa5d10d3a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:01.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.257+0000 7fcfd0edf700 1 -- 172.21.15.2:0/2644666194 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfbc001670 con 0x7fcfcc15ad70 2023-11-26T07:12:01.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.257+0000 7fcfd0edf700 1 -- 172.21.15.2:0/2644666194 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc8004030 con 0x7fcfcc15ad70 2023-11-26T07:12:01.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.257+0000 7fcfd0edf700 1 -- 172.21.15.2:0/2644666194 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc80043c0 con 0x7fcfcc15ad70 2023-11-26T07:12:01.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.257+0000 7fcfd4145700 1 -- 172.21.15.2:0/2644666194 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfcc15ad70 msgr2=0x7fcfcc0b5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:01.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.257+0000 7fcfd4145700 1 --2- 172.21.15.2:0/2644666194 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfcc15ad70 0x7fcfcc0b5e40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8009870 tx=0x7fcfc8009b80 comp rx=0 tx=0).stop 2023-11-26T07:12:01.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.257+0000 7fcfd4145700 1 -- 172.21.15.2:0/2644666194 shutdown_connections 2023-11-26T07:12:01.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.257+0000 7fcfd4145700 1 --2- 172.21.15.2:0/2644666194 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfcc15ad70 0x7fcfcc0b5e40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:01.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.257+0000 7fcfd4145700 1 -- 172.21.15.2:0/2644666194 >> 172.21.15.2:0/2644666194 conn(0x7fcfcc0b5070 msgr2=0x7fcfcc0b5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:01.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.257+0000 7fcfd4145700 1 -- 172.21.15.2:0/2644666194 shutdown_connections 2023-11-26T07:12:01.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.257+0000 7fcfd4145700 1 -- 172.21.15.2:0/2644666194 wait complete. 2023-11-26T07:12:01.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.259+0000 7fcfd4145700 1 Processor -- start 2023-11-26T07:12:01.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.259+0000 7fcfd4145700 1 -- start start 2023-11-26T07:12:01.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.259+0000 7fcfd4145700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfcc0adda0 0x7fcfcc09df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:01.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.259+0000 7fcfd4145700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfcc0b03b0 0x7fcfcc0d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:01.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.259+0000 7fcfd4145700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfcc15ad70 0x7fcfcc09b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:01.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.259+0000 7fcfd4145700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc09a370 con 0x7fcfcc0b03b0 2023-11-26T07:12:01.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.259+0000 7fcfd4145700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc09a650 con 0x7fcfcc15ad70 2023-11-26T07:12:01.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.259+0000 7fcfd4145700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc09a930 con 0x7fcfcc0adda0 2023-11-26T07:12:01.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.260+0000 7fcfd16e0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfcc0b03b0 0x7fcfcc0d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:01.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.260+0000 7fcfd16e0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfcc0b03b0 0x7fcfcc0d08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39798/0 (socket says 172.21.15.2:39798) 2023-11-26T07:12:01.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.260+0000 7fcfd16e0700 1 -- 172.21.15.2:0/3325203171 learned_addr learned my addr 172.21.15.2:0/3325203171 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:01.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.260+0000 7fcfd26e2700 1 --2- 172.21.15.2:0/3325203171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfcc15ad70 0x7fcfcc09b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:01.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.260+0000 7fcfd1ee1700 1 --2- 172.21.15.2:0/3325203171 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfcc0adda0 0x7fcfcc09df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:01.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.260+0000 7fcfd16e0700 1 -- 172.21.15.2:0/3325203171 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfcc0adda0 msgr2=0x7fcfcc09df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:01.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.260+0000 7fcfd16e0700 1 --2- 172.21.15.2:0/3325203171 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfcc0adda0 0x7fcfcc09df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:01.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.260+0000 7fcfd16e0700 1 -- 172.21.15.2:0/3325203171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfcc15ad70 msgr2=0x7fcfcc09b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:01.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.260+0000 7fcfd16e0700 1 --2- 172.21.15.2:0/3325203171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfcc15ad70 0x7fcfcc09b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:01.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.260+0000 7fcfd16e0700 1 -- 172.21.15.2:0/3325203171 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc80094a0 con 0x7fcfcc0b03b0 2023-11-26T07:12:01.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.260+0000 7fcfd1ee1700 1 --2- 172.21.15.2:0/3325203171 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfcc0adda0 0x7fcfcc09df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:01.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.260+0000 7fcfd16e0700 1 --2- 172.21.15.2:0/3325203171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfcc0b03b0 0x7fcfcc0d08e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc00c780 tx=0x7fcfbc00ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:01.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.260+0000 7fcfc27fc700 1 -- 172.21.15.2:0/3325203171 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfbc005d70 con 0x7fcfcc0b03b0 2023-11-26T07:12:01.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.260+0000 7fcfc27fc700 1 -- 172.21.15.2:0/3325203171 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfbc007070 con 0x7fcfcc0b03b0 2023-11-26T07:12:01.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.260+0000 7fcfd4145700 1 -- 172.21.15.2:0/3325203171 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfcc09ac10 con 0x7fcfcc0b03b0 2023-11-26T07:12:01.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.260+0000 7fcfc27fc700 1 -- 172.21.15.2:0/3325203171 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfbc007400 con 0x7fcfcc0b03b0 2023-11-26T07:12:01.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.260+0000 7fcfd4145700 1 -- 172.21.15.2:0/3325203171 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfcc0d0510 con 0x7fcfcc0b03b0 2023-11-26T07:12:01.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.261+0000 7fcfd4145700 1 -- 172.21.15.2:0/3325203171 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfcc0adbc0 con 0x7fcfcc0b03b0 2023-11-26T07:12:01.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.262+0000 7fcfc27fc700 1 -- 172.21.15.2:0/3325203171 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcfbc007560 con 0x7fcfcc0b03b0 2023-11-26T07:12:01.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.262+0000 7fcfc27fc700 1 --2- 172.21.15.2:0/3325203171 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fcfb006aed0 0x7fcfb006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:01.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.262+0000 7fcfc27fc700 1 -- 172.21.15.2:0/3325203171 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcfbc089240 con 0x7fcfcc0b03b0 2023-11-26T07:12:01.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.262+0000 7fcfd1ee1700 1 --2- 172.21.15.2:0/3325203171 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fcfb006aed0 0x7fcfb006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:01.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.263+0000 7fcfd1ee1700 1 --2- 172.21.15.2:0/3325203171 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fcfb006aed0 0x7fcfb006d390 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcfc80097c0 tx=0x7fcfc8008000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:01.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.267+0000 7fcfc27fc700 1 -- 172.21.15.2:0/3325203171 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcfbc054300 con 0x7fcfcc0b03b0 2023-11-26T07:12:01.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.470+0000 7fcfd4145700 1 -- 172.21.15.2:0/3325203171 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcfcc068670 con 0x7fcfcc0b03b0 2023-11-26T07:12:01.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.471+0000 7fcfc27fc700 1 -- 172.21.15.2:0/3325203171 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16457 (secure 0 0 0) 0x7fcfbc057920 con 0x7fcfcc0b03b0 2023-11-26T07:12:01.473 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:12:01.473 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:11:35.634747+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:11:32.129474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:11:33.019837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:12:01.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.473+0000 7fcfd4145700 1 -- 172.21.15.2:0/3325203171 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fcfb006aed0 msgr2=0x7fcfb006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:01.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.473+0000 7fcfd4145700 1 --2- 172.21.15.2:0/3325203171 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fcfb006aed0 0x7fcfb006d390 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcfc80097c0 tx=0x7fcfc8008000 comp rx=0 tx=0).stop 2023-11-26T07:12:01.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.473+0000 7fcfd4145700 1 -- 172.21.15.2:0/3325203171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfcc0b03b0 msgr2=0x7fcfcc0d08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:01.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.473+0000 7fcfd4145700 1 --2- 172.21.15.2:0/3325203171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfcc0b03b0 0x7fcfcc0d08e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc00c780 tx=0x7fcfbc00ca90 comp rx=0 tx=0).stop 2023-11-26T07:12:01.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.473+0000 7fcfd4145700 1 -- 172.21.15.2:0/3325203171 shutdown_connections 2023-11-26T07:12:01.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.473+0000 7fcfd4145700 1 --2- 172.21.15.2:0/3325203171 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fcfb006aed0 0x7fcfb006d390 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:01.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.473+0000 7fcfd4145700 1 --2- 172.21.15.2:0/3325203171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfcc15ad70 0x7fcfcc09b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:01.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.473+0000 7fcfd4145700 1 --2- 172.21.15.2:0/3325203171 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfcc0adda0 0x7fcfcc09df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:01.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.473+0000 7fcfd4145700 1 --2- 172.21.15.2:0/3325203171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfcc0b03b0 0x7fcfcc0d08e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:01.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.473+0000 7fcfd4145700 1 -- 172.21.15.2:0/3325203171 >> 172.21.15.2:0/3325203171 conn(0x7fcfcc0b5070 msgr2=0x7fcfcc0b1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:01.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.473+0000 7fcfd4145700 1 -- 172.21.15.2:0/3325203171 shutdown_connections 2023-11-26T07:12:01.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.473+0000 7fcfd4145700 1 -- 172.21.15.2:0/3325203171 wait complete. 2023-11-26T07:12:01.487 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:11:28.205739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:11:32.129474+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:11:33.019837+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:12:01.488 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:12:01.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.613+0000 7f21cf05a700 1 Processor -- start 2023-11-26T07:12:01.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.613+0000 7f21cf05a700 1 -- start start 2023-11-26T07:12:01.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.614+0000 7f21cf05a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f21c80cfde0 0x7f21c80d24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:01.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.614+0000 7f21cf05a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f21c80d2a10 0x7f21c80b4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:01.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.614+0000 7f21cf05a700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21c80b7810 con 0x7f21c815e190 2023-11-26T07:12:01.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.614+0000 7f21cf05a700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c80d1930 con 0x7f21c80cfde0 2023-11-26T07:12:01.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.614+0000 7f21cf05a700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c80d2ea0 con 0x7f21c80d2a10 2023-11-26T07:12:01.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.614+0000 7f21c7fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f21c80cfde0 0x7f21c80d24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:01.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.614+0000 7f21ccdf6700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f21c815e190 0x7f21c80d0f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59248/0 (socket says 172.21.15.2:59248) 2023-11-26T07:12:01.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.614+0000 7f21ccdf6700 1 -- 172.21.15.2:0/974003663 learned_addr learned my addr 172.21.15.2:0/974003663 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:01.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.615+0000 7f21c7fff700 1 -- 172.21.15.2:0/974003663 >> v2:172.21.15.192:3300/0 conn(0x7f21c80d2a10 msgr2=0x7f21c80b4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:01.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.615+0000 7f21c7fff700 1 --2- 172.21.15.2:0/974003663 >> v2:172.21.15.192:3300/0 conn(0x7f21c80d2a10 0x7f21c80b4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:01.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.615+0000 7f21c7fff700 1 -- 172.21.15.2:0/974003663 >> v1:172.21.15.2:6789/0 conn(0x7f21c815e190 legacy=0x7f21c80d0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:01.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.615+0000 7f21c77fe700 1 -- 172.21.15.2:0/974003663 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1300247317 0 0) 0x7f21c80b7810 con 0x7f21c815e190 2023-11-26T07:12:01.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.615+0000 7f21c7fff700 1 -- 172.21.15.2:0/974003663 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c80d1660 con 0x7f21c80cfde0 2023-11-26T07:12:01.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.615+0000 7f21c7fff700 1 --2- 172.21.15.2:0/974003663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21c80cfde0 0x7f21c80d24d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f21c80b7780 tx=0x7f21b4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94d9aaa4693fe547 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:01.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.615+0000 7f21c77fe700 1 -- 172.21.15.2:0/974003663 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b4011830 con 0x7f21c80cfde0 2023-11-26T07:12:01.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.615+0000 7f21c77fe700 1 -- 172.21.15.2:0/974003663 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b4011990 con 0x7f21c80cfde0 2023-11-26T07:12:01.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.615+0000 7f21c77fe700 1 -- 172.21.15.2:0/974003663 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b4011d20 con 0x7f21c80cfde0 2023-11-26T07:12:01.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.616+0000 7f21cf05a700 1 -- 172.21.15.2:0/974003663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21c80cfde0 msgr2=0x7f21c80d24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:01.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.616+0000 7f21cf05a700 1 --2- 172.21.15.2:0/974003663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21c80cfde0 0x7f21c80d24d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f21c80b7780 tx=0x7f21b4009b20 comp rx=0 tx=0).stop 2023-11-26T07:12:01.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.616+0000 7f21cf05a700 1 -- 172.21.15.2:0/974003663 shutdown_connections 2023-11-26T07:12:01.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.616+0000 7f21cf05a700 1 --2- 172.21.15.2:0/974003663 >> v2:172.21.15.192:3300/0 conn(0x7f21c80d2a10 0x7f21c80b4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:01.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.616+0000 7f21cf05a700 1 --2- 172.21.15.2:0/974003663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21c80cfde0 0x7f21c80d24d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:01.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.616+0000 7f21cf05a700 1 -- 172.21.15.2:0/974003663 >> 172.21.15.2:0/974003663 conn(0x7f21c809d180 msgr2=0x7f21c80d3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:01.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.616+0000 7f21cf05a700 1 -- 172.21.15.2:0/974003663 shutdown_connections 2023-11-26T07:12:01.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.616+0000 7f21cf05a700 1 -- 172.21.15.2:0/974003663 wait complete. 2023-11-26T07:12:01.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.617+0000 7f21cf05a700 1 Processor -- start 2023-11-26T07:12:01.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.617+0000 7f21cf05a700 1 -- start start 2023-11-26T07:12:01.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.618+0000 7f21cf05a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21c80cfde0 0x7f21c815b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:01.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.618+0000 7f21cf05a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21c80d2a10 0x7f21c80cd630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:01.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.618+0000 7f21cf05a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f21c815e190 0x7f21c81609e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:01.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.618+0000 7f21cf05a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c80c7970 con 0x7f21c80cfde0 2023-11-26T07:12:01.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.618+0000 7f21cf05a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c81f72b0 con 0x7f21c80d2a10 2023-11-26T07:12:01.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.618+0000 7f21cf05a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c81f7590 con 0x7f21c815e190 2023-11-26T07:12:01.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.618+0000 7f21ccdf6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21c80cfde0 0x7f21c815b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:01.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.618+0000 7f21ccdf6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21c80cfde0 0x7f21c815b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39812/0 (socket says 172.21.15.2:39812) 2023-11-26T07:12:01.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.619+0000 7f21ccdf6700 1 -- 172.21.15.2:0/1813876879 learned_addr learned my addr 172.21.15.2:0/1813876879 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:01.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.619+0000 7f21c7fff700 1 --2- 172.21.15.2:0/1813876879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21c80d2a10 0x7f21c80cd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:01.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.619+0000 7f21cd5f7700 1 --2- 172.21.15.2:0/1813876879 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f21c815e190 0x7f21c81609e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:01.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.619+0000 7f21ccdf6700 1 -- 172.21.15.2:0/1813876879 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f21c815e190 msgr2=0x7f21c81609e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:01.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.619+0000 7f21ccdf6700 1 --2- 172.21.15.2:0/1813876879 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f21c815e190 0x7f21c81609e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:01.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.619+0000 7f21ccdf6700 1 -- 172.21.15.2:0/1813876879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21c80d2a10 msgr2=0x7f21c80cd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:01.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.619+0000 7f21ccdf6700 1 --2- 172.21.15.2:0/1813876879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21c80d2a10 0x7f21c80cd630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:01.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.619+0000 7f21ccdf6700 1 -- 172.21.15.2:0/1813876879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b40094a0 con 0x7f21c80cfde0 2023-11-26T07:12:01.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.619+0000 7f21c7fff700 1 --2- 172.21.15.2:0/1813876879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21c80d2a10 0x7f21c80cd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:01.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.619+0000 7f21ccdf6700 1 --2- 172.21.15.2:0/1813876879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21c80cfde0 0x7f21c815b820 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f21bc00c550 tx=0x7f21bc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:01.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.619+0000 7f21c57fa700 1 -- 172.21.15.2:0/1813876879 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc004c80 con 0x7f21c80cfde0 2023-11-26T07:12:01.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.619+0000 7f21c57fa700 1 -- 172.21.15.2:0/1813876879 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21bc004e00 con 0x7f21c80cfde0 2023-11-26T07:12:01.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.619+0000 7f21cf05a700 1 -- 172.21.15.2:0/1813876879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c81f7870 con 0x7f21c80cfde0 2023-11-26T07:12:01.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.619+0000 7f21c57fa700 1 -- 172.21.15.2:0/1813876879 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc007310 con 0x7f21c80cfde0 2023-11-26T07:12:01.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.619+0000 7f21cf05a700 1 -- 172.21.15.2:0/1813876879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c815bd60 con 0x7f21c80cfde0 2023-11-26T07:12:01.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.620+0000 7f21cf05a700 1 -- 172.21.15.2:0/1813876879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21c8075480 con 0x7f21c80cfde0 2023-11-26T07:12:01.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.621+0000 7f21c57fa700 1 -- 172.21.15.2:0/1813876879 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f21bc007470 con 0x7f21c80cfde0 2023-11-26T07:12:01.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.621+0000 7f21c57fa700 1 --2- 172.21.15.2:0/1813876879 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f21ac06aed0 0x7f21ac06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:01.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.621+0000 7f21c57fa700 1 -- 172.21.15.2:0/1813876879 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21bc0892d0 con 0x7f21c80cfde0 2023-11-26T07:12:01.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.621+0000 7f21c7fff700 1 --2- 172.21.15.2:0/1813876879 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f21ac06aed0 0x7f21ac06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:01.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.622+0000 7f21c7fff700 1 --2- 172.21.15.2:0/1813876879 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f21ac06aed0 0x7f21ac06d390 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f21c80d01c0 tx=0x7f21b4008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:01.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.625+0000 7f21c57fa700 1 -- 172.21.15.2:0/1813876879 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f21bc054380 con 0x7f21c80cfde0 2023-11-26T07:12:01.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.823+0000 7f21cf05a700 1 -- 172.21.15.2:0/1813876879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f21c80d3170 con 0x7f21c80cfde0 2023-11-26T07:12:01.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.824+0000 7f21c57fa700 1 -- 172.21.15.2:0/1813876879 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f21bc0579a0 con 0x7f21c80cfde0 2023-11-26T07:12:01.826 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-26T07:12:01.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.826+0000 7f21cf05a700 1 -- 172.21.15.2:0/1813876879 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f21ac06aed0 msgr2=0x7f21ac06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:01.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.826+0000 7f21cf05a700 1 --2- 172.21.15.2:0/1813876879 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f21ac06aed0 0x7f21ac06d390 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f21c80d01c0 tx=0x7f21b4008030 comp rx=0 tx=0).stop 2023-11-26T07:12:01.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.826+0000 7f21cf05a700 1 -- 172.21.15.2:0/1813876879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21c80cfde0 msgr2=0x7f21c815b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:01.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.826+0000 7f21cf05a700 1 --2- 172.21.15.2:0/1813876879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21c80cfde0 0x7f21c815b820 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f21bc00c550 tx=0x7f21bc00c910 comp rx=0 tx=0).stop 2023-11-26T07:12:01.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.826+0000 7f21cf05a700 1 -- 172.21.15.2:0/1813876879 shutdown_connections 2023-11-26T07:12:01.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.826+0000 7f21cf05a700 1 --2- 172.21.15.2:0/1813876879 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f21ac06aed0 0x7f21ac06d390 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:01.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.826+0000 7f21cf05a700 1 --2- 172.21.15.2:0/1813876879 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f21c815e190 0x7f21c81609e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:01.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.826+0000 7f21cf05a700 1 --2- 172.21.15.2:0/1813876879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21c80cfde0 0x7f21c815b820 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:01.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.826+0000 7f21cf05a700 1 --2- 172.21.15.2:0/1813876879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21c80d2a10 0x7f21c80cd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:01.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.826+0000 7f21cf05a700 1 -- 172.21.15.2:0/1813876879 >> 172.21.15.2:0/1813876879 conn(0x7f21c809d180 msgr2=0x7f21c80d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:01.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.826+0000 7f21cf05a700 1 -- 172.21.15.2:0/1813876879 shutdown_connections 2023-11-26T07:12:01.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.826+0000 7f21cf05a700 1 -- 172.21.15.2:0/1813876879 wait complete. 2023-11-26T07:12:01.840 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:12:01.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.965+0000 7f7f97b98700 1 Processor -- start 2023-11-26T07:12:01.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.965+0000 7f7f97b98700 1 -- start start 2023-11-26T07:12:01.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.966+0000 7f7f97b98700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7f9006b620 0x7f7f900b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:01.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.966+0000 7f7f97b98700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f900b5ab0 0x7f7f900b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:01.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.966+0000 7f7f97b98700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f90071f50 con 0x7f7f901478c0 2023-11-26T07:12:01.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.966+0000 7f7f97b98700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f90072230 con 0x7f7f9006b620 2023-11-26T07:12:01.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.966+0000 7f7f97b98700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f90072510 con 0x7f7f900b5ab0 2023-11-26T07:12:01.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.966+0000 7f7f96135700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7f901478c0 0x7f7f90161ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59266/0 (socket says 172.21.15.2:59266) 2023-11-26T07:12:01.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.966+0000 7f7f96135700 1 -- 172.21.15.2:0/2443768906 learned_addr learned my addr 172.21.15.2:0/2443768906 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:01.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.967+0000 7f7f95934700 1 --2- 172.21.15.2:0/2443768906 >> v2:172.21.15.192:3300/0 conn(0x7f7f9006b620 0x7f7f900b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:01.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.967+0000 7f7f95133700 1 --2- 172.21.15.2:0/2443768906 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f900b5ab0 0x7f7f900b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:01.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.967+0000 7f7f94932700 1 -- 172.21.15.2:0/2443768906 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2368478150 0 0) 0x7f7f90071f50 con 0x7f7f901478c0 2023-11-26T07:12:01.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.967+0000 7f7f94932700 1 -- 172.21.15.2:0/2443768906 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f7c0035b0 con 0x7f7f901478c0 2023-11-26T07:12:01.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.967+0000 7f7f94932700 1 -- 172.21.15.2:0/2443768906 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 935850259 0 0) 0x7f7f7c0035b0 con 0x7f7f901478c0 2023-11-26T07:12:01.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.967+0000 7f7f94932700 1 -- 172.21.15.2:0/2443768906 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f900b5ab0 msgr2=0x7f7f900b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:01.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.967+0000 7f7f94932700 1 --2- 172.21.15.2:0/2443768906 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f900b5ab0 0x7f7f900b3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:01.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.967+0000 7f7f94932700 1 -- 172.21.15.2:0/2443768906 >> v2:172.21.15.192:3300/0 conn(0x7f7f9006b620 msgr2=0x7f7f900b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:01.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.967+0000 7f7f94932700 1 --2- 172.21.15.2:0/2443768906 >> v2:172.21.15.192:3300/0 conn(0x7f7f9006b620 0x7f7f900b3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:01.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.967+0000 7f7f94932700 1 -- 172.21.15.2:0/2443768906 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f900727f0 con 0x7f7f901478c0 2023-11-26T07:12:01.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.967+0000 7f7f94932700 1 -- 172.21.15.2:0/2443768906 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f7f880019f0 con 0x7f7f901478c0 2023-11-26T07:12:01.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.967+0000 7f7f94932700 1 -- 172.21.15.2:0/2443768906 >> v1:172.21.15.2:6789/0 conn(0x7f7f901478c0 legacy=0x7f7f90161ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:01.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.967+0000 7f7f94932700 1 --2- 172.21.15.2:0/2443768906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f7c003a00 0x7f7f7c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:01.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.967+0000 7f7f94932700 1 --2- 172.21.15.2:0/2443768906 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f900b5ab0 0x7f7f7c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:01.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.967+0000 7f7f94932700 1 --2- 172.21.15.2:0/2443768906 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f7c004d90 0x7f7f7c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:01.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.967+0000 7f7f94932700 1 -- 172.21.15.2:0/2443768906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f90072230 con 0x7f7f7c003a00 2023-11-26T07:12:01.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.967+0000 7f7f94932700 1 -- 172.21.15.2:0/2443768906 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f90072510 con 0x7f7f7c004d90 2023-11-26T07:12:01.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.967+0000 7f7f94932700 1 -- 172.21.15.2:0/2443768906 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7c00ba10 con 0x7f7f900b5ab0 2023-11-26T07:12:01.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.967+0000 7f7f95934700 1 --2- 172.21.15.2:0/2443768906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f7c003a00 0x7f7f7c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:01.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.967+0000 7f7f95133700 1 --2- 172.21.15.2:0/2443768906 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f900b5ab0 0x7f7f7c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:01.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.967+0000 7f7f96135700 1 --2- 172.21.15.2:0/2443768906 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f7c004d90 0x7f7f7c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:01.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.967+0000 7f7f95934700 1 -- 172.21.15.2:0/2443768906 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f900b5ab0 msgr2=0x7f7f7c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:01.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.967+0000 7f7f95934700 1 --2- 172.21.15.2:0/2443768906 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f900b5ab0 0x7f7f7c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:01.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.967+0000 7f7f95934700 1 -- 172.21.15.2:0/2443768906 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f7c004d90 msgr2=0x7f7f7c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:01.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.967+0000 7f7f95934700 1 --2- 172.21.15.2:0/2443768906 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f7c004d90 0x7f7f7c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:01.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.967+0000 7f7f95934700 1 -- 172.21.15.2:0/2443768906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f7c0035b0 con 0x7f7f7c003a00 2023-11-26T07:12:01.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.967+0000 7f7f96135700 1 --2- 172.21.15.2:0/2443768906 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f7c004d90 0x7f7f7c005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:01.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.968+0000 7f7f95934700 1 --2- 172.21.15.2:0/2443768906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f7c003a00 0x7f7f7c003e20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7f80009b60 tx=0x7f7f7c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=754729e951065a8a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:01.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.968+0000 7f7f94932700 1 -- 172.21.15.2:0/2443768906 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8000e6c0 con 0x7f7f7c003a00 2023-11-26T07:12:01.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.968+0000 7f7f94932700 1 -- 172.21.15.2:0/2443768906 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f8000e820 con 0x7f7f7c003a00 2023-11-26T07:12:01.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.968+0000 7f7f94932700 1 -- 172.21.15.2:0/2443768906 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8000eb90 con 0x7f7f7c003a00 2023-11-26T07:12:01.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.968+0000 7f7f97b98700 1 -- 172.21.15.2:0/2443768906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f7c003a00 msgr2=0x7f7f7c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:01.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.968+0000 7f7f97b98700 1 --2- 172.21.15.2:0/2443768906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f7c003a00 0x7f7f7c003e20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7f80009b60 tx=0x7f7f7c005880 comp rx=0 tx=0).stop 2023-11-26T07:12:01.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.968+0000 7f7f96135700 1 -- 172.21.15.2:0/2443768906 reap_dead start 2023-11-26T07:12:01.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.968+0000 7f7f97b98700 1 -- 172.21.15.2:0/2443768906 shutdown_connections 2023-11-26T07:12:01.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.968+0000 7f7f97b98700 1 -- 172.21.15.2:0/2443768906 >> 172.21.15.2:0/2443768906 conn(0x7f7f900b2740 msgr2=0x7f7f900b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:01.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.968+0000 7f7f97b98700 1 -- 172.21.15.2:0/2443768906 shutdown_connections 2023-11-26T07:12:01.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.968+0000 7f7f97b98700 1 -- 172.21.15.2:0/2443768906 wait complete. 2023-11-26T07:12:01.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.970+0000 7f7f97b98700 1 Processor -- start 2023-11-26T07:12:01.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.970+0000 7f7f97b98700 1 -- start start 2023-11-26T07:12:01.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.970+0000 7f7f97b98700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f7c003a00 0x7f7f90143720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:01.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.970+0000 7f7f97b98700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f900b1880 0x7f7f900b1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:01.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.970+0000 7f7f97b98700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f901450a0 0x7f7f90145530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:01.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.970+0000 7f7f97b98700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f900b2240 con 0x7f7f7c003a00 2023-11-26T07:12:01.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.970+0000 7f7f97b98700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f900c59b0 con 0x7f7f900b1880 2023-11-26T07:12:01.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.970+0000 7f7f97b98700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f90145e10 con 0x7f7f901450a0 2023-11-26T07:12:01.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.970+0000 7f7f95934700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f7c003a00 0x7f7f90143720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:01.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.971+0000 7f7f95934700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f7c003a00 0x7f7f90143720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39832/0 (socket says 172.21.15.2:39832) 2023-11-26T07:12:01.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.971+0000 7f7f95934700 1 -- 172.21.15.2:0/3286019779 learned_addr learned my addr 172.21.15.2:0/3286019779 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:01.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.971+0000 7f7f96135700 1 --2- 172.21.15.2:0/3286019779 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f901450a0 0x7f7f90145530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:01.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.971+0000 7f7f95133700 1 --2- 172.21.15.2:0/3286019779 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f900b1880 0x7f7f900b1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:01.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.971+0000 7f7f95934700 1 -- 172.21.15.2:0/3286019779 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f901450a0 msgr2=0x7f7f90145530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:01.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.971+0000 7f7f95934700 1 --2- 172.21.15.2:0/3286019779 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f901450a0 0x7f7f90145530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:01.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.971+0000 7f7f95934700 1 -- 172.21.15.2:0/3286019779 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f900b1880 msgr2=0x7f7f900b1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:01.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.971+0000 7f7f95934700 1 --2- 172.21.15.2:0/3286019779 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f900b1880 0x7f7f900b1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:01.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.971+0000 7f7f95934700 1 -- 172.21.15.2:0/3286019779 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f900c5c00 con 0x7f7f7c003a00 2023-11-26T07:12:01.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.971+0000 7f7f95934700 1 --2- 172.21.15.2:0/3286019779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f7c003a00 0x7f7f90143720 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7f800090b0 tx=0x7f7f800047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:01.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.971+0000 7f7f867fc700 1 -- 172.21.15.2:0/3286019779 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8000e6c0 con 0x7f7f7c003a00 2023-11-26T07:12:01.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.971+0000 7f7f867fc700 1 -- 172.21.15.2:0/3286019779 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f80003ad0 con 0x7f7f7c003a00 2023-11-26T07:12:01.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.971+0000 7f7f97b98700 1 -- 172.21.15.2:0/3286019779 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f900c5ee0 con 0x7f7f7c003a00 2023-11-26T07:12:01.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.971+0000 7f7f867fc700 1 -- 172.21.15.2:0/3286019779 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f80003e80 con 0x7f7f7c003a00 2023-11-26T07:12:01.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.971+0000 7f7f97b98700 1 -- 172.21.15.2:0/3286019779 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f90143c60 con 0x7f7f7c003a00 2023-11-26T07:12:01.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.972+0000 7f7f97b98700 1 -- 172.21.15.2:0/3286019779 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f900af6a0 con 0x7f7f7c003a00 2023-11-26T07:12:01.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.973+0000 7f7f867fc700 1 -- 172.21.15.2:0/3286019779 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7f80013470 con 0x7f7f7c003a00 2023-11-26T07:12:01.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.973+0000 7f7f867fc700 1 --2- 172.21.15.2:0/3286019779 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7f7406aed0 0x7f7f7406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:01.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.973+0000 7f7f867fc700 1 -- 172.21.15.2:0/3286019779 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f8008add0 con 0x7f7f7c003a00 2023-11-26T07:12:01.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.973+0000 7f7f95133700 1 --2- 172.21.15.2:0/3286019779 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7f7406aed0 0x7f7f7406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:01.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.974+0000 7f7f95133700 1 --2- 172.21.15.2:0/3286019779 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7f7406aed0 0x7f7f7406d390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7f900b5f10 tx=0x7f7f8c009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:01.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:01.977+0000 7f7f867fc700 1 -- 172.21.15.2:0/3286019779 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7f80055fd0 con 0x7f7f7c003a00 2023-11-26T07:12:02.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.180+0000 7f7f97b98700 1 -- 172.21.15.2:0/3286019779 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7f90075480 con 0x7f7f7c003a00 2023-11-26T07:12:02.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.180+0000 7f7f867fc700 1 -- 172.21.15.2:0/3286019779 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7f80017020 con 0x7f7f7c003a00 2023-11-26T07:12:02.182 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-26T07:12:02.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.183+0000 7f7f97b98700 1 -- 172.21.15.2:0/3286019779 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7f7406aed0 msgr2=0x7f7f7406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:02.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.183+0000 7f7f97b98700 1 --2- 172.21.15.2:0/3286019779 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7f7406aed0 0x7f7f7406d390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7f900b5f10 tx=0x7f7f8c009210 comp rx=0 tx=0).stop 2023-11-26T07:12:02.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.183+0000 7f7f97b98700 1 -- 172.21.15.2:0/3286019779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f7c003a00 msgr2=0x7f7f90143720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:02.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.183+0000 7f7f97b98700 1 --2- 172.21.15.2:0/3286019779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f7c003a00 0x7f7f90143720 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7f800090b0 tx=0x7f7f800047c0 comp rx=0 tx=0).stop 2023-11-26T07:12:02.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.183+0000 7f7f97b98700 1 -- 172.21.15.2:0/3286019779 shutdown_connections 2023-11-26T07:12:02.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.183+0000 7f7f97b98700 1 --2- 172.21.15.2:0/3286019779 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7f7406aed0 0x7f7f7406d390 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:02.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.183+0000 7f7f97b98700 1 --2- 172.21.15.2:0/3286019779 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f901450a0 0x7f7f90145530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:02.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.183+0000 7f7f97b98700 1 --2- 172.21.15.2:0/3286019779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f7c003a00 0x7f7f90143720 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:02.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.183+0000 7f7f97b98700 1 --2- 172.21.15.2:0/3286019779 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f900b1880 0x7f7f900b1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:02.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.183+0000 7f7f97b98700 1 -- 172.21.15.2:0/3286019779 >> 172.21.15.2:0/3286019779 conn(0x7f7f900b2740 msgr2=0x7f7f900b0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:02.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.183+0000 7f7f97b98700 1 -- 172.21.15.2:0/3286019779 shutdown_connections 2023-11-26T07:12:02.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.183+0000 7f7f97b98700 1 -- 172.21.15.2:0/3286019779 wait complete. 2023-11-26T07:12:02.197 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:12:02.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.323+0000 7fa10aca3700 1 Processor -- start 2023-11-26T07:12:02.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.323+0000 7fa10aca3700 1 -- start start 2023-11-26T07:12:02.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.324+0000 7fa10aca3700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa104143ae0 0x7fa1040b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:02.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.324+0000 7fa10aca3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa1040722c0 0x7fa10406e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:02.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.324+0000 7fa10aca3700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa104143ec0 con 0x7fa1041440f0 2023-11-26T07:12:02.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.324+0000 7fa10aca3700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1040b40a0 con 0x7fa104143ae0 2023-11-26T07:12:02.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.324+0000 7fa10aca3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1040b3ae0 con 0x7fa1040722c0 2023-11-26T07:12:02.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.324+0000 7fa108a3f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa104143ae0 0x7fa1040b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:02.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.324+0000 7fa109240700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa1040722c0 0x7fa10406e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:02.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.324+0000 7fa108a3f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa104143ae0 0x7fa1040b51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.2:48426/0 (socket says 172.21.15.2:48426) 2023-11-26T07:12:02.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.324+0000 7fa103fff700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fa1041440f0 0x7fa104071bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.2:38420/0 (socket says 172.21.15.2:38420) 2023-11-26T07:12:02.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.324+0000 7fa108a3f700 1 -- 172.21.15.2:0/4024223195 learned_addr learned my addr 172.21.15.2:0/4024223195 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:02.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.324+0000 7fa109240700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa1040722c0 0x7fa10406e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.2:37924/0 (socket says 172.21.15.2:37924) 2023-11-26T07:12:02.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.324+0000 7fa109240700 1 -- 172.21.15.2:0/4024223195 >> v2:172.21.15.192:3300/0 conn(0x7fa104143ae0 msgr2=0x7fa1040b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:02.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.325+0000 7fa109240700 1 --2- 172.21.15.2:0/4024223195 >> v2:172.21.15.192:3300/0 conn(0x7fa104143ae0 0x7fa1040b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:02.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.325+0000 7fa109240700 1 -- 172.21.15.2:0/4024223195 >> v1:172.21.15.192:6789/0 conn(0x7fa1041440f0 legacy=0x7fa104071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:02.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.325+0000 7fa1037fe700 1 -- 172.21.15.2:0/4024223195 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 799143469 0 0) 0x7fa104143ec0 con 0x7fa1041440f0 2023-11-26T07:12:02.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.325+0000 7fa109240700 1 -- 172.21.15.2:0/4024223195 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1040b3dc0 con 0x7fa1040722c0 2023-11-26T07:12:02.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.325+0000 7fa108a3f700 1 --2- 172.21.15.2:0/4024223195 >> v2:172.21.15.192:3300/0 conn(0x7fa104143ae0 0x7fa1040b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:12:02.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.325+0000 7fa109240700 1 --2- 172.21.15.2:0/4024223195 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa1040722c0 0x7fa10406e510 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc009d90 tx=0x7fa0fc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50d1f1284b18c8b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:02.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.325+0000 7fa1037fe700 1 -- 172.21.15.2:0/4024223195 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc00e070 con 0x7fa1040722c0 2023-11-26T07:12:02.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.325+0000 7fa1037fe700 1 -- 172.21.15.2:0/4024223195 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0fc00bb20 con 0x7fa1040722c0 2023-11-26T07:12:02.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.325+0000 7fa1037fe700 1 -- 172.21.15.2:0/4024223195 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc012430 con 0x7fa1040722c0 2023-11-26T07:12:02.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.325+0000 7fa10aca3700 1 -- 172.21.15.2:0/4024223195 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa1040722c0 msgr2=0x7fa10406e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:02.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.325+0000 7fa10aca3700 1 --2- 172.21.15.2:0/4024223195 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa1040722c0 0x7fa10406e510 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc009d90 tx=0x7fa0fc00b330 comp rx=0 tx=0).stop 2023-11-26T07:12:02.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.326+0000 7fa10aca3700 1 -- 172.21.15.2:0/4024223195 shutdown_connections 2023-11-26T07:12:02.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.326+0000 7fa10aca3700 1 --2- 172.21.15.2:0/4024223195 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa1040722c0 0x7fa10406e510 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:02.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.326+0000 7fa10aca3700 1 --2- 172.21.15.2:0/4024223195 >> v2:172.21.15.192:3300/0 conn(0x7fa104143ae0 0x7fa1040b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:02.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.326+0000 7fa10aca3700 1 -- 172.21.15.2:0/4024223195 >> 172.21.15.2:0/4024223195 conn(0x7fa1040b2740 msgr2=0x7fa1040b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:02.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.326+0000 7fa10aca3700 1 -- 172.21.15.2:0/4024223195 shutdown_connections 2023-11-26T07:12:02.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.326+0000 7fa10aca3700 1 -- 172.21.15.2:0/4024223195 wait complete. 2023-11-26T07:12:02.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.327+0000 7fa10aca3700 1 Processor -- start 2023-11-26T07:12:02.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.327+0000 7fa10aca3700 1 -- start start 2023-11-26T07:12:02.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.328+0000 7fa10aca3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa1040722c0 0x7fa1041599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:02.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.328+0000 7fa10aca3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa104143ae0 0x7fa104159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:02.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.328+0000 7fa10aca3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1041440f0 0x7fa10415e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:02.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.328+0000 7fa10aca3700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10413c9c0 con 0x7fa1041440f0 2023-11-26T07:12:02.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.328+0000 7fa10aca3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10413cca0 con 0x7fa104143ae0 2023-11-26T07:12:02.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.328+0000 7fa10aca3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa10413cf80 con 0x7fa1040722c0 2023-11-26T07:12:02.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.328+0000 7fa109240700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1041440f0 0x7fa10415e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:02.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.328+0000 7fa109240700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1041440f0 0x7fa10415e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39850/0 (socket says 172.21.15.2:39850) 2023-11-26T07:12:02.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.328+0000 7fa109240700 1 -- 172.21.15.2:0/1665238624 learned_addr learned my addr 172.21.15.2:0/1665238624 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:02.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.328+0000 7fa108a3f700 1 --2- 172.21.15.2:0/1665238624 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa1040722c0 0x7fa1041599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:02.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.328+0000 7fa103fff700 1 --2- 172.21.15.2:0/1665238624 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa104143ae0 0x7fa104159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:02.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.328+0000 7fa109240700 1 -- 172.21.15.2:0/1665238624 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa1040722c0 msgr2=0x7fa1041599f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:02.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.328+0000 7fa109240700 1 --2- 172.21.15.2:0/1665238624 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa1040722c0 0x7fa1041599f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:02.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.328+0000 7fa109240700 1 -- 172.21.15.2:0/1665238624 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa104143ae0 msgr2=0x7fa104159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:02.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.328+0000 7fa109240700 1 --2- 172.21.15.2:0/1665238624 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa104143ae0 0x7fa104159f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:02.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.328+0000 7fa109240700 1 -- 172.21.15.2:0/1665238624 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f800b7f0 con 0x7fa1041440f0 2023-11-26T07:12:02.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.328+0000 7fa109240700 1 --2- 172.21.15.2:0/1665238624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1041440f0 0x7fa10415e550 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc014040 tx=0x7fa0fc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:02.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.328+0000 7fa1017fa700 1 -- 172.21.15.2:0/1665238624 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc012430 con 0x7fa1041440f0 2023-11-26T07:12:02.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.329+0000 7fa1017fa700 1 -- 172.21.15.2:0/1665238624 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0fc020070 con 0x7fa1041440f0 2023-11-26T07:12:02.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.329+0000 7fa10aca3700 1 -- 172.21.15.2:0/1665238624 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0fc009a70 con 0x7fa1041440f0 2023-11-26T07:12:02.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.329+0000 7fa1017fa700 1 -- 172.21.15.2:0/1665238624 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc004280 con 0x7fa1041440f0 2023-11-26T07:12:02.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.329+0000 7fa10aca3700 1 -- 172.21.15.2:0/1665238624 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1040ce310 con 0x7fa1041440f0 2023-11-26T07:12:02.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.330+0000 7fa10aca3700 1 -- 172.21.15.2:0/1665238624 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa104075480 con 0x7fa1041440f0 2023-11-26T07:12:02.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.330+0000 7fa1017fa700 1 -- 172.21.15.2:0/1665238624 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa0fc0043e0 con 0x7fa1041440f0 2023-11-26T07:12:02.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.330+0000 7fa1017fa700 1 --2- 172.21.15.2:0/1665238624 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa0e806aed0 0x7fa0e806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:02.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.330+0000 7fa1017fa700 1 -- 172.21.15.2:0/1665238624 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa0fc022070 con 0x7fa1041440f0 2023-11-26T07:12:02.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.331+0000 7fa108a3f700 1 --2- 172.21.15.2:0/1665238624 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa0e806aed0 0x7fa0e806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:02.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.331+0000 7fa108a3f700 1 --2- 172.21.15.2:0/1665238624 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa0e806aed0 0x7fa0e806d390 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8006d30 tx=0x7fa0f800b4d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:02.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.335+0000 7fa1017fa700 1 -- 172.21.15.2:0/1665238624 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa0fc0562f0 con 0x7fa1041440f0 2023-11-26T07:12:02.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.535+0000 7fa10aca3700 1 -- 172.21.15.2:0/1665238624 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa1040b5d20 con 0x7fa1041440f0 2023-11-26T07:12:02.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.536+0000 7fa1017fa700 1 -- 172.21.15.2:0/1665238624 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa0fc059910 con 0x7fa1041440f0 2023-11-26T07:12:02.538 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-26T07:12:02.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.538+0000 7fa10aca3700 1 -- 172.21.15.2:0/1665238624 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa0e806aed0 msgr2=0x7fa0e806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:02.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.538+0000 7fa10aca3700 1 --2- 172.21.15.2:0/1665238624 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa0e806aed0 0x7fa0e806d390 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8006d30 tx=0x7fa0f800b4d0 comp rx=0 tx=0).stop 2023-11-26T07:12:02.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.538+0000 7fa10aca3700 1 -- 172.21.15.2:0/1665238624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1041440f0 msgr2=0x7fa10415e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:02.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.538+0000 7fa10aca3700 1 --2- 172.21.15.2:0/1665238624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1041440f0 0x7fa10415e550 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc014040 tx=0x7fa0fc004ad0 comp rx=0 tx=0).stop 2023-11-26T07:12:02.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.538+0000 7fa10aca3700 1 -- 172.21.15.2:0/1665238624 shutdown_connections 2023-11-26T07:12:02.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.538+0000 7fa10aca3700 1 --2- 172.21.15.2:0/1665238624 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa0e806aed0 0x7fa0e806d390 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:02.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.538+0000 7fa10aca3700 1 --2- 172.21.15.2:0/1665238624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1041440f0 0x7fa10415e550 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:02.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.538+0000 7fa10aca3700 1 --2- 172.21.15.2:0/1665238624 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa1040722c0 0x7fa1041599f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:02.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.538+0000 7fa10aca3700 1 --2- 172.21.15.2:0/1665238624 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa104143ae0 0x7fa104159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:02.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.538+0000 7fa10aca3700 1 -- 172.21.15.2:0/1665238624 >> 172.21.15.2:0/1665238624 conn(0x7fa1040b2740 msgr2=0x7fa10406b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:02.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.538+0000 7fa10aca3700 1 -- 172.21.15.2:0/1665238624 shutdown_connections 2023-11-26T07:12:02.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.538+0000 7fa10aca3700 1 -- 172.21.15.2:0/1665238624 wait complete. 2023-11-26T07:12:02.552 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:12:02.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.675+0000 7f861286a700 1 Processor -- start 2023-11-26T07:12:02.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.675+0000 7f861286a700 1 -- start start 2023-11-26T07:12:02.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.676+0000 7f861286a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f860c143ae0 0x7f860c0b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:02.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.676+0000 7f861286a700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f860c143ec0 con 0x7f860c1440f0 2023-11-26T07:12:02.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.676+0000 7f861286a700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f860c0b3ae0 con 0x7f860c0722c0 2023-11-26T07:12:02.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.676+0000 7f861286a700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f860c0b40a0 con 0x7f860c143ae0 2023-11-26T07:12:02.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.676+0000 7f860b7fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f860c1440f0 0x7f860c071bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59298/0 (socket says 172.21.15.2:59298) 2023-11-26T07:12:02.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.676+0000 7f860b7fe700 1 -- 172.21.15.2:0/1339291701 learned_addr learned my addr 172.21.15.2:0/1339291701 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:02.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.676+0000 7f860bfff700 1 --2- 172.21.15.2:0/1339291701 >> v2:172.21.15.192:3300/0 conn(0x7f860c143ae0 0x7f860c0b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:02.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.676+0000 7f860affd700 1 -- 172.21.15.2:0/1339291701 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 470496779 0 0) 0x7f860c143ec0 con 0x7f860c1440f0 2023-11-26T07:12:02.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.676+0000 7f860affd700 1 -- 172.21.15.2:0/1339291701 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85f40035b0 con 0x7f860c1440f0 2023-11-26T07:12:02.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.676+0000 7f860affd700 1 -- 172.21.15.2:0/1339291701 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3289941088 0 0) 0x7f85f40035b0 con 0x7f860c1440f0 2023-11-26T07:12:02.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.676+0000 7f860affd700 1 -- 172.21.15.2:0/1339291701 >> v2:172.21.15.192:3300/0 conn(0x7f860c143ae0 msgr2=0x7f860c0b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:02.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.676+0000 7f860affd700 1 --2- 172.21.15.2:0/1339291701 >> v2:172.21.15.192:3300/0 conn(0x7f860c143ae0 0x7f860c0b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:02.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.676+0000 7f860affd700 1 -- 172.21.15.2:0/1339291701 >> v1:172.21.15.192:6789/0 conn(0x7f860c0722c0 legacy=0x7f860c06e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:02.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.676+0000 7f860affd700 1 -- 172.21.15.2:0/1339291701 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f860c0b3dc0 con 0x7f860c1440f0 2023-11-26T07:12:02.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.676+0000 7f860affd700 1 -- 172.21.15.2:0/1339291701 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f85fc001670 con 0x7f860c1440f0 2023-11-26T07:12:02.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.676+0000 7f860affd700 1 -- 172.21.15.2:0/1339291701 >> v1:172.21.15.2:6789/0 conn(0x7f860c1440f0 legacy=0x7f860c071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:02.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.676+0000 7f860affd700 1 --2- 172.21.15.2:0/1339291701 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85f4003a00 0x7f85f4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:02.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.677+0000 7f860affd700 1 --2- 172.21.15.2:0/1339291701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85f4004850 0x7f85f4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:02.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.677+0000 7f860affd700 1 --2- 172.21.15.2:0/1339291701 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85f4005210 0x7f85f400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:02.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.677+0000 7f860affd700 1 -- 172.21.15.2:0/1339291701 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860c0b40a0 con 0x7f85f4004850 2023-11-26T07:12:02.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.677+0000 7f860affd700 1 -- 172.21.15.2:0/1339291701 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f400c0b0 con 0x7f85f4005210 2023-11-26T07:12:02.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.677+0000 7f860affd700 1 -- 172.21.15.2:0/1339291701 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f400c270 con 0x7f85f4003a00 2023-11-26T07:12:02.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.677+0000 7f860b7fe700 1 --2- 172.21.15.2:0/1339291701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85f4004850 0x7f85f4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:02.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.677+0000 7f860bfff700 1 --2- 172.21.15.2:0/1339291701 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85f4003a00 0x7f85f4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:02.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.677+0000 7f8610e07700 1 --2- 172.21.15.2:0/1339291701 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85f4005210 0x7f85f400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:02.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.677+0000 7f860b7fe700 1 -- 172.21.15.2:0/1339291701 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85f4003a00 msgr2=0x7f85f4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:02.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.677+0000 7f860b7fe700 1 --2- 172.21.15.2:0/1339291701 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85f4003a00 0x7f85f4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:02.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.677+0000 7f860b7fe700 1 -- 172.21.15.2:0/1339291701 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85f4005210 msgr2=0x7f85f400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:02.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.677+0000 7f860b7fe700 1 --2- 172.21.15.2:0/1339291701 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85f4005210 0x7f85f400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:02.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.677+0000 7f8610e07700 1 -- 172.21.15.2:0/1339291701 reap_dead start 2023-11-26T07:12:02.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.677+0000 7f860b7fe700 1 -- 172.21.15.2:0/1339291701 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f40035b0 con 0x7f85f4004850 2023-11-26T07:12:02.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.677+0000 7f860b7fe700 1 --2- 172.21.15.2:0/1339291701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85f4004850 0x7f85f4004cd0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f85fc00c240 tx=0x7f85f4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8912159660489926 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:02.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.677+0000 7f860affd700 1 -- 172.21.15.2:0/1339291701 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85fc007c10 con 0x7f85f4004850 2023-11-26T07:12:02.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.677+0000 7f860affd700 1 -- 172.21.15.2:0/1339291701 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85fc00cde0 con 0x7f85f4004850 2023-11-26T07:12:02.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.677+0000 7f860affd700 1 -- 172.21.15.2:0/1339291701 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85fc005ba0 con 0x7f85f4004850 2023-11-26T07:12:02.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.678+0000 7f861286a700 1 -- 172.21.15.2:0/1339291701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85f4004850 msgr2=0x7f85f4004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:02.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.678+0000 7f861286a700 1 --2- 172.21.15.2:0/1339291701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85f4004850 0x7f85f4004cd0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f85fc00c240 tx=0x7f85f4005880 comp rx=0 tx=0).stop 2023-11-26T07:12:02.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.678+0000 7f861286a700 1 -- 172.21.15.2:0/1339291701 shutdown_connections 2023-11-26T07:12:02.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.678+0000 7f861286a700 1 --2- 172.21.15.2:0/1339291701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85f4004850 0x7f85f4004cd0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:02.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.678+0000 7f861286a700 1 -- 172.21.15.2:0/1339291701 >> 172.21.15.2:0/1339291701 conn(0x7f860c0b2740 msgr2=0x7f860c0b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:02.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.678+0000 7f861286a700 1 -- 172.21.15.2:0/1339291701 shutdown_connections 2023-11-26T07:12:02.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.678+0000 7f861286a700 1 -- 172.21.15.2:0/1339291701 wait complete. 2023-11-26T07:12:02.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.679+0000 7f861286a700 1 Processor -- start 2023-11-26T07:12:02.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.679+0000 7f861286a700 1 -- start start 2023-11-26T07:12:02.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.680+0000 7f861286a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85f4004850 0x7f860c1e6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:02.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.680+0000 7f861286a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f860c13f450 0x7f860c15e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:02.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.680+0000 7f861286a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f860c15ec20 0x7f860c06afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:02.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.680+0000 7f861286a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860c15f0a0 con 0x7f860c13f450 2023-11-26T07:12:02.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.680+0000 7f861286a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860c1e6110 con 0x7f85f4004850 2023-11-26T07:12:02.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.680+0000 7f861286a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f860c15e230 con 0x7f860c15ec20 2023-11-26T07:12:02.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.680+0000 7f860b7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f860c13f450 0x7f860c15e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:02.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.680+0000 7f860b7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f860c13f450 0x7f860c15e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39868/0 (socket says 172.21.15.2:39868) 2023-11-26T07:12:02.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.680+0000 7f860b7fe700 1 -- 172.21.15.2:0/4156627605 learned_addr learned my addr 172.21.15.2:0/4156627605 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:02.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.680+0000 7f860b7fe700 1 -- 172.21.15.2:0/4156627605 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f860c15ec20 msgr2=0x7f860c06afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:02.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.680+0000 7f860bfff700 1 --2- 172.21.15.2:0/4156627605 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85f4004850 0x7f860c1e6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:02.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.680+0000 7f8610e07700 1 --2- 172.21.15.2:0/4156627605 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f860c15ec20 0x7f860c06afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:02.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.680+0000 7f860b7fe700 1 --2- 172.21.15.2:0/4156627605 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f860c15ec20 0x7f860c06afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:02.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.680+0000 7f860b7fe700 1 -- 172.21.15.2:0/4156627605 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85f4004850 msgr2=0x7f860c1e6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:02.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.680+0000 7f860b7fe700 1 --2- 172.21.15.2:0/4156627605 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85f4004850 0x7f860c1e6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:02.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.680+0000 7f860b7fe700 1 -- 172.21.15.2:0/4156627605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f860c15f2a0 con 0x7f860c13f450 2023-11-26T07:12:02.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.680+0000 7f860bfff700 1 --2- 172.21.15.2:0/4156627605 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85f4004850 0x7f860c1e6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:12:02.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.681+0000 7f860b7fe700 1 --2- 172.21.15.2:0/4156627605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f860c13f450 0x7f860c15e6e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f85f400c080 tx=0x7f85fc001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:02.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.681+0000 7f8608ff9700 1 -- 172.21.15.2:0/4156627605 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85fc000ed0 con 0x7f860c13f450 2023-11-26T07:12:02.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.681+0000 7f8608ff9700 1 -- 172.21.15.2:0/4156627605 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85fc0070d0 con 0x7f860c13f450 2023-11-26T07:12:02.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.681+0000 7f861286a700 1 -- 172.21.15.2:0/4156627605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f860c1e6360 con 0x7f860c13f450 2023-11-26T07:12:02.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.681+0000 7f8608ff9700 1 -- 172.21.15.2:0/4156627605 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85fc007460 con 0x7f860c13f450 2023-11-26T07:12:02.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.681+0000 7f861286a700 1 -- 172.21.15.2:0/4156627605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f860c1e6920 con 0x7f860c13f450 2023-11-26T07:12:02.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.682+0000 7f861286a700 1 -- 172.21.15.2:0/4156627605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f860c15f000 con 0x7f860c13f450 2023-11-26T07:12:02.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.682+0000 7f8608ff9700 1 -- 172.21.15.2:0/4156627605 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f85fc0075c0 con 0x7f860c13f450 2023-11-26T07:12:02.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.683+0000 7f8608ff9700 1 --2- 172.21.15.2:0/4156627605 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f85f806af00 0x7f85f806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:02.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.683+0000 7f8608ff9700 1 -- 172.21.15.2:0/4156627605 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f85fc08a500 con 0x7f860c13f450 2023-11-26T07:12:02.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.683+0000 7f860bfff700 1 --2- 172.21.15.2:0/4156627605 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f85f806af00 0x7f85f806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:02.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.683+0000 7f860bfff700 1 --2- 172.21.15.2:0/4156627605 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f85f806af00 0x7f85f806d3c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8600009bd0 tx=0x7f8600008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:02.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.687+0000 7f8608ff9700 1 -- 172.21.15.2:0/4156627605 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f85fc055640 con 0x7f860c13f450 2023-11-26T07:12:02.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.888+0000 7f861286a700 1 -- 172.21.15.2:0/4156627605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f860c068670 con 0x7f860c13f450 2023-11-26T07:12:02.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.890+0000 7f8608ff9700 1 -- 172.21.15.2:0/4156627605 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f85fc058c60 con 0x7f860c13f450 2023-11-26T07:12:02.892 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:12:02.892 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:11:35.634747+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:11:32.129474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:11:33.019837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:12:02.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.892+0000 7f861286a700 1 -- 172.21.15.2:0/4156627605 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f85f806af00 msgr2=0x7f85f806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:02.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.892+0000 7f861286a700 1 --2- 172.21.15.2:0/4156627605 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f85f806af00 0x7f85f806d3c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8600009bd0 tx=0x7f8600008040 comp rx=0 tx=0).stop 2023-11-26T07:12:02.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.892+0000 7f861286a700 1 -- 172.21.15.2:0/4156627605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f860c13f450 msgr2=0x7f860c15e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:02.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.892+0000 7f861286a700 1 --2- 172.21.15.2:0/4156627605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f860c13f450 0x7f860c15e6e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f85f400c080 tx=0x7f85fc001a00 comp rx=0 tx=0).stop 2023-11-26T07:12:02.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.892+0000 7f861286a700 1 -- 172.21.15.2:0/4156627605 shutdown_connections 2023-11-26T07:12:02.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.892+0000 7f861286a700 1 --2- 172.21.15.2:0/4156627605 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f85f806af00 0x7f85f806d3c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:02.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.892+0000 7f861286a700 1 --2- 172.21.15.2:0/4156627605 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f860c15ec20 0x7f860c06afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:02.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.892+0000 7f861286a700 1 --2- 172.21.15.2:0/4156627605 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85f4004850 0x7f860c1e6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:02.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.892+0000 7f861286a700 1 --2- 172.21.15.2:0/4156627605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f860c13f450 0x7f860c15e6e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:02.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.892+0000 7f861286a700 1 -- 172.21.15.2:0/4156627605 >> 172.21.15.2:0/4156627605 conn(0x7f860c0b2740 msgr2=0x7f860c142190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:02.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.892+0000 7f861286a700 1 -- 172.21.15.2:0/4156627605 shutdown_connections 2023-11-26T07:12:02.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:02.892+0000 7f861286a700 1 -- 172.21.15.2:0/4156627605 wait complete. 2023-11-26T07:12:02.906 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:11:28.205739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:11:32.129474+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:11:33.019837+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:12:02.906 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:12:03.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.032+0000 7f09fc646700 1 Processor -- start 2023-11-26T07:12:03.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.032+0000 7f09fc646700 1 -- start start 2023-11-26T07:12:03.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.033+0000 7f09fc646700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f09f40b4150 0x7f09f406de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:03.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.033+0000 7f09fc646700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f4071f50 con 0x7f09f406b620 2023-11-26T07:12:03.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.033+0000 7f09fc646700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f4072230 con 0x7f09f40b5ab0 2023-11-26T07:12:03.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.033+0000 7f09fc646700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f4072510 con 0x7f09f40b4150 2023-11-26T07:12:03.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.033+0000 7f09f9be1700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f09f40b4150 0x7f09f406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:03.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.033+0000 7f09fa3e2700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f09f406b620 0x7f09f40b3a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59316/0 (socket says 172.21.15.2:59316) 2023-11-26T07:12:03.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.033+0000 7f09fa3e2700 1 -- 172.21.15.2:0/3420927555 learned_addr learned my addr 172.21.15.2:0/3420927555 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:03.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.033+0000 7f09f9be1700 1 -- 172.21.15.2:0/3420927555 >> v1:172.21.15.192:6789/0 conn(0x7f09f40b5ab0 legacy=0x7f09f406e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:03.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.033+0000 7f09f9be1700 1 -- 172.21.15.2:0/3420927555 >> v1:172.21.15.2:6789/0 conn(0x7f09f406b620 legacy=0x7f09f40b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:03.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.033+0000 7f09f9be1700 1 -- 172.21.15.2:0/3420927555 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f40727f0 con 0x7f09f40b4150 2023-11-26T07:12:03.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.033+0000 7f09f93e0700 1 -- 172.21.15.2:0/3420927555 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 671021676 0 0) 0x7f09f4071f50 con 0x7f09f406b620 2023-11-26T07:12:03.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.033+0000 7f09f9be1700 1 --2- 172.21.15.2:0/3420927555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09f40b4150 0x7f09f406de50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f09e4009840 tx=0x7f09e4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=945bd76fe1ccfa19 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:03.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.033+0000 7f09f93e0700 1 -- 172.21.15.2:0/3420927555 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e4004230 con 0x7f09f40b4150 2023-11-26T07:12:03.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.033+0000 7f09f93e0700 1 -- 172.21.15.2:0/3420927555 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e4004390 con 0x7f09f40b4150 2023-11-26T07:12:03.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.033+0000 7f09f93e0700 1 -- 172.21.15.2:0/3420927555 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e40036a0 con 0x7f09f40b4150 2023-11-26T07:12:03.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.034+0000 7f09fc646700 1 -- 172.21.15.2:0/3420927555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09f40b4150 msgr2=0x7f09f406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:03.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.034+0000 7f09fc646700 1 --2- 172.21.15.2:0/3420927555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09f40b4150 0x7f09f406de50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f09e4009840 tx=0x7f09e4009b50 comp rx=0 tx=0).stop 2023-11-26T07:12:03.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.034+0000 7f09fc646700 1 -- 172.21.15.2:0/3420927555 shutdown_connections 2023-11-26T07:12:03.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.034+0000 7f09fc646700 1 --2- 172.21.15.2:0/3420927555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09f40b4150 0x7f09f406de50 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:03.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.034+0000 7f09fc646700 1 -- 172.21.15.2:0/3420927555 >> 172.21.15.2:0/3420927555 conn(0x7f09f40b2740 msgr2=0x7f09f40b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:03.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.034+0000 7f09fc646700 1 -- 172.21.15.2:0/3420927555 shutdown_connections 2023-11-26T07:12:03.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.034+0000 7f09fc646700 1 -- 172.21.15.2:0/3420927555 wait complete. 2023-11-26T07:12:03.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.035+0000 7f09fc646700 1 Processor -- start 2023-11-26T07:12:03.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.035+0000 7f09fc646700 1 -- start start 2023-11-26T07:12:03.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.036+0000 7f09fc646700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09f406b620 0x7f09f41e51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:03.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.036+0000 7f09fc646700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09f40b4150 0x7f09f4133110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:03.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.036+0000 7f09fc646700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f09f40b5ab0 0x7f09f4133650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:03.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.036+0000 7f09fc646700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f4131080 con 0x7f09f40b4150 2023-11-26T07:12:03.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.036+0000 7f09fc646700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f4143960 con 0x7f09f406b620 2023-11-26T07:12:03.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.036+0000 7f09fc646700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f4133c60 con 0x7f09f40b5ab0 2023-11-26T07:12:03.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.036+0000 7f09f9be1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09f40b4150 0x7f09f4133110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:03.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.036+0000 7f09f9be1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09f40b4150 0x7f09f4133110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39882/0 (socket says 172.21.15.2:39882) 2023-11-26T07:12:03.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.036+0000 7f09f9be1700 1 -- 172.21.15.2:0/289537251 learned_addr learned my addr 172.21.15.2:0/289537251 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:03.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.036+0000 7f09fa3e2700 1 --2- 172.21.15.2:0/289537251 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09f406b620 0x7f09f41e51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:03.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.037+0000 7f09fabe3700 1 --2- 172.21.15.2:0/289537251 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f09f40b5ab0 0x7f09f4133650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:03.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.037+0000 7f09f9be1700 1 -- 172.21.15.2:0/289537251 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f09f40b5ab0 msgr2=0x7f09f4133650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:03.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.037+0000 7f09f9be1700 1 --2- 172.21.15.2:0/289537251 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f09f40b5ab0 0x7f09f4133650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:03.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.037+0000 7f09f9be1700 1 -- 172.21.15.2:0/289537251 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09f406b620 msgr2=0x7f09f41e51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:03.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.037+0000 7f09f9be1700 1 --2- 172.21.15.2:0/289537251 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09f406b620 0x7f09f41e51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:03.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.037+0000 7f09f9be1700 1 -- 172.21.15.2:0/289537251 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e40094a0 con 0x7f09f40b4150 2023-11-26T07:12:03.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.037+0000 7f09fa3e2700 1 --2- 172.21.15.2:0/289537251 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09f406b620 0x7f09f41e51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:12:03.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.037+0000 7f09fabe3700 1 --2- 172.21.15.2:0/289537251 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f09f40b5ab0 0x7f09f4133650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:12:03.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.037+0000 7f09f9be1700 1 --2- 172.21.15.2:0/289537251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09f40b4150 0x7f09f4133110 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f09e40090b0 tx=0x7f09e4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:03.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.037+0000 7f09eaffd700 1 -- 172.21.15.2:0/289537251 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e4011830 con 0x7f09f40b4150 2023-11-26T07:12:03.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.037+0000 7f09eaffd700 1 -- 172.21.15.2:0/289537251 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e401e070 con 0x7f09f40b4150 2023-11-26T07:12:03.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.037+0000 7f09fc646700 1 -- 172.21.15.2:0/289537251 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f4133f40 con 0x7f09f40b4150 2023-11-26T07:12:03.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.037+0000 7f09eaffd700 1 -- 172.21.15.2:0/289537251 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e4011bb0 con 0x7f09f40b4150 2023-11-26T07:12:03.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.037+0000 7f09fc646700 1 -- 172.21.15.2:0/289537251 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f4131620 con 0x7f09f40b4150 2023-11-26T07:12:03.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.038+0000 7f09fc646700 1 -- 172.21.15.2:0/289537251 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f406da70 con 0x7f09f40b4150 2023-11-26T07:12:03.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.039+0000 7f09eaffd700 1 -- 172.21.15.2:0/289537251 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f09e4011d10 con 0x7f09f40b4150 2023-11-26T07:12:03.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.039+0000 7f09eaffd700 1 --2- 172.21.15.2:0/289537251 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f09d806aed0 0x7f09d806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:03.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.039+0000 7f09eaffd700 1 -- 172.21.15.2:0/289537251 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f09e408aa00 con 0x7f09f40b4150 2023-11-26T07:12:03.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.039+0000 7f09fa3e2700 1 --2- 172.21.15.2:0/289537251 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f09d806aed0 0x7f09d806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:03.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.040+0000 7f09fa3e2700 1 --2- 172.21.15.2:0/289537251 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f09d806aed0 0x7f09d806d390 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f09f0007fd0 tx=0x7f09f0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:03.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.043+0000 7f09eaffd700 1 -- 172.21.15.2:0/289537251 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f09e4055ab0 con 0x7f09f40b4150 2023-11-26T07:12:03.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.246+0000 7f09fc646700 1 -- 172.21.15.2:0/289537251 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f09f4075480 con 0x7f09f40b4150 2023-11-26T07:12:03.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.247+0000 7f09eaffd700 1 -- 172.21.15.2:0/289537251 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f09e4020020 con 0x7f09f40b4150 2023-11-26T07:12:03.249 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-26T07:12:03.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.249+0000 7f09fc646700 1 -- 172.21.15.2:0/289537251 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f09d806aed0 msgr2=0x7f09d806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:03.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.249+0000 7f09fc646700 1 --2- 172.21.15.2:0/289537251 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f09d806aed0 0x7f09d806d390 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f09f0007fd0 tx=0x7f09f0009040 comp rx=0 tx=0).stop 2023-11-26T07:12:03.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.249+0000 7f09fc646700 1 -- 172.21.15.2:0/289537251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09f40b4150 msgr2=0x7f09f4133110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:03.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.249+0000 7f09fc646700 1 --2- 172.21.15.2:0/289537251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09f40b4150 0x7f09f4133110 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f09e40090b0 tx=0x7f09e4004750 comp rx=0 tx=0).stop 2023-11-26T07:12:03.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.249+0000 7f09fc646700 1 -- 172.21.15.2:0/289537251 shutdown_connections 2023-11-26T07:12:03.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.249+0000 7f09fc646700 1 --2- 172.21.15.2:0/289537251 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f09d806aed0 0x7f09d806d390 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:03.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.249+0000 7f09fc646700 1 --2- 172.21.15.2:0/289537251 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f09f40b5ab0 0x7f09f4133650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:03.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.249+0000 7f09fc646700 1 --2- 172.21.15.2:0/289537251 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09f406b620 0x7f09f41e51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:03.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.249+0000 7f09fc646700 1 --2- 172.21.15.2:0/289537251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09f40b4150 0x7f09f4133110 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:03.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.249+0000 7f09fc646700 1 -- 172.21.15.2:0/289537251 >> 172.21.15.2:0/289537251 conn(0x7f09f40b2740 msgr2=0x7f09f41e5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:03.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.249+0000 7f09fc646700 1 -- 172.21.15.2:0/289537251 shutdown_connections 2023-11-26T07:12:03.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.249+0000 7f09fc646700 1 -- 172.21.15.2:0/289537251 wait complete. 2023-11-26T07:12:03.263 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:12:03.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.389+0000 7f4e014ca700 1 Processor -- start 2023-11-26T07:12:03.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.389+0000 7f4e014ca700 1 -- start start 2023-11-26T07:12:03.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.390+0000 7f4e014ca700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4dfc15a820 0x7f4dfc06b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:03.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.390+0000 7f4e014ca700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dfc0b05f0 con 0x7f4dfc15a440 2023-11-26T07:12:03.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.390+0000 7f4e014ca700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dfc15f080 con 0x7f4dfc0d06b0 2023-11-26T07:12:03.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.390+0000 7f4e014ca700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dfc0afd50 con 0x7f4dfc15a820 2023-11-26T07:12:03.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.390+0000 7f4dfaffd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f4dfc15a440 0x7f4dfc0cffa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59330/0 (socket says 172.21.15.2:59330) 2023-11-26T07:12:03.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.390+0000 7f4dfaffd700 1 -- 172.21.15.2:0/3879996514 learned_addr learned my addr 172.21.15.2:0/3879996514 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:03.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.390+0000 7f4dfa7fc700 1 --2- 172.21.15.2:0/3879996514 >> v2:172.21.15.192:3300/0 conn(0x7f4dfc15a820 0x7f4dfc06b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:03.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.390+0000 7f4df9ffb700 1 -- 172.21.15.2:0/3879996514 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 251410974 0 0) 0x7f4dfc0b05f0 con 0x7f4dfc15a440 2023-11-26T07:12:03.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.390+0000 7f4df9ffb700 1 -- 172.21.15.2:0/3879996514 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4de40035b0 con 0x7f4dfc15a440 2023-11-26T07:12:03.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.391+0000 7f4df9ffb700 1 -- 172.21.15.2:0/3879996514 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 604146489 0 0) 0x7f4de40035b0 con 0x7f4dfc15a440 2023-11-26T07:12:03.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.391+0000 7f4df9ffb700 1 -- 172.21.15.2:0/3879996514 >> v2:172.21.15.192:3300/0 conn(0x7f4dfc15a820 msgr2=0x7f4dfc06b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:03.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.391+0000 7f4df9ffb700 1 --2- 172.21.15.2:0/3879996514 >> v2:172.21.15.192:3300/0 conn(0x7f4dfc15a820 0x7f4dfc06b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:03.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.391+0000 7f4df9ffb700 1 -- 172.21.15.2:0/3879996514 >> v1:172.21.15.192:6789/0 conn(0x7f4dfc0d06b0 legacy=0x7f4dfc06b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:03.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.391+0000 7f4df9ffb700 1 -- 172.21.15.2:0/3879996514 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dfc0b0030 con 0x7f4dfc15a440 2023-11-26T07:12:03.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.391+0000 7f4df9ffb700 1 -- 172.21.15.2:0/3879996514 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f4df0001670 con 0x7f4dfc15a440 2023-11-26T07:12:03.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.391+0000 7f4df9ffb700 1 -- 172.21.15.2:0/3879996514 >> v1:172.21.15.2:6789/0 conn(0x7f4dfc15a440 legacy=0x7f4dfc0cffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:03.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.391+0000 7f4df9ffb700 1 --2- 172.21.15.2:0/3879996514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4de4003a00 0x7f4de4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:03.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.391+0000 7f4df9ffb700 1 --2- 172.21.15.2:0/3879996514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4de4004850 0x7f4de4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:03.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.391+0000 7f4df9ffb700 1 --2- 172.21.15.2:0/3879996514 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4de4005210 0x7f4de400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:03.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.391+0000 7f4df9ffb700 1 -- 172.21.15.2:0/3879996514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc0afd50 con 0x7f4de4003a00 2023-11-26T07:12:03.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.391+0000 7f4df9ffb700 1 -- 172.21.15.2:0/3879996514 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de400e370 con 0x7f4de4004850 2023-11-26T07:12:03.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.391+0000 7f4df9ffb700 1 -- 172.21.15.2:0/3879996514 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de400e530 con 0x7f4de4005210 2023-11-26T07:12:03.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.391+0000 7f4dfaffd700 1 --2- 172.21.15.2:0/3879996514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4de4003a00 0x7f4de4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:03.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.391+0000 7f4dfa7fc700 1 --2- 172.21.15.2:0/3879996514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4de4004850 0x7f4de4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:03.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.391+0000 7f4dfb7fe700 1 --2- 172.21.15.2:0/3879996514 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4de4005210 0x7f4de400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:03.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.391+0000 7f4dfaffd700 1 -- 172.21.15.2:0/3879996514 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4de4005210 msgr2=0x7f4de400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:03.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.391+0000 7f4dfaffd700 1 --2- 172.21.15.2:0/3879996514 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4de4005210 0x7f4de400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:03.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.391+0000 7f4dfaffd700 1 -- 172.21.15.2:0/3879996514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4de4004850 msgr2=0x7f4de4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:03.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.391+0000 7f4dfaffd700 1 --2- 172.21.15.2:0/3879996514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4de4004850 0x7f4de4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:03.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.391+0000 7f4dfaffd700 1 -- 172.21.15.2:0/3879996514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de40035b0 con 0x7f4de4003a00 2023-11-26T07:12:03.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.391+0000 7f4dfa7fc700 1 --2- 172.21.15.2:0/3879996514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4de4004850 0x7f4de4004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:03.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.391+0000 7f4dfb7fe700 1 -- 172.21.15.2:0/3879996514 reap_dead start 2023-11-26T07:12:03.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.391+0000 7f4dfaffd700 1 --2- 172.21.15.2:0/3879996514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4de4003a00 0x7f4de4003de0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4df000c2f0 tx=0x7f4de4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd206c1442cbfb0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:03.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.392+0000 7f4df9ffb700 1 -- 172.21.15.2:0/3879996514 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df000ce30 con 0x7f4de4003a00 2023-11-26T07:12:03.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.392+0000 7f4df9ffb700 1 -- 172.21.15.2:0/3879996514 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df0005960 con 0x7f4de4003a00 2023-11-26T07:12:03.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.392+0000 7f4df9ffb700 1 -- 172.21.15.2:0/3879996514 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df0005cf0 con 0x7f4de4003a00 2023-11-26T07:12:03.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.392+0000 7f4e014ca700 1 -- 172.21.15.2:0/3879996514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4de4003a00 msgr2=0x7f4de4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:03.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.392+0000 7f4e014ca700 1 --2- 172.21.15.2:0/3879996514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4de4003a00 0x7f4de4003de0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4df000c2f0 tx=0x7f4de4005880 comp rx=0 tx=0).stop 2023-11-26T07:12:03.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.392+0000 7f4e014ca700 1 -- 172.21.15.2:0/3879996514 shutdown_connections 2023-11-26T07:12:03.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.392+0000 7f4e014ca700 1 --2- 172.21.15.2:0/3879996514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4de4003a00 0x7f4de4003de0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:03.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.392+0000 7f4e014ca700 1 -- 172.21.15.2:0/3879996514 >> 172.21.15.2:0/3879996514 conn(0x7f4dfc0b5070 msgr2=0x7f4dfc0b5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:03.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.392+0000 7f4e014ca700 1 -- 172.21.15.2:0/3879996514 shutdown_connections 2023-11-26T07:12:03.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.392+0000 7f4e014ca700 1 -- 172.21.15.2:0/3879996514 wait complete. 2023-11-26T07:12:03.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.394+0000 7f4e014ca700 1 Processor -- start 2023-11-26T07:12:03.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.394+0000 7f4e014ca700 1 -- start start 2023-11-26T07:12:03.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.395+0000 7f4e014ca700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4de4003a00 0x7f4dfc14fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:03.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.395+0000 7f4e014ca700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4dfc1ef4e0 0x7f4dfc15d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:03.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.395+0000 7f4e014ca700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4dfc1ef960 0x7f4dfc0ae240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:03.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.395+0000 7f4e014ca700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc150890 con 0x7f4dfc1ef960 2023-11-26T07:12:03.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.395+0000 7f4e014ca700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc15b600 con 0x7f4dfc1ef4e0 2023-11-26T07:12:03.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.395+0000 7f4e014ca700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc0ce8b0 con 0x7f4de4003a00 2023-11-26T07:12:03.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.395+0000 7f4dfb7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4dfc1ef960 0x7f4dfc0ae240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:03.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.395+0000 7f4dfb7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4dfc1ef960 0x7f4dfc0ae240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39904/0 (socket says 172.21.15.2:39904) 2023-11-26T07:12:03.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.395+0000 7f4dfb7fe700 1 -- 172.21.15.2:0/1594497854 learned_addr learned my addr 172.21.15.2:0/1594497854 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:03.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.395+0000 7f4dfa7fc700 1 --2- 172.21.15.2:0/1594497854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4dfc1ef4e0 0x7f4dfc15d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:03.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.395+0000 7f4dfaffd700 1 --2- 172.21.15.2:0/1594497854 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4de4003a00 0x7f4dfc14fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:03.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.395+0000 7f4dfb7fe700 1 -- 172.21.15.2:0/1594497854 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4de4003a00 msgr2=0x7f4dfc14fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:03.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.395+0000 7f4dfb7fe700 1 --2- 172.21.15.2:0/1594497854 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4de4003a00 0x7f4dfc14fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:03.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.395+0000 7f4dfb7fe700 1 -- 172.21.15.2:0/1594497854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4dfc1ef4e0 msgr2=0x7f4dfc15d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:03.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.395+0000 7f4dfb7fe700 1 --2- 172.21.15.2:0/1594497854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4dfc1ef4e0 0x7f4dfc15d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:03.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.395+0000 7f4dfb7fe700 1 -- 172.21.15.2:0/1594497854 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dfc15be60 con 0x7f4dfc1ef960 2023-11-26T07:12:03.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.396+0000 7f4dfb7fe700 1 --2- 172.21.15.2:0/1594497854 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4dfc1ef960 0x7f4dfc0ae240 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc0709e0 tx=0x7f4df400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:03.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.396+0000 7f4de37fe700 1 -- 172.21.15.2:0/1594497854 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df4003c10 con 0x7f4dfc1ef960 2023-11-26T07:12:03.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.396+0000 7f4de37fe700 1 -- 172.21.15.2:0/1594497854 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df4003d70 con 0x7f4dfc1ef960 2023-11-26T07:12:03.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.396+0000 7f4e014ca700 1 -- 172.21.15.2:0/1594497854 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dfc15b8a0 con 0x7f4dfc1ef960 2023-11-26T07:12:03.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.396+0000 7f4de37fe700 1 -- 172.21.15.2:0/1594497854 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df4005310 con 0x7f4dfc1ef960 2023-11-26T07:12:03.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.396+0000 7f4e014ca700 1 -- 172.21.15.2:0/1594497854 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dfc0ceb50 con 0x7f4dfc1ef960 2023-11-26T07:12:03.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.397+0000 7f4e014ca700 1 -- 172.21.15.2:0/1594497854 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dfc0ceec0 con 0x7f4dfc1ef960 2023-11-26T07:12:03.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.397+0000 7f4de37fe700 1 -- 172.21.15.2:0/1594497854 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4df4005470 con 0x7f4dfc1ef960 2023-11-26T07:12:03.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.398+0000 7f4de37fe700 1 --2- 172.21.15.2:0/1594497854 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4de806aed0 0x7f4de806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:03.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.398+0000 7f4de37fe700 1 -- 172.21.15.2:0/1594497854 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4df4089640 con 0x7f4dfc1ef960 2023-11-26T07:12:03.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.398+0000 7f4dfaffd700 1 --2- 172.21.15.2:0/1594497854 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4de806aed0 0x7f4de806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:03.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.398+0000 7f4dfaffd700 1 --2- 172.21.15.2:0/1594497854 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4de806aed0 0x7f4de806d390 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4df0000c00 tx=0x7f4df0007000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:03.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.402+0000 7f4de37fe700 1 -- 172.21.15.2:0/1594497854 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4df4054660 con 0x7f4dfc1ef960 2023-11-26T07:12:03.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.603+0000 7f4e014ca700 1 -- 172.21.15.2:0/1594497854 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4dfc0ce710 con 0x7f4dfc1ef960 2023-11-26T07:12:03.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.603+0000 7f4de37fe700 1 -- 172.21.15.2:0/1594497854 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4dfc0ce710 con 0x7f4dfc1ef960 2023-11-26T07:12:03.605 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-26T07:12:03.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.605+0000 7f4e014ca700 1 -- 172.21.15.2:0/1594497854 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4de806aed0 msgr2=0x7f4de806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:03.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.605+0000 7f4e014ca700 1 --2- 172.21.15.2:0/1594497854 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4de806aed0 0x7f4de806d390 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4df0000c00 tx=0x7f4df0007000 comp rx=0 tx=0).stop 2023-11-26T07:12:03.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.605+0000 7f4e014ca700 1 -- 172.21.15.2:0/1594497854 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4dfc1ef960 msgr2=0x7f4dfc0ae240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:03.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.605+0000 7f4e014ca700 1 --2- 172.21.15.2:0/1594497854 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4dfc1ef960 0x7f4dfc0ae240 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc0709e0 tx=0x7f4df400ee70 comp rx=0 tx=0).stop 2023-11-26T07:12:03.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.605+0000 7f4e014ca700 1 -- 172.21.15.2:0/1594497854 shutdown_connections 2023-11-26T07:12:03.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.605+0000 7f4e014ca700 1 --2- 172.21.15.2:0/1594497854 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4de806aed0 0x7f4de806d390 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:03.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.605+0000 7f4e014ca700 1 --2- 172.21.15.2:0/1594497854 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4dfc1ef960 0x7f4dfc0ae240 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:03.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.605+0000 7f4e014ca700 1 --2- 172.21.15.2:0/1594497854 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4de4003a00 0x7f4dfc14fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:03.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.605+0000 7f4e014ca700 1 --2- 172.21.15.2:0/1594497854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4dfc1ef4e0 0x7f4dfc15d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:03.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.605+0000 7f4e014ca700 1 -- 172.21.15.2:0/1594497854 >> 172.21.15.2:0/1594497854 conn(0x7f4dfc0b5070 msgr2=0x7f4dfc06d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:03.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.605+0000 7f4e014ca700 1 -- 172.21.15.2:0/1594497854 shutdown_connections 2023-11-26T07:12:03.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.605+0000 7f4e014ca700 1 -- 172.21.15.2:0/1594497854 wait complete. 2023-11-26T07:12:03.619 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:12:03.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.745+0000 7f400493b700 1 Processor -- start 2023-11-26T07:12:03.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.745+0000 7f400493b700 1 -- start start 2023-11-26T07:12:03.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.746+0000 7f400493b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4000143ae0 0x7f40000b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:03.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.746+0000 7f400493b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40001440f0 0x7f4000071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:03.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.746+0000 7f400493b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f40000720f0 0x7f400015e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:03.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.746+0000 7f400493b700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40000b40a0 con 0x7f40000720f0 2023-11-26T07:12:03.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.746+0000 7f400493b700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4000072580 con 0x7f4000143ae0 2023-11-26T07:12:03.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.746+0000 7f400493b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4000143ec0 con 0x7f40001440f0 2023-11-26T07:12:03.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.746+0000 7f3ffed9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f40000720f0 0x7f400015e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:03.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.746+0000 7f3ffed9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f40000720f0 0x7f400015e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39912/0 (socket says 172.21.15.2:39912) 2023-11-26T07:12:03.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.746+0000 7f3ffed9d700 1 -- 172.21.15.2:0/1677406514 learned_addr learned my addr 172.21.15.2:0/1677406514 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:03.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.746+0000 7f3ffe59c700 1 --2- 172.21.15.2:0/1677406514 >> v2:172.21.15.192:3300/0 conn(0x7f4000143ae0 0x7f40000b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:03.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.746+0000 7f3ffdd9b700 1 --2- 172.21.15.2:0/1677406514 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40001440f0 0x7f4000071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:03.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.746+0000 7f3ffed9d700 1 -- 172.21.15.2:0/1677406514 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40001440f0 msgr2=0x7f4000071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:03.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.746+0000 7f3ffed9d700 1 --2- 172.21.15.2:0/1677406514 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40001440f0 0x7f4000071bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:03.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.746+0000 7f3ffed9d700 1 -- 172.21.15.2:0/1677406514 >> v2:172.21.15.192:3300/0 conn(0x7f4000143ae0 msgr2=0x7f40000b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:03.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.746+0000 7f3ffed9d700 1 --2- 172.21.15.2:0/1677406514 >> v2:172.21.15.192:3300/0 conn(0x7f4000143ae0 0x7f40000b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:03.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.746+0000 7f3ffed9d700 1 -- 172.21.15.2:0/1677406514 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40000b3ae0 con 0x7f40000720f0 2023-11-26T07:12:03.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.746+0000 7f3ffdd9b700 1 --2- 172.21.15.2:0/1677406514 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40001440f0 0x7f4000071bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:03.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.747+0000 7f3ffed9d700 1 --2- 172.21.15.2:0/1677406514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40000720f0 0x7f400015e8b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f400006d2e0 tx=0x7f3ff800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98034c2520ed9ad0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:03.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.747+0000 7f3ffd59a700 1 -- 172.21.15.2:0/1677406514 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff800e070 con 0x7f40000720f0 2023-11-26T07:12:03.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.747+0000 7f3ffd59a700 1 -- 172.21.15.2:0/1677406514 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff800b910 con 0x7f40000720f0 2023-11-26T07:12:03.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.747+0000 7f3ffd59a700 1 -- 172.21.15.2:0/1677406514 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff800bcc0 con 0x7f40000720f0 2023-11-26T07:12:03.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.747+0000 7f400493b700 1 -- 172.21.15.2:0/1677406514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40000720f0 msgr2=0x7f400015e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:03.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.747+0000 7f400493b700 1 --2- 172.21.15.2:0/1677406514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40000720f0 0x7f400015e8b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f400006d2e0 tx=0x7f3ff800b330 comp rx=0 tx=0).stop 2023-11-26T07:12:03.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.748+0000 7f400493b700 1 -- 172.21.15.2:0/1677406514 shutdown_connections 2023-11-26T07:12:03.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.748+0000 7f400493b700 1 --2- 172.21.15.2:0/1677406514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40000720f0 0x7f400015e8b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:03.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.748+0000 7f400493b700 1 --2- 172.21.15.2:0/1677406514 >> v2:172.21.15.192:3300/0 conn(0x7f4000143ae0 0x7f40000b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:03.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.748+0000 7f400493b700 1 --2- 172.21.15.2:0/1677406514 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40001440f0 0x7f4000071bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:03.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.748+0000 7f400493b700 1 -- 172.21.15.2:0/1677406514 >> 172.21.15.2:0/1677406514 conn(0x7f40000b2740 msgr2=0x7f40000b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:03.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.748+0000 7f400493b700 1 -- 172.21.15.2:0/1677406514 shutdown_connections 2023-11-26T07:12:03.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.748+0000 7f400493b700 1 -- 172.21.15.2:0/1677406514 wait complete. 2023-11-26T07:12:03.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.749+0000 7f400493b700 1 Processor -- start 2023-11-26T07:12:03.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.749+0000 7f400493b700 1 -- start start 2023-11-26T07:12:03.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.750+0000 7f400493b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40000720f0 0x7f40001f6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:03.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.750+0000 7f400493b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4000143ae0 0x7f4000156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:03.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.750+0000 7f400493b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40001440f0 0x7f400006afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:03.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.750+0000 7f400493b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40001576f0 con 0x7f4000143ae0 2023-11-26T07:12:03.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.750+0000 7f400493b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4000157b10 con 0x7f40000720f0 2023-11-26T07:12:03.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.750+0000 7f400493b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4000156a70 con 0x7f40001440f0 2023-11-26T07:12:03.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.750+0000 7f3ffdd9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4000143ae0 0x7f4000156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:03.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.750+0000 7f3ffdd9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4000143ae0 0x7f4000156020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39916/0 (socket says 172.21.15.2:39916) 2023-11-26T07:12:03.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.750+0000 7f3ffdd9b700 1 -- 172.21.15.2:0/2758128645 learned_addr learned my addr 172.21.15.2:0/2758128645 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:03.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.750+0000 7f3ffe59c700 1 --2- 172.21.15.2:0/2758128645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40000720f0 0x7f40001f6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:03.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.750+0000 7f3ffed9d700 1 --2- 172.21.15.2:0/2758128645 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40001440f0 0x7f400006afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:03.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.750+0000 7f3ffdd9b700 1 -- 172.21.15.2:0/2758128645 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40001440f0 msgr2=0x7f400006afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:03.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.750+0000 7f3ffdd9b700 1 --2- 172.21.15.2:0/2758128645 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40001440f0 0x7f400006afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:03.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.750+0000 7f3ffdd9b700 1 -- 172.21.15.2:0/2758128645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40000720f0 msgr2=0x7f40001f6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:03.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.750+0000 7f3ffdd9b700 1 --2- 172.21.15.2:0/2758128645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40000720f0 0x7f40001f6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:03.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.750+0000 7f3ffdd9b700 1 -- 172.21.15.2:0/2758128645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff8009b30 con 0x7f4000143ae0 2023-11-26T07:12:03.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.750+0000 7f3ffed9d700 1 --2- 172.21.15.2:0/2758128645 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40001440f0 0x7f400006afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:12:03.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.750+0000 7f3ffdd9b700 1 --2- 172.21.15.2:0/2758128645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4000143ae0 0x7f4000156020 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3ff000e810 tx=0x7f3ff000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:03.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.750+0000 7f3feeffd700 1 -- 172.21.15.2:0/2758128645 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff0013610 con 0x7f4000143ae0 2023-11-26T07:12:03.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.751+0000 7f3feeffd700 1 -- 172.21.15.2:0/2758128645 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff0013770 con 0x7f4000143ae0 2023-11-26T07:12:03.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.751+0000 7f400493b700 1 -- 172.21.15.2:0/2758128645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4000156d50 con 0x7f4000143ae0 2023-11-26T07:12:03.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.751+0000 7f3feeffd700 1 -- 172.21.15.2:0/2758128645 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff0013b20 con 0x7f4000143ae0 2023-11-26T07:12:03.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.751+0000 7f400493b700 1 -- 172.21.15.2:0/2758128645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4000157310 con 0x7f4000143ae0 2023-11-26T07:12:03.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.751+0000 7f400493b700 1 -- 172.21.15.2:0/2758128645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4000157830 con 0x7f4000143ae0 2023-11-26T07:12:03.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.752+0000 7f3feeffd700 1 -- 172.21.15.2:0/2758128645 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3ff0013c80 con 0x7f4000143ae0 2023-11-26T07:12:03.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.752+0000 7f3feeffd700 1 --2- 172.21.15.2:0/2758128645 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3fe006aed0 0x7f3fe006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:03.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.753+0000 7f3feeffd700 1 -- 172.21.15.2:0/2758128645 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ff00892d0 con 0x7f4000143ae0 2023-11-26T07:12:03.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.753+0000 7f3ffe59c700 1 --2- 172.21.15.2:0/2758128645 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3fe006aed0 0x7f3fe006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:03.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.753+0000 7f3ffe59c700 1 --2- 172.21.15.2:0/2758128645 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3fe006aed0 0x7f3fe006d390 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3ff400bbd0 tx=0x7f3ff400b420 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:03.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.757+0000 7f3feeffd700 1 -- 172.21.15.2:0/2758128645 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4000157830 con 0x7f4000143ae0 2023-11-26T07:12:03.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.960+0000 7f400493b700 1 -- 172.21.15.2:0/2758128645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4000157830 con 0x7f4000143ae0 2023-11-26T07:12:03.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.960+0000 7f3feeffd700 1 -- 172.21.15.2:0/2758128645 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4000157830 con 0x7f4000143ae0 2023-11-26T07:12:03.962 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-26T07:12:03.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.962+0000 7f400493b700 1 -- 172.21.15.2:0/2758128645 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3fe006aed0 msgr2=0x7f3fe006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:03.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.962+0000 7f400493b700 1 --2- 172.21.15.2:0/2758128645 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3fe006aed0 0x7f3fe006d390 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3ff400bbd0 tx=0x7f3ff400b420 comp rx=0 tx=0).stop 2023-11-26T07:12:03.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.962+0000 7f400493b700 1 -- 172.21.15.2:0/2758128645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4000143ae0 msgr2=0x7f4000156020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:03.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.962+0000 7f400493b700 1 --2- 172.21.15.2:0/2758128645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4000143ae0 0x7f4000156020 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3ff000e810 tx=0x7f3ff000ebd0 comp rx=0 tx=0).stop 2023-11-26T07:12:03.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.962+0000 7f400493b700 1 -- 172.21.15.2:0/2758128645 shutdown_connections 2023-11-26T07:12:03.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.962+0000 7f400493b700 1 --2- 172.21.15.2:0/2758128645 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3fe006aed0 0x7f3fe006d390 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:03.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.962+0000 7f400493b700 1 --2- 172.21.15.2:0/2758128645 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40001440f0 0x7f400006afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:03.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.962+0000 7f400493b700 1 --2- 172.21.15.2:0/2758128645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40000720f0 0x7f40001f6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:03.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.962+0000 7f400493b700 1 --2- 172.21.15.2:0/2758128645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4000143ae0 0x7f4000156020 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:03.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.962+0000 7f400493b700 1 -- 172.21.15.2:0/2758128645 >> 172.21.15.2:0/2758128645 conn(0x7f40000b2740 msgr2=0x7f40000ce090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:03.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.962+0000 7f400493b700 1 -- 172.21.15.2:0/2758128645 shutdown_connections 2023-11-26T07:12:03.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:03.962+0000 7f400493b700 1 -- 172.21.15.2:0/2758128645 wait complete. 2023-11-26T07:12:04.040 INFO:tasks.cephfs_test_runner:Starting test: test_clone_failure_status_failed (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) ensure failure status is shown when clone is in failed state and validate the reason 2023-11-26T07:12:04.040 INFO:tasks.cephfs_test_runner:test_clone_failure_status_failed (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2023-11-26T07:12:04.041 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:12:04.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.164+0000 7f7af0abc700 1 Processor -- start 2023-11-26T07:12:04.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.165+0000 7f7af0abc700 1 -- start start 2023-11-26T07:12:04.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.165+0000 7f7af0abc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7aec143ae0 0x7f7aec0b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:04.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.165+0000 7f7af0abc700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aec143ec0 con 0x7f7aec1440f0 2023-11-26T07:12:04.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.165+0000 7f7af0abc700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aec0b3ae0 con 0x7f7aec0722c0 2023-11-26T07:12:04.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.165+0000 7f7af0abc700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aec0b40a0 con 0x7f7aec143ae0 2023-11-26T07:12:04.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.166+0000 7f7aea59c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7aec143ae0 0x7f7aec0b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:04.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.166+0000 7f7ae9d9b700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7aec1440f0 0x7f7aec071bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59364/0 (socket says 172.21.15.2:59364) 2023-11-26T07:12:04.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.166+0000 7f7ae9d9b700 1 -- 172.21.15.2:0/2912275325 learned_addr learned my addr 172.21.15.2:0/2912275325 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:04.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.166+0000 7f7aea59c700 1 -- 172.21.15.2:0/2912275325 >> v1:172.21.15.192:6789/0 conn(0x7f7aec0722c0 legacy=0x7f7aec06e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:04.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.166+0000 7f7aea59c700 1 -- 172.21.15.2:0/2912275325 >> v1:172.21.15.2:6789/0 conn(0x7f7aec1440f0 legacy=0x7f7aec071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:04.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.166+0000 7f7aea59c700 1 -- 172.21.15.2:0/2912275325 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aec0b3dc0 con 0x7f7aec143ae0 2023-11-26T07:12:04.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.166+0000 7f7ae959a700 1 -- 172.21.15.2:0/2912275325 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 424481973 0 0) 0x7f7aec143ec0 con 0x7f7aec1440f0 2023-11-26T07:12:04.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.166+0000 7f7aea59c700 1 --2- 172.21.15.2:0/2912275325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7aec143ae0 0x7f7aec0b51b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7adc009840 tx=0x7f7adc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9864256b4c1b3b6f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:04.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.166+0000 7f7ae959a700 1 -- 172.21.15.2:0/2912275325 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7adc004230 con 0x7f7aec143ae0 2023-11-26T07:12:04.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.166+0000 7f7ae959a700 1 -- 172.21.15.2:0/2912275325 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7adc004390 con 0x7f7aec143ae0 2023-11-26T07:12:04.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.166+0000 7f7ae959a700 1 -- 172.21.15.2:0/2912275325 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7adc0036a0 con 0x7f7aec143ae0 2023-11-26T07:12:04.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.167+0000 7f7af0abc700 1 -- 172.21.15.2:0/2912275325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7aec143ae0 msgr2=0x7f7aec0b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:04.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.167+0000 7f7af0abc700 1 --2- 172.21.15.2:0/2912275325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7aec143ae0 0x7f7aec0b51b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7adc009840 tx=0x7f7adc009b50 comp rx=0 tx=0).stop 2023-11-26T07:12:04.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.167+0000 7f7af0abc700 1 -- 172.21.15.2:0/2912275325 shutdown_connections 2023-11-26T07:12:04.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.167+0000 7f7af0abc700 1 --2- 172.21.15.2:0/2912275325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7aec143ae0 0x7f7aec0b51b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:04.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.167+0000 7f7af0abc700 1 -- 172.21.15.2:0/2912275325 >> 172.21.15.2:0/2912275325 conn(0x7f7aec0b2740 msgr2=0x7f7aec0b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:04.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.167+0000 7f7af0abc700 1 -- 172.21.15.2:0/2912275325 shutdown_connections 2023-11-26T07:12:04.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.167+0000 7f7af0abc700 1 -- 172.21.15.2:0/2912275325 wait complete. 2023-11-26T07:12:04.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.168+0000 7f7af0abc700 1 Processor -- start 2023-11-26T07:12:04.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.168+0000 7f7af0abc700 1 -- start start 2023-11-26T07:12:04.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.169+0000 7f7af0abc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec0722c0 0x7f7aec13fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:04.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.169+0000 7f7af0abc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7aec143ae0 0x7f7aec0c6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:04.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.169+0000 7f7af0abc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7aec1440f0 0x7f7aec0c6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:04.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.169+0000 7f7af0abc700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec157500 con 0x7f7aec143ae0 2023-11-26T07:12:04.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.169+0000 7f7af0abc700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec15e640 con 0x7f7aec1440f0 2023-11-26T07:12:04.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.169+0000 7f7af0abc700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec15e920 con 0x7f7aec0722c0 2023-11-26T07:12:04.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.169+0000 7f7ae9d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7aec143ae0 0x7f7aec0c6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:04.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.169+0000 7f7ae9d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7aec143ae0 0x7f7aec0c6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39932/0 (socket says 172.21.15.2:39932) 2023-11-26T07:12:04.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.169+0000 7f7ae9d9b700 1 -- 172.21.15.2:0/2528844426 learned_addr learned my addr 172.21.15.2:0/2528844426 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:04.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.169+0000 7f7aead9d700 1 --2- 172.21.15.2:0/2528844426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7aec1440f0 0x7f7aec0c6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:04.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.169+0000 7f7aea59c700 1 --2- 172.21.15.2:0/2528844426 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec0722c0 0x7f7aec13fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:04.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.169+0000 7f7ae9d9b700 1 -- 172.21.15.2:0/2528844426 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec0722c0 msgr2=0x7f7aec13fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:04.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.169+0000 7f7ae9d9b700 1 --2- 172.21.15.2:0/2528844426 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec0722c0 0x7f7aec13fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:04.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.169+0000 7f7ae9d9b700 1 -- 172.21.15.2:0/2528844426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7aec1440f0 msgr2=0x7f7aec0c6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:04.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.169+0000 7f7ae9d9b700 1 --2- 172.21.15.2:0/2528844426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7aec1440f0 0x7f7aec0c6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:04.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.169+0000 7f7ae9d9b700 1 -- 172.21.15.2:0/2528844426 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7adc0094a0 con 0x7f7aec143ae0 2023-11-26T07:12:04.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.169+0000 7f7aead9d700 1 --2- 172.21.15.2:0/2528844426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7aec1440f0 0x7f7aec0c6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:12:04.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.170+0000 7f7ae9d9b700 1 --2- 172.21.15.2:0/2528844426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7aec143ae0 0x7f7aec0c6110 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7ae000c520 tx=0x7f7ae000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:04.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.170+0000 7f7adaffd700 1 -- 172.21.15.2:0/2528844426 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0004c80 con 0x7f7aec143ae0 2023-11-26T07:12:04.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.170+0000 7f7adaffd700 1 -- 172.21.15.2:0/2528844426 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae0004e20 con 0x7f7aec143ae0 2023-11-26T07:12:04.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.170+0000 7f7adaffd700 1 -- 172.21.15.2:0/2528844426 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0007310 con 0x7f7aec143ae0 2023-11-26T07:12:04.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.170+0000 7f7af0abc700 1 -- 172.21.15.2:0/2528844426 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aec15ec00 con 0x7f7aec143ae0 2023-11-26T07:12:04.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.170+0000 7f7af0abc700 1 -- 172.21.15.2:0/2528844426 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aec15f1c0 con 0x7f7aec143ae0 2023-11-26T07:12:04.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.171+0000 7f7af0abc700 1 -- 172.21.15.2:0/2528844426 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aec0cd8d0 con 0x7f7aec143ae0 2023-11-26T07:12:04.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.171+0000 7f7adaffd700 1 -- 172.21.15.2:0/2528844426 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7ae0007470 con 0x7f7aec143ae0 2023-11-26T07:12:04.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.172+0000 7f7adaffd700 1 --2- 172.21.15.2:0/2528844426 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7acc06aed0 0x7f7acc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:04.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.172+0000 7f7adaffd700 1 -- 172.21.15.2:0/2528844426 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ae00892f0 con 0x7f7aec143ae0 2023-11-26T07:12:04.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.172+0000 7f7aea59c700 1 --2- 172.21.15.2:0/2528844426 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7acc06aed0 0x7f7acc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:04.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.172+0000 7f7aea59c700 1 --2- 172.21.15.2:0/2528844426 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7acc06aed0 0x7f7acc06d390 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7adc009b90 tx=0x7f7adc008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:04.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.176+0000 7f7adaffd700 1 -- 172.21.15.2:0/2528844426 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7ae00543a0 con 0x7f7aec143ae0 2023-11-26T07:12:04.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.378+0000 7f7af0abc700 1 -- 172.21.15.2:0/2528844426 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7aec0c80a0 con 0x7f7aec143ae0 2023-11-26T07:12:04.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.379+0000 7f7adaffd700 1 -- 172.21.15.2:0/2528844426 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f7ae00579c0 con 0x7f7aec143ae0 2023-11-26T07:12:04.381 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:12:04.381 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:11:35.634747+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:11:32.129474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:11:33.019837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:12:04.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.381+0000 7f7af0abc700 1 -- 172.21.15.2:0/2528844426 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7acc06aed0 msgr2=0x7f7acc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:04.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.381+0000 7f7af0abc700 1 --2- 172.21.15.2:0/2528844426 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7acc06aed0 0x7f7acc06d390 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7adc009b90 tx=0x7f7adc008030 comp rx=0 tx=0).stop 2023-11-26T07:12:04.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.381+0000 7f7af0abc700 1 -- 172.21.15.2:0/2528844426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7aec143ae0 msgr2=0x7f7aec0c6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:04.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.381+0000 7f7af0abc700 1 --2- 172.21.15.2:0/2528844426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7aec143ae0 0x7f7aec0c6110 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7ae000c520 tx=0x7f7ae000c8e0 comp rx=0 tx=0).stop 2023-11-26T07:12:04.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.381+0000 7f7af0abc700 1 -- 172.21.15.2:0/2528844426 shutdown_connections 2023-11-26T07:12:04.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.381+0000 7f7af0abc700 1 --2- 172.21.15.2:0/2528844426 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7acc06aed0 0x7f7acc06d390 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:04.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.381+0000 7f7af0abc700 1 --2- 172.21.15.2:0/2528844426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7aec1440f0 0x7f7aec0c6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:04.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.381+0000 7f7af0abc700 1 --2- 172.21.15.2:0/2528844426 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aec0722c0 0x7f7aec13fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:04.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.381+0000 7f7af0abc700 1 --2- 172.21.15.2:0/2528844426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7aec143ae0 0x7f7aec0c6110 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:04.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.381+0000 7f7af0abc700 1 -- 172.21.15.2:0/2528844426 >> 172.21.15.2:0/2528844426 conn(0x7f7aec0b2740 msgr2=0x7f7aec142cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:04.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.381+0000 7f7af0abc700 1 -- 172.21.15.2:0/2528844426 shutdown_connections 2023-11-26T07:12:04.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.381+0000 7f7af0abc700 1 -- 172.21.15.2:0/2528844426 wait complete. 2023-11-26T07:12:04.396 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:11:28.205739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:11:32.129474+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:11:33.019837+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:12:04.396 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:12:04.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.522+0000 7f626a56f700 1 Processor -- start 2023-11-26T07:12:04.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.523+0000 7f626a56f700 1 -- start start 2023-11-26T07:12:04.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.523+0000 7f626a56f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f62640b4150 0x7f626406de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:04.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.523+0000 7f626a56f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f62640b5ab0 0x7f626406e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:04.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.523+0000 7f626a56f700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6264071f50 con 0x7f626406b620 2023-11-26T07:12:04.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.523+0000 7f626a56f700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6264072230 con 0x7f62640b5ab0 2023-11-26T07:12:04.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.523+0000 7f626a56f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6264072510 con 0x7f62640b4150 2023-11-26T07:12:04.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.523+0000 7f6263fff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f626406b620 0x7f62640b3a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59378/0 (socket says 172.21.15.2:59378) 2023-11-26T07:12:04.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.523+0000 7f6263fff700 1 -- 172.21.15.2:0/2669822440 learned_addr learned my addr 172.21.15.2:0/2669822440 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:04.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.524+0000 7f6268b0c700 1 --2- 172.21.15.2:0/2669822440 >> v2:172.21.15.192:3300/0 conn(0x7f62640b5ab0 0x7f626406e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:04.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.524+0000 7f62637fe700 1 --2- 172.21.15.2:0/2669822440 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f62640b4150 0x7f626406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:04.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.524+0000 7f6262ffd700 1 -- 172.21.15.2:0/2669822440 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 893991382 0 0) 0x7f6264071f50 con 0x7f626406b620 2023-11-26T07:12:04.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.524+0000 7f6262ffd700 1 -- 172.21.15.2:0/2669822440 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62500035b0 con 0x7f626406b620 2023-11-26T07:12:04.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.524+0000 7f6262ffd700 1 -- 172.21.15.2:0/2669822440 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1678548243 0 0) 0x7f62500035b0 con 0x7f626406b620 2023-11-26T07:12:04.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.524+0000 7f6262ffd700 1 -- 172.21.15.2:0/2669822440 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f62640b4150 msgr2=0x7f626406de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:04.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.524+0000 7f6262ffd700 1 --2- 172.21.15.2:0/2669822440 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f62640b4150 0x7f626406de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:04.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.524+0000 7f6262ffd700 1 -- 172.21.15.2:0/2669822440 >> v2:172.21.15.192:3300/0 conn(0x7f62640b5ab0 msgr2=0x7f626406e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:04.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.524+0000 7f6262ffd700 1 --2- 172.21.15.2:0/2669822440 >> v2:172.21.15.192:3300/0 conn(0x7f62640b5ab0 0x7f626406e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:04.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.524+0000 7f6262ffd700 1 -- 172.21.15.2:0/2669822440 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62640727f0 con 0x7f626406b620 2023-11-26T07:12:04.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.524+0000 7f6262ffd700 1 -- 172.21.15.2:0/2669822440 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f6254001670 con 0x7f626406b620 2023-11-26T07:12:04.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.524+0000 7f6262ffd700 1 -- 172.21.15.2:0/2669822440 >> v1:172.21.15.2:6789/0 conn(0x7f626406b620 legacy=0x7f62640b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:04.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.524+0000 7f6262ffd700 1 --2- 172.21.15.2:0/2669822440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6250003a00 0x7f6250003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:04.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.524+0000 7f6262ffd700 1 --2- 172.21.15.2:0/2669822440 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6250004850 0x7f6250004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:04.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.524+0000 7f6262ffd700 1 --2- 172.21.15.2:0/2669822440 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f62640b4150 0x7f6250005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:04.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.524+0000 7f6262ffd700 1 -- 172.21.15.2:0/2669822440 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6264072230 con 0x7f6250003a00 2023-11-26T07:12:04.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.524+0000 7f6262ffd700 1 -- 172.21.15.2:0/2669822440 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6264072510 con 0x7f6250004850 2023-11-26T07:12:04.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.524+0000 7f6262ffd700 1 -- 172.21.15.2:0/2669822440 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f625000ba10 con 0x7f62640b4150 2023-11-26T07:12:04.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.524+0000 7f6263fff700 1 --2- 172.21.15.2:0/2669822440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6250003a00 0x7f6250003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:04.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.524+0000 7f62637fe700 1 --2- 172.21.15.2:0/2669822440 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6250004850 0x7f6250004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:04.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.524+0000 7f6268b0c700 1 --2- 172.21.15.2:0/2669822440 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f62640b4150 0x7f6250005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:04.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.525+0000 7f6263fff700 1 -- 172.21.15.2:0/2669822440 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f62640b4150 msgr2=0x7f6250005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:04.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.525+0000 7f6263fff700 1 --2- 172.21.15.2:0/2669822440 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f62640b4150 0x7f6250005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:04.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.525+0000 7f6263fff700 1 -- 172.21.15.2:0/2669822440 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6250004850 msgr2=0x7f6250004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:04.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.525+0000 7f6263fff700 1 --2- 172.21.15.2:0/2669822440 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6250004850 0x7f6250004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:04.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.525+0000 7f6263fff700 1 -- 172.21.15.2:0/2669822440 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62500035b0 con 0x7f6250003a00 2023-11-26T07:12:04.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.525+0000 7f62637fe700 1 --2- 172.21.15.2:0/2669822440 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6250004850 0x7f6250004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:04.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.525+0000 7f6268b0c700 1 --2- 172.21.15.2:0/2669822440 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f62640b4150 0x7f6250005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:04.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.525+0000 7f6263fff700 1 --2- 172.21.15.2:0/2669822440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6250003a00 0x7f6250003e20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f625400c370 tx=0x7f6250005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=483b81be54990b9c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:04.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.525+0000 7f6262ffd700 1 -- 172.21.15.2:0/2669822440 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6254007c60 con 0x7f6250003a00 2023-11-26T07:12:04.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.525+0000 7f6262ffd700 1 -- 172.21.15.2:0/2669822440 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6254005960 con 0x7f6250003a00 2023-11-26T07:12:04.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.525+0000 7f6262ffd700 1 -- 172.21.15.2:0/2669822440 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6254005d10 con 0x7f6250003a00 2023-11-26T07:12:04.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.525+0000 7f626a56f700 1 -- 172.21.15.2:0/2669822440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6250003a00 msgr2=0x7f6250003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:04.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.525+0000 7f626a56f700 1 --2- 172.21.15.2:0/2669822440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6250003a00 0x7f6250003e20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f625400c370 tx=0x7f6250005880 comp rx=0 tx=0).stop 2023-11-26T07:12:04.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.525+0000 7f6268b0c700 1 -- 172.21.15.2:0/2669822440 reap_dead start 2023-11-26T07:12:04.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.526+0000 7f626a56f700 1 -- 172.21.15.2:0/2669822440 shutdown_connections 2023-11-26T07:12:04.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.526+0000 7f626a56f700 1 -- 172.21.15.2:0/2669822440 >> 172.21.15.2:0/2669822440 conn(0x7f62640b2740 msgr2=0x7f62640b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:04.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.526+0000 7f626a56f700 1 -- 172.21.15.2:0/2669822440 shutdown_connections 2023-11-26T07:12:04.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.526+0000 7f626a56f700 1 -- 172.21.15.2:0/2669822440 wait complete. 2023-11-26T07:12:04.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.527+0000 7f626a56f700 1 Processor -- start 2023-11-26T07:12:04.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.527+0000 7f626a56f700 1 -- start start 2023-11-26T07:12:04.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.528+0000 7f626a56f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6250003a00 0x7f62641f4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:04.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.528+0000 7f626a56f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62640ca590 0x7f626406eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:04.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.528+0000 7f626a56f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f626406efe0 0x7f62640c59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:04.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.528+0000 7f626a56f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62640cba80 con 0x7f62640ca590 2023-11-26T07:12:04.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.528+0000 7f626a56f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626406f460 con 0x7f6250003a00 2023-11-26T07:12:04.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.528+0000 7f626a56f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62640c6670 con 0x7f626406efe0 2023-11-26T07:12:04.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.528+0000 7f62637fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62640ca590 0x7f626406eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:04.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.528+0000 7f62637fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62640ca590 0x7f626406eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39950/0 (socket says 172.21.15.2:39950) 2023-11-26T07:12:04.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.528+0000 7f62637fe700 1 -- 172.21.15.2:0/3534006324 learned_addr learned my addr 172.21.15.2:0/3534006324 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:04.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.528+0000 7f6263fff700 1 --2- 172.21.15.2:0/3534006324 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6250003a00 0x7f62641f4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:04.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.528+0000 7f62637fe700 1 -- 172.21.15.2:0/3534006324 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f626406efe0 msgr2=0x7f62640c59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:04.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.528+0000 7f6268b0c700 1 --2- 172.21.15.2:0/3534006324 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f626406efe0 0x7f62640c59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:04.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.528+0000 7f62637fe700 1 --2- 172.21.15.2:0/3534006324 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f626406efe0 0x7f62640c59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:04.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.528+0000 7f62637fe700 1 -- 172.21.15.2:0/3534006324 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6250003a00 msgr2=0x7f62641f4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:04.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.528+0000 7f62637fe700 1 --2- 172.21.15.2:0/3534006324 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6250003a00 0x7f62641f4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:04.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.528+0000 7f62637fe700 1 -- 172.21.15.2:0/3534006324 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62640c6950 con 0x7f62640ca590 2023-11-26T07:12:04.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.528+0000 7f6263fff700 1 --2- 172.21.15.2:0/3534006324 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6250003a00 0x7f62641f4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:12:04.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.528+0000 7f62637fe700 1 --2- 172.21.15.2:0/3534006324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62640ca590 0x7f626406eaa0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f624c010850 tx=0x7f624c010c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:04.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.528+0000 7f6260ff9700 1 -- 172.21.15.2:0/3534006324 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c010e50 con 0x7f62640ca590 2023-11-26T07:12:04.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.528+0000 7f6260ff9700 1 -- 172.21.15.2:0/3534006324 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f624c004020 con 0x7f62640ca590 2023-11-26T07:12:04.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.529+0000 7f626a56f700 1 -- 172.21.15.2:0/3534006324 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62640c7650 con 0x7f62640ca590 2023-11-26T07:12:04.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.529+0000 7f6260ff9700 1 -- 172.21.15.2:0/3534006324 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c0043b0 con 0x7f62640ca590 2023-11-26T07:12:04.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.529+0000 7f626a56f700 1 -- 172.21.15.2:0/3534006324 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62640c7c10 con 0x7f62640ca590 2023-11-26T07:12:04.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.529+0000 7f626a56f700 1 -- 172.21.15.2:0/3534006324 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62640c7f80 con 0x7f62640ca590 2023-11-26T07:12:04.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.530+0000 7f6260ff9700 1 -- 172.21.15.2:0/3534006324 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f624c00e8d0 con 0x7f62640ca590 2023-11-26T07:12:04.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.530+0000 7f6260ff9700 1 --2- 172.21.15.2:0/3534006324 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f624406aed0 0x7f624406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:04.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.530+0000 7f6260ff9700 1 -- 172.21.15.2:0/3534006324 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f624c089850 con 0x7f62640ca590 2023-11-26T07:12:04.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.531+0000 7f6263fff700 1 --2- 172.21.15.2:0/3534006324 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f624406aed0 0x7f624406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:04.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.531+0000 7f6263fff700 1 --2- 172.21.15.2:0/3534006324 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f624406aed0 0x7f624406d390 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6254015040 tx=0x7f625400a000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:04.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.535+0000 7f6260ff9700 1 -- 172.21.15.2:0/3534006324 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f624c054990 con 0x7f62640ca590 2023-11-26T07:12:04.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.733+0000 7f626a56f700 1 -- 172.21.15.2:0/3534006324 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6264075480 con 0x7f62640ca590 2023-11-26T07:12:04.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.734+0000 7f6260ff9700 1 -- 172.21.15.2:0/3534006324 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f624c057fb0 con 0x7f62640ca590 2023-11-26T07:12:04.736 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-26T07:12:04.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.736+0000 7f626a56f700 1 -- 172.21.15.2:0/3534006324 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f624406aed0 msgr2=0x7f624406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:04.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.736+0000 7f626a56f700 1 --2- 172.21.15.2:0/3534006324 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f624406aed0 0x7f624406d390 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6254015040 tx=0x7f625400a000 comp rx=0 tx=0).stop 2023-11-26T07:12:04.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.736+0000 7f626a56f700 1 -- 172.21.15.2:0/3534006324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62640ca590 msgr2=0x7f626406eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:04.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.736+0000 7f626a56f700 1 --2- 172.21.15.2:0/3534006324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62640ca590 0x7f626406eaa0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f624c010850 tx=0x7f624c010c10 comp rx=0 tx=0).stop 2023-11-26T07:12:04.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.736+0000 7f626a56f700 1 -- 172.21.15.2:0/3534006324 shutdown_connections 2023-11-26T07:12:04.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.736+0000 7f626a56f700 1 --2- 172.21.15.2:0/3534006324 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f624406aed0 0x7f624406d390 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:04.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.736+0000 7f626a56f700 1 --2- 172.21.15.2:0/3534006324 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f626406efe0 0x7f62640c59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:04.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.736+0000 7f626a56f700 1 --2- 172.21.15.2:0/3534006324 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6250003a00 0x7f62641f4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:04.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.736+0000 7f626a56f700 1 --2- 172.21.15.2:0/3534006324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62640ca590 0x7f626406eaa0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:04.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.736+0000 7f626a56f700 1 -- 172.21.15.2:0/3534006324 >> 172.21.15.2:0/3534006324 conn(0x7f62640b2740 msgr2=0x7f6264146220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:04.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.736+0000 7f626a56f700 1 -- 172.21.15.2:0/3534006324 shutdown_connections 2023-11-26T07:12:04.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.736+0000 7f626a56f700 1 -- 172.21.15.2:0/3534006324 wait complete. 2023-11-26T07:12:04.750 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:12:04.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.876+0000 7f2ac8ae5700 1 Processor -- start 2023-11-26T07:12:04.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.876+0000 7f2ac8ae5700 1 -- start start 2023-11-26T07:12:04.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.877+0000 7f2ac8ae5700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2ac4143ae0 0x7f2ac40b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:04.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.877+0000 7f2ac8ae5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ac40722c0 0x7f2ac406e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:04.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.877+0000 7f2ac8ae5700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ac4143ec0 con 0x7f2ac41440f0 2023-11-26T07:12:04.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.877+0000 7f2ac8ae5700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ac40b40a0 con 0x7f2ac4143ae0 2023-11-26T07:12:04.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.877+0000 7f2ac8ae5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac40b3ae0 con 0x7f2ac40722c0 2023-11-26T07:12:04.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.877+0000 7f2ac259c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2ac4143ae0 0x7f2ac40b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:04.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.877+0000 7f2ac259c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2ac4143ae0 0x7f2ac40b51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39956/0 (socket says 172.21.15.2:39956) 2023-11-26T07:12:04.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.877+0000 7f2ac259c700 1 -- 172.21.15.2:0/4013757564 learned_addr learned my addr 172.21.15.2:0/4013757564 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:04.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.877+0000 7f2ac1d9b700 1 --1- 172.21.15.2:0/4013757564 >> v1:172.21.15.2:6789/0 conn(0x7f2ac41440f0 0x7f2ac4071bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59398/0 (socket says 172.21.15.2:59398) 2023-11-26T07:12:04.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.877+0000 7f2ac2d9d700 1 --2- 172.21.15.2:0/4013757564 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ac40722c0 0x7f2ac406e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:04.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.877+0000 7f2ac259c700 1 -- 172.21.15.2:0/4013757564 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ac40722c0 msgr2=0x7f2ac406e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:04.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.877+0000 7f2ac259c700 1 --2- 172.21.15.2:0/4013757564 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ac40722c0 0x7f2ac406e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:04.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.877+0000 7f2ac259c700 1 -- 172.21.15.2:0/4013757564 >> v1:172.21.15.2:6789/0 conn(0x7f2ac41440f0 legacy=0x7f2ac4071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:04.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.877+0000 7f2ac159a700 1 -- 172.21.15.2:0/4013757564 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1516064576 0 0) 0x7f2ac4143ec0 con 0x7f2ac41440f0 2023-11-26T07:12:04.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.877+0000 7f2ac259c700 1 -- 172.21.15.2:0/4013757564 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac40b3dc0 con 0x7f2ac4143ae0 2023-11-26T07:12:04.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.877+0000 7f2ac2d9d700 1 --2- 172.21.15.2:0/4013757564 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ac40722c0 0x7f2ac406e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:12:04.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.878+0000 7f2ac259c700 1 --2- 172.21.15.2:0/4013757564 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ac4143ae0 0x7f2ac40b51b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2ab800bb90 tx=0x7f2ab800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32ac32dac3cd7b95 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:04.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.878+0000 7f2ac159a700 1 -- 172.21.15.2:0/4013757564 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab800dd50 con 0x7f2ac4143ae0 2023-11-26T07:12:04.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.878+0000 7f2ac159a700 1 -- 172.21.15.2:0/4013757564 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab8010470 con 0x7f2ac4143ae0 2023-11-26T07:12:04.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.878+0000 7f2ac159a700 1 -- 172.21.15.2:0/4013757564 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab8010800 con 0x7f2ac4143ae0 2023-11-26T07:12:04.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.878+0000 7f2ac8ae5700 1 -- 172.21.15.2:0/4013757564 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ac4143ae0 msgr2=0x7f2ac40b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:04.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.878+0000 7f2ac8ae5700 1 --2- 172.21.15.2:0/4013757564 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ac4143ae0 0x7f2ac40b51b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2ab800bb90 tx=0x7f2ab800bea0 comp rx=0 tx=0).stop 2023-11-26T07:12:04.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.878+0000 7f2ac8ae5700 1 -- 172.21.15.2:0/4013757564 shutdown_connections 2023-11-26T07:12:04.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.878+0000 7f2ac8ae5700 1 --2- 172.21.15.2:0/4013757564 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ac40722c0 0x7f2ac406e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:04.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.878+0000 7f2ac8ae5700 1 --2- 172.21.15.2:0/4013757564 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ac4143ae0 0x7f2ac40b51b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:04.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.878+0000 7f2ac8ae5700 1 -- 172.21.15.2:0/4013757564 >> 172.21.15.2:0/4013757564 conn(0x7f2ac40b2740 msgr2=0x7f2ac40b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:04.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.878+0000 7f2ac8ae5700 1 -- 172.21.15.2:0/4013757564 shutdown_connections 2023-11-26T07:12:04.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.878+0000 7f2ac8ae5700 1 -- 172.21.15.2:0/4013757564 wait complete. 2023-11-26T07:12:04.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.880+0000 7f2ac8ae5700 1 Processor -- start 2023-11-26T07:12:04.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.880+0000 7f2ac8ae5700 1 -- start start 2023-11-26T07:12:04.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.880+0000 7f2ac8ae5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ac40722c0 0x7f2ac4138790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:04.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.880+0000 7f2ac8ae5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ac4143ae0 0x7f2ac4158490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:04.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.880+0000 7f2ac8ae5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ac41440f0 0x7f2ac41589d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:04.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.880+0000 7f2ac8ae5700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac4155ac0 con 0x7f2ac41440f0 2023-11-26T07:12:04.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.880+0000 7f2ac8ae5700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac413c4d0 con 0x7f2ac40722c0 2023-11-26T07:12:04.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.880+0000 7f2ac8ae5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac413d050 con 0x7f2ac4143ae0 2023-11-26T07:12:04.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.881+0000 7f2ac2d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ac41440f0 0x7f2ac41589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:04.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.881+0000 7f2ac2d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ac41440f0 0x7f2ac41589d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39964/0 (socket says 172.21.15.2:39964) 2023-11-26T07:12:04.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.881+0000 7f2ac2d9d700 1 -- 172.21.15.2:0/101604240 learned_addr learned my addr 172.21.15.2:0/101604240 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:04.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.881+0000 7f2ac1d9b700 1 --2- 172.21.15.2:0/101604240 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ac4143ae0 0x7f2ac4158490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:04.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.881+0000 7f2ac259c700 1 --2- 172.21.15.2:0/101604240 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ac40722c0 0x7f2ac4138790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:04.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.881+0000 7f2ac2d9d700 1 -- 172.21.15.2:0/101604240 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ac4143ae0 msgr2=0x7f2ac4158490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:04.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.881+0000 7f2ac2d9d700 1 --2- 172.21.15.2:0/101604240 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ac4143ae0 0x7f2ac4158490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:04.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.881+0000 7f2ac2d9d700 1 -- 172.21.15.2:0/101604240 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ac40722c0 msgr2=0x7f2ac4138790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:04.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.881+0000 7f2ac2d9d700 1 --2- 172.21.15.2:0/101604240 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ac40722c0 0x7f2ac4138790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:04.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.881+0000 7f2ac2d9d700 1 -- 172.21.15.2:0/101604240 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab800b7f0 con 0x7f2ac41440f0 2023-11-26T07:12:04.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.881+0000 7f2ac1d9b700 1 --2- 172.21.15.2:0/101604240 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ac4143ae0 0x7f2ac4158490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:04.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.881+0000 7f2ac2d9d700 1 --2- 172.21.15.2:0/101604240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ac41440f0 0x7f2ac41589d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2abc00ceb0 tx=0x7f2abc00cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:04.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.881+0000 7f2ab2ffd700 1 -- 172.21.15.2:0/101604240 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc00ad60 con 0x7f2ac41440f0 2023-11-26T07:12:04.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.881+0000 7f2ab2ffd700 1 -- 172.21.15.2:0/101604240 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2abc015440 con 0x7f2ac41440f0 2023-11-26T07:12:04.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.881+0000 7f2ac8ae5700 1 -- 172.21.15.2:0/101604240 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ac4138cd0 con 0x7f2ac41440f0 2023-11-26T07:12:04.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.881+0000 7f2ab2ffd700 1 -- 172.21.15.2:0/101604240 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc0157f0 con 0x7f2ac41440f0 2023-11-26T07:12:04.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.881+0000 7f2ac8ae5700 1 -- 172.21.15.2:0/101604240 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ac413ca00 con 0x7f2ac41440f0 2023-11-26T07:12:04.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.882+0000 7f2ac8ae5700 1 -- 172.21.15.2:0/101604240 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ac413d1e0 con 0x7f2ac41440f0 2023-11-26T07:12:04.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.883+0000 7f2ab2ffd700 1 -- 172.21.15.2:0/101604240 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2abc00d430 con 0x7f2ac41440f0 2023-11-26T07:12:04.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.883+0000 7f2ab2ffd700 1 --2- 172.21.15.2:0/101604240 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f2aa406aed0 0x7f2aa406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:04.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.883+0000 7f2ab2ffd700 1 -- 172.21.15.2:0/101604240 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2abc089a70 con 0x7f2ac41440f0 2023-11-26T07:12:04.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.883+0000 7f2ac259c700 1 --2- 172.21.15.2:0/101604240 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f2aa406aed0 0x7f2aa406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:04.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.884+0000 7f2ac259c700 1 --2- 172.21.15.2:0/101604240 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f2aa406aed0 0x7f2aa406d390 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8000c00 tx=0x7f2ab801c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:04.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:04.888+0000 7f2ab2ffd700 1 -- 172.21.15.2:0/101604240 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2abc054bb0 con 0x7f2ac41440f0 2023-11-26T07:12:05.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.086+0000 7f2ac8ae5700 1 -- 172.21.15.2:0/101604240 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2ac4075480 con 0x7f2ac41440f0 2023-11-26T07:12:05.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.087+0000 7f2ab2ffd700 1 -- 172.21.15.2:0/101604240 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2abc01a0a0 con 0x7f2ac41440f0 2023-11-26T07:12:05.089 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-26T07:12:05.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.089+0000 7f2ac8ae5700 1 -- 172.21.15.2:0/101604240 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f2aa406aed0 msgr2=0x7f2aa406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:05.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.089+0000 7f2ac8ae5700 1 --2- 172.21.15.2:0/101604240 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f2aa406aed0 0x7f2aa406d390 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8000c00 tx=0x7f2ab801c040 comp rx=0 tx=0).stop 2023-11-26T07:12:05.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.089+0000 7f2ac8ae5700 1 -- 172.21.15.2:0/101604240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ac41440f0 msgr2=0x7f2ac41589d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:05.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.089+0000 7f2ac8ae5700 1 --2- 172.21.15.2:0/101604240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ac41440f0 0x7f2ac41589d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2abc00ceb0 tx=0x7f2abc00cee0 comp rx=0 tx=0).stop 2023-11-26T07:12:05.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.089+0000 7f2ac8ae5700 1 -- 172.21.15.2:0/101604240 shutdown_connections 2023-11-26T07:12:05.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.089+0000 7f2ac8ae5700 1 --2- 172.21.15.2:0/101604240 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f2aa406aed0 0x7f2aa406d390 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:05.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.089+0000 7f2ac8ae5700 1 --2- 172.21.15.2:0/101604240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ac41440f0 0x7f2ac41589d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:05.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.089+0000 7f2ac8ae5700 1 --2- 172.21.15.2:0/101604240 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ac40722c0 0x7f2ac4138790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:05.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.089+0000 7f2ac8ae5700 1 --2- 172.21.15.2:0/101604240 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ac4143ae0 0x7f2ac4158490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:05.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.089+0000 7f2ac8ae5700 1 -- 172.21.15.2:0/101604240 >> 172.21.15.2:0/101604240 conn(0x7f2ac40b2740 msgr2=0x7f2ac40cefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:05.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.089+0000 7f2ac8ae5700 1 -- 172.21.15.2:0/101604240 shutdown_connections 2023-11-26T07:12:05.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.089+0000 7f2ac8ae5700 1 -- 172.21.15.2:0/101604240 wait complete. 2023-11-26T07:12:05.103 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:12:05.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.228+0000 7f05744b1700 1 Processor -- start 2023-11-26T07:12:05.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.229+0000 7f05744b1700 1 -- start start 2023-11-26T07:12:05.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.229+0000 7f05744b1700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f056c144c10 0x7f056c06afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:05.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.229+0000 7f05744b1700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f056c145100 0x7f056c06b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:05.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.230+0000 7f05744b1700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f056c06eb80 con 0x7f056c145650 2023-11-26T07:12:05.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.230+0000 7f05744b1700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f056c06f500 con 0x7f056c144c10 2023-11-26T07:12:05.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.230+0000 7f05744b1700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f056c0cd610 con 0x7f056c145100 2023-11-26T07:12:05.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.230+0000 7f057224d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f056c144c10 0x7f056c06afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:05.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.230+0000 7f057224d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f056c144c10 0x7f056c06afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39968/0 (socket says 172.21.15.2:39968) 2023-11-26T07:12:05.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.230+0000 7f057224d700 1 -- 172.21.15.2:0/195527588 learned_addr learned my addr 172.21.15.2:0/195527588 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:05.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.230+0000 7f0571a4c700 1 --2- 172.21.15.2:0/195527588 >> v2:172.21.15.192:3300/0 conn(0x7f056c145100 0x7f056c06b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:05.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.230+0000 7f057224d700 1 -- 172.21.15.2:0/195527588 >> v2:172.21.15.192:3300/0 conn(0x7f056c145100 msgr2=0x7f056c06b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:05.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.230+0000 7f057224d700 1 --2- 172.21.15.2:0/195527588 >> v2:172.21.15.192:3300/0 conn(0x7f056c145100 0x7f056c06b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:05.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.230+0000 7f057224d700 1 -- 172.21.15.2:0/195527588 >> v1:172.21.15.192:6789/0 conn(0x7f056c145650 legacy=0x7f056c071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:05.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.230+0000 7f057224d700 1 -- 172.21.15.2:0/195527588 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f056c160720 con 0x7f056c144c10 2023-11-26T07:12:05.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.230+0000 7f057224d700 1 --2- 172.21.15.2:0/195527588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f056c144c10 0x7f056c06afd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f056c071b60 tx=0x7f0568009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=428f93a1b60d9c0e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:05.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.230+0000 7f057124b700 1 -- 172.21.15.2:0/195527588 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0568004230 con 0x7f056c144c10 2023-11-26T07:12:05.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.230+0000 7f057124b700 1 -- 172.21.15.2:0/195527588 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0568004390 con 0x7f056c144c10 2023-11-26T07:12:05.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.230+0000 7f057124b700 1 -- 172.21.15.2:0/195527588 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05680036a0 con 0x7f056c144c10 2023-11-26T07:12:05.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.231+0000 7f05744b1700 1 -- 172.21.15.2:0/195527588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f056c144c10 msgr2=0x7f056c06afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:05.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.231+0000 7f05744b1700 1 --2- 172.21.15.2:0/195527588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f056c144c10 0x7f056c06afd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f056c071b60 tx=0x7f0568009bd0 comp rx=0 tx=0).stop 2023-11-26T07:12:05.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.231+0000 7f05744b1700 1 -- 172.21.15.2:0/195527588 shutdown_connections 2023-11-26T07:12:05.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.231+0000 7f05744b1700 1 --2- 172.21.15.2:0/195527588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f056c144c10 0x7f056c06afd0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:05.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.231+0000 7f05744b1700 1 --2- 172.21.15.2:0/195527588 >> v2:172.21.15.192:3300/0 conn(0x7f056c145100 0x7f056c06b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:05.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.231+0000 7f05744b1700 1 -- 172.21.15.2:0/195527588 >> 172.21.15.2:0/195527588 conn(0x7f056c0b2740 msgr2=0x7f056c0b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:05.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.231+0000 7f05744b1700 1 -- 172.21.15.2:0/195527588 shutdown_connections 2023-11-26T07:12:05.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.231+0000 7f05744b1700 1 -- 172.21.15.2:0/195527588 wait complete. 2023-11-26T07:12:05.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.232+0000 7f05744b1700 1 Processor -- start 2023-11-26T07:12:05.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.232+0000 7f05744b1700 1 -- start start 2023-11-26T07:12:05.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.233+0000 7f05744b1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f056c144c10 0x7f056c14ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:05.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.233+0000 7f05744b1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f056c145100 0x7f056c1e5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:05.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.233+0000 7f05744b1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f056c145650 0x7f056c1501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:05.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.233+0000 7f05744b1700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056c1e5da0 con 0x7f056c145100 2023-11-26T07:12:05.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.233+0000 7f05744b1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056c14f120 con 0x7f056c144c10 2023-11-26T07:12:05.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.233+0000 7f05744b1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f056c14f400 con 0x7f056c145650 2023-11-26T07:12:05.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.233+0000 7f0571a4c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f056c145100 0x7f056c1e5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:05.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.233+0000 7f0571a4c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f056c145100 0x7f056c1e5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39976/0 (socket says 172.21.15.2:39976) 2023-11-26T07:12:05.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.233+0000 7f0571a4c700 1 -- 172.21.15.2:0/3473655888 learned_addr learned my addr 172.21.15.2:0/3473655888 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:05.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.233+0000 7f057224d700 1 --2- 172.21.15.2:0/3473655888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f056c144c10 0x7f056c14ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:05.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.233+0000 7f0572a4e700 1 --2- 172.21.15.2:0/3473655888 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f056c145650 0x7f056c1501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:05.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.233+0000 7f0571a4c700 1 -- 172.21.15.2:0/3473655888 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f056c145650 msgr2=0x7f056c1501c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:05.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.233+0000 7f0571a4c700 1 --2- 172.21.15.2:0/3473655888 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f056c145650 0x7f056c1501c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:05.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.233+0000 7f0571a4c700 1 -- 172.21.15.2:0/3473655888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f056c144c10 msgr2=0x7f056c14ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:05.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.233+0000 7f0571a4c700 1 --2- 172.21.15.2:0/3473655888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f056c144c10 0x7f056c14ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:05.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.233+0000 7f0571a4c700 1 -- 172.21.15.2:0/3473655888 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0568009550 con 0x7f056c145100 2023-11-26T07:12:05.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.233+0000 7f0572a4e700 1 --2- 172.21.15.2:0/3473655888 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f056c145650 0x7f056c1501c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:05.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.233+0000 7f057224d700 1 --2- 172.21.15.2:0/3473655888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f056c144c10 0x7f056c14ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:05.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.234+0000 7f0571a4c700 1 --2- 172.21.15.2:0/3473655888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f056c145100 0x7f056c1e5860 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f056000e7e0 tx=0x7f056000eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:05.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.234+0000 7f055effd700 1 -- 172.21.15.2:0/3473655888 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0560013610 con 0x7f056c145100 2023-11-26T07:12:05.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.234+0000 7f055effd700 1 -- 172.21.15.2:0/3473655888 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0560013770 con 0x7f056c145100 2023-11-26T07:12:05.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.234+0000 7f05744b1700 1 -- 172.21.15.2:0/3473655888 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f056c14f6e0 con 0x7f056c145100 2023-11-26T07:12:05.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.234+0000 7f055effd700 1 -- 172.21.15.2:0/3473655888 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0560013ae0 con 0x7f056c145100 2023-11-26T07:12:05.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.234+0000 7f05744b1700 1 -- 172.21.15.2:0/3473655888 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f056c14fca0 con 0x7f056c145100 2023-11-26T07:12:05.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.235+0000 7f05744b1700 1 -- 172.21.15.2:0/3473655888 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f056c14fe30 con 0x7f056c145100 2023-11-26T07:12:05.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.235+0000 7f055effd700 1 -- 172.21.15.2:0/3473655888 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0560013c40 con 0x7f056c145100 2023-11-26T07:12:05.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.236+0000 7f055effd700 1 --2- 172.21.15.2:0/3473655888 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f055006aed0 0x7f055006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:05.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.236+0000 7f055effd700 1 -- 172.21.15.2:0/3473655888 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0560089200 con 0x7f056c145100 2023-11-26T07:12:05.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.236+0000 7f057224d700 1 --2- 172.21.15.2:0/3473655888 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f055006aed0 0x7f055006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:05.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.236+0000 7f057224d700 1 --2- 172.21.15.2:0/3473655888 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f055006aed0 0x7f055006d390 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0568009130 tx=0x7f0568008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:05.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.240+0000 7f055effd700 1 -- 172.21.15.2:0/3473655888 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0560054340 con 0x7f056c145100 2023-11-26T07:12:05.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.441+0000 7f05744b1700 1 -- 172.21.15.2:0/3473655888 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f056c0cda40 con 0x7f056c145100 2023-11-26T07:12:05.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.441+0000 7f055effd700 1 -- 172.21.15.2:0/3473655888 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f056c0cda40 con 0x7f056c145100 2023-11-26T07:12:05.443 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-26T07:12:05.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.443+0000 7f05744b1700 1 -- 172.21.15.2:0/3473655888 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f055006aed0 msgr2=0x7f055006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:05.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.443+0000 7f05744b1700 1 --2- 172.21.15.2:0/3473655888 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f055006aed0 0x7f055006d390 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0568009130 tx=0x7f0568008030 comp rx=0 tx=0).stop 2023-11-26T07:12:05.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.444+0000 7f05744b1700 1 -- 172.21.15.2:0/3473655888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f056c145100 msgr2=0x7f056c1e5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:05.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.444+0000 7f05744b1700 1 --2- 172.21.15.2:0/3473655888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f056c145100 0x7f056c1e5860 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f056000e7e0 tx=0x7f056000eba0 comp rx=0 tx=0).stop 2023-11-26T07:12:05.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.444+0000 7f05744b1700 1 -- 172.21.15.2:0/3473655888 shutdown_connections 2023-11-26T07:12:05.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.444+0000 7f05744b1700 1 --2- 172.21.15.2:0/3473655888 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f055006aed0 0x7f055006d390 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:05.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.444+0000 7f05744b1700 1 --2- 172.21.15.2:0/3473655888 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f056c145650 0x7f056c1501c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:05.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.444+0000 7f05744b1700 1 --2- 172.21.15.2:0/3473655888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f056c144c10 0x7f056c14ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:05.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.444+0000 7f05744b1700 1 --2- 172.21.15.2:0/3473655888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f056c145100 0x7f056c1e5860 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:05.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.444+0000 7f05744b1700 1 -- 172.21.15.2:0/3473655888 >> 172.21.15.2:0/3473655888 conn(0x7f056c0b2740 msgr2=0x7f056c0b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:05.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.444+0000 7f05744b1700 1 -- 172.21.15.2:0/3473655888 shutdown_connections 2023-11-26T07:12:05.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.444+0000 7f05744b1700 1 -- 172.21.15.2:0/3473655888 wait complete. 2023-11-26T07:12:05.458 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_failed' 2023-11-26T07:12:05.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.581+0000 7f07957c9700 1 Processor -- start 2023-11-26T07:12:05.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.581+0000 7f07957c9700 1 -- start start 2023-11-26T07:12:05.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.582+0000 7f07957c9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f079015e460 0x7f07900d49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:05.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.582+0000 7f07957c9700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f07900d2ba0 0x7f07900b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:05.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.582+0000 7f07957c9700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07900b3370 con 0x7f07900cf480 2023-11-26T07:12:05.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.582+0000 7f07957c9700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07900cfc40 con 0x7f07900d2ba0 2023-11-26T07:12:05.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.582+0000 7f07957c9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07900b35c0 con 0x7f079015e460 2023-11-26T07:12:05.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.582+0000 7f078e7fc700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f07900cf480 0x7f07900d2490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59426/0 (socket says 172.21.15.2:59426) 2023-11-26T07:12:05.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.582+0000 7f078e7fc700 1 -- 172.21.15.2:0/3087162415 learned_addr learned my addr 172.21.15.2:0/3087162415 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:05.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.582+0000 7f078f7fe700 1 --2- 172.21.15.2:0/3087162415 >> v2:172.21.15.192:3300/0 conn(0x7f07900d2ba0 0x7f07900b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:05.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.582+0000 7f078effd700 1 --2- 172.21.15.2:0/3087162415 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f079015e460 0x7f07900d49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:05.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.582+0000 7f078dffb700 1 -- 172.21.15.2:0/3087162415 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1982745612 0 0) 0x7f07900b3370 con 0x7f07900cf480 2023-11-26T07:12:05.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.582+0000 7f078dffb700 1 -- 172.21.15.2:0/3087162415 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07780035b0 con 0x7f07900cf480 2023-11-26T07:12:05.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.583+0000 7f078dffb700 1 -- 172.21.15.2:0/3087162415 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2767704822 0 0) 0x7f07780035b0 con 0x7f07900cf480 2023-11-26T07:12:05.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.583+0000 7f078dffb700 1 -- 172.21.15.2:0/3087162415 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f079015e460 msgr2=0x7f07900d49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:05.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.583+0000 7f078dffb700 1 --2- 172.21.15.2:0/3087162415 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f079015e460 0x7f07900d49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:05.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.583+0000 7f078dffb700 1 -- 172.21.15.2:0/3087162415 >> v2:172.21.15.192:3300/0 conn(0x7f07900d2ba0 msgr2=0x7f07900b40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:05.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.583+0000 7f078dffb700 1 --2- 172.21.15.2:0/3087162415 >> v2:172.21.15.192:3300/0 conn(0x7f07900d2ba0 0x7f07900b40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:05.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.583+0000 7f078dffb700 1 -- 172.21.15.2:0/3087162415 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07900b38a0 con 0x7f07900cf480 2023-11-26T07:12:05.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.583+0000 7f078dffb700 1 -- 172.21.15.2:0/3087162415 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f0780001670 con 0x7f07900cf480 2023-11-26T07:12:05.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.583+0000 7f078dffb700 1 -- 172.21.15.2:0/3087162415 >> v1:172.21.15.2:6789/0 conn(0x7f07900cf480 legacy=0x7f07900d2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:05.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.583+0000 7f078dffb700 1 --2- 172.21.15.2:0/3087162415 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f079015e460 0x7f0778003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:05.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.583+0000 7f078dffb700 1 --2- 172.21.15.2:0/3087162415 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0778003f80 0x7f0778004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:05.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.583+0000 7f078dffb700 1 --2- 172.21.15.2:0/3087162415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0778004d90 0x7f0778005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:05.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.583+0000 7f078dffb700 1 -- 172.21.15.2:0/3087162415 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07900cfc40 con 0x7f0778003f80 2023-11-26T07:12:05.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.583+0000 7f078dffb700 1 -- 172.21.15.2:0/3087162415 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07900b35c0 con 0x7f0778004d90 2023-11-26T07:12:05.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.583+0000 7f078dffb700 1 -- 172.21.15.2:0/3087162415 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f077800ba40 con 0x7f079015e460 2023-11-26T07:12:05.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.583+0000 7f078e7fc700 1 --2- 172.21.15.2:0/3087162415 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0778003f80 0x7f0778004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:05.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.583+0000 7f078effd700 1 --2- 172.21.15.2:0/3087162415 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f079015e460 0x7f0778003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:05.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.583+0000 7f078f7fe700 1 --2- 172.21.15.2:0/3087162415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0778004d90 0x7f0778005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:05.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.583+0000 7f078e7fc700 1 -- 172.21.15.2:0/3087162415 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f079015e460 msgr2=0x7f0778003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:05.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.583+0000 7f078e7fc700 1 --2- 172.21.15.2:0/3087162415 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f079015e460 0x7f0778003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:05.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.583+0000 7f078e7fc700 1 -- 172.21.15.2:0/3087162415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0778004d90 msgr2=0x7f0778005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:05.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.583+0000 7f078e7fc700 1 --2- 172.21.15.2:0/3087162415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0778004d90 0x7f0778005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:05.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.583+0000 7f078e7fc700 1 -- 172.21.15.2:0/3087162415 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07780035b0 con 0x7f0778003f80 2023-11-26T07:12:05.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.583+0000 7f078e7fc700 1 --2- 172.21.15.2:0/3087162415 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0778003f80 0x7f0778004850 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f078000c2f0 tx=0x7f0778005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b00c0f918f76b654 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:05.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.583+0000 7f078dffb700 1 -- 172.21.15.2:0/3087162415 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0780007c40 con 0x7f0778003f80 2023-11-26T07:12:05.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.583+0000 7f078dffb700 1 -- 172.21.15.2:0/3087162415 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078000ce30 con 0x7f0778003f80 2023-11-26T07:12:05.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.584+0000 7f078dffb700 1 -- 172.21.15.2:0/3087162415 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0780005ba0 con 0x7f0778003f80 2023-11-26T07:12:05.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.584+0000 7f07957c9700 1 -- 172.21.15.2:0/3087162415 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0778003f80 msgr2=0x7f0778004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:05.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.584+0000 7f07957c9700 1 --2- 172.21.15.2:0/3087162415 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0778003f80 0x7f0778004850 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f078000c2f0 tx=0x7f0778005880 comp rx=0 tx=0).stop 2023-11-26T07:12:05.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.584+0000 7f078f7fe700 1 -- 172.21.15.2:0/3087162415 reap_dead start 2023-11-26T07:12:05.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.584+0000 7f07957c9700 1 -- 172.21.15.2:0/3087162415 shutdown_connections 2023-11-26T07:12:05.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.584+0000 7f07957c9700 1 -- 172.21.15.2:0/3087162415 >> 172.21.15.2:0/3087162415 conn(0x7f07900d3eb0 msgr2=0x7f07900d42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:05.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.584+0000 7f07957c9700 1 -- 172.21.15.2:0/3087162415 shutdown_connections 2023-11-26T07:12:05.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.584+0000 7f07957c9700 1 -- 172.21.15.2:0/3087162415 wait complete. 2023-11-26T07:12:05.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.585+0000 7f07957c9700 1 Processor -- start 2023-11-26T07:12:05.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.586+0000 7f07957c9700 1 -- start start 2023-11-26T07:12:05.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.586+0000 7f07957c9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0778003f80 0x7f079014bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:05.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.586+0000 7f07957c9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f079014b3a0 0x7f07900b4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:05.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.586+0000 7f07957c9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07900b4740 0x7f07900c7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:05.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.586+0000 7f07957c9700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07900b4bd0 con 0x7f079014b3a0 2023-11-26T07:12:05.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.586+0000 7f07957c9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079014db30 con 0x7f0778003f80 2023-11-26T07:12:05.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.586+0000 7f07957c9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f079014b820 con 0x7f07900b4740 2023-11-26T07:12:05.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.586+0000 7f078e7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f079014b3a0 0x7f07900b4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:05.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.586+0000 7f078e7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f079014b3a0 0x7f07900b4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39996/0 (socket says 172.21.15.2:39996) 2023-11-26T07:12:05.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.586+0000 7f078e7fc700 1 -- 172.21.15.2:0/450175502 learned_addr learned my addr 172.21.15.2:0/450175502 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:05.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.587+0000 7f078f7fe700 1 --2- 172.21.15.2:0/450175502 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07900b4740 0x7f07900c7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:05.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.587+0000 7f078effd700 1 --2- 172.21.15.2:0/450175502 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0778003f80 0x7f079014bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:05.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.587+0000 7f078e7fc700 1 -- 172.21.15.2:0/450175502 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07900b4740 msgr2=0x7f07900c7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:05.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.587+0000 7f078e7fc700 1 --2- 172.21.15.2:0/450175502 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07900b4740 0x7f07900c7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:05.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.587+0000 7f078e7fc700 1 -- 172.21.15.2:0/450175502 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0778003f80 msgr2=0x7f079014bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:05.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.587+0000 7f078e7fc700 1 --2- 172.21.15.2:0/450175502 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0778003f80 0x7f079014bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:05.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.587+0000 7f078e7fc700 1 -- 172.21.15.2:0/450175502 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f079014dd50 con 0x7f079014b3a0 2023-11-26T07:12:05.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.587+0000 7f078f7fe700 1 --2- 172.21.15.2:0/450175502 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07900b4740 0x7f07900c7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:12:05.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.587+0000 7f078e7fc700 1 --2- 172.21.15.2:0/450175502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f079014b3a0 0x7f07900b4200 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f078000c8e0 tx=0x7f07900ce770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:05.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.587+0000 7f07777fe700 1 -- 172.21.15.2:0/450175502 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07800070d0 con 0x7f079014b3a0 2023-11-26T07:12:05.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.587+0000 7f07777fe700 1 -- 172.21.15.2:0/450175502 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0780007250 con 0x7f079014b3a0 2023-11-26T07:12:05.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.587+0000 7f07957c9700 1 -- 172.21.15.2:0/450175502 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f079014e030 con 0x7f079014b3a0 2023-11-26T07:12:05.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.587+0000 7f07777fe700 1 -- 172.21.15.2:0/450175502 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0780007600 con 0x7f079014b3a0 2023-11-26T07:12:05.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.587+0000 7f07957c9700 1 -- 172.21.15.2:0/450175502 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f079014e5f0 con 0x7f079014b3a0 2023-11-26T07:12:05.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.588+0000 7f07957c9700 1 -- 172.21.15.2:0/450175502 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0790067f60 con 0x7f079014b3a0 2023-11-26T07:12:05.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.589+0000 7f07777fe700 1 -- 172.21.15.2:0/450175502 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f078001e430 con 0x7f079014b3a0 2023-11-26T07:12:05.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.589+0000 7f07777fe700 1 --2- 172.21.15.2:0/450175502 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f077c06aed0 0x7f077c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:05.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.589+0000 7f07777fe700 1 -- 172.21.15.2:0/450175502 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f078008aaf0 con 0x7f079014b3a0 2023-11-26T07:12:05.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.589+0000 7f078effd700 1 --2- 172.21.15.2:0/450175502 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f077c06aed0 0x7f077c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:05.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.590+0000 7f078effd700 1 --2- 172.21.15.2:0/450175502 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f077c06aed0 0x7f077c06d390 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f07840099c0 tx=0x7f0784008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:05.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.594+0000 7f07777fe700 1 -- 172.21.15.2:0/450175502 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0780055e10 con 0x7f079014b3a0 2023-11-26T07:12:05.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:05.876+0000 7f07957c9700 1 -- 172.21.15.2:0/450175502 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_failed"]} v 0) v1 -- 0x7f07900b4b90 con 0x7f079014b3a0 2023-11-26T07:12:06.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.292+0000 7f07777fe700 1 -- 172.21.15.2:0/450175502 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_failed"]}]=0 v45) v1 ==== 168+0+0 (secure 0 0 0) 0x7f07900b4b90 con 0x7f079014b3a0 2023-11-26T07:12:06.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.294+0000 7f07957c9700 1 -- 172.21.15.2:0/450175502 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f077c06aed0 msgr2=0x7f077c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:06.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.294+0000 7f07957c9700 1 --2- 172.21.15.2:0/450175502 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f077c06aed0 0x7f077c06d390 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f07840099c0 tx=0x7f0784008040 comp rx=0 tx=0).stop 2023-11-26T07:12:06.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.294+0000 7f07957c9700 1 -- 172.21.15.2:0/450175502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f079014b3a0 msgr2=0x7f07900b4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:06.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.294+0000 7f07957c9700 1 --2- 172.21.15.2:0/450175502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f079014b3a0 0x7f07900b4200 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f078000c8e0 tx=0x7f07900ce770 comp rx=0 tx=0).stop 2023-11-26T07:12:06.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.294+0000 7f07957c9700 1 -- 172.21.15.2:0/450175502 shutdown_connections 2023-11-26T07:12:06.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.294+0000 7f07957c9700 1 --2- 172.21.15.2:0/450175502 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f077c06aed0 0x7f077c06d390 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:06.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.294+0000 7f07957c9700 1 --2- 172.21.15.2:0/450175502 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07900b4740 0x7f07900c7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:06.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.294+0000 7f07957c9700 1 --2- 172.21.15.2:0/450175502 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0778003f80 0x7f079014bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:06.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.294+0000 7f07957c9700 1 --2- 172.21.15.2:0/450175502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f079014b3a0 0x7f07900b4200 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:06.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.294+0000 7f07957c9700 1 -- 172.21.15.2:0/450175502 >> 172.21.15.2:0/450175502 conn(0x7f07900d3eb0 msgr2=0x7f07900b2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:06.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.294+0000 7f07957c9700 1 -- 172.21.15.2:0/450175502 shutdown_connections 2023-11-26T07:12:06.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.294+0000 7f07957c9700 1 -- 172.21.15.2:0/450175502 wait complete. 2023-11-26T07:12:06.310 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-26T07:12:06.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.438+0000 7fba266f3700 1 Processor -- start 2023-11-26T07:12:06.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.438+0000 7fba266f3700 1 -- start start 2023-11-26T07:12:06.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.439+0000 7fba266f3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba200b4150 0x7fba2006de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:06.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.439+0000 7fba266f3700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fba200b5ab0 0x7fba2006e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:06.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.439+0000 7fba266f3700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba20071f50 con 0x7fba2006b620 2023-11-26T07:12:06.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.439+0000 7fba266f3700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba20072230 con 0x7fba200b5ab0 2023-11-26T07:12:06.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.439+0000 7fba266f3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba20072510 con 0x7fba200b4150 2023-11-26T07:12:06.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.439+0000 7fba24c90700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fba200b5ab0 0x7fba2006e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:06.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.439+0000 7fba1ffff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fba2006b620 0x7fba200b3a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59444/0 (socket says 172.21.15.2:59444) 2023-11-26T07:12:06.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.439+0000 7fba1ffff700 1 -- 172.21.15.2:0/1271631762 learned_addr learned my addr 172.21.15.2:0/1271631762 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:06.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.439+0000 7fba1f7fe700 1 --2- 172.21.15.2:0/1271631762 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba200b4150 0x7fba2006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:06.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.440+0000 7fba24c90700 1 -- 172.21.15.2:0/1271631762 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba200b4150 msgr2=0x7fba2006de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:06.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.440+0000 7fba24c90700 1 --2- 172.21.15.2:0/1271631762 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba200b4150 0x7fba2006de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:06.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.440+0000 7fba24c90700 1 -- 172.21.15.2:0/1271631762 >> v1:172.21.15.2:6789/0 conn(0x7fba2006b620 legacy=0x7fba200b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:06.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.440+0000 7fba24c90700 1 -- 172.21.15.2:0/1271631762 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba200727f0 con 0x7fba200b5ab0 2023-11-26T07:12:06.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.440+0000 7fba24c90700 1 --2- 172.21.15.2:0/1271631762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba200b5ab0 0x7fba2006e390 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fba18009d90 tx=0x7fba1800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df0abf0af8e14f74 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:06.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.440+0000 7fba1effd700 1 -- 172.21.15.2:0/1271631762 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1800e070 con 0x7fba200b5ab0 2023-11-26T07:12:06.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.440+0000 7fba1effd700 1 -- 172.21.15.2:0/1271631762 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba1800bbd0 con 0x7fba200b5ab0 2023-11-26T07:12:06.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.440+0000 7fba1effd700 1 -- 172.21.15.2:0/1271631762 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba18012430 con 0x7fba200b5ab0 2023-11-26T07:12:06.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.440+0000 7fba266f3700 1 -- 172.21.15.2:0/1271631762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba200b5ab0 msgr2=0x7fba2006e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:06.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.440+0000 7fba266f3700 1 --2- 172.21.15.2:0/1271631762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba200b5ab0 0x7fba2006e390 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fba18009d90 tx=0x7fba1800b330 comp rx=0 tx=0).stop 2023-11-26T07:12:06.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.440+0000 7fba266f3700 1 -- 172.21.15.2:0/1271631762 shutdown_connections 2023-11-26T07:12:06.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.440+0000 7fba266f3700 1 --2- 172.21.15.2:0/1271631762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba200b5ab0 0x7fba2006e390 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:06.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.440+0000 7fba266f3700 1 --2- 172.21.15.2:0/1271631762 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba200b4150 0x7fba2006de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:06.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.440+0000 7fba266f3700 1 -- 172.21.15.2:0/1271631762 >> 172.21.15.2:0/1271631762 conn(0x7fba200b2740 msgr2=0x7fba200b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:06.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.441+0000 7fba266f3700 1 -- 172.21.15.2:0/1271631762 shutdown_connections 2023-11-26T07:12:06.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.441+0000 7fba266f3700 1 -- 172.21.15.2:0/1271631762 wait complete. 2023-11-26T07:12:06.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.442+0000 7fba266f3700 1 Processor -- start 2023-11-26T07:12:06.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.442+0000 7fba266f3700 1 -- start start 2023-11-26T07:12:06.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.443+0000 7fba266f3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba2006b620 0x7fba201f3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:06.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.443+0000 7fba266f3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba200b4150 0x7fba2013f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:06.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.443+0000 7fba266f3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba200b5ab0 0x7fba2013f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:06.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.443+0000 7fba266f3700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba201400c0 con 0x7fba200b5ab0 2023-11-26T07:12:06.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.443+0000 7fba266f3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba201403a0 con 0x7fba2006b620 2023-11-26T07:12:06.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.443+0000 7fba266f3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba20140680 con 0x7fba200b4150 2023-11-26T07:12:06.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.443+0000 7fba24c90700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba200b5ab0 0x7fba2013f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:06.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.443+0000 7fba24c90700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba200b5ab0 0x7fba2013f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40012/0 (socket says 172.21.15.2:40012) 2023-11-26T07:12:06.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.443+0000 7fba24c90700 1 -- 172.21.15.2:0/1944262941 learned_addr learned my addr 172.21.15.2:0/1944262941 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:06.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.443+0000 7fba1ffff700 1 --2- 172.21.15.2:0/1944262941 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba2006b620 0x7fba201f3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:06.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.443+0000 7fba1f7fe700 1 --2- 172.21.15.2:0/1944262941 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba200b4150 0x7fba2013f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:06.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.443+0000 7fba24c90700 1 -- 172.21.15.2:0/1944262941 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba200b4150 msgr2=0x7fba2013f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:06.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.443+0000 7fba24c90700 1 --2- 172.21.15.2:0/1944262941 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba200b4150 0x7fba2013f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:06.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.443+0000 7fba24c90700 1 -- 172.21.15.2:0/1944262941 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba2006b620 msgr2=0x7fba201f3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:06.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.443+0000 7fba24c90700 1 --2- 172.21.15.2:0/1944262941 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba2006b620 0x7fba201f3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:06.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.443+0000 7fba24c90700 1 -- 172.21.15.2:0/1944262941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba18009a70 con 0x7fba200b5ab0 2023-11-26T07:12:06.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.443+0000 7fba24c90700 1 --2- 172.21.15.2:0/1944262941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba200b5ab0 0x7fba2013f880 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fba18014040 tx=0x7fba18004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:06.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.443+0000 7fba1cff9700 1 -- 172.21.15.2:0/1944262941 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba18003ea0 con 0x7fba200b5ab0 2023-11-26T07:12:06.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.444+0000 7fba1cff9700 1 -- 172.21.15.2:0/1944262941 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba18020070 con 0x7fba200b5ab0 2023-11-26T07:12:06.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.444+0000 7fba1cff9700 1 -- 172.21.15.2:0/1944262941 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba180098f0 con 0x7fba200b5ab0 2023-11-26T07:12:06.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.444+0000 7fba266f3700 1 -- 172.21.15.2:0/1944262941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba20140960 con 0x7fba200b5ab0 2023-11-26T07:12:06.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.444+0000 7fba266f3700 1 -- 172.21.15.2:0/1944262941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba2013fdc0 con 0x7fba200b5ab0 2023-11-26T07:12:06.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.445+0000 7fba266f3700 1 -- 172.21.15.2:0/1944262941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba20075480 con 0x7fba200b5ab0 2023-11-26T07:12:06.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.445+0000 7fba1cff9700 1 -- 172.21.15.2:0/1944262941 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fba18004040 con 0x7fba200b5ab0 2023-11-26T07:12:06.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.445+0000 7fba1cff9700 1 --2- 172.21.15.2:0/1944262941 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fba0006aed0 0x7fba0006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:06.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.446+0000 7fba1cff9700 1 -- 172.21.15.2:0/1944262941 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba18022070 con 0x7fba200b5ab0 2023-11-26T07:12:06.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.446+0000 7fba1ffff700 1 --2- 172.21.15.2:0/1944262941 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fba0006aed0 0x7fba0006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:06.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.446+0000 7fba1ffff700 1 --2- 172.21.15.2:0/1944262941 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fba0006aed0 0x7fba0006d390 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fba08005910 tx=0x7fba08009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:06.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.450+0000 7fba1cff9700 1 -- 172.21.15.2:0/1944262941 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fba18056380 con 0x7fba200b5ab0 2023-11-26T07:12:06.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.657+0000 7fba266f3700 1 -- 172.21.15.2:0/1944262941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fba2006e540 con 0x7fba200b5ab0 2023-11-26T07:12:06.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.659+0000 7fba1cff9700 1 -- 172.21.15.2:0/1944262941 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fba180599a0 con 0x7fba200b5ab0 2023-11-26T07:12:06.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.661+0000 7fba266f3700 1 -- 172.21.15.2:0/1944262941 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fba0006aed0 msgr2=0x7fba0006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:06.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.661+0000 7fba266f3700 1 --2- 172.21.15.2:0/1944262941 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fba0006aed0 0x7fba0006d390 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fba08005910 tx=0x7fba08009040 comp rx=0 tx=0).stop 2023-11-26T07:12:06.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.661+0000 7fba266f3700 1 -- 172.21.15.2:0/1944262941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba200b5ab0 msgr2=0x7fba2013f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:06.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.661+0000 7fba266f3700 1 --2- 172.21.15.2:0/1944262941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba200b5ab0 0x7fba2013f880 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fba18014040 tx=0x7fba18004ad0 comp rx=0 tx=0).stop 2023-11-26T07:12:06.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.662+0000 7fba266f3700 1 -- 172.21.15.2:0/1944262941 shutdown_connections 2023-11-26T07:12:06.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.662+0000 7fba266f3700 1 --2- 172.21.15.2:0/1944262941 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fba0006aed0 0x7fba0006d390 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:06.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.662+0000 7fba266f3700 1 --2- 172.21.15.2:0/1944262941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba200b5ab0 0x7fba2013f880 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:06.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.662+0000 7fba266f3700 1 --2- 172.21.15.2:0/1944262941 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba2006b620 0x7fba201f3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:06.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.662+0000 7fba266f3700 1 --2- 172.21.15.2:0/1944262941 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba200b4150 0x7fba2013f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:06.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.662+0000 7fba266f3700 1 -- 172.21.15.2:0/1944262941 >> 172.21.15.2:0/1944262941 conn(0x7fba200b2740 msgr2=0x7fba200afe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:06.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.662+0000 7fba266f3700 1 -- 172.21.15.2:0/1944262941 shutdown_connections 2023-11-26T07:12:06.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:06.662+0000 7fba266f3700 1 -- 172.21.15.2:0/1944262941 wait complete. 2023-11-26T07:12:06.676 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-26T07:12:06.676 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:12:06.720 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:12:06.764 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-26T07:12:06.764 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:06.764 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:06.782 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:06.782 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:06.820 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:12:06.825 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:12:06.839 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:06.839 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:06.897 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:12:07.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.060+0000 7fc1902a8700 1 Processor -- start 2023-11-26T07:12:07.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.060+0000 7fc1902a8700 1 -- start start 2023-11-26T07:12:07.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.061+0000 7fc1902a8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc188143ae0 0x7fc1880b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:07.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.061+0000 7fc1902a8700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc1881440f0 0x7fc188071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:07.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.061+0000 7fc1902a8700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc1880720f0 0x7fc18815e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:07.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.061+0000 7fc1902a8700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1880b40a0 con 0x7fc1881440f0 2023-11-26T07:12:07.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.061+0000 7fc1902a8700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc188072580 con 0x7fc1880720f0 2023-11-26T07:12:07.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.061+0000 7fc1902a8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc188143ec0 con 0x7fc188143ae0 2023-11-26T07:12:07.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.061+0000 7fc18d843700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc1881440f0 0x7fc188071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:07.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.061+0000 7fc18d843700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc1881440f0 0x7fc188071bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40018/0 (socket says 172.21.15.2:40018) 2023-11-26T07:12:07.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.061+0000 7fc18d843700 1 -- 172.21.15.2:0/3711810081 learned_addr learned my addr 172.21.15.2:0/3711810081 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:07.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.062+0000 7fc18d843700 1 -- 172.21.15.2:0/3711810081 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc188143ae0 msgr2=0x7fc1880b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:07.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.062+0000 7fc18e845700 1 --2- 172.21.15.2:0/3711810081 >> v2:172.21.15.192:3300/0 conn(0x7fc1880720f0 0x7fc18815e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:07.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.062+0000 7fc18e044700 1 --2- 172.21.15.2:0/3711810081 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc188143ae0 0x7fc1880b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:07.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.062+0000 7fc18d843700 1 --2- 172.21.15.2:0/3711810081 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc188143ae0 0x7fc1880b51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:07.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.062+0000 7fc18d843700 1 -- 172.21.15.2:0/3711810081 >> v2:172.21.15.192:3300/0 conn(0x7fc1880720f0 msgr2=0x7fc18815e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:07.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.062+0000 7fc18d843700 1 --2- 172.21.15.2:0/3711810081 >> v2:172.21.15.192:3300/0 conn(0x7fc1880720f0 0x7fc18815e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:07.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.062+0000 7fc18d843700 1 -- 172.21.15.2:0/3711810081 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1880b3ae0 con 0x7fc1881440f0 2023-11-26T07:12:07.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.062+0000 7fc18d843700 1 --2- 172.21.15.2:0/3711810081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1881440f0 0x7fc188071bb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc1880706c0 tx=0x7fc17c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d33db649a5f848 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:07.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.062+0000 7fc18d042700 1 -- 172.21.15.2:0/3711810081 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17c00b870 con 0x7fc1881440f0 2023-11-26T07:12:07.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.062+0000 7fc18d042700 1 -- 172.21.15.2:0/3711810081 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17c00b9d0 con 0x7fc1881440f0 2023-11-26T07:12:07.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.062+0000 7fc18d042700 1 -- 172.21.15.2:0/3711810081 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17c00bd60 con 0x7fc1881440f0 2023-11-26T07:12:07.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.063+0000 7fc1902a8700 1 -- 172.21.15.2:0/3711810081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1881440f0 msgr2=0x7fc188071bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:07.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.063+0000 7fc1902a8700 1 --2- 172.21.15.2:0/3711810081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1881440f0 0x7fc188071bb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc1880706c0 tx=0x7fc17c009bd0 comp rx=0 tx=0).stop 2023-11-26T07:12:07.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.063+0000 7fc1902a8700 1 -- 172.21.15.2:0/3711810081 shutdown_connections 2023-11-26T07:12:07.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.063+0000 7fc1902a8700 1 --2- 172.21.15.2:0/3711810081 >> v2:172.21.15.192:3300/0 conn(0x7fc1880720f0 0x7fc18815e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:07.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.063+0000 7fc1902a8700 1 --2- 172.21.15.2:0/3711810081 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc188143ae0 0x7fc1880b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:07.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.063+0000 7fc1902a8700 1 --2- 172.21.15.2:0/3711810081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1881440f0 0x7fc188071bb0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:07.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.063+0000 7fc1902a8700 1 -- 172.21.15.2:0/3711810081 >> 172.21.15.2:0/3711810081 conn(0x7fc1880b2740 msgr2=0x7fc1880b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:07.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.063+0000 7fc1902a8700 1 -- 172.21.15.2:0/3711810081 shutdown_connections 2023-11-26T07:12:07.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.063+0000 7fc1902a8700 1 -- 172.21.15.2:0/3711810081 wait complete. 2023-11-26T07:12:07.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.064+0000 7fc1902a8700 1 Processor -- start 2023-11-26T07:12:07.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.064+0000 7fc1902a8700 1 -- start start 2023-11-26T07:12:07.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.065+0000 7fc1902a8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc1880720f0 0x7fc18813f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:07.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.065+0000 7fc1902a8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc188143ae0 0x7fc1880ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:07.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.065+0000 7fc1902a8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc1881440f0 0x7fc1880cad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:07.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.065+0000 7fc1902a8700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1881f3a40 con 0x7fc188143ae0 2023-11-26T07:12:07.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.065+0000 7fc1902a8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1881421a0 con 0x7fc1881440f0 2023-11-26T07:12:07.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.065+0000 7fc1902a8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1880cbef0 con 0x7fc1880720f0 2023-11-26T07:12:07.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.065+0000 7fc18d843700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc188143ae0 0x7fc1880ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:07.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.065+0000 7fc18d843700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc188143ae0 0x7fc1880ca7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40024/0 (socket says 172.21.15.2:40024) 2023-11-26T07:12:07.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.065+0000 7fc18d843700 1 -- 172.21.15.2:0/3440919221 learned_addr learned my addr 172.21.15.2:0/3440919221 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:07.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.065+0000 7fc18e044700 1 --2- 172.21.15.2:0/3440919221 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc1880720f0 0x7fc18813f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:07.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.065+0000 7fc18e845700 1 --2- 172.21.15.2:0/3440919221 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc1881440f0 0x7fc1880cad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:07.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.065+0000 7fc18d843700 1 -- 172.21.15.2:0/3440919221 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc1880720f0 msgr2=0x7fc18813f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:07.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.065+0000 7fc18d843700 1 --2- 172.21.15.2:0/3440919221 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc1880720f0 0x7fc18813f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:07.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.065+0000 7fc18d843700 1 -- 172.21.15.2:0/3440919221 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc1881440f0 msgr2=0x7fc1880cad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:07.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.065+0000 7fc18d843700 1 --2- 172.21.15.2:0/3440919221 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc1881440f0 0x7fc1880cad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:07.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.065+0000 7fc18d843700 1 -- 172.21.15.2:0/3440919221 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17c009550 con 0x7fc188143ae0 2023-11-26T07:12:07.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.065+0000 7fc18e845700 1 --2- 172.21.15.2:0/3440919221 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc1881440f0 0x7fc1880cad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:07.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.065+0000 7fc18d843700 1 --2- 172.21.15.2:0/3440919221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc188143ae0 0x7fc1880ca7d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc17c009fd0 tx=0x7fc17c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:07.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.065+0000 7fc17affd700 1 -- 172.21.15.2:0/3440919221 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17c004310 con 0x7fc188143ae0 2023-11-26T07:12:07.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.066+0000 7fc17affd700 1 -- 172.21.15.2:0/3440919221 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17c01f070 con 0x7fc188143ae0 2023-11-26T07:12:07.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.066+0000 7fc1902a8700 1 -- 172.21.15.2:0/3440919221 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1880cb370 con 0x7fc188143ae0 2023-11-26T07:12:07.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.066+0000 7fc17affd700 1 -- 172.21.15.2:0/3440919221 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17c0036a0 con 0x7fc188143ae0 2023-11-26T07:12:07.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.066+0000 7fc1902a8700 1 -- 172.21.15.2:0/3440919221 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1880cb700 con 0x7fc188143ae0 2023-11-26T07:12:07.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.067+0000 7fc1902a8700 1 -- 172.21.15.2:0/3440919221 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc188068670 con 0x7fc188143ae0 2023-11-26T07:12:07.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.067+0000 7fc17affd700 1 -- 172.21.15.2:0/3440919221 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc17c021030 con 0x7fc188143ae0 2023-11-26T07:12:07.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.067+0000 7fc17affd700 1 --2- 172.21.15.2:0/3440919221 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc16c06aed0 0x7fc16c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:07.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.067+0000 7fc17affd700 1 -- 172.21.15.2:0/3440919221 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc17c08a990 con 0x7fc188143ae0 2023-11-26T07:12:07.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.068+0000 7fc18e044700 1 --2- 172.21.15.2:0/3440919221 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc16c06aed0 0x7fc16c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:07.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.068+0000 7fc18e044700 1 --2- 172.21.15.2:0/3440919221 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc16c06aed0 0x7fc16c06d390 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc184006fd0 tx=0x7fc184008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:07.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.072+0000 7fc17affd700 1 -- 172.21.15.2:0/3440919221 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc17c055b50 con 0x7fc188143ae0 2023-11-26T07:12:07.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.274+0000 7fc1902a8700 1 -- 172.21.15.2:0/3440919221 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc188144830 con 0x7fc188143ae0 2023-11-26T07:12:07.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.275+0000 7fc17affd700 1 -- 172.21.15.2:0/3440919221 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16457 (secure 0 0 0) 0x7fc17c015090 con 0x7fc188143ae0 2023-11-26T07:12:07.278 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:12:07.278 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:11:35.634747+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:11:32.129474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:11:33.019837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:12:07.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.278+0000 7fc1902a8700 1 -- 172.21.15.2:0/3440919221 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc16c06aed0 msgr2=0x7fc16c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:07.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.278+0000 7fc1902a8700 1 --2- 172.21.15.2:0/3440919221 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc16c06aed0 0x7fc16c06d390 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc184006fd0 tx=0x7fc184008040 comp rx=0 tx=0).stop 2023-11-26T07:12:07.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.278+0000 7fc1902a8700 1 -- 172.21.15.2:0/3440919221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc188143ae0 msgr2=0x7fc1880ca7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:07.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.278+0000 7fc1902a8700 1 --2- 172.21.15.2:0/3440919221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc188143ae0 0x7fc1880ca7d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc17c009fd0 tx=0x7fc17c004750 comp rx=0 tx=0).stop 2023-11-26T07:12:07.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.278+0000 7fc1902a8700 1 -- 172.21.15.2:0/3440919221 shutdown_connections 2023-11-26T07:12:07.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.278+0000 7fc1902a8700 1 --2- 172.21.15.2:0/3440919221 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc16c06aed0 0x7fc16c06d390 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:07.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.278+0000 7fc1902a8700 1 --2- 172.21.15.2:0/3440919221 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc1881440f0 0x7fc1880cad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:07.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.278+0000 7fc1902a8700 1 --2- 172.21.15.2:0/3440919221 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc1880720f0 0x7fc18813f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:07.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.278+0000 7fc1902a8700 1 --2- 172.21.15.2:0/3440919221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc188143ae0 0x7fc1880ca7d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:07.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.278+0000 7fc1902a8700 1 -- 172.21.15.2:0/3440919221 >> 172.21.15.2:0/3440919221 conn(0x7fc1880b2740 msgr2=0x7fc1880cfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:07.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.278+0000 7fc1902a8700 1 -- 172.21.15.2:0/3440919221 shutdown_connections 2023-11-26T07:12:07.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.278+0000 7fc1902a8700 1 -- 172.21.15.2:0/3440919221 wait complete. 2023-11-26T07:12:07.292 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:11:28.205739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:11:32.129474+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:11:33.019837+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:12:07.292 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:12:07.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.418+0000 7fa741287700 1 Processor -- start 2023-11-26T07:12:07.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.418+0000 7fa741287700 1 -- start start 2023-11-26T07:12:07.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.419+0000 7fa741287700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa73c143ae0 0x7fa73c0b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:07.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.419+0000 7fa741287700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa73c0722c0 0x7fa73c06e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:07.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.419+0000 7fa741287700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa73c143ec0 con 0x7fa73c1440f0 2023-11-26T07:12:07.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.419+0000 7fa741287700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73c0b40a0 con 0x7fa73c143ae0 2023-11-26T07:12:07.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.419+0000 7fa741287700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c0b3ae0 con 0x7fa73c0722c0 2023-11-26T07:12:07.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.419+0000 7fa73affd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa73c143ae0 0x7fa73c0b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:07.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.419+0000 7fa73affd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa73c143ae0 0x7fa73c0b51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40030/0 (socket says 172.21.15.2:40030) 2023-11-26T07:12:07.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.419+0000 7fa73affd700 1 -- 172.21.15.2:0/169826495 learned_addr learned my addr 172.21.15.2:0/169826495 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:07.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.420+0000 7fa73b7fe700 1 --2- 172.21.15.2:0/169826495 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa73c0722c0 0x7fa73c06e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:07.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.420+0000 7fa73affd700 1 -- 172.21.15.2:0/169826495 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa73c0722c0 msgr2=0x7fa73c06e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:07.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.420+0000 7fa73affd700 1 --2- 172.21.15.2:0/169826495 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa73c0722c0 0x7fa73c06e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:07.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.420+0000 7fa73affd700 1 -- 172.21.15.2:0/169826495 >> v1:172.21.15.192:6789/0 conn(0x7fa73c1440f0 legacy=0x7fa73c071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:07.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.420+0000 7fa73affd700 1 -- 172.21.15.2:0/169826495 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c0b3dc0 con 0x7fa73c143ae0 2023-11-26T07:12:07.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.420+0000 7fa73b7fe700 1 --2- 172.21.15.2:0/169826495 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa73c0722c0 0x7fa73c06e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:12:07.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.420+0000 7fa73affd700 1 --2- 172.21.15.2:0/169826495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa73c143ae0 0x7fa73c0b51b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa7300098f0 tx=0x7fa730009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c245d8a7e62b11e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:07.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.420+0000 7fa739ffb700 1 -- 172.21.15.2:0/169826495 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa730004230 con 0x7fa73c143ae0 2023-11-26T07:12:07.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.420+0000 7fa739ffb700 1 -- 172.21.15.2:0/169826495 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa730004390 con 0x7fa73c143ae0 2023-11-26T07:12:07.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.420+0000 7fa739ffb700 1 -- 172.21.15.2:0/169826495 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7300036a0 con 0x7fa73c143ae0 2023-11-26T07:12:07.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.421+0000 7fa741287700 1 -- 172.21.15.2:0/169826495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa73c143ae0 msgr2=0x7fa73c0b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:07.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.421+0000 7fa741287700 1 --2- 172.21.15.2:0/169826495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa73c143ae0 0x7fa73c0b51b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa7300098f0 tx=0x7fa730009c00 comp rx=0 tx=0).stop 2023-11-26T07:12:07.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.421+0000 7fa741287700 1 -- 172.21.15.2:0/169826495 shutdown_connections 2023-11-26T07:12:07.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.421+0000 7fa741287700 1 --2- 172.21.15.2:0/169826495 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa73c0722c0 0x7fa73c06e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:07.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.421+0000 7fa741287700 1 --2- 172.21.15.2:0/169826495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa73c143ae0 0x7fa73c0b51b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:07.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.421+0000 7fa741287700 1 -- 172.21.15.2:0/169826495 >> 172.21.15.2:0/169826495 conn(0x7fa73c0b2740 msgr2=0x7fa73c0b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:07.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.421+0000 7fa741287700 1 -- 172.21.15.2:0/169826495 shutdown_connections 2023-11-26T07:12:07.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.421+0000 7fa741287700 1 -- 172.21.15.2:0/169826495 wait complete. 2023-11-26T07:12:07.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.422+0000 7fa741287700 1 Processor -- start 2023-11-26T07:12:07.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.422+0000 7fa741287700 1 -- start start 2023-11-26T07:12:07.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.423+0000 7fa741287700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa73c0722c0 0x7fa73c0c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:07.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.423+0000 7fa741287700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa73c143ae0 0x7fa73c1f39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:07.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.423+0000 7fa741287700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa73c1440f0 0x7fa73c0b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:07.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.423+0000 7fa741287700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c1f4f30 con 0x7fa73c0722c0 2023-11-26T07:12:07.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.423+0000 7fa741287700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c1f4320 con 0x7fa73c1440f0 2023-11-26T07:12:07.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.423+0000 7fa741287700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c1f4600 con 0x7fa73c143ae0 2023-11-26T07:12:07.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.423+0000 7fa73affd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa73c0722c0 0x7fa73c0c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:07.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.423+0000 7fa73affd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa73c0722c0 0x7fa73c0c9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40036/0 (socket says 172.21.15.2:40036) 2023-11-26T07:12:07.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.423+0000 7fa73affd700 1 -- 172.21.15.2:0/2062695757 learned_addr learned my addr 172.21.15.2:0/2062695757 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:07.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.423+0000 7fa73a7fc700 1 --2- 172.21.15.2:0/2062695757 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa73c143ae0 0x7fa73c1f39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:07.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.423+0000 7fa73b7fe700 1 --2- 172.21.15.2:0/2062695757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa73c1440f0 0x7fa73c0b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:07.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.423+0000 7fa73affd700 1 -- 172.21.15.2:0/2062695757 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa73c143ae0 msgr2=0x7fa73c1f39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:07.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.423+0000 7fa73affd700 1 --2- 172.21.15.2:0/2062695757 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa73c143ae0 0x7fa73c1f39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:07.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.423+0000 7fa73affd700 1 -- 172.21.15.2:0/2062695757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa73c1440f0 msgr2=0x7fa73c0b4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:07.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.423+0000 7fa73affd700 1 --2- 172.21.15.2:0/2062695757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa73c1440f0 0x7fa73c0b4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:07.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.423+0000 7fa73affd700 1 -- 172.21.15.2:0/2062695757 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa730009550 con 0x7fa73c0722c0 2023-11-26T07:12:07.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.423+0000 7fa73b7fe700 1 --2- 172.21.15.2:0/2062695757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa73c1440f0 0x7fa73c0b4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:12:07.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.423+0000 7fa73a7fc700 1 --2- 172.21.15.2:0/2062695757 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa73c143ae0 0x7fa73c1f39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:12:07.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.423+0000 7fa73affd700 1 --2- 172.21.15.2:0/2062695757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa73c0722c0 0x7fa73c0c9dc0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0d1bd0 tx=0x7fa730004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:07.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.424+0000 7fa7237fe700 1 -- 172.21.15.2:0/2062695757 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa730003e70 con 0x7fa73c0722c0 2023-11-26T07:12:07.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.424+0000 7fa741287700 1 -- 172.21.15.2:0/2062695757 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa73c1f48e0 con 0x7fa73c0722c0 2023-11-26T07:12:07.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.424+0000 7fa7237fe700 1 -- 172.21.15.2:0/2062695757 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73001f070 con 0x7fa73c0722c0 2023-11-26T07:12:07.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.424+0000 7fa7237fe700 1 -- 172.21.15.2:0/2062695757 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73000b8c0 con 0x7fa73c0722c0 2023-11-26T07:12:07.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.424+0000 7fa741287700 1 -- 172.21.15.2:0/2062695757 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa73c138940 con 0x7fa73c0722c0 2023-11-26T07:12:07.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.425+0000 7fa741287700 1 -- 172.21.15.2:0/2062695757 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa73c075480 con 0x7fa73c0722c0 2023-11-26T07:12:07.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.425+0000 7fa7237fe700 1 -- 172.21.15.2:0/2062695757 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa730021030 con 0x7fa73c0722c0 2023-11-26T07:12:07.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.425+0000 7fa7237fe700 1 --2- 172.21.15.2:0/2062695757 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa72806aed0 0x7fa72806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:07.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.426+0000 7fa7237fe700 1 -- 172.21.15.2:0/2062695757 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa73008ad10 con 0x7fa73c0722c0 2023-11-26T07:12:07.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.426+0000 7fa73a7fc700 1 --2- 172.21.15.2:0/2062695757 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa72806aed0 0x7fa72806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:07.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.426+0000 7fa73a7fc700 1 --2- 172.21.15.2:0/2062695757 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa72806aed0 0x7fa72806d390 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa72c006fd0 tx=0x7fa72c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:07.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.430+0000 7fa7237fe700 1 -- 172.21.15.2:0/2062695757 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa730055dd0 con 0x7fa73c0722c0 2023-11-26T07:12:07.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.634+0000 7fa741287700 1 -- 172.21.15.2:0/2062695757 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa73c144830 con 0x7fa73c0722c0 2023-11-26T07:12:07.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.634+0000 7fa7237fe700 1 -- 172.21.15.2:0/2062695757 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa7300593f0 con 0x7fa73c0722c0 2023-11-26T07:12:07.637 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-26T07:12:07.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.636+0000 7fa741287700 1 -- 172.21.15.2:0/2062695757 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa72806aed0 msgr2=0x7fa72806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:07.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.636+0000 7fa741287700 1 --2- 172.21.15.2:0/2062695757 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa72806aed0 0x7fa72806d390 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa72c006fd0 tx=0x7fa72c008040 comp rx=0 tx=0).stop 2023-11-26T07:12:07.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.636+0000 7fa741287700 1 -- 172.21.15.2:0/2062695757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa73c0722c0 msgr2=0x7fa73c0c9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:07.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.636+0000 7fa741287700 1 --2- 172.21.15.2:0/2062695757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa73c0722c0 0x7fa73c0c9dc0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0d1bd0 tx=0x7fa730004750 comp rx=0 tx=0).stop 2023-11-26T07:12:07.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.636+0000 7fa741287700 1 -- 172.21.15.2:0/2062695757 shutdown_connections 2023-11-26T07:12:07.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.636+0000 7fa741287700 1 --2- 172.21.15.2:0/2062695757 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa72806aed0 0x7fa72806d390 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:07.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.636+0000 7fa741287700 1 --2- 172.21.15.2:0/2062695757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa73c1440f0 0x7fa73c0b4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:07.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.636+0000 7fa741287700 1 --2- 172.21.15.2:0/2062695757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa73c0722c0 0x7fa73c0c9dc0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:07.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.636+0000 7fa741287700 1 --2- 172.21.15.2:0/2062695757 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa73c143ae0 0x7fa73c1f39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:07.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.636+0000 7fa741287700 1 -- 172.21.15.2:0/2062695757 >> 172.21.15.2:0/2062695757 conn(0x7fa73c0b2740 msgr2=0x7fa73c06ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:07.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.636+0000 7fa741287700 1 -- 172.21.15.2:0/2062695757 shutdown_connections 2023-11-26T07:12:07.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.636+0000 7fa741287700 1 -- 172.21.15.2:0/2062695757 wait complete. 2023-11-26T07:12:07.650 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:12:07.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.776+0000 7f2179f30700 1 Processor -- start 2023-11-26T07:12:07.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.776+0000 7f2179f30700 1 -- start start 2023-11-26T07:12:07.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.777+0000 7f2179f30700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f21740d1010 0x7f21740d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:07.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.777+0000 7f2179f30700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21740d0b80 con 0x7f2174072a00 2023-11-26T07:12:07.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.777+0000 7f2179f30700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f217415ed60 con 0x7f21740b4090 2023-11-26T07:12:07.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.777+0000 7f2179f30700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21740d1960 con 0x7f21740d1010 2023-11-26T07:12:07.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.777+0000 7f2172ffd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2174072a00 0x7f217406db60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59486/0 (socket says 172.21.15.2:59486) 2023-11-26T07:12:07.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.777+0000 7f2172ffd700 1 -- 172.21.15.2:0/2659960512 learned_addr learned my addr 172.21.15.2:0/2659960512 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:07.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.777+0000 7f2173fff700 1 --2- 172.21.15.2:0/2659960512 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f21740d1010 0x7f21740d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:07.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.777+0000 7f21727fc700 1 -- 172.21.15.2:0/2659960512 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 202943715 0 0) 0x7f21740d0b80 con 0x7f2174072a00 2023-11-26T07:12:07.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.777+0000 7f21727fc700 1 -- 172.21.15.2:0/2659960512 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f215c0035b0 con 0x7f2174072a00 2023-11-26T07:12:07.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.777+0000 7f21727fc700 1 -- 172.21.15.2:0/2659960512 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 514718721 0 0) 0x7f215c0035b0 con 0x7f2174072a00 2023-11-26T07:12:07.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.777+0000 7f21727fc700 1 -- 172.21.15.2:0/2659960512 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f21740d1010 msgr2=0x7f21740d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:07.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.777+0000 7f21727fc700 1 --2- 172.21.15.2:0/2659960512 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f21740d1010 0x7f21740d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:07.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.777+0000 7f21727fc700 1 -- 172.21.15.2:0/2659960512 >> v1:172.21.15.192:6789/0 conn(0x7f21740b4090 legacy=0x7f217415e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:07.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.777+0000 7f21727fc700 1 -- 172.21.15.2:0/2659960512 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f217415f040 con 0x7f2174072a00 2023-11-26T07:12:07.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.777+0000 7f21727fc700 1 -- 172.21.15.2:0/2659960512 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f2168001670 con 0x7f2174072a00 2023-11-26T07:12:07.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.777+0000 7f21727fc700 1 -- 172.21.15.2:0/2659960512 >> v1:172.21.15.2:6789/0 conn(0x7f2174072a00 legacy=0x7f217406db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:07.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.777+0000 7f21727fc700 1 --2- 172.21.15.2:0/2659960512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f215c003a30 0x7f215c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:07.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.777+0000 7f21727fc700 1 --2- 172.21.15.2:0/2659960512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f215c004850 0x7f215c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:07.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.778+0000 7f21727fc700 1 --2- 172.21.15.2:0/2659960512 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f21740d1010 0x7f215c0052e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:07.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.778+0000 7f21727fc700 1 -- 172.21.15.2:0/2659960512 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21740d1960 con 0x7f215c003a30 2023-11-26T07:12:07.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.778+0000 7f21727fc700 1 -- 172.21.15.2:0/2659960512 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215c00bbd0 con 0x7f215c004850 2023-11-26T07:12:07.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.778+0000 7f21727fc700 1 -- 172.21.15.2:0/2659960512 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f215c00bd90 con 0x7f21740d1010 2023-11-26T07:12:07.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.778+0000 7f21737fe700 1 --2- 172.21.15.2:0/2659960512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f215c003a30 0x7f215c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:07.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.778+0000 7f2172ffd700 1 --2- 172.21.15.2:0/2659960512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f215c004850 0x7f215c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:07.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.778+0000 7f2173fff700 1 --2- 172.21.15.2:0/2659960512 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f21740d1010 0x7f215c0052e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:07.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.778+0000 7f21737fe700 1 -- 172.21.15.2:0/2659960512 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f21740d1010 msgr2=0x7f215c0052e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:07.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.778+0000 7f21737fe700 1 --2- 172.21.15.2:0/2659960512 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f21740d1010 0x7f215c0052e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:07.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.778+0000 7f21737fe700 1 -- 172.21.15.2:0/2659960512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f215c004850 msgr2=0x7f215c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:07.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.778+0000 7f21737fe700 1 --2- 172.21.15.2:0/2659960512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f215c004850 0x7f215c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:07.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.778+0000 7f21737fe700 1 -- 172.21.15.2:0/2659960512 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f215c0035b0 con 0x7f215c003a30 2023-11-26T07:12:07.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.778+0000 7f21737fe700 1 --2- 172.21.15.2:0/2659960512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f215c003a30 0x7f215c003e50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f21640017c0 tx=0x7f215c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3bf5c57e1947f01 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:07.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.778+0000 7f21727fc700 1 -- 172.21.15.2:0/2659960512 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21640052d0 con 0x7f215c003a30 2023-11-26T07:12:07.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.778+0000 7f21727fc700 1 -- 172.21.15.2:0/2659960512 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2164005430 con 0x7f215c003a30 2023-11-26T07:12:07.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.778+0000 7f21727fc700 1 -- 172.21.15.2:0/2659960512 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21640038c0 con 0x7f215c003a30 2023-11-26T07:12:07.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.779+0000 7f2179f30700 1 -- 172.21.15.2:0/2659960512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f215c003a30 msgr2=0x7f215c003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:07.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.779+0000 7f2179f30700 1 --2- 172.21.15.2:0/2659960512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f215c003a30 0x7f215c003e50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f21640017c0 tx=0x7f215c005880 comp rx=0 tx=0).stop 2023-11-26T07:12:07.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.779+0000 7f2173fff700 1 -- 172.21.15.2:0/2659960512 reap_dead start 2023-11-26T07:12:07.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.779+0000 7f2179f30700 1 -- 172.21.15.2:0/2659960512 shutdown_connections 2023-11-26T07:12:07.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.779+0000 7f2179f30700 1 -- 172.21.15.2:0/2659960512 >> 172.21.15.2:0/2659960512 conn(0x7f21740b2740 msgr2=0x7f21740b2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:07.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.779+0000 7f2179f30700 1 -- 172.21.15.2:0/2659960512 shutdown_connections 2023-11-26T07:12:07.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.779+0000 7f2179f30700 1 -- 172.21.15.2:0/2659960512 wait complete. 2023-11-26T07:12:07.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.780+0000 7f2179f30700 1 Processor -- start 2023-11-26T07:12:07.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.780+0000 7f2179f30700 1 -- start start 2023-11-26T07:12:07.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.781+0000 7f2179f30700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f215c003a30 0x7f21740b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:07.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.781+0000 7f2179f30700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21741ea1f0 0x7f2174151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:07.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.781+0000 7f2179f30700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21740b1110 0x7f21740b1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:07.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.781+0000 7f2179f30700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2174151c50 con 0x7f21741ea1f0 2023-11-26T07:12:07.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.781+0000 7f2179f30700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2174151740 con 0x7f21740b1110 2023-11-26T07:12:07.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.781+0000 7f2179f30700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21741ea670 con 0x7f215c003a30 2023-11-26T07:12:07.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.781+0000 7f2172ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21741ea1f0 0x7f2174151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:07.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.781+0000 7f2172ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21741ea1f0 0x7f2174151200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40058/0 (socket says 172.21.15.2:40058) 2023-11-26T07:12:07.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.781+0000 7f2172ffd700 1 -- 172.21.15.2:0/3020625365 learned_addr learned my addr 172.21.15.2:0/3020625365 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:07.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.781+0000 7f21737fe700 1 --2- 172.21.15.2:0/3020625365 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f215c003a30 0x7f21740b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:07.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.781+0000 7f2173fff700 1 --2- 172.21.15.2:0/3020625365 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21740b1110 0x7f21740b1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:07.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.781+0000 7f2172ffd700 1 -- 172.21.15.2:0/3020625365 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f215c003a30 msgr2=0x7f21740b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:07.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.781+0000 7f2172ffd700 1 --2- 172.21.15.2:0/3020625365 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f215c003a30 0x7f21740b1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:07.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.781+0000 7f2172ffd700 1 -- 172.21.15.2:0/3020625365 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21740b1110 msgr2=0x7f21740b1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:07.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.781+0000 7f2172ffd700 1 --2- 172.21.15.2:0/3020625365 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21740b1110 0x7f21740b1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:07.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.781+0000 7f2172ffd700 1 -- 172.21.15.2:0/3020625365 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f217406e3f0 con 0x7f21741ea1f0 2023-11-26T07:12:07.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.781+0000 7f21737fe700 1 --2- 172.21.15.2:0/3020625365 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f215c003a30 0x7f21740b1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:07.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.782+0000 7f2172ffd700 1 --2- 172.21.15.2:0/3020625365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21741ea1f0 0x7f2174151200 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f21680072f0 tx=0x7f21680076b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:07.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.782+0000 7f215bfff700 1 -- 172.21.15.2:0/3020625365 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21680077d0 con 0x7f21741ea1f0 2023-11-26T07:12:07.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.782+0000 7f215bfff700 1 -- 172.21.15.2:0/3020625365 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216800f8d0 con 0x7f21741ea1f0 2023-11-26T07:12:07.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.782+0000 7f2179f30700 1 -- 172.21.15.2:0/3020625365 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21740ae230 con 0x7f21741ea1f0 2023-11-26T07:12:07.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.782+0000 7f215bfff700 1 -- 172.21.15.2:0/3020625365 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216800fc80 con 0x7f21741ea1f0 2023-11-26T07:12:07.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.782+0000 7f2179f30700 1 -- 172.21.15.2:0/3020625365 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21740b1ad0 con 0x7f21741ea1f0 2023-11-26T07:12:07.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.783+0000 7f2179f30700 1 -- 172.21.15.2:0/3020625365 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2174075480 con 0x7f21741ea1f0 2023-11-26T07:12:07.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.783+0000 7f215bfff700 1 -- 172.21.15.2:0/3020625365 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f216801e3b0 con 0x7f21741ea1f0 2023-11-26T07:12:07.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.784+0000 7f215bfff700 1 --2- 172.21.15.2:0/3020625365 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f216006aed0 0x7f216006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:07.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.784+0000 7f215bfff700 1 -- 172.21.15.2:0/3020625365 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2168089020 con 0x7f21741ea1f0 2023-11-26T07:12:07.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.784+0000 7f21737fe700 1 --2- 172.21.15.2:0/3020625365 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f216006aed0 0x7f216006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:07.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.784+0000 7f21737fe700 1 --2- 172.21.15.2:0/3020625365 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f216006aed0 0x7f216006d390 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2164000c00 tx=0x7f2164009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:07.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.788+0000 7f215bfff700 1 -- 172.21.15.2:0/3020625365 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f21680540d0 con 0x7f21741ea1f0 2023-11-26T07:12:07.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.989+0000 7f2179f30700 1 -- 172.21.15.2:0/3020625365 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2174072650 con 0x7f21741ea1f0 2023-11-26T07:12:07.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.989+0000 7f215bfff700 1 -- 172.21.15.2:0/3020625365 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f21680576f0 con 0x7f21741ea1f0 2023-11-26T07:12:07.991 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-26T07:12:07.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.991+0000 7f2179f30700 1 -- 172.21.15.2:0/3020625365 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f216006aed0 msgr2=0x7f216006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:07.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.991+0000 7f2179f30700 1 --2- 172.21.15.2:0/3020625365 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f216006aed0 0x7f216006d390 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2164000c00 tx=0x7f2164009030 comp rx=0 tx=0).stop 2023-11-26T07:12:07.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.991+0000 7f2179f30700 1 -- 172.21.15.2:0/3020625365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21741ea1f0 msgr2=0x7f2174151200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:07.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.991+0000 7f2179f30700 1 --2- 172.21.15.2:0/3020625365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21741ea1f0 0x7f2174151200 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f21680072f0 tx=0x7f21680076b0 comp rx=0 tx=0).stop 2023-11-26T07:12:07.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.991+0000 7f2179f30700 1 -- 172.21.15.2:0/3020625365 shutdown_connections 2023-11-26T07:12:07.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.991+0000 7f2179f30700 1 --2- 172.21.15.2:0/3020625365 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f216006aed0 0x7f216006d390 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:07.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.991+0000 7f2179f30700 1 --2- 172.21.15.2:0/3020625365 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21740b1110 0x7f21740b1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:07.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.991+0000 7f2179f30700 1 --2- 172.21.15.2:0/3020625365 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f215c003a30 0x7f21740b1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:07.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.991+0000 7f2179f30700 1 --2- 172.21.15.2:0/3020625365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21741ea1f0 0x7f2174151200 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:07.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.991+0000 7f2179f30700 1 -- 172.21.15.2:0/3020625365 >> 172.21.15.2:0/3020625365 conn(0x7f21740b2740 msgr2=0x7f217406db60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:07.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.991+0000 7f2179f30700 1 -- 172.21.15.2:0/3020625365 shutdown_connections 2023-11-26T07:12:07.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:07.991+0000 7f2179f30700 1 -- 172.21.15.2:0/3020625365 wait complete. 2023-11-26T07:12:08.005 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:12:08.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.131+0000 7f9bdef64700 1 Processor -- start 2023-11-26T07:12:08.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.131+0000 7f9bdef64700 1 -- start start 2023-11-26T07:12:08.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.132+0000 7f9bdef64700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9bd806b6e0 0x7f9bd806db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:08.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.132+0000 7f9bdef64700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bd8160720 con 0x7f9bd8145100 2023-11-26T07:12:08.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.132+0000 7f9bdef64700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bd806f710 con 0x7f9bd8144c10 2023-11-26T07:12:08.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.132+0000 7f9bdef64700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd806f500 con 0x7f9bd806b6e0 2023-11-26T07:12:08.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.132+0000 7f9bdd501700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f9bd8145100 0x7f9bd806e0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59508/0 (socket says 172.21.15.2:59508) 2023-11-26T07:12:08.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.132+0000 7f9bdd501700 1 -- 172.21.15.2:0/999040569 learned_addr learned my addr 172.21.15.2:0/999040569 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:08.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.132+0000 7f9bd7fff700 1 --2- 172.21.15.2:0/999040569 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9bd806b6e0 0x7f9bd806db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:08.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.132+0000 7f9bd77fe700 1 -- 172.21.15.2:0/999040569 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2504349277 0 0) 0x7f9bd8160720 con 0x7f9bd8145100 2023-11-26T07:12:08.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.132+0000 7f9bd77fe700 1 -- 172.21.15.2:0/999040569 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bc80035b0 con 0x7f9bd8145100 2023-11-26T07:12:08.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.133+0000 7f9bd77fe700 1 -- 172.21.15.2:0/999040569 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2188194020 0 0) 0x7f9bd806f710 con 0x7f9bd8144c10 2023-11-26T07:12:08.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.133+0000 7f9bd7fff700 1 -- 172.21.15.2:0/999040569 >> v1:172.21.15.192:6789/0 conn(0x7f9bd8144c10 legacy=0x7f9bd806afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:08.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.133+0000 7f9bd7fff700 1 -- 172.21.15.2:0/999040569 >> v1:172.21.15.2:6789/0 conn(0x7f9bd8145100 legacy=0x7f9bd806e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:08.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.133+0000 7f9bd7fff700 1 -- 172.21.15.2:0/999040569 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd806f9f0 con 0x7f9bd806b6e0 2023-11-26T07:12:08.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.133+0000 7f9bd7fff700 1 --2- 172.21.15.2:0/999040569 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9bd806b6e0 0x7f9bd806db70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9bc4009870 tx=0x7f9bc4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5962a893d2c9d911 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:08.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.133+0000 7f9bd77fe700 1 -- 172.21.15.2:0/999040569 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd0001970 con 0x7f9bd806b6e0 2023-11-26T07:12:08.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.133+0000 7f9bd77fe700 1 -- 172.21.15.2:0/999040569 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc4004030 con 0x7f9bd806b6e0 2023-11-26T07:12:08.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.133+0000 7f9bd77fe700 1 -- 172.21.15.2:0/999040569 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc40043a0 con 0x7f9bd806b6e0 2023-11-26T07:12:08.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.134+0000 7f9bdef64700 1 -- 172.21.15.2:0/999040569 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9bd806b6e0 msgr2=0x7f9bd806db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:08.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.134+0000 7f9bdef64700 1 --2- 172.21.15.2:0/999040569 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9bd806b6e0 0x7f9bd806db70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9bc4009870 tx=0x7f9bc4009b80 comp rx=0 tx=0).stop 2023-11-26T07:12:08.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.134+0000 7f9bdef64700 1 -- 172.21.15.2:0/999040569 shutdown_connections 2023-11-26T07:12:08.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.134+0000 7f9bdef64700 1 --2- 172.21.15.2:0/999040569 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9bd806b6e0 0x7f9bd806db70 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:08.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.134+0000 7f9bdef64700 1 -- 172.21.15.2:0/999040569 >> 172.21.15.2:0/999040569 conn(0x7f9bd80b2740 msgr2=0x7f9bd80b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:08.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.134+0000 7f9bdef64700 1 -- 172.21.15.2:0/999040569 shutdown_connections 2023-11-26T07:12:08.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.134+0000 7f9bdef64700 1 -- 172.21.15.2:0/999040569 wait complete. 2023-11-26T07:12:08.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.135+0000 7f9bdef64700 1 Processor -- start 2023-11-26T07:12:08.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.135+0000 7f9bdef64700 1 -- start start 2023-11-26T07:12:08.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.136+0000 7f9bdef64700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bd806b6e0 0x7f9bd8151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:08.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.136+0000 7f9bdef64700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9bd8144c10 0x7f9bd80aa230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:08.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.136+0000 7f9bdef64700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9bd8145100 0x7f9bd80aa770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:08.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.136+0000 7f9bdef64700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd81434e0 con 0x7f9bd806b6e0 2023-11-26T07:12:08.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.136+0000 7f9bdef64700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd81437c0 con 0x7f9bd8144c10 2023-11-26T07:12:08.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.136+0000 7f9bdef64700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd8143aa0 con 0x7f9bd8145100 2023-11-26T07:12:08.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.136+0000 7f9bdcd00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bd806b6e0 0x7f9bd8151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:08.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.136+0000 7f9bdcd00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bd806b6e0 0x7f9bd8151670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40068/0 (socket says 172.21.15.2:40068) 2023-11-26T07:12:08.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.136+0000 7f9bdcd00700 1 -- 172.21.15.2:0/2325375922 learned_addr learned my addr 172.21.15.2:0/2325375922 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:08.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.136+0000 7f9bdd501700 1 --2- 172.21.15.2:0/2325375922 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9bd8145100 0x7f9bd80aa770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:08.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.136+0000 7f9bd7fff700 1 --2- 172.21.15.2:0/2325375922 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9bd8144c10 0x7f9bd80aa230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:08.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.136+0000 7f9bdcd00700 1 -- 172.21.15.2:0/2325375922 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9bd8145100 msgr2=0x7f9bd80aa770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:08.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.136+0000 7f9bdcd00700 1 --2- 172.21.15.2:0/2325375922 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9bd8145100 0x7f9bd80aa770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:08.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.136+0000 7f9bdcd00700 1 -- 172.21.15.2:0/2325375922 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9bd8144c10 msgr2=0x7f9bd80aa230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:08.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.136+0000 7f9bdcd00700 1 --2- 172.21.15.2:0/2325375922 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9bd8144c10 0x7f9bd80aa230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:08.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.136+0000 7f9bdcd00700 1 -- 172.21.15.2:0/2325375922 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc40094a0 con 0x7f9bd806b6e0 2023-11-26T07:12:08.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.136+0000 7f9bdd501700 1 --2- 172.21.15.2:0/2325375922 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9bd8145100 0x7f9bd80aa770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:08.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.136+0000 7f9bdcd00700 1 --2- 172.21.15.2:0/2325375922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bd806b6e0 0x7f9bd8151670 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc00c730 tx=0x7f9bcc00caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:08.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.137+0000 7f9bd57fa700 1 -- 172.21.15.2:0/2325375922 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bcc0054e0 con 0x7f9bd806b6e0 2023-11-26T07:12:08.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.137+0000 7f9bd57fa700 1 -- 172.21.15.2:0/2325375922 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bcc003680 con 0x7f9bd806b6e0 2023-11-26T07:12:08.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.137+0000 7f9bdef64700 1 -- 172.21.15.2:0/2325375922 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bd8143d80 con 0x7f9bd806b6e0 2023-11-26T07:12:08.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.137+0000 7f9bd57fa700 1 -- 172.21.15.2:0/2325375922 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bcc003a30 con 0x7f9bd806b6e0 2023-11-26T07:12:08.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.137+0000 7f9bdef64700 1 -- 172.21.15.2:0/2325375922 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bd8143100 con 0x7f9bd806b6e0 2023-11-26T07:12:08.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.138+0000 7f9bdef64700 1 -- 172.21.15.2:0/2325375922 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bd80cd350 con 0x7f9bd806b6e0 2023-11-26T07:12:08.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.138+0000 7f9bd57fa700 1 -- 172.21.15.2:0/2325375922 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9bcc003b90 con 0x7f9bd806b6e0 2023-11-26T07:12:08.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.139+0000 7f9bd57fa700 1 --2- 172.21.15.2:0/2325375922 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9bbc06aed0 0x7f9bbc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:08.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.139+0000 7f9bd57fa700 1 -- 172.21.15.2:0/2325375922 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9bcc088b00 con 0x7f9bd806b6e0 2023-11-26T07:12:08.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.139+0000 7f9bd7fff700 1 --2- 172.21.15.2:0/2325375922 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9bbc06aed0 0x7f9bbc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:08.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.139+0000 7f9bd7fff700 1 --2- 172.21.15.2:0/2325375922 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9bbc06aed0 0x7f9bbc06d390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9bc4000c00 tx=0x7f9bc4008000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:08.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.143+0000 7f9bd57fa700 1 -- 172.21.15.2:0/2325375922 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9bcc053c40 con 0x7f9bd806b6e0 2023-11-26T07:12:08.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.346+0000 7f9bdef64700 1 -- 172.21.15.2:0/2325375922 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9bd8143290 con 0x7f9bd806b6e0 2023-11-26T07:12:08.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.346+0000 7f9bd57fa700 1 -- 172.21.15.2:0/2325375922 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9bcc017020 con 0x7f9bd806b6e0 2023-11-26T07:12:08.348 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-26T07:12:08.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.348+0000 7f9bdef64700 1 -- 172.21.15.2:0/2325375922 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9bbc06aed0 msgr2=0x7f9bbc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:08.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.348+0000 7f9bdef64700 1 --2- 172.21.15.2:0/2325375922 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9bbc06aed0 0x7f9bbc06d390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9bc4000c00 tx=0x7f9bc4008000 comp rx=0 tx=0).stop 2023-11-26T07:12:08.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.348+0000 7f9bdef64700 1 -- 172.21.15.2:0/2325375922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bd806b6e0 msgr2=0x7f9bd8151670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:08.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.348+0000 7f9bdef64700 1 --2- 172.21.15.2:0/2325375922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bd806b6e0 0x7f9bd8151670 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc00c730 tx=0x7f9bcc00caf0 comp rx=0 tx=0).stop 2023-11-26T07:12:08.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.349+0000 7f9bdef64700 1 -- 172.21.15.2:0/2325375922 shutdown_connections 2023-11-26T07:12:08.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.349+0000 7f9bdef64700 1 --2- 172.21.15.2:0/2325375922 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9bbc06aed0 0x7f9bbc06d390 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:08.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.349+0000 7f9bdef64700 1 --2- 172.21.15.2:0/2325375922 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9bd8145100 0x7f9bd80aa770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:08.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.349+0000 7f9bdef64700 1 --2- 172.21.15.2:0/2325375922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bd806b6e0 0x7f9bd8151670 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:08.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.349+0000 7f9bdef64700 1 --2- 172.21.15.2:0/2325375922 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9bd8144c10 0x7f9bd80aa230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:08.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.349+0000 7f9bdef64700 1 -- 172.21.15.2:0/2325375922 >> 172.21.15.2:0/2325375922 conn(0x7f9bd80b2740 msgr2=0x7f9bd80b15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:08.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.349+0000 7f9bdef64700 1 -- 172.21.15.2:0/2325375922 shutdown_connections 2023-11-26T07:12:08.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.349+0000 7f9bdef64700 1 -- 172.21.15.2:0/2325375922 wait complete. 2023-11-26T07:12:08.363 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-26T07:12:08.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.487+0000 7f5f16c8f700 1 Processor -- start 2023-11-26T07:12:08.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.487+0000 7f5f16c8f700 1 -- start start 2023-11-26T07:12:08.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.488+0000 7f5f16c8f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5f10143ae0 0x7f5f100b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:08.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.488+0000 7f5f16c8f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f100722c0 0x7f5f1006e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:08.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.488+0000 7f5f16c8f700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f10143ec0 con 0x7f5f101440f0 2023-11-26T07:12:08.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.488+0000 7f5f16c8f700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f100b40a0 con 0x7f5f10143ae0 2023-11-26T07:12:08.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.488+0000 7f5f16c8f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f100b3ae0 con 0x7f5f100722c0 2023-11-26T07:12:08.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.488+0000 7f5f0ffff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f5f101440f0 0x7f5f10071bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59518/0 (socket says 172.21.15.2:59518) 2023-11-26T07:12:08.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.488+0000 7f5f0ffff700 1 -- 172.21.15.2:0/3464004610 learned_addr learned my addr 172.21.15.2:0/3464004610 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:08.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.488+0000 7f5f1522c700 1 --2- 172.21.15.2:0/3464004610 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f100722c0 0x7f5f1006e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:08.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.488+0000 7f5f14a2b700 1 --2- 172.21.15.2:0/3464004610 >> v2:172.21.15.192:3300/0 conn(0x7f5f10143ae0 0x7f5f100b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:08.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.488+0000 7f5f0f7fe700 1 -- 172.21.15.2:0/3464004610 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1183950083 0 0) 0x7f5f10143ec0 con 0x7f5f101440f0 2023-11-26T07:12:08.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.488+0000 7f5f0f7fe700 1 -- 172.21.15.2:0/3464004610 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f000035b0 con 0x7f5f101440f0 2023-11-26T07:12:08.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.489+0000 7f5f1522c700 1 -- 172.21.15.2:0/3464004610 >> v2:172.21.15.192:3300/0 conn(0x7f5f10143ae0 msgr2=0x7f5f100b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:08.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.489+0000 7f5f1522c700 1 --2- 172.21.15.2:0/3464004610 >> v2:172.21.15.192:3300/0 conn(0x7f5f10143ae0 0x7f5f100b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:08.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.489+0000 7f5f1522c700 1 -- 172.21.15.2:0/3464004610 >> v1:172.21.15.2:6789/0 conn(0x7f5f101440f0 legacy=0x7f5f10071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:08.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.489+0000 7f5f0f7fe700 1 -- 172.21.15.2:0/3464004610 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1130459083 0 0) 0x7f5f000035b0 con 0x7f5f101440f0 2023-11-26T07:12:08.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.489+0000 7f5f1522c700 1 -- 172.21.15.2:0/3464004610 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f100b3dc0 con 0x7f5f100722c0 2023-11-26T07:12:08.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.489+0000 7f5f14a2b700 1 --2- 172.21.15.2:0/3464004610 >> v2:172.21.15.192:3300/0 conn(0x7f5f10143ae0 0x7f5f100b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:12:08.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.489+0000 7f5f1522c700 1 --2- 172.21.15.2:0/3464004610 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f100722c0 0x7f5f1006e510 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5f08009d90 tx=0x7f5f0800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3006c17a56f65179 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:08.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.489+0000 7f5f0f7fe700 1 -- 172.21.15.2:0/3464004610 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0800e070 con 0x7f5f100722c0 2023-11-26T07:12:08.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.489+0000 7f5f0f7fe700 1 -- 172.21.15.2:0/3464004610 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f08003a20 con 0x7f5f100722c0 2023-11-26T07:12:08.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.489+0000 7f5f0f7fe700 1 -- 172.21.15.2:0/3464004610 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5efc001670 con 0x7f5f100722c0 2023-11-26T07:12:08.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.490+0000 7f5f16c8f700 1 -- 172.21.15.2:0/3464004610 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f100722c0 msgr2=0x7f5f1006e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:08.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.490+0000 7f5f16c8f700 1 --2- 172.21.15.2:0/3464004610 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f100722c0 0x7f5f1006e510 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5f08009d90 tx=0x7f5f0800b330 comp rx=0 tx=0).stop 2023-11-26T07:12:08.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.490+0000 7f5f16c8f700 1 -- 172.21.15.2:0/3464004610 shutdown_connections 2023-11-26T07:12:08.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.490+0000 7f5f16c8f700 1 --2- 172.21.15.2:0/3464004610 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f100722c0 0x7f5f1006e510 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:08.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.490+0000 7f5f16c8f700 1 --2- 172.21.15.2:0/3464004610 >> v2:172.21.15.192:3300/0 conn(0x7f5f10143ae0 0x7f5f100b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:08.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.490+0000 7f5f16c8f700 1 -- 172.21.15.2:0/3464004610 >> 172.21.15.2:0/3464004610 conn(0x7f5f100b2740 msgr2=0x7f5f100b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:08.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.490+0000 7f5f16c8f700 1 -- 172.21.15.2:0/3464004610 shutdown_connections 2023-11-26T07:12:08.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.490+0000 7f5f16c8f700 1 -- 172.21.15.2:0/3464004610 wait complete. 2023-11-26T07:12:08.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.491+0000 7f5f16c8f700 1 Processor -- start 2023-11-26T07:12:08.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.491+0000 7f5f16c8f700 1 -- start start 2023-11-26T07:12:08.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.492+0000 7f5f16c8f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f100722c0 0x7f5f1015e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:08.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.492+0000 7f5f16c8f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f10143ae0 0x7f5f1006afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:08.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.492+0000 7f5f16c8f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f101440f0 0x7f5f1006b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:08.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.492+0000 7f5f16c8f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f100c6910 con 0x7f5f100722c0 2023-11-26T07:12:08.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.492+0000 7f5f16c8f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f100c6bf0 con 0x7f5f101440f0 2023-11-26T07:12:08.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.492+0000 7f5f16c8f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f100c6ed0 con 0x7f5f10143ae0 2023-11-26T07:12:08.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.492+0000 7f5f14a2b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f100722c0 0x7f5f1015e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:08.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.492+0000 7f5f14a2b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f100722c0 0x7f5f1015e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40082/0 (socket says 172.21.15.2:40082) 2023-11-26T07:12:08.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.492+0000 7f5f14a2b700 1 -- 172.21.15.2:0/2865699391 learned_addr learned my addr 172.21.15.2:0/2865699391 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:08.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.492+0000 7f5f1522c700 1 --2- 172.21.15.2:0/2865699391 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f101440f0 0x7f5f1006b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:08.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.492+0000 7f5f0ffff700 1 --2- 172.21.15.2:0/2865699391 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f10143ae0 0x7f5f1006afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:08.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.492+0000 7f5f14a2b700 1 -- 172.21.15.2:0/2865699391 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f10143ae0 msgr2=0x7f5f1006afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:08.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.492+0000 7f5f14a2b700 1 --2- 172.21.15.2:0/2865699391 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f10143ae0 0x7f5f1006afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:08.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.492+0000 7f5f14a2b700 1 -- 172.21.15.2:0/2865699391 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f101440f0 msgr2=0x7f5f1006b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:08.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.492+0000 7f5f14a2b700 1 --2- 172.21.15.2:0/2865699391 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f101440f0 0x7f5f1006b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:08.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.492+0000 7f5f14a2b700 1 -- 172.21.15.2:0/2865699391 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f040094a0 con 0x7f5f100722c0 2023-11-26T07:12:08.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.492+0000 7f5f1522c700 1 --2- 172.21.15.2:0/2865699391 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f101440f0 0x7f5f1006b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:12:08.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.492+0000 7f5f14a2b700 1 --2- 172.21.15.2:0/2865699391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f100722c0 0x7f5f1015e5d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5f0400ebe0 tx=0x7f5f04009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:08.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.493+0000 7f5f0d7fa700 1 -- 172.21.15.2:0/2865699391 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0400c910 con 0x7f5f100722c0 2023-11-26T07:12:08.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.493+0000 7f5f0d7fa700 1 -- 172.21.15.2:0/2865699391 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0400ca70 con 0x7f5f100722c0 2023-11-26T07:12:08.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.493+0000 7f5f16c8f700 1 -- 172.21.15.2:0/2865699391 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f08009a70 con 0x7f5f100722c0 2023-11-26T07:12:08.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.493+0000 7f5f0d7fa700 1 -- 172.21.15.2:0/2865699391 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0400cde0 con 0x7f5f100722c0 2023-11-26T07:12:08.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.493+0000 7f5f16c8f700 1 -- 172.21.15.2:0/2865699391 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f100c7490 con 0x7f5f100722c0 2023-11-26T07:12:08.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.493+0000 7f5f16c8f700 1 -- 172.21.15.2:0/2865699391 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f10068670 con 0x7f5f100722c0 2023-11-26T07:12:08.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.494+0000 7f5f0d7fa700 1 -- 172.21.15.2:0/2865699391 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5f04013470 con 0x7f5f100722c0 2023-11-26T07:12:08.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.494+0000 7f5f0d7fa700 1 --2- 172.21.15.2:0/2865699391 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5ef406aed0 0x7f5ef406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:08.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.495+0000 7f5f0d7fa700 1 -- 172.21.15.2:0/2865699391 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f04089820 con 0x7f5f100722c0 2023-11-26T07:12:08.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.495+0000 7f5f0ffff700 1 --2- 172.21.15.2:0/2865699391 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5ef406aed0 0x7f5ef406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:08.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.495+0000 7f5f0ffff700 1 --2- 172.21.15.2:0/2865699391 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5ef406aed0 0x7f5ef406d390 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5efc001eb0 tx=0x7f5efc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:08.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.499+0000 7f5f0d7fa700 1 -- 172.21.15.2:0/2865699391 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5f04054830 con 0x7f5f100722c0 2023-11-26T07:12:08.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.715+0000 7f5f16c8f700 1 -- 172.21.15.2:0/2865699391 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5f100b5d20 con 0x7f5f100722c0 2023-11-26T07:12:08.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.716+0000 7f5f0d7fa700 1 -- 172.21.15.2:0/2865699391 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5f04057e50 con 0x7f5f100722c0 2023-11-26T07:12:08.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.718+0000 7f5f16c8f700 1 -- 172.21.15.2:0/2865699391 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5ef406aed0 msgr2=0x7f5ef406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:08.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.718+0000 7f5f16c8f700 1 --2- 172.21.15.2:0/2865699391 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5ef406aed0 0x7f5ef406d390 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5efc001eb0 tx=0x7f5efc009040 comp rx=0 tx=0).stop 2023-11-26T07:12:08.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.718+0000 7f5f16c8f700 1 -- 172.21.15.2:0/2865699391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f100722c0 msgr2=0x7f5f1015e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:08.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.718+0000 7f5f16c8f700 1 --2- 172.21.15.2:0/2865699391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f100722c0 0x7f5f1015e5d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5f0400ebe0 tx=0x7f5f04009ec0 comp rx=0 tx=0).stop 2023-11-26T07:12:08.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.718+0000 7f5f16c8f700 1 -- 172.21.15.2:0/2865699391 shutdown_connections 2023-11-26T07:12:08.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.718+0000 7f5f16c8f700 1 --2- 172.21.15.2:0/2865699391 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5ef406aed0 0x7f5ef406d390 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:08.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.718+0000 7f5f16c8f700 1 --2- 172.21.15.2:0/2865699391 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f101440f0 0x7f5f1006b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:08.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.718+0000 7f5f16c8f700 1 --2- 172.21.15.2:0/2865699391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f100722c0 0x7f5f1015e5d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:08.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.718+0000 7f5f16c8f700 1 --2- 172.21.15.2:0/2865699391 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f10143ae0 0x7f5f1006afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:08.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.718+0000 7f5f16c8f700 1 -- 172.21.15.2:0/2865699391 >> 172.21.15.2:0/2865699391 conn(0x7f5f100b2740 msgr2=0x7f5f100b51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:08.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.718+0000 7f5f16c8f700 1 -- 172.21.15.2:0/2865699391 shutdown_connections 2023-11-26T07:12:08.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:08.718+0000 7f5f16c8f700 1 -- 172.21.15.2:0/2865699391 wait complete. 2023-11-26T07:12:08.721 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2023-11-26T07:12:08.732 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-26T07:12:08.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:08.732 DEBUG:teuthology.orchestra.run.smithi002:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-11-26T07:12:08.773 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2023-11-26T07:12:08.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:08.773 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-26T07:12:08.834 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:12:08.834 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:08.856 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:12:08.856 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:08.916 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:12:08.916 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:08.976 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:12:09.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.099+0000 7f412dcf6700 1 Processor -- start 2023-11-26T07:12:09.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.099+0000 7f412dcf6700 1 -- start start 2023-11-26T07:12:09.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.100+0000 7f412dcf6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41280cecd0 0x7f412815c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:09.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.100+0000 7f412dcf6700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41280d0a90 con 0x7f412815bde0 2023-11-26T07:12:09.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.100+0000 7f412dcf6700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f412806ee10 con 0x7f41280cf2b0 2023-11-26T07:12:09.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.101+0000 7f412dcf6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f412806f0f0 con 0x7f41280cecd0 2023-11-26T07:12:09.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.101+0000 7f41277fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f412815bde0 0x7f41280d01b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59532/0 (socket says 172.21.15.2:59532) 2023-11-26T07:12:09.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.101+0000 7f41277fe700 1 -- 172.21.15.2:0/3162851211 learned_addr learned my addr 172.21.15.2:0/3162851211 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:09.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.101+0000 7f4127fff700 1 --2- 172.21.15.2:0/3162851211 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41280cecd0 0x7f412815c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:09.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.101+0000 7f41267fc700 1 -- 172.21.15.2:0/3162851211 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3899510698 0 0) 0x7f41280d0a90 con 0x7f412815bde0 2023-11-26T07:12:09.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.101+0000 7f41267fc700 1 -- 172.21.15.2:0/3162851211 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41140035b0 con 0x7f412815bde0 2023-11-26T07:12:09.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.101+0000 7f41267fc700 1 -- 172.21.15.2:0/3162851211 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 390170544 0 0) 0x7f412806ee10 con 0x7f41280cf2b0 2023-11-26T07:12:09.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.101+0000 7f41267fc700 1 -- 172.21.15.2:0/3162851211 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41280d0a90 con 0x7f41280cf2b0 2023-11-26T07:12:09.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.101+0000 7f41267fc700 1 -- 172.21.15.2:0/3162851211 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2292208662 0 0) 0x7f41140035b0 con 0x7f412815bde0 2023-11-26T07:12:09.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.101+0000 7f41267fc700 1 -- 172.21.15.2:0/3162851211 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41280cecd0 msgr2=0x7f412815c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:09.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.101+0000 7f41267fc700 1 --2- 172.21.15.2:0/3162851211 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41280cecd0 0x7f412815c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:09.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.101+0000 7f41267fc700 1 -- 172.21.15.2:0/3162851211 >> v1:172.21.15.192:6789/0 conn(0x7f41280cf2b0 legacy=0x7f41280ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:09.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.101+0000 7f41267fc700 1 -- 172.21.15.2:0/3162851211 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f412806f3d0 con 0x7f412815bde0 2023-11-26T07:12:09.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.101+0000 7f41267fc700 1 -- 172.21.15.2:0/3162851211 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f4110001670 con 0x7f412815bde0 2023-11-26T07:12:09.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.101+0000 7f41267fc700 1 -- 172.21.15.2:0/3162851211 >> v1:172.21.15.2:6789/0 conn(0x7f412815bde0 legacy=0x7f41280d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:09.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.101+0000 7f41267fc700 1 --2- 172.21.15.2:0/3162851211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4114003bc0 0x7f4114003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:09.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.101+0000 7f41267fc700 1 --2- 172.21.15.2:0/3162851211 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4114004850 0x7f4114004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:09.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.101+0000 7f41267fc700 1 --2- 172.21.15.2:0/3162851211 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41280cecd0 0x7f4114005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:09.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.101+0000 7f41267fc700 1 -- 172.21.15.2:0/3162851211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412806f0f0 con 0x7f4114003bc0 2023-11-26T07:12:09.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.101+0000 7f41267fc700 1 -- 172.21.15.2:0/3162851211 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411400bba0 con 0x7f4114004850 2023-11-26T07:12:09.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.101+0000 7f41267fc700 1 -- 172.21.15.2:0/3162851211 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f411400bd60 con 0x7f41280cecd0 2023-11-26T07:12:09.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.102+0000 7f41277fe700 1 --2- 172.21.15.2:0/3162851211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4114003bc0 0x7f4114003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:09.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.102+0000 7f4126ffd700 1 --2- 172.21.15.2:0/3162851211 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4114004850 0x7f4114004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:09.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.102+0000 7f4127fff700 1 --2- 172.21.15.2:0/3162851211 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41280cecd0 0x7f4114005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:09.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.102+0000 7f41277fe700 1 -- 172.21.15.2:0/3162851211 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41280cecd0 msgr2=0x7f4114005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:09.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.102+0000 7f41277fe700 1 --2- 172.21.15.2:0/3162851211 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41280cecd0 0x7f4114005270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:09.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.102+0000 7f41277fe700 1 -- 172.21.15.2:0/3162851211 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4114004850 msgr2=0x7f4114004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:09.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.102+0000 7f41277fe700 1 --2- 172.21.15.2:0/3162851211 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4114004850 0x7f4114004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:09.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.102+0000 7f41277fe700 1 -- 172.21.15.2:0/3162851211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41140035b0 con 0x7f4114003bc0 2023-11-26T07:12:09.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.102+0000 7f4126ffd700 1 --2- 172.21.15.2:0/3162851211 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4114004850 0x7f4114004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:09.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.102+0000 7f41277fe700 1 --2- 172.21.15.2:0/3162851211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4114003bc0 0x7f4114003fc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f411000c160 tx=0x7f4114005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fabf7348735a467 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:09.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.102+0000 7f41267fc700 1 -- 172.21.15.2:0/3162851211 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411000cca0 con 0x7f4114003bc0 2023-11-26T07:12:09.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.102+0000 7f41267fc700 1 -- 172.21.15.2:0/3162851211 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f411000ce20 con 0x7f4114003bc0 2023-11-26T07:12:09.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.102+0000 7f41267fc700 1 -- 172.21.15.2:0/3162851211 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4110005ba0 con 0x7f4114003bc0 2023-11-26T07:12:09.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.103+0000 7f412dcf6700 1 -- 172.21.15.2:0/3162851211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4114003bc0 msgr2=0x7f4114003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:09.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.103+0000 7f412dcf6700 1 --2- 172.21.15.2:0/3162851211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4114003bc0 0x7f4114003fc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f411000c160 tx=0x7f4114005880 comp rx=0 tx=0).stop 2023-11-26T07:12:09.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.103+0000 7f4127fff700 1 -- 172.21.15.2:0/3162851211 reap_dead start 2023-11-26T07:12:09.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.103+0000 7f412dcf6700 1 -- 172.21.15.2:0/3162851211 shutdown_connections 2023-11-26T07:12:09.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.103+0000 7f412dcf6700 1 -- 172.21.15.2:0/3162851211 >> 172.21.15.2:0/3162851211 conn(0x7f41280b3720 msgr2=0x7f41280b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:09.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.103+0000 7f412dcf6700 1 -- 172.21.15.2:0/3162851211 shutdown_connections 2023-11-26T07:12:09.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.103+0000 7f412dcf6700 1 -- 172.21.15.2:0/3162851211 wait complete. 2023-11-26T07:12:09.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.104+0000 7f412dcf6700 1 Processor -- start 2023-11-26T07:12:09.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.104+0000 7f412dcf6700 1 -- start start 2023-11-26T07:12:09.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.105+0000 7f412dcf6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4114003bc0 0x7f41281f1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:09.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.105+0000 7f412dcf6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41281f2090 0x7f412815eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:09.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.105+0000 7f412dcf6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4128159690 0x7f412815c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:09.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.105+0000 7f412dcf6700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412815e650 con 0x7f4128159690 2023-11-26T07:12:09.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.105+0000 7f412dcf6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41281f2590 con 0x7f4114003bc0 2023-11-26T07:12:09.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.105+0000 7f412dcf6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f412815dd20 con 0x7f41281f2090 2023-11-26T07:12:09.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.105+0000 7f4127fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4128159690 0x7f412815c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:09.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.105+0000 7f4127fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4128159690 0x7f412815c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40106/0 (socket says 172.21.15.2:40106) 2023-11-26T07:12:09.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.105+0000 7f4127fff700 1 -- 172.21.15.2:0/2310241564 learned_addr learned my addr 172.21.15.2:0/2310241564 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:09.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.105+0000 7f41277fe700 1 --2- 172.21.15.2:0/2310241564 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4114003bc0 0x7f41281f1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:09.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.105+0000 7f4126ffd700 1 --2- 172.21.15.2:0/2310241564 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41281f2090 0x7f412815eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:09.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.105+0000 7f4127fff700 1 -- 172.21.15.2:0/2310241564 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41281f2090 msgr2=0x7f412815eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:09.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.105+0000 7f4127fff700 1 --2- 172.21.15.2:0/2310241564 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41281f2090 0x7f412815eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:09.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.105+0000 7f4127fff700 1 -- 172.21.15.2:0/2310241564 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4114003bc0 msgr2=0x7f41281f1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:09.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.105+0000 7f4127fff700 1 --2- 172.21.15.2:0/2310241564 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4114003bc0 0x7f41281f1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:09.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.105+0000 7f4127fff700 1 -- 172.21.15.2:0/2310241564 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f412815e000 con 0x7f4128159690 2023-11-26T07:12:09.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.105+0000 7f4127fff700 1 --2- 172.21.15.2:0/2310241564 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4128159690 0x7f412815c5a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4128072bf0 tx=0x7f41200114b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:09.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.106+0000 7f411ffff700 1 -- 172.21.15.2:0/2310241564 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412000e070 con 0x7f4128159690 2023-11-26T07:12:09.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.106+0000 7f411ffff700 1 -- 172.21.15.2:0/2310241564 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4120003cf0 con 0x7f4128159690 2023-11-26T07:12:09.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.106+0000 7f412dcf6700 1 -- 172.21.15.2:0/2310241564 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f412815e2e0 con 0x7f4128159690 2023-11-26T07:12:09.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.106+0000 7f411ffff700 1 -- 172.21.15.2:0/2310241564 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4120003ea0 con 0x7f4128159690 2023-11-26T07:12:09.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.106+0000 7f412dcf6700 1 -- 172.21.15.2:0/2310241564 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f412815d3d0 con 0x7f4128159690 2023-11-26T07:12:09.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.107+0000 7f412dcf6700 1 -- 172.21.15.2:0/2310241564 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4128068670 con 0x7f4128159690 2023-11-26T07:12:09.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.107+0000 7f411ffff700 1 -- 172.21.15.2:0/2310241564 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4120011a10 con 0x7f4128159690 2023-11-26T07:12:09.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.107+0000 7f411ffff700 1 --2- 172.21.15.2:0/2310241564 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f410806aed0 0x7f410806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:09.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.108+0000 7f411ffff700 1 -- 172.21.15.2:0/2310241564 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4120089a30 con 0x7f4128159690 2023-11-26T07:12:09.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.108+0000 7f41277fe700 1 --2- 172.21.15.2:0/2310241564 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f410806aed0 0x7f410806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:09.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.108+0000 7f41277fe700 1 --2- 172.21.15.2:0/2310241564 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f410806aed0 0x7f410806d390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f411000d010 tx=0x7f4110007000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:09.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.112+0000 7f411ffff700 1 -- 172.21.15.2:0/2310241564 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4120054b70 con 0x7f4128159690 2023-11-26T07:12:09.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.311+0000 7f412dcf6700 1 -- 172.21.15.2:0/2310241564 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f412815e790 con 0x7f4128159690 2023-11-26T07:12:09.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.312+0000 7f411ffff700 1 -- 172.21.15.2:0/2310241564 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f412815e790 con 0x7f4128159690 2023-11-26T07:12:09.315 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:12:09.315 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:11:35.634747+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:11:32.129474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:11:33.019837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:12:09.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.315+0000 7f412dcf6700 1 -- 172.21.15.2:0/2310241564 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f410806aed0 msgr2=0x7f410806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:09.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.315+0000 7f412dcf6700 1 --2- 172.21.15.2:0/2310241564 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f410806aed0 0x7f410806d390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f411000d010 tx=0x7f4110007000 comp rx=0 tx=0).stop 2023-11-26T07:12:09.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.315+0000 7f412dcf6700 1 -- 172.21.15.2:0/2310241564 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4128159690 msgr2=0x7f412815c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:09.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.315+0000 7f412dcf6700 1 --2- 172.21.15.2:0/2310241564 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4128159690 0x7f412815c5a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4128072bf0 tx=0x7f41200114b0 comp rx=0 tx=0).stop 2023-11-26T07:12:09.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.315+0000 7f412dcf6700 1 -- 172.21.15.2:0/2310241564 shutdown_connections 2023-11-26T07:12:09.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.315+0000 7f412dcf6700 1 --2- 172.21.15.2:0/2310241564 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f410806aed0 0x7f410806d390 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:09.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.315+0000 7f412dcf6700 1 --2- 172.21.15.2:0/2310241564 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4128159690 0x7f412815c5a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:09.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.315+0000 7f412dcf6700 1 --2- 172.21.15.2:0/2310241564 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4114003bc0 0x7f41281f1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:09.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.315+0000 7f412dcf6700 1 --2- 172.21.15.2:0/2310241564 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41281f2090 0x7f412815eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:09.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.315+0000 7f412dcf6700 1 -- 172.21.15.2:0/2310241564 >> 172.21.15.2:0/2310241564 conn(0x7f41280b3720 msgr2=0x7f41280cd990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:09.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.315+0000 7f412dcf6700 1 -- 172.21.15.2:0/2310241564 shutdown_connections 2023-11-26T07:12:09.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.315+0000 7f412dcf6700 1 -- 172.21.15.2:0/2310241564 wait complete. 2023-11-26T07:12:09.329 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:11:28.205739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:11:32.129474+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:11:33.019837+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:12:09.329 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:12:09.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.455+0000 7fb4f9d00700 1 Processor -- start 2023-11-26T07:12:09.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.455+0000 7fb4f9d00700 1 -- start start 2023-11-26T07:12:09.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.456+0000 7fb4f9d00700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb4f4143ae0 0x7fb4f40b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:09.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.456+0000 7fb4f9d00700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb4f41440f0 0x7fb4f4071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:09.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.456+0000 7fb4f9d00700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4f4143ec0 con 0x7fb4f40720f0 2023-11-26T07:12:09.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.456+0000 7fb4f9d00700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4f40b40a0 con 0x7fb4f4143ae0 2023-11-26T07:12:09.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.456+0000 7fb4f9d00700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4f4072560 con 0x7fb4f41440f0 2023-11-26T07:12:09.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.456+0000 7fb4f37fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb4f4143ae0 0x7fb4f40b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:09.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.456+0000 7fb4f37fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb4f4143ae0 0x7fb4f40b51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40110/0 (socket says 172.21.15.2:40110) 2023-11-26T07:12:09.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.456+0000 7fb4f37fe700 1 -- 172.21.15.2:0/3734086240 learned_addr learned my addr 172.21.15.2:0/3734086240 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:09.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.456+0000 7fb4f2ffd700 1 --2- 172.21.15.2:0/3734086240 >> v2:172.21.15.192:3300/0 conn(0x7fb4f41440f0 0x7fb4f4071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:09.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.456+0000 7fb4f37fe700 1 -- 172.21.15.2:0/3734086240 >> v2:172.21.15.192:3300/0 conn(0x7fb4f41440f0 msgr2=0x7fb4f4071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:09.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.456+0000 7fb4f37fe700 1 --2- 172.21.15.2:0/3734086240 >> v2:172.21.15.192:3300/0 conn(0x7fb4f41440f0 0x7fb4f4071bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:09.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.456+0000 7fb4f37fe700 1 -- 172.21.15.2:0/3734086240 >> v1:172.21.15.192:6789/0 conn(0x7fb4f40720f0 legacy=0x7fb4f415e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:09.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.456+0000 7fb4f37fe700 1 -- 172.21.15.2:0/3734086240 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f40b3ae0 con 0x7fb4f4143ae0 2023-11-26T07:12:09.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.457+0000 7fb4f37fe700 1 --2- 172.21.15.2:0/3734086240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4f4143ae0 0x7fb4f40b51b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb4f40d1b00 tx=0x7fb4dc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a82d826866e5e568 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:09.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.457+0000 7fb4f27fc700 1 -- 172.21.15.2:0/3734086240 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc004230 con 0x7fb4f4143ae0 2023-11-26T07:12:09.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.457+0000 7fb4f27fc700 1 -- 172.21.15.2:0/3734086240 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4dc004390 con 0x7fb4f4143ae0 2023-11-26T07:12:09.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.457+0000 7fb4f27fc700 1 -- 172.21.15.2:0/3734086240 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc0036a0 con 0x7fb4f4143ae0 2023-11-26T07:12:09.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.457+0000 7fb4f9d00700 1 -- 172.21.15.2:0/3734086240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4f4143ae0 msgr2=0x7fb4f40b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:09.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.457+0000 7fb4f9d00700 1 --2- 172.21.15.2:0/3734086240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4f4143ae0 0x7fb4f40b51b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb4f40d1b00 tx=0x7fb4dc009c00 comp rx=0 tx=0).stop 2023-11-26T07:12:09.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.457+0000 7fb4f9d00700 1 -- 172.21.15.2:0/3734086240 shutdown_connections 2023-11-26T07:12:09.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.457+0000 7fb4f9d00700 1 --2- 172.21.15.2:0/3734086240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4f4143ae0 0x7fb4f40b51b0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:09.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.457+0000 7fb4f9d00700 1 --2- 172.21.15.2:0/3734086240 >> v2:172.21.15.192:3300/0 conn(0x7fb4f41440f0 0x7fb4f4071bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:09.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.457+0000 7fb4f9d00700 1 -- 172.21.15.2:0/3734086240 >> 172.21.15.2:0/3734086240 conn(0x7fb4f40b2740 msgr2=0x7fb4f40b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:09.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.457+0000 7fb4f9d00700 1 -- 172.21.15.2:0/3734086240 shutdown_connections 2023-11-26T07:12:09.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.457+0000 7fb4f9d00700 1 -- 172.21.15.2:0/3734086240 wait complete. 2023-11-26T07:12:09.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.459+0000 7fb4f9d00700 1 Processor -- start 2023-11-26T07:12:09.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.459+0000 7fb4f9d00700 1 -- start start 2023-11-26T07:12:09.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.459+0000 7fb4f9d00700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb4f40720f0 0x7fb4f41f3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:09.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.460+0000 7fb4f9d00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4f4143ae0 0x7fb4f40cc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:09.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.460+0000 7fb4f9d00700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4f41440f0 0x7fb4f4154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:09.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.460+0000 7fb4f9d00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f40cc5a0 con 0x7fb4f4143ae0 2023-11-26T07:12:09.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.460+0000 7fb4f9d00700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f4155220 con 0x7fb4f41440f0 2023-11-26T07:12:09.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.460+0000 7fb4f9d00700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f40ca1a0 con 0x7fb4f40720f0 2023-11-26T07:12:09.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.460+0000 7fb4f2ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4f4143ae0 0x7fb4f40cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:09.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.460+0000 7fb4f2ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4f4143ae0 0x7fb4f40cc060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40118/0 (socket says 172.21.15.2:40118) 2023-11-26T07:12:09.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.460+0000 7fb4f2ffd700 1 -- 172.21.15.2:0/2555511810 learned_addr learned my addr 172.21.15.2:0/2555511810 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:09.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.460+0000 7fb4f3fff700 1 --2- 172.21.15.2:0/2555511810 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4f41440f0 0x7fb4f4154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:09.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.460+0000 7fb4f37fe700 1 --2- 172.21.15.2:0/2555511810 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb4f40720f0 0x7fb4f41f3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:09.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.460+0000 7fb4f2ffd700 1 -- 172.21.15.2:0/2555511810 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb4f40720f0 msgr2=0x7fb4f41f3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:09.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.460+0000 7fb4f2ffd700 1 --2- 172.21.15.2:0/2555511810 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb4f40720f0 0x7fb4f41f3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:09.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.460+0000 7fb4f2ffd700 1 -- 172.21.15.2:0/2555511810 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4f41440f0 msgr2=0x7fb4f4154ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:09.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.460+0000 7fb4f2ffd700 1 --2- 172.21.15.2:0/2555511810 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4f41440f0 0x7fb4f4154ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:09.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.460+0000 7fb4f2ffd700 1 -- 172.21.15.2:0/2555511810 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4dc009550 con 0x7fb4f4143ae0 2023-11-26T07:12:09.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.460+0000 7fb4f2ffd700 1 --2- 172.21.15.2:0/2555511810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4f4143ae0 0x7fb4f40cc060 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb4e400d800 tx=0x7fb4e400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:09.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.460+0000 7fb4ebfff700 1 -- 172.21.15.2:0/2555511810 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e40125f0 con 0x7fb4f4143ae0 2023-11-26T07:12:09.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.460+0000 7fb4ebfff700 1 -- 172.21.15.2:0/2555511810 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e4012750 con 0x7fb4f4143ae0 2023-11-26T07:12:09.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.460+0000 7fb4ebfff700 1 -- 172.21.15.2:0/2555511810 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e4012ae0 con 0x7fb4f4143ae0 2023-11-26T07:12:09.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.460+0000 7fb4f9d00700 1 -- 172.21.15.2:0/2555511810 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4f40ca480 con 0x7fb4f4143ae0 2023-11-26T07:12:09.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.460+0000 7fb4f9d00700 1 -- 172.21.15.2:0/2555511810 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4f40caa40 con 0x7fb4f4143ae0 2023-11-26T07:12:09.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.461+0000 7fb4f9d00700 1 -- 172.21.15.2:0/2555511810 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4f4067a00 con 0x7fb4f4143ae0 2023-11-26T07:12:09.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.462+0000 7fb4ebfff700 1 -- 172.21.15.2:0/2555511810 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb4e4012c40 con 0x7fb4f4143ae0 2023-11-26T07:12:09.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.462+0000 7fb4ebfff700 1 --2- 172.21.15.2:0/2555511810 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb4d406aed0 0x7fb4d406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:09.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.462+0000 7fb4ebfff700 1 -- 172.21.15.2:0/2555511810 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4e4089510 con 0x7fb4f4143ae0 2023-11-26T07:12:09.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.463+0000 7fb4f37fe700 1 --2- 172.21.15.2:0/2555511810 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb4d406aed0 0x7fb4d406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:09.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.463+0000 7fb4f37fe700 1 --2- 172.21.15.2:0/2555511810 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb4d406aed0 0x7fb4d406d390 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc009130 tx=0x7fb4dc008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:09.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.467+0000 7fb4ebfff700 1 -- 172.21.15.2:0/2555511810 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb4e4054650 con 0x7fb4f4143ae0 2023-11-26T07:12:09.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.668+0000 7fb4f9d00700 1 -- 172.21.15.2:0/2555511810 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb4f41f74a0 con 0x7fb4f4143ae0 2023-11-26T07:12:09.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.668+0000 7fb4ebfff700 1 -- 172.21.15.2:0/2555511810 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb4f41f74a0 con 0x7fb4f4143ae0 2023-11-26T07:12:09.670 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-26T07:12:09.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.670+0000 7fb4f9d00700 1 -- 172.21.15.2:0/2555511810 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb4d406aed0 msgr2=0x7fb4d406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:09.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.670+0000 7fb4f9d00700 1 --2- 172.21.15.2:0/2555511810 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb4d406aed0 0x7fb4d406d390 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc009130 tx=0x7fb4dc008030 comp rx=0 tx=0).stop 2023-11-26T07:12:09.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.670+0000 7fb4f9d00700 1 -- 172.21.15.2:0/2555511810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4f4143ae0 msgr2=0x7fb4f40cc060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:09.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.670+0000 7fb4f9d00700 1 --2- 172.21.15.2:0/2555511810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4f4143ae0 0x7fb4f40cc060 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb4e400d800 tx=0x7fb4e400db10 comp rx=0 tx=0).stop 2023-11-26T07:12:09.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.671+0000 7fb4f9d00700 1 -- 172.21.15.2:0/2555511810 shutdown_connections 2023-11-26T07:12:09.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.671+0000 7fb4f9d00700 1 --2- 172.21.15.2:0/2555511810 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb4d406aed0 0x7fb4d406d390 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:09.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.671+0000 7fb4f9d00700 1 --2- 172.21.15.2:0/2555511810 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4f41440f0 0x7fb4f4154ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:09.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.671+0000 7fb4f9d00700 1 --2- 172.21.15.2:0/2555511810 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb4f40720f0 0x7fb4f41f3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:09.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.671+0000 7fb4f9d00700 1 --2- 172.21.15.2:0/2555511810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4f4143ae0 0x7fb4f40cc060 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:09.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.671+0000 7fb4f9d00700 1 -- 172.21.15.2:0/2555511810 >> 172.21.15.2:0/2555511810 conn(0x7fb4f40b2740 msgr2=0x7fb4f406e410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:09.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.671+0000 7fb4f9d00700 1 -- 172.21.15.2:0/2555511810 shutdown_connections 2023-11-26T07:12:09.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.671+0000 7fb4f9d00700 1 -- 172.21.15.2:0/2555511810 wait complete. 2023-11-26T07:12:09.684 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:12:09.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.811+0000 7fc32599d700 1 Processor -- start 2023-11-26T07:12:09.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.811+0000 7fc32599d700 1 -- start start 2023-11-26T07:12:09.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.812+0000 7fc32599d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc32015e260 0x7fc3200acf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:09.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.812+0000 7fc32599d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc3200cf700 0x7fc32006dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:09.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.812+0000 7fc32599d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc3200cfb80 0x7fc32006e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:09.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.812+0000 7fc32599d700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc32006afd0 con 0x7fc3200cf700 2023-11-26T07:12:09.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.812+0000 7fc32599d700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc32006b590 con 0x7fc3200cfb80 2023-11-26T07:12:09.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.812+0000 7fc32599d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3200ad490 con 0x7fc32015e260 2023-11-26T07:12:09.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.812+0000 7fc31ffff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc3200cf700 0x7fc32006dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:09.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.812+0000 7fc31ffff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc3200cf700 0x7fc32006dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40124/0 (socket says 172.21.15.2:40124) 2023-11-26T07:12:09.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.812+0000 7fc31ffff700 1 -- 172.21.15.2:0/2563788744 learned_addr learned my addr 172.21.15.2:0/2563788744 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:09.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.812+0000 7fc32519c700 1 --2- 172.21.15.2:0/2563788744 >> v2:172.21.15.192:3300/0 conn(0x7fc3200cfb80 0x7fc32006e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:09.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.812+0000 7fc32499b700 1 --2- 172.21.15.2:0/2563788744 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc32015e260 0x7fc3200acf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:09.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.812+0000 7fc31ffff700 1 -- 172.21.15.2:0/2563788744 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc32015e260 msgr2=0x7fc3200acf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:09.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.812+0000 7fc31ffff700 1 --2- 172.21.15.2:0/2563788744 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc32015e260 0x7fc3200acf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:09.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.812+0000 7fc31ffff700 1 -- 172.21.15.2:0/2563788744 >> v2:172.21.15.192:3300/0 conn(0x7fc3200cfb80 msgr2=0x7fc32006e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:09.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.812+0000 7fc31ffff700 1 --2- 172.21.15.2:0/2563788744 >> v2:172.21.15.192:3300/0 conn(0x7fc3200cfb80 0x7fc32006e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:09.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.812+0000 7fc31ffff700 1 -- 172.21.15.2:0/2563788744 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc32006d570 con 0x7fc3200cf700 2023-11-26T07:12:09.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.812+0000 7fc32499b700 1 --2- 172.21.15.2:0/2563788744 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc32015e260 0x7fc3200acf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:12:09.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.813+0000 7fc31ffff700 1 --2- 172.21.15.2:0/2563788744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3200cf700 0x7fc32006dca0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc30c0098f0 tx=0x7fc30c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb36dc7fd0d6fae server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:09.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.813+0000 7fc31f7fe700 1 -- 172.21.15.2:0/2563788744 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c00b860 con 0x7fc3200cf700 2023-11-26T07:12:09.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.813+0000 7fc31f7fe700 1 -- 172.21.15.2:0/2563788744 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30c00b9c0 con 0x7fc3200cf700 2023-11-26T07:12:09.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.813+0000 7fc31f7fe700 1 -- 172.21.15.2:0/2563788744 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c00bd50 con 0x7fc3200cf700 2023-11-26T07:12:09.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.813+0000 7fc32599d700 1 -- 172.21.15.2:0/2563788744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3200cf700 msgr2=0x7fc32006dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:09.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.813+0000 7fc32599d700 1 --2- 172.21.15.2:0/2563788744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3200cf700 0x7fc32006dca0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc30c0098f0 tx=0x7fc30c009c00 comp rx=0 tx=0).stop 2023-11-26T07:12:09.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.813+0000 7fc32599d700 1 -- 172.21.15.2:0/2563788744 shutdown_connections 2023-11-26T07:12:09.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.813+0000 7fc32599d700 1 --2- 172.21.15.2:0/2563788744 >> v2:172.21.15.192:3300/0 conn(0x7fc3200cfb80 0x7fc32006e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:09.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.813+0000 7fc32599d700 1 --2- 172.21.15.2:0/2563788744 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc32015e260 0x7fc3200acf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:09.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.813+0000 7fc32599d700 1 --2- 172.21.15.2:0/2563788744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3200cf700 0x7fc32006dca0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:09.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.813+0000 7fc32599d700 1 -- 172.21.15.2:0/2563788744 >> 172.21.15.2:0/2563788744 conn(0x7fc3200d00c0 msgr2=0x7fc3200d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:09.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.813+0000 7fc32599d700 1 -- 172.21.15.2:0/2563788744 shutdown_connections 2023-11-26T07:12:09.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.813+0000 7fc32599d700 1 -- 172.21.15.2:0/2563788744 wait complete. 2023-11-26T07:12:09.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.815+0000 7fc32599d700 1 Processor -- start 2023-11-26T07:12:09.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.815+0000 7fc32599d700 1 -- start start 2023-11-26T07:12:09.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.815+0000 7fc32599d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3200cf700 0x7fc3201f3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:09.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.816+0000 7fc32599d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3200cfb80 0x7fc32009aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:09.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.816+0000 7fc32599d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc32015e260 0x7fc3201f6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:09.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.816+0000 7fc32599d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3200cd2e0 con 0x7fc3200cfb80 2023-11-26T07:12:09.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.816+0000 7fc32599d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3200c5aa0 con 0x7fc32015e260 2023-11-26T07:12:09.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.816+0000 7fc32599d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3200c5d80 con 0x7fc3200cf700 2023-11-26T07:12:09.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.816+0000 7fc31ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3200cfb80 0x7fc32009aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:09.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.816+0000 7fc31ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3200cfb80 0x7fc32009aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40132/0 (socket says 172.21.15.2:40132) 2023-11-26T07:12:09.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.816+0000 7fc31ffff700 1 -- 172.21.15.2:0/2127198124 learned_addr learned my addr 172.21.15.2:0/2127198124 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:09.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.816+0000 7fc32499b700 1 --2- 172.21.15.2:0/2127198124 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3200cf700 0x7fc3201f3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:09.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.816+0000 7fc32519c700 1 --2- 172.21.15.2:0/2127198124 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc32015e260 0x7fc3201f6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:09.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.816+0000 7fc31ffff700 1 -- 172.21.15.2:0/2127198124 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3200cf700 msgr2=0x7fc3201f3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:09.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.816+0000 7fc31ffff700 1 --2- 172.21.15.2:0/2127198124 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3200cf700 0x7fc3201f3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:09.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.816+0000 7fc31ffff700 1 -- 172.21.15.2:0/2127198124 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc32015e260 msgr2=0x7fc3201f6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:09.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.816+0000 7fc31ffff700 1 --2- 172.21.15.2:0/2127198124 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc32015e260 0x7fc3201f6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:09.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.816+0000 7fc31ffff700 1 -- 172.21.15.2:0/2127198124 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc30c009550 con 0x7fc3200cfb80 2023-11-26T07:12:09.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.816+0000 7fc32519c700 1 --2- 172.21.15.2:0/2127198124 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc32015e260 0x7fc3201f6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:09.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.816+0000 7fc31ffff700 1 --2- 172.21.15.2:0/2127198124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3200cfb80 0x7fc32009aa60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc30c009c40 tx=0x7fc30c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:09.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.816+0000 7fc31d7fa700 1 -- 172.21.15.2:0/2127198124 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c004300 con 0x7fc3200cfb80 2023-11-26T07:12:09.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.816+0000 7fc31d7fa700 1 -- 172.21.15.2:0/2127198124 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30c01f070 con 0x7fc3200cfb80 2023-11-26T07:12:09.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.816+0000 7fc31d7fa700 1 -- 172.21.15.2:0/2127198124 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c0036a0 con 0x7fc3200cfb80 2023-11-26T07:12:09.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.816+0000 7fc32599d700 1 -- 172.21.15.2:0/2127198124 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3200c6060 con 0x7fc3200cfb80 2023-11-26T07:12:09.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.816+0000 7fc32599d700 1 -- 172.21.15.2:0/2127198124 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3200c5610 con 0x7fc3200cfb80 2023-11-26T07:12:09.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.817+0000 7fc32599d700 1 -- 172.21.15.2:0/2127198124 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3200caf10 con 0x7fc3200cfb80 2023-11-26T07:12:09.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.818+0000 7fc31d7fa700 1 -- 172.21.15.2:0/2127198124 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc30c021030 con 0x7fc3200cfb80 2023-11-26T07:12:09.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.818+0000 7fc31d7fa700 1 --2- 172.21.15.2:0/2127198124 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc30406aed0 0x7fc30406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:09.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.818+0000 7fc31d7fa700 1 -- 172.21.15.2:0/2127198124 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc30c08a8d0 con 0x7fc3200cfb80 2023-11-26T07:12:09.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.818+0000 7fc32499b700 1 --2- 172.21.15.2:0/2127198124 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc30406aed0 0x7fc30406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:09.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.819+0000 7fc32499b700 1 --2- 172.21.15.2:0/2127198124 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc30406aed0 0x7fc30406d390 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc314006fd0 tx=0x7fc314008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:09.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:09.823+0000 7fc31d7fa700 1 -- 172.21.15.2:0/2127198124 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc30c055a10 con 0x7fc3200cfb80 2023-11-26T07:12:10.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.024+0000 7fc32599d700 1 -- 172.21.15.2:0/2127198124 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc320075300 con 0x7fc3200cfb80 2023-11-26T07:12:10.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.025+0000 7fc31d7fa700 1 -- 172.21.15.2:0/2127198124 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc30c0150a0 con 0x7fc3200cfb80 2023-11-26T07:12:10.027 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-26T07:12:10.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.027+0000 7fc32599d700 1 -- 172.21.15.2:0/2127198124 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc30406aed0 msgr2=0x7fc30406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:10.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.027+0000 7fc32599d700 1 --2- 172.21.15.2:0/2127198124 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc30406aed0 0x7fc30406d390 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc314006fd0 tx=0x7fc314008040 comp rx=0 tx=0).stop 2023-11-26T07:12:10.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.027+0000 7fc32599d700 1 -- 172.21.15.2:0/2127198124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3200cfb80 msgr2=0x7fc32009aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:10.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.027+0000 7fc32599d700 1 --2- 172.21.15.2:0/2127198124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3200cfb80 0x7fc32009aa60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc30c009c40 tx=0x7fc30c004750 comp rx=0 tx=0).stop 2023-11-26T07:12:10.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.027+0000 7fc32599d700 1 -- 172.21.15.2:0/2127198124 shutdown_connections 2023-11-26T07:12:10.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.027+0000 7fc32599d700 1 --2- 172.21.15.2:0/2127198124 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc30406aed0 0x7fc30406d390 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:10.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.027+0000 7fc32599d700 1 --2- 172.21.15.2:0/2127198124 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc32015e260 0x7fc3201f6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:10.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.027+0000 7fc32599d700 1 --2- 172.21.15.2:0/2127198124 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3200cf700 0x7fc3201f3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:10.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.027+0000 7fc32599d700 1 --2- 172.21.15.2:0/2127198124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3200cfb80 0x7fc32009aa60 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:10.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.027+0000 7fc32599d700 1 -- 172.21.15.2:0/2127198124 >> 172.21.15.2:0/2127198124 conn(0x7fc3200d00c0 msgr2=0x7fc320158600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:10.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.027+0000 7fc32599d700 1 -- 172.21.15.2:0/2127198124 shutdown_connections 2023-11-26T07:12:10.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.027+0000 7fc32599d700 1 -- 172.21.15.2:0/2127198124 wait complete. 2023-11-26T07:12:10.041 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:12:10.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.167+0000 7fc31a12f700 1 Processor -- start 2023-11-26T07:12:10.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.167+0000 7fc31a12f700 1 -- start start 2023-11-26T07:12:10.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.168+0000 7fc31a12f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc314143ae0 0x7fc3140b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:10.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.168+0000 7fc31a12f700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc314143ec0 con 0x7fc3140722c0 2023-11-26T07:12:10.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.168+0000 7fc31a12f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3140b3ae0 con 0x7fc3141440f0 2023-11-26T07:12:10.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.168+0000 7fc31a12f700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3140b40a0 con 0x7fc314143ae0 2023-11-26T07:12:10.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.168+0000 7fc313fff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc3140722c0 0x7fc31406e510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59584/0 (socket says 172.21.15.2:59584) 2023-11-26T07:12:10.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.168+0000 7fc313fff700 1 -- 172.21.15.2:0/2344624723 learned_addr learned my addr 172.21.15.2:0/2344624723 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:10.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.168+0000 7fc3137fe700 1 --2- 172.21.15.2:0/2344624723 >> v2:172.21.15.192:3300/0 conn(0x7fc314143ae0 0x7fc3140b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:10.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.168+0000 7fc3127fc700 1 -- 172.21.15.2:0/2344624723 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2933884781 0 0) 0x7fc314143ec0 con 0x7fc3140722c0 2023-11-26T07:12:10.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.168+0000 7fc3127fc700 1 -- 172.21.15.2:0/2344624723 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3000035b0 con 0x7fc3140722c0 2023-11-26T07:12:10.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.168+0000 7fc3127fc700 1 -- 172.21.15.2:0/2344624723 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1889069189 0 0) 0x7fc3000035b0 con 0x7fc3140722c0 2023-11-26T07:12:10.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.168+0000 7fc3127fc700 1 -- 172.21.15.2:0/2344624723 >> v2:172.21.15.192:3300/0 conn(0x7fc314143ae0 msgr2=0x7fc3140b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:10.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.168+0000 7fc3127fc700 1 --2- 172.21.15.2:0/2344624723 >> v2:172.21.15.192:3300/0 conn(0x7fc314143ae0 0x7fc3140b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:10.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.168+0000 7fc3127fc700 1 -- 172.21.15.2:0/2344624723 >> v1:172.21.15.192:6789/0 conn(0x7fc3141440f0 legacy=0x7fc314071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:10.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.168+0000 7fc3127fc700 1 -- 172.21.15.2:0/2344624723 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3140b3dc0 con 0x7fc3140722c0 2023-11-26T07:12:10.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.169+0000 7fc3127fc700 1 -- 172.21.15.2:0/2344624723 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7fc30c0019f0 con 0x7fc3140722c0 2023-11-26T07:12:10.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.169+0000 7fc3127fc700 1 -- 172.21.15.2:0/2344624723 >> v1:172.21.15.2:6789/0 conn(0x7fc3140722c0 legacy=0x7fc31406e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:10.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.169+0000 7fc3127fc700 1 --2- 172.21.15.2:0/2344624723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc300003a00 0x7fc300003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:10.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.169+0000 7fc3127fc700 1 --2- 172.21.15.2:0/2344624723 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc300004850 0x7fc300004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:10.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.169+0000 7fc3127fc700 1 --2- 172.21.15.2:0/2344624723 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc300005210 0x7fc30000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:10.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.169+0000 7fc3127fc700 1 -- 172.21.15.2:0/2344624723 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3140b40a0 con 0x7fc300003a00 2023-11-26T07:12:10.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.169+0000 7fc3127fc700 1 -- 172.21.15.2:0/2344624723 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30000c0b0 con 0x7fc300004850 2023-11-26T07:12:10.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.169+0000 7fc3127fc700 1 -- 172.21.15.2:0/2344624723 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc30000c270 con 0x7fc300005210 2023-11-26T07:12:10.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.169+0000 7fc3137fe700 1 --2- 172.21.15.2:0/2344624723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc300003a00 0x7fc300003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:10.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.169+0000 7fc312ffd700 1 --2- 172.21.15.2:0/2344624723 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc300004850 0x7fc300004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:10.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.169+0000 7fc313fff700 1 --2- 172.21.15.2:0/2344624723 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc300005210 0x7fc30000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:10.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.169+0000 7fc3137fe700 1 -- 172.21.15.2:0/2344624723 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc300005210 msgr2=0x7fc30000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:10.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.169+0000 7fc3137fe700 1 --2- 172.21.15.2:0/2344624723 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc300005210 0x7fc30000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:10.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.169+0000 7fc3137fe700 1 -- 172.21.15.2:0/2344624723 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc300004850 msgr2=0x7fc300004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:10.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.169+0000 7fc3137fe700 1 --2- 172.21.15.2:0/2344624723 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc300004850 0x7fc300004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:10.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.169+0000 7fc3137fe700 1 -- 172.21.15.2:0/2344624723 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3000035b0 con 0x7fc300003a00 2023-11-26T07:12:10.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.169+0000 7fc312ffd700 1 --2- 172.21.15.2:0/2344624723 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc300004850 0x7fc300004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:10.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.169+0000 7fc313fff700 1 -- 172.21.15.2:0/2344624723 reap_dead start 2023-11-26T07:12:10.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.169+0000 7fc3137fe700 1 --2- 172.21.15.2:0/2344624723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc300003a00 0x7fc300003e20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc3040096f0 tx=0x7fc300005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e7390cdd0829c9e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:10.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.169+0000 7fc3127fc700 1 -- 172.21.15.2:0/2344624723 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30400e6c0 con 0x7fc300003a00 2023-11-26T07:12:10.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.169+0000 7fc3127fc700 1 -- 172.21.15.2:0/2344624723 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30400e820 con 0x7fc300003a00 2023-11-26T07:12:10.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.169+0000 7fc3127fc700 1 -- 172.21.15.2:0/2344624723 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30400ebb0 con 0x7fc300003a00 2023-11-26T07:12:10.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.170+0000 7fc31a12f700 1 -- 172.21.15.2:0/2344624723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc300003a00 msgr2=0x7fc300003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:10.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.170+0000 7fc31a12f700 1 --2- 172.21.15.2:0/2344624723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc300003a00 0x7fc300003e20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc3040096f0 tx=0x7fc300005880 comp rx=0 tx=0).stop 2023-11-26T07:12:10.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.170+0000 7fc31a12f700 1 -- 172.21.15.2:0/2344624723 shutdown_connections 2023-11-26T07:12:10.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.170+0000 7fc31a12f700 1 --2- 172.21.15.2:0/2344624723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc300003a00 0x7fc300003e20 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:10.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.170+0000 7fc31a12f700 1 -- 172.21.15.2:0/2344624723 >> 172.21.15.2:0/2344624723 conn(0x7fc3140b2740 msgr2=0x7fc3140b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:10.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.170+0000 7fc31a12f700 1 -- 172.21.15.2:0/2344624723 shutdown_connections 2023-11-26T07:12:10.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.170+0000 7fc31a12f700 1 -- 172.21.15.2:0/2344624723 wait complete. 2023-11-26T07:12:10.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.171+0000 7fc31a12f700 1 Processor -- start 2023-11-26T07:12:10.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.171+0000 7fc31a12f700 1 -- start start 2023-11-26T07:12:10.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.172+0000 7fc31a12f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc300003a00 0x7fc31413f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:10.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.172+0000 7fc31a12f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc3140a9e30 0x7fc314142100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:10.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.172+0000 7fc31a12f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3140aa2b0 0x7fc314142640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:10.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.172+0000 7fc31a12f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3140cd100 con 0x7fc300003a00 2023-11-26T07:12:10.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.172+0000 7fc31a12f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3140ccc70 con 0x7fc3140a9e30 2023-11-26T07:12:10.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.172+0000 7fc31a12f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3140cc060 con 0x7fc3140aa2b0 2023-11-26T07:12:10.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.172+0000 7fc3137fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc300003a00 0x7fc31413f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:10.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.172+0000 7fc3137fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc300003a00 0x7fc31413f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40150/0 (socket says 172.21.15.2:40150) 2023-11-26T07:12:10.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.172+0000 7fc3137fe700 1 -- 172.21.15.2:0/1964465870 learned_addr learned my addr 172.21.15.2:0/1964465870 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:10.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.172+0000 7fc3137fe700 1 -- 172.21.15.2:0/1964465870 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3140aa2b0 msgr2=0x7fc314142640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:10.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.172+0000 7fc3137fe700 1 --2- 172.21.15.2:0/1964465870 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3140aa2b0 0x7fc314142640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:10.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.172+0000 7fc3137fe700 1 -- 172.21.15.2:0/1964465870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc3140a9e30 msgr2=0x7fc314142100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:10.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.172+0000 7fc3137fe700 1 --2- 172.21.15.2:0/1964465870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc3140a9e30 0x7fc314142100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:10.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.172+0000 7fc3137fe700 1 -- 172.21.15.2:0/1964465870 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3140cc340 con 0x7fc300003a00 2023-11-26T07:12:10.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.173+0000 7fc3137fe700 1 --2- 172.21.15.2:0/1964465870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc300003a00 0x7fc31413f670 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc30400e4b0 tx=0x7fc3040047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:10.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.173+0000 7fc30bfff700 1 -- 172.21.15.2:0/1964465870 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30400e6c0 con 0x7fc300003a00 2023-11-26T07:12:10.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.173+0000 7fc30bfff700 1 -- 172.21.15.2:0/1964465870 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3040038c0 con 0x7fc300003a00 2023-11-26T07:12:10.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.173+0000 7fc31a12f700 1 -- 172.21.15.2:0/1964465870 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3140cc620 con 0x7fc300003a00 2023-11-26T07:12:10.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.173+0000 7fc30bfff700 1 -- 172.21.15.2:0/1964465870 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc304006e60 con 0x7fc300003a00 2023-11-26T07:12:10.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.173+0000 7fc31a12f700 1 -- 172.21.15.2:0/1964465870 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc31415a810 con 0x7fc300003a00 2023-11-26T07:12:10.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.174+0000 7fc31a12f700 1 -- 172.21.15.2:0/1964465870 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3140ccf50 con 0x7fc300003a00 2023-11-26T07:12:10.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.174+0000 7fc30bfff700 1 -- 172.21.15.2:0/1964465870 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc304003c70 con 0x7fc300003a00 2023-11-26T07:12:10.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.175+0000 7fc30bfff700 1 --2- 172.21.15.2:0/1964465870 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc2f406aed0 0x7fc2f406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:10.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.175+0000 7fc30bfff700 1 -- 172.21.15.2:0/1964465870 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc30408a340 con 0x7fc300003a00 2023-11-26T07:12:10.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.175+0000 7fc312ffd700 1 --2- 172.21.15.2:0/1964465870 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc2f406aed0 0x7fc2f406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:10.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.175+0000 7fc312ffd700 1 --2- 172.21.15.2:0/1964465870 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc2f406aed0 0x7fc2f406d390 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc001690 tx=0x7fc2fc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:10.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.179+0000 7fc30bfff700 1 -- 172.21.15.2:0/1964465870 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc3040555a0 con 0x7fc300003a00 2023-11-26T07:12:10.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.382+0000 7fc31a12f700 1 -- 172.21.15.2:0/1964465870 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc314144830 con 0x7fc300003a00 2023-11-26T07:12:10.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.382+0000 7fc30bfff700 1 -- 172.21.15.2:0/1964465870 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc304029020 con 0x7fc300003a00 2023-11-26T07:12:10.384 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-26T07:12:10.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.384+0000 7fc31a12f700 1 -- 172.21.15.2:0/1964465870 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc2f406aed0 msgr2=0x7fc2f406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:10.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.384+0000 7fc31a12f700 1 --2- 172.21.15.2:0/1964465870 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc2f406aed0 0x7fc2f406d390 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc001690 tx=0x7fc2fc009040 comp rx=0 tx=0).stop 2023-11-26T07:12:10.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.384+0000 7fc31a12f700 1 -- 172.21.15.2:0/1964465870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc300003a00 msgr2=0x7fc31413f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:10.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.384+0000 7fc31a12f700 1 --2- 172.21.15.2:0/1964465870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc300003a00 0x7fc31413f670 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc30400e4b0 tx=0x7fc3040047c0 comp rx=0 tx=0).stop 2023-11-26T07:12:10.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.384+0000 7fc31a12f700 1 -- 172.21.15.2:0/1964465870 shutdown_connections 2023-11-26T07:12:10.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.384+0000 7fc31a12f700 1 --2- 172.21.15.2:0/1964465870 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc2f406aed0 0x7fc2f406d390 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:10.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.384+0000 7fc31a12f700 1 --2- 172.21.15.2:0/1964465870 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3140aa2b0 0x7fc314142640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:10.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.384+0000 7fc31a12f700 1 --2- 172.21.15.2:0/1964465870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc300003a00 0x7fc31413f670 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:10.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.384+0000 7fc31a12f700 1 --2- 172.21.15.2:0/1964465870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc3140a9e30 0x7fc314142100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:10.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.384+0000 7fc31a12f700 1 -- 172.21.15.2:0/1964465870 >> 172.21.15.2:0/1964465870 conn(0x7fc3140b2740 msgr2=0x7fc3140cf840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:10.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.384+0000 7fc31a12f700 1 -- 172.21.15.2:0/1964465870 shutdown_connections 2023-11-26T07:12:10.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.384+0000 7fc31a12f700 1 -- 172.21.15.2:0/1964465870 wait complete. 2023-11-26T07:12:10.399 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-26T07:12:10.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.523+0000 7f2f24724700 1 Processor -- start 2023-11-26T07:12:10.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.523+0000 7f2f24724700 1 -- start start 2023-11-26T07:12:10.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.524+0000 7f2f24724700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f1c143ae0 0x7f2f1c0b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:10.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.524+0000 7f2f24724700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2f1c0722c0 0x7f2f1c06e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:10.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.524+0000 7f2f24724700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f1c143ec0 con 0x7f2f1c1440f0 2023-11-26T07:12:10.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.524+0000 7f2f24724700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f1c0b40a0 con 0x7f2f1c0722c0 2023-11-26T07:12:10.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.524+0000 7f2f24724700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c0b3ae0 con 0x7f2f1c143ae0 2023-11-26T07:12:10.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.524+0000 7f2f22cc1700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2f1c0722c0 0x7f2f1c06e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:10.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.524+0000 7f2f224c0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f1c143ae0 0x7f2f1c0b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:10.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.524+0000 7f2f22cc1700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2f1c0722c0 0x7f2f1c06e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.2:48748/0 (socket says 172.21.15.2:48748) 2023-11-26T07:12:10.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.524+0000 7f2f21cbf700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f2f1c1440f0 0x7f2f1c071bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.2:38740/0 (socket says 172.21.15.2:38740) 2023-11-26T07:12:10.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.524+0000 7f2f22cc1700 1 -- 172.21.15.2:0/1756580583 learned_addr learned my addr 172.21.15.2:0/1756580583 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:10.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.524+0000 7f2f224c0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f1c143ae0 0x7f2f1c0b51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.2:38238/0 (socket says 172.21.15.2:38238) 2023-11-26T07:12:10.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.524+0000 7f2f22cc1700 1 -- 172.21.15.2:0/1756580583 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f1c143ae0 msgr2=0x7f2f1c0b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:10.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.524+0000 7f2f22cc1700 1 --2- 172.21.15.2:0/1756580583 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f1c143ae0 0x7f2f1c0b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:10.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.524+0000 7f2f22cc1700 1 -- 172.21.15.2:0/1756580583 >> v1:172.21.15.192:6789/0 conn(0x7f2f1c1440f0 legacy=0x7f2f1c071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:10.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.524+0000 7f2f22cc1700 1 -- 172.21.15.2:0/1756580583 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f1c0b3dc0 con 0x7f2f1c0722c0 2023-11-26T07:12:10.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.524+0000 7f2f214be700 1 -- 172.21.15.2:0/1756580583 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2705421848 0 0) 0x7f2f1c143ec0 con 0x7f2f1c1440f0 2023-11-26T07:12:10.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.524+0000 7f2f224c0700 1 --2- 172.21.15.2:0/1756580583 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f1c143ae0 0x7f2f1c0b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:12:10.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.525+0000 7f2f22cc1700 1 --2- 172.21.15.2:0/1756580583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f1c0722c0 0x7f2f1c06e510 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2f14009e50 tx=0x7f2f1400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=531d5a088b8fbbcf server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:10.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.525+0000 7f2f214be700 1 -- 172.21.15.2:0/1756580583 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1400e070 con 0x7f2f1c0722c0 2023-11-26T07:12:10.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.525+0000 7f2f214be700 1 -- 172.21.15.2:0/1756580583 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1400b910 con 0x7f2f1c0722c0 2023-11-26T07:12:10.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.525+0000 7f2f214be700 1 -- 172.21.15.2:0/1756580583 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1400bcc0 con 0x7f2f1c0722c0 2023-11-26T07:12:10.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.525+0000 7f2f24724700 1 -- 172.21.15.2:0/1756580583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f1c0722c0 msgr2=0x7f2f1c06e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:10.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.525+0000 7f2f24724700 1 --2- 172.21.15.2:0/1756580583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f1c0722c0 0x7f2f1c06e510 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2f14009e50 tx=0x7f2f1400b330 comp rx=0 tx=0).stop 2023-11-26T07:12:10.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.525+0000 7f2f24724700 1 -- 172.21.15.2:0/1756580583 shutdown_connections 2023-11-26T07:12:10.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.525+0000 7f2f24724700 1 --2- 172.21.15.2:0/1756580583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f1c0722c0 0x7f2f1c06e510 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:10.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.525+0000 7f2f24724700 1 --2- 172.21.15.2:0/1756580583 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f1c143ae0 0x7f2f1c0b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:10.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.525+0000 7f2f24724700 1 -- 172.21.15.2:0/1756580583 >> 172.21.15.2:0/1756580583 conn(0x7f2f1c0b2740 msgr2=0x7f2f1c0b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:10.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.525+0000 7f2f24724700 1 -- 172.21.15.2:0/1756580583 shutdown_connections 2023-11-26T07:12:10.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.525+0000 7f2f24724700 1 -- 172.21.15.2:0/1756580583 wait complete. 2023-11-26T07:12:10.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.527+0000 7f2f24724700 1 Processor -- start 2023-11-26T07:12:10.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.527+0000 7f2f24724700 1 -- start start 2023-11-26T07:12:10.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.527+0000 7f2f24724700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f1c0722c0 0x7f2f1c156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:10.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.527+0000 7f2f24724700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f1c143ae0 0x7f2f1c1f5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:10.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.527+0000 7f2f24724700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f1c1440f0 0x7f2f1c1f60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:10.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.527+0000 7f2f24724700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c1594c0 con 0x7f2f1c0722c0 2023-11-26T07:12:10.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.527+0000 7f2f24724700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c1597a0 con 0x7f2f1c1440f0 2023-11-26T07:12:10.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.527+0000 7f2f24724700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c159a80 con 0x7f2f1c143ae0 2023-11-26T07:12:10.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.528+0000 7f2f224c0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f1c0722c0 0x7f2f1c156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:10.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.528+0000 7f2f224c0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f1c0722c0 0x7f2f1c156950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40164/0 (socket says 172.21.15.2:40164) 2023-11-26T07:12:10.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.528+0000 7f2f224c0700 1 -- 172.21.15.2:0/3390460945 learned_addr learned my addr 172.21.15.2:0/3390460945 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:10.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.528+0000 7f2f22cc1700 1 --2- 172.21.15.2:0/3390460945 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f1c1440f0 0x7f2f1c1f60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:10.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.528+0000 7f2f21cbf700 1 --2- 172.21.15.2:0/3390460945 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f1c143ae0 0x7f2f1c1f5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:10.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.528+0000 7f2f224c0700 1 -- 172.21.15.2:0/3390460945 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f1c143ae0 msgr2=0x7f2f1c1f5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:10.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.528+0000 7f2f224c0700 1 --2- 172.21.15.2:0/3390460945 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f1c143ae0 0x7f2f1c1f5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:10.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.528+0000 7f2f224c0700 1 -- 172.21.15.2:0/3390460945 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f1c1440f0 msgr2=0x7f2f1c1f60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:10.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.528+0000 7f2f224c0700 1 --2- 172.21.15.2:0/3390460945 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f1c1440f0 0x7f2f1c1f60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:10.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.528+0000 7f2f224c0700 1 -- 172.21.15.2:0/3390460945 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f180094a0 con 0x7f2f1c0722c0 2023-11-26T07:12:10.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.528+0000 7f2f22cc1700 1 --2- 172.21.15.2:0/3390460945 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f1c1440f0 0x7f2f1c1f60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:10.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.528+0000 7f2f224c0700 1 --2- 172.21.15.2:0/3390460945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f1c0722c0 0x7f2f1c156950 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2f1800ebe0 tx=0x7f2f18009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:10.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.528+0000 7f2f12ffd700 1 -- 172.21.15.2:0/3390460945 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1800c910 con 0x7f2f1c0722c0 2023-11-26T07:12:10.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.528+0000 7f2f12ffd700 1 -- 172.21.15.2:0/3390460945 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1800ca70 con 0x7f2f1c0722c0 2023-11-26T07:12:10.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.528+0000 7f2f24724700 1 -- 172.21.15.2:0/3390460945 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f14009b30 con 0x7f2f1c0722c0 2023-11-26T07:12:10.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.528+0000 7f2f12ffd700 1 -- 172.21.15.2:0/3390460945 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1800cde0 con 0x7f2f1c0722c0 2023-11-26T07:12:10.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.528+0000 7f2f24724700 1 -- 172.21.15.2:0/3390460945 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f1c159190 con 0x7f2f1c0722c0 2023-11-26T07:12:10.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.529+0000 7f2f24724700 1 -- 172.21.15.2:0/3390460945 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f1c13fbf0 con 0x7f2f1c0722c0 2023-11-26T07:12:10.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.530+0000 7f2f12ffd700 1 -- 172.21.15.2:0/3390460945 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2f18013470 con 0x7f2f1c0722c0 2023-11-26T07:12:10.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.530+0000 7f2f12ffd700 1 --2- 172.21.15.2:0/3390460945 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f2f0006aed0 0x7f2f0006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:10.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.530+0000 7f2f12ffd700 1 -- 172.21.15.2:0/3390460945 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f18089780 con 0x7f2f1c0722c0 2023-11-26T07:12:10.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.531+0000 7f2f21cbf700 1 --2- 172.21.15.2:0/3390460945 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f2f0006aed0 0x7f2f0006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:10.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.531+0000 7f2f21cbf700 1 --2- 172.21.15.2:0/3390460945 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f2f0006aed0 0x7f2f0006d390 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c000f60 tx=0x7f2f0c007c90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:10.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.535+0000 7f2f12ffd700 1 -- 172.21.15.2:0/3390460945 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2f18054830 con 0x7f2f1c0722c0 2023-11-26T07:12:10.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.753+0000 7f2f24724700 1 -- 172.21.15.2:0/3390460945 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2f1c166a10 con 0x7f2f1c0722c0 2023-11-26T07:12:10.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.754+0000 7f2f12ffd700 1 -- 172.21.15.2:0/3390460945 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2f18057e50 con 0x7f2f1c0722c0 2023-11-26T07:12:10.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.755+0000 7f2f24724700 1 -- 172.21.15.2:0/3390460945 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f2f0006aed0 msgr2=0x7f2f0006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:10.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.755+0000 7f2f24724700 1 --2- 172.21.15.2:0/3390460945 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f2f0006aed0 0x7f2f0006d390 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c000f60 tx=0x7f2f0c007c90 comp rx=0 tx=0).stop 2023-11-26T07:12:10.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.755+0000 7f2f24724700 1 -- 172.21.15.2:0/3390460945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f1c0722c0 msgr2=0x7f2f1c156950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:10.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.755+0000 7f2f24724700 1 --2- 172.21.15.2:0/3390460945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f1c0722c0 0x7f2f1c156950 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2f1800ebe0 tx=0x7f2f18009ec0 comp rx=0 tx=0).stop 2023-11-26T07:12:10.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.756+0000 7f2f24724700 1 -- 172.21.15.2:0/3390460945 shutdown_connections 2023-11-26T07:12:10.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.756+0000 7f2f24724700 1 --2- 172.21.15.2:0/3390460945 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f2f0006aed0 0x7f2f0006d390 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:10.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.756+0000 7f2f24724700 1 --2- 172.21.15.2:0/3390460945 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f1c1440f0 0x7f2f1c1f60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:10.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.756+0000 7f2f24724700 1 --2- 172.21.15.2:0/3390460945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f1c0722c0 0x7f2f1c156950 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:10.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.756+0000 7f2f24724700 1 --2- 172.21.15.2:0/3390460945 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f1c143ae0 0x7f2f1c1f5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:10.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.756+0000 7f2f24724700 1 -- 172.21.15.2:0/3390460945 >> 172.21.15.2:0/3390460945 conn(0x7f2f1c0b2740 msgr2=0x7f2f1c154e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:10.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.756+0000 7f2f24724700 1 -- 172.21.15.2:0/3390460945 shutdown_connections 2023-11-26T07:12:10.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:10.756+0000 7f2f24724700 1 -- 172.21.15.2:0/3390460945 wait complete. 2023-11-26T07:12:10.759 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2023-11-26T07:12:10.770 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-26T07:12:10.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:10.770 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-11-26T07:12:10.823 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2023-11-26T07:12:10.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:10.823 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-26T07:12:10.847 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:10.847 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:10.865 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:10.866 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:10.923 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:10.923 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:10.979 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:12:11.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.141+0000 7f4afc124700 1 Processor -- start 2023-11-26T07:12:11.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.141+0000 7f4afc124700 1 -- start start 2023-11-26T07:12:11.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.142+0000 7f4afc124700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4af40cf1e0 0x7f4af415b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:11.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.142+0000 7f4afc124700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4af4070a80 0x7f4af40c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:11.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.142+0000 7f4afc124700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4af40ca510 0x7f4af415e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:11.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.142+0000 7f4afc124700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4af415ba10 con 0x7f4af4070a80 2023-11-26T07:12:11.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.142+0000 7f4afc124700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4af4072d20 con 0x7f4af40cf1e0 2023-11-26T07:12:11.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.142+0000 7f4afc124700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af40ca960 con 0x7f4af40ca510 2023-11-26T07:12:11.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.142+0000 7f4af96bf700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4af4070a80 0x7f4af40c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:11.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.143+0000 7f4af96bf700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4af4070a80 0x7f4af40c9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40172/0 (socket says 172.21.15.2:40172) 2023-11-26T07:12:11.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.143+0000 7f4af96bf700 1 -- 172.21.15.2:0/3802860490 learned_addr learned my addr 172.21.15.2:0/3802860490 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:11.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.143+0000 7f4afa6c1700 1 --2- 172.21.15.2:0/3802860490 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4af40ca510 0x7f4af415e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:11.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.143+0000 7f4af9ec0700 1 --2- 172.21.15.2:0/3802860490 >> v2:172.21.15.192:3300/0 conn(0x7f4af40cf1e0 0x7f4af415b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:11.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.143+0000 7f4af96bf700 1 -- 172.21.15.2:0/3802860490 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4af40ca510 msgr2=0x7f4af415e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:11.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.143+0000 7f4af96bf700 1 --2- 172.21.15.2:0/3802860490 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4af40ca510 0x7f4af415e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:11.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.143+0000 7f4af96bf700 1 -- 172.21.15.2:0/3802860490 >> v2:172.21.15.192:3300/0 conn(0x7f4af40cf1e0 msgr2=0x7f4af415b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:11.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.143+0000 7f4af96bf700 1 --2- 172.21.15.2:0/3802860490 >> v2:172.21.15.192:3300/0 conn(0x7f4af40cf1e0 0x7f4af415b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:11.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.143+0000 7f4af96bf700 1 -- 172.21.15.2:0/3802860490 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af4071020 con 0x7f4af4070a80 2023-11-26T07:12:11.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.143+0000 7f4af96bf700 1 --2- 172.21.15.2:0/3802860490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af4070a80 0x7f4af40c9fd0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4af4069260 tx=0x7f4ae4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28efc9cb8994249d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:11.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.143+0000 7f4af8ebe700 1 -- 172.21.15.2:0/3802860490 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae400b870 con 0x7f4af4070a80 2023-11-26T07:12:11.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.143+0000 7f4af8ebe700 1 -- 172.21.15.2:0/3802860490 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae400b9d0 con 0x7f4af4070a80 2023-11-26T07:12:11.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.143+0000 7f4af8ebe700 1 -- 172.21.15.2:0/3802860490 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae400bd60 con 0x7f4af4070a80 2023-11-26T07:12:11.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.144+0000 7f4afc124700 1 -- 172.21.15.2:0/3802860490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af4070a80 msgr2=0x7f4af40c9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:11.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.144+0000 7f4afc124700 1 --2- 172.21.15.2:0/3802860490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af4070a80 0x7f4af40c9fd0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4af4069260 tx=0x7f4ae4009bd0 comp rx=0 tx=0).stop 2023-11-26T07:12:11.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.144+0000 7f4afc124700 1 -- 172.21.15.2:0/3802860490 shutdown_connections 2023-11-26T07:12:11.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.144+0000 7f4afc124700 1 --2- 172.21.15.2:0/3802860490 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4af40ca510 0x7f4af415e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:11.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.144+0000 7f4afc124700 1 --2- 172.21.15.2:0/3802860490 >> v2:172.21.15.192:3300/0 conn(0x7f4af40cf1e0 0x7f4af415b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:11.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.144+0000 7f4afc124700 1 --2- 172.21.15.2:0/3802860490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af4070a80 0x7f4af40c9fd0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:11.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.144+0000 7f4afc124700 1 -- 172.21.15.2:0/3802860490 >> 172.21.15.2:0/3802860490 conn(0x7f4af40cf980 msgr2=0x7f4af40cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:11.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.144+0000 7f4afc124700 1 -- 172.21.15.2:0/3802860490 shutdown_connections 2023-11-26T07:12:11.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.144+0000 7f4afc124700 1 -- 172.21.15.2:0/3802860490 wait complete. 2023-11-26T07:12:11.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.145+0000 7f4afc124700 1 Processor -- start 2023-11-26T07:12:11.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.145+0000 7f4afc124700 1 -- start start 2023-11-26T07:12:11.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.146+0000 7f4afc124700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4af4070a80 0x7f4af414b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:11.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.146+0000 7f4afc124700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af40ca510 0x7f4af40cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:11.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.146+0000 7f4afc124700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4af40cf1e0 0x7f4af414c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:11.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.146+0000 7f4afc124700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af4150a90 con 0x7f4af40ca510 2023-11-26T07:12:11.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.146+0000 7f4afc124700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af414d320 con 0x7f4af40cf1e0 2023-11-26T07:12:11.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.146+0000 7f4afc124700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af414d600 con 0x7f4af4070a80 2023-11-26T07:12:11.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.147+0000 7f4af96bf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af40ca510 0x7f4af40cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:11.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.147+0000 7f4af96bf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af40ca510 0x7f4af40cc7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40180/0 (socket says 172.21.15.2:40180) 2023-11-26T07:12:11.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.147+0000 7f4af96bf700 1 -- 172.21.15.2:0/3847898817 learned_addr learned my addr 172.21.15.2:0/3847898817 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:11.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.147+0000 7f4af9ec0700 1 --2- 172.21.15.2:0/3847898817 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4af4070a80 0x7f4af414b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:11.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.147+0000 7f4afa6c1700 1 --2- 172.21.15.2:0/3847898817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4af40cf1e0 0x7f4af414c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:11.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.147+0000 7f4af96bf700 1 -- 172.21.15.2:0/3847898817 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4af4070a80 msgr2=0x7f4af414b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:11.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.147+0000 7f4af96bf700 1 --2- 172.21.15.2:0/3847898817 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4af4070a80 0x7f4af414b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:11.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.147+0000 7f4af96bf700 1 -- 172.21.15.2:0/3847898817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4af40cf1e0 msgr2=0x7f4af414c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:11.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.147+0000 7f4af96bf700 1 --2- 172.21.15.2:0/3847898817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4af40cf1e0 0x7f4af414c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:11.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.147+0000 7f4af96bf700 1 -- 172.21.15.2:0/3847898817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae4009550 con 0x7f4af40ca510 2023-11-26T07:12:11.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.147+0000 7f4afa6c1700 1 --2- 172.21.15.2:0/3847898817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4af40cf1e0 0x7f4af414c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:11.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.147+0000 7f4af96bf700 1 --2- 172.21.15.2:0/3847898817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af40ca510 0x7f4af40cc7e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4000c00 tx=0x7f4ae4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:11.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.147+0000 7f4aea7fc700 1 -- 172.21.15.2:0/3847898817 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4004540 con 0x7f4af40ca510 2023-11-26T07:12:11.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.147+0000 7f4aea7fc700 1 -- 172.21.15.2:0/3847898817 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae40036a0 con 0x7f4af40ca510 2023-11-26T07:12:11.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.147+0000 7f4afc124700 1 -- 172.21.15.2:0/3847898817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4af414d8e0 con 0x7f4af40ca510 2023-11-26T07:12:11.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.147+0000 7f4aea7fc700 1 -- 172.21.15.2:0/3847898817 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4003a50 con 0x7f4af40ca510 2023-11-26T07:12:11.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.147+0000 7f4afc124700 1 -- 172.21.15.2:0/3847898817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af40ccd20 con 0x7f4af40ca510 2023-11-26T07:12:11.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.148+0000 7f4afc124700 1 -- 172.21.15.2:0/3847898817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4af4150c90 con 0x7f4af40ca510 2023-11-26T07:12:11.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.149+0000 7f4aea7fc700 1 -- 172.21.15.2:0/3847898817 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4ae4021070 con 0x7f4af40ca510 2023-11-26T07:12:11.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.149+0000 7f4aea7fc700 1 --2- 172.21.15.2:0/3847898817 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4ad806aed0 0x7f4ad806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:11.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.149+0000 7f4aea7fc700 1 -- 172.21.15.2:0/3847898817 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4ae408abb0 con 0x7f4af40ca510 2023-11-26T07:12:11.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.149+0000 7f4af9ec0700 1 --2- 172.21.15.2:0/3847898817 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4ad806aed0 0x7f4ad806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:11.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.150+0000 7f4af9ec0700 1 --2- 172.21.15.2:0/3847898817 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4ad806aed0 0x7f4ad806d390 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4af0006b20 tx=0x7f4af0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:11.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.154+0000 7f4aea7fc700 1 -- 172.21.15.2:0/3847898817 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4af4150c90 con 0x7f4af40ca510 2023-11-26T07:12:11.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.354+0000 7f4afc124700 1 -- 172.21.15.2:0/3847898817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4af4150c90 con 0x7f4af40ca510 2023-11-26T07:12:11.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.356+0000 7f4aea7fc700 1 -- 172.21.15.2:0/3847898817 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f4af4150c90 con 0x7f4af40ca510 2023-11-26T07:12:11.358 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:12:11.358 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:11:35.634747+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:11:32.129474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:11:33.019837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:12:11.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.358+0000 7f4afc124700 1 -- 172.21.15.2:0/3847898817 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4ad806aed0 msgr2=0x7f4ad806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:11.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.358+0000 7f4afc124700 1 --2- 172.21.15.2:0/3847898817 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4ad806aed0 0x7f4ad806d390 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4af0006b20 tx=0x7f4af0008040 comp rx=0 tx=0).stop 2023-11-26T07:12:11.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.358+0000 7f4afc124700 1 -- 172.21.15.2:0/3847898817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af40ca510 msgr2=0x7f4af40cc7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:11.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.358+0000 7f4afc124700 1 --2- 172.21.15.2:0/3847898817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af40ca510 0x7f4af40cc7e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4000c00 tx=0x7f4ae4004750 comp rx=0 tx=0).stop 2023-11-26T07:12:11.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.358+0000 7f4afc124700 1 -- 172.21.15.2:0/3847898817 shutdown_connections 2023-11-26T07:12:11.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.358+0000 7f4afc124700 1 --2- 172.21.15.2:0/3847898817 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4ad806aed0 0x7f4ad806d390 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:11.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.358+0000 7f4afc124700 1 --2- 172.21.15.2:0/3847898817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4af40cf1e0 0x7f4af414c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:11.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.358+0000 7f4afc124700 1 --2- 172.21.15.2:0/3847898817 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4af4070a80 0x7f4af414b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:11.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.358+0000 7f4afc124700 1 --2- 172.21.15.2:0/3847898817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af40ca510 0x7f4af40cc7e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:11.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.358+0000 7f4afc124700 1 -- 172.21.15.2:0/3847898817 >> 172.21.15.2:0/3847898817 conn(0x7f4af40cf980 msgr2=0x7f4af406cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:11.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.358+0000 7f4afc124700 1 -- 172.21.15.2:0/3847898817 shutdown_connections 2023-11-26T07:12:11.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.358+0000 7f4afc124700 1 -- 172.21.15.2:0/3847898817 wait complete. 2023-11-26T07:12:11.372 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:11:28.205739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:11:32.129474+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:11:33.019837+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:12:11.372 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:12:11.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.499+0000 7fb57a6e6700 1 Processor -- start 2023-11-26T07:12:11.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.499+0000 7fb57a6e6700 1 -- start start 2023-11-26T07:12:11.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.500+0000 7fb57a6e6700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb57406b6e0 0x7fb57406db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:11.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.500+0000 7fb57a6e6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb574145100 0x7fb57406e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:11.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.500+0000 7fb57a6e6700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb574160720 con 0x7fb574144c10 2023-11-26T07:12:11.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.500+0000 7fb57a6e6700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb57406f500 con 0x7fb57406b6e0 2023-11-26T07:12:11.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.500+0000 7fb57a6e6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5740cd610 con 0x7fb574145100 2023-11-26T07:12:11.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.500+0000 7fb578c83700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb574145100 0x7fb57406e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:11.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.500+0000 7fb5737fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb57406b6e0 0x7fb57406db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:11.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.500+0000 7fb578c83700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb574145100 0x7fb57406e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.2:38270/0 (socket says 172.21.15.2:38270) 2023-11-26T07:12:11.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.500+0000 7fb573fff700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fb574144c10 0x7fb57406afd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.2:38766/0 (socket says 172.21.15.2:38766) 2023-11-26T07:12:11.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.500+0000 7fb578c83700 1 -- 172.21.15.2:0/48351788 learned_addr learned my addr 172.21.15.2:0/48351788 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:11.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.500+0000 7fb5737fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb57406b6e0 0x7fb57406db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.2:48774/0 (socket says 172.21.15.2:48774) 2023-11-26T07:12:11.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.500+0000 7fb578c83700 1 -- 172.21.15.2:0/48351788 >> v2:172.21.15.192:3300/0 conn(0x7fb57406b6e0 msgr2=0x7fb57406db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:11.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.500+0000 7fb578c83700 1 --2- 172.21.15.2:0/48351788 >> v2:172.21.15.192:3300/0 conn(0x7fb57406b6e0 0x7fb57406db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:11.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.500+0000 7fb578c83700 1 -- 172.21.15.2:0/48351788 >> v1:172.21.15.192:6789/0 conn(0x7fb574144c10 legacy=0x7fb57406afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:11.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.500+0000 7fb578c83700 1 -- 172.21.15.2:0/48351788 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57406f710 con 0x7fb574145100 2023-11-26T07:12:11.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.501+0000 7fb578c83700 1 --2- 172.21.15.2:0/48351788 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb574145100 0x7fb57406e0b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb56c009e50 tx=0x7fb56c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3aea044ec7da6ba server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:11.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.501+0000 7fb572ffd700 1 -- 172.21.15.2:0/48351788 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56c00e070 con 0x7fb574145100 2023-11-26T07:12:11.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.501+0000 7fb572ffd700 1 -- 172.21.15.2:0/48351788 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56c00b910 con 0x7fb574145100 2023-11-26T07:12:11.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.501+0000 7fb572ffd700 1 -- 172.21.15.2:0/48351788 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56c00bcc0 con 0x7fb574145100 2023-11-26T07:12:11.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.501+0000 7fb57a6e6700 1 -- 172.21.15.2:0/48351788 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb574145100 msgr2=0x7fb57406e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:11.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.501+0000 7fb57a6e6700 1 --2- 172.21.15.2:0/48351788 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb574145100 0x7fb57406e0b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb56c009e50 tx=0x7fb56c00b330 comp rx=0 tx=0).stop 2023-11-26T07:12:11.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.501+0000 7fb57a6e6700 1 -- 172.21.15.2:0/48351788 shutdown_connections 2023-11-26T07:12:11.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.501+0000 7fb57a6e6700 1 --2- 172.21.15.2:0/48351788 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb574145100 0x7fb57406e0b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:11.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.501+0000 7fb57a6e6700 1 --2- 172.21.15.2:0/48351788 >> v2:172.21.15.192:3300/0 conn(0x7fb57406b6e0 0x7fb57406db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:11.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.501+0000 7fb57a6e6700 1 -- 172.21.15.2:0/48351788 >> 172.21.15.2:0/48351788 conn(0x7fb5740b2740 msgr2=0x7fb5740b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:11.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.502+0000 7fb57a6e6700 1 -- 172.21.15.2:0/48351788 shutdown_connections 2023-11-26T07:12:11.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.502+0000 7fb57a6e6700 1 -- 172.21.15.2:0/48351788 wait complete. 2023-11-26T07:12:11.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.503+0000 7fb57a6e6700 1 Processor -- start 2023-11-26T07:12:11.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.503+0000 7fb57a6e6700 1 -- start start 2023-11-26T07:12:11.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.504+0000 7fb57a6e6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb57406b6e0 0x7fb57415bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:11.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.504+0000 7fb57a6e6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb574144c10 0x7fb5740b5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:11.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.504+0000 7fb57a6e6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb574145100 0x7fb5740af060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:11.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.504+0000 7fb57a6e6700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5740af5a0 con 0x7fb574145100 2023-11-26T07:12:11.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.504+0000 7fb57a6e6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5740af7d0 con 0x7fb574144c10 2023-11-26T07:12:11.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.504+0000 7fb57a6e6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5740afab0 con 0x7fb57406b6e0 2023-11-26T07:12:11.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.504+0000 7fb578c83700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb574145100 0x7fb5740af060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:11.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.504+0000 7fb578c83700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb574145100 0x7fb5740af060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40196/0 (socket says 172.21.15.2:40196) 2023-11-26T07:12:11.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.504+0000 7fb578c83700 1 -- 172.21.15.2:0/1657796033 learned_addr learned my addr 172.21.15.2:0/1657796033 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:11.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.504+0000 7fb573fff700 1 --2- 172.21.15.2:0/1657796033 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb57406b6e0 0x7fb57415bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:11.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.504+0000 7fb5737fe700 1 --2- 172.21.15.2:0/1657796033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb574144c10 0x7fb5740b5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:11.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.504+0000 7fb578c83700 1 -- 172.21.15.2:0/1657796033 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb57406b6e0 msgr2=0x7fb57415bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:11.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.504+0000 7fb578c83700 1 --2- 172.21.15.2:0/1657796033 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb57406b6e0 0x7fb57415bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:11.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.504+0000 7fb578c83700 1 -- 172.21.15.2:0/1657796033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb574144c10 msgr2=0x7fb5740b5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:11.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.504+0000 7fb578c83700 1 --2- 172.21.15.2:0/1657796033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb574144c10 0x7fb5740b5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:11.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.504+0000 7fb578c83700 1 -- 172.21.15.2:0/1657796033 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb56c009b30 con 0x7fb574145100 2023-11-26T07:12:11.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.504+0000 7fb578c83700 1 --2- 172.21.15.2:0/1657796033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb574145100 0x7fb5740af060 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb57406f640 tx=0x7fb56c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:11.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.504+0000 7fb570ff9700 1 -- 172.21.15.2:0/1657796033 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56c0099b0 con 0x7fb574145100 2023-11-26T07:12:11.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.504+0000 7fb570ff9700 1 -- 172.21.15.2:0/1657796033 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56c0092e0 con 0x7fb574145100 2023-11-26T07:12:11.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.504+0000 7fb57a6e6700 1 -- 172.21.15.2:0/1657796033 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5741f7070 con 0x7fb574145100 2023-11-26T07:12:11.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.504+0000 7fb570ff9700 1 -- 172.21.15.2:0/1657796033 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56c004450 con 0x7fb574145100 2023-11-26T07:12:11.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.505+0000 7fb57a6e6700 1 -- 172.21.15.2:0/1657796033 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5740afd90 con 0x7fb574145100 2023-11-26T07:12:11.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.505+0000 7fb57a6e6700 1 -- 172.21.15.2:0/1657796033 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5740cd350 con 0x7fb574145100 2023-11-26T07:12:11.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.506+0000 7fb570ff9700 1 -- 172.21.15.2:0/1657796033 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb56c0045b0 con 0x7fb574145100 2023-11-26T07:12:11.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.507+0000 7fb570ff9700 1 --2- 172.21.15.2:0/1657796033 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb56006aed0 0x7fb56006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:11.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.507+0000 7fb570ff9700 1 -- 172.21.15.2:0/1657796033 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb56c08aaf0 con 0x7fb574145100 2023-11-26T07:12:11.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.507+0000 7fb573fff700 1 --2- 172.21.15.2:0/1657796033 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb56006aed0 0x7fb56006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:11.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.508+0000 7fb573fff700 1 --2- 172.21.15.2:0/1657796033 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb56006aed0 0x7fb56006d390 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb564000f60 tx=0x7fb564007ed0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:11.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.511+0000 7fb570ff9700 1 -- 172.21.15.2:0/1657796033 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb56c055e00 con 0x7fb574145100 2023-11-26T07:12:11.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.710+0000 7fb57a6e6700 1 -- 172.21.15.2:0/1657796033 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb574075480 con 0x7fb574145100 2023-11-26T07:12:11.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.710+0000 7fb570ff9700 1 -- 172.21.15.2:0/1657796033 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb56c01f020 con 0x7fb574145100 2023-11-26T07:12:11.712 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-26T07:12:11.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.712+0000 7fb57a6e6700 1 -- 172.21.15.2:0/1657796033 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb56006aed0 msgr2=0x7fb56006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:11.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.712+0000 7fb57a6e6700 1 --2- 172.21.15.2:0/1657796033 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb56006aed0 0x7fb56006d390 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb564000f60 tx=0x7fb564007ed0 comp rx=0 tx=0).stop 2023-11-26T07:12:11.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.712+0000 7fb57a6e6700 1 -- 172.21.15.2:0/1657796033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb574145100 msgr2=0x7fb5740af060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:11.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.712+0000 7fb57a6e6700 1 --2- 172.21.15.2:0/1657796033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb574145100 0x7fb5740af060 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb57406f640 tx=0x7fb56c004ad0 comp rx=0 tx=0).stop 2023-11-26T07:12:11.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.712+0000 7fb57a6e6700 1 -- 172.21.15.2:0/1657796033 shutdown_connections 2023-11-26T07:12:11.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.712+0000 7fb57a6e6700 1 --2- 172.21.15.2:0/1657796033 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb56006aed0 0x7fb56006d390 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:11.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.712+0000 7fb57a6e6700 1 --2- 172.21.15.2:0/1657796033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb574145100 0x7fb5740af060 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:11.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.712+0000 7fb57a6e6700 1 --2- 172.21.15.2:0/1657796033 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb57406b6e0 0x7fb57415bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:11.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.712+0000 7fb57a6e6700 1 --2- 172.21.15.2:0/1657796033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb574144c10 0x7fb5740b5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:11.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.712+0000 7fb57a6e6700 1 -- 172.21.15.2:0/1657796033 >> 172.21.15.2:0/1657796033 conn(0x7fb5740b2740 msgr2=0x7fb5740cf140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:11.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.712+0000 7fb57a6e6700 1 -- 172.21.15.2:0/1657796033 shutdown_connections 2023-11-26T07:12:11.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.712+0000 7fb57a6e6700 1 -- 172.21.15.2:0/1657796033 wait complete. 2023-11-26T07:12:11.726 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:12:11.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.852+0000 7fd71ce1e700 1 Processor -- start 2023-11-26T07:12:11.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.852+0000 7fd71ce1e700 1 -- start start 2023-11-26T07:12:11.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.853+0000 7fd71ce1e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd71815bde0 0x7fd71815c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:11.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.853+0000 7fd71ce1e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd7180cf2b0 0x7fd7180d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:11.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.853+0000 7fd71ce1e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7180d0a90 con 0x7fd7180ce5c0 2023-11-26T07:12:11.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.853+0000 7fd71ce1e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd71806ee10 con 0x7fd7180cf2b0 2023-11-26T07:12:11.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.853+0000 7fd71ce1e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd71806f0f0 con 0x7fd71815bde0 2023-11-26T07:12:11.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.853+0000 7fd715d9b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd7180cf2b0 0x7fd7180d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:11.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.853+0000 7fd715d9b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd7180cf2b0 0x7fd7180d01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40200/0 (socket says 172.21.15.2:40200) 2023-11-26T07:12:11.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.853+0000 7fd715d9b700 1 -- 172.21.15.2:0/209107037 learned_addr learned my addr 172.21.15.2:0/209107037 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:11.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.854+0000 7fd71659c700 1 --2- 172.21.15.2:0/209107037 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd71815bde0 0x7fd71815c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:11.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.854+0000 7fd715d9b700 1 -- 172.21.15.2:0/209107037 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd71815bde0 msgr2=0x7fd71815c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:11.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.854+0000 7fd715d9b700 1 --2- 172.21.15.2:0/209107037 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd71815bde0 0x7fd71815c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:11.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.854+0000 7fd715d9b700 1 -- 172.21.15.2:0/209107037 >> v1:172.21.15.192:6789/0 conn(0x7fd7180ce5c0 legacy=0x7fd7180cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:11.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.854+0000 7fd715d9b700 1 -- 172.21.15.2:0/209107037 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd71806f3d0 con 0x7fd7180cf2b0 2023-11-26T07:12:11.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.854+0000 7fd715d9b700 1 --2- 172.21.15.2:0/209107037 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7180cf2b0 0x7fd7180d01b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd7080098f0 tx=0x7fd708009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc9cb0a633b418e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:11.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.854+0000 7fd71559a700 1 -- 172.21.15.2:0/209107037 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd708004230 con 0x7fd7180cf2b0 2023-11-26T07:12:11.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.854+0000 7fd71559a700 1 -- 172.21.15.2:0/209107037 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd708004390 con 0x7fd7180cf2b0 2023-11-26T07:12:11.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.854+0000 7fd71559a700 1 -- 172.21.15.2:0/209107037 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7080036a0 con 0x7fd7180cf2b0 2023-11-26T07:12:11.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.854+0000 7fd71ce1e700 1 -- 172.21.15.2:0/209107037 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7180cf2b0 msgr2=0x7fd7180d01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:11.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.854+0000 7fd71ce1e700 1 --2- 172.21.15.2:0/209107037 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7180cf2b0 0x7fd7180d01b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd7080098f0 tx=0x7fd708009c00 comp rx=0 tx=0).stop 2023-11-26T07:12:11.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.855+0000 7fd71ce1e700 1 -- 172.21.15.2:0/209107037 shutdown_connections 2023-11-26T07:12:11.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.855+0000 7fd71ce1e700 1 --2- 172.21.15.2:0/209107037 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd71815bde0 0x7fd71815c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:11.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.855+0000 7fd71ce1e700 1 --2- 172.21.15.2:0/209107037 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7180cf2b0 0x7fd7180d01b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:11.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.855+0000 7fd71ce1e700 1 -- 172.21.15.2:0/209107037 >> 172.21.15.2:0/209107037 conn(0x7fd7180b3720 msgr2=0x7fd7180b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:11.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.855+0000 7fd71ce1e700 1 -- 172.21.15.2:0/209107037 shutdown_connections 2023-11-26T07:12:11.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.855+0000 7fd71ce1e700 1 -- 172.21.15.2:0/209107037 wait complete. 2023-11-26T07:12:11.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.856+0000 7fd71ce1e700 1 Processor -- start 2023-11-26T07:12:11.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.856+0000 7fd71ce1e700 1 -- start start 2023-11-26T07:12:11.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.857+0000 7fd71ce1e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7180ce5c0 0x7fd7181f1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:11.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.857+0000 7fd71ce1e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7180cf2b0 0x7fd7180b1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:11.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.857+0000 7fd71ce1e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd71815bde0 0x7fd7180b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:11.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.857+0000 7fd71ce1e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd718153930 con 0x7fd71815bde0 2023-11-26T07:12:11.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.857+0000 7fd71ce1e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7180c9ab0 con 0x7fd7180ce5c0 2023-11-26T07:12:11.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.857+0000 7fd71ce1e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd71815d210 con 0x7fd7180cf2b0 2023-11-26T07:12:11.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.857+0000 7fd716d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd71815bde0 0x7fd7180b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:11.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.857+0000 7fd716d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd71815bde0 0x7fd7180b17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40210/0 (socket says 172.21.15.2:40210) 2023-11-26T07:12:11.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.857+0000 7fd716d9d700 1 -- 172.21.15.2:0/3862931754 learned_addr learned my addr 172.21.15.2:0/3862931754 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:11.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.857+0000 7fd71659c700 1 --2- 172.21.15.2:0/3862931754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7180ce5c0 0x7fd7181f1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:11.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.857+0000 7fd715d9b700 1 --2- 172.21.15.2:0/3862931754 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7180cf2b0 0x7fd7180b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:11.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.857+0000 7fd716d9d700 1 -- 172.21.15.2:0/3862931754 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7180cf2b0 msgr2=0x7fd7180b1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:11.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.857+0000 7fd716d9d700 1 --2- 172.21.15.2:0/3862931754 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7180cf2b0 0x7fd7180b1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:11.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.857+0000 7fd716d9d700 1 -- 172.21.15.2:0/3862931754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7180ce5c0 msgr2=0x7fd7181f1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:11.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.857+0000 7fd716d9d700 1 --2- 172.21.15.2:0/3862931754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7180ce5c0 0x7fd7181f1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:11.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.857+0000 7fd716d9d700 1 -- 172.21.15.2:0/3862931754 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd708009550 con 0x7fd71815bde0 2023-11-26T07:12:11.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.857+0000 7fd715d9b700 1 --2- 172.21.15.2:0/3862931754 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7180cf2b0 0x7fd7180b1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:12:11.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.857+0000 7fd716d9d700 1 --2- 172.21.15.2:0/3862931754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd71815bde0 0x7fd7180b17c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd71000cc10 tx=0x7fd71000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:11.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.857+0000 7fd706ffd700 1 -- 172.21.15.2:0/3862931754 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71000abb0 con 0x7fd71815bde0 2023-11-26T07:12:11.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.857+0000 7fd706ffd700 1 -- 172.21.15.2:0/3862931754 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71000ad10 con 0x7fd71815bde0 2023-11-26T07:12:11.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.857+0000 7fd706ffd700 1 -- 172.21.15.2:0/3862931754 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd710012660 con 0x7fd71815bde0 2023-11-26T07:12:11.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.857+0000 7fd71ce1e700 1 -- 172.21.15.2:0/3862931754 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd71815d4f0 con 0x7fd71815bde0 2023-11-26T07:12:11.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.858+0000 7fd71ce1e700 1 -- 172.21.15.2:0/3862931754 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7180c94f0 con 0x7fd71815bde0 2023-11-26T07:12:11.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.858+0000 7fd71ce1e700 1 -- 172.21.15.2:0/3862931754 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd71815d680 con 0x7fd71815bde0 2023-11-26T07:12:11.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.859+0000 7fd706ffd700 1 -- 172.21.15.2:0/3862931754 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd7100127c0 con 0x7fd71815bde0 2023-11-26T07:12:11.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.859+0000 7fd706ffd700 1 --2- 172.21.15.2:0/3862931754 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd6f806aed0 0x7fd6f806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:11.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.859+0000 7fd706ffd700 1 -- 172.21.15.2:0/3862931754 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd710089d50 con 0x7fd71815bde0 2023-11-26T07:12:11.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.859+0000 7fd71659c700 1 --2- 172.21.15.2:0/3862931754 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd6f806aed0 0x7fd6f806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:11.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.860+0000 7fd71659c700 1 --2- 172.21.15.2:0/3862931754 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd6f806aed0 0x7fd6f806d390 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd70c00a950 tx=0x7fd70c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:11.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:11.864+0000 7fd706ffd700 1 -- 172.21.15.2:0/3862931754 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd710054df0 con 0x7fd71815bde0 2023-11-26T07:12:12.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.064+0000 7fd71ce1e700 1 -- 172.21.15.2:0/3862931754 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd718075480 con 0x7fd71815bde0 2023-11-26T07:12:12.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.064+0000 7fd706ffd700 1 -- 172.21.15.2:0/3862931754 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd710016020 con 0x7fd71815bde0 2023-11-26T07:12:12.066 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-26T07:12:12.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.066+0000 7fd71ce1e700 1 -- 172.21.15.2:0/3862931754 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd6f806aed0 msgr2=0x7fd6f806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:12.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.066+0000 7fd71ce1e700 1 --2- 172.21.15.2:0/3862931754 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd6f806aed0 0x7fd6f806d390 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd70c00a950 tx=0x7fd70c008040 comp rx=0 tx=0).stop 2023-11-26T07:12:12.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.066+0000 7fd71ce1e700 1 -- 172.21.15.2:0/3862931754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd71815bde0 msgr2=0x7fd7180b17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:12.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.066+0000 7fd71ce1e700 1 --2- 172.21.15.2:0/3862931754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd71815bde0 0x7fd7180b17c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd71000cc10 tx=0x7fd71000a060 comp rx=0 tx=0).stop 2023-11-26T07:12:12.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.066+0000 7fd71ce1e700 1 -- 172.21.15.2:0/3862931754 shutdown_connections 2023-11-26T07:12:12.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.066+0000 7fd71ce1e700 1 --2- 172.21.15.2:0/3862931754 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd6f806aed0 0x7fd6f806d390 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:12.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.066+0000 7fd71ce1e700 1 --2- 172.21.15.2:0/3862931754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd71815bde0 0x7fd7180b17c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:12.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.066+0000 7fd71ce1e700 1 --2- 172.21.15.2:0/3862931754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7180ce5c0 0x7fd7181f1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:12.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.066+0000 7fd71ce1e700 1 --2- 172.21.15.2:0/3862931754 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7180cf2b0 0x7fd7180b1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:12.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.066+0000 7fd71ce1e700 1 -- 172.21.15.2:0/3862931754 >> 172.21.15.2:0/3862931754 conn(0x7fd7180b3720 msgr2=0x7fd7180b04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:12.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.066+0000 7fd71ce1e700 1 -- 172.21.15.2:0/3862931754 shutdown_connections 2023-11-26T07:12:12.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.066+0000 7fd71ce1e700 1 -- 172.21.15.2:0/3862931754 wait complete. 2023-11-26T07:12:12.080 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:12:12.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.206+0000 7fc82b099700 1 Processor -- start 2023-11-26T07:12:12.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.206+0000 7fc82b099700 1 -- start start 2023-11-26T07:12:12.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.207+0000 7fc82b099700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8240b4150 0x7fc82406de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:12.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.207+0000 7fc82b099700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc824071f50 con 0x7fc8240b5ab0 2023-11-26T07:12:12.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.207+0000 7fc82b099700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc824072230 con 0x7fc82406b620 2023-11-26T07:12:12.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.207+0000 7fc82b099700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc824072510 con 0x7fc8240b4150 2023-11-26T07:12:12.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.207+0000 7fc829636700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc8240b5ab0 0x7fc82406e390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59660/0 (socket says 172.21.15.2:59660) 2023-11-26T07:12:12.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.207+0000 7fc829636700 1 -- 172.21.15.2:0/1944611673 learned_addr learned my addr 172.21.15.2:0/1944611673 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:12.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.208+0000 7fc823fff700 1 --2- 172.21.15.2:0/1944611673 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8240b4150 0x7fc82406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:12.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.208+0000 7fc8237fe700 1 -- 172.21.15.2:0/1944611673 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 838445601 0 0) 0x7fc824071f50 con 0x7fc8240b5ab0 2023-11-26T07:12:12.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.208+0000 7fc8237fe700 1 -- 172.21.15.2:0/1944611673 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8140035b0 con 0x7fc8240b5ab0 2023-11-26T07:12:12.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.208+0000 7fc8237fe700 1 -- 172.21.15.2:0/1944611673 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3318586037 0 0) 0x7fc824072230 con 0x7fc82406b620 2023-11-26T07:12:12.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.208+0000 7fc8237fe700 1 -- 172.21.15.2:0/1944611673 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc824071f50 con 0x7fc82406b620 2023-11-26T07:12:12.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.208+0000 7fc823fff700 1 -- 172.21.15.2:0/1944611673 >> v1:172.21.15.192:6789/0 conn(0x7fc82406b620 legacy=0x7fc8240b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:12.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.208+0000 7fc823fff700 1 -- 172.21.15.2:0/1944611673 >> v1:172.21.15.2:6789/0 conn(0x7fc8240b5ab0 legacy=0x7fc82406e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:12.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.208+0000 7fc823fff700 1 -- 172.21.15.2:0/1944611673 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8240727f0 con 0x7fc8240b4150 2023-11-26T07:12:12.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.208+0000 7fc823fff700 1 --2- 172.21.15.2:0/1944611673 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8240b4150 0x7fc82406de50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc810009870 tx=0x7fc810009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62b3a4767517580 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:12.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.208+0000 7fc8237fe700 1 -- 172.21.15.2:0/1944611673 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc810011830 con 0x7fc8240b4150 2023-11-26T07:12:12.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.208+0000 7fc8237fe700 1 -- 172.21.15.2:0/1944611673 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc810011990 con 0x7fc8240b4150 2023-11-26T07:12:12.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.208+0000 7fc8237fe700 1 -- 172.21.15.2:0/1944611673 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc810011d20 con 0x7fc8240b4150 2023-11-26T07:12:12.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.209+0000 7fc82b099700 1 -- 172.21.15.2:0/1944611673 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8240b4150 msgr2=0x7fc82406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:12.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.209+0000 7fc82b099700 1 --2- 172.21.15.2:0/1944611673 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8240b4150 0x7fc82406de50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc810009870 tx=0x7fc810009b80 comp rx=0 tx=0).stop 2023-11-26T07:12:12.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.209+0000 7fc82b099700 1 -- 172.21.15.2:0/1944611673 shutdown_connections 2023-11-26T07:12:12.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.209+0000 7fc82b099700 1 --2- 172.21.15.2:0/1944611673 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8240b4150 0x7fc82406de50 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:12.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.209+0000 7fc82b099700 1 -- 172.21.15.2:0/1944611673 >> 172.21.15.2:0/1944611673 conn(0x7fc8240b2740 msgr2=0x7fc8240b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:12.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.209+0000 7fc82b099700 1 -- 172.21.15.2:0/1944611673 shutdown_connections 2023-11-26T07:12:12.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.209+0000 7fc82b099700 1 -- 172.21.15.2:0/1944611673 wait complete. 2023-11-26T07:12:12.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.211+0000 7fc82b099700 1 Processor -- start 2023-11-26T07:12:12.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.211+0000 7fc82b099700 1 -- start start 2023-11-26T07:12:12.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.212+0000 7fc82b099700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc82406b620 0x7fc82406dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:12.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.212+0000 7fc82b099700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8240b4150 0x7fc8241e4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:12.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.212+0000 7fc82b099700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8240b5ab0 0x7fc8240c7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:12.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.212+0000 7fc82b099700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8241e9990 con 0x7fc8240b4150 2023-11-26T07:12:12.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.212+0000 7fc82b099700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82406e450 con 0x7fc8240b5ab0 2023-11-26T07:12:12.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.212+0000 7fc82b099700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc82406e730 con 0x7fc82406b620 2023-11-26T07:12:12.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.212+0000 7fc823fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8240b4150 0x7fc8241e4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:12.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.212+0000 7fc823fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8240b4150 0x7fc8241e4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40222/0 (socket says 172.21.15.2:40222) 2023-11-26T07:12:12.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.212+0000 7fc823fff700 1 -- 172.21.15.2:0/2979220743 learned_addr learned my addr 172.21.15.2:0/2979220743 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:12.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.212+0000 7fc828e35700 1 --2- 172.21.15.2:0/2979220743 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc82406b620 0x7fc82406dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:12.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.212+0000 7fc829636700 1 --2- 172.21.15.2:0/2979220743 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8240b5ab0 0x7fc8240c7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:12.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.212+0000 7fc823fff700 1 -- 172.21.15.2:0/2979220743 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc82406b620 msgr2=0x7fc82406dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:12.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.212+0000 7fc823fff700 1 --2- 172.21.15.2:0/2979220743 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc82406b620 0x7fc82406dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:12.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.212+0000 7fc823fff700 1 -- 172.21.15.2:0/2979220743 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8240b5ab0 msgr2=0x7fc8240c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:12.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.212+0000 7fc823fff700 1 --2- 172.21.15.2:0/2979220743 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8240b5ab0 0x7fc8240c7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:12.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.212+0000 7fc823fff700 1 -- 172.21.15.2:0/2979220743 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8100094a0 con 0x7fc8240b4150 2023-11-26T07:12:12.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.212+0000 7fc823fff700 1 --2- 172.21.15.2:0/2979220743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8240b4150 0x7fc8241e4830 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc8100090b0 tx=0x7fc810004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:12.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.213+0000 7fc8217fa700 1 -- 172.21.15.2:0/2979220743 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81001a6e0 con 0x7fc8240b4150 2023-11-26T07:12:12.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.213+0000 7fc8217fa700 1 -- 172.21.15.2:0/2979220743 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81001a840 con 0x7fc8240b4150 2023-11-26T07:12:12.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.213+0000 7fc82b099700 1 -- 172.21.15.2:0/2979220743 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc82406ea10 con 0x7fc8240b4150 2023-11-26T07:12:12.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.213+0000 7fc8217fa700 1 -- 172.21.15.2:0/2979220743 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81001abb0 con 0x7fc8240b4150 2023-11-26T07:12:12.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.213+0000 7fc82b099700 1 -- 172.21.15.2:0/2979220743 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc82406efd0 con 0x7fc8240b4150 2023-11-26T07:12:12.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.214+0000 7fc82b099700 1 -- 172.21.15.2:0/2979220743 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc82406f160 con 0x7fc8240b4150 2023-11-26T07:12:12.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.214+0000 7fc8217fa700 1 -- 172.21.15.2:0/2979220743 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc810022070 con 0x7fc8240b4150 2023-11-26T07:12:12.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.215+0000 7fc8217fa700 1 --2- 172.21.15.2:0/2979220743 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc80806aed0 0x7fc80806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:12.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.215+0000 7fc8217fa700 1 -- 172.21.15.2:0/2979220743 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc81008a720 con 0x7fc8240b4150 2023-11-26T07:12:12.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.215+0000 7fc828e35700 1 --2- 172.21.15.2:0/2979220743 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc80806aed0 0x7fc80806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:12.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.215+0000 7fc828e35700 1 --2- 172.21.15.2:0/2979220743 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc80806aed0 0x7fc80806d390 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc8180011e0 tx=0x7fc818009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:12.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.219+0000 7fc8217fa700 1 -- 172.21.15.2:0/2979220743 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc8100558f0 con 0x7fc8240b4150 2023-11-26T07:12:12.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.422+0000 7fc82b099700 1 -- 172.21.15.2:0/2979220743 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc824075480 con 0x7fc8240b4150 2023-11-26T07:12:12.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.422+0000 7fc8217fa700 1 -- 172.21.15.2:0/2979220743 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc8100290a0 con 0x7fc8240b4150 2023-11-26T07:12:12.424 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-26T07:12:12.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.424+0000 7fc82b099700 1 -- 172.21.15.2:0/2979220743 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc80806aed0 msgr2=0x7fc80806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:12.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.424+0000 7fc82b099700 1 --2- 172.21.15.2:0/2979220743 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc80806aed0 0x7fc80806d390 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc8180011e0 tx=0x7fc818009040 comp rx=0 tx=0).stop 2023-11-26T07:12:12.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.424+0000 7fc82b099700 1 -- 172.21.15.2:0/2979220743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8240b4150 msgr2=0x7fc8241e4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:12.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.424+0000 7fc82b099700 1 --2- 172.21.15.2:0/2979220743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8240b4150 0x7fc8241e4830 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc8100090b0 tx=0x7fc810004750 comp rx=0 tx=0).stop 2023-11-26T07:12:12.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.424+0000 7fc82b099700 1 -- 172.21.15.2:0/2979220743 shutdown_connections 2023-11-26T07:12:12.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.424+0000 7fc82b099700 1 --2- 172.21.15.2:0/2979220743 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc80806aed0 0x7fc80806d390 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:12.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.424+0000 7fc82b099700 1 --2- 172.21.15.2:0/2979220743 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8240b5ab0 0x7fc8240c7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:12.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.424+0000 7fc82b099700 1 --2- 172.21.15.2:0/2979220743 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc82406b620 0x7fc82406dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:12.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.424+0000 7fc82b099700 1 --2- 172.21.15.2:0/2979220743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8240b4150 0x7fc8241e4830 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:12.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.424+0000 7fc82b099700 1 -- 172.21.15.2:0/2979220743 >> 172.21.15.2:0/2979220743 conn(0x7fc8240b2740 msgr2=0x7fc8240af0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:12.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.424+0000 7fc82b099700 1 -- 172.21.15.2:0/2979220743 shutdown_connections 2023-11-26T07:12:12.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.425+0000 7fc82b099700 1 -- 172.21.15.2:0/2979220743 wait complete. 2023-11-26T07:12:12.439 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-26T07:12:12.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.562+0000 7f6f08909700 1 Processor -- start 2023-11-26T07:12:12.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.562+0000 7f6f08909700 1 -- start start 2023-11-26T07:12:12.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.563+0000 7f6f08909700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f041448b0 0x7f6f0406ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:12.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.563+0000 7f6f08909700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6f040b44c0 0x7f6f0406f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:12.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.563+0000 7f6f08909700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f04144c90 con 0x7f6f0406f7c0 2023-11-26T07:12:12.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.563+0000 7f6f08909700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f0406fc50 con 0x7f6f040b44c0 2023-11-26T07:12:12.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.563+0000 7f6f08909700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f040b4c80 con 0x7f6f041448b0 2023-11-26T07:12:12.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.563+0000 7f6f01d9b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6f040b44c0 0x7f6f0406f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:12.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.564+0000 7f6f01d9b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6f040b44c0 0x7f6f0406f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40230/0 (socket says 172.21.15.2:40230) 2023-11-26T07:12:12.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.564+0000 7f6f01d9b700 1 -- 172.21.15.2:0/1376046212 learned_addr learned my addr 172.21.15.2:0/1376046212 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:12.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.564+0000 7f6f0259c700 1 --2- 172.21.15.2:0/1376046212 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f041448b0 0x7f6f0406ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:12.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.564+0000 7f6f01d9b700 1 -- 172.21.15.2:0/1376046212 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f041448b0 msgr2=0x7f6f0406ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:12.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.564+0000 7f6f01d9b700 1 --2- 172.21.15.2:0/1376046212 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f041448b0 0x7f6f0406ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:12.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.564+0000 7f6f01d9b700 1 -- 172.21.15.2:0/1376046212 >> v1:172.21.15.192:6789/0 conn(0x7f6f0406f7c0 legacy=0x7f6f0406db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:12.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.564+0000 7f6f01d9b700 1 -- 172.21.15.2:0/1376046212 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f040b4f60 con 0x7f6f040b44c0 2023-11-26T07:12:12.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.564+0000 7f6f01d9b700 1 --2- 172.21.15.2:0/1376046212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f040b44c0 0x7f6f0406f280 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6ef40098f0 tx=0x7f6ef4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a901fe2cdfcfc0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:12.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.564+0000 7f6f0159a700 1 -- 172.21.15.2:0/1376046212 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef400b8a0 con 0x7f6f040b44c0 2023-11-26T07:12:12.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.564+0000 7f6f0159a700 1 -- 172.21.15.2:0/1376046212 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef400ba00 con 0x7f6f040b44c0 2023-11-26T07:12:12.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.564+0000 7f6f0159a700 1 -- 172.21.15.2:0/1376046212 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef400bd90 con 0x7f6f040b44c0 2023-11-26T07:12:12.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.565+0000 7f6f08909700 1 -- 172.21.15.2:0/1376046212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f040b44c0 msgr2=0x7f6f0406f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:12.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.565+0000 7f6f08909700 1 --2- 172.21.15.2:0/1376046212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f040b44c0 0x7f6f0406f280 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6ef40098f0 tx=0x7f6ef4009c00 comp rx=0 tx=0).stop 2023-11-26T07:12:12.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.565+0000 7f6f08909700 1 -- 172.21.15.2:0/1376046212 shutdown_connections 2023-11-26T07:12:12.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.565+0000 7f6f08909700 1 --2- 172.21.15.2:0/1376046212 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f041448b0 0x7f6f0406ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:12.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.565+0000 7f6f08909700 1 --2- 172.21.15.2:0/1376046212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f040b44c0 0x7f6f0406f280 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:12.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.565+0000 7f6f08909700 1 -- 172.21.15.2:0/1376046212 >> 172.21.15.2:0/1376046212 conn(0x7f6f040d0bc0 msgr2=0x7f6f040d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:12.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.565+0000 7f6f08909700 1 -- 172.21.15.2:0/1376046212 shutdown_connections 2023-11-26T07:12:12.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.565+0000 7f6f08909700 1 -- 172.21.15.2:0/1376046212 wait complete. 2023-11-26T07:12:12.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.566+0000 7f6f08909700 1 Processor -- start 2023-11-26T07:12:12.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.566+0000 7f6f08909700 1 -- start start 2023-11-26T07:12:12.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.567+0000 7f6f08909700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f0406f7c0 0x7f6f0415d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:12.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.567+0000 7f6f08909700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f040b44c0 0x7f6f0415ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:12.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.567+0000 7f6f08909700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f041448b0 0x7f6f0413f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:12.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.567+0000 7f6f08909700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f040cc440 con 0x7f6f0406f7c0 2023-11-26T07:12:12.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.567+0000 7f6f08909700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f041f4e10 con 0x7f6f041448b0 2023-11-26T07:12:12.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.567+0000 7f6f08909700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0415d560 con 0x7f6f040b44c0 2023-11-26T07:12:12.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.567+0000 7f6f0259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f0406f7c0 0x7f6f0415d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:12.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.567+0000 7f6f0259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f0406f7c0 0x7f6f0415d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40234/0 (socket says 172.21.15.2:40234) 2023-11-26T07:12:12.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.567+0000 7f6f0259c700 1 -- 172.21.15.2:0/2328468730 learned_addr learned my addr 172.21.15.2:0/2328468730 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:12.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.567+0000 7f6f01d9b700 1 --2- 172.21.15.2:0/2328468730 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f040b44c0 0x7f6f0415ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:12.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.567+0000 7f6f02d9d700 1 --2- 172.21.15.2:0/2328468730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f041448b0 0x7f6f0413f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:12.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.567+0000 7f6f0259c700 1 -- 172.21.15.2:0/2328468730 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f040b44c0 msgr2=0x7f6f0415ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:12.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.567+0000 7f6f0259c700 1 --2- 172.21.15.2:0/2328468730 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f040b44c0 0x7f6f0415ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:12.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.567+0000 7f6f0259c700 1 -- 172.21.15.2:0/2328468730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f041448b0 msgr2=0x7f6f0413f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:12.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.567+0000 7f6f0259c700 1 --2- 172.21.15.2:0/2328468730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f041448b0 0x7f6f0413f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:12.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.567+0000 7f6f0259c700 1 -- 172.21.15.2:0/2328468730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef4009550 con 0x7f6f0406f7c0 2023-11-26T07:12:12.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.567+0000 7f6f02d9d700 1 --2- 172.21.15.2:0/2328468730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f041448b0 0x7f6f0413f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:12:12.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.567+0000 7f6f0259c700 1 --2- 172.21.15.2:0/2328468730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f0406f7c0 0x7f6f0415d9f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6ef800d830 tx=0x7f6ef800dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:12.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.568+0000 7f6ef2ffd700 1 -- 172.21.15.2:0/2328468730 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef80125f0 con 0x7f6f0406f7c0 2023-11-26T07:12:12.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.568+0000 7f6ef2ffd700 1 -- 172.21.15.2:0/2328468730 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef8012750 con 0x7f6f0406f7c0 2023-11-26T07:12:12.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.568+0000 7f6ef2ffd700 1 -- 172.21.15.2:0/2328468730 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef8012b00 con 0x7f6f0406f7c0 2023-11-26T07:12:12.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.568+0000 7f6f08909700 1 -- 172.21.15.2:0/2328468730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f0415df30 con 0x7f6f0406f7c0 2023-11-26T07:12:12.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.568+0000 7f6f08909700 1 -- 172.21.15.2:0/2328468730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f0415cc30 con 0x7f6f0406f7c0 2023-11-26T07:12:12.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.569+0000 7f6f08909700 1 -- 172.21.15.2:0/2328468730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f04068670 con 0x7f6f0406f7c0 2023-11-26T07:12:12.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.569+0000 7f6ef2ffd700 1 -- 172.21.15.2:0/2328468730 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6ef8012c60 con 0x7f6f0406f7c0 2023-11-26T07:12:12.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.569+0000 7f6ef2ffd700 1 --2- 172.21.15.2:0/2328468730 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6ee406aed0 0x7f6ee406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:12.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.570+0000 7f6ef2ffd700 1 -- 172.21.15.2:0/2328468730 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ef80899b0 con 0x7f6f0406f7c0 2023-11-26T07:12:12.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.570+0000 7f6f01d9b700 1 --2- 172.21.15.2:0/2328468730 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6ee406aed0 0x7f6ee406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:12.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.570+0000 7f6f01d9b700 1 --2- 172.21.15.2:0/2328468730 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6ee406aed0 0x7f6ee406d390 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4000c00 tx=0x7f6ef4008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:12.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.574+0000 7f6ef2ffd700 1 -- 172.21.15.2:0/2328468730 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6ef8054a60 con 0x7f6f0406f7c0 2023-11-26T07:12:12.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.792+0000 7f6f08909700 1 -- 172.21.15.2:0/2328468730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6f040b1900 con 0x7f6f0406f7c0 2023-11-26T07:12:12.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.792+0000 7f6ef2ffd700 1 -- 172.21.15.2:0/2328468730 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6ef8058080 con 0x7f6f0406f7c0 2023-11-26T07:12:12.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.795+0000 7f6f08909700 1 -- 172.21.15.2:0/2328468730 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6ee406aed0 msgr2=0x7f6ee406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:12.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.795+0000 7f6f08909700 1 --2- 172.21.15.2:0/2328468730 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6ee406aed0 0x7f6ee406d390 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4000c00 tx=0x7f6ef4008030 comp rx=0 tx=0).stop 2023-11-26T07:12:12.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.795+0000 7f6f08909700 1 -- 172.21.15.2:0/2328468730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f0406f7c0 msgr2=0x7f6f0415d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:12.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.795+0000 7f6f08909700 1 --2- 172.21.15.2:0/2328468730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f0406f7c0 0x7f6f0415d9f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6ef800d830 tx=0x7f6ef800dbf0 comp rx=0 tx=0).stop 2023-11-26T07:12:12.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.795+0000 7f6f08909700 1 -- 172.21.15.2:0/2328468730 shutdown_connections 2023-11-26T07:12:12.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.795+0000 7f6f08909700 1 --2- 172.21.15.2:0/2328468730 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6ee406aed0 0x7f6ee406d390 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:12.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.795+0000 7f6f08909700 1 --2- 172.21.15.2:0/2328468730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f041448b0 0x7f6f0413f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:12.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.795+0000 7f6f08909700 1 --2- 172.21.15.2:0/2328468730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f0406f7c0 0x7f6f0415d9f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:12.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.795+0000 7f6f08909700 1 --2- 172.21.15.2:0/2328468730 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f040b44c0 0x7f6f0415ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:12.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.795+0000 7f6f08909700 1 -- 172.21.15.2:0/2328468730 >> 172.21.15.2:0/2328468730 conn(0x7f6f040d0bc0 msgr2=0x7f6f040d01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:12.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.795+0000 7f6f08909700 1 -- 172.21.15.2:0/2328468730 shutdown_connections 2023-11-26T07:12:12.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:12.795+0000 7f6f08909700 1 -- 172.21.15.2:0/2328468730 wait complete. 2023-11-26T07:12:12.798 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2023-11-26T07:12:12.809 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-11-26T07:12:12.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:12.809 DEBUG:teuthology.orchestra.run.smithi002:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-11-26T07:12:12.858 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2023-11-26T07:12:12.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:12.858 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-26T07:12:12.875 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:12:12.875 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:12.896 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:12:12.896 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:12.956 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:12:12.956 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:13.016 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:12:13.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.139+0000 7fe0b3f00700 1 Processor -- start 2023-11-26T07:12:13.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.139+0000 7fe0b3f00700 1 -- start start 2023-11-26T07:12:13.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.140+0000 7fe0b3f00700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0ac15bde0 0x7fe0ac15c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:13.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.140+0000 7fe0b3f00700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe0ac0ce5c0 0x7fe0ac0cea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:13.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.140+0000 7fe0b3f00700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0ac0d0a90 con 0x7fe0ac0cf2b0 2023-11-26T07:12:13.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.140+0000 7fe0b3f00700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0ac0cef90 con 0x7fe0ac0ce5c0 2023-11-26T07:12:13.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.140+0000 7fe0b3f00700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac06ee10 con 0x7fe0ac15bde0 2023-11-26T07:12:13.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.140+0000 7fe0b249d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe0ac0ce5c0 0x7fe0ac0cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:13.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.140+0000 7fe0b249d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe0ac0ce5c0 0x7fe0ac0cea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40246/0 (socket says 172.21.15.2:40246) 2023-11-26T07:12:13.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.140+0000 7fe0b249d700 1 -- 172.21.15.2:0/4118487084 learned_addr learned my addr 172.21.15.2:0/4118487084 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:13.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.140+0000 7fe0b1c9c700 1 --2- 172.21.15.2:0/4118487084 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0ac15bde0 0x7fe0ac15c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:13.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.140+0000 7fe0b249d700 1 -- 172.21.15.2:0/4118487084 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0ac15bde0 msgr2=0x7fe0ac15c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:13.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.140+0000 7fe0b249d700 1 --2- 172.21.15.2:0/4118487084 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0ac15bde0 0x7fe0ac15c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:13.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.140+0000 7fe0b249d700 1 -- 172.21.15.2:0/4118487084 >> v1:172.21.15.192:6789/0 conn(0x7fe0ac0cf2b0 legacy=0x7fe0ac0d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:13.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.140+0000 7fe0b249d700 1 -- 172.21.15.2:0/4118487084 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ac06f0f0 con 0x7fe0ac0ce5c0 2023-11-26T07:12:13.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.140+0000 7fe0b249d700 1 --2- 172.21.15.2:0/4118487084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0ac0ce5c0 0x7fe0ac0cea50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4009e50 tx=0x7fe0a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aea71ed101169bc1 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:13.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.141+0000 7fe0b0c9a700 1 -- 172.21.15.2:0/4118487084 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a400e070 con 0x7fe0ac0ce5c0 2023-11-26T07:12:13.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.141+0000 7fe0b0c9a700 1 -- 172.21.15.2:0/4118487084 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a400b9c0 con 0x7fe0ac0ce5c0 2023-11-26T07:12:13.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.141+0000 7fe0b0c9a700 1 -- 172.21.15.2:0/4118487084 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a400bd70 con 0x7fe0ac0ce5c0 2023-11-26T07:12:13.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.141+0000 7fe0b3f00700 1 -- 172.21.15.2:0/4118487084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0ac0ce5c0 msgr2=0x7fe0ac0cea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:13.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.141+0000 7fe0b3f00700 1 --2- 172.21.15.2:0/4118487084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0ac0ce5c0 0x7fe0ac0cea50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4009e50 tx=0x7fe0a400b330 comp rx=0 tx=0).stop 2023-11-26T07:12:13.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.141+0000 7fe0b3f00700 1 -- 172.21.15.2:0/4118487084 shutdown_connections 2023-11-26T07:12:13.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.141+0000 7fe0b3f00700 1 --2- 172.21.15.2:0/4118487084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0ac0ce5c0 0x7fe0ac0cea50 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:13.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.141+0000 7fe0b3f00700 1 --2- 172.21.15.2:0/4118487084 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0ac15bde0 0x7fe0ac15c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:13.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.141+0000 7fe0b3f00700 1 -- 172.21.15.2:0/4118487084 >> 172.21.15.2:0/4118487084 conn(0x7fe0ac0b3720 msgr2=0x7fe0ac0b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:13.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.141+0000 7fe0b3f00700 1 -- 172.21.15.2:0/4118487084 shutdown_connections 2023-11-26T07:12:13.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.141+0000 7fe0b3f00700 1 -- 172.21.15.2:0/4118487084 wait complete. 2023-11-26T07:12:13.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.142+0000 7fe0b3f00700 1 Processor -- start 2023-11-26T07:12:13.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.142+0000 7fe0b3f00700 1 -- start start 2023-11-26T07:12:13.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.143+0000 7fe0b3f00700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0ac0ce5c0 0x7fe0ac0c5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:13.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.143+0000 7fe0b3f00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0ac0cf2b0 0x7fe0ac0b1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:13.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.143+0000 7fe0b3f00700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0ac15bde0 0x7fe0ac1f0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:13.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.143+0000 7fe0b3f00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac15dab0 con 0x7fe0ac0cf2b0 2023-11-26T07:12:13.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.143+0000 7fe0b3f00700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac0b24d0 con 0x7fe0ac0ce5c0 2023-11-26T07:12:13.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.143+0000 7fe0b3f00700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac1f1210 con 0x7fe0ac15bde0 2023-11-26T07:12:13.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.143+0000 7fe0b149b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0ac0cf2b0 0x7fe0ac0b1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:13.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.143+0000 7fe0b149b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0ac0cf2b0 0x7fe0ac0b1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40250/0 (socket says 172.21.15.2:40250) 2023-11-26T07:12:13.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.143+0000 7fe0b149b700 1 -- 172.21.15.2:0/3710471742 learned_addr learned my addr 172.21.15.2:0/3710471742 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:13.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.143+0000 7fe0b249d700 1 --2- 172.21.15.2:0/3710471742 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0ac15bde0 0x7fe0ac1f0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:13.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.143+0000 7fe0b1c9c700 1 --2- 172.21.15.2:0/3710471742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0ac0ce5c0 0x7fe0ac0c5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:13.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.144+0000 7fe0b149b700 1 -- 172.21.15.2:0/3710471742 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0ac15bde0 msgr2=0x7fe0ac1f0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:13.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.144+0000 7fe0b149b700 1 --2- 172.21.15.2:0/3710471742 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0ac15bde0 0x7fe0ac1f0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:13.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.144+0000 7fe0b149b700 1 -- 172.21.15.2:0/3710471742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0ac0ce5c0 msgr2=0x7fe0ac0c5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:13.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.144+0000 7fe0b149b700 1 --2- 172.21.15.2:0/3710471742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0ac0ce5c0 0x7fe0ac0c5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:13.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.144+0000 7fe0b149b700 1 -- 172.21.15.2:0/3710471742 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a4009b30 con 0x7fe0ac0cf2b0 2023-11-26T07:12:13.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.144+0000 7fe0b149b700 1 --2- 172.21.15.2:0/3710471742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0ac0cf2b0 0x7fe0ac0b1f90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe09c00c4b0 tx=0x7fe09c00c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:13.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.144+0000 7fe0a27fc700 1 -- 172.21.15.2:0/3710471742 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c0052d0 con 0x7fe0ac0cf2b0 2023-11-26T07:12:13.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.144+0000 7fe0a27fc700 1 -- 172.21.15.2:0/3710471742 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09c005430 con 0x7fe0ac0cf2b0 2023-11-26T07:12:13.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.144+0000 7fe0b3f00700 1 -- 172.21.15.2:0/3710471742 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0ac15dce0 con 0x7fe0ac0cf2b0 2023-11-26T07:12:13.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.144+0000 7fe0a27fc700 1 -- 172.21.15.2:0/3710471742 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c0038c0 con 0x7fe0ac0cf2b0 2023-11-26T07:12:13.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.144+0000 7fe0b3f00700 1 -- 172.21.15.2:0/3710471742 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0ac15e2a0 con 0x7fe0ac0cf2b0 2023-11-26T07:12:13.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.145+0000 7fe0b3f00700 1 -- 172.21.15.2:0/3710471742 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0ac068670 con 0x7fe0ac0cf2b0 2023-11-26T07:12:13.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.145+0000 7fe0a27fc700 1 -- 172.21.15.2:0/3710471742 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe09c003a20 con 0x7fe0ac0cf2b0 2023-11-26T07:12:13.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.146+0000 7fe0a27fc700 1 --2- 172.21.15.2:0/3710471742 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe09006aed0 0x7fe09006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:13.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.146+0000 7fe0a27fc700 1 -- 172.21.15.2:0/3710471742 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe09c088960 con 0x7fe0ac0cf2b0 2023-11-26T07:12:13.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.146+0000 7fe0b1c9c700 1 --2- 172.21.15.2:0/3710471742 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe09006aed0 0x7fe09006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:13.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.147+0000 7fe0b1c9c700 1 --2- 172.21.15.2:0/3710471742 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe09006aed0 0x7fe09006d390 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8006b20 tx=0x7fe0a8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:13.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.151+0000 7fe0a27fc700 1 -- 172.21.15.2:0/3710471742 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe09c053a10 con 0x7fe0ac0cf2b0 2023-11-26T07:12:13.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.353+0000 7fe0b3f00700 1 -- 172.21.15.2:0/3710471742 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0ac0b2700 con 0x7fe0ac0cf2b0 2023-11-26T07:12:13.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.354+0000 7fe0a27fc700 1 -- 172.21.15.2:0/3710471742 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16457 (secure 0 0 0) 0x7fe09c017090 con 0x7fe0ac0cf2b0 2023-11-26T07:12:13.356 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:12:13.356 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:11:35.634747+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:11:32.129474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:11:33.019837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:12:13.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.356+0000 7fe0b3f00700 1 -- 172.21.15.2:0/3710471742 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe09006aed0 msgr2=0x7fe09006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:13.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.356+0000 7fe0b3f00700 1 --2- 172.21.15.2:0/3710471742 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe09006aed0 0x7fe09006d390 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8006b20 tx=0x7fe0a8008040 comp rx=0 tx=0).stop 2023-11-26T07:12:13.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.356+0000 7fe0b3f00700 1 -- 172.21.15.2:0/3710471742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0ac0cf2b0 msgr2=0x7fe0ac0b1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:13.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.356+0000 7fe0b3f00700 1 --2- 172.21.15.2:0/3710471742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0ac0cf2b0 0x7fe0ac0b1f90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe09c00c4b0 tx=0x7fe09c00c7c0 comp rx=0 tx=0).stop 2023-11-26T07:12:13.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.356+0000 7fe0b3f00700 1 -- 172.21.15.2:0/3710471742 shutdown_connections 2023-11-26T07:12:13.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.356+0000 7fe0b3f00700 1 --2- 172.21.15.2:0/3710471742 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe09006aed0 0x7fe09006d390 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:13.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.356+0000 7fe0b3f00700 1 --2- 172.21.15.2:0/3710471742 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0ac15bde0 0x7fe0ac1f0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:13.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.356+0000 7fe0b3f00700 1 --2- 172.21.15.2:0/3710471742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0ac0ce5c0 0x7fe0ac0c5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:13.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.356+0000 7fe0b3f00700 1 --2- 172.21.15.2:0/3710471742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0ac0cf2b0 0x7fe0ac0b1f90 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:13.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.356+0000 7fe0b3f00700 1 -- 172.21.15.2:0/3710471742 >> 172.21.15.2:0/3710471742 conn(0x7fe0ac0b3720 msgr2=0x7fe0ac0af480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:13.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.356+0000 7fe0b3f00700 1 -- 172.21.15.2:0/3710471742 shutdown_connections 2023-11-26T07:12:13.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.356+0000 7fe0b3f00700 1 -- 172.21.15.2:0/3710471742 wait complete. 2023-11-26T07:12:13.370 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:11:28.205739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:11:32.129474+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:11:33.019837+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:12:13.371 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:12:13.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.496+0000 7feed784a700 1 Processor -- start 2023-11-26T07:12:13.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.496+0000 7feed784a700 1 -- start start 2023-11-26T07:12:13.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.497+0000 7feed784a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feed00b4150 0x7feed006de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:13.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.497+0000 7feed784a700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feed0071f50 con 0x7feed006b620 2023-11-26T07:12:13.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.498+0000 7feed55e6700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7feed006b620 0x7feed00b3a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59698/0 (socket says 172.21.15.2:59698) 2023-11-26T07:12:13.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.498+0000 7feed784a700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feed0072230 con 0x7feed00b5ab0 2023-11-26T07:12:13.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.498+0000 7feed55e6700 1 -- 172.21.15.2:0/1704607447 learned_addr learned my addr 172.21.15.2:0/1704607447 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:13.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.498+0000 7feed784a700 1 -- 172.21.15.2:0/1704607447 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed0072510 con 0x7feed00b4150 2023-11-26T07:12:13.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.498+0000 7feed4de5700 1 --2- 172.21.15.2:0/1704607447 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feed00b4150 0x7feed006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:13.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.498+0000 7feec7fff700 1 -- 172.21.15.2:0/1704607447 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1616268599 0 0) 0x7feed0071f50 con 0x7feed006b620 2023-11-26T07:12:13.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.498+0000 7feec7fff700 1 -- 172.21.15.2:0/1704607447 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feebc0035b0 con 0x7feed006b620 2023-11-26T07:12:13.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.498+0000 7feec7fff700 1 -- 172.21.15.2:0/1704607447 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1033375753 0 0) 0x7feed0072230 con 0x7feed00b5ab0 2023-11-26T07:12:13.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.498+0000 7feec7fff700 1 -- 172.21.15.2:0/1704607447 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feed0071f50 con 0x7feed00b5ab0 2023-11-26T07:12:13.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.498+0000 7feed4de5700 1 -- 172.21.15.2:0/1704607447 >> v1:172.21.15.192:6789/0 conn(0x7feed00b5ab0 legacy=0x7feed006e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:13.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.498+0000 7feed4de5700 1 -- 172.21.15.2:0/1704607447 >> v1:172.21.15.2:6789/0 conn(0x7feed006b620 legacy=0x7feed00b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:13.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.498+0000 7feed4de5700 1 -- 172.21.15.2:0/1704607447 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed00727f0 con 0x7feed00b4150 2023-11-26T07:12:13.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.498+0000 7feed4de5700 1 --2- 172.21.15.2:0/1704607447 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feed00b4150 0x7feed006de50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7feecc009870 tx=0x7feecc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb17a797cf9c591a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:13.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.498+0000 7feec7fff700 1 -- 172.21.15.2:0/1704607447 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feecc011830 con 0x7feed00b4150 2023-11-26T07:12:13.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.498+0000 7feec7fff700 1 -- 172.21.15.2:0/1704607447 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feecc011990 con 0x7feed00b4150 2023-11-26T07:12:13.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.498+0000 7feec7fff700 1 -- 172.21.15.2:0/1704607447 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feecc011d20 con 0x7feed00b4150 2023-11-26T07:12:13.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.499+0000 7feed784a700 1 -- 172.21.15.2:0/1704607447 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feed00b4150 msgr2=0x7feed006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:13.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.499+0000 7feed784a700 1 --2- 172.21.15.2:0/1704607447 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feed00b4150 0x7feed006de50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7feecc009870 tx=0x7feecc009b80 comp rx=0 tx=0).stop 2023-11-26T07:12:13.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.499+0000 7feed784a700 1 -- 172.21.15.2:0/1704607447 shutdown_connections 2023-11-26T07:12:13.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.499+0000 7feed784a700 1 --2- 172.21.15.2:0/1704607447 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feed00b4150 0x7feed006de50 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:13.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.499+0000 7feed784a700 1 -- 172.21.15.2:0/1704607447 >> 172.21.15.2:0/1704607447 conn(0x7feed00b2740 msgr2=0x7feed00b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:13.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.499+0000 7feed784a700 1 -- 172.21.15.2:0/1704607447 shutdown_connections 2023-11-26T07:12:13.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.499+0000 7feed784a700 1 -- 172.21.15.2:0/1704607447 wait complete. 2023-11-26T07:12:13.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.500+0000 7feed784a700 1 Processor -- start 2023-11-26T07:12:13.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.500+0000 7feed784a700 1 -- start start 2023-11-26T07:12:13.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.501+0000 7feed784a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feed006b620 0x7feed01453f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:13.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.501+0000 7feed784a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feed00b4150 0x7feed00cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:13.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.501+0000 7feed784a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feed00b5ab0 0x7feed00c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:13.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.501+0000 7feed784a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed0145930 con 0x7feed006b620 2023-11-26T07:12:13.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.501+0000 7feed784a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed00c7570 con 0x7feed00b5ab0 2023-11-26T07:12:13.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.501+0000 7feed784a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed00c7850 con 0x7feed00b4150 2023-11-26T07:12:13.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.501+0000 7feed55e6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feed006b620 0x7feed01453f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:13.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.501+0000 7feed55e6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feed006b620 0x7feed01453f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40262/0 (socket says 172.21.15.2:40262) 2023-11-26T07:12:13.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.501+0000 7feed55e6700 1 -- 172.21.15.2:0/1921631684 learned_addr learned my addr 172.21.15.2:0/1921631684 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:13.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.501+0000 7feed4de5700 1 --2- 172.21.15.2:0/1921631684 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feed00b4150 0x7feed00cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:13.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.501+0000 7feed5de7700 1 --2- 172.21.15.2:0/1921631684 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feed00b5ab0 0x7feed00c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:13.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.502+0000 7feed55e6700 1 -- 172.21.15.2:0/1921631684 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feed00b4150 msgr2=0x7feed00cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:13.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.502+0000 7feed55e6700 1 --2- 172.21.15.2:0/1921631684 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feed00b4150 0x7feed00cacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:13.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.502+0000 7feed55e6700 1 -- 172.21.15.2:0/1921631684 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feed00b5ab0 msgr2=0x7feed00c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:13.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.502+0000 7feed55e6700 1 --2- 172.21.15.2:0/1921631684 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feed00b5ab0 0x7feed00c6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:13.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.502+0000 7feed55e6700 1 -- 172.21.15.2:0/1921631684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feecc0094a0 con 0x7feed006b620 2023-11-26T07:12:13.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.502+0000 7feed55e6700 1 --2- 172.21.15.2:0/1921631684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feed006b620 0x7feed01453f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7feec000c6e0 tx=0x7feec000caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:13.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.502+0000 7feec5ffb700 1 -- 172.21.15.2:0/1921631684 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec0005d70 con 0x7feed006b620 2023-11-26T07:12:13.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.502+0000 7feec5ffb700 1 -- 172.21.15.2:0/1921631684 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec00070d0 con 0x7feed006b620 2023-11-26T07:12:13.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.502+0000 7feed784a700 1 -- 172.21.15.2:0/1921631684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feed00ca1e0 con 0x7feed006b620 2023-11-26T07:12:13.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.502+0000 7feec5ffb700 1 -- 172.21.15.2:0/1921631684 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec0007480 con 0x7feed006b620 2023-11-26T07:12:13.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.502+0000 7feed784a700 1 -- 172.21.15.2:0/1921631684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feed00ca7a0 con 0x7feed006b620 2023-11-26T07:12:13.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.503+0000 7feed784a700 1 -- 172.21.15.2:0/1921631684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feed00ca930 con 0x7feed006b620 2023-11-26T07:12:13.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.503+0000 7feec5ffb700 1 -- 172.21.15.2:0/1921631684 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feec00075e0 con 0x7feed006b620 2023-11-26T07:12:13.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.504+0000 7feec5ffb700 1 --2- 172.21.15.2:0/1921631684 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7feeb406aed0 0x7feeb406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:13.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.504+0000 7feec5ffb700 1 -- 172.21.15.2:0/1921631684 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feec0088bd0 con 0x7feed006b620 2023-11-26T07:12:13.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.504+0000 7feed4de5700 1 --2- 172.21.15.2:0/1921631684 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7feeb406aed0 0x7feeb406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:13.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.505+0000 7feed4de5700 1 --2- 172.21.15.2:0/1921631684 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7feeb406aed0 0x7feeb406d390 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7feecc0097c0 tx=0x7feecc01c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:13.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.509+0000 7feec5ffb700 1 -- 172.21.15.2:0/1921631684 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7feec0053c80 con 0x7feed006b620 2023-11-26T07:12:13.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.710+0000 7feed784a700 1 -- 172.21.15.2:0/1921631684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feed0075480 con 0x7feed006b620 2023-11-26T07:12:13.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.711+0000 7feec5ffb700 1 -- 172.21.15.2:0/1921631684 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7feec00170a0 con 0x7feed006b620 2023-11-26T07:12:13.713 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-26T07:12:13.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.713+0000 7feed784a700 1 -- 172.21.15.2:0/1921631684 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7feeb406aed0 msgr2=0x7feeb406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:13.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.713+0000 7feed784a700 1 --2- 172.21.15.2:0/1921631684 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7feeb406aed0 0x7feeb406d390 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7feecc0097c0 tx=0x7feecc01c040 comp rx=0 tx=0).stop 2023-11-26T07:12:13.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.713+0000 7feed784a700 1 -- 172.21.15.2:0/1921631684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feed006b620 msgr2=0x7feed01453f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:13.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.713+0000 7feed784a700 1 --2- 172.21.15.2:0/1921631684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feed006b620 0x7feed01453f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7feec000c6e0 tx=0x7feec000caa0 comp rx=0 tx=0).stop 2023-11-26T07:12:13.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.713+0000 7feed784a700 1 -- 172.21.15.2:0/1921631684 shutdown_connections 2023-11-26T07:12:13.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.713+0000 7feed784a700 1 --2- 172.21.15.2:0/1921631684 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7feeb406aed0 0x7feeb406d390 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:13.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.713+0000 7feed784a700 1 --2- 172.21.15.2:0/1921631684 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feed00b5ab0 0x7feed00c6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:13.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.713+0000 7feed784a700 1 --2- 172.21.15.2:0/1921631684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feed006b620 0x7feed01453f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:13.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.713+0000 7feed784a700 1 --2- 172.21.15.2:0/1921631684 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feed00b4150 0x7feed00cacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:13.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.713+0000 7feed784a700 1 -- 172.21.15.2:0/1921631684 >> 172.21.15.2:0/1921631684 conn(0x7feed00b2740 msgr2=0x7feed00b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:13.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.713+0000 7feed784a700 1 -- 172.21.15.2:0/1921631684 shutdown_connections 2023-11-26T07:12:13.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.713+0000 7feed784a700 1 -- 172.21.15.2:0/1921631684 wait complete. 2023-11-26T07:12:13.727 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:12:13.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.853+0000 7f366e264700 1 Processor -- start 2023-11-26T07:12:13.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.853+0000 7f366e264700 1 -- start start 2023-11-26T07:12:13.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.854+0000 7f366e264700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f366806b620 0x7f36680b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:13.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.854+0000 7f366e264700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36681629c0 con 0x7f36680b5ab0 2023-11-26T07:12:13.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.854+0000 7f366e264700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3668071f50 con 0x7f366806ee60 2023-11-26T07:12:13.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.854+0000 7f366e264700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3668072230 con 0x7f366806b620 2023-11-26T07:12:13.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.854+0000 7f36677fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f36680b5ab0 0x7f3668161ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59714/0 (socket says 172.21.15.2:59714) 2023-11-26T07:12:13.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.854+0000 7f36677fe700 1 -- 172.21.15.2:0/3074028129 learned_addr learned my addr 172.21.15.2:0/3074028129 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:13.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.854+0000 7f3667fff700 1 --2- 172.21.15.2:0/3074028129 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f366806b620 0x7f36680b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:13.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.854+0000 7f3666ffd700 1 -- 172.21.15.2:0/3074028129 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3196118826 0 0) 0x7f36681629c0 con 0x7f36680b5ab0 2023-11-26T07:12:13.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.854+0000 7f3666ffd700 1 -- 172.21.15.2:0/3074028129 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36540035b0 con 0x7f36680b5ab0 2023-11-26T07:12:13.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.855+0000 7f3666ffd700 1 -- 172.21.15.2:0/3074028129 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2753138921 0 0) 0x7f3668071f50 con 0x7f366806ee60 2023-11-26T07:12:13.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.855+0000 7f3666ffd700 1 -- 172.21.15.2:0/3074028129 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36681629c0 con 0x7f366806ee60 2023-11-26T07:12:13.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.855+0000 7f3667fff700 1 -- 172.21.15.2:0/3074028129 >> v1:172.21.15.192:6789/0 conn(0x7f366806ee60 legacy=0x7f36681622b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:13.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.855+0000 7f3667fff700 1 -- 172.21.15.2:0/3074028129 >> v1:172.21.15.2:6789/0 conn(0x7f36680b5ab0 legacy=0x7f3668161ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:13.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.855+0000 7f3666ffd700 1 -- 172.21.15.2:0/3074028129 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3971633860 0 0) 0x7f36540035b0 con 0x7f36680b5ab0 2023-11-26T07:12:13.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.855+0000 7f3667fff700 1 -- 172.21.15.2:0/3074028129 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3668072510 con 0x7f366806b620 2023-11-26T07:12:13.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.855+0000 7f3667fff700 1 --2- 172.21.15.2:0/3074028129 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f366806b620 0x7f36680b3a40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3650009870 tx=0x7f3650009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eab5cecfe165fb04 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:13.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.855+0000 7f3666ffd700 1 -- 172.21.15.2:0/3074028129 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3658001670 con 0x7f366806b620 2023-11-26T07:12:13.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.855+0000 7f3666ffd700 1 -- 172.21.15.2:0/3074028129 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3650004030 con 0x7f366806b620 2023-11-26T07:12:13.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.855+0000 7f3666ffd700 1 -- 172.21.15.2:0/3074028129 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36500043c0 con 0x7f366806b620 2023-11-26T07:12:13.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.856+0000 7f366e264700 1 -- 172.21.15.2:0/3074028129 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f366806b620 msgr2=0x7f36680b3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:13.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.856+0000 7f366e264700 1 --2- 172.21.15.2:0/3074028129 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f366806b620 0x7f36680b3a40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3650009870 tx=0x7f3650009b80 comp rx=0 tx=0).stop 2023-11-26T07:12:13.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.856+0000 7f366e264700 1 -- 172.21.15.2:0/3074028129 shutdown_connections 2023-11-26T07:12:13.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.856+0000 7f366e264700 1 --2- 172.21.15.2:0/3074028129 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f366806b620 0x7f36680b3a40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:13.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.856+0000 7f366e264700 1 -- 172.21.15.2:0/3074028129 >> 172.21.15.2:0/3074028129 conn(0x7f36680b2740 msgr2=0x7f36680b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:13.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.856+0000 7f366e264700 1 -- 172.21.15.2:0/3074028129 shutdown_connections 2023-11-26T07:12:13.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.856+0000 7f366e264700 1 -- 172.21.15.2:0/3074028129 wait complete. 2023-11-26T07:12:13.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.857+0000 7f366e264700 1 Processor -- start 2023-11-26T07:12:13.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.857+0000 7f366e264700 1 -- start start 2023-11-26T07:12:13.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.858+0000 7f366e264700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f366806b620 0x7f36681f6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:13.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.858+0000 7f366e264700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f366806ee60 0x7f36680c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:13.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.858+0000 7f366e264700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36680b5ab0 0x7f36680b1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:13.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.858+0000 7f366e264700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36680c67a0 con 0x7f36680b5ab0 2023-11-26T07:12:13.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.858+0000 7f366e264700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36680c6a80 con 0x7f366806ee60 2023-11-26T07:12:13.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.858+0000 7f366e264700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36680c6d60 con 0x7f366806b620 2023-11-26T07:12:13.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.858+0000 7f366c801700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36680b5ab0 0x7f36680b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:13.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.858+0000 7f366c801700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36680b5ab0 0x7f36680b1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40280/0 (socket says 172.21.15.2:40280) 2023-11-26T07:12:13.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.858+0000 7f366c801700 1 -- 172.21.15.2:0/1203456093 learned_addr learned my addr 172.21.15.2:0/1203456093 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:13.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.858+0000 7f36677fe700 1 --2- 172.21.15.2:0/1203456093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f366806ee60 0x7f36680c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:13.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.858+0000 7f3667fff700 1 --2- 172.21.15.2:0/1203456093 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f366806b620 0x7f36681f6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:13.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.858+0000 7f366c801700 1 -- 172.21.15.2:0/1203456093 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f366806b620 msgr2=0x7f36681f6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:13.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.858+0000 7f366c801700 1 --2- 172.21.15.2:0/1203456093 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f366806b620 0x7f36681f6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:13.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.858+0000 7f366c801700 1 -- 172.21.15.2:0/1203456093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f366806ee60 msgr2=0x7f36680c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:13.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.858+0000 7f366c801700 1 --2- 172.21.15.2:0/1203456093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f366806ee60 0x7f36680c83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:13.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.858+0000 7f366c801700 1 -- 172.21.15.2:0/1203456093 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36500094a0 con 0x7f36680b5ab0 2023-11-26T07:12:13.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.859+0000 7f366c801700 1 --2- 172.21.15.2:0/1203456093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36680b5ab0 0x7f36680b1310 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f366000cc50 tx=0x7f366000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:13.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.859+0000 7f3664ff9700 1 -- 172.21.15.2:0/1203456093 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3660003c00 con 0x7f36680b5ab0 2023-11-26T07:12:13.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.859+0000 7f3664ff9700 1 -- 172.21.15.2:0/1203456093 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3660003d60 con 0x7f36680b5ab0 2023-11-26T07:12:13.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.859+0000 7f366e264700 1 -- 172.21.15.2:0/1203456093 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36680c7040 con 0x7f36680b5ab0 2023-11-26T07:12:13.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.859+0000 7f3664ff9700 1 -- 172.21.15.2:0/1203456093 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366000aab0 con 0x7f36680b5ab0 2023-11-26T07:12:13.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.859+0000 7f366e264700 1 -- 172.21.15.2:0/1203456093 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36680c63c0 con 0x7f36680b5ab0 2023-11-26T07:12:13.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.860+0000 7f366e264700 1 -- 172.21.15.2:0/1203456093 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36680c6550 con 0x7f36680b5ab0 2023-11-26T07:12:13.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.860+0000 7f3664ff9700 1 -- 172.21.15.2:0/1203456093 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f366000ac10 con 0x7f36680b5ab0 2023-11-26T07:12:13.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.861+0000 7f3664ff9700 1 --2- 172.21.15.2:0/1203456093 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f364806aed0 0x7f364806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:13.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.861+0000 7f3664ff9700 1 -- 172.21.15.2:0/1203456093 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f36600895f0 con 0x7f36680b5ab0 2023-11-26T07:12:13.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.861+0000 7f3667fff700 1 --2- 172.21.15.2:0/1203456093 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f364806aed0 0x7f364806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:13.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.862+0000 7f3667fff700 1 --2- 172.21.15.2:0/1203456093 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f364806aed0 0x7f364806d390 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f36500090b0 tx=0x7f3650008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:13.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:13.865+0000 7f3664ff9700 1 -- 172.21.15.2:0/1203456093 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f36600546a0 con 0x7f36680b5ab0 2023-11-26T07:12:14.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.065+0000 7f366e264700 1 -- 172.21.15.2:0/1203456093 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f36681f3e60 con 0x7f36680b5ab0 2023-11-26T07:12:14.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.065+0000 7f3664ff9700 1 -- 172.21.15.2:0/1203456093 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3660057cc0 con 0x7f36680b5ab0 2023-11-26T07:12:14.067 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-26T07:12:14.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.067+0000 7f366e264700 1 -- 172.21.15.2:0/1203456093 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f364806aed0 msgr2=0x7f364806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:14.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.067+0000 7f366e264700 1 --2- 172.21.15.2:0/1203456093 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f364806aed0 0x7f364806d390 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f36500090b0 tx=0x7f3650008030 comp rx=0 tx=0).stop 2023-11-26T07:12:14.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.067+0000 7f366e264700 1 -- 172.21.15.2:0/1203456093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36680b5ab0 msgr2=0x7f36680b1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:14.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.067+0000 7f366e264700 1 --2- 172.21.15.2:0/1203456093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36680b5ab0 0x7f36680b1310 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f366000cc50 tx=0x7f366000cf60 comp rx=0 tx=0).stop 2023-11-26T07:12:14.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.067+0000 7f366e264700 1 -- 172.21.15.2:0/1203456093 shutdown_connections 2023-11-26T07:12:14.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.067+0000 7f366e264700 1 --2- 172.21.15.2:0/1203456093 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f364806aed0 0x7f364806d390 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:14.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.067+0000 7f366e264700 1 --2- 172.21.15.2:0/1203456093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36680b5ab0 0x7f36680b1310 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:14.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.067+0000 7f366e264700 1 --2- 172.21.15.2:0/1203456093 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f366806b620 0x7f36681f6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:14.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.067+0000 7f366e264700 1 --2- 172.21.15.2:0/1203456093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f366806ee60 0x7f36680c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:14.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.067+0000 7f366e264700 1 -- 172.21.15.2:0/1203456093 >> 172.21.15.2:0/1203456093 conn(0x7f36680b2740 msgr2=0x7f3668146e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:14.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.067+0000 7f366e264700 1 -- 172.21.15.2:0/1203456093 shutdown_connections 2023-11-26T07:12:14.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.067+0000 7f366e264700 1 -- 172.21.15.2:0/1203456093 wait complete. 2023-11-26T07:12:14.081 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:12:14.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.208+0000 7f61b5a76700 1 Processor -- start 2023-11-26T07:12:14.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.208+0000 7f61b5a76700 1 -- start start 2023-11-26T07:12:14.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.208+0000 7f61b5a76700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61b015e1e0 0x7f61b00b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:14.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.208+0000 7f61b5a76700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f61b00b5e40 0x7f61b015f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:14.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.208+0000 7f61b5a76700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61b006bb80 con 0x7f61b006b400 2023-11-26T07:12:14.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.208+0000 7f61b5a76700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61b006be20 con 0x7f61b00b5e40 2023-11-26T07:12:14.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.208+0000 7f61b5a76700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b006c100 con 0x7f61b015e1e0 2023-11-26T07:12:14.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.209+0000 7f61affff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f61b00b5e40 0x7f61b015f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:14.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.209+0000 7f61affff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f61b00b5e40 0x7f61b015f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40288/0 (socket says 172.21.15.2:40288) 2023-11-26T07:12:14.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.209+0000 7f61affff700 1 -- 172.21.15.2:0/3117906710 learned_addr learned my addr 172.21.15.2:0/3117906710 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:14.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.209+0000 7f61af7fe700 1 --2- 172.21.15.2:0/3117906710 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61b015e1e0 0x7f61b00b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:14.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.209+0000 7f61affff700 1 -- 172.21.15.2:0/3117906710 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61b015e1e0 msgr2=0x7f61b00b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:14.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.209+0000 7f61affff700 1 --2- 172.21.15.2:0/3117906710 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61b015e1e0 0x7f61b00b12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:14.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.209+0000 7f61affff700 1 -- 172.21.15.2:0/3117906710 >> v1:172.21.15.192:6789/0 conn(0x7f61b006b400 legacy=0x7f61b00726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:14.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.209+0000 7f61affff700 1 -- 172.21.15.2:0/3117906710 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b006c3e0 con 0x7f61b00b5e40 2023-11-26T07:12:14.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.209+0000 7f61affff700 1 --2- 172.21.15.2:0/3117906710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61b00b5e40 0x7f61b015f5d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f61a8009e50 tx=0x7f61a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffb8cdac7cae91ce server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:14.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.209+0000 7f61ae7fc700 1 -- 172.21.15.2:0/3117906710 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a800e070 con 0x7f61b00b5e40 2023-11-26T07:12:14.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.209+0000 7f61ae7fc700 1 -- 172.21.15.2:0/3117906710 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a800b910 con 0x7f61b00b5e40 2023-11-26T07:12:14.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.209+0000 7f61ae7fc700 1 -- 172.21.15.2:0/3117906710 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a800bcc0 con 0x7f61b00b5e40 2023-11-26T07:12:14.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.210+0000 7f61b5a76700 1 -- 172.21.15.2:0/3117906710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61b00b5e40 msgr2=0x7f61b015f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:14.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.210+0000 7f61b5a76700 1 --2- 172.21.15.2:0/3117906710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61b00b5e40 0x7f61b015f5d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f61a8009e50 tx=0x7f61a800b330 comp rx=0 tx=0).stop 2023-11-26T07:12:14.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.210+0000 7f61b5a76700 1 -- 172.21.15.2:0/3117906710 shutdown_connections 2023-11-26T07:12:14.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.210+0000 7f61b5a76700 1 --2- 172.21.15.2:0/3117906710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61b00b5e40 0x7f61b015f5d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:14.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.210+0000 7f61b5a76700 1 --2- 172.21.15.2:0/3117906710 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61b015e1e0 0x7f61b00b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:14.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.210+0000 7f61b5a76700 1 -- 172.21.15.2:0/3117906710 >> 172.21.15.2:0/3117906710 conn(0x7f61b00b5070 msgr2=0x7f61b00b5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:14.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.210+0000 7f61b5a76700 1 -- 172.21.15.2:0/3117906710 shutdown_connections 2023-11-26T07:12:14.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.210+0000 7f61b5a76700 1 -- 172.21.15.2:0/3117906710 wait complete. 2023-11-26T07:12:14.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.211+0000 7f61b5a76700 1 Processor -- start 2023-11-26T07:12:14.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.211+0000 7f61b5a76700 1 -- start start 2023-11-26T07:12:14.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.212+0000 7f61b5a76700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61b006b400 0x7f61b01556b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:14.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.212+0000 7f61b5a76700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61b00b5e40 0x7f61b009b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:14.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.212+0000 7f61b5a76700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61b015e1e0 0x7f61b0156f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:14.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.212+0000 7f61b5a76700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b00add10 con 0x7f61b006b400 2023-11-26T07:12:14.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.212+0000 7f61b5a76700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b00ad370 con 0x7f61b015e1e0 2023-11-26T07:12:14.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.212+0000 7f61b5a76700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b00ad650 con 0x7f61b00b5e40 2023-11-26T07:12:14.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.212+0000 7f61af7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61b006b400 0x7f61b01556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:14.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.212+0000 7f61af7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61b006b400 0x7f61b01556b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40290/0 (socket says 172.21.15.2:40290) 2023-11-26T07:12:14.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.212+0000 7f61af7fe700 1 -- 172.21.15.2:0/3446993692 learned_addr learned my addr 172.21.15.2:0/3446993692 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:14.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.212+0000 7f61affff700 1 --2- 172.21.15.2:0/3446993692 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61b015e1e0 0x7f61b0156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:14.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.212+0000 7f61aeffd700 1 --2- 172.21.15.2:0/3446993692 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61b00b5e40 0x7f61b009b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:14.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.212+0000 7f61af7fe700 1 -- 172.21.15.2:0/3446993692 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61b00b5e40 msgr2=0x7f61b009b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:14.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.212+0000 7f61af7fe700 1 --2- 172.21.15.2:0/3446993692 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61b00b5e40 0x7f61b009b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:14.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.212+0000 7f61af7fe700 1 -- 172.21.15.2:0/3446993692 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61b015e1e0 msgr2=0x7f61b0156f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:14.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.212+0000 7f61af7fe700 1 --2- 172.21.15.2:0/3446993692 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61b015e1e0 0x7f61b0156f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:14.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.212+0000 7f61af7fe700 1 -- 172.21.15.2:0/3446993692 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a8009b30 con 0x7f61b006b400 2023-11-26T07:12:14.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.213+0000 7f61af7fe700 1 --2- 172.21.15.2:0/3446993692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61b006b400 0x7f61b01556b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f61a000e870 tx=0x7f61a000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:14.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.213+0000 7f6197fff700 1 -- 172.21.15.2:0/3446993692 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a0009590 con 0x7f61b006b400 2023-11-26T07:12:14.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.213+0000 7f6197fff700 1 -- 172.21.15.2:0/3446993692 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a0013680 con 0x7f61b006b400 2023-11-26T07:12:14.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.213+0000 7f61b5a76700 1 -- 172.21.15.2:0/3446993692 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61b00ad930 con 0x7f61b006b400 2023-11-26T07:12:14.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.213+0000 7f6197fff700 1 -- 172.21.15.2:0/3446993692 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a00139f0 con 0x7f61b006b400 2023-11-26T07:12:14.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.213+0000 7f61b5a76700 1 -- 172.21.15.2:0/3446993692 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61b009b750 con 0x7f61b006b400 2023-11-26T07:12:14.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.214+0000 7f61b5a76700 1 -- 172.21.15.2:0/3446993692 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61b0075480 con 0x7f61b006b400 2023-11-26T07:12:14.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.214+0000 7f6197fff700 1 -- 172.21.15.2:0/3446993692 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f61a0013b50 con 0x7f61b006b400 2023-11-26T07:12:14.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.215+0000 7f6197fff700 1 --2- 172.21.15.2:0/3446993692 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f619c06aed0 0x7f619c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:14.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.215+0000 7f6197fff700 1 -- 172.21.15.2:0/3446993692 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f61a0089440 con 0x7f61b006b400 2023-11-26T07:12:14.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.215+0000 7f61aeffd700 1 --2- 172.21.15.2:0/3446993692 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f619c06aed0 0x7f619c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:14.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.215+0000 7f61aeffd700 1 --2- 172.21.15.2:0/3446993692 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f619c06aed0 0x7f619c06d390 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f61b015d9b0 tx=0x7f61a4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:14.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.219+0000 7f6197fff700 1 -- 172.21.15.2:0/3446993692 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f61a0054580 con 0x7f61b006b400 2023-11-26T07:12:14.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.420+0000 7f61b5a76700 1 -- 172.21.15.2:0/3446993692 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f61b00b2ac0 con 0x7f61b006b400 2023-11-26T07:12:14.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.421+0000 7f6197fff700 1 -- 172.21.15.2:0/3446993692 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f61a0057ba0 con 0x7f61b006b400 2023-11-26T07:12:14.423 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-26T07:12:14.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.423+0000 7f61b5a76700 1 -- 172.21.15.2:0/3446993692 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f619c06aed0 msgr2=0x7f619c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:14.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.423+0000 7f61b5a76700 1 --2- 172.21.15.2:0/3446993692 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f619c06aed0 0x7f619c06d390 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f61b015d9b0 tx=0x7f61a4009040 comp rx=0 tx=0).stop 2023-11-26T07:12:14.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.423+0000 7f61b5a76700 1 -- 172.21.15.2:0/3446993692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61b006b400 msgr2=0x7f61b01556b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:14.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.423+0000 7f61b5a76700 1 --2- 172.21.15.2:0/3446993692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61b006b400 0x7f61b01556b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f61a000e870 tx=0x7f61a000eb80 comp rx=0 tx=0).stop 2023-11-26T07:12:14.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.423+0000 7f61b5a76700 1 -- 172.21.15.2:0/3446993692 shutdown_connections 2023-11-26T07:12:14.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.423+0000 7f61b5a76700 1 --2- 172.21.15.2:0/3446993692 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f619c06aed0 0x7f619c06d390 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:14.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.423+0000 7f61b5a76700 1 --2- 172.21.15.2:0/3446993692 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61b015e1e0 0x7f61b0156f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:14.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.423+0000 7f61b5a76700 1 --2- 172.21.15.2:0/3446993692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61b006b400 0x7f61b01556b0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:14.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.423+0000 7f61b5a76700 1 --2- 172.21.15.2:0/3446993692 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61b00b5e40 0x7f61b009b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:14.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.423+0000 7f61b5a76700 1 -- 172.21.15.2:0/3446993692 >> 172.21.15.2:0/3446993692 conn(0x7f61b00b5070 msgr2=0x7f61b00b1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:14.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.423+0000 7f61b5a76700 1 -- 172.21.15.2:0/3446993692 shutdown_connections 2023-11-26T07:12:14.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.423+0000 7f61b5a76700 1 -- 172.21.15.2:0/3446993692 wait complete. 2023-11-26T07:12:14.437 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-26T07:12:14.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.562+0000 7f5e6f164700 1 Processor -- start 2023-11-26T07:12:14.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.562+0000 7f5e6f164700 1 -- start start 2023-11-26T07:12:14.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.562+0000 7f5e6f164700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e681617a0 0x7f5e680d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:14.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.562+0000 7f5e6f164700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e68162b40 con 0x7f5e680ce9b0 2023-11-26T07:12:14.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.562+0000 7f5e6f164700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e680d4930 con 0x7f5e680d2930 2023-11-26T07:12:14.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.562+0000 7f5e6f164700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e680d2dc0 con 0x7f5e681617a0 2023-11-26T07:12:14.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.563+0000 7f5e67fff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f5e680ce9b0 0x7f5e68161d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59742/0 (socket says 172.21.15.2:59742) 2023-11-26T07:12:14.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.563+0000 7f5e67fff700 1 -- 172.21.15.2:0/2078788429 learned_addr learned my addr 172.21.15.2:0/2078788429 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:14.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.563+0000 7f5e6cf00700 1 --2- 172.21.15.2:0/2078788429 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e681617a0 0x7f5e680d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:14.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.563+0000 7f5e677fe700 1 -- 172.21.15.2:0/2078788429 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 255342476 0 0) 0x7f5e68162b40 con 0x7f5e680ce9b0 2023-11-26T07:12:14.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.563+0000 7f5e677fe700 1 -- 172.21.15.2:0/2078788429 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e580035b0 con 0x7f5e680ce9b0 2023-11-26T07:12:14.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.563+0000 7f5e677fe700 1 -- 172.21.15.2:0/2078788429 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1559881734 0 0) 0x7f5e680d4930 con 0x7f5e680d2930 2023-11-26T07:12:14.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.563+0000 7f5e677fe700 1 -- 172.21.15.2:0/2078788429 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e68162b40 con 0x7f5e680d2930 2023-11-26T07:12:14.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.563+0000 7f5e677fe700 1 -- 172.21.15.2:0/2078788429 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2678922008 0 0) 0x7f5e580035b0 con 0x7f5e680ce9b0 2023-11-26T07:12:14.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.563+0000 7f5e677fe700 1 -- 172.21.15.2:0/2078788429 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e681617a0 msgr2=0x7f5e680d23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:14.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.563+0000 7f5e677fe700 1 --2- 172.21.15.2:0/2078788429 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e681617a0 0x7f5e680d23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:14.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.563+0000 7f5e677fe700 1 -- 172.21.15.2:0/2078788429 >> v1:172.21.15.192:6789/0 conn(0x7f5e680d2930 legacy=0x7f5e68162430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:14.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.563+0000 7f5e677fe700 1 -- 172.21.15.2:0/2078788429 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e680d4c10 con 0x7f5e680ce9b0 2023-11-26T07:12:14.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.563+0000 7f5e677fe700 1 -- 172.21.15.2:0/2078788429 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f5e54001670 con 0x7f5e680ce9b0 2023-11-26T07:12:14.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.563+0000 7f5e6cf00700 1 --2- 172.21.15.2:0/2078788429 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e681617a0 0x7f5e680d23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:12:14.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.563+0000 7f5e677fe700 1 -- 172.21.15.2:0/2078788429 >> v1:172.21.15.2:6789/0 conn(0x7f5e680ce9b0 legacy=0x7f5e68161d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:14.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.563+0000 7f5e677fe700 1 --2- 172.21.15.2:0/2078788429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e58003bc0 0x7f5e58003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:14.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.563+0000 7f5e677fe700 1 --2- 172.21.15.2:0/2078788429 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e58004850 0x7f5e58004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:14.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.563+0000 7f5e677fe700 1 --2- 172.21.15.2:0/2078788429 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e681617a0 0x7f5e58005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:14.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.563+0000 7f5e677fe700 1 -- 172.21.15.2:0/2078788429 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e680d2dc0 con 0x7f5e58003bc0 2023-11-26T07:12:14.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.563+0000 7f5e677fe700 1 -- 172.21.15.2:0/2078788429 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5800bb20 con 0x7f5e58004850 2023-11-26T07:12:14.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.563+0000 7f5e677fe700 1 -- 172.21.15.2:0/2078788429 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5800bce0 con 0x7f5e681617a0 2023-11-26T07:12:14.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.563+0000 7f5e6cf00700 1 --2- 172.21.15.2:0/2078788429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e58003bc0 0x7f5e58003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:14.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.564+0000 7f5e67fff700 1 --2- 172.21.15.2:0/2078788429 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e58004850 0x7f5e58004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:14.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.564+0000 7f5e6d701700 1 --2- 172.21.15.2:0/2078788429 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e681617a0 0x7f5e58005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:14.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.564+0000 7f5e6cf00700 1 -- 172.21.15.2:0/2078788429 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e681617a0 msgr2=0x7f5e58005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:14.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.564+0000 7f5e6cf00700 1 --2- 172.21.15.2:0/2078788429 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e681617a0 0x7f5e58005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:14.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.564+0000 7f5e6cf00700 1 -- 172.21.15.2:0/2078788429 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e58004850 msgr2=0x7f5e58004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:14.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.564+0000 7f5e6cf00700 1 --2- 172.21.15.2:0/2078788429 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e58004850 0x7f5e58004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:14.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.564+0000 7f5e6cf00700 1 -- 172.21.15.2:0/2078788429 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e5c0094a0 con 0x7f5e58003bc0 2023-11-26T07:12:14.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.564+0000 7f5e6d701700 1 --2- 172.21.15.2:0/2078788429 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e681617a0 0x7f5e58005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:14.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.564+0000 7f5e6cf00700 1 --2- 172.21.15.2:0/2078788429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e58003bc0 0x7f5e58003fc0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c009d30 tx=0x7f5e58005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b880ac472d6fe60 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:14.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.564+0000 7f5e677fe700 1 -- 172.21.15.2:0/2078788429 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c009e80 con 0x7f5e58003bc0 2023-11-26T07:12:14.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.564+0000 7f5e677fe700 1 -- 172.21.15.2:0/2078788429 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e5c00e9a0 con 0x7f5e58003bc0 2023-11-26T07:12:14.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.564+0000 7f5e677fe700 1 -- 172.21.15.2:0/2078788429 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c00ed10 con 0x7f5e58003bc0 2023-11-26T07:12:14.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.564+0000 7f5e6f164700 1 -- 172.21.15.2:0/2078788429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e58003bc0 msgr2=0x7f5e58003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:14.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.564+0000 7f5e6f164700 1 --2- 172.21.15.2:0/2078788429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e58003bc0 0x7f5e58003fc0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c009d30 tx=0x7f5e58005880 comp rx=0 tx=0).stop 2023-11-26T07:12:14.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.564+0000 7f5e6d701700 1 -- 172.21.15.2:0/2078788429 reap_dead start 2023-11-26T07:12:14.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.565+0000 7f5e6f164700 1 -- 172.21.15.2:0/2078788429 shutdown_connections 2023-11-26T07:12:14.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.565+0000 7f5e6f164700 1 -- 172.21.15.2:0/2078788429 >> 172.21.15.2:0/2078788429 conn(0x7f5e680d3e10 msgr2=0x7f5e680d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:14.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.565+0000 7f5e6f164700 1 -- 172.21.15.2:0/2078788429 shutdown_connections 2023-11-26T07:12:14.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.565+0000 7f5e6f164700 1 -- 172.21.15.2:0/2078788429 wait complete. 2023-11-26T07:12:14.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.566+0000 7f5e6f164700 1 Processor -- start 2023-11-26T07:12:14.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.566+0000 7f5e6f164700 1 -- start start 2023-11-26T07:12:14.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.567+0000 7f5e6f164700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e58003bc0 0x7f5e680c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:14.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.567+0000 7f5e6f164700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e680ca240 0x7f5e681520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:14.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.567+0000 7f5e6f164700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e680c8a00 0x7f5e680b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:14.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.567+0000 7f5e6f164700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e680c91a0 con 0x7f5e680c8a00 2023-11-26T07:12:14.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.567+0000 7f5e6f164700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e680c9480 con 0x7f5e680ca240 2023-11-26T07:12:14.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.567+0000 7f5e6f164700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e680c9760 con 0x7f5e58003bc0 2023-11-26T07:12:14.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.567+0000 7f5e6d701700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e680c8a00 0x7f5e680b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:14.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.567+0000 7f5e6d701700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e680c8a00 0x7f5e680b1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40314/0 (socket says 172.21.15.2:40314) 2023-11-26T07:12:14.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.567+0000 7f5e6d701700 1 -- 172.21.15.2:0/1915180347 learned_addr learned my addr 172.21.15.2:0/1915180347 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:14.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.567+0000 7f5e6cf00700 1 --2- 172.21.15.2:0/1915180347 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e58003bc0 0x7f5e680c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:14.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.567+0000 7f5e67fff700 1 --2- 172.21.15.2:0/1915180347 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e680ca240 0x7f5e681520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:14.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.567+0000 7f5e6d701700 1 -- 172.21.15.2:0/1915180347 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e58003bc0 msgr2=0x7f5e680c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:14.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.567+0000 7f5e6d701700 1 --2- 172.21.15.2:0/1915180347 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e58003bc0 0x7f5e680c83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:14.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.567+0000 7f5e6d701700 1 -- 172.21.15.2:0/1915180347 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e680ca240 msgr2=0x7f5e681520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:14.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.567+0000 7f5e6d701700 1 --2- 172.21.15.2:0/1915180347 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e680ca240 0x7f5e681520d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:14.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.567+0000 7f5e6d701700 1 -- 172.21.15.2:0/1915180347 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e680c9a40 con 0x7f5e680c8a00 2023-11-26T07:12:14.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.567+0000 7f5e67fff700 1 --2- 172.21.15.2:0/1915180347 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e680ca240 0x7f5e681520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:14.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.567+0000 7f5e6d701700 1 --2- 172.21.15.2:0/1915180347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e680c8a00 0x7f5e680b1b10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5e6808c6a0 tx=0x7f5e6000ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:14.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.567+0000 7f5e657fa700 1 -- 172.21.15.2:0/1915180347 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e60003c10 con 0x7f5e680c8a00 2023-11-26T07:12:14.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.567+0000 7f5e657fa700 1 -- 172.21.15.2:0/1915180347 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e60003d90 con 0x7f5e680c8a00 2023-11-26T07:12:14.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.567+0000 7f5e6f164700 1 -- 172.21.15.2:0/1915180347 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e680c9d20 con 0x7f5e680c8a00 2023-11-26T07:12:14.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.567+0000 7f5e657fa700 1 -- 172.21.15.2:0/1915180347 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e60005310 con 0x7f5e680c8a00 2023-11-26T07:12:14.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.568+0000 7f5e6f164700 1 -- 172.21.15.2:0/1915180347 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e680b2050 con 0x7f5e680c8a00 2023-11-26T07:12:14.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.568+0000 7f5e6f164700 1 -- 172.21.15.2:0/1915180347 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e680c9ee0 con 0x7f5e680c8a00 2023-11-26T07:12:14.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.569+0000 7f5e657fa700 1 -- 172.21.15.2:0/1915180347 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5e60005470 con 0x7f5e680c8a00 2023-11-26T07:12:14.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.569+0000 7f5e657fa700 1 --2- 172.21.15.2:0/1915180347 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5e4c06aed0 0x7f5e4c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:14.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.570+0000 7f5e657fa700 1 -- 172.21.15.2:0/1915180347 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e60089770 con 0x7f5e680c8a00 2023-11-26T07:12:14.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.570+0000 7f5e6cf00700 1 --2- 172.21.15.2:0/1915180347 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5e4c06aed0 0x7f5e4c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:14.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.570+0000 7f5e6cf00700 1 --2- 172.21.15.2:0/1915180347 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5e4c06aed0 0x7f5e4c06d390 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c0090b0 tx=0x7f5e5c01f040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:14.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.574+0000 7f5e657fa700 1 -- 172.21.15.2:0/1915180347 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5e60054790 con 0x7f5e680c8a00 2023-11-26T07:12:14.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.792+0000 7f5e6f164700 1 -- 172.21.15.2:0/1915180347 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5e68068670 con 0x7f5e680c8a00 2023-11-26T07:12:14.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.793+0000 7f5e657fa700 1 -- 172.21.15.2:0/1915180347 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5e60057db0 con 0x7f5e680c8a00 2023-11-26T07:12:14.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.795+0000 7f5e6f164700 1 -- 172.21.15.2:0/1915180347 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5e4c06aed0 msgr2=0x7f5e4c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:14.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.795+0000 7f5e6f164700 1 --2- 172.21.15.2:0/1915180347 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5e4c06aed0 0x7f5e4c06d390 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c0090b0 tx=0x7f5e5c01f040 comp rx=0 tx=0).stop 2023-11-26T07:12:14.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.795+0000 7f5e6f164700 1 -- 172.21.15.2:0/1915180347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e680c8a00 msgr2=0x7f5e680b1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:14.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.795+0000 7f5e6f164700 1 --2- 172.21.15.2:0/1915180347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e680c8a00 0x7f5e680b1b10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5e6808c6a0 tx=0x7f5e6000ef00 comp rx=0 tx=0).stop 2023-11-26T07:12:14.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.795+0000 7f5e6f164700 1 -- 172.21.15.2:0/1915180347 shutdown_connections 2023-11-26T07:12:14.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.795+0000 7f5e6f164700 1 --2- 172.21.15.2:0/1915180347 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5e4c06aed0 0x7f5e4c06d390 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:14.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.795+0000 7f5e6f164700 1 --2- 172.21.15.2:0/1915180347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e680c8a00 0x7f5e680b1b10 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:14.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.795+0000 7f5e6f164700 1 --2- 172.21.15.2:0/1915180347 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e58003bc0 0x7f5e680c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:14.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.795+0000 7f5e6f164700 1 --2- 172.21.15.2:0/1915180347 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e680ca240 0x7f5e681520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:14.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.795+0000 7f5e6f164700 1 -- 172.21.15.2:0/1915180347 >> 172.21.15.2:0/1915180347 conn(0x7f5e680d3e10 msgr2=0x7f5e680cf530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:14.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.795+0000 7f5e6f164700 1 -- 172.21.15.2:0/1915180347 shutdown_connections 2023-11-26T07:12:14.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.795+0000 7f5e6f164700 1 -- 172.21.15.2:0/1915180347 wait complete. 2023-11-26T07:12:14.799 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2023-11-26T07:12:14.809 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-11-26T07:12:14.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:14.809 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-11-26T07:12:14.856 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2023-11-26T07:12:14.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:14.857 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-26T07:12:14.876 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-26T07:12:14.876 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:12:15.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.998+0000 7facdfc21700 1 Processor -- start 2023-11-26T07:12:15.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.999+0000 7facdfc21700 1 -- start start 2023-11-26T07:12:15.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.999+0000 7facdfc21700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7facd815bde0 0x7facd815c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:15.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:14.999+0000 7facdfc21700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7facd80cf2b0 0x7facd80d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:15.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.000+0000 7facdfc21700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facd80d0a90 con 0x7facd80ce5c0 2023-11-26T07:12:15.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.000+0000 7facdfc21700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facd806ee10 con 0x7facd815bde0 2023-11-26T07:12:15.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.000+0000 7facdfc21700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd806f0f0 con 0x7facd80cf2b0 2023-11-26T07:12:15.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.000+0000 7facdd1bc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7facd80cf2b0 0x7facd80d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:15.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.000+0000 7facdd9bd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7facd815bde0 0x7facd815c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:15.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.000+0000 7facde1be700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7facd80ce5c0 0x7facd80cc670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.2:38902/0 (socket says 172.21.15.2:38902) 2023-11-26T07:12:15.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.000+0000 7facde1be700 1 -- 172.21.15.2:0/1919509524 learned_addr learned my addr 172.21.15.2:0/1919509524 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:15.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.000+0000 7facdd1bc700 1 -- 172.21.15.2:0/1919509524 >> v2:172.21.15.192:3300/0 conn(0x7facd815bde0 msgr2=0x7facd815c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:15.005 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.000+0000 7facdd1bc700 1 --2- 172.21.15.2:0/1919509524 >> v2:172.21.15.192:3300/0 conn(0x7facd815bde0 0x7facd815c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:15.005 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.000+0000 7facdd1bc700 1 -- 172.21.15.2:0/1919509524 >> v1:172.21.15.192:6789/0 conn(0x7facd80ce5c0 legacy=0x7facd80cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:15.005 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.000+0000 7facdd1bc700 1 -- 172.21.15.2:0/1919509524 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd806f3d0 con 0x7facd80cf2b0 2023-11-26T07:12:15.005 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.000+0000 7facdd9bd700 1 --2- 172.21.15.2:0/1919509524 >> v2:172.21.15.192:3300/0 conn(0x7facd815bde0 0x7facd815c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:12:15.005 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.000+0000 7facdd1bc700 1 --2- 172.21.15.2:0/1919509524 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7facd80cf2b0 0x7facd80d01b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7faccc009840 tx=0x7faccc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1da48c634567df52 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:15.005 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.001+0000 7facdc9bb700 1 -- 172.21.15.2:0/1919509524 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc011830 con 0x7facd80cf2b0 2023-11-26T07:12:15.005 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.001+0000 7facdc9bb700 1 -- 172.21.15.2:0/1919509524 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faccc011990 con 0x7facd80cf2b0 2023-11-26T07:12:15.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.001+0000 7facdc9bb700 1 -- 172.21.15.2:0/1919509524 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc011d20 con 0x7facd80cf2b0 2023-11-26T07:12:15.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.001+0000 7facdfc21700 1 -- 172.21.15.2:0/1919509524 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7facd80cf2b0 msgr2=0x7facd80d01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:15.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.001+0000 7facdfc21700 1 --2- 172.21.15.2:0/1919509524 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7facd80cf2b0 0x7facd80d01b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7faccc009840 tx=0x7faccc009b50 comp rx=0 tx=0).stop 2023-11-26T07:12:15.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.001+0000 7facdfc21700 1 -- 172.21.15.2:0/1919509524 shutdown_connections 2023-11-26T07:12:15.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.001+0000 7facdfc21700 1 --2- 172.21.15.2:0/1919509524 >> v2:172.21.15.192:3300/0 conn(0x7facd815bde0 0x7facd815c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:15.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.001+0000 7facdfc21700 1 --2- 172.21.15.2:0/1919509524 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7facd80cf2b0 0x7facd80d01b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:15.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.001+0000 7facdfc21700 1 -- 172.21.15.2:0/1919509524 >> 172.21.15.2:0/1919509524 conn(0x7facd80b3720 msgr2=0x7facd80b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:15.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.001+0000 7facdfc21700 1 -- 172.21.15.2:0/1919509524 shutdown_connections 2023-11-26T07:12:15.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.001+0000 7facdfc21700 1 -- 172.21.15.2:0/1919509524 wait complete. 2023-11-26T07:12:15.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.002+0000 7facdfc21700 1 Processor -- start 2023-11-26T07:12:15.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.003+0000 7facdfc21700 1 -- start start 2023-11-26T07:12:15.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.003+0000 7facdfc21700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7facd80ce5c0 0x7facd81f44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:15.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.003+0000 7facdfc21700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facd80cf2b0 0x7facd80c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:15.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.003+0000 7facdfc21700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7facd815bde0 0x7facd809ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:15.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.003+0000 7facdfc21700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd815a9c0 con 0x7facd80cf2b0 2023-11-26T07:12:15.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.003+0000 7facdfc21700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd81f3a40 con 0x7facd80ce5c0 2023-11-26T07:12:15.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.003+0000 7facdfc21700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd80c7e20 con 0x7facd815bde0 2023-11-26T07:12:15.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.003+0000 7facdd1bc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facd80cf2b0 0x7facd80c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:15.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.003+0000 7facdd1bc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facd80cf2b0 0x7facd80c78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40326/0 (socket says 172.21.15.2:40326) 2023-11-26T07:12:15.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.003+0000 7facdd1bc700 1 -- 172.21.15.2:0/9395316 learned_addr learned my addr 172.21.15.2:0/9395316 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:15.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.004+0000 7facdd9bd700 1 --2- 172.21.15.2:0/9395316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7facd80ce5c0 0x7facd81f44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:15.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.004+0000 7facde1be700 1 --2- 172.21.15.2:0/9395316 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7facd815bde0 0x7facd809ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:15.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.004+0000 7facdd1bc700 1 -- 172.21.15.2:0/9395316 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7facd815bde0 msgr2=0x7facd809ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:15.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.004+0000 7facdd1bc700 1 --2- 172.21.15.2:0/9395316 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7facd815bde0 0x7facd809ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:15.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.004+0000 7facdd1bc700 1 -- 172.21.15.2:0/9395316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7facd80ce5c0 msgr2=0x7facd81f44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:15.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.004+0000 7facdd1bc700 1 --2- 172.21.15.2:0/9395316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7facd80ce5c0 0x7facd81f44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:15.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.004+0000 7facdd1bc700 1 -- 172.21.15.2:0/9395316 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd40094a0 con 0x7facd80cf2b0 2023-11-26T07:12:15.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.004+0000 7facdd1bc700 1 --2- 172.21.15.2:0/9395316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facd80cf2b0 0x7facd80c78e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7faccc000c00 tx=0x7faccc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:15.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.004+0000 7facca7fc700 1 -- 172.21.15.2:0/9395316 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc0036a0 con 0x7facd80cf2b0 2023-11-26T07:12:15.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.004+0000 7facca7fc700 1 -- 172.21.15.2:0/9395316 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faccc01f070 con 0x7facd80cf2b0 2023-11-26T07:12:15.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.004+0000 7facdfc21700 1 -- 172.21.15.2:0/9395316 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faccc0094a0 con 0x7facd80cf2b0 2023-11-26T07:12:15.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.004+0000 7facca7fc700 1 -- 172.21.15.2:0/9395316 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc003a40 con 0x7facd80cf2b0 2023-11-26T07:12:15.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.004+0000 7facdfc21700 1 -- 172.21.15.2:0/9395316 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facd81f3ce0 con 0x7facd80cf2b0 2023-11-26T07:12:15.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.005+0000 7facdfc21700 1 -- 172.21.15.2:0/9395316 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facd8068670 con 0x7facd80cf2b0 2023-11-26T07:12:15.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.005+0000 7facca7fc700 1 -- 172.21.15.2:0/9395316 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faccc003ba0 con 0x7facd80cf2b0 2023-11-26T07:12:15.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.006+0000 7facca7fc700 1 --2- 172.21.15.2:0/9395316 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7facbc06aed0 0x7facbc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:15.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.006+0000 7facca7fc700 1 -- 172.21.15.2:0/9395316 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faccc021070 con 0x7facd80cf2b0 2023-11-26T07:12:15.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.006+0000 7facdd9bd700 1 --2- 172.21.15.2:0/9395316 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7facbc06aed0 0x7facbc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:15.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.007+0000 7facdd9bd700 1 --2- 172.21.15.2:0/9395316 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7facbc06aed0 0x7facbc06d390 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7facd4009cd0 tx=0x7facd4009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:15.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.011+0000 7facca7fc700 1 -- 172.21.15.2:0/9395316 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faccc055ef0 con 0x7facd80cf2b0 2023-11-26T07:12:15.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.256+0000 7facdfc21700 1 -- 172.21.15.2:0/9395316 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7facd815f420 con 0x7facd80cf2b0 2023-11-26T07:12:15.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.256+0000 7facca7fc700 1 -- 172.21.15.2:0/9395316 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7faccc059510 con 0x7facd80cf2b0 2023-11-26T07:12:15.258 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:12:15.259 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/3693634219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3693634219},{"type":"v1","addr":"172.21.15.2:6834","nonce":3693634219}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/953933423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":953933423},{"type":"v1","addr":"172.21.15.2:6835","nonce":953933423}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1000951065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1000951065},{"type":"v1","addr":"172.21.15.192:6836","nonce":1000951065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:11:34.051331+0000","modified":"2023-11-26T07:11:37.067662+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/4032661989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4032661989},{"type":"v1","addr":"172.21.15.192:6837","nonce":4032661989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-26T07:12:15.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.258+0000 7facdfc21700 1 -- 172.21.15.2:0/9395316 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7facbc06aed0 msgr2=0x7facbc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:15.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.258+0000 7facdfc21700 1 --2- 172.21.15.2:0/9395316 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7facbc06aed0 0x7facbc06d390 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7facd4009cd0 tx=0x7facd4009210 comp rx=0 tx=0).stop 2023-11-26T07:12:15.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.258+0000 7facdfc21700 1 -- 172.21.15.2:0/9395316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facd80cf2b0 msgr2=0x7facd80c78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:15.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.258+0000 7facdfc21700 1 --2- 172.21.15.2:0/9395316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facd80cf2b0 0x7facd80c78e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7faccc000c00 tx=0x7faccc004750 comp rx=0 tx=0).stop 2023-11-26T07:12:15.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.259+0000 7facdfc21700 1 -- 172.21.15.2:0/9395316 shutdown_connections 2023-11-26T07:12:15.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.259+0000 7facdfc21700 1 --2- 172.21.15.2:0/9395316 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7facbc06aed0 0x7facbc06d390 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:15.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.259+0000 7facdfc21700 1 --2- 172.21.15.2:0/9395316 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7facd815bde0 0x7facd809ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:15.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.259+0000 7facdfc21700 1 --2- 172.21.15.2:0/9395316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7facd80ce5c0 0x7facd81f44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:15.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.259+0000 7facdfc21700 1 --2- 172.21.15.2:0/9395316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facd80cf2b0 0x7facd80c78e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:15.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.259+0000 7facdfc21700 1 -- 172.21.15.2:0/9395316 >> 172.21.15.2:0/9395316 conn(0x7facd80b3720 msgr2=0x7facd80cde20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:15.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.259+0000 7facdfc21700 1 -- 172.21.15.2:0/9395316 shutdown_connections 2023-11-26T07:12:15.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.259+0000 7facdfc21700 1 -- 172.21.15.2:0/9395316 wait complete. 2023-11-26T07:12:15.263 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 8 2023-11-26T07:12:15.273 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:12:15.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.396+0000 7fcce3605700 1 Processor -- start 2023-11-26T07:12:15.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.396+0000 7fcce3605700 1 -- start start 2023-11-26T07:12:15.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.397+0000 7fcce3605700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fccdc1448b0 0x7fccdc06ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:15.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.397+0000 7fcce3605700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccdc144c90 con 0x7fccdc0b44c0 2023-11-26T07:12:15.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.397+0000 7fcce3605700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccdc0b4c80 con 0x7fccdc06f990 2023-11-26T07:12:15.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.397+0000 7fcce3605700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccdc0b4f60 con 0x7fccdc1448b0 2023-11-26T07:12:15.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.397+0000 7fcce0ba0700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fccdc0b44c0 0x7fccdc06f280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59776/0 (socket says 172.21.15.2:59776) 2023-11-26T07:12:15.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.397+0000 7fcce0ba0700 1 -- 172.21.15.2:0/2828599851 learned_addr learned my addr 172.21.15.2:0/2828599851 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:15.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.397+0000 7fcce13a1700 1 --2- 172.21.15.2:0/2828599851 >> v2:172.21.15.192:3300/0 conn(0x7fccdc1448b0 0x7fccdc06ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:15.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.397+0000 7fccd3fff700 1 -- 172.21.15.2:0/2828599851 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2353456641 0 0) 0x7fccdc144c90 con 0x7fccdc0b44c0 2023-11-26T07:12:15.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.397+0000 7fccd3fff700 1 -- 172.21.15.2:0/2828599851 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccc80035b0 con 0x7fccdc0b44c0 2023-11-26T07:12:15.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.397+0000 7fccd3fff700 1 -- 172.21.15.2:0/2828599851 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 471860058 0 0) 0x7fccc80035b0 con 0x7fccdc0b44c0 2023-11-26T07:12:15.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.397+0000 7fccd3fff700 1 -- 172.21.15.2:0/2828599851 >> v2:172.21.15.192:3300/0 conn(0x7fccdc1448b0 msgr2=0x7fccdc06ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:15.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.397+0000 7fccd3fff700 1 --2- 172.21.15.2:0/2828599851 >> v2:172.21.15.192:3300/0 conn(0x7fccdc1448b0 0x7fccdc06ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:15.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.397+0000 7fccd3fff700 1 -- 172.21.15.2:0/2828599851 >> v1:172.21.15.192:6789/0 conn(0x7fccdc06f990 legacy=0x7fccdc0ce2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:15.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.397+0000 7fccd3fff700 1 -- 172.21.15.2:0/2828599851 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccdc0b5240 con 0x7fccdc0b44c0 2023-11-26T07:12:15.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.397+0000 7fccd3fff700 1 -- 172.21.15.2:0/2828599851 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7fcccc001670 con 0x7fccdc0b44c0 2023-11-26T07:12:15.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.398+0000 7fccd3fff700 1 -- 172.21.15.2:0/2828599851 >> v1:172.21.15.2:6789/0 conn(0x7fccdc0b44c0 legacy=0x7fccdc06f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:15.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.398+0000 7fccd3fff700 1 --2- 172.21.15.2:0/2828599851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccc8003a00 0x7fccc8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:15.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.398+0000 7fccd3fff700 1 --2- 172.21.15.2:0/2828599851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccc8004850 0x7fccc8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:15.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.398+0000 7fccd3fff700 1 --2- 172.21.15.2:0/2828599851 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccc8005210 0x7fccc800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:15.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.398+0000 7fccd3fff700 1 -- 172.21.15.2:0/2828599851 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc0b4f60 con 0x7fccc8003a00 2023-11-26T07:12:15.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.398+0000 7fccd3fff700 1 -- 172.21.15.2:0/2828599851 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc800c1b0 con 0x7fccc8004850 2023-11-26T07:12:15.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.398+0000 7fccd3fff700 1 -- 172.21.15.2:0/2828599851 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc800c370 con 0x7fccc8005210 2023-11-26T07:12:15.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.398+0000 7fcce13a1700 1 --2- 172.21.15.2:0/2828599851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccc8003a00 0x7fccc8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:15.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.398+0000 7fcce0ba0700 1 --2- 172.21.15.2:0/2828599851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccc8004850 0x7fccc8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:15.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.398+0000 7fcce1ba2700 1 --2- 172.21.15.2:0/2828599851 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccc8005210 0x7fccc800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:15.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.398+0000 7fcce13a1700 1 -- 172.21.15.2:0/2828599851 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccc8005210 msgr2=0x7fccc800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:15.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.398+0000 7fcce13a1700 1 --2- 172.21.15.2:0/2828599851 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccc8005210 0x7fccc800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:15.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.398+0000 7fcce13a1700 1 -- 172.21.15.2:0/2828599851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccc8004850 msgr2=0x7fccc8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:15.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.398+0000 7fcce13a1700 1 --2- 172.21.15.2:0/2828599851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccc8004850 0x7fccc8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:15.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.398+0000 7fcce13a1700 1 -- 172.21.15.2:0/2828599851 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc80035b0 con 0x7fccc8003a00 2023-11-26T07:12:15.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.398+0000 7fcce1ba2700 1 --2- 172.21.15.2:0/2828599851 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccc8005210 0x7fccc800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:12:15.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.398+0000 7fcce1ba2700 1 -- 172.21.15.2:0/2828599851 reap_dead start 2023-11-26T07:12:15.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.398+0000 7fcce13a1700 1 --2- 172.21.15.2:0/2828599851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccc8003a00 0x7fccc8003e20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fccd8009b60 tx=0x7fccc8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=736d1d83b3a6d2cd server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:15.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.398+0000 7fccd3fff700 1 -- 172.21.15.2:0/2828599851 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd800e6c0 con 0x7fccc8003a00 2023-11-26T07:12:15.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.398+0000 7fccd3fff700 1 -- 172.21.15.2:0/2828599851 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd800e820 con 0x7fccc8003a00 2023-11-26T07:12:15.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.398+0000 7fccd3fff700 1 -- 172.21.15.2:0/2828599851 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd800eb90 con 0x7fccc8003a00 2023-11-26T07:12:15.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.399+0000 7fcce3605700 1 -- 172.21.15.2:0/2828599851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccc8003a00 msgr2=0x7fccc8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:15.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.399+0000 7fcce3605700 1 --2- 172.21.15.2:0/2828599851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccc8003a00 0x7fccc8003e20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fccd8009b60 tx=0x7fccc8005880 comp rx=0 tx=0).stop 2023-11-26T07:12:15.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.399+0000 7fcce3605700 1 -- 172.21.15.2:0/2828599851 shutdown_connections 2023-11-26T07:12:15.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.399+0000 7fcce3605700 1 --2- 172.21.15.2:0/2828599851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccc8003a00 0x7fccc8003e20 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:15.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.399+0000 7fcce3605700 1 -- 172.21.15.2:0/2828599851 >> 172.21.15.2:0/2828599851 conn(0x7fccdc0d0bc0 msgr2=0x7fccdc0d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:15.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.399+0000 7fcce3605700 1 -- 172.21.15.2:0/2828599851 shutdown_connections 2023-11-26T07:12:15.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.399+0000 7fcce3605700 1 -- 172.21.15.2:0/2828599851 wait complete. 2023-11-26T07:12:15.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.400+0000 7fcce3605700 1 Processor -- start 2023-11-26T07:12:15.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.400+0000 7fcce3605700 1 -- start start 2023-11-26T07:12:15.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.401+0000 7fcce3605700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccc8003a00 0x7fccdc0cecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:15.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.401+0000 7fcce3605700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccdc0cfe10 0x7fccdc159850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:15.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.401+0000 7fcce3605700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccdc15cba0 0x7fccdc15d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:15.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.401+0000 7fcce3605700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc0cf1f0 con 0x7fccdc15cba0 2023-11-26T07:12:15.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.401+0000 7fcce3605700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc15d540 con 0x7fccdc0cfe10 2023-11-26T07:12:15.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.401+0000 7fcce3605700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc0ca520 con 0x7fccc8003a00 2023-11-26T07:12:15.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.401+0000 7fcce1ba2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccdc15cba0 0x7fccdc15d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:15.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.401+0000 7fcce1ba2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccdc15cba0 0x7fccdc15d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40348/0 (socket says 172.21.15.2:40348) 2023-11-26T07:12:15.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.401+0000 7fcce1ba2700 1 -- 172.21.15.2:0/1569457076 learned_addr learned my addr 172.21.15.2:0/1569457076 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:15.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.401+0000 7fcce0ba0700 1 --2- 172.21.15.2:0/1569457076 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccdc0cfe10 0x7fccdc159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:15.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.401+0000 7fcce13a1700 1 --2- 172.21.15.2:0/1569457076 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccc8003a00 0x7fccdc0cecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:15.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.401+0000 7fcce1ba2700 1 -- 172.21.15.2:0/1569457076 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccc8003a00 msgr2=0x7fccdc0cecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:15.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.401+0000 7fcce1ba2700 1 --2- 172.21.15.2:0/1569457076 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccc8003a00 0x7fccdc0cecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:15.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.401+0000 7fcce1ba2700 1 -- 172.21.15.2:0/1569457076 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccdc0cfe10 msgr2=0x7fccdc159850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:15.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.401+0000 7fcce1ba2700 1 --2- 172.21.15.2:0/1569457076 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccdc0cfe10 0x7fccdc159850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:15.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.401+0000 7fcce1ba2700 1 -- 172.21.15.2:0/1569457076 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccdc0cf6c0 con 0x7fccdc15cba0 2023-11-26T07:12:15.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.401+0000 7fcce1ba2700 1 --2- 172.21.15.2:0/1569457076 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccdc15cba0 0x7fccdc15d000 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fccdc0d1ca0 tx=0x7fccd400de70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:15.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.402+0000 7fccd1ffb700 1 -- 172.21.15.2:0/1569457076 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd4003e10 con 0x7fccdc15cba0 2023-11-26T07:12:15.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.402+0000 7fccd1ffb700 1 -- 172.21.15.2:0/1569457076 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd4005070 con 0x7fccdc15cba0 2023-11-26T07:12:15.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.402+0000 7fcce3605700 1 -- 172.21.15.2:0/1569457076 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccdc0d0290 con 0x7fccdc15cba0 2023-11-26T07:12:15.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.402+0000 7fccd1ffb700 1 -- 172.21.15.2:0/1569457076 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd4005420 con 0x7fccdc15cba0 2023-11-26T07:12:15.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.402+0000 7fcce3605700 1 -- 172.21.15.2:0/1569457076 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccdc0c9ed0 con 0x7fccdc15cba0 2023-11-26T07:12:15.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.403+0000 7fcce3605700 1 -- 172.21.15.2:0/1569457076 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccdc0ca800 con 0x7fccdc15cba0 2023-11-26T07:12:15.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.403+0000 7fccd1ffb700 1 -- 172.21.15.2:0/1569457076 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fccd4005580 con 0x7fccdc15cba0 2023-11-26T07:12:15.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.404+0000 7fccd1ffb700 1 --2- 172.21.15.2:0/1569457076 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fccc006aed0 0x7fccc006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:15.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.404+0000 7fccd1ffb700 1 -- 172.21.15.2:0/1569457076 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fccd4089270 con 0x7fccdc15cba0 2023-11-26T07:12:15.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.404+0000 7fcce13a1700 1 --2- 172.21.15.2:0/1569457076 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fccc006aed0 0x7fccc006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:15.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.404+0000 7fcce13a1700 1 --2- 172.21.15.2:0/1569457076 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fccc006aed0 0x7fccc006d390 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fccd80090b0 tx=0x7fccd8008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:15.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.408+0000 7fccd1ffb700 1 -- 172.21.15.2:0/1569457076 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fccd4054280 con 0x7fccdc15cba0 2023-11-26T07:12:15.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.610+0000 7fcce3605700 1 -- 172.21.15.2:0/1569457076 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fccdc068670 con 0x7fccdc15cba0 2023-11-26T07:12:15.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.612+0000 7fccd1ffb700 1 -- 172.21.15.2:0/1569457076 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16457 (secure 0 0 0) 0x7fccd40578a0 con 0x7fccdc15cba0 2023-11-26T07:12:15.615 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:12:15.615 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:11:35.634747+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:11:32.129474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:11:33.019837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:12:15.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.614+0000 7fcce3605700 1 -- 172.21.15.2:0/1569457076 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fccc006aed0 msgr2=0x7fccc006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:15.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.614+0000 7fcce3605700 1 --2- 172.21.15.2:0/1569457076 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fccc006aed0 0x7fccc006d390 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fccd80090b0 tx=0x7fccd8008030 comp rx=0 tx=0).stop 2023-11-26T07:12:15.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.614+0000 7fcce3605700 1 -- 172.21.15.2:0/1569457076 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccdc15cba0 msgr2=0x7fccdc15d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:15.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.614+0000 7fcce3605700 1 --2- 172.21.15.2:0/1569457076 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccdc15cba0 0x7fccdc15d000 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fccdc0d1ca0 tx=0x7fccd400de70 comp rx=0 tx=0).stop 2023-11-26T07:12:15.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.614+0000 7fcce3605700 1 -- 172.21.15.2:0/1569457076 shutdown_connections 2023-11-26T07:12:15.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.614+0000 7fcce3605700 1 --2- 172.21.15.2:0/1569457076 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fccc006aed0 0x7fccc006d390 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:15.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.614+0000 7fcce3605700 1 --2- 172.21.15.2:0/1569457076 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccdc15cba0 0x7fccdc15d000 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:15.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.614+0000 7fcce3605700 1 --2- 172.21.15.2:0/1569457076 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccc8003a00 0x7fccdc0cecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:15.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.614+0000 7fcce3605700 1 --2- 172.21.15.2:0/1569457076 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccdc0cfe10 0x7fccdc159850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:15.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.614+0000 7fcce3605700 1 -- 172.21.15.2:0/1569457076 >> 172.21.15.2:0/1569457076 conn(0x7fccdc0d0bc0 msgr2=0x7fccdc0b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:15.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.614+0000 7fcce3605700 1 -- 172.21.15.2:0/1569457076 shutdown_connections 2023-11-26T07:12:15.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.614+0000 7fcce3605700 1 -- 172.21.15.2:0/1569457076 wait complete. 2023-11-26T07:12:15.629 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:11:28.205739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:11:32.129474+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:11:33.019837+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:12:15.630 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:12:15.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.755+0000 7f75e8627700 1 Processor -- start 2023-11-26T07:12:15.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.755+0000 7f75e8627700 1 -- start start 2023-11-26T07:12:15.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.756+0000 7f75e8627700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f75e00b0e90 0x7f75e006eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:15.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.756+0000 7f75e8627700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75e00d1230 con 0x7f75e006fc50 2023-11-26T07:12:15.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.756+0000 7f75e8627700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75e00d0c70 con 0x7f75e015e1c0 2023-11-26T07:12:15.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.756+0000 7f75e8627700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75e00d0f50 con 0x7f75e00b0e90 2023-11-26T07:12:15.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.756+0000 7f75e5bc2700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f75e006fc50 0x7f75e006ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59794/0 (socket says 172.21.15.2:59794) 2023-11-26T07:12:15.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.756+0000 7f75e5bc2700 1 -- 172.21.15.2:0/3578790820 learned_addr learned my addr 172.21.15.2:0/3578790820 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:15.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.756+0000 7f75e6bc4700 1 --2- 172.21.15.2:0/3578790820 >> v2:172.21.15.192:3300/0 conn(0x7f75e00b0e90 0x7f75e006eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:15.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.756+0000 7f75e53c1700 1 -- 172.21.15.2:0/3578790820 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 89552648 0 0) 0x7f75e00d1230 con 0x7f75e006fc50 2023-11-26T07:12:15.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.756+0000 7f75e53c1700 1 -- 172.21.15.2:0/3578790820 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75cc0035b0 con 0x7f75e006fc50 2023-11-26T07:12:15.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.757+0000 7f75e53c1700 1 -- 172.21.15.2:0/3578790820 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2031151992 0 0) 0x7f75cc0035b0 con 0x7f75e006fc50 2023-11-26T07:12:15.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.757+0000 7f75e6bc4700 1 -- 172.21.15.2:0/3578790820 >> v1:172.21.15.192:6789/0 conn(0x7f75e015e1c0 legacy=0x7f75e006f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:15.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.757+0000 7f75e6bc4700 1 -- 172.21.15.2:0/3578790820 >> v1:172.21.15.2:6789/0 conn(0x7f75e006fc50 legacy=0x7f75e006ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:15.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.757+0000 7f75e6bc4700 1 -- 172.21.15.2:0/3578790820 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e006c210 con 0x7f75e00b0e90 2023-11-26T07:12:15.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.757+0000 7f75e6bc4700 1 --2- 172.21.15.2:0/3578790820 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75e00b0e90 0x7f75e006eef0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f75d8009d90 tx=0x7f75d800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1400d7a9369a69ab server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:15.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.757+0000 7f75e53c1700 1 -- 172.21.15.2:0/3578790820 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d800e070 con 0x7f75e00b0e90 2023-11-26T07:12:15.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.757+0000 7f75e53c1700 1 -- 172.21.15.2:0/3578790820 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d8003a20 con 0x7f75e00b0e90 2023-11-26T07:12:15.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.757+0000 7f75e53c1700 1 -- 172.21.15.2:0/3578790820 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75dc001670 con 0x7f75e00b0e90 2023-11-26T07:12:15.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.758+0000 7f75e8627700 1 -- 172.21.15.2:0/3578790820 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75e00b0e90 msgr2=0x7f75e006eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:15.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.758+0000 7f75e8627700 1 --2- 172.21.15.2:0/3578790820 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75e00b0e90 0x7f75e006eef0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f75d8009d90 tx=0x7f75d800b330 comp rx=0 tx=0).stop 2023-11-26T07:12:15.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.758+0000 7f75e8627700 1 -- 172.21.15.2:0/3578790820 shutdown_connections 2023-11-26T07:12:15.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.758+0000 7f75e8627700 1 --2- 172.21.15.2:0/3578790820 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75e00b0e90 0x7f75e006eef0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:15.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.758+0000 7f75e8627700 1 -- 172.21.15.2:0/3578790820 >> 172.21.15.2:0/3578790820 conn(0x7f75e00b3720 msgr2=0x7f75e00b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:15.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.758+0000 7f75e8627700 1 -- 172.21.15.2:0/3578790820 shutdown_connections 2023-11-26T07:12:15.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.758+0000 7f75e8627700 1 -- 172.21.15.2:0/3578790820 wait complete. 2023-11-26T07:12:15.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.759+0000 7f75e8627700 1 Processor -- start 2023-11-26T07:12:15.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.759+0000 7f75e8627700 1 -- start start 2023-11-26T07:12:15.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.760+0000 7f75e8627700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75e006fc50 0x7f75e0149de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:15.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.760+0000 7f75e8627700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75e00b0e90 0x7f75e014b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:15.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.760+0000 7f75e8627700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f75e015e1c0 0x7f75e014c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:15.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.760+0000 7f75e8627700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e014b1d0 con 0x7f75e006fc50 2023-11-26T07:12:15.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.760+0000 7f75e8627700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e014a320 con 0x7f75e00b0e90 2023-11-26T07:12:15.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.760+0000 7f75e8627700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e014a5c0 con 0x7f75e015e1c0 2023-11-26T07:12:15.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.760+0000 7f75e63c3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75e006fc50 0x7f75e0149de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:15.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.760+0000 7f75e63c3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75e006fc50 0x7f75e0149de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40358/0 (socket says 172.21.15.2:40358) 2023-11-26T07:12:15.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.760+0000 7f75e63c3700 1 -- 172.21.15.2:0/2846467915 learned_addr learned my addr 172.21.15.2:0/2846467915 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:15.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.760+0000 7f75e5bc2700 1 --2- 172.21.15.2:0/2846467915 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75e00b0e90 0x7f75e014b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:15.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.760+0000 7f75e63c3700 1 -- 172.21.15.2:0/2846467915 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f75e015e1c0 msgr2=0x7f75e014c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:15.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.760+0000 7f75e63c3700 1 --2- 172.21.15.2:0/2846467915 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f75e015e1c0 0x7f75e014c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:15.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.760+0000 7f75e63c3700 1 -- 172.21.15.2:0/2846467915 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75e00b0e90 msgr2=0x7f75e014b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:15.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.760+0000 7f75e63c3700 1 --2- 172.21.15.2:0/2846467915 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75e00b0e90 0x7f75e014b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:15.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.760+0000 7f75e63c3700 1 -- 172.21.15.2:0/2846467915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d8009a70 con 0x7f75e006fc50 2023-11-26T07:12:15.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.760+0000 7f75e5bc2700 1 --2- 172.21.15.2:0/2846467915 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75e00b0e90 0x7f75e014b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:12:15.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.760+0000 7f75e63c3700 1 --2- 172.21.15.2:0/2846467915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75e006fc50 0x7f75e0149de0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f75d000c450 tx=0x7f75d000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:15.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.760+0000 7f75d6ffd700 1 -- 172.21.15.2:0/2846467915 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d00052d0 con 0x7f75e006fc50 2023-11-26T07:12:15.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.761+0000 7f75d6ffd700 1 -- 172.21.15.2:0/2846467915 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d0005430 con 0x7f75e006fc50 2023-11-26T07:12:15.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.761+0000 7f75e8627700 1 -- 172.21.15.2:0/2846467915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75e014a8a0 con 0x7f75e006fc50 2023-11-26T07:12:15.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.761+0000 7f75d6ffd700 1 -- 172.21.15.2:0/2846467915 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d00038c0 con 0x7f75e006fc50 2023-11-26T07:12:15.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.761+0000 7f75e8627700 1 -- 172.21.15.2:0/2846467915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75e014ae60 con 0x7f75e006fc50 2023-11-26T07:12:15.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.762+0000 7f75e8627700 1 -- 172.21.15.2:0/2846467915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75e0067ac0 con 0x7f75e006fc50 2023-11-26T07:12:15.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.762+0000 7f75d6ffd700 1 -- 172.21.15.2:0/2846467915 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f75d0003a20 con 0x7f75e006fc50 2023-11-26T07:12:15.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.763+0000 7f75d6ffd700 1 --2- 172.21.15.2:0/2846467915 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f75c406aed0 0x7f75c406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:15.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.763+0000 7f75d6ffd700 1 -- 172.21.15.2:0/2846467915 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f75d00888e0 con 0x7f75e006fc50 2023-11-26T07:12:15.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.763+0000 7f75e5bc2700 1 --2- 172.21.15.2:0/2846467915 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f75c406aed0 0x7f75c406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:15.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.763+0000 7f75e5bc2700 1 --2- 172.21.15.2:0/2846467915 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f75c406aed0 0x7f75c406d390 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f75e014cf70 tx=0x7f75dc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:15.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.767+0000 7f75d6ffd700 1 -- 172.21.15.2:0/2846467915 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f75d0053990 con 0x7f75e006fc50 2023-11-26T07:12:15.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.970+0000 7f75e8627700 1 -- 172.21.15.2:0/2846467915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f75e0075480 con 0x7f75e006fc50 2023-11-26T07:12:15.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.971+0000 7f75d6ffd700 1 -- 172.21.15.2:0/2846467915 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f75d0056fb0 con 0x7f75e006fc50 2023-11-26T07:12:15.974 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-26T07:12:15.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.973+0000 7f75e8627700 1 -- 172.21.15.2:0/2846467915 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f75c406aed0 msgr2=0x7f75c406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:15.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.973+0000 7f75e8627700 1 --2- 172.21.15.2:0/2846467915 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f75c406aed0 0x7f75c406d390 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f75e014cf70 tx=0x7f75dc009040 comp rx=0 tx=0).stop 2023-11-26T07:12:15.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.973+0000 7f75e8627700 1 -- 172.21.15.2:0/2846467915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75e006fc50 msgr2=0x7f75e0149de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:15.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.973+0000 7f75e8627700 1 --2- 172.21.15.2:0/2846467915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75e006fc50 0x7f75e0149de0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f75d000c450 tx=0x7f75d000c810 comp rx=0 tx=0).stop 2023-11-26T07:12:15.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.973+0000 7f75e8627700 1 -- 172.21.15.2:0/2846467915 shutdown_connections 2023-11-26T07:12:15.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.973+0000 7f75e8627700 1 --2- 172.21.15.2:0/2846467915 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f75c406aed0 0x7f75c406d390 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:15.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.973+0000 7f75e8627700 1 --2- 172.21.15.2:0/2846467915 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f75e015e1c0 0x7f75e014c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:15.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.973+0000 7f75e8627700 1 --2- 172.21.15.2:0/2846467915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75e006fc50 0x7f75e0149de0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:15.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.973+0000 7f75e8627700 1 --2- 172.21.15.2:0/2846467915 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75e00b0e90 0x7f75e014b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:15.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.973+0000 7f75e8627700 1 -- 172.21.15.2:0/2846467915 >> 172.21.15.2:0/2846467915 conn(0x7f75e00b3720 msgr2=0x7f75e006ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:15.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.973+0000 7f75e8627700 1 -- 172.21.15.2:0/2846467915 shutdown_connections 2023-11-26T07:12:15.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:15.973+0000 7f75e8627700 1 -- 172.21.15.2:0/2846467915 wait complete. 2023-11-26T07:12:15.988 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:12:16.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.112+0000 7f56d327c700 1 Processor -- start 2023-11-26T07:12:16.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.113+0000 7f56d327c700 1 -- start start 2023-11-26T07:12:16.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.113+0000 7f56d327c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56cc15bde0 0x7f56cc15c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:16.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.113+0000 7f56d327c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f56cc0ce5c0 0x7f56cc0cea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:16.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.113+0000 7f56d327c700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56cc0d0a90 con 0x7f56cc0cf2b0 2023-11-26T07:12:16.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.113+0000 7f56d327c700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56cc0cef90 con 0x7f56cc0ce5c0 2023-11-26T07:12:16.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.113+0000 7f56d327c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc06ee10 con 0x7f56cc15bde0 2023-11-26T07:12:16.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.114+0000 7f56d1819700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f56cc0ce5c0 0x7f56cc0cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:16.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.114+0000 7f56d1819700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f56cc0ce5c0 0x7f56cc0cea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40370/0 (socket says 172.21.15.2:40370) 2023-11-26T07:12:16.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.114+0000 7f56d1819700 1 -- 172.21.15.2:0/2354619596 learned_addr learned my addr 172.21.15.2:0/2354619596 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:16.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.114+0000 7f56d1018700 1 --2- 172.21.15.2:0/2354619596 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56cc15bde0 0x7f56cc15c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:16.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.114+0000 7f56d1819700 1 -- 172.21.15.2:0/2354619596 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56cc15bde0 msgr2=0x7f56cc15c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:16.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.114+0000 7f56d1819700 1 --2- 172.21.15.2:0/2354619596 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56cc15bde0 0x7f56cc15c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:16.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.114+0000 7f56d1819700 1 -- 172.21.15.2:0/2354619596 >> v1:172.21.15.192:6789/0 conn(0x7f56cc0cf2b0 legacy=0x7f56cc0d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:16.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.114+0000 7f56d1819700 1 -- 172.21.15.2:0/2354619596 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56cc06f0f0 con 0x7f56cc0ce5c0 2023-11-26T07:12:16.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.114+0000 7f56d1819700 1 --2- 172.21.15.2:0/2354619596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56cc0ce5c0 0x7f56cc0cea50 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f56c4009e50 tx=0x7f56c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eba88575db05b9f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:16.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.114+0000 7f56c3fff700 1 -- 172.21.15.2:0/2354619596 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c400e070 con 0x7f56cc0ce5c0 2023-11-26T07:12:16.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.114+0000 7f56c3fff700 1 -- 172.21.15.2:0/2354619596 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c400b9c0 con 0x7f56cc0ce5c0 2023-11-26T07:12:16.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.114+0000 7f56c3fff700 1 -- 172.21.15.2:0/2354619596 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c400bd70 con 0x7f56cc0ce5c0 2023-11-26T07:12:16.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.115+0000 7f56d327c700 1 -- 172.21.15.2:0/2354619596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56cc0ce5c0 msgr2=0x7f56cc0cea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:16.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.115+0000 7f56d327c700 1 --2- 172.21.15.2:0/2354619596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56cc0ce5c0 0x7f56cc0cea50 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f56c4009e50 tx=0x7f56c400b330 comp rx=0 tx=0).stop 2023-11-26T07:12:16.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.115+0000 7f56d327c700 1 -- 172.21.15.2:0/2354619596 shutdown_connections 2023-11-26T07:12:16.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.115+0000 7f56d327c700 1 --2- 172.21.15.2:0/2354619596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56cc0ce5c0 0x7f56cc0cea50 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:16.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.115+0000 7f56d327c700 1 --2- 172.21.15.2:0/2354619596 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56cc15bde0 0x7f56cc15c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:16.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.115+0000 7f56d327c700 1 -- 172.21.15.2:0/2354619596 >> 172.21.15.2:0/2354619596 conn(0x7f56cc0b3720 msgr2=0x7f56cc0b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:16.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.115+0000 7f56d327c700 1 -- 172.21.15.2:0/2354619596 shutdown_connections 2023-11-26T07:12:16.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.115+0000 7f56d327c700 1 -- 172.21.15.2:0/2354619596 wait complete. 2023-11-26T07:12:16.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.116+0000 7f56d327c700 1 Processor -- start 2023-11-26T07:12:16.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.117+0000 7f56d327c700 1 -- start start 2023-11-26T07:12:16.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.117+0000 7f56d327c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56cc0ce5c0 0x7f56cc0b4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:16.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.117+0000 7f56d327c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56cc0cf2b0 0x7f56cc159df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:16.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.117+0000 7f56d327c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56cc15bde0 0x7f56cc14f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:16.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.117+0000 7f56d327c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc0ca700 con 0x7f56cc15bde0 2023-11-26T07:12:16.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.118+0000 7f56d327c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc0b4e60 con 0x7f56cc0cf2b0 2023-11-26T07:12:16.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.118+0000 7f56d327c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc0ca9c0 con 0x7f56cc0ce5c0 2023-11-26T07:12:16.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.118+0000 7f56d1819700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56cc15bde0 0x7f56cc14f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:16.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.118+0000 7f56d1819700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56cc15bde0 0x7f56cc14f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40376/0 (socket says 172.21.15.2:40376) 2023-11-26T07:12:16.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.118+0000 7f56d1819700 1 -- 172.21.15.2:0/2465824786 learned_addr learned my addr 172.21.15.2:0/2465824786 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:16.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.118+0000 7f56d0817700 1 --2- 172.21.15.2:0/2465824786 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56cc0cf2b0 0x7f56cc159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:16.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.118+0000 7f56d1018700 1 --2- 172.21.15.2:0/2465824786 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56cc0ce5c0 0x7f56cc0b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:16.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.118+0000 7f56d1819700 1 -- 172.21.15.2:0/2465824786 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56cc0ce5c0 msgr2=0x7f56cc0b4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:16.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.118+0000 7f56d1819700 1 --2- 172.21.15.2:0/2465824786 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56cc0ce5c0 0x7f56cc0b4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:16.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.118+0000 7f56d1819700 1 -- 172.21.15.2:0/2465824786 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56cc0cf2b0 msgr2=0x7f56cc159df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:16.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.118+0000 7f56d1819700 1 --2- 172.21.15.2:0/2465824786 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56cc0cf2b0 0x7f56cc159df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:16.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.118+0000 7f56d1819700 1 -- 172.21.15.2:0/2465824786 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c4009b30 con 0x7f56cc15bde0 2023-11-26T07:12:16.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.118+0000 7f56d0817700 1 --2- 172.21.15.2:0/2465824786 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56cc0cf2b0 0x7f56cc159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:16.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.118+0000 7f56d1819700 1 --2- 172.21.15.2:0/2465824786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56cc15bde0 0x7f56cc14f050 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f56cc072340 tx=0x7f56c4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:16.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.118+0000 7f56c1ffb700 1 -- 172.21.15.2:0/2465824786 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c4003ea0 con 0x7f56cc15bde0 2023-11-26T07:12:16.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.118+0000 7f56c1ffb700 1 -- 172.21.15.2:0/2465824786 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c40099b0 con 0x7f56cc15bde0 2023-11-26T07:12:16.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.118+0000 7f56d327c700 1 -- 172.21.15.2:0/2465824786 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56cc0caca0 con 0x7f56cc15bde0 2023-11-26T07:12:16.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.118+0000 7f56c1ffb700 1 -- 172.21.15.2:0/2465824786 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c401c680 con 0x7f56cc15bde0 2023-11-26T07:12:16.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.119+0000 7f56d327c700 1 -- 172.21.15.2:0/2465824786 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56cc15a330 con 0x7f56cc15bde0 2023-11-26T07:12:16.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.120+0000 7f56d327c700 1 -- 172.21.15.2:0/2465824786 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56cc075480 con 0x7f56cc15bde0 2023-11-26T07:12:16.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.120+0000 7f56c1ffb700 1 -- 172.21.15.2:0/2465824786 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f56c401c7e0 con 0x7f56cc15bde0 2023-11-26T07:12:16.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.120+0000 7f56c1ffb700 1 --2- 172.21.15.2:0/2465824786 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f56b006aed0 0x7f56b006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:16.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.120+0000 7f56c1ffb700 1 -- 172.21.15.2:0/2465824786 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f56c408b3a0 con 0x7f56cc15bde0 2023-11-26T07:12:16.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.121+0000 7f56d1018700 1 --2- 172.21.15.2:0/2465824786 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f56b006aed0 0x7f56b006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:16.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.121+0000 7f56d1018700 1 --2- 172.21.15.2:0/2465824786 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f56b006aed0 0x7f56b006d390 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f56c800b9b0 tx=0x7f56c8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:16.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.125+0000 7f56c1ffb700 1 -- 172.21.15.2:0/2465824786 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f56c4056460 con 0x7f56cc15bde0 2023-11-26T07:12:16.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.326+0000 7f56d327c700 1 -- 172.21.15.2:0/2465824786 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f56cc0cbee0 con 0x7f56cc15bde0 2023-11-26T07:12:16.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.326+0000 7f56c1ffb700 1 -- 172.21.15.2:0/2465824786 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f56c4059a80 con 0x7f56cc15bde0 2023-11-26T07:12:16.329 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-26T07:12:16.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.328+0000 7f56d327c700 1 -- 172.21.15.2:0/2465824786 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f56b006aed0 msgr2=0x7f56b006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:16.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.328+0000 7f56d327c700 1 --2- 172.21.15.2:0/2465824786 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f56b006aed0 0x7f56b006d390 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f56c800b9b0 tx=0x7f56c8008040 comp rx=0 tx=0).stop 2023-11-26T07:12:16.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.328+0000 7f56d327c700 1 -- 172.21.15.2:0/2465824786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56cc15bde0 msgr2=0x7f56cc14f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:16.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.328+0000 7f56d327c700 1 --2- 172.21.15.2:0/2465824786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56cc15bde0 0x7f56cc14f050 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f56cc072340 tx=0x7f56c4004ad0 comp rx=0 tx=0).stop 2023-11-26T07:12:16.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.329+0000 7f56d327c700 1 -- 172.21.15.2:0/2465824786 shutdown_connections 2023-11-26T07:12:16.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.329+0000 7f56d327c700 1 --2- 172.21.15.2:0/2465824786 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f56b006aed0 0x7f56b006d390 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:16.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.329+0000 7f56d327c700 1 --2- 172.21.15.2:0/2465824786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56cc15bde0 0x7f56cc14f050 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:16.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.329+0000 7f56d327c700 1 --2- 172.21.15.2:0/2465824786 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56cc0ce5c0 0x7f56cc0b4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:16.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.329+0000 7f56d327c700 1 --2- 172.21.15.2:0/2465824786 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56cc0cf2b0 0x7f56cc159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:16.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.329+0000 7f56d327c700 1 -- 172.21.15.2:0/2465824786 >> 172.21.15.2:0/2465824786 conn(0x7f56cc0b3720 msgr2=0x7f56cc06fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:16.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.329+0000 7f56d327c700 1 -- 172.21.15.2:0/2465824786 shutdown_connections 2023-11-26T07:12:16.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.329+0000 7f56d327c700 1 -- 172.21.15.2:0/2465824786 wait complete. 2023-11-26T07:12:16.344 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:12:16.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.469+0000 7f81a8cf0700 1 Processor -- start 2023-11-26T07:12:16.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.469+0000 7f81a8cf0700 1 -- start start 2023-11-26T07:12:16.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.470+0000 7f81a8cf0700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f81a40b4150 0x7f81a406de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:16.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.470+0000 7f81a8cf0700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f81a40b5ab0 0x7f81a406e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:16.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.470+0000 7f81a8cf0700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81a4071f50 con 0x7f81a406b620 2023-11-26T07:12:16.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.470+0000 7f81a8cf0700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a4072230 con 0x7f81a40b5ab0 2023-11-26T07:12:16.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.470+0000 7f81a8cf0700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a4072510 con 0x7f81a40b4150 2023-11-26T07:12:16.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.470+0000 7f81a2d9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f81a40b5ab0 0x7f81a406e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:16.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.470+0000 7f81a259c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f81a406b620 0x7f81a40b3a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59822/0 (socket says 172.21.15.2:59822) 2023-11-26T07:12:16.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.470+0000 7f81a2d9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f81a40b5ab0 0x7f81a406e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40384/0 (socket says 172.21.15.2:40384) 2023-11-26T07:12:16.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.470+0000 7f81a259c700 1 -- 172.21.15.2:0/1967781641 learned_addr learned my addr 172.21.15.2:0/1967781641 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:16.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.470+0000 7f81a1d9b700 1 --2- 172.21.15.2:0/1967781641 >> v2:172.21.15.192:3300/0 conn(0x7f81a40b4150 0x7f81a406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:16.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.470+0000 7f81a2d9d700 1 -- 172.21.15.2:0/1967781641 >> v2:172.21.15.192:3300/0 conn(0x7f81a40b4150 msgr2=0x7f81a406de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:16.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.470+0000 7f81a2d9d700 1 --2- 172.21.15.2:0/1967781641 >> v2:172.21.15.192:3300/0 conn(0x7f81a40b4150 0x7f81a406de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:16.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.470+0000 7f81a2d9d700 1 -- 172.21.15.2:0/1967781641 >> v1:172.21.15.2:6789/0 conn(0x7f81a406b620 legacy=0x7f81a40b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:16.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.470+0000 7f81a159a700 1 -- 172.21.15.2:0/1967781641 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4041400078 0 0) 0x7f81a4071f50 con 0x7f81a406b620 2023-11-26T07:12:16.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.470+0000 7f81a2d9d700 1 -- 172.21.15.2:0/1967781641 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a40727f0 con 0x7f81a40b5ab0 2023-11-26T07:12:16.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.470+0000 7f81a2d9d700 1 --2- 172.21.15.2:0/1967781641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81a40b5ab0 0x7f81a406e390 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f81a406d6f0 tx=0x7f819c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=976e4068b0d6c03a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:16.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.470+0000 7f81a159a700 1 -- 172.21.15.2:0/1967781641 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c00e070 con 0x7f81a40b5ab0 2023-11-26T07:12:16.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.471+0000 7f81a159a700 1 -- 172.21.15.2:0/1967781641 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819c00bb20 con 0x7f81a40b5ab0 2023-11-26T07:12:16.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.471+0000 7f81a159a700 1 -- 172.21.15.2:0/1967781641 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c012430 con 0x7f81a40b5ab0 2023-11-26T07:12:16.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.471+0000 7f81a8cf0700 1 -- 172.21.15.2:0/1967781641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81a40b5ab0 msgr2=0x7f81a406e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:16.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.471+0000 7f81a8cf0700 1 --2- 172.21.15.2:0/1967781641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81a40b5ab0 0x7f81a406e390 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f81a406d6f0 tx=0x7f819c00b330 comp rx=0 tx=0).stop 2023-11-26T07:12:16.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.471+0000 7f81a8cf0700 1 -- 172.21.15.2:0/1967781641 shutdown_connections 2023-11-26T07:12:16.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.471+0000 7f81a8cf0700 1 --2- 172.21.15.2:0/1967781641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81a40b5ab0 0x7f81a406e390 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:16.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.471+0000 7f81a8cf0700 1 --2- 172.21.15.2:0/1967781641 >> v2:172.21.15.192:3300/0 conn(0x7f81a40b4150 0x7f81a406de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:16.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.471+0000 7f81a8cf0700 1 -- 172.21.15.2:0/1967781641 >> 172.21.15.2:0/1967781641 conn(0x7f81a40b2740 msgr2=0x7f81a40b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:16.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.471+0000 7f81a8cf0700 1 -- 172.21.15.2:0/1967781641 shutdown_connections 2023-11-26T07:12:16.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.471+0000 7f81a8cf0700 1 -- 172.21.15.2:0/1967781641 wait complete. 2023-11-26T07:12:16.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.473+0000 7f81a8cf0700 1 Processor -- start 2023-11-26T07:12:16.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.473+0000 7f81a8cf0700 1 -- start start 2023-11-26T07:12:16.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.473+0000 7f81a8cf0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81a406b620 0x7f81a4142af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:16.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.473+0000 7f81a8cf0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f81a40b4150 0x7f81a40c59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:16.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.473+0000 7f81a8cf0700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81a40b5ab0 0x7f81a41e7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:16.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.473+0000 7f81a8cf0700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a41f3660 con 0x7f81a406b620 2023-11-26T07:12:16.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.473+0000 7f81a8cf0700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a40c6450 con 0x7f81a40b5ab0 2023-11-26T07:12:16.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.473+0000 7f81a8cf0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a40c6730 con 0x7f81a40b4150 2023-11-26T07:12:16.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.473+0000 7f81a259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81a406b620 0x7f81a4142af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:16.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.473+0000 7f81a259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81a406b620 0x7f81a4142af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40386/0 (socket says 172.21.15.2:40386) 2023-11-26T07:12:16.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.473+0000 7f81a259c700 1 -- 172.21.15.2:0/3319188660 learned_addr learned my addr 172.21.15.2:0/3319188660 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:16.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.474+0000 7f81a2d9d700 1 --2- 172.21.15.2:0/3319188660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81a40b5ab0 0x7f81a41e7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:16.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.474+0000 7f81a1d9b700 1 --2- 172.21.15.2:0/3319188660 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f81a40b4150 0x7f81a40c59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:16.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.474+0000 7f81a259c700 1 -- 172.21.15.2:0/3319188660 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f81a40b4150 msgr2=0x7f81a40c59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:16.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.474+0000 7f81a259c700 1 --2- 172.21.15.2:0/3319188660 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f81a40b4150 0x7f81a40c59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:16.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.474+0000 7f81a259c700 1 -- 172.21.15.2:0/3319188660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81a40b5ab0 msgr2=0x7f81a41e7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:16.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.474+0000 7f81a259c700 1 --2- 172.21.15.2:0/3319188660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81a40b5ab0 0x7f81a41e7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:16.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.474+0000 7f81a259c700 1 -- 172.21.15.2:0/3319188660 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819c009a70 con 0x7f81a406b620 2023-11-26T07:12:16.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.474+0000 7f81a2d9d700 1 --2- 172.21.15.2:0/3319188660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81a40b5ab0 0x7f81a41e7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:16.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.474+0000 7f81a259c700 1 --2- 172.21.15.2:0/3319188660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81a406b620 0x7f81a4142af0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f81940011e0 tx=0x7f819400cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:16.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.474+0000 7f8192ffd700 1 -- 172.21.15.2:0/3319188660 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8194004c80 con 0x7f81a406b620 2023-11-26T07:12:16.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.474+0000 7f8192ffd700 1 -- 172.21.15.2:0/3319188660 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8194004e00 con 0x7f81a406b620 2023-11-26T07:12:16.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.474+0000 7f81a8cf0700 1 -- 172.21.15.2:0/3319188660 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81a40c6a10 con 0x7f81a406b620 2023-11-26T07:12:16.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.474+0000 7f8192ffd700 1 -- 172.21.15.2:0/3319188660 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8194007310 con 0x7f81a406b620 2023-11-26T07:12:16.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.474+0000 7f81a8cf0700 1 -- 172.21.15.2:0/3319188660 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a41e5c40 con 0x7f81a406b620 2023-11-26T07:12:16.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.475+0000 7f81a8cf0700 1 -- 172.21.15.2:0/3319188660 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81a41e5dd0 con 0x7f81a406b620 2023-11-26T07:12:16.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.476+0000 7f8192ffd700 1 -- 172.21.15.2:0/3319188660 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8194007470 con 0x7f81a406b620 2023-11-26T07:12:16.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.476+0000 7f8192ffd700 1 --2- 172.21.15.2:0/3319188660 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f818406aed0 0x7f818406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:16.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.476+0000 7f8192ffd700 1 -- 172.21.15.2:0/3319188660 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8194089380 con 0x7f81a406b620 2023-11-26T07:12:16.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.476+0000 7f81a1d9b700 1 --2- 172.21.15.2:0/3319188660 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f818406aed0 0x7f818406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:16.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.477+0000 7f81a1d9b700 1 --2- 172.21.15.2:0/3319188660 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f818406aed0 0x7f818406d390 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f81a41f6b30 tx=0x7f8198008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:16.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.481+0000 7f8192ffd700 1 -- 172.21.15.2:0/3319188660 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8194054430 con 0x7f81a406b620 2023-11-26T07:12:16.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.683+0000 7f81a8cf0700 1 -- 172.21.15.2:0/3319188660 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f81a4075480 con 0x7f81a406b620 2023-11-26T07:12:16.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.683+0000 7f8192ffd700 1 -- 172.21.15.2:0/3319188660 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8194057a50 con 0x7f81a406b620 2023-11-26T07:12:16.686 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-26T07:12:16.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.685+0000 7f81a8cf0700 1 -- 172.21.15.2:0/3319188660 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f818406aed0 msgr2=0x7f818406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:16.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.685+0000 7f81a8cf0700 1 --2- 172.21.15.2:0/3319188660 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f818406aed0 0x7f818406d390 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f81a41f6b30 tx=0x7f8198008040 comp rx=0 tx=0).stop 2023-11-26T07:12:16.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.685+0000 7f81a8cf0700 1 -- 172.21.15.2:0/3319188660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81a406b620 msgr2=0x7f81a4142af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:16.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.685+0000 7f81a8cf0700 1 --2- 172.21.15.2:0/3319188660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81a406b620 0x7f81a4142af0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f81940011e0 tx=0x7f819400cae0 comp rx=0 tx=0).stop 2023-11-26T07:12:16.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.685+0000 7f81a8cf0700 1 -- 172.21.15.2:0/3319188660 shutdown_connections 2023-11-26T07:12:16.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.685+0000 7f81a8cf0700 1 --2- 172.21.15.2:0/3319188660 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f818406aed0 0x7f818406d390 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:16.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.685+0000 7f81a8cf0700 1 --2- 172.21.15.2:0/3319188660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81a40b5ab0 0x7f81a41e7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:16.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.685+0000 7f81a8cf0700 1 --2- 172.21.15.2:0/3319188660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81a406b620 0x7f81a4142af0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:16.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.685+0000 7f81a8cf0700 1 --2- 172.21.15.2:0/3319188660 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f81a40b4150 0x7f81a40c59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:16.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.685+0000 7f81a8cf0700 1 -- 172.21.15.2:0/3319188660 >> 172.21.15.2:0/3319188660 conn(0x7f81a40b2740 msgr2=0x7f81a40ad860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:16.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.685+0000 7f81a8cf0700 1 -- 172.21.15.2:0/3319188660 shutdown_connections 2023-11-26T07:12:16.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.685+0000 7f81a8cf0700 1 -- 172.21.15.2:0/3319188660 wait complete. 2023-11-26T07:12:16.700 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:12:16.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.822+0000 7fcd160ab700 1 Processor -- start 2023-11-26T07:12:16.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.822+0000 7fcd160ab700 1 -- start start 2023-11-26T07:12:16.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.823+0000 7fcd160ab700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcd100cd470 0x7fcd100cff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:16.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.823+0000 7fcd160ab700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd100d04b0 con 0x7fcd1006afd0 2023-11-26T07:12:16.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.823+0000 7fcd160ab700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd100cf1b0 con 0x7fcd101457a0 2023-11-26T07:12:16.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.823+0000 7fcd160ab700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd100cf490 con 0x7fcd100cd470 2023-11-26T07:12:16.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.823+0000 7fcd0effd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcd100cd470 0x7fcd100cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:16.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.823+0000 7fcd0ffff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fcd1006afd0 0x7fcd1006b3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59840/0 (socket says 172.21.15.2:59840) 2023-11-26T07:12:16.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.823+0000 7fcd0effd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcd100cd470 0x7fcd100cff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40394/0 (socket says 172.21.15.2:40394) 2023-11-26T07:12:16.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.823+0000 7fcd0ffff700 1 -- 172.21.15.2:0/1287537926 learned_addr learned my addr 172.21.15.2:0/1287537926 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:16.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.823+0000 7fcd0effd700 1 -- 172.21.15.2:0/1287537926 >> v1:172.21.15.192:6789/0 conn(0x7fcd101457a0 legacy=0x7fcd10160330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:16.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.823+0000 7fcd0effd700 1 -- 172.21.15.2:0/1287537926 >> v1:172.21.15.2:6789/0 conn(0x7fcd1006afd0 legacy=0x7fcd1006b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:16.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.823+0000 7fcd0effd700 1 -- 172.21.15.2:0/1287537926 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd100cf770 con 0x7fcd100cd470 2023-11-26T07:12:16.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.823+0000 7fcd0e7fc700 1 -- 172.21.15.2:0/1287537926 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2511576972 0 0) 0x7fcd100d04b0 con 0x7fcd1006afd0 2023-11-26T07:12:16.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.824+0000 7fcd0effd700 1 --2- 172.21.15.2:0/1287537926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd100cd470 0x7fcd100cff70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fccf8009840 tx=0x7fccf8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=587df04c065fbb56 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:16.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.824+0000 7fcd0e7fc700 1 -- 172.21.15.2:0/1287537926 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf8004230 con 0x7fcd100cd470 2023-11-26T07:12:16.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.824+0000 7fcd0e7fc700 1 -- 172.21.15.2:0/1287537926 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf8004390 con 0x7fcd100cd470 2023-11-26T07:12:16.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.824+0000 7fcd0e7fc700 1 -- 172.21.15.2:0/1287537926 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf80036a0 con 0x7fcd100cd470 2023-11-26T07:12:16.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.824+0000 7fcd160ab700 1 -- 172.21.15.2:0/1287537926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd100cd470 msgr2=0x7fcd100cff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:16.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.824+0000 7fcd160ab700 1 --2- 172.21.15.2:0/1287537926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd100cd470 0x7fcd100cff70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fccf8009840 tx=0x7fccf8009b50 comp rx=0 tx=0).stop 2023-11-26T07:12:16.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.824+0000 7fcd160ab700 1 -- 172.21.15.2:0/1287537926 shutdown_connections 2023-11-26T07:12:16.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.824+0000 7fcd160ab700 1 --2- 172.21.15.2:0/1287537926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd100cd470 0x7fcd100cff70 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:16.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.824+0000 7fcd160ab700 1 -- 172.21.15.2:0/1287537926 >> 172.21.15.2:0/1287537926 conn(0x7fcd100d0aa0 msgr2=0x7fcd100d0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:16.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.824+0000 7fcd160ab700 1 -- 172.21.15.2:0/1287537926 shutdown_connections 2023-11-26T07:12:16.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.824+0000 7fcd160ab700 1 -- 172.21.15.2:0/1287537926 wait complete. 2023-11-26T07:12:16.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.826+0000 7fcd160ab700 1 Processor -- start 2023-11-26T07:12:16.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.826+0000 7fcd160ab700 1 -- start start 2023-11-26T07:12:16.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.826+0000 7fcd160ab700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd1006afd0 0x7fcd100afe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:16.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.826+0000 7fcd160ab700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd100cd470 0x7fcd1015dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:16.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.826+0000 7fcd160ab700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd101457a0 0x7fcd1015e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:16.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.826+0000 7fcd160ab700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd10158940 con 0x7fcd100cd470 2023-11-26T07:12:16.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.826+0000 7fcd160ab700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd100b50c0 con 0x7fcd1006afd0 2023-11-26T07:12:16.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.827+0000 7fcd160ab700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd100b53a0 con 0x7fcd101457a0 2023-11-26T07:12:16.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.827+0000 7fcd0effd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd100cd470 0x7fcd1015dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:16.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.827+0000 7fcd0effd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd100cd470 0x7fcd1015dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40402/0 (socket says 172.21.15.2:40402) 2023-11-26T07:12:16.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.827+0000 7fcd0effd700 1 -- 172.21.15.2:0/1412935852 learned_addr learned my addr 172.21.15.2:0/1412935852 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:16.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.827+0000 7fcd0f7fe700 1 --2- 172.21.15.2:0/1412935852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd1006afd0 0x7fcd100afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:16.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.827+0000 7fcd0ffff700 1 --2- 172.21.15.2:0/1412935852 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd101457a0 0x7fcd1015e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:16.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.827+0000 7fcd0effd700 1 -- 172.21.15.2:0/1412935852 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd101457a0 msgr2=0x7fcd1015e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:16.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.827+0000 7fcd0effd700 1 --2- 172.21.15.2:0/1412935852 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd101457a0 0x7fcd1015e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:16.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.827+0000 7fcd0effd700 1 -- 172.21.15.2:0/1412935852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd1006afd0 msgr2=0x7fcd100afe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:16.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.827+0000 7fcd0effd700 1 --2- 172.21.15.2:0/1412935852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd1006afd0 0x7fcd100afe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:16.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.827+0000 7fcd0effd700 1 -- 172.21.15.2:0/1412935852 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf80094a0 con 0x7fcd100cd470 2023-11-26T07:12:16.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.827+0000 7fcd0ffff700 1 --2- 172.21.15.2:0/1412935852 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd101457a0 0x7fcd1015e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:12:16.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.827+0000 7fcd0effd700 1 --2- 172.21.15.2:0/1412935852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd100cd470 0x7fcd1015dc20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fccf80090b0 tx=0x7fccf8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:16.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.827+0000 7fcd07fff700 1 -- 172.21.15.2:0/1412935852 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf8011830 con 0x7fcd100cd470 2023-11-26T07:12:16.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.827+0000 7fcd07fff700 1 -- 172.21.15.2:0/1412935852 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf801e070 con 0x7fcd100cd470 2023-11-26T07:12:16.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.827+0000 7fcd07fff700 1 -- 172.21.15.2:0/1412935852 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf8011bb0 con 0x7fcd100cd470 2023-11-26T07:12:16.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.827+0000 7fcd160ab700 1 -- 172.21.15.2:0/1412935852 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd1015d140 con 0x7fcd100cd470 2023-11-26T07:12:16.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.827+0000 7fcd160ab700 1 -- 172.21.15.2:0/1412935852 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd1015d700 con 0x7fcd100cd470 2023-11-26T07:12:16.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.828+0000 7fcd160ab700 1 -- 172.21.15.2:0/1412935852 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd100b03b0 con 0x7fcd100cd470 2023-11-26T07:12:16.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.829+0000 7fcd07fff700 1 -- 172.21.15.2:0/1412935852 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fccf8011d10 con 0x7fcd100cd470 2023-11-26T07:12:16.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.829+0000 7fcd07fff700 1 --2- 172.21.15.2:0/1412935852 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fccf006aed0 0x7fccf006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:16.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.829+0000 7fcd07fff700 1 -- 172.21.15.2:0/1412935852 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fccf808a930 con 0x7fcd100cd470 2023-11-26T07:12:16.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.829+0000 7fcd0f7fe700 1 --2- 172.21.15.2:0/1412935852 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fccf006aed0 0x7fccf006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:16.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.830+0000 7fcd0f7fe700 1 --2- 172.21.15.2:0/1412935852 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fccf006aed0 0x7fccf006d390 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcd00009870 tx=0x7fcd00008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:16.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:16.834+0000 7fcd07fff700 1 -- 172.21.15.2:0/1412935852 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fccf8055a70 con 0x7fcd100cd470 2023-11-26T07:12:17.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.083+0000 7fcd160ab700 1 -- 172.21.15.2:0/1412935852 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd10068670 con 0x7fcd100cd470 2023-11-26T07:12:17.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.083+0000 7fcd07fff700 1 -- 172.21.15.2:0/1412935852 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7fccf8020020 con 0x7fcd100cd470 2023-11-26T07:12:17.087 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:12:17.087 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/3693634219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3693634219},{"type":"v1","addr":"172.21.15.2:6834","nonce":3693634219}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/953933423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":953933423},{"type":"v1","addr":"172.21.15.2:6835","nonce":953933423}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1000951065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1000951065},{"type":"v1","addr":"172.21.15.192:6836","nonce":1000951065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:11:34.051331+0000","modified":"2023-11-26T07:11:37.067662+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/4032661989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4032661989},{"type":"v1","addr":"172.21.15.192:6837","nonce":4032661989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-26T07:12:17.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.086+0000 7fcd160ab700 1 -- 172.21.15.2:0/1412935852 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fccf006aed0 msgr2=0x7fccf006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:17.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.086+0000 7fcd160ab700 1 --2- 172.21.15.2:0/1412935852 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fccf006aed0 0x7fccf006d390 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcd00009870 tx=0x7fcd00008040 comp rx=0 tx=0).stop 2023-11-26T07:12:17.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.086+0000 7fcd160ab700 1 -- 172.21.15.2:0/1412935852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd100cd470 msgr2=0x7fcd1015dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:17.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.086+0000 7fcd160ab700 1 --2- 172.21.15.2:0/1412935852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd100cd470 0x7fcd1015dc20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fccf80090b0 tx=0x7fccf8004750 comp rx=0 tx=0).stop 2023-11-26T07:12:17.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.086+0000 7fcd160ab700 1 -- 172.21.15.2:0/1412935852 shutdown_connections 2023-11-26T07:12:17.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.086+0000 7fcd160ab700 1 --2- 172.21.15.2:0/1412935852 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fccf006aed0 0x7fccf006d390 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:17.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.086+0000 7fcd160ab700 1 --2- 172.21.15.2:0/1412935852 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd101457a0 0x7fcd1015e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:17.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.086+0000 7fcd160ab700 1 --2- 172.21.15.2:0/1412935852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd1006afd0 0x7fcd100afe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:17.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.086+0000 7fcd160ab700 1 --2- 172.21.15.2:0/1412935852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd100cd470 0x7fcd1015dc20 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:17.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.086+0000 7fcd160ab700 1 -- 172.21.15.2:0/1412935852 >> 172.21.15.2:0/1412935852 conn(0x7fcd100d0aa0 msgr2=0x7fcd1006dee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:17.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.086+0000 7fcd160ab700 1 -- 172.21.15.2:0/1412935852 shutdown_connections 2023-11-26T07:12:17.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.086+0000 7fcd160ab700 1 -- 172.21.15.2:0/1412935852 wait complete. 2023-11-26T07:12:17.090 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 8 2023-11-26T07:12:17.101 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:12:17.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.223+0000 7efc6cbe4700 1 Processor -- start 2023-11-26T07:12:17.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.223+0000 7efc6cbe4700 1 -- start start 2023-11-26T07:12:17.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.224+0000 7efc6cbe4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc68143ae0 0x7efc680b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:17.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.224+0000 7efc6cbe4700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc68143ec0 con 0x7efc680722c0 2023-11-26T07:12:17.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.224+0000 7efc6cbe4700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc680b3ae0 con 0x7efc681440f0 2023-11-26T07:12:17.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.224+0000 7efc6cbe4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc680b40a0 con 0x7efc68143ae0 2023-11-26T07:12:17.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.224+0000 7efc66d9d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7efc680722c0 0x7efc6806e510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59854/0 (socket says 172.21.15.2:59854) 2023-11-26T07:12:17.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.224+0000 7efc66d9d700 1 -- 172.21.15.2:0/1388334712 learned_addr learned my addr 172.21.15.2:0/1388334712 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:17.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.225+0000 7efc6659c700 1 --2- 172.21.15.2:0/1388334712 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc68143ae0 0x7efc680b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:17.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.225+0000 7efc6559a700 1 -- 172.21.15.2:0/1388334712 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3946689278 0 0) 0x7efc68143ec0 con 0x7efc680722c0 2023-11-26T07:12:17.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.225+0000 7efc6559a700 1 -- 172.21.15.2:0/1388334712 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc500035b0 con 0x7efc680722c0 2023-11-26T07:12:17.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.225+0000 7efc6559a700 1 -- 172.21.15.2:0/1388334712 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3117524476 0 0) 0x7efc680b3ae0 con 0x7efc681440f0 2023-11-26T07:12:17.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.225+0000 7efc6559a700 1 -- 172.21.15.2:0/1388334712 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc68143ec0 con 0x7efc681440f0 2023-11-26T07:12:17.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.225+0000 7efc6559a700 1 -- 172.21.15.2:0/1388334712 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2043069039 0 0) 0x7efc500035b0 con 0x7efc680722c0 2023-11-26T07:12:17.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.225+0000 7efc6559a700 1 -- 172.21.15.2:0/1388334712 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc68143ae0 msgr2=0x7efc680b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:17.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.225+0000 7efc6559a700 1 --2- 172.21.15.2:0/1388334712 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc68143ae0 0x7efc680b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:17.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.225+0000 7efc6559a700 1 -- 172.21.15.2:0/1388334712 >> v1:172.21.15.192:6789/0 conn(0x7efc681440f0 legacy=0x7efc68071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:17.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.225+0000 7efc6559a700 1 -- 172.21.15.2:0/1388334712 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc680b3dc0 con 0x7efc680722c0 2023-11-26T07:12:17.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.225+0000 7efc6559a700 1 -- 172.21.15.2:0/1388334712 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7efc600019f0 con 0x7efc680722c0 2023-11-26T07:12:17.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.225+0000 7efc6659c700 1 --2- 172.21.15.2:0/1388334712 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc68143ae0 0x7efc680b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:12:17.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.225+0000 7efc6559a700 1 -- 172.21.15.2:0/1388334712 >> v1:172.21.15.2:6789/0 conn(0x7efc680722c0 legacy=0x7efc6806e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:17.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.225+0000 7efc6559a700 1 --2- 172.21.15.2:0/1388334712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc50003bc0 0x7efc50003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:17.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.225+0000 7efc6559a700 1 --2- 172.21.15.2:0/1388334712 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc68143ae0 0x7efc50004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:17.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.225+0000 7efc6559a700 1 --2- 172.21.15.2:0/1388334712 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc50004d90 0x7efc50005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:17.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.225+0000 7efc6559a700 1 -- 172.21.15.2:0/1388334712 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc680b40a0 con 0x7efc50003bc0 2023-11-26T07:12:17.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.225+0000 7efc6559a700 1 -- 172.21.15.2:0/1388334712 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5000bac0 con 0x7efc50004d90 2023-11-26T07:12:17.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.225+0000 7efc6559a700 1 -- 172.21.15.2:0/1388334712 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc5000bc80 con 0x7efc68143ae0 2023-11-26T07:12:17.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.225+0000 7efc6659c700 1 --2- 172.21.15.2:0/1388334712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc50003bc0 0x7efc50003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:17.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.225+0000 7efc65d9b700 1 --2- 172.21.15.2:0/1388334712 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc68143ae0 0x7efc50004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:17.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.225+0000 7efc66d9d700 1 --2- 172.21.15.2:0/1388334712 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc50004d90 0x7efc50005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:17.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.225+0000 7efc6659c700 1 -- 172.21.15.2:0/1388334712 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc68143ae0 msgr2=0x7efc50004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:17.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.225+0000 7efc6659c700 1 --2- 172.21.15.2:0/1388334712 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc68143ae0 0x7efc50004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:17.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.225+0000 7efc6659c700 1 -- 172.21.15.2:0/1388334712 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc50004d90 msgr2=0x7efc50005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:17.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.225+0000 7efc6659c700 1 --2- 172.21.15.2:0/1388334712 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc50004d90 0x7efc50005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:17.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.225+0000 7efc6659c700 1 -- 172.21.15.2:0/1388334712 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc5c0094a0 con 0x7efc50003bc0 2023-11-26T07:12:17.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.226+0000 7efc6659c700 1 --2- 172.21.15.2:0/1388334712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc50003bc0 0x7efc50003fc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7efc5c009d30 tx=0x7efc50005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59d186f6aea2cb21 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:17.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.226+0000 7efc6559a700 1 -- 172.21.15.2:0/1388334712 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5c009e80 con 0x7efc50003bc0 2023-11-26T07:12:17.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.226+0000 7efc6559a700 1 -- 172.21.15.2:0/1388334712 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5c00e9a0 con 0x7efc50003bc0 2023-11-26T07:12:17.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.226+0000 7efc6559a700 1 -- 172.21.15.2:0/1388334712 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5c00ed10 con 0x7efc50003bc0 2023-11-26T07:12:17.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.226+0000 7efc6cbe4700 1 -- 172.21.15.2:0/1388334712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc50003bc0 msgr2=0x7efc50003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:17.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.226+0000 7efc6cbe4700 1 --2- 172.21.15.2:0/1388334712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc50003bc0 0x7efc50003fc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7efc5c009d30 tx=0x7efc50005880 comp rx=0 tx=0).stop 2023-11-26T07:12:17.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.226+0000 7efc66d9d700 1 -- 172.21.15.2:0/1388334712 reap_dead start 2023-11-26T07:12:17.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.226+0000 7efc6cbe4700 1 -- 172.21.15.2:0/1388334712 shutdown_connections 2023-11-26T07:12:17.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.226+0000 7efc6cbe4700 1 -- 172.21.15.2:0/1388334712 >> 172.21.15.2:0/1388334712 conn(0x7efc680b2740 msgr2=0x7efc680b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:17.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.226+0000 7efc6cbe4700 1 -- 172.21.15.2:0/1388334712 shutdown_connections 2023-11-26T07:12:17.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.226+0000 7efc6cbe4700 1 -- 172.21.15.2:0/1388334712 wait complete. 2023-11-26T07:12:17.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.228+0000 7efc6cbe4700 1 Processor -- start 2023-11-26T07:12:17.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.228+0000 7efc6cbe4700 1 -- start start 2023-11-26T07:12:17.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.229+0000 7efc6cbe4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc50003bc0 0x7efc6815d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:17.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.229+0000 7efc6cbe4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc6815ee90 0x7efc68151f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:17.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.229+0000 7efc6cbe4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc68155bd0 0x7efc68152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:17.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.229+0000 7efc6cbe4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6815ddf0 con 0x7efc50003bc0 2023-11-26T07:12:17.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.229+0000 7efc6cbe4700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6815e0d0 con 0x7efc6815ee90 2023-11-26T07:12:17.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.229+0000 7efc6cbe4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc6815e3b0 con 0x7efc68155bd0 2023-11-26T07:12:17.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.229+0000 7efc6659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc50003bc0 0x7efc6815d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:17.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.229+0000 7efc6659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc50003bc0 0x7efc6815d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40420/0 (socket says 172.21.15.2:40420) 2023-11-26T07:12:17.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.229+0000 7efc6659c700 1 -- 172.21.15.2:0/3954970668 learned_addr learned my addr 172.21.15.2:0/3954970668 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:17.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.229+0000 7efc65d9b700 1 --2- 172.21.15.2:0/3954970668 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc6815ee90 0x7efc68151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:17.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.229+0000 7efc66d9d700 1 --2- 172.21.15.2:0/3954970668 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc68155bd0 0x7efc68152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:17.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.229+0000 7efc6659c700 1 -- 172.21.15.2:0/3954970668 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc68155bd0 msgr2=0x7efc68152d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:17.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.229+0000 7efc6659c700 1 --2- 172.21.15.2:0/3954970668 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc68155bd0 0x7efc68152d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:17.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.229+0000 7efc6659c700 1 -- 172.21.15.2:0/3954970668 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc6815ee90 msgr2=0x7efc68151f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:17.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.229+0000 7efc6659c700 1 --2- 172.21.15.2:0/3954970668 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc6815ee90 0x7efc68151f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:17.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.229+0000 7efc6659c700 1 -- 172.21.15.2:0/3954970668 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6815e690 con 0x7efc50003bc0 2023-11-26T07:12:17.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.229+0000 7efc6659c700 1 --2- 172.21.15.2:0/3954970668 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc50003bc0 0x7efc6815d480 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7efc50005810 tx=0x7efc5c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:17.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.229+0000 7efc56ffd700 1 -- 172.21.15.2:0/3954970668 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5c003ab0 con 0x7efc50003bc0 2023-11-26T07:12:17.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.229+0000 7efc56ffd700 1 -- 172.21.15.2:0/3954970668 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5c003c10 con 0x7efc50003bc0 2023-11-26T07:12:17.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.229+0000 7efc6cbe4700 1 -- 172.21.15.2:0/3954970668 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc6815e970 con 0x7efc50003bc0 2023-11-26T07:12:17.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.229+0000 7efc56ffd700 1 -- 172.21.15.2:0/3954970668 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5c009e80 con 0x7efc50003bc0 2023-11-26T07:12:17.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.229+0000 7efc6cbe4700 1 -- 172.21.15.2:0/3954970668 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc6815dba0 con 0x7efc50003bc0 2023-11-26T07:12:17.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.230+0000 7efc6cbe4700 1 -- 172.21.15.2:0/3954970668 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc68068670 con 0x7efc50003bc0 2023-11-26T07:12:17.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.231+0000 7efc56ffd700 1 -- 172.21.15.2:0/3954970668 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efc5c013470 con 0x7efc50003bc0 2023-11-26T07:12:17.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.231+0000 7efc56ffd700 1 --2- 172.21.15.2:0/3954970668 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7efc4806af00 0x7efc4806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:17.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.231+0000 7efc56ffd700 1 -- 172.21.15.2:0/3954970668 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc5c08af20 con 0x7efc50003bc0 2023-11-26T07:12:17.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.232+0000 7efc65d9b700 1 --2- 172.21.15.2:0/3954970668 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7efc4806af00 0x7efc4806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:17.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.232+0000 7efc65d9b700 1 --2- 172.21.15.2:0/3954970668 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7efc4806af00 0x7efc4806d3c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efc580078e0 tx=0x7efc58007870 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:17.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.236+0000 7efc56ffd700 1 -- 172.21.15.2:0/3954970668 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efc5c056180 con 0x7efc50003bc0 2023-11-26T07:12:17.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.437+0000 7efc6cbe4700 1 -- 172.21.15.2:0/3954970668 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc6806bed0 con 0x7efc50003bc0 2023-11-26T07:12:17.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.438+0000 7efc56ffd700 1 -- 172.21.15.2:0/3954970668 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16457 (secure 0 0 0) 0x7efc6806bed0 con 0x7efc50003bc0 2023-11-26T07:12:17.442 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:12:17.442 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:11:35.634747+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:11:32.129474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:11:33.019837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:12:17.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.441+0000 7efc6cbe4700 1 -- 172.21.15.2:0/3954970668 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7efc4806af00 msgr2=0x7efc4806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:17.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.441+0000 7efc6cbe4700 1 --2- 172.21.15.2:0/3954970668 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7efc4806af00 0x7efc4806d3c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efc580078e0 tx=0x7efc58007870 comp rx=0 tx=0).stop 2023-11-26T07:12:17.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.441+0000 7efc6cbe4700 1 -- 172.21.15.2:0/3954970668 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc50003bc0 msgr2=0x7efc6815d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:17.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.441+0000 7efc6cbe4700 1 --2- 172.21.15.2:0/3954970668 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc50003bc0 0x7efc6815d480 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7efc50005810 tx=0x7efc5c0047c0 comp rx=0 tx=0).stop 2023-11-26T07:12:17.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.441+0000 7efc6cbe4700 1 -- 172.21.15.2:0/3954970668 shutdown_connections 2023-11-26T07:12:17.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.441+0000 7efc6cbe4700 1 --2- 172.21.15.2:0/3954970668 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7efc4806af00 0x7efc4806d3c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:17.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.441+0000 7efc6cbe4700 1 --2- 172.21.15.2:0/3954970668 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc68155bd0 0x7efc68152d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:17.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.441+0000 7efc6cbe4700 1 --2- 172.21.15.2:0/3954970668 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc50003bc0 0x7efc6815d480 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:17.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.441+0000 7efc6cbe4700 1 --2- 172.21.15.2:0/3954970668 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc6815ee90 0x7efc68151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:17.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.441+0000 7efc6cbe4700 1 -- 172.21.15.2:0/3954970668 >> 172.21.15.2:0/3954970668 conn(0x7efc680b2740 msgr2=0x7efc680cfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:17.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.441+0000 7efc6cbe4700 1 -- 172.21.15.2:0/3954970668 shutdown_connections 2023-11-26T07:12:17.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.441+0000 7efc6cbe4700 1 -- 172.21.15.2:0/3954970668 wait complete. 2023-11-26T07:12:17.456 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-26T07:12:17.456 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:12:17.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.578+0000 7f485a72e700 1 Processor -- start 2023-11-26T07:12:17.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.578+0000 7f485a72e700 1 -- start start 2023-11-26T07:12:17.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.579+0000 7f485a72e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48541448b0 0x7f485406ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:17.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.579+0000 7f485a72e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f48540b44c0 0x7f485406f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:17.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.579+0000 7f485a72e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f485406f7c0 0x7f485406db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:17.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.579+0000 7f485a72e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f485406fc50 con 0x7f48540b44c0 2023-11-26T07:12:17.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.579+0000 7f485a72e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4854144c90 con 0x7f485406f7c0 2023-11-26T07:12:17.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.579+0000 7f485a72e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48540b4c80 con 0x7f48541448b0 2023-11-26T07:12:17.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.579+0000 7f48537fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f48540b44c0 0x7f485406f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:17.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.579+0000 7f48537fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f48540b44c0 0x7f485406f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40428/0 (socket says 172.21.15.2:40428) 2023-11-26T07:12:17.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.579+0000 7f48537fe700 1 -- 172.21.15.2:0/3913074615 learned_addr learned my addr 172.21.15.2:0/3913074615 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:17.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.579+0000 7f4858ccb700 1 --2- 172.21.15.2:0/3913074615 >> v2:172.21.15.192:3300/0 conn(0x7f485406f7c0 0x7f485406db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:17.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.579+0000 7f4853fff700 1 --2- 172.21.15.2:0/3913074615 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48541448b0 0x7f485406ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:17.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.580+0000 7f48537fe700 1 -- 172.21.15.2:0/3913074615 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48541448b0 msgr2=0x7f485406ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:17.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.580+0000 7f48537fe700 1 --2- 172.21.15.2:0/3913074615 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48541448b0 0x7f485406ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:17.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.580+0000 7f48537fe700 1 -- 172.21.15.2:0/3913074615 >> v2:172.21.15.192:3300/0 conn(0x7f485406f7c0 msgr2=0x7f485406db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:17.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.580+0000 7f48537fe700 1 --2- 172.21.15.2:0/3913074615 >> v2:172.21.15.192:3300/0 conn(0x7f485406f7c0 0x7f485406db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:17.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.580+0000 7f48537fe700 1 -- 172.21.15.2:0/3913074615 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48540b4f60 con 0x7f48540b44c0 2023-11-26T07:12:17.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.580+0000 7f4858ccb700 1 --2- 172.21.15.2:0/3913074615 >> v2:172.21.15.192:3300/0 conn(0x7f485406f7c0 0x7f485406db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:17.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.580+0000 7f4853fff700 1 --2- 172.21.15.2:0/3913074615 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48541448b0 0x7f485406ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:17.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.580+0000 7f48537fe700 1 --2- 172.21.15.2:0/3913074615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48540b44c0 0x7f485406f280 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f48540cd1b0 tx=0x7f4844009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87f121c42ffd65a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:17.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.580+0000 7f4852ffd700 1 -- 172.21.15.2:0/3913074615 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484400b870 con 0x7f48540b44c0 2023-11-26T07:12:17.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.580+0000 7f4852ffd700 1 -- 172.21.15.2:0/3913074615 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484400b9d0 con 0x7f48540b44c0 2023-11-26T07:12:17.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.580+0000 7f4852ffd700 1 -- 172.21.15.2:0/3913074615 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484400bd60 con 0x7f48540b44c0 2023-11-26T07:12:17.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.580+0000 7f485a72e700 1 -- 172.21.15.2:0/3913074615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48540b44c0 msgr2=0x7f485406f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:17.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.580+0000 7f485a72e700 1 --2- 172.21.15.2:0/3913074615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48540b44c0 0x7f485406f280 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f48540cd1b0 tx=0x7f4844009bd0 comp rx=0 tx=0).stop 2023-11-26T07:12:17.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.580+0000 7f485a72e700 1 -- 172.21.15.2:0/3913074615 shutdown_connections 2023-11-26T07:12:17.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.580+0000 7f485a72e700 1 --2- 172.21.15.2:0/3913074615 >> v2:172.21.15.192:3300/0 conn(0x7f485406f7c0 0x7f485406db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:17.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.580+0000 7f485a72e700 1 --2- 172.21.15.2:0/3913074615 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48541448b0 0x7f485406ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:17.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.580+0000 7f485a72e700 1 --2- 172.21.15.2:0/3913074615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48540b44c0 0x7f485406f280 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:17.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.580+0000 7f485a72e700 1 -- 172.21.15.2:0/3913074615 >> 172.21.15.2:0/3913074615 conn(0x7f48540d0bc0 msgr2=0x7f48540d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:17.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.581+0000 7f485a72e700 1 -- 172.21.15.2:0/3913074615 shutdown_connections 2023-11-26T07:12:17.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.581+0000 7f485a72e700 1 -- 172.21.15.2:0/3913074615 wait complete. 2023-11-26T07:12:17.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.582+0000 7f485a72e700 1 Processor -- start 2023-11-26T07:12:17.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.582+0000 7f485a72e700 1 -- start start 2023-11-26T07:12:17.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.583+0000 7f485a72e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f485406f7c0 0x7f48541336a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:17.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.583+0000 7f485a72e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48540b44c0 0x7f4854138e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:17.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.583+0000 7f485a72e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48541448b0 0x7f48541566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:17.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.583+0000 7f485a72e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4854139840 con 0x7f48540b44c0 2023-11-26T07:12:17.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.583+0000 7f485a72e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4854153040 con 0x7f48541448b0 2023-11-26T07:12:17.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.583+0000 7f485a72e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4854153320 con 0x7f485406f7c0 2023-11-26T07:12:17.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.583+0000 7f48537fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48540b44c0 0x7f4854138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:17.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.583+0000 7f48537fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48540b44c0 0x7f4854138e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40436/0 (socket says 172.21.15.2:40436) 2023-11-26T07:12:17.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.583+0000 7f48537fe700 1 -- 172.21.15.2:0/3070319895 learned_addr learned my addr 172.21.15.2:0/3070319895 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:17.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.583+0000 7f4858ccb700 1 --2- 172.21.15.2:0/3070319895 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48541448b0 0x7f48541566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:17.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.583+0000 7f4853fff700 1 --2- 172.21.15.2:0/3070319895 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f485406f7c0 0x7f48541336a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:17.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.583+0000 7f48537fe700 1 -- 172.21.15.2:0/3070319895 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f485406f7c0 msgr2=0x7f48541336a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:17.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.583+0000 7f48537fe700 1 --2- 172.21.15.2:0/3070319895 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f485406f7c0 0x7f48541336a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:17.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.583+0000 7f48537fe700 1 -- 172.21.15.2:0/3070319895 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48541448b0 msgr2=0x7f48541566b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:17.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.583+0000 7f48537fe700 1 --2- 172.21.15.2:0/3070319895 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48541448b0 0x7f48541566b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:17.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.583+0000 7f48537fe700 1 -- 172.21.15.2:0/3070319895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4844009550 con 0x7f48540b44c0 2023-11-26T07:12:17.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.583+0000 7f48537fe700 1 --2- 172.21.15.2:0/3070319895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48540b44c0 0x7f4854138e60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4844000c00 tx=0x7f4844004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:17.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.583+0000 7f4850ff9700 1 -- 172.21.15.2:0/3070319895 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4844004480 con 0x7f48540b44c0 2023-11-26T07:12:17.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.584+0000 7f4850ff9700 1 -- 172.21.15.2:0/3070319895 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48440045e0 con 0x7f48540b44c0 2023-11-26T07:12:17.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.584+0000 7f485a72e700 1 -- 172.21.15.2:0/3070319895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4854153600 con 0x7f48540b44c0 2023-11-26T07:12:17.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.584+0000 7f4850ff9700 1 -- 172.21.15.2:0/3070319895 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48440038e0 con 0x7f48540b44c0 2023-11-26T07:12:17.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.584+0000 7f485a72e700 1 -- 172.21.15.2:0/3070319895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4854133be0 con 0x7f48540b44c0 2023-11-26T07:12:17.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.584+0000 7f485a72e700 1 -- 172.21.15.2:0/3070319895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4854068670 con 0x7f48540b44c0 2023-11-26T07:12:17.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.585+0000 7f4850ff9700 1 -- 172.21.15.2:0/3070319895 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4844021070 con 0x7f48540b44c0 2023-11-26T07:12:17.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.585+0000 7f4850ff9700 1 --2- 172.21.15.2:0/3070319895 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f483406aed0 0x7f483406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:17.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.585+0000 7f4850ff9700 1 -- 172.21.15.2:0/3070319895 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f484408ab10 con 0x7f48540b44c0 2023-11-26T07:12:17.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.586+0000 7f4853fff700 1 --2- 172.21.15.2:0/3070319895 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f483406aed0 0x7f483406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:17.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.586+0000 7f4853fff700 1 --2- 172.21.15.2:0/3070319895 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f483406aed0 0x7f483406d390 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f483c006f10 tx=0x7f483c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:17.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.590+0000 7f4850ff9700 1 -- 172.21.15.2:0/3070319895 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4844055c50 con 0x7f48540b44c0 2023-11-26T07:12:17.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.832+0000 7f485a72e700 1 -- 172.21.15.2:0/3070319895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f48540cea90 con 0x7f48540b44c0 2023-11-26T07:12:17.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.833+0000 7f4850ff9700 1 -- 172.21.15.2:0/3070319895 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7f4844019e60 con 0x7f48540b44c0 2023-11-26T07:12:17.836 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:12:17.836 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/3693634219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3693634219},{"type":"v1","addr":"172.21.15.2:6834","nonce":3693634219}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/953933423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":953933423},{"type":"v1","addr":"172.21.15.2:6835","nonce":953933423}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1000951065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1000951065},{"type":"v1","addr":"172.21.15.192:6836","nonce":1000951065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:11:34.051331+0000","modified":"2023-11-26T07:11:37.067662+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/4032661989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4032661989},{"type":"v1","addr":"172.21.15.192:6837","nonce":4032661989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-26T07:12:17.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.835+0000 7f485a72e700 1 -- 172.21.15.2:0/3070319895 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f483406aed0 msgr2=0x7f483406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:17.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.835+0000 7f485a72e700 1 --2- 172.21.15.2:0/3070319895 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f483406aed0 0x7f483406d390 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f483c006f10 tx=0x7f483c008040 comp rx=0 tx=0).stop 2023-11-26T07:12:17.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.835+0000 7f485a72e700 1 -- 172.21.15.2:0/3070319895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48540b44c0 msgr2=0x7f4854138e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:17.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.835+0000 7f485a72e700 1 --2- 172.21.15.2:0/3070319895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48540b44c0 0x7f4854138e60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4844000c00 tx=0x7f4844004750 comp rx=0 tx=0).stop 2023-11-26T07:12:17.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.835+0000 7f485a72e700 1 -- 172.21.15.2:0/3070319895 shutdown_connections 2023-11-26T07:12:17.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.835+0000 7f485a72e700 1 --2- 172.21.15.2:0/3070319895 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f483406aed0 0x7f483406d390 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:17.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.835+0000 7f485a72e700 1 --2- 172.21.15.2:0/3070319895 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48541448b0 0x7f48541566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:17.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.835+0000 7f485a72e700 1 --2- 172.21.15.2:0/3070319895 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f485406f7c0 0x7f48541336a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:17.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.835+0000 7f485a72e700 1 --2- 172.21.15.2:0/3070319895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48540b44c0 0x7f4854138e60 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:17.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.835+0000 7f485a72e700 1 -- 172.21.15.2:0/3070319895 >> 172.21.15.2:0/3070319895 conn(0x7f48540d0bc0 msgr2=0x7f48540cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:17.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.835+0000 7f485a72e700 1 -- 172.21.15.2:0/3070319895 shutdown_connections 2023-11-26T07:12:17.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.835+0000 7f485a72e700 1 -- 172.21.15.2:0/3070319895 wait complete. 2023-11-26T07:12:17.839 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 8 2023-11-26T07:12:17.850 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:12:17.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.972+0000 7f5a80fcc700 1 Processor -- start 2023-11-26T07:12:17.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.972+0000 7f5a80fcc700 1 -- start start 2023-11-26T07:12:17.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.973+0000 7f5a80fcc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5a7c0722c0 0x7f5a7c0b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:17.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.973+0000 7f5a80fcc700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a7c143ec0 con 0x7f5a7c143ae0 2023-11-26T07:12:17.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.973+0000 7f5a80fcc700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a7c0b3ae0 con 0x7f5a7c1440f0 2023-11-26T07:12:17.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.973+0000 7f5a80fcc700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a7c0b40a0 con 0x7f5a7c0722c0 2023-11-26T07:12:17.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.973+0000 7f5a79d9b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5a7c0722c0 0x7f5a7c0b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:17.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.973+0000 7f5a7a59c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f5a7c143ae0 0x7f5a7c071bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59884/0 (socket says 172.21.15.2:59884) 2023-11-26T07:12:17.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.974+0000 7f5a79d9b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5a7c0722c0 0x7f5a7c0b51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40444/0 (socket says 172.21.15.2:40444) 2023-11-26T07:12:17.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.974+0000 7f5a7a59c700 1 -- 172.21.15.2:0/2362252676 learned_addr learned my addr 172.21.15.2:0/2362252676 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:17.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.974+0000 7f5a79d9b700 1 -- 172.21.15.2:0/2362252676 >> v1:172.21.15.192:6789/0 conn(0x7f5a7c1440f0 legacy=0x7f5a7c06e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:17.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.974+0000 7f5a79d9b700 1 -- 172.21.15.2:0/2362252676 >> v1:172.21.15.2:6789/0 conn(0x7f5a7c143ae0 legacy=0x7f5a7c071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:17.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.974+0000 7f5a79d9b700 1 -- 172.21.15.2:0/2362252676 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a7c0b3dc0 con 0x7f5a7c0722c0 2023-11-26T07:12:17.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.974+0000 7f5a7959a700 1 -- 172.21.15.2:0/2362252676 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2213486221 0 0) 0x7f5a7c143ec0 con 0x7f5a7c143ae0 2023-11-26T07:12:17.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.974+0000 7f5a79d9b700 1 --2- 172.21.15.2:0/2362252676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a7c0722c0 0x7f5a7c0b51b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c009840 tx=0x7f5a6c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6af0788af733af1e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:17.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.974+0000 7f5a7959a700 1 -- 172.21.15.2:0/2362252676 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c011830 con 0x7f5a7c0722c0 2023-11-26T07:12:17.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.974+0000 7f5a7959a700 1 -- 172.21.15.2:0/2362252676 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6c011990 con 0x7f5a7c0722c0 2023-11-26T07:12:17.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.974+0000 7f5a7959a700 1 -- 172.21.15.2:0/2362252676 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c011d20 con 0x7f5a7c0722c0 2023-11-26T07:12:17.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.975+0000 7f5a80fcc700 1 -- 172.21.15.2:0/2362252676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a7c0722c0 msgr2=0x7f5a7c0b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:17.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.975+0000 7f5a80fcc700 1 --2- 172.21.15.2:0/2362252676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a7c0722c0 0x7f5a7c0b51b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c009840 tx=0x7f5a6c009b50 comp rx=0 tx=0).stop 2023-11-26T07:12:17.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.975+0000 7f5a80fcc700 1 -- 172.21.15.2:0/2362252676 shutdown_connections 2023-11-26T07:12:17.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.975+0000 7f5a80fcc700 1 --2- 172.21.15.2:0/2362252676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a7c0722c0 0x7f5a7c0b51b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:17.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.975+0000 7f5a80fcc700 1 -- 172.21.15.2:0/2362252676 >> 172.21.15.2:0/2362252676 conn(0x7f5a7c0b2740 msgr2=0x7f5a7c0b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:17.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.975+0000 7f5a80fcc700 1 -- 172.21.15.2:0/2362252676 shutdown_connections 2023-11-26T07:12:17.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.975+0000 7f5a80fcc700 1 -- 172.21.15.2:0/2362252676 wait complete. 2023-11-26T07:12:17.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.976+0000 7f5a80fcc700 1 Processor -- start 2023-11-26T07:12:17.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.976+0000 7f5a80fcc700 1 -- start start 2023-11-26T07:12:17.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.977+0000 7f5a80fcc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a7c0722c0 0x7f5a7c1f1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:17.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.977+0000 7f5a80fcc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a7c143ae0 0x7f5a7c158c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:17.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.977+0000 7f5a80fcc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a7c1440f0 0x7f5a7c159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:17.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.977+0000 7f5a80fcc700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7c157410 con 0x7f5a7c143ae0 2023-11-26T07:12:17.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.977+0000 7f5a80fcc700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7c1576f0 con 0x7f5a7c0722c0 2023-11-26T07:12:17.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.977+0000 7f5a80fcc700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7c1579d0 con 0x7f5a7c1440f0 2023-11-26T07:12:17.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.977+0000 7f5a79d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a7c143ae0 0x7f5a7c158c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:17.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.977+0000 7f5a79d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a7c143ae0 0x7f5a7c158c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40450/0 (socket says 172.21.15.2:40450) 2023-11-26T07:12:17.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.977+0000 7f5a79d9b700 1 -- 172.21.15.2:0/3113794616 learned_addr learned my addr 172.21.15.2:0/3113794616 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:17.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.977+0000 7f5a7a59c700 1 --2- 172.21.15.2:0/3113794616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a7c0722c0 0x7f5a7c1f1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:17.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.977+0000 7f5a7ad9d700 1 --2- 172.21.15.2:0/3113794616 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a7c1440f0 0x7f5a7c159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:17.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.977+0000 7f5a79d9b700 1 -- 172.21.15.2:0/3113794616 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a7c1440f0 msgr2=0x7f5a7c159140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:17.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.977+0000 7f5a79d9b700 1 --2- 172.21.15.2:0/3113794616 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a7c1440f0 0x7f5a7c159140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:17.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.977+0000 7f5a79d9b700 1 -- 172.21.15.2:0/3113794616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a7c0722c0 msgr2=0x7f5a7c1f1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:17.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.977+0000 7f5a79d9b700 1 --2- 172.21.15.2:0/3113794616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a7c0722c0 0x7f5a7c1f1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:17.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.977+0000 7f5a79d9b700 1 -- 172.21.15.2:0/3113794616 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a6c0094a0 con 0x7f5a7c143ae0 2023-11-26T07:12:17.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.977+0000 7f5a7a59c700 1 --2- 172.21.15.2:0/3113794616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a7c0722c0 0x7f5a7c1f1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:17.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.977+0000 7f5a79d9b700 1 --2- 172.21.15.2:0/3113794616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a7c143ae0 0x7f5a7c158c00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c0090b0 tx=0x7f5a6c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:17.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.978+0000 7f5a6affd700 1 -- 172.21.15.2:0/3113794616 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c01a900 con 0x7f5a7c143ae0 2023-11-26T07:12:17.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.978+0000 7f5a6affd700 1 -- 172.21.15.2:0/3113794616 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6c01aa60 con 0x7f5a7c143ae0 2023-11-26T07:12:17.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.978+0000 7f5a80fcc700 1 -- 172.21.15.2:0/3113794616 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a7c157cb0 con 0x7f5a7c143ae0 2023-11-26T07:12:17.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.978+0000 7f5a6affd700 1 -- 172.21.15.2:0/3113794616 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c01add0 con 0x7f5a7c143ae0 2023-11-26T07:12:17.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.978+0000 7f5a80fcc700 1 -- 172.21.15.2:0/3113794616 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a7c156f80 con 0x7f5a7c143ae0 2023-11-26T07:12:17.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.979+0000 7f5a80fcc700 1 -- 172.21.15.2:0/3113794616 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a7c1f2280 con 0x7f5a7c143ae0 2023-11-26T07:12:17.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.979+0000 7f5a6affd700 1 -- 172.21.15.2:0/3113794616 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5a6c022070 con 0x7f5a7c143ae0 2023-11-26T07:12:17.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.980+0000 7f5a6affd700 1 --2- 172.21.15.2:0/3113794616 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5a5c06aed0 0x7f5a5c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:17.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.980+0000 7f5a6affd700 1 -- 172.21.15.2:0/3113794616 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5a6c08a820 con 0x7f5a7c143ae0 2023-11-26T07:12:17.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.980+0000 7f5a7a59c700 1 --2- 172.21.15.2:0/3113794616 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5a5c06aed0 0x7f5a5c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:17.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.980+0000 7f5a7a59c700 1 --2- 172.21.15.2:0/3113794616 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5a5c06aed0 0x7f5a5c06d390 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5a70000f60 tx=0x7f5a70007ce0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:17.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:17.984+0000 7f5a6affd700 1 -- 172.21.15.2:0/3113794616 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5a6c055a10 con 0x7f5a7c143ae0 2023-11-26T07:12:18.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.229+0000 7f5a80fcc700 1 -- 172.21.15.2:0/3113794616 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5a7c158a00 con 0x7f5a7c143ae0 2023-11-26T07:12:18.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.230+0000 7f5a6affd700 1 -- 172.21.15.2:0/3113794616 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7f5a6c029090 con 0x7f5a7c143ae0 2023-11-26T07:12:18.232 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:12:18.233 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/3693634219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3693634219},{"type":"v1","addr":"172.21.15.2:6834","nonce":3693634219}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/953933423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":953933423},{"type":"v1","addr":"172.21.15.2:6835","nonce":953933423}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1000951065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1000951065},{"type":"v1","addr":"172.21.15.192:6836","nonce":1000951065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:11:34.051331+0000","modified":"2023-11-26T07:11:37.067662+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/4032661989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4032661989},{"type":"v1","addr":"172.21.15.192:6837","nonce":4032661989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-26T07:12:18.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.232+0000 7f5a80fcc700 1 -- 172.21.15.2:0/3113794616 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5a5c06aed0 msgr2=0x7f5a5c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:18.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.232+0000 7f5a80fcc700 1 --2- 172.21.15.2:0/3113794616 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5a5c06aed0 0x7f5a5c06d390 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5a70000f60 tx=0x7f5a70007ce0 comp rx=0 tx=0).stop 2023-11-26T07:12:18.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.232+0000 7f5a80fcc700 1 -- 172.21.15.2:0/3113794616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a7c143ae0 msgr2=0x7f5a7c158c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:18.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.232+0000 7f5a80fcc700 1 --2- 172.21.15.2:0/3113794616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a7c143ae0 0x7f5a7c158c00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c0090b0 tx=0x7f5a6c004750 comp rx=0 tx=0).stop 2023-11-26T07:12:18.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.232+0000 7f5a80fcc700 1 -- 172.21.15.2:0/3113794616 shutdown_connections 2023-11-26T07:12:18.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.232+0000 7f5a80fcc700 1 --2- 172.21.15.2:0/3113794616 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5a5c06aed0 0x7f5a5c06d390 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:18.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.232+0000 7f5a80fcc700 1 --2- 172.21.15.2:0/3113794616 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a7c1440f0 0x7f5a7c159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:18.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.232+0000 7f5a80fcc700 1 --2- 172.21.15.2:0/3113794616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a7c0722c0 0x7f5a7c1f1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:18.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.232+0000 7f5a80fcc700 1 --2- 172.21.15.2:0/3113794616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a7c143ae0 0x7f5a7c158c00 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:18.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.232+0000 7f5a80fcc700 1 -- 172.21.15.2:0/3113794616 >> 172.21.15.2:0/3113794616 conn(0x7f5a7c0b2740 msgr2=0x7f5a7c1582f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:18.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.232+0000 7f5a80fcc700 1 -- 172.21.15.2:0/3113794616 shutdown_connections 2023-11-26T07:12:18.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.232+0000 7f5a80fcc700 1 -- 172.21.15.2:0/3113794616 wait complete. 2023-11-26T07:12:18.236 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 8 2023-11-26T07:12:18.247 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:12:18.372 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.369+0000 7f651c4a1700 1 Processor -- start 2023-11-26T07:12:18.372 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.369+0000 7f651c4a1700 1 -- start start 2023-11-26T07:12:18.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.370+0000 7f651c4a1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6514144c10 0x7f651406afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:18.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.370+0000 7f651c4a1700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6514145100 0x7f651406b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:18.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.370+0000 7f651c4a1700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f651406eb80 con 0x7f6514145650 2023-11-26T07:12:18.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.370+0000 7f651c4a1700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f651406f500 con 0x7f6514145100 2023-11-26T07:12:18.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.370+0000 7f651c4a1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65140cd610 con 0x7f6514144c10 2023-11-26T07:12:18.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.370+0000 7f651aa3e700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f6514145650 0x7f6514071bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59902/0 (socket says 172.21.15.2:59902) 2023-11-26T07:12:18.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.370+0000 7f651aa3e700 1 -- 172.21.15.2:0/1387940581 learned_addr learned my addr 172.21.15.2:0/1387940581 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:18.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.371+0000 7f6519a3c700 1 --2- 172.21.15.2:0/1387940581 >> v2:172.21.15.192:3300/0 conn(0x7f6514145100 0x7f651406b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:18.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.371+0000 7f651a23d700 1 --2- 172.21.15.2:0/1387940581 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6514144c10 0x7f651406afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:18.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.371+0000 7f651923b700 1 -- 172.21.15.2:0/1387940581 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 856205643 0 0) 0x7f651406eb80 con 0x7f6514145650 2023-11-26T07:12:18.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.371+0000 7f651923b700 1 -- 172.21.15.2:0/1387940581 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65000035b0 con 0x7f6514145650 2023-11-26T07:12:18.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.371+0000 7f651923b700 1 -- 172.21.15.2:0/1387940581 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3375941323 0 0) 0x7f65000035b0 con 0x7f6514145650 2023-11-26T07:12:18.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.371+0000 7f651923b700 1 -- 172.21.15.2:0/1387940581 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6514144c10 msgr2=0x7f651406afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:18.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.371+0000 7f651923b700 1 --2- 172.21.15.2:0/1387940581 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6514144c10 0x7f651406afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:18.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.371+0000 7f651923b700 1 -- 172.21.15.2:0/1387940581 >> v2:172.21.15.192:3300/0 conn(0x7f6514145100 msgr2=0x7f651406b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:18.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.371+0000 7f651923b700 1 --2- 172.21.15.2:0/1387940581 >> v2:172.21.15.192:3300/0 conn(0x7f6514145100 0x7f651406b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:18.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.371+0000 7f651923b700 1 -- 172.21.15.2:0/1387940581 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6514160720 con 0x7f6514145650 2023-11-26T07:12:18.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.371+0000 7f651923b700 1 -- 172.21.15.2:0/1387940581 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f650c0019f0 con 0x7f6514145650 2023-11-26T07:12:18.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.371+0000 7f651923b700 1 -- 172.21.15.2:0/1387940581 >> v1:172.21.15.2:6789/0 conn(0x7f6514145650 legacy=0x7f6514071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:18.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.371+0000 7f651923b700 1 --2- 172.21.15.2:0/1387940581 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6514144c10 0x7f6500003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:18.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.371+0000 7f651923b700 1 --2- 172.21.15.2:0/1387940581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6500003f40 0x7f6500004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:18.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.371+0000 7f651923b700 1 --2- 172.21.15.2:0/1387940581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6500004d90 0x7f6500005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:18.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.371+0000 7f651923b700 1 -- 172.21.15.2:0/1387940581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f651406f500 con 0x7f6500003f40 2023-11-26T07:12:18.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.371+0000 7f651923b700 1 -- 172.21.15.2:0/1387940581 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65140cd610 con 0x7f6500004d90 2023-11-26T07:12:18.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.371+0000 7f651923b700 1 -- 172.21.15.2:0/1387940581 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f650000ba10 con 0x7f6514144c10 2023-11-26T07:12:18.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.371+0000 7f6519a3c700 1 --2- 172.21.15.2:0/1387940581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6500003f40 0x7f6500004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:18.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.371+0000 7f651a23d700 1 --2- 172.21.15.2:0/1387940581 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6514144c10 0x7f6500003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:18.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.371+0000 7f651aa3e700 1 --2- 172.21.15.2:0/1387940581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6500004d90 0x7f6500005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:18.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.371+0000 7f6519a3c700 1 -- 172.21.15.2:0/1387940581 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6514144c10 msgr2=0x7f6500003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:18.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.371+0000 7f6519a3c700 1 --2- 172.21.15.2:0/1387940581 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6514144c10 0x7f6500003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:18.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.371+0000 7f6519a3c700 1 -- 172.21.15.2:0/1387940581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6500004d90 msgr2=0x7f6500005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:18.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.371+0000 7f6519a3c700 1 --2- 172.21.15.2:0/1387940581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6500004d90 0x7f6500005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:18.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.371+0000 7f6519a3c700 1 -- 172.21.15.2:0/1387940581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65000035b0 con 0x7f6500003f40 2023-11-26T07:12:18.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.372+0000 7f651aa3e700 1 --2- 172.21.15.2:0/1387940581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6500004d90 0x7f6500005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:18.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.372+0000 7f6519a3c700 1 --2- 172.21.15.2:0/1387940581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6500003f40 0x7f6500004850 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6508009b60 tx=0x7f6500005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f2d1ec1b9c89c1f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:18.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.372+0000 7f651923b700 1 -- 172.21.15.2:0/1387940581 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650800e6c0 con 0x7f6500003f40 2023-11-26T07:12:18.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.372+0000 7f651923b700 1 -- 172.21.15.2:0/1387940581 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f650800e820 con 0x7f6500003f40 2023-11-26T07:12:18.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.372+0000 7f651923b700 1 -- 172.21.15.2:0/1387940581 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650800eb90 con 0x7f6500003f40 2023-11-26T07:12:18.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.372+0000 7f651c4a1700 1 -- 172.21.15.2:0/1387940581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6500003f40 msgr2=0x7f6500004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:18.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.372+0000 7f651c4a1700 1 --2- 172.21.15.2:0/1387940581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6500003f40 0x7f6500004850 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6508009b60 tx=0x7f6500005880 comp rx=0 tx=0).stop 2023-11-26T07:12:18.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.372+0000 7f651aa3e700 1 -- 172.21.15.2:0/1387940581 reap_dead start 2023-11-26T07:12:18.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.372+0000 7f651c4a1700 1 -- 172.21.15.2:0/1387940581 shutdown_connections 2023-11-26T07:12:18.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.372+0000 7f651c4a1700 1 -- 172.21.15.2:0/1387940581 >> 172.21.15.2:0/1387940581 conn(0x7f65140b2740 msgr2=0x7f65140b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:18.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.372+0000 7f651c4a1700 1 -- 172.21.15.2:0/1387940581 shutdown_connections 2023-11-26T07:12:18.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.372+0000 7f651c4a1700 1 -- 172.21.15.2:0/1387940581 wait complete. 2023-11-26T07:12:18.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.374+0000 7f651c4a1700 1 Processor -- start 2023-11-26T07:12:18.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.374+0000 7f651c4a1700 1 -- start start 2023-11-26T07:12:18.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.374+0000 7f651c4a1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6500003f40 0x7f65140a9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:18.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.374+0000 7f651c4a1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f651415e750 0x7f651415f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:18.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.374+0000 7f651c4a1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65141512b0 0x7f65141f1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:18.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.374+0000 7f651c4a1700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f651415fb20 con 0x7f65141512b0 2023-11-26T07:12:18.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.374+0000 7f651c4a1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f651415d6b0 con 0x7f651415e750 2023-11-26T07:12:18.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.374+0000 7f651c4a1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f651415d990 con 0x7f6500003f40 2023-11-26T07:12:18.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.375+0000 7f651aa3e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65141512b0 0x7f65141f1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:18.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.375+0000 7f651aa3e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65141512b0 0x7f65141f1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40472/0 (socket says 172.21.15.2:40472) 2023-11-26T07:12:18.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.375+0000 7f651aa3e700 1 -- 172.21.15.2:0/2825212528 learned_addr learned my addr 172.21.15.2:0/2825212528 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:18.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.375+0000 7f651a23d700 1 --2- 172.21.15.2:0/2825212528 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6500003f40 0x7f65140a9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:18.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.375+0000 7f6519a3c700 1 --2- 172.21.15.2:0/2825212528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f651415e750 0x7f651415f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:18.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.375+0000 7f651aa3e700 1 -- 172.21.15.2:0/2825212528 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6500003f40 msgr2=0x7f65140a9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:18.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.375+0000 7f651aa3e700 1 --2- 172.21.15.2:0/2825212528 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6500003f40 0x7f65140a9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:18.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.375+0000 7f651aa3e700 1 -- 172.21.15.2:0/2825212528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f651415e750 msgr2=0x7f651415f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:18.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.375+0000 7f651aa3e700 1 --2- 172.21.15.2:0/2825212528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f651415e750 0x7f651415f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:18.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.375+0000 7f651aa3e700 1 -- 172.21.15.2:0/2825212528 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f651415dc70 con 0x7f65141512b0 2023-11-26T07:12:18.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.375+0000 7f651a23d700 1 --2- 172.21.15.2:0/2825212528 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6500003f40 0x7f65140a9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:12:18.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.375+0000 7f6519a3c700 1 --2- 172.21.15.2:0/2825212528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f651415e750 0x7f651415f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:12:18.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.375+0000 7f651aa3e700 1 --2- 172.21.15.2:0/2825212528 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65141512b0 0x7f65141f1b00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f650c001e20 tx=0x7f650c006510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:18.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.375+0000 7f6506ffd700 1 -- 172.21.15.2:0/2825212528 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650c008b60 con 0x7f65141512b0 2023-11-26T07:12:18.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.375+0000 7f6506ffd700 1 -- 172.21.15.2:0/2825212528 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f650c006c80 con 0x7f65141512b0 2023-11-26T07:12:18.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.375+0000 7f651c4a1700 1 -- 172.21.15.2:0/2825212528 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f651415df50 con 0x7f65141512b0 2023-11-26T07:12:18.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.375+0000 7f6506ffd700 1 -- 172.21.15.2:0/2825212528 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650c015480 con 0x7f65141512b0 2023-11-26T07:12:18.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.375+0000 7f651c4a1700 1 -- 172.21.15.2:0/2825212528 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6514151720 con 0x7f65141512b0 2023-11-26T07:12:18.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.376+0000 7f651c4a1700 1 -- 172.21.15.2:0/2825212528 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6514067a40 con 0x7f65141512b0 2023-11-26T07:12:18.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.377+0000 7f6506ffd700 1 -- 172.21.15.2:0/2825212528 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f650c01e3b0 con 0x7f65141512b0 2023-11-26T07:12:18.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.377+0000 7f6506ffd700 1 --2- 172.21.15.2:0/2825212528 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f64f806aed0 0x7f64f806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:18.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.377+0000 7f6506ffd700 1 -- 172.21.15.2:0/2825212528 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f650c089530 con 0x7f65141512b0 2023-11-26T07:12:18.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.378+0000 7f651a23d700 1 --2- 172.21.15.2:0/2825212528 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f64f806aed0 0x7f64f806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:18.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.378+0000 7f651a23d700 1 --2- 172.21.15.2:0/2825212528 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f64f806aed0 0x7f64f806d390 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6510009a80 tx=0x7f6510008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:18.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.382+0000 7f6506ffd700 1 -- 172.21.15.2:0/2825212528 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6514067a40 con 0x7f65141512b0 2023-11-26T07:12:18.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.583+0000 7f651c4a1700 1 -- 172.21.15.2:0/2825212528 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6514067a40 con 0x7f65141512b0 2023-11-26T07:12:18.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.584+0000 7f6506ffd700 1 -- 172.21.15.2:0/2825212528 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f6514067a40 con 0x7f65141512b0 2023-11-26T07:12:18.587 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:12:18.587 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:11:35.634747+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:11:32.129474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:11:33.019837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:12:18.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.586+0000 7f651c4a1700 1 -- 172.21.15.2:0/2825212528 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f64f806aed0 msgr2=0x7f64f806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:18.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.586+0000 7f651c4a1700 1 --2- 172.21.15.2:0/2825212528 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f64f806aed0 0x7f64f806d390 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6510009a80 tx=0x7f6510008040 comp rx=0 tx=0).stop 2023-11-26T07:12:18.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.586+0000 7f651c4a1700 1 -- 172.21.15.2:0/2825212528 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65141512b0 msgr2=0x7f65141f1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:18.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.586+0000 7f651c4a1700 1 --2- 172.21.15.2:0/2825212528 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65141512b0 0x7f65141f1b00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f650c001e20 tx=0x7f650c006510 comp rx=0 tx=0).stop 2023-11-26T07:12:18.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.586+0000 7f651c4a1700 1 -- 172.21.15.2:0/2825212528 shutdown_connections 2023-11-26T07:12:18.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.586+0000 7f651c4a1700 1 --2- 172.21.15.2:0/2825212528 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f64f806aed0 0x7f64f806d390 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:18.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.586+0000 7f651c4a1700 1 --2- 172.21.15.2:0/2825212528 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65141512b0 0x7f65141f1b00 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:18.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.586+0000 7f651c4a1700 1 --2- 172.21.15.2:0/2825212528 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6500003f40 0x7f65140a9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:18.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.586+0000 7f651c4a1700 1 --2- 172.21.15.2:0/2825212528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f651415e750 0x7f651415f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:18.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.586+0000 7f651c4a1700 1 -- 172.21.15.2:0/2825212528 >> 172.21.15.2:0/2825212528 conn(0x7f65140b2740 msgr2=0x7f65140cf090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:18.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.586+0000 7f651c4a1700 1 -- 172.21.15.2:0/2825212528 shutdown_connections 2023-11-26T07:12:18.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.586+0000 7f651c4a1700 1 -- 172.21.15.2:0/2825212528 wait complete. 2023-11-26T07:12:18.601 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-26T07:12:18.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.725+0000 7f9227842700 1 Processor -- start 2023-11-26T07:12:18.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.725+0000 7f9227842700 1 -- start start 2023-11-26T07:12:18.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.726+0000 7f9227842700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f922006afd0 0x7f92200b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:18.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.726+0000 7f9227842700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92200ad860 con 0x7f9220071b40 2023-11-26T07:12:18.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.726+0000 7f9227842700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92200d0a20 con 0x7f922006edc0 2023-11-26T07:12:18.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.726+0000 7f9227842700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f922006f830 con 0x7f922006afd0 2023-11-26T07:12:18.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.726+0000 7f92255de700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f922006afd0 0x7f92200b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:18.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.726+0000 7f9225ddf700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f9220071b40 0x7f9220071ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59922/0 (socket says 172.21.15.2:59922) 2023-11-26T07:12:18.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.726+0000 7f92255de700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f922006afd0 0x7f92200b5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40476/0 (socket says 172.21.15.2:40476) 2023-11-26T07:12:18.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.726+0000 7f9225ddf700 1 -- 172.21.15.2:0/1060183775 learned_addr learned my addr 172.21.15.2:0/1060183775 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:18.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.726+0000 7f92255de700 1 -- 172.21.15.2:0/1060183775 >> v1:172.21.15.192:6789/0 conn(0x7f922006edc0 legacy=0x7f922006b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:18.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.726+0000 7f92255de700 1 -- 172.21.15.2:0/1060183775 >> v1:172.21.15.2:6789/0 conn(0x7f9220071b40 legacy=0x7f9220071ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:18.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.726+0000 7f9213fff700 1 -- 172.21.15.2:0/1060183775 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1479813044 0 0) 0x7f92200ad860 con 0x7f9220071b40 2023-11-26T07:12:18.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.726+0000 7f92255de700 1 -- 172.21.15.2:0/1060183775 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9220162a70 con 0x7f922006afd0 2023-11-26T07:12:18.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.727+0000 7f92255de700 1 --2- 172.21.15.2:0/1060183775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f922006afd0 0x7f92200b5a70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f921c009840 tx=0x7f921c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93f21b25a7e26ca3 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:18.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.727+0000 7f9213fff700 1 -- 172.21.15.2:0/1060183775 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c011830 con 0x7f922006afd0 2023-11-26T07:12:18.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.727+0000 7f9213fff700 1 -- 172.21.15.2:0/1060183775 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921c011990 con 0x7f922006afd0 2023-11-26T07:12:18.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.727+0000 7f9213fff700 1 -- 172.21.15.2:0/1060183775 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c011d20 con 0x7f922006afd0 2023-11-26T07:12:18.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.727+0000 7f9227842700 1 -- 172.21.15.2:0/1060183775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f922006afd0 msgr2=0x7f92200b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:18.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.727+0000 7f9227842700 1 --2- 172.21.15.2:0/1060183775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f922006afd0 0x7f92200b5a70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f921c009840 tx=0x7f921c009b50 comp rx=0 tx=0).stop 2023-11-26T07:12:18.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.727+0000 7f9227842700 1 -- 172.21.15.2:0/1060183775 shutdown_connections 2023-11-26T07:12:18.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.727+0000 7f9227842700 1 --2- 172.21.15.2:0/1060183775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f922006afd0 0x7f92200b5a70 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:18.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.727+0000 7f9227842700 1 -- 172.21.15.2:0/1060183775 >> 172.21.15.2:0/1060183775 conn(0x7f92200b2840 msgr2=0x7f92200b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:18.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.728+0000 7f9227842700 1 -- 172.21.15.2:0/1060183775 shutdown_connections 2023-11-26T07:12:18.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.728+0000 7f9227842700 1 -- 172.21.15.2:0/1060183775 wait complete. 2023-11-26T07:12:18.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.729+0000 7f9227842700 1 Processor -- start 2023-11-26T07:12:18.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.729+0000 7f9227842700 1 -- start start 2023-11-26T07:12:18.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.729+0000 7f9227842700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f922006afd0 0x7f92201f42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:18.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.729+0000 7f9227842700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f922006edc0 0x7f92200c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:18.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.729+0000 7f9227842700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9220071b40 0x7f92200c6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:18.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.729+0000 7f9227842700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92200c70d0 con 0x7f9220071b40 2023-11-26T07:12:18.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.729+0000 7f9227842700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922015a860 con 0x7f922006edc0 2023-11-26T07:12:18.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.729+0000 7f9227842700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f922015ab40 con 0x7f922006afd0 2023-11-26T07:12:18.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.730+0000 7f9225ddf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9220071b40 0x7f92200c6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:18.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.730+0000 7f9225ddf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9220071b40 0x7f92200c6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40486/0 (socket says 172.21.15.2:40486) 2023-11-26T07:12:18.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.730+0000 7f9225ddf700 1 -- 172.21.15.2:0/1300482511 learned_addr learned my addr 172.21.15.2:0/1300482511 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:18.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.730+0000 7f9224ddd700 1 --2- 172.21.15.2:0/1300482511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f922006edc0 0x7f92200c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:18.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.730+0000 7f92255de700 1 --2- 172.21.15.2:0/1300482511 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f922006afd0 0x7f92201f42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:18.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.730+0000 7f9225ddf700 1 -- 172.21.15.2:0/1300482511 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f922006afd0 msgr2=0x7f92201f42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:18.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.730+0000 7f9225ddf700 1 --2- 172.21.15.2:0/1300482511 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f922006afd0 0x7f92201f42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:18.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.730+0000 7f9225ddf700 1 -- 172.21.15.2:0/1300482511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f922006edc0 msgr2=0x7f92200c7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:18.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.730+0000 7f9225ddf700 1 --2- 172.21.15.2:0/1300482511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f922006edc0 0x7f92200c7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:18.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.730+0000 7f9225ddf700 1 -- 172.21.15.2:0/1300482511 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f921c0094a0 con 0x7f9220071b40 2023-11-26T07:12:18.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.730+0000 7f9225ddf700 1 --2- 172.21.15.2:0/1300482511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9220071b40 0x7f92200c6750 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f921800cba0 tx=0x7f921800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:18.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.730+0000 7f9211ffb700 1 -- 172.21.15.2:0/1300482511 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921800aaa0 con 0x7f9220071b40 2023-11-26T07:12:18.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.730+0000 7f9211ffb700 1 -- 172.21.15.2:0/1300482511 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921800ac20 con 0x7f9220071b40 2023-11-26T07:12:18.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.730+0000 7f9227842700 1 -- 172.21.15.2:0/1300482511 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f922015ae20 con 0x7f9220071b40 2023-11-26T07:12:18.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.730+0000 7f9211ffb700 1 -- 172.21.15.2:0/1300482511 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92180070d0 con 0x7f9220071b40 2023-11-26T07:12:18.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.730+0000 7f9227842700 1 -- 172.21.15.2:0/1300482511 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92201f4810 con 0x7f9220071b40 2023-11-26T07:12:18.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.731+0000 7f9227842700 1 -- 172.21.15.2:0/1300482511 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92200b4db0 con 0x7f9220071b40 2023-11-26T07:12:18.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.732+0000 7f9211ffb700 1 -- 172.21.15.2:0/1300482511 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9218007230 con 0x7f9220071b40 2023-11-26T07:12:18.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.732+0000 7f9211ffb700 1 --2- 172.21.15.2:0/1300482511 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f920406aed0 0x7f920406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:18.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.732+0000 7f9211ffb700 1 -- 172.21.15.2:0/1300482511 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9218089350 con 0x7f9220071b40 2023-11-26T07:12:18.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.732+0000 7f92255de700 1 --2- 172.21.15.2:0/1300482511 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f920406aed0 0x7f920406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:18.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.733+0000 7f92255de700 1 --2- 172.21.15.2:0/1300482511 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f920406aed0 0x7f920406d390 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f921c0090b0 tx=0x7f921c01c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:18.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.737+0000 7f9211ffb700 1 -- 172.21.15.2:0/1300482511 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9218054400 con 0x7f9220071b40 2023-11-26T07:12:18.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.981+0000 7f9227842700 1 -- 172.21.15.2:0/1300482511 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f922015b340 con 0x7f9220071b40 2023-11-26T07:12:18.984 INFO:tasks.ceph.mon.a.smithi002.stderr:2023-11-26T07:12:18.982+0000 7f35cd3c3700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-26T07:12:18.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.983+0000 7f9211ffb700 1 -- 172.21.15.2:0/1300482511 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f922015b340 con 0x7f9220071b40 2023-11-26T07:12:18.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.985+0000 7f9227842700 1 -- 172.21.15.2:0/1300482511 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f920406aed0 msgr2=0x7f920406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:18.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.985+0000 7f9227842700 1 --2- 172.21.15.2:0/1300482511 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f920406aed0 0x7f920406d390 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f921c0090b0 tx=0x7f921c01c040 comp rx=0 tx=0).stop 2023-11-26T07:12:18.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.985+0000 7f9227842700 1 -- 172.21.15.2:0/1300482511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9220071b40 msgr2=0x7f92200c6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:18.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.985+0000 7f9227842700 1 --2- 172.21.15.2:0/1300482511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9220071b40 0x7f92200c6750 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f921800cba0 tx=0x7f921800ceb0 comp rx=0 tx=0).stop 2023-11-26T07:12:18.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.985+0000 7f9227842700 1 -- 172.21.15.2:0/1300482511 shutdown_connections 2023-11-26T07:12:18.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.985+0000 7f9227842700 1 --2- 172.21.15.2:0/1300482511 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f920406aed0 0x7f920406d390 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:18.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.985+0000 7f9227842700 1 --2- 172.21.15.2:0/1300482511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9220071b40 0x7f92200c6750 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:18.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.985+0000 7f9227842700 1 --2- 172.21.15.2:0/1300482511 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f922006afd0 0x7f92201f42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:18.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.985+0000 7f9227842700 1 --2- 172.21.15.2:0/1300482511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f922006edc0 0x7f92200c7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:18.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.985+0000 7f9227842700 1 -- 172.21.15.2:0/1300482511 >> 172.21.15.2:0/1300482511 conn(0x7f92200b2840 msgr2=0x7f92200b1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:18.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.986+0000 7f9227842700 1 -- 172.21.15.2:0/1300482511 shutdown_connections 2023-11-26T07:12:18.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:18.986+0000 7f9227842700 1 -- 172.21.15.2:0/1300482511 wait complete. 2023-11-26T07:12:18.990 INFO:teuthology.orchestra.run.smithi002.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-26T07:12:19.001 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-26T07:12:19.027 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2023-11-26T07:12:19.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.125+0000 7fdbd8654700 1 Processor -- start 2023-11-26T07:12:19.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.125+0000 7fdbd8654700 1 -- start start 2023-11-26T07:12:19.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.126+0000 7fdbd8654700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdbd015aba0 0x7fdbd0070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:19.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.126+0000 7fdbd8654700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdbd0072850 0x7fdbd0072d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:19.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.126+0000 7fdbd8654700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbd006f2d0 con 0x7fdbd015e710 2023-11-26T07:12:19.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.126+0000 7fdbd8654700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbd00ccb40 con 0x7fdbd015aba0 2023-11-26T07:12:19.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.126+0000 7fdbd8654700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbd0073240 con 0x7fdbd0072850 2023-11-26T07:12:19.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.126+0000 7fdbd63f0700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdbd015aba0 0x7fdbd0070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:19.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.126+0000 7fdbd6bf1700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fdbd015e710 0x7fdbd015eb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59936/0 (socket says 172.21.15.2:59936) 2023-11-26T07:12:19.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.126+0000 7fdbd63f0700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdbd015aba0 0x7fdbd0070eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40490/0 (socket says 172.21.15.2:40490) 2023-11-26T07:12:19.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.126+0000 7fdbd6bf1700 1 -- 172.21.15.2:0/2670334619 learned_addr learned my addr 172.21.15.2:0/2670334619 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:19.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.126+0000 7fdbd5bef700 1 --2- 172.21.15.2:0/2670334619 >> v2:172.21.15.192:3300/0 conn(0x7fdbd0072850 0x7fdbd0072d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:19.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.126+0000 7fdbd63f0700 1 -- 172.21.15.2:0/2670334619 >> v2:172.21.15.192:3300/0 conn(0x7fdbd0072850 msgr2=0x7fdbd0072d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:19.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.126+0000 7fdbd63f0700 1 --2- 172.21.15.2:0/2670334619 >> v2:172.21.15.192:3300/0 conn(0x7fdbd0072850 0x7fdbd0072d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:19.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.126+0000 7fdbd63f0700 1 -- 172.21.15.2:0/2670334619 >> v1:172.21.15.2:6789/0 conn(0x7fdbd015e710 legacy=0x7fdbd015eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:19.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.126+0000 7fdbd53ee700 1 -- 172.21.15.2:0/2670334619 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2243492725 0 0) 0x7fdbd006f2d0 con 0x7fdbd015e710 2023-11-26T07:12:19.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.126+0000 7fdbd63f0700 1 -- 172.21.15.2:0/2670334619 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd015af80 con 0x7fdbd015aba0 2023-11-26T07:12:19.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.127+0000 7fdbd63f0700 1 --2- 172.21.15.2:0/2670334619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbd015aba0 0x7fdbd0070eb0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0067bb0 tx=0x7fdbc000bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=596bce8c03dcbaca server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:19.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.127+0000 7fdbd53ee700 1 -- 172.21.15.2:0/2670334619 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc000dc30 con 0x7fdbd015aba0 2023-11-26T07:12:19.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.127+0000 7fdbd53ee700 1 -- 172.21.15.2:0/2670334619 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc000dd90 con 0x7fdbd015aba0 2023-11-26T07:12:19.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.127+0000 7fdbd53ee700 1 -- 172.21.15.2:0/2670334619 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc0010690 con 0x7fdbd015aba0 2023-11-26T07:12:19.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.127+0000 7fdbd8654700 1 -- 172.21.15.2:0/2670334619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbd015aba0 msgr2=0x7fdbd0070eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:19.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.127+0000 7fdbd8654700 1 --2- 172.21.15.2:0/2670334619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbd015aba0 0x7fdbd0070eb0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0067bb0 tx=0x7fdbc000bdf0 comp rx=0 tx=0).stop 2023-11-26T07:12:19.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.127+0000 7fdbd8654700 1 -- 172.21.15.2:0/2670334619 shutdown_connections 2023-11-26T07:12:19.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.127+0000 7fdbd8654700 1 --2- 172.21.15.2:0/2670334619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbd015aba0 0x7fdbd0070eb0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:19.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.127+0000 7fdbd8654700 1 --2- 172.21.15.2:0/2670334619 >> v2:172.21.15.192:3300/0 conn(0x7fdbd0072850 0x7fdbd0072d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:19.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.127+0000 7fdbd8654700 1 -- 172.21.15.2:0/2670334619 >> 172.21.15.2:0/2670334619 conn(0x7fdbd00b1cc0 msgr2=0x7fdbd00b20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:19.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.128+0000 7fdbd8654700 1 -- 172.21.15.2:0/2670334619 shutdown_connections 2023-11-26T07:12:19.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.128+0000 7fdbd8654700 1 -- 172.21.15.2:0/2670334619 wait complete. 2023-11-26T07:12:19.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.129+0000 7fdbd8654700 1 Processor -- start 2023-11-26T07:12:19.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.129+0000 7fdbd8654700 1 -- start start 2023-11-26T07:12:19.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.130+0000 7fdbd8654700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdbd0072850 0x7fdbd0146730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:19.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.130+0000 7fdbd8654700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbd015aba0 0x7fdbd00ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:19.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.130+0000 7fdbd8654700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbd015e710 0x7fdbd00cac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:19.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.130+0000 7fdbd8654700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd00cbda0 con 0x7fdbd015e710 2023-11-26T07:12:19.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.130+0000 7fdbd8654700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd00cb220 con 0x7fdbd015aba0 2023-11-26T07:12:19.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.130+0000 7fdbd8654700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd00cb500 con 0x7fdbd0072850 2023-11-26T07:12:19.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.130+0000 7fdbd6bf1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbd015e710 0x7fdbd00cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:19.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.130+0000 7fdbd6bf1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbd015e710 0x7fdbd00cac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40498/0 (socket says 172.21.15.2:40498) 2023-11-26T07:12:19.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.130+0000 7fdbd6bf1700 1 -- 172.21.15.2:0/1244620937 learned_addr learned my addr 172.21.15.2:0/1244620937 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:19.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.130+0000 7fdbd5bef700 1 --2- 172.21.15.2:0/1244620937 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbd015aba0 0x7fdbd00ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:19.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.130+0000 7fdbd63f0700 1 --2- 172.21.15.2:0/1244620937 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdbd0072850 0x7fdbd0146730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:19.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.131+0000 7fdbd6bf1700 1 -- 172.21.15.2:0/1244620937 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdbd0072850 msgr2=0x7fdbd0146730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:19.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.131+0000 7fdbd6bf1700 1 --2- 172.21.15.2:0/1244620937 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdbd0072850 0x7fdbd0146730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:19.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.131+0000 7fdbd6bf1700 1 -- 172.21.15.2:0/1244620937 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbd015aba0 msgr2=0x7fdbd00ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:19.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.131+0000 7fdbd6bf1700 1 --2- 172.21.15.2:0/1244620937 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbd015aba0 0x7fdbd00ca6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:19.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.131+0000 7fdbd6bf1700 1 -- 172.21.15.2:0/1244620937 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc000b740 con 0x7fdbd015e710 2023-11-26T07:12:19.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.131+0000 7fdbd63f0700 1 --2- 172.21.15.2:0/1244620937 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdbd0072850 0x7fdbd0146730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:19.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.131+0000 7fdbd6bf1700 1 --2- 172.21.15.2:0/1244620937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbd015e710 0x7fdbd00cac10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fdbc800cba0 tx=0x7fdbc800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:19.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.131+0000 7fdbc6ffd700 1 -- 172.21.15.2:0/1244620937 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc800ab80 con 0x7fdbd015e710 2023-11-26T07:12:19.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.131+0000 7fdbc6ffd700 1 -- 172.21.15.2:0/1244620937 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc800ad00 con 0x7fdbd015e710 2023-11-26T07:12:19.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.131+0000 7fdbd8654700 1 -- 172.21.15.2:0/1244620937 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbd00cb7e0 con 0x7fdbd015e710 2023-11-26T07:12:19.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.131+0000 7fdbc6ffd700 1 -- 172.21.15.2:0/1244620937 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc8007310 con 0x7fdbd015e710 2023-11-26T07:12:19.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.131+0000 7fdbd8654700 1 -- 172.21.15.2:0/1244620937 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbd0150e10 con 0x7fdbd015e710 2023-11-26T07:12:19.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.132+0000 7fdbd8654700 1 -- 172.21.15.2:0/1244620937 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbd0075480 con 0x7fdbd015e710 2023-11-26T07:12:19.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.132+0000 7fdbc6ffd700 1 -- 172.21.15.2:0/1244620937 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdbc8007470 con 0x7fdbd015e710 2023-11-26T07:12:19.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.133+0000 7fdbc6ffd700 1 --2- 172.21.15.2:0/1244620937 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fdbb406aed0 0x7fdbb406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:19.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.133+0000 7fdbc6ffd700 1 -- 172.21.15.2:0/1244620937 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fdbc8089440 con 0x7fdbd015e710 2023-11-26T07:12:19.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.133+0000 7fdbd63f0700 1 --2- 172.21.15.2:0/1244620937 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fdbb406aed0 0x7fdbb406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:19.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.134+0000 7fdbd63f0700 1 --2- 172.21.15.2:0/1244620937 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fdbb406aed0 0x7fdbb406d390 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdbc000b2c0 tx=0x7fdbc0013000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:19.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.138+0000 7fdbc6ffd700 1 -- 172.21.15.2:0/1244620937 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdbc8054520 con 0x7fdbd015e710 2023-11-26T07:12:19.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.385+0000 7fdbd8654700 1 -- 172.21.15.2:0/1244620937 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fdbd0151600 con 0x7fdbd015e710 2023-11-26T07:12:19.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.984+0000 7fdbc6ffd700 1 -- 172.21.15.2:0/1244620937 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fdbc8057b40 con 0x7fdbd015e710 2023-11-26T07:12:19.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.987+0000 7fdbd8654700 1 -- 172.21.15.2:0/1244620937 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fdbb406aed0 msgr2=0x7fdbb406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:19.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.987+0000 7fdbd8654700 1 --2- 172.21.15.2:0/1244620937 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fdbb406aed0 0x7fdbb406d390 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdbc000b2c0 tx=0x7fdbc0013000 comp rx=0 tx=0).stop 2023-11-26T07:12:19.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.988+0000 7fdbd8654700 1 -- 172.21.15.2:0/1244620937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbd015e710 msgr2=0x7fdbd00cac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:19.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.988+0000 7fdbd8654700 1 --2- 172.21.15.2:0/1244620937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbd015e710 0x7fdbd00cac10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fdbc800cba0 tx=0x7fdbc800cf60 comp rx=0 tx=0).stop 2023-11-26T07:12:19.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.988+0000 7fdbd8654700 1 -- 172.21.15.2:0/1244620937 shutdown_connections 2023-11-26T07:12:19.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.988+0000 7fdbd8654700 1 --2- 172.21.15.2:0/1244620937 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fdbb406aed0 0x7fdbb406d390 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:19.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.988+0000 7fdbd8654700 1 --2- 172.21.15.2:0/1244620937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbd015e710 0x7fdbd00cac10 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:19.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.988+0000 7fdbd8654700 1 --2- 172.21.15.2:0/1244620937 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdbd0072850 0x7fdbd0146730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:19.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.988+0000 7fdbd8654700 1 --2- 172.21.15.2:0/1244620937 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbd015aba0 0x7fdbd00ca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:19.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.988+0000 7fdbd8654700 1 -- 172.21.15.2:0/1244620937 >> 172.21.15.2:0/1244620937 conn(0x7fdbd00b1cc0 msgr2=0x7fdbd015db70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:19.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.988+0000 7fdbd8654700 1 -- 172.21.15.2:0/1244620937 shutdown_connections 2023-11-26T07:12:19.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:19.988+0000 7fdbd8654700 1 -- 172.21.15.2:0/1244620937 wait complete. 2023-11-26T07:12:20.006 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-26T07:12:20.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.140+0000 7fd680bfd700 1 Processor -- start 2023-11-26T07:12:20.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.140+0000 7fd680bfd700 1 -- start start 2023-11-26T07:12:20.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.141+0000 7fd680bfd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd67c0b11d0 0x7fd67c0cfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:20.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.141+0000 7fd680bfd700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd67c06f110 con 0x7fd67c06fcb0 2023-11-26T07:12:20.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.141+0000 7fd680bfd700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd67c161a10 con 0x7fd67c0cecc0 2023-11-26T07:12:20.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.141+0000 7fd680bfd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c0d1010 con 0x7fd67c0b11d0 2023-11-26T07:12:20.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.141+0000 7fd679d9b700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd67c06fcb0 0x7fd67c0ce5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59944/0 (socket says 172.21.15.2:59944) 2023-11-26T07:12:20.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.141+0000 7fd679d9b700 1 -- 172.21.15.2:0/971451532 learned_addr learned my addr 172.21.15.2:0/971451532 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:20.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.141+0000 7fd67959a700 1 -- 172.21.15.2:0/971451532 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2789571547 0 0) 0x7fd67c06f110 con 0x7fd67c06fcb0 2023-11-26T07:12:20.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.141+0000 7fd67a59c700 1 --2- 172.21.15.2:0/971451532 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd67c0b11d0 0x7fd67c0cfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:20.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.141+0000 7fd67959a700 1 -- 172.21.15.2:0/971451532 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6640035b0 con 0x7fd67c06fcb0 2023-11-26T07:12:20.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.142+0000 7fd67959a700 1 -- 172.21.15.2:0/971451532 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 178969081 0 0) 0x7fd6640035b0 con 0x7fd67c06fcb0 2023-11-26T07:12:20.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.142+0000 7fd67959a700 1 -- 172.21.15.2:0/971451532 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd67c0b11d0 msgr2=0x7fd67c0cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:20.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.142+0000 7fd67959a700 1 --2- 172.21.15.2:0/971451532 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd67c0b11d0 0x7fd67c0cfd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:20.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.142+0000 7fd67959a700 1 -- 172.21.15.2:0/971451532 >> v1:172.21.15.192:6789/0 conn(0x7fd67c0cecc0 legacy=0x7fd67c167c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:20.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.142+0000 7fd67959a700 1 -- 172.21.15.2:0/971451532 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd67c0d0400 con 0x7fd67c06fcb0 2023-11-26T07:12:20.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.142+0000 7fd67959a700 1 -- 172.21.15.2:0/971451532 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7fd66c001670 con 0x7fd67c06fcb0 2023-11-26T07:12:20.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.142+0000 7fd67959a700 1 -- 172.21.15.2:0/971451532 >> v1:172.21.15.2:6789/0 conn(0x7fd67c06fcb0 legacy=0x7fd67c0ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:20.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.142+0000 7fd67959a700 1 --2- 172.21.15.2:0/971451532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd664003a30 0x7fd664003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:20.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.142+0000 7fd67959a700 1 --2- 172.21.15.2:0/971451532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd664004850 0x7fd664004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:20.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.142+0000 7fd67959a700 1 --2- 172.21.15.2:0/971451532 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd67c0b11d0 0x7fd664005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:20.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.142+0000 7fd67959a700 1 -- 172.21.15.2:0/971451532 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c0d1010 con 0x7fd664003a30 2023-11-26T07:12:20.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.142+0000 7fd67959a700 1 -- 172.21.15.2:0/971451532 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd66400bac0 con 0x7fd664004850 2023-11-26T07:12:20.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.142+0000 7fd67959a700 1 -- 172.21.15.2:0/971451532 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd66400bc80 con 0x7fd67c0b11d0 2023-11-26T07:12:20.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.142+0000 7fd67a59c700 1 --2- 172.21.15.2:0/971451532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd664003a30 0x7fd664003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:20.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.142+0000 7fd679d9b700 1 --2- 172.21.15.2:0/971451532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd664004850 0x7fd664004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:20.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.142+0000 7fd67ad9d700 1 --2- 172.21.15.2:0/971451532 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd67c0b11d0 0x7fd664005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:20.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.142+0000 7fd67a59c700 1 -- 172.21.15.2:0/971451532 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd67c0b11d0 msgr2=0x7fd664005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:20.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.142+0000 7fd67a59c700 1 --2- 172.21.15.2:0/971451532 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd67c0b11d0 0x7fd664005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:20.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.142+0000 7fd67a59c700 1 -- 172.21.15.2:0/971451532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd664004850 msgr2=0x7fd664004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:20.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.142+0000 7fd67a59c700 1 --2- 172.21.15.2:0/971451532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd664004850 0x7fd664004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:20.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.142+0000 7fd67a59c700 1 -- 172.21.15.2:0/971451532 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6640035b0 con 0x7fd664003a30 2023-11-26T07:12:20.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.142+0000 7fd67a59c700 1 --2- 172.21.15.2:0/971451532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd664003a30 0x7fd664003e50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd670009b30 tx=0x7fd664005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8adb0db63b8d049 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:20.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.142+0000 7fd67959a700 1 -- 172.21.15.2:0/971451532 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67000e6c0 con 0x7fd664003a30 2023-11-26T07:12:20.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.142+0000 7fd67959a700 1 -- 172.21.15.2:0/971451532 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd67000e820 con 0x7fd664003a30 2023-11-26T07:12:20.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.142+0000 7fd67959a700 1 -- 172.21.15.2:0/971451532 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67000eb90 con 0x7fd664003a30 2023-11-26T07:12:20.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.143+0000 7fd680bfd700 1 -- 172.21.15.2:0/971451532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd664003a30 msgr2=0x7fd664003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:20.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.143+0000 7fd680bfd700 1 --2- 172.21.15.2:0/971451532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd664003a30 0x7fd664003e50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd670009b30 tx=0x7fd664005880 comp rx=0 tx=0).stop 2023-11-26T07:12:20.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.143+0000 7fd67ad9d700 1 -- 172.21.15.2:0/971451532 reap_dead start 2023-11-26T07:12:20.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.143+0000 7fd680bfd700 1 -- 172.21.15.2:0/971451532 shutdown_connections 2023-11-26T07:12:20.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.143+0000 7fd680bfd700 1 -- 172.21.15.2:0/971451532 >> 172.21.15.2:0/971451532 conn(0x7fd67c0b3700 msgr2=0x7fd67c0b3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:20.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.143+0000 7fd680bfd700 1 -- 172.21.15.2:0/971451532 shutdown_connections 2023-11-26T07:12:20.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.143+0000 7fd680bfd700 1 -- 172.21.15.2:0/971451532 wait complete. 2023-11-26T07:12:20.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.144+0000 7fd680bfd700 1 Processor -- start 2023-11-26T07:12:20.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.145+0000 7fd680bfd700 1 -- start start 2023-11-26T07:12:20.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.145+0000 7fd680bfd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd664003a30 0x7fd67c157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:20.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.145+0000 7fd680bfd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd67c0cbbb0 0x7fd67c0b47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:20.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.145+0000 7fd680bfd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd67c0cd230 0x7fd67c0cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:20.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.145+0000 7fd680bfd700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c0cdc20 con 0x7fd664003a30 2023-11-26T07:12:20.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.145+0000 7fd680bfd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c1f38c0 con 0x7fd67c0cbbb0 2023-11-26T07:12:20.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.145+0000 7fd680bfd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c0b5140 con 0x7fd67c0cd230 2023-11-26T07:12:20.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.145+0000 7fd67a59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd664003a30 0x7fd67c157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:20.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.145+0000 7fd67a59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd664003a30 0x7fd67c157130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40512/0 (socket says 172.21.15.2:40512) 2023-11-26T07:12:20.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.145+0000 7fd67a59c700 1 -- 172.21.15.2:0/2743765584 learned_addr learned my addr 172.21.15.2:0/2743765584 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:20.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.146+0000 7fd67a59c700 1 -- 172.21.15.2:0/2743765584 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd67c0cd230 msgr2=0x7fd67c0cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:20.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.146+0000 7fd67a59c700 1 --2- 172.21.15.2:0/2743765584 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd67c0cd230 0x7fd67c0cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:20.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.146+0000 7fd67a59c700 1 -- 172.21.15.2:0/2743765584 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd67c0cbbb0 msgr2=0x7fd67c0b47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:20.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.146+0000 7fd679d9b700 1 --2- 172.21.15.2:0/2743765584 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd67c0cbbb0 0x7fd67c0b47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:20.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.146+0000 7fd67a59c700 1 --2- 172.21.15.2:0/2743765584 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd67c0cbbb0 0x7fd67c0b47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:20.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.146+0000 7fd67a59c700 1 -- 172.21.15.2:0/2743765584 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd67c0b5420 con 0x7fd664003a30 2023-11-26T07:12:20.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.146+0000 7fd67a59c700 1 --2- 172.21.15.2:0/2743765584 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd664003a30 0x7fd67c157130 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd67000e4b0 tx=0x7fd6700047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:20.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.146+0000 7fd66affd700 1 -- 172.21.15.2:0/2743765584 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67000e6c0 con 0x7fd664003a30 2023-11-26T07:12:20.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.146+0000 7fd66affd700 1 -- 172.21.15.2:0/2743765584 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd670003ad0 con 0x7fd664003a30 2023-11-26T07:12:20.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.146+0000 7fd680bfd700 1 -- 172.21.15.2:0/2743765584 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd67c0b5700 con 0x7fd664003a30 2023-11-26T07:12:20.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.146+0000 7fd66affd700 1 -- 172.21.15.2:0/2743765584 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd670003e80 con 0x7fd664003a30 2023-11-26T07:12:20.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.146+0000 7fd680bfd700 1 -- 172.21.15.2:0/2743765584 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd67c0b5f40 con 0x7fd664003a30 2023-11-26T07:12:20.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.147+0000 7fd680bfd700 1 -- 172.21.15.2:0/2743765584 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd67c0cdc20 con 0x7fd664003a30 2023-11-26T07:12:20.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.147+0000 7fd66affd700 1 -- 172.21.15.2:0/2743765584 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd670013470 con 0x7fd664003a30 2023-11-26T07:12:20.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.148+0000 7fd66affd700 1 --2- 172.21.15.2:0/2743765584 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd65c06aed0 0x7fd65c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:20.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.148+0000 7fd66affd700 1 -- 172.21.15.2:0/2743765584 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fd67008ae40 con 0x7fd664003a30 2023-11-26T07:12:20.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.148+0000 7fd679d9b700 1 --2- 172.21.15.2:0/2743765584 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd65c06aed0 0x7fd65c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:20.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.149+0000 7fd679d9b700 1 --2- 172.21.15.2:0/2743765584 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd65c06aed0 0x7fd65c06d390 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd66c001eb0 tx=0x7fd66c001d40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:20.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.152+0000 7fd66affd700 1 -- 172.21.15.2:0/2743765584 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd67c0cdc20 con 0x7fd664003a30 2023-11-26T07:12:20.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:20.353+0000 7fd680bfd700 1 -- 172.21.15.2:0/2743765584 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd67c0cdc20 con 0x7fd664003a30 2023-11-26T07:12:21.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.335+0000 7fd66affd700 1 -- 172.21.15.2:0/2743765584 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd67c0cdc20 con 0x7fd664003a30 2023-11-26T07:12:21.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.339+0000 7fd680bfd700 1 -- 172.21.15.2:0/2743765584 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd65c06aed0 msgr2=0x7fd65c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:21.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.339+0000 7fd680bfd700 1 --2- 172.21.15.2:0/2743765584 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd65c06aed0 0x7fd65c06d390 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd66c001eb0 tx=0x7fd66c001d40 comp rx=0 tx=0).stop 2023-11-26T07:12:21.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.339+0000 7fd680bfd700 1 -- 172.21.15.2:0/2743765584 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd664003a30 msgr2=0x7fd67c157130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:21.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.339+0000 7fd680bfd700 1 --2- 172.21.15.2:0/2743765584 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd664003a30 0x7fd67c157130 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd67000e4b0 tx=0x7fd6700047c0 comp rx=0 tx=0).stop 2023-11-26T07:12:21.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.339+0000 7fd680bfd700 1 -- 172.21.15.2:0/2743765584 shutdown_connections 2023-11-26T07:12:21.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.339+0000 7fd680bfd700 1 --2- 172.21.15.2:0/2743765584 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd65c06aed0 0x7fd65c06d390 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:21.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.339+0000 7fd680bfd700 1 --2- 172.21.15.2:0/2743765584 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd67c0cd230 0x7fd67c0cd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:21.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.339+0000 7fd680bfd700 1 --2- 172.21.15.2:0/2743765584 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd664003a30 0x7fd67c157130 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:21.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.339+0000 7fd680bfd700 1 --2- 172.21.15.2:0/2743765584 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd67c0cbbb0 0x7fd67c0b47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:21.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.339+0000 7fd680bfd700 1 -- 172.21.15.2:0/2743765584 >> 172.21.15.2:0/2743765584 conn(0x7fd67c0b3700 msgr2=0x7fd67c0cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:21.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.339+0000 7fd680bfd700 1 -- 172.21.15.2:0/2743765584 shutdown_connections 2023-11-26T07:12:21.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.340+0000 7fd680bfd700 1 -- 172.21.15.2:0/2743765584 wait complete. 2023-11-26T07:12:21.344 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' removed 2023-11-26T07:12:21.359 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-26T07:12:21.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.492+0000 7f6cea34e700 1 Processor -- start 2023-11-26T07:12:21.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.492+0000 7f6cea34e700 1 -- start start 2023-11-26T07:12:21.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.493+0000 7f6cea34e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6ce4144c50 0x7f6ce40cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:21.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.493+0000 7f6cea34e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ce406b6e0 0x7f6ce406d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:21.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.493+0000 7f6cea34e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ce40cf590 con 0x7f6ce40d0630 2023-11-26T07:12:21.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.493+0000 7f6cea34e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ce40cf870 con 0x7f6ce4144c50 2023-11-26T07:12:21.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.493+0000 7f6cea34e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce40cfb50 con 0x7f6ce406b6e0 2023-11-26T07:12:21.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.493+0000 7f6ce3fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6ce4144c50 0x7f6ce40cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:21.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.493+0000 7f6ce3fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6ce4144c50 0x7f6ce40cd4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40520/0 (socket says 172.21.15.2:40520) 2023-11-26T07:12:21.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.493+0000 7f6ce3fff700 1 -- 172.21.15.2:0/531564498 learned_addr learned my addr 172.21.15.2:0/531564498 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:21.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.494+0000 7f6ce3fff700 1 -- 172.21.15.2:0/531564498 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ce406b6e0 msgr2=0x7f6ce406d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:21.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.494+0000 7f6ce88eb700 1 --2- 172.21.15.2:0/531564498 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ce406b6e0 0x7f6ce406d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:21.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.494+0000 7f6ce3fff700 1 --2- 172.21.15.2:0/531564498 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ce406b6e0 0x7f6ce406d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:21.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.494+0000 7f6ce3fff700 1 -- 172.21.15.2:0/531564498 >> v1:172.21.15.192:6789/0 conn(0x7f6ce40d0630 legacy=0x7f6ce406afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:21.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.494+0000 7f6ce3fff700 1 -- 172.21.15.2:0/531564498 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce40cfe30 con 0x7f6ce4144c50 2023-11-26T07:12:21.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.494+0000 7f6ce3fff700 1 --2- 172.21.15.2:0/531564498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ce4144c50 0x7f6ce40cd4b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6cd40098f0 tx=0x7f6cd4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cbc355e1db82e8a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:21.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.494+0000 7f6ce2ffd700 1 -- 172.21.15.2:0/531564498 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd4004230 con 0x7f6ce4144c50 2023-11-26T07:12:21.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.494+0000 7f6ce2ffd700 1 -- 172.21.15.2:0/531564498 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd4004390 con 0x7f6ce4144c50 2023-11-26T07:12:21.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.494+0000 7f6ce2ffd700 1 -- 172.21.15.2:0/531564498 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd40036a0 con 0x7f6ce4144c50 2023-11-26T07:12:21.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.494+0000 7f6cea34e700 1 -- 172.21.15.2:0/531564498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ce4144c50 msgr2=0x7f6ce40cd4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:21.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.494+0000 7f6cea34e700 1 --2- 172.21.15.2:0/531564498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ce4144c50 0x7f6ce40cd4b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6cd40098f0 tx=0x7f6cd4009c00 comp rx=0 tx=0).stop 2023-11-26T07:12:21.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.495+0000 7f6cea34e700 1 -- 172.21.15.2:0/531564498 shutdown_connections 2023-11-26T07:12:21.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.495+0000 7f6cea34e700 1 --2- 172.21.15.2:0/531564498 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ce406b6e0 0x7f6ce406d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:21.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.495+0000 7f6cea34e700 1 --2- 172.21.15.2:0/531564498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ce4144c50 0x7f6ce40cd4b0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:21.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.495+0000 7f6cea34e700 1 -- 172.21.15.2:0/531564498 >> 172.21.15.2:0/531564498 conn(0x7f6ce40d0aa0 msgr2=0x7f6ce40d0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:21.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.495+0000 7f6cea34e700 1 -- 172.21.15.2:0/531564498 shutdown_connections 2023-11-26T07:12:21.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.495+0000 7f6cea34e700 1 -- 172.21.15.2:0/531564498 wait complete. 2023-11-26T07:12:21.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.496+0000 7f6cea34e700 1 Processor -- start 2023-11-26T07:12:21.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.496+0000 7f6cea34e700 1 -- start start 2023-11-26T07:12:21.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.497+0000 7f6cea34e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ce406b6e0 0x7f6ce41573e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:21.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.497+0000 7f6cea34e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ce40d0630 0x7f6ce4130250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:21.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.497+0000 7f6cea34e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ce4144c50 0x7f6ce4131a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:21.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.497+0000 7f6cea34e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce4130790 con 0x7f6ce40d0630 2023-11-26T07:12:21.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.497+0000 7f6cea34e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce41309f0 con 0x7f6ce406b6e0 2023-11-26T07:12:21.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.497+0000 7f6cea34e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce4130cd0 con 0x7f6ce4144c50 2023-11-26T07:12:21.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.497+0000 7f6ce37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ce40d0630 0x7f6ce4130250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:21.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.497+0000 7f6ce37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ce40d0630 0x7f6ce4130250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40526/0 (socket says 172.21.15.2:40526) 2023-11-26T07:12:21.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.497+0000 7f6ce37fe700 1 -- 172.21.15.2:0/2052697820 learned_addr learned my addr 172.21.15.2:0/2052697820 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:21.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.497+0000 7f6ce3fff700 1 --2- 172.21.15.2:0/2052697820 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ce406b6e0 0x7f6ce41573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:21.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.497+0000 7f6ce88eb700 1 --2- 172.21.15.2:0/2052697820 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ce4144c50 0x7f6ce4131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:21.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.497+0000 7f6ce37fe700 1 -- 172.21.15.2:0/2052697820 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ce4144c50 msgr2=0x7f6ce4131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:21.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.497+0000 7f6ce37fe700 1 --2- 172.21.15.2:0/2052697820 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ce4144c50 0x7f6ce4131a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:21.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.497+0000 7f6ce37fe700 1 -- 172.21.15.2:0/2052697820 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ce406b6e0 msgr2=0x7f6ce41573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:21.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.497+0000 7f6ce37fe700 1 --2- 172.21.15.2:0/2052697820 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ce406b6e0 0x7f6ce41573e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:21.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.497+0000 7f6ce37fe700 1 -- 172.21.15.2:0/2052697820 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd4009550 con 0x7f6ce40d0630 2023-11-26T07:12:21.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.497+0000 7f6ce3fff700 1 --2- 172.21.15.2:0/2052697820 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ce406b6e0 0x7f6ce41573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:21.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.497+0000 7f6ce37fe700 1 --2- 172.21.15.2:0/2052697820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ce40d0630 0x7f6ce4130250 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc00c4d0 tx=0x7f6ccc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:21.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.497+0000 7f6ce0ff9700 1 -- 172.21.15.2:0/2052697820 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc011790 con 0x7f6ce40d0630 2023-11-26T07:12:21.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.497+0000 7f6ce0ff9700 1 -- 172.21.15.2:0/2052697820 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ccc0118f0 con 0x7f6ce40d0630 2023-11-26T07:12:21.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.497+0000 7f6cea34e700 1 -- 172.21.15.2:0/2052697820 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce4130fb0 con 0x7f6ce40d0630 2023-11-26T07:12:21.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.497+0000 7f6ce0ff9700 1 -- 172.21.15.2:0/2052697820 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc011ca0 con 0x7f6ce40d0630 2023-11-26T07:12:21.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.498+0000 7f6cea34e700 1 -- 172.21.15.2:0/2052697820 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce4131570 con 0x7f6ce40d0630 2023-11-26T07:12:21.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.498+0000 7f6cea34e700 1 -- 172.21.15.2:0/2052697820 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ce4068670 con 0x7f6ce40d0630 2023-11-26T07:12:21.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.499+0000 7f6ce0ff9700 1 -- 172.21.15.2:0/2052697820 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6ccc01c460 con 0x7f6ce40d0630 2023-11-26T07:12:21.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.499+0000 7f6ce0ff9700 1 --2- 172.21.15.2:0/2052697820 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6cc406aed0 0x7f6cc406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:21.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.499+0000 7f6ce0ff9700 1 -- 172.21.15.2:0/2052697820 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f6ccc089440 con 0x7f6ce40d0630 2023-11-26T07:12:21.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.499+0000 7f6ce3fff700 1 --2- 172.21.15.2:0/2052697820 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6cc406aed0 0x7f6cc406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:21.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.500+0000 7f6ce3fff700 1 --2- 172.21.15.2:0/2052697820 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6cc406aed0 0x7f6cc406d390 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4009130 tx=0x7f6cd4008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:21.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.504+0000 7f6ce0ff9700 1 -- 172.21.15.2:0/2052697820 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6ccc0545c0 con 0x7f6ce40d0630 2023-11-26T07:12:21.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:21.709+0000 7f6cea34e700 1 -- 172.21.15.2:0/2052697820 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6ce4131790 con 0x7f6ce40d0630 2023-11-26T07:12:22.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.340+0000 7f6ce0ff9700 1 -- 172.21.15.2:0/2052697820 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6ccc057be0 con 0x7f6ce40d0630 2023-11-26T07:12:22.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.343+0000 7f6cea34e700 1 -- 172.21.15.2:0/2052697820 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6cc406aed0 msgr2=0x7f6cc406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:22.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.343+0000 7f6cea34e700 1 --2- 172.21.15.2:0/2052697820 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6cc406aed0 0x7f6cc406d390 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4009130 tx=0x7f6cd4008030 comp rx=0 tx=0).stop 2023-11-26T07:12:22.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.343+0000 7f6cea34e700 1 -- 172.21.15.2:0/2052697820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ce40d0630 msgr2=0x7f6ce4130250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:22.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.343+0000 7f6cea34e700 1 --2- 172.21.15.2:0/2052697820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ce40d0630 0x7f6ce4130250 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc00c4d0 tx=0x7f6ccc00c890 comp rx=0 tx=0).stop 2023-11-26T07:12:22.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.344+0000 7f6cea34e700 1 -- 172.21.15.2:0/2052697820 shutdown_connections 2023-11-26T07:12:22.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.344+0000 7f6cea34e700 1 --2- 172.21.15.2:0/2052697820 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6cc406aed0 0x7f6cc406d390 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:22.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.344+0000 7f6cea34e700 1 --2- 172.21.15.2:0/2052697820 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ce4144c50 0x7f6ce4131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:22.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.344+0000 7f6cea34e700 1 --2- 172.21.15.2:0/2052697820 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ce406b6e0 0x7f6ce41573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:22.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.344+0000 7f6cea34e700 1 --2- 172.21.15.2:0/2052697820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ce40d0630 0x7f6ce4130250 secure :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc00c4d0 tx=0x7f6ccc00c890 comp rx=0 tx=0).stop 2023-11-26T07:12:22.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.344+0000 7f6cea34e700 1 -- 172.21.15.2:0/2052697820 >> 172.21.15.2:0/2052697820 conn(0x7f6ce40d0aa0 msgr2=0x7f6ce415ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:22.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.345+0000 7f6cea34e700 1 -- 172.21.15.2:0/2052697820 shutdown_connections 2023-11-26T07:12:22.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.345+0000 7f6cea34e700 1 -- 172.21.15.2:0/2052697820 wait complete. 2023-11-26T07:12:22.351 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' removed 2023-11-26T07:12:22.364 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-26T07:12:22.364 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-26T07:12:22.365 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-26T07:12:22.365 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:12:22.365 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-26T07:12:22.365 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-26T07:12:22.365 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-26T07:12:22.365 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:12:22.365 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-26T07:12:22.366 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-26T07:12:22.366 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-26T07:12:22.366 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:12:22.366 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-26T07:12:22.366 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-26T07:12:22.366 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-26T07:12:22.366 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:12:22.375 INFO:tasks.ceph.mds.a:Stopped 2023-11-26T07:12:22.375 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-26T07:12:22.376 INFO:tasks.ceph.mds.c:Stopped 2023-11-26T07:12:22.376 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-26T07:12:22.381 INFO:tasks.ceph.mds.b:Stopped 2023-11-26T07:12:22.381 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-26T07:12:22.381 INFO:tasks.ceph.mds.d:Stopped 2023-11-26T07:12:22.382 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-26T07:12:22.418 INFO:tasks.ceph.mds.a:Started 2023-11-26T07:12:22.418 DEBUG:teuthology.parallel:result is None 2023-11-26T07:12:22.419 INFO:tasks.ceph.mds.c:Started 2023-11-26T07:12:22.419 DEBUG:teuthology.parallel:result is None 2023-11-26T07:12:22.423 INFO:tasks.ceph.mds.b:Started 2023-11-26T07:12:22.423 DEBUG:teuthology.parallel:result is None 2023-11-26T07:12:22.423 INFO:tasks.ceph.mds.d:Started 2023-11-26T07:12:22.424 DEBUG:teuthology.parallel:result is None 2023-11-26T07:12:22.424 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-26T07:12:22.508 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2023-11-26T07:12:22.508 INFO:tasks.ceph.mds.c.smithi002.stdout:starting mds.c at 2023-11-26T07:12:22.508 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2023-11-26T07:12:22.509 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2023-11-26T07:12:22.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.563+0000 7f52d59ac700 1 Processor -- start 2023-11-26T07:12:22.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.563+0000 7f52d59ac700 1 -- start start 2023-11-26T07:12:22.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.564+0000 7f52d59ac700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52d015e460 0x7f52d00d49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:22.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.564+0000 7f52d59ac700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f52d00d2ba0 0x7f52d00b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:22.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.564+0000 7f52d59ac700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d00b3370 con 0x7f52d00cf480 2023-11-26T07:12:22.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.564+0000 7f52d59ac700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d00cfc40 con 0x7f52d00d2ba0 2023-11-26T07:12:22.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.564+0000 7f52d59ac700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d00b35c0 con 0x7f52d015e460 2023-11-26T07:12:22.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.564+0000 7f52ce7fc700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f52d00cf480 0x7f52d00d2490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59998/0 (socket says 172.21.15.2:59998) 2023-11-26T07:12:22.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.564+0000 7f52ce7fc700 1 -- 172.21.15.2:0/2301532310 learned_addr learned my addr 172.21.15.2:0/2301532310 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:22.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.564+0000 7f52cdffb700 1 -- 172.21.15.2:0/2301532310 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2215714719 0 0) 0x7f52d00b3370 con 0x7f52d00cf480 2023-11-26T07:12:22.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.564+0000 7f52cdffb700 1 -- 172.21.15.2:0/2301532310 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52b80035b0 con 0x7f52d00cf480 2023-11-26T07:12:22.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.564+0000 7f52cf7fe700 1 --2- 172.21.15.2:0/2301532310 >> v2:172.21.15.192:3300/0 conn(0x7f52d00d2ba0 0x7f52d00b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:22.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.564+0000 7f52ceffd700 1 --2- 172.21.15.2:0/2301532310 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52d015e460 0x7f52d00d49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:22.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.564+0000 7f52cdffb700 1 -- 172.21.15.2:0/2301532310 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3865672197 0 0) 0x7f52b80035b0 con 0x7f52d00cf480 2023-11-26T07:12:22.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.565+0000 7f52cdffb700 1 -- 172.21.15.2:0/2301532310 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52d015e460 msgr2=0x7f52d00d49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:22.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.565+0000 7f52cdffb700 1 --2- 172.21.15.2:0/2301532310 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52d015e460 0x7f52d00d49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:22.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.565+0000 7f52cdffb700 1 -- 172.21.15.2:0/2301532310 >> v2:172.21.15.192:3300/0 conn(0x7f52d00d2ba0 msgr2=0x7f52d00b40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:22.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.565+0000 7f52cdffb700 1 --2- 172.21.15.2:0/2301532310 >> v2:172.21.15.192:3300/0 conn(0x7f52d00d2ba0 0x7f52d00b40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:22.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.565+0000 7f52cdffb700 1 -- 172.21.15.2:0/2301532310 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d00b38a0 con 0x7f52d00cf480 2023-11-26T07:12:22.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.565+0000 7f52cdffb700 1 -- 172.21.15.2:0/2301532310 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f52c4001670 con 0x7f52d00cf480 2023-11-26T07:12:22.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.565+0000 7f52cdffb700 1 -- 172.21.15.2:0/2301532310 >> v1:172.21.15.2:6789/0 conn(0x7f52d00cf480 legacy=0x7f52d00d2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:22.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.565+0000 7f52cdffb700 1 --2- 172.21.15.2:0/2301532310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52b8003a00 0x7f52b8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:22.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.565+0000 7f52cdffb700 1 --2- 172.21.15.2:0/2301532310 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52b8004850 0x7f52b8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:22.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.565+0000 7f52cdffb700 1 --2- 172.21.15.2:0/2301532310 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52d015e460 0x7f52b8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:22.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.565+0000 7f52cdffb700 1 -- 172.21.15.2:0/2301532310 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d00cfc40 con 0x7f52b8003a00 2023-11-26T07:12:22.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.565+0000 7f52cdffb700 1 -- 172.21.15.2:0/2301532310 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d00b35c0 con 0x7f52b8004850 2023-11-26T07:12:22.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.565+0000 7f52cdffb700 1 -- 172.21.15.2:0/2301532310 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52b800ba10 con 0x7f52d015e460 2023-11-26T07:12:22.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.565+0000 7f52ceffd700 1 --2- 172.21.15.2:0/2301532310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52b8003a00 0x7f52b8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:22.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.565+0000 7f52ce7fc700 1 --2- 172.21.15.2:0/2301532310 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52b8004850 0x7f52b8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:22.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.565+0000 7f52cf7fe700 1 --2- 172.21.15.2:0/2301532310 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52d015e460 0x7f52b8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:22.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.565+0000 7f52ceffd700 1 -- 172.21.15.2:0/2301532310 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52d015e460 msgr2=0x7f52b8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:22.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.565+0000 7f52ceffd700 1 --2- 172.21.15.2:0/2301532310 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52d015e460 0x7f52b8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:22.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.565+0000 7f52ceffd700 1 -- 172.21.15.2:0/2301532310 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52b8004850 msgr2=0x7f52b8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:22.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.565+0000 7f52ceffd700 1 --2- 172.21.15.2:0/2301532310 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52b8004850 0x7f52b8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:22.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.565+0000 7f52ceffd700 1 -- 172.21.15.2:0/2301532310 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b80035b0 con 0x7f52b8003a00 2023-11-26T07:12:22.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.565+0000 7f52ce7fc700 1 --2- 172.21.15.2:0/2301532310 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52b8004850 0x7f52b8004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:12:22.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.565+0000 7f52ceffd700 1 --2- 172.21.15.2:0/2301532310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52b8003a00 0x7f52b8003e20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f52c0009b60 tx=0x7f52b8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60b91618abd0980a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:22.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.565+0000 7f52cdffb700 1 -- 172.21.15.2:0/2301532310 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c000e6c0 con 0x7f52b8003a00 2023-11-26T07:12:22.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.565+0000 7f52cdffb700 1 -- 172.21.15.2:0/2301532310 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c000e820 con 0x7f52b8003a00 2023-11-26T07:12:22.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.565+0000 7f52cdffb700 1 -- 172.21.15.2:0/2301532310 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c000eb90 con 0x7f52b8003a00 2023-11-26T07:12:22.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.566+0000 7f52d59ac700 1 -- 172.21.15.2:0/2301532310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52b8003a00 msgr2=0x7f52b8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:22.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.566+0000 7f52d59ac700 1 --2- 172.21.15.2:0/2301532310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52b8003a00 0x7f52b8003e20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f52c0009b60 tx=0x7f52b8005880 comp rx=0 tx=0).stop 2023-11-26T07:12:22.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.566+0000 7f52cf7fe700 1 -- 172.21.15.2:0/2301532310 reap_dead start 2023-11-26T07:12:22.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.566+0000 7f52d59ac700 1 -- 172.21.15.2:0/2301532310 shutdown_connections 2023-11-26T07:12:22.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.566+0000 7f52d59ac700 1 -- 172.21.15.2:0/2301532310 >> 172.21.15.2:0/2301532310 conn(0x7f52d00d3eb0 msgr2=0x7f52d00d42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:22.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.566+0000 7f52d59ac700 1 -- 172.21.15.2:0/2301532310 shutdown_connections 2023-11-26T07:12:22.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.566+0000 7f52d59ac700 1 -- 172.21.15.2:0/2301532310 wait complete. 2023-11-26T07:12:22.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.567+0000 7f52d59ac700 1 Processor -- start 2023-11-26T07:12:22.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.567+0000 7f52d59ac700 1 -- start start 2023-11-26T07:12:22.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.568+0000 7f52d59ac700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52d01501e0 0x7f52d009fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:22.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.568+0000 7f52d59ac700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52d01505c0 0x7f52d009ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:22.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.568+0000 7f52d59ac700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d0150d60 0x7f52d01511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:22.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.568+0000 7f52d59ac700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d00a0790 con 0x7f52d0150d60 2023-11-26T07:12:22.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.568+0000 7f52d59ac700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d00a0a70 con 0x7f52d01505c0 2023-11-26T07:12:22.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.568+0000 7f52d59ac700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d00a0d50 con 0x7f52d01501e0 2023-11-26T07:12:22.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.568+0000 7f52cf7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d0150d60 0x7f52d01511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:22.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.568+0000 7f52cf7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d0150d60 0x7f52d01511e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40572/0 (socket says 172.21.15.2:40572) 2023-11-26T07:12:22.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.568+0000 7f52cf7fe700 1 -- 172.21.15.2:0/2279241621 learned_addr learned my addr 172.21.15.2:0/2279241621 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:22.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.568+0000 7f52ceffd700 1 --2- 172.21.15.2:0/2279241621 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52d01501e0 0x7f52d009fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:22.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.568+0000 7f52ce7fc700 1 --2- 172.21.15.2:0/2279241621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52d01505c0 0x7f52d009ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:22.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.569+0000 7f52cf7fe700 1 -- 172.21.15.2:0/2279241621 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52d01501e0 msgr2=0x7f52d009fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:22.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.569+0000 7f52cf7fe700 1 --2- 172.21.15.2:0/2279241621 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52d01501e0 0x7f52d009fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:22.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.569+0000 7f52cf7fe700 1 -- 172.21.15.2:0/2279241621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52d01505c0 msgr2=0x7f52d009ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:22.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.569+0000 7f52cf7fe700 1 --2- 172.21.15.2:0/2279241621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52d01505c0 0x7f52d009ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:22.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.569+0000 7f52cf7fe700 1 -- 172.21.15.2:0/2279241621 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d00a1030 con 0x7f52d0150d60 2023-11-26T07:12:22.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.569+0000 7f52cf7fe700 1 --2- 172.21.15.2:0/2279241621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d0150d60 0x7f52d01511e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f52d00b6a30 tx=0x7f52c8011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:22.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.569+0000 7f52b7fff700 1 -- 172.21.15.2:0/2279241621 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c800e040 con 0x7f52d0150d60 2023-11-26T07:12:22.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.569+0000 7f52b7fff700 1 -- 172.21.15.2:0/2279241621 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c800f040 con 0x7f52d0150d60 2023-11-26T07:12:22.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.569+0000 7f52d59ac700 1 -- 172.21.15.2:0/2279241621 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d00a1310 con 0x7f52d0150d60 2023-11-26T07:12:22.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.569+0000 7f52b7fff700 1 -- 172.21.15.2:0/2279241621 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c800f8e0 con 0x7f52d0150d60 2023-11-26T07:12:22.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.569+0000 7f52d59ac700 1 -- 172.21.15.2:0/2279241621 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d00a1830 con 0x7f52d0150d60 2023-11-26T07:12:22.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.570+0000 7f52d59ac700 1 -- 172.21.15.2:0/2279241621 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d0067f60 con 0x7f52d0150d60 2023-11-26T07:12:22.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.571+0000 7f52b7fff700 1 -- 172.21.15.2:0/2279241621 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f52c800fa40 con 0x7f52d0150d60 2023-11-26T07:12:22.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.571+0000 7f52b7fff700 1 --2- 172.21.15.2:0/2279241621 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f52bc06aed0 0x7f52bc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:22.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.571+0000 7f52b7fff700 1 -- 172.21.15.2:0/2279241621 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f52c8089530 con 0x7f52d0150d60 2023-11-26T07:12:22.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.571+0000 7f52ceffd700 1 --2- 172.21.15.2:0/2279241621 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f52bc06aed0 0x7f52bc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:22.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.572+0000 7f52ceffd700 1 --2- 172.21.15.2:0/2279241621 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f52bc06aed0 0x7f52bc06d390 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f52c00090b0 tx=0x7f52c001f040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:22.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.576+0000 7f52b7fff700 1 -- 172.21.15.2:0/2279241621 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f52c80548e0 con 0x7f52d0150d60 2023-11-26T07:12:22.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:22.794+0000 7f52d59ac700 1 -- 172.21.15.2:0/2279241621 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f52d00d2270 con 0x7f52d0150d60 2023-11-26T07:12:23.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.356+0000 7f52b7fff700 1 -- 172.21.15.2:0/2279241621 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) v1 ==== 97+0+0 (secure 0 0 0) 0x7f52c8013310 con 0x7f52d0150d60 2023-11-26T07:12:23.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.359+0000 7f52d59ac700 1 -- 172.21.15.2:0/2279241621 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f52bc06aed0 msgr2=0x7f52bc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:23.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.359+0000 7f52d59ac700 1 --2- 172.21.15.2:0/2279241621 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f52bc06aed0 0x7f52bc06d390 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f52c00090b0 tx=0x7f52c001f040 comp rx=0 tx=0).stop 2023-11-26T07:12:23.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.359+0000 7f52d59ac700 1 -- 172.21.15.2:0/2279241621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d0150d60 msgr2=0x7f52d01511e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:23.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.359+0000 7f52d59ac700 1 --2- 172.21.15.2:0/2279241621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d0150d60 0x7f52d01511e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f52d00b6a30 tx=0x7f52c8011ef0 comp rx=0 tx=0).stop 2023-11-26T07:12:23.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.359+0000 7f52d59ac700 1 -- 172.21.15.2:0/2279241621 shutdown_connections 2023-11-26T07:12:23.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.359+0000 7f52d59ac700 1 --2- 172.21.15.2:0/2279241621 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f52bc06aed0 0x7f52bc06d390 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:23.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.359+0000 7f52d59ac700 1 --2- 172.21.15.2:0/2279241621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d0150d60 0x7f52d01511e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:23.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.359+0000 7f52d59ac700 1 --2- 172.21.15.2:0/2279241621 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52d01501e0 0x7f52d009fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:23.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.359+0000 7f52d59ac700 1 --2- 172.21.15.2:0/2279241621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52d01505c0 0x7f52d009ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:23.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.359+0000 7f52d59ac700 1 -- 172.21.15.2:0/2279241621 >> 172.21.15.2:0/2279241621 conn(0x7f52d00d3eb0 msgr2=0x7f52d006cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:23.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.359+0000 7f52d59ac700 1 -- 172.21.15.2:0/2279241621 shutdown_connections 2023-11-26T07:12:23.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.359+0000 7f52d59ac700 1 -- 172.21.15.2:0/2279241621 wait complete. 2023-11-26T07:12:23.363 INFO:teuthology.orchestra.run.smithi002.stderr: removed all blocklist entries 2023-11-26T07:12:23.377 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-26T07:12:23.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.502+0000 7f0bd38ba700 1 Processor -- start 2023-11-26T07:12:23.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.502+0000 7f0bd38ba700 1 -- start start 2023-11-26T07:12:23.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.503+0000 7f0bd38ba700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0bcc1448b0 0x7f0bcc06ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:23.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.503+0000 7f0bd38ba700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bcc144c90 con 0x7f0bcc0b44c0 2023-11-26T07:12:23.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.503+0000 7f0bd38ba700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bcc0b4c80 con 0x7f0bcc06f990 2023-11-26T07:12:23.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.503+0000 7f0bd38ba700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bcc0b4f60 con 0x7f0bcc1448b0 2023-11-26T07:12:23.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.503+0000 7f0bd1656700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0bcc1448b0 0x7f0bcc06ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:23.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.503+0000 7f0bd0e55700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f0bcc0b44c0 0x7f0bcc06f280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60018/0 (socket says 172.21.15.2:60018) 2023-11-26T07:12:23.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.503+0000 7f0bd0e55700 1 -- 172.21.15.2:0/1037206619 learned_addr learned my addr 172.21.15.2:0/1037206619 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:23.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.503+0000 7f0bd1656700 1 -- 172.21.15.2:0/1037206619 >> v1:172.21.15.192:6789/0 conn(0x7f0bcc06f990 legacy=0x7f0bcc0ce2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:23.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.503+0000 7f0bd1656700 1 -- 172.21.15.2:0/1037206619 >> v1:172.21.15.2:6789/0 conn(0x7f0bcc0b44c0 legacy=0x7f0bcc06f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:23.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.503+0000 7f0bd1656700 1 -- 172.21.15.2:0/1037206619 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bcc0b5240 con 0x7f0bcc1448b0 2023-11-26T07:12:23.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.503+0000 7f0bc3fff700 1 -- 172.21.15.2:0/1037206619 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 742727236 0 0) 0x7f0bcc144c90 con 0x7f0bcc0b44c0 2023-11-26T07:12:23.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.503+0000 7f0bd1656700 1 --2- 172.21.15.2:0/1037206619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bcc1448b0 0x7f0bcc06ec70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8009840 tx=0x7f0bc8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ac12ec1b6c63e2e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:23.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.504+0000 7f0bc3fff700 1 -- 172.21.15.2:0/1037206619 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc8011830 con 0x7f0bcc1448b0 2023-11-26T07:12:23.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.504+0000 7f0bc3fff700 1 -- 172.21.15.2:0/1037206619 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc8011990 con 0x7f0bcc1448b0 2023-11-26T07:12:23.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.504+0000 7f0bc3fff700 1 -- 172.21.15.2:0/1037206619 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc8011d20 con 0x7f0bcc1448b0 2023-11-26T07:12:23.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.504+0000 7f0bd38ba700 1 -- 172.21.15.2:0/1037206619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bcc1448b0 msgr2=0x7f0bcc06ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:23.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.504+0000 7f0bd38ba700 1 --2- 172.21.15.2:0/1037206619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bcc1448b0 0x7f0bcc06ec70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8009840 tx=0x7f0bc8009b50 comp rx=0 tx=0).stop 2023-11-26T07:12:23.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.504+0000 7f0bd38ba700 1 -- 172.21.15.2:0/1037206619 shutdown_connections 2023-11-26T07:12:23.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.504+0000 7f0bd38ba700 1 --2- 172.21.15.2:0/1037206619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bcc1448b0 0x7f0bcc06ec70 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:23.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.504+0000 7f0bd38ba700 1 -- 172.21.15.2:0/1037206619 >> 172.21.15.2:0/1037206619 conn(0x7f0bcc0d0bc0 msgr2=0x7f0bcc0d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:23.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.504+0000 7f0bd38ba700 1 -- 172.21.15.2:0/1037206619 shutdown_connections 2023-11-26T07:12:23.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.504+0000 7f0bd38ba700 1 -- 172.21.15.2:0/1037206619 wait complete. 2023-11-26T07:12:23.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.506+0000 7f0bd38ba700 1 Processor -- start 2023-11-26T07:12:23.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.506+0000 7f0bd38ba700 1 -- start start 2023-11-26T07:12:23.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.507+0000 7f0bd38ba700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bcc06f990 0x7f0bcc1f5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:23.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.507+0000 7f0bd38ba700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bcc0b44c0 0x7f0bcc15cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:23.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.507+0000 7f0bd38ba700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0bcc1448b0 0x7f0bcc0d0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:23.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.507+0000 7f0bd38ba700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc13caa0 con 0x7f0bcc0b44c0 2023-11-26T07:12:23.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.507+0000 7f0bd38ba700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc1f5e40 con 0x7f0bcc06f990 2023-11-26T07:12:23.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.507+0000 7f0bd38ba700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc1f1c10 con 0x7f0bcc1448b0 2023-11-26T07:12:23.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.507+0000 7f0bd0e55700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bcc0b44c0 0x7f0bcc15cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:23.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.507+0000 7f0bd0e55700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bcc0b44c0 0x7f0bcc15cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40584/0 (socket says 172.21.15.2:40584) 2023-11-26T07:12:23.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.507+0000 7f0bd0e55700 1 -- 172.21.15.2:0/4195842814 learned_addr learned my addr 172.21.15.2:0/4195842814 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:23.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.507+0000 7f0bd1e57700 1 --2- 172.21.15.2:0/4195842814 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0bcc1448b0 0x7f0bcc0d0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:23.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.507+0000 7f0bd1656700 1 --2- 172.21.15.2:0/4195842814 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bcc06f990 0x7f0bcc1f5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:23.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.507+0000 7f0bd0e55700 1 -- 172.21.15.2:0/4195842814 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0bcc1448b0 msgr2=0x7f0bcc0d0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:23.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.507+0000 7f0bd0e55700 1 --2- 172.21.15.2:0/4195842814 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0bcc1448b0 0x7f0bcc0d0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:23.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.507+0000 7f0bd0e55700 1 -- 172.21.15.2:0/4195842814 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bcc06f990 msgr2=0x7f0bcc1f5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:23.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.507+0000 7f0bd0e55700 1 --2- 172.21.15.2:0/4195842814 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bcc06f990 0x7f0bcc1f5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:23.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.507+0000 7f0bd0e55700 1 -- 172.21.15.2:0/4195842814 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc80094a0 con 0x7f0bcc0b44c0 2023-11-26T07:12:23.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.507+0000 7f0bd1e57700 1 --2- 172.21.15.2:0/4195842814 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0bcc1448b0 0x7f0bcc0d0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:12:23.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.507+0000 7f0bd1656700 1 --2- 172.21.15.2:0/4195842814 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bcc06f990 0x7f0bcc1f5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:12:23.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.507+0000 7f0bd0e55700 1 --2- 172.21.15.2:0/4195842814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bcc0b44c0 0x7f0bcc15cbd0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc00c520 tx=0x7f0bbc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:23.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.508+0000 7f0bc1ffb700 1 -- 172.21.15.2:0/4195842814 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc004c80 con 0x7f0bcc0b44c0 2023-11-26T07:12:23.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.508+0000 7f0bc1ffb700 1 -- 172.21.15.2:0/4195842814 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bbc004e00 con 0x7f0bcc0b44c0 2023-11-26T07:12:23.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.508+0000 7f0bc1ffb700 1 -- 172.21.15.2:0/4195842814 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc007310 con 0x7f0bcc0b44c0 2023-11-26T07:12:23.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.508+0000 7f0bd38ba700 1 -- 172.21.15.2:0/4195842814 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bcc1f1ef0 con 0x7f0bcc0b44c0 2023-11-26T07:12:23.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.508+0000 7f0bd38ba700 1 -- 172.21.15.2:0/4195842814 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bcc1f24b0 con 0x7f0bcc0b44c0 2023-11-26T07:12:23.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.509+0000 7f0bd38ba700 1 -- 172.21.15.2:0/4195842814 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bcc068670 con 0x7f0bcc0b44c0 2023-11-26T07:12:23.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.509+0000 7f0bc1ffb700 1 -- 172.21.15.2:0/4195842814 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0bbc007470 con 0x7f0bcc0b44c0 2023-11-26T07:12:23.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.510+0000 7f0bc1ffb700 1 --2- 172.21.15.2:0/4195842814 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0bb006aed0 0x7f0bb006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:23.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.510+0000 7f0bc1ffb700 1 -- 172.21.15.2:0/4195842814 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0bbc089000 con 0x7f0bcc0b44c0 2023-11-26T07:12:23.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.510+0000 7f0bd1656700 1 --2- 172.21.15.2:0/4195842814 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0bb006aed0 0x7f0bb006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:23.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.510+0000 7f0bd1656700 1 --2- 172.21.15.2:0/4195842814 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0bb006aed0 0x7f0bb006d390 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0cceb0 tx=0x7f0bc801c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:23.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.514+0000 7f0bc1ffb700 1 -- 172.21.15.2:0/4195842814 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0bbc054400 con 0x7f0bcc0b44c0 2023-11-26T07:12:23.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.798+0000 7f0bd38ba700 1 -- 172.21.15.2:0/4195842814 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f0bcc0b1ab0 con 0x7f0bcc0b44c0 2023-11-26T07:12:23.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.799+0000 7f0bc1ffb700 1 -- 172.21.15.2:0/4195842814 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f0bbc057a20 con 0x7f0bcc0b44c0 2023-11-26T07:12:23.802 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:12:23.802 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-26T07:12:23.802 INFO:teuthology.orchestra.run.smithi002.stdout: "auth_dump": [ 2023-11-26T07:12:23.802 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:12:23.802 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.a", 2023-11-26T07:12:23.802 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBv72JlhmTiEhAA/g3oblyy8oWp0Ha83rXvJw==", 2023-11-26T07:12:23.802 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:12:23.802 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-26T07:12:23.803 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-26T07:12:23.803 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-26T07:12:23.803 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:12:23.803 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:12:23.803 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:12:23.803 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:12:23.803 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.b", 2023-11-26T07:12:23.803 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBv72Jlq7BeHxAAOcHBt+2M+s3xqG9k14Oong==", 2023-11-26T07:12:23.803 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:12:23.803 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-26T07:12:23.803 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-26T07:12:23.803 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-26T07:12:23.804 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:12:23.804 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:12:23.804 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:12:23.804 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:12:23.804 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.c", 2023-11-26T07:12:23.804 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBv72Jl5jJFGhAAni1U32wc8K7h2w2Uri/P1Q==", 2023-11-26T07:12:23.804 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:12:23.804 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-26T07:12:23.804 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-26T07:12:23.804 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-26T07:12:23.804 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:12:23.804 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:12:23.805 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:12:23.805 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:12:23.805 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.d", 2023-11-26T07:12:23.805 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBv72JlhpKzJhAAp75J2TEPTop+Zj8ziajW1w==", 2023-11-26T07:12:23.805 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:12:23.805 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-26T07:12:23.805 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-26T07:12:23.805 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-26T07:12:23.805 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:12:23.805 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:12:23.805 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:12:23.805 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:12:23.806 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.0", 2023-11-26T07:12:23.806 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBx72JlnIatFhAAQQkaBQT0iVGJLFeE3ITlAQ==", 2023-11-26T07:12:23.806 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:12:23.806 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-26T07:12:23.806 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-26T07:12:23.806 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:12:23.806 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:12:23.806 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:12:23.806 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:12:23.806 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.1", 2023-11-26T07:12:23.806 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQB072JlXBpBFhAAAEeTzgDMWrtz6OM1Xt6AQg==", 2023-11-26T07:12:23.806 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:12:23.807 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-26T07:12:23.807 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-26T07:12:23.807 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:12:23.807 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:12:23.807 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:12:23.807 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:12:23.807 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.2", 2023-11-26T07:12:23.807 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQB372Jl4nopFhAAYua4b0EX2F1ldmd/00FcUA==", 2023-11-26T07:12:23.807 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:12:23.807 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-26T07:12:23.807 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-26T07:12:23.807 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:12:23.808 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:12:23.808 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:12:23.808 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:12:23.808 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.3", 2023-11-26T07:12:23.808 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQB672Jl73zLFRAATTzBUJUAS8/WHwoQZWQX1w==", 2023-11-26T07:12:23.808 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:12:23.808 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-26T07:12:23.808 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-26T07:12:23.808 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:12:23.808 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:12:23.808 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:12:23.808 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:12:23.808 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.4", 2023-11-26T07:12:23.809 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQCA72JlEqEZGhAAp//g7ZC8YUXoQhoKZKtcDA==", 2023-11-26T07:12:23.809 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:12:23.809 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-26T07:12:23.809 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-26T07:12:23.809 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:12:23.809 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:12:23.809 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:12:23.809 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:12:23.809 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.5", 2023-11-26T07:12:23.809 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQCD72JlGuu/GRAAQb5WygMoPJ7mjB2fR8N3+g==", 2023-11-26T07:12:23.809 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:12:23.809 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-26T07:12:23.810 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-26T07:12:23.810 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:12:23.810 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:12:23.810 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:12:23.810 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:12:23.810 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.6", 2023-11-26T07:12:23.810 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQCG72JlLHYCGRAAEDOtGcsGAVuKMSaXdJdgXg==", 2023-11-26T07:12:23.810 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:12:23.810 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-26T07:12:23.810 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-26T07:12:23.810 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:12:23.810 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:12:23.811 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:12:23.811 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:12:23.811 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.7", 2023-11-26T07:12:23.811 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQCJ72JlKmUJGRAAG7LL7Ath8gv2/HwbKsXYbg==", 2023-11-26T07:12:23.811 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:12:23.811 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-26T07:12:23.811 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-26T07:12:23.811 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:12:23.811 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:12:23.811 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:12:23.811 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:12:23.811 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.0", 2023-11-26T07:12:23.812 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBv72JlaEgQKxAA4cVx4nUFgqn0HvVBJdVHVg==", 2023-11-26T07:12:23.812 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:12:23.812 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-26T07:12:23.812 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2023-11-26T07:12:23.812 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2023-11-26T07:12:23.812 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2023-11-26T07:12:23.812 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:12:23.812 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:12:23.812 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:12:23.812 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.1", 2023-11-26T07:12:23.812 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBv72Jl/WHJMRAAcXuo1XInXpAErMaGOhvpBA==", 2023-11-26T07:12:23.812 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:12:23.813 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-26T07:12:23.813 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2023-11-26T07:12:23.813 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2023-11-26T07:12:23.813 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2023-11-26T07:12:23.813 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:12:23.813 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:12:23.813 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:12:23.813 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.2", 2023-11-26T07:12:23.813 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBv72Jl859vLhAAX9K4SuB6kAi/thy6EVKwWA==", 2023-11-26T07:12:23.813 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:12:23.813 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-26T07:12:23.813 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2023-11-26T07:12:23.813 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2023-11-26T07:12:23.814 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2023-11-26T07:12:23.814 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:12:23.814 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:12:23.814 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:12:23.814 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.3", 2023-11-26T07:12:23.814 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBv72JlRDh9NxAAgWUYNNwgFOantC7zH0fC8g==", 2023-11-26T07:12:23.814 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:12:23.814 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-26T07:12:23.814 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2023-11-26T07:12:23.814 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2023-11-26T07:12:23.814 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2023-11-26T07:12:23.814 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:12:23.815 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:12:23.815 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:12:23.815 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.admin", 2023-11-26T07:12:23.815 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBu72JlGFz7MBAA3accSSm2BS7VSUwOhEVnRQ==", 2023-11-26T07:12:23.815 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:12:23.815 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2023-11-26T07:12:23.815 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-26T07:12:23.815 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-26T07:12:23.815 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:12:23.815 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:12:23.815 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:12:23.815 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:12:23.816 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-mds", 2023-11-26T07:12:23.816 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQCU72JlznK0GxAALyvYRhX7yIN2jYIcNTMBwQ==", 2023-11-26T07:12:23.816 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:12:23.816 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-mds" 2023-11-26T07:12:23.816 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:12:23.816 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:12:23.816 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:12:23.816 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-mgr", 2023-11-26T07:12:23.816 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQCU72JlpoS0GxAAWvbj//CLhRo6aJgvMt6Rnw==", 2023-11-26T07:12:23.816 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:12:23.816 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-26T07:12:23.816 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:12:23.816 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:12:23.817 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:12:23.817 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-osd", 2023-11-26T07:12:23.817 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQCU72JlWI60GxAA4bSfiT+UF4pTKxyz2VcfzA==", 2023-11-26T07:12:23.817 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:12:23.817 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-osd" 2023-11-26T07:12:23.817 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:12:23.817 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:12:23.817 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:12:23.817 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-rbd", 2023-11-26T07:12:23.817 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQCU72JltZe0GxAAM+XCx10SYx82dCh/vsaA3Q==", 2023-11-26T07:12:23.817 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:12:23.817 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-26T07:12:23.818 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:12:23.818 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:12:23.818 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:12:23.818 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-26T07:12:23.818 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQCU72Jl76C0GxAAJFT/YftpJpQVHj4CAu7ktg==", 2023-11-26T07:12:23.818 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:12:23.818 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-26T07:12:23.818 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:12:23.818 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:12:23.818 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:12:23.818 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-rgw", 2023-11-26T07:12:23.818 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQCU72JlH6q0GxAAwVmJLOACbUhJnvCLi/T0gA==", 2023-11-26T07:12:23.819 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:12:23.819 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-26T07:12:23.819 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:12:23.819 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:12:23.819 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:12:23.819 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.x", 2023-11-26T07:12:23.819 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBv72Jlq5FrDxAAoovK02XkZdaKmOAgVyJKWw==", 2023-11-26T07:12:23.819 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:12:23.819 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2023-11-26T07:12:23.819 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2023-11-26T07:12:23.819 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:12:23.819 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:12:23.819 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:12:23.820 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:12:23.820 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.y", 2023-11-26T07:12:23.820 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBv72Jl5jZZCxAANtm1EyG6Goa1xfuH6Mcy2g==", 2023-11-26T07:12:23.820 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:12:23.820 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2023-11-26T07:12:23.820 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2023-11-26T07:12:23.820 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:12:23.820 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:12:23.820 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:12:23.820 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2023-11-26T07:12:23.820 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-26T07:12:23.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.801+0000 7f0bd38ba700 1 -- 172.21.15.2:0/4195842814 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0bb006aed0 msgr2=0x7f0bb006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:23.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.801+0000 7f0bd38ba700 1 --2- 172.21.15.2:0/4195842814 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0bb006aed0 0x7f0bb006d390 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0cceb0 tx=0x7f0bc801c040 comp rx=0 tx=0).stop 2023-11-26T07:12:23.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.801+0000 7f0bd38ba700 1 -- 172.21.15.2:0/4195842814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bcc0b44c0 msgr2=0x7f0bcc15cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:23.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.801+0000 7f0bd38ba700 1 --2- 172.21.15.2:0/4195842814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bcc0b44c0 0x7f0bcc15cbd0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc00c520 tx=0x7f0bbc00c8e0 comp rx=0 tx=0).stop 2023-11-26T07:12:23.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.801+0000 7f0bd38ba700 1 -- 172.21.15.2:0/4195842814 shutdown_connections 2023-11-26T07:12:23.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.801+0000 7f0bd38ba700 1 --2- 172.21.15.2:0/4195842814 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0bb006aed0 0x7f0bb006d390 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:23.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.801+0000 7f0bd38ba700 1 --2- 172.21.15.2:0/4195842814 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0bcc1448b0 0x7f0bcc0d0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:23.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.801+0000 7f0bd38ba700 1 --2- 172.21.15.2:0/4195842814 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bcc06f990 0x7f0bcc1f5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:23.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.801+0000 7f0bd38ba700 1 --2- 172.21.15.2:0/4195842814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bcc0b44c0 0x7f0bcc15cbd0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:23.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.801+0000 7f0bd38ba700 1 -- 172.21.15.2:0/4195842814 >> 172.21.15.2:0/4195842814 conn(0x7f0bcc0d0bc0 msgr2=0x7f0bcc0b1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:23.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.801+0000 7f0bd38ba700 1 -- 172.21.15.2:0/4195842814 shutdown_connections 2023-11-26T07:12:23.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.801+0000 7f0bd38ba700 1 -- 172.21.15.2:0/4195842814 wait complete. 2023-11-26T07:12:23.823 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-26T07:12:23.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.946+0000 7f8920b99700 1 Processor -- start 2023-11-26T07:12:23.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.946+0000 7f8920b99700 1 -- start start 2023-11-26T07:12:23.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.947+0000 7f8920b99700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f891c15abb0 0x7f891c0b4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:23.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.947+0000 7f8920b99700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f891c0b4d50 0x7f891c071d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:23.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.947+0000 7f8920b99700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f891c072760 con 0x7f891c0722d0 2023-11-26T07:12:23.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.947+0000 7f8920b99700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f891c0b51d0 con 0x7f891c15abb0 2023-11-26T07:12:23.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.947+0000 7f8920b99700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f891c06e550 con 0x7f891c0b4d50 2023-11-26T07:12:23.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.947+0000 7f8919d9b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f891c0b4d50 0x7f891c071d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:23.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.947+0000 7f891a59c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f891c15abb0 0x7f891c0b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:23.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.947+0000 7f8919d9b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f891c0b4d50 0x7f891c071d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.2:38670/0 (socket says 172.21.15.2:38670) 2023-11-26T07:12:23.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.947+0000 7f891a59c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f891c15abb0 0x7f891c0b4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.2:49176/0 (socket says 172.21.15.2:49176) 2023-11-26T07:12:23.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.947+0000 7f891ad9d700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f891c0722d0 0x7f891c15e760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.2:39174/0 (socket says 172.21.15.2:39174) 2023-11-26T07:12:23.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.947+0000 7f8919d9b700 1 -- 172.21.15.2:0/1864351316 learned_addr learned my addr 172.21.15.2:0/1864351316 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:23.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.948+0000 7f891a59c700 1 -- 172.21.15.2:0/1864351316 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f891c0b4d50 msgr2=0x7f891c071d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:23.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.948+0000 7f891a59c700 1 --2- 172.21.15.2:0/1864351316 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f891c0b4d50 0x7f891c071d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:23.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.948+0000 7f891a59c700 1 -- 172.21.15.2:0/1864351316 >> v1:172.21.15.192:6789/0 conn(0x7f891c0722d0 legacy=0x7f891c15e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:23.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.948+0000 7f891a59c700 1 -- 172.21.15.2:0/1864351316 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f891c06f3b0 con 0x7f891c15abb0 2023-11-26T07:12:23.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.948+0000 7f891959a700 1 -- 172.21.15.2:0/1864351316 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2656120403 0 0) 0x7f8914001490 con 0x7f891c0722d0 2023-11-26T07:12:23.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.948+0000 7f8919d9b700 1 --2- 172.21.15.2:0/1864351316 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f891c0b4d50 0x7f891c071d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:12:23.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.948+0000 7f891a59c700 1 --2- 172.21.15.2:0/1864351316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f891c15abb0 0x7f891c0b4810 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f891000bae0 tx=0x7f891000bdf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52cca057a5347b52 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:23.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.948+0000 7f891959a700 1 -- 172.21.15.2:0/1864351316 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891000dc70 con 0x7f891c15abb0 2023-11-26T07:12:23.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.948+0000 7f891959a700 1 -- 172.21.15.2:0/1864351316 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f891000ddd0 con 0x7f891c15abb0 2023-11-26T07:12:23.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.948+0000 7f891959a700 1 -- 172.21.15.2:0/1864351316 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8910010690 con 0x7f891c15abb0 2023-11-26T07:12:23.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.949+0000 7f8920b99700 1 -- 172.21.15.2:0/1864351316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f891c15abb0 msgr2=0x7f891c0b4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:23.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.949+0000 7f8920b99700 1 --2- 172.21.15.2:0/1864351316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f891c15abb0 0x7f891c0b4810 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f891000bae0 tx=0x7f891000bdf0 comp rx=0 tx=0).stop 2023-11-26T07:12:23.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.949+0000 7f8920b99700 1 -- 172.21.15.2:0/1864351316 shutdown_connections 2023-11-26T07:12:23.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.949+0000 7f8920b99700 1 --2- 172.21.15.2:0/1864351316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f891c15abb0 0x7f891c0b4810 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:23.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.949+0000 7f8920b99700 1 --2- 172.21.15.2:0/1864351316 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f891c0b4d50 0x7f891c071d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:23.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.949+0000 7f8920b99700 1 -- 172.21.15.2:0/1864351316 >> 172.21.15.2:0/1864351316 conn(0x7f891c0d0aa0 msgr2=0x7f891c0d0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:23.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.949+0000 7f8920b99700 1 -- 172.21.15.2:0/1864351316 shutdown_connections 2023-11-26T07:12:23.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.949+0000 7f8920b99700 1 -- 172.21.15.2:0/1864351316 wait complete. 2023-11-26T07:12:23.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.950+0000 7f8920b99700 1 Processor -- start 2023-11-26T07:12:23.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.950+0000 7f8920b99700 1 -- start start 2023-11-26T07:12:23.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.951+0000 7f8920b99700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f891c0722d0 0x7f891c1f6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:23.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.951+0000 7f8920b99700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f891c0b4d50 0x7f891c06afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:23.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.951+0000 7f8920b99700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f891c15abb0 0x7f891c06b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:23.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.951+0000 7f8920b99700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f891c159680 con 0x7f891c0b4d50 2023-11-26T07:12:23.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.951+0000 7f8920b99700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f891c15bb70 con 0x7f891c0722d0 2023-11-26T07:12:23.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.951+0000 7f8920b99700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f891c15be50 con 0x7f891c15abb0 2023-11-26T07:12:23.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.951+0000 7f8919d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f891c0b4d50 0x7f891c06afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:23.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.951+0000 7f8919d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f891c0b4d50 0x7f891c06afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40598/0 (socket says 172.21.15.2:40598) 2023-11-26T07:12:23.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.951+0000 7f8919d9b700 1 -- 172.21.15.2:0/269568576 learned_addr learned my addr 172.21.15.2:0/269568576 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:23.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.951+0000 7f891ad9d700 1 --2- 172.21.15.2:0/269568576 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f891c15abb0 0x7f891c06b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:23.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.951+0000 7f891a59c700 1 --2- 172.21.15.2:0/269568576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f891c0722d0 0x7f891c1f6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:23.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.951+0000 7f8919d9b700 1 -- 172.21.15.2:0/269568576 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f891c15abb0 msgr2=0x7f891c06b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:23.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.951+0000 7f8919d9b700 1 --2- 172.21.15.2:0/269568576 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f891c15abb0 0x7f891c06b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:23.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.951+0000 7f8919d9b700 1 -- 172.21.15.2:0/269568576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f891c0722d0 msgr2=0x7f891c1f6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:23.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.951+0000 7f8919d9b700 1 --2- 172.21.15.2:0/269568576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f891c0722d0 0x7f891c1f6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:23.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.951+0000 7f8919d9b700 1 -- 172.21.15.2:0/269568576 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f890c009550 con 0x7f891c0b4d50 2023-11-26T07:12:23.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.951+0000 7f891ad9d700 1 --2- 172.21.15.2:0/269568576 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f891c15abb0 0x7f891c06b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:23.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.952+0000 7f8919d9b700 1 --2- 172.21.15.2:0/269568576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f891c0b4d50 0x7f891c06afd0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f890c00ebe0 tx=0x7f890c009e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:23.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.952+0000 7f890affd700 1 -- 172.21.15.2:0/269568576 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c00c8b0 con 0x7f891c0b4d50 2023-11-26T07:12:23.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.952+0000 7f890affd700 1 -- 172.21.15.2:0/269568576 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f890c00ca10 con 0x7f891c0b4d50 2023-11-26T07:12:23.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.952+0000 7f8920b99700 1 -- 172.21.15.2:0/269568576 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f891000b740 con 0x7f891c0b4d50 2023-11-26T07:12:23.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.952+0000 7f890affd700 1 -- 172.21.15.2:0/269568576 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c00cd80 con 0x7f891c0b4d50 2023-11-26T07:12:23.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.952+0000 7f8920b99700 1 -- 172.21.15.2:0/269568576 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f891c15c410 con 0x7f891c0b4d50 2023-11-26T07:12:23.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.953+0000 7f8920b99700 1 -- 172.21.15.2:0/269568576 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f891c1f3c80 con 0x7f891c0b4d50 2023-11-26T07:12:23.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.953+0000 7f890affd700 1 -- 172.21.15.2:0/269568576 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f890c013470 con 0x7f891c0b4d50 2023-11-26T07:12:23.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.954+0000 7f890affd700 1 --2- 172.21.15.2:0/269568576 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f88fc06af00 0x7f88fc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:23.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.954+0000 7f890affd700 1 -- 172.21.15.2:0/269568576 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f890c0895d0 con 0x7f891c0b4d50 2023-11-26T07:12:23.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.954+0000 7f891a59c700 1 --2- 172.21.15.2:0/269568576 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f88fc06af00 0x7f88fc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:23.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.954+0000 7f891a59c700 1 --2- 172.21.15.2:0/269568576 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f88fc06af00 0x7f88fc06d3c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f891000be30 tx=0x7f8910008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:23.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:23.958+0000 7f890affd700 1 -- 172.21.15.2:0/269568576 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f891c1f3c80 con 0x7f891c0b4d50 2023-11-26T07:12:24.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.242+0000 7f8920b99700 1 -- 172.21.15.2:0/269568576 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f891c1f3c80 con 0x7f891c0b4d50 2023-11-26T07:12:24.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.243+0000 7f890affd700 1 -- 172.21.15.2:0/269568576 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f891c1f3c80 con 0x7f891c0b4d50 2023-11-26T07:12:24.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.245+0000 7f8920b99700 1 -- 172.21.15.2:0/269568576 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f88fc06af00 msgr2=0x7f88fc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:24.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.245+0000 7f8920b99700 1 --2- 172.21.15.2:0/269568576 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f88fc06af00 0x7f88fc06d3c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f891000be30 tx=0x7f8910008040 comp rx=0 tx=0).stop 2023-11-26T07:12:24.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.245+0000 7f8920b99700 1 -- 172.21.15.2:0/269568576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f891c0b4d50 msgr2=0x7f891c06afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:24.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.245+0000 7f8920b99700 1 --2- 172.21.15.2:0/269568576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f891c0b4d50 0x7f891c06afd0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f890c00ebe0 tx=0x7f890c009e70 comp rx=0 tx=0).stop 2023-11-26T07:12:24.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.246+0000 7f8920b99700 1 -- 172.21.15.2:0/269568576 shutdown_connections 2023-11-26T07:12:24.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.246+0000 7f8920b99700 1 --2- 172.21.15.2:0/269568576 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f88fc06af00 0x7f88fc06d3c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:24.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.246+0000 7f8920b99700 1 --2- 172.21.15.2:0/269568576 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f891c15abb0 0x7f891c06b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:24.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.246+0000 7f8920b99700 1 --2- 172.21.15.2:0/269568576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f891c0722d0 0x7f891c1f6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:24.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.246+0000 7f8920b99700 1 --2- 172.21.15.2:0/269568576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f891c0b4d50 0x7f891c06afd0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:24.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.246+0000 7f8920b99700 1 -- 172.21.15.2:0/269568576 >> 172.21.15.2:0/269568576 conn(0x7f891c0d0aa0 msgr2=0x7f891c0cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:24.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.246+0000 7f8920b99700 1 -- 172.21.15.2:0/269568576 shutdown_connections 2023-11-26T07:12:24.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.246+0000 7f8920b99700 1 -- 172.21.15.2:0/269568576 wait complete. 2023-11-26T07:12:24.261 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-26T07:12:24.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.391+0000 7facffd6b700 1 Processor -- start 2023-11-26T07:12:24.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.391+0000 7facffd6b700 1 -- start start 2023-11-26T07:12:24.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.392+0000 7facffd6b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7facf8071bb0 0x7facf806afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:24.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.392+0000 7facffd6b700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facf8147bb0 con 0x7facf806b510 2023-11-26T07:12:24.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.392+0000 7facffd6b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facf80d0460 con 0x7facf80d0080 2023-11-26T07:12:24.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.392+0000 7facffd6b700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facf8072cd0 con 0x7facf8071bb0 2023-11-26T07:12:24.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.392+0000 7facfe308700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7facf806b510 0x7facf806dfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60054/0 (socket says 172.21.15.2:60054) 2023-11-26T07:12:24.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.392+0000 7facfe308700 1 -- 172.21.15.2:0/1987904751 learned_addr learned my addr 172.21.15.2:0/1987904751 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:24.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.393+0000 7facfcb05700 1 -- 172.21.15.2:0/1987904751 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3019458523 0 0) 0x7facf8147bb0 con 0x7facf806b510 2023-11-26T07:12:24.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.393+0000 7facfd306700 1 --2- 172.21.15.2:0/1987904751 >> v2:172.21.15.192:3300/0 conn(0x7facf8071bb0 0x7facf806afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:24.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.393+0000 7facfcb05700 1 -- 172.21.15.2:0/1987904751 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7face00035b0 con 0x7facf806b510 2023-11-26T07:12:24.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.393+0000 7facfcb05700 1 -- 172.21.15.2:0/1987904751 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 288482672 0 0) 0x7face00035b0 con 0x7facf806b510 2023-11-26T07:12:24.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.393+0000 7facfcb05700 1 -- 172.21.15.2:0/1987904751 >> v2:172.21.15.192:3300/0 conn(0x7facf8071bb0 msgr2=0x7facf806afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:24.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.393+0000 7facfcb05700 1 --2- 172.21.15.2:0/1987904751 >> v2:172.21.15.192:3300/0 conn(0x7facf8071bb0 0x7facf806afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:24.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.393+0000 7facfcb05700 1 -- 172.21.15.2:0/1987904751 >> v1:172.21.15.192:6789/0 conn(0x7facf80d0080 legacy=0x7facf80b5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:24.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.393+0000 7facfcb05700 1 -- 172.21.15.2:0/1987904751 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf8072150 con 0x7facf806b510 2023-11-26T07:12:24.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.393+0000 7facfcb05700 1 -- 172.21.15.2:0/1987904751 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7facf0001670 con 0x7facf806b510 2023-11-26T07:12:24.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.393+0000 7facfcb05700 1 -- 172.21.15.2:0/1987904751 >> v1:172.21.15.2:6789/0 conn(0x7facf806b510 legacy=0x7facf806dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:24.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.393+0000 7facfcb05700 1 --2- 172.21.15.2:0/1987904751 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7face0003a00 0x7face0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:24.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.393+0000 7facfcb05700 1 --2- 172.21.15.2:0/1987904751 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7face0004850 0x7face0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:24.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.393+0000 7facfcb05700 1 --2- 172.21.15.2:0/1987904751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7face0005210 0x7face000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:24.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.393+0000 7facfcb05700 1 -- 172.21.15.2:0/1987904751 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf8072cd0 con 0x7face0005210 2023-11-26T07:12:24.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.393+0000 7facfcb05700 1 -- 172.21.15.2:0/1987904751 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face000c0b0 con 0x7face0003a00 2023-11-26T07:12:24.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.393+0000 7facfcb05700 1 -- 172.21.15.2:0/1987904751 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face000c270 con 0x7face0004850 2023-11-26T07:12:24.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.393+0000 7facfe308700 1 --2- 172.21.15.2:0/1987904751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7face0005210 0x7face000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:24.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.393+0000 7facfd306700 1 --2- 172.21.15.2:0/1987904751 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7face0004850 0x7face0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:24.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.393+0000 7facfdb07700 1 --2- 172.21.15.2:0/1987904751 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7face0003a00 0x7face0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:24.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.393+0000 7facfe308700 1 -- 172.21.15.2:0/1987904751 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7face0004850 msgr2=0x7face0004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:24.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.393+0000 7facfe308700 1 --2- 172.21.15.2:0/1987904751 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7face0004850 0x7face0004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:24.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.393+0000 7facfe308700 1 -- 172.21.15.2:0/1987904751 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7face0003a00 msgr2=0x7face0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:24.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.393+0000 7facfe308700 1 --2- 172.21.15.2:0/1987904751 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7face0003a00 0x7face0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:24.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.393+0000 7facfe308700 1 -- 172.21.15.2:0/1987904751 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face00035b0 con 0x7face0005210 2023-11-26T07:12:24.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.393+0000 7facfd306700 1 --2- 172.21.15.2:0/1987904751 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7face0004850 0x7face0004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:24.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.393+0000 7facfe308700 1 -- 172.21.15.2:0/1987904751 reap_dead start 2023-11-26T07:12:24.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.394+0000 7facfe308700 1 --2- 172.21.15.2:0/1987904751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7face0005210 0x7face000ba10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7facf000c240 tx=0x7face0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ded1b498380bb2a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:24.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.394+0000 7facfcb05700 1 -- 172.21.15.2:0/1987904751 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf0007c10 con 0x7face0005210 2023-11-26T07:12:24.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.394+0000 7facfcb05700 1 -- 172.21.15.2:0/1987904751 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf000cde0 con 0x7face0005210 2023-11-26T07:12:24.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.394+0000 7facfcb05700 1 -- 172.21.15.2:0/1987904751 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf0005ba0 con 0x7face0005210 2023-11-26T07:12:24.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.394+0000 7facffd6b700 1 -- 172.21.15.2:0/1987904751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7face0005210 msgr2=0x7face000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:24.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.394+0000 7facffd6b700 1 --2- 172.21.15.2:0/1987904751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7face0005210 0x7face000ba10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7facf000c240 tx=0x7face0005880 comp rx=0 tx=0).stop 2023-11-26T07:12:24.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.394+0000 7facffd6b700 1 -- 172.21.15.2:0/1987904751 shutdown_connections 2023-11-26T07:12:24.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.394+0000 7facffd6b700 1 --2- 172.21.15.2:0/1987904751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7face0005210 0x7face000ba10 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:24.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.394+0000 7facffd6b700 1 -- 172.21.15.2:0/1987904751 >> 172.21.15.2:0/1987904751 conn(0x7facf80b27d0 msgr2=0x7facf80b2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:24.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.394+0000 7facffd6b700 1 -- 172.21.15.2:0/1987904751 shutdown_connections 2023-11-26T07:12:24.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.394+0000 7facffd6b700 1 -- 172.21.15.2:0/1987904751 wait complete. 2023-11-26T07:12:24.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.396+0000 7facffd6b700 1 Processor -- start 2023-11-26T07:12:24.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.396+0000 7facffd6b700 1 -- start start 2023-11-26T07:12:24.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.397+0000 7facffd6b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7face0005210 0x7facf81f7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:24.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.397+0000 7facffd6b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7facf8140c70 0x7facf81410f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:24.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.397+0000 7facffd6b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facf8142c60 0x7facf81430f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:24.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.397+0000 7facffd6b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf81f4730 con 0x7facf8142c60 2023-11-26T07:12:24.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.397+0000 7facffd6b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf8141630 con 0x7face0005210 2023-11-26T07:12:24.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.397+0000 7facffd6b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facf81f5800 con 0x7facf8140c70 2023-11-26T07:12:24.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.397+0000 7facfe308700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facf8142c60 0x7facf81430f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:24.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.397+0000 7facfe308700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facf8142c60 0x7facf81430f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40624/0 (socket says 172.21.15.2:40624) 2023-11-26T07:12:24.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.397+0000 7facfe308700 1 -- 172.21.15.2:0/631183649 learned_addr learned my addr 172.21.15.2:0/631183649 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:24.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.397+0000 7facfd306700 1 --2- 172.21.15.2:0/631183649 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7facf8140c70 0x7facf81410f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:24.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.397+0000 7facfdb07700 1 --2- 172.21.15.2:0/631183649 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7face0005210 0x7facf81f7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:24.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.397+0000 7facfe308700 1 -- 172.21.15.2:0/631183649 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7facf8140c70 msgr2=0x7facf81410f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:24.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.397+0000 7facfe308700 1 --2- 172.21.15.2:0/631183649 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7facf8140c70 0x7facf81410f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:24.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.397+0000 7facfe308700 1 -- 172.21.15.2:0/631183649 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7face0005210 msgr2=0x7facf81f7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:24.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.397+0000 7facfe308700 1 --2- 172.21.15.2:0/631183649 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7face0005210 0x7facf81f7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:24.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.397+0000 7facfe308700 1 -- 172.21.15.2:0/631183649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf81f76b0 con 0x7facf8142c60 2023-11-26T07:12:24.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.397+0000 7facfdb07700 1 --2- 172.21.15.2:0/631183649 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7face0005210 0x7facf81f7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:24.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.397+0000 7facfd306700 1 --2- 172.21.15.2:0/631183649 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7facf8140c70 0x7facf81410f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:24.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.398+0000 7facfe308700 1 --2- 172.21.15.2:0/631183649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facf8142c60 0x7facf81430f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7facf8161af0 tx=0x7facf0001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:24.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.398+0000 7facf67fc700 1 -- 172.21.15.2:0/631183649 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf0000ed0 con 0x7facf8142c60 2023-11-26T07:12:24.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.398+0000 7facf67fc700 1 -- 172.21.15.2:0/631183649 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf000cbe0 con 0x7facf8142c60 2023-11-26T07:12:24.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.398+0000 7facffd6b700 1 -- 172.21.15.2:0/631183649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facf8143970 con 0x7facf8142c60 2023-11-26T07:12:24.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.398+0000 7facf67fc700 1 -- 172.21.15.2:0/631183649 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf00070d0 con 0x7facf8142c60 2023-11-26T07:12:24.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.398+0000 7facffd6b700 1 -- 172.21.15.2:0/631183649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facf813e600 con 0x7facf8142c60 2023-11-26T07:12:24.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.399+0000 7facffd6b700 1 -- 172.21.15.2:0/631183649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facf80b3fa0 con 0x7facf8142c60 2023-11-26T07:12:24.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.399+0000 7facf67fc700 1 -- 172.21.15.2:0/631183649 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7facf0007230 con 0x7facf8142c60 2023-11-26T07:12:24.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.400+0000 7facf67fc700 1 --2- 172.21.15.2:0/631183649 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7face406aed0 0x7face406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:24.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.400+0000 7facf67fc700 1 -- 172.21.15.2:0/631183649 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7facf00890c0 con 0x7facf8142c60 2023-11-26T07:12:24.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.400+0000 7facfdb07700 1 --2- 172.21.15.2:0/631183649 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7face406aed0 0x7face406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:24.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.400+0000 7facfdb07700 1 --2- 172.21.15.2:0/631183649 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7face406aed0 0x7face406d390 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7facf815ef80 tx=0x7face8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:24.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.404+0000 7facf67fc700 1 -- 172.21.15.2:0/631183649 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7facf0054580 con 0x7facf8142c60 2023-11-26T07:12:24.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.689+0000 7facffd6b700 1 -- 172.21.15.2:0/631183649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7facf8068670 con 0x7facf8142c60 2023-11-26T07:12:24.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.691+0000 7facf67fc700 1 -- 172.21.15.2:0/631183649 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7facf0057ba0 con 0x7facf8142c60 2023-11-26T07:12:24.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.693+0000 7facffd6b700 1 -- 172.21.15.2:0/631183649 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7face406aed0 msgr2=0x7face406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:24.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.693+0000 7facffd6b700 1 --2- 172.21.15.2:0/631183649 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7face406aed0 0x7face406d390 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7facf815ef80 tx=0x7face8009040 comp rx=0 tx=0).stop 2023-11-26T07:12:24.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.693+0000 7facffd6b700 1 -- 172.21.15.2:0/631183649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facf8142c60 msgr2=0x7facf81430f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:24.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.693+0000 7facffd6b700 1 --2- 172.21.15.2:0/631183649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facf8142c60 0x7facf81430f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7facf8161af0 tx=0x7facf0001a00 comp rx=0 tx=0).stop 2023-11-26T07:12:24.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.693+0000 7facffd6b700 1 -- 172.21.15.2:0/631183649 shutdown_connections 2023-11-26T07:12:24.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.693+0000 7facffd6b700 1 --2- 172.21.15.2:0/631183649 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7face406aed0 0x7face406d390 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:24.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.693+0000 7facffd6b700 1 --2- 172.21.15.2:0/631183649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facf8142c60 0x7facf81430f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:24.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.693+0000 7facffd6b700 1 --2- 172.21.15.2:0/631183649 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7face0005210 0x7facf81f7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:24.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.693+0000 7facffd6b700 1 --2- 172.21.15.2:0/631183649 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7facf8140c70 0x7facf81410f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:24.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.693+0000 7facffd6b700 1 -- 172.21.15.2:0/631183649 >> 172.21.15.2:0/631183649 conn(0x7facf80b27d0 msgr2=0x7facf80b3890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:24.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.694+0000 7facffd6b700 1 -- 172.21.15.2:0/631183649 shutdown_connections 2023-11-26T07:12:24.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.694+0000 7facffd6b700 1 -- 172.21.15.2:0/631183649 wait complete. 2023-11-26T07:12:24.708 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-26T07:12:24.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.832+0000 7fd297d8d700 1 Processor -- start 2023-11-26T07:12:24.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.832+0000 7fd297d8d700 1 -- start start 2023-11-26T07:12:24.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.833+0000 7fd297d8d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd2901440f0 0x7fd2900b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:24.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.833+0000 7fd297d8d700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd290143ec0 con 0x7fd2900722c0 2023-11-26T07:12:24.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.833+0000 7fd297d8d700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2900b3ae0 con 0x7fd290143ae0 2023-11-26T07:12:24.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.833+0000 7fd297d8d700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2900b40a0 con 0x7fd2901440f0 2023-11-26T07:12:24.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.833+0000 7fd295328700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd2900722c0 0x7fd29006e510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60072/0 (socket says 172.21.15.2:60072) 2023-11-26T07:12:24.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.833+0000 7fd295328700 1 -- 172.21.15.2:0/2421902366 learned_addr learned my addr 172.21.15.2:0/2421902366 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:24.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.833+0000 7fd294b27700 1 -- 172.21.15.2:0/2421902366 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2540722447 0 0) 0x7fd290143ec0 con 0x7fd2900722c0 2023-11-26T07:12:24.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.833+0000 7fd29632a700 1 --2- 172.21.15.2:0/2421902366 >> v2:172.21.15.192:3300/0 conn(0x7fd2901440f0 0x7fd2900b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:24.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.833+0000 7fd294b27700 1 -- 172.21.15.2:0/2421902366 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd27c0057c0 con 0x7fd2900722c0 2023-11-26T07:12:24.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.833+0000 7fd294b27700 1 -- 172.21.15.2:0/2421902366 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3841465950 0 0) 0x7fd27c0057c0 con 0x7fd2900722c0 2023-11-26T07:12:24.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.833+0000 7fd294b27700 1 -- 172.21.15.2:0/2421902366 >> v2:172.21.15.192:3300/0 conn(0x7fd2901440f0 msgr2=0x7fd2900b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:24.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.833+0000 7fd294b27700 1 --2- 172.21.15.2:0/2421902366 >> v2:172.21.15.192:3300/0 conn(0x7fd2901440f0 0x7fd2900b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:24.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.833+0000 7fd294b27700 1 -- 172.21.15.2:0/2421902366 >> v1:172.21.15.192:6789/0 conn(0x7fd290143ae0 legacy=0x7fd290071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:24.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.833+0000 7fd294b27700 1 -- 172.21.15.2:0/2421902366 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2900b3dc0 con 0x7fd2900722c0 2023-11-26T07:12:24.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.833+0000 7fd294b27700 1 -- 172.21.15.2:0/2421902366 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7fd280001670 con 0x7fd2900722c0 2023-11-26T07:12:24.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.833+0000 7fd294b27700 1 -- 172.21.15.2:0/2421902366 >> v1:172.21.15.2:6789/0 conn(0x7fd2900722c0 legacy=0x7fd29006e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:24.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.833+0000 7fd294b27700 1 --2- 172.21.15.2:0/2421902366 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd27c005c10 0x7fd27c006030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:24.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.833+0000 7fd294b27700 1 --2- 172.21.15.2:0/2421902366 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd27c006a60 0x7fd27c006ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:24.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.833+0000 7fd294b27700 1 --2- 172.21.15.2:0/2421902366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd27c007420 0x7fd27c00dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:24.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.833+0000 7fd294b27700 1 -- 172.21.15.2:0/2421902366 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2900b40a0 con 0x7fd27c007420 2023-11-26T07:12:24.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.833+0000 7fd294b27700 1 -- 172.21.15.2:0/2421902366 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c00e2c0 con 0x7fd27c005c10 2023-11-26T07:12:24.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.833+0000 7fd294b27700 1 -- 172.21.15.2:0/2421902366 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c00e480 con 0x7fd27c006a60 2023-11-26T07:12:24.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.834+0000 7fd29632a700 1 --2- 172.21.15.2:0/2421902366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd27c007420 0x7fd27c00dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:24.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.834+0000 7fd295b29700 1 --2- 172.21.15.2:0/2421902366 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd27c005c10 0x7fd27c006030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:24.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.834+0000 7fd295328700 1 --2- 172.21.15.2:0/2421902366 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd27c006a60 0x7fd27c006ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:24.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.834+0000 7fd29632a700 1 -- 172.21.15.2:0/2421902366 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd27c006a60 msgr2=0x7fd27c006ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:24.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.834+0000 7fd29632a700 1 --2- 172.21.15.2:0/2421902366 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd27c006a60 0x7fd27c006ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:24.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.834+0000 7fd29632a700 1 -- 172.21.15.2:0/2421902366 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd27c005c10 msgr2=0x7fd27c006030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:24.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.834+0000 7fd29632a700 1 --2- 172.21.15.2:0/2421902366 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd27c005c10 0x7fd27c006030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:24.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.834+0000 7fd29632a700 1 -- 172.21.15.2:0/2421902366 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd27c0057c0 con 0x7fd27c007420 2023-11-26T07:12:24.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.834+0000 7fd29632a700 1 -- 172.21.15.2:0/2421902366 reap_dead start 2023-11-26T07:12:24.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.834+0000 7fd29632a700 1 --2- 172.21.15.2:0/2421902366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd27c007420 0x7fd27c00dc20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd288009fc0 tx=0x7fd27c007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e335ecdc45e9b3e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:24.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.834+0000 7fd294b27700 1 -- 172.21.15.2:0/2421902366 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd288003a20 con 0x7fd27c007420 2023-11-26T07:12:24.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.834+0000 7fd294b27700 1 -- 172.21.15.2:0/2421902366 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28800f040 con 0x7fd27c007420 2023-11-26T07:12:24.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.834+0000 7fd294b27700 1 -- 172.21.15.2:0/2421902366 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd288003da0 con 0x7fd27c007420 2023-11-26T07:12:24.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.835+0000 7fd297d8d700 1 -- 172.21.15.2:0/2421902366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd27c007420 msgr2=0x7fd27c00dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:24.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.835+0000 7fd297d8d700 1 --2- 172.21.15.2:0/2421902366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd27c007420 0x7fd27c00dc20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd288009fc0 tx=0x7fd27c007a90 comp rx=0 tx=0).stop 2023-11-26T07:12:24.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.835+0000 7fd297d8d700 1 -- 172.21.15.2:0/2421902366 shutdown_connections 2023-11-26T07:12:24.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.835+0000 7fd297d8d700 1 --2- 172.21.15.2:0/2421902366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd27c007420 0x7fd27c00dc20 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:24.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.835+0000 7fd297d8d700 1 -- 172.21.15.2:0/2421902366 >> 172.21.15.2:0/2421902366 conn(0x7fd2900b2740 msgr2=0x7fd2900b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:24.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.835+0000 7fd297d8d700 1 -- 172.21.15.2:0/2421902366 shutdown_connections 2023-11-26T07:12:24.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.835+0000 7fd297d8d700 1 -- 172.21.15.2:0/2421902366 wait complete. 2023-11-26T07:12:24.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.836+0000 7fd297d8d700 1 Processor -- start 2023-11-26T07:12:24.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.836+0000 7fd297d8d700 1 -- start start 2023-11-26T07:12:24.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.837+0000 7fd297d8d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd27c007420 0x7fd29015b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:24.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.837+0000 7fd297d8d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2901401a0 0x7fd29012e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:24.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.837+0000 7fd297d8d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd29012e950 0x7fd290140f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:24.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.837+0000 7fd297d8d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd290153eb0 con 0x7fd27c007420 2023-11-26T07:12:24.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.837+0000 7fd297d8d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd290154100 con 0x7fd2901401a0 2023-11-26T07:12:24.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.837+0000 7fd297d8d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2901543e0 con 0x7fd29012e950 2023-11-26T07:12:24.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.837+0000 7fd295b29700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd27c007420 0x7fd29015b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:24.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.837+0000 7fd295b29700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd27c007420 0x7fd29015b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40640/0 (socket says 172.21.15.2:40640) 2023-11-26T07:12:24.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.837+0000 7fd295b29700 1 -- 172.21.15.2:0/2212531072 learned_addr learned my addr 172.21.15.2:0/2212531072 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:24.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.837+0000 7fd295b29700 1 -- 172.21.15.2:0/2212531072 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd29012e950 msgr2=0x7fd290140f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:24.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.837+0000 7fd295b29700 1 --2- 172.21.15.2:0/2212531072 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd29012e950 0x7fd290140f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:24.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.837+0000 7fd295b29700 1 -- 172.21.15.2:0/2212531072 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2901401a0 msgr2=0x7fd29012e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:24.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.837+0000 7fd295b29700 1 --2- 172.21.15.2:0/2212531072 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2901401a0 0x7fd29012e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:24.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.837+0000 7fd295b29700 1 -- 172.21.15.2:0/2212531072 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd290140a70 con 0x7fd27c007420 2023-11-26T07:12:24.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.837+0000 7fd295b29700 1 --2- 172.21.15.2:0/2212531072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd27c007420 0x7fd29015b5c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd28c00f7f0 tx=0x7fd28c00fbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:24.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.837+0000 7fd2867fc700 1 -- 172.21.15.2:0/2212531072 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28c0052e0 con 0x7fd27c007420 2023-11-26T07:12:24.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.838+0000 7fd2867fc700 1 -- 172.21.15.2:0/2212531072 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28c005440 con 0x7fd27c007420 2023-11-26T07:12:24.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.838+0000 7fd297d8d700 1 -- 172.21.15.2:0/2212531072 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2901546c0 con 0x7fd27c007420 2023-11-26T07:12:24.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.838+0000 7fd2867fc700 1 -- 172.21.15.2:0/2212531072 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28c0038a0 con 0x7fd27c007420 2023-11-26T07:12:24.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.838+0000 7fd297d8d700 1 -- 172.21.15.2:0/2212531072 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd290140800 con 0x7fd27c007420 2023-11-26T07:12:24.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.838+0000 7fd297d8d700 1 -- 172.21.15.2:0/2212531072 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd290140c00 con 0x7fd27c007420 2023-11-26T07:12:24.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.839+0000 7fd2867fc700 1 -- 172.21.15.2:0/2212531072 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd28c003a00 con 0x7fd27c007420 2023-11-26T07:12:24.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.839+0000 7fd2867fc700 1 --2- 172.21.15.2:0/2212531072 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd27406aed0 0x7fd27406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:24.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.839+0000 7fd2867fc700 1 -- 172.21.15.2:0/2212531072 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd28c0890d0 con 0x7fd27c007420 2023-11-26T07:12:24.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.840+0000 7fd295328700 1 --2- 172.21.15.2:0/2212531072 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd27406aed0 0x7fd27406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:24.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.840+0000 7fd295328700 1 --2- 172.21.15.2:0/2212531072 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd27406aed0 0x7fd27406d390 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd2800011e0 tx=0x7fd280001170 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:24.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:24.844+0000 7fd2867fc700 1 -- 172.21.15.2:0/2212531072 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd28c054430 con 0x7fd27c007420 2023-11-26T07:12:25.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.127+0000 7fd297d8d700 1 -- 172.21.15.2:0/2212531072 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fd2900cd8d0 con 0x7fd27c007420 2023-11-26T07:12:25.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.129+0000 7fd2867fc700 1 -- 172.21.15.2:0/2212531072 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd28c003cb0 con 0x7fd27c007420 2023-11-26T07:12:25.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.131+0000 7fd297d8d700 1 -- 172.21.15.2:0/2212531072 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd27406aed0 msgr2=0x7fd27406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:25.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.131+0000 7fd297d8d700 1 --2- 172.21.15.2:0/2212531072 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd27406aed0 0x7fd27406d390 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd2800011e0 tx=0x7fd280001170 comp rx=0 tx=0).stop 2023-11-26T07:12:25.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.131+0000 7fd297d8d700 1 -- 172.21.15.2:0/2212531072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd27c007420 msgr2=0x7fd29015b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:25.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.131+0000 7fd297d8d700 1 --2- 172.21.15.2:0/2212531072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd27c007420 0x7fd29015b5c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd28c00f7f0 tx=0x7fd28c00fbb0 comp rx=0 tx=0).stop 2023-11-26T07:12:25.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.131+0000 7fd297d8d700 1 -- 172.21.15.2:0/2212531072 shutdown_connections 2023-11-26T07:12:25.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.131+0000 7fd297d8d700 1 --2- 172.21.15.2:0/2212531072 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd27406aed0 0x7fd27406d390 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:25.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.131+0000 7fd297d8d700 1 --2- 172.21.15.2:0/2212531072 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd29012e950 0x7fd290140f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:25.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.131+0000 7fd297d8d700 1 --2- 172.21.15.2:0/2212531072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd27c007420 0x7fd29015b5c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:25.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.131+0000 7fd297d8d700 1 --2- 172.21.15.2:0/2212531072 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2901401a0 0x7fd29012e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:25.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.131+0000 7fd297d8d700 1 -- 172.21.15.2:0/2212531072 >> 172.21.15.2:0/2212531072 conn(0x7fd2900b2740 msgr2=0x7fd2900cf720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:25.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.131+0000 7fd297d8d700 1 -- 172.21.15.2:0/2212531072 shutdown_connections 2023-11-26T07:12:25.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.131+0000 7fd297d8d700 1 -- 172.21.15.2:0/2212531072 wait complete. 2023-11-26T07:12:25.146 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-26T07:12:25.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.270+0000 7f9f582d3700 1 Processor -- start 2023-11-26T07:12:25.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.270+0000 7f9f582d3700 1 -- start start 2023-11-26T07:12:25.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.270+0000 7f9f582d3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f501440f0 0x7f9f500b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:25.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.270+0000 7f9f582d3700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f50143ec0 con 0x7f9f500722c0 2023-11-26T07:12:25.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.270+0000 7f9f582d3700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f500b3ae0 con 0x7f9f50143ae0 2023-11-26T07:12:25.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.270+0000 7f9f582d3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f500b40a0 con 0x7f9f501440f0 2023-11-26T07:12:25.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.270+0000 7f9f5586e700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f9f500722c0 0x7f9f5006e510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60092/0 (socket says 172.21.15.2:60092) 2023-11-26T07:12:25.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.270+0000 7f9f5586e700 1 -- 172.21.15.2:0/4111238155 learned_addr learned my addr 172.21.15.2:0/4111238155 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:25.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.270+0000 7f9f56870700 1 --2- 172.21.15.2:0/4111238155 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f501440f0 0x7f9f500b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:25.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.270+0000 7f9f5506d700 1 -- 172.21.15.2:0/4111238155 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1205955270 0 0) 0x7f9f50143ec0 con 0x7f9f500722c0 2023-11-26T07:12:25.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.270+0000 7f9f5506d700 1 -- 172.21.15.2:0/4111238155 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f3c0035b0 con 0x7f9f500722c0 2023-11-26T07:12:25.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.271+0000 7f9f5506d700 1 -- 172.21.15.2:0/4111238155 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2730878784 0 0) 0x7f9f3c0035b0 con 0x7f9f500722c0 2023-11-26T07:12:25.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.271+0000 7f9f5506d700 1 -- 172.21.15.2:0/4111238155 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f501440f0 msgr2=0x7f9f500b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:25.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.271+0000 7f9f5506d700 1 --2- 172.21.15.2:0/4111238155 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f501440f0 0x7f9f500b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:25.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.271+0000 7f9f5506d700 1 -- 172.21.15.2:0/4111238155 >> v1:172.21.15.192:6789/0 conn(0x7f9f50143ae0 legacy=0x7f9f50071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:25.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.271+0000 7f9f5506d700 1 -- 172.21.15.2:0/4111238155 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f500b3dc0 con 0x7f9f500722c0 2023-11-26T07:12:25.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.271+0000 7f9f5506d700 1 -- 172.21.15.2:0/4111238155 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f9f4c001670 con 0x7f9f500722c0 2023-11-26T07:12:25.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.271+0000 7f9f5506d700 1 -- 172.21.15.2:0/4111238155 >> v1:172.21.15.2:6789/0 conn(0x7f9f500722c0 legacy=0x7f9f5006e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:25.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.271+0000 7f9f5506d700 1 --2- 172.21.15.2:0/4111238155 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f3c003a30 0x7f9f3c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:25.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.271+0000 7f9f5506d700 1 --2- 172.21.15.2:0/4111238155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f3c004850 0x7f9f3c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:25.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.271+0000 7f9f5506d700 1 --2- 172.21.15.2:0/4111238155 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f501440f0 0x7f9f3c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:25.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.271+0000 7f9f5506d700 1 -- 172.21.15.2:0/4111238155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f500b40a0 con 0x7f9f3c004850 2023-11-26T07:12:25.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.271+0000 7f9f5506d700 1 -- 172.21.15.2:0/4111238155 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3c00bac0 con 0x7f9f3c003a30 2023-11-26T07:12:25.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.271+0000 7f9f5506d700 1 -- 172.21.15.2:0/4111238155 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3c00bc30 con 0x7f9f501440f0 2023-11-26T07:12:25.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.271+0000 7f9f5586e700 1 --2- 172.21.15.2:0/4111238155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f3c004850 0x7f9f3c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:25.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.271+0000 7f9f56870700 1 --2- 172.21.15.2:0/4111238155 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f501440f0 0x7f9f3c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:25.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.271+0000 7f9f5606f700 1 --2- 172.21.15.2:0/4111238155 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f3c003a30 0x7f9f3c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:25.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.271+0000 7f9f5586e700 1 -- 172.21.15.2:0/4111238155 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f501440f0 msgr2=0x7f9f3c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:25.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.271+0000 7f9f5586e700 1 --2- 172.21.15.2:0/4111238155 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f501440f0 0x7f9f3c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:25.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.271+0000 7f9f5586e700 1 -- 172.21.15.2:0/4111238155 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f3c003a30 msgr2=0x7f9f3c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:25.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.271+0000 7f9f5586e700 1 --2- 172.21.15.2:0/4111238155 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f3c003a30 0x7f9f3c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:25.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.271+0000 7f9f5586e700 1 -- 172.21.15.2:0/4111238155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f3c0035b0 con 0x7f9f3c004850 2023-11-26T07:12:25.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.271+0000 7f9f5606f700 1 --2- 172.21.15.2:0/4111238155 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f3c003a30 0x7f9f3c003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:25.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.271+0000 7f9f5586e700 1 --2- 172.21.15.2:0/4111238155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f3c004850 0x7f9f3c004cd0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c00c160 tx=0x7f9f3c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14850de8049413c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:25.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.271+0000 7f9f5506d700 1 -- 172.21.15.2:0/4111238155 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c007b50 con 0x7f9f3c004850 2023-11-26T07:12:25.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.271+0000 7f9f5506d700 1 -- 172.21.15.2:0/4111238155 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4c00cca0 con 0x7f9f3c004850 2023-11-26T07:12:25.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.271+0000 7f9f5506d700 1 -- 172.21.15.2:0/4111238155 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c005b80 con 0x7f9f3c004850 2023-11-26T07:12:25.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.272+0000 7f9f582d3700 1 -- 172.21.15.2:0/4111238155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f3c004850 msgr2=0x7f9f3c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:25.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.272+0000 7f9f582d3700 1 --2- 172.21.15.2:0/4111238155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f3c004850 0x7f9f3c004cd0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c00c160 tx=0x7f9f3c005880 comp rx=0 tx=0).stop 2023-11-26T07:12:25.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.272+0000 7f9f56870700 1 -- 172.21.15.2:0/4111238155 reap_dead start 2023-11-26T07:12:25.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.272+0000 7f9f582d3700 1 -- 172.21.15.2:0/4111238155 shutdown_connections 2023-11-26T07:12:25.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.272+0000 7f9f582d3700 1 -- 172.21.15.2:0/4111238155 >> 172.21.15.2:0/4111238155 conn(0x7f9f500b2740 msgr2=0x7f9f500b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:25.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.272+0000 7f9f582d3700 1 -- 172.21.15.2:0/4111238155 shutdown_connections 2023-11-26T07:12:25.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.272+0000 7f9f582d3700 1 -- 172.21.15.2:0/4111238155 wait complete. 2023-11-26T07:12:25.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.273+0000 7f9f582d3700 1 Processor -- start 2023-11-26T07:12:25.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.273+0000 7f9f582d3700 1 -- start start 2023-11-26T07:12:25.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.274+0000 7f9f582d3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f3c004850 0x7f9f5015c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:25.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.274+0000 7f9f582d3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f5013eb20 0x7f9f5013efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:25.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.274+0000 7f9f582d3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f50154fd0 0x7f9f50155450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:25.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.274+0000 7f9f582d3700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5015cc90 con 0x7f9f5013eb20 2023-11-26T07:12:25.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.274+0000 7f9f582d3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5015bd00 con 0x7f9f3c004850 2023-11-26T07:12:25.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.274+0000 7f9f582d3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5015c2c0 con 0x7f9f50154fd0 2023-11-26T07:12:25.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.274+0000 7f9f5586e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f5013eb20 0x7f9f5013efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:25.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.274+0000 7f9f5586e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f5013eb20 0x7f9f5013efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40662/0 (socket says 172.21.15.2:40662) 2023-11-26T07:12:25.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.274+0000 7f9f5586e700 1 -- 172.21.15.2:0/896854480 learned_addr learned my addr 172.21.15.2:0/896854480 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:25.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.274+0000 7f9f56870700 1 --2- 172.21.15.2:0/896854480 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f50154fd0 0x7f9f50155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:25.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.274+0000 7f9f5606f700 1 --2- 172.21.15.2:0/896854480 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f3c004850 0x7f9f5015c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:25.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.274+0000 7f9f5586e700 1 -- 172.21.15.2:0/896854480 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f50154fd0 msgr2=0x7f9f50155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:25.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.274+0000 7f9f5586e700 1 --2- 172.21.15.2:0/896854480 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f50154fd0 0x7f9f50155450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:25.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.274+0000 7f9f5586e700 1 -- 172.21.15.2:0/896854480 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f3c004850 msgr2=0x7f9f5015c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:25.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.274+0000 7f9f5586e700 1 --2- 172.21.15.2:0/896854480 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f3c004850 0x7f9f5015c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:25.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.274+0000 7f9f5586e700 1 -- 172.21.15.2:0/896854480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f5015d1e0 con 0x7f9f5013eb20 2023-11-26T07:12:25.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.275+0000 7f9f5586e700 1 --2- 172.21.15.2:0/896854480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f5013eb20 0x7f9f5013efa0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c001780 tx=0x7f9f500b56f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:25.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.275+0000 7f9f46ffd700 1 -- 172.21.15.2:0/896854480 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c020070 con 0x7f9f5013eb20 2023-11-26T07:12:25.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.275+0000 7f9f46ffd700 1 -- 172.21.15.2:0/896854480 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4c00caa0 con 0x7f9f5013eb20 2023-11-26T07:12:25.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.275+0000 7f9f582d3700 1 -- 172.21.15.2:0/896854480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f5015d4c0 con 0x7f9f5013eb20 2023-11-26T07:12:25.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.275+0000 7f9f46ffd700 1 -- 172.21.15.2:0/896854480 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c004c80 con 0x7f9f5013eb20 2023-11-26T07:12:25.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.275+0000 7f9f582d3700 1 -- 172.21.15.2:0/896854480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f5015ce70 con 0x7f9f5013eb20 2023-11-26T07:12:25.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.276+0000 7f9f582d3700 1 -- 172.21.15.2:0/896854480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f50068670 con 0x7f9f5013eb20 2023-11-26T07:12:25.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.277+0000 7f9f46ffd700 1 -- 172.21.15.2:0/896854480 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9f4c007070 con 0x7f9f5013eb20 2023-11-26T07:12:25.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.277+0000 7f9f46ffd700 1 --2- 172.21.15.2:0/896854480 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9f3406aed0 0x7f9f3406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:25.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.277+0000 7f9f46ffd700 1 -- 172.21.15.2:0/896854480 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9f4c08b6a0 con 0x7f9f5013eb20 2023-11-26T07:12:25.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.278+0000 7f9f5606f700 1 --2- 172.21.15.2:0/896854480 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9f3406aed0 0x7f9f3406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:25.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.278+0000 7f9f5606f700 1 --2- 172.21.15.2:0/896854480 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9f3406aed0 0x7f9f3406d390 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9f40000c00 tx=0x7f9f40009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:25.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.281+0000 7f9f46ffd700 1 -- 172.21.15.2:0/896854480 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9f4c056bb0 con 0x7f9f5013eb20 2023-11-26T07:12:25.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.566+0000 7f9f582d3700 1 -- 172.21.15.2:0/896854480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f9f500b5d20 con 0x7f9f5013eb20 2023-11-26T07:12:25.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.568+0000 7f9f46ffd700 1 -- 172.21.15.2:0/896854480 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f9f4c0290a0 con 0x7f9f5013eb20 2023-11-26T07:12:25.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.571+0000 7f9f582d3700 1 -- 172.21.15.2:0/896854480 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9f3406aed0 msgr2=0x7f9f3406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:25.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.571+0000 7f9f582d3700 1 --2- 172.21.15.2:0/896854480 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9f3406aed0 0x7f9f3406d390 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9f40000c00 tx=0x7f9f40009040 comp rx=0 tx=0).stop 2023-11-26T07:12:25.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.571+0000 7f9f582d3700 1 -- 172.21.15.2:0/896854480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f5013eb20 msgr2=0x7f9f5013efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:25.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.571+0000 7f9f582d3700 1 --2- 172.21.15.2:0/896854480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f5013eb20 0x7f9f5013efa0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c001780 tx=0x7f9f500b56f0 comp rx=0 tx=0).stop 2023-11-26T07:12:25.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.571+0000 7f9f582d3700 1 -- 172.21.15.2:0/896854480 shutdown_connections 2023-11-26T07:12:25.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.571+0000 7f9f582d3700 1 --2- 172.21.15.2:0/896854480 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9f3406aed0 0x7f9f3406d390 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:25.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.571+0000 7f9f582d3700 1 --2- 172.21.15.2:0/896854480 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f50154fd0 0x7f9f50155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:25.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.571+0000 7f9f582d3700 1 --2- 172.21.15.2:0/896854480 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f3c004850 0x7f9f5015c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:25.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.571+0000 7f9f582d3700 1 --2- 172.21.15.2:0/896854480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f5013eb20 0x7f9f5013efa0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:25.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.571+0000 7f9f582d3700 1 -- 172.21.15.2:0/896854480 >> 172.21.15.2:0/896854480 conn(0x7f9f500b2740 msgr2=0x7f9f5006f200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:25.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.571+0000 7f9f582d3700 1 -- 172.21.15.2:0/896854480 shutdown_connections 2023-11-26T07:12:25.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.571+0000 7f9f582d3700 1 -- 172.21.15.2:0/896854480 wait complete. 2023-11-26T07:12:25.585 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-26T07:12:25.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.709+0000 7feb234ba700 1 Processor -- start 2023-11-26T07:12:25.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.709+0000 7feb234ba700 1 -- start start 2023-11-26T07:12:25.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.710+0000 7feb234ba700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7feb1c0d16e0 0x7feb1c0affb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:25.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.710+0000 7feb234ba700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb1c0d1b40 con 0x7feb1c0ada10 2023-11-26T07:12:25.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.710+0000 7feb234ba700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb1c070490 con 0x7feb1c06afd0 2023-11-26T07:12:25.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.710+0000 7feb234ba700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb1c0b04f0 con 0x7feb1c0d16e0 2023-11-26T07:12:25.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.710+0000 7feb20a55700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7feb1c0d16e0 0x7feb1c0affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:25.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.710+0000 7feb21a57700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7feb1c0ada10 0x7feb1c0adea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60114/0 (socket says 172.21.15.2:60114) 2023-11-26T07:12:25.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.710+0000 7feb21a57700 1 -- 172.21.15.2:0/4049062632 learned_addr learned my addr 172.21.15.2:0/4049062632 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:25.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.710+0000 7feb13fff700 1 -- 172.21.15.2:0/4049062632 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2979927662 0 0) 0x7feb1c0d1b40 con 0x7feb1c0ada10 2023-11-26T07:12:25.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.710+0000 7feb13fff700 1 -- 172.21.15.2:0/4049062632 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb080035b0 con 0x7feb1c0ada10 2023-11-26T07:12:25.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.710+0000 7feb20a55700 1 -- 172.21.15.2:0/4049062632 >> v1:172.21.15.192:6789/0 conn(0x7feb1c06afd0 legacy=0x7feb1c06b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:25.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.710+0000 7feb20a55700 1 -- 172.21.15.2:0/4049062632 >> v1:172.21.15.2:6789/0 conn(0x7feb1c0ada10 legacy=0x7feb1c0adea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:25.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.710+0000 7feb20a55700 1 -- 172.21.15.2:0/4049062632 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb1c0af9f0 con 0x7feb1c0d16e0 2023-11-26T07:12:25.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.711+0000 7feb20a55700 1 --2- 172.21.15.2:0/4049062632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb1c0d16e0 0x7feb1c0affb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7feb18009840 tx=0x7feb18009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7415e0ccc05da194 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:25.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.711+0000 7feb13fff700 1 -- 172.21.15.2:0/4049062632 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb18004230 con 0x7feb1c0d16e0 2023-11-26T07:12:25.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.711+0000 7feb13fff700 1 -- 172.21.15.2:0/4049062632 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb18004390 con 0x7feb1c0d16e0 2023-11-26T07:12:25.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.711+0000 7feb13fff700 1 -- 172.21.15.2:0/4049062632 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb180036c0 con 0x7feb1c0d16e0 2023-11-26T07:12:25.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.711+0000 7feb234ba700 1 -- 172.21.15.2:0/4049062632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb1c0d16e0 msgr2=0x7feb1c0affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:25.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.711+0000 7feb234ba700 1 --2- 172.21.15.2:0/4049062632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb1c0d16e0 0x7feb1c0affb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7feb18009840 tx=0x7feb18009b50 comp rx=0 tx=0).stop 2023-11-26T07:12:25.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.711+0000 7feb234ba700 1 -- 172.21.15.2:0/4049062632 shutdown_connections 2023-11-26T07:12:25.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.711+0000 7feb234ba700 1 --2- 172.21.15.2:0/4049062632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb1c0d16e0 0x7feb1c0affb0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:25.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.711+0000 7feb234ba700 1 -- 172.21.15.2:0/4049062632 >> 172.21.15.2:0/4049062632 conn(0x7feb1c0d0bc0 msgr2=0x7feb1c0d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:25.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.711+0000 7feb234ba700 1 -- 172.21.15.2:0/4049062632 shutdown_connections 2023-11-26T07:12:25.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.711+0000 7feb234ba700 1 -- 172.21.15.2:0/4049062632 wait complete. 2023-11-26T07:12:25.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.713+0000 7feb234ba700 1 Processor -- start 2023-11-26T07:12:25.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.713+0000 7feb234ba700 1 -- start start 2023-11-26T07:12:25.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.713+0000 7feb234ba700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb1c06afd0 0x7feb1c154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:25.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.713+0000 7feb234ba700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb1c0ada10 0x7feb1c15ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:25.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.713+0000 7feb234ba700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb1c0d16e0 0x7feb1c156720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:25.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.713+0000 7feb234ba700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb1c15b260 con 0x7feb1c06afd0 2023-11-26T07:12:25.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.713+0000 7feb234ba700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb1c156c60 con 0x7feb1c0d16e0 2023-11-26T07:12:25.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.713+0000 7feb234ba700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb1c155680 con 0x7feb1c0ada10 2023-11-26T07:12:25.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.714+0000 7feb21256700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb1c06afd0 0x7feb1c154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:25.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.714+0000 7feb21256700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb1c06afd0 0x7feb1c154ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40674/0 (socket says 172.21.15.2:40674) 2023-11-26T07:12:25.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.714+0000 7feb21256700 1 -- 172.21.15.2:0/3377917459 learned_addr learned my addr 172.21.15.2:0/3377917459 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:25.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.714+0000 7feb20a55700 1 --2- 172.21.15.2:0/3377917459 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb1c0ada10 0x7feb1c15ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:25.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.714+0000 7feb21256700 1 -- 172.21.15.2:0/3377917459 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb1c0ada10 msgr2=0x7feb1c15ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:25.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.714+0000 7feb21a57700 1 --2- 172.21.15.2:0/3377917459 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb1c0d16e0 0x7feb1c156720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:25.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.714+0000 7feb21256700 1 --2- 172.21.15.2:0/3377917459 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb1c0ada10 0x7feb1c15ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:25.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.714+0000 7feb21256700 1 -- 172.21.15.2:0/3377917459 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb1c0d16e0 msgr2=0x7feb1c156720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:25.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.714+0000 7feb21256700 1 --2- 172.21.15.2:0/3377917459 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb1c0d16e0 0x7feb1c156720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:25.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.714+0000 7feb21256700 1 -- 172.21.15.2:0/3377917459 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb180094a0 con 0x7feb1c06afd0 2023-11-26T07:12:25.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.714+0000 7feb20a55700 1 --2- 172.21.15.2:0/3377917459 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb1c0ada10 0x7feb1c15ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:12:25.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.714+0000 7feb21a57700 1 --2- 172.21.15.2:0/3377917459 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb1c0d16e0 0x7feb1c156720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:12:25.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.714+0000 7feb21256700 1 --2- 172.21.15.2:0/3377917459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb1c06afd0 0x7feb1c154ff0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7feb0c00b4a0 tx=0x7feb0c00b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:25.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.714+0000 7feb11ffb700 1 -- 172.21.15.2:0/3377917459 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c011830 con 0x7feb1c06afd0 2023-11-26T07:12:25.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.714+0000 7feb11ffb700 1 -- 172.21.15.2:0/3377917459 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb0c011990 con 0x7feb1c06afd0 2023-11-26T07:12:25.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.714+0000 7feb234ba700 1 -- 172.21.15.2:0/3377917459 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb1c155960 con 0x7feb1c06afd0 2023-11-26T07:12:25.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.714+0000 7feb11ffb700 1 -- 172.21.15.2:0/3377917459 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c011d40 con 0x7feb1c06afd0 2023-11-26T07:12:25.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.714+0000 7feb234ba700 1 -- 172.21.15.2:0/3377917459 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb1c155f20 con 0x7feb1c06afd0 2023-11-26T07:12:25.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.715+0000 7feb234ba700 1 -- 172.21.15.2:0/3377917459 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb1c156570 con 0x7feb1c06afd0 2023-11-26T07:12:25.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.716+0000 7feb11ffb700 1 -- 172.21.15.2:0/3377917459 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feb0c01a400 con 0x7feb1c06afd0 2023-11-26T07:12:25.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.716+0000 7feb11ffb700 1 --2- 172.21.15.2:0/3377917459 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7feb0006aed0 0x7feb0006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:25.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.716+0000 7feb11ffb700 1 -- 172.21.15.2:0/3377917459 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7feb0c088f40 con 0x7feb1c06afd0 2023-11-26T07:12:25.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.716+0000 7feb20a55700 1 --2- 172.21.15.2:0/3377917459 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7feb0006aed0 0x7feb0006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:25.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.717+0000 7feb20a55700 1 --2- 172.21.15.2:0/3377917459 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7feb0006aed0 0x7feb0006d390 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7feb18009b90 tx=0x7feb18010000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:25.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:25.721+0000 7feb11ffb700 1 -- 172.21.15.2:0/3377917459 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7feb0c0543d0 con 0x7feb1c06afd0 2023-11-26T07:12:26.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.006+0000 7feb234ba700 1 -- 172.21.15.2:0/3377917459 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7feb1c0732b0 con 0x7feb1c06afd0 2023-11-26T07:12:26.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.008+0000 7feb11ffb700 1 -- 172.21.15.2:0/3377917459 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7feb0c0579f0 con 0x7feb1c06afd0 2023-11-26T07:12:26.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.010+0000 7feb234ba700 1 -- 172.21.15.2:0/3377917459 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7feb0006aed0 msgr2=0x7feb0006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:26.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.010+0000 7feb234ba700 1 --2- 172.21.15.2:0/3377917459 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7feb0006aed0 0x7feb0006d390 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7feb18009b90 tx=0x7feb18010000 comp rx=0 tx=0).stop 2023-11-26T07:12:26.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.010+0000 7feb234ba700 1 -- 172.21.15.2:0/3377917459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb1c06afd0 msgr2=0x7feb1c154ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:26.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.010+0000 7feb234ba700 1 --2- 172.21.15.2:0/3377917459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb1c06afd0 0x7feb1c154ff0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7feb0c00b4a0 tx=0x7feb0c00b860 comp rx=0 tx=0).stop 2023-11-26T07:12:26.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.010+0000 7feb234ba700 1 -- 172.21.15.2:0/3377917459 shutdown_connections 2023-11-26T07:12:26.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.010+0000 7feb234ba700 1 --2- 172.21.15.2:0/3377917459 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7feb0006aed0 0x7feb0006d390 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:26.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.010+0000 7feb234ba700 1 --2- 172.21.15.2:0/3377917459 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb1c0d16e0 0x7feb1c156720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:26.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.010+0000 7feb234ba700 1 --2- 172.21.15.2:0/3377917459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb1c06afd0 0x7feb1c154ff0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:26.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.010+0000 7feb234ba700 1 --2- 172.21.15.2:0/3377917459 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb1c0ada10 0x7feb1c15ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:26.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.010+0000 7feb234ba700 1 -- 172.21.15.2:0/3377917459 >> 172.21.15.2:0/3377917459 conn(0x7feb1c0d0bc0 msgr2=0x7feb1c0d0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:26.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.010+0000 7feb234ba700 1 -- 172.21.15.2:0/3377917459 shutdown_connections 2023-11-26T07:12:26.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.010+0000 7feb234ba700 1 -- 172.21.15.2:0/3377917459 wait complete. 2023-11-26T07:12:26.024 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-26T07:12:26.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.147+0000 7f7783171700 1 Processor -- start 2023-11-26T07:12:26.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.147+0000 7f7783171700 1 -- start start 2023-11-26T07:12:26.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.148+0000 7f7783171700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f777c0affb0 0x7f777c0ae120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:26.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.148+0000 7f7783171700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f777c0d1b40 con 0x7f777c06afd0 2023-11-26T07:12:26.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.148+0000 7f7783171700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f777c070490 con 0x7f777c0d16e0 2023-11-26T07:12:26.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.148+0000 7f7783171700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f777c0b0440 con 0x7f777c0affb0 2023-11-26T07:12:26.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.148+0000 7f7780f0d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f777c06afd0 0x7f777c06b3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60124/0 (socket says 172.21.15.2:60124) 2023-11-26T07:12:26.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.148+0000 7f7780f0d700 1 -- 172.21.15.2:0/3515576885 learned_addr learned my addr 172.21.15.2:0/3515576885 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:26.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.149+0000 7f778170e700 1 --2- 172.21.15.2:0/3515576885 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f777c0affb0 0x7f777c0ae120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:26.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.149+0000 7f777b7fe700 1 -- 172.21.15.2:0/3515576885 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 181953850 0 0) 0x7f777c0d1b40 con 0x7f777c06afd0 2023-11-26T07:12:26.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.149+0000 7f777b7fe700 1 -- 172.21.15.2:0/3515576885 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f776c0035b0 con 0x7f777c06afd0 2023-11-26T07:12:26.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.149+0000 7f777b7fe700 1 -- 172.21.15.2:0/3515576885 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1491337296 0 0) 0x7f777c070490 con 0x7f777c0d16e0 2023-11-26T07:12:26.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.149+0000 7f777b7fe700 1 -- 172.21.15.2:0/3515576885 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f777c0d1b40 con 0x7f777c0d16e0 2023-11-26T07:12:26.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.149+0000 7f777b7fe700 1 -- 172.21.15.2:0/3515576885 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 539116542 0 0) 0x7f776c0035b0 con 0x7f777c06afd0 2023-11-26T07:12:26.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.149+0000 7f777b7fe700 1 -- 172.21.15.2:0/3515576885 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f777c0affb0 msgr2=0x7f777c0ae120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:26.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.149+0000 7f777b7fe700 1 --2- 172.21.15.2:0/3515576885 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f777c0affb0 0x7f777c0ae120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:26.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.149+0000 7f777b7fe700 1 -- 172.21.15.2:0/3515576885 >> v1:172.21.15.192:6789/0 conn(0x7f777c0d16e0 legacy=0x7f777c0ada10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:26.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.149+0000 7f777b7fe700 1 -- 172.21.15.2:0/3515576885 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f777c0af9f0 con 0x7f777c06afd0 2023-11-26T07:12:26.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.149+0000 7f777b7fe700 1 -- 172.21.15.2:0/3515576885 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f77700015f0 con 0x7f777c06afd0 2023-11-26T07:12:26.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.149+0000 7f777b7fe700 1 -- 172.21.15.2:0/3515576885 >> v1:172.21.15.2:6789/0 conn(0x7f777c06afd0 legacy=0x7f777c06b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:26.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.149+0000 7f777b7fe700 1 --2- 172.21.15.2:0/3515576885 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f777c0affb0 0x7f776c003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:26.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.149+0000 7f777b7fe700 1 --2- 172.21.15.2:0/3515576885 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f776c004170 0x7f776c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:26.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.149+0000 7f777b7fe700 1 --2- 172.21.15.2:0/3515576885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f776c004d90 0x7f776c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:26.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.149+0000 7f777b7fe700 1 -- 172.21.15.2:0/3515576885 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777c0b0440 con 0x7f776c004d90 2023-11-26T07:12:26.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.149+0000 7f777b7fe700 1 -- 172.21.15.2:0/3515576885 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f776c00bb50 con 0x7f776c004170 2023-11-26T07:12:26.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.149+0000 7f777b7fe700 1 -- 172.21.15.2:0/3515576885 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f776c00bd10 con 0x7f777c0affb0 2023-11-26T07:12:26.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.149+0000 7f778170e700 1 --2- 172.21.15.2:0/3515576885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f776c004d90 0x7f776c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:26.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.149+0000 7f7780f0d700 1 --2- 172.21.15.2:0/3515576885 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f777c0affb0 0x7f776c003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:26.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.149+0000 7f777bfff700 1 --2- 172.21.15.2:0/3515576885 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f776c004170 0x7f776c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:26.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.149+0000 7f778170e700 1 -- 172.21.15.2:0/3515576885 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f777c0affb0 msgr2=0x7f776c003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:26.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.149+0000 7f778170e700 1 --2- 172.21.15.2:0/3515576885 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f777c0affb0 0x7f776c003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:26.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.149+0000 7f778170e700 1 -- 172.21.15.2:0/3515576885 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f776c004170 msgr2=0x7f776c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:26.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.149+0000 7f778170e700 1 --2- 172.21.15.2:0/3515576885 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f776c004170 0x7f776c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:26.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.149+0000 7f778170e700 1 -- 172.21.15.2:0/3515576885 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f776c0035b0 con 0x7f776c004d90 2023-11-26T07:12:26.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.150+0000 7f778170e700 1 --2- 172.21.15.2:0/3515576885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f776c004d90 0x7f776c005210 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7774009fc0 tx=0x7f776c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5b7356e87506926 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:26.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.150+0000 7f777b7fe700 1 -- 172.21.15.2:0/3515576885 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777400ec30 con 0x7f776c004d90 2023-11-26T07:12:26.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.150+0000 7f777b7fe700 1 -- 172.21.15.2:0/3515576885 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f777400f040 con 0x7f776c004d90 2023-11-26T07:12:26.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.150+0000 7f777b7fe700 1 -- 172.21.15.2:0/3515576885 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7774014480 con 0x7f776c004d90 2023-11-26T07:12:26.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.150+0000 7f7783171700 1 -- 172.21.15.2:0/3515576885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f776c004d90 msgr2=0x7f776c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:26.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.150+0000 7f7783171700 1 --2- 172.21.15.2:0/3515576885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f776c004d90 0x7f776c005210 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7774009fc0 tx=0x7f776c005880 comp rx=0 tx=0).stop 2023-11-26T07:12:26.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.150+0000 7f778170e700 1 -- 172.21.15.2:0/3515576885 reap_dead start 2023-11-26T07:12:26.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.150+0000 7f7783171700 1 -- 172.21.15.2:0/3515576885 shutdown_connections 2023-11-26T07:12:26.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.150+0000 7f7783171700 1 -- 172.21.15.2:0/3515576885 >> 172.21.15.2:0/3515576885 conn(0x7f777c0d0bc0 msgr2=0x7f777c0d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:26.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.150+0000 7f7783171700 1 -- 172.21.15.2:0/3515576885 shutdown_connections 2023-11-26T07:12:26.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.150+0000 7f7783171700 1 -- 172.21.15.2:0/3515576885 wait complete. 2023-11-26T07:12:26.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.152+0000 7f7783171700 1 Processor -- start 2023-11-26T07:12:26.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.152+0000 7f7783171700 1 -- start start 2023-11-26T07:12:26.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.152+0000 7f7783171700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f776c004d90 0x7f777c157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:26.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.152+0000 7f7783171700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f777c15a430 0x7f777c1f3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:26.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.152+0000 7f7783171700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f777c0b1a00 0x7f777c14d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:26.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.152+0000 7f7783171700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777c0ce440 con 0x7f777c15a430 2023-11-26T07:12:26.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.152+0000 7f7783171700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777c15a8b0 con 0x7f777c0b1a00 2023-11-26T07:12:26.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.152+0000 7f7783171700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f777c1582a0 con 0x7f776c004d90 2023-11-26T07:12:26.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.153+0000 7f777bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f777c15a430 0x7f777c1f3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:26.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.153+0000 7f777bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f777c15a430 0x7f777c1f3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40694/0 (socket says 172.21.15.2:40694) 2023-11-26T07:12:26.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.153+0000 7f777bfff700 1 -- 172.21.15.2:0/2916721616 learned_addr learned my addr 172.21.15.2:0/2916721616 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:26.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.153+0000 7f778170e700 1 --2- 172.21.15.2:0/2916721616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f777c0b1a00 0x7f777c14d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:26.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.153+0000 7f7780f0d700 1 --2- 172.21.15.2:0/2916721616 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f776c004d90 0x7f777c157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:26.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.153+0000 7f777bfff700 1 -- 172.21.15.2:0/2916721616 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f776c004d90 msgr2=0x7f777c157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:26.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.153+0000 7f777bfff700 1 --2- 172.21.15.2:0/2916721616 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f776c004d90 0x7f777c157cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:26.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.153+0000 7f777bfff700 1 -- 172.21.15.2:0/2916721616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f777c0b1a00 msgr2=0x7f777c14d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:26.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.153+0000 7f777bfff700 1 --2- 172.21.15.2:0/2916721616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f777c0b1a00 0x7f777c14d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:26.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.153+0000 7f777bfff700 1 -- 172.21.15.2:0/2916721616 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f777c0ce690 con 0x7f777c15a430 2023-11-26T07:12:26.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.153+0000 7f777bfff700 1 --2- 172.21.15.2:0/2916721616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f777c15a430 0x7f777c1f3c20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f776800f8b0 tx=0x7f776800fbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:26.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.153+0000 7f77797fa700 1 -- 172.21.15.2:0/2916721616 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77680052e0 con 0x7f777c15a430 2023-11-26T07:12:26.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.153+0000 7f77797fa700 1 -- 172.21.15.2:0/2916721616 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7768005440 con 0x7f777c15a430 2023-11-26T07:12:26.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.153+0000 7f7783171700 1 -- 172.21.15.2:0/2916721616 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f777c0ce970 con 0x7f777c15a430 2023-11-26T07:12:26.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.153+0000 7f77797fa700 1 -- 172.21.15.2:0/2916721616 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77680038c0 con 0x7f777c15a430 2023-11-26T07:12:26.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.153+0000 7f7783171700 1 -- 172.21.15.2:0/2916721616 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f777c1f4160 con 0x7f777c15a430 2023-11-26T07:12:26.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.154+0000 7f7783171700 1 -- 172.21.15.2:0/2916721616 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f777c068f50 con 0x7f777c15a430 2023-11-26T07:12:26.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.155+0000 7f77797fa700 1 -- 172.21.15.2:0/2916721616 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7768003a20 con 0x7f777c15a430 2023-11-26T07:12:26.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.155+0000 7f77797fa700 1 --2- 172.21.15.2:0/2916721616 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f776006aed0 0x7f776006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:26.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.155+0000 7f77797fa700 1 -- 172.21.15.2:0/2916721616 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f77680891c0 con 0x7f777c15a430 2023-11-26T07:12:26.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.156+0000 7f7780f0d700 1 --2- 172.21.15.2:0/2916721616 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f776006aed0 0x7f776006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:26.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.156+0000 7f7780f0d700 1 --2- 172.21.15.2:0/2916721616 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f776006aed0 0x7f776006d390 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7770001050 tx=0x7f7770000fe0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:26.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.160+0000 7f77797fa700 1 -- 172.21.15.2:0/2916721616 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7768054530 con 0x7f777c15a430 2023-11-26T07:12:26.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.447+0000 7f7783171700 1 -- 172.21.15.2:0/2916721616 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f777c068670 con 0x7f777c15a430 2023-11-26T07:12:26.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.449+0000 7f77797fa700 1 -- 172.21.15.2:0/2916721616 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7768087e60 con 0x7f777c15a430 2023-11-26T07:12:26.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.451+0000 7f7783171700 1 -- 172.21.15.2:0/2916721616 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f776006aed0 msgr2=0x7f776006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:26.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.451+0000 7f7783171700 1 --2- 172.21.15.2:0/2916721616 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f776006aed0 0x7f776006d390 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7770001050 tx=0x7f7770000fe0 comp rx=0 tx=0).stop 2023-11-26T07:12:26.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.451+0000 7f7783171700 1 -- 172.21.15.2:0/2916721616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f777c15a430 msgr2=0x7f777c1f3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:26.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.451+0000 7f7783171700 1 --2- 172.21.15.2:0/2916721616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f777c15a430 0x7f777c1f3c20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f776800f8b0 tx=0x7f776800fbc0 comp rx=0 tx=0).stop 2023-11-26T07:12:26.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.451+0000 7f7783171700 1 -- 172.21.15.2:0/2916721616 shutdown_connections 2023-11-26T07:12:26.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.451+0000 7f7783171700 1 --2- 172.21.15.2:0/2916721616 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f776006aed0 0x7f776006d390 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:26.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.451+0000 7f7783171700 1 --2- 172.21.15.2:0/2916721616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f777c0b1a00 0x7f777c14d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:26.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.451+0000 7f7783171700 1 --2- 172.21.15.2:0/2916721616 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f776c004d90 0x7f777c157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:26.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.451+0000 7f7783171700 1 --2- 172.21.15.2:0/2916721616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f777c15a430 0x7f777c1f3c20 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:26.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.451+0000 7f7783171700 1 -- 172.21.15.2:0/2916721616 >> 172.21.15.2:0/2916721616 conn(0x7f777c0d0bc0 msgr2=0x7f777c06b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:26.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.451+0000 7f7783171700 1 -- 172.21.15.2:0/2916721616 shutdown_connections 2023-11-26T07:12:26.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.451+0000 7f7783171700 1 -- 172.21.15.2:0/2916721616 wait complete. 2023-11-26T07:12:26.465 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:12:26.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.589+0000 7fde25a39700 1 Processor -- start 2023-11-26T07:12:26.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.589+0000 7fde25a39700 1 -- start start 2023-11-26T07:12:26.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.589+0000 7fde25a39700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fde200b4f20 0x7fde20071d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:26.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.589+0000 7fde25a39700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fde200722d0 0x7fde200cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:26.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.590+0000 7fde25a39700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde20072760 con 0x7fde2015abb0 2023-11-26T07:12:26.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.590+0000 7fde25a39700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde2006e550 con 0x7fde200b4f20 2023-11-26T07:12:26.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.590+0000 7fde25a39700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde2006f3b0 con 0x7fde200722d0 2023-11-26T07:12:26.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.590+0000 7fde1e7fc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fde200b4f20 0x7fde20071d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:26.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.590+0000 7fde1e7fc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fde200b4f20 0x7fde20071d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40702/0 (socket says 172.21.15.2:40702) 2023-11-26T07:12:26.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.590+0000 7fde1e7fc700 1 -- 172.21.15.2:0/610943442 learned_addr learned my addr 172.21.15.2:0/610943442 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:26.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.590+0000 7fde1f7fe700 1 --2- 172.21.15.2:0/610943442 >> v2:172.21.15.192:3300/0 conn(0x7fde200722d0 0x7fde200cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:26.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.590+0000 7fde1e7fc700 1 -- 172.21.15.2:0/610943442 >> v2:172.21.15.192:3300/0 conn(0x7fde200722d0 msgr2=0x7fde200cdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:26.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.590+0000 7fde1e7fc700 1 --2- 172.21.15.2:0/610943442 >> v2:172.21.15.192:3300/0 conn(0x7fde200722d0 0x7fde200cdee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:26.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.590+0000 7fde1e7fc700 1 -- 172.21.15.2:0/610943442 >> v1:172.21.15.192:6789/0 conn(0x7fde2015abb0 legacy=0x7fde200b4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:26.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.590+0000 7fde1e7fc700 1 -- 172.21.15.2:0/610943442 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde2006e7a0 con 0x7fde200b4f20 2023-11-26T07:12:26.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.590+0000 7fde1e7fc700 1 --2- 172.21.15.2:0/610943442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde200b4f20 0x7fde20071d90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fde200d09c0 tx=0x7fde1400be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31bdef289274e82 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:26.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.590+0000 7fde1dffb700 1 -- 172.21.15.2:0/610943442 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1400dcf0 con 0x7fde200b4f20 2023-11-26T07:12:26.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.590+0000 7fde1dffb700 1 -- 172.21.15.2:0/610943442 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1400de50 con 0x7fde200b4f20 2023-11-26T07:12:26.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.590+0000 7fde1dffb700 1 -- 172.21.15.2:0/610943442 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde14004250 con 0x7fde200b4f20 2023-11-26T07:12:26.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.591+0000 7fde25a39700 1 -- 172.21.15.2:0/610943442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde200b4f20 msgr2=0x7fde20071d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:26.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.591+0000 7fde25a39700 1 --2- 172.21.15.2:0/610943442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde200b4f20 0x7fde20071d90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fde200d09c0 tx=0x7fde1400be70 comp rx=0 tx=0).stop 2023-11-26T07:12:26.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.591+0000 7fde25a39700 1 -- 172.21.15.2:0/610943442 shutdown_connections 2023-11-26T07:12:26.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.591+0000 7fde25a39700 1 --2- 172.21.15.2:0/610943442 >> v2:172.21.15.192:3300/0 conn(0x7fde200722d0 0x7fde200cdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:26.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.591+0000 7fde25a39700 1 --2- 172.21.15.2:0/610943442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde200b4f20 0x7fde20071d90 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:26.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.591+0000 7fde25a39700 1 -- 172.21.15.2:0/610943442 >> 172.21.15.2:0/610943442 conn(0x7fde200d0aa0 msgr2=0x7fde200d0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:26.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.591+0000 7fde25a39700 1 -- 172.21.15.2:0/610943442 shutdown_connections 2023-11-26T07:12:26.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.591+0000 7fde25a39700 1 -- 172.21.15.2:0/610943442 wait complete. 2023-11-26T07:12:26.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.592+0000 7fde25a39700 1 Processor -- start 2023-11-26T07:12:26.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.592+0000 7fde25a39700 1 -- start start 2023-11-26T07:12:26.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.593+0000 7fde25a39700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde200722d0 0x7fde201536d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:26.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.593+0000 7fde25a39700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde200b4f20 0x7fde200af7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:26.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.593+0000 7fde25a39700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde2015abb0 0x7fde200afce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:26.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.593+0000 7fde25a39700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde20153c10 con 0x7fde200722d0 2023-11-26T07:12:26.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.593+0000 7fde25a39700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde201587b0 con 0x7fde2015abb0 2023-11-26T07:12:26.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.593+0000 7fde25a39700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde201581f0 con 0x7fde200b4f20 2023-11-26T07:12:26.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.593+0000 7fde1effd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde200722d0 0x7fde201536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:26.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.593+0000 7fde1effd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde200722d0 0x7fde201536d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40708/0 (socket says 172.21.15.2:40708) 2023-11-26T07:12:26.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.593+0000 7fde1effd700 1 -- 172.21.15.2:0/1625383323 learned_addr learned my addr 172.21.15.2:0/1625383323 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:26.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.593+0000 7fde1f7fe700 1 --2- 172.21.15.2:0/1625383323 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde2015abb0 0x7fde200afce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:26.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.593+0000 7fde1e7fc700 1 --2- 172.21.15.2:0/1625383323 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde200b4f20 0x7fde200af7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:26.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.594+0000 7fde1effd700 1 -- 172.21.15.2:0/1625383323 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde200b4f20 msgr2=0x7fde200af7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:26.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.594+0000 7fde1effd700 1 --2- 172.21.15.2:0/1625383323 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde200b4f20 0x7fde200af7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:26.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.594+0000 7fde1effd700 1 -- 172.21.15.2:0/1625383323 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde2015abb0 msgr2=0x7fde200afce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:26.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.594+0000 7fde1effd700 1 --2- 172.21.15.2:0/1625383323 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde2015abb0 0x7fde200afce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:26.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.594+0000 7fde1effd700 1 -- 172.21.15.2:0/1625383323 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde1400b7f0 con 0x7fde200722d0 2023-11-26T07:12:26.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.594+0000 7fde1f7fe700 1 --2- 172.21.15.2:0/1625383323 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde2015abb0 0x7fde200afce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:26.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.594+0000 7fde1effd700 1 --2- 172.21.15.2:0/1625383323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde200722d0 0x7fde201536d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fde1000c4d0 tx=0x7fde1000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:26.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.594+0000 7fde07fff700 1 -- 172.21.15.2:0/1625383323 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde10011790 con 0x7fde200722d0 2023-11-26T07:12:26.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.594+0000 7fde07fff700 1 -- 172.21.15.2:0/1625383323 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde100118f0 con 0x7fde200722d0 2023-11-26T07:12:26.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.594+0000 7fde07fff700 1 -- 172.21.15.2:0/1625383323 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde10011ca0 con 0x7fde200722d0 2023-11-26T07:12:26.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.594+0000 7fde25a39700 1 -- 172.21.15.2:0/1625383323 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde201584d0 con 0x7fde200722d0 2023-11-26T07:12:26.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.594+0000 7fde25a39700 1 -- 172.21.15.2:0/1625383323 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde200adbe0 con 0x7fde200722d0 2023-11-26T07:12:26.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.595+0000 7fde25a39700 1 -- 172.21.15.2:0/1625383323 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde20068670 con 0x7fde200722d0 2023-11-26T07:12:26.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.595+0000 7fde07fff700 1 -- 172.21.15.2:0/1625383323 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fde1001c460 con 0x7fde200722d0 2023-11-26T07:12:26.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.596+0000 7fde07fff700 1 --2- 172.21.15.2:0/1625383323 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fde0c06aed0 0x7fde0c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:26.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.596+0000 7fde07fff700 1 -- 172.21.15.2:0/1625383323 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fde10089160 con 0x7fde200722d0 2023-11-26T07:12:26.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.596+0000 7fde1e7fc700 1 --2- 172.21.15.2:0/1625383323 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fde0c06aed0 0x7fde0c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:26.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.597+0000 7fde1e7fc700 1 --2- 172.21.15.2:0/1625383323 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fde0c06aed0 0x7fde0c06d390 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fde1400b340 tx=0x7fde14012000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:26.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.600+0000 7fde07fff700 1 -- 172.21.15.2:0/1625383323 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fde10054560 con 0x7fde200722d0 2023-11-26T07:12:26.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.805+0000 7fde25a39700 1 -- 172.21.15.2:0/1625383323 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde2006cc40 con 0x7fde200722d0 2023-11-26T07:12:26.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.806+0000 7fde07fff700 1 -- 172.21.15.2:0/1625383323 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+12809 (secure 0 0 0) 0x7fde10057b80 con 0x7fde200722d0 2023-11-26T07:12:26.808 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:12:26.808 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":28,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:12:23.366256+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:12:26.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.808+0000 7fde25a39700 1 -- 172.21.15.2:0/1625383323 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fde0c06aed0 msgr2=0x7fde0c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:26.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.808+0000 7fde25a39700 1 --2- 172.21.15.2:0/1625383323 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fde0c06aed0 0x7fde0c06d390 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fde1400b340 tx=0x7fde14012000 comp rx=0 tx=0).stop 2023-11-26T07:12:26.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.808+0000 7fde25a39700 1 -- 172.21.15.2:0/1625383323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde200722d0 msgr2=0x7fde201536d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:26.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.808+0000 7fde25a39700 1 --2- 172.21.15.2:0/1625383323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde200722d0 0x7fde201536d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fde1000c4d0 tx=0x7fde1000c890 comp rx=0 tx=0).stop 2023-11-26T07:12:26.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.808+0000 7fde25a39700 1 -- 172.21.15.2:0/1625383323 shutdown_connections 2023-11-26T07:12:26.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.808+0000 7fde25a39700 1 --2- 172.21.15.2:0/1625383323 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fde0c06aed0 0x7fde0c06d390 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:26.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.808+0000 7fde25a39700 1 --2- 172.21.15.2:0/1625383323 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde2015abb0 0x7fde200afce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:26.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.808+0000 7fde25a39700 1 --2- 172.21.15.2:0/1625383323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde200722d0 0x7fde201536d0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:26.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.808+0000 7fde25a39700 1 --2- 172.21.15.2:0/1625383323 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde200b4f20 0x7fde200af7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:26.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.808+0000 7fde25a39700 1 -- 172.21.15.2:0/1625383323 >> 172.21.15.2:0/1625383323 conn(0x7fde200d0aa0 msgr2=0x7fde200cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:26.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.808+0000 7fde25a39700 1 -- 172.21.15.2:0/1625383323 shutdown_connections 2023-11-26T07:12:26.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.808+0000 7fde25a39700 1 -- 172.21.15.2:0/1625383323 wait complete. 2023-11-26T07:12:26.822 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:11:28.205739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:12:26.822 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:12:26.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.948+0000 7f18c03fe700 1 Processor -- start 2023-11-26T07:12:26.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.948+0000 7f18c03fe700 1 -- start start 2023-11-26T07:12:26.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.949+0000 7f18c03fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18b8143ae0 0x7f18b80b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:26.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.949+0000 7f18c03fe700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18b8143ec0 con 0x7f18b80722c0 2023-11-26T07:12:26.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.949+0000 7f18c03fe700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18b80b3ae0 con 0x7f18b81440f0 2023-11-26T07:12:26.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.949+0000 7f18c03fe700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b80b40a0 con 0x7f18b8143ae0 2023-11-26T07:12:26.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.949+0000 7f18be99b700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f18b80722c0 0x7f18b806e510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60162/0 (socket says 172.21.15.2:60162) 2023-11-26T07:12:26.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.949+0000 7f18be99b700 1 -- 172.21.15.2:0/3886577284 learned_addr learned my addr 172.21.15.2:0/3886577284 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:26.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.949+0000 7f18be19a700 1 --2- 172.21.15.2:0/3886577284 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18b8143ae0 0x7f18b80b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:26.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.949+0000 7f18bd198700 1 -- 172.21.15.2:0/3886577284 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2461041987 0 0) 0x7f18b8143ec0 con 0x7f18b80722c0 2023-11-26T07:12:26.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.950+0000 7f18bd198700 1 -- 172.21.15.2:0/3886577284 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18a40035b0 con 0x7f18b80722c0 2023-11-26T07:12:26.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.950+0000 7f18bd198700 1 -- 172.21.15.2:0/3886577284 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 605800258 0 0) 0x7f18b80b3ae0 con 0x7f18b81440f0 2023-11-26T07:12:26.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.950+0000 7f18bd198700 1 -- 172.21.15.2:0/3886577284 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18b8143ec0 con 0x7f18b81440f0 2023-11-26T07:12:26.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.950+0000 7f18be19a700 1 -- 172.21.15.2:0/3886577284 >> v1:172.21.15.192:6789/0 conn(0x7f18b81440f0 legacy=0x7f18b8071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:26.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.950+0000 7f18bd198700 1 -- 172.21.15.2:0/3886577284 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3896217484 0 0) 0x7f18a40035b0 con 0x7f18b80722c0 2023-11-26T07:12:26.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.950+0000 7f18be19a700 1 -- 172.21.15.2:0/3886577284 >> v1:172.21.15.2:6789/0 conn(0x7f18b80722c0 legacy=0x7f18b806e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:26.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.950+0000 7f18be19a700 1 -- 172.21.15.2:0/3886577284 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b80b3dc0 con 0x7f18b8143ae0 2023-11-26T07:12:26.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.950+0000 7f18be19a700 1 --2- 172.21.15.2:0/3886577284 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18b8143ae0 0x7f18b80b51b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f18a8009870 tx=0x7f18a8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c9453dce9cc1cea server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:26.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.950+0000 7f18bd198700 1 -- 172.21.15.2:0/3886577284 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b00019f0 con 0x7f18b8143ae0 2023-11-26T07:12:26.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.950+0000 7f18bd198700 1 -- 172.21.15.2:0/3886577284 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a8004030 con 0x7f18b8143ae0 2023-11-26T07:12:26.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.950+0000 7f18bd198700 1 -- 172.21.15.2:0/3886577284 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a80043c0 con 0x7f18b8143ae0 2023-11-26T07:12:26.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.951+0000 7f18c03fe700 1 -- 172.21.15.2:0/3886577284 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18b8143ae0 msgr2=0x7f18b80b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:26.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.951+0000 7f18c03fe700 1 --2- 172.21.15.2:0/3886577284 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18b8143ae0 0x7f18b80b51b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f18a8009870 tx=0x7f18a8009b80 comp rx=0 tx=0).stop 2023-11-26T07:12:26.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.951+0000 7f18c03fe700 1 -- 172.21.15.2:0/3886577284 shutdown_connections 2023-11-26T07:12:26.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.951+0000 7f18c03fe700 1 --2- 172.21.15.2:0/3886577284 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18b8143ae0 0x7f18b80b51b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:26.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.951+0000 7f18c03fe700 1 -- 172.21.15.2:0/3886577284 >> 172.21.15.2:0/3886577284 conn(0x7f18b80b2740 msgr2=0x7f18b80b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:26.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.951+0000 7f18c03fe700 1 -- 172.21.15.2:0/3886577284 shutdown_connections 2023-11-26T07:12:26.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.951+0000 7f18c03fe700 1 -- 172.21.15.2:0/3886577284 wait complete. 2023-11-26T07:12:26.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.952+0000 7f18c03fe700 1 Processor -- start 2023-11-26T07:12:26.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.952+0000 7f18c03fe700 1 -- start start 2023-11-26T07:12:26.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.953+0000 7f18c03fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18b80722c0 0x7f18b815bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:26.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.953+0000 7f18c03fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18b8143ae0 0x7f18b813ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:26.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.953+0000 7f18c03fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18b81440f0 0x7f18b8155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:26.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.953+0000 7f18c03fe700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b815e410 con 0x7f18b8143ae0 2023-11-26T07:12:26.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.953+0000 7f18c03fe700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b8142c10 con 0x7f18b80722c0 2023-11-26T07:12:26.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.953+0000 7f18c03fe700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b81403a0 con 0x7f18b81440f0 2023-11-26T07:12:26.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.953+0000 7f18bd999700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18b8143ae0 0x7f18b813ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:26.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.953+0000 7f18bd999700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18b8143ae0 0x7f18b813ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40724/0 (socket says 172.21.15.2:40724) 2023-11-26T07:12:26.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.953+0000 7f18bd999700 1 -- 172.21.15.2:0/1387062253 learned_addr learned my addr 172.21.15.2:0/1387062253 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:26.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.953+0000 7f18be19a700 1 --2- 172.21.15.2:0/1387062253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18b80722c0 0x7f18b815bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:26.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.953+0000 7f18be99b700 1 --2- 172.21.15.2:0/1387062253 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18b81440f0 0x7f18b8155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:26.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.953+0000 7f18bd999700 1 -- 172.21.15.2:0/1387062253 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18b81440f0 msgr2=0x7f18b8155040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:26.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.953+0000 7f18bd999700 1 --2- 172.21.15.2:0/1387062253 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18b81440f0 0x7f18b8155040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:26.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.953+0000 7f18bd999700 1 -- 172.21.15.2:0/1387062253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18b80722c0 msgr2=0x7f18b815bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:26.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.953+0000 7f18bd999700 1 --2- 172.21.15.2:0/1387062253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18b80722c0 0x7f18b815bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:26.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.953+0000 7f18bd999700 1 -- 172.21.15.2:0/1387062253 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a80094a0 con 0x7f18b8143ae0 2023-11-26T07:12:26.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.953+0000 7f18be99b700 1 --2- 172.21.15.2:0/1387062253 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18b81440f0 0x7f18b8155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:26.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.953+0000 7f18be19a700 1 --2- 172.21.15.2:0/1387062253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18b80722c0 0x7f18b815bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:26.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.953+0000 7f18bd999700 1 --2- 172.21.15.2:0/1387062253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18b8143ae0 0x7f18b813ee60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f18b400c530 tx=0x7f18b400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:26.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.954+0000 7f18aeffd700 1 -- 172.21.15.2:0/1387062253 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b40052d0 con 0x7f18b8143ae0 2023-11-26T07:12:26.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.954+0000 7f18aeffd700 1 -- 172.21.15.2:0/1387062253 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b4005450 con 0x7f18b8143ae0 2023-11-26T07:12:26.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.954+0000 7f18c03fe700 1 -- 172.21.15.2:0/1387062253 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18b813f3a0 con 0x7f18b8143ae0 2023-11-26T07:12:26.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.954+0000 7f18aeffd700 1 -- 172.21.15.2:0/1387062253 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b40038c0 con 0x7f18b8143ae0 2023-11-26T07:12:26.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.954+0000 7f18c03fe700 1 -- 172.21.15.2:0/1387062253 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18b8142930 con 0x7f18b8143ae0 2023-11-26T07:12:26.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.955+0000 7f18c03fe700 1 -- 172.21.15.2:0/1387062253 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18b8075480 con 0x7f18b8143ae0 2023-11-26T07:12:26.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.955+0000 7f18aeffd700 1 -- 172.21.15.2:0/1387062253 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f18b4003a20 con 0x7f18b8143ae0 2023-11-26T07:12:26.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.955+0000 7f18aeffd700 1 --2- 172.21.15.2:0/1387062253 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f189c06aed0 0x7f189c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:26.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.955+0000 7f18aeffd700 1 -- 172.21.15.2:0/1387062253 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f18b4088710 con 0x7f18b8143ae0 2023-11-26T07:12:26.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.956+0000 7f18be19a700 1 --2- 172.21.15.2:0/1387062253 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f189c06aed0 0x7f189c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:26.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.956+0000 7f18be19a700 1 --2- 172.21.15.2:0/1387062253 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f189c06aed0 0x7f189c06d390 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f18a80090b0 tx=0x7f18a8008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:26.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:26.960+0000 7f18aeffd700 1 -- 172.21.15.2:0/1387062253 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f18b4053ba0 con 0x7f18b8143ae0 2023-11-26T07:12:27.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.157+0000 7f18c03fe700 1 -- 172.21.15.2:0/1387062253 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f18b80b5d20 con 0x7f18b8143ae0 2023-11-26T07:12:27.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.157+0000 7f18aeffd700 1 -- 172.21.15.2:0/1387062253 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f18b4017020 con 0x7f18b8143ae0 2023-11-26T07:12:27.159 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-26T07:12:27.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.159+0000 7f18c03fe700 1 -- 172.21.15.2:0/1387062253 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f189c06aed0 msgr2=0x7f189c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:27.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.159+0000 7f18c03fe700 1 --2- 172.21.15.2:0/1387062253 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f189c06aed0 0x7f189c06d390 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f18a80090b0 tx=0x7f18a8008030 comp rx=0 tx=0).stop 2023-11-26T07:12:27.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.159+0000 7f18c03fe700 1 -- 172.21.15.2:0/1387062253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18b8143ae0 msgr2=0x7f18b813ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:27.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.159+0000 7f18c03fe700 1 --2- 172.21.15.2:0/1387062253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18b8143ae0 0x7f18b813ee60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f18b400c530 tx=0x7f18b400c8f0 comp rx=0 tx=0).stop 2023-11-26T07:12:27.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.159+0000 7f18c03fe700 1 -- 172.21.15.2:0/1387062253 shutdown_connections 2023-11-26T07:12:27.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.159+0000 7f18c03fe700 1 --2- 172.21.15.2:0/1387062253 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f189c06aed0 0x7f189c06d390 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:27.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.159+0000 7f18c03fe700 1 --2- 172.21.15.2:0/1387062253 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18b81440f0 0x7f18b8155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:27.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.159+0000 7f18c03fe700 1 --2- 172.21.15.2:0/1387062253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18b80722c0 0x7f18b815bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:27.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.159+0000 7f18c03fe700 1 --2- 172.21.15.2:0/1387062253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18b8143ae0 0x7f18b813ee60 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:27.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.159+0000 7f18c03fe700 1 -- 172.21.15.2:0/1387062253 >> 172.21.15.2:0/1387062253 conn(0x7f18b80b2740 msgr2=0x7f18b806e410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:27.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.159+0000 7f18c03fe700 1 -- 172.21.15.2:0/1387062253 shutdown_connections 2023-11-26T07:12:27.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.159+0000 7f18c03fe700 1 -- 172.21.15.2:0/1387062253 wait complete. 2023-11-26T07:12:27.173 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-26T07:12:27.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.296+0000 7f6837687700 1 Processor -- start 2023-11-26T07:12:27.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.296+0000 7f6837687700 1 -- start start 2023-11-26T07:12:27.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.297+0000 7f6837687700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6830143ae0 0x7f68300b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:27.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.297+0000 7f6837687700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f68301440f0 0x7f6830071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:27.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.297+0000 7f6837687700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f68300720f0 0x7f683015e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:27.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.297+0000 7f6837687700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68300b40a0 con 0x7f68300720f0 2023-11-26T07:12:27.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.297+0000 7f6837687700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6830072580 con 0x7f68301440f0 2023-11-26T07:12:27.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.297+0000 7f6837687700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6830143ec0 con 0x7f6830143ae0 2023-11-26T07:12:27.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.297+0000 7f6835c24700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f68300720f0 0x7f683015e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:27.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.297+0000 7f6835c24700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f68300720f0 0x7f683015e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40734/0 (socket says 172.21.15.2:40734) 2023-11-26T07:12:27.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.297+0000 7f6835c24700 1 -- 172.21.15.2:0/3340536329 learned_addr learned my addr 172.21.15.2:0/3340536329 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:27.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.297+0000 7f6835423700 1 --2- 172.21.15.2:0/3340536329 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6830143ae0 0x7f68300b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:27.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.297+0000 7f6834c22700 1 --2- 172.21.15.2:0/3340536329 >> v2:172.21.15.192:3300/0 conn(0x7f68301440f0 0x7f6830071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:27.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.297+0000 7f6835c24700 1 -- 172.21.15.2:0/3340536329 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6830143ae0 msgr2=0x7f68300b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:27.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.297+0000 7f6835c24700 1 --2- 172.21.15.2:0/3340536329 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6830143ae0 0x7f68300b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:27.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.297+0000 7f6835c24700 1 -- 172.21.15.2:0/3340536329 >> v2:172.21.15.192:3300/0 conn(0x7f68301440f0 msgr2=0x7f6830071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:27.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.297+0000 7f6835c24700 1 --2- 172.21.15.2:0/3340536329 >> v2:172.21.15.192:3300/0 conn(0x7f68301440f0 0x7f6830071bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:27.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.297+0000 7f6835c24700 1 -- 172.21.15.2:0/3340536329 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68300b3ae0 con 0x7f68300720f0 2023-11-26T07:12:27.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.297+0000 7f6834c22700 1 --2- 172.21.15.2:0/3340536329 >> v2:172.21.15.192:3300/0 conn(0x7f68301440f0 0x7f6830071bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:27.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.297+0000 7f6835423700 1 --2- 172.21.15.2:0/3340536329 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6830143ae0 0x7f68300b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:27.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.297+0000 7f6835c24700 1 --2- 172.21.15.2:0/3340536329 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68300720f0 0x7f683015e8b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f683006d070 tx=0x7f682800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c893fca6b51399dc server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:27.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.297+0000 7f6823fff700 1 -- 172.21.15.2:0/3340536329 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682800e070 con 0x7f68300720f0 2023-11-26T07:12:27.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.297+0000 7f6823fff700 1 -- 172.21.15.2:0/3340536329 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f682800b9c0 con 0x7f68300720f0 2023-11-26T07:12:27.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.298+0000 7f6823fff700 1 -- 172.21.15.2:0/3340536329 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682800bd70 con 0x7f68300720f0 2023-11-26T07:12:27.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.298+0000 7f6837687700 1 -- 172.21.15.2:0/3340536329 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68300720f0 msgr2=0x7f683015e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:27.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.298+0000 7f6837687700 1 --2- 172.21.15.2:0/3340536329 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68300720f0 0x7f683015e8b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f683006d070 tx=0x7f682800b330 comp rx=0 tx=0).stop 2023-11-26T07:12:27.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.298+0000 7f6837687700 1 -- 172.21.15.2:0/3340536329 shutdown_connections 2023-11-26T07:12:27.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.298+0000 7f6837687700 1 --2- 172.21.15.2:0/3340536329 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68300720f0 0x7f683015e8b0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:27.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.298+0000 7f6837687700 1 --2- 172.21.15.2:0/3340536329 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6830143ae0 0x7f68300b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:27.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.298+0000 7f6837687700 1 --2- 172.21.15.2:0/3340536329 >> v2:172.21.15.192:3300/0 conn(0x7f68301440f0 0x7f6830071bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:27.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.298+0000 7f6837687700 1 -- 172.21.15.2:0/3340536329 >> 172.21.15.2:0/3340536329 conn(0x7f68300b2740 msgr2=0x7f68300b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:27.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.298+0000 7f6837687700 1 -- 172.21.15.2:0/3340536329 shutdown_connections 2023-11-26T07:12:27.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.298+0000 7f6837687700 1 -- 172.21.15.2:0/3340536329 wait complete. 2023-11-26T07:12:27.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.299+0000 7f6837687700 1 Processor -- start 2023-11-26T07:12:27.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.299+0000 7f6837687700 1 -- start start 2023-11-26T07:12:27.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.300+0000 7f6837687700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f68300720f0 0x7f683013ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:27.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.300+0000 7f6837687700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6830143ae0 0x7f68300cb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:27.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.300+0000 7f6837687700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68301440f0 0x7f683006afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:27.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.300+0000 7f6837687700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68300cab00 con 0x7f68301440f0 2023-11-26T07:12:27.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.300+0000 7f6837687700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f683013f360 con 0x7f6830143ae0 2023-11-26T07:12:27.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.300+0000 7f6837687700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68300c9ef0 con 0x7f68300720f0 2023-11-26T07:12:27.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.300+0000 7f6835c24700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68301440f0 0x7f683006afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:27.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.300+0000 7f6835c24700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68301440f0 0x7f683006afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40740/0 (socket says 172.21.15.2:40740) 2023-11-26T07:12:27.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.300+0000 7f6835c24700 1 -- 172.21.15.2:0/286508561 learned_addr learned my addr 172.21.15.2:0/286508561 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:27.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.300+0000 7f6834c22700 1 --2- 172.21.15.2:0/286508561 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6830143ae0 0x7f68300cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:27.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.301+0000 7f6835c24700 1 -- 172.21.15.2:0/286508561 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f68300720f0 msgr2=0x7f683013ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:27.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.301+0000 7f6835423700 1 --2- 172.21.15.2:0/286508561 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f68300720f0 0x7f683013ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:27.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.301+0000 7f6835c24700 1 --2- 172.21.15.2:0/286508561 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f68300720f0 0x7f683013ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:27.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.301+0000 7f6835c24700 1 -- 172.21.15.2:0/286508561 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6830143ae0 msgr2=0x7f68300cb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:27.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.301+0000 7f6835c24700 1 --2- 172.21.15.2:0/286508561 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6830143ae0 0x7f68300cb590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:27.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.301+0000 7f6835c24700 1 -- 172.21.15.2:0/286508561 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6828009b30 con 0x7f68301440f0 2023-11-26T07:12:27.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.301+0000 7f6835c24700 1 --2- 172.21.15.2:0/286508561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68301440f0 0x7f683006afd0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f68300d1bd0 tx=0x7f6828004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:27.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.301+0000 7f6821ffb700 1 -- 172.21.15.2:0/286508561 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6828004250 con 0x7f68301440f0 2023-11-26T07:12:27.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.301+0000 7f6821ffb700 1 -- 172.21.15.2:0/286508561 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68280043d0 con 0x7f68301440f0 2023-11-26T07:12:27.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.301+0000 7f6837687700 1 -- 172.21.15.2:0/286508561 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68300ca1d0 con 0x7f68301440f0 2023-11-26T07:12:27.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.301+0000 7f6821ffb700 1 -- 172.21.15.2:0/286508561 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6828004780 con 0x7f68301440f0 2023-11-26T07:12:27.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.301+0000 7f6837687700 1 -- 172.21.15.2:0/286508561 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68300ca790 con 0x7f68301440f0 2023-11-26T07:12:27.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.302+0000 7f6837687700 1 -- 172.21.15.2:0/286508561 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68300ca950 con 0x7f68301440f0 2023-11-26T07:12:27.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.302+0000 7f6821ffb700 1 -- 172.21.15.2:0/286508561 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f682801b430 con 0x7f68301440f0 2023-11-26T07:12:27.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.303+0000 7f6821ffb700 1 --2- 172.21.15.2:0/286508561 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f681406aed0 0x7f681406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:27.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.303+0000 7f6821ffb700 1 -- 172.21.15.2:0/286508561 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f682808a4a0 con 0x7f68301440f0 2023-11-26T07:12:27.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.303+0000 7f6835423700 1 --2- 172.21.15.2:0/286508561 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f681406aed0 0x7f681406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:27.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.304+0000 7f6835423700 1 --2- 172.21.15.2:0/286508561 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f681406aed0 0x7f681406d390 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f682c0096d0 tx=0x7f682c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:27.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.307+0000 7f6821ffb700 1 -- 172.21.15.2:0/286508561 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6828055930 con 0x7f68301440f0 2023-11-26T07:12:27.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.512+0000 7f6837687700 1 -- 172.21.15.2:0/286508561 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6830144830 con 0x7f68301440f0 2023-11-26T07:12:27.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.512+0000 7f6821ffb700 1 -- 172.21.15.2:0/286508561 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) v1 ==== 84+0+65 (secure 0 0 0) 0x7f682801f090 con 0x7f68301440f0 2023-11-26T07:12:27.515 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:12:27.515 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2023-11-26T07:12:27.515 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:12:27.515 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 1, 2023-11-26T07:12:27.515 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": ".mgr" 2023-11-26T07:12:27.515 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:12:27.515 INFO:teuthology.orchestra.run.smithi002.stdout:] 2023-11-26T07:12:27.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.514+0000 7f6837687700 1 -- 172.21.15.2:0/286508561 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f681406aed0 msgr2=0x7f681406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:27.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.514+0000 7f6837687700 1 --2- 172.21.15.2:0/286508561 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f681406aed0 0x7f681406d390 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f682c0096d0 tx=0x7f682c008040 comp rx=0 tx=0).stop 2023-11-26T07:12:27.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.514+0000 7f6837687700 1 -- 172.21.15.2:0/286508561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68301440f0 msgr2=0x7f683006afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:27.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.514+0000 7f6837687700 1 --2- 172.21.15.2:0/286508561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68301440f0 0x7f683006afd0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f68300d1bd0 tx=0x7f6828004ad0 comp rx=0 tx=0).stop 2023-11-26T07:12:27.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.514+0000 7f6837687700 1 -- 172.21.15.2:0/286508561 shutdown_connections 2023-11-26T07:12:27.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.515+0000 7f6837687700 1 --2- 172.21.15.2:0/286508561 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f681406aed0 0x7f681406d390 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:27.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.515+0000 7f6837687700 1 --2- 172.21.15.2:0/286508561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68301440f0 0x7f683006afd0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:27.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.515+0000 7f6837687700 1 --2- 172.21.15.2:0/286508561 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f68300720f0 0x7f683013ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:27.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.515+0000 7f6837687700 1 --2- 172.21.15.2:0/286508561 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6830143ae0 0x7f68300cb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:27.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.515+0000 7f6837687700 1 -- 172.21.15.2:0/286508561 >> 172.21.15.2:0/286508561 conn(0x7f68300b2740 msgr2=0x7f6830142890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:27.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.515+0000 7f6837687700 1 -- 172.21.15.2:0/286508561 shutdown_connections 2023-11-26T07:12:27.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.515+0000 7f6837687700 1 -- 172.21.15.2:0/286508561 wait complete. 2023-11-26T07:12:27.528 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-26T07:12:27.529 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-26T07:12:27.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.655+0000 7f1a4f093700 1 Processor -- start 2023-11-26T07:12:27.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.656+0000 7f1a4f093700 1 -- start start 2023-11-26T07:12:27.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.656+0000 7f1a4f093700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a48158700 0x7f1a48071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:27.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.656+0000 7f1a4f093700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1a480b4a80 0x7f1a480720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:27.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.656+0000 7f1a4f093700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a480b45f0 con 0x7f1a4806efa0 2023-11-26T07:12:27.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.656+0000 7f1a4f093700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a4806fcd0 con 0x7f1a480b4a80 2023-11-26T07:12:27.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.656+0000 7f1a4f093700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a48158ae0 con 0x7f1a48158700 2023-11-26T07:12:27.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.657+0000 7f1a47fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1a480b4a80 0x7f1a480720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:27.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.657+0000 7f1a4d630700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f1a4806efa0 0x7f1a4806f410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60190/0 (socket says 172.21.15.2:60190) 2023-11-26T07:12:27.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.657+0000 7f1a4d630700 1 -- 172.21.15.2:0/9836752 learned_addr learned my addr 172.21.15.2:0/9836752 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:27.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.657+0000 7f1a4ce2f700 1 --2- 172.21.15.2:0/9836752 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a48158700 0x7f1a48071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:27.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.657+0000 7f1a47fff700 1 -- 172.21.15.2:0/9836752 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a48158700 msgr2=0x7f1a48071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:27.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.657+0000 7f1a47fff700 1 --2- 172.21.15.2:0/9836752 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a48158700 0x7f1a48071bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:27.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.657+0000 7f1a47fff700 1 -- 172.21.15.2:0/9836752 >> v1:172.21.15.2:6789/0 conn(0x7f1a4806efa0 legacy=0x7f1a4806f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:27.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.657+0000 7f1a47fff700 1 -- 172.21.15.2:0/9836752 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a480b3cc0 con 0x7f1a480b4a80 2023-11-26T07:12:27.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.657+0000 7f1a477fe700 1 -- 172.21.15.2:0/9836752 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1646234800 0 0) 0x7f1a480b45f0 con 0x7f1a4806efa0 2023-11-26T07:12:27.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.657+0000 7f1a4ce2f700 1 --2- 172.21.15.2:0/9836752 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a48158700 0x7f1a48071bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:27.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.657+0000 7f1a47fff700 1 --2- 172.21.15.2:0/9836752 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a480b4a80 0x7f1a480720f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1a34009840 tx=0x7f1a34009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28fe1b80e187a3a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:27.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.657+0000 7f1a477fe700 1 -- 172.21.15.2:0/9836752 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a34011830 con 0x7f1a480b4a80 2023-11-26T07:12:27.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.657+0000 7f1a477fe700 1 -- 172.21.15.2:0/9836752 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a34011990 con 0x7f1a480b4a80 2023-11-26T07:12:27.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.657+0000 7f1a477fe700 1 -- 172.21.15.2:0/9836752 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a34011d20 con 0x7f1a480b4a80 2023-11-26T07:12:27.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.658+0000 7f1a4f093700 1 -- 172.21.15.2:0/9836752 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a480b4a80 msgr2=0x7f1a480720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:27.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.658+0000 7f1a4f093700 1 --2- 172.21.15.2:0/9836752 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a480b4a80 0x7f1a480720f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1a34009840 tx=0x7f1a34009b50 comp rx=0 tx=0).stop 2023-11-26T07:12:27.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.658+0000 7f1a4f093700 1 -- 172.21.15.2:0/9836752 shutdown_connections 2023-11-26T07:12:27.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.658+0000 7f1a4f093700 1 --2- 172.21.15.2:0/9836752 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a48158700 0x7f1a48071bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:27.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.658+0000 7f1a4f093700 1 --2- 172.21.15.2:0/9836752 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a480b4a80 0x7f1a480720f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:27.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.658+0000 7f1a4f093700 1 -- 172.21.15.2:0/9836752 >> 172.21.15.2:0/9836752 conn(0x7f1a480b2840 msgr2=0x7f1a480b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:27.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.658+0000 7f1a4f093700 1 -- 172.21.15.2:0/9836752 shutdown_connections 2023-11-26T07:12:27.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.658+0000 7f1a4f093700 1 -- 172.21.15.2:0/9836752 wait complete. 2023-11-26T07:12:27.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.659+0000 7f1a4f093700 1 Processor -- start 2023-11-26T07:12:27.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.659+0000 7f1a4f093700 1 -- start start 2023-11-26T07:12:27.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.660+0000 7f1a4f093700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a4806efa0 0x7f1a4814a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:27.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.660+0000 7f1a4f093700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a480b4a80 0x7f1a480b16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:27.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.660+0000 7f1a4f093700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a48158700 0x7f1a480b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:27.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.660+0000 7f1a4f093700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4813bce0 con 0x7f1a48158700 2023-11-26T07:12:27.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.660+0000 7f1a4f093700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a481f12f0 con 0x7f1a480b4a80 2023-11-26T07:12:27.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.660+0000 7f1a4f093700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4815c2e0 con 0x7f1a4806efa0 2023-11-26T07:12:27.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.660+0000 7f1a4d630700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a48158700 0x7f1a480b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:27.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.660+0000 7f1a4d630700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a48158700 0x7f1a480b1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40752/0 (socket says 172.21.15.2:40752) 2023-11-26T07:12:27.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.660+0000 7f1a4d630700 1 -- 172.21.15.2:0/3550009508 learned_addr learned my addr 172.21.15.2:0/3550009508 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:27.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.660+0000 7f1a4ce2f700 1 --2- 172.21.15.2:0/3550009508 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a4806efa0 0x7f1a4814a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:27.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.660+0000 7f1a47fff700 1 --2- 172.21.15.2:0/3550009508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a480b4a80 0x7f1a480b16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:27.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.660+0000 7f1a4d630700 1 -- 172.21.15.2:0/3550009508 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a4806efa0 msgr2=0x7f1a4814a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:27.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.660+0000 7f1a4d630700 1 --2- 172.21.15.2:0/3550009508 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a4806efa0 0x7f1a4814a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:27.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.660+0000 7f1a4d630700 1 -- 172.21.15.2:0/3550009508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a480b4a80 msgr2=0x7f1a480b16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:27.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.660+0000 7f1a4d630700 1 --2- 172.21.15.2:0/3550009508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a480b4a80 0x7f1a480b16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:27.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.660+0000 7f1a4d630700 1 -- 172.21.15.2:0/3550009508 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a340094a0 con 0x7f1a48158700 2023-11-26T07:12:27.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.660+0000 7f1a4ce2f700 1 --2- 172.21.15.2:0/3550009508 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a4806efa0 0x7f1a4814a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:12:27.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.661+0000 7f1a4d630700 1 --2- 172.21.15.2:0/3550009508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a48158700 0x7f1a480b1c20 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1a40002230 tx=0x7f1a4000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:27.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.661+0000 7f1a457fa700 1 -- 172.21.15.2:0/3550009508 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4000ac20 con 0x7f1a48158700 2023-11-26T07:12:27.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.661+0000 7f1a457fa700 1 -- 172.21.15.2:0/3550009508 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4000ada0 con 0x7f1a48158700 2023-11-26T07:12:27.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.661+0000 7f1a4f093700 1 -- 172.21.15.2:0/3550009508 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a4815c5c0 con 0x7f1a48158700 2023-11-26T07:12:27.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.661+0000 7f1a457fa700 1 -- 172.21.15.2:0/3550009508 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a40007310 con 0x7f1a48158700 2023-11-26T07:12:27.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.661+0000 7f1a4f093700 1 -- 172.21.15.2:0/3550009508 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a4815cb80 con 0x7f1a48158700 2023-11-26T07:12:27.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.662+0000 7f1a4f093700 1 -- 172.21.15.2:0/3550009508 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a48068670 con 0x7f1a48158700 2023-11-26T07:12:27.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.662+0000 7f1a457fa700 1 -- 172.21.15.2:0/3550009508 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1a40007470 con 0x7f1a48158700 2023-11-26T07:12:27.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.662+0000 7f1a457fa700 1 --2- 172.21.15.2:0/3550009508 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f1a2c06aed0 0x7f1a2c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:27.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.663+0000 7f1a457fa700 1 -- 172.21.15.2:0/3550009508 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1a400891e0 con 0x7f1a48158700 2023-11-26T07:12:27.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.663+0000 7f1a4ce2f700 1 --2- 172.21.15.2:0/3550009508 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f1a2c06aed0 0x7f1a2c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:27.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.663+0000 7f1a4ce2f700 1 --2- 172.21.15.2:0/3550009508 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f1a2c06aed0 0x7f1a2c06d390 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1a4815f2f0 tx=0x7f1a3c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:27.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.667+0000 7f1a457fa700 1 -- 172.21.15.2:0/3550009508 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1a400545e0 con 0x7f1a48158700 2023-11-26T07:12:27.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:27.868+0000 7f1a4f093700 1 -- 172.21.15.2:0/3550009508 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f1a4815cd70 con 0x7f1a48158700 2023-11-26T07:12:28.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.363+0000 7f1a457fa700 1 -- 172.21.15.2:0/3550009508 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1a40057c00 con 0x7f1a48158700 2023-11-26T07:12:28.368 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.366+0000 7f1a4f093700 1 -- 172.21.15.2:0/3550009508 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f1a2c06aed0 msgr2=0x7f1a2c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:28.368 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.366+0000 7f1a4f093700 1 --2- 172.21.15.2:0/3550009508 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f1a2c06aed0 0x7f1a2c06d390 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1a4815f2f0 tx=0x7f1a3c008040 comp rx=0 tx=0).stop 2023-11-26T07:12:28.368 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.366+0000 7f1a4f093700 1 -- 172.21.15.2:0/3550009508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a48158700 msgr2=0x7f1a480b1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:28.368 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.366+0000 7f1a4f093700 1 --2- 172.21.15.2:0/3550009508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a48158700 0x7f1a480b1c20 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1a40002230 tx=0x7f1a4000a060 comp rx=0 tx=0).stop 2023-11-26T07:12:28.368 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.366+0000 7f1a4f093700 1 -- 172.21.15.2:0/3550009508 shutdown_connections 2023-11-26T07:12:28.368 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.366+0000 7f1a4f093700 1 --2- 172.21.15.2:0/3550009508 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f1a2c06aed0 0x7f1a2c06d390 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:28.368 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.366+0000 7f1a4f093700 1 --2- 172.21.15.2:0/3550009508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a48158700 0x7f1a480b1c20 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:28.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.366+0000 7f1a4f093700 1 --2- 172.21.15.2:0/3550009508 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a4806efa0 0x7f1a4814a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:28.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.366+0000 7f1a4f093700 1 --2- 172.21.15.2:0/3550009508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a480b4a80 0x7f1a480b16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:28.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.366+0000 7f1a4f093700 1 -- 172.21.15.2:0/3550009508 >> 172.21.15.2:0/3550009508 conn(0x7f1a480b2840 msgr2=0x7f1a48158c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:28.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.366+0000 7f1a4f093700 1 -- 172.21.15.2:0/3550009508 shutdown_connections 2023-11-26T07:12:28.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.366+0000 7f1a4f093700 1 -- 172.21.15.2:0/3550009508 wait complete. 2023-11-26T07:12:28.373 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' created 2023-11-26T07:12:28.385 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-26T07:12:28.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.519+0000 7f3aca8d9700 1 Processor -- start 2023-11-26T07:12:28.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.519+0000 7f3aca8d9700 1 -- start start 2023-11-26T07:12:28.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.520+0000 7f3aca8d9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ac406b620 0x7f3ac40b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:28.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.520+0000 7f3aca8d9700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ac41629c0 con 0x7f3ac406ee60 2023-11-26T07:12:28.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.520+0000 7f3aca8d9700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ac4071f50 con 0x7f3ac40b5ab0 2023-11-26T07:12:28.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.520+0000 7f3aca8d9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac4072230 con 0x7f3ac406b620 2023-11-26T07:12:28.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.520+0000 7f3ac8e76700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f3ac406ee60 0x7f3ac41622b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60204/0 (socket says 172.21.15.2:60204) 2023-11-26T07:12:28.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.520+0000 7f3ac8e76700 1 -- 172.21.15.2:0/1097975791 learned_addr learned my addr 172.21.15.2:0/1097975791 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:28.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.520+0000 7f3ac3fff700 1 --2- 172.21.15.2:0/1097975791 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ac406b620 0x7f3ac40b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:28.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.521+0000 7f3ac2ffd700 1 -- 172.21.15.2:0/1097975791 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4166235635 0 0) 0x7f3ac41629c0 con 0x7f3ac406ee60 2023-11-26T07:12:28.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.521+0000 7f3ac2ffd700 1 -- 172.21.15.2:0/1097975791 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3aac0035b0 con 0x7f3ac406ee60 2023-11-26T07:12:28.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.521+0000 7f3ac2ffd700 1 -- 172.21.15.2:0/1097975791 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3624997851 0 0) 0x7f3ac4071f50 con 0x7f3ac40b5ab0 2023-11-26T07:12:28.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.521+0000 7f3ac2ffd700 1 -- 172.21.15.2:0/1097975791 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ac41629c0 con 0x7f3ac40b5ab0 2023-11-26T07:12:28.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.521+0000 7f3ac2ffd700 1 -- 172.21.15.2:0/1097975791 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1982983840 0 0) 0x7f3aac0035b0 con 0x7f3ac406ee60 2023-11-26T07:12:28.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.521+0000 7f3ac2ffd700 1 -- 172.21.15.2:0/1097975791 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ac406b620 msgr2=0x7f3ac40b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.521+0000 7f3ac2ffd700 1 --2- 172.21.15.2:0/1097975791 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ac406b620 0x7f3ac40b3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.521+0000 7f3ac2ffd700 1 -- 172.21.15.2:0/1097975791 >> v1:172.21.15.192:6789/0 conn(0x7f3ac40b5ab0 legacy=0x7f3ac4161ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.521+0000 7f3ac2ffd700 1 -- 172.21.15.2:0/1097975791 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac4072510 con 0x7f3ac406ee60 2023-11-26T07:12:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.521+0000 7f3ac2ffd700 1 -- 172.21.15.2:0/1097975791 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f3abc0019f0 con 0x7f3ac406ee60 2023-11-26T07:12:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.521+0000 7f3ac2ffd700 1 -- 172.21.15.2:0/1097975791 >> v1:172.21.15.2:6789/0 conn(0x7f3ac406ee60 legacy=0x7f3ac41622b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.521+0000 7f3ac2ffd700 1 --2- 172.21.15.2:0/1097975791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3aac003bc0 0x7f3aac003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.521+0000 7f3ac2ffd700 1 --2- 172.21.15.2:0/1097975791 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3aac004850 0x7f3aac004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.521+0000 7f3ac2ffd700 1 --2- 172.21.15.2:0/1097975791 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ac406b620 0x7f3aac005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.521+0000 7f3ac2ffd700 1 -- 172.21.15.2:0/1097975791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac4072230 con 0x7f3aac003bc0 2023-11-26T07:12:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.521+0000 7f3ac2ffd700 1 -- 172.21.15.2:0/1097975791 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac00bac0 con 0x7f3aac004850 2023-11-26T07:12:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.521+0000 7f3ac2ffd700 1 -- 172.21.15.2:0/1097975791 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac00bc80 con 0x7f3ac406b620 2023-11-26T07:12:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.521+0000 7f3ac3fff700 1 --2- 172.21.15.2:0/1097975791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3aac003bc0 0x7f3aac003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.521+0000 7f3ac37fe700 1 --2- 172.21.15.2:0/1097975791 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3aac004850 0x7f3aac004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:28.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.521+0000 7f3ac8e76700 1 --2- 172.21.15.2:0/1097975791 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ac406b620 0x7f3aac005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:28.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.521+0000 7f3ac3fff700 1 -- 172.21.15.2:0/1097975791 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ac406b620 msgr2=0x7f3aac005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:28.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.521+0000 7f3ac3fff700 1 --2- 172.21.15.2:0/1097975791 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ac406b620 0x7f3aac005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:28.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.521+0000 7f3ac3fff700 1 -- 172.21.15.2:0/1097975791 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3aac004850 msgr2=0x7f3aac004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:28.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.521+0000 7f3ac3fff700 1 --2- 172.21.15.2:0/1097975791 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3aac004850 0x7f3aac004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:28.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.521+0000 7f3ac3fff700 1 -- 172.21.15.2:0/1097975791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aac0035b0 con 0x7f3aac003bc0 2023-11-26T07:12:28.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.521+0000 7f3ac37fe700 1 --2- 172.21.15.2:0/1097975791 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3aac004850 0x7f3aac004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:28.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.522+0000 7f3ac3fff700 1 --2- 172.21.15.2:0/1097975791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3aac003bc0 0x7f3aac003fc0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3ab8009b60 tx=0x7f3aac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9eaeae4541e53fb server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:28.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.522+0000 7f3ac2ffd700 1 -- 172.21.15.2:0/1097975791 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab800e6c0 con 0x7f3aac003bc0 2023-11-26T07:12:28.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.522+0000 7f3ac2ffd700 1 -- 172.21.15.2:0/1097975791 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab800e820 con 0x7f3aac003bc0 2023-11-26T07:12:28.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.522+0000 7f3ac2ffd700 1 -- 172.21.15.2:0/1097975791 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab800eb90 con 0x7f3aac003bc0 2023-11-26T07:12:28.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.522+0000 7f3aca8d9700 1 -- 172.21.15.2:0/1097975791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3aac003bc0 msgr2=0x7f3aac003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:28.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.522+0000 7f3aca8d9700 1 --2- 172.21.15.2:0/1097975791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3aac003bc0 0x7f3aac003fc0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3ab8009b60 tx=0x7f3aac005880 comp rx=0 tx=0).stop 2023-11-26T07:12:28.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.522+0000 7f3ac8e76700 1 -- 172.21.15.2:0/1097975791 reap_dead start 2023-11-26T07:12:28.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.522+0000 7f3aca8d9700 1 -- 172.21.15.2:0/1097975791 shutdown_connections 2023-11-26T07:12:28.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.522+0000 7f3aca8d9700 1 -- 172.21.15.2:0/1097975791 >> 172.21.15.2:0/1097975791 conn(0x7f3ac40b2740 msgr2=0x7f3ac40b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:28.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.522+0000 7f3aca8d9700 1 -- 172.21.15.2:0/1097975791 shutdown_connections 2023-11-26T07:12:28.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.522+0000 7f3aca8d9700 1 -- 172.21.15.2:0/1097975791 wait complete. 2023-11-26T07:12:28.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.523+0000 7f3aca8d9700 1 Processor -- start 2023-11-26T07:12:28.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.524+0000 7f3aca8d9700 1 -- start start 2023-11-26T07:12:28.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.524+0000 7f3aca8d9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3aac003bc0 0x7f3ac40caa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:28.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.524+0000 7f3aca8d9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ac40cf440 0x7f3ac41341f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:28.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.524+0000 7f3aca8d9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ac40adf20 0x7f3ac40ae3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:28.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.524+0000 7f3aca8d9700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac41f6e50 con 0x7f3ac40cf440 2023-11-26T07:12:28.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.524+0000 7f3aca8d9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac40ae8e0 con 0x7f3aac003bc0 2023-11-26T07:12:28.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.524+0000 7f3aca8d9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac40cf8c0 con 0x7f3ac40adf20 2023-11-26T07:12:28.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.525+0000 7f3ac37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ac40cf440 0x7f3ac41341f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:28.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.525+0000 7f3ac37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ac40cf440 0x7f3ac41341f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40772/0 (socket says 172.21.15.2:40772) 2023-11-26T07:12:28.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.525+0000 7f3ac37fe700 1 -- 172.21.15.2:0/1594349743 learned_addr learned my addr 172.21.15.2:0/1594349743 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:28.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.525+0000 7f3ac3fff700 1 --2- 172.21.15.2:0/1594349743 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3aac003bc0 0x7f3ac40caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:28.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.525+0000 7f3ac8e76700 1 --2- 172.21.15.2:0/1594349743 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ac40adf20 0x7f3ac40ae3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:28.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.525+0000 7f3ac8e76700 1 -- 172.21.15.2:0/1594349743 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3aac003bc0 msgr2=0x7f3ac40caa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:28.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.525+0000 7f3ac8e76700 1 --2- 172.21.15.2:0/1594349743 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3aac003bc0 0x7f3ac40caa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:28.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.525+0000 7f3ac8e76700 1 -- 172.21.15.2:0/1594349743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ac40cf440 msgr2=0x7f3ac41341f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:28.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.525+0000 7f3ac8e76700 1 --2- 172.21.15.2:0/1594349743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ac40cf440 0x7f3ac41341f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:28.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.525+0000 7f3ac8e76700 1 -- 172.21.15.2:0/1594349743 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac41f70a0 con 0x7f3ac40adf20 2023-11-26T07:12:28.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.525+0000 7f3ac8e76700 1 --2- 172.21.15.2:0/1594349743 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ac40adf20 0x7f3ac40ae3a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3ac406d6f0 tx=0x7f3abc00e440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:28.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.525+0000 7f3ac0ff9700 1 -- 172.21.15.2:0/1594349743 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3abc00ebb0 con 0x7f3ac40adf20 2023-11-26T07:12:28.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.525+0000 7f3ac0ff9700 1 -- 172.21.15.2:0/1594349743 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3abc00ed10 con 0x7f3ac40adf20 2023-11-26T07:12:28.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.525+0000 7f3aca8d9700 1 -- 172.21.15.2:0/1594349743 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ac41f7380 con 0x7f3ac40adf20 2023-11-26T07:12:28.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.525+0000 7f3ac0ff9700 1 -- 172.21.15.2:0/1594349743 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3abc013660 con 0x7f3ac40adf20 2023-11-26T07:12:28.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.525+0000 7f3aca8d9700 1 -- 172.21.15.2:0/1594349743 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ac41f7940 con 0x7f3ac40adf20 2023-11-26T07:12:28.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.526+0000 7f3aca8d9700 1 -- 172.21.15.2:0/1594349743 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ac41f7cb0 con 0x7f3ac40adf20 2023-11-26T07:12:28.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.527+0000 7f3ac0ff9700 1 -- 172.21.15.2:0/1594349743 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3abc0137c0 con 0x7f3ac40adf20 2023-11-26T07:12:28.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.527+0000 7f3ac0ff9700 1 --2- 172.21.15.2:0/1594349743 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3ab006aed0 0x7f3ab006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:28.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.527+0000 7f3ac0ff9700 1 -- 172.21.15.2:0/1594349743 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f3abc089bb0 con 0x7f3ac40adf20 2023-11-26T07:12:28.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.528+0000 7f3ac3fff700 1 --2- 172.21.15.2:0/1594349743 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3ab006aed0 0x7f3ab006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:28.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.528+0000 7f3ac3fff700 1 --2- 172.21.15.2:0/1594349743 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3ab006aed0 0x7f3ab006d390 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3ab80090b0 tx=0x7f3ab801f040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:28.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.532+0000 7f3ac0ff9700 1 -- 172.21.15.2:0/1594349743 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3abc054f20 con 0x7f3ac40adf20 2023-11-26T07:12:28.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:28.731+0000 7f3aca8d9700 1 -- 172.21.15.2:0/1594349743 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3ac41f7ad0 con 0x7f3ac40adf20 2023-11-26T07:12:29.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.373+0000 7f3ac0ff9700 1 -- 172.21.15.2:0/1594349743 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3abc058540 con 0x7f3ac40adf20 2023-11-26T07:12:29.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.385+0000 7f3aca8d9700 1 -- 172.21.15.2:0/1594349743 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3ab006aed0 msgr2=0x7f3ab006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:29.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.385+0000 7f3aca8d9700 1 --2- 172.21.15.2:0/1594349743 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3ab006aed0 0x7f3ab006d390 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3ab80090b0 tx=0x7f3ab801f040 comp rx=0 tx=0).stop 2023-11-26T07:12:29.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.385+0000 7f3aca8d9700 1 -- 172.21.15.2:0/1594349743 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ac40adf20 msgr2=0x7f3ac40ae3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:29.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.385+0000 7f3aca8d9700 1 --2- 172.21.15.2:0/1594349743 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ac40adf20 0x7f3ac40ae3a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3ac406d6f0 tx=0x7f3abc00e440 comp rx=0 tx=0).stop 2023-11-26T07:12:29.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.386+0000 7f3aca8d9700 1 -- 172.21.15.2:0/1594349743 shutdown_connections 2023-11-26T07:12:29.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.386+0000 7f3aca8d9700 1 --2- 172.21.15.2:0/1594349743 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3ab006aed0 0x7f3ab006d390 secure :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3ab80090b0 tx=0x7f3ab801f040 comp rx=0 tx=0).stop 2023-11-26T07:12:29.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.386+0000 7f3aca8d9700 1 --2- 172.21.15.2:0/1594349743 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ac40adf20 0x7f3ac40ae3a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:29.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.386+0000 7f3aca8d9700 1 --2- 172.21.15.2:0/1594349743 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3aac003bc0 0x7f3ac40caa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:29.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.386+0000 7f3aca8d9700 1 --2- 172.21.15.2:0/1594349743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ac40cf440 0x7f3ac41341f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:29.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.386+0000 7f3aca8d9700 1 -- 172.21.15.2:0/1594349743 >> 172.21.15.2:0/1594349743 conn(0x7f3ac40b2740 msgr2=0x7f3ac40b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:29.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.386+0000 7f3aca8d9700 1 -- 172.21.15.2:0/1594349743 shutdown_connections 2023-11-26T07:12:29.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.386+0000 7f3aca8d9700 1 -- 172.21.15.2:0/1594349743 wait complete. 2023-11-26T07:12:29.393 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' created 2023-11-26T07:12:29.406 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-26T07:12:29.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.538+0000 7f19ed872700 1 Processor -- start 2023-11-26T07:12:29.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.538+0000 7f19ed872700 1 -- start start 2023-11-26T07:12:29.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.539+0000 7f19ed872700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f19e80d0870 0x7f19e80d26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:29.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.539+0000 7f19ed872700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19e80d0c50 0x7f19e80d49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:29.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.539+0000 7f19ed872700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19e80b5370 con 0x7f19e80cf860 2023-11-26T07:12:29.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.539+0000 7f19ed872700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19e80d2f80 con 0x7f19e80d0870 2023-11-26T07:12:29.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.539+0000 7f19ed872700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e80ceae0 con 0x7f19e80d0c50 2023-11-26T07:12:29.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.539+0000 7f19e6ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f19e80d0870 0x7f19e80d26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:29.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.539+0000 7f19e6ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f19e80d0870 0x7f19e80d26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40778/0 (socket says 172.21.15.2:40778) 2023-11-26T07:12:29.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.539+0000 7f19e6ffd700 1 -- 172.21.15.2:0/4134404799 learned_addr learned my addr 172.21.15.2:0/4134404799 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:29.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.539+0000 7f19e67fc700 1 --2- 172.21.15.2:0/4134404799 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19e80d0c50 0x7f19e80d49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.539+0000 7f19e6ffd700 1 -- 172.21.15.2:0/4134404799 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19e80d0c50 msgr2=0x7f19e80d49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.539+0000 7f19e6ffd700 1 --2- 172.21.15.2:0/4134404799 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19e80d0c50 0x7f19e80d49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.539+0000 7f19e6ffd700 1 -- 172.21.15.2:0/4134404799 >> v1:172.21.15.192:6789/0 conn(0x7f19e80cf860 legacy=0x7f19e80b6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.539+0000 7f19e6ffd700 1 -- 172.21.15.2:0/4134404799 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e80d2ca0 con 0x7f19e80d0870 2023-11-26T07:12:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.539+0000 7f19e6ffd700 1 --2- 172.21.15.2:0/4134404799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19e80d0870 0x7f19e80d26c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f19dc0098f0 tx=0x7f19dc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17355d380420f3a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.539+0000 7f19e5ffb700 1 -- 172.21.15.2:0/4134404799 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19dc011830 con 0x7f19e80d0870 2023-11-26T07:12:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.539+0000 7f19e5ffb700 1 -- 172.21.15.2:0/4134404799 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19dc011990 con 0x7f19e80d0870 2023-11-26T07:12:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.539+0000 7f19e5ffb700 1 -- 172.21.15.2:0/4134404799 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19dc011d20 con 0x7f19e80d0870 2023-11-26T07:12:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.540+0000 7f19ed872700 1 -- 172.21.15.2:0/4134404799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19e80d0870 msgr2=0x7f19e80d26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.540+0000 7f19ed872700 1 --2- 172.21.15.2:0/4134404799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19e80d0870 0x7f19e80d26c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f19dc0098f0 tx=0x7f19dc009c00 comp rx=0 tx=0).stop 2023-11-26T07:12:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.540+0000 7f19ed872700 1 -- 172.21.15.2:0/4134404799 shutdown_connections 2023-11-26T07:12:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.540+0000 7f19ed872700 1 --2- 172.21.15.2:0/4134404799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19e80d0870 0x7f19e80d26c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.540+0000 7f19ed872700 1 --2- 172.21.15.2:0/4134404799 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19e80d0c50 0x7f19e80d49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:29.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.540+0000 7f19ed872700 1 -- 172.21.15.2:0/4134404799 >> 172.21.15.2:0/4134404799 conn(0x7f19e80d3ed0 msgr2=0x7f19e80d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:29.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.540+0000 7f19ed872700 1 -- 172.21.15.2:0/4134404799 shutdown_connections 2023-11-26T07:12:29.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.540+0000 7f19ed872700 1 -- 172.21.15.2:0/4134404799 wait complete. 2023-11-26T07:12:29.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.541+0000 7f19ed872700 1 Processor -- start 2023-11-26T07:12:29.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.541+0000 7f19ed872700 1 -- start start 2023-11-26T07:12:29.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.542+0000 7f19ed872700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19e80cf860 0x7f19e80ca630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:29.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.542+0000 7f19ed872700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19e80d0870 0x7f19e81f8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:29.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.542+0000 7f19ed872700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19e80d0c50 0x7f19e8158920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:29.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.542+0000 7f19ed872700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e80c9640 con 0x7f19e80d0870 2023-11-26T07:12:29.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.542+0000 7f19ed872700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e8159490 con 0x7f19e80d0c50 2023-11-26T07:12:29.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.542+0000 7f19ed872700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e80ca1a0 con 0x7f19e80cf860 2023-11-26T07:12:29.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.542+0000 7f19e67fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19e80d0870 0x7f19e81f8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:29.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.542+0000 7f19e67fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19e80d0870 0x7f19e81f8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40786/0 (socket says 172.21.15.2:40786) 2023-11-26T07:12:29.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.542+0000 7f19e67fc700 1 -- 172.21.15.2:0/4222534017 learned_addr learned my addr 172.21.15.2:0/4222534017 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:29.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.542+0000 7f19e6ffd700 1 --2- 172.21.15.2:0/4222534017 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19e80cf860 0x7f19e80ca630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:29.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.542+0000 7f19e77fe700 1 --2- 172.21.15.2:0/4222534017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19e80d0c50 0x7f19e8158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:29.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.543+0000 7f19e67fc700 1 -- 172.21.15.2:0/4222534017 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19e80cf860 msgr2=0x7f19e80ca630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:29.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.543+0000 7f19e67fc700 1 --2- 172.21.15.2:0/4222534017 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19e80cf860 0x7f19e80ca630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:29.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.543+0000 7f19e67fc700 1 -- 172.21.15.2:0/4222534017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19e80d0c50 msgr2=0x7f19e8158920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:29.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.543+0000 7f19e67fc700 1 --2- 172.21.15.2:0/4222534017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19e80d0c50 0x7f19e8158920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:29.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.543+0000 7f19e67fc700 1 -- 172.21.15.2:0/4222534017 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19dc009550 con 0x7f19e80d0870 2023-11-26T07:12:29.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.543+0000 7f19e67fc700 1 --2- 172.21.15.2:0/4222534017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19e80d0870 0x7f19e81f8b90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f19d800e8a0 tx=0x7f19d800ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:29.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.543+0000 7f19cffff700 1 -- 172.21.15.2:0/4222534017 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d8009590 con 0x7f19e80d0870 2023-11-26T07:12:29.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.543+0000 7f19cffff700 1 -- 172.21.15.2:0/4222534017 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d8013680 con 0x7f19e80d0870 2023-11-26T07:12:29.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.543+0000 7f19ed872700 1 -- 172.21.15.2:0/4222534017 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19e80c9870 con 0x7f19e80d0870 2023-11-26T07:12:29.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.543+0000 7f19cffff700 1 -- 172.21.15.2:0/4222534017 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d80139f0 con 0x7f19e80d0870 2023-11-26T07:12:29.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.543+0000 7f19ed872700 1 -- 172.21.15.2:0/4222534017 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19e80c9e30 con 0x7f19e80d0870 2023-11-26T07:12:29.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.544+0000 7f19ed872700 1 -- 172.21.15.2:0/4222534017 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19e80b57c0 con 0x7f19e80d0870 2023-11-26T07:12:29.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.545+0000 7f19cffff700 1 -- 172.21.15.2:0/4222534017 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f19d8013b50 con 0x7f19e80d0870 2023-11-26T07:12:29.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.545+0000 7f19cffff700 1 --2- 172.21.15.2:0/4222534017 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f19d406aed0 0x7f19d406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:29.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.545+0000 7f19cffff700 1 -- 172.21.15.2:0/4222534017 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f19d8089450 con 0x7f19e80d0870 2023-11-26T07:12:29.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.545+0000 7f19e6ffd700 1 --2- 172.21.15.2:0/4222534017 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f19d406aed0 0x7f19d406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:29.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.546+0000 7f19e6ffd700 1 --2- 172.21.15.2:0/4222534017 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f19d406aed0 0x7f19d406d390 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f19dc009c40 tx=0x7f19dc008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:29.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.550+0000 7f19cffff700 1 -- 172.21.15.2:0/4222534017 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f19d8054570 con 0x7f19e80d0870 2023-11-26T07:12:29.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:29.800+0000 7f19ed872700 1 -- 172.21.15.2:0/4222534017 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f19e8067a20 con 0x7f19e80d0870 2023-11-26T07:12:30.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.394+0000 7f19cffff700 1 -- 172.21.15.2:0/4222534017 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f19d8057b90 con 0x7f19e80d0870 2023-11-26T07:12:30.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.410+0000 7f19ed872700 1 -- 172.21.15.2:0/4222534017 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f19d406aed0 msgr2=0x7f19d406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:30.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.410+0000 7f19ed872700 1 --2- 172.21.15.2:0/4222534017 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f19d406aed0 0x7f19d406d390 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f19dc009c40 tx=0x7f19dc008030 comp rx=0 tx=0).stop 2023-11-26T07:12:30.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.410+0000 7f19ed872700 1 -- 172.21.15.2:0/4222534017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19e80d0870 msgr2=0x7f19e81f8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:30.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.410+0000 7f19ed872700 1 --2- 172.21.15.2:0/4222534017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19e80d0870 0x7f19e81f8b90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f19d800e8a0 tx=0x7f19d800ebb0 comp rx=0 tx=0).stop 2023-11-26T07:12:30.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.411+0000 7f19ed872700 1 -- 172.21.15.2:0/4222534017 shutdown_connections 2023-11-26T07:12:30.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.411+0000 7f19ed872700 1 --2- 172.21.15.2:0/4222534017 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f19d406aed0 0x7f19d406d390 secure :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f19dc009c40 tx=0x7f19dc008030 comp rx=0 tx=0).stop 2023-11-26T07:12:30.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.411+0000 7f19ed872700 1 --2- 172.21.15.2:0/4222534017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19e80d0c50 0x7f19e8158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:30.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.411+0000 7f19ed872700 1 --2- 172.21.15.2:0/4222534017 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19e80cf860 0x7f19e80ca630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:30.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.411+0000 7f19ed872700 1 --2- 172.21.15.2:0/4222534017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19e80d0870 0x7f19e81f8b90 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:30.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.411+0000 7f19ed872700 1 -- 172.21.15.2:0/4222534017 >> 172.21.15.2:0/4222534017 conn(0x7f19e80d3ed0 msgr2=0x7f19e80d3190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:30.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.411+0000 7f19ed872700 1 -- 172.21.15.2:0/4222534017 shutdown_connections 2023-11-26T07:12:30.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.411+0000 7f19ed872700 1 -- 172.21.15.2:0/4222534017 wait complete. 2023-11-26T07:12:30.419 INFO:teuthology.orchestra.run.smithi002.stderr:new fs with metadata pool 4 and data pool 5 2023-11-26T07:12:30.432 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:12:30.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.560+0000 7f47d617b700 1 Processor -- start 2023-11-26T07:12:30.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.560+0000 7f47d617b700 1 -- start start 2023-11-26T07:12:30.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.561+0000 7f47d617b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47d015e000 0x7f47d006eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:30.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.561+0000 7f47d617b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f47d00d0ae0 0x7f47d006f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:30.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.561+0000 7f47d617b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47d00cfd60 con 0x7f47d00d0f60 2023-11-26T07:12:30.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.561+0000 7f47d617b700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47d00cf4b0 con 0x7f47d00d0ae0 2023-11-26T07:12:30.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.561+0000 7f47d617b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d006f430 con 0x7f47d015e000 2023-11-26T07:12:30.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.561+0000 7f47cf7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47d015e000 0x7f47d006eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:30.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.561+0000 7f47ceffd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f47d00d0ae0 0x7f47d006f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:30.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.561+0000 7f47cf7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47d015e000 0x7f47d006eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.2:38886/0 (socket says 172.21.15.2:38886) 2023-11-26T07:12:30.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.561+0000 7f47cf7fe700 1 -- 172.21.15.2:0/303057524 learned_addr learned my addr 172.21.15.2:0/303057524 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:30.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.561+0000 7f47cffff700 1 --1- 172.21.15.2:0/303057524 >> v1:172.21.15.192:6789/0 conn(0x7f47d00d0f60 0x7f47d00cc220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.2:39390/0 (socket says 172.21.15.2:39390) 2023-11-26T07:12:30.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.561+0000 7f47cf7fe700 1 -- 172.21.15.2:0/303057524 >> v2:172.21.15.192:3300/0 conn(0x7f47d00d0ae0 msgr2=0x7f47d006f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:30.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.561+0000 7f47cf7fe700 1 --2- 172.21.15.2:0/303057524 >> v2:172.21.15.192:3300/0 conn(0x7f47d00d0ae0 0x7f47d006f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:30.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.561+0000 7f47cf7fe700 1 -- 172.21.15.2:0/303057524 >> v1:172.21.15.192:6789/0 conn(0x7f47d00d0f60 legacy=0x7f47d00cc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:30.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.561+0000 7f47cf7fe700 1 -- 172.21.15.2:0/303057524 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d00cf1d0 con 0x7f47d015e000 2023-11-26T07:12:30.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.561+0000 7f47ceffd700 1 --2- 172.21.15.2:0/303057524 >> v2:172.21.15.192:3300/0 conn(0x7f47d00d0ae0 0x7f47d006f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:12:30.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.562+0000 7f47cf7fe700 1 --2- 172.21.15.2:0/303057524 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47d015e000 0x7f47d006eef0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f47c00098f0 tx=0x7f47c0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=961bf5ceb2e0605b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:30.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.562+0000 7f47ce7fc700 1 -- 172.21.15.2:0/303057524 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c0011830 con 0x7f47d015e000 2023-11-26T07:12:30.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.562+0000 7f47ce7fc700 1 -- 172.21.15.2:0/303057524 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c0011990 con 0x7f47d015e000 2023-11-26T07:12:30.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.562+0000 7f47ce7fc700 1 -- 172.21.15.2:0/303057524 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c0011d20 con 0x7f47d015e000 2023-11-26T07:12:30.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.562+0000 7f47d617b700 1 -- 172.21.15.2:0/303057524 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47d015e000 msgr2=0x7f47d006eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:30.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.562+0000 7f47d617b700 1 --2- 172.21.15.2:0/303057524 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47d015e000 0x7f47d006eef0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f47c00098f0 tx=0x7f47c0009c00 comp rx=0 tx=0).stop 2023-11-26T07:12:30.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.562+0000 7f47d617b700 1 -- 172.21.15.2:0/303057524 shutdown_connections 2023-11-26T07:12:30.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.562+0000 7f47d617b700 1 --2- 172.21.15.2:0/303057524 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47d015e000 0x7f47d006eef0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:30.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.562+0000 7f47d617b700 1 --2- 172.21.15.2:0/303057524 >> v2:172.21.15.192:3300/0 conn(0x7f47d00d0ae0 0x7f47d006f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:30.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.562+0000 7f47d617b700 1 -- 172.21.15.2:0/303057524 >> 172.21.15.2:0/303057524 conn(0x7f47d00b3720 msgr2=0x7f47d00b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:30.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.562+0000 7f47d617b700 1 -- 172.21.15.2:0/303057524 shutdown_connections 2023-11-26T07:12:30.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.562+0000 7f47d617b700 1 -- 172.21.15.2:0/303057524 wait complete. 2023-11-26T07:12:30.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.563+0000 7f47d617b700 1 Processor -- start 2023-11-26T07:12:30.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.564+0000 7f47d617b700 1 -- start start 2023-11-26T07:12:30.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.564+0000 7f47d617b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47d00d0ae0 0x7f47d01566e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:30.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.564+0000 7f47d617b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47d00d0f60 0x7f47d0152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:30.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.564+0000 7f47d617b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47d015e000 0x7f47d00b4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:30.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.564+0000 7f47d617b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d015fde0 con 0x7f47d015e000 2023-11-26T07:12:30.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.564+0000 7f47d617b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d00b5ba0 con 0x7f47d00d0ae0 2023-11-26T07:12:30.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.564+0000 7f47d617b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d0156c20 con 0x7f47d00d0f60 2023-11-26T07:12:30.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.565+0000 7f47cffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47d015e000 0x7f47d00b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:30.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.565+0000 7f47cffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47d015e000 0x7f47d00b4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40816/0 (socket says 172.21.15.2:40816) 2023-11-26T07:12:30.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.565+0000 7f47cffff700 1 -- 172.21.15.2:0/3086033349 learned_addr learned my addr 172.21.15.2:0/3086033349 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:30.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.565+0000 7f47cf7fe700 1 --2- 172.21.15.2:0/3086033349 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47d00d0ae0 0x7f47d01566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:30.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.565+0000 7f47ceffd700 1 --2- 172.21.15.2:0/3086033349 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47d00d0f60 0x7f47d0152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:30.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.565+0000 7f47cffff700 1 -- 172.21.15.2:0/3086033349 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47d00d0f60 msgr2=0x7f47d0152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:30.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.565+0000 7f47cffff700 1 --2- 172.21.15.2:0/3086033349 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47d00d0f60 0x7f47d0152c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:30.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.565+0000 7f47cffff700 1 -- 172.21.15.2:0/3086033349 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47d00d0ae0 msgr2=0x7f47d01566e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:30.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.565+0000 7f47cffff700 1 --2- 172.21.15.2:0/3086033349 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47d00d0ae0 0x7f47d01566e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:30.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.565+0000 7f47cffff700 1 -- 172.21.15.2:0/3086033349 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b80094a0 con 0x7f47d015e000 2023-11-26T07:12:30.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.565+0000 7f47cffff700 1 --2- 172.21.15.2:0/3086033349 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47d015e000 0x7f47d00b4810 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f47c800cbc0 tx=0x7f47c800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:30.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.565+0000 7f47c7fff700 1 -- 172.21.15.2:0/3086033349 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c800a9e0 con 0x7f47d015e000 2023-11-26T07:12:30.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.565+0000 7f47c7fff700 1 -- 172.21.15.2:0/3086033349 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c800ab40 con 0x7f47d015e000 2023-11-26T07:12:30.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.565+0000 7f47d617b700 1 -- 172.21.15.2:0/3086033349 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47c0009550 con 0x7f47d015e000 2023-11-26T07:12:30.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.565+0000 7f47c7fff700 1 -- 172.21.15.2:0/3086033349 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c8007070 con 0x7f47d015e000 2023-11-26T07:12:30.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.565+0000 7f47d617b700 1 -- 172.21.15.2:0/3086033349 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47d0156250 con 0x7f47d015e000 2023-11-26T07:12:30.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.566+0000 7f47d617b700 1 -- 172.21.15.2:0/3086033349 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47d0068670 con 0x7f47d015e000 2023-11-26T07:12:30.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.567+0000 7f47c7fff700 1 -- 172.21.15.2:0/3086033349 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f47c80071d0 con 0x7f47d015e000 2023-11-26T07:12:30.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.567+0000 7f47c7fff700 1 --2- 172.21.15.2:0/3086033349 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f47b006aed0 0x7f47b006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:30.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.567+0000 7f47c7fff700 1 -- 172.21.15.2:0/3086033349 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f47c8089140 con 0x7f47d015e000 2023-11-26T07:12:30.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.567+0000 7f47cf7fe700 1 --2- 172.21.15.2:0/3086033349 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f47b006aed0 0x7f47b006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:30.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.568+0000 7f47cf7fe700 1 --2- 172.21.15.2:0/3086033349 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f47b006aed0 0x7f47b006d390 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f47c0009840 tx=0x7f47c001d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:30.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.572+0000 7f47c7fff700 1 -- 172.21.15.2:0/3086033349 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f47c8054210 con 0x7f47d015e000 2023-11-26T07:12:30.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.774+0000 7f47d617b700 1 -- 172.21.15.2:0/3086033349 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47d015db40 con 0x7f47d015e000 2023-11-26T07:12:30.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.775+0000 7f47c7fff700 1 -- 172.21.15.2:0/3086033349 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16534 (secure 0 0 0) 0x7f47c8057830 con 0x7f47d015e000 2023-11-26T07:12:30.777 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:12:30.778 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":31,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:12:29.802072+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:12:27.898687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-26T07:12:28.763512+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:12:30.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.777+0000 7f47d617b700 1 -- 172.21.15.2:0/3086033349 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f47b006aed0 msgr2=0x7f47b006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:30.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.777+0000 7f47d617b700 1 --2- 172.21.15.2:0/3086033349 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f47b006aed0 0x7f47b006d390 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f47c0009840 tx=0x7f47c001d040 comp rx=0 tx=0).stop 2023-11-26T07:12:30.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.777+0000 7f47d617b700 1 -- 172.21.15.2:0/3086033349 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47d015e000 msgr2=0x7f47d00b4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:30.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.777+0000 7f47d617b700 1 --2- 172.21.15.2:0/3086033349 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47d015e000 0x7f47d00b4810 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f47c800cbc0 tx=0x7f47c800ced0 comp rx=0 tx=0).stop 2023-11-26T07:12:30.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.777+0000 7f47d617b700 1 -- 172.21.15.2:0/3086033349 shutdown_connections 2023-11-26T07:12:30.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.777+0000 7f47d617b700 1 --2- 172.21.15.2:0/3086033349 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f47b006aed0 0x7f47b006d390 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:30.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.777+0000 7f47d617b700 1 --2- 172.21.15.2:0/3086033349 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47d015e000 0x7f47d00b4810 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:30.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.777+0000 7f47d617b700 1 --2- 172.21.15.2:0/3086033349 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47d00d0ae0 0x7f47d01566e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:30.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.777+0000 7f47d617b700 1 --2- 172.21.15.2:0/3086033349 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47d00d0f60 0x7f47d0152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:30.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.777+0000 7f47d617b700 1 -- 172.21.15.2:0/3086033349 >> 172.21.15.2:0/3086033349 conn(0x7f47d00b3720 msgr2=0x7f47d006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:30.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.778+0000 7f47d617b700 1 -- 172.21.15.2:0/3086033349 shutdown_connections 2023-11-26T07:12:30.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.778+0000 7f47d617b700 1 -- 172.21.15.2:0/3086033349 wait complete. 2023-11-26T07:12:30.792 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:12:30.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.915+0000 7fd927b8c700 1 Processor -- start 2023-11-26T07:12:30.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.915+0000 7fd927b8c700 1 -- start start 2023-11-26T07:12:30.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.916+0000 7fd927b8c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd92015bde0 0x7fd92015c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:30.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.916+0000 7fd927b8c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd9200cf2b0 0x7fd9200d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:30.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.916+0000 7fd927b8c700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9200d0a90 con 0x7fd9200ce5c0 2023-11-26T07:12:30.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.916+0000 7fd927b8c700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd92006ee10 con 0x7fd9200cf2b0 2023-11-26T07:12:30.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.916+0000 7fd927b8c700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd92006f0f0 con 0x7fd92015bde0 2023-11-26T07:12:30.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.916+0000 7fd925127700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd9200cf2b0 0x7fd9200d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:30.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.916+0000 7fd925127700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd9200cf2b0 0x7fd9200d01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40822/0 (socket says 172.21.15.2:40822) 2023-11-26T07:12:30.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.916+0000 7fd925127700 1 -- 172.21.15.2:0/3146438134 learned_addr learned my addr 172.21.15.2:0/3146438134 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:30.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.916+0000 7fd925928700 1 --2- 172.21.15.2:0/3146438134 >> v2:172.21.15.192:3300/0 conn(0x7fd92015bde0 0x7fd92015c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:30.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.916+0000 7fd925127700 1 -- 172.21.15.2:0/3146438134 >> v2:172.21.15.192:3300/0 conn(0x7fd92015bde0 msgr2=0x7fd92015c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:30.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.916+0000 7fd925127700 1 --2- 172.21.15.2:0/3146438134 >> v2:172.21.15.192:3300/0 conn(0x7fd92015bde0 0x7fd92015c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:30.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.916+0000 7fd925127700 1 -- 172.21.15.2:0/3146438134 >> v1:172.21.15.192:6789/0 conn(0x7fd9200ce5c0 legacy=0x7fd9200cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:30.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.916+0000 7fd925127700 1 -- 172.21.15.2:0/3146438134 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd92006f3d0 con 0x7fd9200cf2b0 2023-11-26T07:12:30.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.917+0000 7fd925127700 1 --2- 172.21.15.2:0/3146438134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9200cf2b0 0x7fd9200d01b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd920072370 tx=0x7fd91c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc8b2febd9c50085 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:30.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.917+0000 7fd924926700 1 -- 172.21.15.2:0/3146438134 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91c004230 con 0x7fd9200cf2b0 2023-11-26T07:12:30.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.917+0000 7fd924926700 1 -- 172.21.15.2:0/3146438134 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd91c004390 con 0x7fd9200cf2b0 2023-11-26T07:12:30.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.917+0000 7fd924926700 1 -- 172.21.15.2:0/3146438134 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91c0036a0 con 0x7fd9200cf2b0 2023-11-26T07:12:30.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.917+0000 7fd927b8c700 1 -- 172.21.15.2:0/3146438134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9200cf2b0 msgr2=0x7fd9200d01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:30.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.917+0000 7fd927b8c700 1 --2- 172.21.15.2:0/3146438134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9200cf2b0 0x7fd9200d01b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd920072370 tx=0x7fd91c009bd0 comp rx=0 tx=0).stop 2023-11-26T07:12:30.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.917+0000 7fd927b8c700 1 -- 172.21.15.2:0/3146438134 shutdown_connections 2023-11-26T07:12:30.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.917+0000 7fd927b8c700 1 --2- 172.21.15.2:0/3146438134 >> v2:172.21.15.192:3300/0 conn(0x7fd92015bde0 0x7fd92015c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:30.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.917+0000 7fd927b8c700 1 --2- 172.21.15.2:0/3146438134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9200cf2b0 0x7fd9200d01b0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:30.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.917+0000 7fd927b8c700 1 -- 172.21.15.2:0/3146438134 >> 172.21.15.2:0/3146438134 conn(0x7fd9200b3720 msgr2=0x7fd9200b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:30.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.917+0000 7fd927b8c700 1 -- 172.21.15.2:0/3146438134 shutdown_connections 2023-11-26T07:12:30.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.917+0000 7fd927b8c700 1 -- 172.21.15.2:0/3146438134 wait complete. 2023-11-26T07:12:30.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.919+0000 7fd927b8c700 1 Processor -- start 2023-11-26T07:12:30.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.919+0000 7fd927b8c700 1 -- start start 2023-11-26T07:12:30.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.919+0000 7fd927b8c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9200ce5c0 0x7fd92015d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:30.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.919+0000 7fd927b8c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9200cf2b0 0x7fd92015d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:30.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.919+0000 7fd927b8c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd92015bde0 0x7fd9201f0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:30.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.919+0000 7fd927b8c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd92015e0b0 con 0x7fd9200ce5c0 2023-11-26T07:12:30.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.919+0000 7fd927b8c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd92015e390 con 0x7fd92015bde0 2023-11-26T07:12:30.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.919+0000 7fd927b8c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd92015e670 con 0x7fd9200cf2b0 2023-11-26T07:12:30.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.919+0000 7fd925928700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9200ce5c0 0x7fd92015d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:30.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.919+0000 7fd925928700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9200ce5c0 0x7fd92015d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40826/0 (socket says 172.21.15.2:40826) 2023-11-26T07:12:30.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.919+0000 7fd925928700 1 -- 172.21.15.2:0/3690605004 learned_addr learned my addr 172.21.15.2:0/3690605004 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:30.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.920+0000 7fd925127700 1 --2- 172.21.15.2:0/3690605004 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9200cf2b0 0x7fd92015d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:30.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.920+0000 7fd926129700 1 --2- 172.21.15.2:0/3690605004 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd92015bde0 0x7fd9201f0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:30.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.920+0000 7fd925928700 1 -- 172.21.15.2:0/3690605004 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9200cf2b0 msgr2=0x7fd92015d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:30.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.920+0000 7fd925928700 1 --2- 172.21.15.2:0/3690605004 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9200cf2b0 0x7fd92015d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:30.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.920+0000 7fd925928700 1 -- 172.21.15.2:0/3690605004 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd92015bde0 msgr2=0x7fd9201f0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:30.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.920+0000 7fd925928700 1 --2- 172.21.15.2:0/3690605004 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd92015bde0 0x7fd9201f0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:30.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.920+0000 7fd925928700 1 -- 172.21.15.2:0/3690605004 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd91c009550 con 0x7fd9200ce5c0 2023-11-26T07:12:30.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.920+0000 7fd925928700 1 --2- 172.21.15.2:0/3690605004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9200ce5c0 0x7fd92015d480 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd91000c7f0 tx=0x7fd91000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:30.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.920+0000 7fd9167fc700 1 -- 172.21.15.2:0/3690605004 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd910011800 con 0x7fd9200ce5c0 2023-11-26T07:12:30.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.920+0000 7fd9167fc700 1 -- 172.21.15.2:0/3690605004 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd910011960 con 0x7fd9200ce5c0 2023-11-26T07:12:30.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.920+0000 7fd9167fc700 1 -- 172.21.15.2:0/3690605004 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd910011cf0 con 0x7fd9200ce5c0 2023-11-26T07:12:30.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.920+0000 7fd927b8c700 1 -- 172.21.15.2:0/3690605004 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd92015e950 con 0x7fd9200ce5c0 2023-11-26T07:12:30.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.920+0000 7fd927b8c700 1 -- 172.21.15.2:0/3690605004 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9201f0ea0 con 0x7fd9200ce5c0 2023-11-26T07:12:30.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.921+0000 7fd927b8c700 1 -- 172.21.15.2:0/3690605004 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd92014ae00 con 0x7fd9200ce5c0 2023-11-26T07:12:30.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.921+0000 7fd9167fc700 1 -- 172.21.15.2:0/3690605004 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd910018360 con 0x7fd9200ce5c0 2023-11-26T07:12:30.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.922+0000 7fd9167fc700 1 --2- 172.21.15.2:0/3690605004 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd90406aed0 0x7fd90406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:30.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.922+0000 7fd9167fc700 1 -- 172.21.15.2:0/3690605004 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd910089460 con 0x7fd9200ce5c0 2023-11-26T07:12:30.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.922+0000 7fd925127700 1 --2- 172.21.15.2:0/3690605004 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd90406aed0 0x7fd90406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:30.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.922+0000 7fd925127700 1 --2- 172.21.15.2:0/3690605004 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd90406aed0 0x7fd90406d390 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd920072370 tx=0x7fd91c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:30.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:30.926+0000 7fd9167fc700 1 -- 172.21.15.2:0/3690605004 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd9100545a0 con 0x7fd9200ce5c0 2023-11-26T07:12:31.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.127+0000 7fd927b8c700 1 -- 172.21.15.2:0/3690605004 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd92014abf0 con 0x7fd9200ce5c0 2023-11-26T07:12:31.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.128+0000 7fd9167fc700 1 -- 172.21.15.2:0/3690605004 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16534 (secure 0 0 0) 0x7fd910057bc0 con 0x7fd9200ce5c0 2023-11-26T07:12:31.131 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:12:31.131 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":31,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:12:29.802072+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:12:27.898687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-26T07:12:28.763512+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:12:31.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.130+0000 7fd927b8c700 1 -- 172.21.15.2:0/3690605004 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd90406aed0 msgr2=0x7fd90406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:31.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.130+0000 7fd927b8c700 1 --2- 172.21.15.2:0/3690605004 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd90406aed0 0x7fd90406d390 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd920072370 tx=0x7fd91c008030 comp rx=0 tx=0).stop 2023-11-26T07:12:31.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.131+0000 7fd927b8c700 1 -- 172.21.15.2:0/3690605004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9200ce5c0 msgr2=0x7fd92015d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:31.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.131+0000 7fd927b8c700 1 --2- 172.21.15.2:0/3690605004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9200ce5c0 0x7fd92015d480 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd91000c7f0 tx=0x7fd91000cbb0 comp rx=0 tx=0).stop 2023-11-26T07:12:31.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.131+0000 7fd927b8c700 1 -- 172.21.15.2:0/3690605004 shutdown_connections 2023-11-26T07:12:31.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.131+0000 7fd927b8c700 1 --2- 172.21.15.2:0/3690605004 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd90406aed0 0x7fd90406d390 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:31.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.131+0000 7fd927b8c700 1 --2- 172.21.15.2:0/3690605004 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd92015bde0 0x7fd9201f0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:31.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.131+0000 7fd927b8c700 1 --2- 172.21.15.2:0/3690605004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9200ce5c0 0x7fd92015d480 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:31.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.131+0000 7fd927b8c700 1 --2- 172.21.15.2:0/3690605004 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9200cf2b0 0x7fd92015d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:31.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.131+0000 7fd927b8c700 1 -- 172.21.15.2:0/3690605004 >> 172.21.15.2:0/3690605004 conn(0x7fd9200b3720 msgr2=0x7fd9200cacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:31.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.131+0000 7fd927b8c700 1 -- 172.21.15.2:0/3690605004 shutdown_connections 2023-11-26T07:12:31.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.131+0000 7fd927b8c700 1 -- 172.21.15.2:0/3690605004 wait complete. 2023-11-26T07:12:31.145 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-26T07:12:31.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.271+0000 7f6dd1f30700 1 Processor -- start 2023-11-26T07:12:31.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.271+0000 7f6dd1f30700 1 -- start start 2023-11-26T07:12:31.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.272+0000 7f6dd1f30700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6dcc15add0 0x7f6dcc0b4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:31.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.272+0000 7f6dd1f30700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dcc0ce5b0 con 0x7f6dcc0b3ab0 2023-11-26T07:12:31.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.272+0000 7f6dd1f30700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dcc072d70 con 0x7f6dcc06f540 2023-11-26T07:12:31.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.272+0000 7f6dd1f30700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc0b4f10 con 0x7f6dcc15add0 2023-11-26T07:12:31.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.272+0000 7f6dcaffd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f6dcc0b3ab0 0x7f6dcc06ee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60278/0 (socket says 172.21.15.2:60278) 2023-11-26T07:12:31.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.272+0000 7f6dcaffd700 1 -- 172.21.15.2:0/4119615009 learned_addr learned my addr 172.21.15.2:0/4119615009 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:31.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.273+0000 7f6dcb7fe700 1 --2- 172.21.15.2:0/4119615009 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6dcc15add0 0x7f6dcc0b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:31.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.273+0000 7f6dca7fc700 1 -- 172.21.15.2:0/4119615009 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 779040352 0 0) 0x7f6dcc0ce5b0 con 0x7f6dcc0b3ab0 2023-11-26T07:12:31.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.273+0000 7f6dca7fc700 1 -- 172.21.15.2:0/4119615009 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6db40035b0 con 0x7f6dcc0b3ab0 2023-11-26T07:12:31.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.273+0000 7f6dca7fc700 1 -- 172.21.15.2:0/4119615009 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1236398170 0 0) 0x7f6db40035b0 con 0x7f6dcc0b3ab0 2023-11-26T07:12:31.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.273+0000 7f6dca7fc700 1 -- 172.21.15.2:0/4119615009 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6dcc15add0 msgr2=0x7f6dcc0b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:31.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.273+0000 7f6dca7fc700 1 --2- 172.21.15.2:0/4119615009 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6dcc15add0 0x7f6dcc0b4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:31.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.273+0000 7f6dca7fc700 1 -- 172.21.15.2:0/4119615009 >> v1:172.21.15.192:6789/0 conn(0x7f6dcc06f540 legacy=0x7f6dcc0cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:31.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.273+0000 7f6dca7fc700 1 -- 172.21.15.2:0/4119615009 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dcc0b51f0 con 0x7f6dcc0b3ab0 2023-11-26T07:12:31.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.273+0000 7f6dca7fc700 1 -- 172.21.15.2:0/4119615009 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f6dc0001670 con 0x7f6dcc0b3ab0 2023-11-26T07:12:31.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.273+0000 7f6dca7fc700 1 -- 172.21.15.2:0/4119615009 >> v1:172.21.15.2:6789/0 conn(0x7f6dcc0b3ab0 legacy=0x7f6dcc06ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:31.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.273+0000 7f6dca7fc700 1 --2- 172.21.15.2:0/4119615009 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db4003a30 0x7f6db4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:31.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.273+0000 7f6dca7fc700 1 --2- 172.21.15.2:0/4119615009 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6db40043e0 0x7f6db40048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:31.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.273+0000 7f6dca7fc700 1 --2- 172.21.15.2:0/4119615009 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6dcc15add0 0x7f6db40051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:31.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.273+0000 7f6dca7fc700 1 -- 172.21.15.2:0/4119615009 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc0b4f10 con 0x7f6db4003a30 2023-11-26T07:12:31.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.273+0000 7f6dca7fc700 1 -- 172.21.15.2:0/4119615009 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db400bac0 con 0x7f6db40043e0 2023-11-26T07:12:31.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.273+0000 7f6dca7fc700 1 -- 172.21.15.2:0/4119615009 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db400de90 con 0x7f6dcc15add0 2023-11-26T07:12:31.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.273+0000 7f6dcb7fe700 1 --2- 172.21.15.2:0/4119615009 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db4003a30 0x7f6db4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:31.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.273+0000 7f6dcbfff700 1 --2- 172.21.15.2:0/4119615009 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6dcc15add0 0x7f6db40051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:31.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.273+0000 7f6dcaffd700 1 --2- 172.21.15.2:0/4119615009 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6db40043e0 0x7f6db40048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:31.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.273+0000 7f6dcb7fe700 1 -- 172.21.15.2:0/4119615009 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6dcc15add0 msgr2=0x7f6db40051b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:31.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.273+0000 7f6dcb7fe700 1 --2- 172.21.15.2:0/4119615009 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6dcc15add0 0x7f6db40051b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:31.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.273+0000 7f6dcb7fe700 1 -- 172.21.15.2:0/4119615009 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6db40043e0 msgr2=0x7f6db40048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:31.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.273+0000 7f6dcb7fe700 1 --2- 172.21.15.2:0/4119615009 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6db40043e0 0x7f6db40048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:31.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.273+0000 7f6dcb7fe700 1 -- 172.21.15.2:0/4119615009 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db40035b0 con 0x7f6db4003a30 2023-11-26T07:12:31.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.274+0000 7f6dcb7fe700 1 --2- 172.21.15.2:0/4119615009 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db4003a30 0x7f6db4003e10 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc009b60 tx=0x7f6db4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52552aa9e174ae31 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:31.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.274+0000 7f6dca7fc700 1 -- 172.21.15.2:0/4119615009 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc00e6c0 con 0x7f6db4003a30 2023-11-26T07:12:31.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.274+0000 7f6dca7fc700 1 -- 172.21.15.2:0/4119615009 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dbc00e820 con 0x7f6db4003a30 2023-11-26T07:12:31.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.274+0000 7f6dca7fc700 1 -- 172.21.15.2:0/4119615009 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc00eb90 con 0x7f6db4003a30 2023-11-26T07:12:31.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.274+0000 7f6dd1f30700 1 -- 172.21.15.2:0/4119615009 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db4003a30 msgr2=0x7f6db4003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:31.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.274+0000 7f6dd1f30700 1 --2- 172.21.15.2:0/4119615009 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db4003a30 0x7f6db4003e10 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc009b60 tx=0x7f6db4005880 comp rx=0 tx=0).stop 2023-11-26T07:12:31.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.274+0000 7f6dcbfff700 1 -- 172.21.15.2:0/4119615009 reap_dead start 2023-11-26T07:12:31.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.274+0000 7f6dd1f30700 1 -- 172.21.15.2:0/4119615009 shutdown_connections 2023-11-26T07:12:31.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.274+0000 7f6dd1f30700 1 -- 172.21.15.2:0/4119615009 >> 172.21.15.2:0/4119615009 conn(0x7f6dcc0b27b0 msgr2=0x7f6dcc0b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:31.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.274+0000 7f6dd1f30700 1 -- 172.21.15.2:0/4119615009 shutdown_connections 2023-11-26T07:12:31.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.274+0000 7f6dd1f30700 1 -- 172.21.15.2:0/4119615009 wait complete. 2023-11-26T07:12:31.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.276+0000 7f6dd1f30700 1 Processor -- start 2023-11-26T07:12:31.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.276+0000 7f6dd1f30700 1 -- start start 2023-11-26T07:12:31.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.276+0000 7f6dd1f30700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db4003a30 0x7f6dcc14c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:31.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.276+0000 7f6dd1f30700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6dcc15b590 0x7f6dcc0ce940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:31.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.277+0000 7f6dd1f30700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6dcc15ba10 0x7f6dcc0cee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:31.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.277+0000 7f6dd1f30700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc1f48a0 con 0x7f6db4003a30 2023-11-26T07:12:31.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.277+0000 7f6dd1f30700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc1f3960 con 0x7f6dcc15ba10 2023-11-26T07:12:31.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.277+0000 7f6dd1f30700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc1f3c20 con 0x7f6dcc15b590 2023-11-26T07:12:31.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.277+0000 7f6dcb7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db4003a30 0x7f6dcc14c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:31.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.277+0000 7f6dcb7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db4003a30 0x7f6dcc14c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40846/0 (socket says 172.21.15.2:40846) 2023-11-26T07:12:31.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.277+0000 7f6dcb7fe700 1 -- 172.21.15.2:0/2517964142 learned_addr learned my addr 172.21.15.2:0/2517964142 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:31.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.277+0000 7f6dcaffd700 1 --2- 172.21.15.2:0/2517964142 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6dcc15b590 0x7f6dcc0ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:31.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.277+0000 7f6dcbfff700 1 --2- 172.21.15.2:0/2517964142 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6dcc15ba10 0x7f6dcc0cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:31.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.277+0000 7f6dcb7fe700 1 -- 172.21.15.2:0/2517964142 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6dcc15b590 msgr2=0x7f6dcc0ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:31.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.277+0000 7f6dcb7fe700 1 --2- 172.21.15.2:0/2517964142 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6dcc15b590 0x7f6dcc0ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:31.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.277+0000 7f6dcb7fe700 1 -- 172.21.15.2:0/2517964142 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6dcc15ba10 msgr2=0x7f6dcc0cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:31.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.277+0000 7f6dcb7fe700 1 --2- 172.21.15.2:0/2517964142 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6dcc15ba10 0x7f6dcc0cee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:31.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.277+0000 7f6dcb7fe700 1 -- 172.21.15.2:0/2517964142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dcc1f3f00 con 0x7f6db4003a30 2023-11-26T07:12:31.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.277+0000 7f6dcb7fe700 1 --2- 172.21.15.2:0/2517964142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db4003a30 0x7f6dcc14c610 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6db4005810 tx=0x7f6dbc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:31.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.277+0000 7f6db3fff700 1 -- 172.21.15.2:0/2517964142 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc00e6c0 con 0x7f6db4003a30 2023-11-26T07:12:31.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.277+0000 7f6db3fff700 1 -- 172.21.15.2:0/2517964142 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dbc0038a0 con 0x7f6db4003a30 2023-11-26T07:12:31.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.277+0000 7f6dd1f30700 1 -- 172.21.15.2:0/2517964142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dcc1f41e0 con 0x7f6db4003a30 2023-11-26T07:12:31.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.277+0000 7f6db3fff700 1 -- 172.21.15.2:0/2517964142 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc003c50 con 0x7f6db4003a30 2023-11-26T07:12:31.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.277+0000 7f6dd1f30700 1 -- 172.21.15.2:0/2517964142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dcc14cb50 con 0x7f6db4003a30 2023-11-26T07:12:31.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.278+0000 7f6dd1f30700 1 -- 172.21.15.2:0/2517964142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dcc075480 con 0x7f6db4003a30 2023-11-26T07:12:31.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.280+0000 7f6db3fff700 1 -- 172.21.15.2:0/2517964142 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6dbc013470 con 0x7f6db4003a30 2023-11-26T07:12:31.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.280+0000 7f6db3fff700 1 --2- 172.21.15.2:0/2517964142 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6db806aed0 0x7f6db806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:31.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.280+0000 7f6db3fff700 1 -- 172.21.15.2:0/2517964142 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6dbc08b2b0 con 0x7f6db4003a30 2023-11-26T07:12:31.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.281+0000 7f6dcaffd700 1 --2- 172.21.15.2:0/2517964142 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6db806aed0 0x7f6db806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:31.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.281+0000 7f6dcaffd700 1 --2- 172.21.15.2:0/2517964142 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6db806aed0 0x7f6db806d390 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc159940 tx=0x7f6dc0000fa0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:31.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.284+0000 7f6db3fff700 1 -- 172.21.15.2:0/2517964142 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6dbc0564f0 con 0x7f6db4003a30 2023-11-26T07:12:31.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:31.537+0000 7f6dd1f30700 1 -- 172.21.15.2:0/2517964142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f6dcc06bc30 con 0x7f6db4003a30 2023-11-26T07:12:32.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.402+0000 7f6db3fff700 1 -- 172.21.15.2:0/2517964142 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6dbc059b10 con 0x7f6db4003a30 2023-11-26T07:12:32.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.406+0000 7f6dd1f30700 1 -- 172.21.15.2:0/2517964142 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6db806aed0 msgr2=0x7f6db806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:32.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.406+0000 7f6dd1f30700 1 --2- 172.21.15.2:0/2517964142 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6db806aed0 0x7f6db806d390 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc159940 tx=0x7f6dc0000fa0 comp rx=0 tx=0).stop 2023-11-26T07:12:32.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.406+0000 7f6dd1f30700 1 -- 172.21.15.2:0/2517964142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db4003a30 msgr2=0x7f6dcc14c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:32.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.406+0000 7f6dd1f30700 1 --2- 172.21.15.2:0/2517964142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db4003a30 0x7f6dcc14c610 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6db4005810 tx=0x7f6dbc0047c0 comp rx=0 tx=0).stop 2023-11-26T07:12:32.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.406+0000 7f6dd1f30700 1 -- 172.21.15.2:0/2517964142 shutdown_connections 2023-11-26T07:12:32.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.406+0000 7f6dd1f30700 1 --2- 172.21.15.2:0/2517964142 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6db806aed0 0x7f6db806d390 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:32.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.406+0000 7f6dd1f30700 1 --2- 172.21.15.2:0/2517964142 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6dcc15ba10 0x7f6dcc0cee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:32.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.406+0000 7f6dd1f30700 1 --2- 172.21.15.2:0/2517964142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db4003a30 0x7f6dcc14c610 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:32.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.406+0000 7f6dd1f30700 1 --2- 172.21.15.2:0/2517964142 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6dcc15b590 0x7f6dcc0ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:32.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.406+0000 7f6dd1f30700 1 -- 172.21.15.2:0/2517964142 >> 172.21.15.2:0/2517964142 conn(0x7f6dcc0b27b0 msgr2=0x7f6dcc0cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:32.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.406+0000 7f6dd1f30700 1 -- 172.21.15.2:0/2517964142 shutdown_connections 2023-11-26T07:12:32.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.406+0000 7f6dd1f30700 1 -- 172.21.15.2:0/2517964142 wait complete. 2023-11-26T07:12:32.425 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-26T07:12:32.426 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-26T07:12:32.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.562+0000 7f6c5c10e700 1 Processor -- start 2023-11-26T07:12:32.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.562+0000 7f6c5c10e700 1 -- start start 2023-11-26T07:12:32.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.563+0000 7f6c5c10e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6c540d1100 0x7f6c5415e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:32.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.563+0000 7f6c5c10e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6c5406f700 0x7f6c5415ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:32.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.563+0000 7f6c5c10e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c5406e9d0 con 0x7f6c54144610 2023-11-26T07:12:32.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.563+0000 7f6c5c10e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c5406f270 con 0x7f6c540d1100 2023-11-26T07:12:32.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.563+0000 7f6c5c10e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c541449f0 con 0x7f6c5406f700 2023-11-26T07:12:32.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.563+0000 7f6c59eaa700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f6c54144610 0x7f6c540d09f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60296/0 (socket says 172.21.15.2:60296) 2023-11-26T07:12:32.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.563+0000 7f6c59eaa700 1 -- 172.21.15.2:0/3379153379 learned_addr learned my addr 172.21.15.2:0/3379153379 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:32.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.564+0000 7f6c596a9700 1 --2- 172.21.15.2:0/3379153379 >> v2:172.21.15.192:3300/0 conn(0x7f6c540d1100 0x7f6c5415e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:32.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.564+0000 7f6c5a6ab700 1 --2- 172.21.15.2:0/3379153379 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6c5406f700 0x7f6c5415ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:32.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.564+0000 7f6c58ea8700 1 -- 172.21.15.2:0/3379153379 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2793321403 0 0) 0x7f6c5406e9d0 con 0x7f6c54144610 2023-11-26T07:12:32.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.564+0000 7f6c58ea8700 1 -- 172.21.15.2:0/3379153379 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c400035b0 con 0x7f6c54144610 2023-11-26T07:12:32.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.564+0000 7f6c58ea8700 1 -- 172.21.15.2:0/3379153379 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1332075510 0 0) 0x7f6c400035b0 con 0x7f6c54144610 2023-11-26T07:12:32.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.564+0000 7f6c58ea8700 1 -- 172.21.15.2:0/3379153379 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6c5406f700 msgr2=0x7f6c5415ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:32.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.564+0000 7f6c58ea8700 1 --2- 172.21.15.2:0/3379153379 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6c5406f700 0x7f6c5415ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:32.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.564+0000 7f6c58ea8700 1 -- 172.21.15.2:0/3379153379 >> v2:172.21.15.192:3300/0 conn(0x7f6c540d1100 msgr2=0x7f6c5415e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:32.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.564+0000 7f6c58ea8700 1 --2- 172.21.15.2:0/3379153379 >> v2:172.21.15.192:3300/0 conn(0x7f6c540d1100 0x7f6c5415e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:32.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.564+0000 7f6c58ea8700 1 -- 172.21.15.2:0/3379153379 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c5415f530 con 0x7f6c54144610 2023-11-26T07:12:32.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.564+0000 7f6c58ea8700 1 -- 172.21.15.2:0/3379153379 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f6c44001670 con 0x7f6c54144610 2023-11-26T07:12:32.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.564+0000 7f6c58ea8700 1 -- 172.21.15.2:0/3379153379 >> v1:172.21.15.2:6789/0 conn(0x7f6c54144610 legacy=0x7f6c540d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:32.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.564+0000 7f6c58ea8700 1 --2- 172.21.15.2:0/3379153379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c40003a00 0x7f6c40003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:32.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.564+0000 7f6c58ea8700 1 --2- 172.21.15.2:0/3379153379 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6c5406f700 0x7f6c40004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:32.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.564+0000 7f6c58ea8700 1 --2- 172.21.15.2:0/3379153379 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6c40004d90 0x7f6c40005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:32.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.564+0000 7f6c58ea8700 1 -- 172.21.15.2:0/3379153379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5406f270 con 0x7f6c40003a00 2023-11-26T07:12:32.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.564+0000 7f6c58ea8700 1 -- 172.21.15.2:0/3379153379 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c541449f0 con 0x7f6c40004d90 2023-11-26T07:12:32.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.564+0000 7f6c58ea8700 1 -- 172.21.15.2:0/3379153379 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4000ba90 con 0x7f6c5406f700 2023-11-26T07:12:32.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.564+0000 7f6c59eaa700 1 --2- 172.21.15.2:0/3379153379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c40003a00 0x7f6c40003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:32.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.564+0000 7f6c596a9700 1 --2- 172.21.15.2:0/3379153379 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6c5406f700 0x7f6c40004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:32.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.564+0000 7f6c5a6ab700 1 --2- 172.21.15.2:0/3379153379 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6c40004d90 0x7f6c40005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:32.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.564+0000 7f6c59eaa700 1 -- 172.21.15.2:0/3379153379 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6c5406f700 msgr2=0x7f6c40004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:32.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.564+0000 7f6c59eaa700 1 --2- 172.21.15.2:0/3379153379 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6c5406f700 0x7f6c40004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:32.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.564+0000 7f6c59eaa700 1 -- 172.21.15.2:0/3379153379 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6c40004d90 msgr2=0x7f6c40005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:32.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.564+0000 7f6c59eaa700 1 --2- 172.21.15.2:0/3379153379 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6c40004d90 0x7f6c40005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:32.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.564+0000 7f6c59eaa700 1 -- 172.21.15.2:0/3379153379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c400035b0 con 0x7f6c40003a00 2023-11-26T07:12:32.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.564+0000 7f6c596a9700 1 --2- 172.21.15.2:0/3379153379 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6c5406f700 0x7f6c40004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:32.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.565+0000 7f6c59eaa700 1 --2- 172.21.15.2:0/3379153379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c40003a00 0x7f6c40003e20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6c4400c2f0 tx=0x7f6c40005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96a5913d4530da59 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:32.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.565+0000 7f6c58ea8700 1 -- 172.21.15.2:0/3379153379 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c44007c40 con 0x7f6c40003a00 2023-11-26T07:12:32.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.565+0000 7f6c58ea8700 1 -- 172.21.15.2:0/3379153379 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4400ce30 con 0x7f6c40003a00 2023-11-26T07:12:32.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.565+0000 7f6c58ea8700 1 -- 172.21.15.2:0/3379153379 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c44005ba0 con 0x7f6c40003a00 2023-11-26T07:12:32.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.565+0000 7f6c5c10e700 1 -- 172.21.15.2:0/3379153379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c40003a00 msgr2=0x7f6c40003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:32.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.565+0000 7f6c5c10e700 1 --2- 172.21.15.2:0/3379153379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c40003a00 0x7f6c40003e20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6c4400c2f0 tx=0x7f6c40005880 comp rx=0 tx=0).stop 2023-11-26T07:12:32.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.565+0000 7f6c5a6ab700 1 -- 172.21.15.2:0/3379153379 reap_dead start 2023-11-26T07:12:32.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.565+0000 7f6c5c10e700 1 -- 172.21.15.2:0/3379153379 shutdown_connections 2023-11-26T07:12:32.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.565+0000 7f6c5c10e700 1 -- 172.21.15.2:0/3379153379 >> 172.21.15.2:0/3379153379 conn(0x7f6c540b2740 msgr2=0x7f6c540b2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:32.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.565+0000 7f6c5c10e700 1 -- 172.21.15.2:0/3379153379 shutdown_connections 2023-11-26T07:12:32.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.565+0000 7f6c5c10e700 1 -- 172.21.15.2:0/3379153379 wait complete. 2023-11-26T07:12:32.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.567+0000 7f6c5c10e700 1 Processor -- start 2023-11-26T07:12:32.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.567+0000 7f6c5c10e700 1 -- start start 2023-11-26T07:12:32.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.567+0000 7f6c5c10e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6c40003a00 0x7f6c540aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:32.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.567+0000 7f6c5c10e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6c54140e00 0x7f6c5415c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:32.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.567+0000 7f6c5c10e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c54141260 0x7f6c5415cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:32.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.567+0000 7f6c5c10e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c540adc40 con 0x7f6c54141260 2023-11-26T07:12:32.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.567+0000 7f6c5c10e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c540adf20 con 0x7f6c54140e00 2023-11-26T07:12:32.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.567+0000 7f6c5c10e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c540ae200 con 0x7f6c40003a00 2023-11-26T07:12:32.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.568+0000 7f6c5a6ab700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c54141260 0x7f6c5415cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:32.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.568+0000 7f6c59eaa700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6c40003a00 0x7f6c540aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:32.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.568+0000 7f6c5a6ab700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c54141260 0x7f6c5415cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40870/0 (socket says 172.21.15.2:40870) 2023-11-26T07:12:32.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.568+0000 7f6c5a6ab700 1 -- 172.21.15.2:0/755163477 learned_addr learned my addr 172.21.15.2:0/755163477 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:32.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.568+0000 7f6c596a9700 1 --2- 172.21.15.2:0/755163477 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6c54140e00 0x7f6c5415c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:32.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.568+0000 7f6c5a6ab700 1 -- 172.21.15.2:0/755163477 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6c40003a00 msgr2=0x7f6c540aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:32.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.568+0000 7f6c5a6ab700 1 --2- 172.21.15.2:0/755163477 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6c40003a00 0x7f6c540aece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:32.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.568+0000 7f6c5a6ab700 1 -- 172.21.15.2:0/755163477 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6c54140e00 msgr2=0x7f6c5415c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:32.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.568+0000 7f6c5a6ab700 1 --2- 172.21.15.2:0/755163477 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6c54140e00 0x7f6c5415c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:32.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.568+0000 7f6c5a6ab700 1 -- 172.21.15.2:0/755163477 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c540ae4e0 con 0x7f6c54141260 2023-11-26T07:12:32.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.568+0000 7f6c5a6ab700 1 --2- 172.21.15.2:0/755163477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c54141260 0x7f6c5415cbb0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6c5406e920 tx=0x7f6c4c0111d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:32.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.568+0000 7f6c4a7fc700 1 -- 172.21.15.2:0/755163477 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c00e070 con 0x7f6c54141260 2023-11-26T07:12:32.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.568+0000 7f6c4a7fc700 1 -- 172.21.15.2:0/755163477 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4c003cf0 con 0x7f6c54141260 2023-11-26T07:12:32.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.568+0000 7f6c5c10e700 1 -- 172.21.15.2:0/755163477 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c540ae7c0 con 0x7f6c54141260 2023-11-26T07:12:32.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.568+0000 7f6c4a7fc700 1 -- 172.21.15.2:0/755163477 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c0117a0 con 0x7f6c54141260 2023-11-26T07:12:32.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.568+0000 7f6c5c10e700 1 -- 172.21.15.2:0/755163477 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c5415d0f0 con 0x7f6c54141260 2023-11-26T07:12:32.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.569+0000 7f6c5c10e700 1 -- 172.21.15.2:0/755163477 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c54075480 con 0x7f6c54141260 2023-11-26T07:12:32.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.570+0000 7f6c4a7fc700 1 -- 172.21.15.2:0/755163477 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6c4c011900 con 0x7f6c54141260 2023-11-26T07:12:32.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.570+0000 7f6c4a7fc700 1 --2- 172.21.15.2:0/755163477 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6c3806aed0 0x7f6c3806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:32.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.570+0000 7f6c4a7fc700 1 -- 172.21.15.2:0/755163477 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c4c089830 con 0x7f6c54141260 2023-11-26T07:12:32.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.570+0000 7f6c59eaa700 1 --2- 172.21.15.2:0/755163477 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6c3806aed0 0x7f6c3806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:32.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.571+0000 7f6c59eaa700 1 --2- 172.21.15.2:0/755163477 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6c3806aed0 0x7f6c3806d390 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6c44008fd0 tx=0x7f6c4400a000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:32.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.575+0000 7f6c4a7fc700 1 -- 172.21.15.2:0/755163477 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6c4c054970 con 0x7f6c54141260 2023-11-26T07:12:32.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:32.822+0000 7f6c5c10e700 1 -- 172.21.15.2:0/755163477 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6c5406e2a0 con 0x7f6c54141260 2023-11-26T07:12:33.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.403+0000 7f6c4a7fc700 1 -- 172.21.15.2:0/755163477 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6c4c057f90 con 0x7f6c54141260 2023-11-26T07:12:33.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.406+0000 7f6c5c10e700 1 -- 172.21.15.2:0/755163477 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6c3806aed0 msgr2=0x7f6c3806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:33.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.406+0000 7f6c5c10e700 1 --2- 172.21.15.2:0/755163477 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6c3806aed0 0x7f6c3806d390 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6c44008fd0 tx=0x7f6c4400a000 comp rx=0 tx=0).stop 2023-11-26T07:12:33.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.406+0000 7f6c5c10e700 1 -- 172.21.15.2:0/755163477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c54141260 msgr2=0x7f6c5415cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:33.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.406+0000 7f6c5c10e700 1 --2- 172.21.15.2:0/755163477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c54141260 0x7f6c5415cbb0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6c5406e920 tx=0x7f6c4c0111d0 comp rx=0 tx=0).stop 2023-11-26T07:12:33.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.406+0000 7f6c5c10e700 1 -- 172.21.15.2:0/755163477 shutdown_connections 2023-11-26T07:12:33.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.406+0000 7f6c5c10e700 1 --2- 172.21.15.2:0/755163477 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6c3806aed0 0x7f6c3806d390 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:33.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.406+0000 7f6c5c10e700 1 --2- 172.21.15.2:0/755163477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c54141260 0x7f6c5415cbb0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:33.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.406+0000 7f6c5c10e700 1 --2- 172.21.15.2:0/755163477 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6c40003a00 0x7f6c540aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:33.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.406+0000 7f6c5c10e700 1 --2- 172.21.15.2:0/755163477 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6c54140e00 0x7f6c5415c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:33.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.406+0000 7f6c5c10e700 1 -- 172.21.15.2:0/755163477 >> 172.21.15.2:0/755163477 conn(0x7f6c540b2740 msgr2=0x7f6c540cf470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:33.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.406+0000 7f6c5c10e700 1 -- 172.21.15.2:0/755163477 shutdown_connections 2023-11-26T07:12:33.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.406+0000 7f6c5c10e700 1 -- 172.21.15.2:0/755163477 wait complete. 2023-11-26T07:12:33.422 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-26T07:12:33.423 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:12:33.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.550+0000 7f27d053f700 1 Processor -- start 2023-11-26T07:12:33.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.550+0000 7f27d053f700 1 -- start start 2023-11-26T07:12:33.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.551+0000 7f27d053f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f27c815abb0 0x7f27c80b4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:33.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.551+0000 7f27d053f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f27c80724a0 0x7f27c80cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:33.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.551+0000 7f27d053f700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27c806e550 con 0x7f27c80b4d50 2023-11-26T07:12:33.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.551+0000 7f27d053f700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27c80b51d0 con 0x7f27c815abb0 2023-11-26T07:12:33.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.551+0000 7f27d053f700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27c806f3b0 con 0x7f27c80724a0 2023-11-26T07:12:33.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.552+0000 7f27ce2db700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f27c815abb0 0x7f27c80b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:33.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.552+0000 7f27cdada700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f27c80b4d50 0x7f27c8071d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60318/0 (socket says 172.21.15.2:60318) 2023-11-26T07:12:33.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.552+0000 7f27cdada700 1 -- 172.21.15.2:0/2362381936 learned_addr learned my addr 172.21.15.2:0/2362381936 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:33.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.552+0000 7f27ceadc700 1 --2- 172.21.15.2:0/2362381936 >> v2:172.21.15.192:3300/0 conn(0x7f27c80724a0 0x7f27c80cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:33.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.552+0000 7f27ce2db700 1 -- 172.21.15.2:0/2362381936 >> v2:172.21.15.192:3300/0 conn(0x7f27c80724a0 msgr2=0x7f27c80cdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:33.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.552+0000 7f27ce2db700 1 --2- 172.21.15.2:0/2362381936 >> v2:172.21.15.192:3300/0 conn(0x7f27c80724a0 0x7f27c80cdee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:33.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.552+0000 7f27ce2db700 1 -- 172.21.15.2:0/2362381936 >> v1:172.21.15.2:6789/0 conn(0x7f27c80b4d50 legacy=0x7f27c8071d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:33.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.552+0000 7f27ce2db700 1 -- 172.21.15.2:0/2362381936 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c806e7a0 con 0x7f27c815abb0 2023-11-26T07:12:33.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.552+0000 7f27ce2db700 1 --2- 172.21.15.2:0/2362381936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27c815abb0 0x7f27c80b4810 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f27c80d0990 tx=0x7f27c4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd1e8ab88bd437c8 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:33.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.552+0000 7f27cd2d9700 1 -- 172.21.15.2:0/2362381936 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c4011830 con 0x7f27c815abb0 2023-11-26T07:12:33.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.552+0000 7f27cd2d9700 1 -- 172.21.15.2:0/2362381936 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c4011990 con 0x7f27c815abb0 2023-11-26T07:12:33.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.552+0000 7f27cd2d9700 1 -- 172.21.15.2:0/2362381936 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c4011d20 con 0x7f27c815abb0 2023-11-26T07:12:33.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.553+0000 7f27d053f700 1 -- 172.21.15.2:0/2362381936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27c815abb0 msgr2=0x7f27c80b4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:33.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.553+0000 7f27d053f700 1 --2- 172.21.15.2:0/2362381936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27c815abb0 0x7f27c80b4810 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f27c80d0990 tx=0x7f27c4009b20 comp rx=0 tx=0).stop 2023-11-26T07:12:33.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.553+0000 7f27d053f700 1 -- 172.21.15.2:0/2362381936 shutdown_connections 2023-11-26T07:12:33.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.553+0000 7f27d053f700 1 --2- 172.21.15.2:0/2362381936 >> v2:172.21.15.192:3300/0 conn(0x7f27c80724a0 0x7f27c80cdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:33.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.553+0000 7f27d053f700 1 --2- 172.21.15.2:0/2362381936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27c815abb0 0x7f27c80b4810 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:33.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.553+0000 7f27d053f700 1 -- 172.21.15.2:0/2362381936 >> 172.21.15.2:0/2362381936 conn(0x7f27c80d0aa0 msgr2=0x7f27c80d0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:33.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.553+0000 7f27d053f700 1 -- 172.21.15.2:0/2362381936 shutdown_connections 2023-11-26T07:12:33.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.553+0000 7f27d053f700 1 -- 172.21.15.2:0/2362381936 wait complete. 2023-11-26T07:12:33.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.554+0000 7f27d053f700 1 Processor -- start 2023-11-26T07:12:33.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.554+0000 7f27d053f700 1 -- start start 2023-11-26T07:12:33.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.555+0000 7f27d053f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27c80724a0 0x7f27c81f68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:33.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.555+0000 7f27d053f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27c80b4d50 0x7f27c8159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:33.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.555+0000 7f27d053f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27c815abb0 0x7f27c8158b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:33.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.555+0000 7f27d053f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c80cfc30 con 0x7f27c815abb0 2023-11-26T07:12:33.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.555+0000 7f27d053f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c80cf020 con 0x7f27c80724a0 2023-11-26T07:12:33.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.555+0000 7f27d053f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27c80cf300 con 0x7f27c80b4d50 2023-11-26T07:12:33.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.555+0000 7f27ceadc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27c815abb0 0x7f27c8158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:33.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.555+0000 7f27ceadc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27c815abb0 0x7f27c8158b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40884/0 (socket says 172.21.15.2:40884) 2023-11-26T07:12:33.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.555+0000 7f27ceadc700 1 -- 172.21.15.2:0/2980268630 learned_addr learned my addr 172.21.15.2:0/2980268630 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:33.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.555+0000 7f27ce2db700 1 --2- 172.21.15.2:0/2980268630 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27c80724a0 0x7f27c81f68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:33.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.555+0000 7f27cdada700 1 --2- 172.21.15.2:0/2980268630 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27c80b4d50 0x7f27c8159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:33.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.555+0000 7f27ceadc700 1 -- 172.21.15.2:0/2980268630 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27c80b4d50 msgr2=0x7f27c8159bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:33.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.555+0000 7f27ceadc700 1 --2- 172.21.15.2:0/2980268630 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27c80b4d50 0x7f27c8159bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:33.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.555+0000 7f27ceadc700 1 -- 172.21.15.2:0/2980268630 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27c80724a0 msgr2=0x7f27c81f68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:33.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.555+0000 7f27ceadc700 1 --2- 172.21.15.2:0/2980268630 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27c80724a0 0x7f27c81f68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:33.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.555+0000 7f27ceadc700 1 -- 172.21.15.2:0/2980268630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c40094a0 con 0x7f27c815abb0 2023-11-26T07:12:33.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.555+0000 7f27cdada700 1 --2- 172.21.15.2:0/2980268630 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27c80b4d50 0x7f27c8159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:12:33.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.555+0000 7f27ceadc700 1 --2- 172.21.15.2:0/2980268630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27c815abb0 0x7f27c8158b10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f27c0007e40 tx=0x7f27c000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:33.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.556+0000 7f27baffd700 1 -- 172.21.15.2:0/2980268630 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c000eea0 con 0x7f27c815abb0 2023-11-26T07:12:33.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.556+0000 7f27baffd700 1 -- 172.21.15.2:0/2980268630 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c0014420 con 0x7f27c815abb0 2023-11-26T07:12:33.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.556+0000 7f27d053f700 1 -- 172.21.15.2:0/2980268630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27c80cf5e0 con 0x7f27c815abb0 2023-11-26T07:12:33.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.556+0000 7f27baffd700 1 -- 172.21.15.2:0/2980268630 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c00147b0 con 0x7f27c815abb0 2023-11-26T07:12:33.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.556+0000 7f27d053f700 1 -- 172.21.15.2:0/2980268630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27c81f6de0 con 0x7f27c815abb0 2023-11-26T07:12:33.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.557+0000 7f27d053f700 1 -- 172.21.15.2:0/2980268630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27c806f8d0 con 0x7f27c815abb0 2023-11-26T07:12:33.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.557+0000 7f27baffd700 1 -- 172.21.15.2:0/2980268630 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f27c0014910 con 0x7f27c815abb0 2023-11-26T07:12:33.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.557+0000 7f27baffd700 1 --2- 172.21.15.2:0/2980268630 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f27ac06aed0 0x7f27ac06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:33.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.558+0000 7f27baffd700 1 -- 172.21.15.2:0/2980268630 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27c0089e20 con 0x7f27c815abb0 2023-11-26T07:12:33.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.558+0000 7f27ce2db700 1 --2- 172.21.15.2:0/2980268630 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f27ac06aed0 0x7f27ac06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:33.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.558+0000 7f27ce2db700 1 --2- 172.21.15.2:0/2980268630 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f27ac06aed0 0x7f27ac06d390 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f27c40090b0 tx=0x7f27c401c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:33.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.562+0000 7f27baffd700 1 -- 172.21.15.2:0/2980268630 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f27c0054ed0 con 0x7f27c815abb0 2023-11-26T07:12:33.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.815+0000 7f27d053f700 1 -- 172.21.15.2:0/2980268630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f27c80b4b70 con 0x7f27c815abb0 2023-11-26T07:12:33.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.815+0000 7f27baffd700 1 -- 172.21.15.2:0/2980268630 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f27c00584f0 con 0x7f27c815abb0 2023-11-26T07:12:33.817 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:12:33.817 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4727,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3580414083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3580414083},{"type":"v1","addr":"172.21.15.192:6837","nonce":3580414083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4948,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/3401314194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3401314194},{"type":"v1","addr":"172.21.15.2:6834","nonce":3401314194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4954,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3579861389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3579861389},{"type":"v1","addr":"172.21.15.192:6836","nonce":3579861389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:12:29.802382+0000","modified":"2023-11-26T07:12:32.823481+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5046":{"gid":5046,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6835/3058610366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":3058610366},{"type":"v1","addr":"172.21.15.2:6835","nonce":3058610366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-26T07:12:33.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.817+0000 7f27d053f700 1 -- 172.21.15.2:0/2980268630 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f27ac06aed0 msgr2=0x7f27ac06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:33.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.817+0000 7f27d053f700 1 --2- 172.21.15.2:0/2980268630 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f27ac06aed0 0x7f27ac06d390 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f27c40090b0 tx=0x7f27c401c040 comp rx=0 tx=0).stop 2023-11-26T07:12:33.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.817+0000 7f27d053f700 1 -- 172.21.15.2:0/2980268630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27c815abb0 msgr2=0x7f27c8158b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:33.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.817+0000 7f27d053f700 1 --2- 172.21.15.2:0/2980268630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27c815abb0 0x7f27c8158b10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f27c0007e40 tx=0x7f27c000e3c0 comp rx=0 tx=0).stop 2023-11-26T07:12:33.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.817+0000 7f27d053f700 1 -- 172.21.15.2:0/2980268630 shutdown_connections 2023-11-26T07:12:33.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.817+0000 7f27d053f700 1 --2- 172.21.15.2:0/2980268630 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f27ac06aed0 0x7f27ac06d390 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:33.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.817+0000 7f27d053f700 1 --2- 172.21.15.2:0/2980268630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27c815abb0 0x7f27c8158b10 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:33.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.817+0000 7f27d053f700 1 --2- 172.21.15.2:0/2980268630 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27c80724a0 0x7f27c81f68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:33.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.817+0000 7f27d053f700 1 --2- 172.21.15.2:0/2980268630 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27c80b4d50 0x7f27c8159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:33.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.817+0000 7f27d053f700 1 -- 172.21.15.2:0/2980268630 >> 172.21.15.2:0/2980268630 conn(0x7f27c80d0aa0 msgr2=0x7f27c815d180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:33.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.818+0000 7f27d053f700 1 -- 172.21.15.2:0/2980268630 shutdown_connections 2023-11-26T07:12:33.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.818+0000 7f27d053f700 1 -- 172.21.15.2:0/2980268630 wait complete. 2023-11-26T07:12:33.821 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 16 2023-11-26T07:12:33.832 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:12:33.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.955+0000 7fb4df661700 1 Processor -- start 2023-11-26T07:12:33.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.955+0000 7fb4df661700 1 -- start start 2023-11-26T07:12:33.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.956+0000 7fb4df661700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb4d80b4f70 0x7fb4d806f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:33.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.956+0000 7fb4df661700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb4d8155300 0x7fb4d815e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:33.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.956+0000 7fb4df661700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4d815f5a0 con 0x7fb4d8154f20 2023-11-26T07:12:33.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.956+0000 7fb4df661700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4d806e7e0 con 0x7fb4d8155300 2023-11-26T07:12:33.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.956+0000 7fb4df661700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d806eac0 con 0x7fb4d80b4f70 2023-11-26T07:12:33.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.956+0000 7fb4ddbfe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb4d8155300 0x7fb4d815e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:33.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.956+0000 7fb4dd3fd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb4d8154f20 0x7fb4d80b4860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60330/0 (socket says 172.21.15.2:60330) 2023-11-26T07:12:33.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.956+0000 7fb4dd3fd700 1 -- 172.21.15.2:0/3791671947 learned_addr learned my addr 172.21.15.2:0/3791671947 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:33.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.956+0000 7fb4dcbfc700 1 --2- 172.21.15.2:0/3791671947 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb4d80b4f70 0x7fb4d806f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:33.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.956+0000 7fb4ddbfe700 1 -- 172.21.15.2:0/3791671947 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb4d80b4f70 msgr2=0x7fb4d806f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:33.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.956+0000 7fb4ddbfe700 1 --2- 172.21.15.2:0/3791671947 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb4d80b4f70 0x7fb4d806f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:33.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.956+0000 7fb4ddbfe700 1 -- 172.21.15.2:0/3791671947 >> v1:172.21.15.2:6789/0 conn(0x7fb4d8154f20 legacy=0x7fb4d80b4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:33.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.956+0000 7fb4ddbfe700 1 -- 172.21.15.2:0/3791671947 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d806eda0 con 0x7fb4d8155300 2023-11-26T07:12:33.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.956+0000 7fb4cffff700 1 -- 172.21.15.2:0/3791671947 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 991091264 0 0) 0x7fb4d815f5a0 con 0x7fb4d8154f20 2023-11-26T07:12:33.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.957+0000 7fb4ddbfe700 1 --2- 172.21.15.2:0/3791671947 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4d8155300 0x7fb4d815e830 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0009d90 tx=0x7fb4d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70987f8c955b7fda server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:33.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.957+0000 7fb4cffff700 1 -- 172.21.15.2:0/3791671947 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d000e070 con 0x7fb4d8155300 2023-11-26T07:12:33.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.957+0000 7fb4cffff700 1 -- 172.21.15.2:0/3791671947 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d000bbd0 con 0x7fb4d8155300 2023-11-26T07:12:33.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.957+0000 7fb4cffff700 1 -- 172.21.15.2:0/3791671947 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d0012430 con 0x7fb4d8155300 2023-11-26T07:12:33.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.957+0000 7fb4df661700 1 -- 172.21.15.2:0/3791671947 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4d8155300 msgr2=0x7fb4d815e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:33.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.957+0000 7fb4df661700 1 --2- 172.21.15.2:0/3791671947 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4d8155300 0x7fb4d815e830 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0009d90 tx=0x7fb4d000b330 comp rx=0 tx=0).stop 2023-11-26T07:12:33.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.957+0000 7fb4df661700 1 -- 172.21.15.2:0/3791671947 shutdown_connections 2023-11-26T07:12:33.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.957+0000 7fb4df661700 1 --2- 172.21.15.2:0/3791671947 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4d8155300 0x7fb4d815e830 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:33.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.957+0000 7fb4df661700 1 --2- 172.21.15.2:0/3791671947 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb4d80b4f70 0x7fb4d806f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:33.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.957+0000 7fb4df661700 1 -- 172.21.15.2:0/3791671947 >> 172.21.15.2:0/3791671947 conn(0x7fb4d806c0e0 msgr2=0x7fb4d806c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:33.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.957+0000 7fb4df661700 1 -- 172.21.15.2:0/3791671947 shutdown_connections 2023-11-26T07:12:33.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.958+0000 7fb4df661700 1 -- 172.21.15.2:0/3791671947 wait complete. 2023-11-26T07:12:33.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.959+0000 7fb4df661700 1 Processor -- start 2023-11-26T07:12:33.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.959+0000 7fb4df661700 1 -- start start 2023-11-26T07:12:33.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.960+0000 7fb4df661700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb4d80b4f70 0x7fb4d814c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:33.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.960+0000 7fb4df661700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4d8154f20 0x7fb4d8159640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:33.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.960+0000 7fb4df661700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4d8155300 0x7fb4d8159b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:33.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.960+0000 7fb4df661700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d8155d60 con 0x7fb4d8155300 2023-11-26T07:12:33.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.960+0000 7fb4df661700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d8155770 con 0x7fb4d8154f20 2023-11-26T07:12:33.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.960+0000 7fb4df661700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d814cae0 con 0x7fb4d80b4f70 2023-11-26T07:12:33.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.960+0000 7fb4ddbfe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4d8155300 0x7fb4d8159b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:33.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.960+0000 7fb4ddbfe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4d8155300 0x7fb4d8159b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40898/0 (socket says 172.21.15.2:40898) 2023-11-26T07:12:33.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.960+0000 7fb4ddbfe700 1 -- 172.21.15.2:0/1845000712 learned_addr learned my addr 172.21.15.2:0/1845000712 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:33.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.960+0000 7fb4dcbfc700 1 --2- 172.21.15.2:0/1845000712 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4d8154f20 0x7fb4d8159640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:33.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.960+0000 7fb4dd3fd700 1 --2- 172.21.15.2:0/1845000712 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb4d80b4f70 0x7fb4d814c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:33.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.961+0000 7fb4ddbfe700 1 -- 172.21.15.2:0/1845000712 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb4d80b4f70 msgr2=0x7fb4d814c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:33.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.961+0000 7fb4ddbfe700 1 --2- 172.21.15.2:0/1845000712 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb4d80b4f70 0x7fb4d814c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:33.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.961+0000 7fb4ddbfe700 1 -- 172.21.15.2:0/1845000712 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4d8154f20 msgr2=0x7fb4d8159640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:33.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.961+0000 7fb4ddbfe700 1 --2- 172.21.15.2:0/1845000712 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4d8154f20 0x7fb4d8159640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:33.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.961+0000 7fb4ddbfe700 1 -- 172.21.15.2:0/1845000712 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d0009a70 con 0x7fb4d8155300 2023-11-26T07:12:33.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.961+0000 7fb4ddbfe700 1 --2- 172.21.15.2:0/1845000712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4d8155300 0x7fb4d8159b80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8073050 tx=0x7fb4d0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:33.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.961+0000 7fb4cdffb700 1 -- 172.21.15.2:0/1845000712 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d0012430 con 0x7fb4d8155300 2023-11-26T07:12:33.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.961+0000 7fb4cdffb700 1 -- 172.21.15.2:0/1845000712 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d0020070 con 0x7fb4d8155300 2023-11-26T07:12:33.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.961+0000 7fb4df661700 1 -- 172.21.15.2:0/1845000712 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4d80d03a0 con 0x7fb4d8155300 2023-11-26T07:12:33.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.961+0000 7fb4cdffb700 1 -- 172.21.15.2:0/1845000712 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d0004280 con 0x7fb4d8155300 2023-11-26T07:12:33.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.961+0000 7fb4df661700 1 -- 172.21.15.2:0/1845000712 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4d815a4c0 con 0x7fb4d8155300 2023-11-26T07:12:33.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.962+0000 7fb4df661700 1 -- 172.21.15.2:0/1845000712 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4d8155ea0 con 0x7fb4d8155300 2023-11-26T07:12:33.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.962+0000 7fb4cdffb700 1 -- 172.21.15.2:0/1845000712 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb4d00043e0 con 0x7fb4d8155300 2023-11-26T07:12:33.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.963+0000 7fb4cdffb700 1 --2- 172.21.15.2:0/1845000712 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb4bc06aed0 0x7fb4bc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:33.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.963+0000 7fb4cdffb700 1 -- 172.21.15.2:0/1845000712 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4d0022070 con 0x7fb4d8155300 2023-11-26T07:12:33.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.963+0000 7fb4dd3fd700 1 --2- 172.21.15.2:0/1845000712 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb4bc06aed0 0x7fb4bc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:33.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.964+0000 7fb4dd3fd700 1 --2- 172.21.15.2:0/1845000712 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb4bc06aed0 0x7fb4bc06d390 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8000f60 tx=0x7fb4c8007be0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:33.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:33.967+0000 7fb4cdffb700 1 -- 172.21.15.2:0/1845000712 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb4d8155ea0 con 0x7fb4d8155300 2023-11-26T07:12:34.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.167+0000 7fb4df661700 1 -- 172.21.15.2:0/1845000712 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4d8155ea0 con 0x7fb4d8155300 2023-11-26T07:12:34.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.168+0000 7fb4cdffb700 1 -- 172.21.15.2:0/1845000712 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16521 (secure 0 0 0) 0x7fb4d8155ea0 con 0x7fb4d8155300 2023-11-26T07:12:34.170 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:12:34.171 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":32,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:12:31.382755+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:12:27.898687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-26T07:12:28.763512+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:12:34.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.171+0000 7fb4df661700 1 -- 172.21.15.2:0/1845000712 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb4bc06aed0 msgr2=0x7fb4bc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:34.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.171+0000 7fb4df661700 1 --2- 172.21.15.2:0/1845000712 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb4bc06aed0 0x7fb4bc06d390 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8000f60 tx=0x7fb4c8007be0 comp rx=0 tx=0).stop 2023-11-26T07:12:34.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.171+0000 7fb4df661700 1 -- 172.21.15.2:0/1845000712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4d8155300 msgr2=0x7fb4d8159b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:34.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.171+0000 7fb4df661700 1 --2- 172.21.15.2:0/1845000712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4d8155300 0x7fb4d8159b80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8073050 tx=0x7fb4d0004ad0 comp rx=0 tx=0).stop 2023-11-26T07:12:34.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.171+0000 7fb4df661700 1 -- 172.21.15.2:0/1845000712 shutdown_connections 2023-11-26T07:12:34.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.171+0000 7fb4df661700 1 --2- 172.21.15.2:0/1845000712 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb4bc06aed0 0x7fb4bc06d390 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:34.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.171+0000 7fb4df661700 1 --2- 172.21.15.2:0/1845000712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4d8155300 0x7fb4d8159b80 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:34.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.171+0000 7fb4df661700 1 --2- 172.21.15.2:0/1845000712 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb4d80b4f70 0x7fb4d814c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:34.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.171+0000 7fb4df661700 1 --2- 172.21.15.2:0/1845000712 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4d8154f20 0x7fb4d8159640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:34.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.171+0000 7fb4df661700 1 -- 172.21.15.2:0/1845000712 >> 172.21.15.2:0/1845000712 conn(0x7fb4d806c0e0 msgr2=0x7fb4d814e800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:34.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.171+0000 7fb4df661700 1 -- 172.21.15.2:0/1845000712 shutdown_connections 2023-11-26T07:12:34.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.171+0000 7fb4df661700 1 -- 172.21.15.2:0/1845000712 wait complete. 2023-11-26T07:12:34.185 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-26T07:12:34.185 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:12:34.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.308+0000 7f5409db8700 1 Processor -- start 2023-11-26T07:12:34.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.308+0000 7f5409db8700 1 -- start start 2023-11-26T07:12:34.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.309+0000 7f5409db8700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f54040b5e40 0x7f5404165b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:34.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.309+0000 7f5409db8700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54040b0ec0 con 0x7f540415ae00 2023-11-26T07:12:34.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.309+0000 7f5409db8700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54040b62f0 con 0x7f54040b03b0 2023-11-26T07:12:34.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.309+0000 7f5409db8700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5404073610 con 0x7f54040b5e40 2023-11-26T07:12:34.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.309+0000 7f5403fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f54040b5e40 0x7f5404165b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:34.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.309+0000 7f54037fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f540415ae00 0x7f54040ad690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60344/0 (socket says 172.21.15.2:60344) 2023-11-26T07:12:34.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.309+0000 7f54037fe700 1 -- 172.21.15.2:0/1243416261 learned_addr learned my addr 172.21.15.2:0/1243416261 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:34.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.309+0000 7f54027fc700 1 -- 172.21.15.2:0/1243416261 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2993390822 0 0) 0x7f54040b0ec0 con 0x7f540415ae00 2023-11-26T07:12:34.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.309+0000 7f54027fc700 1 -- 172.21.15.2:0/1243416261 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53f00035b0 con 0x7f540415ae00 2023-11-26T07:12:34.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.309+0000 7f5403fff700 1 -- 172.21.15.2:0/1243416261 >> v1:172.21.15.192:6789/0 conn(0x7f54040b03b0 legacy=0x7f54040adda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:34.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.309+0000 7f5403fff700 1 -- 172.21.15.2:0/1243416261 >> v1:172.21.15.2:6789/0 conn(0x7f540415ae00 legacy=0x7f54040ad690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:34.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.309+0000 7f5403fff700 1 -- 172.21.15.2:0/1243416261 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54040b0900 con 0x7f54040b5e40 2023-11-26T07:12:34.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.310+0000 7f5403fff700 1 --2- 172.21.15.2:0/1243416261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54040b5e40 0x7f5404165b80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f53fc009d90 tx=0x7f53fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=707efefd8133296a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:34.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.310+0000 7f54027fc700 1 -- 172.21.15.2:0/1243416261 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc00e070 con 0x7f54040b5e40 2023-11-26T07:12:34.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.310+0000 7f54027fc700 1 -- 172.21.15.2:0/1243416261 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53fc00bb20 con 0x7f54040b5e40 2023-11-26T07:12:34.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.310+0000 7f54027fc700 1 -- 172.21.15.2:0/1243416261 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc012430 con 0x7f54040b5e40 2023-11-26T07:12:34.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.310+0000 7f5409db8700 1 -- 172.21.15.2:0/1243416261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54040b5e40 msgr2=0x7f5404165b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:34.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.310+0000 7f5409db8700 1 --2- 172.21.15.2:0/1243416261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54040b5e40 0x7f5404165b80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f53fc009d90 tx=0x7f53fc00b330 comp rx=0 tx=0).stop 2023-11-26T07:12:34.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.310+0000 7f5409db8700 1 -- 172.21.15.2:0/1243416261 shutdown_connections 2023-11-26T07:12:34.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.310+0000 7f5409db8700 1 --2- 172.21.15.2:0/1243416261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54040b5e40 0x7f5404165b80 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:34.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.310+0000 7f5409db8700 1 -- 172.21.15.2:0/1243416261 >> 172.21.15.2:0/1243416261 conn(0x7f54040b5070 msgr2=0x7f54040b5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:34.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.310+0000 7f5409db8700 1 -- 172.21.15.2:0/1243416261 shutdown_connections 2023-11-26T07:12:34.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.310+0000 7f5409db8700 1 -- 172.21.15.2:0/1243416261 wait complete. 2023-11-26T07:12:34.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.311+0000 7f5409db8700 1 Processor -- start 2023-11-26T07:12:34.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.312+0000 7f5409db8700 1 -- start start 2023-11-26T07:12:34.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.312+0000 7f5409db8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54040b03b0 0x7f540414eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:34.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.312+0000 7f5409db8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54040b5e40 0x7f540415da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.312+0000 7f5409db8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f540415ae00 0x7f54041f3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.312+0000 7f5409db8700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540414dcf0 con 0x7f540415ae00 2023-11-26T07:12:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.312+0000 7f5409db8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540414d3c0 con 0x7f54040b03b0 2023-11-26T07:12:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.312+0000 7f5409db8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f540414d6a0 con 0x7f54040b5e40 2023-11-26T07:12:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.312+0000 7f5403fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f540415ae00 0x7f54041f3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.313+0000 7f5403fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f540415ae00 0x7f54041f3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40912/0 (socket says 172.21.15.2:40912) 2023-11-26T07:12:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.313+0000 7f5403fff700 1 -- 172.21.15.2:0/4292103413 learned_addr learned my addr 172.21.15.2:0/4292103413 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.313+0000 7f54037fe700 1 --2- 172.21.15.2:0/4292103413 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54040b03b0 0x7f540414eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.313+0000 7f5402ffd700 1 --2- 172.21.15.2:0/4292103413 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54040b5e40 0x7f540415da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.313+0000 7f5403fff700 1 -- 172.21.15.2:0/4292103413 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54040b5e40 msgr2=0x7f540415da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.313+0000 7f5403fff700 1 --2- 172.21.15.2:0/4292103413 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54040b5e40 0x7f540415da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.313+0000 7f5403fff700 1 -- 172.21.15.2:0/4292103413 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54040b03b0 msgr2=0x7f540414eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.313+0000 7f5403fff700 1 --2- 172.21.15.2:0/4292103413 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54040b03b0 0x7f540414eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.313+0000 7f5403fff700 1 -- 172.21.15.2:0/4292103413 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53fc009a70 con 0x7f540415ae00 2023-11-26T07:12:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.313+0000 7f54037fe700 1 --2- 172.21.15.2:0/4292103413 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54040b03b0 0x7f540414eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.313+0000 7f5403fff700 1 --2- 172.21.15.2:0/4292103413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f540415ae00 0x7f54041f3340 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f540406fc30 tx=0x7f53fc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.313+0000 7f53fbfff700 1 -- 172.21.15.2:0/4292103413 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc012430 con 0x7f540415ae00 2023-11-26T07:12:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.313+0000 7f53fbfff700 1 -- 172.21.15.2:0/4292103413 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53fc020070 con 0x7f540415ae00 2023-11-26T07:12:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.313+0000 7f5409db8700 1 -- 172.21.15.2:0/4292103413 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f540414d980 con 0x7f540415ae00 2023-11-26T07:12:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.313+0000 7f53fbfff700 1 -- 172.21.15.2:0/4292103413 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc004280 con 0x7f540415ae00 2023-11-26T07:12:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.313+0000 7f5409db8700 1 -- 172.21.15.2:0/4292103413 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54041f3880 con 0x7f540415ae00 2023-11-26T07:12:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.314+0000 7f5409db8700 1 -- 172.21.15.2:0/4292103413 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f540414dea0 con 0x7f540415ae00 2023-11-26T07:12:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.315+0000 7f53fbfff700 1 -- 172.21.15.2:0/4292103413 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f53fc0043e0 con 0x7f540415ae00 2023-11-26T07:12:34.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.315+0000 7f53fbfff700 1 --2- 172.21.15.2:0/4292103413 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f53e406aed0 0x7f53e406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:34.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.315+0000 7f53fbfff700 1 -- 172.21.15.2:0/4292103413 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f53fc022070 con 0x7f540415ae00 2023-11-26T07:12:34.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.315+0000 7f54037fe700 1 --2- 172.21.15.2:0/4292103413 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f53e406aed0 0x7f53e406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:34.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.316+0000 7f54037fe700 1 --2- 172.21.15.2:0/4292103413 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f53e406aed0 0x7f53e406d390 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f53f40011e0 tx=0x7f53f4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:34.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.319+0000 7f53fbfff700 1 -- 172.21.15.2:0/4292103413 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f540414dea0 con 0x7f540415ae00 2023-11-26T07:12:34.362 INFO:tasks.ceph.mds.a.smithi002.stderr:2023-11-26T07:12:34.361+0000 7ff21608d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-26T07:12:34.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.519+0000 7f5409db8700 1 -- 172.21.15.2:0/4292103413 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f54041f3aa0 con 0x7f53e406aed0 2023-11-26T07:12:34.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.529+0000 7f53fbfff700 1 -- 172.21.15.2:0/4292103413 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289563 (secure 0 0 0) 0x7f54041f3aa0 con 0x7f53e406aed0 2023-11-26T07:12:34.534 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:12:34.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.532+0000 7f5409db8700 1 -- 172.21.15.2:0/4292103413 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f53e406aed0 msgr2=0x7f53e406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:34.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.532+0000 7f5409db8700 1 --2- 172.21.15.2:0/4292103413 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f53e406aed0 0x7f53e406d390 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f53f40011e0 tx=0x7f53f4009040 comp rx=0 tx=0).stop 2023-11-26T07:12:34.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.532+0000 7f5409db8700 1 -- 172.21.15.2:0/4292103413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f540415ae00 msgr2=0x7f54041f3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:34.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.532+0000 7f5409db8700 1 --2- 172.21.15.2:0/4292103413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f540415ae00 0x7f54041f3340 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f540406fc30 tx=0x7f53fc004ad0 comp rx=0 tx=0).stop 2023-11-26T07:12:34.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.532+0000 7f5409db8700 1 -- 172.21.15.2:0/4292103413 shutdown_connections 2023-11-26T07:12:34.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.532+0000 7f5409db8700 1 --2- 172.21.15.2:0/4292103413 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f53e406aed0 0x7f53e406d390 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:34.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.532+0000 7f5409db8700 1 --2- 172.21.15.2:0/4292103413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f540415ae00 0x7f54041f3340 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:34.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.532+0000 7f5409db8700 1 --2- 172.21.15.2:0/4292103413 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54040b03b0 0x7f540414eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:34.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.532+0000 7f5409db8700 1 --2- 172.21.15.2:0/4292103413 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54040b5e40 0x7f540415da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:34.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.532+0000 7f5409db8700 1 -- 172.21.15.2:0/4292103413 >> 172.21.15.2:0/4292103413 conn(0x7f54040b5070 msgr2=0x7f54040b1f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:34.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.532+0000 7f5409db8700 1 -- 172.21.15.2:0/4292103413 shutdown_connections 2023-11-26T07:12:34.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.532+0000 7f5409db8700 1 -- 172.21.15.2:0/4292103413 wait complete. 2023-11-26T07:12:34.537 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-26T07:12:34.546 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2023-11-26T07:12:34.166905+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":131,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220180,"kb_used_data":3980,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754540,"statfs":{"total":773094113280,"available":772868648960,"internally_reserved":0,"allocated":4075520,"data_stored":2264240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.801493"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.661595+0000","last_change":"2023-11-26T07:12:30.412545+0000","last_active":"2023-11-26T07:12:31.661595+0000","last_peered":"2023-11-26T07:12:31.661595+0000","last_clean":"2023-11-26T07:12:31.661595+0000","last_became_active":"2023-11-26T07:12:30.412231+0000","last_became_peered":"2023-11-26T07:12:30.412231+0000","last_unstale":"2023-11-26T07:12:31.661595+0000","last_undegraded":"2023-11-26T07:12:31.661595+0000","last_fullsized":"2023-11-26T07:12:31.661595+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:46:50.072348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.386661+0000","last_change":"2023-11-26T07:12:30.404293+0000","last_active":"2023-11-26T07:12:31.386661+0000","last_peered":"2023-11-26T07:12:31.386661+0000","last_clean":"2023-11-26T07:12:31.386661+0000","last_became_active":"2023-11-26T07:12:30.401872+0000","last_became_peered":"2023-11-26T07:12:30.401872+0000","last_unstale":"2023-11-26T07:12:31.386661+0000","last_undegraded":"2023-11-26T07:12:31.386661+0000","last_fullsized":"2023-11-26T07:12:31.386661+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:06:22.102518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162308+0000","last_change":"2023-11-26T07:12:30.410519+0000","last_active":"2023-11-26T07:12:32.162308+0000","last_peered":"2023-11-26T07:12:32.162308+0000","last_clean":"2023-11-26T07:12:32.162308+0000","last_became_active":"2023-11-26T07:12:30.410227+0000","last_became_peered":"2023-11-26T07:12:30.410227+0000","last_unstale":"2023-11-26T07:12:32.162308+0000","last_undegraded":"2023-11-26T07:12:32.162308+0000","last_fullsized":"2023-11-26T07:12:32.162308+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:21:56.456451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.061866+0000","last_change":"2023-11-26T07:12:30.403758+0000","last_active":"2023-11-26T07:12:32.061866+0000","last_peered":"2023-11-26T07:12:32.061866+0000","last_clean":"2023-11-26T07:12:32.061866+0000","last_became_active":"2023-11-26T07:12:30.403457+0000","last_became_peered":"2023-11-26T07:12:30.403457+0000","last_unstale":"2023-11-26T07:12:32.061866+0000","last_undegraded":"2023-11-26T07:12:32.061866+0000","last_fullsized":"2023-11-26T07:12:32.061866+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:45:30.307834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162347+0000","last_change":"2023-11-26T07:12:30.403260+0000","last_active":"2023-11-26T07:12:32.162347+0000","last_peered":"2023-11-26T07:12:32.162347+0000","last_clean":"2023-11-26T07:12:32.162347+0000","last_became_active":"2023-11-26T07:12:30.402914+0000","last_became_peered":"2023-11-26T07:12:30.402914+0000","last_unstale":"2023-11-26T07:12:32.162347+0000","last_undegraded":"2023-11-26T07:12:32.162347+0000","last_fullsized":"2023-11-26T07:12:32.162347+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:42:35.346485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.386380+0000","last_change":"2023-11-26T07:12:30.405402+0000","last_active":"2023-11-26T07:12:31.386380+0000","last_peered":"2023-11-26T07:12:31.386380+0000","last_clean":"2023-11-26T07:12:31.386380+0000","last_became_active":"2023-11-26T07:12:30.405109+0000","last_became_peered":"2023-11-26T07:12:30.405109+0000","last_unstale":"2023-11-26T07:12:31.386380+0000","last_undegraded":"2023-11-26T07:12:31.386380+0000","last_fullsized":"2023-11-26T07:12:31.386380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:16:42.282322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.161647+0000","last_change":"2023-11-26T07:12:30.406676+0000","last_active":"2023-11-26T07:12:32.161647+0000","last_peered":"2023-11-26T07:12:32.161647+0000","last_clean":"2023-11-26T07:12:32.161647+0000","last_became_active":"2023-11-26T07:12:30.406337+0000","last_became_peered":"2023-11-26T07:12:30.406337+0000","last_unstale":"2023-11-26T07:12:32.161647+0000","last_undegraded":"2023-11-26T07:12:32.161647+0000","last_fullsized":"2023-11-26T07:12:32.161647+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:44:25.640038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.161481+0000","last_change":"2023-11-26T07:12:30.398600+0000","last_active":"2023-11-26T07:12:32.161481+0000","last_peered":"2023-11-26T07:12:32.161481+0000","last_clean":"2023-11-26T07:12:32.161481+0000","last_became_active":"2023-11-26T07:12:30.398336+0000","last_became_peered":"2023-11-26T07:12:30.398336+0000","last_unstale":"2023-11-26T07:12:32.161481+0000","last_undegraded":"2023-11-26T07:12:32.161481+0000","last_fullsized":"2023-11-26T07:12:32.161481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:16:08.184427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.389549+0000","last_change":"2023-11-26T07:12:30.410558+0000","last_active":"2023-11-26T07:12:31.389549+0000","last_peered":"2023-11-26T07:12:31.389549+0000","last_clean":"2023-11-26T07:12:31.389549+0000","last_became_active":"2023-11-26T07:12:30.410286+0000","last_became_peered":"2023-11-26T07:12:30.410286+0000","last_unstale":"2023-11-26T07:12:31.389549+0000","last_undegraded":"2023-11-26T07:12:31.389549+0000","last_fullsized":"2023-11-26T07:12:31.389549+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:46:10.899807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.062058+0000","last_change":"2023-11-26T07:12:30.403024+0000","last_active":"2023-11-26T07:12:32.062058+0000","last_peered":"2023-11-26T07:12:32.062058+0000","last_clean":"2023-11-26T07:12:32.062058+0000","last_became_active":"2023-11-26T07:12:30.402733+0000","last_became_peered":"2023-11-26T07:12:30.402733+0000","last_unstale":"2023-11-26T07:12:32.062058+0000","last_undegraded":"2023-11-26T07:12:32.062058+0000","last_fullsized":"2023-11-26T07:12:32.062058+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:16:08.184427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162061+0000","last_change":"2023-11-26T07:12:30.411540+0000","last_active":"2023-11-26T07:12:32.162061+0000","last_peered":"2023-11-26T07:12:32.162061+0000","last_clean":"2023-11-26T07:12:32.162061+0000","last_became_active":"2023-11-26T07:12:30.411263+0000","last_became_peered":"2023-11-26T07:12:30.411263+0000","last_unstale":"2023-11-26T07:12:32.162061+0000","last_undegraded":"2023-11-26T07:12:32.162061+0000","last_fullsized":"2023-11-26T07:12:32.162061+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:21:56.456451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162046+0000","last_change":"2023-11-26T07:12:30.398646+0000","last_active":"2023-11-26T07:12:32.162046+0000","last_peered":"2023-11-26T07:12:32.162046+0000","last_clean":"2023-11-26T07:12:32.162046+0000","last_became_active":"2023-11-26T07:12:30.398367+0000","last_became_peered":"2023-11-26T07:12:30.398367+0000","last_unstale":"2023-11-26T07:12:32.162046+0000","last_undegraded":"2023-11-26T07:12:32.162046+0000","last_fullsized":"2023-11-26T07:12:32.162046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:26:51.020116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162512+0000","last_change":"2023-11-26T07:12:30.412100+0000","last_active":"2023-11-26T07:12:32.162512+0000","last_peered":"2023-11-26T07:12:32.162512+0000","last_clean":"2023-11-26T07:12:32.162512+0000","last_became_active":"2023-11-26T07:12:30.411800+0000","last_became_peered":"2023-11-26T07:12:30.411800+0000","last_unstale":"2023-11-26T07:12:32.162512+0000","last_undegraded":"2023-11-26T07:12:32.162512+0000","last_fullsized":"2023-11-26T07:12:32.162512+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:16:15.547781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.386481+0000","last_change":"2023-11-26T07:12:30.408073+0000","last_active":"2023-11-26T07:12:31.386481+0000","last_peered":"2023-11-26T07:12:31.386481+0000","last_clean":"2023-11-26T07:12:31.386481+0000","last_became_active":"2023-11-26T07:12:30.407693+0000","last_became_peered":"2023-11-26T07:12:30.407693+0000","last_unstale":"2023-11-26T07:12:31.386481+0000","last_undegraded":"2023-11-26T07:12:31.386481+0000","last_fullsized":"2023-11-26T07:12:31.386481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:46:31.104505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.161748+0000","last_change":"2023-11-26T07:12:30.406400+0000","last_active":"2023-11-26T07:12:32.161748+0000","last_peered":"2023-11-26T07:12:32.161748+0000","last_clean":"2023-11-26T07:12:32.161748+0000","last_became_active":"2023-11-26T07:12:30.406111+0000","last_became_peered":"2023-11-26T07:12:30.406111+0000","last_unstale":"2023-11-26T07:12:32.161748+0000","last_undegraded":"2023-11-26T07:12:32.161748+0000","last_fullsized":"2023-11-26T07:12:32.161748+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:47:04.640542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162289+0000","last_change":"2023-11-26T07:12:30.408067+0000","last_active":"2023-11-26T07:12:32.162289+0000","last_peered":"2023-11-26T07:12:32.162289+0000","last_clean":"2023-11-26T07:12:32.162289+0000","last_became_active":"2023-11-26T07:12:30.407801+0000","last_became_peered":"2023-11-26T07:12:30.407801+0000","last_unstale":"2023-11-26T07:12:32.162289+0000","last_undegraded":"2023-11-26T07:12:32.162289+0000","last_fullsized":"2023-11-26T07:12:32.162289+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:20:46.702320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162189+0000","last_change":"2023-11-26T07:12:30.413105+0000","last_active":"2023-11-26T07:12:32.162189+0000","last_peered":"2023-11-26T07:12:32.162189+0000","last_clean":"2023-11-26T07:12:32.162189+0000","last_became_active":"2023-11-26T07:12:30.412803+0000","last_became_peered":"2023-11-26T07:12:30.412803+0000","last_unstale":"2023-11-26T07:12:32.162189+0000","last_undegraded":"2023-11-26T07:12:32.162189+0000","last_fullsized":"2023-11-26T07:12:32.162189+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:47:51.074571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.386647+0000","last_change":"2023-11-26T07:12:30.408671+0000","last_active":"2023-11-26T07:12:31.386647+0000","last_peered":"2023-11-26T07:12:31.386647+0000","last_clean":"2023-11-26T07:12:31.386647+0000","last_became_active":"2023-11-26T07:12:30.408358+0000","last_became_peered":"2023-11-26T07:12:30.408358+0000","last_unstale":"2023-11-26T07:12:31.386647+0000","last_undegraded":"2023-11-26T07:12:31.386647+0000","last_fullsized":"2023-11-26T07:12:31.386647+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:56:00.607416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.386118+0000","last_change":"2023-11-26T07:12:30.408486+0000","last_active":"2023-11-26T07:12:31.386118+0000","last_peered":"2023-11-26T07:12:31.386118+0000","last_clean":"2023-11-26T07:12:31.386118+0000","last_became_active":"2023-11-26T07:12:30.408176+0000","last_became_peered":"2023-11-26T07:12:30.408176+0000","last_unstale":"2023-11-26T07:12:31.386118+0000","last_undegraded":"2023-11-26T07:12:31.386118+0000","last_fullsized":"2023-11-26T07:12:31.386118+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:20:46.702320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162426+0000","last_change":"2023-11-26T07:12:30.401061+0000","last_active":"2023-11-26T07:12:32.162426+0000","last_peered":"2023-11-26T07:12:32.162426+0000","last_clean":"2023-11-26T07:12:32.162426+0000","last_became_active":"2023-11-26T07:12:30.400779+0000","last_became_peered":"2023-11-26T07:12:30.400779+0000","last_unstale":"2023-11-26T07:12:32.162426+0000","last_undegraded":"2023-11-26T07:12:32.162426+0000","last_fullsized":"2023-11-26T07:12:32.162426+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:35:06.908600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.389380+0000","last_change":"2023-11-26T07:12:30.400263+0000","last_active":"2023-11-26T07:12:31.389380+0000","last_peered":"2023-11-26T07:12:31.389380+0000","last_clean":"2023-11-26T07:12:31.389380+0000","last_became_active":"2023-11-26T07:12:30.399970+0000","last_became_peered":"2023-11-26T07:12:30.399970+0000","last_unstale":"2023-11-26T07:12:31.389380+0000","last_undegraded":"2023-11-26T07:12:31.389380+0000","last_fullsized":"2023-11-26T07:12:31.389380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:51:33.900805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.389202+0000","last_change":"2023-11-26T07:12:30.406947+0000","last_active":"2023-11-26T07:12:31.389202+0000","last_peered":"2023-11-26T07:12:31.389202+0000","last_clean":"2023-11-26T07:12:31.389202+0000","last_became_active":"2023-11-26T07:12:30.406661+0000","last_became_peered":"2023-11-26T07:12:30.406661+0000","last_unstale":"2023-11-26T07:12:31.389202+0000","last_undegraded":"2023-11-26T07:12:31.389202+0000","last_fullsized":"2023-11-26T07:12:31.389202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:46:50.072348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.161638+0000","last_change":"2023-11-26T07:12:30.393722+0000","last_active":"2023-11-26T07:12:32.161638+0000","last_peered":"2023-11-26T07:12:32.161638+0000","last_clean":"2023-11-26T07:12:32.161638+0000","last_became_active":"2023-11-26T07:12:30.393388+0000","last_became_peered":"2023-11-26T07:12:30.393388+0000","last_unstale":"2023-11-26T07:12:32.161638+0000","last_undegraded":"2023-11-26T07:12:32.161638+0000","last_fullsized":"2023-11-26T07:12:32.161638+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:43:20.223243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.161564+0000","last_change":"2023-11-26T07:12:30.398678+0000","last_active":"2023-11-26T07:12:32.161564+0000","last_peered":"2023-11-26T07:12:32.161564+0000","last_clean":"2023-11-26T07:12:32.161564+0000","last_became_active":"2023-11-26T07:12:30.398385+0000","last_became_peered":"2023-11-26T07:12:30.398385+0000","last_unstale":"2023-11-26T07:12:32.161564+0000","last_undegraded":"2023-11-26T07:12:32.161564+0000","last_fullsized":"2023-11-26T07:12:32.161564+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:17:30.745863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.062094+0000","last_change":"2023-11-26T07:12:30.402184+0000","last_active":"2023-11-26T07:12:32.062094+0000","last_peered":"2023-11-26T07:12:32.062094+0000","last_clean":"2023-11-26T07:12:32.062094+0000","last_became_active":"2023-11-26T07:12:30.401910+0000","last_became_peered":"2023-11-26T07:12:30.401910+0000","last_unstale":"2023-11-26T07:12:32.062094+0000","last_undegraded":"2023-11-26T07:12:32.062094+0000","last_fullsized":"2023-11-26T07:12:32.062094+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:44:25.640038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.386793+0000","last_change":"2023-11-26T07:12:30.396847+0000","last_active":"2023-11-26T07:12:31.386793+0000","last_peered":"2023-11-26T07:12:31.386793+0000","last_clean":"2023-11-26T07:12:31.386793+0000","last_became_active":"2023-11-26T07:12:30.396602+0000","last_became_peered":"2023-11-26T07:12:30.396602+0000","last_unstale":"2023-11-26T07:12:31.386793+0000","last_undegraded":"2023-11-26T07:12:31.386793+0000","last_fullsized":"2023-11-26T07:12:31.386793+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:37:22.724414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.062280+0000","last_change":"2023-11-26T07:12:30.405968+0000","last_active":"2023-11-26T07:12:32.062280+0000","last_peered":"2023-11-26T07:12:32.062280+0000","last_clean":"2023-11-26T07:12:32.062280+0000","last_became_active":"2023-11-26T07:12:30.405494+0000","last_became_peered":"2023-11-26T07:12:30.405494+0000","last_unstale":"2023-11-26T07:12:32.062280+0000","last_undegraded":"2023-11-26T07:12:32.062280+0000","last_fullsized":"2023-11-26T07:12:32.062280+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:47:04.640542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162131+0000","last_change":"2023-11-26T07:12:30.393339+0000","last_active":"2023-11-26T07:12:32.162131+0000","last_peered":"2023-11-26T07:12:32.162131+0000","last_clean":"2023-11-26T07:12:32.162131+0000","last_became_active":"2023-11-26T07:12:30.393039+0000","last_became_peered":"2023-11-26T07:12:30.393039+0000","last_unstale":"2023-11-26T07:12:32.162131+0000","last_undegraded":"2023-11-26T07:12:32.162131+0000","last_fullsized":"2023-11-26T07:12:32.162131+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:50:40.720534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.389565+0000","last_change":"2023-11-26T07:12:30.408964+0000","last_active":"2023-11-26T07:12:31.389565+0000","last_peered":"2023-11-26T07:12:31.389565+0000","last_clean":"2023-11-26T07:12:31.389565+0000","last_became_active":"2023-11-26T07:12:30.408631+0000","last_became_peered":"2023-11-26T07:12:30.408631+0000","last_unstale":"2023-11-26T07:12:31.389565+0000","last_undegraded":"2023-11-26T07:12:31.389565+0000","last_fullsized":"2023-11-26T07:12:31.389565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:45:30.307834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.161608+0000","last_change":"2023-11-26T07:12:30.406660+0000","last_active":"2023-11-26T07:12:32.161608+0000","last_peered":"2023-11-26T07:12:32.161608+0000","last_clean":"2023-11-26T07:12:32.161608+0000","last_became_active":"2023-11-26T07:12:30.406322+0000","last_became_peered":"2023-11-26T07:12:30.406322+0000","last_unstale":"2023-11-26T07:12:32.161608+0000","last_undegraded":"2023-11-26T07:12:32.161608+0000","last_fullsized":"2023-11-26T07:12:32.161608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:17:30.745863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.661146+0000","last_change":"2023-11-26T07:12:30.409687+0000","last_active":"2023-11-26T07:12:31.661146+0000","last_peered":"2023-11-26T07:12:31.661146+0000","last_clean":"2023-11-26T07:12:31.661146+0000","last_became_active":"2023-11-26T07:12:30.409357+0000","last_became_peered":"2023-11-26T07:12:30.409357+0000","last_unstale":"2023-11-26T07:12:31.661146+0000","last_undegraded":"2023-11-26T07:12:31.661146+0000","last_fullsized":"2023-11-26T07:12:31.661146+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:43:20.223243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162443+0000","last_change":"2023-11-26T07:12:30.404308+0000","last_active":"2023-11-26T07:12:32.162443+0000","last_peered":"2023-11-26T07:12:32.162443+0000","last_clean":"2023-11-26T07:12:32.162443+0000","last_became_active":"2023-11-26T07:12:30.403952+0000","last_became_peered":"2023-11-26T07:12:30.403952+0000","last_unstale":"2023-11-26T07:12:32.162443+0000","last_undegraded":"2023-11-26T07:12:32.162443+0000","last_fullsized":"2023-11-26T07:12:32.162443+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:10:28.618472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162098+0000","last_change":"2023-11-26T07:12:30.393700+0000","last_active":"2023-11-26T07:12:32.162098+0000","last_peered":"2023-11-26T07:12:32.162098+0000","last_clean":"2023-11-26T07:12:32.162098+0000","last_became_active":"2023-11-26T07:12:30.393423+0000","last_became_peered":"2023-11-26T07:12:30.393423+0000","last_unstale":"2023-11-26T07:12:32.162098+0000","last_undegraded":"2023-11-26T07:12:32.162098+0000","last_fullsized":"2023-11-26T07:12:32.162098+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:09:57.137824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.661263+0000","last_change":"2023-11-26T07:12:29.390023+0000","last_active":"2023-11-26T07:12:31.661263+0000","last_peered":"2023-11-26T07:12:31.661263+0000","last_clean":"2023-11-26T07:12:31.661263+0000","last_became_active":"2023-11-26T07:12:29.389838+0000","last_became_peered":"2023-11-26T07:12:29.389838+0000","last_unstale":"2023-11-26T07:12:31.661263+0000","last_undegraded":"2023-11-26T07:12:31.661263+0000","last_fullsized":"2023-11-26T07:12:31.661263+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:37:50.879550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.661209+0000","last_change":"2023-11-26T07:12:30.403835+0000","last_active":"2023-11-26T07:12:31.661209+0000","last_peered":"2023-11-26T07:12:31.661209+0000","last_clean":"2023-11-26T07:12:31.661209+0000","last_became_active":"2023-11-26T07:12:30.403548+0000","last_became_peered":"2023-11-26T07:12:30.403548+0000","last_unstale":"2023-11-26T07:12:31.661209+0000","last_undegraded":"2023-11-26T07:12:31.661209+0000","last_fullsized":"2023-11-26T07:12:31.661209+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:53:56.686837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162083+0000","last_change":"2023-11-26T07:12:29.391282+0000","last_active":"2023-11-26T07:12:32.162083+0000","last_peered":"2023-11-26T07:12:32.162083+0000","last_clean":"2023-11-26T07:12:32.162083+0000","last_became_active":"2023-11-26T07:12:29.391022+0000","last_became_peered":"2023-11-26T07:12:29.391022+0000","last_unstale":"2023-11-26T07:12:32.162083+0000","last_undegraded":"2023-11-26T07:12:32.162083+0000","last_fullsized":"2023-11-26T07:12:32.162083+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:14:40.199280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.389316+0000","last_change":"2023-11-26T07:12:30.408872+0000","last_active":"2023-11-26T07:12:31.389316+0000","last_peered":"2023-11-26T07:12:31.389316+0000","last_clean":"2023-11-26T07:12:31.389316+0000","last_became_active":"2023-11-26T07:12:30.408430+0000","last_became_peered":"2023-11-26T07:12:30.408430+0000","last_unstale":"2023-11-26T07:12:31.389316+0000","last_undegraded":"2023-11-26T07:12:31.389316+0000","last_fullsized":"2023-11-26T07:12:31.389316+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:09:57.137824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.386219+0000","last_change":"2023-11-26T07:12:29.389038+0000","last_active":"2023-11-26T07:12:31.386219+0000","last_peered":"2023-11-26T07:12:31.386219+0000","last_clean":"2023-11-26T07:12:31.386219+0000","last_became_active":"2023-11-26T07:12:29.388644+0000","last_became_peered":"2023-11-26T07:12:29.388644+0000","last_unstale":"2023-11-26T07:12:31.386219+0000","last_undegraded":"2023-11-26T07:12:31.386219+0000","last_fullsized":"2023-11-26T07:12:31.386219+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:26:50.015933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.062282+0000","last_change":"2023-11-26T07:12:30.405754+0000","last_active":"2023-11-26T07:12:32.062282+0000","last_peered":"2023-11-26T07:12:32.062282+0000","last_clean":"2023-11-26T07:12:32.062282+0000","last_became_active":"2023-11-26T07:12:30.404989+0000","last_became_peered":"2023-11-26T07:12:30.404989+0000","last_unstale":"2023-11-26T07:12:32.062282+0000","last_undegraded":"2023-11-26T07:12:32.062282+0000","last_fullsized":"2023-11-26T07:12:32.062282+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:26:51.020116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162345+0000","last_change":"2023-11-26T07:12:29.386873+0000","last_active":"2023-11-26T07:12:32.162345+0000","last_peered":"2023-11-26T07:12:32.162345+0000","last_clean":"2023-11-26T07:12:32.162345+0000","last_became_active":"2023-11-26T07:12:29.386558+0000","last_became_peered":"2023-11-26T07:12:29.386558+0000","last_unstale":"2023-11-26T07:12:32.162345+0000","last_undegraded":"2023-11-26T07:12:32.162345+0000","last_fullsized":"2023-11-26T07:12:32.162345+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:18:43.441012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.161778+0000","last_change":"2023-11-26T07:12:30.403176+0000","last_active":"2023-11-26T07:12:32.161778+0000","last_peered":"2023-11-26T07:12:32.161778+0000","last_clean":"2023-11-26T07:12:32.161778+0000","last_became_active":"2023-11-26T07:12:30.402892+0000","last_became_peered":"2023-11-26T07:12:30.402892+0000","last_unstale":"2023-11-26T07:12:32.161778+0000","last_undegraded":"2023-11-26T07:12:32.161778+0000","last_fullsized":"2023-11-26T07:12:32.161778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:47:04.640542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.389621+0000","last_change":"2023-11-26T07:12:29.384555+0000","last_active":"2023-11-26T07:12:31.389621+0000","last_peered":"2023-11-26T07:12:31.389621+0000","last_clean":"2023-11-26T07:12:31.389621+0000","last_became_active":"2023-11-26T07:12:29.384276+0000","last_became_peered":"2023-11-26T07:12:29.384276+0000","last_unstale":"2023-11-26T07:12:31.389621+0000","last_undegraded":"2023-11-26T07:12:31.389621+0000","last_fullsized":"2023-11-26T07:12:31.389621+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:42:15.656581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.161787+0000","last_change":"2023-11-26T07:12:30.393351+0000","last_active":"2023-11-26T07:12:32.161787+0000","last_peered":"2023-11-26T07:12:32.161787+0000","last_clean":"2023-11-26T07:12:32.161787+0000","last_became_active":"2023-11-26T07:12:30.393090+0000","last_became_peered":"2023-11-26T07:12:30.393090+0000","last_unstale":"2023-11-26T07:12:32.161787+0000","last_undegraded":"2023-11-26T07:12:32.161787+0000","last_fullsized":"2023-11-26T07:12:32.161787+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:44:25.640038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.389218+0000","last_change":"2023-11-26T07:12:29.384360+0000","last_active":"2023-11-26T07:12:31.389218+0000","last_peered":"2023-11-26T07:12:31.389218+0000","last_clean":"2023-11-26T07:12:31.389218+0000","last_became_active":"2023-11-26T07:12:29.384093+0000","last_became_peered":"2023-11-26T07:12:29.384093+0000","last_unstale":"2023-11-26T07:12:31.389218+0000","last_undegraded":"2023-11-26T07:12:31.389218+0000","last_fullsized":"2023-11-26T07:12:31.389218+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:32:46.189573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.389050+0000","last_change":"2023-11-26T07:12:30.406536+0000","last_active":"2023-11-26T07:12:31.389050+0000","last_peered":"2023-11-26T07:12:31.389050+0000","last_clean":"2023-11-26T07:12:31.389050+0000","last_became_active":"2023-11-26T07:12:30.405942+0000","last_became_peered":"2023-11-26T07:12:30.405942+0000","last_unstale":"2023-11-26T07:12:31.389050+0000","last_undegraded":"2023-11-26T07:12:31.389050+0000","last_fullsized":"2023-11-26T07:12:31.389050+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:43:20.223243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.385964+0000","last_change":"2023-11-26T07:12:29.383209+0000","last_active":"2023-11-26T07:12:31.385964+0000","last_peered":"2023-11-26T07:12:31.385964+0000","last_clean":"2023-11-26T07:12:31.385964+0000","last_became_active":"2023-11-26T07:12:29.382214+0000","last_became_peered":"2023-11-26T07:12:29.382214+0000","last_unstale":"2023-11-26T07:12:31.385964+0000","last_undegraded":"2023-11-26T07:12:31.385964+0000","last_fullsized":"2023-11-26T07:12:31.385964+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:46:09.895624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.061725+0000","last_change":"2023-11-26T07:12:30.401622+0000","last_active":"2023-11-26T07:12:32.061725+0000","last_peered":"2023-11-26T07:12:32.061725+0000","last_clean":"2023-11-26T07:12:32.061725+0000","last_became_active":"2023-11-26T07:12:30.401388+0000","last_became_peered":"2023-11-26T07:12:30.401388+0000","last_unstale":"2023-11-26T07:12:32.061725+0000","last_undegraded":"2023-11-26T07:12:32.061725+0000","last_fullsized":"2023-11-26T07:12:32.061725+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:51:33.900805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.388929+0000","last_change":"2023-11-26T07:12:29.383860+0000","last_active":"2023-11-26T07:12:31.388929+0000","last_peered":"2023-11-26T07:12:31.388929+0000","last_clean":"2023-11-26T07:12:31.388929+0000","last_became_active":"2023-11-26T07:12:29.383475+0000","last_became_peered":"2023-11-26T07:12:29.383475+0000","last_unstale":"2023-11-26T07:12:31.388929+0000","last_undegraded":"2023-11-26T07:12:31.388929+0000","last_fullsized":"2023-11-26T07:12:31.388929+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:37:50.879550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162330+0000","last_change":"2023-11-26T07:12:30.401538+0000","last_active":"2023-11-26T07:12:32.162330+0000","last_peered":"2023-11-26T07:12:32.162330+0000","last_clean":"2023-11-26T07:12:32.162330+0000","last_became_active":"2023-11-26T07:12:30.401268+0000","last_became_peered":"2023-11-26T07:12:30.401268+0000","last_unstale":"2023-11-26T07:12:32.162330+0000","last_undegraded":"2023-11-26T07:12:32.162330+0000","last_fullsized":"2023-11-26T07:12:32.162330+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:47:51.074571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.386373+0000","last_change":"2023-11-26T07:12:29.390503+0000","last_active":"2023-11-26T07:12:31.386373+0000","last_peered":"2023-11-26T07:12:31.386373+0000","last_clean":"2023-11-26T07:12:31.386373+0000","last_became_active":"2023-11-26T07:12:29.390015+0000","last_became_peered":"2023-11-26T07:12:29.390015+0000","last_unstale":"2023-11-26T07:12:31.386373+0000","last_undegraded":"2023-11-26T07:12:31.386373+0000","last_fullsized":"2023-11-26T07:12:31.386373+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:50:39.716351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.386584+0000","last_change":"2023-11-26T07:12:30.414717+0000","last_active":"2023-11-26T07:12:31.386584+0000","last_peered":"2023-11-26T07:12:31.386584+0000","last_clean":"2023-11-26T07:12:31.386584+0000","last_became_active":"2023-11-26T07:12:30.413444+0000","last_became_peered":"2023-11-26T07:12:30.413444+0000","last_unstale":"2023-11-26T07:12:31.386584+0000","last_undegraded":"2023-11-26T07:12:31.386584+0000","last_fullsized":"2023-11-26T07:12:31.386584+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:07:35.428329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162186+0000","last_change":"2023-11-26T07:12:29.384382+0000","last_active":"2023-11-26T07:12:32.162186+0000","last_peered":"2023-11-26T07:12:32.162186+0000","last_clean":"2023-11-26T07:12:32.162186+0000","last_became_active":"2023-11-26T07:12:29.384086+0000","last_became_peered":"2023-11-26T07:12:29.384086+0000","last_unstale":"2023-11-26T07:12:32.162186+0000","last_undegraded":"2023-11-26T07:12:32.162186+0000","last_fullsized":"2023-11-26T07:12:32.162186+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:24:34.963721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.386377+0000","last_change":"2023-11-26T07:12:30.398978+0000","last_active":"2023-11-26T07:12:31.386377+0000","last_peered":"2023-11-26T07:12:31.386377+0000","last_clean":"2023-11-26T07:12:31.386377+0000","last_became_active":"2023-11-26T07:12:30.398724+0000","last_became_peered":"2023-11-26T07:12:30.398724+0000","last_unstale":"2023-11-26T07:12:31.386377+0000","last_undegraded":"2023-11-26T07:12:31.386377+0000","last_fullsized":"2023-11-26T07:12:31.386377+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:10:28.618472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162563+0000","last_change":"2023-11-26T07:12:29.383650+0000","last_active":"2023-11-26T07:12:32.162563+0000","last_peered":"2023-11-26T07:12:32.162563+0000","last_clean":"2023-11-26T07:12:32.162563+0000","last_became_active":"2023-11-26T07:12:29.383343+0000","last_became_peered":"2023-11-26T07:12:29.383343+0000","last_unstale":"2023-11-26T07:12:32.162563+0000","last_undegraded":"2023-11-26T07:12:32.162563+0000","last_fullsized":"2023-11-26T07:12:32.162563+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:45:29.303651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162463+0000","last_change":"2023-11-26T07:12:30.410892+0000","last_active":"2023-11-26T07:12:32.162463+0000","last_peered":"2023-11-26T07:12:32.162463+0000","last_clean":"2023-11-26T07:12:32.162463+0000","last_became_active":"2023-11-26T07:12:30.410063+0000","last_became_peered":"2023-11-26T07:12:30.410063+0000","last_unstale":"2023-11-26T07:12:32.162463+0000","last_undegraded":"2023-11-26T07:12:32.162463+0000","last_fullsized":"2023-11-26T07:12:32.162463+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:20:46.702320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.386410+0000","last_change":"2023-11-26T07:12:29.390243+0000","last_active":"2023-11-26T07:12:31.386410+0000","last_peered":"2023-11-26T07:12:31.386410+0000","last_clean":"2023-11-26T07:12:31.386410+0000","last_became_active":"2023-11-26T07:12:29.389908+0000","last_became_peered":"2023-11-26T07:12:29.389908+0000","last_unstale":"2023-11-26T07:12:31.386410+0000","last_undegraded":"2023-11-26T07:12:31.386410+0000","last_fullsized":"2023-11-26T07:12:31.386410+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:21:55.452268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.061723+0000","last_change":"2023-11-26T07:12:30.405158+0000","last_active":"2023-11-26T07:12:32.061723+0000","last_peered":"2023-11-26T07:12:32.061723+0000","last_clean":"2023-11-26T07:12:32.061723+0000","last_became_active":"2023-11-26T07:12:30.404878+0000","last_became_peered":"2023-11-26T07:12:30.404878+0000","last_unstale":"2023-11-26T07:12:32.061723+0000","last_undegraded":"2023-11-26T07:12:32.061723+0000","last_fullsized":"2023-11-26T07:12:32.061723+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:46:10.899807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.389668+0000","last_change":"2023-11-26T07:12:29.384017+0000","last_active":"2023-11-26T07:12:31.389668+0000","last_peered":"2023-11-26T07:12:31.389668+0000","last_clean":"2023-11-26T07:12:31.389668+0000","last_became_active":"2023-11-26T07:12:29.383695+0000","last_became_peered":"2023-11-26T07:12:29.383695+0000","last_unstale":"2023-11-26T07:12:31.389668+0000","last_undegraded":"2023-11-26T07:12:31.389668+0000","last_fullsized":"2023-11-26T07:12:31.389668+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:22:16.001138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.386290+0000","last_change":"2023-11-26T07:12:30.397867+0000","last_active":"2023-11-26T07:12:31.386290+0000","last_peered":"2023-11-26T07:12:31.386290+0000","last_clean":"2023-11-26T07:12:31.386290+0000","last_became_active":"2023-11-26T07:12:30.392982+0000","last_became_peered":"2023-11-26T07:12:30.392982+0000","last_unstale":"2023-11-26T07:12:31.386290+0000","last_undegraded":"2023-11-26T07:12:31.386290+0000","last_fullsized":"2023-11-26T07:12:31.386290+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:42:44.921403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.061736+0000","last_change":"2023-11-26T07:12:29.385157+0000","last_active":"2023-11-26T07:12:32.061736+0000","last_peered":"2023-11-26T07:12:32.061736+0000","last_clean":"2023-11-26T07:12:32.061736+0000","last_became_active":"2023-11-26T07:12:29.384906+0000","last_became_peered":"2023-11-26T07:12:29.384906+0000","last_unstale":"2023-11-26T07:12:32.061736+0000","last_undegraded":"2023-11-26T07:12:32.061736+0000","last_fullsized":"2023-11-26T07:12:32.061736+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:46:49.068165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162386+0000","last_change":"2023-11-26T07:12:30.404190+0000","last_active":"2023-11-26T07:12:32.162386+0000","last_peered":"2023-11-26T07:12:32.162386+0000","last_clean":"2023-11-26T07:12:32.162386+0000","last_became_active":"2023-11-26T07:12:30.403606+0000","last_became_peered":"2023-11-26T07:12:30.403606+0000","last_unstale":"2023-11-26T07:12:32.162386+0000","last_undegraded":"2023-11-26T07:12:32.162386+0000","last_fullsized":"2023-11-26T07:12:32.162386+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:42:44.921403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.386053+0000","last_change":"2023-11-26T07:12:29.386048+0000","last_active":"2023-11-26T07:12:31.386053+0000","last_peered":"2023-11-26T07:12:31.386053+0000","last_clean":"2023-11-26T07:12:31.386053+0000","last_became_active":"2023-11-26T07:12:29.385713+0000","last_became_peered":"2023-11-26T07:12:29.385713+0000","last_unstale":"2023-11-26T07:12:31.386053+0000","last_undegraded":"2023-11-26T07:12:31.386053+0000","last_fullsized":"2023-11-26T07:12:31.386053+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:17:29.741680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.661097+0000","last_change":"2023-11-26T07:12:30.408448+0000","last_active":"2023-11-26T07:12:31.661097+0000","last_peered":"2023-11-26T07:12:31.661097+0000","last_clean":"2023-11-26T07:12:31.661097+0000","last_became_active":"2023-11-26T07:12:30.407942+0000","last_became_peered":"2023-11-26T07:12:30.407942+0000","last_unstale":"2023-11-26T07:12:31.661097+0000","last_undegraded":"2023-11-26T07:12:31.661097+0000","last_fullsized":"2023-11-26T07:12:31.661097+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:23:48.522291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.386589+0000","last_change":"2023-11-26T07:12:29.390346+0000","last_active":"2023-11-26T07:12:31.386589+0000","last_peered":"2023-11-26T07:12:31.386589+0000","last_clean":"2023-11-26T07:12:31.386589+0000","last_became_active":"2023-11-26T07:12:29.389968+0000","last_became_peered":"2023-11-26T07:12:29.389968+0000","last_unstale":"2023-11-26T07:12:31.386589+0000","last_undegraded":"2023-11-26T07:12:31.386589+0000","last_fullsized":"2023-11-26T07:12:31.386589+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:16:07.180244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.389309+0000","last_change":"2023-11-26T07:12:30.401973+0000","last_active":"2023-11-26T07:12:31.389309+0000","last_peered":"2023-11-26T07:12:31.389309+0000","last_clean":"2023-11-26T07:12:31.389309+0000","last_became_active":"2023-11-26T07:12:30.401699+0000","last_became_peered":"2023-11-26T07:12:30.401699+0000","last_unstale":"2023-11-26T07:12:31.389309+0000","last_undegraded":"2023-11-26T07:12:31.389309+0000","last_fullsized":"2023-11-26T07:12:31.389309+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:53:56.686837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.062237+0000","last_change":"2023-11-26T07:12:29.388991+0000","last_active":"2023-11-26T07:12:32.062237+0000","last_peered":"2023-11-26T07:12:32.062237+0000","last_clean":"2023-11-26T07:12:32.062237+0000","last_became_active":"2023-11-26T07:12:29.388640+0000","last_became_peered":"2023-11-26T07:12:29.388640+0000","last_unstale":"2023-11-26T07:12:32.062237+0000","last_undegraded":"2023-11-26T07:12:32.062237+0000","last_fullsized":"2023-11-26T07:12:32.062237+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:03:17.543886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162509+0000","last_change":"2023-11-26T07:12:30.403710+0000","last_active":"2023-11-26T07:12:32.162509+0000","last_peered":"2023-11-26T07:12:32.162509+0000","last_clean":"2023-11-26T07:12:32.162509+0000","last_became_active":"2023-11-26T07:12:30.403431+0000","last_became_peered":"2023-11-26T07:12:30.403431+0000","last_unstale":"2023-11-26T07:12:32.162509+0000","last_undegraded":"2023-11-26T07:12:32.162509+0000","last_fullsized":"2023-11-26T07:12:32.162509+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:42:44.921403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.389475+0000","last_change":"2023-11-26T07:12:29.383912+0000","last_active":"2023-11-26T07:12:31.389475+0000","last_peered":"2023-11-26T07:12:31.389475+0000","last_clean":"2023-11-26T07:12:31.389475+0000","last_became_active":"2023-11-26T07:12:29.383538+0000","last_became_peered":"2023-11-26T07:12:29.383538+0000","last_unstale":"2023-11-26T07:12:31.389475+0000","last_undegraded":"2023-11-26T07:12:31.389475+0000","last_fullsized":"2023-11-26T07:12:31.389475+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:24:34.963721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.062099+0000","last_change":"2023-11-26T07:12:30.403520+0000","last_active":"2023-11-26T07:12:32.062099+0000","last_peered":"2023-11-26T07:12:32.062099+0000","last_clean":"2023-11-26T07:12:32.062099+0000","last_became_active":"2023-11-26T07:12:30.403130+0000","last_became_peered":"2023-11-26T07:12:30.403130+0000","last_unstale":"2023-11-26T07:12:32.062099+0000","last_undegraded":"2023-11-26T07:12:32.062099+0000","last_fullsized":"2023-11-26T07:12:32.062099+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:17:30.745863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.389577+0000","last_change":"2023-11-26T07:12:29.381996+0000","last_active":"2023-11-26T07:12:31.389577+0000","last_peered":"2023-11-26T07:12:31.389577+0000","last_clean":"2023-11-26T07:12:31.389577+0000","last_became_active":"2023-11-26T07:12:29.381703+0000","last_became_peered":"2023-11-26T07:12:29.381703+0000","last_unstale":"2023-11-26T07:12:31.389577+0000","last_undegraded":"2023-11-26T07:12:31.389577+0000","last_fullsized":"2023-11-26T07:12:31.389577+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:03:17.543886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162684+0000","last_change":"2023-11-26T07:12:30.396832+0000","last_active":"2023-11-26T07:12:32.162684+0000","last_peered":"2023-11-26T07:12:32.162684+0000","last_clean":"2023-11-26T07:12:32.162684+0000","last_became_active":"2023-11-26T07:12:30.396528+0000","last_became_peered":"2023-11-26T07:12:30.396528+0000","last_unstale":"2023-11-26T07:12:32.162684+0000","last_undegraded":"2023-11-26T07:12:32.162684+0000","last_fullsized":"2023-11-26T07:12:32.162684+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:09:36.174557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.389369+0000","last_change":"2023-11-26T07:12:29.388801+0000","last_active":"2023-11-26T07:12:31.389369+0000","last_peered":"2023-11-26T07:12:31.389369+0000","last_clean":"2023-11-26T07:12:31.389369+0000","last_became_active":"2023-11-26T07:12:29.388511+0000","last_became_peered":"2023-11-26T07:12:29.388511+0000","last_unstale":"2023-11-26T07:12:31.389369+0000","last_undegraded":"2023-11-26T07:12:31.389369+0000","last_fullsized":"2023-11-26T07:12:31.389369+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:14:40.199280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162331+0000","last_change":"2023-11-26T07:12:30.402194+0000","last_active":"2023-11-26T07:12:32.162331+0000","last_peered":"2023-11-26T07:12:32.162331+0000","last_clean":"2023-11-26T07:12:32.162331+0000","last_became_active":"2023-11-26T07:12:30.401878+0000","last_became_peered":"2023-11-26T07:12:30.401878+0000","last_unstale":"2023-11-26T07:12:32.162331+0000","last_undegraded":"2023-11-26T07:12:32.162331+0000","last_fullsized":"2023-11-26T07:12:32.162331+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:33:29.419133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.161877+0000","last_change":"2023-11-26T07:12:29.386385+0000","last_active":"2023-11-26T07:12:32.161877+0000","last_peered":"2023-11-26T07:12:32.161877+0000","last_clean":"2023-11-26T07:12:32.161877+0000","last_became_active":"2023-11-26T07:12:29.386074+0000","last_became_peered":"2023-11-26T07:12:29.386074+0000","last_unstale":"2023-11-26T07:12:32.161877+0000","last_undegraded":"2023-11-26T07:12:32.161877+0000","last_fullsized":"2023-11-26T07:12:32.161877+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:32:19.358509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162430+0000","last_change":"2023-11-26T07:12:30.398334+0000","last_active":"2023-11-26T07:12:32.162430+0000","last_peered":"2023-11-26T07:12:32.162430+0000","last_clean":"2023-11-26T07:12:32.162430+0000","last_became_active":"2023-11-26T07:12:30.397829+0000","last_became_peered":"2023-11-26T07:12:30.397829+0000","last_unstale":"2023-11-26T07:12:32.162430+0000","last_undegraded":"2023-11-26T07:12:32.162430+0000","last_fullsized":"2023-11-26T07:12:32.162430+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:08:24.944701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.661090+0000","last_change":"2023-11-26T07:12:29.388436+0000","last_active":"2023-11-26T07:12:31.661090+0000","last_peered":"2023-11-26T07:12:31.661090+0000","last_clean":"2023-11-26T07:12:31.661090+0000","last_became_active":"2023-11-26T07:12:29.388156+0000","last_became_peered":"2023-11-26T07:12:29.388156+0000","last_unstale":"2023-11-26T07:12:31.661090+0000","last_undegraded":"2023-11-26T07:12:31.661090+0000","last_fullsized":"2023-11-26T07:12:31.661090+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:03:17.543886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.161866+0000","last_change":"2023-11-26T07:12:30.397083+0000","last_active":"2023-11-26T07:12:32.161866+0000","last_peered":"2023-11-26T07:12:32.161866+0000","last_clean":"2023-11-26T07:12:32.161866+0000","last_became_active":"2023-11-26T07:12:30.396611+0000","last_became_peered":"2023-11-26T07:12:30.396611+0000","last_unstale":"2023-11-26T07:12:32.161866+0000","last_undegraded":"2023-11-26T07:12:32.161866+0000","last_fullsized":"2023-11-26T07:12:32.161866+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:47:21.180588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.389057+0000","last_change":"2023-11-26T07:12:29.380747+0000","last_active":"2023-11-26T07:12:31.389057+0000","last_peered":"2023-11-26T07:12:31.389057+0000","last_clean":"2023-11-26T07:12:31.389057+0000","last_became_active":"2023-11-26T07:12:29.380458+0000","last_became_peered":"2023-11-26T07:12:29.380458+0000","last_unstale":"2023-11-26T07:12:31.389057+0000","last_undegraded":"2023-11-26T07:12:31.389057+0000","last_fullsized":"2023-11-26T07:12:31.389057+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:51:46.685590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.161814+0000","last_change":"2023-11-26T07:12:30.406823+0000","last_active":"2023-11-26T07:12:32.161814+0000","last_peered":"2023-11-26T07:12:32.161814+0000","last_clean":"2023-11-26T07:12:32.161814+0000","last_became_active":"2023-11-26T07:12:30.406250+0000","last_became_peered":"2023-11-26T07:12:30.406250+0000","last_unstale":"2023-11-26T07:12:32.161814+0000","last_undegraded":"2023-11-26T07:12:32.161814+0000","last_fullsized":"2023-11-26T07:12:32.161814+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:26:51.020116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.161678+0000","last_change":"2023-11-26T07:12:29.390015+0000","last_active":"2023-11-26T07:12:32.161678+0000","last_peered":"2023-11-26T07:12:32.161678+0000","last_clean":"2023-11-26T07:12:32.161678+0000","last_became_active":"2023-11-26T07:12:29.389686+0000","last_became_peered":"2023-11-26T07:12:29.389686+0000","last_unstale":"2023-11-26T07:12:32.161678+0000","last_undegraded":"2023-11-26T07:12:32.161678+0000","last_fullsized":"2023-11-26T07:12:32.161678+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:32:46.189573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162393+0000","last_change":"2023-11-26T07:12:30.401291+0000","last_active":"2023-11-26T07:12:32.162393+0000","last_peered":"2023-11-26T07:12:32.162393+0000","last_clean":"2023-11-26T07:12:32.162393+0000","last_became_active":"2023-11-26T07:12:30.400976+0000","last_became_peered":"2023-11-26T07:12:30.400976+0000","last_unstale":"2023-11-26T07:12:32.162393+0000","last_undegraded":"2023-11-26T07:12:32.162393+0000","last_fullsized":"2023-11-26T07:12:32.162393+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:33:17.829630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.062119+0000","last_change":"2023-11-26T07:12:29.391654+0000","last_active":"2023-11-26T07:12:32.062119+0000","last_peered":"2023-11-26T07:12:32.062119+0000","last_clean":"2023-11-26T07:12:32.062119+0000","last_became_active":"2023-11-26T07:12:29.390570+0000","last_became_peered":"2023-11-26T07:12:29.390570+0000","last_unstale":"2023-11-26T07:12:32.062119+0000","last_undegraded":"2023-11-26T07:12:32.062119+0000","last_fullsized":"2023-11-26T07:12:32.062119+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:37:50.879550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162635+0000","last_change":"2023-11-26T07:12:30.409856+0000","last_active":"2023-11-26T07:12:32.162635+0000","last_peered":"2023-11-26T07:12:32.162635+0000","last_clean":"2023-11-26T07:12:32.162635+0000","last_became_active":"2023-11-26T07:12:30.409541+0000","last_became_peered":"2023-11-26T07:12:30.409541+0000","last_unstale":"2023-11-26T07:12:32.162635+0000","last_undegraded":"2023-11-26T07:12:32.162635+0000","last_fullsized":"2023-11-26T07:12:32.162635+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:10:28.618472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162194+0000","last_change":"2023-11-26T07:12:29.386207+0000","last_active":"2023-11-26T07:12:32.162194+0000","last_peered":"2023-11-26T07:12:32.162194+0000","last_clean":"2023-11-26T07:12:32.162194+0000","last_became_active":"2023-11-26T07:12:29.385912+0000","last_became_peered":"2023-11-26T07:12:29.385912+0000","last_unstale":"2023-11-26T07:12:32.162194+0000","last_undegraded":"2023-11-26T07:12:32.162194+0000","last_fullsized":"2023-11-26T07:12:32.162194+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:32:46.189573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.161914+0000","last_change":"2023-11-26T07:12:30.406090+0000","last_active":"2023-11-26T07:12:32.161914+0000","last_peered":"2023-11-26T07:12:32.161914+0000","last_clean":"2023-11-26T07:12:32.161914+0000","last_became_active":"2023-11-26T07:12:30.405808+0000","last_became_peered":"2023-11-26T07:12:30.405808+0000","last_unstale":"2023-11-26T07:12:32.161914+0000","last_undegraded":"2023-11-26T07:12:32.161914+0000","last_fullsized":"2023-11-26T07:12:32.161914+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:46:50.072348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.061972+0000","last_change":"2023-11-26T07:12:29.386445+0000","last_active":"2023-11-26T07:12:32.061972+0000","last_peered":"2023-11-26T07:12:32.061972+0000","last_clean":"2023-11-26T07:12:32.061972+0000","last_became_active":"2023-11-26T07:12:29.386164+0000","last_became_peered":"2023-11-26T07:12:29.386164+0000","last_unstale":"2023-11-26T07:12:32.061972+0000","last_undegraded":"2023-11-26T07:12:32.061972+0000","last_fullsized":"2023-11-26T07:12:32.061972+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:32:46.189573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.661074+0000","last_change":"2023-11-26T07:12:30.414698+0000","last_active":"2023-11-26T07:12:31.661074+0000","last_peered":"2023-11-26T07:12:31.661074+0000","last_clean":"2023-11-26T07:12:31.661074+0000","last_became_active":"2023-11-26T07:12:30.414364+0000","last_became_peered":"2023-11-26T07:12:30.414364+0000","last_unstale":"2023-11-26T07:12:31.661074+0000","last_undegraded":"2023-11-26T07:12:31.661074+0000","last_fullsized":"2023-11-26T07:12:31.661074+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:32:47.193756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.161815+0000","last_change":"2023-11-26T07:12:29.390248+0000","last_active":"2023-11-26T07:12:32.161815+0000","last_peered":"2023-11-26T07:12:32.161815+0000","last_clean":"2023-11-26T07:12:32.161815+0000","last_became_active":"2023-11-26T07:12:29.389868+0000","last_became_peered":"2023-11-26T07:12:29.389868+0000","last_unstale":"2023-11-26T07:12:32.161815+0000","last_undegraded":"2023-11-26T07:12:32.161815+0000","last_fullsized":"2023-11-26T07:12:32.161815+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:51:46.685590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.161984+0000","last_change":"2023-11-26T07:12:30.406766+0000","last_active":"2023-11-26T07:12:32.161984+0000","last_peered":"2023-11-26T07:12:32.161984+0000","last_clean":"2023-11-26T07:12:32.161984+0000","last_became_active":"2023-11-26T07:12:30.406470+0000","last_became_peered":"2023-11-26T07:12:30.406470+0000","last_unstale":"2023-11-26T07:12:32.161984+0000","last_undegraded":"2023-11-26T07:12:32.161984+0000","last_fullsized":"2023-11-26T07:12:32.161984+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:53:56.686837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.062033+0000","last_change":"2023-11-26T07:12:29.391354+0000","last_active":"2023-11-26T07:12:32.062033+0000","last_peered":"2023-11-26T07:12:32.062033+0000","last_clean":"2023-11-26T07:12:32.062033+0000","last_became_active":"2023-11-26T07:12:29.391047+0000","last_became_peered":"2023-11-26T07:12:29.391047+0000","last_unstale":"2023-11-26T07:12:32.062033+0000","last_undegraded":"2023-11-26T07:12:32.062033+0000","last_fullsized":"2023-11-26T07:12:32.062033+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:53:55.682654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.386089+0000","last_change":"2023-11-26T07:12:30.406772+0000","last_active":"2023-11-26T07:12:31.386089+0000","last_peered":"2023-11-26T07:12:31.386089+0000","last_clean":"2023-11-26T07:12:31.386089+0000","last_became_active":"2023-11-26T07:12:30.405775+0000","last_became_peered":"2023-11-26T07:12:30.405775+0000","last_unstale":"2023-11-26T07:12:31.386089+0000","last_undegraded":"2023-11-26T07:12:31.386089+0000","last_fullsized":"2023-11-26T07:12:31.386089+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:47:51.074571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.389132+0000","last_change":"2023-11-26T07:12:29.382306+0000","last_active":"2023-11-26T07:12:31.389132+0000","last_peered":"2023-11-26T07:12:31.389132+0000","last_clean":"2023-11-26T07:12:31.389132+0000","last_became_active":"2023-11-26T07:12:29.382013+0000","last_became_peered":"2023-11-26T07:12:29.382013+0000","last_unstale":"2023-11-26T07:12:31.389132+0000","last_undegraded":"2023-11-26T07:12:31.389132+0000","last_fullsized":"2023-11-26T07:12:31.389132+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:32:19.358509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.388993+0000","last_change":"2023-11-26T07:12:30.408741+0000","last_active":"2023-11-26T07:12:31.388993+0000","last_peered":"2023-11-26T07:12:31.388993+0000","last_clean":"2023-11-26T07:12:31.388993+0000","last_became_active":"2023-11-26T07:12:30.408443+0000","last_became_peered":"2023-11-26T07:12:30.408443+0000","last_unstale":"2023-11-26T07:12:31.388993+0000","last_undegraded":"2023-11-26T07:12:31.388993+0000","last_fullsized":"2023-11-26T07:12:31.388993+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:23:48.522291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.385909+0000","last_change":"2023-11-26T07:12:29.385800+0000","last_active":"2023-11-26T07:12:31.385909+0000","last_peered":"2023-11-26T07:12:31.385909+0000","last_clean":"2023-11-26T07:12:31.385909+0000","last_became_active":"2023-11-26T07:12:29.385539+0000","last_became_peered":"2023-11-26T07:12:29.385539+0000","last_unstale":"2023-11-26T07:12:31.385909+0000","last_undegraded":"2023-11-26T07:12:31.385909+0000","last_fullsized":"2023-11-26T07:12:31.385909+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:44:24.635855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.161942+0000","last_change":"2023-11-26T07:12:30.398581+0000","last_active":"2023-11-26T07:12:32.161942+0000","last_peered":"2023-11-26T07:12:32.161942+0000","last_clean":"2023-11-26T07:12:32.161942+0000","last_became_active":"2023-11-26T07:12:30.398005+0000","last_became_peered":"2023-11-26T07:12:30.398005+0000","last_unstale":"2023-11-26T07:12:32.161942+0000","last_undegraded":"2023-11-26T07:12:32.161942+0000","last_fullsized":"2023-11-26T07:12:32.161942+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:50:40.720534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.661068+0000","last_change":"2023-11-26T07:12:29.383624+0000","last_active":"2023-11-26T07:12:31.661068+0000","last_peered":"2023-11-26T07:12:31.661068+0000","last_clean":"2023-11-26T07:12:31.661068+0000","last_became_active":"2023-11-26T07:12:29.383342+0000","last_became_peered":"2023-11-26T07:12:29.383342+0000","last_unstale":"2023-11-26T07:12:31.661068+0000","last_undegraded":"2023-11-26T07:12:31.661068+0000","last_fullsized":"2023-11-26T07:12:31.661068+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:24:34.963721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-26T07:12:30.388559+0000","last_change":"2023-11-26T07:11:29.855919+0000","last_active":"2023-11-26T07:12:30.388559+0000","last_peered":"2023-11-26T07:12:30.388559+0000","last_clean":"2023-11-26T07:12:30.388559+0000","last_became_active":"2023-11-26T07:11:29.854903+0000","last_became_peered":"2023-11-26T07:11:29.854903+0000","last_unstale":"2023-11-26T07:12:30.388559+0000","last_undegraded":"2023-11-26T07:12:30.388559+0000","last_fullsized":"2023-11-26T07:12:30.388559+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:28.594252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:28.594252+0000","last_clean_scrub_stamp":"2023-11-26T07:11:28.594252+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:33:34.642696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":946176,"data_stored":722931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.48899999999999999}]},{"osd":1,"last update":"Sun Nov 26 07:12:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":9.5600000000000005,"5min":9.5600000000000005,"15min":9.5600000000000005},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.63}]},{"osd":2,"last update":"Sun Nov 26 07:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.70199999999999996}]},{"osd":3,"last update":"Sun Nov 26 07:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.75700000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.73399999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.77400000000000002}]},{"osd":6,"last update":"Sun Nov 26 07:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.78900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":139389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.81200000000000006}]},{"osd":1,"last update":"Sun Nov 26 07:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.751}]},{"osd":2,"last update":"Sun Nov 26 07:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.67300000000000004}]},{"osd":3,"last update":"Sun Nov 26 07:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.89200000000000002}]},{"osd":4,"last update":"Sun Nov 26 07:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.52200000000000002}]},{"osd":5,"last update":"Sun Nov 26 07:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.69499999999999995}]},{"osd":7,"last update":"Sun Nov 26 07:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.72399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":364544,"data_stored":134107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":11.922000000000001,"5min":11.922000000000001,"15min":11.922000000000001},"last":0.35899999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.41299999999999998}]},{"osd":3,"last update":"Sun Nov 26 07:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.48499999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":6.8979999999999997,"5min":6.8979999999999997,"15min":6.8979999999999997},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.78500000000000003}]},{"osd":5,"last update":"Sun Nov 26 07:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":6.9480000000000004,"5min":6.9480000000000004,"15min":6.9480000000000004},"last":0.63600000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.748},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":6.9800000000000004,"5min":6.9800000000000004,"15min":6.9800000000000004},"last":0.76300000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.61099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":942080,"data_stored":722841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":11.987,"5min":11.987,"15min":11.987},"last":0.33400000000000002}]},{"osd":2,"last update":"Sun Nov 26 07:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.376},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.41399999999999998}]},{"osd":3,"last update":"Sun Nov 26 07:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.442}]},{"osd":4,"last update":"Sun Nov 26 07:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":6.5279999999999996,"5min":6.5279999999999996,"15min":6.5279999999999996},"last":0.61499999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.72599999999999998}]},{"osd":6,"last update":"Sun Nov 26 07:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":6.5419999999999998,"5min":6.5419999999999998,"15min":6.5419999999999998},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.80400000000000005}]},{"osd":7,"last update":"Sun Nov 26 07:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.68600000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":132543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.378}]},{"osd":1,"last update":"Sun Nov 26 07:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.46000000000000002}]},{"osd":3,"last update":"Sun Nov 26 07:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.316}]},{"osd":4,"last update":"Sun Nov 26 07:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.496},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.59399999999999997}]},{"osd":5,"last update":"Sun Nov 26 07:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.53500000000000003}]},{"osd":6,"last update":"Sun Nov 26 07:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.48699999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.61699999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":140407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.44900000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.38},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":2.903,"5min":2.903,"15min":2.903},"last":0.36299999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.42399999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.9609999999999999,"5min":2.9609999999999999,"15min":2.9609999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.71999999999999997}]},{"osd":5,"last update":"Sun Nov 26 07:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.70399999999999996}]},{"osd":6,"last update":"Sun Nov 26 07:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.92400000000000004}]},{"osd":7,"last update":"Sun Nov 26 07:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.9969999999999999,"5min":2.9969999999999999,"15min":2.9969999999999999},"last":0.85699999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":138877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:12:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":8.7539999999999996,"5min":8.7539999999999996,"15min":8.7539999999999996},"last":0.71199999999999997},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":8.7390000000000008,"5min":8.7390000000000008,"15min":8.7390000000000008},"last":0.75600000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:12:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":9.7720000000000002,"5min":9.7720000000000002,"15min":9.7720000000000002},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.78300000000000003}]},{"osd":2,"last update":"Sun Nov 26 07:12:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":9.8119999999999994,"5min":9.8119999999999994,"15min":9.8119999999999994},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":3.645,"5min":3.645,"15min":3.645},"last":0.72699999999999998}]},{"osd":3,"last update":"Sun Nov 26 07:12:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":8.8089999999999993,"5min":8.8089999999999993,"15min":8.8089999999999993},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.745}]},{"osd":5,"last update":"Sun Nov 26 07:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.59799999999999998}]},{"osd":6,"last update":"Sun Nov 26 07:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.621}]},{"osd":7,"last update":"Sun Nov 26 07:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.68799999999999994}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":133145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.496}]},{"osd":1,"last update":"Sun Nov 26 07:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.41999999999999998}]},{"osd":2,"last update":"Sun Nov 26 07:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.38800000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.372},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.51600000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.504}]},{"osd":6,"last update":"Sun Nov 26 07:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.44600000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.53400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:12:34.551 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:12:34.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.708+0000 7fc5b221e700 1 Processor -- start 2023-11-26T07:12:34.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.708+0000 7fc5b221e700 1 -- start start 2023-11-26T07:12:34.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.709+0000 7fc5b221e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc5ac0cecd0 0x7fc5ac15c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:34.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.709+0000 7fc5b221e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5ac0d0a90 con 0x7fc5ac0cf2b0 2023-11-26T07:12:34.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.709+0000 7fc5b221e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5ac06ee10 con 0x7fc5ac15bde0 2023-11-26T07:12:34.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.709+0000 7fc5b221e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5ac06f0f0 con 0x7fc5ac0cecd0 2023-11-26T07:12:34.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.709+0000 7fc5abfff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc5ac0cecd0 0x7fc5ac15c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:34.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.709+0000 7fc5aaffd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc5ac0cf2b0 0x7fc5ac0ce5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60358/0 (socket says 172.21.15.2:60358) 2023-11-26T07:12:34.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.709+0000 7fc5aaffd700 1 -- 172.21.15.2:0/1088100875 learned_addr learned my addr 172.21.15.2:0/1088100875 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:34.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.709+0000 7fc5abfff700 1 -- 172.21.15.2:0/1088100875 >> v1:172.21.15.192:6789/0 conn(0x7fc5ac15bde0 legacy=0x7fc5ac0d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:34.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.709+0000 7fc5abfff700 1 -- 172.21.15.2:0/1088100875 >> v1:172.21.15.2:6789/0 conn(0x7fc5ac0cf2b0 legacy=0x7fc5ac0ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:34.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.709+0000 7fc5abfff700 1 -- 172.21.15.2:0/1088100875 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ac06f3d0 con 0x7fc5ac0cecd0 2023-11-26T07:12:34.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.709+0000 7fc5aa7fc700 1 -- 172.21.15.2:0/1088100875 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2610114421 0 0) 0x7fc5ac0d0a90 con 0x7fc5ac0cf2b0 2023-11-26T07:12:34.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.710+0000 7fc5abfff700 1 --2- 172.21.15.2:0/1088100875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5ac0cecd0 0x7fc5ac15c1c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4009d90 tx=0x7fc5a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e63d0f12cc609126 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:34.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.710+0000 7fc5aa7fc700 1 -- 172.21.15.2:0/1088100875 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a400e070 con 0x7fc5ac0cecd0 2023-11-26T07:12:34.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.710+0000 7fc5aa7fc700 1 -- 172.21.15.2:0/1088100875 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a400bb90 con 0x7fc5ac0cecd0 2023-11-26T07:12:34.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.710+0000 7fc5aa7fc700 1 -- 172.21.15.2:0/1088100875 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a4003a20 con 0x7fc5ac0cecd0 2023-11-26T07:12:34.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.710+0000 7fc5b221e700 1 -- 172.21.15.2:0/1088100875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5ac0cecd0 msgr2=0x7fc5ac15c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:34.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.710+0000 7fc5b221e700 1 --2- 172.21.15.2:0/1088100875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5ac0cecd0 0x7fc5ac15c1c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4009d90 tx=0x7fc5a400b330 comp rx=0 tx=0).stop 2023-11-26T07:12:34.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.710+0000 7fc5b221e700 1 -- 172.21.15.2:0/1088100875 shutdown_connections 2023-11-26T07:12:34.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.710+0000 7fc5b221e700 1 --2- 172.21.15.2:0/1088100875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5ac0cecd0 0x7fc5ac15c1c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:34.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.710+0000 7fc5b221e700 1 -- 172.21.15.2:0/1088100875 >> 172.21.15.2:0/1088100875 conn(0x7fc5ac0b3720 msgr2=0x7fc5ac0b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:34.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.710+0000 7fc5b221e700 1 -- 172.21.15.2:0/1088100875 shutdown_connections 2023-11-26T07:12:34.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.710+0000 7fc5b221e700 1 -- 172.21.15.2:0/1088100875 wait complete. 2023-11-26T07:12:34.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.712+0000 7fc5b221e700 1 Processor -- start 2023-11-26T07:12:34.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.712+0000 7fc5b221e700 1 -- start start 2023-11-26T07:12:34.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.712+0000 7fc5b221e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc5ac0cecd0 0x7fc5ac14d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:34.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.713+0000 7fc5b221e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5ac0cf2b0 0x7fc5ac06db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:34.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.713+0000 7fc5b221e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5ac15bde0 0x7fc5ac152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:34.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.713+0000 7fc5b221e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac156880 con 0x7fc5ac0cf2b0 2023-11-26T07:12:34.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.713+0000 7fc5b221e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac1f4f10 con 0x7fc5ac15bde0 2023-11-26T07:12:34.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.713+0000 7fc5b221e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac156ad0 con 0x7fc5ac0cecd0 2023-11-26T07:12:34.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.713+0000 7fc5aaffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5ac0cf2b0 0x7fc5ac06db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:34.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.713+0000 7fc5aaffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5ac0cf2b0 0x7fc5ac06db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40924/0 (socket says 172.21.15.2:40924) 2023-11-26T07:12:34.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.713+0000 7fc5aaffd700 1 -- 172.21.15.2:0/1458182963 learned_addr learned my addr 172.21.15.2:0/1458182963 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:34.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.713+0000 7fc5ab7fe700 1 --2- 172.21.15.2:0/1458182963 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc5ac0cecd0 0x7fc5ac14d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:34.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.713+0000 7fc5abfff700 1 --2- 172.21.15.2:0/1458182963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5ac15bde0 0x7fc5ac152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:34.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.713+0000 7fc5aaffd700 1 -- 172.21.15.2:0/1458182963 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc5ac0cecd0 msgr2=0x7fc5ac14d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:34.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.713+0000 7fc5aaffd700 1 --2- 172.21.15.2:0/1458182963 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc5ac0cecd0 0x7fc5ac14d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:34.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.713+0000 7fc5aaffd700 1 -- 172.21.15.2:0/1458182963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5ac15bde0 msgr2=0x7fc5ac152260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:34.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.713+0000 7fc5aaffd700 1 --2- 172.21.15.2:0/1458182963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5ac15bde0 0x7fc5ac152260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:34.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.713+0000 7fc5aaffd700 1 -- 172.21.15.2:0/1458182963 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a4009a70 con 0x7fc5ac0cf2b0 2023-11-26T07:12:34.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.713+0000 7fc5aaffd700 1 --2- 172.21.15.2:0/1458182963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5ac0cf2b0 0x7fc5ac06db00 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fc59c00c570 tx=0x7fc59c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:34.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.713+0000 7fc593fff700 1 -- 172.21.15.2:0/1458182963 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59c004c80 con 0x7fc5ac0cf2b0 2023-11-26T07:12:34.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.713+0000 7fc593fff700 1 -- 172.21.15.2:0/1458182963 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc59c004de0 con 0x7fc5ac0cf2b0 2023-11-26T07:12:34.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.713+0000 7fc5b221e700 1 -- 172.21.15.2:0/1458182963 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5ac156db0 con 0x7fc5ac0cf2b0 2023-11-26T07:12:34.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.713+0000 7fc593fff700 1 -- 172.21.15.2:0/1458182963 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59c007310 con 0x7fc5ac0cf2b0 2023-11-26T07:12:34.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.713+0000 7fc5b221e700 1 -- 172.21.15.2:0/1458182963 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5ac157090 con 0x7fc5ac0cf2b0 2023-11-26T07:12:34.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.714+0000 7fc5b221e700 1 -- 172.21.15.2:0/1458182963 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5ac1f53c0 con 0x7fc5ac0cf2b0 2023-11-26T07:12:34.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.715+0000 7fc593fff700 1 -- 172.21.15.2:0/1458182963 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc59c007470 con 0x7fc5ac0cf2b0 2023-11-26T07:12:34.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.715+0000 7fc593fff700 1 --2- 172.21.15.2:0/1458182963 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc59806aed0 0x7fc59806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:34.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.715+0000 7fc593fff700 1 -- 172.21.15.2:0/1458182963 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc59c089240 con 0x7fc5ac0cf2b0 2023-11-26T07:12:34.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.715+0000 7fc5ab7fe700 1 --2- 172.21.15.2:0/1458182963 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc59806aed0 0x7fc59806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:34.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.716+0000 7fc5ab7fe700 1 --2- 172.21.15.2:0/1458182963 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc59806aed0 0x7fc59806d390 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc5a0009960 tx=0x7fc5a00090e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:34.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.720+0000 7fc593fff700 1 -- 172.21.15.2:0/1458182963 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc5ac1f53c0 con 0x7fc5ac0cf2b0 2023-11-26T07:12:34.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.917+0000 7fc5b221e700 1 -- 172.21.15.2:0/1458182963 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc5ac1f53c0 con 0x7fc59806aed0 2023-11-26T07:12:34.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.926+0000 7fc593fff700 1 -- 172.21.15.2:0/1458182963 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289563 (secure 0 0 0) 0x7fc5ac1f53c0 con 0x7fc59806aed0 2023-11-26T07:12:34.931 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:12:34.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.929+0000 7fc5b221e700 1 -- 172.21.15.2:0/1458182963 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc59806aed0 msgr2=0x7fc59806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:34.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.929+0000 7fc5b221e700 1 --2- 172.21.15.2:0/1458182963 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc59806aed0 0x7fc59806d390 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc5a0009960 tx=0x7fc5a00090e0 comp rx=0 tx=0).stop 2023-11-26T07:12:34.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.929+0000 7fc5b221e700 1 -- 172.21.15.2:0/1458182963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5ac0cf2b0 msgr2=0x7fc5ac06db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:34.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.929+0000 7fc5b221e700 1 --2- 172.21.15.2:0/1458182963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5ac0cf2b0 0x7fc5ac06db00 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fc59c00c570 tx=0x7fc59c00c880 comp rx=0 tx=0).stop 2023-11-26T07:12:34.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.929+0000 7fc5b221e700 1 -- 172.21.15.2:0/1458182963 shutdown_connections 2023-11-26T07:12:34.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.929+0000 7fc5b221e700 1 --2- 172.21.15.2:0/1458182963 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc59806aed0 0x7fc59806d390 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:34.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.929+0000 7fc5b221e700 1 --2- 172.21.15.2:0/1458182963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5ac15bde0 0x7fc5ac152260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:34.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.929+0000 7fc5b221e700 1 --2- 172.21.15.2:0/1458182963 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc5ac0cecd0 0x7fc5ac14d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:34.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.929+0000 7fc5b221e700 1 --2- 172.21.15.2:0/1458182963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5ac0cf2b0 0x7fc5ac06db00 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:34.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.929+0000 7fc5b221e700 1 -- 172.21.15.2:0/1458182963 >> 172.21.15.2:0/1458182963 conn(0x7fc5ac0b3720 msgr2=0x7fc5ac0cdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:34.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.929+0000 7fc5b221e700 1 -- 172.21.15.2:0/1458182963 shutdown_connections 2023-11-26T07:12:34.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:34.929+0000 7fc5b221e700 1 -- 172.21.15.2:0/1458182963 wait complete. 2023-11-26T07:12:34.934 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-26T07:12:34.943 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2023-11-26T07:12:34.166905+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":131,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220180,"kb_used_data":3980,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754540,"statfs":{"total":773094113280,"available":772868648960,"internally_reserved":0,"allocated":4075520,"data_stored":2264240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.801493"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.661595+0000","last_change":"2023-11-26T07:12:30.412545+0000","last_active":"2023-11-26T07:12:31.661595+0000","last_peered":"2023-11-26T07:12:31.661595+0000","last_clean":"2023-11-26T07:12:31.661595+0000","last_became_active":"2023-11-26T07:12:30.412231+0000","last_became_peered":"2023-11-26T07:12:30.412231+0000","last_unstale":"2023-11-26T07:12:31.661595+0000","last_undegraded":"2023-11-26T07:12:31.661595+0000","last_fullsized":"2023-11-26T07:12:31.661595+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:46:50.072348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.386661+0000","last_change":"2023-11-26T07:12:30.404293+0000","last_active":"2023-11-26T07:12:31.386661+0000","last_peered":"2023-11-26T07:12:31.386661+0000","last_clean":"2023-11-26T07:12:31.386661+0000","last_became_active":"2023-11-26T07:12:30.401872+0000","last_became_peered":"2023-11-26T07:12:30.401872+0000","last_unstale":"2023-11-26T07:12:31.386661+0000","last_undegraded":"2023-11-26T07:12:31.386661+0000","last_fullsized":"2023-11-26T07:12:31.386661+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:06:22.102518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162308+0000","last_change":"2023-11-26T07:12:30.410519+0000","last_active":"2023-11-26T07:12:32.162308+0000","last_peered":"2023-11-26T07:12:32.162308+0000","last_clean":"2023-11-26T07:12:32.162308+0000","last_became_active":"2023-11-26T07:12:30.410227+0000","last_became_peered":"2023-11-26T07:12:30.410227+0000","last_unstale":"2023-11-26T07:12:32.162308+0000","last_undegraded":"2023-11-26T07:12:32.162308+0000","last_fullsized":"2023-11-26T07:12:32.162308+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:21:56.456451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.061866+0000","last_change":"2023-11-26T07:12:30.403758+0000","last_active":"2023-11-26T07:12:32.061866+0000","last_peered":"2023-11-26T07:12:32.061866+0000","last_clean":"2023-11-26T07:12:32.061866+0000","last_became_active":"2023-11-26T07:12:30.403457+0000","last_became_peered":"2023-11-26T07:12:30.403457+0000","last_unstale":"2023-11-26T07:12:32.061866+0000","last_undegraded":"2023-11-26T07:12:32.061866+0000","last_fullsized":"2023-11-26T07:12:32.061866+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:45:30.307834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162347+0000","last_change":"2023-11-26T07:12:30.403260+0000","last_active":"2023-11-26T07:12:32.162347+0000","last_peered":"2023-11-26T07:12:32.162347+0000","last_clean":"2023-11-26T07:12:32.162347+0000","last_became_active":"2023-11-26T07:12:30.402914+0000","last_became_peered":"2023-11-26T07:12:30.402914+0000","last_unstale":"2023-11-26T07:12:32.162347+0000","last_undegraded":"2023-11-26T07:12:32.162347+0000","last_fullsized":"2023-11-26T07:12:32.162347+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:42:35.346485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.386380+0000","last_change":"2023-11-26T07:12:30.405402+0000","last_active":"2023-11-26T07:12:31.386380+0000","last_peered":"2023-11-26T07:12:31.386380+0000","last_clean":"2023-11-26T07:12:31.386380+0000","last_became_active":"2023-11-26T07:12:30.405109+0000","last_became_peered":"2023-11-26T07:12:30.405109+0000","last_unstale":"2023-11-26T07:12:31.386380+0000","last_undegraded":"2023-11-26T07:12:31.386380+0000","last_fullsized":"2023-11-26T07:12:31.386380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:16:42.282322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.161647+0000","last_change":"2023-11-26T07:12:30.406676+0000","last_active":"2023-11-26T07:12:32.161647+0000","last_peered":"2023-11-26T07:12:32.161647+0000","last_clean":"2023-11-26T07:12:32.161647+0000","last_became_active":"2023-11-26T07:12:30.406337+0000","last_became_peered":"2023-11-26T07:12:30.406337+0000","last_unstale":"2023-11-26T07:12:32.161647+0000","last_undegraded":"2023-11-26T07:12:32.161647+0000","last_fullsized":"2023-11-26T07:12:32.161647+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:44:25.640038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.161481+0000","last_change":"2023-11-26T07:12:30.398600+0000","last_active":"2023-11-26T07:12:32.161481+0000","last_peered":"2023-11-26T07:12:32.161481+0000","last_clean":"2023-11-26T07:12:32.161481+0000","last_became_active":"2023-11-26T07:12:30.398336+0000","last_became_peered":"2023-11-26T07:12:30.398336+0000","last_unstale":"2023-11-26T07:12:32.161481+0000","last_undegraded":"2023-11-26T07:12:32.161481+0000","last_fullsized":"2023-11-26T07:12:32.161481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:16:08.184427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.389549+0000","last_change":"2023-11-26T07:12:30.410558+0000","last_active":"2023-11-26T07:12:31.389549+0000","last_peered":"2023-11-26T07:12:31.389549+0000","last_clean":"2023-11-26T07:12:31.389549+0000","last_became_active":"2023-11-26T07:12:30.410286+0000","last_became_peered":"2023-11-26T07:12:30.410286+0000","last_unstale":"2023-11-26T07:12:31.389549+0000","last_undegraded":"2023-11-26T07:12:31.389549+0000","last_fullsized":"2023-11-26T07:12:31.389549+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:46:10.899807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.062058+0000","last_change":"2023-11-26T07:12:30.403024+0000","last_active":"2023-11-26T07:12:32.062058+0000","last_peered":"2023-11-26T07:12:32.062058+0000","last_clean":"2023-11-26T07:12:32.062058+0000","last_became_active":"2023-11-26T07:12:30.402733+0000","last_became_peered":"2023-11-26T07:12:30.402733+0000","last_unstale":"2023-11-26T07:12:32.062058+0000","last_undegraded":"2023-11-26T07:12:32.062058+0000","last_fullsized":"2023-11-26T07:12:32.062058+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:16:08.184427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162061+0000","last_change":"2023-11-26T07:12:30.411540+0000","last_active":"2023-11-26T07:12:32.162061+0000","last_peered":"2023-11-26T07:12:32.162061+0000","last_clean":"2023-11-26T07:12:32.162061+0000","last_became_active":"2023-11-26T07:12:30.411263+0000","last_became_peered":"2023-11-26T07:12:30.411263+0000","last_unstale":"2023-11-26T07:12:32.162061+0000","last_undegraded":"2023-11-26T07:12:32.162061+0000","last_fullsized":"2023-11-26T07:12:32.162061+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:21:56.456451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162046+0000","last_change":"2023-11-26T07:12:30.398646+0000","last_active":"2023-11-26T07:12:32.162046+0000","last_peered":"2023-11-26T07:12:32.162046+0000","last_clean":"2023-11-26T07:12:32.162046+0000","last_became_active":"2023-11-26T07:12:30.398367+0000","last_became_peered":"2023-11-26T07:12:30.398367+0000","last_unstale":"2023-11-26T07:12:32.162046+0000","last_undegraded":"2023-11-26T07:12:32.162046+0000","last_fullsized":"2023-11-26T07:12:32.162046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:26:51.020116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162512+0000","last_change":"2023-11-26T07:12:30.412100+0000","last_active":"2023-11-26T07:12:32.162512+0000","last_peered":"2023-11-26T07:12:32.162512+0000","last_clean":"2023-11-26T07:12:32.162512+0000","last_became_active":"2023-11-26T07:12:30.411800+0000","last_became_peered":"2023-11-26T07:12:30.411800+0000","last_unstale":"2023-11-26T07:12:32.162512+0000","last_undegraded":"2023-11-26T07:12:32.162512+0000","last_fullsized":"2023-11-26T07:12:32.162512+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:16:15.547781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.386481+0000","last_change":"2023-11-26T07:12:30.408073+0000","last_active":"2023-11-26T07:12:31.386481+0000","last_peered":"2023-11-26T07:12:31.386481+0000","last_clean":"2023-11-26T07:12:31.386481+0000","last_became_active":"2023-11-26T07:12:30.407693+0000","last_became_peered":"2023-11-26T07:12:30.407693+0000","last_unstale":"2023-11-26T07:12:31.386481+0000","last_undegraded":"2023-11-26T07:12:31.386481+0000","last_fullsized":"2023-11-26T07:12:31.386481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:46:31.104505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.161748+0000","last_change":"2023-11-26T07:12:30.406400+0000","last_active":"2023-11-26T07:12:32.161748+0000","last_peered":"2023-11-26T07:12:32.161748+0000","last_clean":"2023-11-26T07:12:32.161748+0000","last_became_active":"2023-11-26T07:12:30.406111+0000","last_became_peered":"2023-11-26T07:12:30.406111+0000","last_unstale":"2023-11-26T07:12:32.161748+0000","last_undegraded":"2023-11-26T07:12:32.161748+0000","last_fullsized":"2023-11-26T07:12:32.161748+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:47:04.640542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162289+0000","last_change":"2023-11-26T07:12:30.408067+0000","last_active":"2023-11-26T07:12:32.162289+0000","last_peered":"2023-11-26T07:12:32.162289+0000","last_clean":"2023-11-26T07:12:32.162289+0000","last_became_active":"2023-11-26T07:12:30.407801+0000","last_became_peered":"2023-11-26T07:12:30.407801+0000","last_unstale":"2023-11-26T07:12:32.162289+0000","last_undegraded":"2023-11-26T07:12:32.162289+0000","last_fullsized":"2023-11-26T07:12:32.162289+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:20:46.702320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162189+0000","last_change":"2023-11-26T07:12:30.413105+0000","last_active":"2023-11-26T07:12:32.162189+0000","last_peered":"2023-11-26T07:12:32.162189+0000","last_clean":"2023-11-26T07:12:32.162189+0000","last_became_active":"2023-11-26T07:12:30.412803+0000","last_became_peered":"2023-11-26T07:12:30.412803+0000","last_unstale":"2023-11-26T07:12:32.162189+0000","last_undegraded":"2023-11-26T07:12:32.162189+0000","last_fullsized":"2023-11-26T07:12:32.162189+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:47:51.074571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.386647+0000","last_change":"2023-11-26T07:12:30.408671+0000","last_active":"2023-11-26T07:12:31.386647+0000","last_peered":"2023-11-26T07:12:31.386647+0000","last_clean":"2023-11-26T07:12:31.386647+0000","last_became_active":"2023-11-26T07:12:30.408358+0000","last_became_peered":"2023-11-26T07:12:30.408358+0000","last_unstale":"2023-11-26T07:12:31.386647+0000","last_undegraded":"2023-11-26T07:12:31.386647+0000","last_fullsized":"2023-11-26T07:12:31.386647+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:56:00.607416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.386118+0000","last_change":"2023-11-26T07:12:30.408486+0000","last_active":"2023-11-26T07:12:31.386118+0000","last_peered":"2023-11-26T07:12:31.386118+0000","last_clean":"2023-11-26T07:12:31.386118+0000","last_became_active":"2023-11-26T07:12:30.408176+0000","last_became_peered":"2023-11-26T07:12:30.408176+0000","last_unstale":"2023-11-26T07:12:31.386118+0000","last_undegraded":"2023-11-26T07:12:31.386118+0000","last_fullsized":"2023-11-26T07:12:31.386118+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:20:46.702320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162426+0000","last_change":"2023-11-26T07:12:30.401061+0000","last_active":"2023-11-26T07:12:32.162426+0000","last_peered":"2023-11-26T07:12:32.162426+0000","last_clean":"2023-11-26T07:12:32.162426+0000","last_became_active":"2023-11-26T07:12:30.400779+0000","last_became_peered":"2023-11-26T07:12:30.400779+0000","last_unstale":"2023-11-26T07:12:32.162426+0000","last_undegraded":"2023-11-26T07:12:32.162426+0000","last_fullsized":"2023-11-26T07:12:32.162426+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:35:06.908600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.389380+0000","last_change":"2023-11-26T07:12:30.400263+0000","last_active":"2023-11-26T07:12:31.389380+0000","last_peered":"2023-11-26T07:12:31.389380+0000","last_clean":"2023-11-26T07:12:31.389380+0000","last_became_active":"2023-11-26T07:12:30.399970+0000","last_became_peered":"2023-11-26T07:12:30.399970+0000","last_unstale":"2023-11-26T07:12:31.389380+0000","last_undegraded":"2023-11-26T07:12:31.389380+0000","last_fullsized":"2023-11-26T07:12:31.389380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:51:33.900805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.389202+0000","last_change":"2023-11-26T07:12:30.406947+0000","last_active":"2023-11-26T07:12:31.389202+0000","last_peered":"2023-11-26T07:12:31.389202+0000","last_clean":"2023-11-26T07:12:31.389202+0000","last_became_active":"2023-11-26T07:12:30.406661+0000","last_became_peered":"2023-11-26T07:12:30.406661+0000","last_unstale":"2023-11-26T07:12:31.389202+0000","last_undegraded":"2023-11-26T07:12:31.389202+0000","last_fullsized":"2023-11-26T07:12:31.389202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:46:50.072348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.161638+0000","last_change":"2023-11-26T07:12:30.393722+0000","last_active":"2023-11-26T07:12:32.161638+0000","last_peered":"2023-11-26T07:12:32.161638+0000","last_clean":"2023-11-26T07:12:32.161638+0000","last_became_active":"2023-11-26T07:12:30.393388+0000","last_became_peered":"2023-11-26T07:12:30.393388+0000","last_unstale":"2023-11-26T07:12:32.161638+0000","last_undegraded":"2023-11-26T07:12:32.161638+0000","last_fullsized":"2023-11-26T07:12:32.161638+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:43:20.223243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.161564+0000","last_change":"2023-11-26T07:12:30.398678+0000","last_active":"2023-11-26T07:12:32.161564+0000","last_peered":"2023-11-26T07:12:32.161564+0000","last_clean":"2023-11-26T07:12:32.161564+0000","last_became_active":"2023-11-26T07:12:30.398385+0000","last_became_peered":"2023-11-26T07:12:30.398385+0000","last_unstale":"2023-11-26T07:12:32.161564+0000","last_undegraded":"2023-11-26T07:12:32.161564+0000","last_fullsized":"2023-11-26T07:12:32.161564+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:17:30.745863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.062094+0000","last_change":"2023-11-26T07:12:30.402184+0000","last_active":"2023-11-26T07:12:32.062094+0000","last_peered":"2023-11-26T07:12:32.062094+0000","last_clean":"2023-11-26T07:12:32.062094+0000","last_became_active":"2023-11-26T07:12:30.401910+0000","last_became_peered":"2023-11-26T07:12:30.401910+0000","last_unstale":"2023-11-26T07:12:32.062094+0000","last_undegraded":"2023-11-26T07:12:32.062094+0000","last_fullsized":"2023-11-26T07:12:32.062094+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:44:25.640038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.386793+0000","last_change":"2023-11-26T07:12:30.396847+0000","last_active":"2023-11-26T07:12:31.386793+0000","last_peered":"2023-11-26T07:12:31.386793+0000","last_clean":"2023-11-26T07:12:31.386793+0000","last_became_active":"2023-11-26T07:12:30.396602+0000","last_became_peered":"2023-11-26T07:12:30.396602+0000","last_unstale":"2023-11-26T07:12:31.386793+0000","last_undegraded":"2023-11-26T07:12:31.386793+0000","last_fullsized":"2023-11-26T07:12:31.386793+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:37:22.724414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.062280+0000","last_change":"2023-11-26T07:12:30.405968+0000","last_active":"2023-11-26T07:12:32.062280+0000","last_peered":"2023-11-26T07:12:32.062280+0000","last_clean":"2023-11-26T07:12:32.062280+0000","last_became_active":"2023-11-26T07:12:30.405494+0000","last_became_peered":"2023-11-26T07:12:30.405494+0000","last_unstale":"2023-11-26T07:12:32.062280+0000","last_undegraded":"2023-11-26T07:12:32.062280+0000","last_fullsized":"2023-11-26T07:12:32.062280+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:47:04.640542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162131+0000","last_change":"2023-11-26T07:12:30.393339+0000","last_active":"2023-11-26T07:12:32.162131+0000","last_peered":"2023-11-26T07:12:32.162131+0000","last_clean":"2023-11-26T07:12:32.162131+0000","last_became_active":"2023-11-26T07:12:30.393039+0000","last_became_peered":"2023-11-26T07:12:30.393039+0000","last_unstale":"2023-11-26T07:12:32.162131+0000","last_undegraded":"2023-11-26T07:12:32.162131+0000","last_fullsized":"2023-11-26T07:12:32.162131+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:50:40.720534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.389565+0000","last_change":"2023-11-26T07:12:30.408964+0000","last_active":"2023-11-26T07:12:31.389565+0000","last_peered":"2023-11-26T07:12:31.389565+0000","last_clean":"2023-11-26T07:12:31.389565+0000","last_became_active":"2023-11-26T07:12:30.408631+0000","last_became_peered":"2023-11-26T07:12:30.408631+0000","last_unstale":"2023-11-26T07:12:31.389565+0000","last_undegraded":"2023-11-26T07:12:31.389565+0000","last_fullsized":"2023-11-26T07:12:31.389565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:45:30.307834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.161608+0000","last_change":"2023-11-26T07:12:30.406660+0000","last_active":"2023-11-26T07:12:32.161608+0000","last_peered":"2023-11-26T07:12:32.161608+0000","last_clean":"2023-11-26T07:12:32.161608+0000","last_became_active":"2023-11-26T07:12:30.406322+0000","last_became_peered":"2023-11-26T07:12:30.406322+0000","last_unstale":"2023-11-26T07:12:32.161608+0000","last_undegraded":"2023-11-26T07:12:32.161608+0000","last_fullsized":"2023-11-26T07:12:32.161608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:17:30.745863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.661146+0000","last_change":"2023-11-26T07:12:30.409687+0000","last_active":"2023-11-26T07:12:31.661146+0000","last_peered":"2023-11-26T07:12:31.661146+0000","last_clean":"2023-11-26T07:12:31.661146+0000","last_became_active":"2023-11-26T07:12:30.409357+0000","last_became_peered":"2023-11-26T07:12:30.409357+0000","last_unstale":"2023-11-26T07:12:31.661146+0000","last_undegraded":"2023-11-26T07:12:31.661146+0000","last_fullsized":"2023-11-26T07:12:31.661146+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:43:20.223243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162443+0000","last_change":"2023-11-26T07:12:30.404308+0000","last_active":"2023-11-26T07:12:32.162443+0000","last_peered":"2023-11-26T07:12:32.162443+0000","last_clean":"2023-11-26T07:12:32.162443+0000","last_became_active":"2023-11-26T07:12:30.403952+0000","last_became_peered":"2023-11-26T07:12:30.403952+0000","last_unstale":"2023-11-26T07:12:32.162443+0000","last_undegraded":"2023-11-26T07:12:32.162443+0000","last_fullsized":"2023-11-26T07:12:32.162443+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:10:28.618472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162098+0000","last_change":"2023-11-26T07:12:30.393700+0000","last_active":"2023-11-26T07:12:32.162098+0000","last_peered":"2023-11-26T07:12:32.162098+0000","last_clean":"2023-11-26T07:12:32.162098+0000","last_became_active":"2023-11-26T07:12:30.393423+0000","last_became_peered":"2023-11-26T07:12:30.393423+0000","last_unstale":"2023-11-26T07:12:32.162098+0000","last_undegraded":"2023-11-26T07:12:32.162098+0000","last_fullsized":"2023-11-26T07:12:32.162098+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:09:57.137824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.661263+0000","last_change":"2023-11-26T07:12:29.390023+0000","last_active":"2023-11-26T07:12:31.661263+0000","last_peered":"2023-11-26T07:12:31.661263+0000","last_clean":"2023-11-26T07:12:31.661263+0000","last_became_active":"2023-11-26T07:12:29.389838+0000","last_became_peered":"2023-11-26T07:12:29.389838+0000","last_unstale":"2023-11-26T07:12:31.661263+0000","last_undegraded":"2023-11-26T07:12:31.661263+0000","last_fullsized":"2023-11-26T07:12:31.661263+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:37:50.879550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.661209+0000","last_change":"2023-11-26T07:12:30.403835+0000","last_active":"2023-11-26T07:12:31.661209+0000","last_peered":"2023-11-26T07:12:31.661209+0000","last_clean":"2023-11-26T07:12:31.661209+0000","last_became_active":"2023-11-26T07:12:30.403548+0000","last_became_peered":"2023-11-26T07:12:30.403548+0000","last_unstale":"2023-11-26T07:12:31.661209+0000","last_undegraded":"2023-11-26T07:12:31.661209+0000","last_fullsized":"2023-11-26T07:12:31.661209+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:53:56.686837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162083+0000","last_change":"2023-11-26T07:12:29.391282+0000","last_active":"2023-11-26T07:12:32.162083+0000","last_peered":"2023-11-26T07:12:32.162083+0000","last_clean":"2023-11-26T07:12:32.162083+0000","last_became_active":"2023-11-26T07:12:29.391022+0000","last_became_peered":"2023-11-26T07:12:29.391022+0000","last_unstale":"2023-11-26T07:12:32.162083+0000","last_undegraded":"2023-11-26T07:12:32.162083+0000","last_fullsized":"2023-11-26T07:12:32.162083+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:14:40.199280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.389316+0000","last_change":"2023-11-26T07:12:30.408872+0000","last_active":"2023-11-26T07:12:31.389316+0000","last_peered":"2023-11-26T07:12:31.389316+0000","last_clean":"2023-11-26T07:12:31.389316+0000","last_became_active":"2023-11-26T07:12:30.408430+0000","last_became_peered":"2023-11-26T07:12:30.408430+0000","last_unstale":"2023-11-26T07:12:31.389316+0000","last_undegraded":"2023-11-26T07:12:31.389316+0000","last_fullsized":"2023-11-26T07:12:31.389316+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:09:57.137824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.386219+0000","last_change":"2023-11-26T07:12:29.389038+0000","last_active":"2023-11-26T07:12:31.386219+0000","last_peered":"2023-11-26T07:12:31.386219+0000","last_clean":"2023-11-26T07:12:31.386219+0000","last_became_active":"2023-11-26T07:12:29.388644+0000","last_became_peered":"2023-11-26T07:12:29.388644+0000","last_unstale":"2023-11-26T07:12:31.386219+0000","last_undegraded":"2023-11-26T07:12:31.386219+0000","last_fullsized":"2023-11-26T07:12:31.386219+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:26:50.015933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.062282+0000","last_change":"2023-11-26T07:12:30.405754+0000","last_active":"2023-11-26T07:12:32.062282+0000","last_peered":"2023-11-26T07:12:32.062282+0000","last_clean":"2023-11-26T07:12:32.062282+0000","last_became_active":"2023-11-26T07:12:30.404989+0000","last_became_peered":"2023-11-26T07:12:30.404989+0000","last_unstale":"2023-11-26T07:12:32.062282+0000","last_undegraded":"2023-11-26T07:12:32.062282+0000","last_fullsized":"2023-11-26T07:12:32.062282+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:26:51.020116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162345+0000","last_change":"2023-11-26T07:12:29.386873+0000","last_active":"2023-11-26T07:12:32.162345+0000","last_peered":"2023-11-26T07:12:32.162345+0000","last_clean":"2023-11-26T07:12:32.162345+0000","last_became_active":"2023-11-26T07:12:29.386558+0000","last_became_peered":"2023-11-26T07:12:29.386558+0000","last_unstale":"2023-11-26T07:12:32.162345+0000","last_undegraded":"2023-11-26T07:12:32.162345+0000","last_fullsized":"2023-11-26T07:12:32.162345+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:18:43.441012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.161778+0000","last_change":"2023-11-26T07:12:30.403176+0000","last_active":"2023-11-26T07:12:32.161778+0000","last_peered":"2023-11-26T07:12:32.161778+0000","last_clean":"2023-11-26T07:12:32.161778+0000","last_became_active":"2023-11-26T07:12:30.402892+0000","last_became_peered":"2023-11-26T07:12:30.402892+0000","last_unstale":"2023-11-26T07:12:32.161778+0000","last_undegraded":"2023-11-26T07:12:32.161778+0000","last_fullsized":"2023-11-26T07:12:32.161778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:47:04.640542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.389621+0000","last_change":"2023-11-26T07:12:29.384555+0000","last_active":"2023-11-26T07:12:31.389621+0000","last_peered":"2023-11-26T07:12:31.389621+0000","last_clean":"2023-11-26T07:12:31.389621+0000","last_became_active":"2023-11-26T07:12:29.384276+0000","last_became_peered":"2023-11-26T07:12:29.384276+0000","last_unstale":"2023-11-26T07:12:31.389621+0000","last_undegraded":"2023-11-26T07:12:31.389621+0000","last_fullsized":"2023-11-26T07:12:31.389621+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:42:15.656581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.161787+0000","last_change":"2023-11-26T07:12:30.393351+0000","last_active":"2023-11-26T07:12:32.161787+0000","last_peered":"2023-11-26T07:12:32.161787+0000","last_clean":"2023-11-26T07:12:32.161787+0000","last_became_active":"2023-11-26T07:12:30.393090+0000","last_became_peered":"2023-11-26T07:12:30.393090+0000","last_unstale":"2023-11-26T07:12:32.161787+0000","last_undegraded":"2023-11-26T07:12:32.161787+0000","last_fullsized":"2023-11-26T07:12:32.161787+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:44:25.640038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.389218+0000","last_change":"2023-11-26T07:12:29.384360+0000","last_active":"2023-11-26T07:12:31.389218+0000","last_peered":"2023-11-26T07:12:31.389218+0000","last_clean":"2023-11-26T07:12:31.389218+0000","last_became_active":"2023-11-26T07:12:29.384093+0000","last_became_peered":"2023-11-26T07:12:29.384093+0000","last_unstale":"2023-11-26T07:12:31.389218+0000","last_undegraded":"2023-11-26T07:12:31.389218+0000","last_fullsized":"2023-11-26T07:12:31.389218+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:32:46.189573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.389050+0000","last_change":"2023-11-26T07:12:30.406536+0000","last_active":"2023-11-26T07:12:31.389050+0000","last_peered":"2023-11-26T07:12:31.389050+0000","last_clean":"2023-11-26T07:12:31.389050+0000","last_became_active":"2023-11-26T07:12:30.405942+0000","last_became_peered":"2023-11-26T07:12:30.405942+0000","last_unstale":"2023-11-26T07:12:31.389050+0000","last_undegraded":"2023-11-26T07:12:31.389050+0000","last_fullsized":"2023-11-26T07:12:31.389050+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:43:20.223243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.385964+0000","last_change":"2023-11-26T07:12:29.383209+0000","last_active":"2023-11-26T07:12:31.385964+0000","last_peered":"2023-11-26T07:12:31.385964+0000","last_clean":"2023-11-26T07:12:31.385964+0000","last_became_active":"2023-11-26T07:12:29.382214+0000","last_became_peered":"2023-11-26T07:12:29.382214+0000","last_unstale":"2023-11-26T07:12:31.385964+0000","last_undegraded":"2023-11-26T07:12:31.385964+0000","last_fullsized":"2023-11-26T07:12:31.385964+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:46:09.895624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.061725+0000","last_change":"2023-11-26T07:12:30.401622+0000","last_active":"2023-11-26T07:12:32.061725+0000","last_peered":"2023-11-26T07:12:32.061725+0000","last_clean":"2023-11-26T07:12:32.061725+0000","last_became_active":"2023-11-26T07:12:30.401388+0000","last_became_peered":"2023-11-26T07:12:30.401388+0000","last_unstale":"2023-11-26T07:12:32.061725+0000","last_undegraded":"2023-11-26T07:12:32.061725+0000","last_fullsized":"2023-11-26T07:12:32.061725+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:51:33.900805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.388929+0000","last_change":"2023-11-26T07:12:29.383860+0000","last_active":"2023-11-26T07:12:31.388929+0000","last_peered":"2023-11-26T07:12:31.388929+0000","last_clean":"2023-11-26T07:12:31.388929+0000","last_became_active":"2023-11-26T07:12:29.383475+0000","last_became_peered":"2023-11-26T07:12:29.383475+0000","last_unstale":"2023-11-26T07:12:31.388929+0000","last_undegraded":"2023-11-26T07:12:31.388929+0000","last_fullsized":"2023-11-26T07:12:31.388929+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:37:50.879550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162330+0000","last_change":"2023-11-26T07:12:30.401538+0000","last_active":"2023-11-26T07:12:32.162330+0000","last_peered":"2023-11-26T07:12:32.162330+0000","last_clean":"2023-11-26T07:12:32.162330+0000","last_became_active":"2023-11-26T07:12:30.401268+0000","last_became_peered":"2023-11-26T07:12:30.401268+0000","last_unstale":"2023-11-26T07:12:32.162330+0000","last_undegraded":"2023-11-26T07:12:32.162330+0000","last_fullsized":"2023-11-26T07:12:32.162330+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:47:51.074571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.386373+0000","last_change":"2023-11-26T07:12:29.390503+0000","last_active":"2023-11-26T07:12:31.386373+0000","last_peered":"2023-11-26T07:12:31.386373+0000","last_clean":"2023-11-26T07:12:31.386373+0000","last_became_active":"2023-11-26T07:12:29.390015+0000","last_became_peered":"2023-11-26T07:12:29.390015+0000","last_unstale":"2023-11-26T07:12:31.386373+0000","last_undegraded":"2023-11-26T07:12:31.386373+0000","last_fullsized":"2023-11-26T07:12:31.386373+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:50:39.716351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.386584+0000","last_change":"2023-11-26T07:12:30.414717+0000","last_active":"2023-11-26T07:12:31.386584+0000","last_peered":"2023-11-26T07:12:31.386584+0000","last_clean":"2023-11-26T07:12:31.386584+0000","last_became_active":"2023-11-26T07:12:30.413444+0000","last_became_peered":"2023-11-26T07:12:30.413444+0000","last_unstale":"2023-11-26T07:12:31.386584+0000","last_undegraded":"2023-11-26T07:12:31.386584+0000","last_fullsized":"2023-11-26T07:12:31.386584+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:07:35.428329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162186+0000","last_change":"2023-11-26T07:12:29.384382+0000","last_active":"2023-11-26T07:12:32.162186+0000","last_peered":"2023-11-26T07:12:32.162186+0000","last_clean":"2023-11-26T07:12:32.162186+0000","last_became_active":"2023-11-26T07:12:29.384086+0000","last_became_peered":"2023-11-26T07:12:29.384086+0000","last_unstale":"2023-11-26T07:12:32.162186+0000","last_undegraded":"2023-11-26T07:12:32.162186+0000","last_fullsized":"2023-11-26T07:12:32.162186+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:24:34.963721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.386377+0000","last_change":"2023-11-26T07:12:30.398978+0000","last_active":"2023-11-26T07:12:31.386377+0000","last_peered":"2023-11-26T07:12:31.386377+0000","last_clean":"2023-11-26T07:12:31.386377+0000","last_became_active":"2023-11-26T07:12:30.398724+0000","last_became_peered":"2023-11-26T07:12:30.398724+0000","last_unstale":"2023-11-26T07:12:31.386377+0000","last_undegraded":"2023-11-26T07:12:31.386377+0000","last_fullsized":"2023-11-26T07:12:31.386377+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:10:28.618472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162563+0000","last_change":"2023-11-26T07:12:29.383650+0000","last_active":"2023-11-26T07:12:32.162563+0000","last_peered":"2023-11-26T07:12:32.162563+0000","last_clean":"2023-11-26T07:12:32.162563+0000","last_became_active":"2023-11-26T07:12:29.383343+0000","last_became_peered":"2023-11-26T07:12:29.383343+0000","last_unstale":"2023-11-26T07:12:32.162563+0000","last_undegraded":"2023-11-26T07:12:32.162563+0000","last_fullsized":"2023-11-26T07:12:32.162563+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:45:29.303651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162463+0000","last_change":"2023-11-26T07:12:30.410892+0000","last_active":"2023-11-26T07:12:32.162463+0000","last_peered":"2023-11-26T07:12:32.162463+0000","last_clean":"2023-11-26T07:12:32.162463+0000","last_became_active":"2023-11-26T07:12:30.410063+0000","last_became_peered":"2023-11-26T07:12:30.410063+0000","last_unstale":"2023-11-26T07:12:32.162463+0000","last_undegraded":"2023-11-26T07:12:32.162463+0000","last_fullsized":"2023-11-26T07:12:32.162463+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:20:46.702320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.386410+0000","last_change":"2023-11-26T07:12:29.390243+0000","last_active":"2023-11-26T07:12:31.386410+0000","last_peered":"2023-11-26T07:12:31.386410+0000","last_clean":"2023-11-26T07:12:31.386410+0000","last_became_active":"2023-11-26T07:12:29.389908+0000","last_became_peered":"2023-11-26T07:12:29.389908+0000","last_unstale":"2023-11-26T07:12:31.386410+0000","last_undegraded":"2023-11-26T07:12:31.386410+0000","last_fullsized":"2023-11-26T07:12:31.386410+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:21:55.452268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.061723+0000","last_change":"2023-11-26T07:12:30.405158+0000","last_active":"2023-11-26T07:12:32.061723+0000","last_peered":"2023-11-26T07:12:32.061723+0000","last_clean":"2023-11-26T07:12:32.061723+0000","last_became_active":"2023-11-26T07:12:30.404878+0000","last_became_peered":"2023-11-26T07:12:30.404878+0000","last_unstale":"2023-11-26T07:12:32.061723+0000","last_undegraded":"2023-11-26T07:12:32.061723+0000","last_fullsized":"2023-11-26T07:12:32.061723+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:46:10.899807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.389668+0000","last_change":"2023-11-26T07:12:29.384017+0000","last_active":"2023-11-26T07:12:31.389668+0000","last_peered":"2023-11-26T07:12:31.389668+0000","last_clean":"2023-11-26T07:12:31.389668+0000","last_became_active":"2023-11-26T07:12:29.383695+0000","last_became_peered":"2023-11-26T07:12:29.383695+0000","last_unstale":"2023-11-26T07:12:31.389668+0000","last_undegraded":"2023-11-26T07:12:31.389668+0000","last_fullsized":"2023-11-26T07:12:31.389668+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:22:16.001138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.386290+0000","last_change":"2023-11-26T07:12:30.397867+0000","last_active":"2023-11-26T07:12:31.386290+0000","last_peered":"2023-11-26T07:12:31.386290+0000","last_clean":"2023-11-26T07:12:31.386290+0000","last_became_active":"2023-11-26T07:12:30.392982+0000","last_became_peered":"2023-11-26T07:12:30.392982+0000","last_unstale":"2023-11-26T07:12:31.386290+0000","last_undegraded":"2023-11-26T07:12:31.386290+0000","last_fullsized":"2023-11-26T07:12:31.386290+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:42:44.921403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.061736+0000","last_change":"2023-11-26T07:12:29.385157+0000","last_active":"2023-11-26T07:12:32.061736+0000","last_peered":"2023-11-26T07:12:32.061736+0000","last_clean":"2023-11-26T07:12:32.061736+0000","last_became_active":"2023-11-26T07:12:29.384906+0000","last_became_peered":"2023-11-26T07:12:29.384906+0000","last_unstale":"2023-11-26T07:12:32.061736+0000","last_undegraded":"2023-11-26T07:12:32.061736+0000","last_fullsized":"2023-11-26T07:12:32.061736+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:46:49.068165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162386+0000","last_change":"2023-11-26T07:12:30.404190+0000","last_active":"2023-11-26T07:12:32.162386+0000","last_peered":"2023-11-26T07:12:32.162386+0000","last_clean":"2023-11-26T07:12:32.162386+0000","last_became_active":"2023-11-26T07:12:30.403606+0000","last_became_peered":"2023-11-26T07:12:30.403606+0000","last_unstale":"2023-11-26T07:12:32.162386+0000","last_undegraded":"2023-11-26T07:12:32.162386+0000","last_fullsized":"2023-11-26T07:12:32.162386+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:42:44.921403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.386053+0000","last_change":"2023-11-26T07:12:29.386048+0000","last_active":"2023-11-26T07:12:31.386053+0000","last_peered":"2023-11-26T07:12:31.386053+0000","last_clean":"2023-11-26T07:12:31.386053+0000","last_became_active":"2023-11-26T07:12:29.385713+0000","last_became_peered":"2023-11-26T07:12:29.385713+0000","last_unstale":"2023-11-26T07:12:31.386053+0000","last_undegraded":"2023-11-26T07:12:31.386053+0000","last_fullsized":"2023-11-26T07:12:31.386053+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:17:29.741680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.661097+0000","last_change":"2023-11-26T07:12:30.408448+0000","last_active":"2023-11-26T07:12:31.661097+0000","last_peered":"2023-11-26T07:12:31.661097+0000","last_clean":"2023-11-26T07:12:31.661097+0000","last_became_active":"2023-11-26T07:12:30.407942+0000","last_became_peered":"2023-11-26T07:12:30.407942+0000","last_unstale":"2023-11-26T07:12:31.661097+0000","last_undegraded":"2023-11-26T07:12:31.661097+0000","last_fullsized":"2023-11-26T07:12:31.661097+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:23:48.522291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.386589+0000","last_change":"2023-11-26T07:12:29.390346+0000","last_active":"2023-11-26T07:12:31.386589+0000","last_peered":"2023-11-26T07:12:31.386589+0000","last_clean":"2023-11-26T07:12:31.386589+0000","last_became_active":"2023-11-26T07:12:29.389968+0000","last_became_peered":"2023-11-26T07:12:29.389968+0000","last_unstale":"2023-11-26T07:12:31.386589+0000","last_undegraded":"2023-11-26T07:12:31.386589+0000","last_fullsized":"2023-11-26T07:12:31.386589+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:16:07.180244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.389309+0000","last_change":"2023-11-26T07:12:30.401973+0000","last_active":"2023-11-26T07:12:31.389309+0000","last_peered":"2023-11-26T07:12:31.389309+0000","last_clean":"2023-11-26T07:12:31.389309+0000","last_became_active":"2023-11-26T07:12:30.401699+0000","last_became_peered":"2023-11-26T07:12:30.401699+0000","last_unstale":"2023-11-26T07:12:31.389309+0000","last_undegraded":"2023-11-26T07:12:31.389309+0000","last_fullsized":"2023-11-26T07:12:31.389309+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:53:56.686837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.062237+0000","last_change":"2023-11-26T07:12:29.388991+0000","last_active":"2023-11-26T07:12:32.062237+0000","last_peered":"2023-11-26T07:12:32.062237+0000","last_clean":"2023-11-26T07:12:32.062237+0000","last_became_active":"2023-11-26T07:12:29.388640+0000","last_became_peered":"2023-11-26T07:12:29.388640+0000","last_unstale":"2023-11-26T07:12:32.062237+0000","last_undegraded":"2023-11-26T07:12:32.062237+0000","last_fullsized":"2023-11-26T07:12:32.062237+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:03:17.543886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162509+0000","last_change":"2023-11-26T07:12:30.403710+0000","last_active":"2023-11-26T07:12:32.162509+0000","last_peered":"2023-11-26T07:12:32.162509+0000","last_clean":"2023-11-26T07:12:32.162509+0000","last_became_active":"2023-11-26T07:12:30.403431+0000","last_became_peered":"2023-11-26T07:12:30.403431+0000","last_unstale":"2023-11-26T07:12:32.162509+0000","last_undegraded":"2023-11-26T07:12:32.162509+0000","last_fullsized":"2023-11-26T07:12:32.162509+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:42:44.921403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.389475+0000","last_change":"2023-11-26T07:12:29.383912+0000","last_active":"2023-11-26T07:12:31.389475+0000","last_peered":"2023-11-26T07:12:31.389475+0000","last_clean":"2023-11-26T07:12:31.389475+0000","last_became_active":"2023-11-26T07:12:29.383538+0000","last_became_peered":"2023-11-26T07:12:29.383538+0000","last_unstale":"2023-11-26T07:12:31.389475+0000","last_undegraded":"2023-11-26T07:12:31.389475+0000","last_fullsized":"2023-11-26T07:12:31.389475+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:24:34.963721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.062099+0000","last_change":"2023-11-26T07:12:30.403520+0000","last_active":"2023-11-26T07:12:32.062099+0000","last_peered":"2023-11-26T07:12:32.062099+0000","last_clean":"2023-11-26T07:12:32.062099+0000","last_became_active":"2023-11-26T07:12:30.403130+0000","last_became_peered":"2023-11-26T07:12:30.403130+0000","last_unstale":"2023-11-26T07:12:32.062099+0000","last_undegraded":"2023-11-26T07:12:32.062099+0000","last_fullsized":"2023-11-26T07:12:32.062099+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:17:30.745863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.389577+0000","last_change":"2023-11-26T07:12:29.381996+0000","last_active":"2023-11-26T07:12:31.389577+0000","last_peered":"2023-11-26T07:12:31.389577+0000","last_clean":"2023-11-26T07:12:31.389577+0000","last_became_active":"2023-11-26T07:12:29.381703+0000","last_became_peered":"2023-11-26T07:12:29.381703+0000","last_unstale":"2023-11-26T07:12:31.389577+0000","last_undegraded":"2023-11-26T07:12:31.389577+0000","last_fullsized":"2023-11-26T07:12:31.389577+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:03:17.543886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162684+0000","last_change":"2023-11-26T07:12:30.396832+0000","last_active":"2023-11-26T07:12:32.162684+0000","last_peered":"2023-11-26T07:12:32.162684+0000","last_clean":"2023-11-26T07:12:32.162684+0000","last_became_active":"2023-11-26T07:12:30.396528+0000","last_became_peered":"2023-11-26T07:12:30.396528+0000","last_unstale":"2023-11-26T07:12:32.162684+0000","last_undegraded":"2023-11-26T07:12:32.162684+0000","last_fullsized":"2023-11-26T07:12:32.162684+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:09:36.174557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.389369+0000","last_change":"2023-11-26T07:12:29.388801+0000","last_active":"2023-11-26T07:12:31.389369+0000","last_peered":"2023-11-26T07:12:31.389369+0000","last_clean":"2023-11-26T07:12:31.389369+0000","last_became_active":"2023-11-26T07:12:29.388511+0000","last_became_peered":"2023-11-26T07:12:29.388511+0000","last_unstale":"2023-11-26T07:12:31.389369+0000","last_undegraded":"2023-11-26T07:12:31.389369+0000","last_fullsized":"2023-11-26T07:12:31.389369+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:14:40.199280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162331+0000","last_change":"2023-11-26T07:12:30.402194+0000","last_active":"2023-11-26T07:12:32.162331+0000","last_peered":"2023-11-26T07:12:32.162331+0000","last_clean":"2023-11-26T07:12:32.162331+0000","last_became_active":"2023-11-26T07:12:30.401878+0000","last_became_peered":"2023-11-26T07:12:30.401878+0000","last_unstale":"2023-11-26T07:12:32.162331+0000","last_undegraded":"2023-11-26T07:12:32.162331+0000","last_fullsized":"2023-11-26T07:12:32.162331+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:33:29.419133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.161877+0000","last_change":"2023-11-26T07:12:29.386385+0000","last_active":"2023-11-26T07:12:32.161877+0000","last_peered":"2023-11-26T07:12:32.161877+0000","last_clean":"2023-11-26T07:12:32.161877+0000","last_became_active":"2023-11-26T07:12:29.386074+0000","last_became_peered":"2023-11-26T07:12:29.386074+0000","last_unstale":"2023-11-26T07:12:32.161877+0000","last_undegraded":"2023-11-26T07:12:32.161877+0000","last_fullsized":"2023-11-26T07:12:32.161877+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:32:19.358509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162430+0000","last_change":"2023-11-26T07:12:30.398334+0000","last_active":"2023-11-26T07:12:32.162430+0000","last_peered":"2023-11-26T07:12:32.162430+0000","last_clean":"2023-11-26T07:12:32.162430+0000","last_became_active":"2023-11-26T07:12:30.397829+0000","last_became_peered":"2023-11-26T07:12:30.397829+0000","last_unstale":"2023-11-26T07:12:32.162430+0000","last_undegraded":"2023-11-26T07:12:32.162430+0000","last_fullsized":"2023-11-26T07:12:32.162430+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:08:24.944701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.661090+0000","last_change":"2023-11-26T07:12:29.388436+0000","last_active":"2023-11-26T07:12:31.661090+0000","last_peered":"2023-11-26T07:12:31.661090+0000","last_clean":"2023-11-26T07:12:31.661090+0000","last_became_active":"2023-11-26T07:12:29.388156+0000","last_became_peered":"2023-11-26T07:12:29.388156+0000","last_unstale":"2023-11-26T07:12:31.661090+0000","last_undegraded":"2023-11-26T07:12:31.661090+0000","last_fullsized":"2023-11-26T07:12:31.661090+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:03:17.543886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.161866+0000","last_change":"2023-11-26T07:12:30.397083+0000","last_active":"2023-11-26T07:12:32.161866+0000","last_peered":"2023-11-26T07:12:32.161866+0000","last_clean":"2023-11-26T07:12:32.161866+0000","last_became_active":"2023-11-26T07:12:30.396611+0000","last_became_peered":"2023-11-26T07:12:30.396611+0000","last_unstale":"2023-11-26T07:12:32.161866+0000","last_undegraded":"2023-11-26T07:12:32.161866+0000","last_fullsized":"2023-11-26T07:12:32.161866+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:47:21.180588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.389057+0000","last_change":"2023-11-26T07:12:29.380747+0000","last_active":"2023-11-26T07:12:31.389057+0000","last_peered":"2023-11-26T07:12:31.389057+0000","last_clean":"2023-11-26T07:12:31.389057+0000","last_became_active":"2023-11-26T07:12:29.380458+0000","last_became_peered":"2023-11-26T07:12:29.380458+0000","last_unstale":"2023-11-26T07:12:31.389057+0000","last_undegraded":"2023-11-26T07:12:31.389057+0000","last_fullsized":"2023-11-26T07:12:31.389057+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:51:46.685590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.161814+0000","last_change":"2023-11-26T07:12:30.406823+0000","last_active":"2023-11-26T07:12:32.161814+0000","last_peered":"2023-11-26T07:12:32.161814+0000","last_clean":"2023-11-26T07:12:32.161814+0000","last_became_active":"2023-11-26T07:12:30.406250+0000","last_became_peered":"2023-11-26T07:12:30.406250+0000","last_unstale":"2023-11-26T07:12:32.161814+0000","last_undegraded":"2023-11-26T07:12:32.161814+0000","last_fullsized":"2023-11-26T07:12:32.161814+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:26:51.020116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.161678+0000","last_change":"2023-11-26T07:12:29.390015+0000","last_active":"2023-11-26T07:12:32.161678+0000","last_peered":"2023-11-26T07:12:32.161678+0000","last_clean":"2023-11-26T07:12:32.161678+0000","last_became_active":"2023-11-26T07:12:29.389686+0000","last_became_peered":"2023-11-26T07:12:29.389686+0000","last_unstale":"2023-11-26T07:12:32.161678+0000","last_undegraded":"2023-11-26T07:12:32.161678+0000","last_fullsized":"2023-11-26T07:12:32.161678+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:32:46.189573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162393+0000","last_change":"2023-11-26T07:12:30.401291+0000","last_active":"2023-11-26T07:12:32.162393+0000","last_peered":"2023-11-26T07:12:32.162393+0000","last_clean":"2023-11-26T07:12:32.162393+0000","last_became_active":"2023-11-26T07:12:30.400976+0000","last_became_peered":"2023-11-26T07:12:30.400976+0000","last_unstale":"2023-11-26T07:12:32.162393+0000","last_undegraded":"2023-11-26T07:12:32.162393+0000","last_fullsized":"2023-11-26T07:12:32.162393+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:33:17.829630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.062119+0000","last_change":"2023-11-26T07:12:29.391654+0000","last_active":"2023-11-26T07:12:32.062119+0000","last_peered":"2023-11-26T07:12:32.062119+0000","last_clean":"2023-11-26T07:12:32.062119+0000","last_became_active":"2023-11-26T07:12:29.390570+0000","last_became_peered":"2023-11-26T07:12:29.390570+0000","last_unstale":"2023-11-26T07:12:32.062119+0000","last_undegraded":"2023-11-26T07:12:32.062119+0000","last_fullsized":"2023-11-26T07:12:32.062119+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:37:50.879550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162635+0000","last_change":"2023-11-26T07:12:30.409856+0000","last_active":"2023-11-26T07:12:32.162635+0000","last_peered":"2023-11-26T07:12:32.162635+0000","last_clean":"2023-11-26T07:12:32.162635+0000","last_became_active":"2023-11-26T07:12:30.409541+0000","last_became_peered":"2023-11-26T07:12:30.409541+0000","last_unstale":"2023-11-26T07:12:32.162635+0000","last_undegraded":"2023-11-26T07:12:32.162635+0000","last_fullsized":"2023-11-26T07:12:32.162635+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:10:28.618472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.162194+0000","last_change":"2023-11-26T07:12:29.386207+0000","last_active":"2023-11-26T07:12:32.162194+0000","last_peered":"2023-11-26T07:12:32.162194+0000","last_clean":"2023-11-26T07:12:32.162194+0000","last_became_active":"2023-11-26T07:12:29.385912+0000","last_became_peered":"2023-11-26T07:12:29.385912+0000","last_unstale":"2023-11-26T07:12:32.162194+0000","last_undegraded":"2023-11-26T07:12:32.162194+0000","last_fullsized":"2023-11-26T07:12:32.162194+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:32:46.189573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.161914+0000","last_change":"2023-11-26T07:12:30.406090+0000","last_active":"2023-11-26T07:12:32.161914+0000","last_peered":"2023-11-26T07:12:32.161914+0000","last_clean":"2023-11-26T07:12:32.161914+0000","last_became_active":"2023-11-26T07:12:30.405808+0000","last_became_peered":"2023-11-26T07:12:30.405808+0000","last_unstale":"2023-11-26T07:12:32.161914+0000","last_undegraded":"2023-11-26T07:12:32.161914+0000","last_fullsized":"2023-11-26T07:12:32.161914+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:46:50.072348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.061972+0000","last_change":"2023-11-26T07:12:29.386445+0000","last_active":"2023-11-26T07:12:32.061972+0000","last_peered":"2023-11-26T07:12:32.061972+0000","last_clean":"2023-11-26T07:12:32.061972+0000","last_became_active":"2023-11-26T07:12:29.386164+0000","last_became_peered":"2023-11-26T07:12:29.386164+0000","last_unstale":"2023-11-26T07:12:32.061972+0000","last_undegraded":"2023-11-26T07:12:32.061972+0000","last_fullsized":"2023-11-26T07:12:32.061972+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:32:46.189573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.661074+0000","last_change":"2023-11-26T07:12:30.414698+0000","last_active":"2023-11-26T07:12:31.661074+0000","last_peered":"2023-11-26T07:12:31.661074+0000","last_clean":"2023-11-26T07:12:31.661074+0000","last_became_active":"2023-11-26T07:12:30.414364+0000","last_became_peered":"2023-11-26T07:12:30.414364+0000","last_unstale":"2023-11-26T07:12:31.661074+0000","last_undegraded":"2023-11-26T07:12:31.661074+0000","last_fullsized":"2023-11-26T07:12:31.661074+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:32:47.193756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.161815+0000","last_change":"2023-11-26T07:12:29.390248+0000","last_active":"2023-11-26T07:12:32.161815+0000","last_peered":"2023-11-26T07:12:32.161815+0000","last_clean":"2023-11-26T07:12:32.161815+0000","last_became_active":"2023-11-26T07:12:29.389868+0000","last_became_peered":"2023-11-26T07:12:29.389868+0000","last_unstale":"2023-11-26T07:12:32.161815+0000","last_undegraded":"2023-11-26T07:12:32.161815+0000","last_fullsized":"2023-11-26T07:12:32.161815+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:51:46.685590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.161984+0000","last_change":"2023-11-26T07:12:30.406766+0000","last_active":"2023-11-26T07:12:32.161984+0000","last_peered":"2023-11-26T07:12:32.161984+0000","last_clean":"2023-11-26T07:12:32.161984+0000","last_became_active":"2023-11-26T07:12:30.406470+0000","last_became_peered":"2023-11-26T07:12:30.406470+0000","last_unstale":"2023-11-26T07:12:32.161984+0000","last_undegraded":"2023-11-26T07:12:32.161984+0000","last_fullsized":"2023-11-26T07:12:32.161984+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:53:56.686837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.062033+0000","last_change":"2023-11-26T07:12:29.391354+0000","last_active":"2023-11-26T07:12:32.062033+0000","last_peered":"2023-11-26T07:12:32.062033+0000","last_clean":"2023-11-26T07:12:32.062033+0000","last_became_active":"2023-11-26T07:12:29.391047+0000","last_became_peered":"2023-11-26T07:12:29.391047+0000","last_unstale":"2023-11-26T07:12:32.062033+0000","last_undegraded":"2023-11-26T07:12:32.062033+0000","last_fullsized":"2023-11-26T07:12:32.062033+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:53:55.682654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.386089+0000","last_change":"2023-11-26T07:12:30.406772+0000","last_active":"2023-11-26T07:12:31.386089+0000","last_peered":"2023-11-26T07:12:31.386089+0000","last_clean":"2023-11-26T07:12:31.386089+0000","last_became_active":"2023-11-26T07:12:30.405775+0000","last_became_peered":"2023-11-26T07:12:30.405775+0000","last_unstale":"2023-11-26T07:12:31.386089+0000","last_undegraded":"2023-11-26T07:12:31.386089+0000","last_fullsized":"2023-11-26T07:12:31.386089+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:47:51.074571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.389132+0000","last_change":"2023-11-26T07:12:29.382306+0000","last_active":"2023-11-26T07:12:31.389132+0000","last_peered":"2023-11-26T07:12:31.389132+0000","last_clean":"2023-11-26T07:12:31.389132+0000","last_became_active":"2023-11-26T07:12:29.382013+0000","last_became_peered":"2023-11-26T07:12:29.382013+0000","last_unstale":"2023-11-26T07:12:31.389132+0000","last_undegraded":"2023-11-26T07:12:31.389132+0000","last_fullsized":"2023-11-26T07:12:31.389132+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:32:19.358509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.388993+0000","last_change":"2023-11-26T07:12:30.408741+0000","last_active":"2023-11-26T07:12:31.388993+0000","last_peered":"2023-11-26T07:12:31.388993+0000","last_clean":"2023-11-26T07:12:31.388993+0000","last_became_active":"2023-11-26T07:12:30.408443+0000","last_became_peered":"2023-11-26T07:12:30.408443+0000","last_unstale":"2023-11-26T07:12:31.388993+0000","last_undegraded":"2023-11-26T07:12:31.388993+0000","last_fullsized":"2023-11-26T07:12:31.388993+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:23:48.522291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.385909+0000","last_change":"2023-11-26T07:12:29.385800+0000","last_active":"2023-11-26T07:12:31.385909+0000","last_peered":"2023-11-26T07:12:31.385909+0000","last_clean":"2023-11-26T07:12:31.385909+0000","last_became_active":"2023-11-26T07:12:29.385539+0000","last_became_peered":"2023-11-26T07:12:29.385539+0000","last_unstale":"2023-11-26T07:12:31.385909+0000","last_undegraded":"2023-11-26T07:12:31.385909+0000","last_fullsized":"2023-11-26T07:12:31.385909+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:44:24.635855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:32.161942+0000","last_change":"2023-11-26T07:12:30.398581+0000","last_active":"2023-11-26T07:12:32.161942+0000","last_peered":"2023-11-26T07:12:32.161942+0000","last_clean":"2023-11-26T07:12:32.161942+0000","last_became_active":"2023-11-26T07:12:30.398005+0000","last_became_peered":"2023-11-26T07:12:30.398005+0000","last_unstale":"2023-11-26T07:12:32.161942+0000","last_undegraded":"2023-11-26T07:12:32.161942+0000","last_fullsized":"2023-11-26T07:12:32.161942+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:29.364679+0000","last_clean_scrub_stamp":"2023-11-26T07:12:29.364679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:50:40.720534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-26T07:12:31.661068+0000","last_change":"2023-11-26T07:12:29.383624+0000","last_active":"2023-11-26T07:12:31.661068+0000","last_peered":"2023-11-26T07:12:31.661068+0000","last_clean":"2023-11-26T07:12:31.661068+0000","last_became_active":"2023-11-26T07:12:29.383342+0000","last_became_peered":"2023-11-26T07:12:29.383342+0000","last_unstale":"2023-11-26T07:12:31.661068+0000","last_undegraded":"2023-11-26T07:12:31.661068+0000","last_fullsized":"2023-11-26T07:12:31.661068+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:12:28.360496+0000","last_clean_scrub_stamp":"2023-11-26T07:12:28.360496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:24:34.963721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-26T07:12:30.388559+0000","last_change":"2023-11-26T07:11:29.855919+0000","last_active":"2023-11-26T07:12:30.388559+0000","last_peered":"2023-11-26T07:12:30.388559+0000","last_clean":"2023-11-26T07:12:30.388559+0000","last_became_active":"2023-11-26T07:11:29.854903+0000","last_became_peered":"2023-11-26T07:11:29.854903+0000","last_unstale":"2023-11-26T07:12:30.388559+0000","last_undegraded":"2023-11-26T07:12:30.388559+0000","last_fullsized":"2023-11-26T07:12:30.388559+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:28.594252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:28.594252+0000","last_clean_scrub_stamp":"2023-11-26T07:11:28.594252+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:33:34.642696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":946176,"data_stored":722931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.48899999999999999}]},{"osd":1,"last update":"Sun Nov 26 07:12:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":9.5600000000000005,"5min":9.5600000000000005,"15min":9.5600000000000005},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.63}]},{"osd":2,"last update":"Sun Nov 26 07:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.70199999999999996}]},{"osd":3,"last update":"Sun Nov 26 07:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.75700000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.73399999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.77400000000000002}]},{"osd":6,"last update":"Sun Nov 26 07:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.78900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":139389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.81200000000000006}]},{"osd":1,"last update":"Sun Nov 26 07:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.751}]},{"osd":2,"last update":"Sun Nov 26 07:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.67300000000000004}]},{"osd":3,"last update":"Sun Nov 26 07:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.89200000000000002}]},{"osd":4,"last update":"Sun Nov 26 07:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.52200000000000002}]},{"osd":5,"last update":"Sun Nov 26 07:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.69499999999999995}]},{"osd":7,"last update":"Sun Nov 26 07:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.72399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":364544,"data_stored":134107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":11.922000000000001,"5min":11.922000000000001,"15min":11.922000000000001},"last":0.35899999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.41299999999999998}]},{"osd":3,"last update":"Sun Nov 26 07:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.48499999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":6.8979999999999997,"5min":6.8979999999999997,"15min":6.8979999999999997},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.78500000000000003}]},{"osd":5,"last update":"Sun Nov 26 07:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":6.9480000000000004,"5min":6.9480000000000004,"15min":6.9480000000000004},"last":0.63600000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.748},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":6.9800000000000004,"5min":6.9800000000000004,"15min":6.9800000000000004},"last":0.76300000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.61099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":942080,"data_stored":722841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":11.987,"5min":11.987,"15min":11.987},"last":0.33400000000000002}]},{"osd":2,"last update":"Sun Nov 26 07:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.376},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.41399999999999998}]},{"osd":3,"last update":"Sun Nov 26 07:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.442}]},{"osd":4,"last update":"Sun Nov 26 07:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":6.5279999999999996,"5min":6.5279999999999996,"15min":6.5279999999999996},"last":0.61499999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.72599999999999998}]},{"osd":6,"last update":"Sun Nov 26 07:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":6.5419999999999998,"5min":6.5419999999999998,"15min":6.5419999999999998},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.80400000000000005}]},{"osd":7,"last update":"Sun Nov 26 07:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.68600000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":132543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.378}]},{"osd":1,"last update":"Sun Nov 26 07:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.46000000000000002}]},{"osd":3,"last update":"Sun Nov 26 07:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.316}]},{"osd":4,"last update":"Sun Nov 26 07:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.496},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.59399999999999997}]},{"osd":5,"last update":"Sun Nov 26 07:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.53500000000000003}]},{"osd":6,"last update":"Sun Nov 26 07:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.48699999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.61699999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":140407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.44900000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.38},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":2.903,"5min":2.903,"15min":2.903},"last":0.36299999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.42399999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.9609999999999999,"5min":2.9609999999999999,"15min":2.9609999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.71999999999999997}]},{"osd":5,"last update":"Sun Nov 26 07:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.70399999999999996}]},{"osd":6,"last update":"Sun Nov 26 07:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.92400000000000004}]},{"osd":7,"last update":"Sun Nov 26 07:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.9969999999999999,"5min":2.9969999999999999,"15min":2.9969999999999999},"last":0.85699999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":138877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:12:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":8.7539999999999996,"5min":8.7539999999999996,"15min":8.7539999999999996},"last":0.71199999999999997},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":8.7390000000000008,"5min":8.7390000000000008,"15min":8.7390000000000008},"last":0.75600000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:12:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":9.7720000000000002,"5min":9.7720000000000002,"15min":9.7720000000000002},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.78300000000000003}]},{"osd":2,"last update":"Sun Nov 26 07:12:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":9.8119999999999994,"5min":9.8119999999999994,"15min":9.8119999999999994},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":3.645,"5min":3.645,"15min":3.645},"last":0.72699999999999998}]},{"osd":3,"last update":"Sun Nov 26 07:12:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":8.8089999999999993,"5min":8.8089999999999993,"15min":8.8089999999999993},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.745}]},{"osd":5,"last update":"Sun Nov 26 07:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.59799999999999998}]},{"osd":6,"last update":"Sun Nov 26 07:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.621}]},{"osd":7,"last update":"Sun Nov 26 07:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.68799999999999994}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":133145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.496}]},{"osd":1,"last update":"Sun Nov 26 07:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.41999999999999998}]},{"osd":2,"last update":"Sun Nov 26 07:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.38800000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.372},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.51600000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.504}]},{"osd":6,"last update":"Sun Nov 26 07:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.44600000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:12:27 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.53400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:12:34.948 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-26T07:12:34.949 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-26T07:12:35.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.114+0000 7f35fc28c700 1 Processor -- start 2023-11-26T07:12:35.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.114+0000 7f35fc28c700 1 -- start start 2023-11-26T07:12:35.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.115+0000 7f35fc28c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f35f40cf2b0 0x7f35f415c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:35.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.115+0000 7f35fc28c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f35f40ce5c0 0x7f35f40cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:35.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.115+0000 7f35fc28c700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35f40d0a90 con 0x7f35f415bde0 2023-11-26T07:12:35.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.115+0000 7f35fc28c700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35f40cef70 con 0x7f35f40ce5c0 2023-11-26T07:12:35.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.115+0000 7f35fc28c700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35f406ee10 con 0x7f35f40cf2b0 2023-11-26T07:12:35.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.115+0000 7f35fa829700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f35f40ce5c0 0x7f35f40cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:35.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.115+0000 7f35fa829700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f35f40ce5c0 0x7f35f40cea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40934/0 (socket says 172.21.15.2:40934) 2023-11-26T07:12:35.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.115+0000 7f35fa829700 1 -- 172.21.15.2:0/3906727069 learned_addr learned my addr 172.21.15.2:0/3906727069 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:35.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.115+0000 7f35f9827700 1 --2- 172.21.15.2:0/3906727069 >> v2:172.21.15.192:3300/0 conn(0x7f35f40cf2b0 0x7f35f415c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:35.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.116+0000 7f35fa829700 1 -- 172.21.15.2:0/3906727069 >> v2:172.21.15.192:3300/0 conn(0x7f35f40cf2b0 msgr2=0x7f35f415c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:35.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.116+0000 7f35fa829700 1 --2- 172.21.15.2:0/3906727069 >> v2:172.21.15.192:3300/0 conn(0x7f35f40cf2b0 0x7f35f415c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:35.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.116+0000 7f35fa829700 1 -- 172.21.15.2:0/3906727069 >> v1:172.21.15.192:6789/0 conn(0x7f35f415bde0 legacy=0x7f35f40d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:35.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.116+0000 7f35fa829700 1 -- 172.21.15.2:0/3906727069 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f406f0f0 con 0x7f35f40ce5c0 2023-11-26T07:12:35.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.116+0000 7f35fa829700 1 --2- 172.21.15.2:0/3906727069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35f40ce5c0 0x7f35f40cea30 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f35f406e780 tx=0x7f35ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da7125288abbe7c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:35.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.116+0000 7f35f9026700 1 -- 172.21.15.2:0/3906727069 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ec00e070 con 0x7f35f40ce5c0 2023-11-26T07:12:35.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.116+0000 7f35f9026700 1 -- 172.21.15.2:0/3906727069 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35ec00b910 con 0x7f35f40ce5c0 2023-11-26T07:12:35.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.116+0000 7f35f9026700 1 -- 172.21.15.2:0/3906727069 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ec00bcc0 con 0x7f35f40ce5c0 2023-11-26T07:12:35.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.116+0000 7f35fc28c700 1 -- 172.21.15.2:0/3906727069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35f40ce5c0 msgr2=0x7f35f40cea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:35.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.116+0000 7f35fc28c700 1 --2- 172.21.15.2:0/3906727069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35f40ce5c0 0x7f35f40cea30 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f35f406e780 tx=0x7f35ec00b330 comp rx=0 tx=0).stop 2023-11-26T07:12:35.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.117+0000 7f35fc28c700 1 -- 172.21.15.2:0/3906727069 shutdown_connections 2023-11-26T07:12:35.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.117+0000 7f35fc28c700 1 --2- 172.21.15.2:0/3906727069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35f40ce5c0 0x7f35f40cea30 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:35.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.117+0000 7f35fc28c700 1 --2- 172.21.15.2:0/3906727069 >> v2:172.21.15.192:3300/0 conn(0x7f35f40cf2b0 0x7f35f415c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:35.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.117+0000 7f35fc28c700 1 -- 172.21.15.2:0/3906727069 >> 172.21.15.2:0/3906727069 conn(0x7f35f40b3720 msgr2=0x7f35f40b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:35.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.117+0000 7f35fc28c700 1 -- 172.21.15.2:0/3906727069 shutdown_connections 2023-11-26T07:12:35.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.117+0000 7f35fc28c700 1 -- 172.21.15.2:0/3906727069 wait complete. 2023-11-26T07:12:35.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.118+0000 7f35fc28c700 1 Processor -- start 2023-11-26T07:12:35.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.118+0000 7f35fc28c700 1 -- start start 2023-11-26T07:12:35.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.119+0000 7f35fc28c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35f40ce5c0 0x7f35f40c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:35.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.119+0000 7f35fc28c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f35f40cf2b0 0x7f35f4157510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:35.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.119+0000 7f35fc28c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35f415bde0 0x7f35f40cb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:35.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.119+0000 7f35fc28c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f41f3ad0 con 0x7f35f40ce5c0 2023-11-26T07:12:35.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.119+0000 7f35fc28c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f41f2ec0 con 0x7f35f415bde0 2023-11-26T07:12:35.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.119+0000 7f35fc28c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f41f31a0 con 0x7f35f40cf2b0 2023-11-26T07:12:35.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.119+0000 7f35fa028700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35f40ce5c0 0x7f35f40c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:35.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.119+0000 7f35fa028700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35f40ce5c0 0x7f35f40c7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40936/0 (socket says 172.21.15.2:40936) 2023-11-26T07:12:35.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.119+0000 7f35fa028700 1 -- 172.21.15.2:0/3602149393 learned_addr learned my addr 172.21.15.2:0/3602149393 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:35.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.119+0000 7f35fa829700 1 --2- 172.21.15.2:0/3602149393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35f415bde0 0x7f35f40cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:35.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.119+0000 7f35f9827700 1 --2- 172.21.15.2:0/3602149393 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f35f40cf2b0 0x7f35f4157510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:35.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.119+0000 7f35fa028700 1 -- 172.21.15.2:0/3602149393 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f35f40cf2b0 msgr2=0x7f35f4157510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:35.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.119+0000 7f35fa028700 1 --2- 172.21.15.2:0/3602149393 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f35f40cf2b0 0x7f35f4157510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:35.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.119+0000 7f35fa028700 1 -- 172.21.15.2:0/3602149393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35f415bde0 msgr2=0x7f35f40cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:35.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.119+0000 7f35fa028700 1 --2- 172.21.15.2:0/3602149393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35f415bde0 0x7f35f40cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:35.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.119+0000 7f35fa028700 1 -- 172.21.15.2:0/3602149393 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35ec009b30 con 0x7f35f40ce5c0 2023-11-26T07:12:35.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.119+0000 7f35fa028700 1 --2- 172.21.15.2:0/3602149393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35f40ce5c0 0x7f35f40c7f40 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f35e400c450 tx=0x7f35e400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:35.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.119+0000 7f35eaffd700 1 -- 172.21.15.2:0/3602149393 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e40052d0 con 0x7f35f40ce5c0 2023-11-26T07:12:35.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.119+0000 7f35eaffd700 1 -- 172.21.15.2:0/3602149393 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e4005430 con 0x7f35f40ce5c0 2023-11-26T07:12:35.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.119+0000 7f35fc28c700 1 -- 172.21.15.2:0/3602149393 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35f41f3480 con 0x7f35f40ce5c0 2023-11-26T07:12:35.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.119+0000 7f35eaffd700 1 -- 172.21.15.2:0/3602149393 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e40038c0 con 0x7f35f40ce5c0 2023-11-26T07:12:35.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.119+0000 7f35fc28c700 1 -- 172.21.15.2:0/3602149393 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35f41f2a70 con 0x7f35f40ce5c0 2023-11-26T07:12:35.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.120+0000 7f35fc28c700 1 -- 172.21.15.2:0/3602149393 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35f41f3db0 con 0x7f35f40ce5c0 2023-11-26T07:12:35.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.121+0000 7f35eaffd700 1 -- 172.21.15.2:0/3602149393 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f35e4003a20 con 0x7f35f40ce5c0 2023-11-26T07:12:35.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.121+0000 7f35eaffd700 1 --2- 172.21.15.2:0/3602149393 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f35d806af00 0x7f35d806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:35.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.121+0000 7f35eaffd700 1 -- 172.21.15.2:0/3602149393 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f35e40888c0 con 0x7f35f40ce5c0 2023-11-26T07:12:35.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.121+0000 7f35f9827700 1 --2- 172.21.15.2:0/3602149393 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f35d806af00 0x7f35d806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:35.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.122+0000 7f35f9827700 1 --2- 172.21.15.2:0/3602149393 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f35d806af00 0x7f35d806d3c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f35f40cf710 tx=0x7f35f0009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:35.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.126+0000 7f35eaffd700 1 -- 172.21.15.2:0/3602149393 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f35e4053970 con 0x7f35f40ce5c0 2023-11-26T07:12:35.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.415+0000 7f35fc28c700 1 -- 172.21.15.2:0/3602149393 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f35f4075480 con 0x7f35f40ce5c0 2023-11-26T07:12:35.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.416+0000 7f35eaffd700 1 -- 172.21.15.2:0/3602149393 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7f35e40170e0 con 0x7f35f40ce5c0 2023-11-26T07:12:35.418 INFO:teuthology.orchestra.run.smithi002.stdout:[client.0] 2023-11-26T07:12:35.418 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBv72JlaEgQKxAA4cVx4nUFgqn0HvVBJdVHVg== 2023-11-26T07:12:35.419 INFO:teuthology.orchestra.run.smithi002.stdout: caps mds = "allow" 2023-11-26T07:12:35.419 INFO:teuthology.orchestra.run.smithi002.stdout: caps mon = "allow r" 2023-11-26T07:12:35.419 INFO:teuthology.orchestra.run.smithi002.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-26T07:12:35.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.419+0000 7f35fc28c700 1 -- 172.21.15.2:0/3602149393 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f35d806af00 msgr2=0x7f35d806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:35.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.419+0000 7f35fc28c700 1 --2- 172.21.15.2:0/3602149393 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f35d806af00 0x7f35d806d3c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f35f40cf710 tx=0x7f35f0009210 comp rx=0 tx=0).stop 2023-11-26T07:12:35.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.419+0000 7f35fc28c700 1 -- 172.21.15.2:0/3602149393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35f40ce5c0 msgr2=0x7f35f40c7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:35.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.419+0000 7f35fc28c700 1 --2- 172.21.15.2:0/3602149393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35f40ce5c0 0x7f35f40c7f40 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f35e400c450 tx=0x7f35e400c760 comp rx=0 tx=0).stop 2023-11-26T07:12:35.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.419+0000 7f35fc28c700 1 -- 172.21.15.2:0/3602149393 shutdown_connections 2023-11-26T07:12:35.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.419+0000 7f35fc28c700 1 --2- 172.21.15.2:0/3602149393 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f35d806af00 0x7f35d806d3c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:35.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.419+0000 7f35fc28c700 1 --2- 172.21.15.2:0/3602149393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35f415bde0 0x7f35f40cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:35.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.419+0000 7f35fc28c700 1 --2- 172.21.15.2:0/3602149393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35f40ce5c0 0x7f35f40c7f40 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:35.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.419+0000 7f35fc28c700 1 --2- 172.21.15.2:0/3602149393 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f35f40cf2b0 0x7f35f4157510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:35.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.419+0000 7f35fc28c700 1 -- 172.21.15.2:0/3602149393 >> 172.21.15.2:0/3602149393 conn(0x7f35f40b3720 msgr2=0x7f35f40704e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:35.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.419+0000 7f35fc28c700 1 -- 172.21.15.2:0/3602149393 shutdown_connections 2023-11-26T07:12:35.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.419+0000 7f35fc28c700 1 -- 172.21.15.2:0/3602149393 wait complete. 2023-11-26T07:12:35.423 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.0 2023-11-26T07:12:35.433 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:12:35.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.556+0000 7f4874cb4700 1 Processor -- start 2023-11-26T07:12:35.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.556+0000 7f4874cb4700 1 -- start start 2023-11-26T07:12:35.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.557+0000 7f4874cb4700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f48701459a0 0x7f48700cfa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:35.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.557+0000 7f4874cb4700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f487006b6e0 0x7f48700cffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:35.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.557+0000 7f4874cb4700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48700cf5f0 con 0x7f4870142810 2023-11-26T07:12:35.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.557+0000 7f4874cb4700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f487006ea80 con 0x7f487006b6e0 2023-11-26T07:12:35.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.557+0000 7f4874cb4700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f487006ed60 con 0x7f48701459a0 2023-11-26T07:12:35.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.557+0000 7f486ed9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f487006b6e0 0x7f48700cffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:35.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.557+0000 7f486e59c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f4870142810 0x7f487006afd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60386/0 (socket says 172.21.15.2:60386) 2023-11-26T07:12:35.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.557+0000 7f486e59c700 1 -- 172.21.15.2:0/353723167 learned_addr learned my addr 172.21.15.2:0/353723167 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:35.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.557+0000 7f486ed9d700 1 -- 172.21.15.2:0/353723167 >> v2:172.21.15.192:3300/0 conn(0x7f48701459a0 msgr2=0x7f48700cfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:35.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.557+0000 7f486ed9d700 1 --2- 172.21.15.2:0/353723167 >> v2:172.21.15.192:3300/0 conn(0x7f48701459a0 0x7f48700cfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:35.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.557+0000 7f486ed9d700 1 -- 172.21.15.2:0/353723167 >> v1:172.21.15.2:6789/0 conn(0x7f4870142810 legacy=0x7f487006afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:35.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.557+0000 7f486ed9d700 1 -- 172.21.15.2:0/353723167 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487006f040 con 0x7f487006b6e0 2023-11-26T07:12:35.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.557+0000 7f486d59a700 1 -- 172.21.15.2:0/353723167 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1362238818 0 0) 0x7f48700cf5f0 con 0x7f4870142810 2023-11-26T07:12:35.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.557+0000 7f486ed9d700 1 --2- 172.21.15.2:0/353723167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f487006b6e0 0x7f48700cffc0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f48700706e0 tx=0x7f486800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ef0f329be152988 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:35.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.557+0000 7f486d59a700 1 -- 172.21.15.2:0/353723167 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486800e070 con 0x7f487006b6e0 2023-11-26T07:12:35.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.557+0000 7f486d59a700 1 -- 172.21.15.2:0/353723167 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486800bbd0 con 0x7f487006b6e0 2023-11-26T07:12:35.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.557+0000 7f486d59a700 1 -- 172.21.15.2:0/353723167 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4868012430 con 0x7f487006b6e0 2023-11-26T07:12:35.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.558+0000 7f4874cb4700 1 -- 172.21.15.2:0/353723167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f487006b6e0 msgr2=0x7f48700cffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:35.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.558+0000 7f4874cb4700 1 --2- 172.21.15.2:0/353723167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f487006b6e0 0x7f48700cffc0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f48700706e0 tx=0x7f486800b330 comp rx=0 tx=0).stop 2023-11-26T07:12:35.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.558+0000 7f4874cb4700 1 -- 172.21.15.2:0/353723167 shutdown_connections 2023-11-26T07:12:35.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.558+0000 7f4874cb4700 1 --2- 172.21.15.2:0/353723167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f487006b6e0 0x7f48700cffc0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:35.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.558+0000 7f4874cb4700 1 --2- 172.21.15.2:0/353723167 >> v2:172.21.15.192:3300/0 conn(0x7f48701459a0 0x7f48700cfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:35.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.558+0000 7f4874cb4700 1 -- 172.21.15.2:0/353723167 >> 172.21.15.2:0/353723167 conn(0x7f48700b2740 msgr2=0x7f48700b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:35.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.558+0000 7f4874cb4700 1 -- 172.21.15.2:0/353723167 shutdown_connections 2023-11-26T07:12:35.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.558+0000 7f4874cb4700 1 -- 172.21.15.2:0/353723167 wait complete. 2023-11-26T07:12:35.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.559+0000 7f4874cb4700 1 Processor -- start 2023-11-26T07:12:35.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.560+0000 7f4874cb4700 1 -- start start 2023-11-26T07:12:35.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.560+0000 7f4874cb4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f487006b6e0 0x7f487014e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:35.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.560+0000 7f4874cb4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4870142810 0x7f487015de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:35.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.560+0000 7f4874cb4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48701459a0 0x7f48700b06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:35.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.560+0000 7f4874cb4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487013ea20 con 0x7f487006b6e0 2023-11-26T07:12:35.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.560+0000 7f4874cb4700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487013db50 con 0x7f48701459a0 2023-11-26T07:12:35.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.560+0000 7f4874cb4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f487014e8e0 con 0x7f4870142810 2023-11-26T07:12:35.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.560+0000 7f486e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f487006b6e0 0x7f487014e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:35.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.560+0000 7f486e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f487006b6e0 0x7f487014e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40950/0 (socket says 172.21.15.2:40950) 2023-11-26T07:12:35.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.560+0000 7f486e59c700 1 -- 172.21.15.2:0/3797684493 learned_addr learned my addr 172.21.15.2:0/3797684493 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:35.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.561+0000 7f486dd9b700 1 --2- 172.21.15.2:0/3797684493 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4870142810 0x7f487015de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:35.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.561+0000 7f486ed9d700 1 --2- 172.21.15.2:0/3797684493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48701459a0 0x7f48700b06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:35.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.561+0000 7f486e59c700 1 -- 172.21.15.2:0/3797684493 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4870142810 msgr2=0x7f487015de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:35.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.561+0000 7f486e59c700 1 --2- 172.21.15.2:0/3797684493 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4870142810 0x7f487015de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:35.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.561+0000 7f486e59c700 1 -- 172.21.15.2:0/3797684493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48701459a0 msgr2=0x7f48700b06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:35.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.561+0000 7f486e59c700 1 --2- 172.21.15.2:0/3797684493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48701459a0 0x7f48700b06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:35.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.561+0000 7f486e59c700 1 -- 172.21.15.2:0/3797684493 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4868009a70 con 0x7f487006b6e0 2023-11-26T07:12:35.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.561+0000 7f486dd9b700 1 --2- 172.21.15.2:0/3797684493 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4870142810 0x7f487015de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:12:35.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.561+0000 7f486ed9d700 1 --2- 172.21.15.2:0/3797684493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48701459a0 0x7f48700b06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:12:35.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.561+0000 7f486e59c700 1 --2- 172.21.15.2:0/3797684493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f487006b6e0 0x7f487014e3a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f48600011e0 tx=0x7f486000cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:35.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.561+0000 7f485effd700 1 -- 172.21.15.2:0/3797684493 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4860004c80 con 0x7f487006b6e0 2023-11-26T07:12:35.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.561+0000 7f485effd700 1 -- 172.21.15.2:0/3797684493 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4860004e00 con 0x7f487006b6e0 2023-11-26T07:12:35.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.561+0000 7f4874cb4700 1 -- 172.21.15.2:0/3797684493 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f487013de10 con 0x7f487006b6e0 2023-11-26T07:12:35.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.561+0000 7f485effd700 1 -- 172.21.15.2:0/3797684493 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4860007310 con 0x7f487006b6e0 2023-11-26T07:12:35.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.561+0000 7f4874cb4700 1 -- 172.21.15.2:0/3797684493 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f487013e3d0 con 0x7f487006b6e0 2023-11-26T07:12:35.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.562+0000 7f4874cb4700 1 -- 172.21.15.2:0/3797684493 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4870068670 con 0x7f487006b6e0 2023-11-26T07:12:35.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.562+0000 7f485effd700 1 -- 172.21.15.2:0/3797684493 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4860007470 con 0x7f487006b6e0 2023-11-26T07:12:35.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.563+0000 7f485effd700 1 --2- 172.21.15.2:0/3797684493 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f485006aed0 0x7f485006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:35.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.563+0000 7f485effd700 1 -- 172.21.15.2:0/3797684493 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f48600893f0 con 0x7f487006b6e0 2023-11-26T07:12:35.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.563+0000 7f486dd9b700 1 --2- 172.21.15.2:0/3797684493 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f485006aed0 0x7f485006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:35.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.564+0000 7f486dd9b700 1 --2- 172.21.15.2:0/3797684493 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f485006aed0 0x7f485006d390 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f48700d1840 tx=0x7f4864008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:35.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.567+0000 7f485effd700 1 -- 172.21.15.2:0/3797684493 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f48600544a0 con 0x7f487006b6e0 2023-11-26T07:12:35.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.815+0000 7f4874cb4700 1 -- 172.21.15.2:0/3797684493 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f487015be80 con 0x7f487006b6e0 2023-11-26T07:12:35.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.816+0000 7f485effd700 1 -- 172.21.15.2:0/3797684493 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f4860057ac0 con 0x7f487006b6e0 2023-11-26T07:12:35.818 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:12:35.818 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4727,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3580414083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3580414083},{"type":"v1","addr":"172.21.15.192:6837","nonce":3580414083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4948,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/3401314194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3401314194},{"type":"v1","addr":"172.21.15.2:6834","nonce":3401314194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4954,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3579861389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3579861389},{"type":"v1","addr":"172.21.15.192:6836","nonce":3579861389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:12:29.802382+0000","modified":"2023-11-26T07:12:32.823481+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5046":{"gid":5046,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6835/3058610366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":3058610366},{"type":"v1","addr":"172.21.15.2:6835","nonce":3058610366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-26T07:12:35.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.818+0000 7f4874cb4700 1 -- 172.21.15.2:0/3797684493 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f485006aed0 msgr2=0x7f485006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:35.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.818+0000 7f4874cb4700 1 --2- 172.21.15.2:0/3797684493 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f485006aed0 0x7f485006d390 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f48700d1840 tx=0x7f4864008040 comp rx=0 tx=0).stop 2023-11-26T07:12:35.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.818+0000 7f4874cb4700 1 -- 172.21.15.2:0/3797684493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f487006b6e0 msgr2=0x7f487014e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:35.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.818+0000 7f4874cb4700 1 --2- 172.21.15.2:0/3797684493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f487006b6e0 0x7f487014e3a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f48600011e0 tx=0x7f486000cae0 comp rx=0 tx=0).stop 2023-11-26T07:12:35.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.818+0000 7f4874cb4700 1 -- 172.21.15.2:0/3797684493 shutdown_connections 2023-11-26T07:12:35.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.818+0000 7f4874cb4700 1 --2- 172.21.15.2:0/3797684493 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f485006aed0 0x7f485006d390 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:35.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.818+0000 7f4874cb4700 1 --2- 172.21.15.2:0/3797684493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48701459a0 0x7f48700b06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:35.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.818+0000 7f4874cb4700 1 --2- 172.21.15.2:0/3797684493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f487006b6e0 0x7f487014e3a0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:35.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.818+0000 7f4874cb4700 1 --2- 172.21.15.2:0/3797684493 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4870142810 0x7f487015de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:35.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.818+0000 7f4874cb4700 1 -- 172.21.15.2:0/3797684493 >> 172.21.15.2:0/3797684493 conn(0x7f48700b2740 msgr2=0x7f487006afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:35.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.818+0000 7f4874cb4700 1 -- 172.21.15.2:0/3797684493 shutdown_connections 2023-11-26T07:12:35.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:35.818+0000 7f4874cb4700 1 -- 172.21.15.2:0/3797684493 wait complete. 2023-11-26T07:12:35.822 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 16 2023-11-26T07:12:36.234 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-26T07:12:29.802382+0000', 'modified': '2023-11-26T07:12:32.823481+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5046}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5046': {'gid': 5046, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6835/3058610366', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6833', 'nonce': 3058610366}, {'type': 'v1', 'addr': '172.21.15.2:6835', 'nonce': 3058610366}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-26T07:12:36.235 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-26T07:12:36.235 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-26T07:12:36.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.363+0000 7f1203176700 1 Processor -- start 2023-11-26T07:12:36.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.363+0000 7f1203176700 1 -- start start 2023-11-26T07:12:36.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.364+0000 7f1203176700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f11fc06ea50 0x7f11fc0b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:36.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.364+0000 7f1203176700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11fc15b230 con 0x7f11fc0721e0 2023-11-26T07:12:36.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.364+0000 7f1203176700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11fc0b4110 con 0x7f11fc15ae50 2023-11-26T07:12:36.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.364+0000 7f1203176700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11fc0b43f0 con 0x7f11fc06ea50 2023-11-26T07:12:36.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.364+0000 7f1201713700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f11fc06ea50 0x7f11fc0b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:36.368 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.364+0000 7f11fbfff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f11fc0721e0 0x7f11fc0ce0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60402/0 (socket says 172.21.15.2:60402) 2023-11-26T07:12:36.368 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.364+0000 7f11fbfff700 1 -- 172.21.15.2:0/3379557583 learned_addr learned my addr 172.21.15.2:0/3379557583 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:36.368 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.364+0000 7f1201713700 1 -- 172.21.15.2:0/3379557583 >> v1:172.21.15.192:6789/0 conn(0x7f11fc15ae50 legacy=0x7f11fc071ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:36.368 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.364+0000 7f1201713700 1 -- 172.21.15.2:0/3379557583 >> v1:172.21.15.2:6789/0 conn(0x7f11fc0721e0 legacy=0x7f11fc0ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:36.368 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.364+0000 7f1201713700 1 -- 172.21.15.2:0/3379557583 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11fc0b46d0 con 0x7f11fc06ea50 2023-11-26T07:12:36.368 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.364+0000 7f11fb7fe700 1 -- 172.21.15.2:0/3379557583 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4203239366 0 0) 0x7f11e8001110 con 0x7f11fc0721e0 2023-11-26T07:12:36.368 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.365+0000 7f1201713700 1 --2- 172.21.15.2:0/3379557583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11fc06ea50 0x7f11fc0b51b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f11f4009d90 tx=0x7f11f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9e595f8581ea145 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:36.368 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.365+0000 7f11fb7fe700 1 -- 172.21.15.2:0/3379557583 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f400e070 con 0x7f11fc06ea50 2023-11-26T07:12:36.368 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.365+0000 7f11fb7fe700 1 -- 172.21.15.2:0/3379557583 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f400bbd0 con 0x7f11fc06ea50 2023-11-26T07:12:36.368 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.365+0000 7f11fb7fe700 1 -- 172.21.15.2:0/3379557583 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f4012430 con 0x7f11fc06ea50 2023-11-26T07:12:36.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.365+0000 7f1203176700 1 -- 172.21.15.2:0/3379557583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11fc06ea50 msgr2=0x7f11fc0b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:36.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.365+0000 7f1203176700 1 --2- 172.21.15.2:0/3379557583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11fc06ea50 0x7f11fc0b51b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f11f4009d90 tx=0x7f11f400b330 comp rx=0 tx=0).stop 2023-11-26T07:12:36.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.365+0000 7f1203176700 1 -- 172.21.15.2:0/3379557583 shutdown_connections 2023-11-26T07:12:36.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.365+0000 7f1203176700 1 --2- 172.21.15.2:0/3379557583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11fc06ea50 0x7f11fc0b51b0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:36.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.365+0000 7f1203176700 1 -- 172.21.15.2:0/3379557583 >> 172.21.15.2:0/3379557583 conn(0x7f11fc0b27b0 msgr2=0x7f11fc0b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:36.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.365+0000 7f1203176700 1 -- 172.21.15.2:0/3379557583 shutdown_connections 2023-11-26T07:12:36.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.365+0000 7f1203176700 1 -- 172.21.15.2:0/3379557583 wait complete. 2023-11-26T07:12:36.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.367+0000 7f1203176700 1 Processor -- start 2023-11-26T07:12:36.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.367+0000 7f1203176700 1 -- start start 2023-11-26T07:12:36.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.367+0000 7f1203176700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11fc06ea50 0x7f11fc0cb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:36.372 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.367+0000 7f1203176700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f11fc0721e0 0x7f11fc0ca840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:36.372 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.367+0000 7f1203176700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11fc15ae50 0x7f11fc06b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:36.372 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.367+0000 7f1203176700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc0cad80 con 0x7f11fc06ea50 2023-11-26T07:12:36.372 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.367+0000 7f1203176700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc0cba10 con 0x7f11fc15ae50 2023-11-26T07:12:36.372 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.367+0000 7f1203176700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc0cbcf0 con 0x7f11fc0721e0 2023-11-26T07:12:36.372 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.368+0000 7f1200f12700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11fc06ea50 0x7f11fc0cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:36.372 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.368+0000 7f1200f12700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11fc06ea50 0x7f11fc0cb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40964/0 (socket says 172.21.15.2:40964) 2023-11-26T07:12:36.372 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.368+0000 7f1200f12700 1 -- 172.21.15.2:0/1719937347 learned_addr learned my addr 172.21.15.2:0/1719937347 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:36.372 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.368+0000 7f1201713700 1 --2- 172.21.15.2:0/1719937347 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11fc15ae50 0x7f11fc06b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:36.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.368+0000 7f11fbfff700 1 --2- 172.21.15.2:0/1719937347 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f11fc0721e0 0x7f11fc0ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:36.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.368+0000 7f1200f12700 1 -- 172.21.15.2:0/1719937347 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f11fc0721e0 msgr2=0x7f11fc0ca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:36.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.368+0000 7f1200f12700 1 --2- 172.21.15.2:0/1719937347 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f11fc0721e0 0x7f11fc0ca840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:36.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.368+0000 7f1200f12700 1 -- 172.21.15.2:0/1719937347 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11fc15ae50 msgr2=0x7f11fc06b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:36.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.368+0000 7f1200f12700 1 --2- 172.21.15.2:0/1719937347 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11fc15ae50 0x7f11fc06b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:36.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.368+0000 7f1200f12700 1 -- 172.21.15.2:0/1719937347 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f4009a70 con 0x7f11fc06ea50 2023-11-26T07:12:36.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.368+0000 7f11fbfff700 1 --2- 172.21.15.2:0/1719937347 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f11fc0721e0 0x7f11fc0ca840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:36.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.368+0000 7f1200f12700 1 --2- 172.21.15.2:0/1719937347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11fc06ea50 0x7f11fc0cb430 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f11f000c450 tx=0x7f11f000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:36.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.368+0000 7f11f97fa700 1 -- 172.21.15.2:0/1719937347 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f00052d0 con 0x7f11fc06ea50 2023-11-26T07:12:36.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.368+0000 7f11f97fa700 1 -- 172.21.15.2:0/1719937347 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f0005430 con 0x7f11fc06ea50 2023-11-26T07:12:36.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.368+0000 7f11f97fa700 1 -- 172.21.15.2:0/1719937347 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f00038c0 con 0x7f11fc06ea50 2023-11-26T07:12:36.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.368+0000 7f1203176700 1 -- 172.21.15.2:0/1719937347 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11fc0cbfd0 con 0x7f11fc06ea50 2023-11-26T07:12:36.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.368+0000 7f1203176700 1 -- 172.21.15.2:0/1719937347 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11fc0cc590 con 0x7f11fc06ea50 2023-11-26T07:12:36.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.370+0000 7f11f97fa700 1 -- 172.21.15.2:0/1719937347 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f11f0003a20 con 0x7f11fc06ea50 2023-11-26T07:12:36.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.370+0000 7f11f97fa700 1 --2- 172.21.15.2:0/1719937347 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f11e006af00 0x7f11e006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:36.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.370+0000 7f11f97fa700 1 -- 172.21.15.2:0/1719937347 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f11f0088ab0 con 0x7f11fc06ea50 2023-11-26T07:12:36.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.370+0000 7f11fbfff700 1 --2- 172.21.15.2:0/1719937347 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f11e006af00 0x7f11e006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:36.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.371+0000 7f11fbfff700 1 --2- 172.21.15.2:0/1719937347 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f11e006af00 0x7f11e006d3c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f11e8007990 tx=0x7f11e8007b60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:36.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.372+0000 7f120f36fb80 1 Processor -- start 2023-11-26T07:12:36.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.372+0000 7f120f36fb80 1 -- start start 2023-11-26T07:12:36.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.373+0000 7f120f36fb80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55c01b103080 0x55c01b149840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:36.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.373+0000 7f120f36fb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c01b118ed0 0x55c01b149d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:36.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.373+0000 7f120f36fb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c01b100490 0x55c01b12ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:36.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.373+0000 7f120f36fb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c01b076770 con 0x55c01b118ed0 2023-11-26T07:12:36.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.373+0000 7f120f36fb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c01b05d750 con 0x55c01b100490 2023-11-26T07:12:36.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.373+0000 7f120f36fb80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c01b05b070 con 0x55c01b103080 2023-11-26T07:12:36.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.373+0000 7f11fbfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c01b118ed0 0x55c01b149d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:36.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.373+0000 7f11fbfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c01b118ed0 0x55c01b149d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40974/0 (socket says 172.21.15.2:40974) 2023-11-26T07:12:36.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.373+0000 7f11fbfff700 1 -- 172.21.15.2:0/3187286551 learned_addr learned my addr 172.21.15.2:0/3187286551 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:36.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.373+0000 7f1200f12700 1 --2- 172.21.15.2:0/3187286551 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55c01b103080 0x55c01b149840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:36.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.373+0000 7f1201713700 1 --2- 172.21.15.2:0/3187286551 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c01b100490 0x55c01b12ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:36.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.373+0000 7f11fbfff700 1 -- 172.21.15.2:0/3187286551 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55c01b103080 msgr2=0x55c01b149840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:36.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.373+0000 7f11fbfff700 1 --2- 172.21.15.2:0/3187286551 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55c01b103080 0x55c01b149840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:36.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.373+0000 7f11fbfff700 1 -- 172.21.15.2:0/3187286551 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c01b100490 msgr2=0x55c01b12ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:36.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.373+0000 7f11fbfff700 1 --2- 172.21.15.2:0/3187286551 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c01b100490 0x55c01b12ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:36.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.373+0000 7f11fbfff700 1 -- 172.21.15.2:0/3187286551 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c01aed35e0 con 0x55c01b118ed0 2023-11-26T07:12:36.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.373+0000 7f11fbfff700 1 --2- 172.21.15.2:0/3187286551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c01b118ed0 0x55c01b149d80 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f11e8001370 tx=0x7f11e8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=400323a41c27885 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:36.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.373+0000 7f11e67fc700 1 -- 172.21.15.2:0/3187286551 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e80059d0 con 0x55c01b118ed0 2023-11-26T07:12:36.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.373+0000 7f11e67fc700 1 -- 172.21.15.2:0/3187286551 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e8001ce0 con 0x55c01b118ed0 2023-11-26T07:12:36.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.373+0000 7f11e67fc700 1 -- 172.21.15.2:0/3187286551 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e8013830 con 0x55c01b118ed0 2023-11-26T07:12:36.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.374+0000 7f120f36fb80 1 -- 172.21.15.2:0/3187286551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c01b118ed0 msgr2=0x55c01b149d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:36.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.374+0000 7f120f36fb80 1 --2- 172.21.15.2:0/3187286551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c01b118ed0 0x55c01b149d80 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f11e8001370 tx=0x7f11e8012000 comp rx=0 tx=0).stop 2023-11-26T07:12:36.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.374+0000 7f120f36fb80 1 -- 172.21.15.2:0/3187286551 shutdown_connections 2023-11-26T07:12:36.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.374+0000 7f120f36fb80 1 --2- 172.21.15.2:0/3187286551 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c01b100490 0x55c01b12ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:36.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.374+0000 7f120f36fb80 1 --2- 172.21.15.2:0/3187286551 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55c01b103080 0x55c01b149840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:36.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.374+0000 7f120f36fb80 1 --2- 172.21.15.2:0/3187286551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c01b118ed0 0x55c01b149d80 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:36.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.374+0000 7f120f36fb80 1 -- 172.21.15.2:0/3187286551 >> 172.21.15.2:0/3187286551 conn(0x55c01b031310 msgr2=0x55c01b147e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:36.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.374+0000 7f120f36fb80 1 -- 172.21.15.2:0/3187286551 shutdown_connections 2023-11-26T07:12:36.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.374+0000 7f120f36fb80 1 -- 172.21.15.2:0/3187286551 wait complete. 2023-11-26T07:12:36.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.375+0000 7f120f36fb80 1 -- start start 2023-11-26T07:12:36.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.375+0000 7f120f36fb80 1 Processor -- start 2023-11-26T07:12:36.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.376+0000 7f120f36fb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c01b100490 0x55c01b12e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:36.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.376+0000 7f120f36fb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c01b103080 0x55c01b157390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:36.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.376+0000 7f120f36fb80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55c01b118ed0 0x55c01b1578d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:36.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.376+0000 7f120f36fb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c01b056960 con 0x55c01b103080 2023-11-26T07:12:36.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.376+0000 7f120f36fb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c01b010510 con 0x55c01b100490 2023-11-26T07:12:36.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.376+0000 7f120f36fb80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c01b0101b0 con 0x55c01b118ed0 2023-11-26T07:12:36.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.376+0000 7f120f36fb80 10 client.0 _ll_register_callbacks cb 0x55c01af3ba30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-26T07:12:36.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.376+0000 7f11fbfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c01b103080 0x55c01b157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:36.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.376+0000 7f11fbfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c01b103080 0x55c01b157390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40980/0 (socket says 172.21.15.2:40980) 2023-11-26T07:12:36.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.376+0000 7f11fbfff700 1 -- 172.21.15.2:0/63211693 learned_addr learned my addr 172.21.15.2:0/63211693 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:36.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.376+0000 7f1201713700 1 --2- 172.21.15.2:0/63211693 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55c01b118ed0 0x55c01b1578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:36.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.376+0000 7f1200f12700 1 --2- 172.21.15.2:0/63211693 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c01b100490 0x55c01b12e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:36.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.376+0000 7f11fbfff700 1 -- 172.21.15.2:0/63211693 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55c01b118ed0 msgr2=0x55c01b1578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:36.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.376+0000 7f11fbfff700 1 --2- 172.21.15.2:0/63211693 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55c01b118ed0 0x55c01b1578d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:36.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.376+0000 7f11fbfff700 1 -- 172.21.15.2:0/63211693 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c01b100490 msgr2=0x55c01b12e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:36.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.376+0000 7f11fbfff700 1 --2- 172.21.15.2:0/63211693 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c01b100490 0x55c01b12e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:36.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.376+0000 7f11fbfff700 1 -- 172.21.15.2:0/63211693 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11e800f040 con 0x55c01b103080 2023-11-26T07:12:36.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.376+0000 7f11db7fe700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-26T07:12:36.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.376+0000 7f11fbfff700 1 --2- 172.21.15.2:0/63211693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c01b103080 0x55c01b157390 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f11e8007e60 tx=0x7f11e8007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5201aef191038106 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:36.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.376+0000 7f11db7fe700 1 -- 172.21.15.2:0/63211693 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e8013d30 con 0x55c01b103080 2023-11-26T07:12:36.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.376+0000 7f11db7fe700 1 -- 172.21.15.2:0/63211693 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f11e8028070 con 0x55c01b103080 2023-11-26T07:12:36.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.377+0000 7f120f36fb80 1 -- 172.21.15.2:0/63211693 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c01b0f5a40 con 0x55c01b103080 2023-11-26T07:12:36.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.377+0000 7f11db7fe700 1 -- 172.21.15.2:0/63211693 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11e8013e90 con 0x55c01b103080 2023-11-26T07:12:36.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.377+0000 7f120f36fb80 10 client.5229 fetch_fsmap learned FSMap version 16 2023-11-26T07:12:36.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.377+0000 7f120f36fb80 1 -- 172.21.15.2:0/63211693 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55c01ae7fd90 con 0x55c01b103080 2023-11-26T07:12:36.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.377+0000 7f11db7fe700 1 -- 172.21.15.2:0/63211693 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c01b0f5a40 con 0x55c01b103080 2023-11-26T07:12:36.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.377+0000 7f11db7fe700 1 -- 172.21.15.2:0/63211693 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f11e8021450 con 0x55c01b103080 2023-11-26T07:12:36.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.377+0000 7f120f36fb80 10 client.5229 fetch_fsmap finished waiting for FSMap version 16 2023-11-26T07:12:36.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.377+0000 7f120f36fb80 10 client.5229 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-26T07:12:36.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.377+0000 7f120f36fb80 20 client.5229 populate_metadata read hostname 'smithi002' 2023-11-26T07:12:36.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.377+0000 7f120f36fb80 1 --2- 172.21.15.2:0/63211693 >> [v2:172.21.15.2:6833/3058610366,v1:172.21.15.2:6835/3058610366] conn(0x55c01b12a440 0x55c01b164a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:36.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.377+0000 7f120f36fb80 4 client.5229 mds_command: new command op to 5046 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-26T07:12:36.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.377+0000 7f120f36fb80 1 -- 172.21.15.2:0/63211693 --> [v2:172.21.15.2:6833/3058610366,v1:172.21.15.2:6835/3058610366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c01b0d1840 con 0x55c01b12a440 2023-11-26T07:12:36.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.377+0000 7f1200f12700 1 --2- 172.21.15.2:0/63211693 >> [v2:172.21.15.2:6833/3058610366,v1:172.21.15.2:6835/3058610366] conn(0x55c01b12a440 0x55c01b164a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:36.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.377+0000 7f1200f12700 1 --2- 172.21.15.2:0/63211693 >> [v2:172.21.15.2:6833/3058610366,v1:172.21.15.2:6835/3058610366] conn(0x55c01b12a440 0x55c01b164a60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f30213684eadbac server_cookie=8bdc2607951b2fac in_seq=0 out_seq=0 2023-11-26T07:12:36.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.377+0000 7f11db7fe700 10 client.5229 ms_handle_connect on v2:172.21.15.2:6833/3058610366 2023-11-26T07:12:36.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.378+0000 7f11db7fe700 1 -- 172.21.15.2:0/63211693 <== mds.0 v2:172.21.15.2:6833/3058610366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c01b0d1840 con 0x55c01b12a440 2023-11-26T07:12:36.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.378+0000 7f11db7fe700 10 client.5229 handle_command_reply: tid=0 2023-11-26T07:12:36.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.378+0000 7f120f36fb80 1 client.5229 shutdown 2023-11-26T07:12:36.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.378+0000 7f120f36fb80 1 -- 172.21.15.2:0/63211693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c01b103080 msgr2=0x55c01b157390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:36.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.378+0000 7f120f36fb80 1 --2- 172.21.15.2:0/63211693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c01b103080 0x55c01b157390 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f11e8007e60 tx=0x7f11e8007900 comp rx=0 tx=0).stop 2023-11-26T07:12:36.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.378+0000 7f120f36fb80 1 -- 172.21.15.2:0/63211693 shutdown_connections 2023-11-26T07:12:36.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.378+0000 7f120f36fb80 1 --2- 172.21.15.2:0/63211693 >> [v2:172.21.15.2:6833/3058610366,v1:172.21.15.2:6835/3058610366] conn(0x55c01b12a440 0x55c01b164a60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:36.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.378+0000 7f120f36fb80 1 --2- 172.21.15.2:0/63211693 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55c01b118ed0 0x55c01b1578d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:36.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.378+0000 7f120f36fb80 1 --2- 172.21.15.2:0/63211693 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c01b100490 0x55c01b12e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:36.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.378+0000 7f11db7fe700 0 client.5229 ms_handle_reset on v2:172.21.15.2:6833/3058610366 2023-11-26T07:12:36.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.378+0000 7f120f36fb80 1 --2- 172.21.15.2:0/63211693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c01b103080 0x55c01b157390 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:36.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.378+0000 7f120f36fb80 1 -- 172.21.15.2:0/63211693 >> 172.21.15.2:0/63211693 conn(0x55c01b031310 msgr2=0x55c01b14bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:36.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.378+0000 7f120f36fb80 1 -- 172.21.15.2:0/63211693 shutdown_connections 2023-11-26T07:12:36.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.378+0000 7f120f36fb80 1 -- 172.21.15.2:0/63211693 wait complete. 2023-11-26T07:12:36.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.379+0000 7f120f36fb80 20 client.5229 trim_cache size 0 max 16384 2023-11-26T07:12:36.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.396+0000 7f120f36fb80 1 Processor -- start 2023-11-26T07:12:36.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.397+0000 7f120f36fb80 1 -- start start 2023-11-26T07:12:36.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.397+0000 7f120f36fb80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55c01b100490 0x55c01b147e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:36.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.397+0000 7f120f36fb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c01b103080 0x55c01b12b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:36.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.397+0000 7f120f36fb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c01b118ed0 0x55c01b127b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:36.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.397+0000 7f120f36fb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c01aed58d0 con 0x55c01b103080 2023-11-26T07:12:36.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.397+0000 7f120f36fb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c01b1000d0 con 0x55c01b118ed0 2023-11-26T07:12:36.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.397+0000 7f120f36fb80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c01b14ae60 con 0x55c01b100490 2023-11-26T07:12:36.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.397+0000 7f11fbfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c01b103080 0x55c01b12b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:36.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.397+0000 7f11fbfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c01b103080 0x55c01b12b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40988/0 (socket says 172.21.15.2:40988) 2023-11-26T07:12:36.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.397+0000 7f11fbfff700 1 -- 172.21.15.2:0/2457897870 learned_addr learned my addr 172.21.15.2:0/2457897870 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:36.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.398+0000 7f1201713700 1 --2- 172.21.15.2:0/2457897870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c01b118ed0 0x55c01b127b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:36.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.398+0000 7f11fbfff700 1 -- 172.21.15.2:0/2457897870 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55c01b100490 msgr2=0x55c01b147e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:36.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.398+0000 7f11fbfff700 1 --2- 172.21.15.2:0/2457897870 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55c01b100490 0x55c01b147e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:36.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.398+0000 7f11fbfff700 1 -- 172.21.15.2:0/2457897870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c01b118ed0 msgr2=0x55c01b127b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:36.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.398+0000 7f11fbfff700 1 --2- 172.21.15.2:0/2457897870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c01b118ed0 0x55c01b127b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:36.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.398+0000 7f11fbfff700 1 -- 172.21.15.2:0/2457897870 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c01ae68c10 con 0x55c01b103080 2023-11-26T07:12:36.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.398+0000 7f1201713700 1 --2- 172.21.15.2:0/2457897870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c01b118ed0 0x55c01b127b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:12:36.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.398+0000 7f11fbfff700 1 --2- 172.21.15.2:0/2457897870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c01b103080 0x55c01b12b140 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f11e8001370 tx=0x7f11e8028000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdf5cbb9d0507585 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:36.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.398+0000 7f11e6ffd700 1 -- 172.21.15.2:0/2457897870 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e8021bd0 con 0x55c01b103080 2023-11-26T07:12:36.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.398+0000 7f11e6ffd700 1 -- 172.21.15.2:0/2457897870 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e8019030 con 0x55c01b103080 2023-11-26T07:12:36.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.398+0000 7f11e6ffd700 1 -- 172.21.15.2:0/2457897870 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e8005a80 con 0x55c01b103080 2023-11-26T07:12:36.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.398+0000 7f120f36fb80 1 -- 172.21.15.2:0/2457897870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c01b103080 msgr2=0x55c01b12b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:36.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.398+0000 7f120f36fb80 1 --2- 172.21.15.2:0/2457897870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c01b103080 0x55c01b12b140 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f11e8001370 tx=0x7f11e8028000 comp rx=0 tx=0).stop 2023-11-26T07:12:36.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.398+0000 7f120f36fb80 1 -- 172.21.15.2:0/2457897870 shutdown_connections 2023-11-26T07:12:36.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.398+0000 7f120f36fb80 1 --2- 172.21.15.2:0/2457897870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c01b118ed0 0x55c01b127b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:36.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.398+0000 7f120f36fb80 1 --2- 172.21.15.2:0/2457897870 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55c01b100490 0x55c01b147e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:36.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.398+0000 7f120f36fb80 1 --2- 172.21.15.2:0/2457897870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c01b103080 0x55c01b12b140 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:36.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.398+0000 7f120f36fb80 1 -- 172.21.15.2:0/2457897870 >> 172.21.15.2:0/2457897870 conn(0x55c01b031310 msgr2=0x55c01b12f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:36.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.399+0000 7f120f36fb80 1 -- 172.21.15.2:0/2457897870 shutdown_connections 2023-11-26T07:12:36.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.399+0000 7f120f36fb80 1 -- 172.21.15.2:0/2457897870 wait complete. 2023-11-26T07:12:36.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.399+0000 7f120f36fb80 1 -- start start 2023-11-26T07:12:36.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.399+0000 7f120f36fb80 1 Processor -- start 2023-11-26T07:12:36.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.401+0000 7f120f36fb80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55c01b100490 0x55c01b12b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:36.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.401+0000 7f120f36fb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c01b103080 0x55c01b12c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:36.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.401+0000 7f120f36fb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c01b118ed0 0x55c01b12c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:36.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.401+0000 7f120f36fb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c01b1461d0 con 0x55c01b118ed0 2023-11-26T07:12:36.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.401+0000 7f120f36fb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c01b12e130 con 0x55c01b103080 2023-11-26T07:12:36.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.401+0000 7f120f36fb80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c01b128920 con 0x55c01b100490 2023-11-26T07:12:36.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.401+0000 7f120f36fb80 10 client.0 _ll_register_callbacks cb 0x55c01af3ba30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-26T07:12:36.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.401+0000 7f1201713700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c01b118ed0 0x55c01b12c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:36.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.401+0000 7f1201713700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c01b118ed0 0x55c01b12c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40996/0 (socket says 172.21.15.2:40996) 2023-11-26T07:12:36.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.401+0000 7f1201713700 1 -- 172.21.15.2:0/918656301 learned_addr learned my addr 172.21.15.2:0/918656301 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:36.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.401+0000 7f1200f12700 1 --2- 172.21.15.2:0/918656301 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55c01b100490 0x55c01b12b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:36.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.401+0000 7f11fbfff700 1 --2- 172.21.15.2:0/918656301 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c01b103080 0x55c01b12c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:36.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.401+0000 7f1201713700 1 -- 172.21.15.2:0/918656301 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55c01b100490 msgr2=0x55c01b12b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:36.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.401+0000 7f1201713700 1 --2- 172.21.15.2:0/918656301 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55c01b100490 0x55c01b12b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:36.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.401+0000 7f1201713700 1 -- 172.21.15.2:0/918656301 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c01b103080 msgr2=0x55c01b12c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:36.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.401+0000 7f1201713700 1 --2- 172.21.15.2:0/918656301 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c01b103080 0x55c01b12c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:36.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.401+0000 7f1201713700 1 -- 172.21.15.2:0/918656301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c01ae7fd90 con 0x55c01b118ed0 2023-11-26T07:12:36.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.401+0000 7f1201713700 1 --2- 172.21.15.2:0/918656301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c01b118ed0 0x55c01b12c6b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f11fc070680 tx=0x7f11f4004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eef23bad06b73a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:36.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.401+0000 7f11db7fe700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-26T07:12:36.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.401+0000 7f11db7fe700 1 -- 172.21.15.2:0/918656301 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f402c070 con 0x55c01b118ed0 2023-11-26T07:12:36.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.402+0000 7f11db7fe700 1 -- 172.21.15.2:0/918656301 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f11f4012910 con 0x55c01b118ed0 2023-11-26T07:12:36.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.402+0000 7f120f36fb80 1 -- 172.21.15.2:0/918656301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f11e8001ce0 con 0x55c01b118ed0 2023-11-26T07:12:36.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.402+0000 7f11db7fe700 1 -- 172.21.15.2:0/918656301 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11f4021050 con 0x55c01b118ed0 2023-11-26T07:12:36.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.402+0000 7f120f36fb80 10 client.5235 fetch_fsmap learned FSMap version 16 2023-11-26T07:12:36.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.402+0000 7f120f36fb80 1 -- 172.21.15.2:0/918656301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55c01aea6200 con 0x55c01b118ed0 2023-11-26T07:12:36.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.402+0000 7f11db7fe700 1 -- 172.21.15.2:0/918656301 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e8001ce0 con 0x55c01b118ed0 2023-11-26T07:12:36.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.402+0000 7f11db7fe700 1 -- 172.21.15.2:0/918656301 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f11f402f020 con 0x55c01b118ed0 2023-11-26T07:12:36.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.402+0000 7f120f36fb80 10 client.5235 fetch_fsmap finished waiting for FSMap version 16 2023-11-26T07:12:36.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.402+0000 7f120f36fb80 10 client.5235 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-26T07:12:36.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.402+0000 7f120f36fb80 20 client.5235 populate_metadata read hostname 'smithi002' 2023-11-26T07:12:36.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.402+0000 7f120f36fb80 1 --2- 172.21.15.2:0/918656301 >> [v2:172.21.15.2:6833/3058610366,v1:172.21.15.2:6835/3058610366] conn(0x55c01b1b1230 0x55c01b1b1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:36.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.402+0000 7f120f36fb80 4 client.5235 mds_command: new command op to 5046 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-26T07:12:36.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.402+0000 7f120f36fb80 1 -- 172.21.15.2:0/918656301 --> [v2:172.21.15.2:6833/3058610366,v1:172.21.15.2:6835/3058610366] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c01b01cf80 con 0x55c01b1b1230 2023-11-26T07:12:36.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.402+0000 7f1200f12700 1 --2- 172.21.15.2:0/918656301 >> [v2:172.21.15.2:6833/3058610366,v1:172.21.15.2:6835/3058610366] conn(0x55c01b1b1230 0x55c01b1b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:36.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.402+0000 7f11db7fe700 10 client.5235 ms_handle_connect on v2:172.21.15.2:6833/3058610366 2023-11-26T07:12:36.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.402+0000 7f1200f12700 1 --2- 172.21.15.2:0/918656301 >> [v2:172.21.15.2:6833/3058610366,v1:172.21.15.2:6835/3058610366] conn(0x55c01b1b1230 0x55c01b1b1610 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d89b8b8d35632e14 server_cookie=b2b6717204cce575 in_seq=0 out_seq=0 2023-11-26T07:12:36.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.403+0000 7f11db7fe700 1 -- 172.21.15.2:0/918656301 <== mds.0 v2:172.21.15.2:6833/3058610366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55c01b01cf80 con 0x55c01b1b1230 2023-11-26T07:12:36.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.403+0000 7f11db7fe700 10 client.5235 handle_command_reply: tid=0 2023-11-26T07:12:36.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.403+0000 7f120f36fb80 1 client.5235 shutdown 2023-11-26T07:12:36.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.403+0000 7f120f36fb80 1 -- 172.21.15.2:0/918656301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c01b118ed0 msgr2=0x55c01b12c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:36.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.403+0000 7f120f36fb80 1 --2- 172.21.15.2:0/918656301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c01b118ed0 0x55c01b12c6b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f11fc070680 tx=0x7f11f4004b40 comp rx=0 tx=0).stop 2023-11-26T07:12:36.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.403+0000 7f120f36fb80 1 -- 172.21.15.2:0/918656301 shutdown_connections 2023-11-26T07:12:36.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.403+0000 7f120f36fb80 1 --2- 172.21.15.2:0/918656301 >> [v2:172.21.15.2:6833/3058610366,v1:172.21.15.2:6835/3058610366] conn(0x55c01b1b1230 0x55c01b1b1610 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:36.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.403+0000 7f120f36fb80 1 --2- 172.21.15.2:0/918656301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c01b118ed0 0x55c01b12c6b0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:36.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.403+0000 7f120f36fb80 1 --2- 172.21.15.2:0/918656301 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55c01b100490 0x55c01b12b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:36.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.403+0000 7f120f36fb80 1 --2- 172.21.15.2:0/918656301 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c01b103080 0x55c01b12c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:36.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.403+0000 7f11db7fe700 0 client.5235 ms_handle_reset on v2:172.21.15.2:6833/3058610366 2023-11-26T07:12:36.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.403+0000 7f120f36fb80 1 -- 172.21.15.2:0/918656301 >> 172.21.15.2:0/918656301 conn(0x55c01b031310 msgr2=0x55c01b12f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:36.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.403+0000 7f120f36fb80 1 -- 172.21.15.2:0/918656301 shutdown_connections 2023-11-26T07:12:36.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.403+0000 7f120f36fb80 1 -- 172.21.15.2:0/918656301 wait complete. 2023-11-26T07:12:36.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.403+0000 7f120f36fb80 20 client.5235 trim_cache size 0 max 16384 2023-11-26T07:12:36.412 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-26T07:12:36.412 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "cb9817c7-f1ed-4745-9395-2760a3bb9712", 2023-11-26T07:12:36.412 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2023-11-26T07:12:36.412 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 5046, 2023-11-26T07:12:36.412 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2023-11-26T07:12:36.413 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2023-11-26T07:12:36.413 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2023-11-26T07:12:36.413 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 6.0080574259999997, 2023-11-26T07:12:36.413 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 16, 2023-11-26T07:12:36.413 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 32, 2023-11-26T07:12:36.413 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 32, 2023-11-26T07:12:36.413 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 13.894310697 2023-11-26T07:12:36.413 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-26T07:12:36.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.403+0000 7f1203176700 1 -- 172.21.15.2:0/1719937347 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f11e006af00 msgr2=0x7f11e006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:36.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.403+0000 7f1203176700 1 --2- 172.21.15.2:0/1719937347 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f11e006af00 0x7f11e006d3c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f11e8007990 tx=0x7f11e8007b60 comp rx=0 tx=0).stop 2023-11-26T07:12:36.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.403+0000 7f1203176700 1 -- 172.21.15.2:0/1719937347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11fc06ea50 msgr2=0x7f11fc0cb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:36.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.403+0000 7f1203176700 1 --2- 172.21.15.2:0/1719937347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11fc06ea50 0x7f11fc0cb430 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f11f000c450 tx=0x7f11f000c760 comp rx=0 tx=0).stop 2023-11-26T07:12:36.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.404+0000 7f1203176700 1 -- 172.21.15.2:0/1719937347 shutdown_connections 2023-11-26T07:12:36.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.404+0000 7f1203176700 1 --2- 172.21.15.2:0/1719937347 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f11e006af00 0x7f11e006d3c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:36.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.404+0000 7f1203176700 1 --2- 172.21.15.2:0/1719937347 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11fc15ae50 0x7f11fc06b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:36.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.404+0000 7f1203176700 1 --2- 172.21.15.2:0/1719937347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11fc06ea50 0x7f11fc0cb430 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:36.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.404+0000 7f1203176700 1 --2- 172.21.15.2:0/1719937347 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f11fc0721e0 0x7f11fc0ca840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:36.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.404+0000 7f1203176700 1 -- 172.21.15.2:0/1719937347 >> 172.21.15.2:0/1719937347 conn(0x7f11fc0b27b0 msgr2=0x7f11fc071ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:36.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.404+0000 7f1203176700 1 -- 172.21.15.2:0/1719937347 shutdown_connections 2023-11-26T07:12:36.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.404+0000 7f1203176700 1 -- 172.21.15.2:0/1719937347 wait complete. 2023-11-26T07:12:36.418 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-26T07:12:36.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.540+0000 7f4e61a2c700 1 Processor -- start 2023-11-26T07:12:36.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.540+0000 7f4e61a2c700 1 -- start start 2023-11-26T07:12:36.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.541+0000 7f4e61a2c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e5c15a820 0x7f4e5c06b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:36.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.541+0000 7f4e61a2c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4e5c0d06b0 0x7f4e5c06b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:36.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.541+0000 7f4e61a2c700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e5c0b05f0 con 0x7f4e5c15a440 2023-11-26T07:12:36.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.541+0000 7f4e61a2c700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e5c15f080 con 0x7f4e5c0d06b0 2023-11-26T07:12:36.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.541+0000 7f4e61a2c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c0afd50 con 0x7f4e5c15a820 2023-11-26T07:12:36.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.541+0000 7f4e5b7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4e5c0d06b0 0x7f4e5c06b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:36.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.541+0000 7f4e5affd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f4e5c15a440 0x7f4e5c0cffa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60442/0 (socket says 172.21.15.2:60442) 2023-11-26T07:12:36.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.541+0000 7f4e5b7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4e5c0d06b0 0x7f4e5c06b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41004/0 (socket says 172.21.15.2:41004) 2023-11-26T07:12:36.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.541+0000 7f4e5affd700 1 -- 172.21.15.2:0/1005984286 learned_addr learned my addr 172.21.15.2:0/1005984286 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:36.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.542+0000 7f4e5a7fc700 1 --2- 172.21.15.2:0/1005984286 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e5c15a820 0x7f4e5c06b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:36.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.542+0000 7f4e5b7fe700 1 -- 172.21.15.2:0/1005984286 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e5c15a820 msgr2=0x7f4e5c06b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:36.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.542+0000 7f4e5b7fe700 1 --2- 172.21.15.2:0/1005984286 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e5c15a820 0x7f4e5c06b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:36.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.542+0000 7f4e5b7fe700 1 -- 172.21.15.2:0/1005984286 >> v1:172.21.15.2:6789/0 conn(0x7f4e5c15a440 legacy=0x7f4e5c0cffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:36.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.542+0000 7f4e5b7fe700 1 -- 172.21.15.2:0/1005984286 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e5c0b0030 con 0x7f4e5c0d06b0 2023-11-26T07:12:36.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.542+0000 7f4e59ffb700 1 -- 172.21.15.2:0/1005984286 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1771465501 0 0) 0x7f4e5c0b05f0 con 0x7f4e5c15a440 2023-11-26T07:12:36.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.542+0000 7f4e5b7fe700 1 --2- 172.21.15.2:0/1005984286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e5c0d06b0 0x7f4e5c06b880 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4e5400bfa0 tx=0x7f4e5400d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3b091becba1a3b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:36.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.542+0000 7f4e59ffb700 1 -- 172.21.15.2:0/1005984286 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e54010070 con 0x7f4e5c0d06b0 2023-11-26T07:12:36.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.542+0000 7f4e59ffb700 1 -- 172.21.15.2:0/1005984286 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5400dab0 con 0x7f4e5c0d06b0 2023-11-26T07:12:36.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.542+0000 7f4e59ffb700 1 -- 172.21.15.2:0/1005984286 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5400de40 con 0x7f4e5c0d06b0 2023-11-26T07:12:36.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.543+0000 7f4e61a2c700 1 -- 172.21.15.2:0/1005984286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e5c0d06b0 msgr2=0x7f4e5c06b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:36.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.543+0000 7f4e61a2c700 1 --2- 172.21.15.2:0/1005984286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e5c0d06b0 0x7f4e5c06b880 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4e5400bfa0 tx=0x7f4e5400d330 comp rx=0 tx=0).stop 2023-11-26T07:12:36.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.543+0000 7f4e61a2c700 1 -- 172.21.15.2:0/1005984286 shutdown_connections 2023-11-26T07:12:36.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.543+0000 7f4e61a2c700 1 --2- 172.21.15.2:0/1005984286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e5c0d06b0 0x7f4e5c06b880 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:36.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.543+0000 7f4e61a2c700 1 --2- 172.21.15.2:0/1005984286 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e5c15a820 0x7f4e5c06b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:36.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.543+0000 7f4e61a2c700 1 -- 172.21.15.2:0/1005984286 >> 172.21.15.2:0/1005984286 conn(0x7f4e5c0b5070 msgr2=0x7f4e5c0b5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:36.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.543+0000 7f4e61a2c700 1 -- 172.21.15.2:0/1005984286 shutdown_connections 2023-11-26T07:12:36.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.543+0000 7f4e61a2c700 1 -- 172.21.15.2:0/1005984286 wait complete. 2023-11-26T07:12:36.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.544+0000 7f4e61a2c700 1 Processor -- start 2023-11-26T07:12:36.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.544+0000 7f4e61a2c700 1 -- start start 2023-11-26T07:12:36.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.545+0000 7f4e61a2c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e5c0d06b0 0x7f4e5c14fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:36.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.545+0000 7f4e61a2c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e5c15a440 0x7f4e5c15b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:36.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.545+0000 7f4e61a2c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e5c150670 0x7f4e5c150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:36.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.545+0000 7f4e61a2c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c15cbb0 con 0x7f4e5c150670 2023-11-26T07:12:36.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.545+0000 7f4e61a2c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c1503d0 con 0x7f4e5c15a440 2023-11-26T07:12:36.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.545+0000 7f4e61a2c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c15bf30 con 0x7f4e5c0d06b0 2023-11-26T07:12:36.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.545+0000 7f4e5b7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e5c150670 0x7f4e5c150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:36.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.545+0000 7f4e5b7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e5c150670 0x7f4e5c150f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41010/0 (socket says 172.21.15.2:41010) 2023-11-26T07:12:36.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.545+0000 7f4e5b7fe700 1 -- 172.21.15.2:0/2942924802 learned_addr learned my addr 172.21.15.2:0/2942924802 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:36.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.545+0000 7f4e5a7fc700 1 --2- 172.21.15.2:0/2942924802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e5c15a440 0x7f4e5c15b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:36.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.545+0000 7f4e5affd700 1 --2- 172.21.15.2:0/2942924802 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e5c0d06b0 0x7f4e5c14fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:36.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.545+0000 7f4e5b7fe700 1 -- 172.21.15.2:0/2942924802 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e5c0d06b0 msgr2=0x7f4e5c14fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:36.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.545+0000 7f4e5b7fe700 1 --2- 172.21.15.2:0/2942924802 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e5c0d06b0 0x7f4e5c14fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:36.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.545+0000 7f4e5b7fe700 1 -- 172.21.15.2:0/2942924802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e5c15a440 msgr2=0x7f4e5c15b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:36.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.545+0000 7f4e5b7fe700 1 --2- 172.21.15.2:0/2942924802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e5c15a440 0x7f4e5c15b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:36.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.545+0000 7f4e5b7fe700 1 -- 172.21.15.2:0/2942924802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e5400bc80 con 0x7f4e5c150670 2023-11-26T07:12:36.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.545+0000 7f4e5affd700 1 --2- 172.21.15.2:0/2942924802 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e5c0d06b0 0x7f4e5c14fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:12:36.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.545+0000 7f4e5a7fc700 1 --2- 172.21.15.2:0/2942924802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e5c15a440 0x7f4e5c15b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:12:36.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.545+0000 7f4e5b7fe700 1 --2- 172.21.15.2:0/2942924802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e5c150670 0x7f4e5c150f30 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c0737f0 tx=0x7f4e54004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:36.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.546+0000 7f4e53fff700 1 -- 172.21.15.2:0/2942924802 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e54004780 con 0x7f4e5c150670 2023-11-26T07:12:36.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.546+0000 7f4e53fff700 1 -- 172.21.15.2:0/2942924802 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e540048e0 con 0x7f4e5c150670 2023-11-26T07:12:36.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.546+0000 7f4e61a2c700 1 -- 172.21.15.2:0/2942924802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e5c15c210 con 0x7f4e5c150670 2023-11-26T07:12:36.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.546+0000 7f4e53fff700 1 -- 172.21.15.2:0/2942924802 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5401e600 con 0x7f4e5c150670 2023-11-26T07:12:36.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.546+0000 7f4e61a2c700 1 -- 172.21.15.2:0/2942924802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e5c15c7d0 con 0x7f4e5c150670 2023-11-26T07:12:36.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.547+0000 7f4e61a2c700 1 -- 172.21.15.2:0/2942924802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e5c159fa0 con 0x7f4e5c150670 2023-11-26T07:12:36.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.547+0000 7f4e53fff700 1 -- 172.21.15.2:0/2942924802 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4e5401e760 con 0x7f4e5c150670 2023-11-26T07:12:36.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.547+0000 7f4e53fff700 1 --2- 172.21.15.2:0/2942924802 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4e3c06aed0 0x7f4e3c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:36.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.548+0000 7f4e53fff700 1 -- 172.21.15.2:0/2942924802 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4e5408ba30 con 0x7f4e5c150670 2023-11-26T07:12:36.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.548+0000 7f4e5affd700 1 --2- 172.21.15.2:0/2942924802 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4e3c06aed0 0x7f4e3c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:36.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.548+0000 7f4e5affd700 1 --2- 172.21.15.2:0/2942924802 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4e3c06aed0 0x7f4e3c06d390 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c000f60 tx=0x7f4e4c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:36.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.552+0000 7f4e53fff700 1 -- 172.21.15.2:0/2942924802 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4e54056b70 con 0x7f4e5c150670 2023-11-26T07:12:36.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.800+0000 7f4e61a2c700 1 -- 172.21.15.2:0/2942924802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4e5c068670 con 0x7f4e5c150670 2023-11-26T07:12:36.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.800+0000 7f4e53fff700 1 -- 172.21.15.2:0/2942924802 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4e54022070 con 0x7f4e5c150670 2023-11-26T07:12:36.802 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-26T07:12:36.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.802+0000 7f4e61a2c700 1 -- 172.21.15.2:0/2942924802 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4e3c06aed0 msgr2=0x7f4e3c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:36.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.802+0000 7f4e61a2c700 1 --2- 172.21.15.2:0/2942924802 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4e3c06aed0 0x7f4e3c06d390 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c000f60 tx=0x7f4e4c009040 comp rx=0 tx=0).stop 2023-11-26T07:12:36.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.802+0000 7f4e61a2c700 1 -- 172.21.15.2:0/2942924802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e5c150670 msgr2=0x7f4e5c150f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:36.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.802+0000 7f4e61a2c700 1 --2- 172.21.15.2:0/2942924802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e5c150670 0x7f4e5c150f30 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c0737f0 tx=0x7f4e54004ad0 comp rx=0 tx=0).stop 2023-11-26T07:12:36.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.802+0000 7f4e61a2c700 1 -- 172.21.15.2:0/2942924802 shutdown_connections 2023-11-26T07:12:36.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.802+0000 7f4e61a2c700 1 --2- 172.21.15.2:0/2942924802 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4e3c06aed0 0x7f4e3c06d390 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:36.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.802+0000 7f4e61a2c700 1 --2- 172.21.15.2:0/2942924802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e5c150670 0x7f4e5c150f30 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:36.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.802+0000 7f4e61a2c700 1 --2- 172.21.15.2:0/2942924802 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e5c0d06b0 0x7f4e5c14fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:36.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.802+0000 7f4e61a2c700 1 --2- 172.21.15.2:0/2942924802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e5c15a440 0x7f4e5c15b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:36.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.802+0000 7f4e61a2c700 1 -- 172.21.15.2:0/2942924802 >> 172.21.15.2:0/2942924802 conn(0x7f4e5c0b5070 msgr2=0x7f4e5c0b1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:36.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.802+0000 7f4e61a2c700 1 -- 172.21.15.2:0/2942924802 shutdown_connections 2023-11-26T07:12:36.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:36.802+0000 7f4e61a2c700 1 -- 172.21.15.2:0/2942924802 wait complete. 2023-11-26T07:12:36.816 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-26T07:12:36.817 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-26T07:12:36.817 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2023-11-26T07:12:36.817 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-26T07:12:36.817 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-26T07:12:36.817 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-26T07:12:36.817 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-26T07:12:36.817 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-26T07:12:36.817 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-26T07:12:36.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:36.817 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2023-11-26T07:12:36.835 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:12:36.835 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:12:36.835 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:12:36.835 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:12:36.835 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2023-11-26T07:12:36.835 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:12:36.835 INFO:teuthology.orchestra.run.smithi002.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:12:36.835 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:12:36.836 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:12:36.836 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:12:36.836 INFO:teuthology.orchestra.run.smithi002.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-26T07:12:36.836 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:12:36.836 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-26T07:12:36.836 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 42267sec preferred_lft 42267sec 2023-11-26T07:12:36.836 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link 2023-11-26T07:12:36.837 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:12:36.837 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:12:36.837 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:12:36.837 INFO:teuthology.orchestra.run.smithi002.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-26T07:12:36.837 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0a:57:c2:51:2c:98 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:12:36.837 INFO:teuthology.orchestra.run.smithi002.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-26T07:12:36.837 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:12:36.837 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::60ae:c7ff:fe6a:97cb/64 scope link 2023-11-26T07:12:36.837 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:12:36.838 INFO:teuthology.orchestra.run.smithi002.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:12:36.838 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0a:57:c2:51:2c:98 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:12:36.838 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::857:c2ff:fe51:2c98/64 scope link 2023-11-26T07:12:36.838 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:12:36.838 INFO:teuthology.orchestra.run.smithi002.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:12:36.838 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether a2:e0:b8:ef:39:07 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-26T07:12:36.838 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::a0e0:b8ff:feef:3907/64 scope link 2023-11-26T07:12:36.838 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:12:36.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:36.839 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-26T07:12:36.883 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:12:36.901 INFO:teuthology.orchestra.run.smithi002.stdout:1 2023-11-26T07:12:36.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:36.903 DEBUG:teuthology.orchestra.run.smithi002:> route 2023-11-26T07:12:36.903 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:12:36.962 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2023-11-26T07:12:36.962 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-26T07:12:36.963 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-26T07:12:36.963 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-26T07:12:36.963 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-26T07:12:36.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:36.963 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-11-26T07:12:36.963 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-11-26T07:12:36.963 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-26T07:12:36.964 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-26T07:12:36.964 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-26T07:12:36.964 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-11-26T07:12:37.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:37.070 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2023-11-26T07:12:37.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-26T07:12:37.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-26T07:12:37.088 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-26T07:12:37.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:37.088 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 up 2023-11-26T07:12:37.157 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:12:37.157 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-26T07:12:37.214 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-26T07:12:37.214 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:12:37.214 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-26T07:12:37.271 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-26T07:12:37.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:37.272 DEBUG:teuthology.orchestra.run.smithi002:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-26T07:12:37.358 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-26T07:12:37.359 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-26T07:12:37.359 INFO:teuthology.orchestra.run.smithi002.stdout:invalid new device string format 2023-11-26T07:12:37.367 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-26T07:12:37.368 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-26T07:12:37.368 INFO:teuthology.orchestra.run.smithi002.stdout:invalid new device string format 2023-11-26T07:12:37.368 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-11-26T07:12:37.368 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:12:37.441 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-26T07:12:37.441 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-26T07:12:37.441 INFO:teuthology.orchestra.run.smithi002.stdout:invalid new device string format 2023-11-26T07:12:37.441 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-11-26T07:12:37.441 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:12:37.441 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: resolved to: "172.21.15.2:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-11-26T07:12:37.441 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.2:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-11-26T07:12:37.441 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=cb9817c7-f1ed-4745-9395-2760a3bb9712" will pass to kernel 2023-11-26T07:12:37.443 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-26T07:12:37.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:37.443 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-26T07:12:37.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:37.471 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-26T07:12:37.545 INFO:teuthology.orchestra.run.smithi002.stdout:client5089 2023-11-26T07:12:37.545 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:37.545 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:37.603 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-26T07:12:37.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.766+0000 7efda9193700 1 Processor -- start 2023-11-26T07:12:37.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.766+0000 7efda9193700 1 -- start start 2023-11-26T07:12:37.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.767+0000 7efda9193700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efda415e1c0 0x7efda406eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:37.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.767+0000 7efda9193700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efda40b0e90 0x7efda406f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:37.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.767+0000 7efda9193700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7efda406fa80 0x7efda4161d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:37.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.767+0000 7efda9193700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efda406ff10 con 0x7efda40b0e90 2023-11-26T07:12:37.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.767+0000 7efda9193700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efda40d1230 con 0x7efda406fa80 2023-11-26T07:12:37.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.767+0000 7efda9193700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda40d0c70 con 0x7efda415e1c0 2023-11-26T07:12:37.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.767+0000 7efda259c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efda40b0e90 0x7efda406f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:37.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.767+0000 7efda259c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efda40b0e90 0x7efda406f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41018/0 (socket says 172.21.15.2:41018) 2023-11-26T07:12:37.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.767+0000 7efda259c700 1 -- 172.21.15.2:0/3545285162 learned_addr learned my addr 172.21.15.2:0/3545285162 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:37.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.768+0000 7efda259c700 1 -- 172.21.15.2:0/3545285162 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efda415e1c0 msgr2=0x7efda406eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:37.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.768+0000 7efda2d9d700 1 --2- 172.21.15.2:0/3545285162 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efda415e1c0 0x7efda406eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:37.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.768+0000 7efda259c700 1 --2- 172.21.15.2:0/3545285162 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efda415e1c0 0x7efda406eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:37.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.768+0000 7efda359e700 1 --2- 172.21.15.2:0/3545285162 >> v2:172.21.15.192:3300/0 conn(0x7efda406fa80 0x7efda4161d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:37.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.768+0000 7efda259c700 1 -- 172.21.15.2:0/3545285162 >> v2:172.21.15.192:3300/0 conn(0x7efda406fa80 msgr2=0x7efda4161d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:37.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.768+0000 7efda259c700 1 --2- 172.21.15.2:0/3545285162 >> v2:172.21.15.192:3300/0 conn(0x7efda406fa80 0x7efda4161d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:37.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.768+0000 7efda259c700 1 -- 172.21.15.2:0/3545285162 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda40d0f50 con 0x7efda40b0e90 2023-11-26T07:12:37.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.768+0000 7efda259c700 1 --2- 172.21.15.2:0/3545285162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efda40b0e90 0x7efda406f540 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7efda40b0db0 tx=0x7efd94009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cea36431d783f0e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:37.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.768+0000 7efda1d9b700 1 -- 172.21.15.2:0/3545285162 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9400b870 con 0x7efda40b0e90 2023-11-26T07:12:37.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.768+0000 7efda1d9b700 1 -- 172.21.15.2:0/3545285162 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9400b9d0 con 0x7efda40b0e90 2023-11-26T07:12:37.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.768+0000 7efda1d9b700 1 -- 172.21.15.2:0/3545285162 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9400bd60 con 0x7efda40b0e90 2023-11-26T07:12:37.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.769+0000 7efda9193700 1 -- 172.21.15.2:0/3545285162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efda40b0e90 msgr2=0x7efda406f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:37.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.769+0000 7efda9193700 1 --2- 172.21.15.2:0/3545285162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efda40b0e90 0x7efda406f540 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7efda40b0db0 tx=0x7efd94009bd0 comp rx=0 tx=0).stop 2023-11-26T07:12:37.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.769+0000 7efda9193700 1 -- 172.21.15.2:0/3545285162 shutdown_connections 2023-11-26T07:12:37.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.769+0000 7efda9193700 1 --2- 172.21.15.2:0/3545285162 >> v2:172.21.15.192:3300/0 conn(0x7efda406fa80 0x7efda4161d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:37.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.769+0000 7efda9193700 1 --2- 172.21.15.2:0/3545285162 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efda415e1c0 0x7efda406eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:37.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.769+0000 7efda9193700 1 --2- 172.21.15.2:0/3545285162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efda40b0e90 0x7efda406f540 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:37.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.769+0000 7efda9193700 1 -- 172.21.15.2:0/3545285162 >> 172.21.15.2:0/3545285162 conn(0x7efda40b3720 msgr2=0x7efda40b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:37.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.769+0000 7efda9193700 1 -- 172.21.15.2:0/3545285162 shutdown_connections 2023-11-26T07:12:37.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.769+0000 7efda9193700 1 -- 172.21.15.2:0/3545285162 wait complete. 2023-11-26T07:12:37.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.770+0000 7efda9193700 1 Processor -- start 2023-11-26T07:12:37.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.770+0000 7efda9193700 1 -- start start 2023-11-26T07:12:37.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.771+0000 7efda9193700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efda406fa80 0x7efda41f7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:37.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.771+0000 7efda9193700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efda40b0e90 0x7efda4149970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:37.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.771+0000 7efda9193700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efda415e1c0 0x7efda41f3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:37.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.771+0000 7efda9193700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda41f4490 con 0x7efda40b0e90 2023-11-26T07:12:37.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.771+0000 7efda9193700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda41f4770 con 0x7efda415e1c0 2023-11-26T07:12:37.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.771+0000 7efda9193700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda41f4a50 con 0x7efda406fa80 2023-11-26T07:12:37.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.771+0000 7efda259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efda40b0e90 0x7efda4149970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:37.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.771+0000 7efda259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efda40b0e90 0x7efda4149970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41026/0 (socket says 172.21.15.2:41026) 2023-11-26T07:12:37.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.771+0000 7efda259c700 1 -- 172.21.15.2:0/3377237233 learned_addr learned my addr 172.21.15.2:0/3377237233 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:37.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.771+0000 7efda2d9d700 1 --2- 172.21.15.2:0/3377237233 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efda406fa80 0x7efda41f7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:37.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.771+0000 7efda359e700 1 --2- 172.21.15.2:0/3377237233 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efda415e1c0 0x7efda41f3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:37.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.771+0000 7efda259c700 1 -- 172.21.15.2:0/3377237233 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efda406fa80 msgr2=0x7efda41f7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:37.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.771+0000 7efda259c700 1 --2- 172.21.15.2:0/3377237233 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efda406fa80 0x7efda41f7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:37.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.771+0000 7efda259c700 1 -- 172.21.15.2:0/3377237233 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efda415e1c0 msgr2=0x7efda41f3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:37.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.771+0000 7efda259c700 1 --2- 172.21.15.2:0/3377237233 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efda415e1c0 0x7efda41f3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:37.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.771+0000 7efda259c700 1 -- 172.21.15.2:0/3377237233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd94009550 con 0x7efda40b0e90 2023-11-26T07:12:37.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.772+0000 7efda259c700 1 --2- 172.21.15.2:0/3377237233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efda40b0e90 0x7efda4149970 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7efda4072340 tx=0x7efd94004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:37.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.772+0000 7efd8b7fe700 1 -- 172.21.15.2:0/3377237233 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd94004310 con 0x7efda40b0e90 2023-11-26T07:12:37.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.772+0000 7efd8b7fe700 1 -- 172.21.15.2:0/3377237233 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9401f070 con 0x7efda40b0e90 2023-11-26T07:12:37.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.772+0000 7efd8b7fe700 1 -- 172.21.15.2:0/3377237233 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd940036a0 con 0x7efda40b0e90 2023-11-26T07:12:37.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.772+0000 7efda9193700 1 -- 172.21.15.2:0/3377237233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efda4160a70 con 0x7efda40b0e90 2023-11-26T07:12:37.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.772+0000 7efda9193700 1 -- 172.21.15.2:0/3377237233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efda41f4150 con 0x7efda40b0e90 2023-11-26T07:12:37.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.773+0000 7efda9193700 1 -- 172.21.15.2:0/3377237233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efda4160c30 con 0x7efda40b0e90 2023-11-26T07:12:37.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.773+0000 7efd8b7fe700 1 -- 172.21.15.2:0/3377237233 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efd94021030 con 0x7efda40b0e90 2023-11-26T07:12:37.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.774+0000 7efd8b7fe700 1 --2- 172.21.15.2:0/3377237233 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7efd9006aed0 0x7efd9006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:37.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.774+0000 7efd8b7fe700 1 -- 172.21.15.2:0/3377237233 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efd9408ab80 con 0x7efda40b0e90 2023-11-26T07:12:37.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.774+0000 7efda2d9d700 1 --2- 172.21.15.2:0/3377237233 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7efd9006aed0 0x7efd9006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:37.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.774+0000 7efda2d9d700 1 --2- 172.21.15.2:0/3377237233 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7efd9006aed0 0x7efd9006d390 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7efda41623b0 tx=0x7efd98008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:37.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:37.778+0000 7efd8b7fe700 1 -- 172.21.15.2:0/3377237233 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efd94055d60 con 0x7efda40b0e90 2023-11-26T07:12:38.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.027+0000 7efda9193700 1 -- 172.21.15.2:0/3377237233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7efda4068670 con 0x7efda40b0e90 2023-11-26T07:12:38.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.028+0000 7efd8b7fe700 1 -- 172.21.15.2:0/3377237233 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7efd94015070 con 0x7efda40b0e90 2023-11-26T07:12:38.030 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-26T07:12:38.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.030+0000 7efda9193700 1 -- 172.21.15.2:0/3377237233 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7efd9006aed0 msgr2=0x7efd9006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:38.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.030+0000 7efda9193700 1 --2- 172.21.15.2:0/3377237233 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7efd9006aed0 0x7efd9006d390 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7efda41623b0 tx=0x7efd98008040 comp rx=0 tx=0).stop 2023-11-26T07:12:38.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.030+0000 7efda9193700 1 -- 172.21.15.2:0/3377237233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efda40b0e90 msgr2=0x7efda4149970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:38.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.030+0000 7efda9193700 1 --2- 172.21.15.2:0/3377237233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efda40b0e90 0x7efda4149970 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7efda4072340 tx=0x7efd94004750 comp rx=0 tx=0).stop 2023-11-26T07:12:38.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.030+0000 7efda9193700 1 -- 172.21.15.2:0/3377237233 shutdown_connections 2023-11-26T07:12:38.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.030+0000 7efda9193700 1 --2- 172.21.15.2:0/3377237233 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7efd9006aed0 0x7efd9006d390 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:38.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.030+0000 7efda9193700 1 --2- 172.21.15.2:0/3377237233 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efda415e1c0 0x7efda41f3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:38.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.030+0000 7efda9193700 1 --2- 172.21.15.2:0/3377237233 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efda406fa80 0x7efda41f7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:38.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.030+0000 7efda9193700 1 --2- 172.21.15.2:0/3377237233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efda40b0e90 0x7efda4149970 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:38.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.030+0000 7efda9193700 1 -- 172.21.15.2:0/3377237233 >> 172.21.15.2:0/3377237233 conn(0x7efda40b3720 msgr2=0x7efda40b2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:38.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.030+0000 7efda9193700 1 -- 172.21.15.2:0/3377237233 shutdown_connections 2023-11-26T07:12:38.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.030+0000 7efda9193700 1 -- 172.21.15.2:0/3377237233 wait complete. 2023-11-26T07:12:38.044 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-26T07:12:38.044 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-26T07:12:38.044 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2023-11-26T07:12:38.044 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-26T07:12:38.044 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-26T07:12:38.044 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-26T07:12:38.045 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-26T07:12:38.045 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-26T07:12:38.045 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-26T07:12:38.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:38.045 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2023-11-26T07:12:38.066 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:12:38.066 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:12:38.066 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:12:38.066 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:12:38.066 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2023-11-26T07:12:38.067 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:12:38.067 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:12:38.067 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2023-11-26T07:12:38.067 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:12:38.067 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2023-11-26T07:12:38.067 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:12:38.067 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:12:38.067 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-26T07:12:38.067 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:12:38.067 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-26T07:12:38.068 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42343sec preferred_lft 42343sec 2023-11-26T07:12:38.068 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::4774:e26a:42bc:5f29/64 scope link noprefixroute 2023-11-26T07:12:38.068 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:12:38.068 INFO:teuthology.orchestra.run.smithi192.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-26T07:12:38.068 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 8a:29:a0:eb:3c:15 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:12:38.068 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-26T07:12:38.068 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:12:38.068 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::548b:6dff:fe7a:f7ca/64 scope link 2023-11-26T07:12:38.068 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:12:38.068 INFO:teuthology.orchestra.run.smithi192.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:12:38.068 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether a2:92:2e:43:f5:72 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:12:38.068 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::a092:2eff:fe43:f572/64 scope link 2023-11-26T07:12:38.069 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:12:38.069 INFO:teuthology.orchestra.run.smithi192.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:12:38.069 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 8a:29:a0:eb:3c:15 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-26T07:12:38.069 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::8829:a0ff:feeb:3c15/64 scope link 2023-11-26T07:12:38.069 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:12:38.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:38.069 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-26T07:12:38.135 INFO:teuthology.orchestra.run.smithi192.stdout:1 2023-11-26T07:12:38.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:38.137 DEBUG:teuthology.orchestra.run.smithi192:> route 2023-11-26T07:12:38.197 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2023-11-26T07:12:38.198 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-26T07:12:38.198 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-26T07:12:38.198 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-26T07:12:38.198 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-26T07:12:38.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:38.198 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-11-26T07:12:38.198 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-11-26T07:12:38.199 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-26T07:12:38.199 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-26T07:12:38.199 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-26T07:12:38.199 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-11-26T07:12:38.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:38.307 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2023-11-26T07:12:38.324 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-26T07:12:38.325 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-26T07:12:38.325 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-26T07:12:38.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:38.325 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2023-11-26T07:12:38.392 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:12:38.392 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-26T07:12:38.448 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-26T07:12:38.449 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:12:38.449 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-26T07:12:38.505 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-26T07:12:38.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:38.505 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-26T07:12:38.590 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-26T07:12:38.590 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-26T07:12:38.590 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2023-11-26T07:12:38.599 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-26T07:12:38.599 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-26T07:12:38.599 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2023-11-26T07:12:38.599 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-11-26T07:12:38.599 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:12:38.640 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-26T07:12:38.641 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-26T07:12:38.641 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2023-11-26T07:12:38.641 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-11-26T07:12:38.641 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:12:38.641 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.2:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-11-26T07:12:38.641 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.2:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-11-26T07:12:38.641 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=cb9817c7-f1ed-4745-9395-2760a3bb9712" will pass to kernel 2023-11-26T07:12:38.654 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-26T07:12:38.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:38.655 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-26T07:12:38.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:38.682 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-26T07:12:38.753 INFO:teuthology.orchestra.run.smithi192.stdout:client4835 2023-11-26T07:12:38.754 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:12:38.754 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:38.811 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-11-26T07:12:38.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.952+0000 7fb2b7976700 1 Processor -- start 2023-11-26T07:12:38.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.952+0000 7fb2b7976700 1 -- start start 2023-11-26T07:12:38.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.953+0000 7fb2b7976700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb2b00cd150 0x7fb2b00ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:38.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.953+0000 7fb2b7976700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2b006f940 0x7fb2b006fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:38.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.953+0000 7fb2b7976700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2b006f4b0 con 0x7fb2b015bfe0 2023-11-26T07:12:38.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.953+0000 7fb2b7976700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2b015c3c0 con 0x7fb2b00cd150 2023-11-26T07:12:38.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.953+0000 7fb2b7976700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b00cd760 con 0x7fb2b006f940 2023-11-26T07:12:38.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.953+0000 7fb2b5f13700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2b006f940 0x7fb2b006fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:38.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.953+0000 7fb2b4f11700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb2b00cd150 0x7fb2b00ceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:38.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.953+0000 7fb2b5f13700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2b006f940 0x7fb2b006fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.2:39116/0 (socket says 172.21.15.2:39116) 2023-11-26T07:12:38.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.953+0000 7fb2b5f13700 1 -- 172.21.15.2:0/2740335528 learned_addr learned my addr 172.21.15.2:0/2740335528 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:38.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.953+0000 7fb2b5712700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fb2b015bfe0 0x7fb2b00ce430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.2:39612/0 (socket says 172.21.15.2:39612) 2023-11-26T07:12:38.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.954+0000 7fb2b4f11700 1 -- 172.21.15.2:0/2740335528 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2b006f940 msgr2=0x7fb2b006fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:38.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.954+0000 7fb2b4f11700 1 --2- 172.21.15.2:0/2740335528 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2b006f940 0x7fb2b006fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:38.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.954+0000 7fb2b4f11700 1 -- 172.21.15.2:0/2740335528 >> v1:172.21.15.192:6789/0 conn(0x7fb2b015bfe0 legacy=0x7fb2b00ce430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:38.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.954+0000 7fb2a7fff700 1 -- 172.21.15.2:0/2740335528 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2389662238 0 0) 0x7fb2b006f4b0 con 0x7fb2b015bfe0 2023-11-26T07:12:38.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.954+0000 7fb2b4f11700 1 -- 172.21.15.2:0/2740335528 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b006ee60 con 0x7fb2b00cd150 2023-11-26T07:12:38.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.954+0000 7fb2b5f13700 1 --2- 172.21.15.2:0/2740335528 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2b006f940 0x7fb2b006fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:12:38.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.954+0000 7fb2b4f11700 1 --2- 172.21.15.2:0/2740335528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2b00cd150 0x7fb2b00ceb40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0009840 tx=0x7fb2a0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=798f48047546e3bc server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:38.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.954+0000 7fb2a7fff700 1 -- 172.21.15.2:0/2740335528 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a0011830 con 0x7fb2b00cd150 2023-11-26T07:12:38.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.954+0000 7fb2a7fff700 1 -- 172.21.15.2:0/2740335528 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a0011990 con 0x7fb2b00cd150 2023-11-26T07:12:38.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.954+0000 7fb2a7fff700 1 -- 172.21.15.2:0/2740335528 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a0011d20 con 0x7fb2b00cd150 2023-11-26T07:12:38.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.954+0000 7fb2b7976700 1 -- 172.21.15.2:0/2740335528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2b00cd150 msgr2=0x7fb2b00ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:38.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.954+0000 7fb2b7976700 1 --2- 172.21.15.2:0/2740335528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2b00cd150 0x7fb2b00ceb40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0009840 tx=0x7fb2a0009b50 comp rx=0 tx=0).stop 2023-11-26T07:12:38.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.954+0000 7fb2b7976700 1 -- 172.21.15.2:0/2740335528 shutdown_connections 2023-11-26T07:12:38.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.954+0000 7fb2b7976700 1 --2- 172.21.15.2:0/2740335528 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2b006f940 0x7fb2b006fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:38.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.954+0000 7fb2b7976700 1 --2- 172.21.15.2:0/2740335528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2b00cd150 0x7fb2b00ceb40 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:38.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.954+0000 7fb2b7976700 1 -- 172.21.15.2:0/2740335528 >> 172.21.15.2:0/2740335528 conn(0x7fb2b00b3700 msgr2=0x7fb2b00b3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:38.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.955+0000 7fb2b7976700 1 -- 172.21.15.2:0/2740335528 shutdown_connections 2023-11-26T07:12:38.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.955+0000 7fb2b7976700 1 -- 172.21.15.2:0/2740335528 wait complete. 2023-11-26T07:12:38.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.956+0000 7fb2b7976700 1 Processor -- start 2023-11-26T07:12:38.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.956+0000 7fb2b7976700 1 -- start start 2023-11-26T07:12:38.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.956+0000 7fb2b7976700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2b006f940 0x7fb2b00cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:38.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.956+0000 7fb2b7976700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2b00cd150 0x7fb2b00c6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:38.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.957+0000 7fb2b7976700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2b015bfe0 0x7fb2b00c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:38.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.957+0000 7fb2b7976700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b00c6c40 con 0x7fb2b015bfe0 2023-11-26T07:12:38.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.957+0000 7fb2b7976700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b006c610 con 0x7fb2b006f940 2023-11-26T07:12:38.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.957+0000 7fb2b7976700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b006c8f0 con 0x7fb2b00cd150 2023-11-26T07:12:38.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.957+0000 7fb2b4f11700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2b00cd150 0x7fb2b00c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:38.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.957+0000 7fb2b5712700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2b006f940 0x7fb2b00cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:38.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.957+0000 7fb2b5f13700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2b015bfe0 0x7fb2b00c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:38.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.957+0000 7fb2b4f11700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2b00cd150 0x7fb2b00c6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.2:39120/0 (socket says 172.21.15.2:39120) 2023-11-26T07:12:38.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.957+0000 7fb2b4f11700 1 -- 172.21.15.2:0/2149380478 learned_addr learned my addr 172.21.15.2:0/2149380478 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:38.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.957+0000 7fb2b5712700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2b006f940 0x7fb2b00cbe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.2:49624/0 (socket says 172.21.15.2:49624) 2023-11-26T07:12:38.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.957+0000 7fb2b5f13700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2b015bfe0 0x7fb2b00c9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41042/0 (socket says 172.21.15.2:41042) 2023-11-26T07:12:38.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.957+0000 7fb2b5712700 1 -- 172.21.15.2:0/2149380478 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2b00cd150 msgr2=0x7fb2b00c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:38.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.957+0000 7fb2b5712700 1 --2- 172.21.15.2:0/2149380478 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2b00cd150 0x7fb2b00c6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:38.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.957+0000 7fb2b5712700 1 -- 172.21.15.2:0/2149380478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2b015bfe0 msgr2=0x7fb2b00c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:38.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.957+0000 7fb2b5712700 1 --2- 172.21.15.2:0/2149380478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2b015bfe0 0x7fb2b00c9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:38.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.957+0000 7fb2b5712700 1 -- 172.21.15.2:0/2149380478 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a8009b30 con 0x7fb2b006f940 2023-11-26T07:12:38.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.957+0000 7fb2b4f11700 1 --2- 172.21.15.2:0/2149380478 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2b00cd150 0x7fb2b00c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:12:38.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.957+0000 7fb2b5f13700 1 --2- 172.21.15.2:0/2149380478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2b015bfe0 0x7fb2b00c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:12:38.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.957+0000 7fb2b5712700 1 --2- 172.21.15.2:0/2149380478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2b006f940 0x7fb2b00cbe20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac00c410 tx=0x7fb2ac00c720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:38.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.957+0000 7fb2a5ffb700 1 -- 172.21.15.2:0/2149380478 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac004c80 con 0x7fb2b006f940 2023-11-26T07:12:38.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.957+0000 7fb2a5ffb700 1 -- 172.21.15.2:0/2149380478 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2ac004de0 con 0x7fb2b006f940 2023-11-26T07:12:38.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.957+0000 7fb2b7976700 1 -- 172.21.15.2:0/2149380478 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2a00094a0 con 0x7fb2b006f940 2023-11-26T07:12:38.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.957+0000 7fb2a5ffb700 1 -- 172.21.15.2:0/2149380478 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac007310 con 0x7fb2b006f940 2023-11-26T07:12:38.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.958+0000 7fb2b7976700 1 -- 172.21.15.2:0/2149380478 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b006ceb0 con 0x7fb2b006f940 2023-11-26T07:12:38.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.959+0000 7fb2b7976700 1 -- 172.21.15.2:0/2149380478 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2b006bc40 con 0x7fb2b006f940 2023-11-26T07:12:38.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.959+0000 7fb2a5ffb700 1 -- 172.21.15.2:0/2149380478 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb2ac007470 con 0x7fb2b006f940 2023-11-26T07:12:38.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.959+0000 7fb2a5ffb700 1 --2- 172.21.15.2:0/2149380478 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb29406aed0 0x7fb29406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:38.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.960+0000 7fb2a5ffb700 1 -- 172.21.15.2:0/2149380478 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb2ac0890e0 con 0x7fb2b006f940 2023-11-26T07:12:38.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.960+0000 7fb2b4f11700 1 --2- 172.21.15.2:0/2149380478 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb29406aed0 0x7fb29406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:38.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.960+0000 7fb2b4f11700 1 --2- 172.21.15.2:0/2149380478 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb29406aed0 0x7fb29406d390 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb2b00d1460 tx=0x7fb2a0008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:38.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:38.964+0000 7fb2a5ffb700 1 -- 172.21.15.2:0/2149380478 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb2ac054190 con 0x7fb2b006f940 2023-11-26T07:12:39.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.211+0000 7fb2b7976700 1 -- 172.21.15.2:0/2149380478 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb2b00cf000 con 0x7fb2b006f940 2023-11-26T07:12:39.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.426+0000 7fb2a5ffb700 1 -- 172.21.15.2:0/2149380478 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v17) v1 ==== 136+0+0 (secure 0 0 0) 0x7fb2ac0577b0 con 0x7fb2b006f940 2023-11-26T07:12:39.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.428+0000 7fb2b7976700 1 -- 172.21.15.2:0/2149380478 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb29406aed0 msgr2=0x7fb29406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:39.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.428+0000 7fb2b7976700 1 --2- 172.21.15.2:0/2149380478 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb29406aed0 0x7fb29406d390 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb2b00d1460 tx=0x7fb2a0008030 comp rx=0 tx=0).stop 2023-11-26T07:12:39.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.428+0000 7fb2b7976700 1 -- 172.21.15.2:0/2149380478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2b006f940 msgr2=0x7fb2b00cbe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:39.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.428+0000 7fb2b7976700 1 --2- 172.21.15.2:0/2149380478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2b006f940 0x7fb2b00cbe20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac00c410 tx=0x7fb2ac00c720 comp rx=0 tx=0).stop 2023-11-26T07:12:39.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.428+0000 7fb2b7976700 1 -- 172.21.15.2:0/2149380478 shutdown_connections 2023-11-26T07:12:39.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.428+0000 7fb2b7976700 1 --2- 172.21.15.2:0/2149380478 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb29406aed0 0x7fb29406d390 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:39.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.428+0000 7fb2b7976700 1 --2- 172.21.15.2:0/2149380478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2b015bfe0 0x7fb2b00c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:39.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.428+0000 7fb2b7976700 1 --2- 172.21.15.2:0/2149380478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2b006f940 0x7fb2b00cbe20 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:39.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.428+0000 7fb2b7976700 1 --2- 172.21.15.2:0/2149380478 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2b00cd150 0x7fb2b00c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:39.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.428+0000 7fb2b7976700 1 -- 172.21.15.2:0/2149380478 >> 172.21.15.2:0/2149380478 conn(0x7fb2b00b3700 msgr2=0x7fb2b00ce430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:39.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.428+0000 7fb2b7976700 1 -- 172.21.15.2:0/2149380478 shutdown_connections 2023-11-26T07:12:39.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.428+0000 7fb2b7976700 1 -- 172.21.15.2:0/2149380478 wait complete. 2023-11-26T07:12:39.443 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-26T07:12:39.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.567+0000 7fc92c8c9700 1 Processor -- start 2023-11-26T07:12:39.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.567+0000 7fc92c8c9700 1 -- start start 2023-11-26T07:12:39.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.568+0000 7fc92c8c9700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc928144c10 0x7fc92806afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:39.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.568+0000 7fc92c8c9700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc928145650 0x7fc92806b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:39.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.568+0000 7fc92c8c9700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc92806eb80 con 0x7fc928145100 2023-11-26T07:12:39.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.568+0000 7fc92c8c9700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc92806f500 con 0x7fc928144c10 2023-11-26T07:12:39.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.568+0000 7fc92c8c9700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9280cd610 con 0x7fc928145650 2023-11-26T07:12:39.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.568+0000 7fc92659c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc928144c10 0x7fc92806afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:39.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.568+0000 7fc925d9b700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc928145100 0x7fc928071bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60488/0 (socket says 172.21.15.2:60488) 2023-11-26T07:12:39.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.568+0000 7fc925d9b700 1 -- 172.21.15.2:0/2282033151 learned_addr learned my addr 172.21.15.2:0/2282033151 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:12:39.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.569+0000 7fc926d9d700 1 --2- 172.21.15.2:0/2282033151 >> v2:172.21.15.192:3300/0 conn(0x7fc928145650 0x7fc92806b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:39.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.569+0000 7fc92659c700 1 -- 172.21.15.2:0/2282033151 >> v2:172.21.15.192:3300/0 conn(0x7fc928145650 msgr2=0x7fc92806b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:39.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.569+0000 7fc92659c700 1 --2- 172.21.15.2:0/2282033151 >> v2:172.21.15.192:3300/0 conn(0x7fc928145650 0x7fc92806b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:39.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.569+0000 7fc92659c700 1 -- 172.21.15.2:0/2282033151 >> v1:172.21.15.2:6789/0 conn(0x7fc928145100 legacy=0x7fc928071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:39.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.569+0000 7fc92659c700 1 -- 172.21.15.2:0/2282033151 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc928160720 con 0x7fc928144c10 2023-11-26T07:12:39.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.569+0000 7fc92559a700 1 -- 172.21.15.2:0/2282033151 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3409885806 0 0) 0x7fc92806eb80 con 0x7fc928145100 2023-11-26T07:12:39.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.569+0000 7fc92659c700 1 --2- 172.21.15.2:0/2282033151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc928144c10 0x7fc92806afd0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc928073800 tx=0x7fc91c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba9381e7ea2011a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:39.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.569+0000 7fc92559a700 1 -- 172.21.15.2:0/2282033151 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91c011830 con 0x7fc928144c10 2023-11-26T07:12:39.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.569+0000 7fc92559a700 1 -- 172.21.15.2:0/2282033151 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc91c011990 con 0x7fc928144c10 2023-11-26T07:12:39.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.569+0000 7fc92559a700 1 -- 172.21.15.2:0/2282033151 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91c011d20 con 0x7fc928144c10 2023-11-26T07:12:39.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.570+0000 7fc92c8c9700 1 -- 172.21.15.2:0/2282033151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc928144c10 msgr2=0x7fc92806afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:39.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.570+0000 7fc92c8c9700 1 --2- 172.21.15.2:0/2282033151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc928144c10 0x7fc92806afd0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc928073800 tx=0x7fc91c009b20 comp rx=0 tx=0).stop 2023-11-26T07:12:39.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.570+0000 7fc92c8c9700 1 -- 172.21.15.2:0/2282033151 shutdown_connections 2023-11-26T07:12:39.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.570+0000 7fc92c8c9700 1 --2- 172.21.15.2:0/2282033151 >> v2:172.21.15.192:3300/0 conn(0x7fc928145650 0x7fc92806b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:39.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.570+0000 7fc92c8c9700 1 --2- 172.21.15.2:0/2282033151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc928144c10 0x7fc92806afd0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:39.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.570+0000 7fc92c8c9700 1 -- 172.21.15.2:0/2282033151 >> 172.21.15.2:0/2282033151 conn(0x7fc9280b2740 msgr2=0x7fc9280b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:39.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.570+0000 7fc92c8c9700 1 -- 172.21.15.2:0/2282033151 shutdown_connections 2023-11-26T07:12:39.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.570+0000 7fc92c8c9700 1 -- 172.21.15.2:0/2282033151 wait complete. 2023-11-26T07:12:39.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.571+0000 7fc92c8c9700 1 Processor -- start 2023-11-26T07:12:39.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.571+0000 7fc92c8c9700 1 -- start start 2023-11-26T07:12:39.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.572+0000 7fc92c8c9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc928144c10 0x7fc9280ad770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:39.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.572+0000 7fc92c8c9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc928145100 0x7fc928132cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:39.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.572+0000 7fc92c8c9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc928145650 0x7fc9281f53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:39.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.572+0000 7fc92c8c9700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9280adcb0 con 0x7fc928145650 2023-11-26T07:12:39.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.572+0000 7fc92c8c9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9281f62d0 con 0x7fc928144c10 2023-11-26T07:12:39.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.572+0000 7fc92c8c9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9281f5d10 con 0x7fc928145100 2023-11-26T07:12:39.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.572+0000 7fc926d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc928145650 0x7fc9281f53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:39.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.572+0000 7fc926d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc928145650 0x7fc9281f53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41054/0 (socket says 172.21.15.2:41054) 2023-11-26T07:12:39.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.572+0000 7fc926d9d700 1 -- 172.21.15.2:0/2215912491 learned_addr learned my addr 172.21.15.2:0/2215912491 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:39.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.572+0000 7fc92659c700 1 --2- 172.21.15.2:0/2215912491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc928144c10 0x7fc9280ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:39.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.572+0000 7fc925d9b700 1 --2- 172.21.15.2:0/2215912491 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc928145100 0x7fc928132cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:39.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.572+0000 7fc926d9d700 1 -- 172.21.15.2:0/2215912491 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc928145100 msgr2=0x7fc928132cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:39.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.572+0000 7fc926d9d700 1 --2- 172.21.15.2:0/2215912491 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc928145100 0x7fc928132cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:39.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.572+0000 7fc926d9d700 1 -- 172.21.15.2:0/2215912491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc928144c10 msgr2=0x7fc9280ad770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:39.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.572+0000 7fc926d9d700 1 --2- 172.21.15.2:0/2215912491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc928144c10 0x7fc9280ad770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:39.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.572+0000 7fc926d9d700 1 -- 172.21.15.2:0/2215912491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc91c0094a0 con 0x7fc928145650 2023-11-26T07:12:39.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.572+0000 7fc92659c700 1 --2- 172.21.15.2:0/2215912491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc928144c10 0x7fc9280ad770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:12:39.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.572+0000 7fc926d9d700 1 --2- 172.21.15.2:0/2215912491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc928145650 0x7fc9281f53a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc92000efc0 tx=0x7fc92000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:39.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.573+0000 7fc916ffd700 1 -- 172.21.15.2:0/2215912491 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc920009b20 con 0x7fc928145650 2023-11-26T07:12:39.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.573+0000 7fc916ffd700 1 -- 172.21.15.2:0/2215912491 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92000f040 con 0x7fc928145650 2023-11-26T07:12:39.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.573+0000 7fc916ffd700 1 -- 172.21.15.2:0/2215912491 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc920009e50 con 0x7fc928145650 2023-11-26T07:12:39.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.573+0000 7fc92c8c9700 1 -- 172.21.15.2:0/2215912491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9281f5ff0 con 0x7fc928145650 2023-11-26T07:12:39.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.573+0000 7fc92c8c9700 1 -- 172.21.15.2:0/2215912491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9281327b0 con 0x7fc928145650 2023-11-26T07:12:39.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.574+0000 7fc92c8c9700 1 -- 172.21.15.2:0/2215912491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc928068670 con 0x7fc928145650 2023-11-26T07:12:39.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.574+0000 7fc916ffd700 1 -- 172.21.15.2:0/2215912491 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc920014480 con 0x7fc928145650 2023-11-26T07:12:39.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.574+0000 7fc916ffd700 1 --2- 172.21.15.2:0/2215912491 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc90806aed0 0x7fc90806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:39.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.574+0000 7fc916ffd700 1 -- 172.21.15.2:0/2215912491 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc92008a090 con 0x7fc928145650 2023-11-26T07:12:39.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.575+0000 7fc92659c700 1 --2- 172.21.15.2:0/2215912491 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc90806aed0 0x7fc90806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:39.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.575+0000 7fc92659c700 1 --2- 172.21.15.2:0/2215912491 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc90806aed0 0x7fc90806d390 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc91c009b60 tx=0x7fc91c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:39.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.579+0000 7fc916ffd700 1 -- 172.21.15.2:0/2215912491 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc9200551d0 con 0x7fc928145650 2023-11-26T07:12:39.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.807+0000 7fc92c8c9700 1 -- 172.21.15.2:0/2215912491 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fc9281603b0 con 0x7fc90806aed0 2023-11-26T07:12:39.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.809+0000 7fc916ffd700 1 -- 172.21.15.2:0/2215912491 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fc91c011630 con 0x7fc90806aed0 2023-11-26T07:12:39.810 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2023-11-26T07:12:39.811 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:12:39.811 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephfs" 2023-11-26T07:12:39.811 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:12:39.811 INFO:teuthology.orchestra.run.smithi002.stdout:] 2023-11-26T07:12:39.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.811+0000 7fc92c8c9700 1 -- 172.21.15.2:0/2215912491 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc90806aed0 msgr2=0x7fc90806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:39.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.811+0000 7fc92c8c9700 1 --2- 172.21.15.2:0/2215912491 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc90806aed0 0x7fc90806d390 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc91c009b60 tx=0x7fc91c008030 comp rx=0 tx=0).stop 2023-11-26T07:12:39.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.811+0000 7fc92c8c9700 1 -- 172.21.15.2:0/2215912491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc928145650 msgr2=0x7fc9281f53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:39.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.811+0000 7fc92c8c9700 1 --2- 172.21.15.2:0/2215912491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc928145650 0x7fc9281f53a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc92000efc0 tx=0x7fc92000c3a0 comp rx=0 tx=0).stop 2023-11-26T07:12:39.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.811+0000 7fc92c8c9700 1 -- 172.21.15.2:0/2215912491 shutdown_connections 2023-11-26T07:12:39.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.811+0000 7fc92c8c9700 1 --2- 172.21.15.2:0/2215912491 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc90806aed0 0x7fc90806d390 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:39.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.811+0000 7fc92c8c9700 1 --2- 172.21.15.2:0/2215912491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc928145650 0x7fc9281f53a0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:39.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.811+0000 7fc92c8c9700 1 --2- 172.21.15.2:0/2215912491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc928144c10 0x7fc9280ad770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:39.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.811+0000 7fc92c8c9700 1 --2- 172.21.15.2:0/2215912491 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc928145100 0x7fc928132cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:39.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.811+0000 7fc92c8c9700 1 -- 172.21.15.2:0/2215912491 >> 172.21.15.2:0/2215912491 conn(0x7fc9280b2740 msgr2=0x7fc928142c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:39.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.811+0000 7fc92c8c9700 1 -- 172.21.15.2:0/2215912491 shutdown_connections 2023-11-26T07:12:39.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.811+0000 7fc92c8c9700 1 -- 172.21.15.2:0/2215912491 wait complete. 2023-11-26T07:12:39.825 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-26T07:12:39.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.951+0000 7f021edba700 1 Processor -- start 2023-11-26T07:12:39.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.951+0000 7f021edba700 1 -- start start 2023-11-26T07:12:39.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.952+0000 7f021edba700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0218143ae0 0x7f02180b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:39.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.952+0000 7f021edba700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02181440f0 0x7f0218071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:39.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.952+0000 7f021edba700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f02180720f0 0x7f021815e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:39.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.952+0000 7f021edba700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02180b40a0 con 0x7f0218143ae0 2023-11-26T07:12:39.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.952+0000 7f021edba700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0218072580 con 0x7f02180720f0 2023-11-26T07:12:39.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.952+0000 7f021edba700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0218143ec0 con 0x7f02181440f0 2023-11-26T07:12:39.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.952+0000 7f021cb56700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0218143ae0 0x7f02180b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:39.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.952+0000 7f021cb56700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0218143ae0 0x7f02180b51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41058/0 (socket says 172.21.15.2:41058) 2023-11-26T07:12:39.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.952+0000 7f021cb56700 1 -- 172.21.15.2:0/2057803118 learned_addr learned my addr 172.21.15.2:0/2057803118 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:39.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.952+0000 7f021d357700 1 --2- 172.21.15.2:0/2057803118 >> v2:172.21.15.192:3300/0 conn(0x7f02180720f0 0x7f021815e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:39.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.952+0000 7f0217fff700 1 --2- 172.21.15.2:0/2057803118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02181440f0 0x7f0218071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:39.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.952+0000 7f021cb56700 1 -- 172.21.15.2:0/2057803118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02181440f0 msgr2=0x7f0218071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:39.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.952+0000 7f021cb56700 1 --2- 172.21.15.2:0/2057803118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02181440f0 0x7f0218071bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:39.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.952+0000 7f021cb56700 1 -- 172.21.15.2:0/2057803118 >> v2:172.21.15.192:3300/0 conn(0x7f02180720f0 msgr2=0x7f021815e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:39.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.952+0000 7f021cb56700 1 --2- 172.21.15.2:0/2057803118 >> v2:172.21.15.192:3300/0 conn(0x7f02180720f0 0x7f021815e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:39.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.952+0000 7f021cb56700 1 -- 172.21.15.2:0/2057803118 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02180b3ae0 con 0x7f0218143ae0 2023-11-26T07:12:39.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.953+0000 7f021cb56700 1 --2- 172.21.15.2:0/2057803118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0218143ae0 0x7f02180b51b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f02180706c0 tx=0x7f020c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ee22d4bea90c65d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:39.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.953+0000 7f02177fe700 1 -- 172.21.15.2:0/2057803118 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020c00b870 con 0x7f0218143ae0 2023-11-26T07:12:39.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.953+0000 7f02177fe700 1 -- 172.21.15.2:0/2057803118 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020c00b9d0 con 0x7f0218143ae0 2023-11-26T07:12:39.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.953+0000 7f02177fe700 1 -- 172.21.15.2:0/2057803118 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020c00bd60 con 0x7f0218143ae0 2023-11-26T07:12:39.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.953+0000 7f021edba700 1 -- 172.21.15.2:0/2057803118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0218143ae0 msgr2=0x7f02180b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:39.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.953+0000 7f021edba700 1 --2- 172.21.15.2:0/2057803118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0218143ae0 0x7f02180b51b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f02180706c0 tx=0x7f020c009bd0 comp rx=0 tx=0).stop 2023-11-26T07:12:39.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.953+0000 7f021edba700 1 -- 172.21.15.2:0/2057803118 shutdown_connections 2023-11-26T07:12:39.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.953+0000 7f021edba700 1 --2- 172.21.15.2:0/2057803118 >> v2:172.21.15.192:3300/0 conn(0x7f02180720f0 0x7f021815e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:39.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.953+0000 7f021edba700 1 --2- 172.21.15.2:0/2057803118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0218143ae0 0x7f02180b51b0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:39.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.953+0000 7f021edba700 1 --2- 172.21.15.2:0/2057803118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02181440f0 0x7f0218071bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:39.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.953+0000 7f021edba700 1 -- 172.21.15.2:0/2057803118 >> 172.21.15.2:0/2057803118 conn(0x7f02180b2740 msgr2=0x7f02180b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:39.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.953+0000 7f021edba700 1 -- 172.21.15.2:0/2057803118 shutdown_connections 2023-11-26T07:12:39.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.953+0000 7f021edba700 1 -- 172.21.15.2:0/2057803118 wait complete. 2023-11-26T07:12:39.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.955+0000 7f021edba700 1 Processor -- start 2023-11-26T07:12:39.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.955+0000 7f021edba700 1 -- start start 2023-11-26T07:12:39.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.955+0000 7f021edba700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02180720f0 0x7f0218131d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:39.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.955+0000 7f021edba700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0218143ae0 0x7f02181303a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:39.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.955+0000 7f021edba700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02181440f0 0x7f02181326a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:39.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.955+0000 7f021edba700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0218132240 con 0x7f02180720f0 2023-11-26T07:12:39.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.955+0000 7f021edba700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0218130c60 con 0x7f02181440f0 2023-11-26T07:12:39.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.955+0000 7f021edba700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0218130f40 con 0x7f0218143ae0 2023-11-26T07:12:39.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.956+0000 7f021cb56700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02180720f0 0x7f0218131d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:39.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.956+0000 7f021cb56700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02180720f0 0x7f0218131d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41064/0 (socket says 172.21.15.2:41064) 2023-11-26T07:12:39.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.956+0000 7f021cb56700 1 -- 172.21.15.2:0/3653077410 learned_addr learned my addr 172.21.15.2:0/3653077410 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:39.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.956+0000 7f0217fff700 1 --2- 172.21.15.2:0/3653077410 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0218143ae0 0x7f02181303a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:39.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.956+0000 7f021d357700 1 --2- 172.21.15.2:0/3653077410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02181440f0 0x7f02181326a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:39.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.956+0000 7f021cb56700 1 -- 172.21.15.2:0/3653077410 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0218143ae0 msgr2=0x7f02181303a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:39.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.956+0000 7f021cb56700 1 --2- 172.21.15.2:0/3653077410 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0218143ae0 0x7f02181303a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:39.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.956+0000 7f021cb56700 1 -- 172.21.15.2:0/3653077410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02181440f0 msgr2=0x7f02181326a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:39.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.956+0000 7f021cb56700 1 --2- 172.21.15.2:0/3653077410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02181440f0 0x7f02181326a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:39.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.956+0000 7f021cb56700 1 -- 172.21.15.2:0/3653077410 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020c009550 con 0x7f02180720f0 2023-11-26T07:12:39.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.956+0000 7f021cb56700 1 --2- 172.21.15.2:0/3653077410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02180720f0 0x7f0218131d00 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f020c000c00 tx=0x7f020c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:39.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.956+0000 7f02157fa700 1 -- 172.21.15.2:0/3653077410 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020c004310 con 0x7f02180720f0 2023-11-26T07:12:39.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.956+0000 7f021edba700 1 -- 172.21.15.2:0/3653077410 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0218131220 con 0x7f02180720f0 2023-11-26T07:12:39.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.956+0000 7f02157fa700 1 -- 172.21.15.2:0/3653077410 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020c01e070 con 0x7f02180720f0 2023-11-26T07:12:39.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.956+0000 7f02157fa700 1 -- 172.21.15.2:0/3653077410 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020c0036a0 con 0x7f02180720f0 2023-11-26T07:12:39.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.956+0000 7f021edba700 1 -- 172.21.15.2:0/3653077410 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02181317e0 con 0x7f02180720f0 2023-11-26T07:12:39.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.957+0000 7f021edba700 1 -- 172.21.15.2:0/3653077410 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0218131b50 con 0x7f02180720f0 2023-11-26T07:12:39.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.958+0000 7f02157fa700 1 -- 172.21.15.2:0/3653077410 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f020c020030 con 0x7f02180720f0 2023-11-26T07:12:39.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.958+0000 7f02157fa700 1 --2- 172.21.15.2:0/3653077410 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f01fc06aed0 0x7f01fc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:39.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.958+0000 7f02157fa700 1 -- 172.21.15.2:0/3653077410 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f020c08a460 con 0x7f02180720f0 2023-11-26T07:12:39.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.958+0000 7f0217fff700 1 --2- 172.21.15.2:0/3653077410 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f01fc06aed0 0x7f01fc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:39.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.959+0000 7f0217fff700 1 --2- 172.21.15.2:0/3653077410 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f01fc06aed0 0x7f01fc06d390 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0218159dc0 tx=0x7f0204008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:39.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:39.963+0000 7f02157fa700 1 -- 172.21.15.2:0/3653077410 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f020c055520 con 0x7f02180720f0 2023-11-26T07:12:40.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.164+0000 7f021edba700 1 -- 172.21.15.2:0/3653077410 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f0218144830 con 0x7f02180720f0 2023-11-26T07:12:40.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.164+0000 7f02157fa700 1 -- 172.21.15.2:0/3653077410 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f020c058b40 con 0x7f02180720f0 2023-11-26T07:12:40.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.166+0000 7f021edba700 1 -- 172.21.15.2:0/3653077410 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f01fc06aed0 msgr2=0x7f01fc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:40.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.166+0000 7f021edba700 1 --2- 172.21.15.2:0/3653077410 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f01fc06aed0 0x7f01fc06d390 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0218159dc0 tx=0x7f0204008040 comp rx=0 tx=0).stop 2023-11-26T07:12:40.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.166+0000 7f021edba700 1 -- 172.21.15.2:0/3653077410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02180720f0 msgr2=0x7f0218131d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:40.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.166+0000 7f021edba700 1 --2- 172.21.15.2:0/3653077410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02180720f0 0x7f0218131d00 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f020c000c00 tx=0x7f020c004750 comp rx=0 tx=0).stop 2023-11-26T07:12:40.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.166+0000 7f021edba700 1 -- 172.21.15.2:0/3653077410 shutdown_connections 2023-11-26T07:12:40.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.166+0000 7f021edba700 1 --2- 172.21.15.2:0/3653077410 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f01fc06aed0 0x7f01fc06d390 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:40.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.166+0000 7f021edba700 1 --2- 172.21.15.2:0/3653077410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02181440f0 0x7f02181326a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:40.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.166+0000 7f021edba700 1 --2- 172.21.15.2:0/3653077410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02180720f0 0x7f0218131d00 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:40.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.166+0000 7f021edba700 1 --2- 172.21.15.2:0/3653077410 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0218143ae0 0x7f02181303a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:40.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.166+0000 7f021edba700 1 -- 172.21.15.2:0/3653077410 >> 172.21.15.2:0/3653077410 conn(0x7f02180b2740 msgr2=0x7f021815b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:40.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.166+0000 7f021edba700 1 -- 172.21.15.2:0/3653077410 shutdown_connections 2023-11-26T07:12:40.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.166+0000 7f021edba700 1 -- 172.21.15.2:0/3653077410 wait complete. 2023-11-26T07:12:40.180 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol68520 --mode=777 2023-11-26T07:12:40.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.307+0000 7f6356db3700 1 Processor -- start 2023-11-26T07:12:40.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.307+0000 7f6356db3700 1 -- start start 2023-11-26T07:12:40.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.308+0000 7f6356db3700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f63500725a0 0x7f635006f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:40.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.308+0000 7f6356db3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63500cf020 0x7f63500cf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:40.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.308+0000 7f6356db3700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63500cd490 con 0x7f63501457b0 2023-11-26T07:12:40.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.308+0000 7f6356db3700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f635006fac0 con 0x7f63500725a0 2023-11-26T07:12:40.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.308+0000 7f6356db3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6350072a20 con 0x7f63500cf020 2023-11-26T07:12:40.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.308+0000 7f634ffff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f63500725a0 0x7f635006f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:40.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.308+0000 7f634ffff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f63500725a0 0x7f635006f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41072/0 (socket says 172.21.15.2:41072) 2023-11-26T07:12:40.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.308+0000 7f634ffff700 1 -- 172.21.15.2:0/3374728876 learned_addr learned my addr 172.21.15.2:0/3374728876 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:40.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.308+0000 7f6355350700 1 --2- 172.21.15.2:0/3374728876 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63500cf020 0x7f63500cf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:40.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.308+0000 7f634ffff700 1 -- 172.21.15.2:0/3374728876 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63500cf020 msgr2=0x7f63500cf4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:40.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.308+0000 7f634ffff700 1 --2- 172.21.15.2:0/3374728876 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63500cf020 0x7f63500cf4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:40.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.309+0000 7f634ffff700 1 -- 172.21.15.2:0/3374728876 >> v1:172.21.15.192:6789/0 conn(0x7f63501457b0 legacy=0x7f635006e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:40.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.309+0000 7f634ffff700 1 -- 172.21.15.2:0/3374728876 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63500cd6e0 con 0x7f63500725a0 2023-11-26T07:12:40.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.309+0000 7f634ffff700 1 --2- 172.21.15.2:0/3374728876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63500725a0 0x7f635006f580 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f633c0098f0 tx=0x7f633c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44247d525eb0897 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:40.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.309+0000 7f634f7fe700 1 -- 172.21.15.2:0/3374728876 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c00b8a0 con 0x7f63500725a0 2023-11-26T07:12:40.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.309+0000 7f634f7fe700 1 -- 172.21.15.2:0/3374728876 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633c00ba00 con 0x7f63500725a0 2023-11-26T07:12:40.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.309+0000 7f634f7fe700 1 -- 172.21.15.2:0/3374728876 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c00bd90 con 0x7f63500725a0 2023-11-26T07:12:40.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.309+0000 7f6356db3700 1 -- 172.21.15.2:0/3374728876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63500725a0 msgr2=0x7f635006f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:40.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.309+0000 7f6356db3700 1 --2- 172.21.15.2:0/3374728876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63500725a0 0x7f635006f580 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f633c0098f0 tx=0x7f633c009c00 comp rx=0 tx=0).stop 2023-11-26T07:12:40.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.309+0000 7f6356db3700 1 -- 172.21.15.2:0/3374728876 shutdown_connections 2023-11-26T07:12:40.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.309+0000 7f6356db3700 1 --2- 172.21.15.2:0/3374728876 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63500cf020 0x7f63500cf4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:40.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.309+0000 7f6356db3700 1 --2- 172.21.15.2:0/3374728876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63500725a0 0x7f635006f580 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:40.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.309+0000 7f6356db3700 1 -- 172.21.15.2:0/3374728876 >> 172.21.15.2:0/3374728876 conn(0x7f63500b2760 msgr2=0x7f63500b2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:40.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.309+0000 7f6356db3700 1 -- 172.21.15.2:0/3374728876 shutdown_connections 2023-11-26T07:12:40.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.309+0000 7f6356db3700 1 -- 172.21.15.2:0/3374728876 wait complete. 2023-11-26T07:12:40.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.311+0000 7f6356db3700 1 Processor -- start 2023-11-26T07:12:40.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.311+0000 7f6356db3700 1 -- start start 2023-11-26T07:12:40.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.311+0000 7f6356db3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63500725a0 0x7f635015b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:40.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.312+0000 7f6356db3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63500cf020 0x7f63500ae640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:40.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.312+0000 7f6356db3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63501457b0 0x7f63500aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:40.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.312+0000 7f6356db3700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63500b58c0 con 0x7f63500cf020 2023-11-26T07:12:40.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.312+0000 7f6356db3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63500b4c40 con 0x7f63500725a0 2023-11-26T07:12:40.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.312+0000 7f6356db3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63500b4f20 con 0x7f63501457b0 2023-11-26T07:12:40.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.312+0000 7f634ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63500cf020 0x7f63500ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:40.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.312+0000 7f634ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63500cf020 0x7f63500ae640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41080/0 (socket says 172.21.15.2:41080) 2023-11-26T07:12:40.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.312+0000 7f634ffff700 1 -- 172.21.15.2:0/3540000207 learned_addr learned my addr 172.21.15.2:0/3540000207 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:40.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.312+0000 7f6354b4f700 1 --2- 172.21.15.2:0/3540000207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63500725a0 0x7f635015b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:40.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.312+0000 7f6355350700 1 --2- 172.21.15.2:0/3540000207 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63501457b0 0x7f63500aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:40.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.312+0000 7f634ffff700 1 -- 172.21.15.2:0/3540000207 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63501457b0 msgr2=0x7f63500aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:40.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.312+0000 7f634ffff700 1 --2- 172.21.15.2:0/3540000207 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63501457b0 0x7f63500aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:40.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.312+0000 7f634ffff700 1 -- 172.21.15.2:0/3540000207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63500725a0 msgr2=0x7f635015b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:40.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.312+0000 7f634ffff700 1 --2- 172.21.15.2:0/3540000207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63500725a0 0x7f635015b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:40.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.312+0000 7f634ffff700 1 -- 172.21.15.2:0/3540000207 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f633c009550 con 0x7f63500cf020 2023-11-26T07:12:40.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.312+0000 7f6354b4f700 1 --2- 172.21.15.2:0/3540000207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63500725a0 0x7f635015b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:12:40.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.312+0000 7f634ffff700 1 --2- 172.21.15.2:0/3540000207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63500cf020 0x7f63500ae640 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f633c000c00 tx=0x7f633c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:40.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.312+0000 7f634d7fa700 1 -- 172.21.15.2:0/3540000207 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c004480 con 0x7f63500cf020 2023-11-26T07:12:40.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.312+0000 7f634d7fa700 1 -- 172.21.15.2:0/3540000207 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633c01f070 con 0x7f63500cf020 2023-11-26T07:12:40.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.312+0000 7f6356db3700 1 -- 172.21.15.2:0/3540000207 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63500b5200 con 0x7f63500cf020 2023-11-26T07:12:40.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.312+0000 7f634d7fa700 1 -- 172.21.15.2:0/3540000207 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c0038c0 con 0x7f63500cf020 2023-11-26T07:12:40.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.312+0000 7f6356db3700 1 -- 172.21.15.2:0/3540000207 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f635015bc10 con 0x7f63500cf020 2023-11-26T07:12:40.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.313+0000 7f6356db3700 1 -- 172.21.15.2:0/3540000207 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63501430d0 con 0x7f63500cf020 2023-11-26T07:12:40.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.314+0000 7f634d7fa700 1 -- 172.21.15.2:0/3540000207 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f633c021030 con 0x7f63500cf020 2023-11-26T07:12:40.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.314+0000 7f634d7fa700 1 --2- 172.21.15.2:0/3540000207 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f633406af00 0x7f633406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:40.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.314+0000 7f634d7fa700 1 -- 172.21.15.2:0/3540000207 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f633c08aad0 con 0x7f63500cf020 2023-11-26T07:12:40.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.314+0000 7f6354b4f700 1 --2- 172.21.15.2:0/3540000207 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f633406af00 0x7f633406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:40.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.315+0000 7f6354b4f700 1 --2- 172.21.15.2:0/3540000207 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f633406af00 0x7f633406d3c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6344000f60 tx=0x7f6344009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:40.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.319+0000 7f634d7fa700 1 -- 172.21.15.2:0/3540000207 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f63501430d0 con 0x7f63500cf020 2023-11-26T07:12:40.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.553+0000 7f6356db3700 1 -- 172.21.15.2:0/3540000207 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol68520", "mode": "777", "target": ["mon-mgr", ""]}) v1 -- 0x7f635006deb0 con 0x7f633406af00 2023-11-26T07:12:40.560 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:12:40.559+0000 7f8da6aa7700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:12:40.560 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:12:40.559+0000 7f8da6aa7700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:12:40.561 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:12:40.559+0000 7f8da6aa7700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:12:40.561 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:12:40.559+0000 7f8da6aa7700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:12:40.561 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:12:40.559+0000 7f8da6aa7700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:12:40.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.592+0000 7f634d7fa700 1 -- 172.21.15.2:0/3540000207 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f63440050d0 con 0x7f633406af00 2023-11-26T07:12:40.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.595+0000 7f6356db3700 1 -- 172.21.15.2:0/3540000207 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f633406af00 msgr2=0x7f633406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:40.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.595+0000 7f6356db3700 1 --2- 172.21.15.2:0/3540000207 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f633406af00 0x7f633406d3c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6344000f60 tx=0x7f6344009040 comp rx=0 tx=0).stop 2023-11-26T07:12:40.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.595+0000 7f6356db3700 1 -- 172.21.15.2:0/3540000207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63500cf020 msgr2=0x7f63500ae640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:40.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.595+0000 7f6356db3700 1 --2- 172.21.15.2:0/3540000207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63500cf020 0x7f63500ae640 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f633c000c00 tx=0x7f633c004750 comp rx=0 tx=0).stop 2023-11-26T07:12:40.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.595+0000 7f6356db3700 1 -- 172.21.15.2:0/3540000207 shutdown_connections 2023-11-26T07:12:40.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.595+0000 7f6356db3700 1 --2- 172.21.15.2:0/3540000207 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f633406af00 0x7f633406d3c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:40.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.595+0000 7f6356db3700 1 --2- 172.21.15.2:0/3540000207 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63501457b0 0x7f63500aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:40.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.595+0000 7f6356db3700 1 --2- 172.21.15.2:0/3540000207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63500725a0 0x7f635015b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:40.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.595+0000 7f6356db3700 1 --2- 172.21.15.2:0/3540000207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63500cf020 0x7f63500ae640 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:40.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.595+0000 7f6356db3700 1 -- 172.21.15.2:0/3540000207 >> 172.21.15.2:0/3540000207 conn(0x7f63500b2760 msgr2=0x7f635006e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:40.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.595+0000 7f6356db3700 1 -- 172.21.15.2:0/3540000207 shutdown_connections 2023-11-26T07:12:40.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.595+0000 7f6356db3700 1 -- 172.21.15.2:0/3540000207 wait complete. 2023-11-26T07:12:40.609 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol68520 2023-11-26T07:12:40.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.735+0000 7fda3eafa700 1 Processor -- start 2023-11-26T07:12:40.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.735+0000 7fda3eafa700 1 -- start start 2023-11-26T07:12:40.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.736+0000 7fda3eafa700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fda38143ae0 0x7fda380b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:40.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.736+0000 7fda3eafa700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fda381440f0 0x7fda38071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:40.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.736+0000 7fda3eafa700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda380720f0 0x7fda3815e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:40.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.736+0000 7fda3eafa700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda380b40a0 con 0x7fda38143ae0 2023-11-26T07:12:40.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.736+0000 7fda3eafa700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda38072580 con 0x7fda381440f0 2023-11-26T07:12:40.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.736+0000 7fda3eafa700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda38143ec0 con 0x7fda380720f0 2023-11-26T07:12:40.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.736+0000 7fda3c896700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fda38143ae0 0x7fda380b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:40.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.736+0000 7fda3c896700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fda38143ae0 0x7fda380b51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41086/0 (socket says 172.21.15.2:41086) 2023-11-26T07:12:40.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.736+0000 7fda3c896700 1 -- 172.21.15.2:0/1338033395 learned_addr learned my addr 172.21.15.2:0/1338033395 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:40.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.736+0000 7fda37fff700 1 --2- 172.21.15.2:0/1338033395 >> v2:172.21.15.192:3300/0 conn(0x7fda381440f0 0x7fda38071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:40.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.736+0000 7fda3c896700 1 -- 172.21.15.2:0/1338033395 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda380720f0 msgr2=0x7fda3815e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:40.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.736+0000 7fda3d097700 1 --2- 172.21.15.2:0/1338033395 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda380720f0 0x7fda3815e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:40.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.736+0000 7fda3c896700 1 --2- 172.21.15.2:0/1338033395 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda380720f0 0x7fda3815e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:40.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.736+0000 7fda3c896700 1 -- 172.21.15.2:0/1338033395 >> v2:172.21.15.192:3300/0 conn(0x7fda381440f0 msgr2=0x7fda38071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:12:40.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.736+0000 7fda3c896700 1 --2- 172.21.15.2:0/1338033395 >> v2:172.21.15.192:3300/0 conn(0x7fda381440f0 0x7fda38071bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:40.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.736+0000 7fda3c896700 1 -- 172.21.15.2:0/1338033395 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda380b3ae0 con 0x7fda38143ae0 2023-11-26T07:12:40.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.736+0000 7fda3c896700 1 --2- 172.21.15.2:0/1338033395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda38143ae0 0x7fda380b51b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fda380d1b00 tx=0x7fda2c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67d593244e09a728 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:40.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.736+0000 7fda377fe700 1 -- 172.21.15.2:0/1338033395 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2c00b870 con 0x7fda38143ae0 2023-11-26T07:12:40.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.737+0000 7fda377fe700 1 -- 172.21.15.2:0/1338033395 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda2c00b9d0 con 0x7fda38143ae0 2023-11-26T07:12:40.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.737+0000 7fda377fe700 1 -- 172.21.15.2:0/1338033395 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2c00bd60 con 0x7fda38143ae0 2023-11-26T07:12:40.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.737+0000 7fda3eafa700 1 -- 172.21.15.2:0/1338033395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda38143ae0 msgr2=0x7fda380b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:40.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.737+0000 7fda3eafa700 1 --2- 172.21.15.2:0/1338033395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda38143ae0 0x7fda380b51b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fda380d1b00 tx=0x7fda2c009bd0 comp rx=0 tx=0).stop 2023-11-26T07:12:40.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.737+0000 7fda3eafa700 1 -- 172.21.15.2:0/1338033395 shutdown_connections 2023-11-26T07:12:40.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.737+0000 7fda3eafa700 1 --2- 172.21.15.2:0/1338033395 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda380720f0 0x7fda3815e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:40.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.737+0000 7fda3eafa700 1 --2- 172.21.15.2:0/1338033395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda38143ae0 0x7fda380b51b0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:40.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.737+0000 7fda3eafa700 1 --2- 172.21.15.2:0/1338033395 >> v2:172.21.15.192:3300/0 conn(0x7fda381440f0 0x7fda38071bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:40.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.737+0000 7fda3eafa700 1 -- 172.21.15.2:0/1338033395 >> 172.21.15.2:0/1338033395 conn(0x7fda380b2740 msgr2=0x7fda380b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:40.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.737+0000 7fda3eafa700 1 -- 172.21.15.2:0/1338033395 shutdown_connections 2023-11-26T07:12:40.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.737+0000 7fda3eafa700 1 -- 172.21.15.2:0/1338033395 wait complete. 2023-11-26T07:12:40.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.738+0000 7fda3eafa700 1 Processor -- start 2023-11-26T07:12:40.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.738+0000 7fda3eafa700 1 -- start start 2023-11-26T07:12:40.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.739+0000 7fda3eafa700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda380720f0 0x7fda380cc350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:40.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.739+0000 7fda3eafa700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda38143ae0 0x7fda38151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:40.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.739+0000 7fda3eafa700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda381440f0 0x7fda381f8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:40.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.739+0000 7fda3eafa700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda381f7c00 con 0x7fda38143ae0 2023-11-26T07:12:40.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.739+0000 7fda3eafa700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda38142930 con 0x7fda380720f0 2023-11-26T07:12:40.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.739+0000 7fda3eafa700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda381558c0 con 0x7fda381440f0 2023-11-26T07:12:40.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.739+0000 7fda37fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda38143ae0 0x7fda38151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:40.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.739+0000 7fda37fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda38143ae0 0x7fda38151fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41094/0 (socket says 172.21.15.2:41094) 2023-11-26T07:12:40.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.739+0000 7fda37fff700 1 -- 172.21.15.2:0/2907352110 learned_addr learned my addr 172.21.15.2:0/2907352110 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:12:40.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.740+0000 7fda3d097700 1 --2- 172.21.15.2:0/2907352110 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda381440f0 0x7fda381f8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:40.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.740+0000 7fda3c896700 1 --2- 172.21.15.2:0/2907352110 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda380720f0 0x7fda380cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:40.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.740+0000 7fda37fff700 1 -- 172.21.15.2:0/2907352110 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda381440f0 msgr2=0x7fda381f8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:40.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.740+0000 7fda37fff700 1 --2- 172.21.15.2:0/2907352110 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda381440f0 0x7fda381f8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:40.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.740+0000 7fda37fff700 1 -- 172.21.15.2:0/2907352110 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda380720f0 msgr2=0x7fda380cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:40.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.740+0000 7fda37fff700 1 --2- 172.21.15.2:0/2907352110 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda380720f0 0x7fda380cc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:40.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.740+0000 7fda37fff700 1 -- 172.21.15.2:0/2907352110 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda2c009550 con 0x7fda38143ae0 2023-11-26T07:12:40.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.740+0000 7fda3d097700 1 --2- 172.21.15.2:0/2907352110 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda381440f0 0x7fda381f8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:12:40.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.740+0000 7fda3c896700 1 --2- 172.21.15.2:0/2907352110 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda380720f0 0x7fda380cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:12:40.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.740+0000 7fda37fff700 1 --2- 172.21.15.2:0/2907352110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda38143ae0 0x7fda38151fb0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fda2400c7f0 tx=0x7fda2400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:40.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.740+0000 7fda357fa700 1 -- 172.21.15.2:0/2907352110 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda24011800 con 0x7fda38143ae0 2023-11-26T07:12:40.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.740+0000 7fda357fa700 1 -- 172.21.15.2:0/2907352110 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda24011960 con 0x7fda38143ae0 2023-11-26T07:12:40.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.740+0000 7fda3eafa700 1 -- 172.21.15.2:0/2907352110 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda38155b10 con 0x7fda38143ae0 2023-11-26T07:12:40.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.740+0000 7fda357fa700 1 -- 172.21.15.2:0/2907352110 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda24011cf0 con 0x7fda38143ae0 2023-11-26T07:12:40.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.740+0000 7fda3eafa700 1 -- 172.21.15.2:0/2907352110 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda381f7820 con 0x7fda38143ae0 2023-11-26T07:12:40.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.741+0000 7fda3eafa700 1 -- 172.21.15.2:0/2907352110 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda380cfcb0 con 0x7fda38143ae0 2023-11-26T07:12:40.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.741+0000 7fda357fa700 1 -- 172.21.15.2:0/2907352110 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fda24018360 con 0x7fda38143ae0 2023-11-26T07:12:40.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.742+0000 7fda357fa700 1 --2- 172.21.15.2:0/2907352110 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fda1c06aed0 0x7fda1c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:12:40.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.742+0000 7fda357fa700 1 -- 172.21.15.2:0/2907352110 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fda24089570 con 0x7fda38143ae0 2023-11-26T07:12:40.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.742+0000 7fda3c896700 1 --2- 172.21.15.2:0/2907352110 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fda1c06aed0 0x7fda1c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:12:40.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.743+0000 7fda3c896700 1 --2- 172.21.15.2:0/2907352110 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fda1c06aed0 0x7fda1c06d390 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fda2c009130 tx=0x7fda2c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:12:40.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.747+0000 7fda357fa700 1 -- 172.21.15.2:0/2907352110 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fda24054630 con 0x7fda38143ae0 2023-11-26T07:12:40.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.981+0000 7fda3eafa700 1 -- 172.21.15.2:0/2907352110 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol68520", "target": ["mon-mgr", ""]}) v1 -- 0x7fda3806dff0 con 0x7fda1c06aed0 2023-11-26T07:12:40.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.989+0000 7fda357fa700 1 -- 172.21.15.2:0/2907352110 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+67 (secure 0 0 0) 0x7fda2c01f070 con 0x7fda1c06aed0 2023-11-26T07:12:40.990 INFO:teuthology.orchestra.run.smithi002.stdout:/volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922 2023-11-26T07:12:40.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.990+0000 7fda3eafa700 1 -- 172.21.15.2:0/2907352110 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fda1c06aed0 msgr2=0x7fda1c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:40.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.990+0000 7fda3eafa700 1 --2- 172.21.15.2:0/2907352110 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fda1c06aed0 0x7fda1c06d390 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fda2c009130 tx=0x7fda2c008030 comp rx=0 tx=0).stop 2023-11-26T07:12:40.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.990+0000 7fda3eafa700 1 -- 172.21.15.2:0/2907352110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda38143ae0 msgr2=0x7fda38151fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:12:40.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.990+0000 7fda3eafa700 1 --2- 172.21.15.2:0/2907352110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda38143ae0 0x7fda38151fb0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fda2400c7f0 tx=0x7fda2400cbb0 comp rx=0 tx=0).stop 2023-11-26T07:12:40.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.991+0000 7fda3eafa700 1 -- 172.21.15.2:0/2907352110 shutdown_connections 2023-11-26T07:12:40.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.991+0000 7fda3eafa700 1 --2- 172.21.15.2:0/2907352110 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fda1c06aed0 0x7fda1c06d390 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:40.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.991+0000 7fda3eafa700 1 --2- 172.21.15.2:0/2907352110 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda381440f0 0x7fda381f8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:40.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.991+0000 7fda3eafa700 1 --2- 172.21.15.2:0/2907352110 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda380720f0 0x7fda380cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:40.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.991+0000 7fda3eafa700 1 --2- 172.21.15.2:0/2907352110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda38143ae0 0x7fda38151fb0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:12:40.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.991+0000 7fda3eafa700 1 -- 172.21.15.2:0/2907352110 >> 172.21.15.2:0/2907352110 conn(0x7fda380b2740 msgr2=0x7fda380b41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:12:40.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.991+0000 7fda3eafa700 1 -- 172.21.15.2:0/2907352110 shutdown_connections 2023-11-26T07:12:40.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:12:40.991+0000 7fda3eafa700 1 -- 172.21.15.2:0/2907352110 wait complete. 2023-11-26T07:12:41.004 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvol68520 with 200 files each 1MB size under directory volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922 2023-11-26T07:12:41.005 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:41.005 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:41.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:41.022 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:41.099 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:41.100 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:41.100 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124047 s, 84.5 MB/s 2023-11-26T07:12:41.100 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:41.100 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:41.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:41.158 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:41.226 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:41.226 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:41.226 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113114 s, 92.7 MB/s 2023-11-26T07:12:41.227 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:41.228 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:41.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:41.287 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:41.356 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:41.357 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:41.357 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109205 s, 96.0 MB/s 2023-11-26T07:12:41.357 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:41.357 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:41.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:41.415 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:41.481 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:41.482 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:41.482 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00923313 s, 114 MB/s 2023-11-26T07:12:41.483 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:41.483 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:41.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:41.541 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:41.612 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:41.612 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:41.612 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133571 s, 78.5 MB/s 2023-11-26T07:12:41.613 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:41.613 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:41.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:41.671 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:41.738 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:41.738 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:41.738 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00884924 s, 118 MB/s 2023-11-26T07:12:41.739 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:41.739 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:41.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:41.798 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:41.865 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:41.865 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:41.865 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00991865 s, 106 MB/s 2023-11-26T07:12:41.866 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:41.866 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:41.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:41.925 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:41.992 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:41.992 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:41.992 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00929795 s, 113 MB/s 2023-11-26T07:12:41.992 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:41.992 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:42.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:42.050 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:42.117 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:42.117 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:42.117 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00974472 s, 108 MB/s 2023-11-26T07:12:42.118 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:42.118 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:42.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:42.175 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:42.242 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:42.243 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:42.243 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00826577 s, 127 MB/s 2023-11-26T07:12:42.243 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:42.243 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:42.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:42.301 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.10 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:42.368 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:42.369 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:42.369 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00991475 s, 106 MB/s 2023-11-26T07:12:42.369 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:42.370 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:42.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:42.429 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.11 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:42.494 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:42.495 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:42.495 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00960161 s, 109 MB/s 2023-11-26T07:12:42.496 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:42.496 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:42.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:42.554 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.12 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:42.622 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:42.622 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:42.622 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101544 s, 103 MB/s 2023-11-26T07:12:42.622 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:42.622 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:42.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:42.681 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.13 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:42.748 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:42.749 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:42.749 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100334 s, 105 MB/s 2023-11-26T07:12:42.749 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:42.749 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:42.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:42.807 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.14 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:42.874 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:42.875 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:42.875 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100352 s, 104 MB/s 2023-11-26T07:12:42.875 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:42.875 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:42.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:42.932 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.15 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:43.000 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:43.001 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:43.001 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101414 s, 103 MB/s 2023-11-26T07:12:43.001 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:43.001 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:43.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:43.058 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.16 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:43.127 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:43.238 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:43.239 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109841 s, 95.5 MB/s 2023-11-26T07:12:43.239 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:43.239 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:43.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:43.258 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.17 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:43.328 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:43.328 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:43.328 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123155 s, 85.1 MB/s 2023-11-26T07:12:43.329 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:43.329 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:43.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:43.388 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.18 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:43.455 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:43.455 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:43.455 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100325 s, 105 MB/s 2023-11-26T07:12:43.456 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:43.456 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:43.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:43.516 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.19 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:43.583 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:43.584 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:43.584 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.009928 s, 106 MB/s 2023-11-26T07:12:43.585 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:43.585 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:43.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:43.645 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.20 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:43.712 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:43.712 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:43.712 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00929508 s, 113 MB/s 2023-11-26T07:12:43.713 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:43.713 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:43.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:43.774 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.21 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:43.840 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:43.840 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:43.840 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00851217 s, 123 MB/s 2023-11-26T07:12:43.841 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:43.841 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:43.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:43.898 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.22 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:43.968 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:43.968 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:43.968 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116915 s, 89.7 MB/s 2023-11-26T07:12:43.968 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:43.968 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:44.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:44.026 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.23 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:44.092 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:44.092 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:44.092 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00824541 s, 127 MB/s 2023-11-26T07:12:44.093 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:44.093 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:44.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:44.151 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.24 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:44.219 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:44.219 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:44.219 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010139 s, 103 MB/s 2023-11-26T07:12:44.220 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:44.220 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:44.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:44.277 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.25 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:44.342 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:44.342 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:44.342 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0085437 s, 123 MB/s 2023-11-26T07:12:44.343 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:44.343 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:44.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:44.401 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.26 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:44.470 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:44.470 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:44.470 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104096 s, 101 MB/s 2023-11-26T07:12:44.470 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:44.471 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:44.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:44.528 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.27 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:44.594 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:44.595 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:44.595 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00869564 s, 121 MB/s 2023-11-26T07:12:44.596 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:44.596 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:44.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:44.653 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.28 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:44.723 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:44.723 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:44.723 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118768 s, 88.3 MB/s 2023-11-26T07:12:44.724 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:44.724 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:44.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:44.782 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.29 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:44.848 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:44.849 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:44.849 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00868222 s, 121 MB/s 2023-11-26T07:12:44.850 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:44.850 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:44.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:44.908 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.30 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:44.974 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:44.975 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:44.975 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00905531 s, 116 MB/s 2023-11-26T07:12:44.975 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:44.975 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:45.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:45.033 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.31 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:45.103 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:45.103 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:45.103 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113703 s, 92.2 MB/s 2023-11-26T07:12:45.103 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:45.103 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:45.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:45.160 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.32 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:45.229 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:45.230 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:45.230 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112417 s, 93.3 MB/s 2023-11-26T07:12:45.230 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:45.230 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:45.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:45.288 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.33 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:45.355 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:45.355 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:45.356 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010506 s, 99.8 MB/s 2023-11-26T07:12:45.357 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:45.357 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:45.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:45.415 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.34 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:45.481 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:45.482 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:45.482 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00966916 s, 108 MB/s 2023-11-26T07:12:45.483 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:45.483 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:45.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:45.540 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.35 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:45.607 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:45.608 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:45.608 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00951276 s, 110 MB/s 2023-11-26T07:12:45.608 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:45.608 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:45.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:45.667 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.36 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:45.734 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:45.734 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:45.735 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00912683 s, 115 MB/s 2023-11-26T07:12:45.735 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:45.735 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:45.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:45.793 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.37 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:45.860 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:45.861 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:45.861 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00933332 s, 112 MB/s 2023-11-26T07:12:45.862 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:45.862 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:45.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:45.922 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.38 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:45.990 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:45.990 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:45.990 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101427 s, 103 MB/s 2023-11-26T07:12:45.990 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:45.991 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:46.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:46.048 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.39 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:46.118 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:46.118 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:46.118 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121624 s, 86.2 MB/s 2023-11-26T07:12:46.118 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:46.118 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:46.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:46.178 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.40 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:46.247 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:46.247 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:46.248 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106863 s, 98.1 MB/s 2023-11-26T07:12:46.248 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:46.248 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:46.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:46.305 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.41 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:46.372 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:46.373 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:46.373 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101773 s, 103 MB/s 2023-11-26T07:12:46.373 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:46.373 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:46.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:46.431 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.42 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:46.498 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:46.499 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:46.499 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00957474 s, 110 MB/s 2023-11-26T07:12:46.499 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:46.500 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:46.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:46.556 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.43 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:46.624 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:46.624 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:46.625 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100991 s, 104 MB/s 2023-11-26T07:12:46.625 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:46.625 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:46.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:46.683 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.44 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:46.752 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:46.753 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:46.753 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00952117 s, 110 MB/s 2023-11-26T07:12:46.753 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:46.753 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:46.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:46.811 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.45 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:46.880 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:46.881 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:46.881 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114862 s, 91.3 MB/s 2023-11-26T07:12:46.881 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:46.881 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:46.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:46.939 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.46 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:47.006 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:47.007 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:47.007 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00981427 s, 107 MB/s 2023-11-26T07:12:47.007 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:47.007 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:47.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:47.065 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.47 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:47.133 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:47.133 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:47.133 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100388 s, 104 MB/s 2023-11-26T07:12:47.134 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:47.134 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:47.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:47.191 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.48 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:47.261 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:47.261 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:47.261 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107289 s, 97.7 MB/s 2023-11-26T07:12:47.261 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:47.261 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:47.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:47.318 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.49 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:47.388 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:47.388 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:47.388 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101908 s, 103 MB/s 2023-11-26T07:12:47.389 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:47.389 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:47.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:47.446 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.50 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:47.516 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:47.516 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:47.516 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115338 s, 90.9 MB/s 2023-11-26T07:12:47.517 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:47.517 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:47.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:47.576 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.51 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:47.645 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:47.646 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:47.646 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113339 s, 92.5 MB/s 2023-11-26T07:12:47.647 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:47.647 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:47.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:47.705 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.52 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:47.772 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:47.773 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:47.773 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106179 s, 98.8 MB/s 2023-11-26T07:12:47.773 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:47.774 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:47.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:47.833 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.53 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:47.899 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:47.899 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:47.899 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00831699 s, 126 MB/s 2023-11-26T07:12:47.899 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:47.899 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:47.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:47.959 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.54 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:48.027 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:48.027 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:48.027 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105384 s, 99.5 MB/s 2023-11-26T07:12:48.028 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:48.028 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:48.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:48.086 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.55 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:48.152 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:48.152 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:48.152 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00981138 s, 107 MB/s 2023-11-26T07:12:48.153 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:48.153 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:48.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:48.212 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.56 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:48.278 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:48.278 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:48.279 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00966369 s, 109 MB/s 2023-11-26T07:12:48.280 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:48.280 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:48.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:48.338 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.57 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:48.406 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:48.406 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:48.406 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00984407 s, 107 MB/s 2023-11-26T07:12:48.407 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:48.407 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:48.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:48.465 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.58 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:48.532 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:48.533 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:48.533 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107828 s, 97.2 MB/s 2023-11-26T07:12:48.534 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:48.534 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:48.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:48.592 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.59 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:48.660 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:48.660 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:48.660 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00979388 s, 107 MB/s 2023-11-26T07:12:48.660 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:48.660 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:48.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:48.717 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.60 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:48.784 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:48.784 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:48.784 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00985821 s, 106 MB/s 2023-11-26T07:12:48.785 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:48.785 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:48.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:48.843 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.61 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:48.911 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:48.911 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:48.911 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00971578 s, 108 MB/s 2023-11-26T07:12:48.912 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:48.912 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:48.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:48.969 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.62 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:49.037 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:49.037 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:49.038 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00994324 s, 105 MB/s 2023-11-26T07:12:49.038 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:49.038 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:49.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:49.096 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.63 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:49.166 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:49.166 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:49.166 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122958 s, 85.3 MB/s 2023-11-26T07:12:49.166 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:49.166 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:49.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:49.224 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.64 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:49.291 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:49.292 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:49.292 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100807 s, 104 MB/s 2023-11-26T07:12:49.292 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:49.292 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:49.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:49.349 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.65 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:49.417 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:49.418 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:49.418 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102888 s, 102 MB/s 2023-11-26T07:12:49.418 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:49.418 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:49.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:49.476 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.66 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:49.542 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:49.543 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:49.543 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00898237 s, 117 MB/s 2023-11-26T07:12:49.543 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:49.543 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:49.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:49.600 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.67 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:49.670 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:49.671 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:49.671 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115965 s, 90.4 MB/s 2023-11-26T07:12:49.671 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:49.671 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:49.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:49.729 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.68 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:49.794 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:49.795 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:49.795 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0086258 s, 122 MB/s 2023-11-26T07:12:49.796 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:49.796 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:49.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:49.854 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.69 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:49.921 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:49.921 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:49.922 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100446 s, 104 MB/s 2023-11-26T07:12:49.922 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:49.922 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:49.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:49.979 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.70 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:50.046 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:50.046 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:50.046 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00846598 s, 124 MB/s 2023-11-26T07:12:50.047 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:50.047 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:50.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:50.104 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.71 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:50.170 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:50.170 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:50.170 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00840585 s, 125 MB/s 2023-11-26T07:12:50.171 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:50.171 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:50.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:50.230 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.72 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:50.296 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:50.296 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:50.297 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101877 s, 103 MB/s 2023-11-26T07:12:50.297 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:50.298 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:50.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:50.356 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.73 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:50.423 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:50.423 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:50.423 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00958497 s, 109 MB/s 2023-11-26T07:12:50.423 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:50.424 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:50.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:50.483 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.74 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:50.549 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:50.549 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:50.550 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00992638 s, 106 MB/s 2023-11-26T07:12:50.551 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:50.551 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:50.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:50.609 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.75 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:50.676 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:50.676 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:50.676 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00868012 s, 121 MB/s 2023-11-26T07:12:50.677 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:50.677 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:50.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:50.735 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.76 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:50.804 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:50.804 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:50.804 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012043 s, 87.1 MB/s 2023-11-26T07:12:50.805 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:50.805 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:50.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:50.862 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.77 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:50.932 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:50.932 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:50.932 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116355 s, 90.1 MB/s 2023-11-26T07:12:50.932 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:50.933 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:50.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:50.991 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.78 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:51.059 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:51.060 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:51.060 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109237 s, 96.0 MB/s 2023-11-26T07:12:51.061 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:51.061 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:51.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:51.118 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.79 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:51.188 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:51.188 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:51.188 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115978 s, 90.4 MB/s 2023-11-26T07:12:51.188 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:51.189 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:51.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:51.247 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.80 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:51.314 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:51.315 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:51.315 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00958447 s, 109 MB/s 2023-11-26T07:12:51.315 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:51.315 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:51.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:51.372 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.81 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:51.441 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:51.442 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:51.442 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011538 s, 90.9 MB/s 2023-11-26T07:12:51.442 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:51.442 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:51.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:51.499 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.82 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:51.568 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:51.569 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:51.569 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110274 s, 95.1 MB/s 2023-11-26T07:12:51.569 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:51.569 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:51.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:51.626 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.83 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:51.695 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:51.695 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:51.696 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113335 s, 92.5 MB/s 2023-11-26T07:12:51.696 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:51.697 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:51.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:51.755 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.84 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:51.823 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:51.823 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:51.823 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101259 s, 104 MB/s 2023-11-26T07:12:51.824 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:51.824 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:51.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:51.883 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.85 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:51.948 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:51.949 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:51.949 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00914524 s, 115 MB/s 2023-11-26T07:12:51.949 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:51.950 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:52.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:52.008 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.86 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:52.075 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:52.076 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:52.076 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102107 s, 103 MB/s 2023-11-26T07:12:52.076 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:52.076 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:52.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:52.133 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.87 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:52.200 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:52.200 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:52.200 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00872297 s, 120 MB/s 2023-11-26T07:12:52.200 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:52.201 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:52.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:52.258 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.88 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:52.326 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:52.326 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:52.326 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100246 s, 105 MB/s 2023-11-26T07:12:52.327 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:52.327 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:52.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:52.385 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.89 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:52.454 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:52.454 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:52.454 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123617 s, 84.8 MB/s 2023-11-26T07:12:52.455 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:52.455 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:52.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:52.514 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.90 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:52.581 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:52.582 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:52.582 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104398 s, 100 MB/s 2023-11-26T07:12:52.583 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:52.583 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:52.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:52.640 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.91 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:52.709 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:52.709 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:52.709 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00994062 s, 105 MB/s 2023-11-26T07:12:52.709 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:52.709 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:52.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:52.766 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.92 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:52.834 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:52.834 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:52.834 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010108 s, 104 MB/s 2023-11-26T07:12:52.835 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:52.835 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:52.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:52.892 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.93 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:52.960 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:52.960 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:52.960 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00965599 s, 109 MB/s 2023-11-26T07:12:52.960 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:52.960 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:53.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:53.019 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.94 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:53.086 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:53.086 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:53.086 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00988536 s, 106 MB/s 2023-11-26T07:12:53.087 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:53.087 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:53.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:53.146 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.95 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:53.214 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:53.214 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:53.215 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115121 s, 91.1 MB/s 2023-11-26T07:12:53.215 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:53.216 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:53.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:53.273 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.96 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:53.339 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:53.340 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:53.340 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00819235 s, 128 MB/s 2023-11-26T07:12:53.340 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:53.340 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:53.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:53.398 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.97 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:53.467 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:53.467 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:53.467 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111702 s, 93.9 MB/s 2023-11-26T07:12:53.468 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:53.468 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:53.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:53.526 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.98 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:53.592 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:53.592 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:53.592 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00799286 s, 131 MB/s 2023-11-26T07:12:53.593 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:53.593 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:53.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:53.651 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.99 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:53.719 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:53.719 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:53.719 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102397 s, 102 MB/s 2023-11-26T07:12:53.720 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:53.720 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:53.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:53.777 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.100 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:53.844 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:53.844 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:53.844 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103184 s, 102 MB/s 2023-11-26T07:12:53.845 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:53.845 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:53.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:53.904 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.101 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:53.971 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:53.971 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:53.971 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00991073 s, 106 MB/s 2023-11-26T07:12:53.972 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:53.972 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:54.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:54.031 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.102 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:54.098 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:54.099 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:54.099 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108337 s, 96.8 MB/s 2023-11-26T07:12:54.100 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:54.100 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:54.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:54.158 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.103 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:54.224 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:54.224 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:54.224 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00923342 s, 114 MB/s 2023-11-26T07:12:54.225 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:54.225 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:54.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:54.284 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.104 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:54.350 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:54.350 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:54.351 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00929841 s, 113 MB/s 2023-11-26T07:12:54.351 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:54.351 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:54.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:54.409 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.105 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:54.476 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:54.477 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:54.477 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00988858 s, 106 MB/s 2023-11-26T07:12:54.478 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:54.478 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:54.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:54.535 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.106 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:54.601 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:54.602 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:54.602 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0088507 s, 118 MB/s 2023-11-26T07:12:54.603 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:54.603 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:54.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:54.661 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.107 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:54.729 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:54.729 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:54.729 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101693 s, 103 MB/s 2023-11-26T07:12:54.729 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:54.729 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:54.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:54.787 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.108 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:54.852 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:54.852 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:54.852 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00860626 s, 122 MB/s 2023-11-26T07:12:54.853 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:54.853 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:54.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:54.912 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.109 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:54.979 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:54.979 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:54.979 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102098 s, 103 MB/s 2023-11-26T07:12:54.980 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:54.980 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:55.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:55.039 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.110 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:55.105 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:55.106 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:55.106 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00994731 s, 105 MB/s 2023-11-26T07:12:55.107 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:55.107 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:55.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:55.168 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.111 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:55.235 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:55.235 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:55.235 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00953144 s, 110 MB/s 2023-11-26T07:12:55.236 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:55.236 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:55.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:55.295 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.112 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:55.360 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:55.360 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:55.360 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00837346 s, 125 MB/s 2023-11-26T07:12:55.361 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:55.362 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:55.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:55.419 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.113 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:55.487 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:55.487 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:55.487 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00986665 s, 106 MB/s 2023-11-26T07:12:55.487 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:55.487 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:55.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:55.545 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.114 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:55.615 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:55.615 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:55.615 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124348 s, 84.3 MB/s 2023-11-26T07:12:55.616 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:55.617 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:55.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:55.675 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.115 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:55.745 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:55.745 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:55.745 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105855 s, 99.1 MB/s 2023-11-26T07:12:55.746 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:55.746 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:55.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:55.805 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.116 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:55.873 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:55.873 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:55.874 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100774 s, 104 MB/s 2023-11-26T07:12:55.874 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:55.874 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:55.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:55.933 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.117 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:55.999 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:56.000 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:56.000 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00980332 s, 107 MB/s 2023-11-26T07:12:56.001 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:56.001 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:56.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:56.059 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.118 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:56.126 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:56.126 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:56.126 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00947153 s, 111 MB/s 2023-11-26T07:12:56.127 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:56.127 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:56.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:56.185 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.119 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:56.251 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:56.252 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:56.252 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00941433 s, 111 MB/s 2023-11-26T07:12:56.253 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:56.253 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:56.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:56.312 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.120 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:56.377 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:56.378 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:56.378 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00860928 s, 122 MB/s 2023-11-26T07:12:56.378 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:56.379 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:56.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:56.437 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.121 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:56.506 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:56.506 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:56.506 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114131 s, 91.9 MB/s 2023-11-26T07:12:56.506 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:56.507 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:56.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:56.565 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.122 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:56.632 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:56.632 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:56.632 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00987089 s, 106 MB/s 2023-11-26T07:12:56.632 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:56.632 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:56.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:56.690 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.123 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:56.757 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:56.757 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:56.757 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103077 s, 102 MB/s 2023-11-26T07:12:56.758 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:56.758 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:56.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:56.817 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.124 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:56.884 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:56.884 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:56.885 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00980269 s, 107 MB/s 2023-11-26T07:12:56.885 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:56.886 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:56.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:56.944 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.125 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:57.010 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:57.010 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:57.010 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00920195 s, 114 MB/s 2023-11-26T07:12:57.011 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:57.011 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:57.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:57.069 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.126 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:57.138 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:57.138 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:57.138 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114902 s, 91.3 MB/s 2023-11-26T07:12:57.139 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:57.139 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:57.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:57.198 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.127 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:57.265 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:57.265 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:57.265 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105843 s, 99.1 MB/s 2023-11-26T07:12:57.266 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:57.267 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:57.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:57.325 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.128 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:57.391 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:57.392 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:57.392 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00964301 s, 109 MB/s 2023-11-26T07:12:57.392 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:57.392 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:57.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:57.449 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.129 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:57.517 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:57.517 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:57.517 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106002 s, 98.9 MB/s 2023-11-26T07:12:57.518 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:57.518 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:57.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:57.576 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.130 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:57.643 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:57.643 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:57.643 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00931153 s, 113 MB/s 2023-11-26T07:12:57.644 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:57.645 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:57.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:57.702 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.131 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:57.770 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:57.770 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:57.770 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00997619 s, 105 MB/s 2023-11-26T07:12:57.771 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:57.771 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:57.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:57.830 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.132 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:57.895 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:57.895 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:57.895 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00843284 s, 124 MB/s 2023-11-26T07:12:57.896 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:57.896 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:57.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:57.955 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.133 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:58.022 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:58.023 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:58.023 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00935338 s, 112 MB/s 2023-11-26T07:12:58.023 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:58.023 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:58.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:58.080 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.134 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:58.148 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:58.148 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:58.148 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0093352 s, 112 MB/s 2023-11-26T07:12:58.148 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:58.149 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:58.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:58.206 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.135 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:58.273 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:58.274 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:58.274 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00969256 s, 108 MB/s 2023-11-26T07:12:58.275 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:58.275 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:58.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:58.333 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.136 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:58.399 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:58.399 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:58.399 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00876481 s, 120 MB/s 2023-11-26T07:12:58.400 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:58.400 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:58.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:58.458 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.137 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:58.527 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:58.527 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:58.527 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00975652 s, 107 MB/s 2023-11-26T07:12:58.527 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:58.527 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:58.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:58.584 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.138 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:58.651 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:58.652 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:58.652 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00932943 s, 112 MB/s 2023-11-26T07:12:58.652 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:58.652 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:58.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:58.710 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.139 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:58.780 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:58.781 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:58.781 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114479 s, 91.6 MB/s 2023-11-26T07:12:58.781 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:58.781 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:58.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:58.839 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.140 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:58.906 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:58.906 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:58.906 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101138 s, 104 MB/s 2023-11-26T07:12:58.907 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:58.907 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:58.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:58.965 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.141 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:59.031 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:59.032 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:59.032 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00915939 s, 114 MB/s 2023-11-26T07:12:59.033 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:59.033 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:59.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:59.091 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.142 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:59.158 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:59.158 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:59.158 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00935419 s, 112 MB/s 2023-11-26T07:12:59.158 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:59.158 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:59.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:59.216 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.143 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:59.284 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:59.285 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:59.285 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010065 s, 104 MB/s 2023-11-26T07:12:59.285 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:59.285 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:59.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:59.343 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.144 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:59.410 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:59.410 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:59.410 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00888969 s, 118 MB/s 2023-11-26T07:12:59.411 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:59.411 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:59.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:59.470 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.145 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:59.537 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:59.537 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:59.537 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00911617 s, 115 MB/s 2023-11-26T07:12:59.537 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:59.537 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:59.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:59.595 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.146 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:59.662 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:59.662 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:59.662 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0083051 s, 126 MB/s 2023-11-26T07:12:59.663 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:59.663 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:59.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:59.720 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.147 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:59.790 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:59.791 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:59.791 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115053 s, 91.1 MB/s 2023-11-26T07:12:59.791 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:59.791 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:59.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:59.850 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.148 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:12:59.918 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:12:59.919 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:12:59.919 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120216 s, 87.2 MB/s 2023-11-26T07:12:59.920 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:12:59.920 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:12:59.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:12:59.977 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.149 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:00.043 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:00.043 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:00.043 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00803498 s, 131 MB/s 2023-11-26T07:13:00.044 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:00.044 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:00.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:00.102 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.150 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:00.166 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:00.167 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:00.167 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00797241 s, 132 MB/s 2023-11-26T07:13:00.168 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:00.168 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:00.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:00.226 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.151 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:00.293 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:00.293 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:00.293 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102836 s, 102 MB/s 2023-11-26T07:13:00.294 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:00.294 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:00.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:00.353 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.152 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:00.419 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:00.420 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:00.420 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00865761 s, 121 MB/s 2023-11-26T07:13:00.420 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:00.420 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:00.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:00.478 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.153 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:00.546 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:00.546 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:00.546 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109088 s, 96.1 MB/s 2023-11-26T07:13:00.547 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:00.547 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:00.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:00.605 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.154 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:00.672 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:00.672 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:00.673 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00984297 s, 107 MB/s 2023-11-26T07:13:00.673 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:00.674 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:00.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:00.731 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.155 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:00.799 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:00.799 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:00.799 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0094085 s, 111 MB/s 2023-11-26T07:13:00.800 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:00.800 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:00.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:00.859 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.156 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:00.930 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:00.930 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:00.930 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011019 s, 95.2 MB/s 2023-11-26T07:13:00.930 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:00.930 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:00.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:00.988 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.157 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:01.055 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:01.055 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:01.055 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00977106 s, 107 MB/s 2023-11-26T07:13:01.056 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:01.056 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:01.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:01.114 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.158 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:01.182 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:01.183 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:01.183 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107314 s, 97.7 MB/s 2023-11-26T07:13:01.183 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:01.184 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:01.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:01.241 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.159 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:01.308 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:01.308 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:01.309 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00970732 s, 108 MB/s 2023-11-26T07:13:01.309 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:01.309 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:01.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:01.367 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.160 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:01.436 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:01.436 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:01.436 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00969432 s, 108 MB/s 2023-11-26T07:13:01.436 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:01.436 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:01.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:01.494 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.161 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:01.561 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:01.562 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:01.562 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00991423 s, 106 MB/s 2023-11-26T07:13:01.562 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:01.562 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:01.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:01.620 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.162 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:01.688 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:01.688 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:01.689 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114261 s, 91.8 MB/s 2023-11-26T07:13:01.689 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:01.690 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:01.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:01.748 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.163 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:01.817 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:01.817 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:01.817 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00984691 s, 106 MB/s 2023-11-26T07:13:01.817 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:01.817 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:01.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:01.874 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.164 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:01.942 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:01.942 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:01.942 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00966677 s, 108 MB/s 2023-11-26T07:13:01.942 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:01.943 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:02.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:02.001 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.165 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:02.068 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:02.069 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:02.069 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0093495 s, 112 MB/s 2023-11-26T07:13:02.069 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:02.069 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:02.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:02.127 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.166 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:02.195 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:02.195 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:02.195 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0099777 s, 105 MB/s 2023-11-26T07:13:02.195 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:02.195 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:02.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:02.255 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.167 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:02.322 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:02.322 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:02.322 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00872034 s, 120 MB/s 2023-11-26T07:13:02.323 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:02.323 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:02.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:02.381 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.168 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:02.447 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:02.448 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:02.448 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00868787 s, 121 MB/s 2023-11-26T07:13:02.448 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:02.448 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:02.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:02.506 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.169 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:02.573 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:02.573 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:02.573 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00974862 s, 108 MB/s 2023-11-26T07:13:02.574 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:02.575 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:02.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:02.632 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.170 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:02.699 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:02.699 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:02.699 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0088169 s, 119 MB/s 2023-11-26T07:13:02.700 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:02.700 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:02.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:02.759 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.171 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:02.827 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:02.827 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:02.827 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010492 s, 99.9 MB/s 2023-11-26T07:13:02.828 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:02.829 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:02.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:02.887 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.172 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:02.954 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:02.955 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:02.955 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00999243 s, 105 MB/s 2023-11-26T07:13:02.955 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:02.955 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:03.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:03.012 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.173 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:03.080 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:03.080 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:03.080 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00919836 s, 114 MB/s 2023-11-26T07:13:03.081 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:03.081 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:03.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:03.139 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.174 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:03.206 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:03.207 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:03.207 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00930732 s, 113 MB/s 2023-11-26T07:13:03.208 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:03.208 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:03.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:03.267 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.175 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:03.332 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:03.332 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:03.333 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00803812 s, 130 MB/s 2023-11-26T07:13:03.334 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:03.334 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:03.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:03.392 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.176 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:03.460 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:03.460 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:03.460 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101683 s, 103 MB/s 2023-11-26T07:13:03.461 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:03.461 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:03.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:03.519 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.177 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:03.584 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:03.585 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:03.585 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00841624 s, 125 MB/s 2023-11-26T07:13:03.586 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:03.586 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:03.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:03.646 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.178 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:03.716 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:03.716 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:03.716 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011609 s, 90.3 MB/s 2023-11-26T07:13:03.717 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:03.717 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:03.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:03.775 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.179 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:03.843 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:03.843 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:03.843 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111908 s, 93.7 MB/s 2023-11-26T07:13:03.844 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:03.845 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:03.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:03.903 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.180 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:03.970 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:03.970 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:03.970 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00962675 s, 109 MB/s 2023-11-26T07:13:03.971 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:03.971 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:04.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:04.028 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.181 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:04.096 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:04.097 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:04.097 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100445 s, 104 MB/s 2023-11-26T07:13:04.097 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:04.097 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:04.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:04.155 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.182 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:04.222 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:04.223 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:04.223 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101602 s, 103 MB/s 2023-11-26T07:13:04.224 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:04.224 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:04.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:04.284 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.183 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:04.349 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:04.349 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:04.349 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00810174 s, 129 MB/s 2023-11-26T07:13:04.350 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:04.350 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:04.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:04.408 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.184 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:04.476 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:04.476 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:04.476 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00985528 s, 106 MB/s 2023-11-26T07:13:04.477 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:04.477 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:04.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:04.536 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.185 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:04.605 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:04.605 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:04.606 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117883 s, 89.0 MB/s 2023-11-26T07:13:04.607 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:04.607 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:04.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:04.665 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.186 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:04.733 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:04.733 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:04.734 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108398 s, 96.7 MB/s 2023-11-26T07:13:04.734 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:04.734 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:04.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:04.792 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.187 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:04.860 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:04.860 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:04.860 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00993778 s, 106 MB/s 2023-11-26T07:13:04.860 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:04.861 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:04.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:04.918 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.188 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:04.986 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:04.986 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:04.987 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00991439 s, 106 MB/s 2023-11-26T07:13:04.987 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:04.987 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:05.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:05.045 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.189 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:05.112 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:05.113 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:05.113 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00959573 s, 109 MB/s 2023-11-26T07:13:05.113 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:05.113 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:05.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:05.170 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.190 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:05.238 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:05.238 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:05.238 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100248 s, 105 MB/s 2023-11-26T07:13:05.239 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:05.239 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:05.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:05.298 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.191 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:05.365 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:05.365 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:05.365 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00930316 s, 113 MB/s 2023-11-26T07:13:05.365 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:05.365 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:05.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:05.424 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.192 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:05.494 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:05.494 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:05.494 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124201 s, 84.4 MB/s 2023-11-26T07:13:05.494 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:05.495 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:05.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:05.553 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.193 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:05.620 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:05.620 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:05.620 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00960593 s, 109 MB/s 2023-11-26T07:13:05.620 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:05.621 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:05.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:05.678 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.194 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:05.745 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:05.745 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:05.745 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00902781 s, 116 MB/s 2023-11-26T07:13:05.746 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:05.746 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:05.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:05.804 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.195 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:05.871 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:05.871 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:05.872 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00923545 s, 114 MB/s 2023-11-26T07:13:05.872 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:05.872 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:05.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:05.930 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.196 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:05.999 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:05.999 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:05.999 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105427 s, 99.5 MB/s 2023-11-26T07:13:05.999 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:06.000 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:06.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:06.057 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.197 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:06.123 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:06.123 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:06.123 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00848015 s, 124 MB/s 2023-11-26T07:13:06.124 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:06.125 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:06.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:06.183 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.198 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:06.252 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:06.252 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:06.252 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00986373 s, 106 MB/s 2023-11-26T07:13:06.252 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:06.252 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:06.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:06.311 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol68520/e362b58a-ecfe-4348-bba6-f913400de922/subvolume_file.199 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:13:06.376 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:13:06.377 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:13:06.377 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00902227 s, 116 MB/s 2023-11-26T07:13:06.378 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs subvol68520 subvol_snap50220 2023-11-26T07:13:06.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.547+0000 7ff9fe377700 1 Processor -- start 2023-11-26T07:13:06.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.547+0000 7ff9fe377700 1 -- start start 2023-11-26T07:13:06.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.548+0000 7ff9fe377700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff9f81447a0 0x7ff9f8071b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:06.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.548+0000 7ff9fe377700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff9f806f070 0x7ff9f80720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:06.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.548+0000 7ff9fe377700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9f806dbd0 con 0x7ff9f8072ab0 2023-11-26T07:13:06.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.548+0000 7ff9fe377700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9f815b700 con 0x7ff9f806f070 2023-11-26T07:13:06.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.548+0000 7ff9fe377700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9f815b9e0 con 0x7ff9f81447a0 2023-11-26T07:13:06.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.548+0000 7ff9fc914700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff9f806f070 0x7ff9f80720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:06.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.548+0000 7ff9fc914700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff9f806f070 0x7ff9f80720d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41120/0 (socket says 172.21.15.2:41120) 2023-11-26T07:13:06.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.548+0000 7ff9fc914700 1 -- 172.21.15.2:0/1383849429 learned_addr learned my addr 172.21.15.2:0/1383849429 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:06.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.548+0000 7ff9f7fff700 1 --2- 172.21.15.2:0/1383849429 >> v2:172.21.15.192:3300/0 conn(0x7ff9f81447a0 0x7ff9f8071b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:06.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.549+0000 7ff9fc914700 1 -- 172.21.15.2:0/1383849429 >> v2:172.21.15.192:3300/0 conn(0x7ff9f81447a0 msgr2=0x7ff9f8071b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:06.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.549+0000 7ff9fc914700 1 --2- 172.21.15.2:0/1383849429 >> v2:172.21.15.192:3300/0 conn(0x7ff9f81447a0 0x7ff9f8071b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:06.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.549+0000 7ff9fc914700 1 -- 172.21.15.2:0/1383849429 >> v1:172.21.15.192:6789/0 conn(0x7ff9f8072ab0 legacy=0x7ff9f815e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:06.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.549+0000 7ff9fc914700 1 -- 172.21.15.2:0/1383849429 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f815bcc0 con 0x7ff9f806f070 2023-11-26T07:13:06.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.549+0000 7ff9fc914700 1 --2- 172.21.15.2:0/1383849429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9f806f070 0x7ff9f80720d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff9f80b05a0 tx=0x7ff9f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dc7a2ff441f4326 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:06.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.549+0000 7ff9f6ffd700 1 -- 172.21.15.2:0/1383849429 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f000e070 con 0x7ff9f806f070 2023-11-26T07:13:06.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.549+0000 7ff9f6ffd700 1 -- 172.21.15.2:0/1383849429 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f000b9c0 con 0x7ff9f806f070 2023-11-26T07:13:06.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.549+0000 7ff9f6ffd700 1 -- 172.21.15.2:0/1383849429 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f000bd70 con 0x7ff9f806f070 2023-11-26T07:13:06.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.549+0000 7ff9fe377700 1 -- 172.21.15.2:0/1383849429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9f806f070 msgr2=0x7ff9f80720d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:06.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.549+0000 7ff9fe377700 1 --2- 172.21.15.2:0/1383849429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9f806f070 0x7ff9f80720d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff9f80b05a0 tx=0x7ff9f000b330 comp rx=0 tx=0).stop 2023-11-26T07:13:06.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.549+0000 7ff9fe377700 1 -- 172.21.15.2:0/1383849429 shutdown_connections 2023-11-26T07:13:06.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.549+0000 7ff9fe377700 1 --2- 172.21.15.2:0/1383849429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9f806f070 0x7ff9f80720d0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:06.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.550+0000 7ff9fe377700 1 --2- 172.21.15.2:0/1383849429 >> v2:172.21.15.192:3300/0 conn(0x7ff9f81447a0 0x7ff9f8071b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:06.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.550+0000 7ff9fe377700 1 -- 172.21.15.2:0/1383849429 >> 172.21.15.2:0/1383849429 conn(0x7ff9f80b2760 msgr2=0x7ff9f80b2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:06.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.550+0000 7ff9fe377700 1 -- 172.21.15.2:0/1383849429 shutdown_connections 2023-11-26T07:13:06.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.550+0000 7ff9fe377700 1 -- 172.21.15.2:0/1383849429 wait complete. 2023-11-26T07:13:06.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.551+0000 7ff9fe377700 1 Processor -- start 2023-11-26T07:13:06.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.551+0000 7ff9fe377700 1 -- start start 2023-11-26T07:13:06.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.552+0000 7ff9fe377700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9f806f070 0x7ff9f81579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:06.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.552+0000 7ff9fe377700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9f8072ab0 0x7ff9f813c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:06.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.552+0000 7ff9fe377700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9f81447a0 0x7ff9f80ce190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:06.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.552+0000 7ff9fe377700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f813b780 con 0x7ff9f81447a0 2023-11-26T07:13:06.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.552+0000 7ff9fe377700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f813ba60 con 0x7ff9f8072ab0 2023-11-26T07:13:06.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.552+0000 7ff9fe377700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f813bd40 con 0x7ff9f806f070 2023-11-26T07:13:06.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.552+0000 7ff9fc914700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9f81447a0 0x7ff9f80ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:06.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.552+0000 7ff9fc914700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9f81447a0 0x7ff9f80ce190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41126/0 (socket says 172.21.15.2:41126) 2023-11-26T07:13:06.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.552+0000 7ff9fc914700 1 -- 172.21.15.2:0/338759350 learned_addr learned my addr 172.21.15.2:0/338759350 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:06.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.552+0000 7ff9f77fe700 1 --2- 172.21.15.2:0/338759350 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9f8072ab0 0x7ff9f813c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:06.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.552+0000 7ff9f7fff700 1 --2- 172.21.15.2:0/338759350 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9f806f070 0x7ff9f81579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:06.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.552+0000 7ff9fc914700 1 -- 172.21.15.2:0/338759350 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9f806f070 msgr2=0x7ff9f81579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:06.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.552+0000 7ff9fc914700 1 --2- 172.21.15.2:0/338759350 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9f806f070 0x7ff9f81579f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:06.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.552+0000 7ff9fc914700 1 -- 172.21.15.2:0/338759350 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9f8072ab0 msgr2=0x7ff9f813c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:06.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.552+0000 7ff9fc914700 1 --2- 172.21.15.2:0/338759350 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9f8072ab0 0x7ff9f813c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:06.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.552+0000 7ff9fc914700 1 -- 172.21.15.2:0/338759350 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f0009b30 con 0x7ff9f81447a0 2023-11-26T07:13:06.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.552+0000 7ff9fc914700 1 --2- 172.21.15.2:0/338759350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9f81447a0 0x7ff9f80ce190 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff9f8068340 tx=0x7ff9f0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:06.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.553+0000 7ff9f4ff9700 1 -- 172.21.15.2:0/338759350 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f0004880 con 0x7ff9f81447a0 2023-11-26T07:13:06.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.553+0000 7ff9f4ff9700 1 -- 172.21.15.2:0/338759350 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f00092e0 con 0x7ff9f81447a0 2023-11-26T07:13:06.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.553+0000 7ff9fe377700 1 -- 172.21.15.2:0/338759350 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9f813c020 con 0x7ff9f81447a0 2023-11-26T07:13:06.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.553+0000 7ff9f4ff9700 1 -- 172.21.15.2:0/338759350 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f001c660 con 0x7ff9f81447a0 2023-11-26T07:13:06.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.553+0000 7ff9fe377700 1 -- 172.21.15.2:0/338759350 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9f813b2f0 con 0x7ff9f81447a0 2023-11-26T07:13:06.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.554+0000 7ff9fe377700 1 -- 172.21.15.2:0/338759350 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9f8068670 con 0x7ff9f81447a0 2023-11-26T07:13:06.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.554+0000 7ff9f4ff9700 1 -- 172.21.15.2:0/338759350 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7ff9f001c7c0 con 0x7ff9f81447a0 2023-11-26T07:13:06.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.554+0000 7ff9f4ff9700 1 --2- 172.21.15.2:0/338759350 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff9d806af60 0x7ff9d806d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:06.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.555+0000 7ff9f4ff9700 1 -- 172.21.15.2:0/338759350 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff9f008b2b0 con 0x7ff9f81447a0 2023-11-26T07:13:06.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.555+0000 7ff9f7fff700 1 --2- 172.21.15.2:0/338759350 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff9d806af60 0x7ff9d806d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:06.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.555+0000 7ff9f7fff700 1 --2- 172.21.15.2:0/338759350 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff9d806af60 0x7ff9d806d420 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0006b20 tx=0x7ff9e0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:06.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.559+0000 7ff9f4ff9700 1 -- 172.21.15.2:0/338759350 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff9f00562f0 con 0x7ff9f81447a0 2023-11-26T07:13:06.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.797+0000 7ff9fe377700 1 -- 172.21.15.2:0/338759350 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "subvol68520", "snap_name": "subvol_snap50220", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9f815b130 con 0x7ff9d806af60 2023-11-26T07:13:06.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.824+0000 7ff9f4ff9700 1 -- 172.21.15.2:0/338759350 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7ff9e00076b0 con 0x7ff9d806af60 2023-11-26T07:13:06.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.828+0000 7ff9fe377700 1 -- 172.21.15.2:0/338759350 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff9d806af60 msgr2=0x7ff9d806d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:06.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.828+0000 7ff9fe377700 1 --2- 172.21.15.2:0/338759350 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff9d806af60 0x7ff9d806d420 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0006b20 tx=0x7ff9e0008040 comp rx=0 tx=0).stop 2023-11-26T07:13:06.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.828+0000 7ff9fe377700 1 -- 172.21.15.2:0/338759350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9f81447a0 msgr2=0x7ff9f80ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:06.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.828+0000 7ff9fe377700 1 --2- 172.21.15.2:0/338759350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9f81447a0 0x7ff9f80ce190 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff9f8068340 tx=0x7ff9f0004ad0 comp rx=0 tx=0).stop 2023-11-26T07:13:06.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.828+0000 7ff9fe377700 1 -- 172.21.15.2:0/338759350 shutdown_connections 2023-11-26T07:13:06.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.828+0000 7ff9fe377700 1 --2- 172.21.15.2:0/338759350 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff9d806af60 0x7ff9d806d420 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:06.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.828+0000 7ff9fe377700 1 --2- 172.21.15.2:0/338759350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9f81447a0 0x7ff9f80ce190 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:06.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.828+0000 7ff9fe377700 1 --2- 172.21.15.2:0/338759350 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9f806f070 0x7ff9f81579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:06.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.828+0000 7ff9fe377700 1 --2- 172.21.15.2:0/338759350 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9f8072ab0 0x7ff9f813c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:06.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.828+0000 7ff9fe377700 1 -- 172.21.15.2:0/338759350 >> 172.21.15.2:0/338759350 conn(0x7ff9f80b2760 msgr2=0x7ff9f8073f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:06.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.828+0000 7ff9fe377700 1 -- 172.21.15.2:0/338759350 shutdown_connections 2023-11-26T07:13:06.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.828+0000 7ff9fe377700 1 -- 172.21.15.2:0/338759350 wait complete. 2023-11-26T07:13:06.847 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/snapshot_clone_delay 5 2023-11-26T07:13:06.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.974+0000 7f8bd662e700 1 Processor -- start 2023-11-26T07:13:06.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.974+0000 7f8bd662e700 1 -- start start 2023-11-26T07:13:06.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.975+0000 7f8bd662e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bd015e500 0x7f8bd006c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:06.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.975+0000 7f8bd662e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bd00d0830 con 0x7f8bd015e120 2023-11-26T07:13:06.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.975+0000 7f8bd662e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bd00d0a90 con 0x7f8bd00b0c20 2023-11-26T07:13:06.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.975+0000 7f8bd662e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd00d0d70 con 0x7f8bd015e500 2023-11-26T07:13:06.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.975+0000 7f8bcffff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f8bd015e120 0x7f8bd006c0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60572/0 (socket says 172.21.15.2:60572) 2023-11-26T07:13:06.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.975+0000 7f8bcffff700 1 -- 172.21.15.2:0/201144665 learned_addr learned my addr 172.21.15.2:0/201144665 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:13:06.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.975+0000 7f8bceffd700 1 -- 172.21.15.2:0/201144665 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3273719563 0 0) 0x7f8bd00d0830 con 0x7f8bd015e120 2023-11-26T07:13:06.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.975+0000 7f8bceffd700 1 -- 172.21.15.2:0/201144665 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bb80035b0 con 0x7f8bd015e120 2023-11-26T07:13:06.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.975+0000 7f8bcf7fe700 1 --2- 172.21.15.2:0/201144665 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bd015e500 0x7f8bd006c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:06.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.976+0000 7f8bceffd700 1 -- 172.21.15.2:0/201144665 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 537407824 0 0) 0x7f8bb80035b0 con 0x7f8bd015e120 2023-11-26T07:13:06.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.976+0000 7f8bceffd700 1 -- 172.21.15.2:0/201144665 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bd015e500 msgr2=0x7f8bd006c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:06.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.976+0000 7f8bceffd700 1 --2- 172.21.15.2:0/201144665 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bd015e500 0x7f8bd006c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:06.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.976+0000 7f8bceffd700 1 -- 172.21.15.2:0/201144665 >> v1:172.21.15.192:6789/0 conn(0x7f8bd00b0c20 legacy=0x7f8bd00ccb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:06.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.976+0000 7f8bceffd700 1 -- 172.21.15.2:0/201144665 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd00d1050 con 0x7f8bd015e120 2023-11-26T07:13:06.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.976+0000 7f8bceffd700 1 -- 172.21.15.2:0/201144665 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f8bc4001670 con 0x7f8bd015e120 2023-11-26T07:13:06.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.976+0000 7f8bceffd700 1 -- 172.21.15.2:0/201144665 >> v1:172.21.15.2:6789/0 conn(0x7f8bd015e120 legacy=0x7f8bd006c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:06.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.976+0000 7f8bceffd700 1 --2- 172.21.15.2:0/201144665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bb8003a30 0x7f8bb8003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:06.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.976+0000 7f8bceffd700 1 --2- 172.21.15.2:0/201144665 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bd015e500 0x7f8bb8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:06.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.976+0000 7f8bceffd700 1 --2- 172.21.15.2:0/201144665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bb8004d90 0x7f8bb8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:06.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.976+0000 7f8bceffd700 1 -- 172.21.15.2:0/201144665 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd00d0d70 con 0x7f8bb8003a30 2023-11-26T07:13:06.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.976+0000 7f8bceffd700 1 -- 172.21.15.2:0/201144665 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb800baf0 con 0x7f8bb8004d90 2023-11-26T07:13:06.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.976+0000 7f8bceffd700 1 -- 172.21.15.2:0/201144665 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb800bcb0 con 0x7f8bd015e500 2023-11-26T07:13:06.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.976+0000 7f8bcffff700 1 --2- 172.21.15.2:0/201144665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bb8003a30 0x7f8bb8003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:06.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.976+0000 7f8bcf7fe700 1 --2- 172.21.15.2:0/201144665 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bd015e500 0x7f8bb8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:06.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.976+0000 7f8bd4bcb700 1 --2- 172.21.15.2:0/201144665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bb8004d90 0x7f8bb8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:06.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.976+0000 7f8bcffff700 1 -- 172.21.15.2:0/201144665 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bd015e500 msgr2=0x7f8bb8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:06.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.976+0000 7f8bcffff700 1 --2- 172.21.15.2:0/201144665 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bd015e500 0x7f8bb8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:06.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.976+0000 7f8bcffff700 1 -- 172.21.15.2:0/201144665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bb8004d90 msgr2=0x7f8bb8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:06.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.976+0000 7f8bcffff700 1 --2- 172.21.15.2:0/201144665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bb8004d90 0x7f8bb8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:06.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.976+0000 7f8bcffff700 1 -- 172.21.15.2:0/201144665 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb80035b0 con 0x7f8bb8003a30 2023-11-26T07:13:06.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.976+0000 7f8bcf7fe700 1 --2- 172.21.15.2:0/201144665 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bd015e500 0x7f8bb8004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:13:06.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.976+0000 7f8bd4bcb700 1 --2- 172.21.15.2:0/201144665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bb8004d90 0x7f8bb8005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:13:06.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.976+0000 7f8bcffff700 1 --2- 172.21.15.2:0/201144665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bb8003a30 0x7f8bb8003e50 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8bc400c210 tx=0x7f8bb8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea612535f6232629 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:06.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.976+0000 7f8bceffd700 1 -- 172.21.15.2:0/201144665 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc4007c10 con 0x7f8bb8003a30 2023-11-26T07:13:06.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.976+0000 7f8bceffd700 1 -- 172.21.15.2:0/201144665 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc400cdd0 con 0x7f8bb8003a30 2023-11-26T07:13:06.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.976+0000 7f8bceffd700 1 -- 172.21.15.2:0/201144665 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc4005ba0 con 0x7f8bb8003a30 2023-11-26T07:13:06.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.977+0000 7f8bd662e700 1 -- 172.21.15.2:0/201144665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bb8003a30 msgr2=0x7f8bb8003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:06.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.977+0000 7f8bd662e700 1 --2- 172.21.15.2:0/201144665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bb8003a30 0x7f8bb8003e50 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8bc400c210 tx=0x7f8bb8005880 comp rx=0 tx=0).stop 2023-11-26T07:13:06.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.977+0000 7f8bd4bcb700 1 -- 172.21.15.2:0/201144665 reap_dead start 2023-11-26T07:13:06.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.977+0000 7f8bd662e700 1 -- 172.21.15.2:0/201144665 shutdown_connections 2023-11-26T07:13:06.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.977+0000 7f8bd662e700 1 -- 172.21.15.2:0/201144665 >> 172.21.15.2:0/201144665 conn(0x7f8bd00d1c30 msgr2=0x7f8bd00d2040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:06.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.977+0000 7f8bd662e700 1 -- 172.21.15.2:0/201144665 shutdown_connections 2023-11-26T07:13:06.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.977+0000 7f8bd662e700 1 -- 172.21.15.2:0/201144665 wait complete. 2023-11-26T07:13:06.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.978+0000 7f8bd662e700 1 Processor -- start 2023-11-26T07:13:06.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.978+0000 7f8bd662e700 1 -- start start 2023-11-26T07:13:06.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.979+0000 7f8bd662e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bb8003a30 0x7f8bd014f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:06.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.979+0000 7f8bd662e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bd009baf0 0x7f8bd009bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:06.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.979+0000 7f8bd662e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bd00ca7d0 0x7f8bd00cac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:06.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.979+0000 7f8bd662e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd009c4b0 con 0x7f8bd00ca7d0 2023-11-26T07:13:06.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.979+0000 7f8bd662e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd009db10 con 0x7f8bb8003a30 2023-11-26T07:13:06.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.979+0000 7f8bd662e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd00cb540 con 0x7f8bd009baf0 2023-11-26T07:13:06.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.979+0000 7f8bd4bcb700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bd00ca7d0 0x7f8bd00cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:06.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.979+0000 7f8bd4bcb700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bd00ca7d0 0x7f8bd00cac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41146/0 (socket says 172.21.15.2:41146) 2023-11-26T07:13:06.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.979+0000 7f8bd4bcb700 1 -- 172.21.15.2:0/1919692291 learned_addr learned my addr 172.21.15.2:0/1919692291 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:06.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.979+0000 7f8bcf7fe700 1 --2- 172.21.15.2:0/1919692291 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bd009baf0 0x7f8bd009bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:06.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.979+0000 7f8bcffff700 1 --2- 172.21.15.2:0/1919692291 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bb8003a30 0x7f8bd014f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:06.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.980+0000 7f8bd4bcb700 1 -- 172.21.15.2:0/1919692291 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bd009baf0 msgr2=0x7f8bd009bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:06.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.980+0000 7f8bd4bcb700 1 --2- 172.21.15.2:0/1919692291 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bd009baf0 0x7f8bd009bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:06.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.980+0000 7f8bd4bcb700 1 -- 172.21.15.2:0/1919692291 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bb8003a30 msgr2=0x7f8bd014f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:06.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.980+0000 7f8bd4bcb700 1 --2- 172.21.15.2:0/1919692291 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bb8003a30 0x7f8bd014f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:06.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.980+0000 7f8bd4bcb700 1 -- 172.21.15.2:0/1919692291 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd009dd80 con 0x7f8bd00ca7d0 2023-11-26T07:13:06.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.980+0000 7f8bd4bcb700 1 --2- 172.21.15.2:0/1919692291 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bd00ca7d0 0x7f8bd00cac60 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8bd009fcc0 tx=0x7f8bc800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:06.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.980+0000 7f8bccff9700 1 -- 172.21.15.2:0/1919692291 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc8003c10 con 0x7f8bd00ca7d0 2023-11-26T07:13:06.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.980+0000 7f8bccff9700 1 -- 172.21.15.2:0/1919692291 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc8003d90 con 0x7f8bd00ca7d0 2023-11-26T07:13:06.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.980+0000 7f8bd662e700 1 -- 172.21.15.2:0/1919692291 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bd009e060 con 0x7f8bd00ca7d0 2023-11-26T07:13:06.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.980+0000 7f8bccff9700 1 -- 172.21.15.2:0/1919692291 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc8005310 con 0x7f8bd00ca7d0 2023-11-26T07:13:06.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.980+0000 7f8bd662e700 1 -- 172.21.15.2:0/1919692291 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bd00cb1a0 con 0x7f8bd00ca7d0 2023-11-26T07:13:06.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.981+0000 7f8bd662e700 1 -- 172.21.15.2:0/1919692291 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bd0075480 con 0x7f8bd00ca7d0 2023-11-26T07:13:06.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.981+0000 7f8bccff9700 1 -- 172.21.15.2:0/1919692291 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f8bc8005470 con 0x7f8bd00ca7d0 2023-11-26T07:13:06.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.982+0000 7f8bccff9700 1 --2- 172.21.15.2:0/1919692291 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8bbc06af60 0x7f8bbc06d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:06.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.982+0000 7f8bccff9700 1 -- 172.21.15.2:0/1919692291 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8bc8089560 con 0x7f8bd00ca7d0 2023-11-26T07:13:06.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.982+0000 7f8bcffff700 1 --2- 172.21.15.2:0/1919692291 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8bbc06af60 0x7f8bbc06d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:06.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.982+0000 7f8bcffff700 1 --2- 172.21.15.2:0/1919692291 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8bbc06af60 0x7f8bbc06d420 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4001930 tx=0x7f8bc4007000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:06.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:06.986+0000 7f8bccff9700 1 -- 172.21.15.2:0/1919692291 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8bc80546b0 con 0x7f8bd00ca7d0 2023-11-26T07:13:06.993 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:13:06.995 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:13:07.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.189+0000 7f8bd662e700 1 -- 172.21.15.2:0/1919692291 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}] v 0) v1 -- 0x7f8bd00b0810 con 0x7f8bd00ca7d0 2023-11-26T07:13:07.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.193+0000 7f8bccff9700 1 -- 172.21.15.2:0/1919692291 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}]=0 v11)=0 v11) v1 ==== 130+0+0 (secure 0 0 0) 0x7f8bc8001b50 con 0x7f8bd00ca7d0 2023-11-26T07:13:07.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.195+0000 7f8bd662e700 1 -- 172.21.15.2:0/1919692291 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8bbc06af60 msgr2=0x7f8bbc06d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:07.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.195+0000 7f8bd662e700 1 --2- 172.21.15.2:0/1919692291 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8bbc06af60 0x7f8bbc06d420 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4001930 tx=0x7f8bc4007000 comp rx=0 tx=0).stop 2023-11-26T07:13:07.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.195+0000 7f8bd662e700 1 -- 172.21.15.2:0/1919692291 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bd00ca7d0 msgr2=0x7f8bd00cac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:07.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.195+0000 7f8bd662e700 1 --2- 172.21.15.2:0/1919692291 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bd00ca7d0 0x7f8bd00cac60 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8bd009fcc0 tx=0x7f8bc800ee70 comp rx=0 tx=0).stop 2023-11-26T07:13:07.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.195+0000 7f8bd662e700 1 -- 172.21.15.2:0/1919692291 shutdown_connections 2023-11-26T07:13:07.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.195+0000 7f8bd662e700 1 --2- 172.21.15.2:0/1919692291 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8bbc06af60 0x7f8bbc06d420 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:07.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.195+0000 7f8bd662e700 1 --2- 172.21.15.2:0/1919692291 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bd00ca7d0 0x7f8bd00cac60 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:07.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.195+0000 7f8bd662e700 1 --2- 172.21.15.2:0/1919692291 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bb8003a30 0x7f8bd014f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:07.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.195+0000 7f8bd662e700 1 --2- 172.21.15.2:0/1919692291 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bd009baf0 0x7f8bd009bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:07.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.195+0000 7f8bd662e700 1 -- 172.21.15.2:0/1919692291 >> 172.21.15.2:0/1919692291 conn(0x7f8bd00d1c30 msgr2=0x7f8bd006c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:07.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.195+0000 7f8bd662e700 1 -- 172.21.15.2:0/1919692291 shutdown_connections 2023-11-26T07:13:07.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.195+0000 7f8bd662e700 1 -- 172.21.15.2:0/1919692291 wait complete. 2023-11-26T07:13:07.210 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs subvol68520 subvol_snap50220 subvol_clone11910 2023-11-26T07:13:07.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.338+0000 7f102b2d6700 1 Processor -- start 2023-11-26T07:13:07.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.338+0000 7f102b2d6700 1 -- start start 2023-11-26T07:13:07.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.339+0000 7f102b2d6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f102415e080 0x7f102406b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:07.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.339+0000 7f102b2d6700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f102406b840 con 0x7f102406c460 2023-11-26T07:13:07.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.339+0000 7f102b2d6700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f102406c9e0 con 0x7f10240b1a90 2023-11-26T07:13:07.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.339+0000 7f102b2d6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10240ad370 con 0x7f102415e080 2023-11-26T07:13:07.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.339+0000 7f1028871700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f102406c460 0x7f10240b1380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60594/0 (socket says 172.21.15.2:60594) 2023-11-26T07:13:07.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.339+0000 7f1028871700 1 -- 172.21.15.2:0/376146970 learned_addr learned my addr 172.21.15.2:0/376146970 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:13:07.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.339+0000 7f101bfff700 1 -- 172.21.15.2:0/376146970 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 298443454 0 0) 0x7f102406b840 con 0x7f102406c460 2023-11-26T07:13:07.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.339+0000 7f101bfff700 1 -- 172.21.15.2:0/376146970 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10100035b0 con 0x7f102406c460 2023-11-26T07:13:07.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.339+0000 7f1029072700 1 --2- 172.21.15.2:0/376146970 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f102415e080 0x7f102406b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:07.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.339+0000 7f101bfff700 1 -- 172.21.15.2:0/376146970 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4240890718 0 0) 0x7f10100035b0 con 0x7f102406c460 2023-11-26T07:13:07.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.339+0000 7f101bfff700 1 -- 172.21.15.2:0/376146970 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f102415e080 msgr2=0x7f102406b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:07.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.340+0000 7f101bfff700 1 --2- 172.21.15.2:0/376146970 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f102415e080 0x7f102406b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:07.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.340+0000 7f101bfff700 1 -- 172.21.15.2:0/376146970 >> v1:172.21.15.192:6789/0 conn(0x7f10240b1a90 legacy=0x7f10240ae130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:07.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.340+0000 7f101bfff700 1 -- 172.21.15.2:0/376146970 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10240ad650 con 0x7f102406c460 2023-11-26T07:13:07.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.340+0000 7f101bfff700 1 -- 172.21.15.2:0/376146970 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f1014001670 con 0x7f102406c460 2023-11-26T07:13:07.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.340+0000 7f101bfff700 1 -- 172.21.15.2:0/376146970 >> v1:172.21.15.2:6789/0 conn(0x7f102406c460 legacy=0x7f10240b1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:07.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.340+0000 7f101bfff700 1 --2- 172.21.15.2:0/376146970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1010003a30 0x7f1010003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:07.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.340+0000 7f101bfff700 1 --2- 172.21.15.2:0/376146970 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f102415e080 0x7f1010004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:07.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.340+0000 7f101bfff700 1 --2- 172.21.15.2:0/376146970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1010004d90 0x7f1010005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:07.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.340+0000 7f101bfff700 1 -- 172.21.15.2:0/376146970 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10240ad370 con 0x7f1010003a30 2023-11-26T07:13:07.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.340+0000 7f101bfff700 1 -- 172.21.15.2:0/376146970 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101000bb40 con 0x7f1010004d90 2023-11-26T07:13:07.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.340+0000 7f101bfff700 1 -- 172.21.15.2:0/376146970 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f101000bd00 con 0x7f102415e080 2023-11-26T07:13:07.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.340+0000 7f1029072700 1 --2- 172.21.15.2:0/376146970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1010003a30 0x7f1010003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:07.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.340+0000 7f1028871700 1 --2- 172.21.15.2:0/376146970 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f102415e080 0x7f1010004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:07.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.340+0000 7f1029873700 1 --2- 172.21.15.2:0/376146970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1010004d90 0x7f1010005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:07.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.340+0000 7f1029072700 1 -- 172.21.15.2:0/376146970 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f102415e080 msgr2=0x7f1010004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:07.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.340+0000 7f1029072700 1 --2- 172.21.15.2:0/376146970 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f102415e080 0x7f1010004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:07.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.340+0000 7f1029072700 1 -- 172.21.15.2:0/376146970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1010004d90 msgr2=0x7f1010005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:07.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.340+0000 7f1029072700 1 --2- 172.21.15.2:0/376146970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1010004d90 0x7f1010005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:07.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.340+0000 7f1029072700 1 -- 172.21.15.2:0/376146970 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10100035b0 con 0x7f1010003a30 2023-11-26T07:13:07.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.340+0000 7f1029072700 1 --2- 172.21.15.2:0/376146970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1010003a30 0x7f1010003e50 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1020009b60 tx=0x7f1010005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2feb1f20aae55558 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:07.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.340+0000 7f101bfff700 1 -- 172.21.15.2:0/376146970 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102000e6c0 con 0x7f1010003a30 2023-11-26T07:13:07.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.340+0000 7f101bfff700 1 -- 172.21.15.2:0/376146970 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f102000e820 con 0x7f1010003a30 2023-11-26T07:13:07.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.340+0000 7f101bfff700 1 -- 172.21.15.2:0/376146970 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102000eb90 con 0x7f1010003a30 2023-11-26T07:13:07.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.341+0000 7f102b2d6700 1 -- 172.21.15.2:0/376146970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1010003a30 msgr2=0x7f1010003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:07.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.341+0000 7f102b2d6700 1 --2- 172.21.15.2:0/376146970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1010003a30 0x7f1010003e50 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1020009b60 tx=0x7f1010005880 comp rx=0 tx=0).stop 2023-11-26T07:13:07.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.341+0000 7f1029873700 1 -- 172.21.15.2:0/376146970 reap_dead start 2023-11-26T07:13:07.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.341+0000 7f102b2d6700 1 -- 172.21.15.2:0/376146970 shutdown_connections 2023-11-26T07:13:07.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.341+0000 7f102b2d6700 1 -- 172.21.15.2:0/376146970 >> 172.21.15.2:0/376146970 conn(0x7f10240717f0 msgr2=0x7f10240b5150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:07.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.341+0000 7f102b2d6700 1 -- 172.21.15.2:0/376146970 shutdown_connections 2023-11-26T07:13:07.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.341+0000 7f102b2d6700 1 -- 172.21.15.2:0/376146970 wait complete. 2023-11-26T07:13:07.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.342+0000 7f102b2d6700 1 Processor -- start 2023-11-26T07:13:07.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.342+0000 7f102b2d6700 1 -- start start 2023-11-26T07:13:07.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.343+0000 7f102b2d6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1010003a30 0x7f10241f30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:07.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.343+0000 7f102b2d6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1024159240 0x7f10241f6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:07.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.343+0000 7f102b2d6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10241f7130 0x7f10241f75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:07.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.343+0000 7f102b2d6700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102415a580 con 0x7f1024159240 2023-11-26T07:13:07.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.343+0000 7f102b2d6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10241596c0 con 0x7f1010003a30 2023-11-26T07:13:07.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.343+0000 7f102b2d6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1024159970 con 0x7f10241f7130 2023-11-26T07:13:07.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.343+0000 7f1028871700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1024159240 0x7f10241f6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:07.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.343+0000 7f1028871700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1024159240 0x7f10241f6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41162/0 (socket says 172.21.15.2:41162) 2023-11-26T07:13:07.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.343+0000 7f1028871700 1 -- 172.21.15.2:0/1415379853 learned_addr learned my addr 172.21.15.2:0/1415379853 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:07.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.343+0000 7f1029873700 1 --2- 172.21.15.2:0/1415379853 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10241f7130 0x7f10241f75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:07.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.343+0000 7f1029072700 1 --2- 172.21.15.2:0/1415379853 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1010003a30 0x7f10241f30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:07.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.343+0000 7f1028871700 1 -- 172.21.15.2:0/1415379853 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10241f7130 msgr2=0x7f10241f75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:07.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.343+0000 7f1028871700 1 --2- 172.21.15.2:0/1415379853 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10241f7130 0x7f10241f75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:07.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.343+0000 7f1028871700 1 -- 172.21.15.2:0/1415379853 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1010003a30 msgr2=0x7f10241f30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:07.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.343+0000 7f1028871700 1 --2- 172.21.15.2:0/1415379853 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1010003a30 0x7f10241f30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:07.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.343+0000 7f1028871700 1 -- 172.21.15.2:0/1415379853 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1024159c50 con 0x7f1024159240 2023-11-26T07:13:07.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.344+0000 7f1028871700 1 --2- 172.21.15.2:0/1415379853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1024159240 0x7f10241f6bf0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f10140072c0 tx=0x7f1014007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:07.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.344+0000 7f1019ffb700 1 -- 172.21.15.2:0/1415379853 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1014001450 con 0x7f1024159240 2023-11-26T07:13:07.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.344+0000 7f1019ffb700 1 -- 172.21.15.2:0/1415379853 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f101400f850 con 0x7f1024159240 2023-11-26T07:13:07.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.344+0000 7f102b2d6700 1 -- 172.21.15.2:0/1415379853 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1024159f30 con 0x7f1024159240 2023-11-26T07:13:07.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.344+0000 7f1019ffb700 1 -- 172.21.15.2:0/1415379853 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101400fc00 con 0x7f1024159240 2023-11-26T07:13:07.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.344+0000 7f102b2d6700 1 -- 172.21.15.2:0/1415379853 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10241481b0 con 0x7f1024159240 2023-11-26T07:13:07.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.345+0000 7f102b2d6700 1 -- 172.21.15.2:0/1415379853 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1024075480 con 0x7f1024159240 2023-11-26T07:13:07.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.345+0000 7f1019ffb700 1 -- 172.21.15.2:0/1415379853 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f101400fd60 con 0x7f1024159240 2023-11-26T07:13:07.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.345+0000 7f1019ffb700 1 --2- 172.21.15.2:0/1415379853 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f100806af60 0x7f100806d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:07.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.346+0000 7f1019ffb700 1 -- 172.21.15.2:0/1415379853 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f10140896c0 con 0x7f1024159240 2023-11-26T07:13:07.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.346+0000 7f1029072700 1 --2- 172.21.15.2:0/1415379853 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f100806af60 0x7f100806d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:07.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.346+0000 7f1029072700 1 --2- 172.21.15.2:0/1415379853 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f100806af60 0x7f100806d420 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1020000c00 tx=0x7f1020008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:07.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.350+0000 7f1019ffb700 1 -- 172.21.15.2:0/1415379853 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1014054780 con 0x7f1024159240 2023-11-26T07:13:07.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.602+0000 7f102b2d6700 1 -- 172.21.15.2:0/1415379853 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "subvol68520", "snap_name": "subvol_snap50220", "target_sub_name": "subvol_clone11910", "target": ["mon-mgr", ""]}) v1 -- 0x7f102415e460 con 0x7f100806af60 2023-11-26T07:13:07.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.671+0000 7f1019ffb700 1 -- 172.21.15.2:0/1415379853 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f1020006c60 con 0x7f100806af60 2023-11-26T07:13:07.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.673+0000 7f102b2d6700 1 -- 172.21.15.2:0/1415379853 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f100806af60 msgr2=0x7f100806d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:07.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.673+0000 7f102b2d6700 1 --2- 172.21.15.2:0/1415379853 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f100806af60 0x7f100806d420 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1020000c00 tx=0x7f1020008030 comp rx=0 tx=0).stop 2023-11-26T07:13:07.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.673+0000 7f102b2d6700 1 -- 172.21.15.2:0/1415379853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1024159240 msgr2=0x7f10241f6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:07.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.673+0000 7f102b2d6700 1 --2- 172.21.15.2:0/1415379853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1024159240 0x7f10241f6bf0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f10140072c0 tx=0x7f1014007680 comp rx=0 tx=0).stop 2023-11-26T07:13:07.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.673+0000 7f102b2d6700 1 -- 172.21.15.2:0/1415379853 shutdown_connections 2023-11-26T07:13:07.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.673+0000 7f102b2d6700 1 --2- 172.21.15.2:0/1415379853 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f100806af60 0x7f100806d420 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:07.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.673+0000 7f102b2d6700 1 --2- 172.21.15.2:0/1415379853 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10241f7130 0x7f10241f75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:07.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.673+0000 7f102b2d6700 1 --2- 172.21.15.2:0/1415379853 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1010003a30 0x7f10241f30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:07.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.673+0000 7f102b2d6700 1 --2- 172.21.15.2:0/1415379853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1024159240 0x7f10241f6bf0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:07.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.673+0000 7f102b2d6700 1 -- 172.21.15.2:0/1415379853 >> 172.21.15.2:0/1415379853 conn(0x7f10240717f0 msgr2=0x7f102415acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:07.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.673+0000 7f102b2d6700 1 -- 172.21.15.2:0/1415379853 shutdown_connections 2023-11-26T07:13:07.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.673+0000 7f102b2d6700 1 -- 172.21.15.2:0/1415379853 wait complete. 2023-11-26T07:13:07.678 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:13:07.676+0000 7f8dacab3700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:13:07.678 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:13:07.676+0000 7f8dacab3700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:13:07.678 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:13:07.676+0000 7f8dacab3700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:13:07.678 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:13:07.676+0000 7f8dacab3700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:13:07.678 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:13:07.676+0000 7f8dacab3700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:13:07.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:07.689 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo rmdir ./volumes/_nogroup/subvol68520/.snap/subvol_snap50220) 2023-11-26T07:13:07.693 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:13:07.692+0000 7f8dac2b2700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:13:07.693 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:13:07.692+0000 7f8dac2b2700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:13:07.694 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:13:07.692+0000 7f8dac2b2700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:13:07.694 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:13:07.692+0000 7f8dac2b2700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:13:07.694 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:13:07.692+0000 7f8dac2b2700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:13:07.725 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone11910 2023-11-26T07:13:07.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.891+0000 7f43ffbad700 1 Processor -- start 2023-11-26T07:13:07.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.891+0000 7f43ffbad700 1 -- start start 2023-11-26T07:13:07.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.891+0000 7f43ffbad700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f43f8143ae0 0x7f43f80b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:07.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.891+0000 7f43ffbad700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f43f81440f0 0x7f43f8071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:07.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.891+0000 7f43ffbad700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43f8143ec0 con 0x7f43f80720f0 2023-11-26T07:13:07.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.891+0000 7f43ffbad700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43f80b40a0 con 0x7f43f81440f0 2023-11-26T07:13:07.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.891+0000 7f43ffbad700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43f8072580 con 0x7f43f8143ae0 2023-11-26T07:13:07.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.891+0000 7f43fd148700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f43f81440f0 0x7f43f8071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:07.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.891+0000 7f43fe14a700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f43f80720f0 0x7f43f815e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60616/0 (socket says 172.21.15.2:60616) 2023-11-26T07:13:07.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.891+0000 7f43fe14a700 1 -- 172.21.15.2:0/316384460 learned_addr learned my addr 172.21.15.2:0/316384460 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:13:07.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.891+0000 7f43fd949700 1 --2- 172.21.15.2:0/316384460 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f43f8143ae0 0x7f43f80b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:07.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.891+0000 7f43fd148700 1 -- 172.21.15.2:0/316384460 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f43f8143ae0 msgr2=0x7f43f80b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:07.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.891+0000 7f43fd148700 1 --2- 172.21.15.2:0/316384460 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f43f8143ae0 0x7f43f80b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:07.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.891+0000 7f43fd148700 1 -- 172.21.15.2:0/316384460 >> v1:172.21.15.2:6789/0 conn(0x7f43f80720f0 legacy=0x7f43f815e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:07.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.891+0000 7f43fd148700 1 -- 172.21.15.2:0/316384460 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f80b3ae0 con 0x7f43f81440f0 2023-11-26T07:13:07.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.891+0000 7f43fd148700 1 --2- 172.21.15.2:0/316384460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43f81440f0 0x7f43f8071bb0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f43e8009840 tx=0x7f43e8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92c956f1f5b35a10 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:07.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.892+0000 7f43fc947700 1 -- 172.21.15.2:0/316384460 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e8011830 con 0x7f43f81440f0 2023-11-26T07:13:07.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.892+0000 7f43fc947700 1 -- 172.21.15.2:0/316384460 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e8011990 con 0x7f43f81440f0 2023-11-26T07:13:07.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.892+0000 7f43fc947700 1 -- 172.21.15.2:0/316384460 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e8011d20 con 0x7f43f81440f0 2023-11-26T07:13:07.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.892+0000 7f43ffbad700 1 -- 172.21.15.2:0/316384460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43f81440f0 msgr2=0x7f43f8071bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:07.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.892+0000 7f43ffbad700 1 --2- 172.21.15.2:0/316384460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43f81440f0 0x7f43f8071bb0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f43e8009840 tx=0x7f43e8009b50 comp rx=0 tx=0).stop 2023-11-26T07:13:07.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.892+0000 7f43ffbad700 1 -- 172.21.15.2:0/316384460 shutdown_connections 2023-11-26T07:13:07.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.892+0000 7f43ffbad700 1 --2- 172.21.15.2:0/316384460 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f43f8143ae0 0x7f43f80b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:07.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.892+0000 7f43ffbad700 1 --2- 172.21.15.2:0/316384460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43f81440f0 0x7f43f8071bb0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:07.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.892+0000 7f43ffbad700 1 -- 172.21.15.2:0/316384460 >> 172.21.15.2:0/316384460 conn(0x7f43f80b2740 msgr2=0x7f43f80b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:07.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.892+0000 7f43ffbad700 1 -- 172.21.15.2:0/316384460 shutdown_connections 2023-11-26T07:13:07.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.892+0000 7f43ffbad700 1 -- 172.21.15.2:0/316384460 wait complete. 2023-11-26T07:13:07.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.894+0000 7f43ffbad700 1 Processor -- start 2023-11-26T07:13:07.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.894+0000 7f43ffbad700 1 -- start start 2023-11-26T07:13:07.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.895+0000 7f43ffbad700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f43f80720f0 0x7f43f814dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:07.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.895+0000 7f43ffbad700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43f8143ae0 0x7f43f8142460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:07.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.895+0000 7f43ffbad700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43f81440f0 0x7f43f806afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:07.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.895+0000 7f43ffbad700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f815b310 con 0x7f43f81440f0 2023-11-26T07:13:07.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.895+0000 7f43ffbad700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f815be90 con 0x7f43f8143ae0 2023-11-26T07:13:07.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.895+0000 7f43ffbad700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43f815b560 con 0x7f43f80720f0 2023-11-26T07:13:07.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.895+0000 7f43fe14a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43f81440f0 0x7f43f806afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:07.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.895+0000 7f43fe14a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43f81440f0 0x7f43f806afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41180/0 (socket says 172.21.15.2:41180) 2023-11-26T07:13:07.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.895+0000 7f43fe14a700 1 -- 172.21.15.2:0/697053780 learned_addr learned my addr 172.21.15.2:0/697053780 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:07.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.895+0000 7f43fd949700 1 --2- 172.21.15.2:0/697053780 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f43f80720f0 0x7f43f814dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:07.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.895+0000 7f43fd148700 1 --2- 172.21.15.2:0/697053780 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43f8143ae0 0x7f43f8142460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:07.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.895+0000 7f43fe14a700 1 -- 172.21.15.2:0/697053780 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f43f80720f0 msgr2=0x7f43f814dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:07.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.895+0000 7f43fe14a700 1 --2- 172.21.15.2:0/697053780 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f43f80720f0 0x7f43f814dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:07.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.895+0000 7f43fe14a700 1 -- 172.21.15.2:0/697053780 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43f8143ae0 msgr2=0x7f43f8142460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:07.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.895+0000 7f43fe14a700 1 --2- 172.21.15.2:0/697053780 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43f8143ae0 0x7f43f8142460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:07.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.895+0000 7f43fe14a700 1 -- 172.21.15.2:0/697053780 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e80094a0 con 0x7f43f81440f0 2023-11-26T07:13:07.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.895+0000 7f43fe14a700 1 --2- 172.21.15.2:0/697053780 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43f81440f0 0x7f43f806afd0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f43f000cab0 tx=0x7f43f000ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:07.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.896+0000 7f43ee7fc700 1 -- 172.21.15.2:0/697053780 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f000aa60 con 0x7f43f81440f0 2023-11-26T07:13:07.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.896+0000 7f43ee7fc700 1 -- 172.21.15.2:0/697053780 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f000abc0 con 0x7f43f81440f0 2023-11-26T07:13:07.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.896+0000 7f43ffbad700 1 -- 172.21.15.2:0/697053780 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43f815b840 con 0x7f43f81440f0 2023-11-26T07:13:07.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.896+0000 7f43ee7fc700 1 -- 172.21.15.2:0/697053780 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f0012400 con 0x7f43f81440f0 2023-11-26T07:13:07.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.896+0000 7f43ffbad700 1 -- 172.21.15.2:0/697053780 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43f814e320 con 0x7f43f81440f0 2023-11-26T07:13:07.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.897+0000 7f43ffbad700 1 -- 172.21.15.2:0/697053780 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43f8075480 con 0x7f43f81440f0 2023-11-26T07:13:07.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.897+0000 7f43ee7fc700 1 -- 172.21.15.2:0/697053780 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f43f001b3b0 con 0x7f43f81440f0 2023-11-26T07:13:07.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.897+0000 7f43ee7fc700 1 --2- 172.21.15.2:0/697053780 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f43dc06af60 0x7f43dc06d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:07.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.898+0000 7f43ee7fc700 1 -- 172.21.15.2:0/697053780 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f43f00891d0 con 0x7f43f81440f0 2023-11-26T07:13:07.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.898+0000 7f43fd949700 1 --2- 172.21.15.2:0/697053780 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f43dc06af60 0x7f43dc06d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:07.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.898+0000 7f43fd949700 1 --2- 172.21.15.2:0/697053780 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f43dc06af60 0x7f43dc06d420 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f43f4009930 tx=0x7f43f4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:07.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:07.902+0000 7f43ee7fc700 1 -- 172.21.15.2:0/697053780 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f43f00542d0 con 0x7f43f81440f0 2023-11-26T07:13:08.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:08.147+0000 7f43ffbad700 1 -- 172.21.15.2:0/697053780 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone11910", "target": ["mon-mgr", ""]}) v1 -- 0x7f43f806dff0 con 0x7f43dc06af60 2023-11-26T07:13:08.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:08.155+0000 7f43ee7fc700 1 -- 172.21.15.2:0/697053780 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+165 (secure 0 0 0) 0x7f43f40095c0 con 0x7f43dc06af60 2023-11-26T07:13:08.158 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-26T07:13:08.158 INFO:teuthology.orchestra.run.smithi002.stdout: "status": { 2023-11-26T07:13:08.158 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "pending", 2023-11-26T07:13:08.158 INFO:teuthology.orchestra.run.smithi002.stdout: "source": { 2023-11-26T07:13:08.158 INFO:teuthology.orchestra.run.smithi002.stdout: "volume": "cephfs", 2023-11-26T07:13:08.158 INFO:teuthology.orchestra.run.smithi002.stdout: "subvolume": "subvol68520", 2023-11-26T07:13:08.158 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot": "subvol_snap50220" 2023-11-26T07:13:08.159 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:13:08.159 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:13:08.159 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-26T07:13:08.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:08.158+0000 7f43ffbad700 1 -- 172.21.15.2:0/697053780 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f43dc06af60 msgr2=0x7f43dc06d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:08.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:08.158+0000 7f43ffbad700 1 --2- 172.21.15.2:0/697053780 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f43dc06af60 0x7f43dc06d420 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f43f4009930 tx=0x7f43f4008040 comp rx=0 tx=0).stop 2023-11-26T07:13:08.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:08.158+0000 7f43ffbad700 1 -- 172.21.15.2:0/697053780 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43f81440f0 msgr2=0x7f43f806afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:08.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:08.158+0000 7f43ffbad700 1 --2- 172.21.15.2:0/697053780 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43f81440f0 0x7f43f806afd0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f43f000cab0 tx=0x7f43f000ce70 comp rx=0 tx=0).stop 2023-11-26T07:13:08.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:08.158+0000 7f43ffbad700 1 -- 172.21.15.2:0/697053780 shutdown_connections 2023-11-26T07:13:08.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:08.158+0000 7f43ffbad700 1 --2- 172.21.15.2:0/697053780 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f43dc06af60 0x7f43dc06d420 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:08.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:08.158+0000 7f43ffbad700 1 --2- 172.21.15.2:0/697053780 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43f81440f0 0x7f43f806afd0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:08.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:08.158+0000 7f43ffbad700 1 --2- 172.21.15.2:0/697053780 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f43f80720f0 0x7f43f814dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:08.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:08.158+0000 7f43ffbad700 1 --2- 172.21.15.2:0/697053780 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43f8143ae0 0x7f43f8142460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:08.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:08.158+0000 7f43ffbad700 1 -- 172.21.15.2:0/697053780 >> 172.21.15.2:0/697053780 conn(0x7f43f80b2740 msgr2=0x7f43f80cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:08.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:08.158+0000 7f43ffbad700 1 -- 172.21.15.2:0/697053780 shutdown_connections 2023-11-26T07:13:08.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:08.158+0000 7f43ffbad700 1 -- 172.21.15.2:0/697053780 wait complete. 2023-11-26T07:13:09.172 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone11910 2023-11-26T07:13:09.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.313+0000 7f0506aa4700 1 Processor -- start 2023-11-26T07:13:09.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.313+0000 7f0506aa4700 1 -- start start 2023-11-26T07:13:09.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.314+0000 7f0506aa4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05000722c0 0x7f05000b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:09.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.314+0000 7f0506aa4700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f05001440f0 0x7f050006e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:09.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.314+0000 7f0506aa4700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0500143ec0 con 0x7f0500143ae0 2023-11-26T07:13:09.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.314+0000 7f0506aa4700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05000b40a0 con 0x7f05001440f0 2023-11-26T07:13:09.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.314+0000 7f0506aa4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05000b3ae0 con 0x7f05000722c0 2023-11-26T07:13:09.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.314+0000 7f0505041700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f05001440f0 0x7f050006e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:09.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.314+0000 7f0504840700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f0500143ae0 0x7f0500071bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60626/0 (socket says 172.21.15.2:60626) 2023-11-26T07:13:09.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.314+0000 7f0504840700 1 -- 172.21.15.2:0/350962380 learned_addr learned my addr 172.21.15.2:0/350962380 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:13:09.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.315+0000 7f04ff7fe700 1 -- 172.21.15.2:0/350962380 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1411271085 0 0) 0x7f0500143ec0 con 0x7f0500143ae0 2023-11-26T07:13:09.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.315+0000 7f04ff7fe700 1 -- 172.21.15.2:0/350962380 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04f00035b0 con 0x7f0500143ae0 2023-11-26T07:13:09.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.315+0000 7f04fffff700 1 --2- 172.21.15.2:0/350962380 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05000722c0 0x7f05000b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:09.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.315+0000 7f0505041700 1 -- 172.21.15.2:0/350962380 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05000722c0 msgr2=0x7f05000b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:09.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.315+0000 7f0505041700 1 --2- 172.21.15.2:0/350962380 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05000722c0 0x7f05000b51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:09.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.315+0000 7f0505041700 1 -- 172.21.15.2:0/350962380 >> v1:172.21.15.2:6789/0 conn(0x7f0500143ae0 legacy=0x7f0500071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:09.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.315+0000 7f0505041700 1 -- 172.21.15.2:0/350962380 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05000b3dc0 con 0x7f05001440f0 2023-11-26T07:13:09.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.315+0000 7f0505041700 1 --2- 172.21.15.2:0/350962380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05001440f0 0x7f050006e510 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f04f8009d90 tx=0x7f04f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dee2ee8f8db01abe server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:09.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.315+0000 7f04ff7fe700 1 -- 172.21.15.2:0/350962380 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f800e070 con 0x7f05001440f0 2023-11-26T07:13:09.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.315+0000 7f04ff7fe700 1 -- 172.21.15.2:0/350962380 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f800bb20 con 0x7f05001440f0 2023-11-26T07:13:09.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.315+0000 7f04ff7fe700 1 -- 172.21.15.2:0/350962380 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f800be90 con 0x7f05001440f0 2023-11-26T07:13:09.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.316+0000 7f0506aa4700 1 -- 172.21.15.2:0/350962380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05001440f0 msgr2=0x7f050006e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:09.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.316+0000 7f0506aa4700 1 --2- 172.21.15.2:0/350962380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05001440f0 0x7f050006e510 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f04f8009d90 tx=0x7f04f800b330 comp rx=0 tx=0).stop 2023-11-26T07:13:09.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.316+0000 7f0506aa4700 1 -- 172.21.15.2:0/350962380 shutdown_connections 2023-11-26T07:13:09.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.316+0000 7f0506aa4700 1 --2- 172.21.15.2:0/350962380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05001440f0 0x7f050006e510 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:09.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.316+0000 7f0506aa4700 1 --2- 172.21.15.2:0/350962380 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05000722c0 0x7f05000b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:09.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.316+0000 7f0506aa4700 1 -- 172.21.15.2:0/350962380 >> 172.21.15.2:0/350962380 conn(0x7f05000b2740 msgr2=0x7f05000b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:09.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.316+0000 7f0506aa4700 1 -- 172.21.15.2:0/350962380 shutdown_connections 2023-11-26T07:13:09.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.316+0000 7f0506aa4700 1 -- 172.21.15.2:0/350962380 wait complete. 2023-11-26T07:13:09.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.317+0000 7f0506aa4700 1 Processor -- start 2023-11-26T07:13:09.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.317+0000 7f0506aa4700 1 -- start start 2023-11-26T07:13:09.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.318+0000 7f0506aa4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05000722c0 0x7f0500155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:09.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.319+0000 7f0506aa4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0500143ae0 0x7f0500155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:09.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.319+0000 7f0506aa4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05001440f0 0x7f0500159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:09.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.319+0000 7f0506aa4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05001f4d20 con 0x7f0500143ae0 2023-11-26T07:13:09.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.319+0000 7f0506aa4700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0500154e70 con 0x7f05000722c0 2023-11-26T07:13:09.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.319+0000 7f0506aa4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05001f4f70 con 0x7f05001440f0 2023-11-26T07:13:09.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.319+0000 7f04fffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0500143ae0 0x7f0500155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:09.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.319+0000 7f04fffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0500143ae0 0x7f0500155a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41192/0 (socket says 172.21.15.2:41192) 2023-11-26T07:13:09.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.319+0000 7f04fffff700 1 -- 172.21.15.2:0/1470175365 learned_addr learned my addr 172.21.15.2:0/1470175365 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:09.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.319+0000 7f0505041700 1 --2- 172.21.15.2:0/1470175365 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05001440f0 0x7f0500159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:09.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.319+0000 7f0504840700 1 --2- 172.21.15.2:0/1470175365 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05000722c0 0x7f0500155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:09.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.319+0000 7f04fffff700 1 -- 172.21.15.2:0/1470175365 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05001440f0 msgr2=0x7f0500159140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:09.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.319+0000 7f04fffff700 1 --2- 172.21.15.2:0/1470175365 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05001440f0 0x7f0500159140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:09.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.319+0000 7f04fffff700 1 -- 172.21.15.2:0/1470175365 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05000722c0 msgr2=0x7f0500155510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:09.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.319+0000 7f04fffff700 1 --2- 172.21.15.2:0/1470175365 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05000722c0 0x7f0500155510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:09.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.319+0000 7f04fffff700 1 -- 172.21.15.2:0/1470175365 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f8009a70 con 0x7f0500143ae0 2023-11-26T07:13:09.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.319+0000 7f04fffff700 1 --2- 172.21.15.2:0/1470175365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0500143ae0 0x7f0500155a50 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f04ec00c7f0 tx=0x7f04ec00cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:09.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.319+0000 7f04fd7fa700 1 -- 172.21.15.2:0/1470175365 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ec004220 con 0x7f0500143ae0 2023-11-26T07:13:09.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.319+0000 7f04fd7fa700 1 -- 172.21.15.2:0/1470175365 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04ec004380 con 0x7f0500143ae0 2023-11-26T07:13:09.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.319+0000 7f04fd7fa700 1 -- 172.21.15.2:0/1470175365 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ec0036a0 con 0x7f0500143ae0 2023-11-26T07:13:09.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.319+0000 7f0506aa4700 1 -- 172.21.15.2:0/1470175365 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05001f5250 con 0x7f0500143ae0 2023-11-26T07:13:09.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.320+0000 7f0506aa4700 1 -- 172.21.15.2:0/1470175365 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05001f5810 con 0x7f0500143ae0 2023-11-26T07:13:09.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.320+0000 7f0506aa4700 1 -- 172.21.15.2:0/1470175365 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0500075480 con 0x7f0500143ae0 2023-11-26T07:13:09.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.321+0000 7f04fd7fa700 1 -- 172.21.15.2:0/1470175365 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f04ec003800 con 0x7f0500143ae0 2023-11-26T07:13:09.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.321+0000 7f04fd7fa700 1 --2- 172.21.15.2:0/1470175365 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f04e406af60 0x7f04e406d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:09.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.321+0000 7f04fd7fa700 1 -- 172.21.15.2:0/1470175365 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f04ec0891b0 con 0x7f0500143ae0 2023-11-26T07:13:09.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.322+0000 7f0504840700 1 --2- 172.21.15.2:0/1470175365 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f04e406af60 0x7f04e406d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:09.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.322+0000 7f0504840700 1 --2- 172.21.15.2:0/1470175365 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f04e406af60 0x7f04e406d420 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f04f4007fd0 tx=0x7f04f4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:09.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.326+0000 7f04fd7fa700 1 -- 172.21.15.2:0/1470175365 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f04ec0541f0 con 0x7f0500143ae0 2023-11-26T07:13:09.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.495+0000 7f04fd7fa700 1 -- 172.21.15.2:0/1470175365 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f04ec0545c0 con 0x7f0500143ae0 2023-11-26T07:13:09.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.575+0000 7f0506aa4700 1 -- 172.21.15.2:0/1470175365 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone11910", "target": ["mon-mgr", ""]}) v1 -- 0x7f0500144860 con 0x7f04e406af60 2023-11-26T07:13:09.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.581+0000 7f04fd7fa700 1 -- 172.21.15.2:0/1470175365 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+165 (secure 0 0 0) 0x7f04f400f690 con 0x7f04e406af60 2023-11-26T07:13:09.583 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-26T07:13:09.583 INFO:teuthology.orchestra.run.smithi002.stdout: "status": { 2023-11-26T07:13:09.584 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "pending", 2023-11-26T07:13:09.584 INFO:teuthology.orchestra.run.smithi002.stdout: "source": { 2023-11-26T07:13:09.584 INFO:teuthology.orchestra.run.smithi002.stdout: "volume": "cephfs", 2023-11-26T07:13:09.584 INFO:teuthology.orchestra.run.smithi002.stdout: "subvolume": "subvol68520", 2023-11-26T07:13:09.584 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot": "subvol_snap50220" 2023-11-26T07:13:09.584 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:13:09.584 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:13:09.584 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-26T07:13:09.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.583+0000 7f0506aa4700 1 -- 172.21.15.2:0/1470175365 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f04e406af60 msgr2=0x7f04e406d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:09.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.583+0000 7f0506aa4700 1 --2- 172.21.15.2:0/1470175365 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f04e406af60 0x7f04e406d420 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f04f4007fd0 tx=0x7f04f4009040 comp rx=0 tx=0).stop 2023-11-26T07:13:09.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.583+0000 7f0506aa4700 1 -- 172.21.15.2:0/1470175365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0500143ae0 msgr2=0x7f0500155a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:09.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.583+0000 7f0506aa4700 1 --2- 172.21.15.2:0/1470175365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0500143ae0 0x7f0500155a50 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f04ec00c7f0 tx=0x7f04ec00cb00 comp rx=0 tx=0).stop 2023-11-26T07:13:09.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.584+0000 7f0506aa4700 1 -- 172.21.15.2:0/1470175365 shutdown_connections 2023-11-26T07:13:09.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.584+0000 7f0506aa4700 1 --2- 172.21.15.2:0/1470175365 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f04e406af60 0x7f04e406d420 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:09.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.584+0000 7f0506aa4700 1 --2- 172.21.15.2:0/1470175365 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05001440f0 0x7f0500159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:09.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.584+0000 7f0506aa4700 1 --2- 172.21.15.2:0/1470175365 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05000722c0 0x7f0500155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:09.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.584+0000 7f0506aa4700 1 --2- 172.21.15.2:0/1470175365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0500143ae0 0x7f0500155a50 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:09.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.584+0000 7f0506aa4700 1 -- 172.21.15.2:0/1470175365 >> 172.21.15.2:0/1470175365 conn(0x7f05000b2740 msgr2=0x7f050015e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:09.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.584+0000 7f0506aa4700 1 -- 172.21.15.2:0/1470175365 shutdown_connections 2023-11-26T07:13:09.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:09.584+0000 7f0506aa4700 1 -- 172.21.15.2:0/1470175365 wait complete. 2023-11-26T07:13:10.598 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone11910 2023-11-26T07:13:10.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.739+0000 7fe05d152700 1 Processor -- start 2023-11-26T07:13:10.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.739+0000 7fe05d152700 1 -- start start 2023-11-26T07:13:10.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.740+0000 7fe05d152700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe05815bde0 0x7fe05815c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:10.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.740+0000 7fe05d152700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0580d0a90 con 0x7fe0580ce5c0 2023-11-26T07:13:10.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.740+0000 7fe05d152700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe05806ee10 con 0x7fe0580cf2b0 2023-11-26T07:13:10.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.740+0000 7fe05d152700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05806f0f0 con 0x7fe05815bde0 2023-11-26T07:13:10.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.740+0000 7fe05759e700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe0580ce5c0 0x7fe05806fbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60644/0 (socket says 172.21.15.2:60644) 2023-11-26T07:13:10.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.740+0000 7fe05759e700 1 -- 172.21.15.2:0/482463921 learned_addr learned my addr 172.21.15.2:0/482463921 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:13:10.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.740+0000 7fe056d9d700 1 --2- 172.21.15.2:0/482463921 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe05815bde0 0x7fe05815c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:10.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.740+0000 7fe055d9b700 1 -- 172.21.15.2:0/482463921 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1488461360 0 0) 0x7fe0580d0a90 con 0x7fe0580ce5c0 2023-11-26T07:13:10.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.740+0000 7fe055d9b700 1 -- 172.21.15.2:0/482463921 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0400035b0 con 0x7fe0580ce5c0 2023-11-26T07:13:10.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.740+0000 7fe055d9b700 1 -- 172.21.15.2:0/482463921 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3507618205 0 0) 0x7fe05806ee10 con 0x7fe0580cf2b0 2023-11-26T07:13:10.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.740+0000 7fe055d9b700 1 -- 172.21.15.2:0/482463921 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0580d0a90 con 0x7fe0580cf2b0 2023-11-26T07:13:10.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.740+0000 7fe055d9b700 1 -- 172.21.15.2:0/482463921 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2537335891 0 0) 0x7fe0400035b0 con 0x7fe0580ce5c0 2023-11-26T07:13:10.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.740+0000 7fe056d9d700 1 -- 172.21.15.2:0/482463921 >> v1:172.21.15.192:6789/0 conn(0x7fe0580cf2b0 legacy=0x7fe0580d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:10.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.740+0000 7fe056d9d700 1 -- 172.21.15.2:0/482463921 >> v1:172.21.15.2:6789/0 conn(0x7fe0580ce5c0 legacy=0x7fe05806fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:10.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.740+0000 7fe056d9d700 1 -- 172.21.15.2:0/482463921 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe05806f3d0 con 0x7fe05815bde0 2023-11-26T07:13:10.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.741+0000 7fe056d9d700 1 --2- 172.21.15.2:0/482463921 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe05815bde0 0x7fe05815c1c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe048009870 tx=0x7fe048009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7d010429a798475 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:10.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.741+0000 7fe055d9b700 1 -- 172.21.15.2:0/482463921 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0500019f0 con 0x7fe05815bde0 2023-11-26T07:13:10.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.741+0000 7fe055d9b700 1 -- 172.21.15.2:0/482463921 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe048004030 con 0x7fe05815bde0 2023-11-26T07:13:10.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.741+0000 7fe055d9b700 1 -- 172.21.15.2:0/482463921 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0480043c0 con 0x7fe05815bde0 2023-11-26T07:13:10.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.741+0000 7fe05d152700 1 -- 172.21.15.2:0/482463921 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe05815bde0 msgr2=0x7fe05815c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:10.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.741+0000 7fe05d152700 1 --2- 172.21.15.2:0/482463921 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe05815bde0 0x7fe05815c1c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe048009870 tx=0x7fe048009b80 comp rx=0 tx=0).stop 2023-11-26T07:13:10.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.741+0000 7fe05d152700 1 -- 172.21.15.2:0/482463921 shutdown_connections 2023-11-26T07:13:10.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.741+0000 7fe05d152700 1 --2- 172.21.15.2:0/482463921 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe05815bde0 0x7fe05815c1c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:10.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.741+0000 7fe05d152700 1 -- 172.21.15.2:0/482463921 >> 172.21.15.2:0/482463921 conn(0x7fe0580b3720 msgr2=0x7fe0580b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:10.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.741+0000 7fe05d152700 1 -- 172.21.15.2:0/482463921 shutdown_connections 2023-11-26T07:13:10.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.742+0000 7fe05d152700 1 -- 172.21.15.2:0/482463921 wait complete. 2023-11-26T07:13:10.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.743+0000 7fe05d152700 1 Processor -- start 2023-11-26T07:13:10.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.744+0000 7fe05d152700 1 -- start start 2023-11-26T07:13:10.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.744+0000 7fe05d152700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0580ce5c0 0x7fe05815a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:10.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.744+0000 7fe05d152700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0580cf2b0 0x7fe05815c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:10.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.744+0000 7fe05d152700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe05815bde0 0x7fe0580c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:10.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.744+0000 7fe05d152700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0580c8ca0 con 0x7fe0580ce5c0 2023-11-26T07:13:10.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.744+0000 7fe05d152700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0580c8ef0 con 0x7fe0580cf2b0 2023-11-26T07:13:10.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.744+0000 7fe05d152700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0580c91d0 con 0x7fe05815bde0 2023-11-26T07:13:10.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.745+0000 7fe056d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0580ce5c0 0x7fe05815a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:10.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.745+0000 7fe056d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0580ce5c0 0x7fe05815a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41204/0 (socket says 172.21.15.2:41204) 2023-11-26T07:13:10.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.745+0000 7fe056d9d700 1 -- 172.21.15.2:0/893866393 learned_addr learned my addr 172.21.15.2:0/893866393 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:10.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.745+0000 7fe05759e700 1 --2- 172.21.15.2:0/893866393 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe05815bde0 0x7fe0580c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:10.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.745+0000 7fe05659c700 1 --2- 172.21.15.2:0/893866393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0580cf2b0 0x7fe05815c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:10.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.745+0000 7fe056d9d700 1 -- 172.21.15.2:0/893866393 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe05815bde0 msgr2=0x7fe0580c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:10.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.745+0000 7fe056d9d700 1 --2- 172.21.15.2:0/893866393 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe05815bde0 0x7fe0580c9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:10.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.745+0000 7fe056d9d700 1 -- 172.21.15.2:0/893866393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0580cf2b0 msgr2=0x7fe05815c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:10.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.745+0000 7fe056d9d700 1 --2- 172.21.15.2:0/893866393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0580cf2b0 0x7fe05815c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:10.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.745+0000 7fe056d9d700 1 -- 172.21.15.2:0/893866393 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0480094a0 con 0x7fe0580ce5c0 2023-11-26T07:13:10.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.745+0000 7fe056d9d700 1 --2- 172.21.15.2:0/893866393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0580ce5c0 0x7fe05815a380 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe048000c00 tx=0x7fe048004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:10.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.745+0000 7fe03f7fe700 1 -- 172.21.15.2:0/893866393 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe048003cd0 con 0x7fe0580ce5c0 2023-11-26T07:13:10.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.745+0000 7fe03f7fe700 1 -- 172.21.15.2:0/893866393 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04801f070 con 0x7fe0580ce5c0 2023-11-26T07:13:10.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.745+0000 7fe05d152700 1 -- 172.21.15.2:0/893866393 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0580c94b0 con 0x7fe0580ce5c0 2023-11-26T07:13:10.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.745+0000 7fe03f7fe700 1 -- 172.21.15.2:0/893866393 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe048011870 con 0x7fe0580ce5c0 2023-11-26T07:13:10.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.745+0000 7fe05d152700 1 -- 172.21.15.2:0/893866393 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe05815a8c0 con 0x7fe0580ce5c0 2023-11-26T07:13:10.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.747+0000 7fe05d152700 1 -- 172.21.15.2:0/893866393 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe05815aa50 con 0x7fe0580ce5c0 2023-11-26T07:13:10.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.747+0000 7fe03f7fe700 1 -- 172.21.15.2:0/893866393 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fe048021030 con 0x7fe0580ce5c0 2023-11-26T07:13:10.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.747+0000 7fe03f7fe700 1 --2- 172.21.15.2:0/893866393 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe04406b080 0x7fe04406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:10.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.747+0000 7fe03f7fe700 1 -- 172.21.15.2:0/893866393 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe04808ab40 con 0x7fe0580ce5c0 2023-11-26T07:13:10.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.747+0000 7fe05659c700 1 --2- 172.21.15.2:0/893866393 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe04406b080 0x7fe04406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:10.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.748+0000 7fe05659c700 1 --2- 172.21.15.2:0/893866393 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe04406b080 0x7fe04406d540 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe0580b08c0 tx=0x7fe04c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:10.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.752+0000 7fe03f7fe700 1 -- 172.21.15.2:0/893866393 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe048055aa0 con 0x7fe0580ce5c0 2023-11-26T07:13:11.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:10.999+0000 7fe05d152700 1 -- 172.21.15.2:0/893866393 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone11910", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0580cea50 con 0x7fe04406b080 2023-11-26T07:13:11.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:11.006+0000 7fe03f7fe700 1 -- 172.21.15.2:0/893866393 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+165 (secure 0 0 0) 0x7fe04c001d50 con 0x7fe04406b080 2023-11-26T07:13:11.008 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-26T07:13:11.009 INFO:teuthology.orchestra.run.smithi002.stdout: "status": { 2023-11-26T07:13:11.009 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "pending", 2023-11-26T07:13:11.009 INFO:teuthology.orchestra.run.smithi002.stdout: "source": { 2023-11-26T07:13:11.009 INFO:teuthology.orchestra.run.smithi002.stdout: "volume": "cephfs", 2023-11-26T07:13:11.009 INFO:teuthology.orchestra.run.smithi002.stdout: "subvolume": "subvol68520", 2023-11-26T07:13:11.009 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot": "subvol_snap50220" 2023-11-26T07:13:11.009 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:13:11.009 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:13:11.009 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-26T07:13:11.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:11.009+0000 7fe05d152700 1 -- 172.21.15.2:0/893866393 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe04406b080 msgr2=0x7fe04406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:11.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:11.009+0000 7fe05d152700 1 --2- 172.21.15.2:0/893866393 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe04406b080 0x7fe04406d540 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe0580b08c0 tx=0x7fe04c009040 comp rx=0 tx=0).stop 2023-11-26T07:13:11.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:11.009+0000 7fe05d152700 1 -- 172.21.15.2:0/893866393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0580ce5c0 msgr2=0x7fe05815a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:11.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:11.009+0000 7fe05d152700 1 --2- 172.21.15.2:0/893866393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0580ce5c0 0x7fe05815a380 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe048000c00 tx=0x7fe048004750 comp rx=0 tx=0).stop 2023-11-26T07:13:11.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:11.009+0000 7fe05d152700 1 -- 172.21.15.2:0/893866393 shutdown_connections 2023-11-26T07:13:11.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:11.009+0000 7fe05d152700 1 --2- 172.21.15.2:0/893866393 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe04406b080 0x7fe04406d540 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:11.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:11.009+0000 7fe05d152700 1 --2- 172.21.15.2:0/893866393 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe05815bde0 0x7fe0580c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:11.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:11.009+0000 7fe05d152700 1 --2- 172.21.15.2:0/893866393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0580ce5c0 0x7fe05815a380 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:11.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:11.009+0000 7fe05d152700 1 --2- 172.21.15.2:0/893866393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0580cf2b0 0x7fe05815c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:11.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:11.009+0000 7fe05d152700 1 -- 172.21.15.2:0/893866393 >> 172.21.15.2:0/893866393 conn(0x7fe0580b3720 msgr2=0x7fe0580b3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:11.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:11.009+0000 7fe05d152700 1 -- 172.21.15.2:0/893866393 shutdown_connections 2023-11-26T07:13:11.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:11.009+0000 7fe05d152700 1 -- 172.21.15.2:0/893866393 wait complete. 2023-11-26T07:13:12.023 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone11910 2023-11-26T07:13:12.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.163+0000 7f006867b700 1 Processor -- start 2023-11-26T07:13:12.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.163+0000 7f006867b700 1 -- start start 2023-11-26T07:13:12.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.164+0000 7f006867b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00600cf820 0x7f0060166c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:12.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.164+0000 7f006867b700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00600d0c70 con 0x7f006015f5e0 2023-11-26T07:13:12.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.164+0000 7f006867b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f006015f9c0 con 0x7f00600b4320 2023-11-26T07:13:12.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.164+0000 7f006867b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00600cd250 con 0x7f00600cf820 2023-11-26T07:13:12.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.164+0000 7f0066417700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f006015f5e0 0x7f00600cfcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60654/0 (socket says 172.21.15.2:60654) 2023-11-26T07:13:12.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.164+0000 7f0066417700 1 -- 172.21.15.2:0/557819744 learned_addr learned my addr 172.21.15.2:0/557819744 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:13:12.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.165+0000 7f0066c18700 1 --2- 172.21.15.2:0/557819744 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00600cf820 0x7f0060166c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:12.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.165+0000 7f0065415700 1 -- 172.21.15.2:0/557819744 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2809300869 0 0) 0x7f00600d0c70 con 0x7f006015f5e0 2023-11-26T07:13:12.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.165+0000 7f0065415700 1 -- 172.21.15.2:0/557819744 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f004c0035b0 con 0x7f006015f5e0 2023-11-26T07:13:12.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.165+0000 7f0065415700 1 -- 172.21.15.2:0/557819744 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2861829976 0 0) 0x7f005c001110 con 0x7f00600b4320 2023-11-26T07:13:12.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.165+0000 7f0065415700 1 -- 172.21.15.2:0/557819744 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00600d0c70 con 0x7f00600b4320 2023-11-26T07:13:12.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.165+0000 7f0065415700 1 -- 172.21.15.2:0/557819744 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2034923736 0 0) 0x7f004c0035b0 con 0x7f006015f5e0 2023-11-26T07:13:12.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.165+0000 7f0066c18700 1 -- 172.21.15.2:0/557819744 >> v1:172.21.15.192:6789/0 conn(0x7f00600b4320 legacy=0x7f00600d03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:12.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.165+0000 7f0066c18700 1 -- 172.21.15.2:0/557819744 >> v1:172.21.15.2:6789/0 conn(0x7f006015f5e0 legacy=0x7f00600cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:12.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.165+0000 7f0066c18700 1 -- 172.21.15.2:0/557819744 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00600c5860 con 0x7f00600cf820 2023-11-26T07:13:12.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.165+0000 7f0066c18700 1 --2- 172.21.15.2:0/557819744 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00600cf820 0x7f0060166c10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0058009dc0 tx=0x7f005800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef0b977f07e38f0c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:12.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.166+0000 7f0065415700 1 -- 172.21.15.2:0/557819744 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005800e070 con 0x7f00600cf820 2023-11-26T07:13:12.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.166+0000 7f0065415700 1 -- 172.21.15.2:0/557819744 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0058003a20 con 0x7f00600cf820 2023-11-26T07:13:12.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.166+0000 7f0065415700 1 -- 172.21.15.2:0/557819744 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0050001670 con 0x7f00600cf820 2023-11-26T07:13:12.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.166+0000 7f006867b700 1 -- 172.21.15.2:0/557819744 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00600cf820 msgr2=0x7f0060166c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:12.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.166+0000 7f006867b700 1 --2- 172.21.15.2:0/557819744 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00600cf820 0x7f0060166c10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0058009dc0 tx=0x7f005800b330 comp rx=0 tx=0).stop 2023-11-26T07:13:12.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.166+0000 7f006867b700 1 -- 172.21.15.2:0/557819744 shutdown_connections 2023-11-26T07:13:12.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.166+0000 7f006867b700 1 --2- 172.21.15.2:0/557819744 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00600cf820 0x7f0060166c10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:12.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.166+0000 7f006867b700 1 -- 172.21.15.2:0/557819744 >> 172.21.15.2:0/557819744 conn(0x7f00600b3800 msgr2=0x7f00600b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:12.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.166+0000 7f006867b700 1 -- 172.21.15.2:0/557819744 shutdown_connections 2023-11-26T07:13:12.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.166+0000 7f006867b700 1 -- 172.21.15.2:0/557819744 wait complete. 2023-11-26T07:13:12.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.167+0000 7f006867b700 1 Processor -- start 2023-11-26T07:13:12.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.167+0000 7f006867b700 1 -- start start 2023-11-26T07:13:12.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.168+0000 7f006867b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00600b4320 0x7f00600cff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:12.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.168+0000 7f006867b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00600cf820 0x7f006014f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:12.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.168+0000 7f006867b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f006015f5e0 0x7f006014f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:12.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.168+0000 7f006867b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f006014faf0 con 0x7f00600cf820 2023-11-26T07:13:12.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.168+0000 7f006867b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00601f4e90 con 0x7f00600b4320 2023-11-26T07:13:12.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.168+0000 7f006867b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00601f5100 con 0x7f006015f5e0 2023-11-26T07:13:12.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.168+0000 7f0065c16700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00600cf820 0x7f006014f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:12.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.168+0000 7f0065c16700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00600cf820 0x7f006014f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41220/0 (socket says 172.21.15.2:41220) 2023-11-26T07:13:12.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.168+0000 7f0065c16700 1 -- 172.21.15.2:0/2555373091 learned_addr learned my addr 172.21.15.2:0/2555373091 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:12.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.169+0000 7f0066417700 1 --2- 172.21.15.2:0/2555373091 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00600b4320 0x7f00600cff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:12.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.169+0000 7f0066c18700 1 --2- 172.21.15.2:0/2555373091 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f006015f5e0 0x7f006014f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:12.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.169+0000 7f0065c16700 1 -- 172.21.15.2:0/2555373091 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f006015f5e0 msgr2=0x7f006014f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:12.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.169+0000 7f0065c16700 1 --2- 172.21.15.2:0/2555373091 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f006015f5e0 0x7f006014f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:12.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.169+0000 7f0065c16700 1 -- 172.21.15.2:0/2555373091 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00600b4320 msgr2=0x7f00600cff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:12.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.169+0000 7f0065c16700 1 --2- 172.21.15.2:0/2555373091 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00600b4320 0x7f00600cff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:12.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.169+0000 7f0065c16700 1 -- 172.21.15.2:0/2555373091 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0058009a70 con 0x7f00600cf820 2023-11-26T07:13:12.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.169+0000 7f0065c16700 1 --2- 172.21.15.2:0/2555373091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00600cf820 0x7f006014f070 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f005c00c760 tx=0x7f005c00cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:12.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.169+0000 7f0056ffd700 1 -- 172.21.15.2:0/2555373091 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c0052d0 con 0x7f00600cf820 2023-11-26T07:13:12.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.169+0000 7f0056ffd700 1 -- 172.21.15.2:0/2555373091 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005c005430 con 0x7f00600cf820 2023-11-26T07:13:12.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.169+0000 7f006867b700 1 -- 172.21.15.2:0/2555373091 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00601f53e0 con 0x7f00600cf820 2023-11-26T07:13:12.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.169+0000 7f0056ffd700 1 -- 172.21.15.2:0/2555373091 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c0038a0 con 0x7f00600cf820 2023-11-26T07:13:12.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.169+0000 7f006867b700 1 -- 172.21.15.2:0/2555373091 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00601f59a0 con 0x7f00600cf820 2023-11-26T07:13:12.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.170+0000 7f006867b700 1 -- 172.21.15.2:0/2555373091 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0060075480 con 0x7f00600cf820 2023-11-26T07:13:12.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.170+0000 7f0056ffd700 1 -- 172.21.15.2:0/2555373091 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f005c003a00 con 0x7f00600cf820 2023-11-26T07:13:12.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.171+0000 7f0056ffd700 1 --2- 172.21.15.2:0/2555373091 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f004406b080 0x7f004406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:12.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.171+0000 7f0056ffd700 1 -- 172.21.15.2:0/2555373091 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f005c088c40 con 0x7f00600cf820 2023-11-26T07:13:12.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.171+0000 7f0066417700 1 --2- 172.21.15.2:0/2555373091 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f004406b080 0x7f004406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:12.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.172+0000 7f0066417700 1 --2- 172.21.15.2:0/2555373091 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f004406b080 0x7f004406d540 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0050000f60 tx=0x7f0050001490 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:12.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.176+0000 7f0056ffd700 1 -- 172.21.15.2:0/2555373091 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f005c053a70 con 0x7f00600cf820 2023-11-26T07:13:12.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.421+0000 7f006867b700 1 -- 172.21.15.2:0/2555373091 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone11910", "target": ["mon-mgr", ""]}) v1 -- 0x7f00600cda60 con 0x7f004406b080 2023-11-26T07:13:12.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.429+0000 7f0056ffd700 1 -- 172.21.15.2:0/2555373091 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+165 (secure 0 0 0) 0x7f0050001b80 con 0x7f004406b080 2023-11-26T07:13:12.431 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-26T07:13:12.432 INFO:teuthology.orchestra.run.smithi002.stdout: "status": { 2023-11-26T07:13:12.432 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "pending", 2023-11-26T07:13:12.432 INFO:teuthology.orchestra.run.smithi002.stdout: "source": { 2023-11-26T07:13:12.432 INFO:teuthology.orchestra.run.smithi002.stdout: "volume": "cephfs", 2023-11-26T07:13:12.432 INFO:teuthology.orchestra.run.smithi002.stdout: "subvolume": "subvol68520", 2023-11-26T07:13:12.433 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot": "subvol_snap50220" 2023-11-26T07:13:12.433 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:13:12.433 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:13:12.433 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-26T07:13:12.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.431+0000 7f006867b700 1 -- 172.21.15.2:0/2555373091 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f004406b080 msgr2=0x7f004406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:12.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.431+0000 7f006867b700 1 --2- 172.21.15.2:0/2555373091 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f004406b080 0x7f004406d540 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0050000f60 tx=0x7f0050001490 comp rx=0 tx=0).stop 2023-11-26T07:13:12.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.431+0000 7f006867b700 1 -- 172.21.15.2:0/2555373091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00600cf820 msgr2=0x7f006014f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:12.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.431+0000 7f006867b700 1 --2- 172.21.15.2:0/2555373091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00600cf820 0x7f006014f070 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f005c00c760 tx=0x7f005c00cb20 comp rx=0 tx=0).stop 2023-11-26T07:13:12.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.432+0000 7f006867b700 1 -- 172.21.15.2:0/2555373091 shutdown_connections 2023-11-26T07:13:12.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.432+0000 7f006867b700 1 --2- 172.21.15.2:0/2555373091 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f004406b080 0x7f004406d540 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:12.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.432+0000 7f006867b700 1 --2- 172.21.15.2:0/2555373091 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f006015f5e0 0x7f006014f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:12.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.432+0000 7f006867b700 1 --2- 172.21.15.2:0/2555373091 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00600b4320 0x7f00600cff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:12.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.432+0000 7f006867b700 1 --2- 172.21.15.2:0/2555373091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00600cf820 0x7f006014f070 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:12.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.432+0000 7f006867b700 1 -- 172.21.15.2:0/2555373091 >> 172.21.15.2:0/2555373091 conn(0x7f00600b3800 msgr2=0x7f00600c7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:12.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.432+0000 7f006867b700 1 -- 172.21.15.2:0/2555373091 shutdown_connections 2023-11-26T07:13:12.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:12.432+0000 7f006867b700 1 -- 172.21.15.2:0/2555373091 wait complete. 2023-11-26T07:13:13.447 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone11910 2023-11-26T07:13:13.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.590+0000 7fd458158700 1 Processor -- start 2023-11-26T07:13:13.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.590+0000 7fd458158700 1 -- start start 2023-11-26T07:13:13.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.591+0000 7fd458158700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd45015bde0 0x7fd45015c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:13.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.591+0000 7fd458158700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4500ce5c0 0x7fd4500cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:13.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.591+0000 7fd458158700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4500d0a90 con 0x7fd4500cf2b0 2023-11-26T07:13:13.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.591+0000 7fd458158700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4500cefb0 con 0x7fd45015bde0 2023-11-26T07:13:13.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.591+0000 7fd458158700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd45006ee10 con 0x7fd4500ce5c0 2023-11-26T07:13:13.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.591+0000 7fd455ef4700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd45015bde0 0x7fd45015c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:13.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.591+0000 7fd4566f5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4500ce5c0 0x7fd4500cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:13.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.591+0000 7fd4556f3700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fd4500cf2b0 0x7fd4500d01b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.2:39806/0 (socket says 172.21.15.2:39806) 2023-11-26T07:13:13.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.591+0000 7fd4556f3700 1 -- 172.21.15.2:0/2618505345 learned_addr learned my addr 172.21.15.2:0/2618505345 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:13:13.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.591+0000 7fd454ef2700 1 -- 172.21.15.2:0/2618505345 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4240550408 0 0) 0x7fd4500d0a90 con 0x7fd4500cf2b0 2023-11-26T07:13:13.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.591+0000 7fd4566f5700 1 -- 172.21.15.2:0/2618505345 >> v2:172.21.15.192:3300/0 conn(0x7fd45015bde0 msgr2=0x7fd45015c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:13.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.591+0000 7fd4566f5700 1 --2- 172.21.15.2:0/2618505345 >> v2:172.21.15.192:3300/0 conn(0x7fd45015bde0 0x7fd45015c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:13.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.591+0000 7fd4566f5700 1 -- 172.21.15.2:0/2618505345 >> v1:172.21.15.192:6789/0 conn(0x7fd4500cf2b0 legacy=0x7fd4500d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:13.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.591+0000 7fd4566f5700 1 -- 172.21.15.2:0/2618505345 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd45006f0f0 con 0x7fd4500ce5c0 2023-11-26T07:13:13.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.592+0000 7fd4566f5700 1 --2- 172.21.15.2:0/2618505345 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4500ce5c0 0x7fd4500cea70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd448009d90 tx=0x7fd44800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8c09735950f7460 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:13.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.592+0000 7fd454ef2700 1 -- 172.21.15.2:0/2618505345 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44800e070 con 0x7fd4500ce5c0 2023-11-26T07:13:13.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.592+0000 7fd454ef2700 1 -- 172.21.15.2:0/2618505345 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44800bb20 con 0x7fd4500ce5c0 2023-11-26T07:13:13.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.592+0000 7fd454ef2700 1 -- 172.21.15.2:0/2618505345 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd448012430 con 0x7fd4500ce5c0 2023-11-26T07:13:13.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.592+0000 7fd458158700 1 -- 172.21.15.2:0/2618505345 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4500ce5c0 msgr2=0x7fd4500cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:13.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.592+0000 7fd458158700 1 --2- 172.21.15.2:0/2618505345 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4500ce5c0 0x7fd4500cea70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd448009d90 tx=0x7fd44800b330 comp rx=0 tx=0).stop 2023-11-26T07:13:13.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.592+0000 7fd458158700 1 -- 172.21.15.2:0/2618505345 shutdown_connections 2023-11-26T07:13:13.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.592+0000 7fd458158700 1 --2- 172.21.15.2:0/2618505345 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4500ce5c0 0x7fd4500cea70 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:13.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.592+0000 7fd458158700 1 --2- 172.21.15.2:0/2618505345 >> v2:172.21.15.192:3300/0 conn(0x7fd45015bde0 0x7fd45015c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:13.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.592+0000 7fd458158700 1 -- 172.21.15.2:0/2618505345 >> 172.21.15.2:0/2618505345 conn(0x7fd4500b3720 msgr2=0x7fd4500b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:13.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.592+0000 7fd458158700 1 -- 172.21.15.2:0/2618505345 shutdown_connections 2023-11-26T07:13:13.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.592+0000 7fd458158700 1 -- 172.21.15.2:0/2618505345 wait complete. 2023-11-26T07:13:13.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.594+0000 7fd458158700 1 Processor -- start 2023-11-26T07:13:13.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.594+0000 7fd458158700 1 -- start start 2023-11-26T07:13:13.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.594+0000 7fd458158700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4500ce5c0 0x7fd450158c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:13.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.594+0000 7fd458158700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4500cf2b0 0x7fd4500c4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:13.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.594+0000 7fd458158700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd45015bde0 0x7fd4500b3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:13.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.594+0000 7fd458158700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4501f4220 con 0x7fd4500ce5c0 2023-11-26T07:13:13.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.594+0000 7fd458158700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4501f35a0 con 0x7fd45015bde0 2023-11-26T07:13:13.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.594+0000 7fd458158700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4501f3880 con 0x7fd4500cf2b0 2023-11-26T07:13:13.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.594+0000 7fd455ef4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4500ce5c0 0x7fd450158c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:13.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.594+0000 7fd455ef4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4500ce5c0 0x7fd450158c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41232/0 (socket says 172.21.15.2:41232) 2023-11-26T07:13:13.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.595+0000 7fd455ef4700 1 -- 172.21.15.2:0/787978314 learned_addr learned my addr 172.21.15.2:0/787978314 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:13.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.595+0000 7fd4556f3700 1 --2- 172.21.15.2:0/787978314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4500cf2b0 0x7fd4500c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:13.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.595+0000 7fd4566f5700 1 --2- 172.21.15.2:0/787978314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd45015bde0 0x7fd4500b3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:13.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.595+0000 7fd455ef4700 1 -- 172.21.15.2:0/787978314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4500cf2b0 msgr2=0x7fd4500c4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:13.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.595+0000 7fd455ef4700 1 --2- 172.21.15.2:0/787978314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4500cf2b0 0x7fd4500c4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:13.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.595+0000 7fd455ef4700 1 -- 172.21.15.2:0/787978314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd45015bde0 msgr2=0x7fd4500b3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:13.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.595+0000 7fd455ef4700 1 --2- 172.21.15.2:0/787978314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd45015bde0 0x7fd4500b3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:13.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.595+0000 7fd455ef4700 1 -- 172.21.15.2:0/787978314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd448009a70 con 0x7fd4500ce5c0 2023-11-26T07:13:13.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.595+0000 7fd455ef4700 1 --2- 172.21.15.2:0/787978314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4500ce5c0 0x7fd450158c90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd44000e870 tx=0x7fd44000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:13.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.595+0000 7fd4467fc700 1 -- 172.21.15.2:0/787978314 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd440009590 con 0x7fd4500ce5c0 2023-11-26T07:13:13.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.595+0000 7fd4467fc700 1 -- 172.21.15.2:0/787978314 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd440013680 con 0x7fd4500ce5c0 2023-11-26T07:13:13.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.595+0000 7fd458158700 1 -- 172.21.15.2:0/787978314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4501f3b60 con 0x7fd4500ce5c0 2023-11-26T07:13:13.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.595+0000 7fd4467fc700 1 -- 172.21.15.2:0/787978314 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4400139f0 con 0x7fd4500ce5c0 2023-11-26T07:13:13.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.595+0000 7fd458158700 1 -- 172.21.15.2:0/787978314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4500b5c50 con 0x7fd4500ce5c0 2023-11-26T07:13:13.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.596+0000 7fd458158700 1 -- 172.21.15.2:0/787978314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd450075480 con 0x7fd4500ce5c0 2023-11-26T07:13:13.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.597+0000 7fd4467fc700 1 -- 172.21.15.2:0/787978314 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fd440013b50 con 0x7fd4500ce5c0 2023-11-26T07:13:13.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.597+0000 7fd4467fc700 1 --2- 172.21.15.2:0/787978314 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd43406b080 0x7fd43406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:13.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.597+0000 7fd4467fc700 1 -- 172.21.15.2:0/787978314 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd4400896c0 con 0x7fd4500ce5c0 2023-11-26T07:13:13.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.597+0000 7fd4556f3700 1 --2- 172.21.15.2:0/787978314 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd43406b080 0x7fd43406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:13.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.598+0000 7fd4556f3700 1 --2- 172.21.15.2:0/787978314 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd43406b080 0x7fd43406d540 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd45006c190 tx=0x7fd44c007de0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:13.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.602+0000 7fd4467fc700 1 -- 172.21.15.2:0/787978314 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd440054580 con 0x7fd4500ce5c0 2023-11-26T07:13:13.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:13.848+0000 7fd458158700 1 -- 172.21.15.2:0/787978314 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone11910", "target": ["mon-mgr", ""]}) v1 -- 0x7fd45006f6b0 con 0x7fd43406b080 2023-11-26T07:13:17.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:17.526+0000 7fd4467fc700 1 -- 172.21.15.2:0/787978314 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+169 (secure 0 0 0) 0x7fd44c004b10 con 0x7fd43406b080 2023-11-26T07:13:17.528 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-26T07:13:17.529 INFO:teuthology.orchestra.run.smithi002.stdout: "status": { 2023-11-26T07:13:17.529 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "in-progress", 2023-11-26T07:13:17.529 INFO:teuthology.orchestra.run.smithi002.stdout: "source": { 2023-11-26T07:13:17.529 INFO:teuthology.orchestra.run.smithi002.stdout: "volume": "cephfs", 2023-11-26T07:13:17.529 INFO:teuthology.orchestra.run.smithi002.stdout: "subvolume": "subvol68520", 2023-11-26T07:13:17.529 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot": "subvol_snap50220" 2023-11-26T07:13:17.529 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:13:17.529 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:13:17.529 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-26T07:13:17.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:17.529+0000 7fd458158700 1 -- 172.21.15.2:0/787978314 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd43406b080 msgr2=0x7fd43406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:17.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:17.529+0000 7fd458158700 1 --2- 172.21.15.2:0/787978314 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd43406b080 0x7fd43406d540 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd45006c190 tx=0x7fd44c007de0 comp rx=0 tx=0).stop 2023-11-26T07:13:17.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:17.529+0000 7fd458158700 1 -- 172.21.15.2:0/787978314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4500ce5c0 msgr2=0x7fd450158c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:17.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:17.529+0000 7fd458158700 1 --2- 172.21.15.2:0/787978314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4500ce5c0 0x7fd450158c90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd44000e870 tx=0x7fd44000eb80 comp rx=0 tx=0).stop 2023-11-26T07:13:17.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:17.529+0000 7fd458158700 1 -- 172.21.15.2:0/787978314 shutdown_connections 2023-11-26T07:13:17.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:17.529+0000 7fd458158700 1 --2- 172.21.15.2:0/787978314 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd43406b080 0x7fd43406d540 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:17.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:17.529+0000 7fd458158700 1 --2- 172.21.15.2:0/787978314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd45015bde0 0x7fd4500b3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:17.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:17.529+0000 7fd458158700 1 --2- 172.21.15.2:0/787978314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4500ce5c0 0x7fd450158c90 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:17.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:17.529+0000 7fd458158700 1 --2- 172.21.15.2:0/787978314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4500cf2b0 0x7fd4500c4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:17.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:17.529+0000 7fd458158700 1 -- 172.21.15.2:0/787978314 >> 172.21.15.2:0/787978314 conn(0x7fd4500b3720 msgr2=0x7fd4500b00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:17.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:17.529+0000 7fd458158700 1 -- 172.21.15.2:0/787978314 shutdown_connections 2023-11-26T07:13:17.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:17.529+0000 7fd458158700 1 -- 172.21.15.2:0/787978314 wait complete. 2023-11-26T07:13:18.548 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone11910 2023-11-26T07:13:18.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.692+0000 7fe379237700 1 Processor -- start 2023-11-26T07:13:18.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.692+0000 7fe379237700 1 -- start start 2023-11-26T07:13:18.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.693+0000 7fe379237700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe374144c10 0x7fe37406afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:18.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.693+0000 7fe379237700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe374145650 0x7fe37406b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:18.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.693+0000 7fe379237700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe37406eb80 con 0x7fe374145100 2023-11-26T07:13:18.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.693+0000 7fe379237700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe37406f500 con 0x7fe374144c10 2023-11-26T07:13:18.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.693+0000 7fe379237700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3740cd610 con 0x7fe374145650 2023-11-26T07:13:18.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.693+0000 7fe372d9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe374144c10 0x7fe37406afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:18.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.693+0000 7fe372d9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe374144c10 0x7fe37406afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41240/0 (socket says 172.21.15.2:41240) 2023-11-26T07:13:18.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.693+0000 7fe372d9d700 1 -- 172.21.15.2:0/3746845961 learned_addr learned my addr 172.21.15.2:0/3746845961 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:18.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.693+0000 7fe37359e700 1 --2- 172.21.15.2:0/3746845961 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe374145650 0x7fe37406b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:18.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.693+0000 7fe372d9d700 1 -- 172.21.15.2:0/3746845961 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe374145650 msgr2=0x7fe37406b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:18.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.693+0000 7fe372d9d700 1 --2- 172.21.15.2:0/3746845961 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe374145650 0x7fe37406b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:18.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.693+0000 7fe372d9d700 1 -- 172.21.15.2:0/3746845961 >> v1:172.21.15.192:6789/0 conn(0x7fe374145100 legacy=0x7fe374071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:18.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.693+0000 7fe372d9d700 1 -- 172.21.15.2:0/3746845961 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe374160720 con 0x7fe374144c10 2023-11-26T07:13:18.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.694+0000 7fe372d9d700 1 --2- 172.21.15.2:0/3746845961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe374144c10 0x7fe37406afd0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe3680098f0 tx=0x7fe368009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34776a2fc5dbfafe server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:18.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.694+0000 7fe371d9b700 1 -- 172.21.15.2:0/3746845961 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe368004230 con 0x7fe374144c10 2023-11-26T07:13:18.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.694+0000 7fe371d9b700 1 -- 172.21.15.2:0/3746845961 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe368004390 con 0x7fe374144c10 2023-11-26T07:13:18.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.694+0000 7fe371d9b700 1 -- 172.21.15.2:0/3746845961 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3680036a0 con 0x7fe374144c10 2023-11-26T07:13:18.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.694+0000 7fe379237700 1 -- 172.21.15.2:0/3746845961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe374144c10 msgr2=0x7fe37406afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:18.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.694+0000 7fe379237700 1 --2- 172.21.15.2:0/3746845961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe374144c10 0x7fe37406afd0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe3680098f0 tx=0x7fe368009c00 comp rx=0 tx=0).stop 2023-11-26T07:13:18.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.694+0000 7fe379237700 1 -- 172.21.15.2:0/3746845961 shutdown_connections 2023-11-26T07:13:18.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.694+0000 7fe379237700 1 --2- 172.21.15.2:0/3746845961 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe374145650 0x7fe37406b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:18.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.694+0000 7fe379237700 1 --2- 172.21.15.2:0/3746845961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe374144c10 0x7fe37406afd0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:18.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.694+0000 7fe379237700 1 -- 172.21.15.2:0/3746845961 >> 172.21.15.2:0/3746845961 conn(0x7fe3740b2740 msgr2=0x7fe3740b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:18.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.694+0000 7fe379237700 1 -- 172.21.15.2:0/3746845961 shutdown_connections 2023-11-26T07:13:18.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.694+0000 7fe379237700 1 -- 172.21.15.2:0/3746845961 wait complete. 2023-11-26T07:13:18.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.696+0000 7fe379237700 1 Processor -- start 2023-11-26T07:13:18.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.696+0000 7fe379237700 1 -- start start 2023-11-26T07:13:18.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.697+0000 7fe379237700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe374144c10 0x7fe3741394f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:18.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.697+0000 7fe379237700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe374145100 0x7fe374142d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:18.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.697+0000 7fe379237700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe374145650 0x7fe3741432b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:18.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.697+0000 7fe379237700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3741438c0 con 0x7fe374145650 2023-11-26T07:13:18.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.697+0000 7fe379237700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe374143ba0 con 0x7fe374145100 2023-11-26T07:13:18.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.697+0000 7fe379237700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe374143e80 con 0x7fe374144c10 2023-11-26T07:13:18.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.697+0000 7fe37359e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe374145650 0x7fe3741432b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:18.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.697+0000 7fe37359e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe374145650 0x7fe3741432b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41250/0 (socket says 172.21.15.2:41250) 2023-11-26T07:13:18.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.697+0000 7fe37359e700 1 -- 172.21.15.2:0/4126483621 learned_addr learned my addr 172.21.15.2:0/4126483621 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:18.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.697+0000 7fe372d9d700 1 --2- 172.21.15.2:0/4126483621 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe374144c10 0x7fe3741394f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:18.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.697+0000 7fe37259c700 1 --2- 172.21.15.2:0/4126483621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe374145100 0x7fe374142d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:18.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.697+0000 7fe37359e700 1 -- 172.21.15.2:0/4126483621 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe374144c10 msgr2=0x7fe3741394f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:18.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.697+0000 7fe37359e700 1 --2- 172.21.15.2:0/4126483621 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe374144c10 0x7fe3741394f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:18.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.697+0000 7fe37359e700 1 -- 172.21.15.2:0/4126483621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe374145100 msgr2=0x7fe374142d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:18.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.697+0000 7fe37359e700 1 --2- 172.21.15.2:0/4126483621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe374145100 0x7fe374142d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:18.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.697+0000 7fe37359e700 1 -- 172.21.15.2:0/4126483621 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe368009550 con 0x7fe374145650 2023-11-26T07:13:18.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.697+0000 7fe37259c700 1 --2- 172.21.15.2:0/4126483621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe374145100 0x7fe374142d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:13:18.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.698+0000 7fe37359e700 1 --2- 172.21.15.2:0/4126483621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe374145650 0x7fe3741432b0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe36c009fd0 tx=0x7fe36c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:18.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.698+0000 7fe35b7fe700 1 -- 172.21.15.2:0/4126483621 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36c00ede0 con 0x7fe374145650 2023-11-26T07:13:18.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.698+0000 7fe35b7fe700 1 -- 172.21.15.2:0/4126483621 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36c014420 con 0x7fe374145650 2023-11-26T07:13:18.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.698+0000 7fe379237700 1 -- 172.21.15.2:0/4126483621 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe374144160 con 0x7fe374145650 2023-11-26T07:13:18.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.698+0000 7fe35b7fe700 1 -- 172.21.15.2:0/4126483621 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36c0147d0 con 0x7fe374145650 2023-11-26T07:13:18.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.698+0000 7fe379237700 1 -- 172.21.15.2:0/4126483621 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe374139a30 con 0x7fe374145650 2023-11-26T07:13:18.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.699+0000 7fe379237700 1 -- 172.21.15.2:0/4126483621 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe374075480 con 0x7fe374145650 2023-11-26T07:13:18.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.699+0000 7fe35b7fe700 1 -- 172.21.15.2:0/4126483621 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fe36c014930 con 0x7fe374145650 2023-11-26T07:13:18.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.700+0000 7fe35b7fe700 1 --2- 172.21.15.2:0/4126483621 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe36006b080 0x7fe36006d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:18.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.700+0000 7fe35b7fe700 1 -- 172.21.15.2:0/4126483621 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5765+0+0 (secure 0 0 0) 0x7fe36c08a0d0 con 0x7fe374145650 2023-11-26T07:13:18.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.700+0000 7fe372d9d700 1 --2- 172.21.15.2:0/4126483621 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe36006b080 0x7fe36006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:18.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.701+0000 7fe372d9d700 1 --2- 172.21.15.2:0/4126483621 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe36006b080 0x7fe36006d540 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe3740d14d0 tx=0x7fe368008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:18.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.704+0000 7fe35b7fe700 1 -- 172.21.15.2:0/4126483621 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe36c054ec0 con 0x7fe374145650 2023-11-26T07:13:18.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:18.957+0000 7fe379237700 1 -- 172.21.15.2:0/4126483621 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone11910", "target": ["mon-mgr", ""]}) v1 -- 0x7fe37406b040 con 0x7fe36006b080 2023-11-26T07:13:22.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.523+0000 7fe35b7fe700 1 -- 172.21.15.2:0/4126483621 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+272 (secure 0 0 0) 0x7fe37406b040 con 0x7fe36006b080 2023-11-26T07:13:22.526 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-26T07:13:22.526 INFO:teuthology.orchestra.run.smithi002.stdout: "status": { 2023-11-26T07:13:22.526 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "failed", 2023-11-26T07:13:22.526 INFO:teuthology.orchestra.run.smithi002.stdout: "source": { 2023-11-26T07:13:22.526 INFO:teuthology.orchestra.run.smithi002.stdout: "volume": "cephfs", 2023-11-26T07:13:22.527 INFO:teuthology.orchestra.run.smithi002.stdout: "subvolume": "subvol68520", 2023-11-26T07:13:22.527 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot": "subvol_snap50220" 2023-11-26T07:13:22.527 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:13:22.527 INFO:teuthology.orchestra.run.smithi002.stdout: "failure": { 2023-11-26T07:13:22.527 INFO:teuthology.orchestra.run.smithi002.stdout: "errno": "2", 2023-11-26T07:13:22.527 INFO:teuthology.orchestra.run.smithi002.stdout: "error_msg": "snapshot 'subvol_snap50220' does not exist" 2023-11-26T07:13:22.527 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:13:22.527 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:13:22.527 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-26T07:13:22.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.527+0000 7fe379237700 1 -- 172.21.15.2:0/4126483621 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe36006b080 msgr2=0x7fe36006d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:22.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.527+0000 7fe379237700 1 --2- 172.21.15.2:0/4126483621 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe36006b080 0x7fe36006d540 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe3740d14d0 tx=0x7fe368008030 comp rx=0 tx=0).stop 2023-11-26T07:13:22.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.527+0000 7fe379237700 1 -- 172.21.15.2:0/4126483621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe374145650 msgr2=0x7fe3741432b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:22.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.527+0000 7fe379237700 1 --2- 172.21.15.2:0/4126483621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe374145650 0x7fe3741432b0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe36c009fd0 tx=0x7fe36c00e3c0 comp rx=0 tx=0).stop 2023-11-26T07:13:22.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.527+0000 7fe379237700 1 -- 172.21.15.2:0/4126483621 shutdown_connections 2023-11-26T07:13:22.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.527+0000 7fe379237700 1 --2- 172.21.15.2:0/4126483621 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe36006b080 0x7fe36006d540 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:22.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.527+0000 7fe379237700 1 --2- 172.21.15.2:0/4126483621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe374145650 0x7fe3741432b0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:22.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.527+0000 7fe379237700 1 --2- 172.21.15.2:0/4126483621 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe374144c10 0x7fe3741394f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:22.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.527+0000 7fe379237700 1 --2- 172.21.15.2:0/4126483621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe374145100 0x7fe374142d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:22.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.527+0000 7fe379237700 1 -- 172.21.15.2:0/4126483621 >> 172.21.15.2:0/4126483621 conn(0x7fe3740b2740 msgr2=0x7fe3740ce060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:22.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.527+0000 7fe379237700 1 -- 172.21.15.2:0/4126483621 shutdown_connections 2023-11-26T07:13:22.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.527+0000 7fe379237700 1 -- 172.21.15.2:0/4126483621 wait complete. 2023-11-26T07:13:22.545 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone11910 2023-11-26T07:13:22.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.677+0000 7f7065546700 1 Processor -- start 2023-11-26T07:13:22.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.677+0000 7f7065546700 1 -- start start 2023-11-26T07:13:22.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.678+0000 7f7065546700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f706015c1b0 0x7f70600b4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:22.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.678+0000 7f7065546700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f706015c590 0x7f70600b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:22.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.678+0000 7f7065546700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f70600b4fd0 0x7f70600b5b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:22.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.678+0000 7f7065546700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70600af440 con 0x7f706015c1b0 2023-11-26T07:13:22.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.678+0000 7f7065546700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70600af6e0 con 0x7f70600b4fd0 2023-11-26T07:13:22.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.678+0000 7f7065546700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70600af9c0 con 0x7f706015c590 2023-11-26T07:13:22.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.678+0000 7f705effd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f706015c1b0 0x7f70600b4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:22.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.678+0000 7f705effd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f706015c1b0 0x7f70600b4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41254/0 (socket says 172.21.15.2:41254) 2023-11-26T07:13:22.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.678+0000 7f705effd700 1 -- 172.21.15.2:0/126441473 learned_addr learned my addr 172.21.15.2:0/126441473 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:22.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.679+0000 7f705f7fe700 1 --2- 172.21.15.2:0/126441473 >> v2:172.21.15.192:3300/0 conn(0x7f70600b4fd0 0x7f70600b5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:22.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.679+0000 7f705e7fc700 1 --2- 172.21.15.2:0/126441473 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f706015c590 0x7f70600b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:22.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.679+0000 7f705effd700 1 -- 172.21.15.2:0/126441473 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f706015c590 msgr2=0x7f70600b55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:22.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.679+0000 7f705effd700 1 --2- 172.21.15.2:0/126441473 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f706015c590 0x7f70600b55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:22.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.679+0000 7f705effd700 1 -- 172.21.15.2:0/126441473 >> v2:172.21.15.192:3300/0 conn(0x7f70600b4fd0 msgr2=0x7f70600b5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:22.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.679+0000 7f705effd700 1 --2- 172.21.15.2:0/126441473 >> v2:172.21.15.192:3300/0 conn(0x7f70600b4fd0 0x7f70600b5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:22.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.679+0000 7f705effd700 1 -- 172.21.15.2:0/126441473 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70600afca0 con 0x7f706015c1b0 2023-11-26T07:13:22.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.679+0000 7f705effd700 1 --2- 172.21.15.2:0/126441473 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f706015c1b0 0x7f70600b4a90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f706006ec70 tx=0x7f7054009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a9cbf32e728c7e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:22.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.679+0000 7f705dffb700 1 -- 172.21.15.2:0/126441473 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705400b870 con 0x7f706015c1b0 2023-11-26T07:13:22.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.679+0000 7f705dffb700 1 -- 172.21.15.2:0/126441473 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705400b9d0 con 0x7f706015c1b0 2023-11-26T07:13:22.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.679+0000 7f705dffb700 1 -- 172.21.15.2:0/126441473 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705400bd60 con 0x7f706015c1b0 2023-11-26T07:13:22.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.680+0000 7f7065546700 1 -- 172.21.15.2:0/126441473 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f706015c1b0 msgr2=0x7f70600b4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:22.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.680+0000 7f7065546700 1 --2- 172.21.15.2:0/126441473 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f706015c1b0 0x7f70600b4a90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f706006ec70 tx=0x7f7054009bd0 comp rx=0 tx=0).stop 2023-11-26T07:13:22.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.680+0000 7f7065546700 1 -- 172.21.15.2:0/126441473 shutdown_connections 2023-11-26T07:13:22.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.680+0000 7f7065546700 1 --2- 172.21.15.2:0/126441473 >> v2:172.21.15.192:3300/0 conn(0x7f70600b4fd0 0x7f70600b5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:22.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.680+0000 7f7065546700 1 --2- 172.21.15.2:0/126441473 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f706015c1b0 0x7f70600b4a90 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:22.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.680+0000 7f7065546700 1 --2- 172.21.15.2:0/126441473 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f706015c590 0x7f70600b55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:22.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.680+0000 7f7065546700 1 -- 172.21.15.2:0/126441473 >> 172.21.15.2:0/126441473 conn(0x7f706009a9f0 msgr2=0x7f706009ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.680+0000 7f7065546700 1 -- 172.21.15.2:0/126441473 shutdown_connections 2023-11-26T07:13:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.680+0000 7f7065546700 1 -- 172.21.15.2:0/126441473 wait complete. 2023-11-26T07:13:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.681+0000 7f7065546700 1 Processor -- start 2023-11-26T07:13:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.681+0000 7f7065546700 1 -- start start 2023-11-26T07:13:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.682+0000 7f7065546700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70600b4fd0 0x7f7060150210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.682+0000 7f7065546700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f706015c1b0 0x7f70600ce310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.682+0000 7f7065546700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f706015c590 0x7f70601582d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.682+0000 7f7065546700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7060150b60 con 0x7f70600b4fd0 2023-11-26T07:13:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.682+0000 7f7065546700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70600ced60 con 0x7f706015c1b0 2023-11-26T07:13:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.682+0000 7f7065546700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70600cf040 con 0x7f706015c590 2023-11-26T07:13:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.682+0000 7f705effd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70600b4fd0 0x7f7060150210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:22.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.682+0000 7f705effd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70600b4fd0 0x7f7060150210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41260/0 (socket says 172.21.15.2:41260) 2023-11-26T07:13:22.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.682+0000 7f705effd700 1 -- 172.21.15.2:0/835213035 learned_addr learned my addr 172.21.15.2:0/835213035 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:22.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.682+0000 7f705effd700 1 -- 172.21.15.2:0/835213035 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f706015c590 msgr2=0x7f70601582d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:22.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.682+0000 7f705effd700 1 --2- 172.21.15.2:0/835213035 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f706015c590 0x7f70601582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:22.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.682+0000 7f705effd700 1 -- 172.21.15.2:0/835213035 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f706015c1b0 msgr2=0x7f70600ce310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:22.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.682+0000 7f705effd700 1 --2- 172.21.15.2:0/835213035 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f706015c1b0 0x7f70600ce310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:22.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.682+0000 7f705effd700 1 -- 172.21.15.2:0/835213035 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7054009550 con 0x7f70600b4fd0 2023-11-26T07:13:22.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.682+0000 7f705effd700 1 --2- 172.21.15.2:0/835213035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70600b4fd0 0x7f7060150210 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f7054000c00 tx=0x7f7054004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:22.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.683+0000 7f70477fe700 1 -- 172.21.15.2:0/835213035 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7054004540 con 0x7f70600b4fd0 2023-11-26T07:13:22.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.683+0000 7f70477fe700 1 -- 172.21.15.2:0/835213035 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70540036a0 con 0x7f70600b4fd0 2023-11-26T07:13:22.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.683+0000 7f7065546700 1 -- 172.21.15.2:0/835213035 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70600b2940 con 0x7f70600b4fd0 2023-11-26T07:13:22.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.683+0000 7f70477fe700 1 -- 172.21.15.2:0/835213035 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7054003a50 con 0x7f70600b4fd0 2023-11-26T07:13:22.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.683+0000 7f7065546700 1 -- 172.21.15.2:0/835213035 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70600cf600 con 0x7f70600b4fd0 2023-11-26T07:13:22.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.684+0000 7f7065546700 1 -- 172.21.15.2:0/835213035 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70600b3590 con 0x7f70600b4fd0 2023-11-26T07:13:22.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.684+0000 7f70477fe700 1 -- 172.21.15.2:0/835213035 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f7054021070 con 0x7f70600b4fd0 2023-11-26T07:13:22.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.685+0000 7f70477fe700 1 --2- 172.21.15.2:0/835213035 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f704c06b080 0x7f704c06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:22.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.685+0000 7f70477fe700 1 -- 172.21.15.2:0/835213035 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f705408b100 con 0x7f70600b4fd0 2023-11-26T07:13:22.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.685+0000 7f705e7fc700 1 --2- 172.21.15.2:0/835213035 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f704c06b080 0x7f704c06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:22.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.686+0000 7f705e7fc700 1 --2- 172.21.15.2:0/835213035 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f704c06b080 0x7f704c06d540 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f706009fba0 tx=0x7f7050008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:22.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.689+0000 7f70477fe700 1 -- 172.21.15.2:0/835213035 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f70540560a0 con 0x7f70600b4fd0 2023-11-26T07:13:22.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.935+0000 7f7065546700 1 -- 172.21.15.2:0/835213035 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone11910", "target": ["mon-mgr", ""]}) v1 -- 0x7f70600b27c0 con 0x7f704c06b080 2023-11-26T07:13:22.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.942+0000 7f70477fe700 1 -- 172.21.15.2:0/835213035 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+272 (secure 0 0 0) 0x7f70500094c0 con 0x7f704c06b080 2023-11-26T07:13:22.944 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-26T07:13:22.944 INFO:teuthology.orchestra.run.smithi002.stdout: "status": { 2023-11-26T07:13:22.945 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "failed", 2023-11-26T07:13:22.945 INFO:teuthology.orchestra.run.smithi002.stdout: "source": { 2023-11-26T07:13:22.945 INFO:teuthology.orchestra.run.smithi002.stdout: "volume": "cephfs", 2023-11-26T07:13:22.945 INFO:teuthology.orchestra.run.smithi002.stdout: "subvolume": "subvol68520", 2023-11-26T07:13:22.945 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot": "subvol_snap50220" 2023-11-26T07:13:22.945 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:13:22.945 INFO:teuthology.orchestra.run.smithi002.stdout: "failure": { 2023-11-26T07:13:22.945 INFO:teuthology.orchestra.run.smithi002.stdout: "errno": "2", 2023-11-26T07:13:22.945 INFO:teuthology.orchestra.run.smithi002.stdout: "error_msg": "snapshot 'subvol_snap50220' does not exist" 2023-11-26T07:13:22.945 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:13:22.945 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:13:22.945 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-26T07:13:22.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.945+0000 7f7065546700 1 -- 172.21.15.2:0/835213035 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f704c06b080 msgr2=0x7f704c06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:22.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.945+0000 7f7065546700 1 --2- 172.21.15.2:0/835213035 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f704c06b080 0x7f704c06d540 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f706009fba0 tx=0x7f7050008040 comp rx=0 tx=0).stop 2023-11-26T07:13:22.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.945+0000 7f7065546700 1 -- 172.21.15.2:0/835213035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70600b4fd0 msgr2=0x7f7060150210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:22.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.945+0000 7f7065546700 1 --2- 172.21.15.2:0/835213035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70600b4fd0 0x7f7060150210 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f7054000c00 tx=0x7f7054004750 comp rx=0 tx=0).stop 2023-11-26T07:13:22.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.945+0000 7f7065546700 1 -- 172.21.15.2:0/835213035 shutdown_connections 2023-11-26T07:13:22.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.945+0000 7f7065546700 1 --2- 172.21.15.2:0/835213035 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f704c06b080 0x7f704c06d540 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:22.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.945+0000 7f7065546700 1 --2- 172.21.15.2:0/835213035 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f706015c590 0x7f70601582d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:22.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.945+0000 7f7065546700 1 --2- 172.21.15.2:0/835213035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70600b4fd0 0x7f7060150210 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:22.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.945+0000 7f7065546700 1 --2- 172.21.15.2:0/835213035 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f706015c1b0 0x7f70600ce310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:22.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.945+0000 7f7065546700 1 -- 172.21.15.2:0/835213035 >> 172.21.15.2:0/835213035 conn(0x7f706009a9f0 msgr2=0x7f706015b360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:22.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.945+0000 7f7065546700 1 -- 172.21.15.2:0/835213035 shutdown_connections 2023-11-26T07:13:22.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:22.945+0000 7f7065546700 1 -- 172.21.15.2:0/835213035 wait complete. 2023-11-26T07:13:22.959 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol_clone11910 --force 2023-11-26T07:13:23.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.086+0000 7fb00ff71700 1 Processor -- start 2023-11-26T07:13:23.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.086+0000 7fb00ff71700 1 -- start start 2023-11-26T07:13:23.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.087+0000 7fb00ff71700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb00806afd0 0x7fb0080b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:23.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.087+0000 7fb00ff71700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb00806b3b0 0x7fb00815e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:23.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.087+0000 7fb00ff71700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb008071ec0 con 0x7fb008072350 2023-11-26T07:13:23.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.087+0000 7fb00ff71700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb008071b90 con 0x7fb00806afd0 2023-11-26T07:13:23.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.087+0000 7fb00ff71700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb00815ed30 con 0x7fb00806b3b0 2023-11-26T07:13:23.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.087+0000 7fb00dd0d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb00806afd0 0x7fb0080b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:23.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.087+0000 7fb00dd0d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb00806afd0 0x7fb0080b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41268/0 (socket says 172.21.15.2:41268) 2023-11-26T07:13:23.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.087+0000 7fb00dd0d700 1 -- 172.21.15.2:0/3757915823 learned_addr learned my addr 172.21.15.2:0/3757915823 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:23.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.087+0000 7fb00d50c700 1 --2- 172.21.15.2:0/3757915823 >> v2:172.21.15.192:3300/0 conn(0x7fb00806b3b0 0x7fb00815e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:23.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.087+0000 7fb00dd0d700 1 -- 172.21.15.2:0/3757915823 >> v2:172.21.15.192:3300/0 conn(0x7fb00806b3b0 msgr2=0x7fb00815e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:23.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.087+0000 7fb00dd0d700 1 --2- 172.21.15.2:0/3757915823 >> v2:172.21.15.192:3300/0 conn(0x7fb00806b3b0 0x7fb00815e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:23.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.087+0000 7fb00dd0d700 1 -- 172.21.15.2:0/3757915823 >> v1:172.21.15.192:6789/0 conn(0x7fb008072350 legacy=0x7fb00806dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:23.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.087+0000 7fb00dd0d700 1 -- 172.21.15.2:0/3757915823 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb00815f010 con 0x7fb00806afd0 2023-11-26T07:13:23.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.087+0000 7fb00d50c700 1 --2- 172.21.15.2:0/3757915823 >> v2:172.21.15.192:3300/0 conn(0x7fb00806b3b0 0x7fb00815e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:13:23.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.087+0000 7fb00dd0d700 1 --2- 172.21.15.2:0/3757915823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb00806afd0 0x7fb0080b59d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb008071520 tx=0x7fb004009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=660db92b85ba7a00 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:23.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.087+0000 7fb00cd0b700 1 -- 172.21.15.2:0/3757915823 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb004004230 con 0x7fb00806afd0 2023-11-26T07:13:23.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.087+0000 7fb00cd0b700 1 -- 172.21.15.2:0/3757915823 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb004004390 con 0x7fb00806afd0 2023-11-26T07:13:23.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.087+0000 7fb00cd0b700 1 -- 172.21.15.2:0/3757915823 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0040036a0 con 0x7fb00806afd0 2023-11-26T07:13:23.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.088+0000 7fb00ff71700 1 -- 172.21.15.2:0/3757915823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb00806afd0 msgr2=0x7fb0080b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:23.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.088+0000 7fb00ff71700 1 --2- 172.21.15.2:0/3757915823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb00806afd0 0x7fb0080b59d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb008071520 tx=0x7fb004009bd0 comp rx=0 tx=0).stop 2023-11-26T07:13:23.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.088+0000 7fb00ff71700 1 -- 172.21.15.2:0/3757915823 shutdown_connections 2023-11-26T07:13:23.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.088+0000 7fb00ff71700 1 --2- 172.21.15.2:0/3757915823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb00806afd0 0x7fb0080b59d0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:23.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.088+0000 7fb00ff71700 1 --2- 172.21.15.2:0/3757915823 >> v2:172.21.15.192:3300/0 conn(0x7fb00806b3b0 0x7fb00815e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:23.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.088+0000 7fb00ff71700 1 -- 172.21.15.2:0/3757915823 >> 172.21.15.2:0/3757915823 conn(0x7fb0080b2760 msgr2=0x7fb0080b2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:23.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.088+0000 7fb00ff71700 1 -- 172.21.15.2:0/3757915823 shutdown_connections 2023-11-26T07:13:23.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.088+0000 7fb00ff71700 1 -- 172.21.15.2:0/3757915823 wait complete. 2023-11-26T07:13:23.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.089+0000 7fb00ff71700 1 Processor -- start 2023-11-26T07:13:23.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.089+0000 7fb00ff71700 1 -- start start 2023-11-26T07:13:23.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.090+0000 7fb00ff71700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb00806afd0 0x7fb00815d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:23.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.090+0000 7fb00ff71700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb00806b3b0 0x7fb0080af350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:23.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.090+0000 7fb00ff71700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb008072350 0x7fb0080ad860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:23.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.090+0000 7fb00ff71700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0080af890 con 0x7fb008072350 2023-11-26T07:13:23.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.090+0000 7fb00ff71700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0080aeec0 con 0x7fb00806b3b0 2023-11-26T07:13:23.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.090+0000 7fb00ff71700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0080ae2b0 con 0x7fb00806afd0 2023-11-26T07:13:23.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.090+0000 7fb00e50e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb008072350 0x7fb0080ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:23.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.090+0000 7fb00e50e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb008072350 0x7fb0080ad860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41278/0 (socket says 172.21.15.2:41278) 2023-11-26T07:13:23.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.090+0000 7fb00e50e700 1 -- 172.21.15.2:0/2523048222 learned_addr learned my addr 172.21.15.2:0/2523048222 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:23.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.090+0000 7fb00d50c700 1 --2- 172.21.15.2:0/2523048222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb00806b3b0 0x7fb0080af350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:23.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.090+0000 7fb00dd0d700 1 --2- 172.21.15.2:0/2523048222 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb00806afd0 0x7fb00815d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:23.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.090+0000 7fb00e50e700 1 -- 172.21.15.2:0/2523048222 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb00806afd0 msgr2=0x7fb00815d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:23.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.090+0000 7fb00e50e700 1 --2- 172.21.15.2:0/2523048222 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb00806afd0 0x7fb00815d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:23.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.090+0000 7fb00e50e700 1 -- 172.21.15.2:0/2523048222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb00806b3b0 msgr2=0x7fb0080af350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:23.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.090+0000 7fb00e50e700 1 --2- 172.21.15.2:0/2523048222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb00806b3b0 0x7fb0080af350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:23.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.090+0000 7fb00e50e700 1 -- 172.21.15.2:0/2523048222 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb004009550 con 0x7fb008072350 2023-11-26T07:13:23.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.090+0000 7fb00d50c700 1 --2- 172.21.15.2:0/2523048222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb00806b3b0 0x7fb0080af350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:13:23.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.091+0000 7fb00e50e700 1 --2- 172.21.15.2:0/2523048222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb008072350 0x7fb0080ad860 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb00000b9a0 tx=0x7fb00000bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:23.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.091+0000 7faffa7fc700 1 -- 172.21.15.2:0/2523048222 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00000c9b0 con 0x7fb008072350 2023-11-26T07:13:23.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.091+0000 7faffa7fc700 1 -- 172.21.15.2:0/2523048222 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00000cb10 con 0x7fb008072350 2023-11-26T07:13:23.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.091+0000 7fb00ff71700 1 -- 172.21.15.2:0/2523048222 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0080ae590 con 0x7fb008072350 2023-11-26T07:13:23.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.091+0000 7faffa7fc700 1 -- 172.21.15.2:0/2523048222 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb000014440 con 0x7fb008072350 2023-11-26T07:13:23.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.091+0000 7fb00ff71700 1 -- 172.21.15.2:0/2523048222 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0080aeb50 con 0x7fb008072350 2023-11-26T07:13:23.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.092+0000 7fb00ff71700 1 -- 172.21.15.2:0/2523048222 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb008068670 con 0x7fb008072350 2023-11-26T07:13:23.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.092+0000 7faffa7fc700 1 -- 172.21.15.2:0/2523048222 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fb00001d3b0 con 0x7fb008072350 2023-11-26T07:13:23.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.093+0000 7faffa7fc700 1 --2- 172.21.15.2:0/2523048222 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fafec06b080 0x7fafec06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:23.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.093+0000 7faffa7fc700 1 -- 172.21.15.2:0/2523048222 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5765+0+0 (secure 0 0 0) 0x7fb000089560 con 0x7fb008072350 2023-11-26T07:13:23.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.093+0000 7fb00dd0d700 1 --2- 172.21.15.2:0/2523048222 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fafec06b080 0x7fafec06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:23.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.094+0000 7fb00dd0d700 1 --2- 172.21.15.2:0/2523048222 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fafec06b080 0x7fafec06d540 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb004009130 tx=0x7fb004008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:23.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.097+0000 7faffa7fc700 1 -- 172.21.15.2:0/2523048222 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb000054360 con 0x7fb008072350 2023-11-26T07:13:23.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.329+0000 7fb00ff71700 1 -- 172.21.15.2:0/2523048222 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol_clone11910", "force": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fb00815e9b0 con 0x7fafec06b080 2023-11-26T07:13:23.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.345+0000 7faffa7fc700 1 -- 172.21.15.2:0/2523048222 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fb0040041b0 con 0x7fafec06b080 2023-11-26T07:13:23.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.347+0000 7fb00ff71700 1 -- 172.21.15.2:0/2523048222 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fafec06b080 msgr2=0x7fafec06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:23.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.347+0000 7fb00ff71700 1 --2- 172.21.15.2:0/2523048222 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fafec06b080 0x7fafec06d540 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb004009130 tx=0x7fb004008030 comp rx=0 tx=0).stop 2023-11-26T07:13:23.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.347+0000 7fb00ff71700 1 -- 172.21.15.2:0/2523048222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb008072350 msgr2=0x7fb0080ad860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:23.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.347+0000 7fb00ff71700 1 --2- 172.21.15.2:0/2523048222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb008072350 0x7fb0080ad860 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb00000b9a0 tx=0x7fb00000bd60 comp rx=0 tx=0).stop 2023-11-26T07:13:23.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.347+0000 7fb00ff71700 1 -- 172.21.15.2:0/2523048222 shutdown_connections 2023-11-26T07:13:23.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.347+0000 7fb00ff71700 1 --2- 172.21.15.2:0/2523048222 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fafec06b080 0x7fafec06d540 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:23.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.347+0000 7fb00ff71700 1 --2- 172.21.15.2:0/2523048222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb008072350 0x7fb0080ad860 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:23.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.347+0000 7fb00ff71700 1 --2- 172.21.15.2:0/2523048222 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb00806afd0 0x7fb00815d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:23.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.347+0000 7fb00ff71700 1 --2- 172.21.15.2:0/2523048222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb00806b3b0 0x7fb0080af350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:23.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.347+0000 7fb00ff71700 1 -- 172.21.15.2:0/2523048222 >> 172.21.15.2:0/2523048222 conn(0x7fb0080b2760 msgr2=0x7fb0080b3850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:23.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.347+0000 7fb00ff71700 1 -- 172.21.15.2:0/2523048222 shutdown_connections 2023-11-26T07:13:23.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.347+0000 7fb00ff71700 1 -- 172.21.15.2:0/2523048222 wait complete. 2023-11-26T07:13:23.351 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:13:23.349+0000 7f8da9aad700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:13:23.351 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:13:23.349+0000 7f8da9aad700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:13:23.351 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:13:23.349+0000 7f8da9aad700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:13:23.351 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:13:23.349+0000 7f8da9aad700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:13:23.351 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:13:23.349+0000 7f8da9aad700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:13:23.361 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol68520 2023-11-26T07:13:23.365 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:13:23.363+0000 7f8da82aa700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:13:23.365 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:13:23.363+0000 7f8da82aa700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:13:23.365 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:13:23.363+0000 7f8da82aa700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:13:23.365 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:13:23.363+0000 7f8da82aa700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:13:23.365 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:13:23.363+0000 7f8da82aa700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:13:23.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.489+0000 7f5165898700 1 Processor -- start 2023-11-26T07:13:23.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.489+0000 7f5165898700 1 -- start start 2023-11-26T07:13:23.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.490+0000 7f5165898700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f51600d0870 0x7f51600d26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:23.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.490+0000 7f5165898700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51600d4e20 con 0x7f51600d0c50 2023-11-26T07:13:23.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.490+0000 7f5165898700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51600b5370 con 0x7f51600d49f0 2023-11-26T07:13:23.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.490+0000 7f5165898700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51600d2f80 con 0x7f51600d0870 2023-11-26T07:13:23.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.490+0000 7f515effd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f51600d0870 0x7f51600d26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:23.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.490+0000 7f515e7fc700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f51600d0c50 0x7f51600cf860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60724/0 (socket says 172.21.15.2:60724) 2023-11-26T07:13:23.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.490+0000 7f515e7fc700 1 -- 172.21.15.2:0/1966668803 learned_addr learned my addr 172.21.15.2:0/1966668803 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:13:23.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.490+0000 7f515effd700 1 -- 172.21.15.2:0/1966668803 >> v1:172.21.15.192:6789/0 conn(0x7f51600d49f0 legacy=0x7f51600b6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:23.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.490+0000 7f515effd700 1 -- 172.21.15.2:0/1966668803 >> v1:172.21.15.2:6789/0 conn(0x7f51600d0c50 legacy=0x7f51600cf860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:23.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.490+0000 7f515effd700 1 -- 172.21.15.2:0/1966668803 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51600ceae0 con 0x7f51600d0870 2023-11-26T07:13:23.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.490+0000 7f515dffb700 1 -- 172.21.15.2:0/1966668803 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1346477400 0 0) 0x7f51600d4e20 con 0x7f51600d0c50 2023-11-26T07:13:23.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.490+0000 7f515effd700 1 --2- 172.21.15.2:0/1966668803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51600d0870 0x7f51600d26c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f5154009840 tx=0x7f5154009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22dc6c9bdf4b9e81 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:23.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.491+0000 7f515dffb700 1 -- 172.21.15.2:0/1966668803 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5154011830 con 0x7f51600d0870 2023-11-26T07:13:23.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.491+0000 7f515dffb700 1 -- 172.21.15.2:0/1966668803 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5154011990 con 0x7f51600d0870 2023-11-26T07:13:23.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.491+0000 7f515dffb700 1 -- 172.21.15.2:0/1966668803 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5154011d20 con 0x7f51600d0870 2023-11-26T07:13:23.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.491+0000 7f5165898700 1 -- 172.21.15.2:0/1966668803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51600d0870 msgr2=0x7f51600d26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:23.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.491+0000 7f5165898700 1 --2- 172.21.15.2:0/1966668803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51600d0870 0x7f51600d26c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f5154009840 tx=0x7f5154009b50 comp rx=0 tx=0).stop 2023-11-26T07:13:23.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.491+0000 7f5165898700 1 -- 172.21.15.2:0/1966668803 shutdown_connections 2023-11-26T07:13:23.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.491+0000 7f5165898700 1 --2- 172.21.15.2:0/1966668803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51600d0870 0x7f51600d26c0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:23.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.491+0000 7f5165898700 1 -- 172.21.15.2:0/1966668803 >> 172.21.15.2:0/1966668803 conn(0x7f51600d3ed0 msgr2=0x7f51600d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:23.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.491+0000 7f5165898700 1 -- 172.21.15.2:0/1966668803 shutdown_connections 2023-11-26T07:13:23.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.491+0000 7f5165898700 1 -- 172.21.15.2:0/1966668803 wait complete. 2023-11-26T07:13:23.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.492+0000 7f5165898700 1 Processor -- start 2023-11-26T07:13:23.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.493+0000 7f5165898700 1 -- start start 2023-11-26T07:13:23.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.493+0000 7f5165898700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51600d0870 0x7f5160144ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:23.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.493+0000 7f5165898700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51600d0c50 0x7f51600c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:23.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.493+0000 7f5165898700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51600d49f0 0x7f51600ca200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:23.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.493+0000 7f5165898700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51600cff70 con 0x7f51600d49f0 2023-11-26T07:13:23.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.493+0000 7f5165898700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5160154310 con 0x7f51600d0870 2023-11-26T07:13:23.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.493+0000 7f5165898700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51601545f0 con 0x7f51600d0c50 2023-11-26T07:13:23.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.493+0000 7f515f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51600d49f0 0x7f51600ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:23.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.494+0000 7f515f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51600d49f0 0x7f51600ca200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41290/0 (socket says 172.21.15.2:41290) 2023-11-26T07:13:23.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.494+0000 7f515f7fe700 1 -- 172.21.15.2:0/3739386296 learned_addr learned my addr 172.21.15.2:0/3739386296 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:23.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.494+0000 7f515effd700 1 --2- 172.21.15.2:0/3739386296 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51600d0870 0x7f5160144ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:23.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.494+0000 7f515e7fc700 1 --2- 172.21.15.2:0/3739386296 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51600d0c50 0x7f51600c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:23.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.494+0000 7f515f7fe700 1 -- 172.21.15.2:0/3739386296 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51600d0c50 msgr2=0x7f51600c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:23.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.494+0000 7f515f7fe700 1 --2- 172.21.15.2:0/3739386296 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51600d0c50 0x7f51600c7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:23.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.494+0000 7f515f7fe700 1 -- 172.21.15.2:0/3739386296 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51600d0870 msgr2=0x7f5160144ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:23.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.494+0000 7f515f7fe700 1 --2- 172.21.15.2:0/3739386296 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51600d0870 0x7f5160144ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:23.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.494+0000 7f515f7fe700 1 -- 172.21.15.2:0/3739386296 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51540094a0 con 0x7f51600d49f0 2023-11-26T07:13:23.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.494+0000 7f515f7fe700 1 --2- 172.21.15.2:0/3739386296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51600d49f0 0x7f51600ca200 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f515800cb50 tx=0x7f515800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:23.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.494+0000 7f5147fff700 1 -- 172.21.15.2:0/3739386296 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5158003c00 con 0x7f51600d49f0 2023-11-26T07:13:23.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.494+0000 7f5147fff700 1 -- 172.21.15.2:0/3739386296 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5158003d60 con 0x7f51600d49f0 2023-11-26T07:13:23.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.494+0000 7f5165898700 1 -- 172.21.15.2:0/3739386296 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51601548d0 con 0x7f51600d49f0 2023-11-26T07:13:23.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.494+0000 7f5147fff700 1 -- 172.21.15.2:0/3739386296 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515800aa20 con 0x7f51600d49f0 2023-11-26T07:13:23.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.494+0000 7f5165898700 1 -- 172.21.15.2:0/3739386296 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5160145420 con 0x7f51600d49f0 2023-11-26T07:13:23.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.495+0000 7f5165898700 1 -- 172.21.15.2:0/3739386296 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5160154f20 con 0x7f51600d49f0 2023-11-26T07:13:23.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.496+0000 7f5147fff700 1 -- 172.21.15.2:0/3739386296 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f515800ab80 con 0x7f51600d49f0 2023-11-26T07:13:23.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.496+0000 7f5147fff700 1 --2- 172.21.15.2:0/3739386296 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f514c06b080 0x7f514c06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:23.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.496+0000 7f5147fff700 1 -- 172.21.15.2:0/3739386296 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f5158089930 con 0x7f51600d49f0 2023-11-26T07:13:23.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.496+0000 7f515effd700 1 --2- 172.21.15.2:0/3739386296 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f514c06b080 0x7f514c06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:23.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.497+0000 7f515effd700 1 --2- 172.21.15.2:0/3739386296 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f514c06b080 0x7f514c06d540 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f51540090b0 tx=0x7f5154008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:23.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.501+0000 7f5147fff700 1 -- 172.21.15.2:0/3739386296 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5158054720 con 0x7f51600d49f0 2023-11-26T07:13:23.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:23.738+0000 7f5165898700 1 -- 172.21.15.2:0/3739386296 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol68520", "target": ["mon-mgr", ""]}) v1 -- 0x7f51600cf060 con 0x7f514c06b080 2023-11-26T07:13:25.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:25.539+0000 7f5147fff700 1 -- 172.21.15.2:0/3739386296 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f515808bd50 con 0x7f51600d49f0 2023-11-26T07:13:27.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:27.526+0000 7f5147fff700 1 -- 172.21.15.2:0/3739386296 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f5154011d10 con 0x7f514c06b080 2023-11-26T07:13:27.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:27.529+0000 7f5165898700 1 -- 172.21.15.2:0/3739386296 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f514c06b080 msgr2=0x7f514c06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:27.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:27.529+0000 7f5165898700 1 --2- 172.21.15.2:0/3739386296 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f514c06b080 0x7f514c06d540 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f51540090b0 tx=0x7f5154008030 comp rx=0 tx=0).stop 2023-11-26T07:13:27.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:27.529+0000 7f5165898700 1 -- 172.21.15.2:0/3739386296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51600d49f0 msgr2=0x7f51600ca200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:27.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:27.529+0000 7f5165898700 1 --2- 172.21.15.2:0/3739386296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51600d49f0 0x7f51600ca200 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f515800cb50 tx=0x7f515800ce60 comp rx=0 tx=0).stop 2023-11-26T07:13:27.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:27.529+0000 7f5165898700 1 -- 172.21.15.2:0/3739386296 shutdown_connections 2023-11-26T07:13:27.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:27.529+0000 7f5165898700 1 --2- 172.21.15.2:0/3739386296 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f514c06b080 0x7f514c06d540 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:27.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:27.529+0000 7f5165898700 1 --2- 172.21.15.2:0/3739386296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51600d49f0 0x7f51600ca200 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:27.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:27.529+0000 7f5165898700 1 --2- 172.21.15.2:0/3739386296 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51600d0870 0x7f5160144ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:27.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:27.529+0000 7f5165898700 1 --2- 172.21.15.2:0/3739386296 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51600d0c50 0x7f51600c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:27.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:27.529+0000 7f5165898700 1 -- 172.21.15.2:0/3739386296 >> 172.21.15.2:0/3739386296 conn(0x7f51600d3ed0 msgr2=0x7f51600d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:27.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:27.529+0000 7f5165898700 1 -- 172.21.15.2:0/3739386296 shutdown_connections 2023-11-26T07:13:27.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:27.529+0000 7f5165898700 1 -- 172.21.15.2:0/3739386296 wait complete. 2023-11-26T07:13:27.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:27.548 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-11-26T07:13:27.587 INFO:teuthology.orchestra.run.smithi002.stdout:3 2023-11-26T07:13:32.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:32.588 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-11-26T07:13:32.627 INFO:teuthology.orchestra.run.smithi002.stdout:2 2023-11-26T07:13:32.629 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-26T07:13:32.629 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:13:32.715 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:13:32.762 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-26T07:13:32.763 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:32.763 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:32.783 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:32.783 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:32.843 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:13:33.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.013+0000 7f77d8353700 1 Processor -- start 2023-11-26T07:13:33.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.013+0000 7f77d8353700 1 -- start start 2023-11-26T07:13:33.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.014+0000 7f77d8353700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f77d00cfc60 0x7f77d00d0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:33.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.014+0000 7f77d8353700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77d006f610 con 0x7f77d00d0650 2023-11-26T07:13:33.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.014+0000 7f77d8353700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77d00cdac0 con 0x7f77d015c010 2023-11-26T07:13:33.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.014+0000 7f77d8353700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77d006ece0 con 0x7f77d00cfc60 2023-11-26T07:13:33.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.015+0000 7f77d58ee700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f77d00cfc60 0x7f77d00d0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:33.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.015+0000 7f77d68f0700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f77d00d0650 0x7f77d006faa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60742/0 (socket says 172.21.15.2:60742) 2023-11-26T07:13:33.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.015+0000 7f77d68f0700 1 -- 172.21.15.2:0/2590502290 learned_addr learned my addr 172.21.15.2:0/2590502290 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:13:33.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.015+0000 7f77d58ee700 1 -- 172.21.15.2:0/2590502290 >> v1:172.21.15.192:6789/0 conn(0x7f77d015c010 legacy=0x7f77d00cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:33.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.015+0000 7f77d58ee700 1 -- 172.21.15.2:0/2590502290 >> v1:172.21.15.2:6789/0 conn(0x7f77d00d0650 legacy=0x7f77d006faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:33.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.015+0000 7f77d50ed700 1 -- 172.21.15.2:0/2590502290 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1330646031 0 0) 0x7f77d006f610 con 0x7f77d00d0650 2023-11-26T07:13:33.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.015+0000 7f77d58ee700 1 -- 172.21.15.2:0/2590502290 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d006efc0 con 0x7f77d00cfc60 2023-11-26T07:13:33.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.015+0000 7f77d58ee700 1 --2- 172.21.15.2:0/2590502290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77d00cfc60 0x7f77d00d0110 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f77c4009840 tx=0x7f77c4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebff8a667bb43957 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:33.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.015+0000 7f77d50ed700 1 -- 172.21.15.2:0/2590502290 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c4004230 con 0x7f77d00cfc60 2023-11-26T07:13:33.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.015+0000 7f77d50ed700 1 -- 172.21.15.2:0/2590502290 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c4004390 con 0x7f77d00cfc60 2023-11-26T07:13:33.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.015+0000 7f77d50ed700 1 -- 172.21.15.2:0/2590502290 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c40036a0 con 0x7f77d00cfc60 2023-11-26T07:13:33.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.016+0000 7f77d8353700 1 -- 172.21.15.2:0/2590502290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77d00cfc60 msgr2=0x7f77d00d0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:33.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.016+0000 7f77d8353700 1 --2- 172.21.15.2:0/2590502290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77d00cfc60 0x7f77d00d0110 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f77c4009840 tx=0x7f77c4009b50 comp rx=0 tx=0).stop 2023-11-26T07:13:33.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.016+0000 7f77d8353700 1 -- 172.21.15.2:0/2590502290 shutdown_connections 2023-11-26T07:13:33.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.016+0000 7f77d8353700 1 --2- 172.21.15.2:0/2590502290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77d00cfc60 0x7f77d00d0110 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:33.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.016+0000 7f77d8353700 1 -- 172.21.15.2:0/2590502290 >> 172.21.15.2:0/2590502290 conn(0x7f77d00b3790 msgr2=0x7f77d00b3ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:33.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.016+0000 7f77d8353700 1 -- 172.21.15.2:0/2590502290 shutdown_connections 2023-11-26T07:13:33.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.016+0000 7f77d8353700 1 -- 172.21.15.2:0/2590502290 wait complete. 2023-11-26T07:13:33.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.017+0000 7f77d8353700 1 Processor -- start 2023-11-26T07:13:33.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.017+0000 7f77d8353700 1 -- start start 2023-11-26T07:13:33.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.018+0000 7f77d8353700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77d00cfc60 0x7f77d00c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:33.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.018+0000 7f77d8353700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77d00d0650 0x7f77d015e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:33.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.018+0000 7f77d8353700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77d015c010 0x7f77d006fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:33.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.018+0000 7f77d8353700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d00c9f30 con 0x7f77d015c010 2023-11-26T07:13:33.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.018+0000 7f77d8353700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d015e7c0 con 0x7f77d00cfc60 2023-11-26T07:13:33.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.018+0000 7f77d8353700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d00c9320 con 0x7f77d00d0650 2023-11-26T07:13:33.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.018+0000 7f77d68f0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77d015c010 0x7f77d006fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:33.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.018+0000 7f77d68f0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77d015c010 0x7f77d006fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41306/0 (socket says 172.21.15.2:41306) 2023-11-26T07:13:33.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.018+0000 7f77d68f0700 1 -- 172.21.15.2:0/4184993522 learned_addr learned my addr 172.21.15.2:0/4184993522 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:33.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.018+0000 7f77d60ef700 1 --2- 172.21.15.2:0/4184993522 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77d00cfc60 0x7f77d00c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:33.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.018+0000 7f77d58ee700 1 --2- 172.21.15.2:0/4184993522 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77d00d0650 0x7f77d015e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:33.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.018+0000 7f77d68f0700 1 -- 172.21.15.2:0/4184993522 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77d00d0650 msgr2=0x7f77d015e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:33.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.018+0000 7f77d68f0700 1 --2- 172.21.15.2:0/4184993522 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77d00d0650 0x7f77d015e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:33.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.018+0000 7f77d68f0700 1 -- 172.21.15.2:0/4184993522 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77d00cfc60 msgr2=0x7f77d00c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:33.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.018+0000 7f77d68f0700 1 --2- 172.21.15.2:0/4184993522 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77d00cfc60 0x7f77d00c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:33.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.018+0000 7f77d68f0700 1 -- 172.21.15.2:0/4184993522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c40094a0 con 0x7f77d015c010 2023-11-26T07:13:33.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.019+0000 7f77d68f0700 1 --2- 172.21.15.2:0/4184993522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77d015c010 0x7f77d006fda0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f77c800ccd0 tx=0x7f77c800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:33.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.019+0000 7f77c2ffd700 1 -- 172.21.15.2:0/4184993522 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c800ada0 con 0x7f77d015c010 2023-11-26T07:13:33.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.019+0000 7f77c2ffd700 1 -- 172.21.15.2:0/4184993522 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c80070d0 con 0x7f77d015c010 2023-11-26T07:13:33.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.019+0000 7f77d8353700 1 -- 172.21.15.2:0/4184993522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77d00c9600 con 0x7f77d015c010 2023-11-26T07:13:33.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.019+0000 7f77c2ffd700 1 -- 172.21.15.2:0/4184993522 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c8007480 con 0x7f77d015c010 2023-11-26T07:13:33.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.019+0000 7f77d8353700 1 -- 172.21.15.2:0/4184993522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77d00c9bc0 con 0x7f77d015c010 2023-11-26T07:13:33.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.020+0000 7f77d8353700 1 -- 172.21.15.2:0/4184993522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77d00ca0e0 con 0x7f77d015c010 2023-11-26T07:13:33.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.020+0000 7f77c2ffd700 1 -- 172.21.15.2:0/4184993522 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f77c80075e0 con 0x7f77d015c010 2023-11-26T07:13:33.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.021+0000 7f77c2ffd700 1 --2- 172.21.15.2:0/4184993522 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f77b406b1a0 0x7f77b406d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:33.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.021+0000 7f77c2ffd700 1 -- 172.21.15.2:0/4184993522 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f77c80897b0 con 0x7f77d015c010 2023-11-26T07:13:33.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.021+0000 7f77d60ef700 1 --2- 172.21.15.2:0/4184993522 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f77b406b1a0 0x7f77b406d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:33.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.021+0000 7f77d60ef700 1 --2- 172.21.15.2:0/4184993522 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f77b406b1a0 0x7f77b406d660 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f77cc009870 tx=0x7f77cc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:33.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.025+0000 7f77c2ffd700 1 -- 172.21.15.2:0/4184993522 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f77d00ca0e0 con 0x7f77d015c010 2023-11-26T07:13:33.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.228+0000 7f77d8353700 1 -- 172.21.15.2:0/4184993522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f77d00ca0e0 con 0x7f77d015c010 2023-11-26T07:13:33.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.229+0000 7f77c2ffd700 1 -- 172.21.15.2:0/4184993522 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16586 (secure 0 0 0) 0x7f77d00ca0e0 con 0x7f77d015c010 2023-11-26T07:13:33.231 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:13:33.231 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":34,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:13:26.223324+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:12:27.898687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-26T07:12:28.763512+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":33,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:13:33.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.231+0000 7f77d8353700 1 -- 172.21.15.2:0/4184993522 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f77b406b1a0 msgr2=0x7f77b406d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:33.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.231+0000 7f77d8353700 1 --2- 172.21.15.2:0/4184993522 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f77b406b1a0 0x7f77b406d660 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f77cc009870 tx=0x7f77cc008040 comp rx=0 tx=0).stop 2023-11-26T07:13:33.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.231+0000 7f77d8353700 1 -- 172.21.15.2:0/4184993522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77d015c010 msgr2=0x7f77d006fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:33.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.231+0000 7f77d8353700 1 --2- 172.21.15.2:0/4184993522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77d015c010 0x7f77d006fda0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f77c800ccd0 tx=0x7f77c800a340 comp rx=0 tx=0).stop 2023-11-26T07:13:33.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.231+0000 7f77d8353700 1 -- 172.21.15.2:0/4184993522 shutdown_connections 2023-11-26T07:13:33.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.231+0000 7f77d8353700 1 --2- 172.21.15.2:0/4184993522 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f77b406b1a0 0x7f77b406d660 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:33.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.231+0000 7f77d8353700 1 --2- 172.21.15.2:0/4184993522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77d015c010 0x7f77d006fda0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:33.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.231+0000 7f77d8353700 1 --2- 172.21.15.2:0/4184993522 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77d00cfc60 0x7f77d00c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:33.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.231+0000 7f77d8353700 1 --2- 172.21.15.2:0/4184993522 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77d00d0650 0x7f77d015e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:33.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.231+0000 7f77d8353700 1 -- 172.21.15.2:0/4184993522 >> 172.21.15.2:0/4184993522 conn(0x7f77d00b3790 msgr2=0x7f77d00ccef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:33.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.231+0000 7f77d8353700 1 -- 172.21.15.2:0/4184993522 shutdown_connections 2023-11-26T07:13:33.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.231+0000 7f77d8353700 1 -- 172.21.15.2:0/4184993522 wait complete. 2023-11-26T07:13:33.245 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:11:28.205739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:12:27.898687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:12:28.763512+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 33, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:13:33.246 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:13:33.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.371+0000 7fa9e433b700 1 Processor -- start 2023-11-26T07:13:33.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.371+0000 7fa9e433b700 1 -- start start 2023-11-26T07:13:33.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.372+0000 7fa9e433b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa9dc0b4090 0x7fa9dc15e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:33.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.372+0000 7fa9e433b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa9dc072a00 0x7fa9dc06db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:33.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.372+0000 7fa9e433b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9dc0d0b80 con 0x7fa9dc06e0a0 2023-11-26T07:13:33.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.372+0000 7fa9e433b700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9dc15ed60 con 0x7fa9dc072a00 2023-11-26T07:13:33.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.372+0000 7fa9e433b700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9dc15f040 con 0x7fa9dc0b4090 2023-11-26T07:13:33.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.373+0000 7fa9e18d6700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa9dc072a00 0x7fa9dc06db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:33.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.373+0000 7fa9e18d6700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa9dc072a00 0x7fa9dc06db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41312/0 (socket says 172.21.15.2:41312) 2023-11-26T07:13:33.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.373+0000 7fa9e18d6700 1 -- 172.21.15.2:0/114770493 learned_addr learned my addr 172.21.15.2:0/114770493 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:33.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.373+0000 7fa9e20d7700 1 --2- 172.21.15.2:0/114770493 >> v2:172.21.15.192:3300/0 conn(0x7fa9dc0b4090 0x7fa9dc15e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:33.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.373+0000 7fa9e18d6700 1 -- 172.21.15.2:0/114770493 >> v2:172.21.15.192:3300/0 conn(0x7fa9dc0b4090 msgr2=0x7fa9dc15e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:33.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.373+0000 7fa9e18d6700 1 --2- 172.21.15.2:0/114770493 >> v2:172.21.15.192:3300/0 conn(0x7fa9dc0b4090 0x7fa9dc15e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:33.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.373+0000 7fa9e18d6700 1 -- 172.21.15.2:0/114770493 >> v1:172.21.15.192:6789/0 conn(0x7fa9dc06e0a0 legacy=0x7fa9dc0d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:33.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.373+0000 7fa9e18d6700 1 -- 172.21.15.2:0/114770493 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9dc15f320 con 0x7fa9dc072a00 2023-11-26T07:13:33.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.373+0000 7fa9e18d6700 1 --2- 172.21.15.2:0/114770493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9dc072a00 0x7fa9dc06db60 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc069590 tx=0x7fa9d8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8252941c6dab7550 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:33.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.373+0000 7fa9e10d5700 1 -- 172.21.15.2:0/114770493 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d800b870 con 0x7fa9dc072a00 2023-11-26T07:13:33.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.373+0000 7fa9e10d5700 1 -- 172.21.15.2:0/114770493 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d800b9d0 con 0x7fa9dc072a00 2023-11-26T07:13:33.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.373+0000 7fa9e10d5700 1 -- 172.21.15.2:0/114770493 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d800bd60 con 0x7fa9dc072a00 2023-11-26T07:13:33.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.374+0000 7fa9e433b700 1 -- 172.21.15.2:0/114770493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9dc072a00 msgr2=0x7fa9dc06db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:33.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.374+0000 7fa9e433b700 1 --2- 172.21.15.2:0/114770493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9dc072a00 0x7fa9dc06db60 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc069590 tx=0x7fa9d8009bd0 comp rx=0 tx=0).stop 2023-11-26T07:13:33.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.374+0000 7fa9e433b700 1 -- 172.21.15.2:0/114770493 shutdown_connections 2023-11-26T07:13:33.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.374+0000 7fa9e433b700 1 --2- 172.21.15.2:0/114770493 >> v2:172.21.15.192:3300/0 conn(0x7fa9dc0b4090 0x7fa9dc15e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:33.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.374+0000 7fa9e433b700 1 --2- 172.21.15.2:0/114770493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9dc072a00 0x7fa9dc06db60 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:33.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.374+0000 7fa9e433b700 1 -- 172.21.15.2:0/114770493 >> 172.21.15.2:0/114770493 conn(0x7fa9dc0b2740 msgr2=0x7fa9dc0b2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:33.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.374+0000 7fa9e433b700 1 -- 172.21.15.2:0/114770493 shutdown_connections 2023-11-26T07:13:33.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.374+0000 7fa9e433b700 1 -- 172.21.15.2:0/114770493 wait complete. 2023-11-26T07:13:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.375+0000 7fa9e433b700 1 Processor -- start 2023-11-26T07:13:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.375+0000 7fa9e433b700 1 -- start start 2023-11-26T07:13:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.376+0000 7fa9e433b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa9dc06e0a0 0x7fa9dc1476d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.376+0000 7fa9e433b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9dc072a00 0x7fa9dc151f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.376+0000 7fa9e433b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9dc0b4090 0x7fa9dc158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:33.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.376+0000 7fa9e433b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc159890 con 0x7fa9dc072a00 2023-11-26T07:13:33.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.376+0000 7fa9e433b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc152460 con 0x7fa9dc0b4090 2023-11-26T07:13:33.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.376+0000 7fa9e433b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc15b520 con 0x7fa9dc06e0a0 2023-11-26T07:13:33.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.376+0000 7fa9e18d6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9dc072a00 0x7fa9dc151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:33.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.376+0000 7fa9e18d6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9dc072a00 0x7fa9dc151f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41318/0 (socket says 172.21.15.2:41318) 2023-11-26T07:13:33.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.376+0000 7fa9e18d6700 1 -- 172.21.15.2:0/3786600581 learned_addr learned my addr 172.21.15.2:0/3786600581 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:33.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.376+0000 7fa9e28d8700 1 --2- 172.21.15.2:0/3786600581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9dc0b4090 0x7fa9dc158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:33.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.376+0000 7fa9e20d7700 1 --2- 172.21.15.2:0/3786600581 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa9dc06e0a0 0x7fa9dc1476d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:33.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.376+0000 7fa9e18d6700 1 -- 172.21.15.2:0/3786600581 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa9dc06e0a0 msgr2=0x7fa9dc1476d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:33.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.376+0000 7fa9e18d6700 1 --2- 172.21.15.2:0/3786600581 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa9dc06e0a0 0x7fa9dc1476d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:33.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.376+0000 7fa9e18d6700 1 -- 172.21.15.2:0/3786600581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9dc0b4090 msgr2=0x7fa9dc158b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:33.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.376+0000 7fa9e18d6700 1 --2- 172.21.15.2:0/3786600581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9dc0b4090 0x7fa9dc158b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:33.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.376+0000 7fa9e18d6700 1 -- 172.21.15.2:0/3786600581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d8009550 con 0x7fa9dc072a00 2023-11-26T07:13:33.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.376+0000 7fa9e18d6700 1 --2- 172.21.15.2:0/3786600581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9dc072a00 0x7fa9dc151f20 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8000c00 tx=0x7fa9d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:33.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.377+0000 7fa9d2ffd700 1 -- 172.21.15.2:0/3786600581 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d8004480 con 0x7fa9dc072a00 2023-11-26T07:13:33.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.377+0000 7fa9d2ffd700 1 -- 172.21.15.2:0/3786600581 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d80045e0 con 0x7fa9dc072a00 2023-11-26T07:13:33.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.377+0000 7fa9e433b700 1 -- 172.21.15.2:0/3786600581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9dc15b800 con 0x7fa9dc072a00 2023-11-26T07:13:33.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.377+0000 7fa9d2ffd700 1 -- 172.21.15.2:0/3786600581 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d80038e0 con 0x7fa9dc072a00 2023-11-26T07:13:33.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.377+0000 7fa9e433b700 1 -- 172.21.15.2:0/3786600581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9dc1562e0 con 0x7fa9dc072a00 2023-11-26T07:13:33.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.378+0000 7fa9e433b700 1 -- 172.21.15.2:0/3786600581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9dc15b9f0 con 0x7fa9dc072a00 2023-11-26T07:13:33.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.378+0000 7fa9d2ffd700 1 -- 172.21.15.2:0/3786600581 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7fa9d8021070 con 0x7fa9dc072a00 2023-11-26T07:13:33.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.378+0000 7fa9d2ffd700 1 --2- 172.21.15.2:0/3786600581 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa9c006b1a0 0x7fa9c006d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:33.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.379+0000 7fa9d2ffd700 1 -- 172.21.15.2:0/3786600581 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fa9d808b000 con 0x7fa9dc072a00 2023-11-26T07:13:33.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.379+0000 7fa9e20d7700 1 --2- 172.21.15.2:0/3786600581 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa9c006b1a0 0x7fa9c006d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:33.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.379+0000 7fa9e20d7700 1 --2- 172.21.15.2:0/3786600581 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa9c006b1a0 0x7fa9c006d660 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc007a30 tx=0x7fa9cc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:33.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.383+0000 7fa9d2ffd700 1 -- 172.21.15.2:0/3786600581 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa9d80bde90 con 0x7fa9dc072a00 2023-11-26T07:13:33.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.584+0000 7fa9e433b700 1 -- 172.21.15.2:0/3786600581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa9dc0b24a0 con 0x7fa9dc072a00 2023-11-26T07:13:33.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.585+0000 7fa9d2ffd700 1 -- 172.21.15.2:0/3786600581 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa9dc15b9f0 con 0x7fa9dc072a00 2023-11-26T07:13:33.587 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-26T07:13:33.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.587+0000 7fa9e433b700 1 -- 172.21.15.2:0/3786600581 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa9c006b1a0 msgr2=0x7fa9c006d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:33.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.587+0000 7fa9e433b700 1 --2- 172.21.15.2:0/3786600581 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa9c006b1a0 0x7fa9c006d660 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc007a30 tx=0x7fa9cc008040 comp rx=0 tx=0).stop 2023-11-26T07:13:33.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.587+0000 7fa9e433b700 1 -- 172.21.15.2:0/3786600581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9dc072a00 msgr2=0x7fa9dc151f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:33.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.587+0000 7fa9e433b700 1 --2- 172.21.15.2:0/3786600581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9dc072a00 0x7fa9dc151f20 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8000c00 tx=0x7fa9d8004750 comp rx=0 tx=0).stop 2023-11-26T07:13:33.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.587+0000 7fa9e433b700 1 -- 172.21.15.2:0/3786600581 shutdown_connections 2023-11-26T07:13:33.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.587+0000 7fa9e433b700 1 --2- 172.21.15.2:0/3786600581 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa9c006b1a0 0x7fa9c006d660 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:33.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.587+0000 7fa9e433b700 1 --2- 172.21.15.2:0/3786600581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9dc0b4090 0x7fa9dc158b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:33.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.587+0000 7fa9e433b700 1 --2- 172.21.15.2:0/3786600581 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa9dc06e0a0 0x7fa9dc1476d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:33.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.587+0000 7fa9e433b700 1 --2- 172.21.15.2:0/3786600581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9dc072a00 0x7fa9dc151f20 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:33.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.587+0000 7fa9e433b700 1 -- 172.21.15.2:0/3786600581 >> 172.21.15.2:0/3786600581 conn(0x7fa9dc0b2740 msgr2=0x7fa9dc0b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:33.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.587+0000 7fa9e433b700 1 -- 172.21.15.2:0/3786600581 shutdown_connections 2023-11-26T07:13:33.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.587+0000 7fa9e433b700 1 -- 172.21.15.2:0/3786600581 wait complete. 2023-11-26T07:13:33.601 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:13:33.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.727+0000 7fb0c93b9700 1 Processor -- start 2023-11-26T07:13:33.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.727+0000 7fb0c93b9700 1 -- start start 2023-11-26T07:13:33.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.728+0000 7fb0c93b9700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb0c40d0c50 0x7fb0c40d26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:33.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.728+0000 7fb0c93b9700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb0c40d49f0 0x7fb0c40b6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:33.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.728+0000 7fb0c93b9700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0c40d4e20 con 0x7fb0c40d0870 2023-11-26T07:13:33.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.728+0000 7fb0c93b9700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0c40d2f80 con 0x7fb0c40d49f0 2023-11-26T07:13:33.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.728+0000 7fb0c93b9700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0c40cff70 con 0x7fb0c40d0c50 2023-11-26T07:13:33.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.728+0000 7fb0c37fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb0c40d49f0 0x7fb0c40b6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:33.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.728+0000 7fb0c37fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb0c40d49f0 0x7fb0c40b6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41328/0 (socket says 172.21.15.2:41328) 2023-11-26T07:13:33.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.728+0000 7fb0c37fe700 1 -- 172.21.15.2:0/2745352123 learned_addr learned my addr 172.21.15.2:0/2745352123 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:33.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.728+0000 7fb0c27fc700 1 --2- 172.21.15.2:0/2745352123 >> v2:172.21.15.192:3300/0 conn(0x7fb0c40d0c50 0x7fb0c40d26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:33.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.728+0000 7fb0c37fe700 1 -- 172.21.15.2:0/2745352123 >> v2:172.21.15.192:3300/0 conn(0x7fb0c40d0c50 msgr2=0x7fb0c40d26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:33.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.728+0000 7fb0c37fe700 1 --2- 172.21.15.2:0/2745352123 >> v2:172.21.15.192:3300/0 conn(0x7fb0c40d0c50 0x7fb0c40d26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:33.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.728+0000 7fb0c37fe700 1 -- 172.21.15.2:0/2745352123 >> v1:172.21.15.192:6789/0 conn(0x7fb0c40d0870 legacy=0x7fb0c40cf860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:33.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.728+0000 7fb0c37fe700 1 -- 172.21.15.2:0/2745352123 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c40b5370 con 0x7fb0c40d49f0 2023-11-26T07:13:33.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.728+0000 7fb0c27fc700 1 --2- 172.21.15.2:0/2745352123 >> v2:172.21.15.192:3300/0 conn(0x7fb0c40d0c50 0x7fb0c40d26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:13:33.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.728+0000 7fb0c37fe700 1 --2- 172.21.15.2:0/2745352123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0c40d49f0 0x7fb0c40b6d20 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb0c408dec0 tx=0x7fb0bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9c3b8937a0a3496 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:33.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.729+0000 7fb0c1ffb700 1 -- 172.21.15.2:0/2745352123 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc00e070 con 0x7fb0c40d49f0 2023-11-26T07:13:33.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.729+0000 7fb0c1ffb700 1 -- 172.21.15.2:0/2745352123 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0bc00b9c0 con 0x7fb0c40d49f0 2023-11-26T07:13:33.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.729+0000 7fb0c1ffb700 1 -- 172.21.15.2:0/2745352123 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc00bd70 con 0x7fb0c40d49f0 2023-11-26T07:13:33.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.729+0000 7fb0c93b9700 1 -- 172.21.15.2:0/2745352123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0c40d49f0 msgr2=0x7fb0c40b6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:33.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.729+0000 7fb0c93b9700 1 --2- 172.21.15.2:0/2745352123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0c40d49f0 0x7fb0c40b6d20 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb0c408dec0 tx=0x7fb0bc00b330 comp rx=0 tx=0).stop 2023-11-26T07:13:33.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.729+0000 7fb0c93b9700 1 -- 172.21.15.2:0/2745352123 shutdown_connections 2023-11-26T07:13:33.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.729+0000 7fb0c93b9700 1 --2- 172.21.15.2:0/2745352123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0c40d49f0 0x7fb0c40b6d20 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:33.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.729+0000 7fb0c93b9700 1 --2- 172.21.15.2:0/2745352123 >> v2:172.21.15.192:3300/0 conn(0x7fb0c40d0c50 0x7fb0c40d26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:33.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.729+0000 7fb0c93b9700 1 -- 172.21.15.2:0/2745352123 >> 172.21.15.2:0/2745352123 conn(0x7fb0c40d3ed0 msgr2=0x7fb0c40d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:33.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.729+0000 7fb0c93b9700 1 -- 172.21.15.2:0/2745352123 shutdown_connections 2023-11-26T07:13:33.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.729+0000 7fb0c93b9700 1 -- 172.21.15.2:0/2745352123 wait complete. 2023-11-26T07:13:33.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.731+0000 7fb0c93b9700 1 Processor -- start 2023-11-26T07:13:33.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.731+0000 7fb0c93b9700 1 -- start start 2023-11-26T07:13:33.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.731+0000 7fb0c93b9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0c40d0870 0x7fb0c41f7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:33.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.731+0000 7fb0c93b9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0c40d0c50 0x7fb0c415af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:33.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.731+0000 7fb0c93b9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0c40d49f0 0x7fb0c415b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:33.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.731+0000 7fb0c93b9700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c414be50 con 0x7fb0c40d49f0 2023-11-26T07:13:33.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.731+0000 7fb0c93b9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c41552e0 con 0x7fb0c40d0870 2023-11-26T07:13:33.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.731+0000 7fb0c93b9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c41555c0 con 0x7fb0c40d0c50 2023-11-26T07:13:33.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.731+0000 7fb0c37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0c40d49f0 0x7fb0c415b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:33.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.732+0000 7fb0c37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0c40d49f0 0x7fb0c415b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41334/0 (socket says 172.21.15.2:41334) 2023-11-26T07:13:33.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.732+0000 7fb0c37fe700 1 -- 172.21.15.2:0/368116336 learned_addr learned my addr 172.21.15.2:0/368116336 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:33.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.732+0000 7fb0c27fc700 1 --2- 172.21.15.2:0/368116336 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0c40d0c50 0x7fb0c415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:33.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.732+0000 7fb0c2ffd700 1 --2- 172.21.15.2:0/368116336 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0c40d0870 0x7fb0c41f7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:33.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.732+0000 7fb0c37fe700 1 -- 172.21.15.2:0/368116336 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0c40d0c50 msgr2=0x7fb0c415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:33.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.732+0000 7fb0c37fe700 1 --2- 172.21.15.2:0/368116336 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0c40d0c50 0x7fb0c415af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:33.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.732+0000 7fb0c37fe700 1 -- 172.21.15.2:0/368116336 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0c40d0870 msgr2=0x7fb0c41f7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:33.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.732+0000 7fb0c37fe700 1 --2- 172.21.15.2:0/368116336 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0c40d0870 0x7fb0c41f7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:33.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.732+0000 7fb0c37fe700 1 -- 172.21.15.2:0/368116336 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0bc009b30 con 0x7fb0c40d49f0 2023-11-26T07:13:33.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.732+0000 7fb0c37fe700 1 --2- 172.21.15.2:0/368116336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0c40d49f0 0x7fb0c415b440 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb0c408c300 tx=0x7fb0bc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:33.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.732+0000 7fb0ab7fe700 1 -- 172.21.15.2:0/368116336 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc004880 con 0x7fb0c40d49f0 2023-11-26T07:13:33.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.732+0000 7fb0ab7fe700 1 -- 172.21.15.2:0/368116336 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0bc0099b0 con 0x7fb0c40d49f0 2023-11-26T07:13:33.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.732+0000 7fb0ab7fe700 1 -- 172.21.15.2:0/368116336 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc01b670 con 0x7fb0c40d49f0 2023-11-26T07:13:33.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.732+0000 7fb0c93b9700 1 -- 172.21.15.2:0/368116336 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0c41558a0 con 0x7fb0c40d49f0 2023-11-26T07:13:33.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.732+0000 7fb0c93b9700 1 -- 172.21.15.2:0/368116336 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0c4155e60 con 0x7fb0c40d49f0 2023-11-26T07:13:33.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.733+0000 7fb0c93b9700 1 -- 172.21.15.2:0/368116336 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0c40b57c0 con 0x7fb0c40d49f0 2023-11-26T07:13:33.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.734+0000 7fb0ab7fe700 1 -- 172.21.15.2:0/368116336 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7fb0bc01b7d0 con 0x7fb0c40d49f0 2023-11-26T07:13:33.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.734+0000 7fb0ab7fe700 1 --2- 172.21.15.2:0/368116336 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb0b006b1a0 0x7fb0b006d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:33.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.734+0000 7fb0ab7fe700 1 -- 172.21.15.2:0/368116336 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fb0bc08b310 con 0x7fb0c40d49f0 2023-11-26T07:13:33.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.734+0000 7fb0c2ffd700 1 --2- 172.21.15.2:0/368116336 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb0b006b1a0 0x7fb0b006d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:33.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.735+0000 7fb0c2ffd700 1 --2- 172.21.15.2:0/368116336 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb0b006b1a0 0x7fb0b006d660 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8007fd0 tx=0x7fb0b8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:33.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.739+0000 7fb0ab7fe700 1 -- 172.21.15.2:0/368116336 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb0bc055fd0 con 0x7fb0c40d49f0 2023-11-26T07:13:33.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.938+0000 7fb0c93b9700 1 -- 172.21.15.2:0/368116336 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb0c4067a20 con 0x7fb0c40d49f0 2023-11-26T07:13:33.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.939+0000 7fb0ab7fe700 1 -- 172.21.15.2:0/368116336 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb0bc0595f0 con 0x7fb0c40d49f0 2023-11-26T07:13:33.941 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-26T07:13:33.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.941+0000 7fb0c93b9700 1 -- 172.21.15.2:0/368116336 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb0b006b1a0 msgr2=0x7fb0b006d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:33.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.941+0000 7fb0c93b9700 1 --2- 172.21.15.2:0/368116336 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb0b006b1a0 0x7fb0b006d660 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8007fd0 tx=0x7fb0b8009040 comp rx=0 tx=0).stop 2023-11-26T07:13:33.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.941+0000 7fb0c93b9700 1 -- 172.21.15.2:0/368116336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0c40d49f0 msgr2=0x7fb0c415b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:33.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.941+0000 7fb0c93b9700 1 --2- 172.21.15.2:0/368116336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0c40d49f0 0x7fb0c415b440 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb0c408c300 tx=0x7fb0bc004ad0 comp rx=0 tx=0).stop 2023-11-26T07:13:33.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.941+0000 7fb0c93b9700 1 -- 172.21.15.2:0/368116336 shutdown_connections 2023-11-26T07:13:33.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.941+0000 7fb0c93b9700 1 --2- 172.21.15.2:0/368116336 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb0b006b1a0 0x7fb0b006d660 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:33.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.941+0000 7fb0c93b9700 1 --2- 172.21.15.2:0/368116336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0c40d49f0 0x7fb0c415b440 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:33.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.941+0000 7fb0c93b9700 1 --2- 172.21.15.2:0/368116336 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0c40d0870 0x7fb0c41f7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:33.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.941+0000 7fb0c93b9700 1 --2- 172.21.15.2:0/368116336 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0c40d0c50 0x7fb0c415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:33.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.941+0000 7fb0c93b9700 1 -- 172.21.15.2:0/368116336 >> 172.21.15.2:0/368116336 conn(0x7fb0c40d3ed0 msgr2=0x7fb0c40c75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:33.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.941+0000 7fb0c93b9700 1 -- 172.21.15.2:0/368116336 shutdown_connections 2023-11-26T07:13:33.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:33.941+0000 7fb0c93b9700 1 -- 172.21.15.2:0/368116336 wait complete. 2023-11-26T07:13:33.955 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:13:34.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.081+0000 7fe756416700 1 Processor -- start 2023-11-26T07:13:34.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.081+0000 7fe756416700 1 -- start start 2023-11-26T07:13:34.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.082+0000 7fe756416700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe750143ae0 0x7fe7500b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:34.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.082+0000 7fe756416700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7501440f0 0x7fe750071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:34.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.082+0000 7fe756416700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe750143ec0 con 0x7fe7500720f0 2023-11-26T07:13:34.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.082+0000 7fe756416700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7500b40a0 con 0x7fe750143ae0 2023-11-26T07:13:34.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.082+0000 7fe756416700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe750072580 con 0x7fe7501440f0 2023-11-26T07:13:34.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.082+0000 7fe74ffff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe750143ae0 0x7fe7500b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:34.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.082+0000 7fe7549b3700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe7500720f0 0x7fe75015e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60782/0 (socket says 172.21.15.2:60782) 2023-11-26T07:13:34.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.082+0000 7fe7549b3700 1 -- 172.21.15.2:0/243250712 learned_addr learned my addr 172.21.15.2:0/243250712 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:13:34.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.082+0000 7fe74f7fe700 1 --2- 172.21.15.2:0/243250712 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7501440f0 0x7fe750071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:34.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.082+0000 7fe74ffff700 1 -- 172.21.15.2:0/243250712 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7501440f0 msgr2=0x7fe750071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:34.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.082+0000 7fe74ffff700 1 --2- 172.21.15.2:0/243250712 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7501440f0 0x7fe750071bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:34.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.082+0000 7fe74ffff700 1 -- 172.21.15.2:0/243250712 >> v1:172.21.15.2:6789/0 conn(0x7fe7500720f0 legacy=0x7fe75015e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:34.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.082+0000 7fe74effd700 1 -- 172.21.15.2:0/243250712 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3657499884 0 0) 0x7fe750143ec0 con 0x7fe7500720f0 2023-11-26T07:13:34.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.082+0000 7fe74ffff700 1 -- 172.21.15.2:0/243250712 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7500b3ae0 con 0x7fe750143ae0 2023-11-26T07:13:34.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.082+0000 7fe74ffff700 1 --2- 172.21.15.2:0/243250712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe750143ae0 0x7fe7500b51b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe740009840 tx=0x7fe740009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2903d4d2d1387bb server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:34.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.082+0000 7fe74effd700 1 -- 172.21.15.2:0/243250712 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe740011830 con 0x7fe750143ae0 2023-11-26T07:13:34.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.082+0000 7fe74effd700 1 -- 172.21.15.2:0/243250712 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe740011990 con 0x7fe750143ae0 2023-11-26T07:13:34.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.082+0000 7fe74effd700 1 -- 172.21.15.2:0/243250712 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe740011d20 con 0x7fe750143ae0 2023-11-26T07:13:34.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.083+0000 7fe756416700 1 -- 172.21.15.2:0/243250712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe750143ae0 msgr2=0x7fe7500b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:34.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.083+0000 7fe756416700 1 --2- 172.21.15.2:0/243250712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe750143ae0 0x7fe7500b51b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe740009840 tx=0x7fe740009b50 comp rx=0 tx=0).stop 2023-11-26T07:13:34.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.083+0000 7fe756416700 1 -- 172.21.15.2:0/243250712 shutdown_connections 2023-11-26T07:13:34.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.083+0000 7fe756416700 1 --2- 172.21.15.2:0/243250712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe750143ae0 0x7fe7500b51b0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:34.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.083+0000 7fe756416700 1 --2- 172.21.15.2:0/243250712 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7501440f0 0x7fe750071bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:34.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.083+0000 7fe756416700 1 -- 172.21.15.2:0/243250712 >> 172.21.15.2:0/243250712 conn(0x7fe7500b2740 msgr2=0x7fe7500b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:34.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.083+0000 7fe756416700 1 -- 172.21.15.2:0/243250712 shutdown_connections 2023-11-26T07:13:34.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.083+0000 7fe756416700 1 -- 172.21.15.2:0/243250712 wait complete. 2023-11-26T07:13:34.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.084+0000 7fe756416700 1 Processor -- start 2023-11-26T07:13:34.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.084+0000 7fe756416700 1 -- start start 2023-11-26T07:13:34.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.085+0000 7fe756416700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7500720f0 0x7fe75013def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:34.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.085+0000 7fe756416700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe750143ae0 0x7fe75015c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:34.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.085+0000 7fe756416700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7501440f0 0x7fe7501411a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:34.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.085+0000 7fe756416700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75015e4f0 con 0x7fe750143ae0 2023-11-26T07:13:34.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.085+0000 7fe756416700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75013e430 con 0x7fe7500720f0 2023-11-26T07:13:34.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.085+0000 7fe756416700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe75013f550 con 0x7fe7501440f0 2023-11-26T07:13:34.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.085+0000 7fe74f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe750143ae0 0x7fe75015c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:34.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.085+0000 7fe74f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe750143ae0 0x7fe75015c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41346/0 (socket says 172.21.15.2:41346) 2023-11-26T07:13:34.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.085+0000 7fe74f7fe700 1 -- 172.21.15.2:0/2322072572 learned_addr learned my addr 172.21.15.2:0/2322072572 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:34.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.086+0000 7fe74f7fe700 1 -- 172.21.15.2:0/2322072572 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7501440f0 msgr2=0x7fe7501411a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:34.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.086+0000 7fe74f7fe700 1 --2- 172.21.15.2:0/2322072572 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7501440f0 0x7fe7501411a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:34.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.086+0000 7fe74f7fe700 1 -- 172.21.15.2:0/2322072572 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7500720f0 msgr2=0x7fe75013def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:34.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.086+0000 7fe74f7fe700 1 --2- 172.21.15.2:0/2322072572 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7500720f0 0x7fe75013def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:34.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.086+0000 7fe74f7fe700 1 -- 172.21.15.2:0/2322072572 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7400094a0 con 0x7fe750143ae0 2023-11-26T07:13:34.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.086+0000 7fe74f7fe700 1 --2- 172.21.15.2:0/2322072572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe750143ae0 0x7fe75015c2d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe74400c7f0 tx=0x7fe74400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:34.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.086+0000 7fe74cff9700 1 -- 172.21.15.2:0/2322072572 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe744011800 con 0x7fe750143ae0 2023-11-26T07:13:34.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.086+0000 7fe74cff9700 1 -- 172.21.15.2:0/2322072572 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe744011960 con 0x7fe750143ae0 2023-11-26T07:13:34.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.086+0000 7fe756416700 1 -- 172.21.15.2:0/2322072572 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe75013f830 con 0x7fe750143ae0 2023-11-26T07:13:34.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.086+0000 7fe74cff9700 1 -- 172.21.15.2:0/2322072572 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe744011cf0 con 0x7fe750143ae0 2023-11-26T07:13:34.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.086+0000 7fe756416700 1 -- 172.21.15.2:0/2322072572 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe75015de30 con 0x7fe750143ae0 2023-11-26T07:13:34.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.087+0000 7fe756416700 1 -- 172.21.15.2:0/2322072572 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe750075480 con 0x7fe750143ae0 2023-11-26T07:13:34.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.088+0000 7fe74cff9700 1 -- 172.21.15.2:0/2322072572 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7fe744024480 con 0x7fe750143ae0 2023-11-26T07:13:34.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.088+0000 7fe74cff9700 1 --2- 172.21.15.2:0/2322072572 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe73c06b1a0 0x7fe73c06d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:34.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.088+0000 7fe74cff9700 1 -- 172.21.15.2:0/2322072572 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fe744089f80 con 0x7fe750143ae0 2023-11-26T07:13:34.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.088+0000 7fe74ffff700 1 --2- 172.21.15.2:0/2322072572 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe73c06b1a0 0x7fe73c06d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:34.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.089+0000 7fe74ffff700 1 --2- 172.21.15.2:0/2322072572 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe73c06b1a0 0x7fe73c06d660 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe7400090b0 tx=0x7fe740010000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:34.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.092+0000 7fe74cff9700 1 -- 172.21.15.2:0/2322072572 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe744054c40 con 0x7fe750143ae0 2023-11-26T07:13:34.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.293+0000 7fe756416700 1 -- 172.21.15.2:0/2322072572 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe75015e630 con 0x7fe750143ae0 2023-11-26T07:13:34.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.293+0000 7fe74cff9700 1 -- 172.21.15.2:0/2322072572 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe744058260 con 0x7fe750143ae0 2023-11-26T07:13:34.296 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-26T07:13:34.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.295+0000 7fe756416700 1 -- 172.21.15.2:0/2322072572 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe73c06b1a0 msgr2=0x7fe73c06d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:34.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.295+0000 7fe756416700 1 --2- 172.21.15.2:0/2322072572 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe73c06b1a0 0x7fe73c06d660 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe7400090b0 tx=0x7fe740010000 comp rx=0 tx=0).stop 2023-11-26T07:13:34.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.295+0000 7fe756416700 1 -- 172.21.15.2:0/2322072572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe750143ae0 msgr2=0x7fe75015c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:34.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.295+0000 7fe756416700 1 --2- 172.21.15.2:0/2322072572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe750143ae0 0x7fe75015c2d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe74400c7f0 tx=0x7fe74400cbb0 comp rx=0 tx=0).stop 2023-11-26T07:13:34.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.295+0000 7fe756416700 1 -- 172.21.15.2:0/2322072572 shutdown_connections 2023-11-26T07:13:34.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.295+0000 7fe756416700 1 --2- 172.21.15.2:0/2322072572 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe73c06b1a0 0x7fe73c06d660 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:34.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.296+0000 7fe756416700 1 --2- 172.21.15.2:0/2322072572 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7501440f0 0x7fe7501411a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:34.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.296+0000 7fe756416700 1 --2- 172.21.15.2:0/2322072572 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7500720f0 0x7fe75013def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:34.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.296+0000 7fe756416700 1 --2- 172.21.15.2:0/2322072572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe750143ae0 0x7fe75015c2d0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:34.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.296+0000 7fe756416700 1 -- 172.21.15.2:0/2322072572 >> 172.21.15.2:0/2322072572 conn(0x7fe7500b2740 msgr2=0x7fe75006e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:34.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.296+0000 7fe756416700 1 -- 172.21.15.2:0/2322072572 shutdown_connections 2023-11-26T07:13:34.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.296+0000 7fe756416700 1 -- 172.21.15.2:0/2322072572 wait complete. 2023-11-26T07:13:34.310 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-26T07:13:34.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.436+0000 7f4b104be700 1 Processor -- start 2023-11-26T07:13:34.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.436+0000 7f4b104be700 1 -- start start 2023-11-26T07:13:34.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.437+0000 7f4b104be700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4b0815e1e0 0x7f4b080b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:34.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.437+0000 7f4b104be700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4b080b5e40 0x7f4b0815f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:34.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.437+0000 7f4b104be700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b0806bb80 con 0x7f4b0806b400 2023-11-26T07:13:34.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.437+0000 7f4b104be700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b0806be20 con 0x7f4b080b5e40 2023-11-26T07:13:34.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.437+0000 7f4b104be700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b0806c100 con 0x7f4b0815e1e0 2023-11-26T07:13:34.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.437+0000 7f4b0ea5b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4b080b5e40 0x7f4b0815f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:34.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.437+0000 7f4b0ea5b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4b080b5e40 0x7f4b0815f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41354/0 (socket says 172.21.15.2:41354) 2023-11-26T07:13:34.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.437+0000 7f4b0ea5b700 1 -- 172.21.15.2:0/1809521852 learned_addr learned my addr 172.21.15.2:0/1809521852 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:34.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.437+0000 7f4b0da59700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f4b0806b400 0x7f4b080726a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60794/0 (socket says 172.21.15.2:60794) 2023-11-26T07:13:34.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.438+0000 7f4b0e25a700 1 --2- 172.21.15.2:0/1809521852 >> v2:172.21.15.192:3300/0 conn(0x7f4b0815e1e0 0x7f4b080b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:34.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.438+0000 7f4b0ea5b700 1 -- 172.21.15.2:0/1809521852 >> v2:172.21.15.192:3300/0 conn(0x7f4b0815e1e0 msgr2=0x7f4b080b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:34.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.438+0000 7f4b0ea5b700 1 --2- 172.21.15.2:0/1809521852 >> v2:172.21.15.192:3300/0 conn(0x7f4b0815e1e0 0x7f4b080b12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:34.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.438+0000 7f4b0ea5b700 1 -- 172.21.15.2:0/1809521852 >> v1:172.21.15.2:6789/0 conn(0x7f4b0806b400 legacy=0x7f4b080726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:34.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.438+0000 7f4b0ea5b700 1 -- 172.21.15.2:0/1809521852 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b0806c3e0 con 0x7f4b080b5e40 2023-11-26T07:13:34.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.438+0000 7f4b0d258700 1 -- 172.21.15.2:0/1809521852 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2714244742 0 0) 0x7f4b0806bb80 con 0x7f4b0806b400 2023-11-26T07:13:34.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.438+0000 7f4b0ea5b700 1 --2- 172.21.15.2:0/1809521852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b080b5e40 0x7f4b0815f5d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4b080737c0 tx=0x7f4b0000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=600f0aee76f29d92 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:34.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.438+0000 7f4b0d258700 1 -- 172.21.15.2:0/1809521852 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0000e070 con 0x7f4b080b5e40 2023-11-26T07:13:34.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.438+0000 7f4b0d258700 1 -- 172.21.15.2:0/1809521852 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0000b9c0 con 0x7f4b080b5e40 2023-11-26T07:13:34.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.438+0000 7f4b0d258700 1 -- 172.21.15.2:0/1809521852 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0000bd70 con 0x7f4b080b5e40 2023-11-26T07:13:34.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.438+0000 7f4b104be700 1 -- 172.21.15.2:0/1809521852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b080b5e40 msgr2=0x7f4b0815f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:34.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.439+0000 7f4b104be700 1 --2- 172.21.15.2:0/1809521852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b080b5e40 0x7f4b0815f5d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4b080737c0 tx=0x7f4b0000b330 comp rx=0 tx=0).stop 2023-11-26T07:13:34.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.439+0000 7f4b104be700 1 -- 172.21.15.2:0/1809521852 shutdown_connections 2023-11-26T07:13:34.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.439+0000 7f4b104be700 1 --2- 172.21.15.2:0/1809521852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b080b5e40 0x7f4b0815f5d0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:34.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.439+0000 7f4b104be700 1 --2- 172.21.15.2:0/1809521852 >> v2:172.21.15.192:3300/0 conn(0x7f4b0815e1e0 0x7f4b080b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:34.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.439+0000 7f4b104be700 1 -- 172.21.15.2:0/1809521852 >> 172.21.15.2:0/1809521852 conn(0x7f4b080b5070 msgr2=0x7f4b080b5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:34.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.439+0000 7f4b104be700 1 -- 172.21.15.2:0/1809521852 shutdown_connections 2023-11-26T07:13:34.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.439+0000 7f4b104be700 1 -- 172.21.15.2:0/1809521852 wait complete. 2023-11-26T07:13:34.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.440+0000 7f4b104be700 1 Processor -- start 2023-11-26T07:13:34.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.440+0000 7f4b104be700 1 -- start start 2023-11-26T07:13:34.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.441+0000 7f4b104be700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4b0806b400 0x7f4b0815aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:34.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.441+0000 7f4b104be700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b080b5e40 0x7f4b08157b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:34.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.441+0000 7f4b104be700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b0815e1e0 0x7f4b08153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:34.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.441+0000 7f4b104be700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b08158090 con 0x7f4b0815e1e0 2023-11-26T07:13:34.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.441+0000 7f4b104be700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b08154750 con 0x7f4b080b5e40 2023-11-26T07:13:34.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.441+0000 7f4b104be700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b08154a10 con 0x7f4b0806b400 2023-11-26T07:13:34.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.441+0000 7f4b0ea5b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b0815e1e0 0x7f4b08153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:34.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.441+0000 7f4b0ea5b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b0815e1e0 0x7f4b08153800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41360/0 (socket says 172.21.15.2:41360) 2023-11-26T07:13:34.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.441+0000 7f4b0ea5b700 1 -- 172.21.15.2:0/1476941945 learned_addr learned my addr 172.21.15.2:0/1476941945 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:34.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.441+0000 7f4b0da59700 1 --2- 172.21.15.2:0/1476941945 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b080b5e40 0x7f4b08157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:34.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.441+0000 7f4b0e25a700 1 --2- 172.21.15.2:0/1476941945 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4b0806b400 0x7f4b0815aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:34.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.441+0000 7f4b0ea5b700 1 -- 172.21.15.2:0/1476941945 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4b0806b400 msgr2=0x7f4b0815aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:34.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.441+0000 7f4b0ea5b700 1 --2- 172.21.15.2:0/1476941945 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4b0806b400 0x7f4b0815aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:34.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.441+0000 7f4b0ea5b700 1 -- 172.21.15.2:0/1476941945 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b080b5e40 msgr2=0x7f4b08157b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:34.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.441+0000 7f4b0ea5b700 1 --2- 172.21.15.2:0/1476941945 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b080b5e40 0x7f4b08157b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:34.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.441+0000 7f4b0ea5b700 1 -- 172.21.15.2:0/1476941945 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b00009b30 con 0x7f4b0815e1e0 2023-11-26T07:13:34.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.441+0000 7f4b0da59700 1 --2- 172.21.15.2:0/1476941945 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b080b5e40 0x7f4b08157b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:13:34.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.441+0000 7f4b0ea5b700 1 --2- 172.21.15.2:0/1476941945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b0815e1e0 0x7f4b08153800 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4b080737f0 tx=0x7f4b00004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:34.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.441+0000 7f4afeffd700 1 -- 172.21.15.2:0/1476941945 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b000099b0 con 0x7f4b0815e1e0 2023-11-26T07:13:34.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.441+0000 7f4afeffd700 1 -- 172.21.15.2:0/1476941945 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b000092e0 con 0x7f4b0815e1e0 2023-11-26T07:13:34.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.441+0000 7f4b104be700 1 -- 172.21.15.2:0/1476941945 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b08154cf0 con 0x7f4b0815e1e0 2023-11-26T07:13:34.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.441+0000 7f4afeffd700 1 -- 172.21.15.2:0/1476941945 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0001c660 con 0x7f4b0815e1e0 2023-11-26T07:13:34.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.441+0000 7f4b104be700 1 -- 172.21.15.2:0/1476941945 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b08153d40 con 0x7f4b0815e1e0 2023-11-26T07:13:34.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.442+0000 7f4b104be700 1 -- 172.21.15.2:0/1476941945 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b08068670 con 0x7f4b0815e1e0 2023-11-26T07:13:34.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.443+0000 7f4afeffd700 1 -- 172.21.15.2:0/1476941945 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f4b0001c7c0 con 0x7f4b0815e1e0 2023-11-26T07:13:34.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.443+0000 7f4afeffd700 1 --2- 172.21.15.2:0/1476941945 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4aec06b1a0 0x7f4aec06d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:34.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.443+0000 7f4afeffd700 1 -- 172.21.15.2:0/1476941945 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f4b0008b810 con 0x7f4b0815e1e0 2023-11-26T07:13:34.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.443+0000 7f4b0e25a700 1 --2- 172.21.15.2:0/1476941945 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4aec06b1a0 0x7f4aec06d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:34.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.444+0000 7f4b0e25a700 1 --2- 172.21.15.2:0/1476941945 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4aec06b1a0 0x7f4aec06d660 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4af800b9b0 tx=0x7f4af8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:34.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.448+0000 7f4afeffd700 1 -- 172.21.15.2:0/1476941945 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4b000564d0 con 0x7f4b0815e1e0 2023-11-26T07:13:34.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.666+0000 7f4b104be700 1 -- 172.21.15.2:0/1476941945 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4b081551b0 con 0x7f4b0815e1e0 2023-11-26T07:13:34.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.666+0000 7f4afeffd700 1 -- 172.21.15.2:0/1476941945 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4b00059af0 con 0x7f4b0815e1e0 2023-11-26T07:13:34.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.668+0000 7f4b104be700 1 -- 172.21.15.2:0/1476941945 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4aec06b1a0 msgr2=0x7f4aec06d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:34.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.668+0000 7f4b104be700 1 --2- 172.21.15.2:0/1476941945 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4aec06b1a0 0x7f4aec06d660 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4af800b9b0 tx=0x7f4af8008040 comp rx=0 tx=0).stop 2023-11-26T07:13:34.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.668+0000 7f4b104be700 1 -- 172.21.15.2:0/1476941945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b0815e1e0 msgr2=0x7f4b08153800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:34.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.668+0000 7f4b104be700 1 --2- 172.21.15.2:0/1476941945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b0815e1e0 0x7f4b08153800 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4b080737f0 tx=0x7f4b00004ad0 comp rx=0 tx=0).stop 2023-11-26T07:13:34.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.668+0000 7f4b104be700 1 -- 172.21.15.2:0/1476941945 shutdown_connections 2023-11-26T07:13:34.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.668+0000 7f4b104be700 1 --2- 172.21.15.2:0/1476941945 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4aec06b1a0 0x7f4aec06d660 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:34.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.668+0000 7f4b104be700 1 --2- 172.21.15.2:0/1476941945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b0815e1e0 0x7f4b08153800 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:34.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.668+0000 7f4b104be700 1 --2- 172.21.15.2:0/1476941945 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4b0806b400 0x7f4b0815aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:34.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.668+0000 7f4b104be700 1 --2- 172.21.15.2:0/1476941945 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b080b5e40 0x7f4b08157b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:34.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.668+0000 7f4b104be700 1 -- 172.21.15.2:0/1476941945 >> 172.21.15.2:0/1476941945 conn(0x7f4b080b5070 msgr2=0x7f4b080b1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:34.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.668+0000 7f4b104be700 1 -- 172.21.15.2:0/1476941945 shutdown_connections 2023-11-26T07:13:34.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.668+0000 7f4b104be700 1 -- 172.21.15.2:0/1476941945 wait complete. 2023-11-26T07:13:34.672 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2023-11-26T07:13:34.682 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-26T07:13:34.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:34.683 DEBUG:teuthology.orchestra.run.smithi002:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-26T07:13:34.742 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2023-11-26T07:13:34.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:34.743 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-26T07:13:34.775 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:13:34.775 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:34.795 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:13:34.795 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:34.853 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:13:34.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.976+0000 7f4382ea1700 1 Processor -- start 2023-11-26T07:13:34.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.976+0000 7f4382ea1700 1 -- start start 2023-11-26T07:13:34.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.977+0000 7f4382ea1700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f437c0d09e0 0x7f437c06f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:34.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.977+0000 7f4382ea1700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f437c0ccdd0 0x7f437c0cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:34.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.977+0000 7f4382ea1700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f437c0d0f50 con 0x7f437c15e260 2023-11-26T07:13:34.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.977+0000 7f4382ea1700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f437c0d1230 con 0x7f437c0d09e0 2023-11-26T07:13:34.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.977+0000 7f4382ea1700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f437c0cc2f0 con 0x7f437c0ccdd0 2023-11-26T07:13:34.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.977+0000 7f437bfff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f437c0d09e0 0x7f437c06f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:34.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.977+0000 7f437bfff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f437c0d09e0 0x7f437c06f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41366/0 (socket says 172.21.15.2:41366) 2023-11-26T07:13:34.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.977+0000 7f437bfff700 1 -- 172.21.15.2:0/2251183243 learned_addr learned my addr 172.21.15.2:0/2251183243 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:34.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.977+0000 7f438143e700 1 --2- 172.21.15.2:0/2251183243 >> v2:172.21.15.192:3300/0 conn(0x7f437c0ccdd0 0x7f437c0cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:34.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.977+0000 7f437bfff700 1 -- 172.21.15.2:0/2251183243 >> v2:172.21.15.192:3300/0 conn(0x7f437c0ccdd0 msgr2=0x7f437c0cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:34.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.977+0000 7f437bfff700 1 --2- 172.21.15.2:0/2251183243 >> v2:172.21.15.192:3300/0 conn(0x7f437c0ccdd0 0x7f437c0cd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.977+0000 7f437bfff700 1 -- 172.21.15.2:0/2251183243 >> v1:172.21.15.192:6789/0 conn(0x7f437c15e260 legacy=0x7f437c06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.977+0000 7f437bfff700 1 -- 172.21.15.2:0/2251183243 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f437c0cc5d0 con 0x7f437c0d09e0 2023-11-26T07:13:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.977+0000 7f438143e700 1 --2- 172.21.15.2:0/2251183243 >> v2:172.21.15.192:3300/0 conn(0x7f437c0ccdd0 0x7f437c0cd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:13:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.977+0000 7f437bfff700 1 --2- 172.21.15.2:0/2251183243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f437c0d09e0 0x7f437c06f600 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f437c06ea50 tx=0x7f4368009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=363ab70538a17304 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.978+0000 7f437b7fe700 1 -- 172.21.15.2:0/2251183243 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436800b870 con 0x7f437c0d09e0 2023-11-26T07:13:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.978+0000 7f437b7fe700 1 -- 172.21.15.2:0/2251183243 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436800b9d0 con 0x7f437c0d09e0 2023-11-26T07:13:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.978+0000 7f437b7fe700 1 -- 172.21.15.2:0/2251183243 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436800bd60 con 0x7f437c0d09e0 2023-11-26T07:13:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.978+0000 7f4382ea1700 1 -- 172.21.15.2:0/2251183243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f437c0d09e0 msgr2=0x7f437c06f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.978+0000 7f4382ea1700 1 --2- 172.21.15.2:0/2251183243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f437c0d09e0 0x7f437c06f600 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f437c06ea50 tx=0x7f4368009bd0 comp rx=0 tx=0).stop 2023-11-26T07:13:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.978+0000 7f4382ea1700 1 -- 172.21.15.2:0/2251183243 shutdown_connections 2023-11-26T07:13:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.978+0000 7f4382ea1700 1 --2- 172.21.15.2:0/2251183243 >> v2:172.21.15.192:3300/0 conn(0x7f437c0ccdd0 0x7f437c0cd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:34.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.978+0000 7f4382ea1700 1 --2- 172.21.15.2:0/2251183243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f437c0d09e0 0x7f437c06f600 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:34.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.978+0000 7f4382ea1700 1 -- 172.21.15.2:0/2251183243 >> 172.21.15.2:0/2251183243 conn(0x7f437c0b3790 msgr2=0x7f437c0b3ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:34.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.978+0000 7f4382ea1700 1 -- 172.21.15.2:0/2251183243 shutdown_connections 2023-11-26T07:13:34.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.978+0000 7f4382ea1700 1 -- 172.21.15.2:0/2251183243 wait complete. 2023-11-26T07:13:34.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.979+0000 7f4382ea1700 1 Processor -- start 2023-11-26T07:13:34.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.979+0000 7f4382ea1700 1 -- start start 2023-11-26T07:13:34.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.980+0000 7f4382ea1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f437c0ccdd0 0x7f437c14d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:34.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.980+0000 7f4382ea1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f437c0d09e0 0x7f437c0cb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:34.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.980+0000 7f4382ea1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f437c15e260 0x7f437c1f3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:34.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.980+0000 7f4382ea1700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437c0b6760 con 0x7f437c0ccdd0 2023-11-26T07:13:34.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.980+0000 7f4382ea1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437c0b5870 con 0x7f437c15e260 2023-11-26T07:13:34.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.980+0000 7f4382ea1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f437c0b5b50 con 0x7f437c0d09e0 2023-11-26T07:13:34.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.980+0000 7f4380c3d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f437c0ccdd0 0x7f437c14d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:34.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.980+0000 7f4380c3d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f437c0ccdd0 0x7f437c14d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41370/0 (socket says 172.21.15.2:41370) 2023-11-26T07:13:34.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.980+0000 7f4380c3d700 1 -- 172.21.15.2:0/147317964 learned_addr learned my addr 172.21.15.2:0/147317964 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:34.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.981+0000 7f438143e700 1 --2- 172.21.15.2:0/147317964 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f437c15e260 0x7f437c1f3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:34.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.981+0000 7f437bfff700 1 --2- 172.21.15.2:0/147317964 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f437c0d09e0 0x7f437c0cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:34.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.981+0000 7f4380c3d700 1 -- 172.21.15.2:0/147317964 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f437c0d09e0 msgr2=0x7f437c0cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:34.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.981+0000 7f4380c3d700 1 --2- 172.21.15.2:0/147317964 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f437c0d09e0 0x7f437c0cb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:34.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.981+0000 7f4380c3d700 1 -- 172.21.15.2:0/147317964 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f437c15e260 msgr2=0x7f437c1f3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:34.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.981+0000 7f4380c3d700 1 --2- 172.21.15.2:0/147317964 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f437c15e260 0x7f437c1f3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:34.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.981+0000 7f4380c3d700 1 -- 172.21.15.2:0/147317964 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4368009550 con 0x7f437c0ccdd0 2023-11-26T07:13:34.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.981+0000 7f4380c3d700 1 --2- 172.21.15.2:0/147317964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f437c0ccdd0 0x7f437c14d050 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f437000c4e0 tx=0x7f437000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:34.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.981+0000 7f43797fa700 1 -- 172.21.15.2:0/147317964 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43700052d0 con 0x7f437c0ccdd0 2023-11-26T07:13:34.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.981+0000 7f43797fa700 1 -- 172.21.15.2:0/147317964 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4370005430 con 0x7f437c0ccdd0 2023-11-26T07:13:34.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.981+0000 7f4382ea1700 1 -- 172.21.15.2:0/147317964 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f437c0b5e30 con 0x7f437c0ccdd0 2023-11-26T07:13:34.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.981+0000 7f43797fa700 1 -- 172.21.15.2:0/147317964 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43700038c0 con 0x7f437c0ccdd0 2023-11-26T07:13:34.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.981+0000 7f4382ea1700 1 -- 172.21.15.2:0/147317964 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f437c0b63f0 con 0x7f437c0ccdd0 2023-11-26T07:13:34.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.982+0000 7f4382ea1700 1 -- 172.21.15.2:0/147317964 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f437c0b6580 con 0x7f437c0ccdd0 2023-11-26T07:13:34.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.982+0000 7f43797fa700 1 -- 172.21.15.2:0/147317964 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f4370003a20 con 0x7f437c0ccdd0 2023-11-26T07:13:34.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.983+0000 7f43797fa700 1 --2- 172.21.15.2:0/147317964 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f436006b1a0 0x7f436006d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:34.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.983+0000 7f43797fa700 1 -- 172.21.15.2:0/147317964 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f4370088dd0 con 0x7f437c0ccdd0 2023-11-26T07:13:34.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.983+0000 7f437bfff700 1 --2- 172.21.15.2:0/147317964 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f436006b1a0 0x7f436006d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:34.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.984+0000 7f437bfff700 1 --2- 172.21.15.2:0/147317964 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f436006b1a0 0x7f436006d660 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4368000c00 tx=0x7f4368008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:34.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:34.987+0000 7f43797fa700 1 -- 172.21.15.2:0/147317964 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4370053b10 con 0x7f437c0ccdd0 2023-11-26T07:13:35.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.189+0000 7f4382ea1700 1 -- 172.21.15.2:0/147317964 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f437c0d1860 con 0x7f437c0ccdd0 2023-11-26T07:13:35.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.191+0000 7f43797fa700 1 -- 172.21.15.2:0/147317964 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16586 (secure 0 0 0) 0x7f4370017090 con 0x7f437c0ccdd0 2023-11-26T07:13:35.193 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:13:35.193 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":34,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:13:26.223324+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:12:27.898687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-26T07:12:28.763512+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":33,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:13:35.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.193+0000 7f4382ea1700 1 -- 172.21.15.2:0/147317964 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f436006b1a0 msgr2=0x7f436006d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:35.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.193+0000 7f4382ea1700 1 --2- 172.21.15.2:0/147317964 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f436006b1a0 0x7f436006d660 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4368000c00 tx=0x7f4368008030 comp rx=0 tx=0).stop 2023-11-26T07:13:35.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.193+0000 7f4382ea1700 1 -- 172.21.15.2:0/147317964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f437c0ccdd0 msgr2=0x7f437c14d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:35.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.193+0000 7f4382ea1700 1 --2- 172.21.15.2:0/147317964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f437c0ccdd0 0x7f437c14d050 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f437000c4e0 tx=0x7f437000c7f0 comp rx=0 tx=0).stop 2023-11-26T07:13:35.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.193+0000 7f4382ea1700 1 -- 172.21.15.2:0/147317964 shutdown_connections 2023-11-26T07:13:35.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.193+0000 7f4382ea1700 1 --2- 172.21.15.2:0/147317964 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f436006b1a0 0x7f436006d660 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:35.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.193+0000 7f4382ea1700 1 --2- 172.21.15.2:0/147317964 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f437c15e260 0x7f437c1f3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:35.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.193+0000 7f4382ea1700 1 --2- 172.21.15.2:0/147317964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f437c0ccdd0 0x7f437c14d050 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:35.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.193+0000 7f4382ea1700 1 --2- 172.21.15.2:0/147317964 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f437c0d09e0 0x7f437c0cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:35.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.193+0000 7f4382ea1700 1 -- 172.21.15.2:0/147317964 >> 172.21.15.2:0/147317964 conn(0x7f437c0b3790 msgr2=0x7f437c0cf270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:35.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.193+0000 7f4382ea1700 1 -- 172.21.15.2:0/147317964 shutdown_connections 2023-11-26T07:13:35.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.193+0000 7f4382ea1700 1 -- 172.21.15.2:0/147317964 wait complete. 2023-11-26T07:13:35.207 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:11:28.205739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:12:27.898687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:12:28.763512+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 33, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:13:35.207 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:13:35.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.333+0000 7f26f0b55700 1 Processor -- start 2023-11-26T07:13:35.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.333+0000 7f26f0b55700 1 -- start start 2023-11-26T07:13:35.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.334+0000 7f26f0b55700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26ec06b620 0x7f26ec0b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:35.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.334+0000 7f26f0b55700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f26ec06ee60 0x7f26ec0b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:35.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.334+0000 7f26f0b55700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26ec071f50 con 0x7f26ec0b5ab0 2023-11-26T07:13:35.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.334+0000 7f26f0b55700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26ec072230 con 0x7f26ec06ee60 2023-11-26T07:13:35.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.334+0000 7f26f0b55700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26ec072510 con 0x7f26ec06b620 2023-11-26T07:13:35.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.334+0000 7f26e9d9b700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f26ec0b5ab0 0x7f26ec161ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60820/0 (socket says 172.21.15.2:60820) 2023-11-26T07:13:35.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.334+0000 7f26e9d9b700 1 -- 172.21.15.2:0/3166875513 learned_addr learned my addr 172.21.15.2:0/3166875513 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:13:35.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.334+0000 7f26ead9d700 1 --2- 172.21.15.2:0/3166875513 >> v2:172.21.15.2:3300/0 conn(0x7f26ec06ee60 0x7f26ec0b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:35.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.334+0000 7f26ea59c700 1 --2- 172.21.15.2:0/3166875513 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26ec06b620 0x7f26ec0b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:35.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.334+0000 7f26ead9d700 1 -- 172.21.15.2:0/3166875513 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26ec06b620 msgr2=0x7f26ec0b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:35.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.334+0000 7f26ead9d700 1 --2- 172.21.15.2:0/3166875513 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26ec06b620 0x7f26ec0b3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:35.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.334+0000 7f26ead9d700 1 -- 172.21.15.2:0/3166875513 >> v1:172.21.15.2:6789/0 conn(0x7f26ec0b5ab0 legacy=0x7f26ec161ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:35.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.334+0000 7f26ead9d700 1 -- 172.21.15.2:0/3166875513 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26ec0727f0 con 0x7f26ec06ee60 2023-11-26T07:13:35.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.334+0000 7f26e959a700 1 -- 172.21.15.2:0/3166875513 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 240079224 0 0) 0x7f26ec071f50 con 0x7f26ec0b5ab0 2023-11-26T07:13:35.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.334+0000 7f26ead9d700 1 --2- 172.21.15.2:0/3166875513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26ec06ee60 0x7f26ec0b3f80 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f26e4009d90 tx=0x7f26e400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3926bf5ed921ac62 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:35.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.335+0000 7f26e959a700 1 -- 172.21.15.2:0/3166875513 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e400e070 con 0x7f26ec06ee60 2023-11-26T07:13:35.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.335+0000 7f26e959a700 1 -- 172.21.15.2:0/3166875513 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e400bbd0 con 0x7f26ec06ee60 2023-11-26T07:13:35.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.335+0000 7f26e959a700 1 -- 172.21.15.2:0/3166875513 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e4012430 con 0x7f26ec06ee60 2023-11-26T07:13:35.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.335+0000 7f26f0b55700 1 -- 172.21.15.2:0/3166875513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26ec06ee60 msgr2=0x7f26ec0b3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:35.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.335+0000 7f26f0b55700 1 --2- 172.21.15.2:0/3166875513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26ec06ee60 0x7f26ec0b3f80 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f26e4009d90 tx=0x7f26e400b330 comp rx=0 tx=0).stop 2023-11-26T07:13:35.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.335+0000 7f26f0b55700 1 -- 172.21.15.2:0/3166875513 shutdown_connections 2023-11-26T07:13:35.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.335+0000 7f26f0b55700 1 --2- 172.21.15.2:0/3166875513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26ec06ee60 0x7f26ec0b3f80 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:35.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.335+0000 7f26f0b55700 1 --2- 172.21.15.2:0/3166875513 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26ec06b620 0x7f26ec0b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:35.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.335+0000 7f26f0b55700 1 -- 172.21.15.2:0/3166875513 >> 172.21.15.2:0/3166875513 conn(0x7f26ec0b2740 msgr2=0x7f26ec0b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:35.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.335+0000 7f26f0b55700 1 -- 172.21.15.2:0/3166875513 shutdown_connections 2023-11-26T07:13:35.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.335+0000 7f26f0b55700 1 -- 172.21.15.2:0/3166875513 wait complete. 2023-11-26T07:13:35.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.337+0000 7f26f0b55700 1 Processor -- start 2023-11-26T07:13:35.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.337+0000 7f26f0b55700 1 -- start start 2023-11-26T07:13:35.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.337+0000 7f26f0b55700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26ec06b620 0x7f26ec0c7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:35.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.337+0000 7f26f0b55700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26ec06ee60 0x7f26ec143280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:35.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.337+0000 7f26f0b55700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26ec0b5ab0 0x7f26ec1e5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:35.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.337+0000 7f26f0b55700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ec0c7840 con 0x7f26ec0b5ab0 2023-11-26T07:13:35.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.337+0000 7f26f0b55700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ec0c6f30 con 0x7f26ec06b620 2023-11-26T07:13:35.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.337+0000 7f26f0b55700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26ec0adbb0 con 0x7f26ec06ee60 2023-11-26T07:13:35.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.338+0000 7f26ead9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26ec0b5ab0 0x7f26ec1e5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:35.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.338+0000 7f26ead9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26ec0b5ab0 0x7f26ec1e5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41388/0 (socket says 172.21.15.2:41388) 2023-11-26T07:13:35.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.338+0000 7f26ead9d700 1 -- 172.21.15.2:0/2758791221 learned_addr learned my addr 172.21.15.2:0/2758791221 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:35.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.338+0000 7f26e9d9b700 1 --2- 172.21.15.2:0/2758791221 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26ec06ee60 0x7f26ec143280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:35.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.338+0000 7f26ea59c700 1 --2- 172.21.15.2:0/2758791221 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26ec06b620 0x7f26ec0c7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:35.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.338+0000 7f26ead9d700 1 -- 172.21.15.2:0/2758791221 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26ec06ee60 msgr2=0x7f26ec143280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:35.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.338+0000 7f26ead9d700 1 --2- 172.21.15.2:0/2758791221 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26ec06ee60 0x7f26ec143280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:35.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.338+0000 7f26ead9d700 1 -- 172.21.15.2:0/2758791221 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26ec06b620 msgr2=0x7f26ec0c7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:35.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.338+0000 7f26ead9d700 1 --2- 172.21.15.2:0/2758791221 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26ec06b620 0x7f26ec0c7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:35.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.338+0000 7f26ead9d700 1 -- 172.21.15.2:0/2758791221 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e4009a70 con 0x7f26ec0b5ab0 2023-11-26T07:13:35.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.338+0000 7f26ead9d700 1 --2- 172.21.15.2:0/2758791221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26ec0b5ab0 0x7f26ec1e5c40 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f26e4013000 tx=0x7f26e4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:35.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.338+0000 7f26daffd700 1 -- 172.21.15.2:0/2758791221 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e4012e20 con 0x7f26ec0b5ab0 2023-11-26T07:13:35.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.338+0000 7f26daffd700 1 -- 172.21.15.2:0/2758791221 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e4020070 con 0x7f26ec0b5ab0 2023-11-26T07:13:35.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.338+0000 7f26f0b55700 1 -- 172.21.15.2:0/2758791221 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26ec0c5e90 con 0x7f26ec0b5ab0 2023-11-26T07:13:35.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.338+0000 7f26daffd700 1 -- 172.21.15.2:0/2758791221 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e4004280 con 0x7f26ec0b5ab0 2023-11-26T07:13:35.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.338+0000 7f26f0b55700 1 -- 172.21.15.2:0/2758791221 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26ec0c6450 con 0x7f26ec0b5ab0 2023-11-26T07:13:35.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.339+0000 7f26f0b55700 1 -- 172.21.15.2:0/2758791221 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26ec0c6d80 con 0x7f26ec0b5ab0 2023-11-26T07:13:35.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.340+0000 7f26daffd700 1 -- 172.21.15.2:0/2758791221 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f26e40043e0 con 0x7f26ec0b5ab0 2023-11-26T07:13:35.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.340+0000 7f26daffd700 1 --2- 172.21.15.2:0/2758791221 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f26cc06b1a0 0x7f26cc06d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:35.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.340+0000 7f26daffd700 1 -- 172.21.15.2:0/2758791221 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f26e4022070 con 0x7f26ec0b5ab0 2023-11-26T07:13:35.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.340+0000 7f26ea59c700 1 --2- 172.21.15.2:0/2758791221 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f26cc06b1a0 0x7f26cc06d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:35.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.341+0000 7f26ea59c700 1 --2- 172.21.15.2:0/2758791221 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f26cc06b1a0 0x7f26cc06d660 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f26ec06fbd0 tx=0x7f26dc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:35.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.345+0000 7f26daffd700 1 -- 172.21.15.2:0/2758791221 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f26e4056d10 con 0x7f26ec0b5ab0 2023-11-26T07:13:35.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.544+0000 7f26f0b55700 1 -- 172.21.15.2:0/2758791221 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f26ec075480 con 0x7f26ec0b5ab0 2023-11-26T07:13:35.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.545+0000 7f26daffd700 1 -- 172.21.15.2:0/2758791221 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7f26e405a330 con 0x7f26ec0b5ab0 2023-11-26T07:13:35.547 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-26T07:13:35.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.547+0000 7f26f0b55700 1 -- 172.21.15.2:0/2758791221 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f26cc06b1a0 msgr2=0x7f26cc06d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:35.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.547+0000 7f26f0b55700 1 --2- 172.21.15.2:0/2758791221 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f26cc06b1a0 0x7f26cc06d660 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f26ec06fbd0 tx=0x7f26dc008040 comp rx=0 tx=0).stop 2023-11-26T07:13:35.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.547+0000 7f26f0b55700 1 -- 172.21.15.2:0/2758791221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26ec0b5ab0 msgr2=0x7f26ec1e5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:35.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.547+0000 7f26f0b55700 1 --2- 172.21.15.2:0/2758791221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26ec0b5ab0 0x7f26ec1e5c40 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f26e4013000 tx=0x7f26e4004ad0 comp rx=0 tx=0).stop 2023-11-26T07:13:35.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.547+0000 7f26f0b55700 1 -- 172.21.15.2:0/2758791221 shutdown_connections 2023-11-26T07:13:35.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.547+0000 7f26f0b55700 1 --2- 172.21.15.2:0/2758791221 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f26cc06b1a0 0x7f26cc06d660 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:35.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.547+0000 7f26f0b55700 1 --2- 172.21.15.2:0/2758791221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26ec0b5ab0 0x7f26ec1e5c40 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:35.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.547+0000 7f26f0b55700 1 --2- 172.21.15.2:0/2758791221 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26ec06b620 0x7f26ec0c7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:35.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.547+0000 7f26f0b55700 1 --2- 172.21.15.2:0/2758791221 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26ec06ee60 0x7f26ec143280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:35.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.547+0000 7f26f0b55700 1 -- 172.21.15.2:0/2758791221 >> 172.21.15.2:0/2758791221 conn(0x7f26ec0b2740 msgr2=0x7f26ec0aefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:35.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.547+0000 7f26f0b55700 1 -- 172.21.15.2:0/2758791221 shutdown_connections 2023-11-26T07:13:35.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.547+0000 7f26f0b55700 1 -- 172.21.15.2:0/2758791221 wait complete. 2023-11-26T07:13:35.561 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:13:35.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.686+0000 7ff7282dd700 1 Processor -- start 2023-11-26T07:13:35.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.686+0000 7ff7282dd700 1 -- start start 2023-11-26T07:13:35.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.687+0000 7ff7282dd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff7200cf020 0x7ff72006ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:35.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.687+0000 7ff7282dd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff72006f2b0 0x7ff7200cd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:35.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.687+0000 7ff7282dd700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7200cf7d0 con 0x7ff7200d01e0 2023-11-26T07:13:35.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.687+0000 7ff7282dd700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7200cfa20 con 0x7ff72006f2b0 2023-11-26T07:13:35.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.687+0000 7ff7282dd700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7200cfd00 con 0x7ff7200cf020 2023-11-26T07:13:35.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.687+0000 7ff72687a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff72006f2b0 0x7ff7200cd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:35.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.687+0000 7ff726079700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff7200d01e0 0x7ff7200d05c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60834/0 (socket says 172.21.15.2:60834) 2023-11-26T07:13:35.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.687+0000 7ff72687a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff72006f2b0 0x7ff7200cd260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41396/0 (socket says 172.21.15.2:41396) 2023-11-26T07:13:35.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.687+0000 7ff726079700 1 -- 172.21.15.2:0/515833844 learned_addr learned my addr 172.21.15.2:0/515833844 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:13:35.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.688+0000 7ff725878700 1 --2- 172.21.15.2:0/515833844 >> v2:172.21.15.192:3300/0 conn(0x7ff7200cf020 0x7ff72006ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:35.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.688+0000 7ff72687a700 1 -- 172.21.15.2:0/515833844 >> v2:172.21.15.192:3300/0 conn(0x7ff7200cf020 msgr2=0x7ff72006ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:35.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.688+0000 7ff72687a700 1 --2- 172.21.15.2:0/515833844 >> v2:172.21.15.192:3300/0 conn(0x7ff7200cf020 0x7ff72006ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:35.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.688+0000 7ff72687a700 1 -- 172.21.15.2:0/515833844 >> v1:172.21.15.2:6789/0 conn(0x7ff7200d01e0 legacy=0x7ff7200d05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:35.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.688+0000 7ff72687a700 1 -- 172.21.15.2:0/515833844 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7200cca60 con 0x7ff72006f2b0 2023-11-26T07:13:35.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.688+0000 7ff725077700 1 -- 172.21.15.2:0/515833844 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1097727769 0 0) 0x7ff7200cf7d0 con 0x7ff7200d01e0 2023-11-26T07:13:35.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.688+0000 7ff72687a700 1 --2- 172.21.15.2:0/515833844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff72006f2b0 0x7ff7200cd260 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff72006bf40 tx=0x7ff71800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d98c755742a9216f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:35.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.688+0000 7ff725077700 1 -- 172.21.15.2:0/515833844 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71800e070 con 0x7ff72006f2b0 2023-11-26T07:13:35.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.688+0000 7ff725077700 1 -- 172.21.15.2:0/515833844 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff71800bbd0 con 0x7ff72006f2b0 2023-11-26T07:13:35.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.688+0000 7ff725077700 1 -- 172.21.15.2:0/515833844 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff718012430 con 0x7ff72006f2b0 2023-11-26T07:13:35.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.689+0000 7ff7282dd700 1 -- 172.21.15.2:0/515833844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff72006f2b0 msgr2=0x7ff7200cd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:35.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.689+0000 7ff7282dd700 1 --2- 172.21.15.2:0/515833844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff72006f2b0 0x7ff7200cd260 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff72006bf40 tx=0x7ff71800b330 comp rx=0 tx=0).stop 2023-11-26T07:13:35.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.689+0000 7ff7282dd700 1 -- 172.21.15.2:0/515833844 shutdown_connections 2023-11-26T07:13:35.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.689+0000 7ff7282dd700 1 --2- 172.21.15.2:0/515833844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff72006f2b0 0x7ff7200cd260 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:35.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.689+0000 7ff7282dd700 1 --2- 172.21.15.2:0/515833844 >> v2:172.21.15.192:3300/0 conn(0x7ff7200cf020 0x7ff72006ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:35.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.689+0000 7ff7282dd700 1 -- 172.21.15.2:0/515833844 >> 172.21.15.2:0/515833844 conn(0x7ff7200b3790 msgr2=0x7ff7200b3ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:35.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.689+0000 7ff7282dd700 1 -- 172.21.15.2:0/515833844 shutdown_connections 2023-11-26T07:13:35.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.689+0000 7ff7282dd700 1 -- 172.21.15.2:0/515833844 wait complete. 2023-11-26T07:13:35.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.690+0000 7ff7282dd700 1 Processor -- start 2023-11-26T07:13:35.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.690+0000 7ff7282dd700 1 -- start start 2023-11-26T07:13:35.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.691+0000 7ff7282dd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff72006f2b0 0x7ff7201e7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:35.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.691+0000 7ff7282dd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7200cf020 0x7ff7200c6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:35.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.691+0000 7ff7282dd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7200d01e0 0x7ff720149ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:35.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.691+0000 7ff7282dd700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7201e5820 con 0x7ff7200d01e0 2023-11-26T07:13:35.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.691+0000 7ff7282dd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7200c6e80 con 0x7ff7200cf020 2023-11-26T07:13:35.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.691+0000 7ff7282dd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7200c7160 con 0x7ff72006f2b0 2023-11-26T07:13:35.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.691+0000 7ff72687a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7200d01e0 0x7ff720149ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:35.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.691+0000 7ff72687a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7200d01e0 0x7ff720149ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41402/0 (socket says 172.21.15.2:41402) 2023-11-26T07:13:35.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.691+0000 7ff72687a700 1 -- 172.21.15.2:0/250602543 learned_addr learned my addr 172.21.15.2:0/250602543 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:35.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.691+0000 7ff72687a700 1 -- 172.21.15.2:0/250602543 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff72006f2b0 msgr2=0x7ff7201e7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:35.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.691+0000 7ff72687a700 1 --2- 172.21.15.2:0/250602543 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff72006f2b0 0x7ff7201e7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:35.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.691+0000 7ff72687a700 1 -- 172.21.15.2:0/250602543 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7200cf020 msgr2=0x7ff7200c6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:35.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.691+0000 7ff725878700 1 --2- 172.21.15.2:0/250602543 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7200cf020 0x7ff7200c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:35.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.691+0000 7ff72687a700 1 --2- 172.21.15.2:0/250602543 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7200cf020 0x7ff7200c6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:35.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.691+0000 7ff72687a700 1 -- 172.21.15.2:0/250602543 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff718009a70 con 0x7ff7200d01e0 2023-11-26T07:13:35.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.691+0000 7ff72687a700 1 --2- 172.21.15.2:0/250602543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7200d01e0 0x7ff720149ef0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff720071fb0 tx=0x7ff718004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:35.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.691+0000 7ff712ffd700 1 -- 172.21.15.2:0/250602543 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff718012430 con 0x7ff7200d01e0 2023-11-26T07:13:35.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.692+0000 7ff712ffd700 1 -- 172.21.15.2:0/250602543 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff718020070 con 0x7ff7200d01e0 2023-11-26T07:13:35.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.692+0000 7ff712ffd700 1 -- 172.21.15.2:0/250602543 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff718004280 con 0x7ff7200d01e0 2023-11-26T07:13:35.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.692+0000 7ff7282dd700 1 -- 172.21.15.2:0/250602543 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7200cf620 con 0x7ff7200d01e0 2023-11-26T07:13:35.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.692+0000 7ff7282dd700 1 -- 172.21.15.2:0/250602543 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7200c7720 con 0x7ff7200d01e0 2023-11-26T07:13:35.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.692+0000 7ff7282dd700 1 -- 172.21.15.2:0/250602543 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff720075480 con 0x7ff7200d01e0 2023-11-26T07:13:35.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.693+0000 7ff712ffd700 1 -- 172.21.15.2:0/250602543 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7ff7180043e0 con 0x7ff7200d01e0 2023-11-26T07:13:35.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.694+0000 7ff712ffd700 1 --2- 172.21.15.2:0/250602543 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff70406b1a0 0x7ff70406d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:35.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.694+0000 7ff712ffd700 1 -- 172.21.15.2:0/250602543 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5737+0+0 (secure 0 0 0) 0x7ff718022070 con 0x7ff7200d01e0 2023-11-26T07:13:35.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.694+0000 7ff726079700 1 --2- 172.21.15.2:0/250602543 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff70406b1a0 0x7ff70406d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:35.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.694+0000 7ff726079700 1 --2- 172.21.15.2:0/250602543 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff70406b1a0 0x7ff70406d660 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff71c001610 tx=0x7ff71c0079f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:35.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.698+0000 7ff712ffd700 1 -- 172.21.15.2:0/250602543 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff718056ba0 con 0x7ff7200d01e0 2023-11-26T07:13:35.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.896+0000 7ff7282dd700 1 -- 172.21.15.2:0/250602543 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff72015ba60 con 0x7ff7200d01e0 2023-11-26T07:13:35.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.897+0000 7ff712ffd700 1 -- 172.21.15.2:0/250602543 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff71802c020 con 0x7ff7200d01e0 2023-11-26T07:13:35.899 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-26T07:13:35.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.899+0000 7ff7282dd700 1 -- 172.21.15.2:0/250602543 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff70406b1a0 msgr2=0x7ff70406d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:35.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.899+0000 7ff7282dd700 1 --2- 172.21.15.2:0/250602543 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff70406b1a0 0x7ff70406d660 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff71c001610 tx=0x7ff71c0079f0 comp rx=0 tx=0).stop 2023-11-26T07:13:35.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.899+0000 7ff7282dd700 1 -- 172.21.15.2:0/250602543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7200d01e0 msgr2=0x7ff720149ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:35.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.899+0000 7ff7282dd700 1 --2- 172.21.15.2:0/250602543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7200d01e0 0x7ff720149ef0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff720071fb0 tx=0x7ff718004ad0 comp rx=0 tx=0).stop 2023-11-26T07:13:35.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.899+0000 7ff7282dd700 1 -- 172.21.15.2:0/250602543 shutdown_connections 2023-11-26T07:13:35.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.899+0000 7ff7282dd700 1 --2- 172.21.15.2:0/250602543 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff70406b1a0 0x7ff70406d660 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:35.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.899+0000 7ff7282dd700 1 --2- 172.21.15.2:0/250602543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7200d01e0 0x7ff720149ef0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:35.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.899+0000 7ff7282dd700 1 --2- 172.21.15.2:0/250602543 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff72006f2b0 0x7ff7201e7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:35.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.899+0000 7ff7282dd700 1 --2- 172.21.15.2:0/250602543 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7200cf020 0x7ff7200c6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:35.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.899+0000 7ff7282dd700 1 -- 172.21.15.2:0/250602543 >> 172.21.15.2:0/250602543 conn(0x7ff7200b3790 msgr2=0x7ff720070620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:35.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.899+0000 7ff7282dd700 1 -- 172.21.15.2:0/250602543 shutdown_connections 2023-11-26T07:13:35.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:35.899+0000 7ff7282dd700 1 -- 172.21.15.2:0/250602543 wait complete. 2023-11-26T07:13:35.913 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:13:36.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.039+0000 7f2451812700 1 Processor -- start 2023-11-26T07:13:36.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.039+0000 7f2451812700 1 -- start start 2023-11-26T07:13:36.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.040+0000 7f2451812700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f244c15e080 0x7f244c0cfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:36.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.040+0000 7f2451812700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f244c0d2440 0x7f244c0d28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:36.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.040+0000 7f2451812700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f244c0d2de0 con 0x7f244c0d0740 2023-11-26T07:13:36.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.040+0000 7f2451812700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f244c0d14b0 con 0x7f244c0d2440 2023-11-26T07:13:36.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.040+0000 7f2451812700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f244c0ce9a0 con 0x7f244c15e080 2023-11-26T07:13:36.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.040+0000 7f244a7fc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f244c0d2440 0x7f244c0d28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:36.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.040+0000 7f244a7fc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f244c0d2440 0x7f244c0d28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41406/0 (socket says 172.21.15.2:41406) 2023-11-26T07:13:36.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.040+0000 7f244a7fc700 1 -- 172.21.15.2:0/3862559306 learned_addr learned my addr 172.21.15.2:0/3862559306 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:36.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.040+0000 7f244affd700 1 --2- 172.21.15.2:0/3862559306 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f244c15e080 0x7f244c0cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:36.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.040+0000 7f244a7fc700 1 -- 172.21.15.2:0/3862559306 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f244c15e080 msgr2=0x7f244c0cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:36.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.040+0000 7f244a7fc700 1 --2- 172.21.15.2:0/3862559306 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f244c15e080 0x7f244c0cfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:36.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.040+0000 7f244a7fc700 1 -- 172.21.15.2:0/3862559306 >> v1:172.21.15.192:6789/0 conn(0x7f244c0d0740 legacy=0x7f244c0d0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:36.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.040+0000 7f244a7fc700 1 -- 172.21.15.2:0/3862559306 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f244c0cec40 con 0x7f244c0d2440 2023-11-26T07:13:36.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.040+0000 7f244affd700 1 --2- 172.21.15.2:0/3862559306 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f244c15e080 0x7f244c0cfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:13:36.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.041+0000 7f244a7fc700 1 --2- 172.21.15.2:0/3862559306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f244c0d2440 0x7f244c0d28a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f243c0098f0 tx=0x7f243c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be37872866399b83 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:36.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.041+0000 7f2449ffb700 1 -- 172.21.15.2:0/3862559306 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c00b8a0 con 0x7f244c0d2440 2023-11-26T07:13:36.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.041+0000 7f2449ffb700 1 -- 172.21.15.2:0/3862559306 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243c00ba00 con 0x7f244c0d2440 2023-11-26T07:13:36.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.041+0000 7f2449ffb700 1 -- 172.21.15.2:0/3862559306 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c00bd90 con 0x7f244c0d2440 2023-11-26T07:13:36.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.041+0000 7f2451812700 1 -- 172.21.15.2:0/3862559306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f244c0d2440 msgr2=0x7f244c0d28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:36.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.041+0000 7f2451812700 1 --2- 172.21.15.2:0/3862559306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f244c0d2440 0x7f244c0d28a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f243c0098f0 tx=0x7f243c009c00 comp rx=0 tx=0).stop 2023-11-26T07:13:36.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.041+0000 7f2451812700 1 -- 172.21.15.2:0/3862559306 shutdown_connections 2023-11-26T07:13:36.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.041+0000 7f2451812700 1 --2- 172.21.15.2:0/3862559306 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f244c15e080 0x7f244c0cfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:36.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.041+0000 7f2451812700 1 --2- 172.21.15.2:0/3862559306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f244c0d2440 0x7f244c0d28a0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:36.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.041+0000 7f2451812700 1 -- 172.21.15.2:0/3862559306 >> 172.21.15.2:0/3862559306 conn(0x7f244c09d180 msgr2=0x7f244c0d3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:36.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.041+0000 7f2451812700 1 -- 172.21.15.2:0/3862559306 shutdown_connections 2023-11-26T07:13:36.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.041+0000 7f2451812700 1 -- 172.21.15.2:0/3862559306 wait complete. 2023-11-26T07:13:36.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.042+0000 7f2451812700 1 Processor -- start 2023-11-26T07:13:36.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.043+0000 7f2451812700 1 -- start start 2023-11-26T07:13:36.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.043+0000 7f2451812700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f244c0d0740 0x7f244c155080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:36.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.043+0000 7f2451812700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f244c0d2440 0x7f244c0b95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:36.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.043+0000 7f2451812700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f244c15e080 0x7f244c159810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:36.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.043+0000 7f2451812700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244c0b9b20 con 0x7f244c15e080 2023-11-26T07:13:36.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.043+0000 7f2451812700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244c0c83e0 con 0x7f244c0d0740 2023-11-26T07:13:36.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.043+0000 7f2451812700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f244c0c86c0 con 0x7f244c0d2440 2023-11-26T07:13:36.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.044+0000 7f244b7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f244c15e080 0x7f244c159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:36.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.044+0000 7f244affd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f244c0d0740 0x7f244c155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:36.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.044+0000 7f244b7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f244c15e080 0x7f244c159810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41416/0 (socket says 172.21.15.2:41416) 2023-11-26T07:13:36.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.044+0000 7f244b7fe700 1 -- 172.21.15.2:0/3379009922 learned_addr learned my addr 172.21.15.2:0/3379009922 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:36.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.044+0000 7f244a7fc700 1 --2- 172.21.15.2:0/3379009922 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f244c0d2440 0x7f244c0b95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:36.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.044+0000 7f244b7fe700 1 -- 172.21.15.2:0/3379009922 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f244c0d2440 msgr2=0x7f244c0b95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:36.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.044+0000 7f244b7fe700 1 --2- 172.21.15.2:0/3379009922 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f244c0d2440 0x7f244c0b95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:36.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.044+0000 7f244b7fe700 1 -- 172.21.15.2:0/3379009922 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f244c0d0740 msgr2=0x7f244c155080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:36.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.044+0000 7f244b7fe700 1 --2- 172.21.15.2:0/3379009922 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f244c0d0740 0x7f244c155080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:36.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.044+0000 7f244b7fe700 1 -- 172.21.15.2:0/3379009922 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f243c009550 con 0x7f244c15e080 2023-11-26T07:13:36.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.044+0000 7f244b7fe700 1 --2- 172.21.15.2:0/3379009922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f244c15e080 0x7f244c159810 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f244400cc50 tx=0x7f244400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:36.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.044+0000 7f2433fff700 1 -- 172.21.15.2:0/3379009922 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2444003c00 con 0x7f244c15e080 2023-11-26T07:13:36.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.044+0000 7f2433fff700 1 -- 172.21.15.2:0/3379009922 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2444003d60 con 0x7f244c15e080 2023-11-26T07:13:36.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.044+0000 7f2451812700 1 -- 172.21.15.2:0/3379009922 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f244c0c89a0 con 0x7f244c15e080 2023-11-26T07:13:36.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.044+0000 7f2433fff700 1 -- 172.21.15.2:0/3379009922 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244400aab0 con 0x7f244c15e080 2023-11-26T07:13:36.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.044+0000 7f2451812700 1 -- 172.21.15.2:0/3379009922 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f244c0c7e90 con 0x7f244c15e080 2023-11-26T07:13:36.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.045+0000 7f2451812700 1 -- 172.21.15.2:0/3379009922 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f244c0c8ff0 con 0x7f244c15e080 2023-11-26T07:13:36.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.046+0000 7f2433fff700 1 -- 172.21.15.2:0/3379009922 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f244400ac10 con 0x7f244c15e080 2023-11-26T07:13:36.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.046+0000 7f2433fff700 1 --2- 172.21.15.2:0/3379009922 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f243806b1a0 0x7f243806d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:36.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.046+0000 7f2433fff700 1 -- 172.21.15.2:0/3379009922 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f24440899d0 con 0x7f244c15e080 2023-11-26T07:13:36.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.047+0000 7f244affd700 1 --2- 172.21.15.2:0/3379009922 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f243806b1a0 0x7f243806d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:36.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.047+0000 7f244affd700 1 --2- 172.21.15.2:0/3379009922 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f243806b1a0 0x7f243806d660 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2440006f10 tx=0x7f2440008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:36.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.051+0000 7f2433fff700 1 -- 172.21.15.2:0/3379009922 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2444054760 con 0x7f244c15e080 2023-11-26T07:13:36.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.253+0000 7f2451812700 1 -- 172.21.15.2:0/3379009922 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f244c075480 con 0x7f244c15e080 2023-11-26T07:13:36.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.253+0000 7f2433fff700 1 -- 172.21.15.2:0/3379009922 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2444057d80 con 0x7f244c15e080 2023-11-26T07:13:36.255 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-26T07:13:36.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.255+0000 7f2451812700 1 -- 172.21.15.2:0/3379009922 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f243806b1a0 msgr2=0x7f243806d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:36.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.255+0000 7f2451812700 1 --2- 172.21.15.2:0/3379009922 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f243806b1a0 0x7f243806d660 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2440006f10 tx=0x7f2440008040 comp rx=0 tx=0).stop 2023-11-26T07:13:36.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.255+0000 7f2451812700 1 -- 172.21.15.2:0/3379009922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f244c15e080 msgr2=0x7f244c159810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:36.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.255+0000 7f2451812700 1 --2- 172.21.15.2:0/3379009922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f244c15e080 0x7f244c159810 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f244400cc50 tx=0x7f244400cf60 comp rx=0 tx=0).stop 2023-11-26T07:13:36.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.255+0000 7f2451812700 1 -- 172.21.15.2:0/3379009922 shutdown_connections 2023-11-26T07:13:36.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.255+0000 7f2451812700 1 --2- 172.21.15.2:0/3379009922 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f243806b1a0 0x7f243806d660 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:36.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.255+0000 7f2451812700 1 --2- 172.21.15.2:0/3379009922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f244c15e080 0x7f244c159810 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:36.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.255+0000 7f2451812700 1 --2- 172.21.15.2:0/3379009922 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f244c0d0740 0x7f244c155080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:36.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.255+0000 7f2451812700 1 --2- 172.21.15.2:0/3379009922 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f244c0d2440 0x7f244c0b95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:36.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.255+0000 7f2451812700 1 -- 172.21.15.2:0/3379009922 >> 172.21.15.2:0/3379009922 conn(0x7f244c09d180 msgr2=0x7f244c15f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:36.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.255+0000 7f2451812700 1 -- 172.21.15.2:0/3379009922 shutdown_connections 2023-11-26T07:13:36.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.255+0000 7f2451812700 1 -- 172.21.15.2:0/3379009922 wait complete. 2023-11-26T07:13:36.270 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-26T07:13:36.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.393+0000 7fd912af6700 1 Processor -- start 2023-11-26T07:13:36.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.393+0000 7fd912af6700 1 -- start start 2023-11-26T07:13:36.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.394+0000 7fd912af6700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd90c0b5ab0 0x7fd90c06e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:36.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.394+0000 7fd912af6700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd90c071f50 con 0x7fd90c0b4150 2023-11-26T07:13:36.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.394+0000 7fd912af6700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd90c072230 con 0x7fd90c06b620 2023-11-26T07:13:36.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.394+0000 7fd912af6700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd90c072510 con 0x7fd90c0b5ab0 2023-11-26T07:13:36.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.394+0000 7fd911093700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd90c0b5ab0 0x7fd90c06e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:36.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.394+0000 7fd90bfff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd90c0b4150 0x7fd90c06de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60862/0 (socket says 172.21.15.2:60862) 2023-11-26T07:13:36.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.394+0000 7fd90bfff700 1 -- 172.21.15.2:0/2504353107 learned_addr learned my addr 172.21.15.2:0/2504353107 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:13:36.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.395+0000 7fd911093700 1 -- 172.21.15.2:0/2504353107 >> v1:172.21.15.192:6789/0 conn(0x7fd90c06b620 legacy=0x7fd90c0b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:36.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.395+0000 7fd911093700 1 -- 172.21.15.2:0/2504353107 >> v1:172.21.15.2:6789/0 conn(0x7fd90c0b4150 legacy=0x7fd90c06de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:36.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.395+0000 7fd911093700 1 -- 172.21.15.2:0/2504353107 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd90c0727f0 con 0x7fd90c0b5ab0 2023-11-26T07:13:36.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.395+0000 7fd911093700 1 --2- 172.21.15.2:0/2504353107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd90c0b5ab0 0x7fd90c06e560 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd904009d90 tx=0x7fd90400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=173b44910b385e65 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:36.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.395+0000 7fd90b7fe700 1 -- 172.21.15.2:0/2504353107 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90400e070 con 0x7fd90c0b5ab0 2023-11-26T07:13:36.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.395+0000 7fd90b7fe700 1 -- 172.21.15.2:0/2504353107 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90400bb90 con 0x7fd90c0b5ab0 2023-11-26T07:13:36.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.395+0000 7fd90b7fe700 1 -- 172.21.15.2:0/2504353107 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd904003a20 con 0x7fd90c0b5ab0 2023-11-26T07:13:36.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.395+0000 7fd912af6700 1 -- 172.21.15.2:0/2504353107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd90c0b5ab0 msgr2=0x7fd90c06e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:36.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.395+0000 7fd912af6700 1 --2- 172.21.15.2:0/2504353107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd90c0b5ab0 0x7fd90c06e560 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd904009d90 tx=0x7fd90400b330 comp rx=0 tx=0).stop 2023-11-26T07:13:36.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.395+0000 7fd912af6700 1 -- 172.21.15.2:0/2504353107 shutdown_connections 2023-11-26T07:13:36.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.395+0000 7fd912af6700 1 --2- 172.21.15.2:0/2504353107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd90c0b5ab0 0x7fd90c06e560 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:36.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.395+0000 7fd912af6700 1 -- 172.21.15.2:0/2504353107 >> 172.21.15.2:0/2504353107 conn(0x7fd90c0b2740 msgr2=0x7fd90c0b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:36.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.396+0000 7fd912af6700 1 -- 172.21.15.2:0/2504353107 shutdown_connections 2023-11-26T07:13:36.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.396+0000 7fd912af6700 1 -- 172.21.15.2:0/2504353107 wait complete. 2023-11-26T07:13:36.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.397+0000 7fd912af6700 1 Processor -- start 2023-11-26T07:13:36.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.397+0000 7fd912af6700 1 -- start start 2023-11-26T07:13:36.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.398+0000 7fd912af6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd90c06b620 0x7fd90c1330a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:36.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.398+0000 7fd912af6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd90c0b4150 0x7fd90c0c7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:36.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.398+0000 7fd912af6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd90c0b5ab0 0x7fd90c0cf500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:36.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.398+0000 7fd912af6700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90c0c7960 con 0x7fd90c0b4150 2023-11-26T07:13:36.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.398+0000 7fd912af6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90c1f7a50 con 0x7fd90c06b620 2023-11-26T07:13:36.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.398+0000 7fd912af6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd90c1f7d30 con 0x7fd90c0b5ab0 2023-11-26T07:13:36.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.398+0000 7fd90bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd90c0b4150 0x7fd90c0c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:36.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.398+0000 7fd90bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd90c0b4150 0x7fd90c0c7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41426/0 (socket says 172.21.15.2:41426) 2023-11-26T07:13:36.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.398+0000 7fd90bfff700 1 -- 172.21.15.2:0/3851848817 learned_addr learned my addr 172.21.15.2:0/3851848817 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:36.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.398+0000 7fd911093700 1 --2- 172.21.15.2:0/3851848817 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd90c0b5ab0 0x7fd90c0cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:36.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.398+0000 7fd910892700 1 --2- 172.21.15.2:0/3851848817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd90c06b620 0x7fd90c1330a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:36.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.398+0000 7fd90bfff700 1 -- 172.21.15.2:0/3851848817 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd90c0b5ab0 msgr2=0x7fd90c0cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:36.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.398+0000 7fd90bfff700 1 --2- 172.21.15.2:0/3851848817 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd90c0b5ab0 0x7fd90c0cf500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:36.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.398+0000 7fd90bfff700 1 -- 172.21.15.2:0/3851848817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd90c06b620 msgr2=0x7fd90c1330a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:36.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.398+0000 7fd90bfff700 1 --2- 172.21.15.2:0/3851848817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd90c06b620 0x7fd90c1330a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:36.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.398+0000 7fd90bfff700 1 -- 172.21.15.2:0/3851848817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd904009a70 con 0x7fd90c0b4150 2023-11-26T07:13:36.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.398+0000 7fd90bfff700 1 --2- 172.21.15.2:0/3851848817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd90c0b4150 0x7fd90c0c7420 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd8f800c490 tx=0x7fd8f800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:36.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.398+0000 7fd9097fa700 1 -- 172.21.15.2:0/3851848817 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8005d70 con 0x7fd90c0b4150 2023-11-26T07:13:36.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.398+0000 7fd9097fa700 1 -- 172.21.15.2:0/3851848817 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f80070d0 con 0x7fd90c0b4150 2023-11-26T07:13:36.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.398+0000 7fd912af6700 1 -- 172.21.15.2:0/3851848817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd90c1f8010 con 0x7fd90c0b4150 2023-11-26T07:13:36.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.398+0000 7fd9097fa700 1 -- 172.21.15.2:0/3851848817 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8007460 con 0x7fd90c0b4150 2023-11-26T07:13:36.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.398+0000 7fd912af6700 1 -- 172.21.15.2:0/3851848817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd90c1f85d0 con 0x7fd90c0b4150 2023-11-26T07:13:36.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.399+0000 7fd912af6700 1 -- 172.21.15.2:0/3851848817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd90c072e70 con 0x7fd90c0b4150 2023-11-26T07:13:36.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.400+0000 7fd9097fa700 1 -- 172.21.15.2:0/3851848817 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7fd8f80075c0 con 0x7fd90c0b4150 2023-11-26T07:13:36.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.400+0000 7fd9097fa700 1 --2- 172.21.15.2:0/3851848817 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd8f006b1a0 0x7fd8f006d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:36.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.400+0000 7fd9097fa700 1 -- 172.21.15.2:0/3851848817 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fd8f8088ff0 con 0x7fd90c0b4150 2023-11-26T07:13:36.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.400+0000 7fd910892700 1 --2- 172.21.15.2:0/3851848817 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd8f006b1a0 0x7fd8f006d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:36.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.401+0000 7fd910892700 1 --2- 172.21.15.2:0/3851848817 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd8f006b1a0 0x7fd8f006d660 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd90000a7d0 tx=0x7fd900008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:36.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.405+0000 7fd9097fa700 1 -- 172.21.15.2:0/3851848817 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd8f80bbe90 con 0x7fd90c0b4150 2023-11-26T07:13:36.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.621+0000 7fd912af6700 1 -- 172.21.15.2:0/3851848817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd90c068670 con 0x7fd90c0b4150 2023-11-26T07:13:36.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.621+0000 7fd9097fa700 1 -- 172.21.15.2:0/3851848817 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd8f8017020 con 0x7fd90c0b4150 2023-11-26T07:13:36.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.623+0000 7fd912af6700 1 -- 172.21.15.2:0/3851848817 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd8f006b1a0 msgr2=0x7fd8f006d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:36.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.623+0000 7fd912af6700 1 --2- 172.21.15.2:0/3851848817 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd8f006b1a0 0x7fd8f006d660 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd90000a7d0 tx=0x7fd900008040 comp rx=0 tx=0).stop 2023-11-26T07:13:36.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.623+0000 7fd912af6700 1 -- 172.21.15.2:0/3851848817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd90c0b4150 msgr2=0x7fd90c0c7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:36.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.623+0000 7fd912af6700 1 --2- 172.21.15.2:0/3851848817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd90c0b4150 0x7fd90c0c7420 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd8f800c490 tx=0x7fd8f800c850 comp rx=0 tx=0).stop 2023-11-26T07:13:36.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.623+0000 7fd912af6700 1 -- 172.21.15.2:0/3851848817 shutdown_connections 2023-11-26T07:13:36.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.623+0000 7fd912af6700 1 --2- 172.21.15.2:0/3851848817 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd8f006b1a0 0x7fd8f006d660 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:36.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.623+0000 7fd912af6700 1 --2- 172.21.15.2:0/3851848817 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd90c0b5ab0 0x7fd90c0cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:36.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.623+0000 7fd912af6700 1 --2- 172.21.15.2:0/3851848817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd90c06b620 0x7fd90c1330a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:36.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.623+0000 7fd912af6700 1 --2- 172.21.15.2:0/3851848817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd90c0b4150 0x7fd90c0c7420 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:36.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.623+0000 7fd912af6700 1 -- 172.21.15.2:0/3851848817 >> 172.21.15.2:0/3851848817 conn(0x7fd90c0b2740 msgr2=0x7fd90c0afe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:36.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.623+0000 7fd912af6700 1 -- 172.21.15.2:0/3851848817 shutdown_connections 2023-11-26T07:13:36.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.623+0000 7fd912af6700 1 -- 172.21.15.2:0/3851848817 wait complete. 2023-11-26T07:13:36.628 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2023-11-26T07:13:36.637 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-26T07:13:36.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:36.637 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-26T07:13:36.690 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2023-11-26T07:13:36.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:13:36.691 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-26T07:13:36.709 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:36.710 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:36.727 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19704 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-26T07:13:36.728 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:13:36.728 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:36.769 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284224k,nr_inodes=4071056,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3837 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260544k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-26T07:13:36.770 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:13:36.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.892+0000 7ff9f575c700 1 Processor -- start 2023-11-26T07:13:36.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.892+0000 7ff9f575c700 1 -- start start 2023-11-26T07:13:36.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.893+0000 7ff9f575c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9f0143ae0 0x7ff9f00b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:36.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.893+0000 7ff9f575c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff9f00722c0 0x7ff9f006e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:36.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.893+0000 7ff9f575c700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9f0143ec0 con 0x7ff9f01440f0 2023-11-26T07:13:36.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.893+0000 7ff9f575c700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9f00b40a0 con 0x7ff9f00722c0 2023-11-26T07:13:36.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.893+0000 7ff9f575c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f00b3ae0 con 0x7ff9f0143ae0 2023-11-26T07:13:36.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.894+0000 7ff9eeffd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9f0143ae0 0x7ff9f00b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:36.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.894+0000 7ff9eeffd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9f0143ae0 0x7ff9f00b51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.2:39512/0 (socket says 172.21.15.2:39512) 2023-11-26T07:13:36.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.894+0000 7ff9ef7fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff9f00722c0 0x7ff9f006e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:36.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.894+0000 7ff9eeffd700 1 -- 172.21.15.2:0/3451497044 learned_addr learned my addr 172.21.15.2:0/3451497044 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:36.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.894+0000 7ff9ef7fe700 1 -- 172.21.15.2:0/3451497044 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9f0143ae0 msgr2=0x7ff9f00b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:36.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.894+0000 7ff9ef7fe700 1 --2- 172.21.15.2:0/3451497044 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9f0143ae0 0x7ff9f00b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:36.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.894+0000 7ff9ef7fe700 1 -- 172.21.15.2:0/3451497044 >> v1:172.21.15.192:6789/0 conn(0x7ff9f01440f0 legacy=0x7ff9f0071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:36.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.894+0000 7ff9ef7fe700 1 -- 172.21.15.2:0/3451497044 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f00b3dc0 con 0x7ff9f00722c0 2023-11-26T07:13:36.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.894+0000 7ff9eeffd700 1 --2- 172.21.15.2:0/3451497044 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9f0143ae0 0x7ff9f00b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:13:36.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.894+0000 7ff9ef7fe700 1 --2- 172.21.15.2:0/3451497044 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9f00722c0 0x7ff9f006e510 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8009d90 tx=0x7ff9e800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=feafc71e11b801b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:36.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.894+0000 7ff9edffb700 1 -- 172.21.15.2:0/3451497044 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e800e070 con 0x7ff9f00722c0 2023-11-26T07:13:36.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.894+0000 7ff9edffb700 1 -- 172.21.15.2:0/3451497044 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e800bb20 con 0x7ff9f00722c0 2023-11-26T07:13:36.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.894+0000 7ff9edffb700 1 -- 172.21.15.2:0/3451497044 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e8012430 con 0x7ff9f00722c0 2023-11-26T07:13:36.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.895+0000 7ff9f575c700 1 -- 172.21.15.2:0/3451497044 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9f00722c0 msgr2=0x7ff9f006e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:36.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.895+0000 7ff9f575c700 1 --2- 172.21.15.2:0/3451497044 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9f00722c0 0x7ff9f006e510 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8009d90 tx=0x7ff9e800b330 comp rx=0 tx=0).stop 2023-11-26T07:13:36.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.895+0000 7ff9f575c700 1 -- 172.21.15.2:0/3451497044 shutdown_connections 2023-11-26T07:13:36.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.895+0000 7ff9f575c700 1 --2- 172.21.15.2:0/3451497044 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9f00722c0 0x7ff9f006e510 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:36.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.895+0000 7ff9f575c700 1 --2- 172.21.15.2:0/3451497044 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9f0143ae0 0x7ff9f00b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:36.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.895+0000 7ff9f575c700 1 -- 172.21.15.2:0/3451497044 >> 172.21.15.2:0/3451497044 conn(0x7ff9f00b2740 msgr2=0x7ff9f00b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:36.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.895+0000 7ff9f575c700 1 -- 172.21.15.2:0/3451497044 shutdown_connections 2023-11-26T07:13:36.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.895+0000 7ff9f575c700 1 -- 172.21.15.2:0/3451497044 wait complete. 2023-11-26T07:13:36.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.896+0000 7ff9f575c700 1 Processor -- start 2023-11-26T07:13:36.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.896+0000 7ff9f575c700 1 -- start start 2023-11-26T07:13:36.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.897+0000 7ff9f575c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9f00722c0 0x7ff9f00aa090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:36.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.897+0000 7ff9f575c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9f0143ae0 0x7ff9f00cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:36.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.897+0000 7ff9f575c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9f01440f0 0x7ff9f0158420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:36.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.897+0000 7ff9f575c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f00cc400 con 0x7ff9f0143ae0 2023-11-26T07:13:36.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.897+0000 7ff9f575c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f00cc6e0 con 0x7ff9f00722c0 2023-11-26T07:13:36.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.897+0000 7ff9f575c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f00cc9c0 con 0x7ff9f01440f0 2023-11-26T07:13:36.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.897+0000 7ff9ee7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9f0143ae0 0x7ff9f00cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:36.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.897+0000 7ff9ee7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9f0143ae0 0x7ff9f00cbb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41438/0 (socket says 172.21.15.2:41438) 2023-11-26T07:13:36.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.897+0000 7ff9ee7fc700 1 -- 172.21.15.2:0/1926592677 learned_addr learned my addr 172.21.15.2:0/1926592677 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:36.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.898+0000 7ff9ef7fe700 1 --2- 172.21.15.2:0/1926592677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9f01440f0 0x7ff9f0158420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:36.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.898+0000 7ff9eeffd700 1 --2- 172.21.15.2:0/1926592677 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9f00722c0 0x7ff9f00aa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:36.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.898+0000 7ff9ee7fc700 1 -- 172.21.15.2:0/1926592677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9f01440f0 msgr2=0x7ff9f0158420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:36.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.898+0000 7ff9ee7fc700 1 --2- 172.21.15.2:0/1926592677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9f01440f0 0x7ff9f0158420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:36.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.898+0000 7ff9ee7fc700 1 -- 172.21.15.2:0/1926592677 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9f00722c0 msgr2=0x7ff9f00aa090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:36.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.898+0000 7ff9ee7fc700 1 --2- 172.21.15.2:0/1926592677 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9f00722c0 0x7ff9f00aa090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:36.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.898+0000 7ff9ee7fc700 1 -- 172.21.15.2:0/1926592677 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d8009550 con 0x7ff9f0143ae0 2023-11-26T07:13:36.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.898+0000 7ff9ef7fe700 1 --2- 172.21.15.2:0/1926592677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9f01440f0 0x7ff9f0158420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:13:36.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.898+0000 7ff9ee7fc700 1 --2- 172.21.15.2:0/1926592677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9f0143ae0 0x7ff9f00cbb00 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff9e000c450 tx=0x7ff9e000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:36.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.898+0000 7ff9e77fe700 1 -- 172.21.15.2:0/1926592677 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e00052d0 con 0x7ff9f0143ae0 2023-11-26T07:13:36.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.898+0000 7ff9e77fe700 1 -- 172.21.15.2:0/1926592677 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e0005430 con 0x7ff9f0143ae0 2023-11-26T07:13:36.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.898+0000 7ff9e77fe700 1 -- 172.21.15.2:0/1926592677 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e00038c0 con 0x7ff9f0143ae0 2023-11-26T07:13:36.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.898+0000 7ff9f575c700 1 -- 172.21.15.2:0/1926592677 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9e8009a70 con 0x7ff9f0143ae0 2023-11-26T07:13:36.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.898+0000 7ff9f575c700 1 -- 172.21.15.2:0/1926592677 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9f00ccf80 con 0x7ff9f0143ae0 2023-11-26T07:13:36.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.899+0000 7ff9f575c700 1 -- 172.21.15.2:0/1926592677 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9f0068670 con 0x7ff9f0143ae0 2023-11-26T07:13:36.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.899+0000 7ff9e77fe700 1 -- 172.21.15.2:0/1926592677 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7ff9e0003a20 con 0x7ff9f0143ae0 2023-11-26T07:13:36.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.900+0000 7ff9e77fe700 1 --2- 172.21.15.2:0/1926592677 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff9d006b1a0 0x7ff9d006d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:36.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.900+0000 7ff9e77fe700 1 -- 172.21.15.2:0/1926592677 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5737+0+0 (secure 0 0 0) 0x7ff9e0088d10 con 0x7ff9f0143ae0 2023-11-26T07:13:36.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.900+0000 7ff9eeffd700 1 --2- 172.21.15.2:0/1926592677 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff9d006b1a0 0x7ff9d006d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:36.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.901+0000 7ff9eeffd700 1 --2- 172.21.15.2:0/1926592677 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff9d006b1a0 0x7ff9d006d660 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0142ea0 tx=0x7ff9d8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:36.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:36.904+0000 7ff9e77fe700 1 -- 172.21.15.2:0/1926592677 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff9e0053ae0 con 0x7ff9f0143ae0 2023-11-26T07:13:37.068 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:13:37.071 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:13:37.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.150+0000 7ff9f575c700 1 -- 172.21.15.2:0/1926592677 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff9f00b5d20 con 0x7ff9f0143ae0 2023-11-26T07:13:37.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.151+0000 7ff9e77fe700 1 -- 172.21.15.2:0/1926592677 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4913 (secure 0 0 0) 0x7ff9e0057100 con 0x7ff9f0143ae0 2023-11-26T07:13:37.153 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:13:37.153 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4727,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3580414083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3580414083},{"type":"v1","addr":"172.21.15.192:6837","nonce":3580414083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4948,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/3401314194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3401314194},{"type":"v1","addr":"172.21.15.2:6834","nonce":3401314194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4954,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3579861389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3579861389},{"type":"v1","addr":"172.21.15.192:6836","nonce":3579861389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:12:29.802382+0000","modified":"2023-11-26T07:12:32.823481+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5046":{"gid":5046,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6835/3058610366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":3058610366},{"type":"v1","addr":"172.21.15.2:6835","nonce":3058610366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-26T07:13:37.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.153+0000 7ff9f575c700 1 -- 172.21.15.2:0/1926592677 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff9d006b1a0 msgr2=0x7ff9d006d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:37.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.153+0000 7ff9f575c700 1 --2- 172.21.15.2:0/1926592677 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff9d006b1a0 0x7ff9d006d660 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0142ea0 tx=0x7ff9d8008040 comp rx=0 tx=0).stop 2023-11-26T07:13:37.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.153+0000 7ff9f575c700 1 -- 172.21.15.2:0/1926592677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9f0143ae0 msgr2=0x7ff9f00cbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:37.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.153+0000 7ff9f575c700 1 --2- 172.21.15.2:0/1926592677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9f0143ae0 0x7ff9f00cbb00 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff9e000c450 tx=0x7ff9e000c810 comp rx=0 tx=0).stop 2023-11-26T07:13:37.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.153+0000 7ff9f575c700 1 -- 172.21.15.2:0/1926592677 shutdown_connections 2023-11-26T07:13:37.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.153+0000 7ff9f575c700 1 --2- 172.21.15.2:0/1926592677 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff9d006b1a0 0x7ff9d006d660 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:37.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.153+0000 7ff9f575c700 1 --2- 172.21.15.2:0/1926592677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9f01440f0 0x7ff9f0158420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:37.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.153+0000 7ff9f575c700 1 --2- 172.21.15.2:0/1926592677 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9f00722c0 0x7ff9f00aa090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:37.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.153+0000 7ff9f575c700 1 --2- 172.21.15.2:0/1926592677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9f0143ae0 0x7ff9f00cbb00 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:37.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.153+0000 7ff9f575c700 1 -- 172.21.15.2:0/1926592677 >> 172.21.15.2:0/1926592677 conn(0x7ff9f00b2740 msgr2=0x7ff9f00cf1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:37.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.153+0000 7ff9f575c700 1 -- 172.21.15.2:0/1926592677 shutdown_connections 2023-11-26T07:13:37.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.153+0000 7ff9f575c700 1 -- 172.21.15.2:0/1926592677 wait complete. 2023-11-26T07:13:37.157 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 17 2023-11-26T07:13:37.167 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:13:37.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.331+0000 7fa034cbe700 1 Processor -- start 2023-11-26T07:13:37.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.331+0000 7fa034cbe700 1 -- start start 2023-11-26T07:13:37.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.332+0000 7fa034cbe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa03015c460 0x7fa03006f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:37.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.332+0000 7fa034cbe700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa03006e580 con 0x7fa030144d10 2023-11-26T07:13:37.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.332+0000 7fa034cbe700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa03006e7d0 con 0x7fa03006b6e0 2023-11-26T07:13:37.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.332+0000 7fa034cbe700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa03006eab0 con 0x7fa03015c460 2023-11-26T07:13:37.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.333+0000 7fa02ed9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa03015c460 0x7fa03006f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:37.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.333+0000 7fa02e59c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa030144d10 0x7fa03006afd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60888/0 (socket says 172.21.15.2:60888) 2023-11-26T07:13:37.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.333+0000 7fa02e59c700 1 -- 172.21.15.2:0/4077225726 learned_addr learned my addr 172.21.15.2:0/4077225726 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:13:37.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.333+0000 7fa02ed9d700 1 -- 172.21.15.2:0/4077225726 >> v1:172.21.15.192:6789/0 conn(0x7fa03006b6e0 legacy=0x7fa0300cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:37.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.333+0000 7fa02ed9d700 1 -- 172.21.15.2:0/4077225726 >> v1:172.21.15.2:6789/0 conn(0x7fa030144d10 legacy=0x7fa03006afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:37.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.333+0000 7fa02d59a700 1 -- 172.21.15.2:0/4077225726 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 174978471 0 0) 0x7fa03006e580 con 0x7fa030144d10 2023-11-26T07:13:37.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.333+0000 7fa02ed9d700 1 -- 172.21.15.2:0/4077225726 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03006ed90 con 0x7fa03015c460 2023-11-26T07:13:37.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.333+0000 7fa02ed9d700 1 --2- 172.21.15.2:0/4077225726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa03015c460 0x7fa03006f720 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa028009d90 tx=0x7fa02800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afad329168f3d3f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:37.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.333+0000 7fa02d59a700 1 -- 172.21.15.2:0/4077225726 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02800e070 con 0x7fa03015c460 2023-11-26T07:13:37.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.333+0000 7fa02d59a700 1 -- 172.21.15.2:0/4077225726 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02800bbd0 con 0x7fa03015c460 2023-11-26T07:13:37.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.333+0000 7fa02d59a700 1 -- 172.21.15.2:0/4077225726 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa028012430 con 0x7fa03015c460 2023-11-26T07:13:37.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.334+0000 7fa034cbe700 1 -- 172.21.15.2:0/4077225726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa03015c460 msgr2=0x7fa03006f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:37.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.334+0000 7fa034cbe700 1 --2- 172.21.15.2:0/4077225726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa03015c460 0x7fa03006f720 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa028009d90 tx=0x7fa02800b330 comp rx=0 tx=0).stop 2023-11-26T07:13:37.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.334+0000 7fa034cbe700 1 -- 172.21.15.2:0/4077225726 shutdown_connections 2023-11-26T07:13:37.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.334+0000 7fa034cbe700 1 --2- 172.21.15.2:0/4077225726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa03015c460 0x7fa03006f720 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:37.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.334+0000 7fa034cbe700 1 -- 172.21.15.2:0/4077225726 >> 172.21.15.2:0/4077225726 conn(0x7fa0300b2740 msgr2=0x7fa0300b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:37.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.334+0000 7fa034cbe700 1 -- 172.21.15.2:0/4077225726 shutdown_connections 2023-11-26T07:13:37.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.334+0000 7fa034cbe700 1 -- 172.21.15.2:0/4077225726 wait complete. 2023-11-26T07:13:37.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.335+0000 7fa034cbe700 1 Processor -- start 2023-11-26T07:13:37.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.335+0000 7fa034cbe700 1 -- start start 2023-11-26T07:13:37.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.336+0000 7fa034cbe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa03006b6e0 0x7fa0301f4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:37.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.336+0000 7fa034cbe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa030144d10 0x7fa0300b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:37.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.336+0000 7fa034cbe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa03015c460 0x7fa030150aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:37.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.336+0000 7fa034cbe700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa030150310 con 0x7fa03006b6e0 2023-11-26T07:13:37.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.336+0000 7fa034cbe700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0301f5210 con 0x7fa03015c460 2023-11-26T07:13:37.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.336+0000 7fa034cbe700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0301f54b0 con 0x7fa030144d10 2023-11-26T07:13:37.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.336+0000 7fa02e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa03006b6e0 0x7fa0301f4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:37.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.336+0000 7fa02e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa03006b6e0 0x7fa0301f4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41452/0 (socket says 172.21.15.2:41452) 2023-11-26T07:13:37.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.336+0000 7fa02e59c700 1 -- 172.21.15.2:0/2291088045 learned_addr learned my addr 172.21.15.2:0/2291088045 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:37.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.336+0000 7fa02ed9d700 1 --2- 172.21.15.2:0/2291088045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa03015c460 0x7fa030150aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:37.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.336+0000 7fa02dd9b700 1 --2- 172.21.15.2:0/2291088045 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa030144d10 0x7fa0300b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:37.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.336+0000 7fa02e59c700 1 -- 172.21.15.2:0/2291088045 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa030144d10 msgr2=0x7fa0300b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:37.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.336+0000 7fa02e59c700 1 --2- 172.21.15.2:0/2291088045 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa030144d10 0x7fa0300b1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:37.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.336+0000 7fa02e59c700 1 -- 172.21.15.2:0/2291088045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa03015c460 msgr2=0x7fa030150aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:37.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.336+0000 7fa02e59c700 1 --2- 172.21.15.2:0/2291088045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa03015c460 0x7fa030150aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:37.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.337+0000 7fa02e59c700 1 -- 172.21.15.2:0/2291088045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa028009a70 con 0x7fa03006b6e0 2023-11-26T07:13:37.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.337+0000 7fa02dd9b700 1 --2- 172.21.15.2:0/2291088045 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa030144d10 0x7fa0300b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:13:37.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.337+0000 7fa02e59c700 1 --2- 172.21.15.2:0/2291088045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa03006b6e0 0x7fa0301f4cd0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa02000c520 tx=0x7fa02000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:37.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.337+0000 7fa026ffd700 1 -- 172.21.15.2:0/2291088045 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa020004c80 con 0x7fa03006b6e0 2023-11-26T07:13:37.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.337+0000 7fa026ffd700 1 -- 172.21.15.2:0/2291088045 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa020004e00 con 0x7fa03006b6e0 2023-11-26T07:13:37.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.337+0000 7fa034cbe700 1 -- 172.21.15.2:0/2291088045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0301f5790 con 0x7fa03006b6e0 2023-11-26T07:13:37.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.337+0000 7fa026ffd700 1 -- 172.21.15.2:0/2291088045 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa020007310 con 0x7fa03006b6e0 2023-11-26T07:13:37.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.337+0000 7fa034cbe700 1 -- 172.21.15.2:0/2291088045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0301505a0 con 0x7fa03006b6e0 2023-11-26T07:13:37.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.338+0000 7fa034cbe700 1 -- 172.21.15.2:0/2291088045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa030068670 con 0x7fa03006b6e0 2023-11-26T07:13:37.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.338+0000 7fa026ffd700 1 -- 172.21.15.2:0/2291088045 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7fa020007470 con 0x7fa03006b6e0 2023-11-26T07:13:37.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.339+0000 7fa026ffd700 1 --2- 172.21.15.2:0/2291088045 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa01006b1a0 0x7fa01006d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:37.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.339+0000 7fa026ffd700 1 -- 172.21.15.2:0/2291088045 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fa0200897d0 con 0x7fa03006b6e0 2023-11-26T07:13:37.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.339+0000 7fa02dd9b700 1 --2- 172.21.15.2:0/2291088045 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa01006b1a0 0x7fa01006d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:37.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.339+0000 7fa02dd9b700 1 --2- 172.21.15.2:0/2291088045 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa01006b1a0 0x7fa01006d660 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa0300b3200 tx=0x7fa018009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:37.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.343+0000 7fa026ffd700 1 -- 172.21.15.2:0/2291088045 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa020054510 con 0x7fa03006b6e0 2023-11-26T07:13:37.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.544+0000 7fa034cbe700 1 -- 172.21.15.2:0/2291088045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa030150910 con 0x7fa03006b6e0 2023-11-26T07:13:37.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.545+0000 7fa026ffd700 1 -- 172.21.15.2:0/2291088045 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16586 (secure 0 0 0) 0x7fa020057b30 con 0x7fa03006b6e0 2023-11-26T07:13:37.547 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:13:37.547 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":34,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:13:26.223324+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:12:27.898687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-26T07:12:28.763512+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":33,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:13:37.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.547+0000 7fa034cbe700 1 -- 172.21.15.2:0/2291088045 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa01006b1a0 msgr2=0x7fa01006d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:37.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.547+0000 7fa034cbe700 1 --2- 172.21.15.2:0/2291088045 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa01006b1a0 0x7fa01006d660 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa0300b3200 tx=0x7fa018009040 comp rx=0 tx=0).stop 2023-11-26T07:13:37.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.547+0000 7fa034cbe700 1 -- 172.21.15.2:0/2291088045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa03006b6e0 msgr2=0x7fa0301f4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:37.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.547+0000 7fa034cbe700 1 --2- 172.21.15.2:0/2291088045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa03006b6e0 0x7fa0301f4cd0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa02000c520 tx=0x7fa02000c8e0 comp rx=0 tx=0).stop 2023-11-26T07:13:37.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.547+0000 7fa034cbe700 1 -- 172.21.15.2:0/2291088045 shutdown_connections 2023-11-26T07:13:37.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.547+0000 7fa034cbe700 1 --2- 172.21.15.2:0/2291088045 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa01006b1a0 0x7fa01006d660 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:37.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.547+0000 7fa034cbe700 1 --2- 172.21.15.2:0/2291088045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa03015c460 0x7fa030150aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:37.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.547+0000 7fa034cbe700 1 --2- 172.21.15.2:0/2291088045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa03006b6e0 0x7fa0301f4cd0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:37.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.547+0000 7fa034cbe700 1 --2- 172.21.15.2:0/2291088045 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa030144d10 0x7fa0300b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:37.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.547+0000 7fa034cbe700 1 -- 172.21.15.2:0/2291088045 >> 172.21.15.2:0/2291088045 conn(0x7fa0300b2740 msgr2=0x7fa03006f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:37.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.547+0000 7fa034cbe700 1 -- 172.21.15.2:0/2291088045 shutdown_connections 2023-11-26T07:13:37.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.547+0000 7fa034cbe700 1 -- 172.21.15.2:0/2291088045 wait complete. 2023-11-26T07:13:37.562 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:11:28.205739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:12:27.898687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:12:28.763512+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 33, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:13:37.563 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:13:37.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.689+0000 7f90ca6fd700 1 Processor -- start 2023-11-26T07:13:37.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.689+0000 7f90ca6fd700 1 -- start start 2023-11-26T07:13:37.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.690+0000 7f90ca6fd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f90c4142810 0x7f90c406afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:37.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.690+0000 7f90ca6fd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90c406e580 0x7f90c406b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:37.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.690+0000 7f90ca6fd700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90c40cf5f0 con 0x7f90c41459a0 2023-11-26T07:13:37.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.690+0000 7f90ca6fd700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90c406ea80 con 0x7f90c4142810 2023-11-26T07:13:37.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.690+0000 7f90ca6fd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c406ed60 con 0x7f90c406e580 2023-11-26T07:13:37.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.690+0000 7f90c3fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f90c4142810 0x7f90c406afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:37.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.690+0000 7f90c37fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f90c41459a0 0x7f90c4071bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60904/0 (socket says 172.21.15.2:60904) 2023-11-26T07:13:37.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.690+0000 7f90c37fe700 1 -- 172.21.15.2:0/687607182 learned_addr learned my addr 172.21.15.2:0/687607182 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:13:37.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.690+0000 7f90c8c9a700 1 --2- 172.21.15.2:0/687607182 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90c406e580 0x7f90c406b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:37.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.690+0000 7f90c3fff700 1 -- 172.21.15.2:0/687607182 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90c406e580 msgr2=0x7f90c406b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:37.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.690+0000 7f90c3fff700 1 --2- 172.21.15.2:0/687607182 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90c406e580 0x7f90c406b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:37.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.690+0000 7f90c3fff700 1 -- 172.21.15.2:0/687607182 >> v1:172.21.15.2:6789/0 conn(0x7f90c41459a0 legacy=0x7f90c4071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:37.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.690+0000 7f90c3fff700 1 -- 172.21.15.2:0/687607182 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c406f040 con 0x7f90c4142810 2023-11-26T07:13:37.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.690+0000 7f90c2ffd700 1 -- 172.21.15.2:0/687607182 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4129351322 0 0) 0x7f90c40cf5f0 con 0x7f90c41459a0 2023-11-26T07:13:37.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.690+0000 7f90c3fff700 1 --2- 172.21.15.2:0/687607182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90c4142810 0x7f90c406afd0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f90b4009840 tx=0x7f90b4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c48b762c2dcc06d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:37.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.690+0000 7f90c2ffd700 1 -- 172.21.15.2:0/687607182 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b4011830 con 0x7f90c4142810 2023-11-26T07:13:37.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.691+0000 7f90c2ffd700 1 -- 172.21.15.2:0/687607182 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b4011990 con 0x7f90c4142810 2023-11-26T07:13:37.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.691+0000 7f90c2ffd700 1 -- 172.21.15.2:0/687607182 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b4011d20 con 0x7f90c4142810 2023-11-26T07:13:37.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.691+0000 7f90ca6fd700 1 -- 172.21.15.2:0/687607182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90c4142810 msgr2=0x7f90c406afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:37.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.691+0000 7f90ca6fd700 1 --2- 172.21.15.2:0/687607182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90c4142810 0x7f90c406afd0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f90b4009840 tx=0x7f90b4009b50 comp rx=0 tx=0).stop 2023-11-26T07:13:37.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.691+0000 7f90ca6fd700 1 -- 172.21.15.2:0/687607182 shutdown_connections 2023-11-26T07:13:37.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.691+0000 7f90ca6fd700 1 --2- 172.21.15.2:0/687607182 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90c406e580 0x7f90c406b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:37.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.691+0000 7f90ca6fd700 1 --2- 172.21.15.2:0/687607182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90c4142810 0x7f90c406afd0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:37.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.691+0000 7f90ca6fd700 1 -- 172.21.15.2:0/687607182 >> 172.21.15.2:0/687607182 conn(0x7f90c40b2740 msgr2=0x7f90c40b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:37.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.691+0000 7f90ca6fd700 1 -- 172.21.15.2:0/687607182 shutdown_connections 2023-11-26T07:13:37.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.691+0000 7f90ca6fd700 1 -- 172.21.15.2:0/687607182 wait complete. 2023-11-26T07:13:37.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.692+0000 7f90ca6fd700 1 Processor -- start 2023-11-26T07:13:37.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.692+0000 7f90ca6fd700 1 -- start start 2023-11-26T07:13:37.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.693+0000 7f90ca6fd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90c406e580 0x7f90c415a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:37.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.693+0000 7f90ca6fd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90c4142810 0x7f90c413eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:37.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.693+0000 7f90ca6fd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90c41459a0 0x7f90c413f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:37.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.693+0000 7f90ca6fd700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c415ad90 con 0x7f90c406e580 2023-11-26T07:13:37.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.693+0000 7f90ca6fd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c41f4e50 con 0x7f90c41459a0 2023-11-26T07:13:37.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.693+0000 7f90ca6fd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c41f5130 con 0x7f90c4142810 2023-11-26T07:13:37.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.693+0000 7f90c3fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90c406e580 0x7f90c415a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:37.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.693+0000 7f90c3fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90c406e580 0x7f90c415a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41468/0 (socket says 172.21.15.2:41468) 2023-11-26T07:13:37.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.693+0000 7f90c3fff700 1 -- 172.21.15.2:0/3742367424 learned_addr learned my addr 172.21.15.2:0/3742367424 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:37.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.693+0000 7f90c8c9a700 1 --2- 172.21.15.2:0/3742367424 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90c41459a0 0x7f90c413f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:37.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.693+0000 7f90c37fe700 1 --2- 172.21.15.2:0/3742367424 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90c4142810 0x7f90c413eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:37.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.694+0000 7f90c3fff700 1 -- 172.21.15.2:0/3742367424 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90c4142810 msgr2=0x7f90c413eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:37.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.694+0000 7f90c3fff700 1 --2- 172.21.15.2:0/3742367424 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90c4142810 0x7f90c413eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:37.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.694+0000 7f90c3fff700 1 -- 172.21.15.2:0/3742367424 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90c41459a0 msgr2=0x7f90c413f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:37.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.694+0000 7f90c3fff700 1 --2- 172.21.15.2:0/3742367424 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90c41459a0 0x7f90c413f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:37.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.694+0000 7f90c3fff700 1 -- 172.21.15.2:0/3742367424 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b40094a0 con 0x7f90c406e580 2023-11-26T07:13:37.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.694+0000 7f90c3fff700 1 --2- 172.21.15.2:0/3742367424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90c406e580 0x7f90c415a850 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f90b40090b0 tx=0x7f90b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:37.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.694+0000 7f90c0ff9700 1 -- 172.21.15.2:0/3742367424 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b40036a0 con 0x7f90c406e580 2023-11-26T07:13:37.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.694+0000 7f90c0ff9700 1 -- 172.21.15.2:0/3742367424 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b401f070 con 0x7f90c406e580 2023-11-26T07:13:37.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.694+0000 7f90ca6fd700 1 -- 172.21.15.2:0/3742367424 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90c41f5410 con 0x7f90c406e580 2023-11-26T07:13:37.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.694+0000 7f90c0ff9700 1 -- 172.21.15.2:0/3742367424 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b4003a60 con 0x7f90c406e580 2023-11-26T07:13:37.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.694+0000 7f90ca6fd700 1 -- 172.21.15.2:0/3742367424 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90c41f2790 con 0x7f90c406e580 2023-11-26T07:13:37.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.695+0000 7f90ca6fd700 1 -- 172.21.15.2:0/3742367424 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90c41f5a60 con 0x7f90c406e580 2023-11-26T07:13:37.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.695+0000 7f90c0ff9700 1 -- 172.21.15.2:0/3742367424 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f90b4003bc0 con 0x7f90c406e580 2023-11-26T07:13:37.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.696+0000 7f90c0ff9700 1 --2- 172.21.15.2:0/3742367424 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f90b006b1a0 0x7f90b006d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:37.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.696+0000 7f90c0ff9700 1 -- 172.21.15.2:0/3742367424 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f90b4021070 con 0x7f90c406e580 2023-11-26T07:13:37.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.696+0000 7f90c37fe700 1 --2- 172.21.15.2:0/3742367424 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f90b006b1a0 0x7f90b006d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:37.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.697+0000 7f90c37fe700 1 --2- 172.21.15.2:0/3742367424 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f90b006b1a0 0x7f90b006d660 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f90c41ef240 tx=0x7f90b8007e70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:37.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.701+0000 7f90c0ff9700 1 -- 172.21.15.2:0/3742367424 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f90b40560d0 con 0x7f90c406e580 2023-11-26T07:13:37.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.902+0000 7f90ca6fd700 1 -- 172.21.15.2:0/3742367424 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f90c41f2920 con 0x7f90c406e580 2023-11-26T07:13:37.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.902+0000 7f90c0ff9700 1 -- 172.21.15.2:0/3742367424 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7f90b40596f0 con 0x7f90c406e580 2023-11-26T07:13:37.905 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-26T07:13:37.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.905+0000 7f90ca6fd700 1 -- 172.21.15.2:0/3742367424 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f90b006b1a0 msgr2=0x7f90b006d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:37.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.905+0000 7f90ca6fd700 1 --2- 172.21.15.2:0/3742367424 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f90b006b1a0 0x7f90b006d660 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f90c41ef240 tx=0x7f90b8007e70 comp rx=0 tx=0).stop 2023-11-26T07:13:37.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.905+0000 7f90ca6fd700 1 -- 172.21.15.2:0/3742367424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90c406e580 msgr2=0x7f90c415a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:37.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.905+0000 7f90ca6fd700 1 --2- 172.21.15.2:0/3742367424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90c406e580 0x7f90c415a850 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f90b40090b0 tx=0x7f90b4004750 comp rx=0 tx=0).stop 2023-11-26T07:13:37.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.905+0000 7f90ca6fd700 1 -- 172.21.15.2:0/3742367424 shutdown_connections 2023-11-26T07:13:37.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.905+0000 7f90ca6fd700 1 --2- 172.21.15.2:0/3742367424 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f90b006b1a0 0x7f90b006d660 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:37.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.905+0000 7f90ca6fd700 1 --2- 172.21.15.2:0/3742367424 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90c41459a0 0x7f90c413f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:37.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.905+0000 7f90ca6fd700 1 --2- 172.21.15.2:0/3742367424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90c406e580 0x7f90c415a850 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:37.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.905+0000 7f90ca6fd700 1 --2- 172.21.15.2:0/3742367424 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90c4142810 0x7f90c413eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:37.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.905+0000 7f90ca6fd700 1 -- 172.21.15.2:0/3742367424 >> 172.21.15.2:0/3742367424 conn(0x7f90c40b2740 msgr2=0x7f90c4141460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:37.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.905+0000 7f90ca6fd700 1 -- 172.21.15.2:0/3742367424 shutdown_connections 2023-11-26T07:13:37.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:37.905+0000 7f90ca6fd700 1 -- 172.21.15.2:0/3742367424 wait complete. 2023-11-26T07:13:37.919 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:13:38.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.045+0000 7fb6337a4700 1 Processor -- start 2023-11-26T07:13:38.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.045+0000 7fb6337a4700 1 -- start start 2023-11-26T07:13:38.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.046+0000 7fb6337a4700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb62c0cf2b0 0x7fb62c15c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:38.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.046+0000 7fb6337a4700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb62c0ce5c0 0x7fb62c0cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:38.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.046+0000 7fb6337a4700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb62c0d0a90 con 0x7fb62c15bde0 2023-11-26T07:13:38.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.046+0000 7fb6337a4700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb62c0cef70 con 0x7fb62c0cf2b0 2023-11-26T07:13:38.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.046+0000 7fb6337a4700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb62c06ee10 con 0x7fb62c0ce5c0 2023-11-26T07:13:38.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.046+0000 7fb630d3f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb62c0cf2b0 0x7fb62c15c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:38.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.046+0000 7fb631540700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb62c15bde0 0x7fb62c0d01b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60916/0 (socket says 172.21.15.2:60916) 2023-11-26T07:13:38.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.046+0000 7fb631540700 1 -- 172.21.15.2:0/1680694697 learned_addr learned my addr 172.21.15.2:0/1680694697 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:13:38.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.046+0000 7fb631d41700 1 --2- 172.21.15.2:0/1680694697 >> v2:172.21.15.192:3300/0 conn(0x7fb62c0ce5c0 0x7fb62c0cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:38.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.046+0000 7fb630d3f700 1 -- 172.21.15.2:0/1680694697 >> v2:172.21.15.192:3300/0 conn(0x7fb62c0ce5c0 msgr2=0x7fb62c0cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:38.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.046+0000 7fb630d3f700 1 --2- 172.21.15.2:0/1680694697 >> v2:172.21.15.192:3300/0 conn(0x7fb62c0ce5c0 0x7fb62c0cea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:38.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.046+0000 7fb630d3f700 1 -- 172.21.15.2:0/1680694697 >> v1:172.21.15.2:6789/0 conn(0x7fb62c15bde0 legacy=0x7fb62c0d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:38.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.046+0000 7fb630d3f700 1 -- 172.21.15.2:0/1680694697 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb62c06f0f0 con 0x7fb62c0cf2b0 2023-11-26T07:13:38.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.046+0000 7fb623fff700 1 -- 172.21.15.2:0/1680694697 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 467439672 0 0) 0x7fb62c0d0a90 con 0x7fb62c15bde0 2023-11-26T07:13:38.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.046+0000 7fb631d41700 1 --2- 172.21.15.2:0/1680694697 >> v2:172.21.15.192:3300/0 conn(0x7fb62c0ce5c0 0x7fb62c0cea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:13:38.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.046+0000 7fb630d3f700 1 --2- 172.21.15.2:0/1680694697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb62c0cf2b0 0x7fb62c15c1c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb62c068360 tx=0x7fb61c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=375f6bdb55c73c0c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:38.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.047+0000 7fb623fff700 1 -- 172.21.15.2:0/1680694697 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61c011830 con 0x7fb62c0cf2b0 2023-11-26T07:13:38.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.047+0000 7fb623fff700 1 -- 172.21.15.2:0/1680694697 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb61c011990 con 0x7fb62c0cf2b0 2023-11-26T07:13:38.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.047+0000 7fb623fff700 1 -- 172.21.15.2:0/1680694697 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61c011d20 con 0x7fb62c0cf2b0 2023-11-26T07:13:38.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.047+0000 7fb6337a4700 1 -- 172.21.15.2:0/1680694697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb62c0cf2b0 msgr2=0x7fb62c15c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:38.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.047+0000 7fb6337a4700 1 --2- 172.21.15.2:0/1680694697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb62c0cf2b0 0x7fb62c15c1c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb62c068360 tx=0x7fb61c009b20 comp rx=0 tx=0).stop 2023-11-26T07:13:38.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.047+0000 7fb6337a4700 1 -- 172.21.15.2:0/1680694697 shutdown_connections 2023-11-26T07:13:38.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.047+0000 7fb6337a4700 1 --2- 172.21.15.2:0/1680694697 >> v2:172.21.15.192:3300/0 conn(0x7fb62c0ce5c0 0x7fb62c0cea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:38.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.047+0000 7fb6337a4700 1 --2- 172.21.15.2:0/1680694697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb62c0cf2b0 0x7fb62c15c1c0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:38.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.047+0000 7fb6337a4700 1 -- 172.21.15.2:0/1680694697 >> 172.21.15.2:0/1680694697 conn(0x7fb62c0b3720 msgr2=0x7fb62c0b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:38.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.047+0000 7fb6337a4700 1 -- 172.21.15.2:0/1680694697 shutdown_connections 2023-11-26T07:13:38.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.047+0000 7fb6337a4700 1 -- 172.21.15.2:0/1680694697 wait complete. 2023-11-26T07:13:38.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.048+0000 7fb6337a4700 1 Processor -- start 2023-11-26T07:13:38.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.049+0000 7fb6337a4700 1 -- start start 2023-11-26T07:13:38.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.049+0000 7fb6337a4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb62c0ce5c0 0x7fb62c149170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:38.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.049+0000 7fb6337a4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb62c0cf2b0 0x7fb62c1f45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:38.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.049+0000 7fb6337a4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb62c15bde0 0x7fb62c1f29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:38.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.049+0000 7fb6337a4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c1f41a0 con 0x7fb62c15bde0 2023-11-26T07:13:38.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.049+0000 7fb6337a4700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c070310 con 0x7fb62c0ce5c0 2023-11-26T07:13:38.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.049+0000 7fb6337a4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c1f3520 con 0x7fb62c0cf2b0 2023-11-26T07:13:38.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.049+0000 7fb631d41700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb62c15bde0 0x7fb62c1f29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:38.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.049+0000 7fb631d41700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb62c15bde0 0x7fb62c1f29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41484/0 (socket says 172.21.15.2:41484) 2023-11-26T07:13:38.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.049+0000 7fb631d41700 1 -- 172.21.15.2:0/2566740088 learned_addr learned my addr 172.21.15.2:0/2566740088 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:38.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.050+0000 7fb631d41700 1 -- 172.21.15.2:0/2566740088 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb62c0cf2b0 msgr2=0x7fb62c1f45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:38.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.050+0000 7fb630d3f700 1 --2- 172.21.15.2:0/2566740088 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb62c0cf2b0 0x7fb62c1f45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:38.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.050+0000 7fb631540700 1 --2- 172.21.15.2:0/2566740088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb62c0ce5c0 0x7fb62c149170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:38.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.050+0000 7fb631d41700 1 --2- 172.21.15.2:0/2566740088 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb62c0cf2b0 0x7fb62c1f45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:38.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.050+0000 7fb631d41700 1 -- 172.21.15.2:0/2566740088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb62c0ce5c0 msgr2=0x7fb62c149170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:38.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.050+0000 7fb631d41700 1 --2- 172.21.15.2:0/2566740088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb62c0ce5c0 0x7fb62c149170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:38.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.050+0000 7fb631d41700 1 -- 172.21.15.2:0/2566740088 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb61c0094a0 con 0x7fb62c15bde0 2023-11-26T07:13:38.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.050+0000 7fb631d41700 1 --2- 172.21.15.2:0/2566740088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb62c15bde0 0x7fb62c1f29b0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb62400cef0 tx=0x7fb62400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:38.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.050+0000 7fb621ffb700 1 -- 172.21.15.2:0/2566740088 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62400ae50 con 0x7fb62c15bde0 2023-11-26T07:13:38.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.050+0000 7fb621ffb700 1 -- 172.21.15.2:0/2566740088 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb624015440 con 0x7fb62c15bde0 2023-11-26T07:13:38.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.050+0000 7fb6337a4700 1 -- 172.21.15.2:0/2566740088 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb62c1f3800 con 0x7fb62c15bde0 2023-11-26T07:13:38.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.050+0000 7fb621ffb700 1 -- 172.21.15.2:0/2566740088 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6240157f0 con 0x7fb62c15bde0 2023-11-26T07:13:38.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.050+0000 7fb6337a4700 1 -- 172.21.15.2:0/2566740088 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb62c1f3dc0 con 0x7fb62c15bde0 2023-11-26T07:13:38.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.051+0000 7fb6337a4700 1 -- 172.21.15.2:0/2566740088 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb62c1f4410 con 0x7fb62c15bde0 2023-11-26T07:13:38.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.052+0000 7fb621ffb700 1 -- 172.21.15.2:0/2566740088 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7fb62400d430 con 0x7fb62c15bde0 2023-11-26T07:13:38.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.052+0000 7fb621ffb700 1 --2- 172.21.15.2:0/2566740088 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb61006b1a0 0x7fb61006d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:38.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.052+0000 7fb621ffb700 1 -- 172.21.15.2:0/2566740088 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fb62408a120 con 0x7fb62c15bde0 2023-11-26T07:13:38.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.052+0000 7fb631540700 1 --2- 172.21.15.2:0/2566740088 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb61006b1a0 0x7fb61006d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:38.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.053+0000 7fb631540700 1 --2- 172.21.15.2:0/2566740088 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb61006b1a0 0x7fb61006d660 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb628000f60 tx=0x7fb628009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:38.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.056+0000 7fb621ffb700 1 -- 172.21.15.2:0/2566740088 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb624054d80 con 0x7fb62c15bde0 2023-11-26T07:13:38.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.255+0000 7fb6337a4700 1 -- 172.21.15.2:0/2566740088 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb62c1f3f50 con 0x7fb62c15bde0 2023-11-26T07:13:38.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.256+0000 7fb621ffb700 1 -- 172.21.15.2:0/2566740088 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb6240583a0 con 0x7fb62c15bde0 2023-11-26T07:13:38.258 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-26T07:13:38.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.258+0000 7fb6337a4700 1 -- 172.21.15.2:0/2566740088 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb61006b1a0 msgr2=0x7fb61006d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:38.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.258+0000 7fb6337a4700 1 --2- 172.21.15.2:0/2566740088 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb61006b1a0 0x7fb61006d660 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb628000f60 tx=0x7fb628009040 comp rx=0 tx=0).stop 2023-11-26T07:13:38.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.258+0000 7fb6337a4700 1 -- 172.21.15.2:0/2566740088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb62c15bde0 msgr2=0x7fb62c1f29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:38.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.258+0000 7fb6337a4700 1 --2- 172.21.15.2:0/2566740088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb62c15bde0 0x7fb62c1f29b0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb62400cef0 tx=0x7fb62400a340 comp rx=0 tx=0).stop 2023-11-26T07:13:38.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.258+0000 7fb6337a4700 1 -- 172.21.15.2:0/2566740088 shutdown_connections 2023-11-26T07:13:38.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.258+0000 7fb6337a4700 1 --2- 172.21.15.2:0/2566740088 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb61006b1a0 0x7fb61006d660 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:38.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.258+0000 7fb6337a4700 1 --2- 172.21.15.2:0/2566740088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb62c15bde0 0x7fb62c1f29b0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:38.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.258+0000 7fb6337a4700 1 --2- 172.21.15.2:0/2566740088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb62c0ce5c0 0x7fb62c149170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:38.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.258+0000 7fb6337a4700 1 --2- 172.21.15.2:0/2566740088 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb62c0cf2b0 0x7fb62c1f45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:38.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.258+0000 7fb6337a4700 1 -- 172.21.15.2:0/2566740088 >> 172.21.15.2:0/2566740088 conn(0x7fb62c0b3720 msgr2=0x7fb62c0b3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:38.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.258+0000 7fb6337a4700 1 -- 172.21.15.2:0/2566740088 shutdown_connections 2023-11-26T07:13:38.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.258+0000 7fb6337a4700 1 -- 172.21.15.2:0/2566740088 wait complete. 2023-11-26T07:13:38.272 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:13:38.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.397+0000 7f72f3423700 1 Processor -- start 2023-11-26T07:13:38.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.398+0000 7f72f3423700 1 -- start start 2023-11-26T07:13:38.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.398+0000 7f72f3423700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f72ec143ae0 0x7f72ec0b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:38.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.398+0000 7f72f3423700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f72ec0722c0 0x7f72ec06e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:38.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.398+0000 7f72f3423700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72ec143ec0 con 0x7f72ec1440f0 2023-11-26T07:13:38.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.398+0000 7f72f3423700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72ec0b40a0 con 0x7f72ec143ae0 2023-11-26T07:13:38.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.398+0000 7f72f3423700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72ec0b3ae0 con 0x7f72ec0722c0 2023-11-26T07:13:38.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.399+0000 7f72f11bf700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f72ec143ae0 0x7f72ec0b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:38.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.399+0000 7f72f09be700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f72ec1440f0 0x7f72ec071bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60930/0 (socket says 172.21.15.2:60930) 2023-11-26T07:13:38.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.399+0000 7f72f09be700 1 -- 172.21.15.2:0/3886505862 learned_addr learned my addr 172.21.15.2:0/3886505862 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:13:38.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.399+0000 7f72f19c0700 1 --2- 172.21.15.2:0/3886505862 >> v2:172.21.15.192:3300/0 conn(0x7f72ec0722c0 0x7f72ec06e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:38.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.399+0000 7f72f11bf700 1 -- 172.21.15.2:0/3886505862 >> v2:172.21.15.192:3300/0 conn(0x7f72ec0722c0 msgr2=0x7f72ec06e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:38.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.399+0000 7f72f11bf700 1 --2- 172.21.15.2:0/3886505862 >> v2:172.21.15.192:3300/0 conn(0x7f72ec0722c0 0x7f72ec06e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:38.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.399+0000 7f72f11bf700 1 -- 172.21.15.2:0/3886505862 >> v1:172.21.15.2:6789/0 conn(0x7f72ec1440f0 legacy=0x7f72ec071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:38.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.399+0000 7f72f11bf700 1 -- 172.21.15.2:0/3886505862 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72ec0b3dc0 con 0x7f72ec143ae0 2023-11-26T07:13:38.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.399+0000 7f72f11bf700 1 --2- 172.21.15.2:0/3886505862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72ec143ae0 0x7f72ec0b51b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f72ec0747c0 tx=0x7f72e8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7275968f4245298 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:38.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.399+0000 7f72dffff700 1 -- 172.21.15.2:0/3886505862 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e8011830 con 0x7f72ec143ae0 2023-11-26T07:13:38.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.399+0000 7f72dffff700 1 -- 172.21.15.2:0/3886505862 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e8011990 con 0x7f72ec143ae0 2023-11-26T07:13:38.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.399+0000 7f72dffff700 1 -- 172.21.15.2:0/3886505862 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e8011d20 con 0x7f72ec143ae0 2023-11-26T07:13:38.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.400+0000 7f72f3423700 1 -- 172.21.15.2:0/3886505862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72ec143ae0 msgr2=0x7f72ec0b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:38.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.400+0000 7f72f3423700 1 --2- 172.21.15.2:0/3886505862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72ec143ae0 0x7f72ec0b51b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f72ec0747c0 tx=0x7f72e8009b20 comp rx=0 tx=0).stop 2023-11-26T07:13:38.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.400+0000 7f72f3423700 1 -- 172.21.15.2:0/3886505862 shutdown_connections 2023-11-26T07:13:38.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.400+0000 7f72f3423700 1 --2- 172.21.15.2:0/3886505862 >> v2:172.21.15.192:3300/0 conn(0x7f72ec0722c0 0x7f72ec06e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:38.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.400+0000 7f72f3423700 1 --2- 172.21.15.2:0/3886505862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72ec143ae0 0x7f72ec0b51b0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:38.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.400+0000 7f72f3423700 1 -- 172.21.15.2:0/3886505862 >> 172.21.15.2:0/3886505862 conn(0x7f72ec0b2740 msgr2=0x7f72ec0b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:38.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.400+0000 7f72f3423700 1 -- 172.21.15.2:0/3886505862 shutdown_connections 2023-11-26T07:13:38.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.400+0000 7f72f3423700 1 -- 172.21.15.2:0/3886505862 wait complete. 2023-11-26T07:13:38.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.401+0000 7f72f3423700 1 Processor -- start 2023-11-26T07:13:38.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.402+0000 7f72f3423700 1 -- start start 2023-11-26T07:13:38.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.402+0000 7f72f3423700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72ec0722c0 0x7f72ec1424d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:38.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.402+0000 7f72f3423700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72ec143ae0 0x7f72ec1414e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:38.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.402+0000 7f72f3423700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72ec1440f0 0x7f72ec13ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:38.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.402+0000 7f72f3423700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ec13c440 con 0x7f72ec0722c0 2023-11-26T07:13:38.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.402+0000 7f72f3423700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ec13b550 con 0x7f72ec143ae0 2023-11-26T07:13:38.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.402+0000 7f72f3423700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72ec13b830 con 0x7f72ec1440f0 2023-11-26T07:13:38.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.403+0000 7f72f11bf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72ec0722c0 0x7f72ec1424d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:38.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.403+0000 7f72f11bf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72ec0722c0 0x7f72ec1424d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41494/0 (socket says 172.21.15.2:41494) 2023-11-26T07:13:38.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.403+0000 7f72f11bf700 1 -- 172.21.15.2:0/3726561686 learned_addr learned my addr 172.21.15.2:0/3726561686 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:38.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.403+0000 7f72f09be700 1 --2- 172.21.15.2:0/3726561686 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72ec143ae0 0x7f72ec1414e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:38.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.403+0000 7f72f19c0700 1 --2- 172.21.15.2:0/3726561686 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72ec1440f0 0x7f72ec13ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:38.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.403+0000 7f72f11bf700 1 -- 172.21.15.2:0/3726561686 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72ec1440f0 msgr2=0x7f72ec13ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:38.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.403+0000 7f72f11bf700 1 --2- 172.21.15.2:0/3726561686 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72ec1440f0 0x7f72ec13ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:38.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.403+0000 7f72f11bf700 1 -- 172.21.15.2:0/3726561686 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72ec143ae0 msgr2=0x7f72ec1414e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:38.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.403+0000 7f72f11bf700 1 --2- 172.21.15.2:0/3726561686 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72ec143ae0 0x7f72ec1414e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:38.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.403+0000 7f72f11bf700 1 -- 172.21.15.2:0/3726561686 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e80094a0 con 0x7f72ec0722c0 2023-11-26T07:13:38.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.403+0000 7f72f11bf700 1 --2- 172.21.15.2:0/3726561686 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72ec0722c0 0x7f72ec1424d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f72e8000c00 tx=0x7f72e8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:38.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.403+0000 7f72ddffb700 1 -- 172.21.15.2:0/3726561686 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e80036a0 con 0x7f72ec0722c0 2023-11-26T07:13:38.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.403+0000 7f72ddffb700 1 -- 172.21.15.2:0/3726561686 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e801f070 con 0x7f72ec0722c0 2023-11-26T07:13:38.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.403+0000 7f72f3423700 1 -- 172.21.15.2:0/3726561686 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72ec13bb10 con 0x7f72ec0722c0 2023-11-26T07:13:38.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.403+0000 7f72ddffb700 1 -- 172.21.15.2:0/3726561686 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e8003a20 con 0x7f72ec0722c0 2023-11-26T07:13:38.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.404+0000 7f72f3423700 1 -- 172.21.15.2:0/3726561686 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72ec13c0d0 con 0x7f72ec0722c0 2023-11-26T07:13:38.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.404+0000 7f72f3423700 1 -- 172.21.15.2:0/3726561686 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72ec075480 con 0x7f72ec0722c0 2023-11-26T07:13:38.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.405+0000 7f72ddffb700 1 -- 172.21.15.2:0/3726561686 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f72e8003b80 con 0x7f72ec0722c0 2023-11-26T07:13:38.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.405+0000 7f72ddffb700 1 --2- 172.21.15.2:0/3726561686 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f72d006b1a0 0x7f72d006d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:38.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.405+0000 7f72ddffb700 1 -- 172.21.15.2:0/3726561686 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f72e8021070 con 0x7f72ec0722c0 2023-11-26T07:13:38.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.406+0000 7f72f09be700 1 --2- 172.21.15.2:0/3726561686 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f72d006b1a0 0x7f72d006d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:38.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.406+0000 7f72f09be700 1 --2- 172.21.15.2:0/3726561686 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f72d006b1a0 0x7f72d006d660 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f72ec168b50 tx=0x7f72e0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:38.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.410+0000 7f72ddffb700 1 -- 172.21.15.2:0/3726561686 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f72e80561f0 con 0x7f72ec0722c0 2023-11-26T07:13:38.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.610+0000 7f72f3423700 1 -- 172.21.15.2:0/3726561686 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f72ec144830 con 0x7f72ec0722c0 2023-11-26T07:13:38.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.611+0000 7f72ddffb700 1 -- 172.21.15.2:0/3726561686 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) v1 ==== 100+0+11 (secure 0 0 0) 0x7f72e8059810 con 0x7f72ec0722c0 2023-11-26T07:13:38.614 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-26T07:13:38.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.613+0000 7f72f3423700 1 -- 172.21.15.2:0/3726561686 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f72d006b1a0 msgr2=0x7f72d006d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:38.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.613+0000 7f72f3423700 1 --2- 172.21.15.2:0/3726561686 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f72d006b1a0 0x7f72d006d660 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f72ec168b50 tx=0x7f72e0009040 comp rx=0 tx=0).stop 2023-11-26T07:13:38.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.613+0000 7f72f3423700 1 -- 172.21.15.2:0/3726561686 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72ec0722c0 msgr2=0x7f72ec1424d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:38.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.613+0000 7f72f3423700 1 --2- 172.21.15.2:0/3726561686 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72ec0722c0 0x7f72ec1424d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f72e8000c00 tx=0x7f72e8004750 comp rx=0 tx=0).stop 2023-11-26T07:13:38.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.613+0000 7f72f3423700 1 -- 172.21.15.2:0/3726561686 shutdown_connections 2023-11-26T07:13:38.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.613+0000 7f72f3423700 1 --2- 172.21.15.2:0/3726561686 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f72d006b1a0 0x7f72d006d660 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:38.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.613+0000 7f72f3423700 1 --2- 172.21.15.2:0/3726561686 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72ec1440f0 0x7f72ec13ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:38.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.613+0000 7f72f3423700 1 --2- 172.21.15.2:0/3726561686 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72ec0722c0 0x7f72ec1424d0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:38.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.613+0000 7f72f3423700 1 --2- 172.21.15.2:0/3726561686 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72ec143ae0 0x7f72ec1414e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:38.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.613+0000 7f72f3423700 1 -- 172.21.15.2:0/3726561686 >> 172.21.15.2:0/3726561686 conn(0x7f72ec0b2740 msgr2=0x7f72ec0cdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:38.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.613+0000 7f72f3423700 1 -- 172.21.15.2:0/3726561686 shutdown_connections 2023-11-26T07:13:38.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.613+0000 7f72f3423700 1 -- 172.21.15.2:0/3726561686 wait complete. 2023-11-26T07:13:38.627 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:13:38.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.751+0000 7fd2cd835700 1 Processor -- start 2023-11-26T07:13:38.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.751+0000 7fd2cd835700 1 -- start start 2023-11-26T07:13:38.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.752+0000 7fd2cd835700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd2c80d2ba0 0x7fd2c8168e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:38.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.752+0000 7fd2cd835700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2c80d4e50 con 0x7fd2c80d49d0 2023-11-26T07:13:38.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.752+0000 7fd2cd835700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2c80b3370 con 0x7fd2c815e460 2023-11-26T07:13:38.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.752+0000 7fd2cd835700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2c80cfc40 con 0x7fd2c80d2ba0 2023-11-26T07:13:38.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.752+0000 7fd2c67fc700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd2c80d49d0 0x7fd2c80d2490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60944/0 (socket says 172.21.15.2:60944) 2023-11-26T07:13:38.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.752+0000 7fd2c67fc700 1 -- 172.21.15.2:0/3944417646 learned_addr learned my addr 172.21.15.2:0/3944417646 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:13:38.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.752+0000 7fd2c77fe700 1 --2- 172.21.15.2:0/3944417646 >> v2:172.21.15.192:3300/0 conn(0x7fd2c80d2ba0 0x7fd2c8168e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:38.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.752+0000 7fd2c5ffb700 1 -- 172.21.15.2:0/3944417646 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2080463555 0 0) 0x7fd2c80d4e50 con 0x7fd2c80d49d0 2023-11-26T07:13:38.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.752+0000 7fd2c5ffb700 1 -- 172.21.15.2:0/3944417646 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2b00035b0 con 0x7fd2c80d49d0 2023-11-26T07:13:38.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.752+0000 7fd2c5ffb700 1 -- 172.21.15.2:0/3944417646 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1606520957 0 0) 0x7fd2b00035b0 con 0x7fd2c80d49d0 2023-11-26T07:13:38.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.752+0000 7fd2c5ffb700 1 -- 172.21.15.2:0/3944417646 >> v2:172.21.15.192:3300/0 conn(0x7fd2c80d2ba0 msgr2=0x7fd2c8168e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:38.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.752+0000 7fd2c5ffb700 1 --2- 172.21.15.2:0/3944417646 >> v2:172.21.15.192:3300/0 conn(0x7fd2c80d2ba0 0x7fd2c8168e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:38.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.752+0000 7fd2c5ffb700 1 -- 172.21.15.2:0/3944417646 >> v1:172.21.15.192:6789/0 conn(0x7fd2c815e460 legacy=0x7fd2c80cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:38.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.752+0000 7fd2c5ffb700 1 -- 172.21.15.2:0/3944417646 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c80b35c0 con 0x7fd2c80d49d0 2023-11-26T07:13:38.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.752+0000 7fd2c5ffb700 1 -- 172.21.15.2:0/3944417646 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7fd2bc001670 con 0x7fd2c80d49d0 2023-11-26T07:13:38.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.752+0000 7fd2c5ffb700 1 -- 172.21.15.2:0/3944417646 >> v1:172.21.15.2:6789/0 conn(0x7fd2c80d49d0 legacy=0x7fd2c80d2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:38.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.752+0000 7fd2c5ffb700 1 --2- 172.21.15.2:0/3944417646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2b0003a00 0x7fd2b0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:38.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.752+0000 7fd2c5ffb700 1 --2- 172.21.15.2:0/3944417646 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2b0004850 0x7fd2b0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:38.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.752+0000 7fd2c5ffb700 1 --2- 172.21.15.2:0/3944417646 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2b0005210 0x7fd2b000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:38.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.752+0000 7fd2c5ffb700 1 -- 172.21.15.2:0/3944417646 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c80cfc40 con 0x7fd2b0003a00 2023-11-26T07:13:38.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.752+0000 7fd2c5ffb700 1 -- 172.21.15.2:0/3944417646 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b000c0c0 con 0x7fd2b0004850 2023-11-26T07:13:38.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.752+0000 7fd2c5ffb700 1 -- 172.21.15.2:0/3944417646 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b000c280 con 0x7fd2b0005210 2023-11-26T07:13:38.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.752+0000 7fd2c6ffd700 1 --2- 172.21.15.2:0/3944417646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2b0003a00 0x7fd2b0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:38.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.753+0000 7fd2c67fc700 1 --2- 172.21.15.2:0/3944417646 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2b0004850 0x7fd2b0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:38.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.753+0000 7fd2c77fe700 1 --2- 172.21.15.2:0/3944417646 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2b0005210 0x7fd2b000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:38.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.753+0000 7fd2c6ffd700 1 -- 172.21.15.2:0/3944417646 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2b0005210 msgr2=0x7fd2b000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:38.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.753+0000 7fd2c6ffd700 1 --2- 172.21.15.2:0/3944417646 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2b0005210 0x7fd2b000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:38.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.753+0000 7fd2c6ffd700 1 -- 172.21.15.2:0/3944417646 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2b0004850 msgr2=0x7fd2b0004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:38.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.753+0000 7fd2c6ffd700 1 --2- 172.21.15.2:0/3944417646 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2b0004850 0x7fd2b0004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:38.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.753+0000 7fd2c6ffd700 1 -- 172.21.15.2:0/3944417646 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b00035b0 con 0x7fd2b0003a00 2023-11-26T07:13:38.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.753+0000 7fd2c77fe700 1 -- 172.21.15.2:0/3944417646 reap_dead start 2023-11-26T07:13:38.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.753+0000 7fd2c6ffd700 1 --2- 172.21.15.2:0/3944417646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2b0003a00 0x7fd2b0003e20 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd2b80017c0 tx=0x7fd2b0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba28ba4b271d4878 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:38.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.753+0000 7fd2c5ffb700 1 -- 172.21.15.2:0/3944417646 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b80052d0 con 0x7fd2b0003a00 2023-11-26T07:13:38.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.753+0000 7fd2c5ffb700 1 -- 172.21.15.2:0/3944417646 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b8005430 con 0x7fd2b0003a00 2023-11-26T07:13:38.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.753+0000 7fd2c5ffb700 1 -- 172.21.15.2:0/3944417646 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b80038c0 con 0x7fd2b0003a00 2023-11-26T07:13:38.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.754+0000 7fd2cd835700 1 -- 172.21.15.2:0/3944417646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2b0003a00 msgr2=0x7fd2b0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:38.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.754+0000 7fd2cd835700 1 --2- 172.21.15.2:0/3944417646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2b0003a00 0x7fd2b0003e20 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd2b80017c0 tx=0x7fd2b0005880 comp rx=0 tx=0).stop 2023-11-26T07:13:38.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.754+0000 7fd2cd835700 1 -- 172.21.15.2:0/3944417646 shutdown_connections 2023-11-26T07:13:38.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.754+0000 7fd2cd835700 1 --2- 172.21.15.2:0/3944417646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2b0003a00 0x7fd2b0003e20 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:38.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.754+0000 7fd2cd835700 1 -- 172.21.15.2:0/3944417646 >> 172.21.15.2:0/3944417646 conn(0x7fd2c80d3eb0 msgr2=0x7fd2c80d42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:38.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.754+0000 7fd2cd835700 1 -- 172.21.15.2:0/3944417646 shutdown_connections 2023-11-26T07:13:38.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.754+0000 7fd2cd835700 1 -- 172.21.15.2:0/3944417646 wait complete. 2023-11-26T07:13:38.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.755+0000 7fd2cd835700 1 Processor -- start 2023-11-26T07:13:38.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.755+0000 7fd2cd835700 1 -- start start 2023-11-26T07:13:38.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.756+0000 7fd2cd835700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2b0003a00 0x7fd2c80b7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:38.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.756+0000 7fd2cd835700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2c80cdcc0 0x7fd2c80b8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:38.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.756+0000 7fd2cd835700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2c80b8dd0 0x7fd2c80b9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:38.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.756+0000 7fd2cd835700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c80b7aa0 con 0x7fd2c80b8dd0 2023-11-26T07:13:38.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.756+0000 7fd2cd835700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c80b7d80 con 0x7fd2c80cdcc0 2023-11-26T07:13:38.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.756+0000 7fd2cd835700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c80b8060 con 0x7fd2b0003a00 2023-11-26T07:13:38.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.756+0000 7fd2c77fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2c80b8dd0 0x7fd2c80b9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:38.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.756+0000 7fd2c77fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2c80b8dd0 0x7fd2c80b9250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41518/0 (socket says 172.21.15.2:41518) 2023-11-26T07:13:38.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.756+0000 7fd2c77fe700 1 -- 172.21.15.2:0/4155286050 learned_addr learned my addr 172.21.15.2:0/4155286050 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:38.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.756+0000 7fd2c6ffd700 1 --2- 172.21.15.2:0/4155286050 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2b0003a00 0x7fd2c80b7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:38.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.756+0000 7fd2c67fc700 1 --2- 172.21.15.2:0/4155286050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2c80cdcc0 0x7fd2c80b8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:38.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.756+0000 7fd2c77fe700 1 -- 172.21.15.2:0/4155286050 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2b0003a00 msgr2=0x7fd2c80b7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:38.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.756+0000 7fd2c77fe700 1 --2- 172.21.15.2:0/4155286050 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2b0003a00 0x7fd2c80b7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:38.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.756+0000 7fd2c77fe700 1 -- 172.21.15.2:0/4155286050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2c80cdcc0 msgr2=0x7fd2c80b8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:38.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.756+0000 7fd2c77fe700 1 --2- 172.21.15.2:0/4155286050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2c80cdcc0 0x7fd2c80b8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:38.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.756+0000 7fd2c77fe700 1 -- 172.21.15.2:0/4155286050 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c80b8340 con 0x7fd2c80b8dd0 2023-11-26T07:13:38.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.756+0000 7fd2c67fc700 1 --2- 172.21.15.2:0/4155286050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2c80cdcc0 0x7fd2c80b8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:13:38.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.756+0000 7fd2c77fe700 1 --2- 172.21.15.2:0/4155286050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2c80b8dd0 0x7fd2c80b9250 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8161d60 tx=0x7fd2c00111d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:38.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.756+0000 7fd2affff700 1 -- 172.21.15.2:0/4155286050 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c000e070 con 0x7fd2c80b8dd0 2023-11-26T07:13:38.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.757+0000 7fd2affff700 1 -- 172.21.15.2:0/4155286050 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c0003cf0 con 0x7fd2c80b8dd0 2023-11-26T07:13:38.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.757+0000 7fd2affff700 1 -- 172.21.15.2:0/4155286050 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c0003ea0 con 0x7fd2c80b8dd0 2023-11-26T07:13:38.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.757+0000 7fd2cd835700 1 -- 172.21.15.2:0/4155286050 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2c80ce140 con 0x7fd2c80b8dd0 2023-11-26T07:13:38.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.757+0000 7fd2cd835700 1 -- 172.21.15.2:0/4155286050 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2c815ef00 con 0x7fd2c80b8dd0 2023-11-26T07:13:38.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.757+0000 7fd2cd835700 1 -- 172.21.15.2:0/4155286050 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2c8067f60 con 0x7fd2c80b8dd0 2023-11-26T07:13:38.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.758+0000 7fd2affff700 1 -- 172.21.15.2:0/4155286050 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7fd2c00117f0 con 0x7fd2c80b8dd0 2023-11-26T07:13:38.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.758+0000 7fd2affff700 1 --2- 172.21.15.2:0/4155286050 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd2b406b1a0 0x7fd2b406d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:38.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.759+0000 7fd2affff700 1 -- 172.21.15.2:0/4155286050 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fd2c0089fe0 con 0x7fd2c80b8dd0 2023-11-26T07:13:38.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.759+0000 7fd2c6ffd700 1 --2- 172.21.15.2:0/4155286050 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd2b406b1a0 0x7fd2b406d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:38.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.759+0000 7fd2c6ffd700 1 --2- 172.21.15.2:0/4155286050 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd2b406b1a0 0x7fd2b406d660 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8005040 tx=0x7fd2b8009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:38.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:38.763+0000 7fd2affff700 1 -- 172.21.15.2:0/4155286050 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd2c0054ca0 con 0x7fd2c80b8dd0 2023-11-26T07:13:39.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.006+0000 7fd2cd835700 1 -- 172.21.15.2:0/4155286050 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd2c80ce330 con 0x7fd2c80b8dd0 2023-11-26T07:13:39.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.007+0000 7fd2affff700 1 -- 172.21.15.2:0/4155286050 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4913 (secure 0 0 0) 0x7fd2c00582c0 con 0x7fd2c80b8dd0 2023-11-26T07:13:39.010 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:13:39.010 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4727,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3580414083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3580414083},{"type":"v1","addr":"172.21.15.192:6837","nonce":3580414083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4948,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/3401314194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3401314194},{"type":"v1","addr":"172.21.15.2:6834","nonce":3401314194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4954,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3579861389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3579861389},{"type":"v1","addr":"172.21.15.192:6836","nonce":3579861389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:12:29.802382+0000","modified":"2023-11-26T07:12:32.823481+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5046":{"gid":5046,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6835/3058610366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":3058610366},{"type":"v1","addr":"172.21.15.2:6835","nonce":3058610366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-26T07:13:39.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.009+0000 7fd2cd835700 1 -- 172.21.15.2:0/4155286050 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd2b406b1a0 msgr2=0x7fd2b406d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:39.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.009+0000 7fd2cd835700 1 --2- 172.21.15.2:0/4155286050 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd2b406b1a0 0x7fd2b406d660 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8005040 tx=0x7fd2b8009030 comp rx=0 tx=0).stop 2023-11-26T07:13:39.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.009+0000 7fd2cd835700 1 -- 172.21.15.2:0/4155286050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2c80b8dd0 msgr2=0x7fd2c80b9250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:39.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.009+0000 7fd2cd835700 1 --2- 172.21.15.2:0/4155286050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2c80b8dd0 0x7fd2c80b9250 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8161d60 tx=0x7fd2c00111d0 comp rx=0 tx=0).stop 2023-11-26T07:13:39.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.009+0000 7fd2cd835700 1 -- 172.21.15.2:0/4155286050 shutdown_connections 2023-11-26T07:13:39.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.009+0000 7fd2cd835700 1 --2- 172.21.15.2:0/4155286050 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd2b406b1a0 0x7fd2b406d660 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:39.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.009+0000 7fd2cd835700 1 --2- 172.21.15.2:0/4155286050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2c80b8dd0 0x7fd2c80b9250 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:39.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.009+0000 7fd2cd835700 1 --2- 172.21.15.2:0/4155286050 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2b0003a00 0x7fd2c80b7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:39.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.009+0000 7fd2cd835700 1 --2- 172.21.15.2:0/4155286050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2c80cdcc0 0x7fd2c80b8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:39.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.009+0000 7fd2cd835700 1 -- 172.21.15.2:0/4155286050 >> 172.21.15.2:0/4155286050 conn(0x7fd2c80d3eb0 msgr2=0x7fd2c80d0030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:39.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.009+0000 7fd2cd835700 1 -- 172.21.15.2:0/4155286050 shutdown_connections 2023-11-26T07:13:39.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.009+0000 7fd2cd835700 1 -- 172.21.15.2:0/4155286050 wait complete. 2023-11-26T07:13:39.012 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 17 2023-11-26T07:13:39.023 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:13:39.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.146+0000 7f2467cdd700 1 Processor -- start 2023-11-26T07:13:39.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.146+0000 7f2467cdd700 1 -- start start 2023-11-26T07:13:39.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.147+0000 7f2467cdd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f24600b4c40 0x7f246006dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:39.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.147+0000 7f2467cdd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f24600b3b40 0x7f24600b5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:39.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.147+0000 7f2467cdd700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f246006ef90 con 0x7f246006f420 2023-11-26T07:13:39.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.147+0000 7f2467cdd700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f246006e0e0 con 0x7f24600b3b40 2023-11-26T07:13:39.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.147+0000 7f2467cdd700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24600b5560 con 0x7f24600b4c40 2023-11-26T07:13:39.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.147+0000 7f2465278700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f24600b3b40 0x7f24600b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:39.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.147+0000 7f2465278700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f24600b3b40 0x7f24600b5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41522/0 (socket says 172.21.15.2:41522) 2023-11-26T07:13:39.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.147+0000 7f2465278700 1 -- 172.21.15.2:0/3425392509 learned_addr learned my addr 172.21.15.2:0/3425392509 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:39.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.147+0000 7f2465a79700 1 --2- 172.21.15.2:0/3425392509 >> v2:172.21.15.192:3300/0 conn(0x7f24600b4c40 0x7f246006dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:39.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.147+0000 7f2465278700 1 -- 172.21.15.2:0/3425392509 >> v2:172.21.15.192:3300/0 conn(0x7f24600b4c40 msgr2=0x7f246006dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:39.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.147+0000 7f2465278700 1 --2- 172.21.15.2:0/3425392509 >> v2:172.21.15.192:3300/0 conn(0x7f24600b4c40 0x7f246006dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:39.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.147+0000 7f2465278700 1 -- 172.21.15.2:0/3425392509 >> v1:172.21.15.192:6789/0 conn(0x7f246006f420 legacy=0x7f24600ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:39.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.147+0000 7f2465278700 1 -- 172.21.15.2:0/3425392509 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f246006e380 con 0x7f24600b3b40 2023-11-26T07:13:39.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.147+0000 7f2465278700 1 --2- 172.21.15.2:0/3425392509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24600b3b40 0x7f24600b5020 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f24600b3900 tx=0x7f245000be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe2c0b700299753a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:39.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.148+0000 7f2464a77700 1 -- 172.21.15.2:0/3425392509 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245000dd30 con 0x7f24600b3b40 2023-11-26T07:13:39.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.148+0000 7f2464a77700 1 -- 172.21.15.2:0/3425392509 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f245000de90 con 0x7f24600b3b40 2023-11-26T07:13:39.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.148+0000 7f2464a77700 1 -- 172.21.15.2:0/3425392509 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2450010690 con 0x7f24600b3b40 2023-11-26T07:13:39.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.148+0000 7f2467cdd700 1 -- 172.21.15.2:0/3425392509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24600b3b40 msgr2=0x7f24600b5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:39.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.148+0000 7f2467cdd700 1 --2- 172.21.15.2:0/3425392509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24600b3b40 0x7f24600b5020 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f24600b3900 tx=0x7f245000be70 comp rx=0 tx=0).stop 2023-11-26T07:13:39.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.148+0000 7f2467cdd700 1 -- 172.21.15.2:0/3425392509 shutdown_connections 2023-11-26T07:13:39.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.148+0000 7f2467cdd700 1 --2- 172.21.15.2:0/3425392509 >> v2:172.21.15.192:3300/0 conn(0x7f24600b4c40 0x7f246006dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:39.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.148+0000 7f2467cdd700 1 --2- 172.21.15.2:0/3425392509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24600b3b40 0x7f24600b5020 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:39.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.148+0000 7f2467cdd700 1 -- 172.21.15.2:0/3425392509 >> 172.21.15.2:0/3425392509 conn(0x7f24600b2840 msgr2=0x7f24600b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:39.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.148+0000 7f2467cdd700 1 -- 172.21.15.2:0/3425392509 shutdown_connections 2023-11-26T07:13:39.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.148+0000 7f2467cdd700 1 -- 172.21.15.2:0/3425392509 wait complete. 2023-11-26T07:13:39.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.149+0000 7f2467cdd700 1 Processor -- start 2023-11-26T07:13:39.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.150+0000 7f2467cdd700 1 -- start start 2023-11-26T07:13:39.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.150+0000 7f2467cdd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f246006f420 0x7f24600a96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:39.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.150+0000 7f2467cdd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24600b3b40 0x7f2460142010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:39.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.150+0000 7f2467cdd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24600b4c40 0x7f2460142550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:39.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.150+0000 7f2467cdd700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24601f06f0 con 0x7f24600b3b40 2023-11-26T07:13:39.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.150+0000 7f2467cdd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2460142d90 con 0x7f24600b4c40 2023-11-26T07:13:39.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.150+0000 7f2467cdd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2460143070 con 0x7f246006f420 2023-11-26T07:13:39.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.150+0000 7f2465278700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24600b3b40 0x7f2460142010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:39.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.150+0000 7f2465278700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24600b3b40 0x7f2460142010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41530/0 (socket says 172.21.15.2:41530) 2023-11-26T07:13:39.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.150+0000 7f2465278700 1 -- 172.21.15.2:0/3887226935 learned_addr learned my addr 172.21.15.2:0/3887226935 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:39.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.151+0000 7f2465a79700 1 --2- 172.21.15.2:0/3887226935 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f246006f420 0x7f24600a96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:39.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.151+0000 7f246627a700 1 --2- 172.21.15.2:0/3887226935 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24600b4c40 0x7f2460142550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:39.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.151+0000 7f2465278700 1 -- 172.21.15.2:0/3887226935 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f246006f420 msgr2=0x7f24600a96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:39.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.151+0000 7f2465278700 1 --2- 172.21.15.2:0/3887226935 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f246006f420 0x7f24600a96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:39.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.151+0000 7f2465278700 1 -- 172.21.15.2:0/3887226935 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24600b4c40 msgr2=0x7f2460142550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:39.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.151+0000 7f2465278700 1 --2- 172.21.15.2:0/3887226935 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24600b4c40 0x7f2460142550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:39.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.151+0000 7f2465278700 1 -- 172.21.15.2:0/3887226935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245000b7f0 con 0x7f24600b3b40 2023-11-26T07:13:39.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.151+0000 7f2465a79700 1 --2- 172.21.15.2:0/3887226935 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f246006f420 0x7f24600a96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:13:39.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.151+0000 7f2465278700 1 --2- 172.21.15.2:0/3887226935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24600b3b40 0x7f2460142010 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f245000b7c0 tx=0x7f2450004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:39.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.151+0000 7f24567fc700 1 -- 172.21.15.2:0/3887226935 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245001f070 con 0x7f24600b3b40 2023-11-26T07:13:39.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.151+0000 7f24567fc700 1 -- 172.21.15.2:0/3887226935 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2450003ba0 con 0x7f24600b3b40 2023-11-26T07:13:39.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.151+0000 7f2467cdd700 1 -- 172.21.15.2:0/3887226935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2460143350 con 0x7f24600b3b40 2023-11-26T07:13:39.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.151+0000 7f24567fc700 1 -- 172.21.15.2:0/3887226935 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2450010470 con 0x7f24600b3b40 2023-11-26T07:13:39.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.151+0000 7f2467cdd700 1 -- 172.21.15.2:0/3887226935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2460142a90 con 0x7f24600b3b40 2023-11-26T07:13:39.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.152+0000 7f2467cdd700 1 -- 172.21.15.2:0/3887226935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2460067c70 con 0x7f24600b3b40 2023-11-26T07:13:39.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.152+0000 7f24567fc700 1 -- 172.21.15.2:0/3887226935 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f2450019400 con 0x7f24600b3b40 2023-11-26T07:13:39.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.153+0000 7f24567fc700 1 --2- 172.21.15.2:0/3887226935 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f244406b1a0 0x7f244406d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:39.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.153+0000 7f24567fc700 1 -- 172.21.15.2:0/3887226935 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f245008cdb0 con 0x7f24600b3b40 2023-11-26T07:13:39.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.153+0000 7f2465a79700 1 --2- 172.21.15.2:0/3887226935 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f244406b1a0 0x7f244406d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:39.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.153+0000 7f2465a79700 1 --2- 172.21.15.2:0/3887226935 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f244406b1a0 0x7f244406d660 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f245c007a50 tx=0x7f245c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:39.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.157+0000 7f24567fc700 1 -- 172.21.15.2:0/3887226935 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2450057a70 con 0x7f24600b3b40 2023-11-26T07:13:39.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.360+0000 7f2467cdd700 1 -- 172.21.15.2:0/3887226935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2460143870 con 0x7f24600b3b40 2023-11-26T07:13:39.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.361+0000 7f24567fc700 1 -- 172.21.15.2:0/3887226935 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16586 (secure 0 0 0) 0x7f2450006d80 con 0x7f24600b3b40 2023-11-26T07:13:39.363 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:13:39.363 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":34,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:13:26.223324+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:12:27.898687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-26T07:12:28.763512+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":33,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:13:39.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.363+0000 7f2467cdd700 1 -- 172.21.15.2:0/3887226935 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f244406b1a0 msgr2=0x7f244406d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:39.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.363+0000 7f2467cdd700 1 --2- 172.21.15.2:0/3887226935 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f244406b1a0 0x7f244406d660 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f245c007a50 tx=0x7f245c008040 comp rx=0 tx=0).stop 2023-11-26T07:13:39.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.363+0000 7f2467cdd700 1 -- 172.21.15.2:0/3887226935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24600b3b40 msgr2=0x7f2460142010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:39.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.363+0000 7f2467cdd700 1 --2- 172.21.15.2:0/3887226935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24600b3b40 0x7f2460142010 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f245000b7c0 tx=0x7f2450004750 comp rx=0 tx=0).stop 2023-11-26T07:13:39.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.363+0000 7f2467cdd700 1 -- 172.21.15.2:0/3887226935 shutdown_connections 2023-11-26T07:13:39.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.363+0000 7f2467cdd700 1 --2- 172.21.15.2:0/3887226935 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f244406b1a0 0x7f244406d660 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:39.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.363+0000 7f2467cdd700 1 --2- 172.21.15.2:0/3887226935 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24600b4c40 0x7f2460142550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:39.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.363+0000 7f2467cdd700 1 --2- 172.21.15.2:0/3887226935 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f246006f420 0x7f24600a96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:39.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.363+0000 7f2467cdd700 1 --2- 172.21.15.2:0/3887226935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24600b3b40 0x7f2460142010 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:39.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.364+0000 7f2467cdd700 1 -- 172.21.15.2:0/3887226935 >> 172.21.15.2:0/3887226935 conn(0x7f24600b2840 msgr2=0x7f246006b860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:39.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.364+0000 7f2467cdd700 1 -- 172.21.15.2:0/3887226935 shutdown_connections 2023-11-26T07:13:39.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.364+0000 7f2467cdd700 1 -- 172.21.15.2:0/3887226935 wait complete. 2023-11-26T07:13:39.378 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-26T07:13:39.378 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:13:39.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.500+0000 7f488b9c9700 1 Processor -- start 2023-11-26T07:13:39.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.501+0000 7f488b9c9700 1 -- start start 2023-11-26T07:13:39.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.502+0000 7f488b9c9700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f48841448b0 0x7f488406ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:39.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.502+0000 7f488b9c9700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f48840b44c0 0x7f488406f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:39.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.502+0000 7f488b9c9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f488406f7c0 0x7f488406db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:39.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.502+0000 7f488b9c9700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f488406fc50 con 0x7f48840b44c0 2023-11-26T07:13:39.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.502+0000 7f488b9c9700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4884144c90 con 0x7f48841448b0 2023-11-26T07:13:39.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.502+0000 7f488b9c9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48840b4c80 con 0x7f488406f7c0 2023-11-26T07:13:39.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.502+0000 7f4888f64700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f48840b44c0 0x7f488406f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:39.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.502+0000 7f4888f64700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f48840b44c0 0x7f488406f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41536/0 (socket says 172.21.15.2:41536) 2023-11-26T07:13:39.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.502+0000 7f4888f64700 1 -- 172.21.15.2:0/1857289424 learned_addr learned my addr 172.21.15.2:0/1857289424 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:39.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.502+0000 7f4889765700 1 --2- 172.21.15.2:0/1857289424 >> v2:172.21.15.192:3300/0 conn(0x7f48841448b0 0x7f488406ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:39.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.502+0000 7f4889f66700 1 --2- 172.21.15.2:0/1857289424 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f488406f7c0 0x7f488406db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:39.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.502+0000 7f4888f64700 1 -- 172.21.15.2:0/1857289424 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f488406f7c0 msgr2=0x7f488406db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:39.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.502+0000 7f4888f64700 1 --2- 172.21.15.2:0/1857289424 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f488406f7c0 0x7f488406db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:39.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.502+0000 7f4888f64700 1 -- 172.21.15.2:0/1857289424 >> v2:172.21.15.192:3300/0 conn(0x7f48841448b0 msgr2=0x7f488406ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:39.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.502+0000 7f4888f64700 1 --2- 172.21.15.2:0/1857289424 >> v2:172.21.15.192:3300/0 conn(0x7f48841448b0 0x7f488406ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:39.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.502+0000 7f4888f64700 1 -- 172.21.15.2:0/1857289424 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48840b4f60 con 0x7f48840b44c0 2023-11-26T07:13:39.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.502+0000 7f4889765700 1 --2- 172.21.15.2:0/1857289424 >> v2:172.21.15.192:3300/0 conn(0x7f48841448b0 0x7f488406ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:13:39.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.502+0000 7f4889f66700 1 --2- 172.21.15.2:0/1857289424 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f488406f7c0 0x7f488406db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:13:39.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.502+0000 7f4888f64700 1 --2- 172.21.15.2:0/1857289424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48840b44c0 0x7f488406f280 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f488406d4b0 tx=0x7f487800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1af27421dbb763d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:39.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.502+0000 7f4877fff700 1 -- 172.21.15.2:0/1857289424 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487800dd30 con 0x7f48840b44c0 2023-11-26T07:13:39.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.502+0000 7f4877fff700 1 -- 172.21.15.2:0/1857289424 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f487800de90 con 0x7f48840b44c0 2023-11-26T07:13:39.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.502+0000 7f4877fff700 1 -- 172.21.15.2:0/1857289424 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4878010690 con 0x7f48840b44c0 2023-11-26T07:13:39.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.503+0000 7f488b9c9700 1 -- 172.21.15.2:0/1857289424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48840b44c0 msgr2=0x7f488406f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:39.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.503+0000 7f488b9c9700 1 --2- 172.21.15.2:0/1857289424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48840b44c0 0x7f488406f280 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f488406d4b0 tx=0x7f487800be70 comp rx=0 tx=0).stop 2023-11-26T07:13:39.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.503+0000 7f488b9c9700 1 -- 172.21.15.2:0/1857289424 shutdown_connections 2023-11-26T07:13:39.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.503+0000 7f488b9c9700 1 --2- 172.21.15.2:0/1857289424 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f488406f7c0 0x7f488406db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:39.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.503+0000 7f488b9c9700 1 --2- 172.21.15.2:0/1857289424 >> v2:172.21.15.192:3300/0 conn(0x7f48841448b0 0x7f488406ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:39.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.503+0000 7f488b9c9700 1 --2- 172.21.15.2:0/1857289424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48840b44c0 0x7f488406f280 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:39.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.503+0000 7f488b9c9700 1 -- 172.21.15.2:0/1857289424 >> 172.21.15.2:0/1857289424 conn(0x7f48840d0bc0 msgr2=0x7f48840d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:39.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.503+0000 7f488b9c9700 1 -- 172.21.15.2:0/1857289424 shutdown_connections 2023-11-26T07:13:39.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.503+0000 7f488b9c9700 1 -- 172.21.15.2:0/1857289424 wait complete. 2023-11-26T07:13:39.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.504+0000 7f488b9c9700 1 Processor -- start 2023-11-26T07:13:39.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.504+0000 7f488b9c9700 1 -- start start 2023-11-26T07:13:39.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.505+0000 7f488b9c9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f488406f7c0 0x7f4884136860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:39.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.505+0000 7f488b9c9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48840b44c0 0x7f488415b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:39.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.505+0000 7f488b9c9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48841448b0 0x7f488415d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:39.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.505+0000 7f488b9c9700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4884136da0 con 0x7f48840b44c0 2023-11-26T07:13:39.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.505+0000 7f488b9c9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488415bf60 con 0x7f488406f7c0 2023-11-26T07:13:39.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.505+0000 7f488b9c9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f488415c240 con 0x7f48841448b0 2023-11-26T07:13:39.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.505+0000 7f4888f64700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48840b44c0 0x7f488415b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:39.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.505+0000 7f4888f64700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48840b44c0 0x7f488415b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41544/0 (socket says 172.21.15.2:41544) 2023-11-26T07:13:39.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.505+0000 7f4888f64700 1 -- 172.21.15.2:0/3237998316 learned_addr learned my addr 172.21.15.2:0/3237998316 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:39.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.505+0000 7f4888f64700 1 -- 172.21.15.2:0/3237998316 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48841448b0 msgr2=0x7f488415d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:39.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.505+0000 7f4888f64700 1 --2- 172.21.15.2:0/3237998316 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48841448b0 0x7f488415d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:39.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.505+0000 7f4888f64700 1 -- 172.21.15.2:0/3237998316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f488406f7c0 msgr2=0x7f4884136860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:39.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.505+0000 7f4888f64700 1 --2- 172.21.15.2:0/3237998316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f488406f7c0 0x7f4884136860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:39.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.505+0000 7f4888f64700 1 -- 172.21.15.2:0/3237998316 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487800b7f0 con 0x7f48840b44c0 2023-11-26T07:13:39.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.506+0000 7f4888f64700 1 --2- 172.21.15.2:0/3237998316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48840b44c0 0x7f488415b5f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f4878000c00 tx=0x7f4878004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:39.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.506+0000 7f4875ffb700 1 -- 172.21.15.2:0/3237998316 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487801f070 con 0x7f48840b44c0 2023-11-26T07:13:39.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.506+0000 7f4875ffb700 1 -- 172.21.15.2:0/3237998316 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4878003a60 con 0x7f48840b44c0 2023-11-26T07:13:39.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.506+0000 7f488b9c9700 1 -- 172.21.15.2:0/3237998316 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f488415c520 con 0x7f48840b44c0 2023-11-26T07:13:39.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.506+0000 7f4875ffb700 1 -- 172.21.15.2:0/3237998316 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4878003e10 con 0x7f48840b44c0 2023-11-26T07:13:39.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.506+0000 7f488b9c9700 1 -- 172.21.15.2:0/3237998316 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f488415cae0 con 0x7f48840b44c0 2023-11-26T07:13:39.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.507+0000 7f488b9c9700 1 -- 172.21.15.2:0/3237998316 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f488415ce50 con 0x7f48840b44c0 2023-11-26T07:13:39.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.507+0000 7f4875ffb700 1 -- 172.21.15.2:0/3237998316 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f4878019400 con 0x7f48840b44c0 2023-11-26T07:13:39.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.508+0000 7f4875ffb700 1 --2- 172.21.15.2:0/3237998316 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f486806b1a0 0x7f486806d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:39.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.508+0000 7f4875ffb700 1 -- 172.21.15.2:0/3237998316 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f487808ce40 con 0x7f48840b44c0 2023-11-26T07:13:39.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.508+0000 7f4889765700 1 --2- 172.21.15.2:0/3237998316 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f486806b1a0 0x7f486806d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:39.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.509+0000 7f4889765700 1 --2- 172.21.15.2:0/3237998316 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f486806b1a0 0x7f486806d660 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f48800098f0 tx=0x7f4880008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:39.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.512+0000 7f4875ffb700 1 -- 172.21.15.2:0/3237998316 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4878057b00 con 0x7f48840b44c0 2023-11-26T07:13:39.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.763+0000 7f488b9c9700 1 -- 172.21.15.2:0/3237998316 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f488415cc70 con 0x7f48840b44c0 2023-11-26T07:13:39.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.763+0000 7f4875ffb700 1 -- 172.21.15.2:0/3237998316 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f487805b120 con 0x7f48840b44c0 2023-11-26T07:13:39.766 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:13:39.766 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4727,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3580414083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3580414083},{"type":"v1","addr":"172.21.15.192:6837","nonce":3580414083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4948,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/3401314194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3401314194},{"type":"v1","addr":"172.21.15.2:6834","nonce":3401314194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4954,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3579861389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3579861389},{"type":"v1","addr":"172.21.15.192:6836","nonce":3579861389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:12:29.802382+0000","modified":"2023-11-26T07:12:32.823481+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5046":{"gid":5046,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6835/3058610366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":3058610366},{"type":"v1","addr":"172.21.15.2:6835","nonce":3058610366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-26T07:13:39.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.766+0000 7f488b9c9700 1 -- 172.21.15.2:0/3237998316 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f486806b1a0 msgr2=0x7f486806d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:39.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.766+0000 7f488b9c9700 1 --2- 172.21.15.2:0/3237998316 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f486806b1a0 0x7f486806d660 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f48800098f0 tx=0x7f4880008040 comp rx=0 tx=0).stop 2023-11-26T07:13:39.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.766+0000 7f488b9c9700 1 -- 172.21.15.2:0/3237998316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48840b44c0 msgr2=0x7f488415b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:39.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.766+0000 7f488b9c9700 1 --2- 172.21.15.2:0/3237998316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48840b44c0 0x7f488415b5f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f4878000c00 tx=0x7f4878004750 comp rx=0 tx=0).stop 2023-11-26T07:13:39.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.766+0000 7f488b9c9700 1 -- 172.21.15.2:0/3237998316 shutdown_connections 2023-11-26T07:13:39.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.766+0000 7f488b9c9700 1 --2- 172.21.15.2:0/3237998316 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f486806b1a0 0x7f486806d660 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:39.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.766+0000 7f488b9c9700 1 --2- 172.21.15.2:0/3237998316 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48841448b0 0x7f488415d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:39.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.766+0000 7f488b9c9700 1 --2- 172.21.15.2:0/3237998316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f488406f7c0 0x7f4884136860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:39.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.766+0000 7f488b9c9700 1 --2- 172.21.15.2:0/3237998316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48840b44c0 0x7f488415b5f0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:39.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.766+0000 7f488b9c9700 1 -- 172.21.15.2:0/3237998316 >> 172.21.15.2:0/3237998316 conn(0x7f48840d0bc0 msgr2=0x7f4884143930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:39.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.766+0000 7f488b9c9700 1 -- 172.21.15.2:0/3237998316 shutdown_connections 2023-11-26T07:13:39.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.766+0000 7f488b9c9700 1 -- 172.21.15.2:0/3237998316 wait complete. 2023-11-26T07:13:39.769 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 17 2023-11-26T07:13:39.780 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:13:39.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.902+0000 7efcdf389700 1 Processor -- start 2023-11-26T07:13:39.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.902+0000 7efcdf389700 1 -- start start 2023-11-26T07:13:39.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.903+0000 7efcdf389700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efcd8143ae0 0x7efcd80b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:39.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.903+0000 7efcdf389700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7efcd80722c0 0x7efcd806e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:39.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.903+0000 7efcdf389700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcd8143ec0 con 0x7efcd81440f0 2023-11-26T07:13:39.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.903+0000 7efcdf389700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcd80b40a0 con 0x7efcd80722c0 2023-11-26T07:13:39.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.903+0000 7efcdf389700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcd80b3ae0 con 0x7efcd8143ae0 2023-11-26T07:13:39.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.903+0000 7efcdc924700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7efcd81440f0 0x7efcd8071bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60992/0 (socket says 172.21.15.2:60992) 2023-11-26T07:13:39.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.903+0000 7efcdc924700 1 -- 172.21.15.2:0/2937384197 learned_addr learned my addr 172.21.15.2:0/2937384197 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:13:39.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.903+0000 7efccffff700 1 -- 172.21.15.2:0/2937384197 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1352669275 0 0) 0x7efcd8143ec0 con 0x7efcd81440f0 2023-11-26T07:13:39.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.903+0000 7efcdd125700 1 --2- 172.21.15.2:0/2937384197 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efcd8143ae0 0x7efcd80b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:39.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.903+0000 7efccffff700 1 -- 172.21.15.2:0/2937384197 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcc40035b0 con 0x7efcd81440f0 2023-11-26T07:13:39.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.903+0000 7efcdd926700 1 --2- 172.21.15.2:0/2937384197 >> v2:172.21.15.192:3300/0 conn(0x7efcd80722c0 0x7efcd806e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:39.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.904+0000 7efccffff700 1 -- 172.21.15.2:0/2937384197 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 104328822 0 0) 0x7efcc40035b0 con 0x7efcd81440f0 2023-11-26T07:13:39.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.904+0000 7efccffff700 1 -- 172.21.15.2:0/2937384197 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efcd8143ae0 msgr2=0x7efcd80b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:39.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.904+0000 7efccffff700 1 --2- 172.21.15.2:0/2937384197 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efcd8143ae0 0x7efcd80b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:39.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.904+0000 7efccffff700 1 -- 172.21.15.2:0/2937384197 >> v2:172.21.15.192:3300/0 conn(0x7efcd80722c0 msgr2=0x7efcd806e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:39.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.904+0000 7efccffff700 1 --2- 172.21.15.2:0/2937384197 >> v2:172.21.15.192:3300/0 conn(0x7efcd80722c0 0x7efcd806e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:39.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.904+0000 7efccffff700 1 -- 172.21.15.2:0/2937384197 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd80b3dc0 con 0x7efcd81440f0 2023-11-26T07:13:39.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.904+0000 7efccffff700 1 -- 172.21.15.2:0/2937384197 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7efcd4001670 con 0x7efcd81440f0 2023-11-26T07:13:39.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.904+0000 7efccffff700 1 -- 172.21.15.2:0/2937384197 >> v1:172.21.15.2:6789/0 conn(0x7efcd81440f0 legacy=0x7efcd8071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:39.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.904+0000 7efccffff700 1 --2- 172.21.15.2:0/2937384197 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efcd8143ae0 0x7efcc4003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:39.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.904+0000 7efccffff700 1 --2- 172.21.15.2:0/2937384197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcc4003f80 0x7efcc4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:39.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.904+0000 7efccffff700 1 --2- 172.21.15.2:0/2937384197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efcc4004d90 0x7efcc4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:39.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.904+0000 7efccffff700 1 -- 172.21.15.2:0/2937384197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd80b40a0 con 0x7efcc4003f80 2023-11-26T07:13:39.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.904+0000 7efccffff700 1 -- 172.21.15.2:0/2937384197 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd80b3ae0 con 0x7efcc4004d90 2023-11-26T07:13:39.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.904+0000 7efccffff700 1 -- 172.21.15.2:0/2937384197 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc400ba10 con 0x7efcd8143ae0 2023-11-26T07:13:39.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.904+0000 7efcdc924700 1 --2- 172.21.15.2:0/2937384197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcc4003f80 0x7efcc4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:39.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.904+0000 7efcdd125700 1 --2- 172.21.15.2:0/2937384197 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efcd8143ae0 0x7efcc4003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:39.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.904+0000 7efcdd926700 1 --2- 172.21.15.2:0/2937384197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efcc4004d90 0x7efcc4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:39.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.904+0000 7efcdc924700 1 -- 172.21.15.2:0/2937384197 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efcd8143ae0 msgr2=0x7efcc4003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:39.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.904+0000 7efcdc924700 1 --2- 172.21.15.2:0/2937384197 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efcd8143ae0 0x7efcc4003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:39.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.904+0000 7efcdc924700 1 -- 172.21.15.2:0/2937384197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efcc4004d90 msgr2=0x7efcc4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:39.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.904+0000 7efcdc924700 1 --2- 172.21.15.2:0/2937384197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efcc4004d90 0x7efcc4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:39.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.904+0000 7efcdc924700 1 -- 172.21.15.2:0/2937384197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc40035b0 con 0x7efcc4003f80 2023-11-26T07:13:39.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.904+0000 7efcdc924700 1 --2- 172.21.15.2:0/2937384197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcc4003f80 0x7efcc4004850 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7efcd400c2f0 tx=0x7efcc4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54693030ba125e59 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:39.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.904+0000 7efccffff700 1 -- 172.21.15.2:0/2937384197 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd400cdd0 con 0x7efcc4003f80 2023-11-26T07:13:39.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.904+0000 7efccffff700 1 -- 172.21.15.2:0/2937384197 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd4005960 con 0x7efcc4003f80 2023-11-26T07:13:39.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.904+0000 7efccffff700 1 -- 172.21.15.2:0/2937384197 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd4005d10 con 0x7efcc4003f80 2023-11-26T07:13:39.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.905+0000 7efcdf389700 1 -- 172.21.15.2:0/2937384197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcc4003f80 msgr2=0x7efcc4004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:39.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.905+0000 7efcdf389700 1 --2- 172.21.15.2:0/2937384197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcc4003f80 0x7efcc4004850 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7efcd400c2f0 tx=0x7efcc4005880 comp rx=0 tx=0).stop 2023-11-26T07:13:39.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.905+0000 7efcdd926700 1 -- 172.21.15.2:0/2937384197 reap_dead start 2023-11-26T07:13:39.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.905+0000 7efcdf389700 1 -- 172.21.15.2:0/2937384197 shutdown_connections 2023-11-26T07:13:39.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.905+0000 7efcdf389700 1 -- 172.21.15.2:0/2937384197 >> 172.21.15.2:0/2937384197 conn(0x7efcd80b2740 msgr2=0x7efcd80b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:39.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.905+0000 7efcdf389700 1 -- 172.21.15.2:0/2937384197 shutdown_connections 2023-11-26T07:13:39.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.905+0000 7efcdf389700 1 -- 172.21.15.2:0/2937384197 wait complete. 2023-11-26T07:13:39.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.906+0000 7efcdf389700 1 Processor -- start 2023-11-26T07:13:39.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.906+0000 7efcdf389700 1 -- start start 2023-11-26T07:13:39.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.907+0000 7efcdf389700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efcc4003f80 0x7efcd81580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:39.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.907+0000 7efcdf389700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efcd81414c0 0x7efcd81585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:39.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.907+0000 7efcdf389700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcd8142d70 0x7efcd8140330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:39.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.907+0000 7efcdf389700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd8141a30 con 0x7efcd8142d70 2023-11-26T07:13:39.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.907+0000 7efcdf389700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd8141d10 con 0x7efcd81414c0 2023-11-26T07:13:39.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.907+0000 7efcdf389700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcd8141ff0 con 0x7efcc4003f80 2023-11-26T07:13:39.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.907+0000 7efcdd926700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcd8142d70 0x7efcd8140330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:39.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.907+0000 7efcdd926700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcd8142d70 0x7efcd8140330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41562/0 (socket says 172.21.15.2:41562) 2023-11-26T07:13:39.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.907+0000 7efcdd926700 1 -- 172.21.15.2:0/157997479 learned_addr learned my addr 172.21.15.2:0/157997479 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:39.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.907+0000 7efcdc924700 1 --2- 172.21.15.2:0/157997479 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efcd81414c0 0x7efcd81585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:39.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.907+0000 7efcdd125700 1 --2- 172.21.15.2:0/157997479 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efcc4003f80 0x7efcd81580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:39.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.908+0000 7efcdd926700 1 -- 172.21.15.2:0/157997479 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efcc4003f80 msgr2=0x7efcd81580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:39.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.908+0000 7efcdd926700 1 --2- 172.21.15.2:0/157997479 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efcc4003f80 0x7efcd81580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:39.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.908+0000 7efcdd926700 1 -- 172.21.15.2:0/157997479 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efcd81414c0 msgr2=0x7efcd81585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:39.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.908+0000 7efcdd926700 1 --2- 172.21.15.2:0/157997479 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efcd81414c0 0x7efcd81585e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:39.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.908+0000 7efcdd926700 1 -- 172.21.15.2:0/157997479 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd81422d0 con 0x7efcd8142d70 2023-11-26T07:13:39.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.908+0000 7efcdd926700 1 --2- 172.21.15.2:0/157997479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcd8142d70 0x7efcd8140330 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7efcd80706c0 tx=0x7efcd0011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:39.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.908+0000 7efccdffb700 1 -- 172.21.15.2:0/157997479 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd000e040 con 0x7efcd8142d70 2023-11-26T07:13:39.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.908+0000 7efccdffb700 1 -- 172.21.15.2:0/157997479 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd000f040 con 0x7efcd8142d70 2023-11-26T07:13:39.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.908+0000 7efcdf389700 1 -- 172.21.15.2:0/157997479 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcd813fe10 con 0x7efcd8142d70 2023-11-26T07:13:39.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.908+0000 7efccdffb700 1 -- 172.21.15.2:0/157997479 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd000fc40 con 0x7efcd8142d70 2023-11-26T07:13:39.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.908+0000 7efcdf389700 1 -- 172.21.15.2:0/157997479 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd813f3b0 con 0x7efcd8142d70 2023-11-26T07:13:39.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.909+0000 7efcdf389700 1 -- 172.21.15.2:0/157997479 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcd8140180 con 0x7efcd8142d70 2023-11-26T07:13:39.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.910+0000 7efccdffb700 1 -- 172.21.15.2:0/157997479 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7efcd0015430 con 0x7efcd8142d70 2023-11-26T07:13:39.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.910+0000 7efccdffb700 1 --2- 172.21.15.2:0/157997479 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7efcbc06b190 0x7efcbc06d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:39.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.910+0000 7efccdffb700 1 -- 172.21.15.2:0/157997479 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5737+0+0 (secure 0 0 0) 0x7efcd008a290 con 0x7efcd8142d70 2023-11-26T07:13:39.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.910+0000 7efcdd125700 1 --2- 172.21.15.2:0/157997479 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7efcbc06b190 0x7efcbc06d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:39.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.911+0000 7efcdd125700 1 --2- 172.21.15.2:0/157997479 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7efcbc06b190 0x7efcbc06d650 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7efcc8009b80 tx=0x7efcc8009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:39.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:39.914+0000 7efccdffb700 1 -- 172.21.15.2:0/157997479 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efcd0054f50 con 0x7efcd8142d70 2023-11-26T07:13:40.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.159+0000 7efcdf389700 1 -- 172.21.15.2:0/157997479 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efcd8067a40 con 0x7efcd8142d70 2023-11-26T07:13:40.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.160+0000 7efccdffb700 1 -- 172.21.15.2:0/157997479 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4913 (secure 0 0 0) 0x7efcd8067a40 con 0x7efcd8142d70 2023-11-26T07:13:40.162 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:13:40.162 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4727,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3580414083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3580414083},{"type":"v1","addr":"172.21.15.192:6837","nonce":3580414083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4948,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/3401314194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3401314194},{"type":"v1","addr":"172.21.15.2:6834","nonce":3401314194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4954,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3579861389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3579861389},{"type":"v1","addr":"172.21.15.192:6836","nonce":3579861389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:12:29.802382+0000","modified":"2023-11-26T07:12:32.823481+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5046":{"gid":5046,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6835/3058610366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":3058610366},{"type":"v1","addr":"172.21.15.2:6835","nonce":3058610366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-26T07:13:40.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.162+0000 7efcdf389700 1 -- 172.21.15.2:0/157997479 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7efcbc06b190 msgr2=0x7efcbc06d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:40.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.162+0000 7efcdf389700 1 --2- 172.21.15.2:0/157997479 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7efcbc06b190 0x7efcbc06d650 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7efcc8009b80 tx=0x7efcc8009210 comp rx=0 tx=0).stop 2023-11-26T07:13:40.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.162+0000 7efcdf389700 1 -- 172.21.15.2:0/157997479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcd8142d70 msgr2=0x7efcd8140330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:40.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.162+0000 7efcdf389700 1 --2- 172.21.15.2:0/157997479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcd8142d70 0x7efcd8140330 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7efcd80706c0 tx=0x7efcd0011ed0 comp rx=0 tx=0).stop 2023-11-26T07:13:40.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.162+0000 7efcdf389700 1 -- 172.21.15.2:0/157997479 shutdown_connections 2023-11-26T07:13:40.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.162+0000 7efcdf389700 1 --2- 172.21.15.2:0/157997479 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7efcbc06b190 0x7efcbc06d650 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:40.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.162+0000 7efcdf389700 1 --2- 172.21.15.2:0/157997479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcd8142d70 0x7efcd8140330 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:40.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.162+0000 7efcdf389700 1 --2- 172.21.15.2:0/157997479 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efcc4003f80 0x7efcd81580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:40.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.162+0000 7efcdf389700 1 --2- 172.21.15.2:0/157997479 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efcd81414c0 0x7efcd81585e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:40.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.162+0000 7efcdf389700 1 -- 172.21.15.2:0/157997479 >> 172.21.15.2:0/157997479 conn(0x7efcd80b2740 msgr2=0x7efcd81594a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:40.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.163+0000 7efcdf389700 1 -- 172.21.15.2:0/157997479 shutdown_connections 2023-11-26T07:13:40.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.163+0000 7efcdf389700 1 -- 172.21.15.2:0/157997479 wait complete. 2023-11-26T07:13:40.166 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 17 2023-11-26T07:13:40.176 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:13:40.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.299+0000 7f5fe4cce700 1 Processor -- start 2023-11-26T07:13:40.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.299+0000 7f5fe4cce700 1 -- start start 2023-11-26T07:13:40.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.300+0000 7f5fe4cce700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fe0071bb0 0x7f5fe006afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:40.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.300+0000 7f5fe4cce700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5fe006b510 0x7f5fe006dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:40.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.300+0000 7f5fe4cce700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fe006b970 con 0x7f5fe00d0080 2023-11-26T07:13:40.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.300+0000 7f5fe4cce700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fe0072cd0 con 0x7f5fe006b510 2023-11-26T07:13:40.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.300+0000 7f5fe4cce700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe0147bb0 con 0x7f5fe0071bb0 2023-11-26T07:13:40.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.300+0000 7f5fde59c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f5fe00d0080 0x7f5fe00b5890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:32778/0 (socket says 172.21.15.2:32778) 2023-11-26T07:13:40.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.300+0000 7f5fde59c700 1 -- 172.21.15.2:0/2614119343 learned_addr learned my addr 172.21.15.2:0/2614119343 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:13:40.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.300+0000 7f5fded9d700 1 --2- 172.21.15.2:0/2614119343 >> v2:172.21.15.192:3300/0 conn(0x7f5fe006b510 0x7f5fe006dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:40.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.300+0000 7f5fddd9b700 1 --2- 172.21.15.2:0/2614119343 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fe0071bb0 0x7f5fe006afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:40.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.300+0000 7f5fdd59a700 1 -- 172.21.15.2:0/2614119343 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 773681129 0 0) 0x7f5fe006b970 con 0x7f5fe00d0080 2023-11-26T07:13:40.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.300+0000 7f5fdd59a700 1 -- 172.21.15.2:0/2614119343 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fc80035b0 con 0x7f5fe00d0080 2023-11-26T07:13:40.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.301+0000 7f5fddd9b700 1 -- 172.21.15.2:0/2614119343 >> v2:172.21.15.192:3300/0 conn(0x7f5fe006b510 msgr2=0x7f5fe006dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:40.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.301+0000 7f5fddd9b700 1 --2- 172.21.15.2:0/2614119343 >> v2:172.21.15.192:3300/0 conn(0x7f5fe006b510 0x7f5fe006dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:40.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.301+0000 7f5fddd9b700 1 -- 172.21.15.2:0/2614119343 >> v1:172.21.15.2:6789/0 conn(0x7f5fe00d0080 legacy=0x7f5fe00b5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:40.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.301+0000 7f5fddd9b700 1 -- 172.21.15.2:0/2614119343 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe00d0460 con 0x7f5fe0071bb0 2023-11-26T07:13:40.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.301+0000 7f5fded9d700 1 --2- 172.21.15.2:0/2614119343 >> v2:172.21.15.192:3300/0 conn(0x7f5fe006b510 0x7f5fe006dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:13:40.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.301+0000 7f5fddd9b700 1 --2- 172.21.15.2:0/2614119343 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fe0071bb0 0x7f5fe006afd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4009840 tx=0x7f5fd4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdcc2192f2335114 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:40.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.301+0000 7f5fdd59a700 1 -- 172.21.15.2:0/2614119343 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd4011830 con 0x7f5fe0071bb0 2023-11-26T07:13:40.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.301+0000 7f5fdd59a700 1 -- 172.21.15.2:0/2614119343 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd4011990 con 0x7f5fe0071bb0 2023-11-26T07:13:40.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.301+0000 7f5fdd59a700 1 -- 172.21.15.2:0/2614119343 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd4011d20 con 0x7f5fe0071bb0 2023-11-26T07:13:40.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.302+0000 7f5fe4cce700 1 -- 172.21.15.2:0/2614119343 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fe0071bb0 msgr2=0x7f5fe006afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:40.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.302+0000 7f5fe4cce700 1 --2- 172.21.15.2:0/2614119343 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fe0071bb0 0x7f5fe006afd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4009840 tx=0x7f5fd4009b50 comp rx=0 tx=0).stop 2023-11-26T07:13:40.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.302+0000 7f5fe4cce700 1 -- 172.21.15.2:0/2614119343 shutdown_connections 2023-11-26T07:13:40.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.302+0000 7f5fe4cce700 1 --2- 172.21.15.2:0/2614119343 >> v2:172.21.15.192:3300/0 conn(0x7f5fe006b510 0x7f5fe006dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:40.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.302+0000 7f5fe4cce700 1 --2- 172.21.15.2:0/2614119343 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fe0071bb0 0x7f5fe006afd0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:40.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.302+0000 7f5fe4cce700 1 -- 172.21.15.2:0/2614119343 >> 172.21.15.2:0/2614119343 conn(0x7f5fe00b27d0 msgr2=0x7f5fe00b2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:40.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.302+0000 7f5fe4cce700 1 -- 172.21.15.2:0/2614119343 shutdown_connections 2023-11-26T07:13:40.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.302+0000 7f5fe4cce700 1 -- 172.21.15.2:0/2614119343 wait complete. 2023-11-26T07:13:40.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.303+0000 7f5fe4cce700 1 Processor -- start 2023-11-26T07:13:40.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.303+0000 7f5fe4cce700 1 -- start start 2023-11-26T07:13:40.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.304+0000 7f5fe4cce700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fe006b510 0x7f5fe013e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:40.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.304+0000 7f5fe4cce700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fe0071bb0 0x7f5fe0142060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:40.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.304+0000 7f5fe4cce700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fe00d0080 0x7f5fe01e3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:40.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.304+0000 7f5fe4cce700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe0141c40 con 0x7f5fe00d0080 2023-11-26T07:13:40.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.304+0000 7f5fe4cce700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe0140fc0 con 0x7f5fe0071bb0 2023-11-26T07:13:40.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.304+0000 7f5fe4cce700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe01412a0 con 0x7f5fe006b510 2023-11-26T07:13:40.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.304+0000 7f5fded9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fe00d0080 0x7f5fe01e3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:40.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.304+0000 7f5fded9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fe00d0080 0x7f5fe01e3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41578/0 (socket says 172.21.15.2:41578) 2023-11-26T07:13:40.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.304+0000 7f5fded9d700 1 -- 172.21.15.2:0/3812610716 learned_addr learned my addr 172.21.15.2:0/3812610716 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:40.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.304+0000 7f5fde59c700 1 --2- 172.21.15.2:0/3812610716 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fe006b510 0x7f5fe013e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:40.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.304+0000 7f5fddd9b700 1 --2- 172.21.15.2:0/3812610716 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fe0071bb0 0x7f5fe0142060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:40.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.304+0000 7f5fded9d700 1 -- 172.21.15.2:0/3812610716 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fe006b510 msgr2=0x7f5fe013e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:40.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.304+0000 7f5fded9d700 1 --2- 172.21.15.2:0/3812610716 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fe006b510 0x7f5fe013e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:40.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.304+0000 7f5fded9d700 1 -- 172.21.15.2:0/3812610716 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fe0071bb0 msgr2=0x7f5fe0142060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:40.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.304+0000 7f5fded9d700 1 --2- 172.21.15.2:0/3812610716 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fe0071bb0 0x7f5fe0142060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:40.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.304+0000 7f5fded9d700 1 -- 172.21.15.2:0/3812610716 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd8009a70 con 0x7f5fe00d0080 2023-11-26T07:13:40.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.304+0000 7f5fde59c700 1 --2- 172.21.15.2:0/3812610716 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fe006b510 0x7f5fe013e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:13:40.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.305+0000 7f5fded9d700 1 --2- 172.21.15.2:0/3812610716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fe00d0080 0x7f5fe01e3e60 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f5fd800efc0 tx=0x7f5fd800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:40.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.305+0000 7f5fceffd700 1 -- 172.21.15.2:0/3812610716 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd800cb40 con 0x7f5fe00d0080 2023-11-26T07:13:40.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.305+0000 7f5fceffd700 1 -- 172.21.15.2:0/3812610716 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd800f040 con 0x7f5fe00d0080 2023-11-26T07:13:40.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.305+0000 7f5fe4cce700 1 -- 172.21.15.2:0/3812610716 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fd40094a0 con 0x7f5fe00d0080 2023-11-26T07:13:40.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.305+0000 7f5fceffd700 1 -- 172.21.15.2:0/3812610716 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8003a20 con 0x7f5fe00d0080 2023-11-26T07:13:40.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.305+0000 7f5fe4cce700 1 -- 172.21.15.2:0/3812610716 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fe0141860 con 0x7f5fe00d0080 2023-11-26T07:13:40.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.306+0000 7f5fe4cce700 1 -- 172.21.15.2:0/3812610716 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fe0068670 con 0x7f5fe00d0080 2023-11-26T07:13:40.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.306+0000 7f5fceffd700 1 -- 172.21.15.2:0/3812610716 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f5fd8014480 con 0x7f5fe00d0080 2023-11-26T07:13:40.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.307+0000 7f5fceffd700 1 --2- 172.21.15.2:0/3812610716 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5fc006b1a0 0x7f5fc006d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:40.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.307+0000 7f5fceffd700 1 -- 172.21.15.2:0/3812610716 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f5fd808a4e0 con 0x7f5fe00d0080 2023-11-26T07:13:40.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.307+0000 7f5fde59c700 1 --2- 172.21.15.2:0/3812610716 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5fc006b1a0 0x7f5fc006d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:40.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.307+0000 7f5fde59c700 1 --2- 172.21.15.2:0/3812610716 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5fc006b1a0 0x7f5fc006d660 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5fd00011e0 tx=0x7f5fd0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:40.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.311+0000 7f5fceffd700 1 -- 172.21.15.2:0/3812610716 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5fd80551a0 con 0x7f5fe00d0080 2023-11-26T07:13:40.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.513+0000 7f5fe4cce700 1 -- 172.21.15.2:0/3812610716 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5fe0141d80 con 0x7f5fe00d0080 2023-11-26T07:13:40.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.514+0000 7f5fceffd700 1 -- 172.21.15.2:0/3812610716 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16586 (secure 0 0 0) 0x7f5fe0141d80 con 0x7f5fe00d0080 2023-11-26T07:13:40.516 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:13:40.517 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":34,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:13:26.223324+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:12:27.898687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-26T07:12:28.763512+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":33,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:13:40.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.517+0000 7f5fe4cce700 1 -- 172.21.15.2:0/3812610716 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5fc006b1a0 msgr2=0x7f5fc006d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:40.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.517+0000 7f5fe4cce700 1 --2- 172.21.15.2:0/3812610716 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5fc006b1a0 0x7f5fc006d660 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5fd00011e0 tx=0x7f5fd0009040 comp rx=0 tx=0).stop 2023-11-26T07:13:40.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.517+0000 7f5fe4cce700 1 -- 172.21.15.2:0/3812610716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fe00d0080 msgr2=0x7f5fe01e3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:40.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.517+0000 7f5fe4cce700 1 --2- 172.21.15.2:0/3812610716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fe00d0080 0x7f5fe01e3e60 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f5fd800efc0 tx=0x7f5fd800c3a0 comp rx=0 tx=0).stop 2023-11-26T07:13:40.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.517+0000 7f5fe4cce700 1 -- 172.21.15.2:0/3812610716 shutdown_connections 2023-11-26T07:13:40.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.517+0000 7f5fe4cce700 1 --2- 172.21.15.2:0/3812610716 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5fc006b1a0 0x7f5fc006d660 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:40.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.517+0000 7f5fe4cce700 1 --2- 172.21.15.2:0/3812610716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fe00d0080 0x7f5fe01e3e60 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:40.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.517+0000 7f5fe4cce700 1 --2- 172.21.15.2:0/3812610716 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fe006b510 0x7f5fe013e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:40.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.517+0000 7f5fe4cce700 1 --2- 172.21.15.2:0/3812610716 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fe0071bb0 0x7f5fe0142060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:40.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.517+0000 7f5fe4cce700 1 -- 172.21.15.2:0/3812610716 >> 172.21.15.2:0/3812610716 conn(0x7f5fe00b27d0 msgr2=0x7f5fe00b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:40.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.517+0000 7f5fe4cce700 1 -- 172.21.15.2:0/3812610716 shutdown_connections 2023-11-26T07:13:40.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.517+0000 7f5fe4cce700 1 -- 172.21.15.2:0/3812610716 wait complete. 2023-11-26T07:13:40.531 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-26T07:13:40.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.655+0000 7f1c1d58f700 1 Processor -- start 2023-11-26T07:13:40.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.655+0000 7f1c1d58f700 1 -- start start 2023-11-26T07:13:40.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.656+0000 7f1c1d58f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1c1806afd0 0x7f1c180b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:40.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.656+0000 7f1c1d58f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1c18071b40 0x7f1c18071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:40.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.656+0000 7f1c1d58f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c180ad860 con 0x7f1c1806edc0 2023-11-26T07:13:40.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.656+0000 7f1c1d58f700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c1806f830 con 0x7f1c18071b40 2023-11-26T07:13:40.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.656+0000 7f1c1d58f700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c180d0a20 con 0x7f1c1806afd0 2023-11-26T07:13:40.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.656+0000 7f1c177fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1c18071b40 0x7f1c18071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:40.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.656+0000 7f1c177fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1c18071b40 0x7f1c18071ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41584/0 (socket says 172.21.15.2:41584) 2023-11-26T07:13:40.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.656+0000 7f1c177fe700 1 -- 172.21.15.2:0/2441069571 learned_addr learned my addr 172.21.15.2:0/2441069571 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:40.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.656+0000 7f1c16ffd700 1 --2- 172.21.15.2:0/2441069571 >> v2:172.21.15.192:3300/0 conn(0x7f1c1806afd0 0x7f1c180b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:40.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.657+0000 7f1c177fe700 1 -- 172.21.15.2:0/2441069571 >> v2:172.21.15.192:3300/0 conn(0x7f1c1806afd0 msgr2=0x7f1c180b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:40.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.657+0000 7f1c177fe700 1 --2- 172.21.15.2:0/2441069571 >> v2:172.21.15.192:3300/0 conn(0x7f1c1806afd0 0x7f1c180b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:40.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.657+0000 7f1c177fe700 1 -- 172.21.15.2:0/2441069571 >> v1:172.21.15.192:6789/0 conn(0x7f1c1806edc0 legacy=0x7f1c1806b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:40.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.657+0000 7f1c177fe700 1 -- 172.21.15.2:0/2441069571 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c18162a70 con 0x7f1c18071b40 2023-11-26T07:13:40.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.657+0000 7f1c16ffd700 1 --2- 172.21.15.2:0/2441069571 >> v2:172.21.15.192:3300/0 conn(0x7f1c1806afd0 0x7f1c180b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:13:40.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.657+0000 7f1c177fe700 1 --2- 172.21.15.2:0/2441069571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c18071b40 0x7f1c18071ff0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1c18073820 tx=0x7f1c1000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ae91c13d0c2201a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:40.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.657+0000 7f1c15ffb700 1 -- 172.21.15.2:0/2441069571 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1000e070 con 0x7f1c18071b40 2023-11-26T07:13:40.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.657+0000 7f1c15ffb700 1 -- 172.21.15.2:0/2441069571 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c10003a20 con 0x7f1c18071b40 2023-11-26T07:13:40.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.657+0000 7f1c15ffb700 1 -- 172.21.15.2:0/2441069571 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c10003dd0 con 0x7f1c18071b40 2023-11-26T07:13:40.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.657+0000 7f1c1d58f700 1 -- 172.21.15.2:0/2441069571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c18071b40 msgr2=0x7f1c18071ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:40.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.657+0000 7f1c1d58f700 1 --2- 172.21.15.2:0/2441069571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c18071b40 0x7f1c18071ff0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1c18073820 tx=0x7f1c1000b330 comp rx=0 tx=0).stop 2023-11-26T07:13:40.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.657+0000 7f1c1d58f700 1 -- 172.21.15.2:0/2441069571 shutdown_connections 2023-11-26T07:13:40.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.657+0000 7f1c1d58f700 1 --2- 172.21.15.2:0/2441069571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c18071b40 0x7f1c18071ff0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:40.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.657+0000 7f1c1d58f700 1 --2- 172.21.15.2:0/2441069571 >> v2:172.21.15.192:3300/0 conn(0x7f1c1806afd0 0x7f1c180b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:40.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.657+0000 7f1c1d58f700 1 -- 172.21.15.2:0/2441069571 >> 172.21.15.2:0/2441069571 conn(0x7f1c180b2840 msgr2=0x7f1c180b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:40.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.658+0000 7f1c1d58f700 1 -- 172.21.15.2:0/2441069571 shutdown_connections 2023-11-26T07:13:40.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.658+0000 7f1c1d58f700 1 -- 172.21.15.2:0/2441069571 wait complete. 2023-11-26T07:13:40.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.659+0000 7f1c1d58f700 1 Processor -- start 2023-11-26T07:13:40.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.659+0000 7f1c1d58f700 1 -- start start 2023-11-26T07:13:40.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.660+0000 7f1c1d58f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c1806afd0 0x7f1c18159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:40.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.660+0000 7f1c1d58f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c1806edc0 0x7f1c1815d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:40.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.660+0000 7f1c1d58f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c18071b40 0x7f1c181f3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:40.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.660+0000 7f1c1d58f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c180c6c30 con 0x7f1c18071b40 2023-11-26T07:13:40.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.660+0000 7f1c1d58f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c18159590 con 0x7f1c1806edc0 2023-11-26T07:13:40.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.660+0000 7f1c1d58f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c180c5fb0 con 0x7f1c1806afd0 2023-11-26T07:13:40.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.660+0000 7f1c177fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c18071b40 0x7f1c181f3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:40.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.660+0000 7f1c177fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c18071b40 0x7f1c181f3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41590/0 (socket says 172.21.15.2:41590) 2023-11-26T07:13:40.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.660+0000 7f1c177fe700 1 -- 172.21.15.2:0/3891539864 learned_addr learned my addr 172.21.15.2:0/3891539864 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:40.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.660+0000 7f1c16ffd700 1 --2- 172.21.15.2:0/3891539864 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c1806afd0 0x7f1c18159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:40.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.660+0000 7f1c167fc700 1 --2- 172.21.15.2:0/3891539864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c1806edc0 0x7f1c1815d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:40.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.660+0000 7f1c177fe700 1 -- 172.21.15.2:0/3891539864 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c1806afd0 msgr2=0x7f1c18159050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:40.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.660+0000 7f1c177fe700 1 --2- 172.21.15.2:0/3891539864 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c1806afd0 0x7f1c18159050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:40.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.660+0000 7f1c177fe700 1 -- 172.21.15.2:0/3891539864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c1806edc0 msgr2=0x7f1c1815d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:40.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.660+0000 7f1c177fe700 1 --2- 172.21.15.2:0/3891539864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c1806edc0 0x7f1c1815d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:40.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.660+0000 7f1c177fe700 1 -- 172.21.15.2:0/3891539864 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c10009b30 con 0x7f1c18071b40 2023-11-26T07:13:40.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.660+0000 7f1c177fe700 1 --2- 172.21.15.2:0/3891539864 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c18071b40 0x7f1c181f3dd0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f1c10015040 tx=0x7f1c10004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:40.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.660+0000 7f1bff7fe700 1 -- 172.21.15.2:0/3891539864 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c10004240 con 0x7f1c18071b40 2023-11-26T07:13:40.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.660+0000 7f1bff7fe700 1 -- 172.21.15.2:0/3891539864 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c100043a0 con 0x7f1c18071b40 2023-11-26T07:13:40.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.660+0000 7f1c1d58f700 1 -- 172.21.15.2:0/3891539864 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c180c6290 con 0x7f1c18071b40 2023-11-26T07:13:40.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.660+0000 7f1bff7fe700 1 -- 172.21.15.2:0/3891539864 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c10004750 con 0x7f1c18071b40 2023-11-26T07:13:40.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.660+0000 7f1c1d58f700 1 -- 172.21.15.2:0/3891539864 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c180c6850 con 0x7f1c18071b40 2023-11-26T07:13:40.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.661+0000 7f1c1d58f700 1 -- 172.21.15.2:0/3891539864 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c180c6d70 con 0x7f1c18071b40 2023-11-26T07:13:40.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.662+0000 7f1bff7fe700 1 -- 172.21.15.2:0/3891539864 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f1c10019070 con 0x7f1c18071b40 2023-11-26T07:13:40.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.662+0000 7f1bff7fe700 1 --2- 172.21.15.2:0/3891539864 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f1c0406b1a0 0x7f1c0406d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:40.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.662+0000 7f1bff7fe700 1 -- 172.21.15.2:0/3891539864 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f1c1008ab70 con 0x7f1c18071b40 2023-11-26T07:13:40.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.662+0000 7f1c16ffd700 1 --2- 172.21.15.2:0/3891539864 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f1c0406b1a0 0x7f1c0406d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:40.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.663+0000 7f1c16ffd700 1 --2- 172.21.15.2:0/3891539864 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f1c0406b1a0 0x7f1c0406d660 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c006fd0 tx=0x7f1c0c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:40.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.667+0000 7f1bff7fe700 1 -- 172.21.15.2:0/3891539864 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1c180c6d70 con 0x7f1c18071b40 2023-11-26T07:13:40.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.913+0000 7f1c1d58f700 1 -- 172.21.15.2:0/3891539864 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1c180c6a10 con 0x7f1c18071b40 2023-11-26T07:13:40.915 INFO:tasks.ceph.mon.a.smithi002.stderr:2023-11-26T07:13:40.913+0000 7f35cd3c3700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-26T07:13:40.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.915+0000 7f1bff7fe700 1 -- 172.21.15.2:0/3891539864 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1c10020090 con 0x7f1c18071b40 2023-11-26T07:13:40.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.917+0000 7f1c1d58f700 1 -- 172.21.15.2:0/3891539864 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f1c0406b1a0 msgr2=0x7f1c0406d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:40.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.917+0000 7f1c1d58f700 1 --2- 172.21.15.2:0/3891539864 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f1c0406b1a0 0x7f1c0406d660 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c006fd0 tx=0x7f1c0c008040 comp rx=0 tx=0).stop 2023-11-26T07:13:40.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.917+0000 7f1c1d58f700 1 -- 172.21.15.2:0/3891539864 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c18071b40 msgr2=0x7f1c181f3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:40.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.917+0000 7f1c1d58f700 1 --2- 172.21.15.2:0/3891539864 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c18071b40 0x7f1c181f3dd0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f1c10015040 tx=0x7f1c10004ad0 comp rx=0 tx=0).stop 2023-11-26T07:13:40.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.917+0000 7f1c1d58f700 1 -- 172.21.15.2:0/3891539864 shutdown_connections 2023-11-26T07:13:40.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.917+0000 7f1c1d58f700 1 --2- 172.21.15.2:0/3891539864 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f1c0406b1a0 0x7f1c0406d660 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:40.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.917+0000 7f1c1d58f700 1 --2- 172.21.15.2:0/3891539864 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c18071b40 0x7f1c181f3dd0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:40.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.917+0000 7f1c1d58f700 1 --2- 172.21.15.2:0/3891539864 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c1806afd0 0x7f1c18159050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:40.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.917+0000 7f1c1d58f700 1 --2- 172.21.15.2:0/3891539864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c1806edc0 0x7f1c1815d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:40.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.917+0000 7f1c1d58f700 1 -- 172.21.15.2:0/3891539864 >> 172.21.15.2:0/3891539864 conn(0x7f1c180b2840 msgr2=0x7f1c1806b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:40.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.917+0000 7f1c1d58f700 1 -- 172.21.15.2:0/3891539864 shutdown_connections 2023-11-26T07:13:40.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:40.917+0000 7f1c1d58f700 1 -- 172.21.15.2:0/3891539864 wait complete. 2023-11-26T07:13:40.920 INFO:teuthology.orchestra.run.smithi002.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-26T07:13:40.932 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-26T07:13:40.958 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2023-11-26T07:13:41.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.060+0000 7f8ab93d0700 1 Processor -- start 2023-11-26T07:13:41.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.060+0000 7f8ab93d0700 1 -- start start 2023-11-26T07:13:41.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.061+0000 7f8ab93d0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ab40cfa00 0x7f8ab40d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:41.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.061+0000 7f8ab93d0700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ab40ce9a0 con 0x7f8ab40d2b50 2023-11-26T07:13:41.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.061+0000 7f8ab93d0700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ab40cec40 con 0x7f8ab415e080 2023-11-26T07:13:41.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.061+0000 7f8ab93d0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab40d14b0 con 0x7f8ab40cfa00 2023-11-26T07:13:41.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.061+0000 7f8ab27fc700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f8ab40d2b50 0x7f8ab40d0740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:32818/0 (socket says 172.21.15.2:32818) 2023-11-26T07:13:41.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.061+0000 7f8ab27fc700 1 -- 172.21.15.2:0/3382424344 learned_addr learned my addr 172.21.15.2:0/3382424344 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:13:41.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.061+0000 7f8ab37fe700 1 --2- 172.21.15.2:0/3382424344 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ab40cfa00 0x7f8ab40d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:41.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.061+0000 7f8ab1ffb700 1 -- 172.21.15.2:0/3382424344 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 736272545 0 0) 0x7f8ab40ce9a0 con 0x7f8ab40d2b50 2023-11-26T07:13:41.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.061+0000 7f8ab1ffb700 1 -- 172.21.15.2:0/3382424344 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a9c0035b0 con 0x7f8ab40d2b50 2023-11-26T07:13:41.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.061+0000 7f8ab1ffb700 1 -- 172.21.15.2:0/3382424344 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 431939727 0 0) 0x7f8ab40cec40 con 0x7f8ab415e080 2023-11-26T07:13:41.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.061+0000 7f8ab1ffb700 1 -- 172.21.15.2:0/3382424344 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ab40ce9a0 con 0x7f8ab415e080 2023-11-26T07:13:41.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.061+0000 7f8ab37fe700 1 -- 172.21.15.2:0/3382424344 >> v1:172.21.15.192:6789/0 conn(0x7f8ab415e080 legacy=0x7f8ab40d2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:41.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.061+0000 7f8ab37fe700 1 -- 172.21.15.2:0/3382424344 >> v1:172.21.15.2:6789/0 conn(0x7f8ab40d2b50 legacy=0x7f8ab40d0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:41.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.061+0000 7f8ab1ffb700 1 -- 172.21.15.2:0/3382424344 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1297580550 0 0) 0x7f8a9c0035b0 con 0x7f8ab40d2b50 2023-11-26T07:13:41.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.061+0000 7f8ab37fe700 1 -- 172.21.15.2:0/3382424344 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab40cef20 con 0x7f8ab40cfa00 2023-11-26T07:13:41.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.062+0000 7f8ab37fe700 1 --2- 172.21.15.2:0/3382424344 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ab40cfa00 0x7f8ab40d0e50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8aac009dc0 tx=0x7f8aac00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f24ccec0d8045177 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:41.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.062+0000 7f8ab1ffb700 1 -- 172.21.15.2:0/3382424344 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aac00e070 con 0x7f8ab40cfa00 2023-11-26T07:13:41.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.062+0000 7f8ab1ffb700 1 -- 172.21.15.2:0/3382424344 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aac003a20 con 0x7f8ab40cfa00 2023-11-26T07:13:41.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.062+0000 7f8ab1ffb700 1 -- 172.21.15.2:0/3382424344 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa4001670 con 0x7f8ab40cfa00 2023-11-26T07:13:41.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.062+0000 7f8ab93d0700 1 -- 172.21.15.2:0/3382424344 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ab40cfa00 msgr2=0x7f8ab40d0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:41.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.062+0000 7f8ab93d0700 1 --2- 172.21.15.2:0/3382424344 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ab40cfa00 0x7f8ab40d0e50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8aac009dc0 tx=0x7f8aac00b330 comp rx=0 tx=0).stop 2023-11-26T07:13:41.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.062+0000 7f8ab93d0700 1 -- 172.21.15.2:0/3382424344 shutdown_connections 2023-11-26T07:13:41.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.062+0000 7f8ab93d0700 1 --2- 172.21.15.2:0/3382424344 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ab40cfa00 0x7f8ab40d0e50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:41.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.062+0000 7f8ab93d0700 1 -- 172.21.15.2:0/3382424344 >> 172.21.15.2:0/3382424344 conn(0x7f8ab409d180 msgr2=0x7f8ab40d3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:41.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.062+0000 7f8ab93d0700 1 -- 172.21.15.2:0/3382424344 shutdown_connections 2023-11-26T07:13:41.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.062+0000 7f8ab93d0700 1 -- 172.21.15.2:0/3382424344 wait complete. 2023-11-26T07:13:41.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.064+0000 7f8ab93d0700 1 Processor -- start 2023-11-26T07:13:41.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.064+0000 7f8ab93d0700 1 -- start start 2023-11-26T07:13:41.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.064+0000 7f8ab93d0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ab40cfa00 0x7f8ab40caf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:41.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.064+0000 7f8ab93d0700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ab40d2b50 0x7f8ab4161130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:41.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.064+0000 7f8ab93d0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ab415e080 0x7f8ab414f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:41.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.064+0000 7f8ab93d0700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab40cb540 con 0x7f8ab40cfa00 2023-11-26T07:13:41.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.064+0000 7f8ab93d0700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab40cb820 con 0x7f8ab40d2b50 2023-11-26T07:13:41.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.064+0000 7f8ab93d0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab40cbb00 con 0x7f8ab415e080 2023-11-26T07:13:41.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.065+0000 7f8ab2ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ab40cfa00 0x7f8ab40caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:41.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.065+0000 7f8ab2ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ab40cfa00 0x7f8ab40caf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41612/0 (socket says 172.21.15.2:41612) 2023-11-26T07:13:41.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.065+0000 7f8ab2ffd700 1 -- 172.21.15.2:0/4159214895 learned_addr learned my addr 172.21.15.2:0/4159214895 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:41.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.065+0000 7f8ab27fc700 1 --2- 172.21.15.2:0/4159214895 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ab40d2b50 0x7f8ab4161130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:41.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.065+0000 7f8ab37fe700 1 --2- 172.21.15.2:0/4159214895 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ab415e080 0x7f8ab414f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:41.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.065+0000 7f8ab2ffd700 1 -- 172.21.15.2:0/4159214895 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ab415e080 msgr2=0x7f8ab414f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:41.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.065+0000 7f8ab2ffd700 1 --2- 172.21.15.2:0/4159214895 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ab415e080 0x7f8ab414f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:41.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.065+0000 7f8ab2ffd700 1 -- 172.21.15.2:0/4159214895 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ab40d2b50 msgr2=0x7f8ab4161130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:41.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.065+0000 7f8ab2ffd700 1 --2- 172.21.15.2:0/4159214895 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ab40d2b50 0x7f8ab4161130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:41.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.065+0000 7f8ab2ffd700 1 -- 172.21.15.2:0/4159214895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aac009a70 con 0x7f8ab40cfa00 2023-11-26T07:13:41.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.065+0000 7f8ab2ffd700 1 --2- 172.21.15.2:0/4159214895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ab40cfa00 0x7f8ab40caf60 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f8aa800c500 tx=0x7f8aa800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:41.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.065+0000 7f8a9b7fe700 1 -- 172.21.15.2:0/4159214895 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa80052d0 con 0x7f8ab40cfa00 2023-11-26T07:13:41.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.065+0000 7f8a9b7fe700 1 -- 172.21.15.2:0/4159214895 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa8005450 con 0x7f8ab40cfa00 2023-11-26T07:13:41.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.065+0000 7f8ab93d0700 1 -- 172.21.15.2:0/4159214895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ab40cbde0 con 0x7f8ab40cfa00 2023-11-26T07:13:41.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.065+0000 7f8a9b7fe700 1 -- 172.21.15.2:0/4159214895 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa80038c0 con 0x7f8ab40cfa00 2023-11-26T07:13:41.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.065+0000 7f8ab93d0700 1 -- 172.21.15.2:0/4159214895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ab4161670 con 0x7f8ab40cfa00 2023-11-26T07:13:41.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.066+0000 7f8ab93d0700 1 -- 172.21.15.2:0/4159214895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ab4068480 con 0x7f8ab40cfa00 2023-11-26T07:13:41.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.067+0000 7f8a9b7fe700 1 -- 172.21.15.2:0/4159214895 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f8aa8003a20 con 0x7f8ab40cfa00 2023-11-26T07:13:41.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.067+0000 7f8a9b7fe700 1 --2- 172.21.15.2:0/4159214895 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8aa006b1a0 0x7f8aa006d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:41.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.067+0000 7f8a9b7fe700 1 -- 172.21.15.2:0/4159214895 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f8aa8089020 con 0x7f8ab40cfa00 2023-11-26T07:13:41.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.068+0000 7f8ab27fc700 1 --2- 172.21.15.2:0/4159214895 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8aa006b1a0 0x7f8aa006d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:41.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.068+0000 7f8ab27fc700 1 --2- 172.21.15.2:0/4159214895 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8aa006b1a0 0x7f8aa006d660 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8ab40d11d0 tx=0x7f8aa4001c20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:41.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.072+0000 7f8a9b7fe700 1 -- 172.21.15.2:0/4159214895 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8aa8053ca0 con 0x7f8ab40cfa00 2023-11-26T07:13:41.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.322+0000 7f8ab93d0700 1 -- 172.21.15.2:0/4159214895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8ab4075480 con 0x7f8ab40cfa00 2023-11-26T07:13:41.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.915+0000 7f8a9b7fe700 1 -- 172.21.15.2:0/4159214895 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8aa80572c0 con 0x7f8ab40cfa00 2023-11-26T07:13:41.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.917+0000 7f8ab93d0700 1 -- 172.21.15.2:0/4159214895 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8aa006b1a0 msgr2=0x7f8aa006d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:41.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.917+0000 7f8ab93d0700 1 --2- 172.21.15.2:0/4159214895 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8aa006b1a0 0x7f8aa006d660 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8ab40d11d0 tx=0x7f8aa4001c20 comp rx=0 tx=0).stop 2023-11-26T07:13:41.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.917+0000 7f8ab93d0700 1 -- 172.21.15.2:0/4159214895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ab40cfa00 msgr2=0x7f8ab40caf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:41.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.917+0000 7f8ab93d0700 1 --2- 172.21.15.2:0/4159214895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ab40cfa00 0x7f8ab40caf60 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f8aa800c500 tx=0x7f8aa800c8c0 comp rx=0 tx=0).stop 2023-11-26T07:13:41.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.918+0000 7f8ab93d0700 1 -- 172.21.15.2:0/4159214895 shutdown_connections 2023-11-26T07:13:41.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.918+0000 7f8ab93d0700 1 --2- 172.21.15.2:0/4159214895 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8aa006b1a0 0x7f8aa006d660 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:41.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.918+0000 7f8ab93d0700 1 --2- 172.21.15.2:0/4159214895 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ab415e080 0x7f8ab414f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:41.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.918+0000 7f8ab93d0700 1 --2- 172.21.15.2:0/4159214895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ab40cfa00 0x7f8ab40caf60 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:41.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.918+0000 7f8ab93d0700 1 --2- 172.21.15.2:0/4159214895 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ab40d2b50 0x7f8ab4161130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:41.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.918+0000 7f8ab93d0700 1 -- 172.21.15.2:0/4159214895 >> 172.21.15.2:0/4159214895 conn(0x7f8ab409d180 msgr2=0x7f8ab40d07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:41.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.918+0000 7f8ab93d0700 1 -- 172.21.15.2:0/4159214895 shutdown_connections 2023-11-26T07:13:41.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:41.918+0000 7f8ab93d0700 1 -- 172.21.15.2:0/4159214895 wait complete. 2023-11-26T07:13:41.936 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-26T07:13:42.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.110+0000 7fe19e4e8700 1 Processor -- start 2023-11-26T07:13:42.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.111+0000 7fe19e4e8700 1 -- start start 2023-11-26T07:13:42.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.111+0000 7fe19e4e8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1980d1210 0x7fe1981692d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:42.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.111+0000 7fe19e4e8700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1980cf7b0 con 0x7fe1980b49b0 2023-11-26T07:13:42.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.111+0000 7fe19e4e8700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1980d2f80 con 0x7fe198162210 2023-11-26T07:13:42.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.111+0000 7fe19e4e8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1980cfa00 con 0x7fe1980d1210 2023-11-26T07:13:42.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.111+0000 7fe1977fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe1980b49b0 0x7fe1980b3e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:32832/0 (socket says 172.21.15.2:32832) 2023-11-26T07:13:42.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.111+0000 7fe1977fe700 1 -- 172.21.15.2:0/4215183050 learned_addr learned my addr 172.21.15.2:0/4215183050 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:13:42.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.112+0000 7fe19ca85700 1 --2- 172.21.15.2:0/4215183050 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1980d1210 0x7fe1981692d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:42.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.112+0000 7fe196ffd700 1 -- 172.21.15.2:0/4215183050 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 752793066 0 0) 0x7fe1980cf7b0 con 0x7fe1980b49b0 2023-11-26T07:13:42.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.112+0000 7fe196ffd700 1 -- 172.21.15.2:0/4215183050 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1800035b0 con 0x7fe1980b49b0 2023-11-26T07:13:42.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.112+0000 7fe196ffd700 1 -- 172.21.15.2:0/4215183050 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 654363670 0 0) 0x7fe1800035b0 con 0x7fe1980b49b0 2023-11-26T07:13:42.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.112+0000 7fe196ffd700 1 -- 172.21.15.2:0/4215183050 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1980d1210 msgr2=0x7fe1981692d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:42.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.112+0000 7fe196ffd700 1 --2- 172.21.15.2:0/4215183050 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1980d1210 0x7fe1981692d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:42.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.112+0000 7fe196ffd700 1 -- 172.21.15.2:0/4215183050 >> v1:172.21.15.192:6789/0 conn(0x7fe198162210 legacy=0x7fe1981625f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:42.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.112+0000 7fe196ffd700 1 -- 172.21.15.2:0/4215183050 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1980cfce0 con 0x7fe1980b49b0 2023-11-26T07:13:42.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.112+0000 7fe196ffd700 1 -- 172.21.15.2:0/4215183050 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7fe18c001670 con 0x7fe1980b49b0 2023-11-26T07:13:42.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.112+0000 7fe196ffd700 1 -- 172.21.15.2:0/4215183050 >> v1:172.21.15.2:6789/0 conn(0x7fe1980b49b0 legacy=0x7fe1980b3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:42.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.112+0000 7fe196ffd700 1 --2- 172.21.15.2:0/4215183050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe180003a30 0x7fe180003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:42.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.112+0000 7fe196ffd700 1 --2- 172.21.15.2:0/4215183050 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1980d1210 0x7fe180004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:42.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.112+0000 7fe196ffd700 1 --2- 172.21.15.2:0/4215183050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe180004d90 0x7fe180005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:42.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.112+0000 7fe196ffd700 1 -- 172.21.15.2:0/4215183050 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1980cfa00 con 0x7fe180004d90 2023-11-26T07:13:42.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.112+0000 7fe196ffd700 1 -- 172.21.15.2:0/4215183050 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18000bac0 con 0x7fe180003a30 2023-11-26T07:13:42.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.112+0000 7fe196ffd700 1 -- 172.21.15.2:0/4215183050 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe18000bc80 con 0x7fe1980d1210 2023-11-26T07:13:42.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.112+0000 7fe19ca85700 1 --2- 172.21.15.2:0/4215183050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe180004d90 0x7fe180005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:42.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.112+0000 7fe1977fe700 1 --2- 172.21.15.2:0/4215183050 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1980d1210 0x7fe180004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:42.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.112+0000 7fe197fff700 1 --2- 172.21.15.2:0/4215183050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe180003a30 0x7fe180003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:42.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.113+0000 7fe19ca85700 1 -- 172.21.15.2:0/4215183050 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1980d1210 msgr2=0x7fe180004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:42.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.113+0000 7fe19ca85700 1 --2- 172.21.15.2:0/4215183050 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1980d1210 0x7fe180004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:42.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.113+0000 7fe19ca85700 1 -- 172.21.15.2:0/4215183050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe180003a30 msgr2=0x7fe180003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:42.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.113+0000 7fe19ca85700 1 --2- 172.21.15.2:0/4215183050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe180003a30 0x7fe180003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:42.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.113+0000 7fe19ca85700 1 -- 172.21.15.2:0/4215183050 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1800035b0 con 0x7fe180004d90 2023-11-26T07:13:42.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.113+0000 7fe19ca85700 1 --2- 172.21.15.2:0/4215183050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe180004d90 0x7fe180005210 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe190009fc0 tx=0x7fe180005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a224d22db634bd29 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:42.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.113+0000 7fe196ffd700 1 -- 172.21.15.2:0/4215183050 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19000ec30 con 0x7fe180004d90 2023-11-26T07:13:42.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.113+0000 7fe196ffd700 1 -- 172.21.15.2:0/4215183050 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19000f040 con 0x7fe180004d90 2023-11-26T07:13:42.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.113+0000 7fe196ffd700 1 -- 172.21.15.2:0/4215183050 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe190014480 con 0x7fe180004d90 2023-11-26T07:13:42.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.113+0000 7fe19e4e8700 1 -- 172.21.15.2:0/4215183050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe180004d90 msgr2=0x7fe180005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:42.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.113+0000 7fe19e4e8700 1 --2- 172.21.15.2:0/4215183050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe180004d90 0x7fe180005210 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe190009fc0 tx=0x7fe180005880 comp rx=0 tx=0).stop 2023-11-26T07:13:42.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.113+0000 7fe19ca85700 1 -- 172.21.15.2:0/4215183050 reap_dead start 2023-11-26T07:13:42.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.114+0000 7fe19e4e8700 1 -- 172.21.15.2:0/4215183050 shutdown_connections 2023-11-26T07:13:42.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.114+0000 7fe19e4e8700 1 -- 172.21.15.2:0/4215183050 >> 172.21.15.2:0/4215183050 conn(0x7fe19809d0c0 msgr2=0x7fe1980d3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:42.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.114+0000 7fe19e4e8700 1 -- 172.21.15.2:0/4215183050 shutdown_connections 2023-11-26T07:13:42.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.114+0000 7fe19e4e8700 1 -- 172.21.15.2:0/4215183050 wait complete. 2023-11-26T07:13:42.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.115+0000 7fe19e4e8700 1 Processor -- start 2023-11-26T07:13:42.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.115+0000 7fe19e4e8700 1 -- start start 2023-11-26T07:13:42.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.116+0000 7fe19e4e8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe19815f7b0 0x7fe1980b38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:42.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.116+0000 7fe19e4e8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1980b3e00 0x7fe1980d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:42.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.116+0000 7fe19e4e8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1980d2430 0x7fe1980b6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:42.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.116+0000 7fe19e4e8700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1980d28b0 con 0x7fe1980d2430 2023-11-26T07:13:42.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.116+0000 7fe19e4e8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1981f3e90 con 0x7fe1980b3e00 2023-11-26T07:13:42.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.116+0000 7fe19e4e8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1981f4170 con 0x7fe19815f7b0 2023-11-26T07:13:42.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.116+0000 7fe19ca85700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1980d2430 0x7fe1980b6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:42.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.116+0000 7fe19ca85700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1980d2430 0x7fe1980b6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41636/0 (socket says 172.21.15.2:41636) 2023-11-26T07:13:42.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.116+0000 7fe19ca85700 1 -- 172.21.15.2:0/2828355369 learned_addr learned my addr 172.21.15.2:0/2828355369 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:42.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.116+0000 7fe197fff700 1 --2- 172.21.15.2:0/2828355369 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe19815f7b0 0x7fe1980b38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:42.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.116+0000 7fe1977fe700 1 --2- 172.21.15.2:0/2828355369 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1980b3e00 0x7fe1980d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:42.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.116+0000 7fe19ca85700 1 -- 172.21.15.2:0/2828355369 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe19815f7b0 msgr2=0x7fe1980b38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:42.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.116+0000 7fe19ca85700 1 --2- 172.21.15.2:0/2828355369 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe19815f7b0 0x7fe1980b38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:42.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.116+0000 7fe19ca85700 1 -- 172.21.15.2:0/2828355369 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1980b3e00 msgr2=0x7fe1980d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:42.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.116+0000 7fe19ca85700 1 --2- 172.21.15.2:0/2828355369 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1980b3e00 0x7fe1980d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:42.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.116+0000 7fe19ca85700 1 -- 172.21.15.2:0/2828355369 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1981f4450 con 0x7fe1980d2430 2023-11-26T07:13:42.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.116+0000 7fe1977fe700 1 --2- 172.21.15.2:0/2828355369 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1980b3e00 0x7fe1980d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:13:42.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.116+0000 7fe197fff700 1 --2- 172.21.15.2:0/2828355369 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe19815f7b0 0x7fe1980b38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:13:42.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.116+0000 7fe19ca85700 1 --2- 172.21.15.2:0/2828355369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1980d2430 0x7fe1980b6a70 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fe190016000 tx=0x7fe190009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:42.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.117+0000 7fe194ff9700 1 -- 172.21.15.2:0/2828355369 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe190007000 con 0x7fe1980d2430 2023-11-26T07:13:42.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.117+0000 7fe194ff9700 1 -- 172.21.15.2:0/2828355369 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe190015b30 con 0x7fe1980d2430 2023-11-26T07:13:42.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.117+0000 7fe19e4e8700 1 -- 172.21.15.2:0/2828355369 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1981f4730 con 0x7fe1980d2430 2023-11-26T07:13:42.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.117+0000 7fe194ff9700 1 -- 172.21.15.2:0/2828355369 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19001d420 con 0x7fe1980d2430 2023-11-26T07:13:42.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.117+0000 7fe19e4e8700 1 -- 172.21.15.2:0/2828355369 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1980b23c0 con 0x7fe1980d2430 2023-11-26T07:13:42.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.118+0000 7fe19e4e8700 1 -- 172.21.15.2:0/2828355369 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe198067f60 con 0x7fe1980d2430 2023-11-26T07:13:42.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.118+0000 7fe194ff9700 1 -- 172.21.15.2:0/2828355369 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7fe19001d580 con 0x7fe1980d2430 2023-11-26T07:13:42.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.118+0000 7fe194ff9700 1 --2- 172.21.15.2:0/2828355369 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe18406b1a0 0x7fe18406d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:42.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.119+0000 7fe194ff9700 1 -- 172.21.15.2:0/2828355369 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fe19008b520 con 0x7fe1980d2430 2023-11-26T07:13:42.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.119+0000 7fe197fff700 1 --2- 172.21.15.2:0/2828355369 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe18406b1a0 0x7fe18406d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:42.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.119+0000 7fe197fff700 1 --2- 172.21.15.2:0/2828355369 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe18406b1a0 0x7fe18406d660 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe188007fd0 tx=0x7fe188009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:42.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.123+0000 7fe194ff9700 1 -- 172.21.15.2:0/2828355369 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe190056280 con 0x7fe1980d2430 2023-11-26T07:13:42.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:42.326+0000 7fe19e4e8700 1 -- 172.21.15.2:0/2828355369 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe1980d1660 con 0x7fe1980d2430 2023-11-26T07:13:43.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.267+0000 7fe194ff9700 1 -- 172.21.15.2:0/2828355369 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v36) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe1900598a0 con 0x7fe1980d2430 2023-11-26T07:13:43.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.270+0000 7fe19e4e8700 1 -- 172.21.15.2:0/2828355369 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe18406b1a0 msgr2=0x7fe18406d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:43.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.270+0000 7fe19e4e8700 1 --2- 172.21.15.2:0/2828355369 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe18406b1a0 0x7fe18406d660 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe188007fd0 tx=0x7fe188009040 comp rx=0 tx=0).stop 2023-11-26T07:13:43.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.270+0000 7fe19e4e8700 1 -- 172.21.15.2:0/2828355369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1980d2430 msgr2=0x7fe1980b6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:43.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.270+0000 7fe19e4e8700 1 --2- 172.21.15.2:0/2828355369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1980d2430 0x7fe1980b6a70 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fe190016000 tx=0x7fe190009750 comp rx=0 tx=0).stop 2023-11-26T07:13:43.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.270+0000 7fe19e4e8700 1 -- 172.21.15.2:0/2828355369 shutdown_connections 2023-11-26T07:13:43.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.270+0000 7fe19e4e8700 1 --2- 172.21.15.2:0/2828355369 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe18406b1a0 0x7fe18406d660 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:43.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.270+0000 7fe19e4e8700 1 --2- 172.21.15.2:0/2828355369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1980d2430 0x7fe1980b6a70 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:43.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.270+0000 7fe19e4e8700 1 --2- 172.21.15.2:0/2828355369 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe19815f7b0 0x7fe1980b38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:43.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.271+0000 7fe19e4e8700 1 --2- 172.21.15.2:0/2828355369 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1980b3e00 0x7fe1980d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:43.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.271+0000 7fe19e4e8700 1 -- 172.21.15.2:0/2828355369 >> 172.21.15.2:0/2828355369 conn(0x7fe19809d0c0 msgr2=0x7fe1981605c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:43.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.271+0000 7fe19e4e8700 1 -- 172.21.15.2:0/2828355369 shutdown_connections 2023-11-26T07:13:43.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.271+0000 7fe19e4e8700 1 -- 172.21.15.2:0/2828355369 wait complete. 2023-11-26T07:13:43.275 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' removed 2023-11-26T07:13:43.288 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-26T07:13:43.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.421+0000 7f5559121700 1 Processor -- start 2023-11-26T07:13:43.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.421+0000 7f5559121700 1 -- start start 2023-11-26T07:13:43.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.422+0000 7f5559121700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f555406b620 0x7f55540b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:43.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.422+0000 7f5559121700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f555406ee60 0x7f55540b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:43.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.422+0000 7f5559121700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5554071f50 con 0x7f55540b5ab0 2023-11-26T07:13:43.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.422+0000 7f5559121700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5554072230 con 0x7f555406b620 2023-11-26T07:13:43.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.422+0000 7f5559121700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5554072510 con 0x7f555406ee60 2023-11-26T07:13:43.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.422+0000 7f5552d9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f555406b620 0x7f55540b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:43.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.422+0000 7f5552d9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f555406b620 0x7f55540b3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41642/0 (socket says 172.21.15.2:41642) 2023-11-26T07:13:43.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.422+0000 7f5552d9d700 1 -- 172.21.15.2:0/911510081 learned_addr learned my addr 172.21.15.2:0/911510081 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:43.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.423+0000 7f555359e700 1 --2- 172.21.15.2:0/911510081 >> v2:172.21.15.192:3300/0 conn(0x7f555406ee60 0x7f55540b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:43.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.423+0000 7f5552d9d700 1 -- 172.21.15.2:0/911510081 >> v2:172.21.15.192:3300/0 conn(0x7f555406ee60 msgr2=0x7f55540b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:43.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.423+0000 7f5552d9d700 1 --2- 172.21.15.2:0/911510081 >> v2:172.21.15.192:3300/0 conn(0x7f555406ee60 0x7f55540b3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:43.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.423+0000 7f5552d9d700 1 -- 172.21.15.2:0/911510081 >> v1:172.21.15.2:6789/0 conn(0x7f55540b5ab0 legacy=0x7f5554161ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:43.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.423+0000 7f5552d9d700 1 -- 172.21.15.2:0/911510081 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55540727f0 con 0x7f555406b620 2023-11-26T07:13:43.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.423+0000 7f5552d9d700 1 --2- 172.21.15.2:0/911510081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f555406b620 0x7f55540b3a40 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f55540b0660 tx=0x7f5548009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ee87aae05fb33b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:43.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.423+0000 7f5551d9b700 1 -- 172.21.15.2:0/911510081 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554800b870 con 0x7f555406b620 2023-11-26T07:13:43.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.423+0000 7f5551d9b700 1 -- 172.21.15.2:0/911510081 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554800b9d0 con 0x7f555406b620 2023-11-26T07:13:43.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.423+0000 7f5551d9b700 1 -- 172.21.15.2:0/911510081 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554800bd60 con 0x7f555406b620 2023-11-26T07:13:43.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.424+0000 7f5559121700 1 -- 172.21.15.2:0/911510081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f555406b620 msgr2=0x7f55540b3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:43.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.424+0000 7f5559121700 1 --2- 172.21.15.2:0/911510081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f555406b620 0x7f55540b3a40 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f55540b0660 tx=0x7f5548009bd0 comp rx=0 tx=0).stop 2023-11-26T07:13:43.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.424+0000 7f5559121700 1 -- 172.21.15.2:0/911510081 shutdown_connections 2023-11-26T07:13:43.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.424+0000 7f5559121700 1 --2- 172.21.15.2:0/911510081 >> v2:172.21.15.192:3300/0 conn(0x7f555406ee60 0x7f55540b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:43.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.424+0000 7f5559121700 1 --2- 172.21.15.2:0/911510081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f555406b620 0x7f55540b3a40 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:43.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.424+0000 7f5559121700 1 -- 172.21.15.2:0/911510081 >> 172.21.15.2:0/911510081 conn(0x7f55540b2740 msgr2=0x7f55540b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:43.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.424+0000 7f5559121700 1 -- 172.21.15.2:0/911510081 shutdown_connections 2023-11-26T07:13:43.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.424+0000 7f5559121700 1 -- 172.21.15.2:0/911510081 wait complete. 2023-11-26T07:13:43.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.425+0000 7f5559121700 1 Processor -- start 2023-11-26T07:13:43.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.425+0000 7f5559121700 1 -- start start 2023-11-26T07:13:43.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.426+0000 7f5559121700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f555406b620 0x7f5554141890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:43.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.426+0000 7f5559121700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f555406ee60 0x7f55541e4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:43.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.426+0000 7f5559121700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55540b5ab0 0x7f55541e4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:43.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.426+0000 7f5559121700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55540aef90 con 0x7f555406ee60 2023-11-26T07:13:43.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.426+0000 7f5559121700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5554141dd0 con 0x7f555406b620 2023-11-26T07:13:43.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.426+0000 7f5559121700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55541e3680 con 0x7f55540b5ab0 2023-11-26T07:13:43.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.426+0000 7f555259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f555406ee60 0x7f55541e4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:43.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.426+0000 7f555259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f555406ee60 0x7f55541e4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41648/0 (socket says 172.21.15.2:41648) 2023-11-26T07:13:43.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.426+0000 7f555259c700 1 -- 172.21.15.2:0/1942171116 learned_addr learned my addr 172.21.15.2:0/1942171116 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:43.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.427+0000 7f555359e700 1 --2- 172.21.15.2:0/1942171116 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55540b5ab0 0x7f55541e4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:43.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.427+0000 7f5552d9d700 1 --2- 172.21.15.2:0/1942171116 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f555406b620 0x7f5554141890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:43.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.427+0000 7f555259c700 1 -- 172.21.15.2:0/1942171116 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55540b5ab0 msgr2=0x7f55541e4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:43.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.427+0000 7f555259c700 1 --2- 172.21.15.2:0/1942171116 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55540b5ab0 0x7f55541e4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:43.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.427+0000 7f555259c700 1 -- 172.21.15.2:0/1942171116 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f555406b620 msgr2=0x7f5554141890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:43.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.427+0000 7f555259c700 1 --2- 172.21.15.2:0/1942171116 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f555406b620 0x7f5554141890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:43.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.427+0000 7f555259c700 1 -- 172.21.15.2:0/1942171116 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5548009550 con 0x7f555406ee60 2023-11-26T07:13:43.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.427+0000 7f5552d9d700 1 --2- 172.21.15.2:0/1942171116 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f555406b620 0x7f5554141890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:13:43.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.427+0000 7f555359e700 1 --2- 172.21.15.2:0/1942171116 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55540b5ab0 0x7f55541e4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:13:43.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.427+0000 7f555259c700 1 --2- 172.21.15.2:0/1942171116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f555406ee60 0x7f55541e4250 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f554400c420 tx=0x7f554400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:43.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.427+0000 7f553b7fe700 1 -- 172.21.15.2:0/1942171116 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55440052d0 con 0x7f555406ee60 2023-11-26T07:13:43.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.427+0000 7f553b7fe700 1 -- 172.21.15.2:0/1942171116 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5544005430 con 0x7f555406ee60 2023-11-26T07:13:43.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.427+0000 7f5559121700 1 -- 172.21.15.2:0/1942171116 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55540ae310 con 0x7f555406ee60 2023-11-26T07:13:43.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.427+0000 7f553b7fe700 1 -- 172.21.15.2:0/1942171116 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55440038c0 con 0x7f555406ee60 2023-11-26T07:13:43.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.427+0000 7f5559121700 1 -- 172.21.15.2:0/1942171116 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55540ae8d0 con 0x7f555406ee60 2023-11-26T07:13:43.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.428+0000 7f5559121700 1 -- 172.21.15.2:0/1942171116 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5554068670 con 0x7f555406ee60 2023-11-26T07:13:43.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.428+0000 7f553b7fe700 1 -- 172.21.15.2:0/1942171116 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f5544003a20 con 0x7f555406ee60 2023-11-26T07:13:43.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.429+0000 7f553b7fe700 1 --2- 172.21.15.2:0/1942171116 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f554006b1a0 0x7f554006d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:43.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.429+0000 7f553b7fe700 1 -- 172.21.15.2:0/1942171116 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f5544088e10 con 0x7f555406ee60 2023-11-26T07:13:43.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.429+0000 7f5552d9d700 1 --2- 172.21.15.2:0/1942171116 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f554006b1a0 0x7f554006d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:43.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.430+0000 7f5552d9d700 1 --2- 172.21.15.2:0/1942171116 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f554006b1a0 0x7f554006d660 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5548009130 tx=0x7f5548008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:43.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.433+0000 7f553b7fe700 1 -- 172.21.15.2:0/1942171116 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5544053b60 con 0x7f555406ee60 2023-11-26T07:13:43.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:43.633+0000 7f5559121700 1 -- 172.21.15.2:0/1942171116 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f55540af0d0 con 0x7f555406ee60 2023-11-26T07:13:44.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.273+0000 7f553b7fe700 1 -- 172.21.15.2:0/1942171116 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v37) v1 ==== 169+0+0 (secure 0 0 0) 0x7f55540af0d0 con 0x7f555406ee60 2023-11-26T07:13:44.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.277+0000 7f5559121700 1 -- 172.21.15.2:0/1942171116 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f554006b1a0 msgr2=0x7f554006d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:44.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.277+0000 7f5559121700 1 --2- 172.21.15.2:0/1942171116 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f554006b1a0 0x7f554006d660 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5548009130 tx=0x7f5548008030 comp rx=0 tx=0).stop 2023-11-26T07:13:44.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.277+0000 7f5559121700 1 -- 172.21.15.2:0/1942171116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f555406ee60 msgr2=0x7f55541e4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:44.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.277+0000 7f5559121700 1 --2- 172.21.15.2:0/1942171116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f555406ee60 0x7f55541e4250 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f554400c420 tx=0x7f554400c7e0 comp rx=0 tx=0).stop 2023-11-26T07:13:44.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.277+0000 7f5559121700 1 -- 172.21.15.2:0/1942171116 shutdown_connections 2023-11-26T07:13:44.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.277+0000 7f5559121700 1 --2- 172.21.15.2:0/1942171116 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f554006b1a0 0x7f554006d660 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:44.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.277+0000 7f5559121700 1 --2- 172.21.15.2:0/1942171116 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55540b5ab0 0x7f55541e4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:44.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.277+0000 7f5559121700 1 --2- 172.21.15.2:0/1942171116 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f555406b620 0x7f5554141890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:44.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.277+0000 7f5559121700 1 --2- 172.21.15.2:0/1942171116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f555406ee60 0x7f55541e4250 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:44.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.278+0000 7f5559121700 1 -- 172.21.15.2:0/1942171116 >> 172.21.15.2:0/1942171116 conn(0x7f55540b2740 msgr2=0x7f55540b0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:44.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.278+0000 7f5559121700 1 -- 172.21.15.2:0/1942171116 shutdown_connections 2023-11-26T07:13:44.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.278+0000 7f5559121700 1 -- 172.21.15.2:0/1942171116 wait complete. 2023-11-26T07:13:44.285 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' removed 2023-11-26T07:13:44.297 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/volumes/snapshot_clone_delay 2023-11-26T07:13:44.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.427+0000 7f26469f0700 1 Processor -- start 2023-11-26T07:13:44.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.427+0000 7f26469f0700 1 -- start start 2023-11-26T07:13:44.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.428+0000 7f26469f0700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f264015e1c0 0x7f264006eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:44.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.428+0000 7f26469f0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26400b0e90 0x7f264006f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:44.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.428+0000 7f26469f0700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f264006fa80 0x7f2640161d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:44.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.428+0000 7f26469f0700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f264006ff10 con 0x7f264015e1c0 2023-11-26T07:13:44.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.428+0000 7f26469f0700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26400d1230 con 0x7f264006fa80 2023-11-26T07:13:44.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.428+0000 7f26469f0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26400d0c70 con 0x7f26400b0e90 2023-11-26T07:13:44.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.428+0000 7f263ffff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f264015e1c0 0x7f264006eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:44.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.428+0000 7f263ffff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f264015e1c0 0x7f264006eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41654/0 (socket says 172.21.15.2:41654) 2023-11-26T07:13:44.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.428+0000 7f263ffff700 1 -- 172.21.15.2:0/1382619070 learned_addr learned my addr 172.21.15.2:0/1382619070 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:44.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.428+0000 7f263f7fe700 1 --2- 172.21.15.2:0/1382619070 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26400b0e90 0x7f264006f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:44.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.428+0000 7f2644f8d700 1 --2- 172.21.15.2:0/1382619070 >> v2:172.21.15.192:3300/0 conn(0x7f264006fa80 0x7f2640161d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:44.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.428+0000 7f263ffff700 1 -- 172.21.15.2:0/1382619070 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26400b0e90 msgr2=0x7f264006f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:44.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.428+0000 7f263ffff700 1 --2- 172.21.15.2:0/1382619070 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26400b0e90 0x7f264006f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:44.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.428+0000 7f263ffff700 1 -- 172.21.15.2:0/1382619070 >> v2:172.21.15.192:3300/0 conn(0x7f264006fa80 msgr2=0x7f2640161d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:44.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.428+0000 7f263ffff700 1 --2- 172.21.15.2:0/1382619070 >> v2:172.21.15.192:3300/0 conn(0x7f264006fa80 0x7f2640161d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:44.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.428+0000 7f263ffff700 1 -- 172.21.15.2:0/1382619070 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26400d0f50 con 0x7f264015e1c0 2023-11-26T07:13:44.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.429+0000 7f263ffff700 1 --2- 172.21.15.2:0/1382619070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f264015e1c0 0x7f264006eef0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f26400b0db0 tx=0x7f2630009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a2e83a39ecfb863 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:44.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.429+0000 7f263effd700 1 -- 172.21.15.2:0/1382619070 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263000b870 con 0x7f264015e1c0 2023-11-26T07:13:44.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.429+0000 7f263effd700 1 -- 172.21.15.2:0/1382619070 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f263000b9d0 con 0x7f264015e1c0 2023-11-26T07:13:44.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.429+0000 7f263effd700 1 -- 172.21.15.2:0/1382619070 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263000bd60 con 0x7f264015e1c0 2023-11-26T07:13:44.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.429+0000 7f26469f0700 1 -- 172.21.15.2:0/1382619070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f264015e1c0 msgr2=0x7f264006eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:44.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.429+0000 7f26469f0700 1 --2- 172.21.15.2:0/1382619070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f264015e1c0 0x7f264006eef0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f26400b0db0 tx=0x7f2630009bd0 comp rx=0 tx=0).stop 2023-11-26T07:13:44.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.429+0000 7f26469f0700 1 -- 172.21.15.2:0/1382619070 shutdown_connections 2023-11-26T07:13:44.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.429+0000 7f26469f0700 1 --2- 172.21.15.2:0/1382619070 >> v2:172.21.15.192:3300/0 conn(0x7f264006fa80 0x7f2640161d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:44.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.429+0000 7f26469f0700 1 --2- 172.21.15.2:0/1382619070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f264015e1c0 0x7f264006eef0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:44.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.429+0000 7f26469f0700 1 --2- 172.21.15.2:0/1382619070 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26400b0e90 0x7f264006f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:44.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.429+0000 7f26469f0700 1 -- 172.21.15.2:0/1382619070 >> 172.21.15.2:0/1382619070 conn(0x7f26400b3720 msgr2=0x7f26400b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:44.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.429+0000 7f26469f0700 1 -- 172.21.15.2:0/1382619070 shutdown_connections 2023-11-26T07:13:44.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.429+0000 7f26469f0700 1 -- 172.21.15.2:0/1382619070 wait complete. 2023-11-26T07:13:44.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.431+0000 7f26469f0700 1 Processor -- start 2023-11-26T07:13:44.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.431+0000 7f26469f0700 1 -- start start 2023-11-26T07:13:44.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.431+0000 7f26469f0700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f264006fa80 0x7f2640162180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:44.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.431+0000 7f26469f0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26400b0e90 0x7f26401f7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:44.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.431+0000 7f26469f0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f264015e1c0 0x7f264015cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:44.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.431+0000 7f26469f0700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26401626c0 con 0x7f26400b0e90 2023-11-26T07:13:44.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.431+0000 7f26469f0700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264009bdd0 con 0x7f264006fa80 2023-11-26T07:13:44.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.431+0000 7f26469f0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26401f4370 con 0x7f264015e1c0 2023-11-26T07:13:44.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.432+0000 7f263f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26400b0e90 0x7f26401f7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:44.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.432+0000 7f263f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26400b0e90 0x7f26401f7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41662/0 (socket says 172.21.15.2:41662) 2023-11-26T07:13:44.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.432+0000 7f263f7fe700 1 -- 172.21.15.2:0/2847078114 learned_addr learned my addr 172.21.15.2:0/2847078114 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:44.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.432+0000 7f263ffff700 1 --2- 172.21.15.2:0/2847078114 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f264006fa80 0x7f2640162180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:44.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.432+0000 7f2644f8d700 1 --2- 172.21.15.2:0/2847078114 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f264015e1c0 0x7f264015cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:44.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.432+0000 7f263f7fe700 1 -- 172.21.15.2:0/2847078114 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f264015e1c0 msgr2=0x7f264015cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:44.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.432+0000 7f263f7fe700 1 --2- 172.21.15.2:0/2847078114 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f264015e1c0 0x7f264015cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:44.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.432+0000 7f263f7fe700 1 -- 172.21.15.2:0/2847078114 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f264006fa80 msgr2=0x7f2640162180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:44.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.432+0000 7f263f7fe700 1 --2- 172.21.15.2:0/2847078114 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f264006fa80 0x7f2640162180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:44.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.432+0000 7f263f7fe700 1 -- 172.21.15.2:0/2847078114 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2630009550 con 0x7f26400b0e90 2023-11-26T07:13:44.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.432+0000 7f2644f8d700 1 --2- 172.21.15.2:0/2847078114 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f264015e1c0 0x7f264015cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:13:44.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.432+0000 7f263f7fe700 1 --2- 172.21.15.2:0/2847078114 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26400b0e90 0x7f26401f7c90 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f263400e810 tx=0x7f263400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:44.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.432+0000 7f263cff9700 1 -- 172.21.15.2:0/2847078114 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2634013610 con 0x7f26400b0e90 2023-11-26T07:13:44.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.432+0000 7f263cff9700 1 -- 172.21.15.2:0/2847078114 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2634013770 con 0x7f26400b0e90 2023-11-26T07:13:44.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.432+0000 7f26469f0700 1 -- 172.21.15.2:0/2847078114 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26401f4650 con 0x7f26400b0e90 2023-11-26T07:13:44.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.432+0000 7f263cff9700 1 -- 172.21.15.2:0/2847078114 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2634013b20 con 0x7f26400b0e90 2023-11-26T07:13:44.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.432+0000 7f26469f0700 1 -- 172.21.15.2:0/2847078114 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26401f4c10 con 0x7f26400b0e90 2023-11-26T07:13:44.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.433+0000 7f26469f0700 1 -- 172.21.15.2:0/2847078114 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2640075480 con 0x7f26400b0e90 2023-11-26T07:13:44.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.434+0000 7f263cff9700 1 -- 172.21.15.2:0/2847078114 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f2634013c80 con 0x7f26400b0e90 2023-11-26T07:13:44.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.434+0000 7f263cff9700 1 --2- 172.21.15.2:0/2847078114 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f262c06b1a0 0x7f262c06d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:44.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.434+0000 7f263cff9700 1 -- 172.21.15.2:0/2847078114 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2634089440 con 0x7f26400b0e90 2023-11-26T07:13:44.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.434+0000 7f263ffff700 1 --2- 172.21.15.2:0/2847078114 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f262c06b1a0 0x7f262c06d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:44.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.435+0000 7f263ffff700 1 --2- 172.21.15.2:0/2847078114 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f262c06b1a0 0x7f262c06d660 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2630009840 tx=0x7f2630008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:44.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.438+0000 7f263cff9700 1 -- 172.21.15.2:0/2847078114 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f26340543e0 con 0x7f26400b0e90 2023-11-26T07:13:44.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.640+0000 7f26469f0700 1 -- 172.21.15.2:0/2847078114 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_delay"} v 0) v1 -- 0x7f26401f4e00 con 0x7f26400b0e90 2023-11-26T07:13:44.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.643+0000 7f263cff9700 1 -- 172.21.15.2:0/2847078114 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_delay"}]=0 v12) v1 ==== 115+0+0 (secure 0 0 0) 0x7f26401f4e00 con 0x7f26400b0e90 2023-11-26T07:13:44.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.645+0000 7f26469f0700 1 -- 172.21.15.2:0/2847078114 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f262c06b1a0 msgr2=0x7f262c06d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:44.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.645+0000 7f26469f0700 1 --2- 172.21.15.2:0/2847078114 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f262c06b1a0 0x7f262c06d660 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2630009840 tx=0x7f2630008030 comp rx=0 tx=0).stop 2023-11-26T07:13:44.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.645+0000 7f26469f0700 1 -- 172.21.15.2:0/2847078114 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26400b0e90 msgr2=0x7f26401f7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:44.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.645+0000 7f26469f0700 1 --2- 172.21.15.2:0/2847078114 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26400b0e90 0x7f26401f7c90 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f263400e810 tx=0x7f263400ebd0 comp rx=0 tx=0).stop 2023-11-26T07:13:44.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.645+0000 7f26469f0700 1 -- 172.21.15.2:0/2847078114 shutdown_connections 2023-11-26T07:13:44.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.645+0000 7f26469f0700 1 --2- 172.21.15.2:0/2847078114 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f262c06b1a0 0x7f262c06d660 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:44.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.645+0000 7f26469f0700 1 --2- 172.21.15.2:0/2847078114 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f264015e1c0 0x7f264015cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:44.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.645+0000 7f26469f0700 1 --2- 172.21.15.2:0/2847078114 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f264006fa80 0x7f2640162180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:44.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.645+0000 7f26469f0700 1 --2- 172.21.15.2:0/2847078114 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26400b0e90 0x7f26401f7c90 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:44.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.645+0000 7f26469f0700 1 -- 172.21.15.2:0/2847078114 >> 172.21.15.2:0/2847078114 conn(0x7f26400b3720 msgr2=0x7f26400b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:44.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.645+0000 7f26469f0700 1 -- 172.21.15.2:0/2847078114 shutdown_connections 2023-11-26T07:13:44.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.645+0000 7f26469f0700 1 -- 172.21.15.2:0/2847078114 wait complete. 2023-11-26T07:13:44.666 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-26T07:13:44.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.790+0000 7fd525de3700 1 Processor -- start 2023-11-26T07:13:44.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.790+0000 7fd525de3700 1 -- start start 2023-11-26T07:13:44.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.790+0000 7fd525de3700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd52006b6e0 0x7fd52006db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:44.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.790+0000 7fd525de3700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd520160720 con 0x7fd520144c10 2023-11-26T07:13:44.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.790+0000 7fd525de3700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd52006f710 con 0x7fd520145100 2023-11-26T07:13:44.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.790+0000 7fd525de3700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd52006f500 con 0x7fd52006b6e0 2023-11-26T07:13:44.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.791+0000 7fd51effd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd52006b6e0 0x7fd52006db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:44.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.791+0000 7fd51effd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd52006b6e0 0x7fd52006db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41670/0 (socket says 172.21.15.2:41670) 2023-11-26T07:13:44.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.791+0000 7fd51effd700 1 -- 172.21.15.2:0/2501771041 learned_addr learned my addr 172.21.15.2:0/2501771041 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:44.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.791+0000 7fd51f7fe700 1 --1- 172.21.15.2:0/2501771041 >> v1:172.21.15.2:6789/0 conn(0x7fd520144c10 0x7fd52006afd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:32878/0 (socket says 172.21.15.2:32878) 2023-11-26T07:13:44.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.791+0000 7fd51effd700 1 -- 172.21.15.2:0/2501771041 >> v1:172.21.15.192:6789/0 conn(0x7fd520145100 legacy=0x7fd52006e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:44.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.791+0000 7fd51effd700 1 -- 172.21.15.2:0/2501771041 >> v1:172.21.15.2:6789/0 conn(0x7fd520144c10 legacy=0x7fd52006afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:44.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.791+0000 7fd51effd700 1 -- 172.21.15.2:0/2501771041 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd52006f9f0 con 0x7fd52006b6e0 2023-11-26T07:13:44.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.791+0000 7fd51effd700 1 --2- 172.21.15.2:0/2501771041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd52006b6e0 0x7fd52006db70 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd5140098f0 tx=0x7fd514009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48c0b45123fae3a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:44.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.791+0000 7fd51e7fc700 1 -- 172.21.15.2:0/2501771041 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd514004230 con 0x7fd52006b6e0 2023-11-26T07:13:44.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.791+0000 7fd51e7fc700 1 -- 172.21.15.2:0/2501771041 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd514004390 con 0x7fd52006b6e0 2023-11-26T07:13:44.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.791+0000 7fd51e7fc700 1 -- 172.21.15.2:0/2501771041 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5140036a0 con 0x7fd52006b6e0 2023-11-26T07:13:44.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.792+0000 7fd525de3700 1 -- 172.21.15.2:0/2501771041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd52006b6e0 msgr2=0x7fd52006db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:44.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.792+0000 7fd525de3700 1 --2- 172.21.15.2:0/2501771041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd52006b6e0 0x7fd52006db70 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd5140098f0 tx=0x7fd514009c00 comp rx=0 tx=0).stop 2023-11-26T07:13:44.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.792+0000 7fd525de3700 1 -- 172.21.15.2:0/2501771041 shutdown_connections 2023-11-26T07:13:44.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.792+0000 7fd525de3700 1 --2- 172.21.15.2:0/2501771041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd52006b6e0 0x7fd52006db70 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:44.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.792+0000 7fd525de3700 1 -- 172.21.15.2:0/2501771041 >> 172.21.15.2:0/2501771041 conn(0x7fd5200b2740 msgr2=0x7fd5200b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:44.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.792+0000 7fd525de3700 1 -- 172.21.15.2:0/2501771041 shutdown_connections 2023-11-26T07:13:44.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.792+0000 7fd525de3700 1 -- 172.21.15.2:0/2501771041 wait complete. 2023-11-26T07:13:44.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.793+0000 7fd525de3700 1 Processor -- start 2023-11-26T07:13:44.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.793+0000 7fd525de3700 1 -- start start 2023-11-26T07:13:44.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.794+0000 7fd525de3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd52006b6e0 0x7fd52015b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:44.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.794+0000 7fd525de3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd520144c10 0x7fd5200c62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:44.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.794+0000 7fd525de3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd520145100 0x7fd52015da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:44.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.794+0000 7fd525de3700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd520142be0 con 0x7fd520144c10 2023-11-26T07:13:44.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.794+0000 7fd525de3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd520142e80 con 0x7fd520145100 2023-11-26T07:13:44.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.794+0000 7fd525de3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd520143160 con 0x7fd52006b6e0 2023-11-26T07:13:44.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.794+0000 7fd51effd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd520144c10 0x7fd5200c62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:44.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.794+0000 7fd51effd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd520144c10 0x7fd5200c62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41676/0 (socket says 172.21.15.2:41676) 2023-11-26T07:13:44.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.794+0000 7fd51effd700 1 -- 172.21.15.2:0/2633228815 learned_addr learned my addr 172.21.15.2:0/2633228815 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:44.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.794+0000 7fd51ffff700 1 --2- 172.21.15.2:0/2633228815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd520145100 0x7fd52015da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:44.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.794+0000 7fd51f7fe700 1 --2- 172.21.15.2:0/2633228815 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd52006b6e0 0x7fd52015b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:44.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.794+0000 7fd51effd700 1 -- 172.21.15.2:0/2633228815 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd52006b6e0 msgr2=0x7fd52015b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:44.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.794+0000 7fd51effd700 1 --2- 172.21.15.2:0/2633228815 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd52006b6e0 0x7fd52015b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:44.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.794+0000 7fd51effd700 1 -- 172.21.15.2:0/2633228815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd520145100 msgr2=0x7fd52015da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:44.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.794+0000 7fd51effd700 1 --2- 172.21.15.2:0/2633228815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd520145100 0x7fd52015da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:44.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.795+0000 7fd51effd700 1 -- 172.21.15.2:0/2633228815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd514009550 con 0x7fd520144c10 2023-11-26T07:13:44.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.795+0000 7fd51effd700 1 --2- 172.21.15.2:0/2633228815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd520144c10 0x7fd5200c62c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd5200d1bd0 tx=0x7fd514004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:44.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.795+0000 7fd507fff700 1 -- 172.21.15.2:0/2633228815 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd514003c90 con 0x7fd520144c10 2023-11-26T07:13:44.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.795+0000 7fd507fff700 1 -- 172.21.15.2:0/2633228815 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51401f070 con 0x7fd520144c10 2023-11-26T07:13:44.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.795+0000 7fd525de3700 1 -- 172.21.15.2:0/2633228815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd520143440 con 0x7fd520144c10 2023-11-26T07:13:44.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.795+0000 7fd507fff700 1 -- 172.21.15.2:0/2633228815 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51400b8e0 con 0x7fd520144c10 2023-11-26T07:13:44.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.795+0000 7fd525de3700 1 -- 172.21.15.2:0/2633228815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd52015bc50 con 0x7fd520144c10 2023-11-26T07:13:44.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.796+0000 7fd525de3700 1 -- 172.21.15.2:0/2633228815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd52015be10 con 0x7fd520144c10 2023-11-26T07:13:44.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.797+0000 7fd507fff700 1 -- 172.21.15.2:0/2633228815 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7fd514021030 con 0x7fd520144c10 2023-11-26T07:13:44.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.797+0000 7fd507fff700 1 --2- 172.21.15.2:0/2633228815 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd50c06b1a0 0x7fd50c06d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:44.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.797+0000 7fd507fff700 1 -- 172.21.15.2:0/2633228815 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd51408ac80 con 0x7fd520144c10 2023-11-26T07:13:44.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.797+0000 7fd51f7fe700 1 --2- 172.21.15.2:0/2633228815 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd50c06b1a0 0x7fd50c06d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:44.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.798+0000 7fd51f7fe700 1 --2- 172.21.15.2:0/2633228815 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd50c06b1a0 0x7fd50c06d660 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd510000f60 tx=0x7fd510007ed0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:44.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:44.802+0000 7fd507fff700 1 -- 172.21.15.2:0/2633228815 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd514055d70 con 0x7fd520144c10 2023-11-26T07:13:45.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.004+0000 7fd525de3700 1 -- 172.21.15.2:0/2633228815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fd52015be10 con 0x7fd520144c10 2023-11-26T07:13:45.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.007+0000 7fd507fff700 1 -- 172.21.15.2:0/2633228815 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd514059390 con 0x7fd520144c10 2023-11-26T07:13:45.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.009+0000 7fd525de3700 1 -- 172.21.15.2:0/2633228815 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd50c06b1a0 msgr2=0x7fd50c06d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:45.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.009+0000 7fd525de3700 1 --2- 172.21.15.2:0/2633228815 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd50c06b1a0 0x7fd50c06d660 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd510000f60 tx=0x7fd510007ed0 comp rx=0 tx=0).stop 2023-11-26T07:13:45.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.009+0000 7fd525de3700 1 -- 172.21.15.2:0/2633228815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd520144c10 msgr2=0x7fd5200c62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:45.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.009+0000 7fd525de3700 1 --2- 172.21.15.2:0/2633228815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd520144c10 0x7fd5200c62c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd5200d1bd0 tx=0x7fd514004750 comp rx=0 tx=0).stop 2023-11-26T07:13:45.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.009+0000 7fd525de3700 1 -- 172.21.15.2:0/2633228815 shutdown_connections 2023-11-26T07:13:45.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.009+0000 7fd525de3700 1 --2- 172.21.15.2:0/2633228815 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd50c06b1a0 0x7fd50c06d660 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:45.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.009+0000 7fd525de3700 1 --2- 172.21.15.2:0/2633228815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd520145100 0x7fd52015da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:45.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.009+0000 7fd525de3700 1 --2- 172.21.15.2:0/2633228815 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd52006b6e0 0x7fd52015b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:45.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.009+0000 7fd525de3700 1 --2- 172.21.15.2:0/2633228815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd520144c10 0x7fd5200c62c0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:45.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.009+0000 7fd525de3700 1 -- 172.21.15.2:0/2633228815 >> 172.21.15.2:0/2633228815 conn(0x7fd5200b2740 msgr2=0x7fd5200ce0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:45.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.009+0000 7fd525de3700 1 -- 172.21.15.2:0/2633228815 shutdown_connections 2023-11-26T07:13:45.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.009+0000 7fd525de3700 1 -- 172.21.15.2:0/2633228815 wait complete. 2023-11-26T07:13:45.024 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_failed' 2023-11-26T07:13:45.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.146+0000 7f0c5e490700 1 Processor -- start 2023-11-26T07:13:45.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.146+0000 7f0c5e490700 1 -- start start 2023-11-26T07:13:45.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.147+0000 7f0c5e490700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0c580d09e0 0x7f0c5806f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:45.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.147+0000 7f0c5e490700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c580d0f50 con 0x7f0c5815e260 2023-11-26T07:13:45.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.147+0000 7f0c5e490700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c580d1230 con 0x7f0c580ccdd0 2023-11-26T07:13:45.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.147+0000 7f0c5e490700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c580cc2f0 con 0x7f0c580d09e0 2023-11-26T07:13:45.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.147+0000 7f0c57fff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f0c5815e260 0x7f0c5806eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:32892/0 (socket says 172.21.15.2:32892) 2023-11-26T07:13:45.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.147+0000 7f0c57fff700 1 -- 172.21.15.2:0/2302980806 learned_addr learned my addr 172.21.15.2:0/2302980806 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:13:45.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.148+0000 7f0c577fe700 1 --2- 172.21.15.2:0/2302980806 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0c580d09e0 0x7f0c5806f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:45.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.148+0000 7f0c56ffd700 1 -- 172.21.15.2:0/2302980806 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 30672488 0 0) 0x7f0c580d0f50 con 0x7f0c5815e260 2023-11-26T07:13:45.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.148+0000 7f0c56ffd700 1 -- 172.21.15.2:0/2302980806 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c400035b0 con 0x7f0c5815e260 2023-11-26T07:13:45.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.148+0000 7f0c56ffd700 1 -- 172.21.15.2:0/2302980806 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2005257415 0 0) 0x7f0c580d1230 con 0x7f0c580ccdd0 2023-11-26T07:13:45.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.148+0000 7f0c56ffd700 1 -- 172.21.15.2:0/2302980806 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c580d0f50 con 0x7f0c580ccdd0 2023-11-26T07:13:45.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.148+0000 7f0c56ffd700 1 -- 172.21.15.2:0/2302980806 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2727320933 0 0) 0x7f0c400035b0 con 0x7f0c5815e260 2023-11-26T07:13:45.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.148+0000 7f0c577fe700 1 -- 172.21.15.2:0/2302980806 >> v1:172.21.15.192:6789/0 conn(0x7f0c580ccdd0 legacy=0x7f0c580cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:45.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.148+0000 7f0c577fe700 1 -- 172.21.15.2:0/2302980806 >> v1:172.21.15.2:6789/0 conn(0x7f0c5815e260 legacy=0x7f0c5806eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:45.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.148+0000 7f0c577fe700 1 -- 172.21.15.2:0/2302980806 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c580cc5d0 con 0x7f0c580d09e0 2023-11-26T07:13:45.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.148+0000 7f0c577fe700 1 --2- 172.21.15.2:0/2302980806 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0c580d09e0 0x7f0c5806f600 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c009870 tx=0x7f0c4c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6aad83fb20b34d39 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:45.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.148+0000 7f0c56ffd700 1 -- 172.21.15.2:0/2302980806 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c48001670 con 0x7f0c580d09e0 2023-11-26T07:13:45.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.148+0000 7f0c56ffd700 1 -- 172.21.15.2:0/2302980806 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4c004030 con 0x7f0c580d09e0 2023-11-26T07:13:45.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.148+0000 7f0c56ffd700 1 -- 172.21.15.2:0/2302980806 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c0043c0 con 0x7f0c580d09e0 2023-11-26T07:13:45.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.149+0000 7f0c5e490700 1 -- 172.21.15.2:0/2302980806 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0c580d09e0 msgr2=0x7f0c5806f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:45.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.149+0000 7f0c5e490700 1 --2- 172.21.15.2:0/2302980806 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0c580d09e0 0x7f0c5806f600 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c009870 tx=0x7f0c4c009b80 comp rx=0 tx=0).stop 2023-11-26T07:13:45.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.149+0000 7f0c5e490700 1 -- 172.21.15.2:0/2302980806 shutdown_connections 2023-11-26T07:13:45.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.149+0000 7f0c5e490700 1 --2- 172.21.15.2:0/2302980806 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0c580d09e0 0x7f0c5806f600 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:45.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.149+0000 7f0c5e490700 1 -- 172.21.15.2:0/2302980806 >> 172.21.15.2:0/2302980806 conn(0x7f0c580b3790 msgr2=0x7f0c580b3ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:45.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.149+0000 7f0c5e490700 1 -- 172.21.15.2:0/2302980806 shutdown_connections 2023-11-26T07:13:45.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.149+0000 7f0c5e490700 1 -- 172.21.15.2:0/2302980806 wait complete. 2023-11-26T07:13:45.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.150+0000 7f0c5e490700 1 Processor -- start 2023-11-26T07:13:45.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.150+0000 7f0c5e490700 1 -- start start 2023-11-26T07:13:45.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.151+0000 7f0c5e490700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c580ccdd0 0x7f0c580c6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:45.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.151+0000 7f0c5e490700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0c580d09e0 0x7f0c5815c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:45.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.151+0000 7f0c5e490700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c5815e260 0x7f0c580cb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:45.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.151+0000 7f0c5e490700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c581f3b40 con 0x7f0c5815e260 2023-11-26T07:13:45.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.151+0000 7f0c5e490700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c580b5870 con 0x7f0c580ccdd0 2023-11-26T07:13:45.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.151+0000 7f0c5e490700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c580b5b10 con 0x7f0c580d09e0 2023-11-26T07:13:45.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.151+0000 7f0c5ca2d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c5815e260 0x7f0c580cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:45.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.151+0000 7f0c5ca2d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c5815e260 0x7f0c580cb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41692/0 (socket says 172.21.15.2:41692) 2023-11-26T07:13:45.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.151+0000 7f0c5ca2d700 1 -- 172.21.15.2:0/2073247748 learned_addr learned my addr 172.21.15.2:0/2073247748 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:45.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.151+0000 7f0c57fff700 1 --2- 172.21.15.2:0/2073247748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c580ccdd0 0x7f0c580c6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:45.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.151+0000 7f0c577fe700 1 --2- 172.21.15.2:0/2073247748 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0c580d09e0 0x7f0c5815c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:45.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.152+0000 7f0c5ca2d700 1 -- 172.21.15.2:0/2073247748 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0c580d09e0 msgr2=0x7f0c5815c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:45.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.152+0000 7f0c5ca2d700 1 --2- 172.21.15.2:0/2073247748 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0c580d09e0 0x7f0c5815c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:45.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.152+0000 7f0c5ca2d700 1 -- 172.21.15.2:0/2073247748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c580ccdd0 msgr2=0x7f0c580c6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:45.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.152+0000 7f0c5ca2d700 1 --2- 172.21.15.2:0/2073247748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c580ccdd0 0x7f0c580c6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:45.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.152+0000 7f0c5ca2d700 1 -- 172.21.15.2:0/2073247748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c4c0094a0 con 0x7f0c5815e260 2023-11-26T07:13:45.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.152+0000 7f0c5ca2d700 1 --2- 172.21.15.2:0/2073247748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c5815e260 0x7f0c580cb040 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f0c5000cbc0 tx=0x7f0c5000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:45.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.152+0000 7f0c54ff9700 1 -- 172.21.15.2:0/2073247748 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c50003c00 con 0x7f0c5815e260 2023-11-26T07:13:45.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.152+0000 7f0c54ff9700 1 -- 172.21.15.2:0/2073247748 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c50003d60 con 0x7f0c5815e260 2023-11-26T07:13:45.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.152+0000 7f0c5e490700 1 -- 172.21.15.2:0/2073247748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c580c7780 con 0x7f0c5815e260 2023-11-26T07:13:45.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.152+0000 7f0c54ff9700 1 -- 172.21.15.2:0/2073247748 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5000aaa0 con 0x7f0c5815e260 2023-11-26T07:13:45.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.152+0000 7f0c5e490700 1 -- 172.21.15.2:0/2073247748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c580c7470 con 0x7f0c5815e260 2023-11-26T07:13:45.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.153+0000 7f0c5e490700 1 -- 172.21.15.2:0/2073247748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c58068670 con 0x7f0c5815e260 2023-11-26T07:13:45.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.154+0000 7f0c54ff9700 1 -- 172.21.15.2:0/2073247748 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f0c5000ac00 con 0x7f0c5815e260 2023-11-26T07:13:45.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.154+0000 7f0c54ff9700 1 --2- 172.21.15.2:0/2073247748 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0c4406b1a0 0x7f0c4406d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:45.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.154+0000 7f0c54ff9700 1 -- 172.21.15.2:0/2073247748 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0c50089640 con 0x7f0c5815e260 2023-11-26T07:13:45.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.154+0000 7f0c57fff700 1 --2- 172.21.15.2:0/2073247748 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0c4406b1a0 0x7f0c4406d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:45.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.155+0000 7f0c57fff700 1 --2- 172.21.15.2:0/2073247748 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0c4406b1a0 0x7f0c4406d660 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0c48001380 tx=0x7f0c48001770 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:45.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.158+0000 7f0c54ff9700 1 -- 172.21.15.2:0/2073247748 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0c50054730 con 0x7f0c5815e260 2023-11-26T07:13:45.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:45.444+0000 7f0c5e490700 1 -- 172.21.15.2:0/2073247748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_failed"]} v 0) v1 -- 0x7f0c580b14a0 con 0x7f0c5815e260 2023-11-26T07:13:46.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.281+0000 7f0c54ff9700 1 -- 172.21.15.2:0/2073247748 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_failed"]}]=0 v125) v1 ==== 165+0+0 (secure 0 0 0) 0x7f0c50057d50 con 0x7f0c5815e260 2023-11-26T07:13:46.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.284+0000 7f0c5e490700 1 -- 172.21.15.2:0/2073247748 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0c4406b1a0 msgr2=0x7f0c4406d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:46.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.284+0000 7f0c5e490700 1 --2- 172.21.15.2:0/2073247748 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0c4406b1a0 0x7f0c4406d660 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0c48001380 tx=0x7f0c48001770 comp rx=0 tx=0).stop 2023-11-26T07:13:46.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.284+0000 7f0c5e490700 1 -- 172.21.15.2:0/2073247748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c5815e260 msgr2=0x7f0c580cb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:46.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.284+0000 7f0c5e490700 1 --2- 172.21.15.2:0/2073247748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c5815e260 0x7f0c580cb040 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f0c5000cbc0 tx=0x7f0c5000ced0 comp rx=0 tx=0).stop 2023-11-26T07:13:46.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.284+0000 7f0c5e490700 1 -- 172.21.15.2:0/2073247748 shutdown_connections 2023-11-26T07:13:46.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.284+0000 7f0c5e490700 1 --2- 172.21.15.2:0/2073247748 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0c4406b1a0 0x7f0c4406d660 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:46.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.284+0000 7f0c5e490700 1 --2- 172.21.15.2:0/2073247748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c5815e260 0x7f0c580cb040 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:46.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.284+0000 7f0c5e490700 1 --2- 172.21.15.2:0/2073247748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c580ccdd0 0x7f0c580c6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:46.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.284+0000 7f0c5e490700 1 --2- 172.21.15.2:0/2073247748 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0c580d09e0 0x7f0c5815c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:46.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.284+0000 7f0c5e490700 1 -- 172.21.15.2:0/2073247748 >> 172.21.15.2:0/2073247748 conn(0x7f0c580b3790 msgr2=0x7f0c580ce480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:46.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.284+0000 7f0c5e490700 1 -- 172.21.15.2:0/2073247748 shutdown_connections 2023-11-26T07:13:46.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.284+0000 7f0c5e490700 1 -- 172.21.15.2:0/2073247748 wait complete. 2023-11-26T07:13:46.302 INFO:tasks.cephfs_test_runner:ensure failure status is shown when clone is in failed state and validate the reason ... ok 2023-11-26T07:13:46.303 INFO:tasks.cephfs_test_runner:Starting test: test_clone_failure_status_in_progress_cancelled (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) ensure failure status is shown when clone is cancelled during in-progress state and validate the reason 2023-11-26T07:13:46.303 INFO:tasks.cephfs_test_runner:test_clone_failure_status_in_progress_cancelled (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2023-11-26T07:13:46.303 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:13:46.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.432+0000 7fcd044fd700 1 Processor -- start 2023-11-26T07:13:46.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.432+0000 7fcd044fd700 1 -- start start 2023-11-26T07:13:46.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.433+0000 7fcd044fd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fccfc15e1c0 0x7fccfc06eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:46.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.433+0000 7fcd044fd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fccfc0b0e90 0x7fccfc06f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:46.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.433+0000 7fcd044fd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccfc06fa80 0x7fccfc161d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:46.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.433+0000 7fcd044fd700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccfc06ff10 con 0x7fccfc15e1c0 2023-11-26T07:13:46.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.433+0000 7fcd044fd700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccfc0d1230 con 0x7fccfc0b0e90 2023-11-26T07:13:46.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.433+0000 7fcd044fd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc0d0c70 con 0x7fccfc06fa80 2023-11-26T07:13:46.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.433+0000 7fcd02299700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fccfc15e1c0 0x7fccfc06eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:46.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.433+0000 7fcd02299700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fccfc15e1c0 0x7fccfc06eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41696/0 (socket says 172.21.15.2:41696) 2023-11-26T07:13:46.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.433+0000 7fcd02299700 1 -- 172.21.15.2:0/1542505551 learned_addr learned my addr 172.21.15.2:0/1542505551 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:46.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.433+0000 7fcd02a9a700 1 --2- 172.21.15.2:0/1542505551 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccfc06fa80 0x7fccfc161d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:46.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.433+0000 7fcd01a98700 1 --2- 172.21.15.2:0/1542505551 >> v2:172.21.15.192:3300/0 conn(0x7fccfc0b0e90 0x7fccfc06f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:46.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.433+0000 7fcd02299700 1 -- 172.21.15.2:0/1542505551 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccfc06fa80 msgr2=0x7fccfc161d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:46.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.433+0000 7fcd02299700 1 --2- 172.21.15.2:0/1542505551 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccfc06fa80 0x7fccfc161d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:46.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.433+0000 7fcd02299700 1 -- 172.21.15.2:0/1542505551 >> v2:172.21.15.192:3300/0 conn(0x7fccfc0b0e90 msgr2=0x7fccfc06f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:46.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.433+0000 7fcd02299700 1 --2- 172.21.15.2:0/1542505551 >> v2:172.21.15.192:3300/0 conn(0x7fccfc0b0e90 0x7fccfc06f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:46.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.433+0000 7fcd02299700 1 -- 172.21.15.2:0/1542505551 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccfc0d0f50 con 0x7fccfc15e1c0 2023-11-26T07:13:46.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.433+0000 7fcd01a98700 1 --2- 172.21.15.2:0/1542505551 >> v2:172.21.15.192:3300/0 conn(0x7fccfc0b0e90 0x7fccfc06f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:13:46.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.433+0000 7fcd02a9a700 1 --2- 172.21.15.2:0/1542505551 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccfc06fa80 0x7fccfc161d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:13:46.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.434+0000 7fcd02299700 1 --2- 172.21.15.2:0/1542505551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccfc15e1c0 0x7fccfc06eef0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fccfc071ba0 tx=0x7fccec009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a58c7c893e58d19a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:46.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.434+0000 7fcd01297700 1 -- 172.21.15.2:0/1542505551 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccec00b870 con 0x7fccfc15e1c0 2023-11-26T07:13:46.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.434+0000 7fcd01297700 1 -- 172.21.15.2:0/1542505551 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccec00b9d0 con 0x7fccfc15e1c0 2023-11-26T07:13:46.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.434+0000 7fcd01297700 1 -- 172.21.15.2:0/1542505551 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccec00bd60 con 0x7fccfc15e1c0 2023-11-26T07:13:46.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.434+0000 7fcd044fd700 1 -- 172.21.15.2:0/1542505551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccfc15e1c0 msgr2=0x7fccfc06eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:46.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.434+0000 7fcd044fd700 1 --2- 172.21.15.2:0/1542505551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccfc15e1c0 0x7fccfc06eef0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fccfc071ba0 tx=0x7fccec009bd0 comp rx=0 tx=0).stop 2023-11-26T07:13:46.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.434+0000 7fcd044fd700 1 -- 172.21.15.2:0/1542505551 shutdown_connections 2023-11-26T07:13:46.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.434+0000 7fcd044fd700 1 --2- 172.21.15.2:0/1542505551 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccfc06fa80 0x7fccfc161d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:46.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.434+0000 7fcd044fd700 1 --2- 172.21.15.2:0/1542505551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccfc15e1c0 0x7fccfc06eef0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:46.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.434+0000 7fcd044fd700 1 --2- 172.21.15.2:0/1542505551 >> v2:172.21.15.192:3300/0 conn(0x7fccfc0b0e90 0x7fccfc06f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:46.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.434+0000 7fcd044fd700 1 -- 172.21.15.2:0/1542505551 >> 172.21.15.2:0/1542505551 conn(0x7fccfc0b3720 msgr2=0x7fccfc0b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:46.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.434+0000 7fcd044fd700 1 -- 172.21.15.2:0/1542505551 shutdown_connections 2023-11-26T07:13:46.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.434+0000 7fcd044fd700 1 -- 172.21.15.2:0/1542505551 wait complete. 2023-11-26T07:13:46.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.436+0000 7fcd044fd700 1 Processor -- start 2023-11-26T07:13:46.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.436+0000 7fcd044fd700 1 -- start start 2023-11-26T07:13:46.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.436+0000 7fcd044fd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccfc06fa80 0x7fccfc0b73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:46.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.436+0000 7fcd044fd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccfc0b0e90 0x7fccfc0b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:46.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.436+0000 7fcd044fd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccfc15e1c0 0x7fccfc0b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:46.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.436+0000 7fcd044fd700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc1f7eb0 con 0x7fccfc06fa80 2023-11-26T07:13:46.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.436+0000 7fcd044fd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc1f3930 con 0x7fccfc15e1c0 2023-11-26T07:13:46.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.436+0000 7fcd044fd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc1f44a0 con 0x7fccfc0b0e90 2023-11-26T07:13:46.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.437+0000 7fcd02299700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccfc06fa80 0x7fccfc0b73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:46.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.437+0000 7fcd02299700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccfc06fa80 0x7fccfc0b73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41700/0 (socket says 172.21.15.2:41700) 2023-11-26T07:13:46.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.437+0000 7fcd02299700 1 -- 172.21.15.2:0/108521721 learned_addr learned my addr 172.21.15.2:0/108521721 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:46.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.437+0000 7fcd01a98700 1 --2- 172.21.15.2:0/108521721 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccfc0b0e90 0x7fccfc0b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:46.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.437+0000 7fcd02a9a700 1 --2- 172.21.15.2:0/108521721 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccfc15e1c0 0x7fccfc0b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:46.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.437+0000 7fcd02299700 1 -- 172.21.15.2:0/108521721 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccfc0b0e90 msgr2=0x7fccfc0b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:46.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.437+0000 7fcd02299700 1 --2- 172.21.15.2:0/108521721 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccfc0b0e90 0x7fccfc0b1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:46.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.437+0000 7fcd02299700 1 -- 172.21.15.2:0/108521721 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccfc15e1c0 msgr2=0x7fccfc0b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:46.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.437+0000 7fcd02299700 1 --2- 172.21.15.2:0/108521721 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccfc15e1c0 0x7fccfc0b1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:46.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.437+0000 7fcd02299700 1 -- 172.21.15.2:0/108521721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccec009550 con 0x7fccfc06fa80 2023-11-26T07:13:46.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.437+0000 7fcd01a98700 1 --2- 172.21.15.2:0/108521721 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccfc0b0e90 0x7fccfc0b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:13:46.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.437+0000 7fcd02299700 1 --2- 172.21.15.2:0/108521721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccfc06fa80 0x7fccfc0b73c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fccec009840 tx=0x7fccec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:46.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.437+0000 7fccf2ffd700 1 -- 172.21.15.2:0/108521721 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccec004500 con 0x7fccfc06fa80 2023-11-26T07:13:46.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.437+0000 7fccf2ffd700 1 -- 172.21.15.2:0/108521721 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccec0036a0 con 0x7fccfc06fa80 2023-11-26T07:13:46.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.437+0000 7fcd044fd700 1 -- 172.21.15.2:0/108521721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccfc1f4930 con 0x7fccfc06fa80 2023-11-26T07:13:46.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.437+0000 7fccf2ffd700 1 -- 172.21.15.2:0/108521721 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccec003a30 con 0x7fccfc06fa80 2023-11-26T07:13:46.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.437+0000 7fcd044fd700 1 -- 172.21.15.2:0/108521721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccfc1f3e50 con 0x7fccfc06fa80 2023-11-26T07:13:46.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.438+0000 7fcd044fd700 1 -- 172.21.15.2:0/108521721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccfc068670 con 0x7fccfc06fa80 2023-11-26T07:13:46.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.439+0000 7fccf2ffd700 1 -- 172.21.15.2:0/108521721 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7fccec003b90 con 0x7fccfc06fa80 2023-11-26T07:13:46.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.439+0000 7fccf2ffd700 1 --2- 172.21.15.2:0/108521721 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fcce006b1a0 0x7fcce006d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:46.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.439+0000 7fccf2ffd700 1 -- 172.21.15.2:0/108521721 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fccec08acb0 con 0x7fccfc06fa80 2023-11-26T07:13:46.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.439+0000 7fcd01a98700 1 --2- 172.21.15.2:0/108521721 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fcce006b1a0 0x7fcce006d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:46.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.440+0000 7fcd01a98700 1 --2- 172.21.15.2:0/108521721 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fcce006b1a0 0x7fcce006d660 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fccfc09fcd0 tx=0x7fccf8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:46.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.444+0000 7fccf2ffd700 1 -- 172.21.15.2:0/108521721 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fccec055da0 con 0x7fccfc06fa80 2023-11-26T07:13:46.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.646+0000 7fcd044fd700 1 -- 172.21.15.2:0/108521721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fccfc15ffa0 con 0x7fccfc06fa80 2023-11-26T07:13:46.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.647+0000 7fccf2ffd700 1 -- 172.21.15.2:0/108521721 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+12936 (secure 0 0 0) 0x7fccec020090 con 0x7fccfc06fa80 2023-11-26T07:13:46.650 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:13:46.650 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":37,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:13:44.269929+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6835/3058610366":"2023-11-27T07:13:40.914260+0000","172.21.15.2:6833/3058610366":"2023-11-27T07:13:40.914260+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:13:46.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.649+0000 7fcd044fd700 1 -- 172.21.15.2:0/108521721 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fcce006b1a0 msgr2=0x7fcce006d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:46.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.649+0000 7fcd044fd700 1 --2- 172.21.15.2:0/108521721 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fcce006b1a0 0x7fcce006d660 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fccfc09fcd0 tx=0x7fccf8008040 comp rx=0 tx=0).stop 2023-11-26T07:13:46.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.649+0000 7fcd044fd700 1 -- 172.21.15.2:0/108521721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccfc06fa80 msgr2=0x7fccfc0b73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:46.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.649+0000 7fcd044fd700 1 --2- 172.21.15.2:0/108521721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccfc06fa80 0x7fccfc0b73c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fccec009840 tx=0x7fccec004750 comp rx=0 tx=0).stop 2023-11-26T07:13:46.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.649+0000 7fcd044fd700 1 -- 172.21.15.2:0/108521721 shutdown_connections 2023-11-26T07:13:46.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.649+0000 7fcd044fd700 1 --2- 172.21.15.2:0/108521721 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fcce006b1a0 0x7fcce006d660 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:46.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.649+0000 7fcd044fd700 1 --2- 172.21.15.2:0/108521721 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccfc15e1c0 0x7fccfc0b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:46.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.649+0000 7fcd044fd700 1 --2- 172.21.15.2:0/108521721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccfc06fa80 0x7fccfc0b73c0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:46.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.649+0000 7fcd044fd700 1 --2- 172.21.15.2:0/108521721 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccfc0b0e90 0x7fccfc0b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:46.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.649+0000 7fcd044fd700 1 -- 172.21.15.2:0/108521721 >> 172.21.15.2:0/108521721 conn(0x7fccfc0b3720 msgr2=0x7fccfc0cfdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:46.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.649+0000 7fcd044fd700 1 -- 172.21.15.2:0/108521721 shutdown_connections 2023-11-26T07:13:46.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.649+0000 7fcd044fd700 1 -- 172.21.15.2:0/108521721 wait complete. 2023-11-26T07:13:46.664 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:11:28.205739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:13:46.665 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:13:46.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.789+0000 7fec62fc2700 1 Processor -- start 2023-11-26T07:13:46.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.789+0000 7fec62fc2700 1 -- start start 2023-11-26T07:13:46.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.790+0000 7fec62fc2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec5c15e090 0x7fec5c06afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:46.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.790+0000 7fec62fc2700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fec5c06b510 0x7fec5c161cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:46.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.790+0000 7fec62fc2700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec5c15e470 con 0x7fec5c162200 2023-11-26T07:13:46.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.790+0000 7fec62fc2700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec5c0c6900 con 0x7fec5c06b510 2023-11-26T07:13:46.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.790+0000 7fec62fc2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c06b990 con 0x7fec5c15e090 2023-11-26T07:13:46.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.791+0000 7fec5bfff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fec5c06b510 0x7fec5c161cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:46.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.791+0000 7fec6155f700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fec5c162200 0x7fec5c071b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.2:40292/0 (socket says 172.21.15.2:40292) 2023-11-26T07:13:46.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.791+0000 7fec5bfff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fec5c06b510 0x7fec5c161cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.2:50294/0 (socket says 172.21.15.2:50294) 2023-11-26T07:13:46.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.791+0000 7fec6155f700 1 -- 172.21.15.2:0/2072530986 learned_addr learned my addr 172.21.15.2:0/2072530986 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:13:46.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.791+0000 7fec60d5e700 1 --2- 172.21.15.2:0/2072530986 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec5c15e090 0x7fec5c06afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:46.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.791+0000 7fec5bfff700 1 -- 172.21.15.2:0/2072530986 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec5c15e090 msgr2=0x7fec5c06afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:46.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.791+0000 7fec5bfff700 1 --2- 172.21.15.2:0/2072530986 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec5c15e090 0x7fec5c06afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:46.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.791+0000 7fec5bfff700 1 -- 172.21.15.2:0/2072530986 >> v1:172.21.15.192:6789/0 conn(0x7fec5c162200 legacy=0x7fec5c071b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:46.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.791+0000 7fec5bfff700 1 -- 172.21.15.2:0/2072530986 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5c1629f0 con 0x7fec5c06b510 2023-11-26T07:13:46.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.791+0000 7fec5b7fe700 1 -- 172.21.15.2:0/2072530986 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1127815611 0 0) 0x7fec5c15e470 con 0x7fec5c162200 2023-11-26T07:13:46.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.791+0000 7fec60d5e700 1 --2- 172.21.15.2:0/2072530986 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec5c15e090 0x7fec5c06afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:13:46.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.791+0000 7fec5bfff700 1 --2- 172.21.15.2:0/2072530986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec5c06b510 0x7fec5c161cc0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fec48009840 tx=0x7fec48009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79affb6d3a897b38 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:46.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.791+0000 7fec5b7fe700 1 -- 172.21.15.2:0/2072530986 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec48011830 con 0x7fec5c06b510 2023-11-26T07:13:46.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.792+0000 7fec5b7fe700 1 -- 172.21.15.2:0/2072530986 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec48011990 con 0x7fec5c06b510 2023-11-26T07:13:46.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.792+0000 7fec5b7fe700 1 -- 172.21.15.2:0/2072530986 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec48011d20 con 0x7fec5c06b510 2023-11-26T07:13:46.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.792+0000 7fec62fc2700 1 -- 172.21.15.2:0/2072530986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec5c06b510 msgr2=0x7fec5c161cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:46.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.792+0000 7fec62fc2700 1 --2- 172.21.15.2:0/2072530986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec5c06b510 0x7fec5c161cc0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fec48009840 tx=0x7fec48009b50 comp rx=0 tx=0).stop 2023-11-26T07:13:46.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.792+0000 7fec62fc2700 1 -- 172.21.15.2:0/2072530986 shutdown_connections 2023-11-26T07:13:46.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.792+0000 7fec62fc2700 1 --2- 172.21.15.2:0/2072530986 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec5c15e090 0x7fec5c06afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:46.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.792+0000 7fec62fc2700 1 --2- 172.21.15.2:0/2072530986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec5c06b510 0x7fec5c161cc0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:46.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.792+0000 7fec62fc2700 1 -- 172.21.15.2:0/2072530986 >> 172.21.15.2:0/2072530986 conn(0x7fec5c0d0b10 msgr2=0x7fec5c0d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:46.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.792+0000 7fec62fc2700 1 -- 172.21.15.2:0/2072530986 shutdown_connections 2023-11-26T07:13:46.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.792+0000 7fec62fc2700 1 -- 172.21.15.2:0/2072530986 wait complete. 2023-11-26T07:13:46.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.793+0000 7fec62fc2700 1 Processor -- start 2023-11-26T07:13:46.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.793+0000 7fec62fc2700 1 -- start start 2023-11-26T07:13:46.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.794+0000 7fec62fc2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec5c06b510 0x7fec5c144c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:46.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.794+0000 7fec62fc2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec5c15e090 0x7fec5c160eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:46.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.794+0000 7fec62fc2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec5c162200 0x7fec5c0b1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:46.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.794+0000 7fec62fc2700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c0b69b0 con 0x7fec5c06b510 2023-11-26T07:13:46.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.794+0000 7fec62fc2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c0b5910 con 0x7fec5c162200 2023-11-26T07:13:46.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.794+0000 7fec62fc2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c0b5bf0 con 0x7fec5c15e090 2023-11-26T07:13:46.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.794+0000 7fec60d5e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec5c06b510 0x7fec5c144c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:46.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.794+0000 7fec60d5e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec5c06b510 0x7fec5c144c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41714/0 (socket says 172.21.15.2:41714) 2023-11-26T07:13:46.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.794+0000 7fec60d5e700 1 -- 172.21.15.2:0/4084702804 learned_addr learned my addr 172.21.15.2:0/4084702804 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:46.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.795+0000 7fec5bfff700 1 --2- 172.21.15.2:0/4084702804 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec5c15e090 0x7fec5c160eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:46.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.795+0000 7fec6155f700 1 --2- 172.21.15.2:0/4084702804 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec5c162200 0x7fec5c0b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:46.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.795+0000 7fec60d5e700 1 -- 172.21.15.2:0/4084702804 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec5c15e090 msgr2=0x7fec5c160eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:46.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.795+0000 7fec60d5e700 1 --2- 172.21.15.2:0/4084702804 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec5c15e090 0x7fec5c160eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.795+0000 7fec60d5e700 1 -- 172.21.15.2:0/4084702804 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec5c162200 msgr2=0x7fec5c0b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.795+0000 7fec60d5e700 1 --2- 172.21.15.2:0/4084702804 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec5c162200 0x7fec5c0b1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.795+0000 7fec60d5e700 1 -- 172.21.15.2:0/4084702804 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec500094a0 con 0x7fec5c06b510 2023-11-26T07:13:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.795+0000 7fec60d5e700 1 --2- 172.21.15.2:0/4084702804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec5c06b510 0x7fec5c144c80 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fec5000ebe0 tx=0x7fec5000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.795+0000 7fec597fa700 1 -- 172.21.15.2:0/4084702804 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5000c850 con 0x7fec5c06b510 2023-11-26T07:13:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.795+0000 7fec597fa700 1 -- 172.21.15.2:0/4084702804 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5000c9b0 con 0x7fec5c06b510 2023-11-26T07:13:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.795+0000 7fec597fa700 1 -- 172.21.15.2:0/4084702804 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5000cd40 con 0x7fec5c06b510 2023-11-26T07:13:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.795+0000 7fec62fc2700 1 -- 172.21.15.2:0/4084702804 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec480094a0 con 0x7fec5c06b510 2023-11-26T07:13:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.795+0000 7fec62fc2700 1 -- 172.21.15.2:0/4084702804 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec5c0b61b0 con 0x7fec5c06b510 2023-11-26T07:13:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.796+0000 7fec62fc2700 1 -- 172.21.15.2:0/4084702804 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec5c075480 con 0x7fec5c06b510 2023-11-26T07:13:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.797+0000 7fec597fa700 1 -- 172.21.15.2:0/4084702804 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7fec50013470 con 0x7fec5c06b510 2023-11-26T07:13:46.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.797+0000 7fec597fa700 1 --2- 172.21.15.2:0/4084702804 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fec4006b1a0 0x7fec4006d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:46.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.797+0000 7fec597fa700 1 -- 172.21.15.2:0/4084702804 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fec50089820 con 0x7fec5c06b510 2023-11-26T07:13:46.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.798+0000 7fec5bfff700 1 --2- 172.21.15.2:0/4084702804 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fec4006b1a0 0x7fec4006d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:46.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.798+0000 7fec5bfff700 1 --2- 172.21.15.2:0/4084702804 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fec4006b1a0 0x7fec4006d660 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fec48000c00 tx=0x7fec48008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:46.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:46.802+0000 7fec597fa700 1 -- 172.21.15.2:0/4084702804 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fec50054880 con 0x7fec5c06b510 2023-11-26T07:13:47.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.004+0000 7fec62fc2700 1 -- 172.21.15.2:0/4084702804 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fec5c0d1810 con 0x7fec5c06b510 2023-11-26T07:13:47.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.005+0000 7fec597fa700 1 -- 172.21.15.2:0/4084702804 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7fec5000cea0 con 0x7fec5c06b510 2023-11-26T07:13:47.008 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-26T07:13:47.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.007+0000 7fec62fc2700 1 -- 172.21.15.2:0/4084702804 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fec4006b1a0 msgr2=0x7fec4006d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:47.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.007+0000 7fec62fc2700 1 --2- 172.21.15.2:0/4084702804 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fec4006b1a0 0x7fec4006d660 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fec48000c00 tx=0x7fec48008030 comp rx=0 tx=0).stop 2023-11-26T07:13:47.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.007+0000 7fec62fc2700 1 -- 172.21.15.2:0/4084702804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec5c06b510 msgr2=0x7fec5c144c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:47.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.007+0000 7fec62fc2700 1 --2- 172.21.15.2:0/4084702804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec5c06b510 0x7fec5c144c80 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fec5000ebe0 tx=0x7fec5000eef0 comp rx=0 tx=0).stop 2023-11-26T07:13:47.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.007+0000 7fec62fc2700 1 -- 172.21.15.2:0/4084702804 shutdown_connections 2023-11-26T07:13:47.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.007+0000 7fec62fc2700 1 --2- 172.21.15.2:0/4084702804 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fec4006b1a0 0x7fec4006d660 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:47.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.007+0000 7fec62fc2700 1 --2- 172.21.15.2:0/4084702804 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec5c162200 0x7fec5c0b1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:47.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.007+0000 7fec62fc2700 1 --2- 172.21.15.2:0/4084702804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec5c06b510 0x7fec5c144c80 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:47.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.007+0000 7fec62fc2700 1 --2- 172.21.15.2:0/4084702804 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec5c15e090 0x7fec5c160eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:47.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.007+0000 7fec62fc2700 1 -- 172.21.15.2:0/4084702804 >> 172.21.15.2:0/4084702804 conn(0x7fec5c0d0b10 msgr2=0x7fec5c0cd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:47.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.007+0000 7fec62fc2700 1 -- 172.21.15.2:0/4084702804 shutdown_connections 2023-11-26T07:13:47.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.007+0000 7fec62fc2700 1 -- 172.21.15.2:0/4084702804 wait complete. 2023-11-26T07:13:47.022 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_in_progress_cancelled' 2023-11-26T07:13:47.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.144+0000 7f7f20337700 1 Processor -- start 2023-11-26T07:13:47.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.144+0000 7f7f20337700 1 -- start start 2023-11-26T07:13:47.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.145+0000 7f7f20337700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7f1815e000 0x7f7f1806eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:47.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.145+0000 7f7f20337700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f180cfd60 con 0x7f7f1806fe00 2023-11-26T07:13:47.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.145+0000 7f7f20337700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f1806f430 con 0x7f7f180d0ae0 2023-11-26T07:13:47.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.145+0000 7f7f20337700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f180cf4b0 con 0x7f7f1815e000 2023-11-26T07:13:47.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.146+0000 7f7f1e8d4700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7f1806fe00 0x7f7f180cc220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:32934/0 (socket says 172.21.15.2:32934) 2023-11-26T07:13:47.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.146+0000 7f7f1e8d4700 1 -- 172.21.15.2:0/3750957383 learned_addr learned my addr 172.21.15.2:0/3750957383 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:13:47.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.146+0000 7f7f1e0d3700 1 --2- 172.21.15.2:0/3750957383 >> v2:172.21.15.192:3300/0 conn(0x7f7f1815e000 0x7f7f1806eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:47.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.146+0000 7f7f1d0d1700 1 -- 172.21.15.2:0/3750957383 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2436028284 0 0) 0x7f7f180cfd60 con 0x7f7f1806fe00 2023-11-26T07:13:47.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.146+0000 7f7f1d0d1700 1 -- 172.21.15.2:0/3750957383 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f040035b0 con 0x7f7f1806fe00 2023-11-26T07:13:47.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.146+0000 7f7f1d0d1700 1 -- 172.21.15.2:0/3750957383 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 703403352 0 0) 0x7f7f1806f430 con 0x7f7f180d0ae0 2023-11-26T07:13:47.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.146+0000 7f7f1d0d1700 1 -- 172.21.15.2:0/3750957383 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f180cfd60 con 0x7f7f180d0ae0 2023-11-26T07:13:47.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.146+0000 7f7f1d0d1700 1 -- 172.21.15.2:0/3750957383 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1422203040 0 0) 0x7f7f040035b0 con 0x7f7f1806fe00 2023-11-26T07:13:47.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.146+0000 7f7f1d0d1700 1 -- 172.21.15.2:0/3750957383 >> v2:172.21.15.192:3300/0 conn(0x7f7f1815e000 msgr2=0x7f7f1806eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:47.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.146+0000 7f7f1d0d1700 1 --2- 172.21.15.2:0/3750957383 >> v2:172.21.15.192:3300/0 conn(0x7f7f1815e000 0x7f7f1806eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:47.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.146+0000 7f7f1d0d1700 1 -- 172.21.15.2:0/3750957383 >> v1:172.21.15.192:6789/0 conn(0x7f7f180d0ae0 legacy=0x7f7f1806f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:47.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.146+0000 7f7f1d0d1700 1 -- 172.21.15.2:0/3750957383 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f180cf1d0 con 0x7f7f1806fe00 2023-11-26T07:13:47.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.146+0000 7f7f1d0d1700 1 -- 172.21.15.2:0/3750957383 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f7f100019f0 con 0x7f7f1806fe00 2023-11-26T07:13:47.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.146+0000 7f7f1d0d1700 1 -- 172.21.15.2:0/3750957383 >> v1:172.21.15.2:6789/0 conn(0x7f7f1806fe00 legacy=0x7f7f180cc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:47.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.146+0000 7f7f1d0d1700 1 --2- 172.21.15.2:0/3750957383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f04003be0 0x7f7f04003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:47.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.146+0000 7f7f1d0d1700 1 --2- 172.21.15.2:0/3750957383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f04004850 0x7f7f04004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:47.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.146+0000 7f7f1d0d1700 1 --2- 172.21.15.2:0/3750957383 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f04005210 0x7f7f0400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:47.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.146+0000 7f7f1d0d1700 1 -- 172.21.15.2:0/3750957383 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f180cf4b0 con 0x7f7f04004850 2023-11-26T07:13:47.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.146+0000 7f7f1d0d1700 1 -- 172.21.15.2:0/3750957383 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0400c0e0 con 0x7f7f04003be0 2023-11-26T07:13:47.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.146+0000 7f7f1d0d1700 1 -- 172.21.15.2:0/3750957383 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0400c2a0 con 0x7f7f04005210 2023-11-26T07:13:47.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.146+0000 7f7f1d8d2700 1 --2- 172.21.15.2:0/3750957383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f04004850 0x7f7f04004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:47.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.147+0000 7f7f1e0d3700 1 --2- 172.21.15.2:0/3750957383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f04003be0 0x7f7f04003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:47.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.147+0000 7f7f1e8d4700 1 --2- 172.21.15.2:0/3750957383 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f04005210 0x7f7f0400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:47.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.147+0000 7f7f1d8d2700 1 -- 172.21.15.2:0/3750957383 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f04005210 msgr2=0x7f7f0400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:47.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.147+0000 7f7f1d8d2700 1 --2- 172.21.15.2:0/3750957383 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f04005210 0x7f7f0400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:47.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.147+0000 7f7f1d8d2700 1 -- 172.21.15.2:0/3750957383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f04003be0 msgr2=0x7f7f04003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:47.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.147+0000 7f7f1d8d2700 1 --2- 172.21.15.2:0/3750957383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f04003be0 0x7f7f04003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:47.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.147+0000 7f7f1d8d2700 1 -- 172.21.15.2:0/3750957383 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f040035b0 con 0x7f7f04004850 2023-11-26T07:13:47.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.147+0000 7f7f1e8d4700 1 -- 172.21.15.2:0/3750957383 reap_dead start 2023-11-26T07:13:47.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.147+0000 7f7f1d8d2700 1 --2- 172.21.15.2:0/3750957383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f04004850 0x7f7f04004cd0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c001940 tx=0x7f7f04005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b149cccb0323d6b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:47.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.147+0000 7f7f1d0d1700 1 -- 172.21.15.2:0/3750957383 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c001430 con 0x7f7f04004850 2023-11-26T07:13:47.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.147+0000 7f7f1d0d1700 1 -- 172.21.15.2:0/3750957383 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0c001d70 con 0x7f7f04004850 2023-11-26T07:13:47.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.147+0000 7f7f1d0d1700 1 -- 172.21.15.2:0/3750957383 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c005530 con 0x7f7f04004850 2023-11-26T07:13:47.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.148+0000 7f7f20337700 1 -- 172.21.15.2:0/3750957383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f04004850 msgr2=0x7f7f04004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:47.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.148+0000 7f7f20337700 1 --2- 172.21.15.2:0/3750957383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f04004850 0x7f7f04004cd0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c001940 tx=0x7f7f04005880 comp rx=0 tx=0).stop 2023-11-26T07:13:47.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.148+0000 7f7f20337700 1 -- 172.21.15.2:0/3750957383 shutdown_connections 2023-11-26T07:13:47.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.148+0000 7f7f20337700 1 --2- 172.21.15.2:0/3750957383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f04004850 0x7f7f04004cd0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:47.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.148+0000 7f7f20337700 1 -- 172.21.15.2:0/3750957383 >> 172.21.15.2:0/3750957383 conn(0x7f7f180b3720 msgr2=0x7f7f180b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:47.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.148+0000 7f7f20337700 1 -- 172.21.15.2:0/3750957383 shutdown_connections 2023-11-26T07:13:47.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.148+0000 7f7f20337700 1 -- 172.21.15.2:0/3750957383 wait complete. 2023-11-26T07:13:47.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.149+0000 7f7f20337700 1 Processor -- start 2023-11-26T07:13:47.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.149+0000 7f7f20337700 1 -- start start 2023-11-26T07:13:47.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.150+0000 7f7f20337700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f04004850 0x7f7f180c5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:47.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.150+0000 7f7f20337700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f180b6cc0 0x7f7f1815e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:47.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.150+0000 7f7f20337700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f18143f40 0x7f7f181443c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:47.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.150+0000 7f7f20337700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f180c6020 con 0x7f7f18143f40 2023-11-26T07:13:47.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.150+0000 7f7f20337700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f18144900 con 0x7f7f04004850 2023-11-26T07:13:47.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.150+0000 7f7f20337700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f180b6830 con 0x7f7f180b6cc0 2023-11-26T07:13:47.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.150+0000 7f7f1e8d4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f18143f40 0x7f7f181443c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:47.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.150+0000 7f7f1e8d4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f18143f40 0x7f7f181443c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41736/0 (socket says 172.21.15.2:41736) 2023-11-26T07:13:47.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.150+0000 7f7f1e8d4700 1 -- 172.21.15.2:0/2133285010 learned_addr learned my addr 172.21.15.2:0/2133285010 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:47.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.151+0000 7f7f1d8d2700 1 --2- 172.21.15.2:0/2133285010 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f180b6cc0 0x7f7f1815e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:47.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.151+0000 7f7f1e0d3700 1 --2- 172.21.15.2:0/2133285010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f04004850 0x7f7f180c5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:47.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.151+0000 7f7f1e8d4700 1 -- 172.21.15.2:0/2133285010 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f180b6cc0 msgr2=0x7f7f1815e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:47.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.151+0000 7f7f1e8d4700 1 --2- 172.21.15.2:0/2133285010 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f180b6cc0 0x7f7f1815e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:47.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.151+0000 7f7f1e8d4700 1 -- 172.21.15.2:0/2133285010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f04004850 msgr2=0x7f7f180c5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:47.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.151+0000 7f7f1e8d4700 1 --2- 172.21.15.2:0/2133285010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f04004850 0x7f7f180c5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:47.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.151+0000 7f7f1e8d4700 1 -- 172.21.15.2:0/2133285010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f18144b10 con 0x7f7f18143f40 2023-11-26T07:13:47.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.151+0000 7f7f1d8d2700 1 --2- 172.21.15.2:0/2133285010 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f180b6cc0 0x7f7f1815e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:13:47.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.151+0000 7f7f1e0d3700 1 --2- 172.21.15.2:0/2133285010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f04004850 0x7f7f180c5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:13:47.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.151+0000 7f7f1e8d4700 1 --2- 172.21.15.2:0/2133285010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f18143f40 0x7f7f181443c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f7f18161bd0 tx=0x7f7f1000e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:47.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.151+0000 7f7f0affd700 1 -- 172.21.15.2:0/2133285010 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1000eb50 con 0x7f7f18143f40 2023-11-26T07:13:47.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.151+0000 7f7f0affd700 1 -- 172.21.15.2:0/2133285010 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1000ecb0 con 0x7f7f18143f40 2023-11-26T07:13:47.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.151+0000 7f7f20337700 1 -- 172.21.15.2:0/2133285010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f180b5c20 con 0x7f7f18143f40 2023-11-26T07:13:47.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.151+0000 7f7f0affd700 1 -- 172.21.15.2:0/2133285010 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f10013420 con 0x7f7f18143f40 2023-11-26T07:13:47.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.151+0000 7f7f20337700 1 -- 172.21.15.2:0/2133285010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f180b61e0 con 0x7f7f18143f40 2023-11-26T07:13:47.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.152+0000 7f7f20337700 1 -- 172.21.15.2:0/2133285010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f18068670 con 0x7f7f18143f40 2023-11-26T07:13:47.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.153+0000 7f7f0affd700 1 -- 172.21.15.2:0/2133285010 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f7f10013580 con 0x7f7f18143f40 2023-11-26T07:13:47.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.153+0000 7f7f0affd700 1 --2- 172.21.15.2:0/2133285010 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7efc06b1a0 0x7f7efc06d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:47.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.153+0000 7f7f0affd700 1 -- 172.21.15.2:0/2133285010 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7f10089d60 con 0x7f7f18143f40 2023-11-26T07:13:47.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.153+0000 7f7f1e0d3700 1 --2- 172.21.15.2:0/2133285010 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7efc06b1a0 0x7f7efc06d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:47.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.154+0000 7f7f1e0d3700 1 --2- 172.21.15.2:0/2133285010 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7efc06b1a0 0x7f7efc06d660 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7f18069c90 tx=0x7f7f14008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:47.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.158+0000 7f7f0affd700 1 -- 172.21.15.2:0/2133285010 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7f10054d30 con 0x7f7f18143f40 2023-11-26T07:13:47.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:47.444+0000 7f7f20337700 1 -- 172.21.15.2:0/2133285010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_in_progress_cancelled"]} v 0) v1 -- 0x7f7f180b7b50 con 0x7f7f18143f40 2023-11-26T07:13:48.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.286+0000 7f7f0affd700 1 -- 172.21.15.2:0/2133285010 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_in_progress_cancelled"]}]=0 v127) v1 ==== 183+0+0 (secure 0 0 0) 0x7f7f10058350 con 0x7f7f18143f40 2023-11-26T07:13:48.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.289+0000 7f7f20337700 1 -- 172.21.15.2:0/2133285010 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7efc06b1a0 msgr2=0x7f7efc06d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:48.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.289+0000 7f7f20337700 1 --2- 172.21.15.2:0/2133285010 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7efc06b1a0 0x7f7efc06d660 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7f18069c90 tx=0x7f7f14008040 comp rx=0 tx=0).stop 2023-11-26T07:13:48.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.289+0000 7f7f20337700 1 -- 172.21.15.2:0/2133285010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f18143f40 msgr2=0x7f7f181443c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:48.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.289+0000 7f7f20337700 1 --2- 172.21.15.2:0/2133285010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f18143f40 0x7f7f181443c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f7f18161bd0 tx=0x7f7f1000e440 comp rx=0 tx=0).stop 2023-11-26T07:13:48.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.289+0000 7f7f20337700 1 -- 172.21.15.2:0/2133285010 shutdown_connections 2023-11-26T07:13:48.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.289+0000 7f7f20337700 1 --2- 172.21.15.2:0/2133285010 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7efc06b1a0 0x7f7efc06d660 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:48.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.289+0000 7f7f20337700 1 --2- 172.21.15.2:0/2133285010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f18143f40 0x7f7f181443c0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:48.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.289+0000 7f7f20337700 1 --2- 172.21.15.2:0/2133285010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f04004850 0x7f7f180c5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:48.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.289+0000 7f7f20337700 1 --2- 172.21.15.2:0/2133285010 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f180b6cc0 0x7f7f1815e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:48.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.289+0000 7f7f20337700 1 -- 172.21.15.2:0/2133285010 >> 172.21.15.2:0/2133285010 conn(0x7f7f180b3720 msgr2=0x7f7f1815c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:48.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.289+0000 7f7f20337700 1 -- 172.21.15.2:0/2133285010 shutdown_connections 2023-11-26T07:13:48.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.289+0000 7f7f20337700 1 -- 172.21.15.2:0/2133285010 wait complete. 2023-11-26T07:13:48.307 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-26T07:13:48.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.439+0000 7f3962b3a700 1 Processor -- start 2023-11-26T07:13:48.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.440+0000 7f3962b3a700 1 -- start start 2023-11-26T07:13:48.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.440+0000 7f3962b3a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f395c06b620 0x7f395c0b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:48.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.440+0000 7f3962b3a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f395c06ee60 0x7f395c0b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:48.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.440+0000 7f3962b3a700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f395c071f50 con 0x7f395c0b5ab0 2023-11-26T07:13:48.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.440+0000 7f3962b3a700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f395c072230 con 0x7f395c06ee60 2023-11-26T07:13:48.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.440+0000 7f3962b3a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f395c072510 con 0x7f395c06b620 2023-11-26T07:13:48.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.440+0000 7f395bfff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f395c0b5ab0 0x7f395c161ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:32950/0 (socket says 172.21.15.2:32950) 2023-11-26T07:13:48.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.441+0000 7f395bfff700 1 -- 172.21.15.2:0/1759751905 learned_addr learned my addr 172.21.15.2:0/1759751905 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:13:48.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.441+0000 7f39608d6700 1 --2- 172.21.15.2:0/1759751905 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f395c06b620 0x7f395c0b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:48.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.441+0000 7f39610d7700 1 --2- 172.21.15.2:0/1759751905 >> v2:172.21.15.192:3300/0 conn(0x7f395c06ee60 0x7f395c0b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:48.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.441+0000 7f395b7fe700 1 -- 172.21.15.2:0/1759751905 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1250988451 0 0) 0x7f395c071f50 con 0x7f395c0b5ab0 2023-11-26T07:13:48.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.441+0000 7f395b7fe700 1 -- 172.21.15.2:0/1759751905 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f394c0035b0 con 0x7f395c0b5ab0 2023-11-26T07:13:48.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.441+0000 7f39608d6700 1 -- 172.21.15.2:0/1759751905 >> v2:172.21.15.192:3300/0 conn(0x7f395c06ee60 msgr2=0x7f395c0b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:48.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.441+0000 7f39608d6700 1 --2- 172.21.15.2:0/1759751905 >> v2:172.21.15.192:3300/0 conn(0x7f395c06ee60 0x7f395c0b3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:48.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.441+0000 7f39608d6700 1 -- 172.21.15.2:0/1759751905 >> v1:172.21.15.2:6789/0 conn(0x7f395c0b5ab0 legacy=0x7f395c161ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:48.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.441+0000 7f39608d6700 1 -- 172.21.15.2:0/1759751905 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f395c0727f0 con 0x7f395c06b620 2023-11-26T07:13:48.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.441+0000 7f39610d7700 1 --2- 172.21.15.2:0/1759751905 >> v2:172.21.15.192:3300/0 conn(0x7f395c06ee60 0x7f395c0b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:13:48.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.441+0000 7f39608d6700 1 --2- 172.21.15.2:0/1759751905 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f395c06b620 0x7f395c0b3a40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3950009840 tx=0x7f3950009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f514b313efa2cd4f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:48.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.441+0000 7f395b7fe700 1 -- 172.21.15.2:0/1759751905 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3950011830 con 0x7f395c06b620 2023-11-26T07:13:48.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.442+0000 7f395b7fe700 1 -- 172.21.15.2:0/1759751905 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3950011990 con 0x7f395c06b620 2023-11-26T07:13:48.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.442+0000 7f395b7fe700 1 -- 172.21.15.2:0/1759751905 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3950011d00 con 0x7f395c06b620 2023-11-26T07:13:48.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.442+0000 7f3962b3a700 1 -- 172.21.15.2:0/1759751905 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f395c06b620 msgr2=0x7f395c0b3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:48.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.442+0000 7f3962b3a700 1 --2- 172.21.15.2:0/1759751905 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f395c06b620 0x7f395c0b3a40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3950009840 tx=0x7f3950009b50 comp rx=0 tx=0).stop 2023-11-26T07:13:48.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.442+0000 7f3962b3a700 1 -- 172.21.15.2:0/1759751905 shutdown_connections 2023-11-26T07:13:48.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.442+0000 7f3962b3a700 1 --2- 172.21.15.2:0/1759751905 >> v2:172.21.15.192:3300/0 conn(0x7f395c06ee60 0x7f395c0b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:48.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.442+0000 7f3962b3a700 1 --2- 172.21.15.2:0/1759751905 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f395c06b620 0x7f395c0b3a40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:48.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.442+0000 7f3962b3a700 1 -- 172.21.15.2:0/1759751905 >> 172.21.15.2:0/1759751905 conn(0x7f395c0b2740 msgr2=0x7f395c0b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:48.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.442+0000 7f3962b3a700 1 -- 172.21.15.2:0/1759751905 shutdown_connections 2023-11-26T07:13:48.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.442+0000 7f3962b3a700 1 -- 172.21.15.2:0/1759751905 wait complete. 2023-11-26T07:13:48.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.443+0000 7f3962b3a700 1 Processor -- start 2023-11-26T07:13:48.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.443+0000 7f3962b3a700 1 -- start start 2023-11-26T07:13:48.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.444+0000 7f3962b3a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f395c06b620 0x7f395c1e6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:48.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.444+0000 7f3962b3a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f395c06ee60 0x7f395c1e8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:48.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.444+0000 7f3962b3a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f395c0b5ab0 0x7f395c1e8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:48.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.444+0000 7f3962b3a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f395c1e8290 con 0x7f395c06b620 2023-11-26T07:13:48.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.444+0000 7f3962b3a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f395c1e3620 con 0x7f395c06ee60 2023-11-26T07:13:48.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.444+0000 7f3962b3a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f395c1e79f0 con 0x7f395c0b5ab0 2023-11-26T07:13:48.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.444+0000 7f39608d6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f395c06b620 0x7f395c1e6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:48.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.444+0000 7f39608d6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f395c06b620 0x7f395c1e6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41744/0 (socket says 172.21.15.2:41744) 2023-11-26T07:13:48.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.444+0000 7f39608d6700 1 -- 172.21.15.2:0/1919920263 learned_addr learned my addr 172.21.15.2:0/1919920263 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:48.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.445+0000 7f395bfff700 1 --2- 172.21.15.2:0/1919920263 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f395c06ee60 0x7f395c1e8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:48.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.445+0000 7f39610d7700 1 --2- 172.21.15.2:0/1919920263 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f395c0b5ab0 0x7f395c1e8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:48.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.445+0000 7f39608d6700 1 -- 172.21.15.2:0/1919920263 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f395c0b5ab0 msgr2=0x7f395c1e8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:48.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.445+0000 7f39608d6700 1 --2- 172.21.15.2:0/1919920263 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f395c0b5ab0 0x7f395c1e8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:48.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.445+0000 7f39608d6700 1 -- 172.21.15.2:0/1919920263 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f395c06ee60 msgr2=0x7f395c1e8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:48.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.445+0000 7f39608d6700 1 --2- 172.21.15.2:0/1919920263 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f395c06ee60 0x7f395c1e8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:48.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.445+0000 7f39608d6700 1 -- 172.21.15.2:0/1919920263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3954009a70 con 0x7f395c06b620 2023-11-26T07:13:48.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.445+0000 7f39610d7700 1 --2- 172.21.15.2:0/1919920263 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f395c0b5ab0 0x7f395c1e8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:13:48.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.445+0000 7f395bfff700 1 --2- 172.21.15.2:0/1919920263 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f395c06ee60 0x7f395c1e8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:13:48.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.445+0000 7f39608d6700 1 --2- 172.21.15.2:0/1919920263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f395c06b620 0x7f395c1e6110 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f3950009b90 tx=0x7f3950004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:48.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.445+0000 7f39597fa700 1 -- 172.21.15.2:0/1919920263 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39500036a0 con 0x7f395c06b620 2023-11-26T07:13:48.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.445+0000 7f39597fa700 1 -- 172.21.15.2:0/1919920263 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395001f070 con 0x7f395c06b620 2023-11-26T07:13:48.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.445+0000 7f3962b3a700 1 -- 172.21.15.2:0/1919920263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39500094a0 con 0x7f395c06b620 2023-11-26T07:13:48.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.445+0000 7f39597fa700 1 -- 172.21.15.2:0/1919920263 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3950003a40 con 0x7f395c06b620 2023-11-26T07:13:48.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.445+0000 7f3962b3a700 1 -- 172.21.15.2:0/1919920263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f395c1e7fb0 con 0x7f395c06b620 2023-11-26T07:13:48.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.446+0000 7f3962b3a700 1 -- 172.21.15.2:0/1919920263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f395c075480 con 0x7f395c06b620 2023-11-26T07:13:48.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.446+0000 7f39597fa700 1 -- 172.21.15.2:0/1919920263 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f3950003ba0 con 0x7f395c06b620 2023-11-26T07:13:48.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.447+0000 7f39597fa700 1 --2- 172.21.15.2:0/1919920263 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f394006b1a0 0x7f394006d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:48.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.447+0000 7f39597fa700 1 -- 172.21.15.2:0/1919920263 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3950021070 con 0x7f395c06b620 2023-11-26T07:13:48.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.447+0000 7f395bfff700 1 --2- 172.21.15.2:0/1919920263 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f394006b1a0 0x7f394006d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:48.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.448+0000 7f395bfff700 1 --2- 172.21.15.2:0/1919920263 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f394006b1a0 0x7f394006d660 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f395c1e9190 tx=0x7f3948009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:48.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.451+0000 7f39597fa700 1 -- 172.21.15.2:0/1919920263 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f39500561a0 con 0x7f395c06b620 2023-11-26T07:13:48.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.651+0000 7f3962b3a700 1 -- 172.21.15.2:0/1919920263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f395c06bd40 con 0x7f395c06b620 2023-11-26T07:13:48.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.654+0000 7f39597fa700 1 -- 172.21.15.2:0/1919920263 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f39500597c0 con 0x7f395c06b620 2023-11-26T07:13:48.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.656+0000 7f3962b3a700 1 -- 172.21.15.2:0/1919920263 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f394006b1a0 msgr2=0x7f394006d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:48.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.656+0000 7f3962b3a700 1 --2- 172.21.15.2:0/1919920263 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f394006b1a0 0x7f394006d660 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f395c1e9190 tx=0x7f3948009040 comp rx=0 tx=0).stop 2023-11-26T07:13:48.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.656+0000 7f3962b3a700 1 -- 172.21.15.2:0/1919920263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f395c06b620 msgr2=0x7f395c1e6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:48.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.656+0000 7f3962b3a700 1 --2- 172.21.15.2:0/1919920263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f395c06b620 0x7f395c1e6110 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f3950009b90 tx=0x7f3950004750 comp rx=0 tx=0).stop 2023-11-26T07:13:48.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.656+0000 7f3962b3a700 1 -- 172.21.15.2:0/1919920263 shutdown_connections 2023-11-26T07:13:48.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.656+0000 7f3962b3a700 1 --2- 172.21.15.2:0/1919920263 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f394006b1a0 0x7f394006d660 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:48.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.656+0000 7f3962b3a700 1 --2- 172.21.15.2:0/1919920263 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f395c0b5ab0 0x7f395c1e8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:48.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.656+0000 7f3962b3a700 1 --2- 172.21.15.2:0/1919920263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f395c06b620 0x7f395c1e6110 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:48.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.656+0000 7f3962b3a700 1 --2- 172.21.15.2:0/1919920263 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f395c06ee60 0x7f395c1e8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:48.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.656+0000 7f3962b3a700 1 -- 172.21.15.2:0/1919920263 >> 172.21.15.2:0/1919920263 conn(0x7f395c0b2740 msgr2=0x7f395c0aeec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:48.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.656+0000 7f3962b3a700 1 -- 172.21.15.2:0/1919920263 shutdown_connections 2023-11-26T07:13:48.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:48.656+0000 7f3962b3a700 1 -- 172.21.15.2:0/1919920263 wait complete. 2023-11-26T07:13:48.671 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-26T07:13:48.671 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:13:48.709 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:13:48.769 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-26T07:13:48.769 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:48.769 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:48.787 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19704 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-26T07:13:48.787 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:13:48.787 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:48.807 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284224k,nr_inodes=4071056,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3837 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260544k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-26T07:13:48.807 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:13:48.807 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:48.844 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19704 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-26T07:13:48.844 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:13:48.844 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:13:48.866 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284224k,nr_inodes=4071056,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3837 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260544k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-26T07:13:48.867 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-26T07:13:48.867 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:13:49.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.006+0000 7fdfbe442700 1 Processor -- start 2023-11-26T07:13:49.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.006+0000 7fdfbe442700 1 -- start start 2023-11-26T07:13:49.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.007+0000 7fdfbe442700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdfb8143ae0 0x7fdfb80b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:49.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.007+0000 7fdfbe442700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdfb80722c0 0x7fdfb806e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:49.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.007+0000 7fdfbe442700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb8143ec0 con 0x7fdfb81440f0 2023-11-26T07:13:49.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.007+0000 7fdfbe442700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfb80b40a0 con 0x7fdfb8143ae0 2023-11-26T07:13:49.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.007+0000 7fdfbe442700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfb80b3ae0 con 0x7fdfb80722c0 2023-11-26T07:13:49.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.007+0000 7fdfb7fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdfb8143ae0 0x7fdfb80b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:49.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.007+0000 7fdfb7fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdfb8143ae0 0x7fdfb80b51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41752/0 (socket says 172.21.15.2:41752) 2023-11-26T07:13:49.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.007+0000 7fdfb7fff700 1 -- 172.21.15.2:0/3048315738 learned_addr learned my addr 172.21.15.2:0/3048315738 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:49.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.007+0000 7fdfbc9df700 1 --2- 172.21.15.2:0/3048315738 >> v2:172.21.15.192:3300/0 conn(0x7fdfb80722c0 0x7fdfb806e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:49.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.007+0000 7fdfb7fff700 1 -- 172.21.15.2:0/3048315738 >> v2:172.21.15.192:3300/0 conn(0x7fdfb80722c0 msgr2=0x7fdfb806e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:49.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.007+0000 7fdfb7fff700 1 --2- 172.21.15.2:0/3048315738 >> v2:172.21.15.192:3300/0 conn(0x7fdfb80722c0 0x7fdfb806e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:49.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.007+0000 7fdfb7fff700 1 -- 172.21.15.2:0/3048315738 >> v1:172.21.15.2:6789/0 conn(0x7fdfb81440f0 legacy=0x7fdfb8071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:49.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.007+0000 7fdfb7fff700 1 -- 172.21.15.2:0/3048315738 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb80b3dc0 con 0x7fdfb8143ae0 2023-11-26T07:13:49.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.007+0000 7fdfb6ffd700 1 -- 172.21.15.2:0/3048315738 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 818747417 0 0) 0x7fdfb8143ec0 con 0x7fdfb81440f0 2023-11-26T07:13:49.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.008+0000 7fdfb7fff700 1 --2- 172.21.15.2:0/3048315738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfb8143ae0 0x7fdfb80b51b0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fdfb80747c0 tx=0x7fdfa8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69505f1e11e98cf1 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:49.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.008+0000 7fdfb6ffd700 1 -- 172.21.15.2:0/3048315738 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa8011830 con 0x7fdfb8143ae0 2023-11-26T07:13:49.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.008+0000 7fdfb6ffd700 1 -- 172.21.15.2:0/3048315738 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa8011990 con 0x7fdfb8143ae0 2023-11-26T07:13:49.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.008+0000 7fdfb6ffd700 1 -- 172.21.15.2:0/3048315738 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa8011d20 con 0x7fdfb8143ae0 2023-11-26T07:13:49.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.008+0000 7fdfbe442700 1 -- 172.21.15.2:0/3048315738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfb8143ae0 msgr2=0x7fdfb80b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:49.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.008+0000 7fdfbe442700 1 --2- 172.21.15.2:0/3048315738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfb8143ae0 0x7fdfb80b51b0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fdfb80747c0 tx=0x7fdfa8009bd0 comp rx=0 tx=0).stop 2023-11-26T07:13:49.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.008+0000 7fdfbe442700 1 -- 172.21.15.2:0/3048315738 shutdown_connections 2023-11-26T07:13:49.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.008+0000 7fdfbe442700 1 --2- 172.21.15.2:0/3048315738 >> v2:172.21.15.192:3300/0 conn(0x7fdfb80722c0 0x7fdfb806e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:49.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.008+0000 7fdfbe442700 1 --2- 172.21.15.2:0/3048315738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfb8143ae0 0x7fdfb80b51b0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:49.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.008+0000 7fdfbe442700 1 -- 172.21.15.2:0/3048315738 >> 172.21.15.2:0/3048315738 conn(0x7fdfb80b2740 msgr2=0x7fdfb80b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:49.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.008+0000 7fdfbe442700 1 -- 172.21.15.2:0/3048315738 shutdown_connections 2023-11-26T07:13:49.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.008+0000 7fdfbe442700 1 -- 172.21.15.2:0/3048315738 wait complete. 2023-11-26T07:13:49.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.010+0000 7fdfbe442700 1 Processor -- start 2023-11-26T07:13:49.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.010+0000 7fdfbe442700 1 -- start start 2023-11-26T07:13:49.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.011+0000 7fdfbe442700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfb80722c0 0x7fdfb813ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:49.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.011+0000 7fdfbe442700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdfb8143ae0 0x7fdfb80cc310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:49.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.011+0000 7fdfbe442700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfb81440f0 0x7fdfb80cc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:49.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.011+0000 7fdfbe442700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb815f6f0 con 0x7fdfb80722c0 2023-11-26T07:13:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.011+0000 7fdfbe442700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb81f3800 con 0x7fdfb81440f0 2023-11-26T07:13:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.011+0000 7fdfbe442700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb81f3ae0 con 0x7fdfb8143ae0 2023-11-26T07:13:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.011+0000 7fdfb7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfb80722c0 0x7fdfb813ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.011+0000 7fdfb7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfb80722c0 0x7fdfb813ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41758/0 (socket says 172.21.15.2:41758) 2023-11-26T07:13:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.011+0000 7fdfb7fff700 1 -- 172.21.15.2:0/2211050589 learned_addr learned my addr 172.21.15.2:0/2211050589 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.011+0000 7fdfbc9df700 1 --2- 172.21.15.2:0/2211050589 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfb81440f0 0x7fdfb80cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.011+0000 7fdfb77fe700 1 --2- 172.21.15.2:0/2211050589 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdfb8143ae0 0x7fdfb80cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.011+0000 7fdfb7fff700 1 -- 172.21.15.2:0/2211050589 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdfb8143ae0 msgr2=0x7fdfb80cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.011+0000 7fdfb7fff700 1 --2- 172.21.15.2:0/2211050589 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdfb8143ae0 0x7fdfb80cc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.011+0000 7fdfb7fff700 1 -- 172.21.15.2:0/2211050589 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfb81440f0 msgr2=0x7fdfb80cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.011+0000 7fdfb7fff700 1 --2- 172.21.15.2:0/2211050589 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfb81440f0 0x7fdfb80cc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.011+0000 7fdfb7fff700 1 -- 172.21.15.2:0/2211050589 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa8009550 con 0x7fdfb80722c0 2023-11-26T07:13:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.011+0000 7fdfb77fe700 1 --2- 172.21.15.2:0/2211050589 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdfb8143ae0 0x7fdfb80cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:13:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.011+0000 7fdfb7fff700 1 --2- 172.21.15.2:0/2211050589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfb80722c0 0x7fdfb813ee60 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8009c10 tx=0x7fdfa8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.011+0000 7fdfb4ff9700 1 -- 172.21.15.2:0/2211050589 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa80036a0 con 0x7fdfb80722c0 2023-11-26T07:13:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.011+0000 7fdfb4ff9700 1 -- 172.21.15.2:0/2211050589 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa8003800 con 0x7fdfb80722c0 2023-11-26T07:13:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.011+0000 7fdfb4ff9700 1 -- 172.21.15.2:0/2211050589 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa8003b70 con 0x7fdfb80722c0 2023-11-26T07:13:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.011+0000 7fdfbe442700 1 -- 172.21.15.2:0/2211050589 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb81f3dc0 con 0x7fdfb80722c0 2023-11-26T07:13:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.011+0000 7fdfbe442700 1 -- 172.21.15.2:0/2211050589 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb813f3a0 con 0x7fdfb80722c0 2023-11-26T07:13:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.013+0000 7fdfb4ff9700 1 -- 172.21.15.2:0/2211050589 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7fdfa8003cd0 con 0x7fdfb80722c0 2023-11-26T07:13:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.013+0000 7fdfbe442700 1 -- 172.21.15.2:0/2211050589 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfb80b57f0 con 0x7fdfb80722c0 2023-11-26T07:13:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.013+0000 7fdfb4ff9700 1 --2- 172.21.15.2:0/2211050589 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fdfa406b1a0 0x7fdfa406d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.013+0000 7fdfb4ff9700 1 -- 172.21.15.2:0/2211050589 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fdfa8021030 con 0x7fdfb80722c0 2023-11-26T07:13:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.013+0000 7fdfb77fe700 1 --2- 172.21.15.2:0/2211050589 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fdfa406b1a0 0x7fdfa406d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:49.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.014+0000 7fdfb77fe700 1 --2- 172.21.15.2:0/2211050589 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fdfa406b1a0 0x7fdfa406d660 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fdfb80b2710 tx=0x7fdfac009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:49.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.018+0000 7fdfb4ff9700 1 -- 172.21.15.2:0/2211050589 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdfa8055e90 con 0x7fdfb80722c0 2023-11-26T07:13:49.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.262+0000 7fdfbe442700 1 -- 172.21.15.2:0/2211050589 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdfb8068670 con 0x7fdfb80722c0 2023-11-26T07:13:49.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.263+0000 7fdfb4ff9700 1 -- 172.21.15.2:0/2211050589 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3699 (secure 0 0 0) 0x7fdfa802b020 con 0x7fdfb80722c0 2023-11-26T07:13:49.266 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:13:49.266 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4727,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3580414083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3580414083},{"type":"v1","addr":"172.21.15.192:6837","nonce":3580414083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4948,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/3401314194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3401314194},{"type":"v1","addr":"172.21.15.2:6834","nonce":3401314194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4954,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3579861389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3579861389},{"type":"v1","addr":"172.21.15.192:6836","nonce":3579861389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5308,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2001864094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":2001864094},{"type":"v1","addr":"172.21.15.2:6835","nonce":2001864094}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[]} 2023-11-26T07:13:49.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.264+0000 7fdfbe442700 1 -- 172.21.15.2:0/2211050589 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fdfa406b1a0 msgr2=0x7fdfa406d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:49.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.265+0000 7fdfbe442700 1 --2- 172.21.15.2:0/2211050589 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fdfa406b1a0 0x7fdfa406d660 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fdfb80b2710 tx=0x7fdfac009040 comp rx=0 tx=0).stop 2023-11-26T07:13:49.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.265+0000 7fdfbe442700 1 -- 172.21.15.2:0/2211050589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfb80722c0 msgr2=0x7fdfb813ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:49.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.265+0000 7fdfbe442700 1 --2- 172.21.15.2:0/2211050589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfb80722c0 0x7fdfb813ee60 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8009c10 tx=0x7fdfa8004750 comp rx=0 tx=0).stop 2023-11-26T07:13:49.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.265+0000 7fdfbe442700 1 -- 172.21.15.2:0/2211050589 shutdown_connections 2023-11-26T07:13:49.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.265+0000 7fdfbe442700 1 --2- 172.21.15.2:0/2211050589 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fdfa406b1a0 0x7fdfa406d660 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:49.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.265+0000 7fdfbe442700 1 --2- 172.21.15.2:0/2211050589 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfb81440f0 0x7fdfb80cc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:49.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.265+0000 7fdfbe442700 1 --2- 172.21.15.2:0/2211050589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfb80722c0 0x7fdfb813ee60 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:49.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.265+0000 7fdfbe442700 1 --2- 172.21.15.2:0/2211050589 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdfb8143ae0 0x7fdfb80cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:49.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.265+0000 7fdfbe442700 1 -- 172.21.15.2:0/2211050589 >> 172.21.15.2:0/2211050589 conn(0x7fdfb80b2740 msgr2=0x7fdfb80cdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:49.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.265+0000 7fdfbe442700 1 -- 172.21.15.2:0/2211050589 shutdown_connections 2023-11-26T07:13:49.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.265+0000 7fdfbe442700 1 -- 172.21.15.2:0/2211050589 wait complete. 2023-11-26T07:13:49.270 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 19 2023-11-26T07:13:49.280 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-26T07:13:49.280 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-26T07:13:49.280 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-26T07:13:49.280 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:13:49.281 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-26T07:13:49.281 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-26T07:13:49.281 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-26T07:13:49.281 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:13:49.282 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-26T07:13:49.282 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-26T07:13:49.282 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-26T07:13:49.282 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:13:49.282 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-26T07:13:49.282 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-26T07:13:49.283 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-26T07:13:49.283 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:13:49.290 INFO:tasks.ceph.mds.a:Stopped 2023-11-26T07:13:49.290 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-26T07:13:49.291 INFO:tasks.ceph.mds.c:Stopped 2023-11-26T07:13:49.291 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-26T07:13:49.295 INFO:tasks.ceph.mds.b:Stopped 2023-11-26T07:13:49.295 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-26T07:13:49.296 INFO:tasks.ceph.mds.d:Stopped 2023-11-26T07:13:49.296 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-26T07:13:49.332 INFO:tasks.ceph.mds.a:Started 2023-11-26T07:13:49.332 DEBUG:teuthology.parallel:result is None 2023-11-26T07:13:49.333 INFO:tasks.ceph.mds.c:Started 2023-11-26T07:13:49.333 DEBUG:teuthology.parallel:result is None 2023-11-26T07:13:49.338 INFO:tasks.ceph.mds.b:Started 2023-11-26T07:13:49.339 DEBUG:teuthology.parallel:result is None 2023-11-26T07:13:49.340 INFO:tasks.ceph.mds.d:Started 2023-11-26T07:13:49.340 DEBUG:teuthology.parallel:result is None 2023-11-26T07:13:49.340 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-26T07:13:49.414 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2023-11-26T07:13:49.415 INFO:tasks.ceph.mds.c.smithi002.stdout:starting mds.c at 2023-11-26T07:13:49.425 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2023-11-26T07:13:49.425 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2023-11-26T07:13:49.425 INFO:tasks.ceph.mds.d.smithi192.stderr:2023-11-26T07:13:49.424+0000 7fc71fe8c700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-11-26T07:13:49.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.469+0000 7f28c6c27700 1 Processor -- start 2023-11-26T07:13:49.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.469+0000 7f28c6c27700 1 -- start start 2023-11-26T07:13:49.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.470+0000 7f28c6c27700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f28c00b4150 0x7f28c006de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:49.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.470+0000 7f28c6c27700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f28c00b5ab0 0x7f28c006e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:49.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.470+0000 7f28c6c27700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28c0071f50 con 0x7f28c006b620 2023-11-26T07:13:49.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.470+0000 7f28c6c27700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28c0072230 con 0x7f28c00b5ab0 2023-11-26T07:13:49.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.470+0000 7f28c6c27700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28c0072510 con 0x7f28c00b4150 2023-11-26T07:13:49.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.471+0000 7f28c51c4700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f28c00b5ab0 0x7f28c006e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:49.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.471+0000 7f28c51c4700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f28c00b5ab0 0x7f28c006e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41792/0 (socket says 172.21.15.2:41792) 2023-11-26T07:13:49.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.471+0000 7f28c51c4700 1 -- 172.21.15.2:0/3428036646 learned_addr learned my addr 172.21.15.2:0/3428036646 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:49.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.471+0000 7f28bffff700 1 --2- 172.21.15.2:0/3428036646 >> v2:172.21.15.192:3300/0 conn(0x7f28c00b4150 0x7f28c006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:49.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.471+0000 7f28c51c4700 1 -- 172.21.15.2:0/3428036646 >> v2:172.21.15.192:3300/0 conn(0x7f28c00b4150 msgr2=0x7f28c006de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:49.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.471+0000 7f28c51c4700 1 --2- 172.21.15.2:0/3428036646 >> v2:172.21.15.192:3300/0 conn(0x7f28c00b4150 0x7f28c006de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:49.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.471+0000 7f28c51c4700 1 -- 172.21.15.2:0/3428036646 >> v1:172.21.15.192:6789/0 conn(0x7f28c006b620 legacy=0x7f28c00b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:49.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.471+0000 7f28c51c4700 1 -- 172.21.15.2:0/3428036646 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c00727f0 con 0x7f28c00b5ab0 2023-11-26T07:13:49.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.471+0000 7f28c51c4700 1 --2- 172.21.15.2:0/3428036646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28c00b5ab0 0x7f28c006e390 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f28c006d6f0 tx=0x7f28b0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f111588f8f71f2f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:49.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.471+0000 7f28bf7fe700 1 -- 172.21.15.2:0/3428036646 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b0011830 con 0x7f28c00b5ab0 2023-11-26T07:13:49.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.471+0000 7f28bf7fe700 1 -- 172.21.15.2:0/3428036646 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b0011990 con 0x7f28c00b5ab0 2023-11-26T07:13:49.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.471+0000 7f28bf7fe700 1 -- 172.21.15.2:0/3428036646 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b0011d20 con 0x7f28c00b5ab0 2023-11-26T07:13:49.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.472+0000 7f28c6c27700 1 -- 172.21.15.2:0/3428036646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28c00b5ab0 msgr2=0x7f28c006e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:49.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.472+0000 7f28c6c27700 1 --2- 172.21.15.2:0/3428036646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28c00b5ab0 0x7f28c006e390 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f28c006d6f0 tx=0x7f28b0009bd0 comp rx=0 tx=0).stop 2023-11-26T07:13:49.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.472+0000 7f28c6c27700 1 -- 172.21.15.2:0/3428036646 shutdown_connections 2023-11-26T07:13:49.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.472+0000 7f28c6c27700 1 --2- 172.21.15.2:0/3428036646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28c00b5ab0 0x7f28c006e390 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:49.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.472+0000 7f28c6c27700 1 --2- 172.21.15.2:0/3428036646 >> v2:172.21.15.192:3300/0 conn(0x7f28c00b4150 0x7f28c006de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:49.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.472+0000 7f28c6c27700 1 -- 172.21.15.2:0/3428036646 >> 172.21.15.2:0/3428036646 conn(0x7f28c00b2740 msgr2=0x7f28c00b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:49.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.472+0000 7f28c6c27700 1 -- 172.21.15.2:0/3428036646 shutdown_connections 2023-11-26T07:13:49.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.472+0000 7f28c6c27700 1 -- 172.21.15.2:0/3428036646 wait complete. 2023-11-26T07:13:49.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.473+0000 7f28c6c27700 1 Processor -- start 2023-11-26T07:13:49.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.473+0000 7f28c6c27700 1 -- start start 2023-11-26T07:13:49.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.474+0000 7f28c6c27700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28c006b620 0x7f28c00add40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:49.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.474+0000 7f28c6c27700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28c00b4150 0x7f28c00ae280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:49.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.474+0000 7f28c6c27700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28c00b5ab0 0x7f28c01f7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:49.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.474+0000 7f28c6c27700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c01e4e30 con 0x7f28c006b620 2023-11-26T07:13:49.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.474+0000 7f28c6c27700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c00c6380 con 0x7f28c00b4150 2023-11-26T07:13:49.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.474+0000 7f28c6c27700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c01f8040 con 0x7f28c00b5ab0 2023-11-26T07:13:49.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.474+0000 7f28c49c3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28c006b620 0x7f28c00add40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:49.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.474+0000 7f28c49c3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28c006b620 0x7f28c00add40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41796/0 (socket says 172.21.15.2:41796) 2023-11-26T07:13:49.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.474+0000 7f28c49c3700 1 -- 172.21.15.2:0/2952338562 learned_addr learned my addr 172.21.15.2:0/2952338562 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:49.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.474+0000 7f28c51c4700 1 --2- 172.21.15.2:0/2952338562 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28c00b5ab0 0x7f28c01f7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:49.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.474+0000 7f28bffff700 1 --2- 172.21.15.2:0/2952338562 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28c00b4150 0x7f28c00ae280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:49.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.474+0000 7f28c49c3700 1 -- 172.21.15.2:0/2952338562 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28c00b5ab0 msgr2=0x7f28c01f7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:49.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.474+0000 7f28c49c3700 1 --2- 172.21.15.2:0/2952338562 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28c00b5ab0 0x7f28c01f7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:49.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.474+0000 7f28c49c3700 1 -- 172.21.15.2:0/2952338562 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28c00b4150 msgr2=0x7f28c00ae280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:49.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.474+0000 7f28c49c3700 1 --2- 172.21.15.2:0/2952338562 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28c00b4150 0x7f28c00ae280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:49.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.474+0000 7f28c49c3700 1 -- 172.21.15.2:0/2952338562 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b0009550 con 0x7f28c006b620 2023-11-26T07:13:49.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.475+0000 7f28c49c3700 1 --2- 172.21.15.2:0/2952338562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28c006b620 0x7f28c00add40 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f28b8001ed0 tx=0x7f28b80021e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:49.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.475+0000 7f28bd7fa700 1 -- 172.21.15.2:0/2952338562 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b8003c00 con 0x7f28c006b620 2023-11-26T07:13:49.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.475+0000 7f28bd7fa700 1 -- 172.21.15.2:0/2952338562 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b8003d60 con 0x7f28c006b620 2023-11-26T07:13:49.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.475+0000 7f28c6c27700 1 -- 172.21.15.2:0/2952338562 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28c00c5a50 con 0x7f28c006b620 2023-11-26T07:13:49.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.475+0000 7f28bd7fa700 1 -- 172.21.15.2:0/2952338562 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b800ab40 con 0x7f28c006b620 2023-11-26T07:13:49.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.475+0000 7f28c6c27700 1 -- 172.21.15.2:0/2952338562 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28c00c6010 con 0x7f28c006b620 2023-11-26T07:13:49.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.476+0000 7f28c6c27700 1 -- 172.21.15.2:0/2952338562 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28c0068670 con 0x7f28c006b620 2023-11-26T07:13:49.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.476+0000 7f28bd7fa700 1 -- 172.21.15.2:0/2952338562 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f28b800aca0 con 0x7f28c006b620 2023-11-26T07:13:49.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.477+0000 7f28bd7fa700 1 --2- 172.21.15.2:0/2952338562 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f28a006b1a0 0x7f28a006d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:49.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.477+0000 7f28bd7fa700 1 -- 172.21.15.2:0/2952338562 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f28b80896f0 con 0x7f28c006b620 2023-11-26T07:13:49.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.477+0000 7f28bffff700 1 --2- 172.21.15.2:0/2952338562 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f28a006b1a0 0x7f28a006d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:49.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.477+0000 7f28bffff700 1 --2- 172.21.15.2:0/2952338562 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f28a006b1a0 0x7f28a006d660 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f28c00c7430 tx=0x7f28a8009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:49.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.481+0000 7f28bd7fa700 1 -- 172.21.15.2:0/2952338562 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f28b80547e0 con 0x7f28c006b620 2023-11-26T07:13:49.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:49.698+0000 7f28c6c27700 1 -- 172.21.15.2:0/2952338562 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f28c006bd40 con 0x7f28c006b620 2023-11-26T07:13:50.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.301+0000 7f28bd7fa700 1 -- 172.21.15.2:0/2952338562 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v39) v1 ==== 97+0+0 (secure 0 0 0) 0x7f28b8057e00 con 0x7f28c006b620 2023-11-26T07:13:50.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.304+0000 7f28c6c27700 1 -- 172.21.15.2:0/2952338562 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f28a006b1a0 msgr2=0x7f28a006d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:50.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.304+0000 7f28c6c27700 1 --2- 172.21.15.2:0/2952338562 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f28a006b1a0 0x7f28a006d660 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f28c00c7430 tx=0x7f28a8009210 comp rx=0 tx=0).stop 2023-11-26T07:13:50.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.304+0000 7f28c6c27700 1 -- 172.21.15.2:0/2952338562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28c006b620 msgr2=0x7f28c00add40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:50.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.304+0000 7f28c6c27700 1 --2- 172.21.15.2:0/2952338562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28c006b620 0x7f28c00add40 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f28b8001ed0 tx=0x7f28b80021e0 comp rx=0 tx=0).stop 2023-11-26T07:13:50.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.304+0000 7f28c6c27700 1 -- 172.21.15.2:0/2952338562 shutdown_connections 2023-11-26T07:13:50.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.304+0000 7f28c6c27700 1 --2- 172.21.15.2:0/2952338562 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f28a006b1a0 0x7f28a006d660 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:50.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.304+0000 7f28c6c27700 1 --2- 172.21.15.2:0/2952338562 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28c00b5ab0 0x7f28c01f7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:50.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.304+0000 7f28c6c27700 1 --2- 172.21.15.2:0/2952338562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28c006b620 0x7f28c00add40 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:50.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.304+0000 7f28c6c27700 1 --2- 172.21.15.2:0/2952338562 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28c00b4150 0x7f28c00ae280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:50.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.304+0000 7f28c6c27700 1 -- 172.21.15.2:0/2952338562 >> 172.21.15.2:0/2952338562 conn(0x7f28c00b2740 msgr2=0x7f28c00b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:50.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.304+0000 7f28c6c27700 1 -- 172.21.15.2:0/2952338562 shutdown_connections 2023-11-26T07:13:50.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.304+0000 7f28c6c27700 1 -- 172.21.15.2:0/2952338562 wait complete. 2023-11-26T07:13:50.309 INFO:teuthology.orchestra.run.smithi002.stderr: removed all blocklist entries 2023-11-26T07:13:50.323 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-26T07:13:50.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.452+0000 7ffa2dc59700 1 Processor -- start 2023-11-26T07:13:50.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.453+0000 7ffa2dc59700 1 -- start start 2023-11-26T07:13:50.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.453+0000 7ffa2dc59700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ffa2815dfc0 0x7ffa280d4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:50.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.453+0000 7ffa2dc59700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffa2815e3a0 0x7ffa280c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:50.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.453+0000 7ffa2dc59700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa280d2790 con 0x7ffa280d1440 2023-11-26T07:13:50.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.453+0000 7ffa2dc59700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa280d2a70 con 0x7ffa2815dfc0 2023-11-26T07:13:50.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.453+0000 7ffa2dc59700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa280c7a30 con 0x7ffa2815e3a0 2023-11-26T07:13:50.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.454+0000 7ffa26ffd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ffa280d1440 0x7ffa280d0830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33014/0 (socket says 172.21.15.2:33014) 2023-11-26T07:13:50.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.454+0000 7ffa26ffd700 1 -- 172.21.15.2:0/2590211334 learned_addr learned my addr 172.21.15.2:0/2590211334 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:13:50.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.454+0000 7ffa267fc700 1 -- 172.21.15.2:0/2590211334 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 951927498 0 0) 0x7ffa280d2790 con 0x7ffa280d1440 2023-11-26T07:13:50.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.454+0000 7ffa267fc700 1 -- 172.21.15.2:0/2590211334 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa100035b0 con 0x7ffa280d1440 2023-11-26T07:13:50.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.454+0000 7ffa27fff700 1 --2- 172.21.15.2:0/2590211334 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffa2815e3a0 0x7ffa280c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:50.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.454+0000 7ffa277fe700 1 --2- 172.21.15.2:0/2590211334 >> v2:172.21.15.192:3300/0 conn(0x7ffa2815dfc0 0x7ffa280d4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:50.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.454+0000 7ffa267fc700 1 -- 172.21.15.2:0/2590211334 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4271172848 0 0) 0x7ffa100035b0 con 0x7ffa280d1440 2023-11-26T07:13:50.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.454+0000 7ffa267fc700 1 -- 172.21.15.2:0/2590211334 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffa2815e3a0 msgr2=0x7ffa280c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:50.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.454+0000 7ffa267fc700 1 --2- 172.21.15.2:0/2590211334 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffa2815e3a0 0x7ffa280c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:50.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.454+0000 7ffa267fc700 1 -- 172.21.15.2:0/2590211334 >> v2:172.21.15.192:3300/0 conn(0x7ffa2815dfc0 msgr2=0x7ffa280d4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:50.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.454+0000 7ffa267fc700 1 --2- 172.21.15.2:0/2590211334 >> v2:172.21.15.192:3300/0 conn(0x7ffa2815dfc0 0x7ffa280d4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:50.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.454+0000 7ffa267fc700 1 -- 172.21.15.2:0/2590211334 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa280c7d10 con 0x7ffa280d1440 2023-11-26T07:13:50.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.454+0000 7ffa267fc700 1 -- 172.21.15.2:0/2590211334 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7ffa18001670 con 0x7ffa280d1440 2023-11-26T07:13:50.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.454+0000 7ffa267fc700 1 -- 172.21.15.2:0/2590211334 >> v1:172.21.15.2:6789/0 conn(0x7ffa280d1440 legacy=0x7ffa280d0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:50.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.454+0000 7ffa267fc700 1 --2- 172.21.15.2:0/2590211334 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffa2815e3a0 0x7ffa10003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:50.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.454+0000 7ffa267fc700 1 --2- 172.21.15.2:0/2590211334 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa10004030 0x7ffa10004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:50.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.454+0000 7ffa267fc700 1 --2- 172.21.15.2:0/2590211334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa10004d90 0x7ffa10005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:50.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.454+0000 7ffa267fc700 1 -- 172.21.15.2:0/2590211334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa280d2a70 con 0x7ffa10004d90 2023-11-26T07:13:50.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.454+0000 7ffa267fc700 1 -- 172.21.15.2:0/2590211334 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa280c7a30 con 0x7ffa10004030 2023-11-26T07:13:50.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.454+0000 7ffa267fc700 1 -- 172.21.15.2:0/2590211334 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1000bb10 con 0x7ffa2815e3a0 2023-11-26T07:13:50.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.454+0000 7ffa277fe700 1 --2- 172.21.15.2:0/2590211334 >> v2:172.21.15.192:3300/0 conn(0x7ffa2815dfc0 0x7ffa280d4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:13:50.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.454+0000 7ffa27fff700 1 --2- 172.21.15.2:0/2590211334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa10004d90 0x7ffa10005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:50.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.454+0000 7ffa26ffd700 1 --2- 172.21.15.2:0/2590211334 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa10004030 0x7ffa10004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:50.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.454+0000 7ffa277fe700 1 --2- 172.21.15.2:0/2590211334 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffa2815e3a0 0x7ffa10003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:50.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.455+0000 7ffa27fff700 1 -- 172.21.15.2:0/2590211334 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffa2815e3a0 msgr2=0x7ffa10003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:50.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.455+0000 7ffa27fff700 1 --2- 172.21.15.2:0/2590211334 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffa2815e3a0 0x7ffa10003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:50.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.455+0000 7ffa27fff700 1 -- 172.21.15.2:0/2590211334 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa10004030 msgr2=0x7ffa10004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:50.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.455+0000 7ffa27fff700 1 --2- 172.21.15.2:0/2590211334 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa10004030 0x7ffa10004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:50.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.455+0000 7ffa27fff700 1 -- 172.21.15.2:0/2590211334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa100035b0 con 0x7ffa10004d90 2023-11-26T07:13:50.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.455+0000 7ffa27fff700 1 --2- 172.21.15.2:0/2590211334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa10004d90 0x7ffa10005210 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ffa20007330 tx=0x7ffa10005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d898a9ed3b1915d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:50.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.455+0000 7ffa267fc700 1 -- 172.21.15.2:0/2590211334 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa20007e50 con 0x7ffa10004d90 2023-11-26T07:13:50.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.455+0000 7ffa267fc700 1 -- 172.21.15.2:0/2590211334 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa20003a20 con 0x7ffa10004d90 2023-11-26T07:13:50.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.455+0000 7ffa267fc700 1 -- 172.21.15.2:0/2590211334 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa20003dd0 con 0x7ffa10004d90 2023-11-26T07:13:50.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.456+0000 7ffa2dc59700 1 -- 172.21.15.2:0/2590211334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa10004d90 msgr2=0x7ffa10005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:50.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.456+0000 7ffa2dc59700 1 --2- 172.21.15.2:0/2590211334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa10004d90 0x7ffa10005210 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ffa20007330 tx=0x7ffa10005880 comp rx=0 tx=0).stop 2023-11-26T07:13:50.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.456+0000 7ffa27fff700 1 -- 172.21.15.2:0/2590211334 reap_dead start 2023-11-26T07:13:50.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.456+0000 7ffa2dc59700 1 -- 172.21.15.2:0/2590211334 shutdown_connections 2023-11-26T07:13:50.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.456+0000 7ffa2dc59700 1 -- 172.21.15.2:0/2590211334 >> 172.21.15.2:0/2590211334 conn(0x7ffa280d3e40 msgr2=0x7ffa280d4250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:50.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.456+0000 7ffa2dc59700 1 -- 172.21.15.2:0/2590211334 shutdown_connections 2023-11-26T07:13:50.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.456+0000 7ffa2dc59700 1 -- 172.21.15.2:0/2590211334 wait complete. 2023-11-26T07:13:50.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.457+0000 7ffa2dc59700 1 Processor -- start 2023-11-26T07:13:50.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.457+0000 7ffa2dc59700 1 -- start start 2023-11-26T07:13:50.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.458+0000 7ffa2dc59700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa28154120 0x7ffa280b1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:50.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.458+0000 7ffa2dc59700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa28154500 0x7ffa280b7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:50.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.458+0000 7ffa2dc59700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffa281f80a0 0x7ffa280cd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:50.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.458+0000 7ffa2dc59700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa280b3ad0 con 0x7ffa28154120 2023-11-26T07:13:50.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.458+0000 7ffa2dc59700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa280b31a0 con 0x7ffa28154500 2023-11-26T07:13:50.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.458+0000 7ffa2dc59700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa280b3480 con 0x7ffa281f80a0 2023-11-26T07:13:50.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.458+0000 7ffa277fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa28154120 0x7ffa280b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:50.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.458+0000 7ffa277fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa28154120 0x7ffa280b1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41814/0 (socket says 172.21.15.2:41814) 2023-11-26T07:13:50.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.458+0000 7ffa277fe700 1 -- 172.21.15.2:0/2199546400 learned_addr learned my addr 172.21.15.2:0/2199546400 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:50.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.458+0000 7ffa27fff700 1 --2- 172.21.15.2:0/2199546400 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffa281f80a0 0x7ffa280cd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:50.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.458+0000 7ffa26ffd700 1 --2- 172.21.15.2:0/2199546400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa28154500 0x7ffa280b7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:50.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.458+0000 7ffa277fe700 1 -- 172.21.15.2:0/2199546400 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffa281f80a0 msgr2=0x7ffa280cd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:50.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.458+0000 7ffa277fe700 1 --2- 172.21.15.2:0/2199546400 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffa281f80a0 0x7ffa280cd0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:50.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.458+0000 7ffa277fe700 1 -- 172.21.15.2:0/2199546400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa28154500 msgr2=0x7ffa280b7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:50.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.458+0000 7ffa277fe700 1 --2- 172.21.15.2:0/2199546400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa28154500 0x7ffa280b7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:50.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.458+0000 7ffa277fe700 1 -- 172.21.15.2:0/2199546400 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa280b3760 con 0x7ffa28154120 2023-11-26T07:13:50.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.458+0000 7ffa26ffd700 1 --2- 172.21.15.2:0/2199546400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa28154500 0x7ffa280b7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:13:50.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.458+0000 7ffa277fe700 1 --2- 172.21.15.2:0/2199546400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa28154120 0x7ffa280b1260 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c0108d0 tx=0x7ffa1c010c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:50.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.458+0000 7ffa0ffff700 1 -- 172.21.15.2:0/2199546400 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c00ea70 con 0x7ffa28154120 2023-11-26T07:13:50.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.459+0000 7ffa0ffff700 1 -- 172.21.15.2:0/2199546400 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa1c00c050 con 0x7ffa28154120 2023-11-26T07:13:50.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.459+0000 7ffa2dc59700 1 -- 172.21.15.2:0/2199546400 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa280b17a0 con 0x7ffa28154120 2023-11-26T07:13:50.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.459+0000 7ffa0ffff700 1 -- 172.21.15.2:0/2199546400 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c00ee10 con 0x7ffa28154120 2023-11-26T07:13:50.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.459+0000 7ffa2dc59700 1 -- 172.21.15.2:0/2199546400 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa280b7870 con 0x7ffa28154120 2023-11-26T07:13:50.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.459+0000 7ffa2dc59700 1 -- 172.21.15.2:0/2199546400 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa28068670 con 0x7ffa28154120 2023-11-26T07:13:50.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.460+0000 7ffa0ffff700 1 -- 172.21.15.2:0/2199546400 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7ffa1c015470 con 0x7ffa28154120 2023-11-26T07:13:50.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.460+0000 7ffa0ffff700 1 --2- 172.21.15.2:0/2199546400 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ffa1406b1a0 0x7ffa1406d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:50.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.460+0000 7ffa0ffff700 1 -- 172.21.15.2:0/2199546400 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ffa1c08a090 con 0x7ffa28154120 2023-11-26T07:13:50.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.461+0000 7ffa26ffd700 1 --2- 172.21.15.2:0/2199546400 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ffa1406b1a0 0x7ffa1406d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:50.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.461+0000 7ffa26ffd700 1 --2- 172.21.15.2:0/2199546400 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ffa1406b1a0 0x7ffa1406d660 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ffa180048d0 tx=0x7ffa18009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:50.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.465+0000 7ffa0ffff700 1 -- 172.21.15.2:0/2199546400 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ffa1c0550c0 con 0x7ffa28154120 2023-11-26T07:13:50.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.743+0000 7ffa2dc59700 1 -- 172.21.15.2:0/2199546400 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ffa2808d550 con 0x7ffa28154120 2023-11-26T07:13:50.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.744+0000 7ffa0ffff700 1 -- 172.21.15.2:0/2199546400 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7ffa1c0586e0 con 0x7ffa28154120 2023-11-26T07:13:50.747 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:13:50.747 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-26T07:13:50.747 INFO:teuthology.orchestra.run.smithi002.stdout: "auth_dump": [ 2023-11-26T07:13:50.747 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:13:50.747 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.a", 2023-11-26T07:13:50.747 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBv72JlhmTiEhAA/g3oblyy8oWp0Ha83rXvJw==", 2023-11-26T07:13:50.748 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:13:50.748 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-26T07:13:50.748 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-26T07:13:50.748 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-26T07:13:50.748 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:13:50.748 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:13:50.748 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:13:50.748 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:13:50.748 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.b", 2023-11-26T07:13:50.748 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBv72Jlq7BeHxAAOcHBt+2M+s3xqG9k14Oong==", 2023-11-26T07:13:50.748 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:13:50.749 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-26T07:13:50.749 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-26T07:13:50.749 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-26T07:13:50.749 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:13:50.749 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:13:50.749 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:13:50.749 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:13:50.749 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.c", 2023-11-26T07:13:50.749 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBv72Jl5jJFGhAAni1U32wc8K7h2w2Uri/P1Q==", 2023-11-26T07:13:50.749 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:13:50.749 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-26T07:13:50.749 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-26T07:13:50.749 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-26T07:13:50.750 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:13:50.750 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:13:50.750 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:13:50.750 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:13:50.750 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.d", 2023-11-26T07:13:50.750 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBv72JlhpKzJhAAp75J2TEPTop+Zj8ziajW1w==", 2023-11-26T07:13:50.750 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:13:50.750 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-26T07:13:50.750 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-26T07:13:50.750 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-26T07:13:50.750 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:13:50.750 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:13:50.751 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:13:50.751 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:13:50.751 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.0", 2023-11-26T07:13:50.751 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBx72JlnIatFhAAQQkaBQT0iVGJLFeE3ITlAQ==", 2023-11-26T07:13:50.751 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:13:50.751 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-26T07:13:50.751 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-26T07:13:50.751 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:13:50.751 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:13:50.751 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:13:50.751 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:13:50.751 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.1", 2023-11-26T07:13:50.752 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQB072JlXBpBFhAAAEeTzgDMWrtz6OM1Xt6AQg==", 2023-11-26T07:13:50.752 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:13:50.752 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-26T07:13:50.752 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-26T07:13:50.752 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:13:50.752 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:13:50.752 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:13:50.752 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:13:50.752 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.2", 2023-11-26T07:13:50.752 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQB372Jl4nopFhAAYua4b0EX2F1ldmd/00FcUA==", 2023-11-26T07:13:50.752 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:13:50.752 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-26T07:13:50.752 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-26T07:13:50.753 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:13:50.753 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:13:50.753 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:13:50.753 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:13:50.753 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.3", 2023-11-26T07:13:50.753 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQB672Jl73zLFRAATTzBUJUAS8/WHwoQZWQX1w==", 2023-11-26T07:13:50.753 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:13:50.753 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-26T07:13:50.753 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-26T07:13:50.753 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:13:50.753 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:13:50.753 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:13:50.753 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:13:50.754 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.4", 2023-11-26T07:13:50.754 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQCA72JlEqEZGhAAp//g7ZC8YUXoQhoKZKtcDA==", 2023-11-26T07:13:50.754 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:13:50.754 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-26T07:13:50.754 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-26T07:13:50.754 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:13:50.754 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:13:50.754 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:13:50.754 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:13:50.754 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.5", 2023-11-26T07:13:50.755 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQCD72JlGuu/GRAAQb5WygMoPJ7mjB2fR8N3+g==", 2023-11-26T07:13:50.755 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:13:50.755 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-26T07:13:50.755 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-26T07:13:50.755 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:13:50.755 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:13:50.755 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:13:50.755 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:13:50.755 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.6", 2023-11-26T07:13:50.755 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQCG72JlLHYCGRAAEDOtGcsGAVuKMSaXdJdgXg==", 2023-11-26T07:13:50.755 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:13:50.755 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-26T07:13:50.756 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-26T07:13:50.756 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:13:50.756 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:13:50.756 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:13:50.756 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:13:50.756 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.7", 2023-11-26T07:13:50.756 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQCJ72JlKmUJGRAAG7LL7Ath8gv2/HwbKsXYbg==", 2023-11-26T07:13:50.756 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:13:50.756 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-26T07:13:50.756 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-26T07:13:50.756 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:13:50.756 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:13:50.757 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:13:50.757 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:13:50.757 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.0", 2023-11-26T07:13:50.757 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBv72JlaEgQKxAA4cVx4nUFgqn0HvVBJdVHVg==", 2023-11-26T07:13:50.757 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:13:50.757 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-26T07:13:50.757 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow r", 2023-11-26T07:13:50.757 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-26T07:13:50.757 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:13:50.757 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:13:50.757 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:13:50.757 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.1", 2023-11-26T07:13:50.757 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBv72Jl/WHJMRAAcXuo1XInXpAErMaGOhvpBA==", 2023-11-26T07:13:50.758 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:13:50.758 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-26T07:13:50.758 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2023-11-26T07:13:50.758 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2023-11-26T07:13:50.758 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2023-11-26T07:13:50.758 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:13:50.758 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:13:50.758 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:13:50.758 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.2", 2023-11-26T07:13:50.758 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBv72Jl859vLhAAX9K4SuB6kAi/thy6EVKwWA==", 2023-11-26T07:13:50.758 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:13:50.758 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-26T07:13:50.759 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2023-11-26T07:13:50.759 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2023-11-26T07:13:50.759 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2023-11-26T07:13:50.759 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:13:50.759 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:13:50.759 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:13:50.759 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.3", 2023-11-26T07:13:50.759 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBv72JlRDh9NxAAgWUYNNwgFOantC7zH0fC8g==", 2023-11-26T07:13:50.759 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:13:50.759 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-26T07:13:50.759 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2023-11-26T07:13:50.760 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2023-11-26T07:13:50.760 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2023-11-26T07:13:50.760 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:13:50.760 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:13:50.760 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:13:50.760 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.admin", 2023-11-26T07:13:50.760 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBu72JlGFz7MBAA3accSSm2BS7VSUwOhEVnRQ==", 2023-11-26T07:13:50.760 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:13:50.760 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2023-11-26T07:13:50.760 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-26T07:13:50.761 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-26T07:13:50.761 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:13:50.761 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:13:50.761 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:13:50.761 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:13:50.761 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.x", 2023-11-26T07:13:50.761 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBv72Jlq5FrDxAAoovK02XkZdaKmOAgVyJKWw==", 2023-11-26T07:13:50.761 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:13:50.761 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2023-11-26T07:13:50.761 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2023-11-26T07:13:50.761 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:13:50.761 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:13:50.762 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:13:50.762 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:13:50.762 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.y", 2023-11-26T07:13:50.762 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBv72Jl5jZZCxAANtm1EyG6Goa1xfuH6Mcy2g==", 2023-11-26T07:13:50.762 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:13:50.762 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2023-11-26T07:13:50.762 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2023-11-26T07:13:50.762 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:13:50.762 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:13:50.762 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:13:50.762 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2023-11-26T07:13:50.763 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-26T07:13:50.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.746+0000 7ffa2dc59700 1 -- 172.21.15.2:0/2199546400 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ffa1406b1a0 msgr2=0x7ffa1406d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:50.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.746+0000 7ffa2dc59700 1 --2- 172.21.15.2:0/2199546400 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ffa1406b1a0 0x7ffa1406d660 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ffa180048d0 tx=0x7ffa18009040 comp rx=0 tx=0).stop 2023-11-26T07:13:50.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.746+0000 7ffa2dc59700 1 -- 172.21.15.2:0/2199546400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa28154120 msgr2=0x7ffa280b1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:50.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.746+0000 7ffa2dc59700 1 --2- 172.21.15.2:0/2199546400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa28154120 0x7ffa280b1260 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c0108d0 tx=0x7ffa1c010c90 comp rx=0 tx=0).stop 2023-11-26T07:13:50.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.746+0000 7ffa2dc59700 1 -- 172.21.15.2:0/2199546400 shutdown_connections 2023-11-26T07:13:50.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.746+0000 7ffa2dc59700 1 --2- 172.21.15.2:0/2199546400 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ffa1406b1a0 0x7ffa1406d660 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:50.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.746+0000 7ffa2dc59700 1 --2- 172.21.15.2:0/2199546400 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffa281f80a0 0x7ffa280cd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:50.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.746+0000 7ffa2dc59700 1 --2- 172.21.15.2:0/2199546400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa28154120 0x7ffa280b1260 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:50.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.746+0000 7ffa2dc59700 1 --2- 172.21.15.2:0/2199546400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa28154500 0x7ffa280b7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:50.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.746+0000 7ffa2dc59700 1 -- 172.21.15.2:0/2199546400 >> 172.21.15.2:0/2199546400 conn(0x7ffa280d3e40 msgr2=0x7ffa2815e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:50.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.746+0000 7ffa2dc59700 1 -- 172.21.15.2:0/2199546400 shutdown_connections 2023-11-26T07:13:50.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.746+0000 7ffa2dc59700 1 -- 172.21.15.2:0/2199546400 wait complete. 2023-11-26T07:13:50.765 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:13:50.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.887+0000 7f77486bf700 1 Processor -- start 2023-11-26T07:13:50.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.887+0000 7f77486bf700 1 -- start start 2023-11-26T07:13:50.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.888+0000 7f77486bf700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f774015bde0 0x7f774015c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:50.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.888+0000 7f77486bf700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f77400cf2b0 0x7f77400d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:50.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.888+0000 7f77486bf700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77400d0a90 con 0x7f77400ce5c0 2023-11-26T07:13:50.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.888+0000 7f77486bf700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f774006ee10 con 0x7f77400cf2b0 2023-11-26T07:13:50.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.888+0000 7f77486bf700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f774006f0f0 con 0x7f774015bde0 2023-11-26T07:13:50.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.888+0000 7f7745c5a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f77400cf2b0 0x7f77400d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:50.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.888+0000 7f7745c5a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f77400cf2b0 0x7f77400d01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41824/0 (socket says 172.21.15.2:41824) 2023-11-26T07:13:50.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.888+0000 7f7745c5a700 1 -- 172.21.15.2:0/2275279983 learned_addr learned my addr 172.21.15.2:0/2275279983 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:50.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.888+0000 7f774645b700 1 --2- 172.21.15.2:0/2275279983 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f774015bde0 0x7f774015c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:50.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.888+0000 7f7745c5a700 1 -- 172.21.15.2:0/2275279983 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f774015bde0 msgr2=0x7f774015c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:50.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.888+0000 7f7745c5a700 1 --2- 172.21.15.2:0/2275279983 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f774015bde0 0x7f774015c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:50.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.888+0000 7f7745c5a700 1 -- 172.21.15.2:0/2275279983 >> v1:172.21.15.192:6789/0 conn(0x7f77400ce5c0 legacy=0x7f77400cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:50.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.888+0000 7f7745c5a700 1 -- 172.21.15.2:0/2275279983 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f774006f3d0 con 0x7f77400cf2b0 2023-11-26T07:13:50.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.888+0000 7f774645b700 1 --2- 172.21.15.2:0/2275279983 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f774015bde0 0x7f774015c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:13:50.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.889+0000 7f7745c5a700 1 --2- 172.21.15.2:0/2275279983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77400cf2b0 0x7f77400d01b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f773c0098f0 tx=0x7f773c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33bcc0400af10ade server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:50.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.889+0000 7f7745459700 1 -- 172.21.15.2:0/2275279983 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773c004230 con 0x7f77400cf2b0 2023-11-26T07:13:50.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.889+0000 7f7745459700 1 -- 172.21.15.2:0/2275279983 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f773c004390 con 0x7f77400cf2b0 2023-11-26T07:13:50.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.889+0000 7f7745459700 1 -- 172.21.15.2:0/2275279983 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773c0036a0 con 0x7f77400cf2b0 2023-11-26T07:13:50.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.889+0000 7f77486bf700 1 -- 172.21.15.2:0/2275279983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77400cf2b0 msgr2=0x7f77400d01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:50.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.889+0000 7f77486bf700 1 --2- 172.21.15.2:0/2275279983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77400cf2b0 0x7f77400d01b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f773c0098f0 tx=0x7f773c009c00 comp rx=0 tx=0).stop 2023-11-26T07:13:50.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.889+0000 7f77486bf700 1 -- 172.21.15.2:0/2275279983 shutdown_connections 2023-11-26T07:13:50.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.889+0000 7f77486bf700 1 --2- 172.21.15.2:0/2275279983 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f774015bde0 0x7f774015c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:50.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.889+0000 7f77486bf700 1 --2- 172.21.15.2:0/2275279983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77400cf2b0 0x7f77400d01b0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:50.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.889+0000 7f77486bf700 1 -- 172.21.15.2:0/2275279983 >> 172.21.15.2:0/2275279983 conn(0x7f77400b3720 msgr2=0x7f77400b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:50.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.889+0000 7f77486bf700 1 -- 172.21.15.2:0/2275279983 shutdown_connections 2023-11-26T07:13:50.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.889+0000 7f77486bf700 1 -- 172.21.15.2:0/2275279983 wait complete. 2023-11-26T07:13:50.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.891+0000 7f77486bf700 1 Processor -- start 2023-11-26T07:13:50.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.891+0000 7f77486bf700 1 -- start start 2023-11-26T07:13:50.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.891+0000 7f77486bf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77400ce5c0 0x7f77400c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:50.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.891+0000 7f77486bf700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77400cf2b0 0x7f774015e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:50.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.891+0000 7f77486bf700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f774015bde0 0x7f7740157df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:50.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.891+0000 7f77486bf700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77401f6f60 con 0x7f77400ce5c0 2023-11-26T07:13:50.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.891+0000 7f77486bf700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77401f7240 con 0x7f774015bde0 2023-11-26T07:13:50.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.891+0000 7f77486bf700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77401f7520 con 0x7f77400cf2b0 2023-11-26T07:13:50.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.892+0000 7f774645b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77400ce5c0 0x7f77400c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:50.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.892+0000 7f774645b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77400ce5c0 0x7f77400c79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41828/0 (socket says 172.21.15.2:41828) 2023-11-26T07:13:50.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.892+0000 7f774645b700 1 -- 172.21.15.2:0/177320959 learned_addr learned my addr 172.21.15.2:0/177320959 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:50.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.892+0000 7f7746c5c700 1 --2- 172.21.15.2:0/177320959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f774015bde0 0x7f7740157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:50.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.892+0000 7f7745c5a700 1 --2- 172.21.15.2:0/177320959 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77400cf2b0 0x7f774015e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:50.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.892+0000 7f774645b700 1 -- 172.21.15.2:0/177320959 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77400cf2b0 msgr2=0x7f774015e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:50.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.892+0000 7f774645b700 1 --2- 172.21.15.2:0/177320959 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77400cf2b0 0x7f774015e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:50.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.892+0000 7f774645b700 1 -- 172.21.15.2:0/177320959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f774015bde0 msgr2=0x7f7740157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:50.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.892+0000 7f774645b700 1 --2- 172.21.15.2:0/177320959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f774015bde0 0x7f7740157df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:50.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.892+0000 7f774645b700 1 -- 172.21.15.2:0/177320959 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f773c009550 con 0x7f77400ce5c0 2023-11-26T07:13:50.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.892+0000 7f7745c5a700 1 --2- 172.21.15.2:0/177320959 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77400cf2b0 0x7f774015e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:13:50.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.892+0000 7f774645b700 1 --2- 172.21.15.2:0/177320959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77400ce5c0 0x7f77400c79f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f773000c7f0 tx=0x7f773000cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:50.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.892+0000 7f7736ffd700 1 -- 172.21.15.2:0/177320959 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7730011800 con 0x7f77400ce5c0 2023-11-26T07:13:50.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.892+0000 7f7736ffd700 1 -- 172.21.15.2:0/177320959 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7730011960 con 0x7f77400ce5c0 2023-11-26T07:13:50.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.892+0000 7f77486bf700 1 -- 172.21.15.2:0/177320959 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77401f7800 con 0x7f77400ce5c0 2023-11-26T07:13:50.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.892+0000 7f7736ffd700 1 -- 172.21.15.2:0/177320959 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7730011cf0 con 0x7f77400ce5c0 2023-11-26T07:13:50.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.892+0000 7f77486bf700 1 -- 172.21.15.2:0/177320959 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77401f7d20 con 0x7f77400ce5c0 2023-11-26T07:13:50.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.893+0000 7f77486bf700 1 -- 172.21.15.2:0/177320959 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77401f7990 con 0x7f77400ce5c0 2023-11-26T07:13:50.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.894+0000 7f7736ffd700 1 -- 172.21.15.2:0/177320959 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f7730018360 con 0x7f77400ce5c0 2023-11-26T07:13:50.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.894+0000 7f7736ffd700 1 --2- 172.21.15.2:0/177320959 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f772406b1a0 0x7f772406d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:50.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.894+0000 7f7736ffd700 1 -- 172.21.15.2:0/177320959 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7730089770 con 0x7f77400ce5c0 2023-11-26T07:13:50.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.895+0000 7f7745c5a700 1 --2- 172.21.15.2:0/177320959 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f772406b1a0 0x7f772406d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:50.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.895+0000 7f7745c5a700 1 --2- 172.21.15.2:0/177320959 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f772406b1a0 0x7f772406d660 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f77400cf710 tx=0x7f773c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:50.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:50.900+0000 7f7736ffd700 1 -- 172.21.15.2:0/177320959 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7730054720 con 0x7f77400ce5c0 2023-11-26T07:13:51.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.101+0000 7f77486bf700 1 -- 172.21.15.2:0/177320959 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f77401f70a0 con 0x7f77400ce5c0 2023-11-26T07:13:51.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.102+0000 7f7736ffd700 1 -- 172.21.15.2:0/177320959 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+12809 (secure 0 0 0) 0x7f77401f70a0 con 0x7f77400ce5c0 2023-11-26T07:13:51.105 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:13:51.105 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":41,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:13:50.313241+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:13:51.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.104+0000 7f77486bf700 1 -- 172.21.15.2:0/177320959 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f772406b1a0 msgr2=0x7f772406d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:51.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.104+0000 7f77486bf700 1 --2- 172.21.15.2:0/177320959 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f772406b1a0 0x7f772406d660 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f77400cf710 tx=0x7f773c008030 comp rx=0 tx=0).stop 2023-11-26T07:13:51.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.104+0000 7f77486bf700 1 -- 172.21.15.2:0/177320959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77400ce5c0 msgr2=0x7f77400c79f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:51.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.104+0000 7f77486bf700 1 --2- 172.21.15.2:0/177320959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77400ce5c0 0x7f77400c79f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f773000c7f0 tx=0x7f773000cb00 comp rx=0 tx=0).stop 2023-11-26T07:13:51.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.104+0000 7f77486bf700 1 -- 172.21.15.2:0/177320959 shutdown_connections 2023-11-26T07:13:51.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.104+0000 7f77486bf700 1 --2- 172.21.15.2:0/177320959 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f772406b1a0 0x7f772406d660 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:51.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.104+0000 7f77486bf700 1 --2- 172.21.15.2:0/177320959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f774015bde0 0x7f7740157df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:51.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.104+0000 7f77486bf700 1 --2- 172.21.15.2:0/177320959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77400ce5c0 0x7f77400c79f0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:51.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.104+0000 7f77486bf700 1 --2- 172.21.15.2:0/177320959 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77400cf2b0 0x7f774015e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:51.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.104+0000 7f77486bf700 1 -- 172.21.15.2:0/177320959 >> 172.21.15.2:0/177320959 conn(0x7f77400b3720 msgr2=0x7f77400b3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:51.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.104+0000 7f77486bf700 1 -- 172.21.15.2:0/177320959 shutdown_connections 2023-11-26T07:13:51.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.104+0000 7f77486bf700 1 -- 172.21.15.2:0/177320959 wait complete. 2023-11-26T07:13:51.120 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:11:28.205739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:13:51.120 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:13:51.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.246+0000 7f019d4c2700 1 Processor -- start 2023-11-26T07:13:51.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.246+0000 7f019d4c2700 1 -- start start 2023-11-26T07:13:51.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.246+0000 7f019d4c2700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f01980d2b50 0x7f01980cfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:51.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.246+0000 7f019d4c2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01980d0740 0x7f01980d0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:51.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.246+0000 7f019d4c2700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01980ce9a0 con 0x7f019815e080 2023-11-26T07:13:51.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.246+0000 7f019d4c2700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01980d14b0 con 0x7f01980d2b50 2023-11-26T07:13:51.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.246+0000 7f019d4c2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01980cec40 con 0x7f01980d0740 2023-11-26T07:13:51.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.246+0000 7f0196ffd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f019815e080 0x7f01980d2440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33046/0 (socket says 172.21.15.2:33046) 2023-11-26T07:13:51.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.246+0000 7f0196ffd700 1 -- 172.21.15.2:0/1137987855 learned_addr learned my addr 172.21.15.2:0/1137987855 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:13:51.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.246+0000 7f01967fc700 1 --2- 172.21.15.2:0/1137987855 >> v2:172.21.15.192:3300/0 conn(0x7f01980d2b50 0x7f01980cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:51.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.246+0000 7f01977fe700 1 --2- 172.21.15.2:0/1137987855 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01980d0740 0x7f01980d0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:51.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.246+0000 7f0195ffb700 1 -- 172.21.15.2:0/1137987855 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3362508637 0 0) 0x7f01980ce9a0 con 0x7f019815e080 2023-11-26T07:13:51.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.246+0000 7f0195ffb700 1 -- 172.21.15.2:0/1137987855 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01800035b0 con 0x7f019815e080 2023-11-26T07:13:51.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.246+0000 7f0195ffb700 1 -- 172.21.15.2:0/1137987855 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1234459699 0 0) 0x7f01800035b0 con 0x7f019815e080 2023-11-26T07:13:51.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.246+0000 7f0195ffb700 1 -- 172.21.15.2:0/1137987855 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01980d0740 msgr2=0x7f01980d0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:51.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.246+0000 7f0195ffb700 1 --2- 172.21.15.2:0/1137987855 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01980d0740 0x7f01980d0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:51.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.246+0000 7f0195ffb700 1 -- 172.21.15.2:0/1137987855 >> v2:172.21.15.192:3300/0 conn(0x7f01980d2b50 msgr2=0x7f01980cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:51.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.246+0000 7f0195ffb700 1 --2- 172.21.15.2:0/1137987855 >> v2:172.21.15.192:3300/0 conn(0x7f01980d2b50 0x7f01980cfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:51.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.246+0000 7f0195ffb700 1 -- 172.21.15.2:0/1137987855 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01980cef20 con 0x7f019815e080 2023-11-26T07:13:51.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.246+0000 7f0195ffb700 1 -- 172.21.15.2:0/1137987855 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f0188001670 con 0x7f019815e080 2023-11-26T07:13:51.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.246+0000 7f0195ffb700 1 -- 172.21.15.2:0/1137987855 >> v1:172.21.15.2:6789/0 conn(0x7f019815e080 legacy=0x7f01980d2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:51.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.246+0000 7f0195ffb700 1 --2- 172.21.15.2:0/1137987855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0180003a00 0x7f0180003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:51.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.246+0000 7f0195ffb700 1 --2- 172.21.15.2:0/1137987855 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01980d0740 0x7f0180004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:51.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.246+0000 7f0195ffb700 1 --2- 172.21.15.2:0/1137987855 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0180004d90 0x7f0180005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:51.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.246+0000 7f0195ffb700 1 -- 172.21.15.2:0/1137987855 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01980d14b0 con 0x7f0180003a00 2023-11-26T07:13:51.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.246+0000 7f0195ffb700 1 -- 172.21.15.2:0/1137987855 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01980cec40 con 0x7f0180004d90 2023-11-26T07:13:51.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.246+0000 7f0195ffb700 1 -- 172.21.15.2:0/1137987855 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f018000ba10 con 0x7f01980d0740 2023-11-26T07:13:51.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.246+0000 7f0196ffd700 1 --2- 172.21.15.2:0/1137987855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0180003a00 0x7f0180003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:51.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.247+0000 7f01977fe700 1 --2- 172.21.15.2:0/1137987855 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0180004d90 0x7f0180005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:51.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.247+0000 7f01967fc700 1 --2- 172.21.15.2:0/1137987855 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01980d0740 0x7f0180004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:51.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.247+0000 7f0196ffd700 1 -- 172.21.15.2:0/1137987855 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01980d0740 msgr2=0x7f0180004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:51.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.247+0000 7f0196ffd700 1 --2- 172.21.15.2:0/1137987855 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01980d0740 0x7f0180004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:51.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.247+0000 7f0196ffd700 1 -- 172.21.15.2:0/1137987855 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0180004d90 msgr2=0x7f0180005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:51.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.247+0000 7f0196ffd700 1 --2- 172.21.15.2:0/1137987855 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0180004d90 0x7f0180005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:51.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.247+0000 7f0196ffd700 1 -- 172.21.15.2:0/1137987855 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01800035b0 con 0x7f0180003a00 2023-11-26T07:13:51.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.247+0000 7f0196ffd700 1 --2- 172.21.15.2:0/1137987855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0180003a00 0x7f0180003e20 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f018800c370 tx=0x7f0180005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=637fb3151b8f3160 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:51.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.247+0000 7f0195ffb700 1 -- 172.21.15.2:0/1137987855 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0188007c60 con 0x7f0180003a00 2023-11-26T07:13:51.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.247+0000 7f0195ffb700 1 -- 172.21.15.2:0/1137987855 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0188005960 con 0x7f0180003a00 2023-11-26T07:13:51.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.247+0000 7f0195ffb700 1 -- 172.21.15.2:0/1137987855 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0188005d10 con 0x7f0180003a00 2023-11-26T07:13:51.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.248+0000 7f019d4c2700 1 -- 172.21.15.2:0/1137987855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0180003a00 msgr2=0x7f0180003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:51.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.248+0000 7f019d4c2700 1 --2- 172.21.15.2:0/1137987855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0180003a00 0x7f0180003e20 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f018800c370 tx=0x7f0180005880 comp rx=0 tx=0).stop 2023-11-26T07:13:51.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.248+0000 7f01977fe700 1 -- 172.21.15.2:0/1137987855 reap_dead start 2023-11-26T07:13:51.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.248+0000 7f019d4c2700 1 -- 172.21.15.2:0/1137987855 shutdown_connections 2023-11-26T07:13:51.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.248+0000 7f019d4c2700 1 -- 172.21.15.2:0/1137987855 >> 172.21.15.2:0/1137987855 conn(0x7f019809d180 msgr2=0x7f01980d3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:51.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.248+0000 7f019d4c2700 1 -- 172.21.15.2:0/1137987855 shutdown_connections 2023-11-26T07:13:51.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.248+0000 7f019d4c2700 1 -- 172.21.15.2:0/1137987855 wait complete. 2023-11-26T07:13:51.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.249+0000 7f019d4c2700 1 Processor -- start 2023-11-26T07:13:51.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.249+0000 7f019d4c2700 1 -- start start 2023-11-26T07:13:51.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.250+0000 7f019d4c2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0180003a00 0x7f01980b8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:51.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.250+0000 7f019d4c2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01980caf60 0x7f01980cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:51.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.250+0000 7f019d4c2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01981460f0 0x7f0198146570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:51.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.250+0000 7f019d4c2700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01980cb920 con 0x7f01981460f0 2023-11-26T07:13:51.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.250+0000 7f019d4c2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01980b8b10 con 0x7f0180003a00 2023-11-26T07:13:51.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.250+0000 7f019d4c2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0198149b90 con 0x7f01980caf60 2023-11-26T07:13:51.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.250+0000 7f01977fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01981460f0 0x7f0198146570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:51.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.250+0000 7f01977fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01981460f0 0x7f0198146570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41852/0 (socket says 172.21.15.2:41852) 2023-11-26T07:13:51.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.250+0000 7f01977fe700 1 -- 172.21.15.2:0/1720417987 learned_addr learned my addr 172.21.15.2:0/1720417987 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:51.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.250+0000 7f01967fc700 1 --2- 172.21.15.2:0/1720417987 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01980caf60 0x7f01980cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:51.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.250+0000 7f0196ffd700 1 --2- 172.21.15.2:0/1720417987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0180003a00 0x7f01980b8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:51.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.250+0000 7f01977fe700 1 -- 172.21.15.2:0/1720417987 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01980caf60 msgr2=0x7f01980cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:51.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.250+0000 7f01977fe700 1 --2- 172.21.15.2:0/1720417987 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01980caf60 0x7f01980cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:51.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.250+0000 7f01977fe700 1 -- 172.21.15.2:0/1720417987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0180003a00 msgr2=0x7f01980b8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:51.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.250+0000 7f01977fe700 1 --2- 172.21.15.2:0/1720417987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0180003a00 0x7f01980b8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:51.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.250+0000 7f01977fe700 1 -- 172.21.15.2:0/1720417987 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01980b7f00 con 0x7f01981460f0 2023-11-26T07:13:51.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.250+0000 7f01967fc700 1 --2- 172.21.15.2:0/1720417987 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01980caf60 0x7f01980cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:13:51.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.250+0000 7f0196ffd700 1 --2- 172.21.15.2:0/1720417987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0180003a00 0x7f01980b8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:13:51.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.250+0000 7f01977fe700 1 --2- 172.21.15.2:0/1720417987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01981460f0 0x7f0198146570 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f01980a1f10 tx=0x7f0190011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:51.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.251+0000 7f017f7fe700 1 -- 172.21.15.2:0/1720417987 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019000e040 con 0x7f01981460f0 2023-11-26T07:13:51.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.251+0000 7f017f7fe700 1 -- 172.21.15.2:0/1720417987 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019000f040 con 0x7f01981460f0 2023-11-26T07:13:51.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.251+0000 7f017f7fe700 1 -- 172.21.15.2:0/1720417987 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019000fdb0 con 0x7f01981460f0 2023-11-26T07:13:51.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.251+0000 7f019d4c2700 1 -- 172.21.15.2:0/1720417987 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01980b81e0 con 0x7f01981460f0 2023-11-26T07:13:51.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.251+0000 7f019d4c2700 1 -- 172.21.15.2:0/1720417987 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01980b87a0 con 0x7f01981460f0 2023-11-26T07:13:51.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.252+0000 7f019d4c2700 1 -- 172.21.15.2:0/1720417987 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0198075480 con 0x7f01981460f0 2023-11-26T07:13:51.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.252+0000 7f017f7fe700 1 -- 172.21.15.2:0/1720417987 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f0190022460 con 0x7f01981460f0 2023-11-26T07:13:51.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.253+0000 7f017f7fe700 1 --2- 172.21.15.2:0/1720417987 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f018406b1a0 0x7f018406d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:51.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.253+0000 7f017f7fe700 1 -- 172.21.15.2:0/1720417987 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0190089e20 con 0x7f01981460f0 2023-11-26T07:13:51.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.253+0000 7f0196ffd700 1 --2- 172.21.15.2:0/1720417987 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f018406b1a0 0x7f018406d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:51.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.253+0000 7f0196ffd700 1 --2- 172.21.15.2:0/1720417987 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f018406b1a0 0x7f018406d660 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0188015040 tx=0x7f018800a000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:51.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.258+0000 7f017f7fe700 1 -- 172.21.15.2:0/1720417987 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0190054d30 con 0x7f01981460f0 2023-11-26T07:13:51.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.459+0000 7f019d4c2700 1 -- 172.21.15.2:0/1720417987 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f01980b8c50 con 0x7f01981460f0 2023-11-26T07:13:51.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.460+0000 7f017f7fe700 1 -- 172.21.15.2:0/1720417987 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0190058350 con 0x7f01981460f0 2023-11-26T07:13:51.462 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-26T07:13:51.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.462+0000 7f019d4c2700 1 -- 172.21.15.2:0/1720417987 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f018406b1a0 msgr2=0x7f018406d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:51.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.462+0000 7f019d4c2700 1 --2- 172.21.15.2:0/1720417987 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f018406b1a0 0x7f018406d660 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0188015040 tx=0x7f018800a000 comp rx=0 tx=0).stop 2023-11-26T07:13:51.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.462+0000 7f019d4c2700 1 -- 172.21.15.2:0/1720417987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01981460f0 msgr2=0x7f0198146570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:51.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.462+0000 7f019d4c2700 1 --2- 172.21.15.2:0/1720417987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01981460f0 0x7f0198146570 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f01980a1f10 tx=0x7f0190011f80 comp rx=0 tx=0).stop 2023-11-26T07:13:51.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.462+0000 7f019d4c2700 1 -- 172.21.15.2:0/1720417987 shutdown_connections 2023-11-26T07:13:51.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.462+0000 7f019d4c2700 1 --2- 172.21.15.2:0/1720417987 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f018406b1a0 0x7f018406d660 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:51.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.462+0000 7f019d4c2700 1 --2- 172.21.15.2:0/1720417987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01981460f0 0x7f0198146570 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:51.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.462+0000 7f019d4c2700 1 --2- 172.21.15.2:0/1720417987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0180003a00 0x7f01980b8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:51.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.462+0000 7f019d4c2700 1 --2- 172.21.15.2:0/1720417987 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01980caf60 0x7f01980cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:51.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.462+0000 7f019d4c2700 1 -- 172.21.15.2:0/1720417987 >> 172.21.15.2:0/1720417987 conn(0x7f019809d180 msgr2=0x7f01980cfa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:51.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.462+0000 7f019d4c2700 1 -- 172.21.15.2:0/1720417987 shutdown_connections 2023-11-26T07:13:51.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.462+0000 7f019d4c2700 1 -- 172.21.15.2:0/1720417987 wait complete. 2023-11-26T07:13:51.476 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-26T07:13:51.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.599+0000 7fc23cd97700 1 Processor -- start 2023-11-26T07:13:51.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.599+0000 7fc23cd97700 1 -- start start 2023-11-26T07:13:51.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.600+0000 7fc23cd97700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc23806b6e0 0x7fc23806db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:51.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.600+0000 7fc23cd97700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc238145100 0x7fc23806e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:51.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.600+0000 7fc23cd97700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc238160720 con 0x7fc238144c10 2023-11-26T07:13:51.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.600+0000 7fc23cd97700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc23806f500 con 0x7fc238145100 2023-11-26T07:13:51.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.600+0000 7fc23cd97700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2380cd610 con 0x7fc23806b6e0 2023-11-26T07:13:51.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.600+0000 7fc236d9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc238145100 0x7fc23806e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:51.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.600+0000 7fc236d9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc238145100 0x7fc23806e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41864/0 (socket says 172.21.15.2:41864) 2023-11-26T07:13:51.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.600+0000 7fc236d9d700 1 -- 172.21.15.2:0/3688578297 learned_addr learned my addr 172.21.15.2:0/3688578297 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:51.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.600+0000 7fc235d9b700 1 --2- 172.21.15.2:0/3688578297 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc23806b6e0 0x7fc23806db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:51.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.600+0000 7fc236d9d700 1 -- 172.21.15.2:0/3688578297 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc23806b6e0 msgr2=0x7fc23806db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:51.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.600+0000 7fc236d9d700 1 --2- 172.21.15.2:0/3688578297 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc23806b6e0 0x7fc23806db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:51.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.600+0000 7fc236d9d700 1 -- 172.21.15.2:0/3688578297 >> v1:172.21.15.192:6789/0 conn(0x7fc238144c10 legacy=0x7fc23806afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:51.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.600+0000 7fc236d9d700 1 -- 172.21.15.2:0/3688578297 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc23806f710 con 0x7fc238145100 2023-11-26T07:13:51.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.601+0000 7fc236d9d700 1 --2- 172.21.15.2:0/3688578297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc238145100 0x7fc23806e0b0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fc230009e50 tx=0x7fc23000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d34c6c712f9fc31 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:51.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.601+0000 7fc23559a700 1 -- 172.21.15.2:0/3688578297 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23000e070 con 0x7fc238145100 2023-11-26T07:13:51.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.601+0000 7fc23559a700 1 -- 172.21.15.2:0/3688578297 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc230003a20 con 0x7fc238145100 2023-11-26T07:13:51.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.601+0000 7fc23559a700 1 -- 172.21.15.2:0/3688578297 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc230003dd0 con 0x7fc238145100 2023-11-26T07:13:51.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.601+0000 7fc23cd97700 1 -- 172.21.15.2:0/3688578297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc238145100 msgr2=0x7fc23806e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:51.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.601+0000 7fc23cd97700 1 --2- 172.21.15.2:0/3688578297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc238145100 0x7fc23806e0b0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fc230009e50 tx=0x7fc23000b330 comp rx=0 tx=0).stop 2023-11-26T07:13:51.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.602+0000 7fc23cd97700 1 -- 172.21.15.2:0/3688578297 shutdown_connections 2023-11-26T07:13:51.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.602+0000 7fc23cd97700 1 --2- 172.21.15.2:0/3688578297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc238145100 0x7fc23806e0b0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:51.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.602+0000 7fc23cd97700 1 --2- 172.21.15.2:0/3688578297 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc23806b6e0 0x7fc23806db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:51.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.602+0000 7fc23cd97700 1 -- 172.21.15.2:0/3688578297 >> 172.21.15.2:0/3688578297 conn(0x7fc2380b2740 msgr2=0x7fc2380b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:51.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.602+0000 7fc23cd97700 1 -- 172.21.15.2:0/3688578297 shutdown_connections 2023-11-26T07:13:51.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.602+0000 7fc23cd97700 1 -- 172.21.15.2:0/3688578297 wait complete. 2023-11-26T07:13:51.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.603+0000 7fc23cd97700 1 Processor -- start 2023-11-26T07:13:51.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.603+0000 7fc23cd97700 1 -- start start 2023-11-26T07:13:51.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.604+0000 7fc23cd97700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc23806b6e0 0x7fc23815ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:51.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.604+0000 7fc23cd97700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc238144c10 0x7fc23813ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:51.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.604+0000 7fc23cd97700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc238145100 0x7fc23815e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:51.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.604+0000 7fc23cd97700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc238141a70 con 0x7fc238145100 2023-11-26T07:13:51.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.604+0000 7fc23cd97700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc238141d50 con 0x7fc238144c10 2023-11-26T07:13:51.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.604+0000 7fc23cd97700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc238142030 con 0x7fc23806b6e0 2023-11-26T07:13:51.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.604+0000 7fc236d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc238145100 0x7fc23815e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:51.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.604+0000 7fc236d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc238145100 0x7fc23815e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41870/0 (socket says 172.21.15.2:41870) 2023-11-26T07:13:51.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.604+0000 7fc236d9d700 1 -- 172.21.15.2:0/2651355087 learned_addr learned my addr 172.21.15.2:0/2651355087 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:51.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.604+0000 7fc23659c700 1 --2- 172.21.15.2:0/2651355087 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc23806b6e0 0x7fc23815ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:51.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.604+0000 7fc235d9b700 1 --2- 172.21.15.2:0/2651355087 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc238144c10 0x7fc23813ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:51.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.604+0000 7fc236d9d700 1 -- 172.21.15.2:0/2651355087 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc23806b6e0 msgr2=0x7fc23815ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:51.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.604+0000 7fc236d9d700 1 --2- 172.21.15.2:0/2651355087 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc23806b6e0 0x7fc23815ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:51.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.604+0000 7fc236d9d700 1 -- 172.21.15.2:0/2651355087 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc238144c10 msgr2=0x7fc23813ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:51.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.604+0000 7fc236d9d700 1 --2- 172.21.15.2:0/2651355087 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc238144c10 0x7fc23813ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:51.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.604+0000 7fc236d9d700 1 -- 172.21.15.2:0/2651355087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc230009b30 con 0x7fc238145100 2023-11-26T07:13:51.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.604+0000 7fc23659c700 1 --2- 172.21.15.2:0/2651355087 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc23806b6e0 0x7fc23815ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:13:51.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.604+0000 7fc235d9b700 1 --2- 172.21.15.2:0/2651355087 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc238144c10 0x7fc23813ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:13:51.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.604+0000 7fc236d9d700 1 --2- 172.21.15.2:0/2651355087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc238145100 0x7fc23815e610 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc230004000 tx=0x7fc230004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:51.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.604+0000 7fc226ffd700 1 -- 172.21.15.2:0/2651355087 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc230004440 con 0x7fc238145100 2023-11-26T07:13:51.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.604+0000 7fc226ffd700 1 -- 172.21.15.2:0/2651355087 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2300045c0 con 0x7fc238145100 2023-11-26T07:13:51.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.604+0000 7fc23cd97700 1 -- 172.21.15.2:0/2651355087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc238142310 con 0x7fc238145100 2023-11-26T07:13:51.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.604+0000 7fc226ffd700 1 -- 172.21.15.2:0/2651355087 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc230004970 con 0x7fc238145100 2023-11-26T07:13:51.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.605+0000 7fc23cd97700 1 -- 172.21.15.2:0/2651355087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2381416b0 con 0x7fc238145100 2023-11-26T07:13:51.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.606+0000 7fc23cd97700 1 -- 172.21.15.2:0/2651355087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc238141840 con 0x7fc238145100 2023-11-26T07:13:51.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.606+0000 7fc226ffd700 1 -- 172.21.15.2:0/2651355087 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7fc230012430 con 0x7fc238145100 2023-11-26T07:13:51.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.606+0000 7fc226ffd700 1 --2- 172.21.15.2:0/2651355087 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc21806b1a0 0x7fc21806d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:51.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.606+0000 7fc226ffd700 1 -- 172.21.15.2:0/2651355087 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc23008abb0 con 0x7fc238145100 2023-11-26T07:13:51.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.607+0000 7fc23659c700 1 --2- 172.21.15.2:0/2651355087 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc21806b1a0 0x7fc21806d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:51.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.607+0000 7fc23659c700 1 --2- 172.21.15.2:0/2651355087 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc21806b1a0 0x7fc21806d660 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc22c003fc0 tx=0x7fc22c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:51.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.611+0000 7fc226ffd700 1 -- 172.21.15.2:0/2651355087 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc230059670 con 0x7fc238145100 2023-11-26T07:13:51.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.812+0000 7fc23cd97700 1 -- 172.21.15.2:0/2651355087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc2381427d0 con 0x7fc238145100 2023-11-26T07:13:51.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.813+0000 7fc226ffd700 1 -- 172.21.15.2:0/2651355087 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v41) v1 ==== 84+0+65 (secure 0 0 0) 0x7fc230017090 con 0x7fc238145100 2023-11-26T07:13:51.815 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:13:51.815 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2023-11-26T07:13:51.815 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:13:51.815 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 1, 2023-11-26T07:13:51.815 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": ".mgr" 2023-11-26T07:13:51.815 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:13:51.816 INFO:teuthology.orchestra.run.smithi002.stdout:] 2023-11-26T07:13:51.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.815+0000 7fc23cd97700 1 -- 172.21.15.2:0/2651355087 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc21806b1a0 msgr2=0x7fc21806d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:51.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.815+0000 7fc23cd97700 1 --2- 172.21.15.2:0/2651355087 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc21806b1a0 0x7fc21806d660 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc22c003fc0 tx=0x7fc22c009040 comp rx=0 tx=0).stop 2023-11-26T07:13:51.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.815+0000 7fc23cd97700 1 -- 172.21.15.2:0/2651355087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc238145100 msgr2=0x7fc23815e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:51.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.815+0000 7fc23cd97700 1 --2- 172.21.15.2:0/2651355087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc238145100 0x7fc23815e610 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc230004000 tx=0x7fc230004ad0 comp rx=0 tx=0).stop 2023-11-26T07:13:51.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.815+0000 7fc23cd97700 1 -- 172.21.15.2:0/2651355087 shutdown_connections 2023-11-26T07:13:51.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.815+0000 7fc23cd97700 1 --2- 172.21.15.2:0/2651355087 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc21806b1a0 0x7fc21806d660 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:51.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.815+0000 7fc23cd97700 1 --2- 172.21.15.2:0/2651355087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc238145100 0x7fc23815e610 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:51.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.815+0000 7fc23cd97700 1 --2- 172.21.15.2:0/2651355087 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc23806b6e0 0x7fc23815ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:51.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.815+0000 7fc23cd97700 1 --2- 172.21.15.2:0/2651355087 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc238144c10 0x7fc23813ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:51.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.815+0000 7fc23cd97700 1 -- 172.21.15.2:0/2651355087 >> 172.21.15.2:0/2651355087 conn(0x7fc2380b2740 msgr2=0x7fc238072300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:51.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.815+0000 7fc23cd97700 1 -- 172.21.15.2:0/2651355087 shutdown_connections 2023-11-26T07:13:51.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.815+0000 7fc23cd97700 1 -- 172.21.15.2:0/2651355087 wait complete. 2023-11-26T07:13:51.829 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-26T07:13:51.829 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-26T07:13:51.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.956+0000 7feef1a2e700 1 Processor -- start 2023-11-26T07:13:51.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.956+0000 7feef1a2e700 1 -- start start 2023-11-26T07:13:51.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.957+0000 7feef1a2e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7feeec0d0f10 0x7feeec0ceab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:51.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.957+0000 7feef1a2e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7feeec0b2070 0x7feeec0ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:51.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.957+0000 7feef1a2e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeec0d49b0 con 0x7feeec15e3c0 2023-11-26T07:13:51.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.957+0000 7feef1a2e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeec15e7a0 con 0x7feeec0d0f10 2023-11-26T07:13:51.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.957+0000 7feef1a2e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeec0d1c70 con 0x7feeec0b2070 2023-11-26T07:13:51.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.957+0000 7feeea7fc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7feeec0d0f10 0x7feeec0ceab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:51.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.957+0000 7feeeaffd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7feeec15e3c0 0x7feeec0d0800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33084/0 (socket says 172.21.15.2:33084) 2023-11-26T07:13:51.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.957+0000 7feeeaffd700 1 -- 172.21.15.2:0/3398692018 learned_addr learned my addr 172.21.15.2:0/3398692018 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:13:51.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.957+0000 7feeeb7fe700 1 --2- 172.21.15.2:0/3398692018 >> v2:172.21.15.192:3300/0 conn(0x7feeec0b2070 0x7feeec0ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:51.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.957+0000 7feeea7fc700 1 -- 172.21.15.2:0/3398692018 >> v2:172.21.15.192:3300/0 conn(0x7feeec0b2070 msgr2=0x7feeec0ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:51.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.957+0000 7feeea7fc700 1 --2- 172.21.15.2:0/3398692018 >> v2:172.21.15.192:3300/0 conn(0x7feeec0b2070 0x7feeec0ceff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:51.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.957+0000 7feeea7fc700 1 -- 172.21.15.2:0/3398692018 >> v1:172.21.15.2:6789/0 conn(0x7feeec15e3c0 legacy=0x7feeec0d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:51.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.957+0000 7feeea7fc700 1 -- 172.21.15.2:0/3398692018 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeec0d4c50 con 0x7feeec0d0f10 2023-11-26T07:13:51.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.957+0000 7feeea7fc700 1 --2- 172.21.15.2:0/3398692018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feeec0d0f10 0x7feeec0ceab0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7feeec08d770 tx=0x7feedc009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebfd03deb023cb4 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:51.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.957+0000 7feee9ffb700 1 -- 172.21.15.2:0/3398692018 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feedc011830 con 0x7feeec0d0f10 2023-11-26T07:13:51.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.958+0000 7feee9ffb700 1 -- 172.21.15.2:0/3398692018 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feedc011990 con 0x7feeec0d0f10 2023-11-26T07:13:51.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.958+0000 7feee9ffb700 1 -- 172.21.15.2:0/3398692018 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feedc011d20 con 0x7feeec0d0f10 2023-11-26T07:13:51.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.958+0000 7feef1a2e700 1 -- 172.21.15.2:0/3398692018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feeec0d0f10 msgr2=0x7feeec0ceab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:51.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.958+0000 7feef1a2e700 1 --2- 172.21.15.2:0/3398692018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feeec0d0f10 0x7feeec0ceab0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7feeec08d770 tx=0x7feedc009b20 comp rx=0 tx=0).stop 2023-11-26T07:13:51.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.958+0000 7feef1a2e700 1 -- 172.21.15.2:0/3398692018 shutdown_connections 2023-11-26T07:13:51.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.958+0000 7feef1a2e700 1 --2- 172.21.15.2:0/3398692018 >> v2:172.21.15.192:3300/0 conn(0x7feeec0b2070 0x7feeec0ceff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:51.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.958+0000 7feef1a2e700 1 --2- 172.21.15.2:0/3398692018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feeec0d0f10 0x7feeec0ceab0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:51.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.958+0000 7feef1a2e700 1 -- 172.21.15.2:0/3398692018 >> 172.21.15.2:0/3398692018 conn(0x7feeec0d3df0 msgr2=0x7feeec0d4200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:51.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.958+0000 7feef1a2e700 1 -- 172.21.15.2:0/3398692018 shutdown_connections 2023-11-26T07:13:51.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.958+0000 7feef1a2e700 1 -- 172.21.15.2:0/3398692018 wait complete. 2023-11-26T07:13:51.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.959+0000 7feef1a2e700 1 Processor -- start 2023-11-26T07:13:51.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.960+0000 7feef1a2e700 1 -- start start 2023-11-26T07:13:51.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.960+0000 7feef1a2e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feeec0b2070 0x7feeec0b6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:51.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.960+0000 7feef1a2e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feeec0d0f10 0x7feeec14a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:51.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.960+0000 7feef1a2e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feeec15e3c0 0x7feeec15f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:51.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.960+0000 7feef1a2e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeec15f230 con 0x7feeec15e3c0 2023-11-26T07:13:51.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.960+0000 7feef1a2e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeec0b8080 con 0x7feeec0d0f10 2023-11-26T07:13:51.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.960+0000 7feef1a2e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeec0b70a0 con 0x7feeec0b2070 2023-11-26T07:13:51.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.960+0000 7feeeb7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feeec15e3c0 0x7feeec15f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:51.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.960+0000 7feeeb7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feeec15e3c0 0x7feeec15f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41884/0 (socket says 172.21.15.2:41884) 2023-11-26T07:13:51.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.960+0000 7feeeb7fe700 1 -- 172.21.15.2:0/2176131977 learned_addr learned my addr 172.21.15.2:0/2176131977 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:51.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.961+0000 7feeea7fc700 1 --2- 172.21.15.2:0/2176131977 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feeec0d0f10 0x7feeec14a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:51.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.961+0000 7feeeaffd700 1 --2- 172.21.15.2:0/2176131977 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feeec0b2070 0x7feeec0b6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:51.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.961+0000 7feeeb7fe700 1 -- 172.21.15.2:0/2176131977 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feeec0b2070 msgr2=0x7feeec0b6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:51.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.961+0000 7feeeb7fe700 1 --2- 172.21.15.2:0/2176131977 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feeec0b2070 0x7feeec0b6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:51.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.961+0000 7feeeb7fe700 1 -- 172.21.15.2:0/2176131977 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feeec0d0f10 msgr2=0x7feeec14a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:51.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.961+0000 7feeeb7fe700 1 --2- 172.21.15.2:0/2176131977 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feeec0d0f10 0x7feeec14a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:51.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.961+0000 7feeeb7fe700 1 -- 172.21.15.2:0/2176131977 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feedc0094a0 con 0x7feeec15e3c0 2023-11-26T07:13:51.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.961+0000 7feeeb7fe700 1 --2- 172.21.15.2:0/2176131977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feeec15e3c0 0x7feeec15f4d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7feee4007e40 tx=0x7feee400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:51.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.961+0000 7feed3fff700 1 -- 172.21.15.2:0/2176131977 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee400eea0 con 0x7feeec15e3c0 2023-11-26T07:13:51.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.961+0000 7feed3fff700 1 -- 172.21.15.2:0/2176131977 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee4014420 con 0x7feeec15e3c0 2023-11-26T07:13:51.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.961+0000 7feef1a2e700 1 -- 172.21.15.2:0/2176131977 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeec0cc140 con 0x7feeec15e3c0 2023-11-26T07:13:51.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.961+0000 7feed3fff700 1 -- 172.21.15.2:0/2176131977 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee40147b0 con 0x7feeec15e3c0 2023-11-26T07:13:51.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.961+0000 7feef1a2e700 1 -- 172.21.15.2:0/2176131977 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeec15ec70 con 0x7feeec15e3c0 2023-11-26T07:13:51.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.962+0000 7feef1a2e700 1 -- 172.21.15.2:0/2176131977 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeec0cbf10 con 0x7feeec15e3c0 2023-11-26T07:13:51.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.962+0000 7feed3fff700 1 -- 172.21.15.2:0/2176131977 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7feee4014910 con 0x7feeec15e3c0 2023-11-26T07:13:51.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.963+0000 7feed3fff700 1 --2- 172.21.15.2:0/2176131977 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7feed806b1a0 0x7feed806d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:51.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.963+0000 7feed3fff700 1 -- 172.21.15.2:0/2176131977 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4857+0+0 (secure 0 0 0) 0x7feee4089e90 con 0x7feeec15e3c0 2023-11-26T07:13:51.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.963+0000 7feeeaffd700 1 --2- 172.21.15.2:0/2176131977 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7feed806b1a0 0x7feed806d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:51.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.964+0000 7feeeaffd700 1 --2- 172.21.15.2:0/2176131977 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7feed806b1a0 0x7feed806d660 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7feee0005910 tx=0x7feee0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:51.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:51.968+0000 7feed3fff700 1 -- 172.21.15.2:0/2176131977 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7feeec0cbf10 con 0x7feeec15e3c0 2023-11-26T07:13:52.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.166+0000 7feef1a2e700 1 -- 172.21.15.2:0/2176131977 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7feeec0cbf10 con 0x7feeec15e3c0 2023-11-26T07:13:52.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.307+0000 7feed3fff700 1 -- 172.21.15.2:0/2176131977 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v42) v1 ==== 138+0+0 (secure 0 0 0) 0x7feeec0cbf10 con 0x7feeec15e3c0 2023-11-26T07:13:52.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.310+0000 7feef1a2e700 1 -- 172.21.15.2:0/2176131977 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7feed806b1a0 msgr2=0x7feed806d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:52.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.310+0000 7feef1a2e700 1 --2- 172.21.15.2:0/2176131977 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7feed806b1a0 0x7feed806d660 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7feee0005910 tx=0x7feee0009040 comp rx=0 tx=0).stop 2023-11-26T07:13:52.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.310+0000 7feef1a2e700 1 -- 172.21.15.2:0/2176131977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feeec15e3c0 msgr2=0x7feeec15f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:52.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.310+0000 7feef1a2e700 1 --2- 172.21.15.2:0/2176131977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feeec15e3c0 0x7feeec15f4d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7feee4007e40 tx=0x7feee400e3c0 comp rx=0 tx=0).stop 2023-11-26T07:13:52.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.310+0000 7feef1a2e700 1 -- 172.21.15.2:0/2176131977 shutdown_connections 2023-11-26T07:13:52.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.310+0000 7feef1a2e700 1 --2- 172.21.15.2:0/2176131977 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7feed806b1a0 0x7feed806d660 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:52.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.310+0000 7feef1a2e700 1 --2- 172.21.15.2:0/2176131977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feeec15e3c0 0x7feeec15f4d0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:52.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.310+0000 7feef1a2e700 1 --2- 172.21.15.2:0/2176131977 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feeec0b2070 0x7feeec0b6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:52.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.310+0000 7feef1a2e700 1 --2- 172.21.15.2:0/2176131977 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feeec0d0f10 0x7feeec14a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:52.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.310+0000 7feef1a2e700 1 -- 172.21.15.2:0/2176131977 >> 172.21.15.2:0/2176131977 conn(0x7feeec0d3df0 msgr2=0x7feeec06ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:52.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.310+0000 7feef1a2e700 1 -- 172.21.15.2:0/2176131977 shutdown_connections 2023-11-26T07:13:52.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.310+0000 7feef1a2e700 1 -- 172.21.15.2:0/2176131977 wait complete. 2023-11-26T07:13:52.313 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' created 2023-11-26T07:13:52.328 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-26T07:13:52.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.459+0000 7f34a1c62700 1 Processor -- start 2023-11-26T07:13:52.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.459+0000 7f34a1c62700 1 -- start start 2023-11-26T07:13:52.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.459+0000 7f34a1c62700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f349c15e090 0x7f349c06afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:52.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.459+0000 7f34a1c62700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f349c1623d0 0x7f349c0cb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:52.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.459+0000 7f34a1c62700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f349c15e470 con 0x7f349c06b510 2023-11-26T07:13:52.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.459+0000 7f34a1c62700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f349c0c6900 con 0x7f349c1623d0 2023-11-26T07:13:52.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.459+0000 7f34a1c62700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f349c06b990 con 0x7f349c15e090 2023-11-26T07:13:52.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.460+0000 7f349bfff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f349c1623d0 0x7f349c0cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:52.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.460+0000 7f349b7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f349c15e090 0x7f349c06afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:52.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.460+0000 7f349affd700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f349c06b510 0x7f349c161cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.2:40468/0 (socket says 172.21.15.2:40468) 2023-11-26T07:13:52.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.460+0000 7f349affd700 1 -- 172.21.15.2:0/3625586689 learned_addr learned my addr 172.21.15.2:0/3625586689 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:13:52.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.460+0000 7f349b7fe700 1 -- 172.21.15.2:0/3625586689 >> v2:172.21.15.192:3300/0 conn(0x7f349c1623d0 msgr2=0x7f349c0cb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:52.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.460+0000 7f349b7fe700 1 --2- 172.21.15.2:0/3625586689 >> v2:172.21.15.192:3300/0 conn(0x7f349c1623d0 0x7f349c0cb160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:52.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.460+0000 7f349b7fe700 1 -- 172.21.15.2:0/3625586689 >> v1:172.21.15.192:6789/0 conn(0x7f349c06b510 legacy=0x7f349c161cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:52.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.460+0000 7f349b7fe700 1 -- 172.21.15.2:0/3625586689 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f349c1629f0 con 0x7f349c15e090 2023-11-26T07:13:52.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.460+0000 7f349bfff700 1 --2- 172.21.15.2:0/3625586689 >> v2:172.21.15.192:3300/0 conn(0x7f349c1623d0 0x7f349c0cb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:13:52.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.460+0000 7f349b7fe700 1 --2- 172.21.15.2:0/3625586689 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f349c15e090 0x7f349c06afd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f348c009840 tx=0x7f348c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfad9f3260aa419d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:52.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.461+0000 7f349a7fc700 1 -- 172.21.15.2:0/3625586689 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348c011830 con 0x7f349c15e090 2023-11-26T07:13:52.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.461+0000 7f349a7fc700 1 -- 172.21.15.2:0/3625586689 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348c011990 con 0x7f349c15e090 2023-11-26T07:13:52.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.461+0000 7f349a7fc700 1 -- 172.21.15.2:0/3625586689 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348c011d20 con 0x7f349c15e090 2023-11-26T07:13:52.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.461+0000 7f34a1c62700 1 -- 172.21.15.2:0/3625586689 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f349c15e090 msgr2=0x7f349c06afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:52.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.461+0000 7f34a1c62700 1 --2- 172.21.15.2:0/3625586689 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f349c15e090 0x7f349c06afd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f348c009840 tx=0x7f348c009b50 comp rx=0 tx=0).stop 2023-11-26T07:13:52.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.461+0000 7f34a1c62700 1 -- 172.21.15.2:0/3625586689 shutdown_connections 2023-11-26T07:13:52.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.461+0000 7f34a1c62700 1 --2- 172.21.15.2:0/3625586689 >> v2:172.21.15.192:3300/0 conn(0x7f349c1623d0 0x7f349c0cb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:52.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.461+0000 7f34a1c62700 1 --2- 172.21.15.2:0/3625586689 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f349c15e090 0x7f349c06afd0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:52.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.461+0000 7f34a1c62700 1 -- 172.21.15.2:0/3625586689 >> 172.21.15.2:0/3625586689 conn(0x7f349c0d0b10 msgr2=0x7f349c0d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:52.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.461+0000 7f34a1c62700 1 -- 172.21.15.2:0/3625586689 shutdown_connections 2023-11-26T07:13:52.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.461+0000 7f34a1c62700 1 -- 172.21.15.2:0/3625586689 wait complete. 2023-11-26T07:13:52.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.462+0000 7f34a1c62700 1 Processor -- start 2023-11-26T07:13:52.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.463+0000 7f34a1c62700 1 -- start start 2023-11-26T07:13:52.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.463+0000 7f34a1c62700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f349c06b510 0x7f349c152050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:52.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.463+0000 7f34a1c62700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f349c15e090 0x7f349c06db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:52.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.463+0000 7f34a1c62700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f349c1623d0 0x7f349c06e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:52.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.463+0000 7f34a1c62700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349c06f350 con 0x7f349c1623d0 2023-11-26T07:13:52.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.463+0000 7f34a1c62700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349c152c20 con 0x7f349c15e090 2023-11-26T07:13:52.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.463+0000 7f34a1c62700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f349c1436f0 con 0x7f349c06b510 2023-11-26T07:13:52.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.463+0000 7f349bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f349c1623d0 0x7f349c06e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:52.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.463+0000 7f349bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f349c1623d0 0x7f349c06e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41896/0 (socket says 172.21.15.2:41896) 2023-11-26T07:13:52.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.463+0000 7f349bfff700 1 -- 172.21.15.2:0/356041170 learned_addr learned my addr 172.21.15.2:0/356041170 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:52.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.464+0000 7f349affd700 1 --2- 172.21.15.2:0/356041170 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f349c15e090 0x7f349c06db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:52.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.464+0000 7f349b7fe700 1 --2- 172.21.15.2:0/356041170 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f349c06b510 0x7f349c152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:52.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.464+0000 7f349bfff700 1 -- 172.21.15.2:0/356041170 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f349c06b510 msgr2=0x7f349c152050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:52.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.464+0000 7f349bfff700 1 --2- 172.21.15.2:0/356041170 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f349c06b510 0x7f349c152050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:52.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.464+0000 7f349bfff700 1 -- 172.21.15.2:0/356041170 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f349c15e090 msgr2=0x7f349c06db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:52.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.464+0000 7f349bfff700 1 --2- 172.21.15.2:0/356041170 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f349c15e090 0x7f349c06db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:52.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.464+0000 7f349bfff700 1 -- 172.21.15.2:0/356041170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3494009a70 con 0x7f349c1623d0 2023-11-26T07:13:52.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.464+0000 7f349affd700 1 --2- 172.21.15.2:0/356041170 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f349c15e090 0x7f349c06db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:13:52.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.464+0000 7f349bfff700 1 --2- 172.21.15.2:0/356041170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f349c1623d0 0x7f349c06e0a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f349400efc0 tx=0x7f349400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:52.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.464+0000 7f3483fff700 1 -- 172.21.15.2:0/356041170 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349400ca90 con 0x7f349c1623d0 2023-11-26T07:13:52.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.464+0000 7f3483fff700 1 -- 172.21.15.2:0/356041170 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349400f040 con 0x7f349c1623d0 2023-11-26T07:13:52.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.464+0000 7f34a1c62700 1 -- 172.21.15.2:0/356041170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f348c0094a0 con 0x7f349c1623d0 2023-11-26T07:13:52.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.464+0000 7f3483fff700 1 -- 172.21.15.2:0/356041170 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349400ce30 con 0x7f349c1623d0 2023-11-26T07:13:52.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.464+0000 7f34a1c62700 1 -- 172.21.15.2:0/356041170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f349c06e9b0 con 0x7f349c1623d0 2023-11-26T07:13:52.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.465+0000 7f34a1c62700 1 -- 172.21.15.2:0/356041170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f349c06f490 con 0x7f349c1623d0 2023-11-26T07:13:52.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.466+0000 7f3483fff700 1 -- 172.21.15.2:0/356041170 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f3494014480 con 0x7f349c1623d0 2023-11-26T07:13:52.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.466+0000 7f3483fff700 1 --2- 172.21.15.2:0/356041170 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f348806b1a0 0x7f348806d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:52.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.467+0000 7f3483fff700 1 -- 172.21.15.2:0/356041170 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f349408a050 con 0x7f349c1623d0 2023-11-26T07:13:52.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.467+0000 7f349b7fe700 1 --2- 172.21.15.2:0/356041170 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f348806b1a0 0x7f348806d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:52.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.467+0000 7f349b7fe700 1 --2- 172.21.15.2:0/356041170 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f348806b1a0 0x7f348806d660 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f348c000c00 tx=0x7f348c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:52.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.471+0000 7f3483fff700 1 -- 172.21.15.2:0/356041170 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f34940bce90 con 0x7f349c1623d0 2023-11-26T07:13:52.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:52.674+0000 7f34a1c62700 1 -- 172.21.15.2:0/356041170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f349c0c6d00 con 0x7f349c1623d0 2023-11-26T07:13:53.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.310+0000 7f3483fff700 1 -- 172.21.15.2:0/356041170 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v43) v1 ==== 170+0+0 (secure 0 0 0) 0x7f349c0c6d00 con 0x7f349c1623d0 2023-11-26T07:13:53.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.313+0000 7f34a1c62700 1 -- 172.21.15.2:0/356041170 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f348806b1a0 msgr2=0x7f348806d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:53.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.313+0000 7f34a1c62700 1 --2- 172.21.15.2:0/356041170 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f348806b1a0 0x7f348806d660 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f348c000c00 tx=0x7f348c008030 comp rx=0 tx=0).stop 2023-11-26T07:13:53.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.313+0000 7f34a1c62700 1 -- 172.21.15.2:0/356041170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f349c1623d0 msgr2=0x7f349c06e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:53.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.313+0000 7f34a1c62700 1 --2- 172.21.15.2:0/356041170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f349c1623d0 0x7f349c06e0a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f349400efc0 tx=0x7f349400c3a0 comp rx=0 tx=0).stop 2023-11-26T07:13:53.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.313+0000 7f34a1c62700 1 -- 172.21.15.2:0/356041170 shutdown_connections 2023-11-26T07:13:53.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.313+0000 7f34a1c62700 1 --2- 172.21.15.2:0/356041170 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f348806b1a0 0x7f348806d660 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:53.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.313+0000 7f34a1c62700 1 --2- 172.21.15.2:0/356041170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f349c1623d0 0x7f349c06e0a0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:53.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.313+0000 7f34a1c62700 1 --2- 172.21.15.2:0/356041170 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f349c06b510 0x7f349c152050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:53.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.313+0000 7f34a1c62700 1 --2- 172.21.15.2:0/356041170 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f349c15e090 0x7f349c06db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:53.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.313+0000 7f34a1c62700 1 -- 172.21.15.2:0/356041170 >> 172.21.15.2:0/356041170 conn(0x7f349c0d0b10 msgr2=0x7f349c0afab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:53.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.314+0000 7f34a1c62700 1 -- 172.21.15.2:0/356041170 shutdown_connections 2023-11-26T07:13:53.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.315+0000 7f34a1c62700 1 -- 172.21.15.2:0/356041170 wait complete. 2023-11-26T07:13:53.325 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' created 2023-11-26T07:13:53.345 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-26T07:13:53.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.477+0000 7f6bf2da9700 1 Processor -- start 2023-11-26T07:13:53.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.477+0000 7f6bf2da9700 1 -- start start 2023-11-26T07:13:53.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.478+0000 7f6bf2da9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6bec15e1c0 0x7f6bec06eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:53.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.478+0000 7f6bf2da9700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6bec0b0e90 0x7f6bec06f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:53.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.478+0000 7f6bf2da9700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6bec06fa80 0x7f6bec161d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:53.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.478+0000 7f6bf2da9700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bec06ff10 con 0x7f6bec0b0e90 2023-11-26T07:13:53.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.478+0000 7f6bf2da9700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bec0d1230 con 0x7f6bec06fa80 2023-11-26T07:13:53.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.478+0000 7f6bf2da9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec0d0c70 con 0x7f6bec15e1c0 2023-11-26T07:13:53.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.478+0000 7f6bebfff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6bec0b0e90 0x7f6bec06f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:53.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.478+0000 7f6bebfff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6bec0b0e90 0x7f6bec06f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41900/0 (socket says 172.21.15.2:41900) 2023-11-26T07:13:53.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.478+0000 7f6bebfff700 1 -- 172.21.15.2:0/786525626 learned_addr learned my addr 172.21.15.2:0/786525626 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:53.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.478+0000 7f6bf0b45700 1 --2- 172.21.15.2:0/786525626 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6bec15e1c0 0x7f6bec06eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:53.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.478+0000 7f6bf1346700 1 --2- 172.21.15.2:0/786525626 >> v2:172.21.15.192:3300/0 conn(0x7f6bec06fa80 0x7f6bec161d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:53.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.478+0000 7f6bebfff700 1 -- 172.21.15.2:0/786525626 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6bec15e1c0 msgr2=0x7f6bec06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:53.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.478+0000 7f6bebfff700 1 --2- 172.21.15.2:0/786525626 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6bec15e1c0 0x7f6bec06eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:53.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.478+0000 7f6bebfff700 1 -- 172.21.15.2:0/786525626 >> v2:172.21.15.192:3300/0 conn(0x7f6bec06fa80 msgr2=0x7f6bec161d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:53.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.478+0000 7f6bebfff700 1 --2- 172.21.15.2:0/786525626 >> v2:172.21.15.192:3300/0 conn(0x7f6bec06fa80 0x7f6bec161d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:53.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.478+0000 7f6bebfff700 1 -- 172.21.15.2:0/786525626 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bec0d0f50 con 0x7f6bec0b0e90 2023-11-26T07:13:53.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.478+0000 7f6bebfff700 1 --2- 172.21.15.2:0/786525626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bec0b0e90 0x7f6bec06f540 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6bec0b0db0 tx=0x7f6bd8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38f6b4d235d8ba14 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:53.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.479+0000 7f6beb7fe700 1 -- 172.21.15.2:0/786525626 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd800b870 con 0x7f6bec0b0e90 2023-11-26T07:13:53.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.479+0000 7f6beb7fe700 1 -- 172.21.15.2:0/786525626 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd800b9d0 con 0x7f6bec0b0e90 2023-11-26T07:13:53.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.479+0000 7f6beb7fe700 1 -- 172.21.15.2:0/786525626 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd800bd60 con 0x7f6bec0b0e90 2023-11-26T07:13:53.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.479+0000 7f6bf2da9700 1 -- 172.21.15.2:0/786525626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bec0b0e90 msgr2=0x7f6bec06f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:53.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.479+0000 7f6bf2da9700 1 --2- 172.21.15.2:0/786525626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bec0b0e90 0x7f6bec06f540 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6bec0b0db0 tx=0x7f6bd8009bd0 comp rx=0 tx=0).stop 2023-11-26T07:13:53.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.479+0000 7f6bf2da9700 1 -- 172.21.15.2:0/786525626 shutdown_connections 2023-11-26T07:13:53.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.479+0000 7f6bf2da9700 1 --2- 172.21.15.2:0/786525626 >> v2:172.21.15.192:3300/0 conn(0x7f6bec06fa80 0x7f6bec161d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:53.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.479+0000 7f6bf2da9700 1 --2- 172.21.15.2:0/786525626 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6bec15e1c0 0x7f6bec06eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:53.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.479+0000 7f6bf2da9700 1 --2- 172.21.15.2:0/786525626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bec0b0e90 0x7f6bec06f540 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:53.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.479+0000 7f6bf2da9700 1 -- 172.21.15.2:0/786525626 >> 172.21.15.2:0/786525626 conn(0x7f6bec0b3720 msgr2=0x7f6bec0b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:53.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.479+0000 7f6bf2da9700 1 -- 172.21.15.2:0/786525626 shutdown_connections 2023-11-26T07:13:53.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.479+0000 7f6bf2da9700 1 -- 172.21.15.2:0/786525626 wait complete. 2023-11-26T07:13:53.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.480+0000 7f6bf2da9700 1 Processor -- start 2023-11-26T07:13:53.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.481+0000 7f6bf2da9700 1 -- start start 2023-11-26T07:13:53.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.481+0000 7f6bf2da9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bec06fa80 0x7f6bec0cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:53.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.481+0000 7f6bf2da9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bec0b0e90 0x7f6bec0b5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:53.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.481+0000 7f6bf2da9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6bec15e1c0 0x7f6bec14dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:53.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.481+0000 7f6bf2da9700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec0b4bd0 con 0x7f6bec0b0e90 2023-11-26T07:13:53.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.481+0000 7f6bf2da9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec0b4eb0 con 0x7f6bec06fa80 2023-11-26T07:13:53.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.481+0000 7f6bf2da9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec0b5190 con 0x7f6bec15e1c0 2023-11-26T07:13:53.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.481+0000 7f6bebfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bec0b0e90 0x7f6bec0b5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:53.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.482+0000 7f6bebfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bec0b0e90 0x7f6bec0b5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41908/0 (socket says 172.21.15.2:41908) 2023-11-26T07:13:53.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.482+0000 7f6bebfff700 1 -- 172.21.15.2:0/2631764874 learned_addr learned my addr 172.21.15.2:0/2631764874 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:53.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.482+0000 7f6bf0b45700 1 --2- 172.21.15.2:0/2631764874 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bec06fa80 0x7f6bec0cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:53.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.482+0000 7f6bf1346700 1 --2- 172.21.15.2:0/2631764874 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6bec15e1c0 0x7f6bec14dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:53.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.482+0000 7f6bebfff700 1 -- 172.21.15.2:0/2631764874 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6bec15e1c0 msgr2=0x7f6bec14dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:53.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.482+0000 7f6bebfff700 1 --2- 172.21.15.2:0/2631764874 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6bec15e1c0 0x7f6bec14dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:53.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.482+0000 7f6bebfff700 1 -- 172.21.15.2:0/2631764874 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bec06fa80 msgr2=0x7f6bec0cb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:53.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.482+0000 7f6bebfff700 1 --2- 172.21.15.2:0/2631764874 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bec06fa80 0x7f6bec0cb8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:53.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.482+0000 7f6bebfff700 1 -- 172.21.15.2:0/2631764874 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd8009550 con 0x7f6bec0b0e90 2023-11-26T07:13:53.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.482+0000 7f6bf0b45700 1 --2- 172.21.15.2:0/2631764874 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bec06fa80 0x7f6bec0cb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:13:53.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.482+0000 7f6bebfff700 1 --2- 172.21.15.2:0/2631764874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bec0b0e90 0x7f6bec0b5c70 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8000c00 tx=0x7f6bd8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:53.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.482+0000 7f6be97fa700 1 -- 172.21.15.2:0/2631764874 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd8004310 con 0x7f6bec0b0e90 2023-11-26T07:13:53.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.482+0000 7f6be97fa700 1 -- 172.21.15.2:0/2631764874 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd801f070 con 0x7f6bec0b0e90 2023-11-26T07:13:53.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.482+0000 7f6bf2da9700 1 -- 172.21.15.2:0/2631764874 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bec0b5470 con 0x7f6bec0b0e90 2023-11-26T07:13:53.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.482+0000 7f6be97fa700 1 -- 172.21.15.2:0/2631764874 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd80036a0 con 0x7f6bec0b0e90 2023-11-26T07:13:53.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.482+0000 7f6bf2da9700 1 -- 172.21.15.2:0/2631764874 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bec158550 con 0x7f6bec0b0e90 2023-11-26T07:13:53.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.483+0000 7f6bf2da9700 1 -- 172.21.15.2:0/2631764874 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bec075480 con 0x7f6bec0b0e90 2023-11-26T07:13:53.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.484+0000 7f6be97fa700 1 -- 172.21.15.2:0/2631764874 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f6bd8021030 con 0x7f6bec0b0e90 2023-11-26T07:13:53.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.484+0000 7f6be97fa700 1 --2- 172.21.15.2:0/2631764874 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6bd006b1a0 0x7f6bd006d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:53.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.484+0000 7f6be97fa700 1 -- 172.21.15.2:0/2631764874 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f6bd808ac20 con 0x7f6bec0b0e90 2023-11-26T07:13:53.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.484+0000 7f6bf0b45700 1 --2- 172.21.15.2:0/2631764874 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6bd006b1a0 0x7f6bd006d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:53.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.485+0000 7f6bf0b45700 1 --2- 172.21.15.2:0/2631764874 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6bd006b1a0 0x7f6bd006d660 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6be00079d0 tx=0x7f6be0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:53.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.489+0000 7f6be97fa700 1 -- 172.21.15.2:0/2631764874 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6bd8055a70 con 0x7f6bec0b0e90 2023-11-26T07:13:53.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:53.739+0000 7f6bf2da9700 1 -- 172.21.15.2:0/2631764874 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6bec0b4240 con 0x7f6bec0b0e90 2023-11-26T07:13:54.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.321+0000 7f6be97fa700 1 -- 172.21.15.2:0/2631764874 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v22) v1 ==== 172+0+0 (secure 0 0 0) 0x7f6bd8015020 con 0x7f6bec0b0e90 2023-11-26T07:13:54.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.324+0000 7f6bf2da9700 1 -- 172.21.15.2:0/2631764874 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6bd006b1a0 msgr2=0x7f6bd006d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:54.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.324+0000 7f6bf2da9700 1 --2- 172.21.15.2:0/2631764874 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6bd006b1a0 0x7f6bd006d660 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6be00079d0 tx=0x7f6be0008040 comp rx=0 tx=0).stop 2023-11-26T07:13:54.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.324+0000 7f6bf2da9700 1 -- 172.21.15.2:0/2631764874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bec0b0e90 msgr2=0x7f6bec0b5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:54.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.324+0000 7f6bf2da9700 1 --2- 172.21.15.2:0/2631764874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bec0b0e90 0x7f6bec0b5c70 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8000c00 tx=0x7f6bd8004750 comp rx=0 tx=0).stop 2023-11-26T07:13:54.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.324+0000 7f6bf2da9700 1 -- 172.21.15.2:0/2631764874 shutdown_connections 2023-11-26T07:13:54.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.324+0000 7f6bf2da9700 1 --2- 172.21.15.2:0/2631764874 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6bd006b1a0 0x7f6bd006d660 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:54.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.324+0000 7f6bf2da9700 1 --2- 172.21.15.2:0/2631764874 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6bec15e1c0 0x7f6bec14dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:54.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.324+0000 7f6bf2da9700 1 --2- 172.21.15.2:0/2631764874 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bec06fa80 0x7f6bec0cb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:54.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.324+0000 7f6bf2da9700 1 --2- 172.21.15.2:0/2631764874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bec0b0e90 0x7f6bec0b5c70 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:54.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.324+0000 7f6bf2da9700 1 -- 172.21.15.2:0/2631764874 >> 172.21.15.2:0/2631764874 conn(0x7f6bec0b3720 msgr2=0x7f6bec0af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:54.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.325+0000 7f6bf2da9700 1 -- 172.21.15.2:0/2631764874 shutdown_connections 2023-11-26T07:13:54.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.326+0000 7f6bf2da9700 1 -- 172.21.15.2:0/2631764874 wait complete. 2023-11-26T07:13:54.335 INFO:teuthology.orchestra.run.smithi002.stderr:new fs with metadata pool 6 and data pool 7 2023-11-26T07:13:54.361 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:13:54.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.488+0000 7f6bd32d9700 1 Processor -- start 2023-11-26T07:13:54.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.489+0000 7f6bd32d9700 1 -- start start 2023-11-26T07:13:54.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.489+0000 7f6bd32d9700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6bcc06b620 0x7f6bcc0b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:54.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.489+0000 7f6bd32d9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6bcc0b5ab0 0x7f6bcc0b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:54.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.489+0000 7f6bd32d9700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6bcc1478c0 0x7f6bcc161ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:54.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.489+0000 7f6bd32d9700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bcc071f50 con 0x7f6bcc06b620 2023-11-26T07:13:54.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.489+0000 7f6bd32d9700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bcc072230 con 0x7f6bcc1478c0 2023-11-26T07:13:54.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.489+0000 7f6bd32d9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc072510 con 0x7f6bcc0b5ab0 2023-11-26T07:13:54.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.490+0000 7f6bd1075700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6bcc06b620 0x7f6bcc0b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:54.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.490+0000 7f6bd1075700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6bcc06b620 0x7f6bcc0b3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41914/0 (socket says 172.21.15.2:41914) 2023-11-26T07:13:54.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.490+0000 7f6bd1075700 1 -- 172.21.15.2:0/1758342989 learned_addr learned my addr 172.21.15.2:0/1758342989 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:54.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.490+0000 7f6bd0874700 1 --2- 172.21.15.2:0/1758342989 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6bcc0b5ab0 0x7f6bcc0b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:54.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.490+0000 7f6bd1075700 1 -- 172.21.15.2:0/1758342989 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6bcc0b5ab0 msgr2=0x7f6bcc0b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:54.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.490+0000 7f6bd1075700 1 --2- 172.21.15.2:0/1758342989 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6bcc0b5ab0 0x7f6bcc0b3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:54.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.490+0000 7f6bd1876700 1 --2- 172.21.15.2:0/1758342989 >> v2:172.21.15.192:3300/0 conn(0x7f6bcc1478c0 0x7f6bcc161ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:54.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.490+0000 7f6bd1075700 1 -- 172.21.15.2:0/1758342989 >> v2:172.21.15.192:3300/0 conn(0x7f6bcc1478c0 msgr2=0x7f6bcc161ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:54.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.490+0000 7f6bd1075700 1 --2- 172.21.15.2:0/1758342989 >> v2:172.21.15.192:3300/0 conn(0x7f6bcc1478c0 0x7f6bcc161ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:54.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.490+0000 7f6bd1075700 1 -- 172.21.15.2:0/1758342989 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bcc0727f0 con 0x7f6bcc06b620 2023-11-26T07:13:54.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.490+0000 7f6bd1075700 1 --2- 172.21.15.2:0/1758342989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bcc06b620 0x7f6bcc0b3a40 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc0747c0 tx=0x7f6bbc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d848fda1dee6a52c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:54.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.490+0000 7f6bc3fff700 1 -- 172.21.15.2:0/1758342989 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc00b870 con 0x7f6bcc06b620 2023-11-26T07:13:54.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.490+0000 7f6bc3fff700 1 -- 172.21.15.2:0/1758342989 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bbc00b9d0 con 0x7f6bcc06b620 2023-11-26T07:13:54.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.490+0000 7f6bc3fff700 1 -- 172.21.15.2:0/1758342989 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc00bd60 con 0x7f6bcc06b620 2023-11-26T07:13:54.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.491+0000 7f6bd32d9700 1 -- 172.21.15.2:0/1758342989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bcc06b620 msgr2=0x7f6bcc0b3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:54.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.491+0000 7f6bd32d9700 1 --2- 172.21.15.2:0/1758342989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bcc06b620 0x7f6bcc0b3a40 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc0747c0 tx=0x7f6bbc009bd0 comp rx=0 tx=0).stop 2023-11-26T07:13:54.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.491+0000 7f6bd32d9700 1 -- 172.21.15.2:0/1758342989 shutdown_connections 2023-11-26T07:13:54.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.491+0000 7f6bd32d9700 1 --2- 172.21.15.2:0/1758342989 >> v2:172.21.15.192:3300/0 conn(0x7f6bcc1478c0 0x7f6bcc161ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:54.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.491+0000 7f6bd32d9700 1 --2- 172.21.15.2:0/1758342989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bcc06b620 0x7f6bcc0b3a40 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:54.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.491+0000 7f6bd32d9700 1 --2- 172.21.15.2:0/1758342989 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6bcc0b5ab0 0x7f6bcc0b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:54.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.491+0000 7f6bd32d9700 1 -- 172.21.15.2:0/1758342989 >> 172.21.15.2:0/1758342989 conn(0x7f6bcc0b2740 msgr2=0x7f6bcc0b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:54.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.491+0000 7f6bd32d9700 1 -- 172.21.15.2:0/1758342989 shutdown_connections 2023-11-26T07:13:54.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.491+0000 7f6bd32d9700 1 -- 172.21.15.2:0/1758342989 wait complete. 2023-11-26T07:13:54.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.492+0000 7f6bd32d9700 1 Processor -- start 2023-11-26T07:13:54.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.492+0000 7f6bd32d9700 1 -- start start 2023-11-26T07:13:54.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.493+0000 7f6bd32d9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6bcc06b620 0x7f6bcc1e4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:54.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.493+0000 7f6bd32d9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bcc0b5ab0 0x7f6bcc0ca470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:54.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.493+0000 7f6bd32d9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bcc1478c0 0x7f6bcc0ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:54.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.493+0000 7f6bd32d9700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc0c7dc0 con 0x7f6bcc0b5ab0 2023-11-26T07:13:54.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.493+0000 7f6bd32d9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc0c8940 con 0x7f6bcc1478c0 2023-11-26T07:13:54.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.493+0000 7f6bd32d9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc0c8010 con 0x7f6bcc06b620 2023-11-26T07:13:54.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.493+0000 7f6bd0874700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bcc0b5ab0 0x7f6bcc0ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:54.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.493+0000 7f6bd0874700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bcc0b5ab0 0x7f6bcc0ca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41922/0 (socket says 172.21.15.2:41922) 2023-11-26T07:13:54.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.493+0000 7f6bd0874700 1 -- 172.21.15.2:0/331245610 learned_addr learned my addr 172.21.15.2:0/331245610 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:54.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.493+0000 7f6bd1876700 1 --2- 172.21.15.2:0/331245610 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bcc1478c0 0x7f6bcc0ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:54.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.493+0000 7f6bd1075700 1 --2- 172.21.15.2:0/331245610 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6bcc06b620 0x7f6bcc1e4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:54.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.493+0000 7f6bd0874700 1 -- 172.21.15.2:0/331245610 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6bcc06b620 msgr2=0x7f6bcc1e4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:54.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.493+0000 7f6bd0874700 1 --2- 172.21.15.2:0/331245610 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6bcc06b620 0x7f6bcc1e4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:54.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.493+0000 7f6bd0874700 1 -- 172.21.15.2:0/331245610 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bcc1478c0 msgr2=0x7f6bcc0ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:54.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.493+0000 7f6bd0874700 1 --2- 172.21.15.2:0/331245610 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bcc1478c0 0x7f6bcc0ca9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:54.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.493+0000 7f6bd0874700 1 -- 172.21.15.2:0/331245610 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bbc009550 con 0x7f6bcc0b5ab0 2023-11-26T07:13:54.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.493+0000 7f6bd1876700 1 --2- 172.21.15.2:0/331245610 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bcc1478c0 0x7f6bcc0ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:13:54.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.493+0000 7f6bd0874700 1 --2- 172.21.15.2:0/331245610 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bcc0b5ab0 0x7f6bcc0ca470 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f6bc800c820 tx=0x7f6bc800cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:54.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.494+0000 7f6bc1ffb700 1 -- 172.21.15.2:0/331245610 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc8011800 con 0x7f6bcc0b5ab0 2023-11-26T07:13:54.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.494+0000 7f6bc1ffb700 1 -- 172.21.15.2:0/331245610 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc8011960 con 0x7f6bcc0b5ab0 2023-11-26T07:13:54.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.494+0000 7f6bc1ffb700 1 -- 172.21.15.2:0/331245610 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc8011cd0 con 0x7f6bcc0b5ab0 2023-11-26T07:13:54.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.494+0000 7f6bd32d9700 1 -- 172.21.15.2:0/331245610 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bcc0c82f0 con 0x7f6bcc0b5ab0 2023-11-26T07:13:54.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.494+0000 7f6bd32d9700 1 -- 172.21.15.2:0/331245610 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bcc1e4970 con 0x7f6bcc0b5ab0 2023-11-26T07:13:54.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.495+0000 7f6bd32d9700 1 -- 172.21.15.2:0/331245610 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bcc0c8ad0 con 0x7f6bcc0b5ab0 2023-11-26T07:13:54.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.495+0000 7f6bc1ffb700 1 -- 172.21.15.2:0/331245610 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f6bc8022350 con 0x7f6bcc0b5ab0 2023-11-26T07:13:54.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.495+0000 7f6bc1ffb700 1 --2- 172.21.15.2:0/331245610 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6bb006b1a0 0x7f6bb006d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:54.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.496+0000 7f6bc1ffb700 1 -- 172.21.15.2:0/331245610 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6bc80899b0 con 0x7f6bcc0b5ab0 2023-11-26T07:13:54.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.496+0000 7f6bd1075700 1 --2- 172.21.15.2:0/331245610 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6bb006b1a0 0x7f6bb006d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:54.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.496+0000 7f6bd1075700 1 --2- 172.21.15.2:0/331245610 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6bb006b1a0 0x7f6bb006d660 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc009130 tx=0x7f6bbc008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:54.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.500+0000 7f6bc1ffb700 1 -- 172.21.15.2:0/331245610 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6bc8054600 con 0x7f6bcc0b5ab0 2023-11-26T07:13:54.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.700+0000 7f6bd32d9700 1 -- 172.21.15.2:0/331245610 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6bcc0b3a40 con 0x7f6bcc0b5ab0 2023-11-26T07:13:54.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.701+0000 7f6bc1ffb700 1 -- 172.21.15.2:0/331245610 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+16478 (secure 0 0 0) 0x7f6bc801f090 con 0x7f6bcc0b5ab0 2023-11-26T07:13:54.703 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:13:54.704 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":44,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:13:53.741133+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:13:52.197275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-26T07:13:52.705487+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:13:54.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.704+0000 7f6bd32d9700 1 -- 172.21.15.2:0/331245610 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6bb006b1a0 msgr2=0x7f6bb006d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:54.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.704+0000 7f6bd32d9700 1 --2- 172.21.15.2:0/331245610 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6bb006b1a0 0x7f6bb006d660 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc009130 tx=0x7f6bbc008030 comp rx=0 tx=0).stop 2023-11-26T07:13:54.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.704+0000 7f6bd32d9700 1 -- 172.21.15.2:0/331245610 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bcc0b5ab0 msgr2=0x7f6bcc0ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:54.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.704+0000 7f6bd32d9700 1 --2- 172.21.15.2:0/331245610 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bcc0b5ab0 0x7f6bcc0ca470 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f6bc800c820 tx=0x7f6bc800cbe0 comp rx=0 tx=0).stop 2023-11-26T07:13:54.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.704+0000 7f6bd32d9700 1 -- 172.21.15.2:0/331245610 shutdown_connections 2023-11-26T07:13:54.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.704+0000 7f6bd32d9700 1 --2- 172.21.15.2:0/331245610 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6bb006b1a0 0x7f6bb006d660 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:54.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.704+0000 7f6bd32d9700 1 --2- 172.21.15.2:0/331245610 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bcc1478c0 0x7f6bcc0ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:54.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.704+0000 7f6bd32d9700 1 --2- 172.21.15.2:0/331245610 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6bcc06b620 0x7f6bcc1e4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:54.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.704+0000 7f6bd32d9700 1 --2- 172.21.15.2:0/331245610 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bcc0b5ab0 0x7f6bcc0ca470 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:54.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.704+0000 7f6bd32d9700 1 -- 172.21.15.2:0/331245610 >> 172.21.15.2:0/331245610 conn(0x7f6bcc0b2740 msgr2=0x7f6bcc146440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:54.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.704+0000 7f6bd32d9700 1 -- 172.21.15.2:0/331245610 shutdown_connections 2023-11-26T07:13:54.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.704+0000 7f6bd32d9700 1 -- 172.21.15.2:0/331245610 wait complete. 2023-11-26T07:13:54.718 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:13:54.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.841+0000 7f54d3e27700 1 Processor -- start 2023-11-26T07:13:54.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.841+0000 7f54d3e27700 1 -- start start 2023-11-26T07:13:54.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.842+0000 7f54d3e27700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f54cc15ad70 0x7f54cc0b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:54.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.843+0000 7f54d3e27700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f54cc0b03b0 0x7f54cc0ad690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:54.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.843+0000 7f54d3e27700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54cc15b150 con 0x7f54cc0adbd0 2023-11-26T07:13:54.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.843+0000 7f54d3e27700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54cc073610 con 0x7f54cc0b03b0 2023-11-26T07:13:54.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.843+0000 7f54d3e27700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54cc0b6380 con 0x7f54cc15ad70 2023-11-26T07:13:54.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.843+0000 7f54d13c2700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f54cc0b03b0 0x7f54cc0ad690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:54.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.843+0000 7f54d13c2700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f54cc0b03b0 0x7f54cc0ad690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41928/0 (socket says 172.21.15.2:41928) 2023-11-26T07:13:54.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.843+0000 7f54d13c2700 1 -- 172.21.15.2:0/1820438545 learned_addr learned my addr 172.21.15.2:0/1820438545 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:54.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.843+0000 7f54d13c2700 1 -- 172.21.15.2:0/1820438545 >> v2:172.21.15.192:3300/0 conn(0x7f54cc15ad70 msgr2=0x7f54cc0b5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:54.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.843+0000 7f54d1bc3700 1 --2- 172.21.15.2:0/1820438545 >> v2:172.21.15.192:3300/0 conn(0x7f54cc15ad70 0x7f54cc0b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:54.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.843+0000 7f54d13c2700 1 --2- 172.21.15.2:0/1820438545 >> v2:172.21.15.192:3300/0 conn(0x7f54cc15ad70 0x7f54cc0b5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:54.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.843+0000 7f54d13c2700 1 -- 172.21.15.2:0/1820438545 >> v1:172.21.15.192:6789/0 conn(0x7f54cc0adbd0 legacy=0x7f54cc15e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:54.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.843+0000 7f54d13c2700 1 -- 172.21.15.2:0/1820438545 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54cc0b0ec0 con 0x7f54cc0b03b0 2023-11-26T07:13:54.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.843+0000 7f54d13c2700 1 --2- 172.21.15.2:0/1820438545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54cc0b03b0 0x7f54cc0ad690 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f54c0009920 tx=0x7f54c0009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=250f2a1178ec991 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:54.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.843+0000 7f54d0bc1700 1 -- 172.21.15.2:0/1820438545 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c0004230 con 0x7f54cc0b03b0 2023-11-26T07:13:54.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.843+0000 7f54d0bc1700 1 -- 172.21.15.2:0/1820438545 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c0004390 con 0x7f54cc0b03b0 2023-11-26T07:13:54.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.843+0000 7f54d0bc1700 1 -- 172.21.15.2:0/1820438545 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c0009e70 con 0x7f54cc0b03b0 2023-11-26T07:13:54.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.844+0000 7f54d3e27700 1 -- 172.21.15.2:0/1820438545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54cc0b03b0 msgr2=0x7f54cc0ad690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:54.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.844+0000 7f54d3e27700 1 --2- 172.21.15.2:0/1820438545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54cc0b03b0 0x7f54cc0ad690 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f54c0009920 tx=0x7f54c0009c30 comp rx=0 tx=0).stop 2023-11-26T07:13:54.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.844+0000 7f54d3e27700 1 -- 172.21.15.2:0/1820438545 shutdown_connections 2023-11-26T07:13:54.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.844+0000 7f54d3e27700 1 --2- 172.21.15.2:0/1820438545 >> v2:172.21.15.192:3300/0 conn(0x7f54cc15ad70 0x7f54cc0b5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:54.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.844+0000 7f54d3e27700 1 --2- 172.21.15.2:0/1820438545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54cc0b03b0 0x7f54cc0ad690 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:54.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.844+0000 7f54d3e27700 1 -- 172.21.15.2:0/1820438545 >> 172.21.15.2:0/1820438545 conn(0x7f54cc0b5070 msgr2=0x7f54cc0b5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:54.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.844+0000 7f54d3e27700 1 -- 172.21.15.2:0/1820438545 shutdown_connections 2023-11-26T07:13:54.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.844+0000 7f54d3e27700 1 -- 172.21.15.2:0/1820438545 wait complete. 2023-11-26T07:13:54.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.846+0000 7f54d3e27700 1 Processor -- start 2023-11-26T07:13:54.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.846+0000 7f54d3e27700 1 -- start start 2023-11-26T07:13:54.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.847+0000 7f54d3e27700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54cc0adbd0 0x7f54cc14d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:54.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.847+0000 7f54d3e27700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54cc0b03b0 0x7f54cc14b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:54.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.847+0000 7f54d3e27700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54cc15ad70 0x7f54cc149820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:54.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.847+0000 7f54d3e27700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc06d760 con 0x7f54cc0adbd0 2023-11-26T07:13:54.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.847+0000 7f54d3e27700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc14bb60 con 0x7f54cc0b03b0 2023-11-26T07:13:54.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.847+0000 7f54d3e27700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc14fb70 con 0x7f54cc15ad70 2023-11-26T07:13:54.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.847+0000 7f54d1bc3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54cc0adbd0 0x7f54cc14d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:54.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.847+0000 7f54d1bc3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54cc0adbd0 0x7f54cc14d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41932/0 (socket says 172.21.15.2:41932) 2023-11-26T07:13:54.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.847+0000 7f54d1bc3700 1 -- 172.21.15.2:0/878996926 learned_addr learned my addr 172.21.15.2:0/878996926 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:54.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.847+0000 7f54d13c2700 1 --2- 172.21.15.2:0/878996926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54cc0b03b0 0x7f54cc14b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:54.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.847+0000 7f54d23c4700 1 --2- 172.21.15.2:0/878996926 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54cc15ad70 0x7f54cc149820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:54.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.847+0000 7f54d1bc3700 1 -- 172.21.15.2:0/878996926 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54cc15ad70 msgr2=0x7f54cc149820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:54.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.847+0000 7f54d1bc3700 1 --2- 172.21.15.2:0/878996926 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54cc15ad70 0x7f54cc149820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:54.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.847+0000 7f54d1bc3700 1 -- 172.21.15.2:0/878996926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54cc0b03b0 msgr2=0x7f54cc14b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:54.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.847+0000 7f54d1bc3700 1 --2- 172.21.15.2:0/878996926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54cc0b03b0 0x7f54cc14b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:54.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.847+0000 7f54d1bc3700 1 -- 172.21.15.2:0/878996926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c0009550 con 0x7f54cc0adbd0 2023-11-26T07:13:54.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.847+0000 7f54d13c2700 1 --2- 172.21.15.2:0/878996926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54cc0b03b0 0x7f54cc14b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:13:54.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.847+0000 7f54d1bc3700 1 --2- 172.21.15.2:0/878996926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54cc0adbd0 0x7f54cc14d400 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f54c400ccd0 tx=0x7f54c400a4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:54.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.847+0000 7f54ca7fc700 1 -- 172.21.15.2:0/878996926 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c400ad30 con 0x7f54cc0adbd0 2023-11-26T07:13:54.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.847+0000 7f54ca7fc700 1 -- 172.21.15.2:0/878996926 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c400ae90 con 0x7f54cc0adbd0 2023-11-26T07:13:54.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.847+0000 7f54d3e27700 1 -- 172.21.15.2:0/878996926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54cc14f610 con 0x7f54cc0adbd0 2023-11-26T07:13:54.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.847+0000 7f54ca7fc700 1 -- 172.21.15.2:0/878996926 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c4003c40 con 0x7f54cc0adbd0 2023-11-26T07:13:54.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.847+0000 7f54d3e27700 1 -- 172.21.15.2:0/878996926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54cc149d60 con 0x7f54cc0adbd0 2023-11-26T07:13:54.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.848+0000 7f54d3e27700 1 -- 172.21.15.2:0/878996926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54cc068670 con 0x7f54cc0adbd0 2023-11-26T07:13:54.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.849+0000 7f54ca7fc700 1 -- 172.21.15.2:0/878996926 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f54c4004020 con 0x7f54cc0adbd0 2023-11-26T07:13:54.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.849+0000 7f54ca7fc700 1 --2- 172.21.15.2:0/878996926 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f54b806b1a0 0x7f54b806d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:54.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.849+0000 7f54ca7fc700 1 -- 172.21.15.2:0/878996926 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f54c4089ce0 con 0x7f54cc0adbd0 2023-11-26T07:13:54.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.850+0000 7f54d13c2700 1 --2- 172.21.15.2:0/878996926 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f54b806b1a0 0x7f54b806d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:54.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.850+0000 7f54d13c2700 1 --2- 172.21.15.2:0/878996926 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f54b806b1a0 0x7f54b806d660 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f54c0009870 tx=0x7f54c0008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:54.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:54.854+0000 7f54ca7fc700 1 -- 172.21.15.2:0/878996926 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f54c40549c0 con 0x7f54cc0adbd0 2023-11-26T07:13:55.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.056+0000 7f54d3e27700 1 -- 172.21.15.2:0/878996926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54cc06f180 con 0x7f54cc0adbd0 2023-11-26T07:13:55.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.057+0000 7f54ca7fc700 1 -- 172.21.15.2:0/878996926 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+16478 (secure 0 0 0) 0x7f54c401d070 con 0x7f54cc0adbd0 2023-11-26T07:13:55.059 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:13:55.059 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":44,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:13:53.741133+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:13:52.197275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-26T07:13:52.705487+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:13:55.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.059+0000 7f54d3e27700 1 -- 172.21.15.2:0/878996926 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f54b806b1a0 msgr2=0x7f54b806d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:55.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.059+0000 7f54d3e27700 1 --2- 172.21.15.2:0/878996926 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f54b806b1a0 0x7f54b806d660 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f54c0009870 tx=0x7f54c0008030 comp rx=0 tx=0).stop 2023-11-26T07:13:55.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.059+0000 7f54d3e27700 1 -- 172.21.15.2:0/878996926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54cc0adbd0 msgr2=0x7f54cc14d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:55.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.059+0000 7f54d3e27700 1 --2- 172.21.15.2:0/878996926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54cc0adbd0 0x7f54cc14d400 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f54c400ccd0 tx=0x7f54c400a4d0 comp rx=0 tx=0).stop 2023-11-26T07:13:55.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.059+0000 7f54d3e27700 1 -- 172.21.15.2:0/878996926 shutdown_connections 2023-11-26T07:13:55.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.059+0000 7f54d3e27700 1 --2- 172.21.15.2:0/878996926 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f54b806b1a0 0x7f54b806d660 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:55.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.059+0000 7f54d3e27700 1 --2- 172.21.15.2:0/878996926 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54cc15ad70 0x7f54cc149820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:55.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.059+0000 7f54d3e27700 1 --2- 172.21.15.2:0/878996926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54cc0adbd0 0x7f54cc14d400 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:55.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.059+0000 7f54d3e27700 1 --2- 172.21.15.2:0/878996926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54cc0b03b0 0x7f54cc14b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:55.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.059+0000 7f54d3e27700 1 -- 172.21.15.2:0/878996926 >> 172.21.15.2:0/878996926 conn(0x7f54cc0b5070 msgr2=0x7f54cc157010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:55.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.060+0000 7f54d3e27700 1 -- 172.21.15.2:0/878996926 shutdown_connections 2023-11-26T07:13:55.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.060+0000 7f54d3e27700 1 -- 172.21.15.2:0/878996926 wait complete. 2023-11-26T07:13:55.074 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-26T07:13:55.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.200+0000 7f18b94c2700 1 Processor -- start 2023-11-26T07:13:55.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.200+0000 7f18b94c2700 1 -- start start 2023-11-26T07:13:55.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.200+0000 7f18b94c2700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f18b40d0870 0x7f18b40d26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:55.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.200+0000 7f18b94c2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18b40d0c50 0x7f18b40d49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:55.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.201+0000 7f18b94c2700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f18b40cf860 0x7f18b40b6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:55.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.201+0000 7f18b94c2700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18b40d2f80 con 0x7f18b40cf860 2023-11-26T07:13:55.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.201+0000 7f18b94c2700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18b40b5370 con 0x7f18b40d0870 2023-11-26T07:13:55.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.201+0000 7f18b94c2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b40ceae0 con 0x7f18b40d0c50 2023-11-26T07:13:55.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.201+0000 7f18b37fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f18b40cf860 0x7f18b40b6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:55.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.201+0000 7f18b37fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f18b40cf860 0x7f18b40b6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41944/0 (socket says 172.21.15.2:41944) 2023-11-26T07:13:55.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.201+0000 7f18b37fe700 1 -- 172.21.15.2:0/1785481235 learned_addr learned my addr 172.21.15.2:0/1785481235 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:55.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.201+0000 7f18b2ffd700 1 --2- 172.21.15.2:0/1785481235 >> v2:172.21.15.192:3300/0 conn(0x7f18b40d0870 0x7f18b40d26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:55.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.201+0000 7f18b27fc700 1 --2- 172.21.15.2:0/1785481235 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18b40d0c50 0x7f18b40d49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:55.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.201+0000 7f18b37fe700 1 -- 172.21.15.2:0/1785481235 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18b40d0c50 msgr2=0x7f18b40d49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:55.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.201+0000 7f18b37fe700 1 --2- 172.21.15.2:0/1785481235 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18b40d0c50 0x7f18b40d49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:55.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.201+0000 7f18b37fe700 1 -- 172.21.15.2:0/1785481235 >> v2:172.21.15.192:3300/0 conn(0x7f18b40d0870 msgr2=0x7f18b40d26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:55.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.201+0000 7f18b37fe700 1 --2- 172.21.15.2:0/1785481235 >> v2:172.21.15.192:3300/0 conn(0x7f18b40d0870 0x7f18b40d26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:55.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.201+0000 7f18b37fe700 1 -- 172.21.15.2:0/1785481235 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b40d2ca0 con 0x7f18b40cf860 2023-11-26T07:13:55.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.201+0000 7f18b37fe700 1 --2- 172.21.15.2:0/1785481235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18b40cf860 0x7f18b40b6d20 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f18b408c560 tx=0x7f18ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fcb32818b963661 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:55.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.201+0000 7f18b1ffb700 1 -- 172.21.15.2:0/1785481235 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ac00e070 con 0x7f18b40cf860 2023-11-26T07:13:55.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.201+0000 7f18b1ffb700 1 -- 172.21.15.2:0/1785481235 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18ac00b9c0 con 0x7f18b40cf860 2023-11-26T07:13:55.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.201+0000 7f18b1ffb700 1 -- 172.21.15.2:0/1785481235 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ac00bd70 con 0x7f18b40cf860 2023-11-26T07:13:55.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.202+0000 7f18b94c2700 1 -- 172.21.15.2:0/1785481235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18b40cf860 msgr2=0x7f18b40b6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:55.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.202+0000 7f18b94c2700 1 --2- 172.21.15.2:0/1785481235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18b40cf860 0x7f18b40b6d20 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f18b408c560 tx=0x7f18ac00b330 comp rx=0 tx=0).stop 2023-11-26T07:13:55.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.202+0000 7f18b94c2700 1 -- 172.21.15.2:0/1785481235 shutdown_connections 2023-11-26T07:13:55.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.202+0000 7f18b94c2700 1 --2- 172.21.15.2:0/1785481235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18b40cf860 0x7f18b40b6d20 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:55.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.202+0000 7f18b94c2700 1 --2- 172.21.15.2:0/1785481235 >> v2:172.21.15.192:3300/0 conn(0x7f18b40d0870 0x7f18b40d26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:55.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.202+0000 7f18b94c2700 1 --2- 172.21.15.2:0/1785481235 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18b40d0c50 0x7f18b40d49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:55.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.202+0000 7f18b94c2700 1 -- 172.21.15.2:0/1785481235 >> 172.21.15.2:0/1785481235 conn(0x7f18b40d3ed0 msgr2=0x7f18b40d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:55.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.202+0000 7f18b94c2700 1 -- 172.21.15.2:0/1785481235 shutdown_connections 2023-11-26T07:13:55.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.202+0000 7f18b94c2700 1 -- 172.21.15.2:0/1785481235 wait complete. 2023-11-26T07:13:55.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.203+0000 7f18b94c2700 1 Processor -- start 2023-11-26T07:13:55.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.203+0000 7f18b94c2700 1 -- start start 2023-11-26T07:13:55.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.204+0000 7f18b94c2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18b40cf860 0x7f18b4154390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:55.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.204+0000 7f18b94c2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18b40d0870 0x7f18b4155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:55.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.204+0000 7f18b94c2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18b40d0c50 0x7f18b4158760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:55.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.204+0000 7f18b94c2700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b4158ca0 con 0x7f18b40d0c50 2023-11-26T07:13:55.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.204+0000 7f18b94c2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b4154970 con 0x7f18b40d0870 2023-11-26T07:13:55.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.204+0000 7f18b94c2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b4154c50 con 0x7f18b40cf860 2023-11-26T07:13:55.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.204+0000 7f18b37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18b40d0c50 0x7f18b4158760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:55.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.204+0000 7f18b37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18b40d0c50 0x7f18b4158760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41950/0 (socket says 172.21.15.2:41950) 2023-11-26T07:13:55.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.204+0000 7f18b37fe700 1 -- 172.21.15.2:0/2865065732 learned_addr learned my addr 172.21.15.2:0/2865065732 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.204+0000 7f18b2ffd700 1 --2- 172.21.15.2:0/2865065732 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18b40cf860 0x7f18b4154390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.204+0000 7f18b27fc700 1 --2- 172.21.15.2:0/2865065732 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18b40d0870 0x7f18b4155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.204+0000 7f18b37fe700 1 -- 172.21.15.2:0/2865065732 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18b40cf860 msgr2=0x7f18b4154390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.204+0000 7f18b37fe700 1 --2- 172.21.15.2:0/2865065732 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18b40cf860 0x7f18b4154390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.205+0000 7f18b37fe700 1 -- 172.21.15.2:0/2865065732 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18b40d0870 msgr2=0x7f18b4155a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.205+0000 7f18b37fe700 1 --2- 172.21.15.2:0/2865065732 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18b40d0870 0x7f18b4155a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.205+0000 7f18b37fe700 1 -- 172.21.15.2:0/2865065732 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ac009b30 con 0x7f18b40d0c50 2023-11-26T07:13:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.205+0000 7f18b37fe700 1 --2- 172.21.15.2:0/2865065732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18b40d0c50 0x7f18b4158760 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f18b408c300 tx=0x7f18ac004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.205+0000 7f189b7fe700 1 -- 172.21.15.2:0/2865065732 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ac004250 con 0x7f18b40d0c50 2023-11-26T07:13:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.205+0000 7f189b7fe700 1 -- 172.21.15.2:0/2865065732 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18ac0043d0 con 0x7f18b40d0c50 2023-11-26T07:13:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.205+0000 7f18b94c2700 1 -- 172.21.15.2:0/2865065732 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18b4154f30 con 0x7f18b40d0c50 2023-11-26T07:13:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.205+0000 7f189b7fe700 1 -- 172.21.15.2:0/2865065732 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ac004780 con 0x7f18b40d0c50 2023-11-26T07:13:55.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.205+0000 7f18b94c2700 1 -- 172.21.15.2:0/2865065732 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18b41554f0 con 0x7f18b40d0c50 2023-11-26T07:13:55.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.206+0000 7f18b94c2700 1 -- 172.21.15.2:0/2865065732 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18b40b57c0 con 0x7f18b40d0c50 2023-11-26T07:13:55.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.206+0000 7f189b7fe700 1 -- 172.21.15.2:0/2865065732 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f18ac01b430 con 0x7f18b40d0c50 2023-11-26T07:13:55.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.207+0000 7f189b7fe700 1 --2- 172.21.15.2:0/2865065732 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f18a006b1a0 0x7f18a006d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:55.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.207+0000 7f189b7fe700 1 -- 172.21.15.2:0/2865065732 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f18ac08ad00 con 0x7f18b40d0c50 2023-11-26T07:13:55.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.207+0000 7f18b2ffd700 1 --2- 172.21.15.2:0/2865065732 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f18a006b1a0 0x7f18a006d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:55.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.208+0000 7f18b2ffd700 1 --2- 172.21.15.2:0/2865065732 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f18a006b1a0 0x7f18a006d660 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f18a400ba10 tx=0x7f18a4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:55.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.211+0000 7f189b7fe700 1 -- 172.21.15.2:0/2865065732 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f18ac0559e0 con 0x7f18b40d0c50 2023-11-26T07:13:55.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:55.460+0000 7f18b94c2700 1 -- 172.21.15.2:0/2865065732 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f18b4067a20 con 0x7f18b40d0c50 2023-11-26T07:13:56.308 INFO:tasks.ceph.mds.b.smithi192.stderr:2023-11-26T07:13:56.306+0000 7ff96dbd5700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-26T07:13:56.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.356+0000 7f189b7fe700 1 -- 172.21.15.2:0/2865065732 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v25) v1 ==== 118+0+0 (secure 0 0 0) 0x7f18ac01f020 con 0x7f18b40d0c50 2023-11-26T07:13:56.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.360+0000 7f18b94c2700 1 -- 172.21.15.2:0/2865065732 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f18a006b1a0 msgr2=0x7f18a006d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:56.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.360+0000 7f18b94c2700 1 --2- 172.21.15.2:0/2865065732 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f18a006b1a0 0x7f18a006d660 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f18a400ba10 tx=0x7f18a4008040 comp rx=0 tx=0).stop 2023-11-26T07:13:56.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.360+0000 7f18b94c2700 1 -- 172.21.15.2:0/2865065732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18b40d0c50 msgr2=0x7f18b4158760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:56.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.360+0000 7f18b94c2700 1 --2- 172.21.15.2:0/2865065732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18b40d0c50 0x7f18b4158760 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f18b408c300 tx=0x7f18ac004ad0 comp rx=0 tx=0).stop 2023-11-26T07:13:56.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.360+0000 7f18b94c2700 1 -- 172.21.15.2:0/2865065732 shutdown_connections 2023-11-26T07:13:56.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.360+0000 7f18b94c2700 1 --2- 172.21.15.2:0/2865065732 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f18a006b1a0 0x7f18a006d660 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:56.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.360+0000 7f18b94c2700 1 --2- 172.21.15.2:0/2865065732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18b40d0c50 0x7f18b4158760 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:56.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.360+0000 7f18b94c2700 1 --2- 172.21.15.2:0/2865065732 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18b40cf860 0x7f18b4154390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:56.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.360+0000 7f18b94c2700 1 --2- 172.21.15.2:0/2865065732 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18b40d0870 0x7f18b4155a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:56.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.360+0000 7f18b94c2700 1 -- 172.21.15.2:0/2865065732 >> 172.21.15.2:0/2865065732 conn(0x7f18b40d3ed0 msgr2=0x7f18b415bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:56.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.360+0000 7f18b94c2700 1 -- 172.21.15.2:0/2865065732 shutdown_connections 2023-11-26T07:13:56.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.360+0000 7f18b94c2700 1 -- 172.21.15.2:0/2865065732 wait complete. 2023-11-26T07:13:56.379 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-26T07:13:56.380 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-26T07:13:56.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.517+0000 7fce4eafe700 1 Processor -- start 2023-11-26T07:13:56.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.517+0000 7fce4eafe700 1 -- start start 2023-11-26T07:13:56.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.517+0000 7fce4eafe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fce480b03b0 0x7fce480b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:56.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.517+0000 7fce4eafe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce480adda0 0x7fce4806b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:56.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.517+0000 7fce4eafe700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce480b0ec0 con 0x7fce4815ae00 2023-11-26T07:13:56.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.517+0000 7fce4eafe700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce48073610 con 0x7fce480b03b0 2023-11-26T07:13:56.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.517+0000 7fce4eafe700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce4815b1e0 con 0x7fce480adda0 2023-11-26T07:13:56.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.518+0000 7fce4c89a700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fce4815ae00 0x7fce480ad690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33164/0 (socket says 172.21.15.2:33164) 2023-11-26T07:13:56.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.518+0000 7fce4c89a700 1 -- 172.21.15.2:0/1752621779 learned_addr learned my addr 172.21.15.2:0/1752621779 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:13:56.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.518+0000 7fce47fff700 1 --2- 172.21.15.2:0/1752621779 >> v2:172.21.15.192:3300/0 conn(0x7fce480b03b0 0x7fce480b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:56.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.518+0000 7fce4d09b700 1 --2- 172.21.15.2:0/1752621779 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce480adda0 0x7fce4806b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:56.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.518+0000 7fce477fe700 1 -- 172.21.15.2:0/1752621779 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1802950078 0 0) 0x7fce480b0ec0 con 0x7fce4815ae00 2023-11-26T07:13:56.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.518+0000 7fce477fe700 1 -- 172.21.15.2:0/1752621779 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce380035b0 con 0x7fce4815ae00 2023-11-26T07:13:56.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.518+0000 7fce47fff700 1 -- 172.21.15.2:0/1752621779 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce480adda0 msgr2=0x7fce4806b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:56.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.518+0000 7fce47fff700 1 --2- 172.21.15.2:0/1752621779 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce480adda0 0x7fce4806b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:56.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.518+0000 7fce47fff700 1 -- 172.21.15.2:0/1752621779 >> v1:172.21.15.2:6789/0 conn(0x7fce4815ae00 legacy=0x7fce480ad690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:56.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.518+0000 7fce47fff700 1 -- 172.21.15.2:0/1752621779 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce480b0900 con 0x7fce480b03b0 2023-11-26T07:13:56.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.519+0000 7fce47fff700 1 --2- 172.21.15.2:0/1752621779 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce480b03b0 0x7fce480b5e40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fce34009840 tx=0x7fce34009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33246a87eb0b1b12 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:56.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.519+0000 7fce477fe700 1 -- 172.21.15.2:0/1752621779 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce34011830 con 0x7fce480b03b0 2023-11-26T07:13:56.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.519+0000 7fce477fe700 1 -- 172.21.15.2:0/1752621779 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce34011990 con 0x7fce480b03b0 2023-11-26T07:13:56.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.519+0000 7fce477fe700 1 -- 172.21.15.2:0/1752621779 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce34011d00 con 0x7fce480b03b0 2023-11-26T07:13:56.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.520+0000 7fce4eafe700 1 -- 172.21.15.2:0/1752621779 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce480b03b0 msgr2=0x7fce480b5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:56.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.520+0000 7fce4eafe700 1 --2- 172.21.15.2:0/1752621779 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce480b03b0 0x7fce480b5e40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fce34009840 tx=0x7fce34009b50 comp rx=0 tx=0).stop 2023-11-26T07:13:56.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.521+0000 7fce4eafe700 1 -- 172.21.15.2:0/1752621779 shutdown_connections 2023-11-26T07:13:56.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.521+0000 7fce4eafe700 1 --2- 172.21.15.2:0/1752621779 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce480adda0 0x7fce4806b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:56.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.521+0000 7fce4eafe700 1 --2- 172.21.15.2:0/1752621779 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce480b03b0 0x7fce480b5e40 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:56.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.521+0000 7fce4eafe700 1 -- 172.21.15.2:0/1752621779 >> 172.21.15.2:0/1752621779 conn(0x7fce480b5070 msgr2=0x7fce480b5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:56.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.521+0000 7fce4eafe700 1 -- 172.21.15.2:0/1752621779 shutdown_connections 2023-11-26T07:13:56.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.521+0000 7fce4eafe700 1 -- 172.21.15.2:0/1752621779 wait complete. 2023-11-26T07:13:56.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.522+0000 7fce4eafe700 1 Processor -- start 2023-11-26T07:13:56.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.522+0000 7fce4eafe700 1 -- start start 2023-11-26T07:13:56.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.523+0000 7fce4eafe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce480adda0 0x7fce48145660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:56.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.523+0000 7fce4eafe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce480b03b0 0x7fce48159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:56.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.523+0000 7fce4eafe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce4815ae00 0x7fce4815a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:56.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.523+0000 7fce4eafe700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4815db90 con 0x7fce480b03b0 2023-11-26T07:13:56.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.523+0000 7fce4eafe700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4815f3b0 con 0x7fce480adda0 2023-11-26T07:13:56.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.523+0000 7fce4eafe700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce4815dde0 con 0x7fce4815ae00 2023-11-26T07:13:56.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.524+0000 7fce47fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce480b03b0 0x7fce48159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:56.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.524+0000 7fce47fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce480b03b0 0x7fce48159bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41962/0 (socket says 172.21.15.2:41962) 2023-11-26T07:13:56.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.524+0000 7fce47fff700 1 -- 172.21.15.2:0/1065402448 learned_addr learned my addr 172.21.15.2:0/1065402448 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:56.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.524+0000 7fce4c89a700 1 --2- 172.21.15.2:0/1065402448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce480adda0 0x7fce48145660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:56.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.524+0000 7fce4d09b700 1 --2- 172.21.15.2:0/1065402448 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce4815ae00 0x7fce4815a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:56.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.524+0000 7fce47fff700 1 -- 172.21.15.2:0/1065402448 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce4815ae00 msgr2=0x7fce4815a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:56.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.524+0000 7fce47fff700 1 --2- 172.21.15.2:0/1065402448 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce4815ae00 0x7fce4815a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:56.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.524+0000 7fce47fff700 1 -- 172.21.15.2:0/1065402448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce480adda0 msgr2=0x7fce48145660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:56.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.524+0000 7fce47fff700 1 --2- 172.21.15.2:0/1065402448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce480adda0 0x7fce48145660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:56.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.524+0000 7fce47fff700 1 -- 172.21.15.2:0/1065402448 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce340094a0 con 0x7fce480b03b0 2023-11-26T07:13:56.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.524+0000 7fce47fff700 1 --2- 172.21.15.2:0/1065402448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce480b03b0 0x7fce48159bc0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fce34009fd0 tx=0x7fce34004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:56.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.524+0000 7fce457fa700 1 -- 172.21.15.2:0/1065402448 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce34004550 con 0x7fce480b03b0 2023-11-26T07:13:56.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.524+0000 7fce457fa700 1 -- 172.21.15.2:0/1065402448 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce3401f070 con 0x7fce480b03b0 2023-11-26T07:13:56.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.524+0000 7fce457fa700 1 -- 172.21.15.2:0/1065402448 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce340038c0 con 0x7fce480b03b0 2023-11-26T07:13:56.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.524+0000 7fce4eafe700 1 -- 172.21.15.2:0/1065402448 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce4815e0c0 con 0x7fce480b03b0 2023-11-26T07:13:56.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.524+0000 7fce4eafe700 1 -- 172.21.15.2:0/1065402448 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce48145ba0 con 0x7fce480b03b0 2023-11-26T07:13:56.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.525+0000 7fce4eafe700 1 -- 172.21.15.2:0/1065402448 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce48159a10 con 0x7fce480b03b0 2023-11-26T07:13:56.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.526+0000 7fce457fa700 1 -- 172.21.15.2:0/1065402448 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7fce34003a20 con 0x7fce480b03b0 2023-11-26T07:13:56.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.526+0000 7fce457fa700 1 --2- 172.21.15.2:0/1065402448 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fce2c06b1a0 0x7fce2c06d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:56.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.526+0000 7fce457fa700 1 -- 172.21.15.2:0/1065402448 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce34021070 con 0x7fce480b03b0 2023-11-26T07:13:56.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.527+0000 7fce4c89a700 1 --2- 172.21.15.2:0/1065402448 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fce2c06b1a0 0x7fce2c06d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:56.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.527+0000 7fce4c89a700 1 --2- 172.21.15.2:0/1065402448 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fce2c06b1a0 0x7fce2c06d660 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fce3c007fd0 tx=0x7fce3c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:56.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.531+0000 7fce457fa700 1 -- 172.21.15.2:0/1065402448 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fce34055ef0 con 0x7fce480b03b0 2023-11-26T07:13:56.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:56.777+0000 7fce4eafe700 1 -- 172.21.15.2:0/1065402448 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fce48075480 con 0x7fce480b03b0 2023-11-26T07:13:57.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.357+0000 7fce457fa700 1 -- 172.21.15.2:0/1065402448 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7fce340150c0 con 0x7fce480b03b0 2023-11-26T07:13:57.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.360+0000 7fce4eafe700 1 -- 172.21.15.2:0/1065402448 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fce2c06b1a0 msgr2=0x7fce2c06d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:57.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.360+0000 7fce4eafe700 1 --2- 172.21.15.2:0/1065402448 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fce2c06b1a0 0x7fce2c06d660 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fce3c007fd0 tx=0x7fce3c009040 comp rx=0 tx=0).stop 2023-11-26T07:13:57.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.360+0000 7fce4eafe700 1 -- 172.21.15.2:0/1065402448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce480b03b0 msgr2=0x7fce48159bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:57.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.360+0000 7fce4eafe700 1 --2- 172.21.15.2:0/1065402448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce480b03b0 0x7fce48159bc0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fce34009fd0 tx=0x7fce34004750 comp rx=0 tx=0).stop 2023-11-26T07:13:57.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.360+0000 7fce4eafe700 1 -- 172.21.15.2:0/1065402448 shutdown_connections 2023-11-26T07:13:57.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.360+0000 7fce4eafe700 1 --2- 172.21.15.2:0/1065402448 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fce2c06b1a0 0x7fce2c06d660 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:57.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.360+0000 7fce4eafe700 1 --2- 172.21.15.2:0/1065402448 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce4815ae00 0x7fce4815a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:57.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.360+0000 7fce4eafe700 1 --2- 172.21.15.2:0/1065402448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce480adda0 0x7fce48145660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:57.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.360+0000 7fce4eafe700 1 --2- 172.21.15.2:0/1065402448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce480b03b0 0x7fce48159bc0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:57.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.360+0000 7fce4eafe700 1 -- 172.21.15.2:0/1065402448 >> 172.21.15.2:0/1065402448 conn(0x7fce480b5070 msgr2=0x7fce480ad650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:57.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.360+0000 7fce4eafe700 1 -- 172.21.15.2:0/1065402448 shutdown_connections 2023-11-26T07:13:57.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.360+0000 7fce4eafe700 1 -- 172.21.15.2:0/1065402448 wait complete. 2023-11-26T07:13:57.376 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-26T07:13:57.377 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:13:57.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.505+0000 7f01000de700 1 Processor -- start 2023-11-26T07:13:57.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.505+0000 7f01000de700 1 -- start start 2023-11-26T07:13:57.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.506+0000 7f01000de700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f00f8143ae0 0x7f00f80b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:57.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.506+0000 7f01000de700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00f80722c0 0x7f00f806e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:57.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.506+0000 7f01000de700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00f8143ec0 con 0x7f00f81440f0 2023-11-26T07:13:57.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.506+0000 7f01000de700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00f80b40a0 con 0x7f00f8143ae0 2023-11-26T07:13:57.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.506+0000 7f01000de700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f80b3ae0 con 0x7f00f80722c0 2023-11-26T07:13:57.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.506+0000 7f00fde7a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f00f8143ae0 0x7f00f80b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:57.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.506+0000 7f00fd679700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f00f81440f0 0x7f00f8071bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33178/0 (socket says 172.21.15.2:33178) 2023-11-26T07:13:57.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.506+0000 7f00fd679700 1 -- 172.21.15.2:0/1321903020 learned_addr learned my addr 172.21.15.2:0/1321903020 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:13:57.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.506+0000 7f00fde7a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f00f8143ae0 0x7f00f80b51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41968/0 (socket says 172.21.15.2:41968) 2023-11-26T07:13:57.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.506+0000 7f00fe67b700 1 --2- 172.21.15.2:0/1321903020 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00f80722c0 0x7f00f806e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:57.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.506+0000 7f00fde7a700 1 -- 172.21.15.2:0/1321903020 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00f80722c0 msgr2=0x7f00f806e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:57.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.506+0000 7f00fde7a700 1 --2- 172.21.15.2:0/1321903020 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00f80722c0 0x7f00f806e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:57.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.506+0000 7f00fde7a700 1 -- 172.21.15.2:0/1321903020 >> v1:172.21.15.2:6789/0 conn(0x7f00f81440f0 legacy=0x7f00f8071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:57.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.506+0000 7f00fce78700 1 -- 172.21.15.2:0/1321903020 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1629791414 0 0) 0x7f00f8143ec0 con 0x7f00f81440f0 2023-11-26T07:13:57.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.506+0000 7f00fde7a700 1 -- 172.21.15.2:0/1321903020 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f80b3dc0 con 0x7f00f8143ae0 2023-11-26T07:13:57.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.507+0000 7f00fde7a700 1 --2- 172.21.15.2:0/1321903020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00f8143ae0 0x7f00f80b51b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f00e800bae0 tx=0x7f00e800bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3a9d6e71813bd60 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:57.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.507+0000 7f00fce78700 1 -- 172.21.15.2:0/1321903020 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e800dd30 con 0x7f00f8143ae0 2023-11-26T07:13:57.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.507+0000 7f00fce78700 1 -- 172.21.15.2:0/1321903020 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e800de90 con 0x7f00f8143ae0 2023-11-26T07:13:57.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.507+0000 7f00fce78700 1 -- 172.21.15.2:0/1321903020 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e8010690 con 0x7f00f8143ae0 2023-11-26T07:13:57.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.507+0000 7f01000de700 1 -- 172.21.15.2:0/1321903020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00f8143ae0 msgr2=0x7f00f80b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:57.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.507+0000 7f01000de700 1 --2- 172.21.15.2:0/1321903020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00f8143ae0 0x7f00f80b51b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f00e800bae0 tx=0x7f00e800bdf0 comp rx=0 tx=0).stop 2023-11-26T07:13:57.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.507+0000 7f01000de700 1 -- 172.21.15.2:0/1321903020 shutdown_connections 2023-11-26T07:13:57.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.507+0000 7f01000de700 1 --2- 172.21.15.2:0/1321903020 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00f80722c0 0x7f00f806e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:57.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.507+0000 7f01000de700 1 --2- 172.21.15.2:0/1321903020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00f8143ae0 0x7f00f80b51b0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:57.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.507+0000 7f01000de700 1 -- 172.21.15.2:0/1321903020 >> 172.21.15.2:0/1321903020 conn(0x7f00f80b2740 msgr2=0x7f00f80b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:57.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.507+0000 7f01000de700 1 -- 172.21.15.2:0/1321903020 shutdown_connections 2023-11-26T07:13:57.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.507+0000 7f01000de700 1 -- 172.21.15.2:0/1321903020 wait complete. 2023-11-26T07:13:57.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.509+0000 7f01000de700 1 Processor -- start 2023-11-26T07:13:57.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.509+0000 7f01000de700 1 -- start start 2023-11-26T07:13:57.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.509+0000 7f01000de700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00f80722c0 0x7f00f8137460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:57.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.509+0000 7f01000de700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00f8143ae0 0x7f00f80cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:57.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.509+0000 7f01000de700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00f81440f0 0x7f00f80ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:57.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.509+0000 7f01000de700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f8152990 con 0x7f00f81440f0 2023-11-26T07:13:57.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.509+0000 7f01000de700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f81535c0 con 0x7f00f8143ae0 2023-11-26T07:13:57.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.509+0000 7f01000de700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f81379a0 con 0x7f00f80722c0 2023-11-26T07:13:57.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.509+0000 7f00fe67b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00f81440f0 0x7f00f80ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:57.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.510+0000 7f00fe67b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00f81440f0 0x7f00f80ce4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41976/0 (socket says 172.21.15.2:41976) 2023-11-26T07:13:57.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.510+0000 7f00fe67b700 1 -- 172.21.15.2:0/2363724336 learned_addr learned my addr 172.21.15.2:0/2363724336 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:57.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.510+0000 7f00fde7a700 1 --2- 172.21.15.2:0/2363724336 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00f80722c0 0x7f00f8137460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:57.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.510+0000 7f00fd679700 1 --2- 172.21.15.2:0/2363724336 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00f8143ae0 0x7f00f80cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:57.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.510+0000 7f00fe67b700 1 -- 172.21.15.2:0/2363724336 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00f80722c0 msgr2=0x7f00f8137460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:57.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.510+0000 7f00fe67b700 1 --2- 172.21.15.2:0/2363724336 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00f80722c0 0x7f00f8137460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:57.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.510+0000 7f00fe67b700 1 -- 172.21.15.2:0/2363724336 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00f8143ae0 msgr2=0x7f00f80cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:57.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.510+0000 7f00fe67b700 1 --2- 172.21.15.2:0/2363724336 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00f8143ae0 0x7f00f80cdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:57.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.510+0000 7f00fe67b700 1 -- 172.21.15.2:0/2363724336 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e800b740 con 0x7f00f81440f0 2023-11-26T07:13:57.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.510+0000 7f00fe67b700 1 --2- 172.21.15.2:0/2363724336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00f81440f0 0x7f00f80ce4d0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f00f0007e60 tx=0x7f00f000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:57.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.510+0000 7f00ee7fc700 1 -- 172.21.15.2:0/2363724336 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f000ed30 con 0x7f00f81440f0 2023-11-26T07:13:57.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.510+0000 7f00ee7fc700 1 -- 172.21.15.2:0/2363724336 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f000ee90 con 0x7f00f81440f0 2023-11-26T07:13:57.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.510+0000 7f01000de700 1 -- 172.21.15.2:0/2363724336 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f8152cd0 con 0x7f00f81440f0 2023-11-26T07:13:57.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.510+0000 7f00ee7fc700 1 -- 172.21.15.2:0/2363724336 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f0014660 con 0x7f00f81440f0 2023-11-26T07:13:57.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.510+0000 7f01000de700 1 -- 172.21.15.2:0/2363724336 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f8153250 con 0x7f00f81440f0 2023-11-26T07:13:57.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.511+0000 7f01000de700 1 -- 172.21.15.2:0/2363724336 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00f8153770 con 0x7f00f81440f0 2023-11-26T07:13:57.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.512+0000 7f00ee7fc700 1 -- 172.21.15.2:0/2363724336 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f00f00147c0 con 0x7f00f81440f0 2023-11-26T07:13:57.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.512+0000 7f00ee7fc700 1 --2- 172.21.15.2:0/2363724336 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f00dc06b1a0 0x7f00dc06d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:57.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.512+0000 7f00ee7fc700 1 -- 172.21.15.2:0/2363724336 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f00f008a0c0 con 0x7f00f81440f0 2023-11-26T07:13:57.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.512+0000 7f00fde7a700 1 --2- 172.21.15.2:0/2363724336 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f00dc06b1a0 0x7f00dc06d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:57.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.513+0000 7f00fde7a700 1 --2- 172.21.15.2:0/2363724336 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f00dc06b1a0 0x7f00dc06d660 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f00e800be30 tx=0x7f00e8013000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:57.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.517+0000 7f00ee7fc700 1 -- 172.21.15.2:0/2363724336 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f00f8153770 con 0x7f00f81440f0 2023-11-26T07:13:57.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.762+0000 7f01000de700 1 -- 172.21.15.2:0/2363724336 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f00f8153770 con 0x7f00f81440f0 2023-11-26T07:13:57.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.763+0000 7f00ee7fc700 1 -- 172.21.15.2:0/2363724336 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f00f0054e20 con 0x7f00f81440f0 2023-11-26T07:13:57.764 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:13:57.765 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5051,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2052180749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":2052180749},{"type":"v1","addr":"172.21.15.2:6835","nonce":2052180749}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/1795687093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1795687093},{"type":"v1","addr":"172.21.15.2:6834","nonce":1795687093}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5646,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2009465289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2009465289},{"type":"v1","addr":"172.21.15.192:6837","nonce":2009465289}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:13:53.741450+0000","modified":"2023-11-26T07:13:56.778566+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5649},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5649":{"gid":5649,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6836/2352660671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2352660671},{"type":"v1","addr":"172.21.15.192:6836","nonce":2352660671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-26T07:13:57.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.764+0000 7f01000de700 1 -- 172.21.15.2:0/2363724336 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f00dc06b1a0 msgr2=0x7f00dc06d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:57.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.764+0000 7f01000de700 1 --2- 172.21.15.2:0/2363724336 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f00dc06b1a0 0x7f00dc06d660 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f00e800be30 tx=0x7f00e8013000 comp rx=0 tx=0).stop 2023-11-26T07:13:57.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.764+0000 7f01000de700 1 -- 172.21.15.2:0/2363724336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00f81440f0 msgr2=0x7f00f80ce4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:57.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.764+0000 7f01000de700 1 --2- 172.21.15.2:0/2363724336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00f81440f0 0x7f00f80ce4d0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f00f0007e60 tx=0x7f00f000e3c0 comp rx=0 tx=0).stop 2023-11-26T07:13:57.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.765+0000 7f01000de700 1 -- 172.21.15.2:0/2363724336 shutdown_connections 2023-11-26T07:13:57.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.765+0000 7f01000de700 1 --2- 172.21.15.2:0/2363724336 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f00dc06b1a0 0x7f00dc06d660 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:57.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.765+0000 7f01000de700 1 --2- 172.21.15.2:0/2363724336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00f81440f0 0x7f00f80ce4d0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:57.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.765+0000 7f01000de700 1 --2- 172.21.15.2:0/2363724336 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00f80722c0 0x7f00f8137460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:57.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.765+0000 7f01000de700 1 --2- 172.21.15.2:0/2363724336 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00f8143ae0 0x7f00f80cdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:57.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.765+0000 7f01000de700 1 -- 172.21.15.2:0/2363724336 >> 172.21.15.2:0/2363724336 conn(0x7f00f80b2740 msgr2=0x7f00f8158ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:57.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.765+0000 7f01000de700 1 -- 172.21.15.2:0/2363724336 shutdown_connections 2023-11-26T07:13:57.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.765+0000 7f01000de700 1 -- 172.21.15.2:0/2363724336 wait complete. 2023-11-26T07:13:57.768 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2023-11-26T07:13:57.779 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:13:57.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.901+0000 7f87c80fa700 1 Processor -- start 2023-11-26T07:13:57.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.901+0000 7f87c80fa700 1 -- start start 2023-11-26T07:13:57.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.902+0000 7f87c80fa700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f87c006afd0 0x7f87c00b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:57.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.902+0000 7f87c80fa700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f87c006edc0 0x7f87c006b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:57.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.902+0000 7f87c80fa700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f87c006dba0 0x7f87c006e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:57.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.902+0000 7f87c80fa700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c006f830 con 0x7f87c006afd0 2023-11-26T07:13:57.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.902+0000 7f87c80fa700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00ad860 con 0x7f87c006edc0 2023-11-26T07:13:57.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.902+0000 7f87c80fa700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c00d0a20 con 0x7f87c006dba0 2023-11-26T07:13:57.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.902+0000 7f87c5e96700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f87c006afd0 0x7f87c00b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:57.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.902+0000 7f87c5e96700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f87c006afd0 0x7f87c00b5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41980/0 (socket says 172.21.15.2:41980) 2023-11-26T07:13:57.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.902+0000 7f87c5e96700 1 -- 172.21.15.2:0/3188600137 learned_addr learned my addr 172.21.15.2:0/3188600137 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:57.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.903+0000 7f87c6697700 1 --2- 172.21.15.2:0/3188600137 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f87c006dba0 0x7f87c006e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:57.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.903+0000 7f87c5695700 1 --2- 172.21.15.2:0/3188600137 >> v2:172.21.15.192:3300/0 conn(0x7f87c006edc0 0x7f87c006b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:57.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.903+0000 7f87c5e96700 1 -- 172.21.15.2:0/3188600137 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f87c006dba0 msgr2=0x7f87c006e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:57.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.903+0000 7f87c5e96700 1 --2- 172.21.15.2:0/3188600137 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f87c006dba0 0x7f87c006e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:57.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.903+0000 7f87c5e96700 1 -- 172.21.15.2:0/3188600137 >> v2:172.21.15.192:3300/0 conn(0x7f87c006edc0 msgr2=0x7f87c006b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:57.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.903+0000 7f87c5e96700 1 --2- 172.21.15.2:0/3188600137 >> v2:172.21.15.192:3300/0 conn(0x7f87c006edc0 0x7f87c006b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:57.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.903+0000 7f87c5e96700 1 -- 172.21.15.2:0/3188600137 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c0162a70 con 0x7f87c006afd0 2023-11-26T07:13:57.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.903+0000 7f87c6697700 1 --2- 172.21.15.2:0/3188600137 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f87c006dba0 0x7f87c006e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:13:57.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.903+0000 7f87c5695700 1 --2- 172.21.15.2:0/3188600137 >> v2:172.21.15.192:3300/0 conn(0x7f87c006edc0 0x7f87c006b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:13:57.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.903+0000 7f87c5e96700 1 --2- 172.21.15.2:0/3188600137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87c006afd0 0x7f87c00b5a70 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f87c006d560 tx=0x7f87b0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db699fcdf9520d19 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:57.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.903+0000 7f87c4e94700 1 -- 172.21.15.2:0/3188600137 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b000b870 con 0x7f87c006afd0 2023-11-26T07:13:57.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.903+0000 7f87c4e94700 1 -- 172.21.15.2:0/3188600137 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b000b9d0 con 0x7f87c006afd0 2023-11-26T07:13:57.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.903+0000 7f87c4e94700 1 -- 172.21.15.2:0/3188600137 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b000bd60 con 0x7f87c006afd0 2023-11-26T07:13:57.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.903+0000 7f87c80fa700 1 -- 172.21.15.2:0/3188600137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87c006afd0 msgr2=0x7f87c00b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:57.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.903+0000 7f87c80fa700 1 --2- 172.21.15.2:0/3188600137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87c006afd0 0x7f87c00b5a70 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f87c006d560 tx=0x7f87b0009bd0 comp rx=0 tx=0).stop 2023-11-26T07:13:57.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.904+0000 7f87c80fa700 1 -- 172.21.15.2:0/3188600137 shutdown_connections 2023-11-26T07:13:57.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.904+0000 7f87c80fa700 1 --2- 172.21.15.2:0/3188600137 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f87c006dba0 0x7f87c006e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:57.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.904+0000 7f87c80fa700 1 --2- 172.21.15.2:0/3188600137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87c006afd0 0x7f87c00b5a70 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:57.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.904+0000 7f87c80fa700 1 --2- 172.21.15.2:0/3188600137 >> v2:172.21.15.192:3300/0 conn(0x7f87c006edc0 0x7f87c006b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:57.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.904+0000 7f87c80fa700 1 -- 172.21.15.2:0/3188600137 >> 172.21.15.2:0/3188600137 conn(0x7f87c00b2840 msgr2=0x7f87c00b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:57.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.904+0000 7f87c80fa700 1 -- 172.21.15.2:0/3188600137 shutdown_connections 2023-11-26T07:13:57.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.904+0000 7f87c80fa700 1 -- 172.21.15.2:0/3188600137 wait complete. 2023-11-26T07:13:57.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.905+0000 7f87c80fa700 1 Processor -- start 2023-11-26T07:13:57.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.905+0000 7f87c80fa700 1 -- start start 2023-11-26T07:13:57.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.906+0000 7f87c80fa700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87c006afd0 0x7f87c0148600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:57.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.906+0000 7f87c80fa700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f87c006dba0 0x7f87c01602e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:57.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.906+0000 7f87c80fa700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87c006edc0 0x7f87c0160820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:57.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.906+0000 7f87c80fa700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c0148e90 con 0x7f87c006edc0 2023-11-26T07:13:57.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.906+0000 7f87c80fa700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c01490a0 con 0x7f87c006afd0 2023-11-26T07:13:57.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.906+0000 7f87c80fa700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c0149380 con 0x7f87c006dba0 2023-11-26T07:13:57.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.906+0000 7f87c6697700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87c006edc0 0x7f87c0160820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:57.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.906+0000 7f87c6697700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87c006edc0 0x7f87c0160820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41990/0 (socket says 172.21.15.2:41990) 2023-11-26T07:13:57.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.906+0000 7f87c6697700 1 -- 172.21.15.2:0/3917374198 learned_addr learned my addr 172.21.15.2:0/3917374198 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:57.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.906+0000 7f87c5e96700 1 --2- 172.21.15.2:0/3917374198 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87c006afd0 0x7f87c0148600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:57.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.906+0000 7f87c5695700 1 --2- 172.21.15.2:0/3917374198 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f87c006dba0 0x7f87c01602e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:57.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.906+0000 7f87c6697700 1 -- 172.21.15.2:0/3917374198 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f87c006dba0 msgr2=0x7f87c01602e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:57.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.906+0000 7f87c6697700 1 --2- 172.21.15.2:0/3917374198 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f87c006dba0 0x7f87c01602e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:57.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.906+0000 7f87c6697700 1 -- 172.21.15.2:0/3917374198 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87c006afd0 msgr2=0x7f87c0148600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:57.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.906+0000 7f87c6697700 1 --2- 172.21.15.2:0/3917374198 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87c006afd0 0x7f87c0148600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:57.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.906+0000 7f87c6697700 1 -- 172.21.15.2:0/3917374198 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b0009550 con 0x7f87c006edc0 2023-11-26T07:13:57.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.906+0000 7f87c6697700 1 --2- 172.21.15.2:0/3917374198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87c006edc0 0x7f87c0160820 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f87b800cef0 tx=0x7f87b800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:57.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.906+0000 7f87b67fc700 1 -- 172.21.15.2:0/3917374198 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b800ac80 con 0x7f87c006edc0 2023-11-26T07:13:57.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.906+0000 7f87b67fc700 1 -- 172.21.15.2:0/3917374198 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b800ade0 con 0x7f87c006edc0 2023-11-26T07:13:57.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.906+0000 7f87c80fa700 1 -- 172.21.15.2:0/3917374198 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87c0149660 con 0x7f87c006edc0 2023-11-26T07:13:57.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.906+0000 7f87b67fc700 1 -- 172.21.15.2:0/3917374198 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b8015680 con 0x7f87c006edc0 2023-11-26T07:13:57.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.906+0000 7f87c80fa700 1 -- 172.21.15.2:0/3917374198 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c0148b40 con 0x7f87c006edc0 2023-11-26T07:13:57.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.907+0000 7f87c80fa700 1 -- 172.21.15.2:0/3917374198 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87c01491e0 con 0x7f87c006edc0 2023-11-26T07:13:57.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.908+0000 7f87b67fc700 1 -- 172.21.15.2:0/3917374198 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f87b800d430 con 0x7f87c006edc0 2023-11-26T07:13:57.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.908+0000 7f87b67fc700 1 --2- 172.21.15.2:0/3917374198 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f87a406b1a0 0x7f87a406d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:57.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.908+0000 7f87b67fc700 1 -- 172.21.15.2:0/3917374198 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f87b8089e50 con 0x7f87c006edc0 2023-11-26T07:13:57.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.909+0000 7f87c5e96700 1 --2- 172.21.15.2:0/3917374198 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f87a406b1a0 0x7f87a406d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:57.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.909+0000 7f87c5e96700 1 --2- 172.21.15.2:0/3917374198 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f87a406b1a0 0x7f87a406d660 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f87b0009840 tx=0x7f87b0008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:57.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:57.913+0000 7f87b67fc700 1 -- 172.21.15.2:0/3917374198 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f87c01491e0 con 0x7f87c006edc0 2023-11-26T07:13:58.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.116+0000 7f87c80fa700 1 -- 172.21.15.2:0/3917374198 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f87c01491e0 con 0x7f87c006edc0 2023-11-26T07:13:58.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.117+0000 7f87b67fc700 1 -- 172.21.15.2:0/3917374198 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+16465 (secure 0 0 0) 0x7f87c01491e0 con 0x7f87c006edc0 2023-11-26T07:13:58.119 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:13:58.120 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":45,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:13:55.322408+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:13:52.197275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-26T07:13:52.705487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:13:58.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.119+0000 7f87c80fa700 1 -- 172.21.15.2:0/3917374198 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f87a406b1a0 msgr2=0x7f87a406d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:58.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.119+0000 7f87c80fa700 1 --2- 172.21.15.2:0/3917374198 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f87a406b1a0 0x7f87a406d660 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f87b0009840 tx=0x7f87b0008030 comp rx=0 tx=0).stop 2023-11-26T07:13:58.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.119+0000 7f87c80fa700 1 -- 172.21.15.2:0/3917374198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87c006edc0 msgr2=0x7f87c0160820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:58.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.119+0000 7f87c80fa700 1 --2- 172.21.15.2:0/3917374198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87c006edc0 0x7f87c0160820 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f87b800cef0 tx=0x7f87b800cf20 comp rx=0 tx=0).stop 2023-11-26T07:13:58.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.119+0000 7f87c80fa700 1 -- 172.21.15.2:0/3917374198 shutdown_connections 2023-11-26T07:13:58.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.119+0000 7f87c80fa700 1 --2- 172.21.15.2:0/3917374198 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f87a406b1a0 0x7f87a406d660 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:58.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.119+0000 7f87c80fa700 1 --2- 172.21.15.2:0/3917374198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87c006edc0 0x7f87c0160820 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:58.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.119+0000 7f87c80fa700 1 --2- 172.21.15.2:0/3917374198 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87c006afd0 0x7f87c0148600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:58.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.119+0000 7f87c80fa700 1 --2- 172.21.15.2:0/3917374198 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f87c006dba0 0x7f87c01602e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:58.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.119+0000 7f87c80fa700 1 -- 172.21.15.2:0/3917374198 >> 172.21.15.2:0/3917374198 conn(0x7f87c00b2840 msgr2=0x7f87c00b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:58.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.119+0000 7f87c80fa700 1 -- 172.21.15.2:0/3917374198 shutdown_connections 2023-11-26T07:13:58.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.119+0000 7f87c80fa700 1 -- 172.21.15.2:0/3917374198 wait complete. 2023-11-26T07:13:58.134 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-26T07:13:58.134 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:13:58.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.257+0000 7f1101842700 1 Processor -- start 2023-11-26T07:13:58.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.258+0000 7f1101842700 1 -- start start 2023-11-26T07:13:58.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.258+0000 7f1101842700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f10fc15e1e0 0x7f10fc0b4390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:58.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.258+0000 7f1101842700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f10fc06caf0 0x7f10fc0ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:58.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.258+0000 7f1101842700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10fc0cea40 0x7f10fc0cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:58.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.258+0000 7f1101842700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10fc15e5c0 con 0x7f10fc06caf0 2023-11-26T07:13:58.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.258+0000 7f1101842700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10fc0cee90 con 0x7f10fc15e1e0 2023-11-26T07:13:58.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.258+0000 7f1101842700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc06d0b0 con 0x7f10fc0cea40 2023-11-26T07:13:58.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.258+0000 7f10fa7fc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f10fc06caf0 0x7f10fc0ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:58.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.258+0000 7f10fa7fc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f10fc06caf0 0x7f10fc0ce500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41998/0 (socket says 172.21.15.2:41998) 2023-11-26T07:13:58.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.258+0000 7f10fa7fc700 1 -- 172.21.15.2:0/3890420006 learned_addr learned my addr 172.21.15.2:0/3890420006 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:58.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.259+0000 7f10fb7fe700 1 --2- 172.21.15.2:0/3890420006 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10fc0cea40 0x7f10fc0cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:58.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.259+0000 7f10faffd700 1 --2- 172.21.15.2:0/3890420006 >> v2:172.21.15.192:3300/0 conn(0x7f10fc15e1e0 0x7f10fc0b4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:58.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.259+0000 7f10fa7fc700 1 -- 172.21.15.2:0/3890420006 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10fc0cea40 msgr2=0x7f10fc0cfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:58.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.259+0000 7f10fa7fc700 1 --2- 172.21.15.2:0/3890420006 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10fc0cea40 0x7f10fc0cfe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:58.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.259+0000 7f10fa7fc700 1 -- 172.21.15.2:0/3890420006 >> v2:172.21.15.192:3300/0 conn(0x7f10fc15e1e0 msgr2=0x7f10fc0b4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:58.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.259+0000 7f10fa7fc700 1 --2- 172.21.15.2:0/3890420006 >> v2:172.21.15.192:3300/0 conn(0x7f10fc15e1e0 0x7f10fc0b4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:58.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.259+0000 7f10fa7fc700 1 -- 172.21.15.2:0/3890420006 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10fc0cc370 con 0x7f10fc06caf0 2023-11-26T07:13:58.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.259+0000 7f10fa7fc700 1 --2- 172.21.15.2:0/3890420006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10fc06caf0 0x7f10fc0ce500 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f10fc074c20 tx=0x7f10e4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=748df7a656c5896e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:58.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.259+0000 7f10f9ffb700 1 -- 172.21.15.2:0/3890420006 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e4011830 con 0x7f10fc06caf0 2023-11-26T07:13:58.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.259+0000 7f10f9ffb700 1 -- 172.21.15.2:0/3890420006 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e4011990 con 0x7f10fc06caf0 2023-11-26T07:13:58.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.259+0000 7f10f9ffb700 1 -- 172.21.15.2:0/3890420006 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e4011d20 con 0x7f10fc06caf0 2023-11-26T07:13:58.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.260+0000 7f1101842700 1 -- 172.21.15.2:0/3890420006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10fc06caf0 msgr2=0x7f10fc0ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:58.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.260+0000 7f1101842700 1 --2- 172.21.15.2:0/3890420006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10fc06caf0 0x7f10fc0ce500 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f10fc074c20 tx=0x7f10e4009bd0 comp rx=0 tx=0).stop 2023-11-26T07:13:58.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.260+0000 7f1101842700 1 -- 172.21.15.2:0/3890420006 shutdown_connections 2023-11-26T07:13:58.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.260+0000 7f1101842700 1 --2- 172.21.15.2:0/3890420006 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10fc0cea40 0x7f10fc0cfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:58.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.260+0000 7f1101842700 1 --2- 172.21.15.2:0/3890420006 >> v2:172.21.15.192:3300/0 conn(0x7f10fc15e1e0 0x7f10fc0b4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:58.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.260+0000 7f1101842700 1 --2- 172.21.15.2:0/3890420006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10fc06caf0 0x7f10fc0ce500 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:58.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.260+0000 7f1101842700 1 -- 172.21.15.2:0/3890420006 >> 172.21.15.2:0/3890420006 conn(0x7f10fc0b3870 msgr2=0x7f10fc0b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:58.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.260+0000 7f1101842700 1 -- 172.21.15.2:0/3890420006 shutdown_connections 2023-11-26T07:13:58.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.260+0000 7f1101842700 1 -- 172.21.15.2:0/3890420006 wait complete. 2023-11-26T07:13:58.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.261+0000 7f1101842700 1 Processor -- start 2023-11-26T07:13:58.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.261+0000 7f1101842700 1 -- start start 2023-11-26T07:13:58.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.262+0000 7f1101842700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10fc06caf0 0x7f10fc150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:58.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.262+0000 7f1101842700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10fc0cea40 0x7f10fc0b6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:58.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.262+0000 7f1101842700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10fc15e1e0 0x7f10fc0ca860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:58.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.262+0000 7f1101842700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc0b4960 con 0x7f10fc0cea40 2023-11-26T07:13:58.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.262+0000 7f1101842700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc151520 con 0x7f10fc15e1e0 2023-11-26T07:13:58.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.262+0000 7f1101842700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc0b7610 con 0x7f10fc06caf0 2023-11-26T07:13:58.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.262+0000 7f10fa7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10fc0cea40 0x7f10fc0b6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:58.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.262+0000 7f10fa7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10fc0cea40 0x7f10fc0b6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42002/0 (socket says 172.21.15.2:42002) 2023-11-26T07:13:58.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.262+0000 7f10fa7fc700 1 -- 172.21.15.2:0/38542922 learned_addr learned my addr 172.21.15.2:0/38542922 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:58.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.262+0000 7f10faffd700 1 --2- 172.21.15.2:0/38542922 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10fc06caf0 0x7f10fc150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:58.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.262+0000 7f10fb7fe700 1 --2- 172.21.15.2:0/38542922 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10fc15e1e0 0x7f10fc0ca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:58.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.262+0000 7f10fa7fc700 1 -- 172.21.15.2:0/38542922 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10fc06caf0 msgr2=0x7f10fc150fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:58.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.262+0000 7f10fa7fc700 1 --2- 172.21.15.2:0/38542922 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10fc06caf0 0x7f10fc150fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:58.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.262+0000 7f10fa7fc700 1 -- 172.21.15.2:0/38542922 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10fc15e1e0 msgr2=0x7f10fc0ca860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:58.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.262+0000 7f10fa7fc700 1 --2- 172.21.15.2:0/38542922 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10fc15e1e0 0x7f10fc0ca860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:58.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.262+0000 7f10fa7fc700 1 -- 172.21.15.2:0/38542922 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e4009550 con 0x7f10fc0cea40 2023-11-26T07:13:58.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.262+0000 7f10fb7fe700 1 --2- 172.21.15.2:0/38542922 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10fc15e1e0 0x7f10fc0ca860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:13:58.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.262+0000 7f10fa7fc700 1 --2- 172.21.15.2:0/38542922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10fc0cea40 0x7f10fc0b6bc0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f10e4000c00 tx=0x7f10e4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:58.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.263+0000 7f10f3fff700 1 -- 172.21.15.2:0/38542922 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e4004300 con 0x7f10fc0cea40 2023-11-26T07:13:58.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.263+0000 7f10f3fff700 1 -- 172.21.15.2:0/38542922 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e401f070 con 0x7f10fc0cea40 2023-11-26T07:13:58.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.263+0000 7f1101842700 1 -- 172.21.15.2:0/38542922 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10fc0b4bb0 con 0x7f10fc0cea40 2023-11-26T07:13:58.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.263+0000 7f10f3fff700 1 -- 172.21.15.2:0/38542922 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e40036a0 con 0x7f10fc0cea40 2023-11-26T07:13:58.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.263+0000 7f1101842700 1 -- 172.21.15.2:0/38542922 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10fc0b5170 con 0x7f10fc0cea40 2023-11-26T07:13:58.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.264+0000 7f1101842700 1 -- 172.21.15.2:0/38542922 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10fc0b5390 con 0x7f10fc0cea40 2023-11-26T07:13:58.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.264+0000 7f10f3fff700 1 -- 172.21.15.2:0/38542922 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f10e4021030 con 0x7f10fc0cea40 2023-11-26T07:13:58.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.265+0000 7f10f3fff700 1 --2- 172.21.15.2:0/38542922 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f10dc06b1a0 0x7f10dc06d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:58.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.265+0000 7f10f3fff700 1 -- 172.21.15.2:0/38542922 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f10e408abf0 con 0x7f10fc0cea40 2023-11-26T07:13:58.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.265+0000 7f10faffd700 1 --2- 172.21.15.2:0/38542922 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f10dc06b1a0 0x7f10dc06d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:58.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.265+0000 7f10faffd700 1 --2- 172.21.15.2:0/38542922 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f10dc06b1a0 0x7f10dc06d660 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f10ec009ad0 tx=0x7f10ec008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:58.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.269+0000 7f10f3fff700 1 -- 172.21.15.2:0/38542922 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f10e40559e0 con 0x7f10fc0cea40 2023-11-26T07:13:58.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.463+0000 7f1101842700 1 -- 172.21.15.2:0/38542922 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f10fc0cf2e0 con 0x7f10dc06b1a0 2023-11-26T07:13:58.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.473+0000 7f10f3fff700 1 -- 172.21.15.2:0/38542922 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289357 (secure 0 0 0) 0x7f10ec011750 con 0x7f10dc06b1a0 2023-11-26T07:13:58.478 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:13:58.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.476+0000 7f1101842700 1 -- 172.21.15.2:0/38542922 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f10dc06b1a0 msgr2=0x7f10dc06d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:58.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.476+0000 7f1101842700 1 --2- 172.21.15.2:0/38542922 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f10dc06b1a0 0x7f10dc06d660 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f10ec009ad0 tx=0x7f10ec008040 comp rx=0 tx=0).stop 2023-11-26T07:13:58.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.476+0000 7f1101842700 1 -- 172.21.15.2:0/38542922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10fc0cea40 msgr2=0x7f10fc0b6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:58.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.476+0000 7f1101842700 1 --2- 172.21.15.2:0/38542922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10fc0cea40 0x7f10fc0b6bc0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f10e4000c00 tx=0x7f10e4004750 comp rx=0 tx=0).stop 2023-11-26T07:13:58.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.476+0000 7f1101842700 1 -- 172.21.15.2:0/38542922 shutdown_connections 2023-11-26T07:13:58.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.476+0000 7f1101842700 1 --2- 172.21.15.2:0/38542922 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f10dc06b1a0 0x7f10dc06d660 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:58.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.476+0000 7f1101842700 1 --2- 172.21.15.2:0/38542922 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10fc15e1e0 0x7f10fc0ca860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:58.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.476+0000 7f1101842700 1 --2- 172.21.15.2:0/38542922 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10fc06caf0 0x7f10fc150fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:58.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.476+0000 7f1101842700 1 --2- 172.21.15.2:0/38542922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10fc0cea40 0x7f10fc0b6bc0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:58.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.476+0000 7f1101842700 1 -- 172.21.15.2:0/38542922 >> 172.21.15.2:0/38542922 conn(0x7f10fc0b3870 msgr2=0x7f10fc06fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:58.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.476+0000 7f1101842700 1 -- 172.21.15.2:0/38542922 shutdown_connections 2023-11-26T07:13:58.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.476+0000 7f1101842700 1 -- 172.21.15.2:0/38542922 wait complete. 2023-11-26T07:13:58.482 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-26T07:13:58.490 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2023-11-26T07:13:58.189041+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":111,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225672,"kb_used_data":5328,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749048,"statfs":{"total":773094113280,"available":772863025152,"internally_reserved":0,"allocated":5455872,"data_stored":2887468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.877670"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522541+0000","last_change":"2023-11-26T07:13:54.349573+0000","last_active":"2023-11-26T07:13:56.522541+0000","last_peered":"2023-11-26T07:13:56.522541+0000","last_clean":"2023-11-26T07:13:56.522541+0000","last_became_active":"2023-11-26T07:13:54.349262+0000","last_became_peered":"2023-11-26T07:13:54.349262+0000","last_unstale":"2023-11-26T07:13:56.522541+0000","last_undegraded":"2023-11-26T07:13:56.522541+0000","last_fullsized":"2023-11-26T07:13:56.522541+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:49:36.834186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522106+0000","last_change":"2023-11-26T07:13:54.352361+0000","last_active":"2023-11-26T07:13:56.522106+0000","last_peered":"2023-11-26T07:13:56.522106+0000","last_clean":"2023-11-26T07:13:56.522106+0000","last_became_active":"2023-11-26T07:13:54.352089+0000","last_became_peered":"2023-11-26T07:13:54.352089+0000","last_unstale":"2023-11-26T07:13:56.522106+0000","last_undegraded":"2023-11-26T07:13:56.522106+0000","last_fullsized":"2023-11-26T07:13:56.522106+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:49:36.834186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:55.328638+0000","last_change":"2023-11-26T07:13:54.351287+0000","last_active":"2023-11-26T07:13:55.328638+0000","last_peered":"2023-11-26T07:13:55.328638+0000","last_clean":"2023-11-26T07:13:55.328638+0000","last_became_active":"2023-11-26T07:13:54.351000+0000","last_became_peered":"2023-11-26T07:13:54.351000+0000","last_unstale":"2023-11-26T07:13:55.328638+0000","last_undegraded":"2023-11-26T07:13:55.328638+0000","last_fullsized":"2023-11-26T07:13:55.328638+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:45:29.804466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.523089+0000","last_change":"2023-11-26T07:13:54.339746+0000","last_active":"2023-11-26T07:13:56.523089+0000","last_peered":"2023-11-26T07:13:56.523089+0000","last_clean":"2023-11-26T07:13:56.523089+0000","last_became_active":"2023-11-26T07:13:54.339449+0000","last_became_peered":"2023-11-26T07:13:54.339449+0000","last_unstale":"2023-11-26T07:13:56.523089+0000","last_undegraded":"2023-11-26T07:13:56.523089+0000","last_fullsized":"2023-11-26T07:13:56.523089+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:39:19.965595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521837+0000","last_change":"2023-11-26T07:13:54.354225+0000","last_active":"2023-11-26T07:13:56.521837+0000","last_peered":"2023-11-26T07:13:56.521837+0000","last_clean":"2023-11-26T07:13:56.521837+0000","last_became_active":"2023-11-26T07:13:54.353957+0000","last_became_peered":"2023-11-26T07:13:54.353957+0000","last_unstale":"2023-11-26T07:13:56.521837+0000","last_undegraded":"2023-11-26T07:13:56.521837+0000","last_fullsized":"2023-11-26T07:13:56.521837+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:22:22.646479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521730+0000","last_change":"2023-11-26T07:13:54.335862+0000","last_active":"2023-11-26T07:13:56.521730+0000","last_peered":"2023-11-26T07:13:56.521730+0000","last_clean":"2023-11-26T07:13:56.521730+0000","last_became_active":"2023-11-26T07:13:54.335565+0000","last_became_peered":"2023-11-26T07:13:54.335565+0000","last_unstale":"2023-11-26T07:13:56.521730+0000","last_undegraded":"2023-11-26T07:13:56.521730+0000","last_fullsized":"2023-11-26T07:13:56.521730+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:12:35.990647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522510+0000","last_change":"2023-11-26T07:13:54.346197+0000","last_active":"2023-11-26T07:13:56.522510+0000","last_peered":"2023-11-26T07:13:56.522510+0000","last_clean":"2023-11-26T07:13:56.522510+0000","last_became_active":"2023-11-26T07:13:54.345938+0000","last_became_peered":"2023-11-26T07:13:54.345938+0000","last_unstale":"2023-11-26T07:13:56.522510+0000","last_undegraded":"2023-11-26T07:13:56.522510+0000","last_fullsized":"2023-11-26T07:13:56.522510+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:20:50.923224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522084+0000","last_change":"2023-11-26T07:13:54.346437+0000","last_active":"2023-11-26T07:13:56.522084+0000","last_peered":"2023-11-26T07:13:56.522084+0000","last_clean":"2023-11-26T07:13:56.522084+0000","last_became_active":"2023-11-26T07:13:54.345923+0000","last_became_peered":"2023-11-26T07:13:54.345923+0000","last_unstale":"2023-11-26T07:13:56.522084+0000","last_undegraded":"2023-11-26T07:13:56.522084+0000","last_fullsized":"2023-11-26T07:13:56.522084+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:59:24.340460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.523097+0000","last_change":"2023-11-26T07:13:54.347194+0000","last_active":"2023-11-26T07:13:56.523097+0000","last_peered":"2023-11-26T07:13:56.523097+0000","last_clean":"2023-11-26T07:13:56.523097+0000","last_became_active":"2023-11-26T07:13:54.346897+0000","last_became_peered":"2023-11-26T07:13:54.346897+0000","last_unstale":"2023-11-26T07:13:56.523097+0000","last_undegraded":"2023-11-26T07:13:56.523097+0000","last_fullsized":"2023-11-26T07:13:56.523097+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:19:34.787417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522908+0000","last_change":"2023-11-26T07:13:54.344363+0000","last_active":"2023-11-26T07:13:56.522908+0000","last_peered":"2023-11-26T07:13:56.522908+0000","last_clean":"2023-11-26T07:13:56.522908+0000","last_became_active":"2023-11-26T07:13:54.343742+0000","last_became_peered":"2023-11-26T07:13:54.343742+0000","last_unstale":"2023-11-26T07:13:56.522908+0000","last_undegraded":"2023-11-26T07:13:56.522908+0000","last_fullsized":"2023-11-26T07:13:56.522908+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:16:34.507626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.523217+0000","last_change":"2023-11-26T07:13:54.355073+0000","last_active":"2023-11-26T07:13:56.523217+0000","last_peered":"2023-11-26T07:13:56.523217+0000","last_clean":"2023-11-26T07:13:56.523217+0000","last_became_active":"2023-11-26T07:13:54.353627+0000","last_became_peered":"2023-11-26T07:13:54.353627+0000","last_unstale":"2023-11-26T07:13:56.523217+0000","last_undegraded":"2023-11-26T07:13:56.523217+0000","last_fullsized":"2023-11-26T07:13:56.523217+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:06:57.736985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522313+0000","last_change":"2023-11-26T07:13:54.351322+0000","last_active":"2023-11-26T07:13:56.522313+0000","last_peered":"2023-11-26T07:13:56.522313+0000","last_clean":"2023-11-26T07:13:56.522313+0000","last_became_active":"2023-11-26T07:13:54.351055+0000","last_became_peered":"2023-11-26T07:13:54.351055+0000","last_unstale":"2023-11-26T07:13:56.522313+0000","last_undegraded":"2023-11-26T07:13:56.522313+0000","last_fullsized":"2023-11-26T07:13:56.522313+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:20:50.923224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:55.325613+0000","last_change":"2023-11-26T07:13:54.351142+0000","last_active":"2023-11-26T07:13:55.325613+0000","last_peered":"2023-11-26T07:13:55.325613+0000","last_clean":"2023-11-26T07:13:55.325613+0000","last_became_active":"2023-11-26T07:13:54.350856+0000","last_became_peered":"2023-11-26T07:13:54.350856+0000","last_unstale":"2023-11-26T07:13:55.325613+0000","last_undegraded":"2023-11-26T07:13:55.325613+0000","last_fullsized":"2023-11-26T07:13:55.325613+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:00:31.148588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522853+0000","last_change":"2023-11-26T07:13:54.355488+0000","last_active":"2023-11-26T07:13:56.522853+0000","last_peered":"2023-11-26T07:13:56.522853+0000","last_clean":"2023-11-26T07:13:56.522853+0000","last_became_active":"2023-11-26T07:13:54.353650+0000","last_became_peered":"2023-11-26T07:13:54.353650+0000","last_unstale":"2023-11-26T07:13:56.522853+0000","last_undegraded":"2023-11-26T07:13:56.522853+0000","last_fullsized":"2023-11-26T07:13:56.522853+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:32:07.644718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521299+0000","last_change":"2023-11-26T07:13:54.349987+0000","last_active":"2023-11-26T07:13:56.521299+0000","last_peered":"2023-11-26T07:13:56.521299+0000","last_clean":"2023-11-26T07:13:56.521299+0000","last_became_active":"2023-11-26T07:13:54.349689+0000","last_became_peered":"2023-11-26T07:13:54.349689+0000","last_unstale":"2023-11-26T07:13:56.521299+0000","last_undegraded":"2023-11-26T07:13:56.521299+0000","last_fullsized":"2023-11-26T07:13:56.521299+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:50:03.118294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521648+0000","last_change":"2023-11-26T07:13:54.347220+0000","last_active":"2023-11-26T07:13:56.521648+0000","last_peered":"2023-11-26T07:13:56.521648+0000","last_clean":"2023-11-26T07:13:56.521648+0000","last_became_active":"2023-11-26T07:13:54.346821+0000","last_became_peered":"2023-11-26T07:13:54.346821+0000","last_unstale":"2023-11-26T07:13:56.521648+0000","last_undegraded":"2023-11-26T07:13:56.521648+0000","last_fullsized":"2023-11-26T07:13:56.521648+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:49:24.833685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:55.328753+0000","last_change":"2023-11-26T07:13:54.349401+0000","last_active":"2023-11-26T07:13:55.328753+0000","last_peered":"2023-11-26T07:13:55.328753+0000","last_clean":"2023-11-26T07:13:55.328753+0000","last_became_active":"2023-11-26T07:13:54.348823+0000","last_became_peered":"2023-11-26T07:13:54.348823+0000","last_unstale":"2023-11-26T07:13:55.328753+0000","last_undegraded":"2023-11-26T07:13:55.328753+0000","last_fullsized":"2023-11-26T07:13:55.328753+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:30:26.598436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:55.328671+0000","last_change":"2023-11-26T07:13:54.354633+0000","last_active":"2023-11-26T07:13:55.328671+0000","last_peered":"2023-11-26T07:13:55.328671+0000","last_clean":"2023-11-26T07:13:55.328671+0000","last_became_active":"2023-11-26T07:13:54.354197+0000","last_became_peered":"2023-11-26T07:13:54.354197+0000","last_unstale":"2023-11-26T07:13:55.328671+0000","last_undegraded":"2023-11-26T07:13:55.328671+0000","last_fullsized":"2023-11-26T07:13:55.328671+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:59:24.340460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522205+0000","last_change":"2023-11-26T07:13:54.337631+0000","last_active":"2023-11-26T07:13:56.522205+0000","last_peered":"2023-11-26T07:13:56.522205+0000","last_clean":"2023-11-26T07:13:56.522205+0000","last_became_active":"2023-11-26T07:13:54.337340+0000","last_became_peered":"2023-11-26T07:13:54.337340+0000","last_unstale":"2023-11-26T07:13:56.522205+0000","last_undegraded":"2023-11-26T07:13:56.522205+0000","last_fullsized":"2023-11-26T07:13:56.522205+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:37:08.994046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:55.325807+0000","last_change":"2023-11-26T07:13:54.350420+0000","last_active":"2023-11-26T07:13:55.325807+0000","last_peered":"2023-11-26T07:13:55.325807+0000","last_clean":"2023-11-26T07:13:55.325807+0000","last_became_active":"2023-11-26T07:13:54.349972+0000","last_became_peered":"2023-11-26T07:13:54.349972+0000","last_unstale":"2023-11-26T07:13:55.325807+0000","last_undegraded":"2023-11-26T07:13:55.325807+0000","last_fullsized":"2023-11-26T07:13:55.325807+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:37:52.259978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521222+0000","last_change":"2023-11-26T07:13:54.335830+0000","last_active":"2023-11-26T07:13:56.521222+0000","last_peered":"2023-11-26T07:13:56.521222+0000","last_clean":"2023-11-26T07:13:56.521222+0000","last_became_active":"2023-11-26T07:13:54.335507+0000","last_became_peered":"2023-11-26T07:13:54.335507+0000","last_unstale":"2023-11-26T07:13:56.521222+0000","last_undegraded":"2023-11-26T07:13:56.521222+0000","last_fullsized":"2023-11-26T07:13:56.521222+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:28:34.227908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522852+0000","last_change":"2023-11-26T07:13:54.339868+0000","last_active":"2023-11-26T07:13:56.522852+0000","last_peered":"2023-11-26T07:13:56.522852+0000","last_clean":"2023-11-26T07:13:56.522852+0000","last_became_active":"2023-11-26T07:13:54.339586+0000","last_became_peered":"2023-11-26T07:13:54.339586+0000","last_unstale":"2023-11-26T07:13:56.522852+0000","last_undegraded":"2023-11-26T07:13:56.522852+0000","last_fullsized":"2023-11-26T07:13:56.522852+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:15:21.013953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521669+0000","last_change":"2023-11-26T07:13:54.334403+0000","last_active":"2023-11-26T07:13:56.521669+0000","last_peered":"2023-11-26T07:13:56.521669+0000","last_clean":"2023-11-26T07:13:56.521669+0000","last_became_active":"2023-11-26T07:13:54.333437+0000","last_became_peered":"2023-11-26T07:13:54.333437+0000","last_unstale":"2023-11-26T07:13:56.521669+0000","last_undegraded":"2023-11-26T07:13:56.521669+0000","last_fullsized":"2023-11-26T07:13:56.521669+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:55:49.004066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521878+0000","last_change":"2023-11-26T07:13:54.333287+0000","last_active":"2023-11-26T07:13:56.521878+0000","last_peered":"2023-11-26T07:13:56.521878+0000","last_clean":"2023-11-26T07:13:56.521878+0000","last_became_active":"2023-11-26T07:13:54.333001+0000","last_became_peered":"2023-11-26T07:13:54.333001+0000","last_unstale":"2023-11-26T07:13:56.521878+0000","last_undegraded":"2023-11-26T07:13:56.521878+0000","last_fullsized":"2023-11-26T07:13:56.521878+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:09:37.588413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522926+0000","last_change":"2023-11-26T07:13:54.346379+0000","last_active":"2023-11-26T07:13:56.522926+0000","last_peered":"2023-11-26T07:13:56.522926+0000","last_clean":"2023-11-26T07:13:56.522926+0000","last_became_active":"2023-11-26T07:13:54.345741+0000","last_became_peered":"2023-11-26T07:13:54.345741+0000","last_unstale":"2023-11-26T07:13:56.522926+0000","last_undegraded":"2023-11-26T07:13:56.522926+0000","last_fullsized":"2023-11-26T07:13:56.522926+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:19:52.890589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:55.325742+0000","last_change":"2023-11-26T07:13:54.349857+0000","last_active":"2023-11-26T07:13:55.325742+0000","last_peered":"2023-11-26T07:13:55.325742+0000","last_clean":"2023-11-26T07:13:55.325742+0000","last_became_active":"2023-11-26T07:13:54.349559+0000","last_became_peered":"2023-11-26T07:13:54.349559+0000","last_unstale":"2023-11-26T07:13:55.325742+0000","last_undegraded":"2023-11-26T07:13:55.325742+0000","last_fullsized":"2023-11-26T07:13:55.325742+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:43:12.052999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:55.328757+0000","last_change":"2023-11-26T07:13:54.349210+0000","last_active":"2023-11-26T07:13:55.328757+0000","last_peered":"2023-11-26T07:13:55.328757+0000","last_clean":"2023-11-26T07:13:55.328757+0000","last_became_active":"2023-11-26T07:13:54.348772+0000","last_became_peered":"2023-11-26T07:13:54.348772+0000","last_unstale":"2023-11-26T07:13:55.328757+0000","last_undegraded":"2023-11-26T07:13:55.328757+0000","last_fullsized":"2023-11-26T07:13:55.328757+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:47:15.762964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522481+0000","last_change":"2023-11-26T07:13:54.351640+0000","last_active":"2023-11-26T07:13:56.522481+0000","last_peered":"2023-11-26T07:13:56.522481+0000","last_clean":"2023-11-26T07:13:56.522481+0000","last_became_active":"2023-11-26T07:13:54.351367+0000","last_became_peered":"2023-11-26T07:13:54.351367+0000","last_unstale":"2023-11-26T07:13:56.522481+0000","last_undegraded":"2023-11-26T07:13:56.522481+0000","last_fullsized":"2023-11-26T07:13:56.522481+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:09:10.784218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521973+0000","last_change":"2023-11-26T07:13:54.353830+0000","last_active":"2023-11-26T07:13:56.521973+0000","last_peered":"2023-11-26T07:13:56.521973+0000","last_clean":"2023-11-26T07:13:56.521973+0000","last_became_active":"2023-11-26T07:13:54.353543+0000","last_became_peered":"2023-11-26T07:13:54.353543+0000","last_unstale":"2023-11-26T07:13:56.521973+0000","last_undegraded":"2023-11-26T07:13:56.521973+0000","last_fullsized":"2023-11-26T07:13:56.521973+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:04:43.652064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:55.328482+0000","last_change":"2023-11-26T07:13:54.349319+0000","last_active":"2023-11-26T07:13:55.328482+0000","last_peered":"2023-11-26T07:13:55.328482+0000","last_clean":"2023-11-26T07:13:55.328482+0000","last_became_active":"2023-11-26T07:13:54.349017+0000","last_became_peered":"2023-11-26T07:13:54.349017+0000","last_unstale":"2023-11-26T07:13:55.328482+0000","last_undegraded":"2023-11-26T07:13:55.328482+0000","last_fullsized":"2023-11-26T07:13:55.328482+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:29:42.822778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521416+0000","last_change":"2023-11-26T07:13:54.340860+0000","last_active":"2023-11-26T07:13:56.521416+0000","last_peered":"2023-11-26T07:13:56.521416+0000","last_clean":"2023-11-26T07:13:56.521416+0000","last_became_active":"2023-11-26T07:13:54.340402+0000","last_became_peered":"2023-11-26T07:13:54.340402+0000","last_unstale":"2023-11-26T07:13:56.521416+0000","last_undegraded":"2023-11-26T07:13:56.521416+0000","last_fullsized":"2023-11-26T07:13:56.521416+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:56:02.700567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:55.325508+0000","last_change":"2023-11-26T07:13:54.355733+0000","last_active":"2023-11-26T07:13:55.325508+0000","last_peered":"2023-11-26T07:13:55.325508+0000","last_clean":"2023-11-26T07:13:55.325508+0000","last_became_active":"2023-11-26T07:13:54.355388+0000","last_became_peered":"2023-11-26T07:13:54.355388+0000","last_unstale":"2023-11-26T07:13:55.325508+0000","last_undegraded":"2023-11-26T07:13:55.325508+0000","last_fullsized":"2023-11-26T07:13:55.325508+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:01:44.730840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521470+0000","last_change":"2023-11-26T07:13:54.344019+0000","last_active":"2023-11-26T07:13:56.521470+0000","last_peered":"2023-11-26T07:13:56.521470+0000","last_clean":"2023-11-26T07:13:56.521470+0000","last_became_active":"2023-11-26T07:13:54.343694+0000","last_became_peered":"2023-11-26T07:13:54.343694+0000","last_unstale":"2023-11-26T07:13:56.521470+0000","last_undegraded":"2023-11-26T07:13:56.521470+0000","last_fullsized":"2023-11-26T07:13:56.521470+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:29:50.743893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522489+0000","last_change":"2023-11-26T07:13:53.333192+0000","last_active":"2023-11-26T07:13:56.522489+0000","last_peered":"2023-11-26T07:13:56.522489+0000","last_clean":"2023-11-26T07:13:56.522489+0000","last_became_active":"2023-11-26T07:13:53.332923+0000","last_became_peered":"2023-11-26T07:13:53.332923+0000","last_unstale":"2023-11-26T07:13:56.522489+0000","last_undegraded":"2023-11-26T07:13:56.522489+0000","last_fullsized":"2023-11-26T07:13:56.522489+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:18:43.048323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522591+0000","last_change":"2023-11-26T07:13:54.350225+0000","last_active":"2023-11-26T07:13:56.522591+0000","last_peered":"2023-11-26T07:13:56.522591+0000","last_clean":"2023-11-26T07:13:56.522591+0000","last_became_active":"2023-11-26T07:13:54.349894+0000","last_became_peered":"2023-11-26T07:13:54.349894+0000","last_unstale":"2023-11-26T07:13:56.522591+0000","last_undegraded":"2023-11-26T07:13:56.522591+0000","last_fullsized":"2023-11-26T07:13:56.522591+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:23:43.481733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:55.328786+0000","last_change":"2023-11-26T07:13:53.326395+0000","last_active":"2023-11-26T07:13:55.328786+0000","last_peered":"2023-11-26T07:13:55.328786+0000","last_clean":"2023-11-26T07:13:55.328786+0000","last_became_active":"2023-11-26T07:13:53.325818+0000","last_became_peered":"2023-11-26T07:13:53.325818+0000","last_unstale":"2023-11-26T07:13:55.328786+0000","last_undegraded":"2023-11-26T07:13:55.328786+0000","last_fullsized":"2023-11-26T07:13:55.328786+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:29:49.737685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522108+0000","last_change":"2023-11-26T07:13:54.342587+0000","last_active":"2023-11-26T07:13:56.522108+0000","last_peered":"2023-11-26T07:13:56.522108+0000","last_clean":"2023-11-26T07:13:56.522108+0000","last_became_active":"2023-11-26T07:13:54.342280+0000","last_became_peered":"2023-11-26T07:13:54.342280+0000","last_unstale":"2023-11-26T07:13:56.522108+0000","last_undegraded":"2023-11-26T07:13:56.522108+0000","last_fullsized":"2023-11-26T07:13:56.522108+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:49:59.764763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522225+0000","last_change":"2023-11-26T07:13:53.323229+0000","last_active":"2023-11-26T07:13:56.522225+0000","last_peered":"2023-11-26T07:13:56.522225+0000","last_clean":"2023-11-26T07:13:56.522225+0000","last_became_active":"2023-11-26T07:13:53.322886+0000","last_became_peered":"2023-11-26T07:13:53.322886+0000","last_unstale":"2023-11-26T07:13:56.522225+0000","last_undegraded":"2023-11-26T07:13:56.522225+0000","last_fullsized":"2023-11-26T07:13:56.522225+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:09:36.582205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.523410+0000","last_change":"2023-11-26T07:13:54.353190+0000","last_active":"2023-11-26T07:13:56.523410+0000","last_peered":"2023-11-26T07:13:56.523410+0000","last_clean":"2023-11-26T07:13:56.523410+0000","last_became_active":"2023-11-26T07:13:54.352901+0000","last_became_peered":"2023-11-26T07:13:54.352901+0000","last_unstale":"2023-11-26T07:13:56.523410+0000","last_undegraded":"2023-11-26T07:13:56.523410+0000","last_fullsized":"2023-11-26T07:13:56.523410+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:37:08.994046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522300+0000","last_change":"2023-11-26T07:13:53.327411+0000","last_active":"2023-11-26T07:13:56.522300+0000","last_peered":"2023-11-26T07:13:56.522300+0000","last_clean":"2023-11-26T07:13:56.522300+0000","last_became_active":"2023-11-26T07:13:53.327216+0000","last_became_peered":"2023-11-26T07:13:53.327216+0000","last_unstale":"2023-11-26T07:13:56.522300+0000","last_undegraded":"2023-11-26T07:13:56.522300+0000","last_fullsized":"2023-11-26T07:13:56.522300+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:15:20.007744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:55.328460+0000","last_change":"2023-11-26T07:13:54.347225+0000","last_active":"2023-11-26T07:13:55.328460+0000","last_peered":"2023-11-26T07:13:55.328460+0000","last_clean":"2023-11-26T07:13:55.328460+0000","last_became_active":"2023-11-26T07:13:54.346934+0000","last_became_peered":"2023-11-26T07:13:54.346934+0000","last_unstale":"2023-11-26T07:13:55.328460+0000","last_undegraded":"2023-11-26T07:13:55.328460+0000","last_fullsized":"2023-11-26T07:13:55.328460+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:22:52.075568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521382+0000","last_change":"2023-11-26T07:13:53.332345+0000","last_active":"2023-11-26T07:13:56.521382+0000","last_peered":"2023-11-26T07:13:56.521382+0000","last_clean":"2023-11-26T07:13:56.521382+0000","last_became_active":"2023-11-26T07:13:53.331726+0000","last_became_peered":"2023-11-26T07:13:53.331726+0000","last_unstale":"2023-11-26T07:13:56.521382+0000","last_undegraded":"2023-11-26T07:13:56.521382+0000","last_fullsized":"2023-11-26T07:13:56.521382+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:49:35.827978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522568+0000","last_change":"2023-11-26T07:13:54.353147+0000","last_active":"2023-11-26T07:13:56.522568+0000","last_peered":"2023-11-26T07:13:56.522568+0000","last_clean":"2023-11-26T07:13:56.522568+0000","last_became_active":"2023-11-26T07:13:54.352827+0000","last_became_peered":"2023-11-26T07:13:54.352827+0000","last_unstale":"2023-11-26T07:13:56.522568+0000","last_undegraded":"2023-11-26T07:13:56.522568+0000","last_fullsized":"2023-11-26T07:13:56.522568+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:30:26.598436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:55.328593+0000","last_change":"2023-11-26T07:13:53.323952+0000","last_active":"2023-11-26T07:13:55.328593+0000","last_peered":"2023-11-26T07:13:55.328593+0000","last_clean":"2023-11-26T07:13:55.328593+0000","last_became_active":"2023-11-26T07:13:53.323409+0000","last_became_peered":"2023-11-26T07:13:53.323409+0000","last_unstale":"2023-11-26T07:13:55.328593+0000","last_undegraded":"2023-11-26T07:13:55.328593+0000","last_fullsized":"2023-11-26T07:13:55.328593+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:29:36.005611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522023+0000","last_change":"2023-11-26T07:13:54.346282+0000","last_active":"2023-11-26T07:13:56.522023+0000","last_peered":"2023-11-26T07:13:56.522023+0000","last_clean":"2023-11-26T07:13:56.522023+0000","last_became_active":"2023-11-26T07:13:54.345603+0000","last_became_peered":"2023-11-26T07:13:54.345603+0000","last_unstale":"2023-11-26T07:13:56.522023+0000","last_undegraded":"2023-11-26T07:13:56.522023+0000","last_fullsized":"2023-11-26T07:13:56.522023+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:19:52.890589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521732+0000","last_change":"2023-11-26T07:13:53.327301+0000","last_active":"2023-11-26T07:13:56.521732+0000","last_peered":"2023-11-26T07:13:56.521732+0000","last_clean":"2023-11-26T07:13:56.521732+0000","last_became_active":"2023-11-26T07:13:53.327078+0000","last_became_peered":"2023-11-26T07:13:53.327078+0000","last_unstale":"2023-11-26T07:13:56.521732+0000","last_undegraded":"2023-11-26T07:13:56.521732+0000","last_fullsized":"2023-11-26T07:13:56.521732+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:19:33.781209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522620+0000","last_change":"2023-11-26T07:13:54.333589+0000","last_active":"2023-11-26T07:13:56.522620+0000","last_peered":"2023-11-26T07:13:56.522620+0000","last_clean":"2023-11-26T07:13:56.522620+0000","last_became_active":"2023-11-26T07:13:54.333086+0000","last_became_peered":"2023-11-26T07:13:54.333086+0000","last_unstale":"2023-11-26T07:13:56.522620+0000","last_undegraded":"2023-11-26T07:13:56.522620+0000","last_fullsized":"2023-11-26T07:13:56.522620+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:22:52.075568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521954+0000","last_change":"2023-11-26T07:13:53.335935+0000","last_active":"2023-11-26T07:13:56.521954+0000","last_peered":"2023-11-26T07:13:56.521954+0000","last_clean":"2023-11-26T07:13:56.521954+0000","last_became_active":"2023-11-26T07:13:53.335531+0000","last_became_peered":"2023-11-26T07:13:53.335531+0000","last_unstale":"2023-11-26T07:13:56.521954+0000","last_undegraded":"2023-11-26T07:13:56.521954+0000","last_fullsized":"2023-11-26T07:13:56.521954+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:37:07.987838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:55.328792+0000","last_change":"2023-11-26T07:13:54.354463+0000","last_active":"2023-11-26T07:13:55.328792+0000","last_peered":"2023-11-26T07:13:55.328792+0000","last_clean":"2023-11-26T07:13:55.328792+0000","last_became_active":"2023-11-26T07:13:54.353794+0000","last_became_peered":"2023-11-26T07:13:54.353794+0000","last_unstale":"2023-11-26T07:13:55.328792+0000","last_undegraded":"2023-11-26T07:13:55.328792+0000","last_fullsized":"2023-11-26T07:13:55.328792+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:32:07.644718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:55.328798+0000","last_change":"2023-11-26T07:13:53.321623+0000","last_active":"2023-11-26T07:13:55.328798+0000","last_peered":"2023-11-26T07:13:55.328798+0000","last_clean":"2023-11-26T07:13:55.328798+0000","last_became_active":"2023-11-26T07:13:53.321318+0000","last_became_peered":"2023-11-26T07:13:53.321318+0000","last_unstale":"2023-11-26T07:13:55.328798+0000","last_undegraded":"2023-11-26T07:13:55.328798+0000","last_fullsized":"2023-11-26T07:13:55.328798+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:04:42.645855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522520+0000","last_change":"2023-11-26T07:13:54.341206+0000","last_active":"2023-11-26T07:13:56.522520+0000","last_peered":"2023-11-26T07:13:56.522520+0000","last_clean":"2023-11-26T07:13:56.522520+0000","last_became_active":"2023-11-26T07:13:54.340862+0000","last_became_peered":"2023-11-26T07:13:54.340862+0000","last_unstale":"2023-11-26T07:13:56.522520+0000","last_undegraded":"2023-11-26T07:13:56.522520+0000","last_fullsized":"2023-11-26T07:13:56.522520+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:47:44.791047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.523214+0000","last_change":"2023-11-26T07:13:53.333651+0000","last_active":"2023-11-26T07:13:56.523214+0000","last_peered":"2023-11-26T07:13:56.523214+0000","last_clean":"2023-11-26T07:13:56.523214+0000","last_became_active":"2023-11-26T07:13:53.333317+0000","last_became_peered":"2023-11-26T07:13:53.333317+0000","last_unstale":"2023-11-26T07:13:56.523214+0000","last_undegraded":"2023-11-26T07:13:56.523214+0000","last_fullsized":"2023-11-26T07:13:56.523214+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:29:41.816570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521364+0000","last_change":"2023-11-26T07:13:54.352443+0000","last_active":"2023-11-26T07:13:56.521364+0000","last_peered":"2023-11-26T07:13:56.521364+0000","last_clean":"2023-11-26T07:13:56.521364+0000","last_became_active":"2023-11-26T07:13:54.352111+0000","last_became_peered":"2023-11-26T07:13:54.352111+0000","last_unstale":"2023-11-26T07:13:56.521364+0000","last_undegraded":"2023-11-26T07:13:56.521364+0000","last_fullsized":"2023-11-26T07:13:56.521364+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:44:23.742350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522858+0000","last_change":"2023-11-26T07:13:53.332505+0000","last_active":"2023-11-26T07:13:56.522858+0000","last_peered":"2023-11-26T07:13:56.522858+0000","last_clean":"2023-11-26T07:13:56.522858+0000","last_became_active":"2023-11-26T07:13:53.332230+0000","last_became_peered":"2023-11-26T07:13:53.332230+0000","last_unstale":"2023-11-26T07:13:56.522858+0000","last_undegraded":"2023-11-26T07:13:56.522858+0000","last_fullsized":"2023-11-26T07:13:56.522858+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:09:09.778010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522606+0000","last_change":"2023-11-26T07:13:54.353808+0000","last_active":"2023-11-26T07:13:56.522606+0000","last_peered":"2023-11-26T07:13:56.522606+0000","last_clean":"2023-11-26T07:13:56.522606+0000","last_became_active":"2023-11-26T07:13:54.353538+0000","last_became_peered":"2023-11-26T07:13:54.353538+0000","last_unstale":"2023-11-26T07:13:56.522606+0000","last_undegraded":"2023-11-26T07:13:56.522606+0000","last_fullsized":"2023-11-26T07:13:56.522606+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:02:46.618954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":18,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:55.325819+0000","last_change":"2023-11-26T07:13:53.321789+0000","last_active":"2023-11-26T07:13:55.325819+0000","last_peered":"2023-11-26T07:13:55.325819+0000","last_clean":"2023-11-26T07:13:55.325819+0000","last_became_active":"2023-11-26T07:13:53.321466+0000","last_became_peered":"2023-11-26T07:13:53.321466+0000","last_unstale":"2023-11-26T07:13:55.325819+0000","last_undegraded":"2023-11-26T07:13:55.325819+0000","last_fullsized":"2023-11-26T07:13:55.325819+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:24:26.009995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521878+0000","last_change":"2023-11-26T07:13:54.337428+0000","last_active":"2023-11-26T07:13:56.521878+0000","last_peered":"2023-11-26T07:13:56.521878+0000","last_clean":"2023-11-26T07:13:56.521878+0000","last_became_active":"2023-11-26T07:13:54.337155+0000","last_became_peered":"2023-11-26T07:13:54.337155+0000","last_unstale":"2023-11-26T07:13:56.521878+0000","last_undegraded":"2023-11-26T07:13:56.521878+0000","last_fullsized":"2023-11-26T07:13:56.521878+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:53:37.751308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521485+0000","last_change":"2023-11-26T07:13:53.335565+0000","last_active":"2023-11-26T07:13:56.521485+0000","last_peered":"2023-11-26T07:13:56.521485+0000","last_clean":"2023-11-26T07:13:56.521485+0000","last_became_active":"2023-11-26T07:13:53.335273+0000","last_became_peered":"2023-11-26T07:13:53.335273+0000","last_unstale":"2023-11-26T07:13:56.521485+0000","last_undegraded":"2023-11-26T07:13:56.521485+0000","last_fullsized":"2023-11-26T07:13:56.521485+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:47:43.784839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522642+0000","last_change":"2023-11-26T07:13:54.340961+0000","last_active":"2023-11-26T07:13:56.522642+0000","last_peered":"2023-11-26T07:13:56.522642+0000","last_clean":"2023-11-26T07:13:56.522642+0000","last_became_active":"2023-11-26T07:13:54.340680+0000","last_became_peered":"2023-11-26T07:13:54.340680+0000","last_unstale":"2023-11-26T07:13:56.522642+0000","last_undegraded":"2023-11-26T07:13:56.522642+0000","last_fullsized":"2023-11-26T07:13:56.522642+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:47:15.762964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522641+0000","last_change":"2023-11-26T07:13:53.329094+0000","last_active":"2023-11-26T07:13:56.522641+0000","last_peered":"2023-11-26T07:13:56.522641+0000","last_clean":"2023-11-26T07:13:56.522641+0000","last_became_active":"2023-11-26T07:13:53.328764+0000","last_became_peered":"2023-11-26T07:13:53.328764+0000","last_unstale":"2023-11-26T07:13:56.522641+0000","last_undegraded":"2023-11-26T07:13:56.522641+0000","last_fullsized":"2023-11-26T07:13:56.522641+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:06:56.730777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521089+0000","last_change":"2023-11-26T07:13:54.351804+0000","last_active":"2023-11-26T07:13:56.521089+0000","last_peered":"2023-11-26T07:13:56.521089+0000","last_clean":"2023-11-26T07:13:56.521089+0000","last_became_active":"2023-11-26T07:13:54.351444+0000","last_became_peered":"2023-11-26T07:13:54.351444+0000","last_unstale":"2023-11-26T07:13:56.521089+0000","last_undegraded":"2023-11-26T07:13:56.521089+0000","last_fullsized":"2023-11-26T07:13:56.521089+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:28:08.488217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.523306+0000","last_change":"2023-11-26T07:13:53.334727+0000","last_active":"2023-11-26T07:13:56.523306+0000","last_peered":"2023-11-26T07:13:56.523306+0000","last_clean":"2023-11-26T07:13:56.523306+0000","last_became_active":"2023-11-26T07:13:53.334392+0000","last_became_peered":"2023-11-26T07:13:53.334392+0000","last_unstale":"2023-11-26T07:13:56.523306+0000","last_undegraded":"2023-11-26T07:13:56.523306+0000","last_fullsized":"2023-11-26T07:13:56.523306+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:34:18.408623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522605+0000","last_change":"2023-11-26T07:13:54.332360+0000","last_active":"2023-11-26T07:13:56.522605+0000","last_peered":"2023-11-26T07:13:56.522605+0000","last_clean":"2023-11-26T07:13:56.522605+0000","last_became_active":"2023-11-26T07:13:54.332084+0000","last_became_peered":"2023-11-26T07:13:54.332084+0000","last_unstale":"2023-11-26T07:13:56.522605+0000","last_undegraded":"2023-11-26T07:13:56.522605+0000","last_fullsized":"2023-11-26T07:13:56.522605+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:25:08.359535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"44'8","reported_seq":20,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521878+0000","last_change":"2023-11-26T07:13:53.335773+0000","last_active":"2023-11-26T07:13:56.521878+0000","last_peered":"2023-11-26T07:13:56.521878+0000","last_clean":"2023-11-26T07:13:56.521878+0000","last_became_active":"2023-11-26T07:13:53.335218+0000","last_became_peered":"2023-11-26T07:13:53.335218+0000","last_unstale":"2023-11-26T07:13:56.521878+0000","last_undegraded":"2023-11-26T07:13:56.521878+0000","last_fullsized":"2023-11-26T07:13:56.521878+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:53:36.745100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:55.325804+0000","last_change":"2023-11-26T07:13:54.350054+0000","last_active":"2023-11-26T07:13:55.325804+0000","last_peered":"2023-11-26T07:13:55.325804+0000","last_clean":"2023-11-26T07:13:55.325804+0000","last_became_active":"2023-11-26T07:13:54.349720+0000","last_became_peered":"2023-11-26T07:13:54.349720+0000","last_unstale":"2023-11-26T07:13:55.325804+0000","last_undegraded":"2023-11-26T07:13:55.325804+0000","last_fullsized":"2023-11-26T07:13:55.325804+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:57:58.921713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:55.325612+0000","last_change":"2023-11-26T07:13:53.328897+0000","last_active":"2023-11-26T07:13:55.325612+0000","last_peered":"2023-11-26T07:13:55.325612+0000","last_clean":"2023-11-26T07:13:55.325612+0000","last_became_active":"2023-11-26T07:13:53.328585+0000","last_became_peered":"2023-11-26T07:13:53.328585+0000","last_unstale":"2023-11-26T07:13:55.325612+0000","last_undegraded":"2023-11-26T07:13:55.325612+0000","last_fullsized":"2023-11-26T07:13:55.325612+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:29:39.283815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.523239+0000","last_change":"2023-11-26T07:13:54.336898+0000","last_active":"2023-11-26T07:13:56.523239+0000","last_peered":"2023-11-26T07:13:56.523239+0000","last_clean":"2023-11-26T07:13:56.523239+0000","last_became_active":"2023-11-26T07:13:54.336584+0000","last_became_peered":"2023-11-26T07:13:54.336584+0000","last_unstale":"2023-11-26T07:13:56.523239+0000","last_undegraded":"2023-11-26T07:13:56.523239+0000","last_fullsized":"2023-11-26T07:13:56.523239+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:27:36.448372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:55.328595+0000","last_change":"2023-11-26T07:13:53.321789+0000","last_active":"2023-11-26T07:13:55.328595+0000","last_peered":"2023-11-26T07:13:55.328595+0000","last_clean":"2023-11-26T07:13:55.328595+0000","last_became_active":"2023-11-26T07:13:53.321375+0000","last_became_peered":"2023-11-26T07:13:53.321375+0000","last_unstale":"2023-11-26T07:13:55.328595+0000","last_undegraded":"2023-11-26T07:13:55.328595+0000","last_fullsized":"2023-11-26T07:13:55.328595+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:53:36.745100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521946+0000","last_change":"2023-11-26T07:13:54.335928+0000","last_active":"2023-11-26T07:13:56.521946+0000","last_peered":"2023-11-26T07:13:56.521946+0000","last_clean":"2023-11-26T07:13:56.521946+0000","last_became_active":"2023-11-26T07:13:54.335672+0000","last_became_peered":"2023-11-26T07:13:54.335672+0000","last_unstale":"2023-11-26T07:13:56.521946+0000","last_undegraded":"2023-11-26T07:13:56.521946+0000","last_fullsized":"2023-11-26T07:13:56.521946+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:29:50.743893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521829+0000","last_change":"2023-11-26T07:13:53.327312+0000","last_active":"2023-11-26T07:13:56.521829+0000","last_peered":"2023-11-26T07:13:56.521829+0000","last_clean":"2023-11-26T07:13:56.521829+0000","last_became_active":"2023-11-26T07:13:53.327025+0000","last_became_peered":"2023-11-26T07:13:53.327025+0000","last_unstale":"2023-11-26T07:13:56.521829+0000","last_undegraded":"2023-11-26T07:13:56.521829+0000","last_fullsized":"2023-11-26T07:13:56.521829+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:33:18.808399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522612+0000","last_change":"2023-11-26T07:13:54.353808+0000","last_active":"2023-11-26T07:13:56.522612+0000","last_peered":"2023-11-26T07:13:56.522612+0000","last_clean":"2023-11-26T07:13:56.522612+0000","last_became_active":"2023-11-26T07:13:54.353501+0000","last_became_peered":"2023-11-26T07:13:54.353501+0000","last_unstale":"2023-11-26T07:13:56.522612+0000","last_undegraded":"2023-11-26T07:13:56.522612+0000","last_fullsized":"2023-11-26T07:13:56.522612+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:29:37.011820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521459+0000","last_change":"2023-11-26T07:13:53.327983+0000","last_active":"2023-11-26T07:13:56.521459+0000","last_peered":"2023-11-26T07:13:56.521459+0000","last_clean":"2023-11-26T07:13:56.521459+0000","last_became_active":"2023-11-26T07:13:53.327624+0000","last_became_peered":"2023-11-26T07:13:53.327624+0000","last_unstale":"2023-11-26T07:13:56.521459+0000","last_undegraded":"2023-11-26T07:13:56.521459+0000","last_fullsized":"2023-11-26T07:13:56.521459+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:20:49.917016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521347+0000","last_change":"2023-11-26T07:13:54.352370+0000","last_active":"2023-11-26T07:13:56.521347+0000","last_peered":"2023-11-26T07:13:56.521347+0000","last_clean":"2023-11-26T07:13:56.521347+0000","last_became_active":"2023-11-26T07:13:54.351547+0000","last_became_peered":"2023-11-26T07:13:54.351547+0000","last_unstale":"2023-11-26T07:13:56.521347+0000","last_undegraded":"2023-11-26T07:13:56.521347+0000","last_fullsized":"2023-11-26T07:13:56.521347+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:37:07.255448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521589+0000","last_change":"2023-11-26T07:13:53.332551+0000","last_active":"2023-11-26T07:13:56.521589+0000","last_peered":"2023-11-26T07:13:56.521589+0000","last_clean":"2023-11-26T07:13:56.521589+0000","last_became_active":"2023-11-26T07:13:53.332060+0000","last_became_peered":"2023-11-26T07:13:53.332060+0000","last_unstale":"2023-11-26T07:13:56.521589+0000","last_undegraded":"2023-11-26T07:13:56.521589+0000","last_fullsized":"2023-11-26T07:13:56.521589+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:04:51.796299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521631+0000","last_change":"2023-11-26T07:13:54.345586+0000","last_active":"2023-11-26T07:13:56.521631+0000","last_peered":"2023-11-26T07:13:56.521631+0000","last_clean":"2023-11-26T07:13:56.521631+0000","last_became_active":"2023-11-26T07:13:54.344018+0000","last_became_peered":"2023-11-26T07:13:54.344018+0000","last_unstale":"2023-11-26T07:13:56.521631+0000","last_undegraded":"2023-11-26T07:13:56.521631+0000","last_fullsized":"2023-11-26T07:13:56.521631+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:04:43.652064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521553+0000","last_change":"2023-11-26T07:13:53.331012+0000","last_active":"2023-11-26T07:13:56.521553+0000","last_peered":"2023-11-26T07:13:56.521553+0000","last_clean":"2023-11-26T07:13:56.521553+0000","last_became_active":"2023-11-26T07:13:53.330765+0000","last_became_peered":"2023-11-26T07:13:53.330765+0000","last_unstale":"2023-11-26T07:13:56.521553+0000","last_undegraded":"2023-11-26T07:13:56.521553+0000","last_fullsized":"2023-11-26T07:13:56.521553+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:39:18.959386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:55.325670+0000","last_change":"2023-11-26T07:13:54.350156+0000","last_active":"2023-11-26T07:13:55.325670+0000","last_peered":"2023-11-26T07:13:55.325670+0000","last_clean":"2023-11-26T07:13:55.325670+0000","last_became_active":"2023-11-26T07:13:54.349622+0000","last_became_peered":"2023-11-26T07:13:54.349622+0000","last_unstale":"2023-11-26T07:13:55.325670+0000","last_undegraded":"2023-11-26T07:13:55.325670+0000","last_fullsized":"2023-11-26T07:13:55.325670+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:58:47.723873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522281+0000","last_change":"2023-11-26T07:13:53.333691+0000","last_active":"2023-11-26T07:13:56.522281+0000","last_peered":"2023-11-26T07:13:56.522281+0000","last_clean":"2023-11-26T07:13:56.522281+0000","last_became_active":"2023-11-26T07:13:53.333415+0000","last_became_peered":"2023-11-26T07:13:53.333415+0000","last_unstale":"2023-11-26T07:13:56.522281+0000","last_undegraded":"2023-11-26T07:13:56.522281+0000","last_fullsized":"2023-11-26T07:13:56.522281+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:11:37.328411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522197+0000","last_change":"2023-11-26T07:13:54.345377+0000","last_active":"2023-11-26T07:13:56.522197+0000","last_peered":"2023-11-26T07:13:56.522197+0000","last_clean":"2023-11-26T07:13:56.522197+0000","last_became_active":"2023-11-26T07:13:54.345025+0000","last_became_peered":"2023-11-26T07:13:54.345025+0000","last_unstale":"2023-11-26T07:13:56.522197+0000","last_undegraded":"2023-11-26T07:13:56.522197+0000","last_fullsized":"2023-11-26T07:13:56.522197+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:45:29.804466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521478+0000","last_change":"2023-11-26T07:13:53.329041+0000","last_active":"2023-11-26T07:13:56.521478+0000","last_peered":"2023-11-26T07:13:56.521478+0000","last_clean":"2023-11-26T07:13:56.521478+0000","last_became_active":"2023-11-26T07:13:53.328703+0000","last_became_peered":"2023-11-26T07:13:53.328703+0000","last_unstale":"2023-11-26T07:13:56.521478+0000","last_undegraded":"2023-11-26T07:13:56.521478+0000","last_fullsized":"2023-11-26T07:13:56.521478+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:32:06.638510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522743+0000","last_change":"2023-11-26T07:13:54.341419+0000","last_active":"2023-11-26T07:13:56.522743+0000","last_peered":"2023-11-26T07:13:56.522743+0000","last_clean":"2023-11-26T07:13:56.522743+0000","last_became_active":"2023-11-26T07:13:54.341116+0000","last_became_peered":"2023-11-26T07:13:54.341116+0000","last_unstale":"2023-11-26T07:13:56.522743+0000","last_undegraded":"2023-11-26T07:13:56.522743+0000","last_fullsized":"2023-11-26T07:13:56.522743+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:29:42.822778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521568+0000","last_change":"2023-11-26T07:13:53.325487+0000","last_active":"2023-11-26T07:13:56.521568+0000","last_peered":"2023-11-26T07:13:56.521568+0000","last_clean":"2023-11-26T07:13:56.521568+0000","last_became_active":"2023-11-26T07:13:53.325180+0000","last_became_peered":"2023-11-26T07:13:53.325180+0000","last_unstale":"2023-11-26T07:13:56.521568+0000","last_undegraded":"2023-11-26T07:13:56.521568+0000","last_fullsized":"2023-11-26T07:13:56.521568+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:02:45.612746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.523006+0000","last_change":"2023-11-26T07:13:54.353127+0000","last_active":"2023-11-26T07:13:56.523006+0000","last_peered":"2023-11-26T07:13:56.523006+0000","last_clean":"2023-11-26T07:13:56.523006+0000","last_became_active":"2023-11-26T07:13:54.352543+0000","last_became_peered":"2023-11-26T07:13:54.352543+0000","last_unstale":"2023-11-26T07:13:56.523006+0000","last_undegraded":"2023-11-26T07:13:56.523006+0000","last_fullsized":"2023-11-26T07:13:56.523006+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:16:13.258095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522947+0000","last_change":"2023-11-26T07:13:53.332462+0000","last_active":"2023-11-26T07:13:56.522947+0000","last_peered":"2023-11-26T07:13:56.522947+0000","last_clean":"2023-11-26T07:13:56.522947+0000","last_became_active":"2023-11-26T07:13:53.332209+0000","last_became_peered":"2023-11-26T07:13:53.332209+0000","last_unstale":"2023-11-26T07:13:56.522947+0000","last_undegraded":"2023-11-26T07:13:56.522947+0000","last_fullsized":"2023-11-26T07:13:56.522947+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:49:58.758555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522762+0000","last_change":"2023-11-26T07:13:54.351527+0000","last_active":"2023-11-26T07:13:56.522762+0000","last_peered":"2023-11-26T07:13:56.522762+0000","last_clean":"2023-11-26T07:13:56.522762+0000","last_became_active":"2023-11-26T07:13:54.350665+0000","last_became_peered":"2023-11-26T07:13:54.350665+0000","last_unstale":"2023-11-26T07:13:56.522762+0000","last_undegraded":"2023-11-26T07:13:56.522762+0000","last_fullsized":"2023-11-26T07:13:56.522762+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:43:29.071124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521564+0000","last_change":"2023-11-26T07:13:53.323367+0000","last_active":"2023-11-26T07:13:56.521564+0000","last_peered":"2023-11-26T07:13:56.521564+0000","last_clean":"2023-11-26T07:13:56.521564+0000","last_became_active":"2023-11-26T07:13:53.323087+0000","last_became_peered":"2023-11-26T07:13:53.323087+0000","last_unstale":"2023-11-26T07:13:56.521564+0000","last_undegraded":"2023-11-26T07:13:56.521564+0000","last_fullsized":"2023-11-26T07:13:56.521564+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:55:47.997858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521505+0000","last_change":"2023-11-26T07:13:54.348553+0000","last_active":"2023-11-26T07:13:56.521505+0000","last_peered":"2023-11-26T07:13:56.521505+0000","last_clean":"2023-11-26T07:13:56.521505+0000","last_became_active":"2023-11-26T07:13:54.348203+0000","last_became_peered":"2023-11-26T07:13:54.348203+0000","last_unstale":"2023-11-26T07:13:56.521505+0000","last_undegraded":"2023-11-26T07:13:56.521505+0000","last_fullsized":"2023-11-26T07:13:56.521505+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:22:38.287552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522527+0000","last_change":"2023-11-26T07:13:53.326049+0000","last_active":"2023-11-26T07:13:56.522527+0000","last_peered":"2023-11-26T07:13:56.522527+0000","last_clean":"2023-11-26T07:13:56.522527+0000","last_became_active":"2023-11-26T07:13:53.325621+0000","last_became_peered":"2023-11-26T07:13:53.325621+0000","last_unstale":"2023-11-26T07:13:56.522527+0000","last_undegraded":"2023-11-26T07:13:56.522527+0000","last_fullsized":"2023-11-26T07:13:56.522527+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:33:18.808399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521705+0000","last_change":"2023-11-26T07:13:54.352530+0000","last_active":"2023-11-26T07:13:56.521705+0000","last_peered":"2023-11-26T07:13:56.521705+0000","last_clean":"2023-11-26T07:13:56.521705+0000","last_became_active":"2023-11-26T07:13:54.351789+0000","last_became_peered":"2023-11-26T07:13:54.351789+0000","last_unstale":"2023-11-26T07:13:56.521705+0000","last_undegraded":"2023-11-26T07:13:56.521705+0000","last_fullsized":"2023-11-26T07:13:56.521705+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:16:00.238480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:55.328601+0000","last_change":"2023-11-26T07:13:53.326329+0000","last_active":"2023-11-26T07:13:55.328601+0000","last_peered":"2023-11-26T07:13:55.328601+0000","last_clean":"2023-11-26T07:13:55.328601+0000","last_became_active":"2023-11-26T07:13:53.325823+0000","last_became_peered":"2023-11-26T07:13:53.325823+0000","last_unstale":"2023-11-26T07:13:55.328601+0000","last_undegraded":"2023-11-26T07:13:55.328601+0000","last_fullsized":"2023-11-26T07:13:55.328601+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:23:42.475525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521359+0000","last_change":"2023-11-26T07:13:54.346843+0000","last_active":"2023-11-26T07:13:56.521359+0000","last_peered":"2023-11-26T07:13:56.521359+0000","last_clean":"2023-11-26T07:13:56.521359+0000","last_became_active":"2023-11-26T07:13:54.346515+0000","last_became_peered":"2023-11-26T07:13:54.346515+0000","last_unstale":"2023-11-26T07:13:56.521359+0000","last_undegraded":"2023-11-26T07:13:56.521359+0000","last_fullsized":"2023-11-26T07:13:56.521359+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:27:36.448372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521740+0000","last_change":"2023-11-26T07:13:53.333673+0000","last_active":"2023-11-26T07:13:56.521740+0000","last_peered":"2023-11-26T07:13:56.521740+0000","last_clean":"2023-11-26T07:13:56.521740+0000","last_became_active":"2023-11-26T07:13:53.333356+0000","last_became_peered":"2023-11-26T07:13:53.333356+0000","last_unstale":"2023-11-26T07:13:56.521740+0000","last_undegraded":"2023-11-26T07:13:56.521740+0000","last_fullsized":"2023-11-26T07:13:56.521740+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:53:36.745100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:55.328476+0000","last_change":"2023-11-26T07:13:54.347067+0000","last_active":"2023-11-26T07:13:55.328476+0000","last_peered":"2023-11-26T07:13:55.328476+0000","last_clean":"2023-11-26T07:13:55.328476+0000","last_became_active":"2023-11-26T07:13:54.346784+0000","last_became_peered":"2023-11-26T07:13:54.346784+0000","last_unstale":"2023-11-26T07:13:55.328476+0000","last_undegraded":"2023-11-26T07:13:55.328476+0000","last_fullsized":"2023-11-26T07:13:55.328476+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:19:52.890589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521880+0000","last_change":"2023-11-26T07:13:53.335020+0000","last_active":"2023-11-26T07:13:56.521880+0000","last_peered":"2023-11-26T07:13:56.521880+0000","last_clean":"2023-11-26T07:13:56.521880+0000","last_became_active":"2023-11-26T07:13:53.334717+0000","last_became_peered":"2023-11-26T07:13:53.334717+0000","last_unstale":"2023-11-26T07:13:56.521880+0000","last_undegraded":"2023-11-26T07:13:56.521880+0000","last_fullsized":"2023-11-26T07:13:56.521880+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:29:49.737685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.523131+0000","last_change":"2023-11-26T07:13:54.344538+0000","last_active":"2023-11-26T07:13:56.523131+0000","last_peered":"2023-11-26T07:13:56.523131+0000","last_clean":"2023-11-26T07:13:56.523131+0000","last_became_active":"2023-11-26T07:13:54.344091+0000","last_became_peered":"2023-11-26T07:13:54.344091+0000","last_unstale":"2023-11-26T07:13:56.523131+0000","last_undegraded":"2023-11-26T07:13:56.523131+0000","last_fullsized":"2023-11-26T07:13:56.523131+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:33:19.814608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522214+0000","last_change":"2023-11-26T07:13:53.326441+0000","last_active":"2023-11-26T07:13:56.522214+0000","last_peered":"2023-11-26T07:13:56.522214+0000","last_clean":"2023-11-26T07:13:56.522214+0000","last_became_active":"2023-11-26T07:13:53.326158+0000","last_became_peered":"2023-11-26T07:13:53.326158+0000","last_unstale":"2023-11-26T07:13:56.522214+0000","last_undegraded":"2023-11-26T07:13:56.522214+0000","last_fullsized":"2023-11-26T07:13:56.522214+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:06:56.730777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":186,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-26T07:13:54.327102+0000","last_change":"2023-11-26T07:11:29.855919+0000","last_active":"2023-11-26T07:13:54.327102+0000","last_peered":"2023-11-26T07:13:54.327102+0000","last_clean":"2023-11-26T07:13:54.327102+0000","last_became_active":"2023-11-26T07:11:29.854903+0000","last_became_peered":"2023-11-26T07:11:29.854903+0000","last_unstale":"2023-11-26T07:13:54.327102+0000","last_undegraded":"2023-11-26T07:13:54.327102+0000","last_fullsized":"2023-11-26T07:13:54.327102+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:28.594252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:28.594252+0000","last_clean_scrub_stamp":"2023-11-26T07:11:28.594252+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:33:34.642696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28120,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343720,"statfs":{"total":96636764160,"available":96607969280,"internally_reserved":0,"allocated":1126400,"data_stored":804772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53700000000000003,"15min":0.53500000000000003},"min":{"1min":0.35599999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.73099999999999998,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.51200000000000001,"15min":0.505},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.64300000000000002}]},{"osd":1,"last update":"Sun Nov 26 07:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.94999999999999996,"15min":1.014},"min":{"1min":0.40799999999999997,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.72099999999999997,"5min":9.5600000000000005,"15min":9.5600000000000005},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57999999999999996,"15min":0.58399999999999996},"min":{"1min":0.42399999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.86699999999999999,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.70199999999999996}]},{"osd":2,"last update":"Sun Nov 26 07:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60299999999999998,"15min":0.60399999999999998},"min":{"1min":0.39800000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.3979999999999999,"5min":1.569,"15min":1.569},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.65000000000000002,"15min":0.65300000000000002},"min":{"1min":0.47099999999999997,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.81499999999999995,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.68899999999999995}]},{"osd":3,"last update":"Sun Nov 26 07:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.494,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.57499999999999996,"15min":0.56499999999999995},"min":{"1min":0.46000000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.77400000000000002}]},{"osd":4,"last update":"Sun Nov 26 07:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.32800000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.73699999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.52100000000000002,"15min":0.51000000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.54100000000000004}]},{"osd":5,"last update":"Sun Nov 26 07:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.54000000000000004,"15min":0.53000000000000003},"min":{"1min":0.39300000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.82099999999999995,"5min":0.876,"15min":0.876},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.83199999999999996,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.59899999999999998}]},{"osd":6,"last update":"Sun Nov 26 07:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59299999999999997,"15min":0.58999999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.60199999999999998,"15min":0.59299999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.497}]}]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":524288,"data_stored":208686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:13:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.496,"15min":0.48199999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.48499999999999999,"15min":0.46999999999999997},"min":{"1min":0.33400000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.51400000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:13:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.52000000000000002,"15min":0.51000000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.85099999999999998,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.54900000000000004,"15min":0.54400000000000004},"min":{"1min":0.42799999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.77900000000000003,"5min":1.198,"15min":1.198},"last":0.60799999999999998}]},{"osd":2,"last update":"Sun Nov 26 07:13:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.505,"15min":0.49099999999999999},"min":{"1min":0.39800000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.52700000000000002,"15min":0.51600000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.621}]},{"osd":3,"last update":"Sun Nov 26 07:13:28 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.55800000000000005,"15min":0.54600000000000004},"min":{"1min":0.41299999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.58899999999999997,"15min":0.57899999999999996},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.59399999999999997}]},{"osd":4,"last update":"Sun Nov 26 07:13:28 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53300000000000003,"15min":0.53400000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.47699999999999998}]},{"osd":5,"last update":"Sun Nov 26 07:13:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56200000000000006,"15min":0.56000000000000005},"min":{"1min":0.39600000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58699999999999997,"15min":0.58899999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80400000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.34599999999999997}]},{"osd":7,"last update":"Sun Nov 26 07:13:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59399999999999997,"15min":0.59199999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.628,"15min":0.626},"min":{"1min":0.46100000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.45800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31700,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340140,"statfs":{"total":96636764160,"available":96604303360,"internally_reserved":0,"allocated":532480,"data_stored":214384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:13:28 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.35899999999999999,"15min":0.36499999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.46999999999999997,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.441},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.79800000000000004,"15min":0.872},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.495,"5min":11.922000000000001,"15min":11.922000000000001},"last":0.29299999999999998}]},{"osd":2,"last update":"Sun Nov 26 07:13:28 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.372,"15min":0.376},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.50600000000000001,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.40799999999999997,"15min":0.40999999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.57499999999999996,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.31900000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:13:28 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.45900000000000002,"15min":0.46100000000000002},"min":{"1min":0.316,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.65100000000000002,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.38},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.44,"15min":0.443},"min":{"1min":0.32000000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.62,"5min":1.101,"15min":1.101},"last":0.34999999999999998}]},{"osd":4,"last update":"Sun Nov 26 07:13:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.86499999999999999,"15min":0.90700000000000003},"min":{"1min":0.433,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.83899999999999997,"5min":6.8979999999999997,"15min":6.8979999999999997},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.66200000000000003,"15min":0.66600000000000004},"min":{"1min":0.47599999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.78500000000000003,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.52700000000000002}]},{"osd":5,"last update":"Sun Nov 26 07:13:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.623,"15min":0.628},"min":{"1min":0.443,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.72899999999999998,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.86799999999999999,"15min":0.91200000000000003},"min":{"1min":0.45700000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.76900000000000002,"5min":6.9480000000000004,"15min":6.9480000000000004},"last":0.40100000000000002}]},{"osd":6,"last update":"Sun Nov 26 07:13:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.65800000000000003,"15min":0.66400000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.80700000000000005,"5min":1.194,"15min":1.194},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.89200000000000002,"15min":0.93999999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.76300000000000001,"5min":6.9800000000000004,"15min":6.9800000000000004},"last":0.372}]},{"osd":7,"last update":"Sun Nov 26 07:13:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65900000000000003,"15min":0.66100000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.84199999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.67700000000000005,"15min":0.68700000000000006},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.79500000000000004,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.48699999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28120,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343720,"statfs":{"total":96636764160,"available":96607969280,"internally_reserved":0,"allocated":1126400,"data_stored":804716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.36799999999999999,"15min":0.377},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.499,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.378,"5min":0.82599999999999996,"15min":0.90100000000000002},"min":{"1min":0.29299999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.56799999999999995,"5min":11.987,"15min":11.987},"last":0.28399999999999997}]},{"osd":2,"last update":"Sun Nov 26 07:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.432,"15min":0.44400000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.54900000000000004,"5min":1.607,"15min":1.607},"last":0.374},{"interface":"front","average":{"1min":0.374,"5min":0.41099999999999998,"15min":0.41699999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.49099999999999999,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.39400000000000002}]},{"osd":3,"last update":"Sun Nov 26 07:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.38900000000000001,"15min":0.39100000000000001},"min":{"1min":0.27500000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.53700000000000003,"5min":0.752,"15min":0.752},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.46800000000000003,"15min":0.47899999999999998},"min":{"1min":0.30499999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.59099999999999997,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.46200000000000002}]},{"osd":4,"last update":"Sun Nov 26 07:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.65700000000000003,"15min":0.66300000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.78700000000000003,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.88800000000000001,"15min":0.93000000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82199999999999995,"5min":6.5279999999999996,"15min":6.5279999999999996},"last":0.65600000000000003}]},{"osd":5,"last update":"Sun Nov 26 07:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.65600000000000003,"15min":0.65800000000000003},"min":{"1min":0.46100000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.80300000000000005,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.69999999999999996,"15min":0.70599999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.88400000000000001,"5min":1.508,"15min":1.508},"last":0.56799999999999995}]},{"osd":6,"last update":"Sun Nov 26 07:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.92300000000000004,"15min":0.96699999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93400000000000005,"5min":6.5419999999999998,"15min":6.5419999999999998},"last":0.625},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.68000000000000005,"15min":0.68600000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.84399999999999997,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.67200000000000004}]},{"osd":7,"last update":"Sun Nov 26 07:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70799999999999996,"15min":0.71199999999999997},"min":{"1min":0.503,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.91000000000000003,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.66400000000000003,"15min":0.67000000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.872,"5min":1.155,"15min":1.155},"last":0.59499999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":544768,"data_stored":215948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.34499999999999997,"15min":0.34799999999999998},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.33000000000000002}]},{"osd":1,"last update":"Sun Nov 26 07:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.34499999999999997,"15min":0.34899999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.41999999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.38,"5min":0.378,"15min":0.378},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.496,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.38200000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.41399999999999998,"15min":0.41699999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.54700000000000004,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.38200000000000001,"15min":0.38500000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.52500000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.36799999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.39200000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.76700000000000002,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.38200000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.78400000000000003,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.54800000000000004}]},{"osd":5,"last update":"Sun Nov 26 07:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57299999999999995,"15min":0.57399999999999995},"min":{"1min":0.44,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.63100000000000001,"15min":0.63700000000000001},"min":{"1min":0.498,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.83099999999999996,"5min":1.002,"15min":1.002},"last":0.56399999999999995}]},{"osd":6,"last update":"Sun Nov 26 07:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.48699999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84699999999999998,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.63200000000000001,"15min":0.63600000000000001},"min":{"1min":0.44400000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.73599999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.78600000000000003}]},{"osd":7,"last update":"Sun Nov 26 07:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.627,"15min":0.63100000000000001},"min":{"1min":0.437,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86299999999999999,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.622,"15min":0.624},"min":{"1min":0.437,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.872,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.745}]}]},{"osd":3,"up_from":13,"seq":55834574882,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":540672,"data_stored":214952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:13:32 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.36399999999999999,"15min":0.373},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.51500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.41799999999999998,"15min":0.42699999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.48099999999999998,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.29499999999999998}]},{"osd":1,"last update":"Sun Nov 26 07:13:32 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.40100000000000002,"15min":0.41199999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.53600000000000003,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.38,"5min":0.5,"15min":0.52000000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.52900000000000003,"5min":2.903,"15min":2.903},"last":0.32000000000000001}]},{"osd":2,"last update":"Sun Nov 26 07:13:32 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.40400000000000003,"15min":0.40799999999999997},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.57399999999999995,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.41699999999999998,"15min":0.42199999999999999},"min":{"1min":0.307,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.51900000000000002,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.33500000000000002}]},{"osd":4,"last update":"Sun Nov 26 07:13:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.70399999999999996,"15min":0.72399999999999998},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.81000000000000005,"5min":2.9609999999999999,"15min":2.9609999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.64100000000000001,"15min":0.64700000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.93100000000000005,"5min":1.163,"15min":1.163},"last":0.5}]},{"osd":5,"last update":"Sun Nov 26 07:13:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.66800000000000004,"15min":0.67800000000000005},"min":{"1min":0.41499999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.879,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.66100000000000003,"15min":0.67100000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.83599999999999997,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.51200000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:13:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.66900000000000004,"15min":0.67900000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.97599999999999998,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.67800000000000005,"15min":0.68799999999999994},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.89900000000000002,"5min":1.258,"15min":1.258},"last":0.47399999999999998}]},{"osd":7,"last update":"Sun Nov 26 07:13:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.67900000000000005,"15min":0.69099999999999995},"min":{"1min":0.47799999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.81899999999999995,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.439},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.747,"15min":0.76900000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.91300000000000003,"5min":2.9969999999999999,"15min":2.9969999999999999},"last":0.48599999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":540672,"data_stored":215926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.91700000000000004,"15min":0.97299999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.87,"5min":8.7539999999999996,"15min":8.7539999999999996},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.93100000000000005,"15min":0.98799999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.82799999999999996,"5min":8.7390000000000008,"15min":8.7390000000000008},"last":0.88200000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.96499999999999997,"15min":1.028},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.81200000000000006,"5min":9.7720000000000002,"15min":9.7720000000000002},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.78300000000000003,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.80000000000000004}]},{"osd":2,"last update":"Sun Nov 26 07:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.91600000000000004,"15min":0.97599999999999998},"min":{"1min":0.39100000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80100000000000005,"5min":9.8119999999999994,"15min":9.8119999999999994},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.82699999999999996,"15min":0.86299999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.85499999999999998,"5min":3.645,"15min":3.645},"last":0.48399999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.96199999999999997,"15min":1.02},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.80600000000000005,"5min":8.8089999999999993,"15min":8.8089999999999993},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60599999999999998,"15min":0.60499999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83899999999999997,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.66800000000000004}]},{"osd":5,"last update":"Sun Nov 26 07:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.502,"15min":0.498},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.746,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.84499999999999997}]},{"osd":6,"last update":"Sun Nov 26 07:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.75800000000000001,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56999999999999995,"15min":0.57399999999999995},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78200000000000003,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.74399999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.78100000000000003,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.60199999999999998,"15min":0.60299999999999998},"min":{"1min":0.38300000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.78900000000000003,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.92700000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":520192,"data_stored":208084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.51000000000000001,"15min":0.51400000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.81499999999999995,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.44},{"interface":"front","average":{"1min":0.505,"5min":0.54900000000000004,"15min":0.55600000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.69099999999999995,"5min":0.877,"15min":0.877},"last":0.64100000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.80400000000000005,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.53300000000000003}]},{"osd":2,"last update":"Sun Nov 26 07:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.74099999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.59399999999999997,"15min":0.59799999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.625}]},{"osd":3,"last update":"Sun Nov 26 07:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56100000000000005,"15min":0.55900000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.78900000000000003,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58299999999999996,"15min":0.58499999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.73999999999999999,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.55800000000000005}]},{"osd":4,"last update":"Sun Nov 26 07:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.48099999999999998,"15min":0.48499999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72899999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56599999999999995,"15min":0.56999999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.79900000000000004,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.70699999999999996}]},{"osd":6,"last update":"Sun Nov 26 07:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.377,"5min":0.308,"15min":0.308},"max":{"1min":0.71399999999999997,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.39600000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78000000000000003,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.68400000000000005}]},{"osd":7,"last update":"Sun Nov 26 07:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58299999999999996,"15min":0.58399999999999996},"min":{"1min":0.42399999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.622,"15min":0.622},"min":{"1min":0.43099999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.81499999999999995,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.71999999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:13:58.496 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:13:58.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.654+0000 7f3759997700 1 Processor -- start 2023-11-26T07:13:58.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.654+0000 7f3759997700 1 -- start start 2023-11-26T07:13:58.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.655+0000 7f3759997700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37540cfc60 0x7f37540d00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:58.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.655+0000 7f3759997700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f37540d0620 0x7f375406faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:58.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.655+0000 7f3759997700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f375406f610 con 0x7f375415c010 2023-11-26T07:13:58.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.655+0000 7f3759997700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37540cdac0 con 0x7f37540d0620 2023-11-26T07:13:58.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.655+0000 7f3759997700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375406ece0 con 0x7f37540cfc60 2023-11-26T07:13:58.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.655+0000 7f37537fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f37540d0620 0x7f375406faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:58.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.655+0000 7f37537fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f37540d0620 0x7f375406faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42012/0 (socket says 172.21.15.2:42012) 2023-11-26T07:13:58.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.655+0000 7f37537fe700 1 -- 172.21.15.2:0/4125109234 learned_addr learned my addr 172.21.15.2:0/4125109234 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:58.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.655+0000 7f37527fc700 1 --2- 172.21.15.2:0/4125109234 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37540cfc60 0x7f37540d00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:58.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.656+0000 7f37537fe700 1 -- 172.21.15.2:0/4125109234 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37540cfc60 msgr2=0x7f37540d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:58.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.656+0000 7f37537fe700 1 --2- 172.21.15.2:0/4125109234 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37540cfc60 0x7f37540d00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:58.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.656+0000 7f37537fe700 1 -- 172.21.15.2:0/4125109234 >> v1:172.21.15.192:6789/0 conn(0x7f375415c010 legacy=0x7f37540cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:58.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.656+0000 7f37537fe700 1 -- 172.21.15.2:0/4125109234 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f375406efc0 con 0x7f37540d0620 2023-11-26T07:13:58.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.656+0000 7f37537fe700 1 --2- 172.21.15.2:0/4125109234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37540d0620 0x7f375406faa0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f374c009e50 tx=0x7f374c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d208554cfa1cb92 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:58.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.656+0000 7f3751ffb700 1 -- 172.21.15.2:0/4125109234 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c00e070 con 0x7f37540d0620 2023-11-26T07:13:58.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.656+0000 7f3751ffb700 1 -- 172.21.15.2:0/4125109234 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374c00b9c0 con 0x7f37540d0620 2023-11-26T07:13:58.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.656+0000 7f3751ffb700 1 -- 172.21.15.2:0/4125109234 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c00bd70 con 0x7f37540d0620 2023-11-26T07:13:58.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.656+0000 7f3759997700 1 -- 172.21.15.2:0/4125109234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37540d0620 msgr2=0x7f375406faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:58.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.656+0000 7f3759997700 1 --2- 172.21.15.2:0/4125109234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37540d0620 0x7f375406faa0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f374c009e50 tx=0x7f374c00b330 comp rx=0 tx=0).stop 2023-11-26T07:13:58.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.656+0000 7f3759997700 1 -- 172.21.15.2:0/4125109234 shutdown_connections 2023-11-26T07:13:58.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.656+0000 7f3759997700 1 --2- 172.21.15.2:0/4125109234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37540d0620 0x7f375406faa0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:58.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.656+0000 7f3759997700 1 --2- 172.21.15.2:0/4125109234 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37540cfc60 0x7f37540d00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:58.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.657+0000 7f3759997700 1 -- 172.21.15.2:0/4125109234 >> 172.21.15.2:0/4125109234 conn(0x7f37540b3790 msgr2=0x7f37540b3ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:58.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.657+0000 7f3759997700 1 -- 172.21.15.2:0/4125109234 shutdown_connections 2023-11-26T07:13:58.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.657+0000 7f3759997700 1 -- 172.21.15.2:0/4125109234 wait complete. 2023-11-26T07:13:58.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.658+0000 7f3759997700 1 Processor -- start 2023-11-26T07:13:58.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.658+0000 7f3759997700 1 -- start start 2023-11-26T07:13:58.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.659+0000 7f3759997700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37540cfc60 0x7f37541490c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:58.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.659+0000 7f3759997700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37540d0620 0x7f3754148720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:58.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.659+0000 7f3759997700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f375415c010 0x7f37540b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:58.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.659+0000 7f3759997700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3754149930 con 0x7f375415c010 2023-11-26T07:13:58.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.659+0000 7f3759997700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37540af110 con 0x7f37540d0620 2023-11-26T07:13:58.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.659+0000 7f3759997700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37540af3f0 con 0x7f37540cfc60 2023-11-26T07:13:58.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.659+0000 7f37537fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f375415c010 0x7f37540b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:58.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.659+0000 7f37537fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f375415c010 0x7f37540b01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42018/0 (socket says 172.21.15.2:42018) 2023-11-26T07:13:58.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.659+0000 7f37537fe700 1 -- 172.21.15.2:0/1721066710 learned_addr learned my addr 172.21.15.2:0/1721066710 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:58.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.660+0000 7f37537fe700 1 -- 172.21.15.2:0/1721066710 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37540cfc60 msgr2=0x7f37541490c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:58.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.660+0000 7f37527fc700 1 --2- 172.21.15.2:0/1721066710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37540d0620 0x7f3754148720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:58.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.660+0000 7f3752ffd700 1 --2- 172.21.15.2:0/1721066710 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37540cfc60 0x7f37541490c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:58.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.660+0000 7f37537fe700 1 --2- 172.21.15.2:0/1721066710 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37540cfc60 0x7f37541490c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:58.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.660+0000 7f37537fe700 1 -- 172.21.15.2:0/1721066710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37540d0620 msgr2=0x7f3754148720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:58.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.660+0000 7f37537fe700 1 --2- 172.21.15.2:0/1721066710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37540d0620 0x7f3754148720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:58.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.660+0000 7f37537fe700 1 -- 172.21.15.2:0/1721066710 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f374c009b30 con 0x7f375415c010 2023-11-26T07:13:58.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.660+0000 7f37527fc700 1 --2- 172.21.15.2:0/1721066710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37540d0620 0x7f3754148720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:13:58.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.660+0000 7f37537fe700 1 --2- 172.21.15.2:0/1721066710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f375415c010 0x7f37540b01b0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f3754072340 tx=0x7f374c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:58.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.660+0000 7f373bfff700 1 -- 172.21.15.2:0/1721066710 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c004960 con 0x7f375415c010 2023-11-26T07:13:58.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.660+0000 7f373bfff700 1 -- 172.21.15.2:0/1721066710 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374c0099b0 con 0x7f375415c010 2023-11-26T07:13:58.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.660+0000 7f3759997700 1 -- 172.21.15.2:0/1721066710 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37540af6d0 con 0x7f375415c010 2023-11-26T07:13:58.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.660+0000 7f373bfff700 1 -- 172.21.15.2:0/1721066710 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c01c680 con 0x7f375415c010 2023-11-26T07:13:58.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.660+0000 7f3759997700 1 -- 172.21.15.2:0/1721066710 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37540afc90 con 0x7f375415c010 2023-11-26T07:13:58.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.661+0000 7f3759997700 1 -- 172.21.15.2:0/1721066710 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3754068670 con 0x7f375415c010 2023-11-26T07:13:58.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.662+0000 7f373bfff700 1 -- 172.21.15.2:0/1721066710 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f374c01c7e0 con 0x7f375415c010 2023-11-26T07:13:58.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.662+0000 7f373bfff700 1 --2- 172.21.15.2:0/1721066710 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f374006b1a0 0x7f374006d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:58.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.662+0000 7f373bfff700 1 -- 172.21.15.2:0/1721066710 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f374c08b820 con 0x7f375415c010 2023-11-26T07:13:58.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.662+0000 7f3752ffd700 1 --2- 172.21.15.2:0/1721066710 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f374006b1a0 0x7f374006d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:58.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.663+0000 7f3752ffd700 1 --2- 172.21.15.2:0/1721066710 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f374006b1a0 0x7f374006d660 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3748000f60 tx=0x7f3748009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:58.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.666+0000 7f373bfff700 1 -- 172.21.15.2:0/1721066710 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f374c056500 con 0x7f375415c010 2023-11-26T07:13:58.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.862+0000 7f3759997700 1 -- 172.21.15.2:0/1721066710 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f37540d0a70 con 0x7f374006b1a0 2023-11-26T07:13:58.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.871+0000 7f373bfff700 1 -- 172.21.15.2:0/1721066710 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289357 (secure 0 0 0) 0x7f37480050d0 con 0x7f374006b1a0 2023-11-26T07:13:58.876 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:13:58.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.874+0000 7f3759997700 1 -- 172.21.15.2:0/1721066710 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f374006b1a0 msgr2=0x7f374006d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:58.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.874+0000 7f3759997700 1 --2- 172.21.15.2:0/1721066710 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f374006b1a0 0x7f374006d660 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3748000f60 tx=0x7f3748009040 comp rx=0 tx=0).stop 2023-11-26T07:13:58.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.874+0000 7f3759997700 1 -- 172.21.15.2:0/1721066710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f375415c010 msgr2=0x7f37540b01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:58.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.874+0000 7f3759997700 1 --2- 172.21.15.2:0/1721066710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f375415c010 0x7f37540b01b0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f3754072340 tx=0x7f374c004ad0 comp rx=0 tx=0).stop 2023-11-26T07:13:58.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.874+0000 7f3759997700 1 -- 172.21.15.2:0/1721066710 shutdown_connections 2023-11-26T07:13:58.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.874+0000 7f3759997700 1 --2- 172.21.15.2:0/1721066710 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f374006b1a0 0x7f374006d660 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:58.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.874+0000 7f3759997700 1 --2- 172.21.15.2:0/1721066710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f375415c010 0x7f37540b01b0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:58.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.874+0000 7f3759997700 1 --2- 172.21.15.2:0/1721066710 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37540cfc60 0x7f37541490c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:58.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.874+0000 7f3759997700 1 --2- 172.21.15.2:0/1721066710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37540d0620 0x7f3754148720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:58.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.874+0000 7f3759997700 1 -- 172.21.15.2:0/1721066710 >> 172.21.15.2:0/1721066710 conn(0x7f37540b3790 msgr2=0x7f375415b270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:58.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.874+0000 7f3759997700 1 -- 172.21.15.2:0/1721066710 shutdown_connections 2023-11-26T07:13:58.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:58.874+0000 7f3759997700 1 -- 172.21.15.2:0/1721066710 wait complete. 2023-11-26T07:13:58.879 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-26T07:13:58.888 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2023-11-26T07:13:58.189041+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":111,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225672,"kb_used_data":5328,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749048,"statfs":{"total":773094113280,"available":772863025152,"internally_reserved":0,"allocated":5455872,"data_stored":2887468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.877670"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522541+0000","last_change":"2023-11-26T07:13:54.349573+0000","last_active":"2023-11-26T07:13:56.522541+0000","last_peered":"2023-11-26T07:13:56.522541+0000","last_clean":"2023-11-26T07:13:56.522541+0000","last_became_active":"2023-11-26T07:13:54.349262+0000","last_became_peered":"2023-11-26T07:13:54.349262+0000","last_unstale":"2023-11-26T07:13:56.522541+0000","last_undegraded":"2023-11-26T07:13:56.522541+0000","last_fullsized":"2023-11-26T07:13:56.522541+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:49:36.834186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522106+0000","last_change":"2023-11-26T07:13:54.352361+0000","last_active":"2023-11-26T07:13:56.522106+0000","last_peered":"2023-11-26T07:13:56.522106+0000","last_clean":"2023-11-26T07:13:56.522106+0000","last_became_active":"2023-11-26T07:13:54.352089+0000","last_became_peered":"2023-11-26T07:13:54.352089+0000","last_unstale":"2023-11-26T07:13:56.522106+0000","last_undegraded":"2023-11-26T07:13:56.522106+0000","last_fullsized":"2023-11-26T07:13:56.522106+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:49:36.834186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:55.328638+0000","last_change":"2023-11-26T07:13:54.351287+0000","last_active":"2023-11-26T07:13:55.328638+0000","last_peered":"2023-11-26T07:13:55.328638+0000","last_clean":"2023-11-26T07:13:55.328638+0000","last_became_active":"2023-11-26T07:13:54.351000+0000","last_became_peered":"2023-11-26T07:13:54.351000+0000","last_unstale":"2023-11-26T07:13:55.328638+0000","last_undegraded":"2023-11-26T07:13:55.328638+0000","last_fullsized":"2023-11-26T07:13:55.328638+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:45:29.804466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.523089+0000","last_change":"2023-11-26T07:13:54.339746+0000","last_active":"2023-11-26T07:13:56.523089+0000","last_peered":"2023-11-26T07:13:56.523089+0000","last_clean":"2023-11-26T07:13:56.523089+0000","last_became_active":"2023-11-26T07:13:54.339449+0000","last_became_peered":"2023-11-26T07:13:54.339449+0000","last_unstale":"2023-11-26T07:13:56.523089+0000","last_undegraded":"2023-11-26T07:13:56.523089+0000","last_fullsized":"2023-11-26T07:13:56.523089+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:39:19.965595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521837+0000","last_change":"2023-11-26T07:13:54.354225+0000","last_active":"2023-11-26T07:13:56.521837+0000","last_peered":"2023-11-26T07:13:56.521837+0000","last_clean":"2023-11-26T07:13:56.521837+0000","last_became_active":"2023-11-26T07:13:54.353957+0000","last_became_peered":"2023-11-26T07:13:54.353957+0000","last_unstale":"2023-11-26T07:13:56.521837+0000","last_undegraded":"2023-11-26T07:13:56.521837+0000","last_fullsized":"2023-11-26T07:13:56.521837+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:22:22.646479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521730+0000","last_change":"2023-11-26T07:13:54.335862+0000","last_active":"2023-11-26T07:13:56.521730+0000","last_peered":"2023-11-26T07:13:56.521730+0000","last_clean":"2023-11-26T07:13:56.521730+0000","last_became_active":"2023-11-26T07:13:54.335565+0000","last_became_peered":"2023-11-26T07:13:54.335565+0000","last_unstale":"2023-11-26T07:13:56.521730+0000","last_undegraded":"2023-11-26T07:13:56.521730+0000","last_fullsized":"2023-11-26T07:13:56.521730+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:12:35.990647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522510+0000","last_change":"2023-11-26T07:13:54.346197+0000","last_active":"2023-11-26T07:13:56.522510+0000","last_peered":"2023-11-26T07:13:56.522510+0000","last_clean":"2023-11-26T07:13:56.522510+0000","last_became_active":"2023-11-26T07:13:54.345938+0000","last_became_peered":"2023-11-26T07:13:54.345938+0000","last_unstale":"2023-11-26T07:13:56.522510+0000","last_undegraded":"2023-11-26T07:13:56.522510+0000","last_fullsized":"2023-11-26T07:13:56.522510+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:20:50.923224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522084+0000","last_change":"2023-11-26T07:13:54.346437+0000","last_active":"2023-11-26T07:13:56.522084+0000","last_peered":"2023-11-26T07:13:56.522084+0000","last_clean":"2023-11-26T07:13:56.522084+0000","last_became_active":"2023-11-26T07:13:54.345923+0000","last_became_peered":"2023-11-26T07:13:54.345923+0000","last_unstale":"2023-11-26T07:13:56.522084+0000","last_undegraded":"2023-11-26T07:13:56.522084+0000","last_fullsized":"2023-11-26T07:13:56.522084+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:59:24.340460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.523097+0000","last_change":"2023-11-26T07:13:54.347194+0000","last_active":"2023-11-26T07:13:56.523097+0000","last_peered":"2023-11-26T07:13:56.523097+0000","last_clean":"2023-11-26T07:13:56.523097+0000","last_became_active":"2023-11-26T07:13:54.346897+0000","last_became_peered":"2023-11-26T07:13:54.346897+0000","last_unstale":"2023-11-26T07:13:56.523097+0000","last_undegraded":"2023-11-26T07:13:56.523097+0000","last_fullsized":"2023-11-26T07:13:56.523097+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:19:34.787417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522908+0000","last_change":"2023-11-26T07:13:54.344363+0000","last_active":"2023-11-26T07:13:56.522908+0000","last_peered":"2023-11-26T07:13:56.522908+0000","last_clean":"2023-11-26T07:13:56.522908+0000","last_became_active":"2023-11-26T07:13:54.343742+0000","last_became_peered":"2023-11-26T07:13:54.343742+0000","last_unstale":"2023-11-26T07:13:56.522908+0000","last_undegraded":"2023-11-26T07:13:56.522908+0000","last_fullsized":"2023-11-26T07:13:56.522908+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:16:34.507626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.523217+0000","last_change":"2023-11-26T07:13:54.355073+0000","last_active":"2023-11-26T07:13:56.523217+0000","last_peered":"2023-11-26T07:13:56.523217+0000","last_clean":"2023-11-26T07:13:56.523217+0000","last_became_active":"2023-11-26T07:13:54.353627+0000","last_became_peered":"2023-11-26T07:13:54.353627+0000","last_unstale":"2023-11-26T07:13:56.523217+0000","last_undegraded":"2023-11-26T07:13:56.523217+0000","last_fullsized":"2023-11-26T07:13:56.523217+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:06:57.736985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522313+0000","last_change":"2023-11-26T07:13:54.351322+0000","last_active":"2023-11-26T07:13:56.522313+0000","last_peered":"2023-11-26T07:13:56.522313+0000","last_clean":"2023-11-26T07:13:56.522313+0000","last_became_active":"2023-11-26T07:13:54.351055+0000","last_became_peered":"2023-11-26T07:13:54.351055+0000","last_unstale":"2023-11-26T07:13:56.522313+0000","last_undegraded":"2023-11-26T07:13:56.522313+0000","last_fullsized":"2023-11-26T07:13:56.522313+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:20:50.923224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:55.325613+0000","last_change":"2023-11-26T07:13:54.351142+0000","last_active":"2023-11-26T07:13:55.325613+0000","last_peered":"2023-11-26T07:13:55.325613+0000","last_clean":"2023-11-26T07:13:55.325613+0000","last_became_active":"2023-11-26T07:13:54.350856+0000","last_became_peered":"2023-11-26T07:13:54.350856+0000","last_unstale":"2023-11-26T07:13:55.325613+0000","last_undegraded":"2023-11-26T07:13:55.325613+0000","last_fullsized":"2023-11-26T07:13:55.325613+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:00:31.148588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522853+0000","last_change":"2023-11-26T07:13:54.355488+0000","last_active":"2023-11-26T07:13:56.522853+0000","last_peered":"2023-11-26T07:13:56.522853+0000","last_clean":"2023-11-26T07:13:56.522853+0000","last_became_active":"2023-11-26T07:13:54.353650+0000","last_became_peered":"2023-11-26T07:13:54.353650+0000","last_unstale":"2023-11-26T07:13:56.522853+0000","last_undegraded":"2023-11-26T07:13:56.522853+0000","last_fullsized":"2023-11-26T07:13:56.522853+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:32:07.644718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521299+0000","last_change":"2023-11-26T07:13:54.349987+0000","last_active":"2023-11-26T07:13:56.521299+0000","last_peered":"2023-11-26T07:13:56.521299+0000","last_clean":"2023-11-26T07:13:56.521299+0000","last_became_active":"2023-11-26T07:13:54.349689+0000","last_became_peered":"2023-11-26T07:13:54.349689+0000","last_unstale":"2023-11-26T07:13:56.521299+0000","last_undegraded":"2023-11-26T07:13:56.521299+0000","last_fullsized":"2023-11-26T07:13:56.521299+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:50:03.118294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521648+0000","last_change":"2023-11-26T07:13:54.347220+0000","last_active":"2023-11-26T07:13:56.521648+0000","last_peered":"2023-11-26T07:13:56.521648+0000","last_clean":"2023-11-26T07:13:56.521648+0000","last_became_active":"2023-11-26T07:13:54.346821+0000","last_became_peered":"2023-11-26T07:13:54.346821+0000","last_unstale":"2023-11-26T07:13:56.521648+0000","last_undegraded":"2023-11-26T07:13:56.521648+0000","last_fullsized":"2023-11-26T07:13:56.521648+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:49:24.833685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:55.328753+0000","last_change":"2023-11-26T07:13:54.349401+0000","last_active":"2023-11-26T07:13:55.328753+0000","last_peered":"2023-11-26T07:13:55.328753+0000","last_clean":"2023-11-26T07:13:55.328753+0000","last_became_active":"2023-11-26T07:13:54.348823+0000","last_became_peered":"2023-11-26T07:13:54.348823+0000","last_unstale":"2023-11-26T07:13:55.328753+0000","last_undegraded":"2023-11-26T07:13:55.328753+0000","last_fullsized":"2023-11-26T07:13:55.328753+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:30:26.598436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:55.328671+0000","last_change":"2023-11-26T07:13:54.354633+0000","last_active":"2023-11-26T07:13:55.328671+0000","last_peered":"2023-11-26T07:13:55.328671+0000","last_clean":"2023-11-26T07:13:55.328671+0000","last_became_active":"2023-11-26T07:13:54.354197+0000","last_became_peered":"2023-11-26T07:13:54.354197+0000","last_unstale":"2023-11-26T07:13:55.328671+0000","last_undegraded":"2023-11-26T07:13:55.328671+0000","last_fullsized":"2023-11-26T07:13:55.328671+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:59:24.340460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522205+0000","last_change":"2023-11-26T07:13:54.337631+0000","last_active":"2023-11-26T07:13:56.522205+0000","last_peered":"2023-11-26T07:13:56.522205+0000","last_clean":"2023-11-26T07:13:56.522205+0000","last_became_active":"2023-11-26T07:13:54.337340+0000","last_became_peered":"2023-11-26T07:13:54.337340+0000","last_unstale":"2023-11-26T07:13:56.522205+0000","last_undegraded":"2023-11-26T07:13:56.522205+0000","last_fullsized":"2023-11-26T07:13:56.522205+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:37:08.994046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:55.325807+0000","last_change":"2023-11-26T07:13:54.350420+0000","last_active":"2023-11-26T07:13:55.325807+0000","last_peered":"2023-11-26T07:13:55.325807+0000","last_clean":"2023-11-26T07:13:55.325807+0000","last_became_active":"2023-11-26T07:13:54.349972+0000","last_became_peered":"2023-11-26T07:13:54.349972+0000","last_unstale":"2023-11-26T07:13:55.325807+0000","last_undegraded":"2023-11-26T07:13:55.325807+0000","last_fullsized":"2023-11-26T07:13:55.325807+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:37:52.259978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521222+0000","last_change":"2023-11-26T07:13:54.335830+0000","last_active":"2023-11-26T07:13:56.521222+0000","last_peered":"2023-11-26T07:13:56.521222+0000","last_clean":"2023-11-26T07:13:56.521222+0000","last_became_active":"2023-11-26T07:13:54.335507+0000","last_became_peered":"2023-11-26T07:13:54.335507+0000","last_unstale":"2023-11-26T07:13:56.521222+0000","last_undegraded":"2023-11-26T07:13:56.521222+0000","last_fullsized":"2023-11-26T07:13:56.521222+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:28:34.227908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522852+0000","last_change":"2023-11-26T07:13:54.339868+0000","last_active":"2023-11-26T07:13:56.522852+0000","last_peered":"2023-11-26T07:13:56.522852+0000","last_clean":"2023-11-26T07:13:56.522852+0000","last_became_active":"2023-11-26T07:13:54.339586+0000","last_became_peered":"2023-11-26T07:13:54.339586+0000","last_unstale":"2023-11-26T07:13:56.522852+0000","last_undegraded":"2023-11-26T07:13:56.522852+0000","last_fullsized":"2023-11-26T07:13:56.522852+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:15:21.013953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521669+0000","last_change":"2023-11-26T07:13:54.334403+0000","last_active":"2023-11-26T07:13:56.521669+0000","last_peered":"2023-11-26T07:13:56.521669+0000","last_clean":"2023-11-26T07:13:56.521669+0000","last_became_active":"2023-11-26T07:13:54.333437+0000","last_became_peered":"2023-11-26T07:13:54.333437+0000","last_unstale":"2023-11-26T07:13:56.521669+0000","last_undegraded":"2023-11-26T07:13:56.521669+0000","last_fullsized":"2023-11-26T07:13:56.521669+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:55:49.004066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521878+0000","last_change":"2023-11-26T07:13:54.333287+0000","last_active":"2023-11-26T07:13:56.521878+0000","last_peered":"2023-11-26T07:13:56.521878+0000","last_clean":"2023-11-26T07:13:56.521878+0000","last_became_active":"2023-11-26T07:13:54.333001+0000","last_became_peered":"2023-11-26T07:13:54.333001+0000","last_unstale":"2023-11-26T07:13:56.521878+0000","last_undegraded":"2023-11-26T07:13:56.521878+0000","last_fullsized":"2023-11-26T07:13:56.521878+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:09:37.588413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522926+0000","last_change":"2023-11-26T07:13:54.346379+0000","last_active":"2023-11-26T07:13:56.522926+0000","last_peered":"2023-11-26T07:13:56.522926+0000","last_clean":"2023-11-26T07:13:56.522926+0000","last_became_active":"2023-11-26T07:13:54.345741+0000","last_became_peered":"2023-11-26T07:13:54.345741+0000","last_unstale":"2023-11-26T07:13:56.522926+0000","last_undegraded":"2023-11-26T07:13:56.522926+0000","last_fullsized":"2023-11-26T07:13:56.522926+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:19:52.890589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:55.325742+0000","last_change":"2023-11-26T07:13:54.349857+0000","last_active":"2023-11-26T07:13:55.325742+0000","last_peered":"2023-11-26T07:13:55.325742+0000","last_clean":"2023-11-26T07:13:55.325742+0000","last_became_active":"2023-11-26T07:13:54.349559+0000","last_became_peered":"2023-11-26T07:13:54.349559+0000","last_unstale":"2023-11-26T07:13:55.325742+0000","last_undegraded":"2023-11-26T07:13:55.325742+0000","last_fullsized":"2023-11-26T07:13:55.325742+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:43:12.052999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:55.328757+0000","last_change":"2023-11-26T07:13:54.349210+0000","last_active":"2023-11-26T07:13:55.328757+0000","last_peered":"2023-11-26T07:13:55.328757+0000","last_clean":"2023-11-26T07:13:55.328757+0000","last_became_active":"2023-11-26T07:13:54.348772+0000","last_became_peered":"2023-11-26T07:13:54.348772+0000","last_unstale":"2023-11-26T07:13:55.328757+0000","last_undegraded":"2023-11-26T07:13:55.328757+0000","last_fullsized":"2023-11-26T07:13:55.328757+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:47:15.762964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522481+0000","last_change":"2023-11-26T07:13:54.351640+0000","last_active":"2023-11-26T07:13:56.522481+0000","last_peered":"2023-11-26T07:13:56.522481+0000","last_clean":"2023-11-26T07:13:56.522481+0000","last_became_active":"2023-11-26T07:13:54.351367+0000","last_became_peered":"2023-11-26T07:13:54.351367+0000","last_unstale":"2023-11-26T07:13:56.522481+0000","last_undegraded":"2023-11-26T07:13:56.522481+0000","last_fullsized":"2023-11-26T07:13:56.522481+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:09:10.784218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521973+0000","last_change":"2023-11-26T07:13:54.353830+0000","last_active":"2023-11-26T07:13:56.521973+0000","last_peered":"2023-11-26T07:13:56.521973+0000","last_clean":"2023-11-26T07:13:56.521973+0000","last_became_active":"2023-11-26T07:13:54.353543+0000","last_became_peered":"2023-11-26T07:13:54.353543+0000","last_unstale":"2023-11-26T07:13:56.521973+0000","last_undegraded":"2023-11-26T07:13:56.521973+0000","last_fullsized":"2023-11-26T07:13:56.521973+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:04:43.652064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:55.328482+0000","last_change":"2023-11-26T07:13:54.349319+0000","last_active":"2023-11-26T07:13:55.328482+0000","last_peered":"2023-11-26T07:13:55.328482+0000","last_clean":"2023-11-26T07:13:55.328482+0000","last_became_active":"2023-11-26T07:13:54.349017+0000","last_became_peered":"2023-11-26T07:13:54.349017+0000","last_unstale":"2023-11-26T07:13:55.328482+0000","last_undegraded":"2023-11-26T07:13:55.328482+0000","last_fullsized":"2023-11-26T07:13:55.328482+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:29:42.822778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521416+0000","last_change":"2023-11-26T07:13:54.340860+0000","last_active":"2023-11-26T07:13:56.521416+0000","last_peered":"2023-11-26T07:13:56.521416+0000","last_clean":"2023-11-26T07:13:56.521416+0000","last_became_active":"2023-11-26T07:13:54.340402+0000","last_became_peered":"2023-11-26T07:13:54.340402+0000","last_unstale":"2023-11-26T07:13:56.521416+0000","last_undegraded":"2023-11-26T07:13:56.521416+0000","last_fullsized":"2023-11-26T07:13:56.521416+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:56:02.700567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:55.325508+0000","last_change":"2023-11-26T07:13:54.355733+0000","last_active":"2023-11-26T07:13:55.325508+0000","last_peered":"2023-11-26T07:13:55.325508+0000","last_clean":"2023-11-26T07:13:55.325508+0000","last_became_active":"2023-11-26T07:13:54.355388+0000","last_became_peered":"2023-11-26T07:13:54.355388+0000","last_unstale":"2023-11-26T07:13:55.325508+0000","last_undegraded":"2023-11-26T07:13:55.325508+0000","last_fullsized":"2023-11-26T07:13:55.325508+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:01:44.730840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521470+0000","last_change":"2023-11-26T07:13:54.344019+0000","last_active":"2023-11-26T07:13:56.521470+0000","last_peered":"2023-11-26T07:13:56.521470+0000","last_clean":"2023-11-26T07:13:56.521470+0000","last_became_active":"2023-11-26T07:13:54.343694+0000","last_became_peered":"2023-11-26T07:13:54.343694+0000","last_unstale":"2023-11-26T07:13:56.521470+0000","last_undegraded":"2023-11-26T07:13:56.521470+0000","last_fullsized":"2023-11-26T07:13:56.521470+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:29:50.743893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522489+0000","last_change":"2023-11-26T07:13:53.333192+0000","last_active":"2023-11-26T07:13:56.522489+0000","last_peered":"2023-11-26T07:13:56.522489+0000","last_clean":"2023-11-26T07:13:56.522489+0000","last_became_active":"2023-11-26T07:13:53.332923+0000","last_became_peered":"2023-11-26T07:13:53.332923+0000","last_unstale":"2023-11-26T07:13:56.522489+0000","last_undegraded":"2023-11-26T07:13:56.522489+0000","last_fullsized":"2023-11-26T07:13:56.522489+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:18:43.048323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522591+0000","last_change":"2023-11-26T07:13:54.350225+0000","last_active":"2023-11-26T07:13:56.522591+0000","last_peered":"2023-11-26T07:13:56.522591+0000","last_clean":"2023-11-26T07:13:56.522591+0000","last_became_active":"2023-11-26T07:13:54.349894+0000","last_became_peered":"2023-11-26T07:13:54.349894+0000","last_unstale":"2023-11-26T07:13:56.522591+0000","last_undegraded":"2023-11-26T07:13:56.522591+0000","last_fullsized":"2023-11-26T07:13:56.522591+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:23:43.481733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:55.328786+0000","last_change":"2023-11-26T07:13:53.326395+0000","last_active":"2023-11-26T07:13:55.328786+0000","last_peered":"2023-11-26T07:13:55.328786+0000","last_clean":"2023-11-26T07:13:55.328786+0000","last_became_active":"2023-11-26T07:13:53.325818+0000","last_became_peered":"2023-11-26T07:13:53.325818+0000","last_unstale":"2023-11-26T07:13:55.328786+0000","last_undegraded":"2023-11-26T07:13:55.328786+0000","last_fullsized":"2023-11-26T07:13:55.328786+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:29:49.737685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522108+0000","last_change":"2023-11-26T07:13:54.342587+0000","last_active":"2023-11-26T07:13:56.522108+0000","last_peered":"2023-11-26T07:13:56.522108+0000","last_clean":"2023-11-26T07:13:56.522108+0000","last_became_active":"2023-11-26T07:13:54.342280+0000","last_became_peered":"2023-11-26T07:13:54.342280+0000","last_unstale":"2023-11-26T07:13:56.522108+0000","last_undegraded":"2023-11-26T07:13:56.522108+0000","last_fullsized":"2023-11-26T07:13:56.522108+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:49:59.764763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522225+0000","last_change":"2023-11-26T07:13:53.323229+0000","last_active":"2023-11-26T07:13:56.522225+0000","last_peered":"2023-11-26T07:13:56.522225+0000","last_clean":"2023-11-26T07:13:56.522225+0000","last_became_active":"2023-11-26T07:13:53.322886+0000","last_became_peered":"2023-11-26T07:13:53.322886+0000","last_unstale":"2023-11-26T07:13:56.522225+0000","last_undegraded":"2023-11-26T07:13:56.522225+0000","last_fullsized":"2023-11-26T07:13:56.522225+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:09:36.582205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.523410+0000","last_change":"2023-11-26T07:13:54.353190+0000","last_active":"2023-11-26T07:13:56.523410+0000","last_peered":"2023-11-26T07:13:56.523410+0000","last_clean":"2023-11-26T07:13:56.523410+0000","last_became_active":"2023-11-26T07:13:54.352901+0000","last_became_peered":"2023-11-26T07:13:54.352901+0000","last_unstale":"2023-11-26T07:13:56.523410+0000","last_undegraded":"2023-11-26T07:13:56.523410+0000","last_fullsized":"2023-11-26T07:13:56.523410+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:37:08.994046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522300+0000","last_change":"2023-11-26T07:13:53.327411+0000","last_active":"2023-11-26T07:13:56.522300+0000","last_peered":"2023-11-26T07:13:56.522300+0000","last_clean":"2023-11-26T07:13:56.522300+0000","last_became_active":"2023-11-26T07:13:53.327216+0000","last_became_peered":"2023-11-26T07:13:53.327216+0000","last_unstale":"2023-11-26T07:13:56.522300+0000","last_undegraded":"2023-11-26T07:13:56.522300+0000","last_fullsized":"2023-11-26T07:13:56.522300+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:15:20.007744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:55.328460+0000","last_change":"2023-11-26T07:13:54.347225+0000","last_active":"2023-11-26T07:13:55.328460+0000","last_peered":"2023-11-26T07:13:55.328460+0000","last_clean":"2023-11-26T07:13:55.328460+0000","last_became_active":"2023-11-26T07:13:54.346934+0000","last_became_peered":"2023-11-26T07:13:54.346934+0000","last_unstale":"2023-11-26T07:13:55.328460+0000","last_undegraded":"2023-11-26T07:13:55.328460+0000","last_fullsized":"2023-11-26T07:13:55.328460+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:22:52.075568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521382+0000","last_change":"2023-11-26T07:13:53.332345+0000","last_active":"2023-11-26T07:13:56.521382+0000","last_peered":"2023-11-26T07:13:56.521382+0000","last_clean":"2023-11-26T07:13:56.521382+0000","last_became_active":"2023-11-26T07:13:53.331726+0000","last_became_peered":"2023-11-26T07:13:53.331726+0000","last_unstale":"2023-11-26T07:13:56.521382+0000","last_undegraded":"2023-11-26T07:13:56.521382+0000","last_fullsized":"2023-11-26T07:13:56.521382+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:49:35.827978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522568+0000","last_change":"2023-11-26T07:13:54.353147+0000","last_active":"2023-11-26T07:13:56.522568+0000","last_peered":"2023-11-26T07:13:56.522568+0000","last_clean":"2023-11-26T07:13:56.522568+0000","last_became_active":"2023-11-26T07:13:54.352827+0000","last_became_peered":"2023-11-26T07:13:54.352827+0000","last_unstale":"2023-11-26T07:13:56.522568+0000","last_undegraded":"2023-11-26T07:13:56.522568+0000","last_fullsized":"2023-11-26T07:13:56.522568+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:30:26.598436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:55.328593+0000","last_change":"2023-11-26T07:13:53.323952+0000","last_active":"2023-11-26T07:13:55.328593+0000","last_peered":"2023-11-26T07:13:55.328593+0000","last_clean":"2023-11-26T07:13:55.328593+0000","last_became_active":"2023-11-26T07:13:53.323409+0000","last_became_peered":"2023-11-26T07:13:53.323409+0000","last_unstale":"2023-11-26T07:13:55.328593+0000","last_undegraded":"2023-11-26T07:13:55.328593+0000","last_fullsized":"2023-11-26T07:13:55.328593+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:29:36.005611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522023+0000","last_change":"2023-11-26T07:13:54.346282+0000","last_active":"2023-11-26T07:13:56.522023+0000","last_peered":"2023-11-26T07:13:56.522023+0000","last_clean":"2023-11-26T07:13:56.522023+0000","last_became_active":"2023-11-26T07:13:54.345603+0000","last_became_peered":"2023-11-26T07:13:54.345603+0000","last_unstale":"2023-11-26T07:13:56.522023+0000","last_undegraded":"2023-11-26T07:13:56.522023+0000","last_fullsized":"2023-11-26T07:13:56.522023+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:19:52.890589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521732+0000","last_change":"2023-11-26T07:13:53.327301+0000","last_active":"2023-11-26T07:13:56.521732+0000","last_peered":"2023-11-26T07:13:56.521732+0000","last_clean":"2023-11-26T07:13:56.521732+0000","last_became_active":"2023-11-26T07:13:53.327078+0000","last_became_peered":"2023-11-26T07:13:53.327078+0000","last_unstale":"2023-11-26T07:13:56.521732+0000","last_undegraded":"2023-11-26T07:13:56.521732+0000","last_fullsized":"2023-11-26T07:13:56.521732+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:19:33.781209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522620+0000","last_change":"2023-11-26T07:13:54.333589+0000","last_active":"2023-11-26T07:13:56.522620+0000","last_peered":"2023-11-26T07:13:56.522620+0000","last_clean":"2023-11-26T07:13:56.522620+0000","last_became_active":"2023-11-26T07:13:54.333086+0000","last_became_peered":"2023-11-26T07:13:54.333086+0000","last_unstale":"2023-11-26T07:13:56.522620+0000","last_undegraded":"2023-11-26T07:13:56.522620+0000","last_fullsized":"2023-11-26T07:13:56.522620+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:22:52.075568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521954+0000","last_change":"2023-11-26T07:13:53.335935+0000","last_active":"2023-11-26T07:13:56.521954+0000","last_peered":"2023-11-26T07:13:56.521954+0000","last_clean":"2023-11-26T07:13:56.521954+0000","last_became_active":"2023-11-26T07:13:53.335531+0000","last_became_peered":"2023-11-26T07:13:53.335531+0000","last_unstale":"2023-11-26T07:13:56.521954+0000","last_undegraded":"2023-11-26T07:13:56.521954+0000","last_fullsized":"2023-11-26T07:13:56.521954+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:37:07.987838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:55.328792+0000","last_change":"2023-11-26T07:13:54.354463+0000","last_active":"2023-11-26T07:13:55.328792+0000","last_peered":"2023-11-26T07:13:55.328792+0000","last_clean":"2023-11-26T07:13:55.328792+0000","last_became_active":"2023-11-26T07:13:54.353794+0000","last_became_peered":"2023-11-26T07:13:54.353794+0000","last_unstale":"2023-11-26T07:13:55.328792+0000","last_undegraded":"2023-11-26T07:13:55.328792+0000","last_fullsized":"2023-11-26T07:13:55.328792+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:32:07.644718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:55.328798+0000","last_change":"2023-11-26T07:13:53.321623+0000","last_active":"2023-11-26T07:13:55.328798+0000","last_peered":"2023-11-26T07:13:55.328798+0000","last_clean":"2023-11-26T07:13:55.328798+0000","last_became_active":"2023-11-26T07:13:53.321318+0000","last_became_peered":"2023-11-26T07:13:53.321318+0000","last_unstale":"2023-11-26T07:13:55.328798+0000","last_undegraded":"2023-11-26T07:13:55.328798+0000","last_fullsized":"2023-11-26T07:13:55.328798+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:04:42.645855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522520+0000","last_change":"2023-11-26T07:13:54.341206+0000","last_active":"2023-11-26T07:13:56.522520+0000","last_peered":"2023-11-26T07:13:56.522520+0000","last_clean":"2023-11-26T07:13:56.522520+0000","last_became_active":"2023-11-26T07:13:54.340862+0000","last_became_peered":"2023-11-26T07:13:54.340862+0000","last_unstale":"2023-11-26T07:13:56.522520+0000","last_undegraded":"2023-11-26T07:13:56.522520+0000","last_fullsized":"2023-11-26T07:13:56.522520+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:47:44.791047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.523214+0000","last_change":"2023-11-26T07:13:53.333651+0000","last_active":"2023-11-26T07:13:56.523214+0000","last_peered":"2023-11-26T07:13:56.523214+0000","last_clean":"2023-11-26T07:13:56.523214+0000","last_became_active":"2023-11-26T07:13:53.333317+0000","last_became_peered":"2023-11-26T07:13:53.333317+0000","last_unstale":"2023-11-26T07:13:56.523214+0000","last_undegraded":"2023-11-26T07:13:56.523214+0000","last_fullsized":"2023-11-26T07:13:56.523214+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:29:41.816570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521364+0000","last_change":"2023-11-26T07:13:54.352443+0000","last_active":"2023-11-26T07:13:56.521364+0000","last_peered":"2023-11-26T07:13:56.521364+0000","last_clean":"2023-11-26T07:13:56.521364+0000","last_became_active":"2023-11-26T07:13:54.352111+0000","last_became_peered":"2023-11-26T07:13:54.352111+0000","last_unstale":"2023-11-26T07:13:56.521364+0000","last_undegraded":"2023-11-26T07:13:56.521364+0000","last_fullsized":"2023-11-26T07:13:56.521364+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:44:23.742350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522858+0000","last_change":"2023-11-26T07:13:53.332505+0000","last_active":"2023-11-26T07:13:56.522858+0000","last_peered":"2023-11-26T07:13:56.522858+0000","last_clean":"2023-11-26T07:13:56.522858+0000","last_became_active":"2023-11-26T07:13:53.332230+0000","last_became_peered":"2023-11-26T07:13:53.332230+0000","last_unstale":"2023-11-26T07:13:56.522858+0000","last_undegraded":"2023-11-26T07:13:56.522858+0000","last_fullsized":"2023-11-26T07:13:56.522858+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:09:09.778010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522606+0000","last_change":"2023-11-26T07:13:54.353808+0000","last_active":"2023-11-26T07:13:56.522606+0000","last_peered":"2023-11-26T07:13:56.522606+0000","last_clean":"2023-11-26T07:13:56.522606+0000","last_became_active":"2023-11-26T07:13:54.353538+0000","last_became_peered":"2023-11-26T07:13:54.353538+0000","last_unstale":"2023-11-26T07:13:56.522606+0000","last_undegraded":"2023-11-26T07:13:56.522606+0000","last_fullsized":"2023-11-26T07:13:56.522606+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:02:46.618954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":18,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:55.325819+0000","last_change":"2023-11-26T07:13:53.321789+0000","last_active":"2023-11-26T07:13:55.325819+0000","last_peered":"2023-11-26T07:13:55.325819+0000","last_clean":"2023-11-26T07:13:55.325819+0000","last_became_active":"2023-11-26T07:13:53.321466+0000","last_became_peered":"2023-11-26T07:13:53.321466+0000","last_unstale":"2023-11-26T07:13:55.325819+0000","last_undegraded":"2023-11-26T07:13:55.325819+0000","last_fullsized":"2023-11-26T07:13:55.325819+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:24:26.009995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521878+0000","last_change":"2023-11-26T07:13:54.337428+0000","last_active":"2023-11-26T07:13:56.521878+0000","last_peered":"2023-11-26T07:13:56.521878+0000","last_clean":"2023-11-26T07:13:56.521878+0000","last_became_active":"2023-11-26T07:13:54.337155+0000","last_became_peered":"2023-11-26T07:13:54.337155+0000","last_unstale":"2023-11-26T07:13:56.521878+0000","last_undegraded":"2023-11-26T07:13:56.521878+0000","last_fullsized":"2023-11-26T07:13:56.521878+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:53:37.751308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521485+0000","last_change":"2023-11-26T07:13:53.335565+0000","last_active":"2023-11-26T07:13:56.521485+0000","last_peered":"2023-11-26T07:13:56.521485+0000","last_clean":"2023-11-26T07:13:56.521485+0000","last_became_active":"2023-11-26T07:13:53.335273+0000","last_became_peered":"2023-11-26T07:13:53.335273+0000","last_unstale":"2023-11-26T07:13:56.521485+0000","last_undegraded":"2023-11-26T07:13:56.521485+0000","last_fullsized":"2023-11-26T07:13:56.521485+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:47:43.784839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522642+0000","last_change":"2023-11-26T07:13:54.340961+0000","last_active":"2023-11-26T07:13:56.522642+0000","last_peered":"2023-11-26T07:13:56.522642+0000","last_clean":"2023-11-26T07:13:56.522642+0000","last_became_active":"2023-11-26T07:13:54.340680+0000","last_became_peered":"2023-11-26T07:13:54.340680+0000","last_unstale":"2023-11-26T07:13:56.522642+0000","last_undegraded":"2023-11-26T07:13:56.522642+0000","last_fullsized":"2023-11-26T07:13:56.522642+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:47:15.762964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522641+0000","last_change":"2023-11-26T07:13:53.329094+0000","last_active":"2023-11-26T07:13:56.522641+0000","last_peered":"2023-11-26T07:13:56.522641+0000","last_clean":"2023-11-26T07:13:56.522641+0000","last_became_active":"2023-11-26T07:13:53.328764+0000","last_became_peered":"2023-11-26T07:13:53.328764+0000","last_unstale":"2023-11-26T07:13:56.522641+0000","last_undegraded":"2023-11-26T07:13:56.522641+0000","last_fullsized":"2023-11-26T07:13:56.522641+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:06:56.730777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521089+0000","last_change":"2023-11-26T07:13:54.351804+0000","last_active":"2023-11-26T07:13:56.521089+0000","last_peered":"2023-11-26T07:13:56.521089+0000","last_clean":"2023-11-26T07:13:56.521089+0000","last_became_active":"2023-11-26T07:13:54.351444+0000","last_became_peered":"2023-11-26T07:13:54.351444+0000","last_unstale":"2023-11-26T07:13:56.521089+0000","last_undegraded":"2023-11-26T07:13:56.521089+0000","last_fullsized":"2023-11-26T07:13:56.521089+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:28:08.488217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.523306+0000","last_change":"2023-11-26T07:13:53.334727+0000","last_active":"2023-11-26T07:13:56.523306+0000","last_peered":"2023-11-26T07:13:56.523306+0000","last_clean":"2023-11-26T07:13:56.523306+0000","last_became_active":"2023-11-26T07:13:53.334392+0000","last_became_peered":"2023-11-26T07:13:53.334392+0000","last_unstale":"2023-11-26T07:13:56.523306+0000","last_undegraded":"2023-11-26T07:13:56.523306+0000","last_fullsized":"2023-11-26T07:13:56.523306+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:34:18.408623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522605+0000","last_change":"2023-11-26T07:13:54.332360+0000","last_active":"2023-11-26T07:13:56.522605+0000","last_peered":"2023-11-26T07:13:56.522605+0000","last_clean":"2023-11-26T07:13:56.522605+0000","last_became_active":"2023-11-26T07:13:54.332084+0000","last_became_peered":"2023-11-26T07:13:54.332084+0000","last_unstale":"2023-11-26T07:13:56.522605+0000","last_undegraded":"2023-11-26T07:13:56.522605+0000","last_fullsized":"2023-11-26T07:13:56.522605+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:25:08.359535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"44'8","reported_seq":20,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521878+0000","last_change":"2023-11-26T07:13:53.335773+0000","last_active":"2023-11-26T07:13:56.521878+0000","last_peered":"2023-11-26T07:13:56.521878+0000","last_clean":"2023-11-26T07:13:56.521878+0000","last_became_active":"2023-11-26T07:13:53.335218+0000","last_became_peered":"2023-11-26T07:13:53.335218+0000","last_unstale":"2023-11-26T07:13:56.521878+0000","last_undegraded":"2023-11-26T07:13:56.521878+0000","last_fullsized":"2023-11-26T07:13:56.521878+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:53:36.745100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:55.325804+0000","last_change":"2023-11-26T07:13:54.350054+0000","last_active":"2023-11-26T07:13:55.325804+0000","last_peered":"2023-11-26T07:13:55.325804+0000","last_clean":"2023-11-26T07:13:55.325804+0000","last_became_active":"2023-11-26T07:13:54.349720+0000","last_became_peered":"2023-11-26T07:13:54.349720+0000","last_unstale":"2023-11-26T07:13:55.325804+0000","last_undegraded":"2023-11-26T07:13:55.325804+0000","last_fullsized":"2023-11-26T07:13:55.325804+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:57:58.921713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:55.325612+0000","last_change":"2023-11-26T07:13:53.328897+0000","last_active":"2023-11-26T07:13:55.325612+0000","last_peered":"2023-11-26T07:13:55.325612+0000","last_clean":"2023-11-26T07:13:55.325612+0000","last_became_active":"2023-11-26T07:13:53.328585+0000","last_became_peered":"2023-11-26T07:13:53.328585+0000","last_unstale":"2023-11-26T07:13:55.325612+0000","last_undegraded":"2023-11-26T07:13:55.325612+0000","last_fullsized":"2023-11-26T07:13:55.325612+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:29:39.283815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.523239+0000","last_change":"2023-11-26T07:13:54.336898+0000","last_active":"2023-11-26T07:13:56.523239+0000","last_peered":"2023-11-26T07:13:56.523239+0000","last_clean":"2023-11-26T07:13:56.523239+0000","last_became_active":"2023-11-26T07:13:54.336584+0000","last_became_peered":"2023-11-26T07:13:54.336584+0000","last_unstale":"2023-11-26T07:13:56.523239+0000","last_undegraded":"2023-11-26T07:13:56.523239+0000","last_fullsized":"2023-11-26T07:13:56.523239+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:27:36.448372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:55.328595+0000","last_change":"2023-11-26T07:13:53.321789+0000","last_active":"2023-11-26T07:13:55.328595+0000","last_peered":"2023-11-26T07:13:55.328595+0000","last_clean":"2023-11-26T07:13:55.328595+0000","last_became_active":"2023-11-26T07:13:53.321375+0000","last_became_peered":"2023-11-26T07:13:53.321375+0000","last_unstale":"2023-11-26T07:13:55.328595+0000","last_undegraded":"2023-11-26T07:13:55.328595+0000","last_fullsized":"2023-11-26T07:13:55.328595+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:53:36.745100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521946+0000","last_change":"2023-11-26T07:13:54.335928+0000","last_active":"2023-11-26T07:13:56.521946+0000","last_peered":"2023-11-26T07:13:56.521946+0000","last_clean":"2023-11-26T07:13:56.521946+0000","last_became_active":"2023-11-26T07:13:54.335672+0000","last_became_peered":"2023-11-26T07:13:54.335672+0000","last_unstale":"2023-11-26T07:13:56.521946+0000","last_undegraded":"2023-11-26T07:13:56.521946+0000","last_fullsized":"2023-11-26T07:13:56.521946+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:29:50.743893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521829+0000","last_change":"2023-11-26T07:13:53.327312+0000","last_active":"2023-11-26T07:13:56.521829+0000","last_peered":"2023-11-26T07:13:56.521829+0000","last_clean":"2023-11-26T07:13:56.521829+0000","last_became_active":"2023-11-26T07:13:53.327025+0000","last_became_peered":"2023-11-26T07:13:53.327025+0000","last_unstale":"2023-11-26T07:13:56.521829+0000","last_undegraded":"2023-11-26T07:13:56.521829+0000","last_fullsized":"2023-11-26T07:13:56.521829+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:33:18.808399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522612+0000","last_change":"2023-11-26T07:13:54.353808+0000","last_active":"2023-11-26T07:13:56.522612+0000","last_peered":"2023-11-26T07:13:56.522612+0000","last_clean":"2023-11-26T07:13:56.522612+0000","last_became_active":"2023-11-26T07:13:54.353501+0000","last_became_peered":"2023-11-26T07:13:54.353501+0000","last_unstale":"2023-11-26T07:13:56.522612+0000","last_undegraded":"2023-11-26T07:13:56.522612+0000","last_fullsized":"2023-11-26T07:13:56.522612+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:29:37.011820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521459+0000","last_change":"2023-11-26T07:13:53.327983+0000","last_active":"2023-11-26T07:13:56.521459+0000","last_peered":"2023-11-26T07:13:56.521459+0000","last_clean":"2023-11-26T07:13:56.521459+0000","last_became_active":"2023-11-26T07:13:53.327624+0000","last_became_peered":"2023-11-26T07:13:53.327624+0000","last_unstale":"2023-11-26T07:13:56.521459+0000","last_undegraded":"2023-11-26T07:13:56.521459+0000","last_fullsized":"2023-11-26T07:13:56.521459+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:20:49.917016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521347+0000","last_change":"2023-11-26T07:13:54.352370+0000","last_active":"2023-11-26T07:13:56.521347+0000","last_peered":"2023-11-26T07:13:56.521347+0000","last_clean":"2023-11-26T07:13:56.521347+0000","last_became_active":"2023-11-26T07:13:54.351547+0000","last_became_peered":"2023-11-26T07:13:54.351547+0000","last_unstale":"2023-11-26T07:13:56.521347+0000","last_undegraded":"2023-11-26T07:13:56.521347+0000","last_fullsized":"2023-11-26T07:13:56.521347+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:37:07.255448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521589+0000","last_change":"2023-11-26T07:13:53.332551+0000","last_active":"2023-11-26T07:13:56.521589+0000","last_peered":"2023-11-26T07:13:56.521589+0000","last_clean":"2023-11-26T07:13:56.521589+0000","last_became_active":"2023-11-26T07:13:53.332060+0000","last_became_peered":"2023-11-26T07:13:53.332060+0000","last_unstale":"2023-11-26T07:13:56.521589+0000","last_undegraded":"2023-11-26T07:13:56.521589+0000","last_fullsized":"2023-11-26T07:13:56.521589+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:04:51.796299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521631+0000","last_change":"2023-11-26T07:13:54.345586+0000","last_active":"2023-11-26T07:13:56.521631+0000","last_peered":"2023-11-26T07:13:56.521631+0000","last_clean":"2023-11-26T07:13:56.521631+0000","last_became_active":"2023-11-26T07:13:54.344018+0000","last_became_peered":"2023-11-26T07:13:54.344018+0000","last_unstale":"2023-11-26T07:13:56.521631+0000","last_undegraded":"2023-11-26T07:13:56.521631+0000","last_fullsized":"2023-11-26T07:13:56.521631+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:04:43.652064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521553+0000","last_change":"2023-11-26T07:13:53.331012+0000","last_active":"2023-11-26T07:13:56.521553+0000","last_peered":"2023-11-26T07:13:56.521553+0000","last_clean":"2023-11-26T07:13:56.521553+0000","last_became_active":"2023-11-26T07:13:53.330765+0000","last_became_peered":"2023-11-26T07:13:53.330765+0000","last_unstale":"2023-11-26T07:13:56.521553+0000","last_undegraded":"2023-11-26T07:13:56.521553+0000","last_fullsized":"2023-11-26T07:13:56.521553+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:39:18.959386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:55.325670+0000","last_change":"2023-11-26T07:13:54.350156+0000","last_active":"2023-11-26T07:13:55.325670+0000","last_peered":"2023-11-26T07:13:55.325670+0000","last_clean":"2023-11-26T07:13:55.325670+0000","last_became_active":"2023-11-26T07:13:54.349622+0000","last_became_peered":"2023-11-26T07:13:54.349622+0000","last_unstale":"2023-11-26T07:13:55.325670+0000","last_undegraded":"2023-11-26T07:13:55.325670+0000","last_fullsized":"2023-11-26T07:13:55.325670+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:58:47.723873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522281+0000","last_change":"2023-11-26T07:13:53.333691+0000","last_active":"2023-11-26T07:13:56.522281+0000","last_peered":"2023-11-26T07:13:56.522281+0000","last_clean":"2023-11-26T07:13:56.522281+0000","last_became_active":"2023-11-26T07:13:53.333415+0000","last_became_peered":"2023-11-26T07:13:53.333415+0000","last_unstale":"2023-11-26T07:13:56.522281+0000","last_undegraded":"2023-11-26T07:13:56.522281+0000","last_fullsized":"2023-11-26T07:13:56.522281+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:11:37.328411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522197+0000","last_change":"2023-11-26T07:13:54.345377+0000","last_active":"2023-11-26T07:13:56.522197+0000","last_peered":"2023-11-26T07:13:56.522197+0000","last_clean":"2023-11-26T07:13:56.522197+0000","last_became_active":"2023-11-26T07:13:54.345025+0000","last_became_peered":"2023-11-26T07:13:54.345025+0000","last_unstale":"2023-11-26T07:13:56.522197+0000","last_undegraded":"2023-11-26T07:13:56.522197+0000","last_fullsized":"2023-11-26T07:13:56.522197+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:45:29.804466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521478+0000","last_change":"2023-11-26T07:13:53.329041+0000","last_active":"2023-11-26T07:13:56.521478+0000","last_peered":"2023-11-26T07:13:56.521478+0000","last_clean":"2023-11-26T07:13:56.521478+0000","last_became_active":"2023-11-26T07:13:53.328703+0000","last_became_peered":"2023-11-26T07:13:53.328703+0000","last_unstale":"2023-11-26T07:13:56.521478+0000","last_undegraded":"2023-11-26T07:13:56.521478+0000","last_fullsized":"2023-11-26T07:13:56.521478+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:32:06.638510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522743+0000","last_change":"2023-11-26T07:13:54.341419+0000","last_active":"2023-11-26T07:13:56.522743+0000","last_peered":"2023-11-26T07:13:56.522743+0000","last_clean":"2023-11-26T07:13:56.522743+0000","last_became_active":"2023-11-26T07:13:54.341116+0000","last_became_peered":"2023-11-26T07:13:54.341116+0000","last_unstale":"2023-11-26T07:13:56.522743+0000","last_undegraded":"2023-11-26T07:13:56.522743+0000","last_fullsized":"2023-11-26T07:13:56.522743+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:29:42.822778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521568+0000","last_change":"2023-11-26T07:13:53.325487+0000","last_active":"2023-11-26T07:13:56.521568+0000","last_peered":"2023-11-26T07:13:56.521568+0000","last_clean":"2023-11-26T07:13:56.521568+0000","last_became_active":"2023-11-26T07:13:53.325180+0000","last_became_peered":"2023-11-26T07:13:53.325180+0000","last_unstale":"2023-11-26T07:13:56.521568+0000","last_undegraded":"2023-11-26T07:13:56.521568+0000","last_fullsized":"2023-11-26T07:13:56.521568+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:02:45.612746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.523006+0000","last_change":"2023-11-26T07:13:54.353127+0000","last_active":"2023-11-26T07:13:56.523006+0000","last_peered":"2023-11-26T07:13:56.523006+0000","last_clean":"2023-11-26T07:13:56.523006+0000","last_became_active":"2023-11-26T07:13:54.352543+0000","last_became_peered":"2023-11-26T07:13:54.352543+0000","last_unstale":"2023-11-26T07:13:56.523006+0000","last_undegraded":"2023-11-26T07:13:56.523006+0000","last_fullsized":"2023-11-26T07:13:56.523006+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:16:13.258095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522947+0000","last_change":"2023-11-26T07:13:53.332462+0000","last_active":"2023-11-26T07:13:56.522947+0000","last_peered":"2023-11-26T07:13:56.522947+0000","last_clean":"2023-11-26T07:13:56.522947+0000","last_became_active":"2023-11-26T07:13:53.332209+0000","last_became_peered":"2023-11-26T07:13:53.332209+0000","last_unstale":"2023-11-26T07:13:56.522947+0000","last_undegraded":"2023-11-26T07:13:56.522947+0000","last_fullsized":"2023-11-26T07:13:56.522947+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:49:58.758555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522762+0000","last_change":"2023-11-26T07:13:54.351527+0000","last_active":"2023-11-26T07:13:56.522762+0000","last_peered":"2023-11-26T07:13:56.522762+0000","last_clean":"2023-11-26T07:13:56.522762+0000","last_became_active":"2023-11-26T07:13:54.350665+0000","last_became_peered":"2023-11-26T07:13:54.350665+0000","last_unstale":"2023-11-26T07:13:56.522762+0000","last_undegraded":"2023-11-26T07:13:56.522762+0000","last_fullsized":"2023-11-26T07:13:56.522762+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:43:29.071124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521564+0000","last_change":"2023-11-26T07:13:53.323367+0000","last_active":"2023-11-26T07:13:56.521564+0000","last_peered":"2023-11-26T07:13:56.521564+0000","last_clean":"2023-11-26T07:13:56.521564+0000","last_became_active":"2023-11-26T07:13:53.323087+0000","last_became_peered":"2023-11-26T07:13:53.323087+0000","last_unstale":"2023-11-26T07:13:56.521564+0000","last_undegraded":"2023-11-26T07:13:56.521564+0000","last_fullsized":"2023-11-26T07:13:56.521564+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:55:47.997858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521505+0000","last_change":"2023-11-26T07:13:54.348553+0000","last_active":"2023-11-26T07:13:56.521505+0000","last_peered":"2023-11-26T07:13:56.521505+0000","last_clean":"2023-11-26T07:13:56.521505+0000","last_became_active":"2023-11-26T07:13:54.348203+0000","last_became_peered":"2023-11-26T07:13:54.348203+0000","last_unstale":"2023-11-26T07:13:56.521505+0000","last_undegraded":"2023-11-26T07:13:56.521505+0000","last_fullsized":"2023-11-26T07:13:56.521505+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:22:38.287552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522527+0000","last_change":"2023-11-26T07:13:53.326049+0000","last_active":"2023-11-26T07:13:56.522527+0000","last_peered":"2023-11-26T07:13:56.522527+0000","last_clean":"2023-11-26T07:13:56.522527+0000","last_became_active":"2023-11-26T07:13:53.325621+0000","last_became_peered":"2023-11-26T07:13:53.325621+0000","last_unstale":"2023-11-26T07:13:56.522527+0000","last_undegraded":"2023-11-26T07:13:56.522527+0000","last_fullsized":"2023-11-26T07:13:56.522527+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:33:18.808399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521705+0000","last_change":"2023-11-26T07:13:54.352530+0000","last_active":"2023-11-26T07:13:56.521705+0000","last_peered":"2023-11-26T07:13:56.521705+0000","last_clean":"2023-11-26T07:13:56.521705+0000","last_became_active":"2023-11-26T07:13:54.351789+0000","last_became_peered":"2023-11-26T07:13:54.351789+0000","last_unstale":"2023-11-26T07:13:56.521705+0000","last_undegraded":"2023-11-26T07:13:56.521705+0000","last_fullsized":"2023-11-26T07:13:56.521705+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:16:00.238480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:55.328601+0000","last_change":"2023-11-26T07:13:53.326329+0000","last_active":"2023-11-26T07:13:55.328601+0000","last_peered":"2023-11-26T07:13:55.328601+0000","last_clean":"2023-11-26T07:13:55.328601+0000","last_became_active":"2023-11-26T07:13:53.325823+0000","last_became_peered":"2023-11-26T07:13:53.325823+0000","last_unstale":"2023-11-26T07:13:55.328601+0000","last_undegraded":"2023-11-26T07:13:55.328601+0000","last_fullsized":"2023-11-26T07:13:55.328601+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:23:42.475525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521359+0000","last_change":"2023-11-26T07:13:54.346843+0000","last_active":"2023-11-26T07:13:56.521359+0000","last_peered":"2023-11-26T07:13:56.521359+0000","last_clean":"2023-11-26T07:13:56.521359+0000","last_became_active":"2023-11-26T07:13:54.346515+0000","last_became_peered":"2023-11-26T07:13:54.346515+0000","last_unstale":"2023-11-26T07:13:56.521359+0000","last_undegraded":"2023-11-26T07:13:56.521359+0000","last_fullsized":"2023-11-26T07:13:56.521359+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:27:36.448372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521740+0000","last_change":"2023-11-26T07:13:53.333673+0000","last_active":"2023-11-26T07:13:56.521740+0000","last_peered":"2023-11-26T07:13:56.521740+0000","last_clean":"2023-11-26T07:13:56.521740+0000","last_became_active":"2023-11-26T07:13:53.333356+0000","last_became_peered":"2023-11-26T07:13:53.333356+0000","last_unstale":"2023-11-26T07:13:56.521740+0000","last_undegraded":"2023-11-26T07:13:56.521740+0000","last_fullsized":"2023-11-26T07:13:56.521740+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:53:36.745100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:55.328476+0000","last_change":"2023-11-26T07:13:54.347067+0000","last_active":"2023-11-26T07:13:55.328476+0000","last_peered":"2023-11-26T07:13:55.328476+0000","last_clean":"2023-11-26T07:13:55.328476+0000","last_became_active":"2023-11-26T07:13:54.346784+0000","last_became_peered":"2023-11-26T07:13:54.346784+0000","last_unstale":"2023-11-26T07:13:55.328476+0000","last_undegraded":"2023-11-26T07:13:55.328476+0000","last_fullsized":"2023-11-26T07:13:55.328476+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:19:52.890589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.521880+0000","last_change":"2023-11-26T07:13:53.335020+0000","last_active":"2023-11-26T07:13:56.521880+0000","last_peered":"2023-11-26T07:13:56.521880+0000","last_clean":"2023-11-26T07:13:56.521880+0000","last_became_active":"2023-11-26T07:13:53.334717+0000","last_became_peered":"2023-11-26T07:13:53.334717+0000","last_unstale":"2023-11-26T07:13:56.521880+0000","last_undegraded":"2023-11-26T07:13:56.521880+0000","last_fullsized":"2023-11-26T07:13:56.521880+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:29:49.737685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.523131+0000","last_change":"2023-11-26T07:13:54.344538+0000","last_active":"2023-11-26T07:13:56.523131+0000","last_peered":"2023-11-26T07:13:56.523131+0000","last_clean":"2023-11-26T07:13:56.523131+0000","last_became_active":"2023-11-26T07:13:54.344091+0000","last_became_peered":"2023-11-26T07:13:54.344091+0000","last_unstale":"2023-11-26T07:13:56.523131+0000","last_undegraded":"2023-11-26T07:13:56.523131+0000","last_fullsized":"2023-11-26T07:13:56.523131+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:53.308336+0000","last_clean_scrub_stamp":"2023-11-26T07:13:53.308336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:33:19.814608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-26T07:13:56.522214+0000","last_change":"2023-11-26T07:13:53.326441+0000","last_active":"2023-11-26T07:13:56.522214+0000","last_peered":"2023-11-26T07:13:56.522214+0000","last_clean":"2023-11-26T07:13:56.522214+0000","last_became_active":"2023-11-26T07:13:53.326158+0000","last_became_peered":"2023-11-26T07:13:53.326158+0000","last_unstale":"2023-11-26T07:13:56.522214+0000","last_undegraded":"2023-11-26T07:13:56.522214+0000","last_fullsized":"2023-11-26T07:13:56.522214+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:13:52.302128+0000","last_clean_scrub_stamp":"2023-11-26T07:13:52.302128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:06:56.730777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":186,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-26T07:13:54.327102+0000","last_change":"2023-11-26T07:11:29.855919+0000","last_active":"2023-11-26T07:13:54.327102+0000","last_peered":"2023-11-26T07:13:54.327102+0000","last_clean":"2023-11-26T07:13:54.327102+0000","last_became_active":"2023-11-26T07:11:29.854903+0000","last_became_peered":"2023-11-26T07:11:29.854903+0000","last_unstale":"2023-11-26T07:13:54.327102+0000","last_undegraded":"2023-11-26T07:13:54.327102+0000","last_fullsized":"2023-11-26T07:13:54.327102+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:28.594252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:28.594252+0000","last_clean_scrub_stamp":"2023-11-26T07:11:28.594252+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:33:34.642696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28120,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343720,"statfs":{"total":96636764160,"available":96607969280,"internally_reserved":0,"allocated":1126400,"data_stored":804772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53700000000000003,"15min":0.53500000000000003},"min":{"1min":0.35599999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.73099999999999998,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.51200000000000001,"15min":0.505},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.64300000000000002}]},{"osd":1,"last update":"Sun Nov 26 07:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.94999999999999996,"15min":1.014},"min":{"1min":0.40799999999999997,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.72099999999999997,"5min":9.5600000000000005,"15min":9.5600000000000005},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57999999999999996,"15min":0.58399999999999996},"min":{"1min":0.42399999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.86699999999999999,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.70199999999999996}]},{"osd":2,"last update":"Sun Nov 26 07:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60299999999999998,"15min":0.60399999999999998},"min":{"1min":0.39800000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.3979999999999999,"5min":1.569,"15min":1.569},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.65000000000000002,"15min":0.65300000000000002},"min":{"1min":0.47099999999999997,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.81499999999999995,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.68899999999999995}]},{"osd":3,"last update":"Sun Nov 26 07:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.494,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.57499999999999996,"15min":0.56499999999999995},"min":{"1min":0.46000000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.77400000000000002}]},{"osd":4,"last update":"Sun Nov 26 07:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.32800000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.73699999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.52100000000000002,"15min":0.51000000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.54100000000000004}]},{"osd":5,"last update":"Sun Nov 26 07:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.54000000000000004,"15min":0.53000000000000003},"min":{"1min":0.39300000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.82099999999999995,"5min":0.876,"15min":0.876},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.83199999999999996,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.59899999999999998}]},{"osd":6,"last update":"Sun Nov 26 07:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59299999999999997,"15min":0.58999999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.60199999999999998,"15min":0.59299999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.497}]}]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":524288,"data_stored":208686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:13:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.496,"15min":0.48199999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.48499999999999999,"15min":0.46999999999999997},"min":{"1min":0.33400000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.51400000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:13:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.52000000000000002,"15min":0.51000000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.85099999999999998,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.54900000000000004,"15min":0.54400000000000004},"min":{"1min":0.42799999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.77900000000000003,"5min":1.198,"15min":1.198},"last":0.60799999999999998}]},{"osd":2,"last update":"Sun Nov 26 07:13:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.505,"15min":0.49099999999999999},"min":{"1min":0.39800000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.52700000000000002,"15min":0.51600000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.621}]},{"osd":3,"last update":"Sun Nov 26 07:13:28 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.55800000000000005,"15min":0.54600000000000004},"min":{"1min":0.41299999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.58899999999999997,"15min":0.57899999999999996},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.59399999999999997}]},{"osd":4,"last update":"Sun Nov 26 07:13:28 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53300000000000003,"15min":0.53400000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.47699999999999998}]},{"osd":5,"last update":"Sun Nov 26 07:13:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56200000000000006,"15min":0.56000000000000005},"min":{"1min":0.39600000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58699999999999997,"15min":0.58899999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80400000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.34599999999999997}]},{"osd":7,"last update":"Sun Nov 26 07:13:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59399999999999997,"15min":0.59199999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.628,"15min":0.626},"min":{"1min":0.46100000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.45800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31700,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340140,"statfs":{"total":96636764160,"available":96604303360,"internally_reserved":0,"allocated":532480,"data_stored":214384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:13:28 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.35899999999999999,"15min":0.36499999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.46999999999999997,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.441},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.79800000000000004,"15min":0.872},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.495,"5min":11.922000000000001,"15min":11.922000000000001},"last":0.29299999999999998}]},{"osd":2,"last update":"Sun Nov 26 07:13:28 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.372,"15min":0.376},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.50600000000000001,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.40799999999999997,"15min":0.40999999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.57499999999999996,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.31900000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:13:28 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.45900000000000002,"15min":0.46100000000000002},"min":{"1min":0.316,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.65100000000000002,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.38},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.44,"15min":0.443},"min":{"1min":0.32000000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.62,"5min":1.101,"15min":1.101},"last":0.34999999999999998}]},{"osd":4,"last update":"Sun Nov 26 07:13:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.86499999999999999,"15min":0.90700000000000003},"min":{"1min":0.433,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.83899999999999997,"5min":6.8979999999999997,"15min":6.8979999999999997},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.66200000000000003,"15min":0.66600000000000004},"min":{"1min":0.47599999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.78500000000000003,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.52700000000000002}]},{"osd":5,"last update":"Sun Nov 26 07:13:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.623,"15min":0.628},"min":{"1min":0.443,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.72899999999999998,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.86799999999999999,"15min":0.91200000000000003},"min":{"1min":0.45700000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.76900000000000002,"5min":6.9480000000000004,"15min":6.9480000000000004},"last":0.40100000000000002}]},{"osd":6,"last update":"Sun Nov 26 07:13:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.65800000000000003,"15min":0.66400000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.80700000000000005,"5min":1.194,"15min":1.194},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.89200000000000002,"15min":0.93999999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.76300000000000001,"5min":6.9800000000000004,"15min":6.9800000000000004},"last":0.372}]},{"osd":7,"last update":"Sun Nov 26 07:13:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65900000000000003,"15min":0.66100000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.84199999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.67700000000000005,"15min":0.68700000000000006},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.79500000000000004,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.48699999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28120,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343720,"statfs":{"total":96636764160,"available":96607969280,"internally_reserved":0,"allocated":1126400,"data_stored":804716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.36799999999999999,"15min":0.377},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.499,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.378,"5min":0.82599999999999996,"15min":0.90100000000000002},"min":{"1min":0.29299999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.56799999999999995,"5min":11.987,"15min":11.987},"last":0.28399999999999997}]},{"osd":2,"last update":"Sun Nov 26 07:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.432,"15min":0.44400000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.54900000000000004,"5min":1.607,"15min":1.607},"last":0.374},{"interface":"front","average":{"1min":0.374,"5min":0.41099999999999998,"15min":0.41699999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.49099999999999999,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.39400000000000002}]},{"osd":3,"last update":"Sun Nov 26 07:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.38900000000000001,"15min":0.39100000000000001},"min":{"1min":0.27500000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.53700000000000003,"5min":0.752,"15min":0.752},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.46800000000000003,"15min":0.47899999999999998},"min":{"1min":0.30499999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.59099999999999997,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.46200000000000002}]},{"osd":4,"last update":"Sun Nov 26 07:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.65700000000000003,"15min":0.66300000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.78700000000000003,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.88800000000000001,"15min":0.93000000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82199999999999995,"5min":6.5279999999999996,"15min":6.5279999999999996},"last":0.65600000000000003}]},{"osd":5,"last update":"Sun Nov 26 07:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.65600000000000003,"15min":0.65800000000000003},"min":{"1min":0.46100000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.80300000000000005,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.69999999999999996,"15min":0.70599999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.88400000000000001,"5min":1.508,"15min":1.508},"last":0.56799999999999995}]},{"osd":6,"last update":"Sun Nov 26 07:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.92300000000000004,"15min":0.96699999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93400000000000005,"5min":6.5419999999999998,"15min":6.5419999999999998},"last":0.625},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.68000000000000005,"15min":0.68600000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.84399999999999997,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.67200000000000004}]},{"osd":7,"last update":"Sun Nov 26 07:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70799999999999996,"15min":0.71199999999999997},"min":{"1min":0.503,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.91000000000000003,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.66400000000000003,"15min":0.67000000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.872,"5min":1.155,"15min":1.155},"last":0.59499999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":544768,"data_stored":215948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.34499999999999997,"15min":0.34799999999999998},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.33000000000000002}]},{"osd":1,"last update":"Sun Nov 26 07:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.34499999999999997,"15min":0.34899999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.41999999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.38,"5min":0.378,"15min":0.378},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.496,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.38200000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.41399999999999998,"15min":0.41699999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.54700000000000004,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.38200000000000001,"15min":0.38500000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.52500000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.36799999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.39200000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.76700000000000002,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.38200000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.78400000000000003,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.54800000000000004}]},{"osd":5,"last update":"Sun Nov 26 07:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57299999999999995,"15min":0.57399999999999995},"min":{"1min":0.44,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.63100000000000001,"15min":0.63700000000000001},"min":{"1min":0.498,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.83099999999999996,"5min":1.002,"15min":1.002},"last":0.56399999999999995}]},{"osd":6,"last update":"Sun Nov 26 07:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.48699999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84699999999999998,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.63200000000000001,"15min":0.63600000000000001},"min":{"1min":0.44400000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.73599999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.78600000000000003}]},{"osd":7,"last update":"Sun Nov 26 07:13:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.627,"15min":0.63100000000000001},"min":{"1min":0.437,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86299999999999999,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.622,"15min":0.624},"min":{"1min":0.437,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.872,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.745}]}]},{"osd":3,"up_from":13,"seq":55834574882,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":540672,"data_stored":214952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:13:32 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.36399999999999999,"15min":0.373},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.51500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.41799999999999998,"15min":0.42699999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.48099999999999998,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.29499999999999998}]},{"osd":1,"last update":"Sun Nov 26 07:13:32 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.40100000000000002,"15min":0.41199999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.53600000000000003,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.38,"5min":0.5,"15min":0.52000000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.52900000000000003,"5min":2.903,"15min":2.903},"last":0.32000000000000001}]},{"osd":2,"last update":"Sun Nov 26 07:13:32 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.40400000000000003,"15min":0.40799999999999997},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.57399999999999995,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.41699999999999998,"15min":0.42199999999999999},"min":{"1min":0.307,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.51900000000000002,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.33500000000000002}]},{"osd":4,"last update":"Sun Nov 26 07:13:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.70399999999999996,"15min":0.72399999999999998},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.81000000000000005,"5min":2.9609999999999999,"15min":2.9609999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.64100000000000001,"15min":0.64700000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.93100000000000005,"5min":1.163,"15min":1.163},"last":0.5}]},{"osd":5,"last update":"Sun Nov 26 07:13:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.66800000000000004,"15min":0.67800000000000005},"min":{"1min":0.41499999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.879,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.66100000000000003,"15min":0.67100000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.83599999999999997,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.51200000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:13:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.66900000000000004,"15min":0.67900000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.97599999999999998,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.67800000000000005,"15min":0.68799999999999994},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.89900000000000002,"5min":1.258,"15min":1.258},"last":0.47399999999999998}]},{"osd":7,"last update":"Sun Nov 26 07:13:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.67900000000000005,"15min":0.69099999999999995},"min":{"1min":0.47799999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.81899999999999995,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.439},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.747,"15min":0.76900000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.91300000000000003,"5min":2.9969999999999999,"15min":2.9969999999999999},"last":0.48599999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":540672,"data_stored":215926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.91700000000000004,"15min":0.97299999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.87,"5min":8.7539999999999996,"15min":8.7539999999999996},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.93100000000000005,"15min":0.98799999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.82799999999999996,"5min":8.7390000000000008,"15min":8.7390000000000008},"last":0.88200000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.96499999999999997,"15min":1.028},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.81200000000000006,"5min":9.7720000000000002,"15min":9.7720000000000002},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.78300000000000003,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.80000000000000004}]},{"osd":2,"last update":"Sun Nov 26 07:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.91600000000000004,"15min":0.97599999999999998},"min":{"1min":0.39100000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80100000000000005,"5min":9.8119999999999994,"15min":9.8119999999999994},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.82699999999999996,"15min":0.86299999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.85499999999999998,"5min":3.645,"15min":3.645},"last":0.48399999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.96199999999999997,"15min":1.02},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.80600000000000005,"5min":8.8089999999999993,"15min":8.8089999999999993},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60599999999999998,"15min":0.60499999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83899999999999997,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.66800000000000004}]},{"osd":5,"last update":"Sun Nov 26 07:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.502,"15min":0.498},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.746,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.84499999999999997}]},{"osd":6,"last update":"Sun Nov 26 07:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.75800000000000001,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56999999999999995,"15min":0.57399999999999995},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78200000000000003,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.74399999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.78100000000000003,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.60199999999999998,"15min":0.60299999999999998},"min":{"1min":0.38300000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.78900000000000003,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.92700000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":520192,"data_stored":208084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.51000000000000001,"15min":0.51400000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.81499999999999995,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.44},{"interface":"front","average":{"1min":0.505,"5min":0.54900000000000004,"15min":0.55600000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.69099999999999995,"5min":0.877,"15min":0.877},"last":0.64100000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.80400000000000005,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.53300000000000003}]},{"osd":2,"last update":"Sun Nov 26 07:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.74099999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.59399999999999997,"15min":0.59799999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.625}]},{"osd":3,"last update":"Sun Nov 26 07:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56100000000000005,"15min":0.55900000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.78900000000000003,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58299999999999996,"15min":0.58499999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.73999999999999999,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.55800000000000005}]},{"osd":4,"last update":"Sun Nov 26 07:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.48099999999999998,"15min":0.48499999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72899999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56599999999999995,"15min":0.56999999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.79900000000000004,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.70699999999999996}]},{"osd":6,"last update":"Sun Nov 26 07:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.377,"5min":0.308,"15min":0.308},"max":{"1min":0.71399999999999997,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.39600000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78000000000000003,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.68400000000000005}]},{"osd":7,"last update":"Sun Nov 26 07:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58299999999999996,"15min":0.58399999999999996},"min":{"1min":0.42399999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.622,"15min":0.622},"min":{"1min":0.43099999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.81499999999999995,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.71999999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:13:58.893 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-26T07:13:58.893 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-26T07:13:59.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.059+0000 7f6800ea5700 1 Processor -- start 2023-11-26T07:13:59.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.059+0000 7f6800ea5700 1 -- start start 2023-11-26T07:13:59.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.060+0000 7f6800ea5700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f67fc15bde0 0x7f67fc15c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:59.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.060+0000 7f6800ea5700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f67fc0cf2b0 0x7f67fc0d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:59.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.060+0000 7f6800ea5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67fc0ce5c0 0x7f67fc0cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:59.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.060+0000 7f6800ea5700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67fc0cefb0 con 0x7f67fc15bde0 2023-11-26T07:13:59.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.060+0000 7f6800ea5700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67fc0d0a90 con 0x7f67fc0cf2b0 2023-11-26T07:13:59.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.060+0000 7f6800ea5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc06ee10 con 0x7f67fc0ce5c0 2023-11-26T07:13:59.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.060+0000 7f67fa59c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f67fc15bde0 0x7f67fc15c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:59.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.060+0000 7f67fa59c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f67fc15bde0 0x7f67fc15c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42022/0 (socket says 172.21.15.2:42022) 2023-11-26T07:13:59.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.060+0000 7f67fa59c700 1 -- 172.21.15.2:0/1022175125 learned_addr learned my addr 172.21.15.2:0/1022175125 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:59.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.061+0000 7f67f9d9b700 1 --2- 172.21.15.2:0/1022175125 >> v2:172.21.15.192:3300/0 conn(0x7f67fc0cf2b0 0x7f67fc0d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:59.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.061+0000 7f67fad9d700 1 --2- 172.21.15.2:0/1022175125 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67fc0ce5c0 0x7f67fc0cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:59.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.061+0000 7f67fa59c700 1 -- 172.21.15.2:0/1022175125 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67fc0ce5c0 msgr2=0x7f67fc0cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:59.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.061+0000 7f67fa59c700 1 --2- 172.21.15.2:0/1022175125 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67fc0ce5c0 0x7f67fc0cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:59.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.061+0000 7f67fa59c700 1 -- 172.21.15.2:0/1022175125 >> v2:172.21.15.192:3300/0 conn(0x7f67fc0cf2b0 msgr2=0x7f67fc0d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:59.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.061+0000 7f67fa59c700 1 --2- 172.21.15.2:0/1022175125 >> v2:172.21.15.192:3300/0 conn(0x7f67fc0cf2b0 0x7f67fc0d01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:59.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.061+0000 7f67fa59c700 1 -- 172.21.15.2:0/1022175125 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67fc06f0f0 con 0x7f67fc15bde0 2023-11-26T07:13:59.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.061+0000 7f67f9d9b700 1 --2- 172.21.15.2:0/1022175125 >> v2:172.21.15.192:3300/0 conn(0x7f67fc0cf2b0 0x7f67fc0d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:13:59.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.061+0000 7f67fa59c700 1 --2- 172.21.15.2:0/1022175125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67fc15bde0 0x7f67fc15c1c0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f67fc06e780 tx=0x7f67f0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f6d9057e68a8c64 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:59.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.061+0000 7f67f959a700 1 -- 172.21.15.2:0/1022175125 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f000b870 con 0x7f67fc15bde0 2023-11-26T07:13:59.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.061+0000 7f67f959a700 1 -- 172.21.15.2:0/1022175125 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f000b9d0 con 0x7f67fc15bde0 2023-11-26T07:13:59.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.061+0000 7f67f959a700 1 -- 172.21.15.2:0/1022175125 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f000bd60 con 0x7f67fc15bde0 2023-11-26T07:13:59.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.062+0000 7f6800ea5700 1 -- 172.21.15.2:0/1022175125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67fc15bde0 msgr2=0x7f67fc15c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:59.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.062+0000 7f6800ea5700 1 --2- 172.21.15.2:0/1022175125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67fc15bde0 0x7f67fc15c1c0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f67fc06e780 tx=0x7f67f0009bd0 comp rx=0 tx=0).stop 2023-11-26T07:13:59.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.062+0000 7f6800ea5700 1 -- 172.21.15.2:0/1022175125 shutdown_connections 2023-11-26T07:13:59.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.062+0000 7f6800ea5700 1 --2- 172.21.15.2:0/1022175125 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67fc0ce5c0 0x7f67fc0cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:59.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.062+0000 7f6800ea5700 1 --2- 172.21.15.2:0/1022175125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67fc15bde0 0x7f67fc15c1c0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:59.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.062+0000 7f6800ea5700 1 --2- 172.21.15.2:0/1022175125 >> v2:172.21.15.192:3300/0 conn(0x7f67fc0cf2b0 0x7f67fc0d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:59.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.062+0000 7f6800ea5700 1 -- 172.21.15.2:0/1022175125 >> 172.21.15.2:0/1022175125 conn(0x7f67fc0b3720 msgr2=0x7f67fc0b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:59.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.062+0000 7f6800ea5700 1 -- 172.21.15.2:0/1022175125 shutdown_connections 2023-11-26T07:13:59.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.062+0000 7f6800ea5700 1 -- 172.21.15.2:0/1022175125 wait complete. 2023-11-26T07:13:59.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.063+0000 7f6800ea5700 1 Processor -- start 2023-11-26T07:13:59.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.063+0000 7f6800ea5700 1 -- start start 2023-11-26T07:13:59.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.064+0000 7f6800ea5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67fc0ce5c0 0x7f67fc15c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:59.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.064+0000 7f6800ea5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67fc0cf2b0 0x7f67fc151060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:59.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.064+0000 7f6800ea5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67fc15bde0 0x7f67fc0c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:59.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.064+0000 7f6800ea5700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc0b19b0 con 0x7f67fc0ce5c0 2023-11-26T07:13:59.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.064+0000 7f6800ea5700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc0ca7f0 con 0x7f67fc15bde0 2023-11-26T07:13:59.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.064+0000 7f6800ea5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc0ca270 con 0x7f67fc0cf2b0 2023-11-26T07:13:59.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.064+0000 7f67fa59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67fc0ce5c0 0x7f67fc15c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:59.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.064+0000 7f67fa59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67fc0ce5c0 0x7f67fc15c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42028/0 (socket says 172.21.15.2:42028) 2023-11-26T07:13:59.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.064+0000 7f67fa59c700 1 -- 172.21.15.2:0/3003379150 learned_addr learned my addr 172.21.15.2:0/3003379150 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:59.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.064+0000 7f67fad9d700 1 --2- 172.21.15.2:0/3003379150 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67fc15bde0 0x7f67fc0c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:59.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.064+0000 7f67f9d9b700 1 --2- 172.21.15.2:0/3003379150 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67fc0cf2b0 0x7f67fc151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:59.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.064+0000 7f67fa59c700 1 -- 172.21.15.2:0/3003379150 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67fc0cf2b0 msgr2=0x7f67fc151060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:59.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.064+0000 7f67fa59c700 1 --2- 172.21.15.2:0/3003379150 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67fc0cf2b0 0x7f67fc151060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:59.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.064+0000 7f67fa59c700 1 -- 172.21.15.2:0/3003379150 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67fc15bde0 msgr2=0x7f67fc0c9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:59.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.064+0000 7f67fa59c700 1 --2- 172.21.15.2:0/3003379150 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67fc15bde0 0x7f67fc0c9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:59.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.064+0000 7f67fa59c700 1 -- 172.21.15.2:0/3003379150 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f0009550 con 0x7f67fc0ce5c0 2023-11-26T07:13:59.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.064+0000 7f67fad9d700 1 --2- 172.21.15.2:0/3003379150 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67fc15bde0 0x7f67fc0c9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:13:59.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.064+0000 7f67fa59c700 1 --2- 172.21.15.2:0/3003379150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67fc0ce5c0 0x7f67fc15c4f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f67f0014040 tx=0x7f67f0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:59.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.065+0000 7f67eaffd700 1 -- 172.21.15.2:0/3003379150 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f0004520 con 0x7f67fc0ce5c0 2023-11-26T07:13:59.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.065+0000 7f67eaffd700 1 -- 172.21.15.2:0/3003379150 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f001e070 con 0x7f67fc0ce5c0 2023-11-26T07:13:59.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.065+0000 7f6800ea5700 1 -- 172.21.15.2:0/3003379150 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67fc0ca510 con 0x7f67fc0ce5c0 2023-11-26T07:13:59.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.065+0000 7f67eaffd700 1 -- 172.21.15.2:0/3003379150 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f00038e0 con 0x7f67fc0ce5c0 2023-11-26T07:13:59.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.065+0000 7f6800ea5700 1 -- 172.21.15.2:0/3003379150 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67fc0b1640 con 0x7f67fc0ce5c0 2023-11-26T07:13:59.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.066+0000 7f6800ea5700 1 -- 172.21.15.2:0/3003379150 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67fc075480 con 0x7f67fc0ce5c0 2023-11-26T07:13:59.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.066+0000 7f67eaffd700 1 -- 172.21.15.2:0/3003379150 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f67f0003a40 con 0x7f67fc0ce5c0 2023-11-26T07:13:59.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.067+0000 7f67eaffd700 1 --2- 172.21.15.2:0/3003379150 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f67dc06b1a0 0x7f67dc06d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:59.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.067+0000 7f67eaffd700 1 -- 172.21.15.2:0/3003379150 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f67f0020070 con 0x7f67fc0ce5c0 2023-11-26T07:13:59.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.067+0000 7f67f9d9b700 1 --2- 172.21.15.2:0/3003379150 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f67dc06b1a0 0x7f67dc06d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:59.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.068+0000 7f67f9d9b700 1 --2- 172.21.15.2:0/3003379150 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f67dc06b1a0 0x7f67dc06d660 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f67fc0706c0 tx=0x7f67ec008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:59.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.071+0000 7f67eaffd700 1 -- 172.21.15.2:0/3003379150 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f67f0055e00 con 0x7f67fc0ce5c0 2023-11-26T07:13:59.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.358+0000 7f6800ea5700 1 -- 172.21.15.2:0/3003379150 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f67fc070410 con 0x7f67fc0ce5c0 2023-11-26T07:13:59.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.361+0000 7f67eaffd700 1 -- 172.21.15.2:0/3003379150 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+147 (secure 0 0 0) 0x7f67f00150e0 con 0x7f67fc0ce5c0 2023-11-26T07:13:59.363 INFO:teuthology.orchestra.run.smithi002.stdout:[client.0] 2023-11-26T07:13:59.363 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBv72JlaEgQKxAA4cVx4nUFgqn0HvVBJdVHVg== 2023-11-26T07:13:59.363 INFO:teuthology.orchestra.run.smithi002.stdout: caps mds = "allow" 2023-11-26T07:13:59.363 INFO:teuthology.orchestra.run.smithi002.stdout: caps mon = "allow r" 2023-11-26T07:13:59.363 INFO:teuthology.orchestra.run.smithi002.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-26T07:13:59.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.364+0000 7f6800ea5700 1 -- 172.21.15.2:0/3003379150 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f67dc06b1a0 msgr2=0x7f67dc06d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:59.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.364+0000 7f6800ea5700 1 --2- 172.21.15.2:0/3003379150 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f67dc06b1a0 0x7f67dc06d660 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f67fc0706c0 tx=0x7f67ec008040 comp rx=0 tx=0).stop 2023-11-26T07:13:59.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.364+0000 7f6800ea5700 1 -- 172.21.15.2:0/3003379150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67fc0ce5c0 msgr2=0x7f67fc15c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:59.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.364+0000 7f6800ea5700 1 --2- 172.21.15.2:0/3003379150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67fc0ce5c0 0x7f67fc15c4f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f67f0014040 tx=0x7f67f0004750 comp rx=0 tx=0).stop 2023-11-26T07:13:59.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.364+0000 7f6800ea5700 1 -- 172.21.15.2:0/3003379150 shutdown_connections 2023-11-26T07:13:59.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.364+0000 7f6800ea5700 1 --2- 172.21.15.2:0/3003379150 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f67dc06b1a0 0x7f67dc06d660 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:59.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.364+0000 7f6800ea5700 1 --2- 172.21.15.2:0/3003379150 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67fc15bde0 0x7f67fc0c9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:59.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.364+0000 7f6800ea5700 1 --2- 172.21.15.2:0/3003379150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67fc0ce5c0 0x7f67fc15c4f0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:59.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.364+0000 7f6800ea5700 1 --2- 172.21.15.2:0/3003379150 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67fc0cf2b0 0x7f67fc151060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:59.368 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.364+0000 7f6800ea5700 1 -- 172.21.15.2:0/3003379150 >> 172.21.15.2:0/3003379150 conn(0x7f67fc0b3720 msgr2=0x7f67fc0b3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:59.368 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.364+0000 7f6800ea5700 1 -- 172.21.15.2:0/3003379150 shutdown_connections 2023-11-26T07:13:59.368 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.364+0000 7f6800ea5700 1 -- 172.21.15.2:0/3003379150 wait complete. 2023-11-26T07:13:59.368 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.0 2023-11-26T07:13:59.378 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:13:59.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.501+0000 7fd957324700 1 Processor -- start 2023-11-26T07:13:59.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.501+0000 7fd957324700 1 -- start start 2023-11-26T07:13:59.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.502+0000 7fd957324700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd950143ae0 0x7fd9500b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:59.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.502+0000 7fd957324700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd9501440f0 0x7fd950071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:59.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.502+0000 7fd957324700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd950143ec0 con 0x7fd9500720f0 2023-11-26T07:13:59.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.502+0000 7fd957324700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9500b40a0 con 0x7fd9501440f0 2023-11-26T07:13:59.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.502+0000 7fd957324700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd950072560 con 0x7fd950143ae0 2023-11-26T07:13:59.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.502+0000 7fd9548bf700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd9501440f0 0x7fd950071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:59.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.502+0000 7fd9548bf700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd9501440f0 0x7fd950071bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42036/0 (socket says 172.21.15.2:42036) 2023-11-26T07:13:59.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.502+0000 7fd9548bf700 1 -- 172.21.15.2:0/2062855314 learned_addr learned my addr 172.21.15.2:0/2062855314 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:59.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.502+0000 7fd9558c1700 1 --1- 172.21.15.2:0/2062855314 >> v1:172.21.15.2:6789/0 conn(0x7fd9500720f0 0x7fd95015e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33248/0 (socket says 172.21.15.2:33248) 2023-11-26T07:13:59.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.502+0000 7fd9550c0700 1 --2- 172.21.15.2:0/2062855314 >> v2:172.21.15.192:3300/0 conn(0x7fd950143ae0 0x7fd9500b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:59.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.502+0000 7fd9548bf700 1 -- 172.21.15.2:0/2062855314 >> v2:172.21.15.192:3300/0 conn(0x7fd950143ae0 msgr2=0x7fd9500b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:13:59.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.502+0000 7fd9548bf700 1 --2- 172.21.15.2:0/2062855314 >> v2:172.21.15.192:3300/0 conn(0x7fd950143ae0 0x7fd9500b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:59.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.502+0000 7fd9548bf700 1 -- 172.21.15.2:0/2062855314 >> v1:172.21.15.2:6789/0 conn(0x7fd9500720f0 legacy=0x7fd95015e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:59.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.502+0000 7fd9548bf700 1 -- 172.21.15.2:0/2062855314 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9500b3ae0 con 0x7fd9501440f0 2023-11-26T07:13:59.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.502+0000 7fd947fff700 1 -- 172.21.15.2:0/2062855314 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2800367846 0 0) 0x7fd950143ec0 con 0x7fd9500720f0 2023-11-26T07:13:59.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.502+0000 7fd9548bf700 1 --2- 172.21.15.2:0/2062855314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9501440f0 0x7fd950071bb0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fd95006d2e0 tx=0x7fd940009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdfd760b9eb01a23 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:59.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.503+0000 7fd947fff700 1 -- 172.21.15.2:0/2062855314 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94000b860 con 0x7fd9501440f0 2023-11-26T07:13:59.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.503+0000 7fd947fff700 1 -- 172.21.15.2:0/2062855314 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd94000b9c0 con 0x7fd9501440f0 2023-11-26T07:13:59.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.503+0000 7fd947fff700 1 -- 172.21.15.2:0/2062855314 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94000bd50 con 0x7fd9501440f0 2023-11-26T07:13:59.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.503+0000 7fd957324700 1 -- 172.21.15.2:0/2062855314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9501440f0 msgr2=0x7fd950071bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:59.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.503+0000 7fd957324700 1 --2- 172.21.15.2:0/2062855314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9501440f0 0x7fd950071bb0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fd95006d2e0 tx=0x7fd940009c00 comp rx=0 tx=0).stop 2023-11-26T07:13:59.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.503+0000 7fd957324700 1 -- 172.21.15.2:0/2062855314 shutdown_connections 2023-11-26T07:13:59.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.503+0000 7fd957324700 1 --2- 172.21.15.2:0/2062855314 >> v2:172.21.15.192:3300/0 conn(0x7fd950143ae0 0x7fd9500b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:59.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.503+0000 7fd957324700 1 --2- 172.21.15.2:0/2062855314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9501440f0 0x7fd950071bb0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:59.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.503+0000 7fd957324700 1 -- 172.21.15.2:0/2062855314 >> 172.21.15.2:0/2062855314 conn(0x7fd9500b2740 msgr2=0x7fd9500b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:59.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.503+0000 7fd957324700 1 -- 172.21.15.2:0/2062855314 shutdown_connections 2023-11-26T07:13:59.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.503+0000 7fd957324700 1 -- 172.21.15.2:0/2062855314 wait complete. 2023-11-26T07:13:59.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.504+0000 7fd957324700 1 Processor -- start 2023-11-26T07:13:59.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.505+0000 7fd957324700 1 -- start start 2023-11-26T07:13:59.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.505+0000 7fd957324700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9500720f0 0x7fd9501f0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:59.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.505+0000 7fd957324700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd950143ae0 0x7fd950159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:59.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.505+0000 7fd957324700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9501440f0 0x7fd9501597b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:59.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.505+0000 7fd957324700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9501372b0 con 0x7fd950143ae0 2023-11-26T07:13:59.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.505+0000 7fd957324700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9501366a0 con 0x7fd9500720f0 2023-11-26T07:13:59.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.505+0000 7fd957324700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd950136980 con 0x7fd9501440f0 2023-11-26T07:13:59.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.505+0000 7fd9548bf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd950143ae0 0x7fd950159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:59.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.505+0000 7fd9548bf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd950143ae0 0x7fd950159270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42042/0 (socket says 172.21.15.2:42042) 2023-11-26T07:13:59.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.505+0000 7fd9548bf700 1 -- 172.21.15.2:0/1857676215 learned_addr learned my addr 172.21.15.2:0/1857676215 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:13:59.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.506+0000 7fd9558c1700 1 --2- 172.21.15.2:0/1857676215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9501440f0 0x7fd9501597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:59.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.506+0000 7fd9550c0700 1 --2- 172.21.15.2:0/1857676215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9500720f0 0x7fd9501f0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:59.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.506+0000 7fd9548bf700 1 -- 172.21.15.2:0/1857676215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9501440f0 msgr2=0x7fd9501597b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:59.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.506+0000 7fd9548bf700 1 --2- 172.21.15.2:0/1857676215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9501440f0 0x7fd9501597b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:59.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.506+0000 7fd9548bf700 1 -- 172.21.15.2:0/1857676215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9500720f0 msgr2=0x7fd9501f0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:59.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.506+0000 7fd9548bf700 1 --2- 172.21.15.2:0/1857676215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9500720f0 0x7fd9501f0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:59.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.506+0000 7fd9548bf700 1 -- 172.21.15.2:0/1857676215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd940009550 con 0x7fd950143ae0 2023-11-26T07:13:59.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.506+0000 7fd9550c0700 1 --2- 172.21.15.2:0/1857676215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9500720f0 0x7fd9501f0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:13:59.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.506+0000 7fd9558c1700 1 --2- 172.21.15.2:0/1857676215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9501440f0 0x7fd9501597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:13:59.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.506+0000 7fd9548bf700 1 --2- 172.21.15.2:0/1857676215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd950143ae0 0x7fd950159270 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fd940009c40 tx=0x7fd940004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:59.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.506+0000 7fd945ffb700 1 -- 172.21.15.2:0/1857676215 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9400036a0 con 0x7fd950143ae0 2023-11-26T07:13:59.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.506+0000 7fd945ffb700 1 -- 172.21.15.2:0/1857676215 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd940003800 con 0x7fd950143ae0 2023-11-26T07:13:59.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.506+0000 7fd957324700 1 -- 172.21.15.2:0/1857676215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd950136c60 con 0x7fd950143ae0 2023-11-26T07:13:59.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.506+0000 7fd945ffb700 1 -- 172.21.15.2:0/1857676215 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd940003bb0 con 0x7fd950143ae0 2023-11-26T07:13:59.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.506+0000 7fd957324700 1 -- 172.21.15.2:0/1857676215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd950137740 con 0x7fd950143ae0 2023-11-26T07:13:59.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.507+0000 7fd957324700 1 -- 172.21.15.2:0/1857676215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9500d03d0 con 0x7fd950143ae0 2023-11-26T07:13:59.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.508+0000 7fd945ffb700 1 -- 172.21.15.2:0/1857676215 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7fd940003d10 con 0x7fd950143ae0 2023-11-26T07:13:59.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.508+0000 7fd945ffb700 1 --2- 172.21.15.2:0/1857676215 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd93406b1a0 0x7fd93406d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:13:59.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.508+0000 7fd945ffb700 1 -- 172.21.15.2:0/1857676215 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd94008c940 con 0x7fd950143ae0 2023-11-26T07:13:59.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.508+0000 7fd9550c0700 1 --2- 172.21.15.2:0/1857676215 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd93406b1a0 0x7fd93406d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:13:59.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.509+0000 7fd9550c0700 1 --2- 172.21.15.2:0/1857676215 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd93406b1a0 0x7fd93406d660 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd94c009820 tx=0x7fd94c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:13:59.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.513+0000 7fd945ffb700 1 -- 172.21.15.2:0/1857676215 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd940057730 con 0x7fd950143ae0 2023-11-26T07:13:59.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.759+0000 7fd957324700 1 -- 172.21.15.2:0/1857676215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd950137460 con 0x7fd950143ae0 2023-11-26T07:13:59.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.759+0000 7fd945ffb700 1 -- 172.21.15.2:0/1857676215 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4913 (secure 0 0 0) 0x7fd950137460 con 0x7fd950143ae0 2023-11-26T07:13:59.761 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:13:59.761 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5051,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2052180749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":2052180749},{"type":"v1","addr":"172.21.15.2:6835","nonce":2052180749}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/1795687093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1795687093},{"type":"v1","addr":"172.21.15.2:6834","nonce":1795687093}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5646,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2009465289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2009465289},{"type":"v1","addr":"172.21.15.192:6837","nonce":2009465289}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:13:53.741450+0000","modified":"2023-11-26T07:13:56.778566+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5649},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5649":{"gid":5649,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6836/2352660671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2352660671},{"type":"v1","addr":"172.21.15.192:6836","nonce":2352660671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-26T07:13:59.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.761+0000 7fd957324700 1 -- 172.21.15.2:0/1857676215 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd93406b1a0 msgr2=0x7fd93406d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:59.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.761+0000 7fd957324700 1 --2- 172.21.15.2:0/1857676215 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd93406b1a0 0x7fd93406d660 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd94c009820 tx=0x7fd94c008040 comp rx=0 tx=0).stop 2023-11-26T07:13:59.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.761+0000 7fd957324700 1 -- 172.21.15.2:0/1857676215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd950143ae0 msgr2=0x7fd950159270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:13:59.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.761+0000 7fd957324700 1 --2- 172.21.15.2:0/1857676215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd950143ae0 0x7fd950159270 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fd940009c40 tx=0x7fd940004750 comp rx=0 tx=0).stop 2023-11-26T07:13:59.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.761+0000 7fd957324700 1 -- 172.21.15.2:0/1857676215 shutdown_connections 2023-11-26T07:13:59.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.761+0000 7fd957324700 1 --2- 172.21.15.2:0/1857676215 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd93406b1a0 0x7fd93406d660 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:59.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.761+0000 7fd957324700 1 --2- 172.21.15.2:0/1857676215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9501440f0 0x7fd9501597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:59.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.761+0000 7fd957324700 1 --2- 172.21.15.2:0/1857676215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9500720f0 0x7fd9501f0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:59.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.761+0000 7fd957324700 1 --2- 172.21.15.2:0/1857676215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd950143ae0 0x7fd950159270 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:13:59.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.761+0000 7fd957324700 1 -- 172.21.15.2:0/1857676215 >> 172.21.15.2:0/1857676215 conn(0x7fd9500b2740 msgr2=0x7fd95006f200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:13:59.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.761+0000 7fd957324700 1 -- 172.21.15.2:0/1857676215 shutdown_connections 2023-11-26T07:13:59.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:13:59.761+0000 7fd957324700 1 -- 172.21.15.2:0/1857676215 wait complete. 2023-11-26T07:13:59.765 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2023-11-26T07:14:00.178 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-26T07:13:53.741450+0000', 'modified': '2023-11-26T07:13:56.778566+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5649}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5649': {'gid': 5649, 'name': 'b', 'rank': 0, 'incarnation': 22, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.192:6836/2352660671', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6834', 'nonce': 2352660671}, {'type': 'v1', 'addr': '172.21.15.192:6836', 'nonce': 2352660671}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-26T07:14:00.178 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-26T07:14:00.178 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-26T07:14:00.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.307+0000 7f577ecc3700 1 Processor -- start 2023-11-26T07:14:00.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.307+0000 7f577ecc3700 1 -- start start 2023-11-26T07:14:00.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.308+0000 7f577ecc3700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5778144c10 0x7f577806afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:00.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.308+0000 7f577ecc3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5778145100 0x7f577806b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:00.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.308+0000 7f577ecc3700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5778145650 0x7f5778071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:00.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.308+0000 7f577ecc3700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f577806f500 con 0x7f5778144c10 2023-11-26T07:14:00.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.308+0000 7f577ecc3700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57780cd610 con 0x7f5778145650 2023-11-26T07:14:00.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.308+0000 7f577ecc3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5778160720 con 0x7f5778145100 2023-11-26T07:14:00.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.308+0000 7f577ca5f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5778144c10 0x7f577806afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:00.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.308+0000 7f577ca5f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5778144c10 0x7f577806afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42048/0 (socket says 172.21.15.2:42048) 2023-11-26T07:14:00.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.308+0000 7f577ca5f700 1 -- 172.21.15.2:0/703947805 learned_addr learned my addr 172.21.15.2:0/703947805 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:00.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.309+0000 7f5777fff700 1 --2- 172.21.15.2:0/703947805 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5778145100 0x7f577806b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:00.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.309+0000 7f577d260700 1 --2- 172.21.15.2:0/703947805 >> v2:172.21.15.192:3300/0 conn(0x7f5778145650 0x7f5778071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:00.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.309+0000 7f577ca5f700 1 -- 172.21.15.2:0/703947805 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5778145100 msgr2=0x7f577806b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:00.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.309+0000 7f577ca5f700 1 --2- 172.21.15.2:0/703947805 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5778145100 0x7f577806b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:00.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.309+0000 7f577ca5f700 1 -- 172.21.15.2:0/703947805 >> v2:172.21.15.192:3300/0 conn(0x7f5778145650 msgr2=0x7f5778071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:00.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.309+0000 7f577ca5f700 1 --2- 172.21.15.2:0/703947805 >> v2:172.21.15.192:3300/0 conn(0x7f5778145650 0x7f5778071bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:00.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.309+0000 7f577ca5f700 1 -- 172.21.15.2:0/703947805 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f577806f710 con 0x7f5778144c10 2023-11-26T07:14:00.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.309+0000 7f577ca5f700 1 --2- 172.21.15.2:0/703947805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5778144c10 0x7f577806afd0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f5778145b50 tx=0x7f576c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b99ee3ac7671e0f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:00.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.309+0000 7f57777fe700 1 -- 172.21.15.2:0/703947805 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c00b870 con 0x7f5778144c10 2023-11-26T07:14:00.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.309+0000 7f57777fe700 1 -- 172.21.15.2:0/703947805 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576c00b9d0 con 0x7f5778144c10 2023-11-26T07:14:00.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.309+0000 7f57777fe700 1 -- 172.21.15.2:0/703947805 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c00bd60 con 0x7f5778144c10 2023-11-26T07:14:00.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.310+0000 7f577ecc3700 1 -- 172.21.15.2:0/703947805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5778144c10 msgr2=0x7f577806afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:00.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.310+0000 7f577ecc3700 1 --2- 172.21.15.2:0/703947805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5778144c10 0x7f577806afd0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f5778145b50 tx=0x7f576c009bd0 comp rx=0 tx=0).stop 2023-11-26T07:14:00.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.310+0000 7f577ecc3700 1 -- 172.21.15.2:0/703947805 shutdown_connections 2023-11-26T07:14:00.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.310+0000 7f577ecc3700 1 --2- 172.21.15.2:0/703947805 >> v2:172.21.15.192:3300/0 conn(0x7f5778145650 0x7f5778071bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:00.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.310+0000 7f577ecc3700 1 --2- 172.21.15.2:0/703947805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5778144c10 0x7f577806afd0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:00.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.310+0000 7f577ecc3700 1 --2- 172.21.15.2:0/703947805 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5778145100 0x7f577806b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:00.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.310+0000 7f577ecc3700 1 -- 172.21.15.2:0/703947805 >> 172.21.15.2:0/703947805 conn(0x7f57780b2740 msgr2=0x7f57780b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:00.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.310+0000 7f577ecc3700 1 -- 172.21.15.2:0/703947805 shutdown_connections 2023-11-26T07:14:00.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.310+0000 7f577ecc3700 1 -- 172.21.15.2:0/703947805 wait complete. 2023-11-26T07:14:00.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.311+0000 7f577ecc3700 1 Processor -- start 2023-11-26T07:14:00.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.311+0000 7f577ecc3700 1 -- start start 2023-11-26T07:14:00.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.312+0000 7f577ecc3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5778144c10 0x7f57781f4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:00.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.312+0000 7f577ecc3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5778145100 0x7f577806e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:00.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.312+0000 7f577ecc3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5778145650 0x7f577806ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:00.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.312+0000 7f577ecc3700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57780aa170 con 0x7f5778145100 2023-11-26T07:14:00.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.312+0000 7f577ecc3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57780a9560 con 0x7f5778145650 2023-11-26T07:14:00.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.312+0000 7f577ecc3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57780a9840 con 0x7f5778144c10 2023-11-26T07:14:00.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.312+0000 7f5777fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5778145100 0x7f577806e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:00.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.312+0000 7f5777fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5778145100 0x7f577806e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42054/0 (socket says 172.21.15.2:42054) 2023-11-26T07:14:00.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.312+0000 7f5777fff700 1 -- 172.21.15.2:0/2534290712 learned_addr learned my addr 172.21.15.2:0/2534290712 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:00.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.312+0000 7f577d260700 1 --2- 172.21.15.2:0/2534290712 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5778145650 0x7f577806ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:00.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.312+0000 7f577ca5f700 1 --2- 172.21.15.2:0/2534290712 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5778144c10 0x7f57781f4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:00.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.312+0000 7f5777fff700 1 -- 172.21.15.2:0/2534290712 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5778144c10 msgr2=0x7f57781f4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:00.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.312+0000 7f5777fff700 1 --2- 172.21.15.2:0/2534290712 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5778144c10 0x7f57781f4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:00.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.312+0000 7f5777fff700 1 -- 172.21.15.2:0/2534290712 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5778145650 msgr2=0x7f577806ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:00.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.312+0000 7f5777fff700 1 --2- 172.21.15.2:0/2534290712 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5778145650 0x7f577806ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:00.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.312+0000 7f5777fff700 1 -- 172.21.15.2:0/2534290712 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f576c009550 con 0x7f5778145100 2023-11-26T07:14:00.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.312+0000 7f5777fff700 1 --2- 172.21.15.2:0/2534290712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5778145100 0x7f577806e6b0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f576400e810 tx=0x7f576400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:00.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.313+0000 7f57757fa700 1 -- 172.21.15.2:0/2534290712 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5764004230 con 0x7f5778145100 2023-11-26T07:14:00.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.313+0000 7f57757fa700 1 -- 172.21.15.2:0/2534290712 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5764004390 con 0x7f5778145100 2023-11-26T07:14:00.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.313+0000 7f577ecc3700 1 -- 172.21.15.2:0/2534290712 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57780a9b20 con 0x7f5778145100 2023-11-26T07:14:00.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.313+0000 7f57757fa700 1 -- 172.21.15.2:0/2534290712 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57640036a0 con 0x7f5778145100 2023-11-26T07:14:00.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.313+0000 7f577ecc3700 1 -- 172.21.15.2:0/2534290712 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57781f5230 con 0x7f5778145100 2023-11-26T07:14:00.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.314+0000 7f57757fa700 1 -- 172.21.15.2:0/2534290712 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f5764003800 con 0x7f5778145100 2023-11-26T07:14:00.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.315+0000 7f57757fa700 1 --2- 172.21.15.2:0/2534290712 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f575c06b1a0 0x7f575c06d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:00.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.315+0000 7f57757fa700 1 -- 172.21.15.2:0/2534290712 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5764089950 con 0x7f5778145100 2023-11-26T07:14:00.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.315+0000 7f577ca5f700 1 --2- 172.21.15.2:0/2534290712 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f575c06b1a0 0x7f575c06d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:00.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.316+0000 7f577ca5f700 1 --2- 172.21.15.2:0/2534290712 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f575c06b1a0 0x7f575c06d660 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f576c000c00 tx=0x7f576c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:00.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.317+0000 7f578aebcb80 1 Processor -- start 2023-11-26T07:14:00.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.317+0000 7f578aebcb80 1 -- start start 2023-11-26T07:14:00.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.318+0000 7f578aebcb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb3444080 0x55ceb348a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:00.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.318+0000 7f578aebcb80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55ceb3459ed0 0x55ceb348ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:00.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.318+0000 7f578aebcb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ceb3441490 0x55ceb346de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:00.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.318+0000 7f578aebcb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceb33b7770 con 0x55ceb3444080 2023-11-26T07:14:00.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.318+0000 7f578aebcb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceb339e750 con 0x55ceb3441490 2023-11-26T07:14:00.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.318+0000 7f578aebcb80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ceb339c070 con 0x55ceb3459ed0 2023-11-26T07:14:00.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.318+0000 7f577ca5f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb3444080 0x55ceb348a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:00.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.318+0000 7f577ca5f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb3444080 0x55ceb348a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42060/0 (socket says 172.21.15.2:42060) 2023-11-26T07:14:00.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.318+0000 7f577ca5f700 1 -- 172.21.15.2:0/1675395252 learned_addr learned my addr 172.21.15.2:0/1675395252 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:00.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.318+0000 7f577d260700 1 --2- 172.21.15.2:0/1675395252 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ceb3441490 0x55ceb346de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:00.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.318+0000 7f5777fff700 1 --2- 172.21.15.2:0/1675395252 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55ceb3459ed0 0x55ceb348ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:00.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.318+0000 7f577ca5f700 1 -- 172.21.15.2:0/1675395252 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55ceb3459ed0 msgr2=0x55ceb348ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:00.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.318+0000 7f577ca5f700 1 --2- 172.21.15.2:0/1675395252 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55ceb3459ed0 0x55ceb348ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:00.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.318+0000 7f577ca5f700 1 -- 172.21.15.2:0/1675395252 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ceb3441490 msgr2=0x55ceb346de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:00.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.318+0000 7f577ca5f700 1 --2- 172.21.15.2:0/1675395252 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ceb3441490 0x55ceb346de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:00.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.318+0000 7f577ca5f700 1 -- 172.21.15.2:0/1675395252 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ceb32145e0 con 0x55ceb3444080 2023-11-26T07:14:00.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.318+0000 7f577ca5f700 1 --2- 172.21.15.2:0/1675395252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb3444080 0x55ceb348a840 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f57780d1bd0 tx=0x7f576c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e66acf8f4319ead2 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:00.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.318+0000 7f57627fc700 1 -- 172.21.15.2:0/1675395252 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c0036a0 con 0x55ceb3444080 2023-11-26T07:14:00.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.318+0000 7f57627fc700 1 -- 172.21.15.2:0/1675395252 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576c003800 con 0x55ceb3444080 2023-11-26T07:14:00.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.318+0000 7f57627fc700 1 -- 172.21.15.2:0/1675395252 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c003b70 con 0x55ceb3444080 2023-11-26T07:14:00.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.319+0000 7f578aebcb80 1 -- 172.21.15.2:0/1675395252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb3444080 msgr2=0x55ceb348a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:00.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.319+0000 7f578aebcb80 1 --2- 172.21.15.2:0/1675395252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb3444080 0x55ceb348a840 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f57780d1bd0 tx=0x7f576c010000 comp rx=0 tx=0).stop 2023-11-26T07:14:00.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.319+0000 7f578aebcb80 1 -- 172.21.15.2:0/1675395252 shutdown_connections 2023-11-26T07:14:00.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.319+0000 7f578aebcb80 1 --2- 172.21.15.2:0/1675395252 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ceb3441490 0x55ceb346de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:00.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.319+0000 7f578aebcb80 1 --2- 172.21.15.2:0/1675395252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb3444080 0x55ceb348a840 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:00.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.319+0000 7f578aebcb80 1 --2- 172.21.15.2:0/1675395252 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55ceb3459ed0 0x55ceb348ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:00.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.319+0000 7f578aebcb80 1 -- 172.21.15.2:0/1675395252 >> 172.21.15.2:0/1675395252 conn(0x55ceb3372310 msgr2=0x55ceb3488e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:00.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.319+0000 7f578aebcb80 1 -- 172.21.15.2:0/1675395252 shutdown_connections 2023-11-26T07:14:00.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.319+0000 7f578aebcb80 1 -- 172.21.15.2:0/1675395252 wait complete. 2023-11-26T07:14:00.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.320+0000 7f578aebcb80 1 -- start start 2023-11-26T07:14:00.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.320+0000 7f578aebcb80 1 Processor -- start 2023-11-26T07:14:00.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.321+0000 7f578aebcb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ceb3441490 0x55ceb3485dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:00.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.321+0000 7f578aebcb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb3444080 0x55ceb3462b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:00.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.321+0000 7f578aebcb80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55ceb3459ed0 0x55ceb3482a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:00.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.321+0000 7f578aebcb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceb3397960 con 0x55ceb3444080 2023-11-26T07:14:00.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.321+0000 7f578aebcb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceb3351510 con 0x55ceb3441490 2023-11-26T07:14:00.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.321+0000 7f578aebcb80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ceb33511b0 con 0x55ceb3459ed0 2023-11-26T07:14:00.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.321+0000 7f578aebcb80 10 client.0 _ll_register_callbacks cb 0x55ceb327ca30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-26T07:14:00.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.321+0000 7f5777fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb3444080 0x55ceb3462b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:00.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.321+0000 7f5777fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb3444080 0x55ceb3462b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42068/0 (socket says 172.21.15.2:42068) 2023-11-26T07:14:00.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.321+0000 7f5777fff700 1 -- 172.21.15.2:0/3551578696 learned_addr learned my addr 172.21.15.2:0/3551578696 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:00.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.321+0000 7f577d260700 1 --2- 172.21.15.2:0/3551578696 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55ceb3459ed0 0x55ceb3482a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:00.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.321+0000 7f577ca5f700 1 --2- 172.21.15.2:0/3551578696 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ceb3441490 0x55ceb3485dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:00.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.321+0000 7f5777fff700 1 -- 172.21.15.2:0/3551578696 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55ceb3459ed0 msgr2=0x55ceb3482a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:00.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.321+0000 7f5777fff700 1 --2- 172.21.15.2:0/3551578696 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55ceb3459ed0 0x55ceb3482a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:00.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.321+0000 7f5777fff700 1 -- 172.21.15.2:0/3551578696 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ceb3441490 msgr2=0x55ceb3485dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:00.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.321+0000 7f5777fff700 1 --2- 172.21.15.2:0/3551578696 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ceb3441490 0x55ceb3485dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:00.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.321+0000 7f5777fff700 1 -- 172.21.15.2:0/3551578696 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f577806f710 con 0x55ceb3444080 2023-11-26T07:14:00.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.321+0000 7f577ca5f700 1 --2- 172.21.15.2:0/3551578696 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ceb3441490 0x55ceb3485dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:14:00.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.321+0000 7f5777fff700 1 --2- 172.21.15.2:0/3551578696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb3444080 0x55ceb3462b90 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f576400e7e0 tx=0x7f5764058710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9197f5afd8a875c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:00.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.321+0000 7f57577fe700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-26T07:14:00.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.322+0000 7f57577fe700 1 -- 172.21.15.2:0/3551578696 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57640602d0 con 0x55ceb3444080 2023-11-26T07:14:00.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.322+0000 7f57577fe700 1 -- 172.21.15.2:0/3551578696 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5764060560 con 0x55ceb3444080 2023-11-26T07:14:00.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.322+0000 7f578aebcb80 1 -- 172.21.15.2:0/3551578696 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ceb3436a40 con 0x55ceb3444080 2023-11-26T07:14:00.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.322+0000 7f57577fe700 1 -- 172.21.15.2:0/3551578696 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5764087cc0 con 0x55ceb3444080 2023-11-26T07:14:00.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.322+0000 7f578aebcb80 10 client.5775 fetch_fsmap learned FSMap version 26 2023-11-26T07:14:00.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.322+0000 7f578aebcb80 1 -- 172.21.15.2:0/3551578696 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x55ceb31c0d90 con 0x55ceb3444080 2023-11-26T07:14:00.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.322+0000 7f57577fe700 1 -- 172.21.15.2:0/3551578696 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ceb3436a40 con 0x55ceb3444080 2023-11-26T07:14:00.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.322+0000 7f57577fe700 1 -- 172.21.15.2:0/3551578696 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5764087e20 con 0x55ceb3444080 2023-11-26T07:14:00.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.322+0000 7f578aebcb80 10 client.5775 fetch_fsmap finished waiting for FSMap version 26 2023-11-26T07:14:00.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.322+0000 7f578aebcb80 10 client.5775 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-26T07:14:00.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.322+0000 7f578aebcb80 20 client.5775 populate_metadata read hostname 'smithi002' 2023-11-26T07:14:00.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.322+0000 7f578aebcb80 1 --2- 172.21.15.2:0/3551578696 >> [v2:172.21.15.192:6834/2352660671,v1:172.21.15.192:6836/2352660671] conn(0x55ceb3480820 0x55ceb34a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:00.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.322+0000 7f578aebcb80 4 client.5775 mds_command: new command op to 5649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-26T07:14:00.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.322+0000 7f578aebcb80 1 -- 172.21.15.2:0/3551578696 --> [v2:172.21.15.192:6834/2352660671,v1:172.21.15.192:6836/2352660671] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ceb3412840 con 0x55ceb3480820 2023-11-26T07:14:00.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.322+0000 7f577ca5f700 1 --2- 172.21.15.2:0/3551578696 >> [v2:172.21.15.192:6834/2352660671,v1:172.21.15.192:6836/2352660671] conn(0x55ceb3480820 0x55ceb34a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:00.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.323+0000 7f57577fe700 10 client.5775 ms_handle_connect on v2:172.21.15.192:6834/2352660671 2023-11-26T07:14:00.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.323+0000 7f577ca5f700 1 --2- 172.21.15.2:0/3551578696 >> [v2:172.21.15.192:6834/2352660671,v1:172.21.15.192:6836/2352660671] conn(0x55ceb3480820 0x55ceb34a59a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1543fa6b6ecbbd0a server_cookie=7a546d2e1047df05 in_seq=0 out_seq=0 2023-11-26T07:14:00.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.323+0000 7f57577fe700 1 -- 172.21.15.2:0/3551578696 <== mds.0 v2:172.21.15.192:6834/2352660671 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ceb3412840 con 0x55ceb3480820 2023-11-26T07:14:00.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.323+0000 7f57577fe700 10 client.5775 handle_command_reply: tid=0 2023-11-26T07:14:00.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.323+0000 7f578aebcb80 1 client.5775 shutdown 2023-11-26T07:14:00.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.324+0000 7f578aebcb80 1 -- 172.21.15.2:0/3551578696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb3444080 msgr2=0x55ceb3462b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:00.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.324+0000 7f578aebcb80 1 --2- 172.21.15.2:0/3551578696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb3444080 0x55ceb3462b90 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f576400e7e0 tx=0x7f5764058710 comp rx=0 tx=0).stop 2023-11-26T07:14:00.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.324+0000 7f578aebcb80 1 -- 172.21.15.2:0/3551578696 shutdown_connections 2023-11-26T07:14:00.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.324+0000 7f578aebcb80 1 --2- 172.21.15.2:0/3551578696 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55ceb3459ed0 0x55ceb3482a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:00.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.324+0000 7f578aebcb80 1 --2- 172.21.15.2:0/3551578696 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ceb3441490 0x55ceb3485dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:00.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.324+0000 7f578aebcb80 1 --2- 172.21.15.2:0/3551578696 >> [v2:172.21.15.192:6834/2352660671,v1:172.21.15.192:6836/2352660671] conn(0x55ceb3480820 0x55ceb34a59a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:00.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.324+0000 7f578aebcb80 1 --2- 172.21.15.2:0/3551578696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb3444080 0x55ceb3462b90 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:00.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.324+0000 7f57577fe700 0 client.5775 ms_handle_reset on v2:172.21.15.192:6834/2352660671 2023-11-26T07:14:00.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.324+0000 7f578aebcb80 1 -- 172.21.15.2:0/3551578696 >> 172.21.15.2:0/3551578696 conn(0x55ceb3372310 msgr2=0x55ceb348cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:00.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.324+0000 7f578aebcb80 1 -- 172.21.15.2:0/3551578696 shutdown_connections 2023-11-26T07:14:00.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.324+0000 7f578aebcb80 1 -- 172.21.15.2:0/3551578696 wait complete. 2023-11-26T07:14:00.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.324+0000 7f578aebcb80 20 client.5775 trim_cache size 0 max 16384 2023-11-26T07:14:00.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.342+0000 7f578aebcb80 1 Processor -- start 2023-11-26T07:14:00.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.342+0000 7f578aebcb80 1 -- start start 2023-11-26T07:14:00.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.343+0000 7f578aebcb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ceb3441490 0x55ceb3485c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:00.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.343+0000 7f578aebcb80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55ceb3444080 0x55ceb34ed480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:00.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.343+0000 7f578aebcb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb3459ed0 0x55ceb3486ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:00.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.343+0000 7f578aebcb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceb32168d0 con 0x55ceb3459ed0 2023-11-26T07:14:00.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.343+0000 7f578aebcb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceb3440cc0 con 0x55ceb3441490 2023-11-26T07:14:00.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.343+0000 7f578aebcb80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ceb348be30 con 0x55ceb3444080 2023-11-26T07:14:00.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.343+0000 7f577d260700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb3459ed0 0x55ceb3486ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:00.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.343+0000 7f577d260700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb3459ed0 0x55ceb3486ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42078/0 (socket says 172.21.15.2:42078) 2023-11-26T07:14:00.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.343+0000 7f577d260700 1 -- 172.21.15.2:0/1294629226 learned_addr learned my addr 172.21.15.2:0/1294629226 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:00.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.343+0000 7f5777fff700 1 --2- 172.21.15.2:0/1294629226 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55ceb3444080 0x55ceb34ed480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:00.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.343+0000 7f577ca5f700 1 --2- 172.21.15.2:0/1294629226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ceb3441490 0x55ceb3485c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:00.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.343+0000 7f577d260700 1 -- 172.21.15.2:0/1294629226 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55ceb3444080 msgr2=0x55ceb34ed480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:00.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.343+0000 7f577d260700 1 --2- 172.21.15.2:0/1294629226 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55ceb3444080 0x55ceb34ed480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:00.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.343+0000 7f577d260700 1 -- 172.21.15.2:0/1294629226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ceb3441490 msgr2=0x55ceb3485c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:00.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.343+0000 7f577d260700 1 --2- 172.21.15.2:0/1294629226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ceb3441490 0x55ceb3485c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:00.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.343+0000 7f577d260700 1 -- 172.21.15.2:0/1294629226 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ceb31a9c10 con 0x55ceb3459ed0 2023-11-26T07:14:00.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.343+0000 7f577ca5f700 1 --2- 172.21.15.2:0/1294629226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ceb3441490 0x55ceb3485c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:14:00.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.344+0000 7f577d260700 1 --2- 172.21.15.2:0/1294629226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb3459ed0 0x55ceb3486ce0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f5770009fc0 tx=0x7f57700145a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51b0746ce896c8e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:00.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.344+0000 7f5762ffd700 1 -- 172.21.15.2:0/1294629226 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5770017640 con 0x55ceb3459ed0 2023-11-26T07:14:00.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.344+0000 7f5762ffd700 1 -- 172.21.15.2:0/1294629226 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f577000f040 con 0x55ceb3459ed0 2023-11-26T07:14:00.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.344+0000 7f5762ffd700 1 -- 172.21.15.2:0/1294629226 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57700179e0 con 0x55ceb3459ed0 2023-11-26T07:14:00.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.344+0000 7f578aebcb80 1 -- 172.21.15.2:0/1294629226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb3459ed0 msgr2=0x55ceb3486ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:00.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.344+0000 7f578aebcb80 1 --2- 172.21.15.2:0/1294629226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb3459ed0 0x55ceb3486ce0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f5770009fc0 tx=0x7f57700145a0 comp rx=0 tx=0).stop 2023-11-26T07:14:00.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.344+0000 7f578aebcb80 1 -- 172.21.15.2:0/1294629226 shutdown_connections 2023-11-26T07:14:00.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.344+0000 7f578aebcb80 1 --2- 172.21.15.2:0/1294629226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb3459ed0 0x55ceb3486ce0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:00.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.344+0000 7f578aebcb80 1 --2- 172.21.15.2:0/1294629226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ceb3441490 0x55ceb3485c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:00.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.344+0000 7f578aebcb80 1 --2- 172.21.15.2:0/1294629226 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55ceb3444080 0x55ceb34ed480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:00.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.344+0000 7f578aebcb80 1 -- 172.21.15.2:0/1294629226 >> 172.21.15.2:0/1294629226 conn(0x55ceb3372310 msgr2=0x55ceb34a99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:00.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.344+0000 7f578aebcb80 1 -- 172.21.15.2:0/1294629226 shutdown_connections 2023-11-26T07:14:00.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.344+0000 7f578aebcb80 1 -- 172.21.15.2:0/1294629226 wait complete. 2023-11-26T07:14:00.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.345+0000 7f578aebcb80 1 -- start start 2023-11-26T07:14:00.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.345+0000 7f578aebcb80 1 Processor -- start 2023-11-26T07:14:00.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.346+0000 7f578aebcb80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55ceb3441490 0x55ceb34e70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:00.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.346+0000 7f578aebcb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb3444080 0x55ceb3481c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:00.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.346+0000 7f578aebcb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ceb3459ed0 0x55ceb3482160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:00.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.346+0000 7f578aebcb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceb3437cb0 con 0x55ceb3444080 2023-11-26T07:14:00.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.346+0000 7f578aebcb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceb34380d0 con 0x55ceb3459ed0 2023-11-26T07:14:00.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.346+0000 7f578aebcb80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ceb3488220 con 0x55ceb3441490 2023-11-26T07:14:00.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.346+0000 7f578aebcb80 10 client.0 _ll_register_callbacks cb 0x55ceb327ca30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-26T07:14:00.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.346+0000 7f5777fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb3444080 0x55ceb3481c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:00.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.346+0000 7f5777fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb3444080 0x55ceb3481c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42082/0 (socket says 172.21.15.2:42082) 2023-11-26T07:14:00.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.346+0000 7f5777fff700 1 -- 172.21.15.2:0/4130955049 learned_addr learned my addr 172.21.15.2:0/4130955049 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:00.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.346+0000 7f577ca5f700 1 --2- 172.21.15.2:0/4130955049 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55ceb3441490 0x55ceb34e70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:00.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.346+0000 7f577d260700 1 --2- 172.21.15.2:0/4130955049 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ceb3459ed0 0x55ceb3482160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:00.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.346+0000 7f5777fff700 1 -- 172.21.15.2:0/4130955049 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55ceb3441490 msgr2=0x55ceb34e70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:00.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.346+0000 7f5777fff700 1 --2- 172.21.15.2:0/4130955049 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55ceb3441490 0x55ceb34e70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:00.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.346+0000 7f5777fff700 1 -- 172.21.15.2:0/4130955049 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ceb3459ed0 msgr2=0x55ceb3482160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:00.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.346+0000 7f5777fff700 1 --2- 172.21.15.2:0/4130955049 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ceb3459ed0 0x55ceb3482160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:00.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.346+0000 7f5777fff700 1 -- 172.21.15.2:0/4130955049 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5770009c40 con 0x55ceb3444080 2023-11-26T07:14:00.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.347+0000 7f5777fff700 1 --2- 172.21.15.2:0/4130955049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb3444080 0x55ceb3481c20 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f5764058160 tx=0x7f576405c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a08d8f22d9440f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:00.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.347+0000 7f57577fe700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-26T07:14:00.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.347+0000 7f57577fe700 1 -- 172.21.15.2:0/4130955049 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5764057fa0 con 0x55ceb3444080 2023-11-26T07:14:00.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.347+0000 7f57577fe700 1 -- 172.21.15.2:0/4130955049 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5764060560 con 0x55ceb3444080 2023-11-26T07:14:00.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.347+0000 7f578aebcb80 1 -- 172.21.15.2:0/4130955049 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f576c003800 con 0x55ceb3444080 2023-11-26T07:14:00.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.347+0000 7f57577fe700 1 -- 172.21.15.2:0/4130955049 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5764053fc0 con 0x55ceb3444080 2023-11-26T07:14:00.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.347+0000 7f578aebcb80 10 client.5781 fetch_fsmap learned FSMap version 26 2023-11-26T07:14:00.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.347+0000 7f578aebcb80 1 -- 172.21.15.2:0/4130955049 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x55ceb31e7200 con 0x55ceb3444080 2023-11-26T07:14:00.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.347+0000 7f57577fe700 1 -- 172.21.15.2:0/4130955049 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5764064080 con 0x55ceb3444080 2023-11-26T07:14:00.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.347+0000 7f57577fe700 1 -- 172.21.15.2:0/4130955049 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5764054120 con 0x55ceb3444080 2023-11-26T07:14:00.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.347+0000 7f578aebcb80 10 client.5781 fetch_fsmap finished waiting for FSMap version 26 2023-11-26T07:14:00.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.347+0000 7f578aebcb80 10 client.5781 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-26T07:14:00.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.347+0000 7f578aebcb80 20 client.5781 populate_metadata read hostname 'smithi002' 2023-11-26T07:14:00.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.347+0000 7f578aebcb80 1 --2- 172.21.15.2:0/4130955049 >> [v2:172.21.15.192:6834/2352660671,v1:172.21.15.192:6836/2352660671] conn(0x55ceb347eb00 0x55ceb347eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:00.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.347+0000 7f578aebcb80 4 client.5781 mds_command: new command op to 5649 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-26T07:14:00.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.347+0000 7f578aebcb80 1 -- 172.21.15.2:0/4130955049 --> [v2:172.21.15.192:6834/2352660671,v1:172.21.15.192:6836/2352660671] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ceb335df80 con 0x55ceb347eb00 2023-11-26T07:14:00.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.347+0000 7f577ca5f700 1 --2- 172.21.15.2:0/4130955049 >> [v2:172.21.15.192:6834/2352660671,v1:172.21.15.192:6836/2352660671] conn(0x55ceb347eb00 0x55ceb347eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:00.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.348+0000 7f57577fe700 10 client.5781 ms_handle_connect on v2:172.21.15.192:6834/2352660671 2023-11-26T07:14:00.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.348+0000 7f577ca5f700 1 --2- 172.21.15.2:0/4130955049 >> [v2:172.21.15.192:6834/2352660671,v1:172.21.15.192:6836/2352660671] conn(0x55ceb347eb00 0x55ceb347eee0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=738b9eacd89023c6 server_cookie=c5077fe04a9df157 in_seq=0 out_seq=0 2023-11-26T07:14:00.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.348+0000 7f57577fe700 1 -- 172.21.15.2:0/4130955049 <== mds.0 v2:172.21.15.192:6834/2352660671 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55ceb335df80 con 0x55ceb347eb00 2023-11-26T07:14:00.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.348+0000 7f57577fe700 10 client.5781 handle_command_reply: tid=0 2023-11-26T07:14:00.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.348+0000 7f578aebcb80 1 client.5781 shutdown 2023-11-26T07:14:00.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.348+0000 7f578aebcb80 1 -- 172.21.15.2:0/4130955049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb3444080 msgr2=0x55ceb3481c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:00.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.348+0000 7f578aebcb80 1 --2- 172.21.15.2:0/4130955049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb3444080 0x55ceb3481c20 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f5764058160 tx=0x7f576405c040 comp rx=0 tx=0).stop 2023-11-26T07:14:00.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.348+0000 7f578aebcb80 1 -- 172.21.15.2:0/4130955049 shutdown_connections 2023-11-26T07:14:00.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.348+0000 7f578aebcb80 1 --2- 172.21.15.2:0/4130955049 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ceb3459ed0 0x55ceb3482160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:00.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.348+0000 7f578aebcb80 1 --2- 172.21.15.2:0/4130955049 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55ceb3441490 0x55ceb34e70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:00.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.348+0000 7f578aebcb80 1 --2- 172.21.15.2:0/4130955049 >> [v2:172.21.15.192:6834/2352660671,v1:172.21.15.192:6836/2352660671] conn(0x55ceb347eb00 0x55ceb347eee0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:00.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.348+0000 7f578aebcb80 1 --2- 172.21.15.2:0/4130955049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ceb3444080 0x55ceb3481c20 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:00.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.348+0000 7f57577fe700 0 client.5781 ms_handle_reset on v2:172.21.15.192:6834/2352660671 2023-11-26T07:14:00.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.348+0000 7f578aebcb80 1 -- 172.21.15.2:0/4130955049 >> 172.21.15.2:0/4130955049 conn(0x55ceb3372310 msgr2=0x55ceb34f05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:00.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.348+0000 7f578aebcb80 1 -- 172.21.15.2:0/4130955049 shutdown_connections 2023-11-26T07:14:00.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.348+0000 7f578aebcb80 1 -- 172.21.15.2:0/4130955049 wait complete. 2023-11-26T07:14:00.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.348+0000 7f578aebcb80 20 client.5781 trim_cache size 0 max 16384 2023-11-26T07:14:00.357 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-26T07:14:00.357 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "cb9817c7-f1ed-4745-9395-2760a3bb9712", 2023-11-26T07:14:00.357 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2023-11-26T07:14:00.357 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 5649, 2023-11-26T07:14:00.357 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2023-11-26T07:14:00.358 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2023-11-26T07:14:00.358 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2023-11-26T07:14:00.358 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 6.0259956770000001, 2023-11-26T07:14:00.358 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 26, 2023-11-26T07:14:00.358 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 45, 2023-11-26T07:14:00.358 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 45, 2023-11-26T07:14:00.358 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 10.923609621000001 2023-11-26T07:14:00.358 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-26T07:14:00.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.349+0000 7f577ecc3700 1 -- 172.21.15.2:0/2534290712 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f575c06b1a0 msgr2=0x7f575c06d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:00.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.349+0000 7f577ecc3700 1 --2- 172.21.15.2:0/2534290712 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f575c06b1a0 0x7f575c06d660 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f576c000c00 tx=0x7f576c008030 comp rx=0 tx=0).stop 2023-11-26T07:14:00.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.349+0000 7f577ecc3700 1 -- 172.21.15.2:0/2534290712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5778145100 msgr2=0x7f577806e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:00.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.349+0000 7f577ecc3700 1 --2- 172.21.15.2:0/2534290712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5778145100 0x7f577806e6b0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f576400e810 tx=0x7f576400ebd0 comp rx=0 tx=0).stop 2023-11-26T07:14:00.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.349+0000 7f577ecc3700 1 -- 172.21.15.2:0/2534290712 shutdown_connections 2023-11-26T07:14:00.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.349+0000 7f577ecc3700 1 --2- 172.21.15.2:0/2534290712 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f575c06b1a0 0x7f575c06d660 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:00.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.349+0000 7f577ecc3700 1 --2- 172.21.15.2:0/2534290712 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5778145650 0x7f577806ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:00.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.349+0000 7f577ecc3700 1 --2- 172.21.15.2:0/2534290712 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5778144c10 0x7f57781f4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:00.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.349+0000 7f577ecc3700 1 --2- 172.21.15.2:0/2534290712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5778145100 0x7f577806e6b0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:00.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.349+0000 7f577ecc3700 1 -- 172.21.15.2:0/2534290712 >> 172.21.15.2:0/2534290712 conn(0x7f57780b2740 msgr2=0x7f57780b12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:00.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.349+0000 7f577ecc3700 1 -- 172.21.15.2:0/2534290712 shutdown_connections 2023-11-26T07:14:00.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.349+0000 7f577ecc3700 1 -- 172.21.15.2:0/2534290712 wait complete. 2023-11-26T07:14:00.363 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-26T07:14:00.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.486+0000 7f5dd98cd700 1 Processor -- start 2023-11-26T07:14:00.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.486+0000 7f5dd98cd700 1 -- start start 2023-11-26T07:14:00.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.487+0000 7f5dd98cd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5dd406edc0 0x7f5dd40b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:00.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.487+0000 7f5dd98cd700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dd40ad860 con 0x7f5dd4071b40 2023-11-26T07:14:00.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.487+0000 7f5dd98cd700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dd40d0a20 con 0x7f5dd406afd0 2023-11-26T07:14:00.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.487+0000 7f5dd98cd700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dd406f830 con 0x7f5dd406edc0 2023-11-26T07:14:00.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.487+0000 7f5dd37fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f5dd4071b40 0x7f5dd4071ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33302/0 (socket says 172.21.15.2:33302) 2023-11-26T07:14:00.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.487+0000 7f5dd37fe700 1 -- 172.21.15.2:0/652636189 learned_addr learned my addr 172.21.15.2:0/652636189 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:14:00.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.488+0000 7f5dd27fc700 1 --2- 172.21.15.2:0/652636189 >> v2:172.21.15.192:3300/0 conn(0x7f5dd406edc0 0x7f5dd40b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:00.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.488+0000 7f5dd1ffb700 1 -- 172.21.15.2:0/652636189 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 838168595 0 0) 0x7f5dd40ad860 con 0x7f5dd4071b40 2023-11-26T07:14:00.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.488+0000 7f5dd1ffb700 1 -- 172.21.15.2:0/652636189 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dbc0035b0 con 0x7f5dd4071b40 2023-11-26T07:14:00.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.488+0000 7f5dd27fc700 1 -- 172.21.15.2:0/652636189 >> v1:172.21.15.192:6789/0 conn(0x7f5dd406afd0 legacy=0x7f5dd406b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:00.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.488+0000 7f5dd1ffb700 1 -- 172.21.15.2:0/652636189 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4152571066 0 0) 0x7f5dbc0035b0 con 0x7f5dd4071b40 2023-11-26T07:14:00.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.488+0000 7f5dd27fc700 1 -- 172.21.15.2:0/652636189 >> v1:172.21.15.2:6789/0 conn(0x7f5dd4071b40 legacy=0x7f5dd4071ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:00.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.488+0000 7f5dd27fc700 1 -- 172.21.15.2:0/652636189 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd4162a70 con 0x7f5dd406edc0 2023-11-26T07:14:00.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.488+0000 7f5dd27fc700 1 --2- 172.21.15.2:0/652636189 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5dd406edc0 0x7f5dd40b5a70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8009840 tx=0x7f5dc8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af11c959b52fc123 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:00.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.488+0000 7f5dd1ffb700 1 -- 172.21.15.2:0/652636189 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc0019f0 con 0x7f5dd406edc0 2023-11-26T07:14:00.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.488+0000 7f5dd1ffb700 1 -- 172.21.15.2:0/652636189 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dc8004030 con 0x7f5dd406edc0 2023-11-26T07:14:00.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.488+0000 7f5dd1ffb700 1 -- 172.21.15.2:0/652636189 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc80043c0 con 0x7f5dd406edc0 2023-11-26T07:14:00.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.489+0000 7f5dd98cd700 1 -- 172.21.15.2:0/652636189 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5dd406edc0 msgr2=0x7f5dd40b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:00.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.489+0000 7f5dd98cd700 1 --2- 172.21.15.2:0/652636189 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5dd406edc0 0x7f5dd40b5a70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8009840 tx=0x7f5dc8009b50 comp rx=0 tx=0).stop 2023-11-26T07:14:00.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.489+0000 7f5dd98cd700 1 -- 172.21.15.2:0/652636189 shutdown_connections 2023-11-26T07:14:00.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.489+0000 7f5dd98cd700 1 --2- 172.21.15.2:0/652636189 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5dd406edc0 0x7f5dd40b5a70 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:00.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.489+0000 7f5dd98cd700 1 -- 172.21.15.2:0/652636189 >> 172.21.15.2:0/652636189 conn(0x7f5dd40b2840 msgr2=0x7f5dd40b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:00.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.489+0000 7f5dd98cd700 1 -- 172.21.15.2:0/652636189 shutdown_connections 2023-11-26T07:14:00.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.489+0000 7f5dd98cd700 1 -- 172.21.15.2:0/652636189 wait complete. 2023-11-26T07:14:00.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.491+0000 7f5dd98cd700 1 Processor -- start 2023-11-26T07:14:00.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.491+0000 7f5dd98cd700 1 -- start start 2023-11-26T07:14:00.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.492+0000 7f5dd98cd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5dd406afd0 0x7f5dd40c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:00.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.492+0000 7f5dd98cd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dd406edc0 0x7f5dd4159d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:00.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.492+0000 7f5dd98cd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5dd4071b40 0x7f5dd41f71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:00.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.492+0000 7f5dd98cd700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd4147050 con 0x7f5dd406edc0 2023-11-26T07:14:00.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.492+0000 7f5dd98cd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd415a2b0 con 0x7f5dd4071b40 2023-11-26T07:14:00.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.492+0000 7f5dd98cd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd415a560 con 0x7f5dd406afd0 2023-11-26T07:14:00.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.492+0000 7f5dd27fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dd406edc0 0x7f5dd4159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:00.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.492+0000 7f5dd27fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dd406edc0 0x7f5dd4159d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42096/0 (socket says 172.21.15.2:42096) 2023-11-26T07:14:00.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.492+0000 7f5dd27fc700 1 -- 172.21.15.2:0/664496682 learned_addr learned my addr 172.21.15.2:0/664496682 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:00.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.492+0000 7f5dd2ffd700 1 --2- 172.21.15.2:0/664496682 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5dd406afd0 0x7f5dd40c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:00.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.492+0000 7f5dd37fe700 1 --2- 172.21.15.2:0/664496682 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5dd4071b40 0x7f5dd41f71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:00.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.492+0000 7f5dd27fc700 1 -- 172.21.15.2:0/664496682 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5dd406afd0 msgr2=0x7f5dd40c5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:00.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.492+0000 7f5dd27fc700 1 --2- 172.21.15.2:0/664496682 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5dd406afd0 0x7f5dd40c5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:00.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.492+0000 7f5dd27fc700 1 -- 172.21.15.2:0/664496682 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5dd4071b40 msgr2=0x7f5dd41f71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:00.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.492+0000 7f5dd27fc700 1 --2- 172.21.15.2:0/664496682 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5dd4071b40 0x7f5dd41f71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:00.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.492+0000 7f5dd27fc700 1 -- 172.21.15.2:0/664496682 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc80094a0 con 0x7f5dd406edc0 2023-11-26T07:14:00.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.492+0000 7f5dd27fc700 1 --2- 172.21.15.2:0/664496682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dd406edc0 0x7f5dd4159d70 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f5dc800a010 tx=0x7f5dc8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:00.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.493+0000 7f5dbbfff700 1 -- 172.21.15.2:0/664496682 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc8003ea0 con 0x7f5dd406edc0 2023-11-26T07:14:00.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.493+0000 7f5dbbfff700 1 -- 172.21.15.2:0/664496682 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dc801f070 con 0x7f5dd406edc0 2023-11-26T07:14:00.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.493+0000 7f5dd98cd700 1 -- 172.21.15.2:0/664496682 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dd415a840 con 0x7f5dd406edc0 2023-11-26T07:14:00.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.493+0000 7f5dbbfff700 1 -- 172.21.15.2:0/664496682 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc8011850 con 0x7f5dd406edc0 2023-11-26T07:14:00.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.493+0000 7f5dd98cd700 1 -- 172.21.15.2:0/664496682 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dd415ae00 con 0x7f5dd406edc0 2023-11-26T07:14:00.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.494+0000 7f5dd98cd700 1 -- 172.21.15.2:0/664496682 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dd4147330 con 0x7f5dd406edc0 2023-11-26T07:14:00.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.494+0000 7f5dbbfff700 1 -- 172.21.15.2:0/664496682 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f5dc80119b0 con 0x7f5dd406edc0 2023-11-26T07:14:00.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.494+0000 7f5dbbfff700 1 --2- 172.21.15.2:0/664496682 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5dc006b1a0 0x7f5dc006d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:00.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.495+0000 7f5dbbfff700 1 -- 172.21.15.2:0/664496682 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5dc8021070 con 0x7f5dd406edc0 2023-11-26T07:14:00.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.495+0000 7f5dd2ffd700 1 --2- 172.21.15.2:0/664496682 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5dc006b1a0 0x7f5dc006d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:00.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.495+0000 7f5dd2ffd700 1 --2- 172.21.15.2:0/664496682 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5dc006b1a0 0x7f5dc006d660 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4007fd0 tx=0x7f5dc4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:00.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.499+0000 7f5dbbfff700 1 -- 172.21.15.2:0/664496682 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5dc8056040 con 0x7f5dd406edc0 2023-11-26T07:14:00.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.745+0000 7f5dd98cd700 1 -- 172.21.15.2:0/664496682 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5dd4068670 con 0x7f5dd406edc0 2023-11-26T07:14:00.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.746+0000 7f5dbbfff700 1 -- 172.21.15.2:0/664496682 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5dc8059660 con 0x7f5dd406edc0 2023-11-26T07:14:00.747 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-26T07:14:00.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.747+0000 7f5dd98cd700 1 -- 172.21.15.2:0/664496682 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5dc006b1a0 msgr2=0x7f5dc006d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:00.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.747+0000 7f5dd98cd700 1 --2- 172.21.15.2:0/664496682 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5dc006b1a0 0x7f5dc006d660 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4007fd0 tx=0x7f5dc4009040 comp rx=0 tx=0).stop 2023-11-26T07:14:00.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.748+0000 7f5dd98cd700 1 -- 172.21.15.2:0/664496682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dd406edc0 msgr2=0x7f5dd4159d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:00.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.748+0000 7f5dd98cd700 1 --2- 172.21.15.2:0/664496682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dd406edc0 0x7f5dd4159d70 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f5dc800a010 tx=0x7f5dc8004750 comp rx=0 tx=0).stop 2023-11-26T07:14:00.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.748+0000 7f5dd98cd700 1 -- 172.21.15.2:0/664496682 shutdown_connections 2023-11-26T07:14:00.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.748+0000 7f5dd98cd700 1 --2- 172.21.15.2:0/664496682 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5dc006b1a0 0x7f5dc006d660 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:00.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.748+0000 7f5dd98cd700 1 --2- 172.21.15.2:0/664496682 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5dd4071b40 0x7f5dd41f71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:00.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.748+0000 7f5dd98cd700 1 --2- 172.21.15.2:0/664496682 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5dd406afd0 0x7f5dd40c5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:00.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.748+0000 7f5dd98cd700 1 --2- 172.21.15.2:0/664496682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dd406edc0 0x7f5dd4159d70 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:00.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.748+0000 7f5dd98cd700 1 -- 172.21.15.2:0/664496682 >> 172.21.15.2:0/664496682 conn(0x7f5dd40b2840 msgr2=0x7f5dd406b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:00.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.748+0000 7f5dd98cd700 1 -- 172.21.15.2:0/664496682 shutdown_connections 2023-11-26T07:14:00.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:00.748+0000 7f5dd98cd700 1 -- 172.21.15.2:0/664496682 wait complete. 2023-11-26T07:14:00.762 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-26T07:14:00.762 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-26T07:14:00.762 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2023-11-26T07:14:00.762 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-26T07:14:00.762 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-26T07:14:00.762 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-26T07:14:00.762 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-26T07:14:00.762 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-26T07:14:00.762 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-26T07:14:00.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:00.763 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2023-11-26T07:14:00.780 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:14:00.780 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:14:00.780 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:14:00.780 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:14:00.780 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2023-11-26T07:14:00.780 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:14:00.781 INFO:teuthology.orchestra.run.smithi002.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:14:00.781 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:14:00.781 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:14:00.781 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:14:00.781 INFO:teuthology.orchestra.run.smithi002.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-26T07:14:00.781 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:14:00.781 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-26T07:14:00.781 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 42183sec preferred_lft 42183sec 2023-11-26T07:14:00.781 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link 2023-11-26T07:14:00.781 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:14:00.781 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:14:00.781 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:14:00.781 INFO:teuthology.orchestra.run.smithi002.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-26T07:14:00.782 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0a:57:c2:51:2c:98 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:14:00.782 INFO:teuthology.orchestra.run.smithi002.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-26T07:14:00.782 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:14:00.782 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::60ae:c7ff:fe6a:97cb/64 scope link 2023-11-26T07:14:00.782 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:14:00.782 INFO:teuthology.orchestra.run.smithi002.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:14:00.782 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0a:57:c2:51:2c:98 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:14:00.782 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::857:c2ff:fe51:2c98/64 scope link 2023-11-26T07:14:00.782 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:14:00.782 INFO:teuthology.orchestra.run.smithi002.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:14:00.782 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether a2:e0:b8:ef:39:07 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-26T07:14:00.782 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::a0e0:b8ff:feef:3907/64 scope link 2023-11-26T07:14:00.783 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:14:00.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:00.783 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-26T07:14:00.846 INFO:teuthology.orchestra.run.smithi002.stdout:1 2023-11-26T07:14:00.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:00.848 DEBUG:teuthology.orchestra.run.smithi002:> route 2023-11-26T07:14:00.906 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2023-11-26T07:14:00.906 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-26T07:14:00.907 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-26T07:14:00.907 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-26T07:14:00.907 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-26T07:14:00.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:00.907 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-11-26T07:14:00.907 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-11-26T07:14:00.908 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-26T07:14:00.908 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-26T07:14:00.908 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-26T07:14:00.908 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-11-26T07:14:01.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:01.013 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2023-11-26T07:14:01.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-26T07:14:01.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-26T07:14:01.031 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-26T07:14:01.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:01.031 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 up 2023-11-26T07:14:01.098 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:14:01.098 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-26T07:14:01.154 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-26T07:14:01.155 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:14:01.155 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-26T07:14:01.211 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-26T07:14:01.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:01.211 DEBUG:teuthology.orchestra.run.smithi002:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-26T07:14:01.298 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-26T07:14:01.299 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-26T07:14:01.299 INFO:teuthology.orchestra.run.smithi002.stdout:invalid new device string format 2023-11-26T07:14:01.308 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-26T07:14:01.308 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-26T07:14:01.308 INFO:teuthology.orchestra.run.smithi002.stdout:invalid new device string format 2023-11-26T07:14:01.308 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-11-26T07:14:01.308 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:14:01.338 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-26T07:14:01.338 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-26T07:14:01.339 INFO:teuthology.orchestra.run.smithi002.stdout:invalid new device string format 2023-11-26T07:14:01.339 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-11-26T07:14:01.339 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:14:01.339 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: resolved to: "172.21.15.2:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-11-26T07:14:01.339 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.2:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-11-26T07:14:01.339 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=cb9817c7-f1ed-4745-9395-2760a3bb9712" will pass to kernel 2023-11-26T07:14:01.342 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-26T07:14:01.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:01.343 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-26T07:14:01.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:01.384 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-26T07:14:01.473 INFO:teuthology.orchestra.run.smithi002.stdout:client5790 2023-11-26T07:14:01.473 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:01.474 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:01.491 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-26T07:14:01.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.654+0000 7f450fbae700 1 Processor -- start 2023-11-26T07:14:01.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.654+0000 7f450fbae700 1 -- start start 2023-11-26T07:14:01.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.655+0000 7f450fbae700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f45080724a0 0x7f45081658c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:01.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.655+0000 7f450fbae700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f450806e550 con 0x7f45080b4f20 2023-11-26T07:14:01.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.655+0000 7f450fbae700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f450806f3b0 con 0x7f450815abb0 2023-11-26T07:14:01.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.655+0000 7f450fbae700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f450806e7a0 con 0x7f45080724a0 2023-11-26T07:14:01.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.655+0000 7f450d149700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f45080b4f20 0x7f4508071d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33318/0 (socket says 172.21.15.2:33318) 2023-11-26T07:14:01.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.655+0000 7f450d149700 1 -- 172.21.15.2:0/1342551620 learned_addr learned my addr 172.21.15.2:0/1342551620 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:14:01.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.655+0000 7f450e14b700 1 --2- 172.21.15.2:0/1342551620 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f45080724a0 0x7f45081658c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:01.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.655+0000 7f450c948700 1 -- 172.21.15.2:0/1342551620 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4193610603 0 0) 0x7f450806e550 con 0x7f45080b4f20 2023-11-26T07:14:01.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.656+0000 7f450c948700 1 -- 172.21.15.2:0/1342551620 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44f40035b0 con 0x7f45080b4f20 2023-11-26T07:14:01.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.656+0000 7f450c948700 1 -- 172.21.15.2:0/1342551620 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2141432048 0 0) 0x7f44f40035b0 con 0x7f45080b4f20 2023-11-26T07:14:01.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.656+0000 7f450c948700 1 -- 172.21.15.2:0/1342551620 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f45080724a0 msgr2=0x7f45081658c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:01.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.656+0000 7f450c948700 1 --2- 172.21.15.2:0/1342551620 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f45080724a0 0x7f45081658c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:01.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.656+0000 7f450c948700 1 -- 172.21.15.2:0/1342551620 >> v1:172.21.15.192:6789/0 conn(0x7f450815abb0 legacy=0x7f45080b4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:01.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.656+0000 7f450c948700 1 -- 172.21.15.2:0/1342551620 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f450806ea80 con 0x7f45080b4f20 2023-11-26T07:14:01.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.656+0000 7f450c948700 1 -- 172.21.15.2:0/1342551620 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f4504001670 con 0x7f45080b4f20 2023-11-26T07:14:01.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.656+0000 7f450c948700 1 -- 172.21.15.2:0/1342551620 >> v1:172.21.15.2:6789/0 conn(0x7f45080b4f20 legacy=0x7f4508071d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:01.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.656+0000 7f450c948700 1 --2- 172.21.15.2:0/1342551620 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f45080724a0 0x7f44f4003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:01.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.656+0000 7f450c948700 1 --2- 172.21.15.2:0/1342551620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44f4003fb0 0x7f44f4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:01.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.656+0000 7f450c948700 1 --2- 172.21.15.2:0/1342551620 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44f4004d90 0x7f44f4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:01.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.656+0000 7f450c948700 1 -- 172.21.15.2:0/1342551620 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450806e7a0 con 0x7f44f4003fb0 2023-11-26T07:14:01.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.656+0000 7f450c948700 1 -- 172.21.15.2:0/1342551620 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f400baf0 con 0x7f44f4004d90 2023-11-26T07:14:01.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.656+0000 7f450c948700 1 -- 172.21.15.2:0/1342551620 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44f400bcb0 con 0x7f45080724a0 2023-11-26T07:14:01.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.656+0000 7f450d149700 1 --2- 172.21.15.2:0/1342551620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44f4003fb0 0x7f44f4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:01.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.656+0000 7f450d94a700 1 --2- 172.21.15.2:0/1342551620 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f45080724a0 0x7f44f4003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:01.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.656+0000 7f450e14b700 1 --2- 172.21.15.2:0/1342551620 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44f4004d90 0x7f44f4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:01.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.656+0000 7f450d149700 1 -- 172.21.15.2:0/1342551620 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f45080724a0 msgr2=0x7f44f4003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:01.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.656+0000 7f450d149700 1 --2- 172.21.15.2:0/1342551620 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f45080724a0 0x7f44f4003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:01.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.656+0000 7f450d149700 1 -- 172.21.15.2:0/1342551620 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44f4004d90 msgr2=0x7f44f4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:01.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.656+0000 7f450d149700 1 --2- 172.21.15.2:0/1342551620 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44f4004d90 0x7f44f4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:01.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.656+0000 7f450d149700 1 -- 172.21.15.2:0/1342551620 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f40035b0 con 0x7f44f4003fb0 2023-11-26T07:14:01.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.656+0000 7f450e14b700 1 --2- 172.21.15.2:0/1342551620 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44f4004d90 0x7f44f4005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:14:01.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.656+0000 7f450d149700 1 --2- 172.21.15.2:0/1342551620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44f4003fb0 0x7f44f4004850 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f4504007d30 tx=0x7f44f4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a4c70521794c71b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:01.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.657+0000 7f450c948700 1 -- 172.21.15.2:0/1342551620 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450400cdb0 con 0x7f44f4003fb0 2023-11-26T07:14:01.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.657+0000 7f450c948700 1 -- 172.21.15.2:0/1342551620 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4504005960 con 0x7f44f4003fb0 2023-11-26T07:14:01.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.657+0000 7f450c948700 1 -- 172.21.15.2:0/1342551620 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4504005d10 con 0x7f44f4003fb0 2023-11-26T07:14:01.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.657+0000 7f450fbae700 1 -- 172.21.15.2:0/1342551620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44f4003fb0 msgr2=0x7f44f4004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:01.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.657+0000 7f450fbae700 1 --2- 172.21.15.2:0/1342551620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44f4003fb0 0x7f44f4004850 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f4504007d30 tx=0x7f44f4005880 comp rx=0 tx=0).stop 2023-11-26T07:14:01.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.657+0000 7f450e14b700 1 -- 172.21.15.2:0/1342551620 reap_dead start 2023-11-26T07:14:01.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.657+0000 7f450fbae700 1 -- 172.21.15.2:0/1342551620 shutdown_connections 2023-11-26T07:14:01.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.657+0000 7f450fbae700 1 -- 172.21.15.2:0/1342551620 >> 172.21.15.2:0/1342551620 conn(0x7f45080d0aa0 msgr2=0x7f45080d0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:01.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.657+0000 7f450fbae700 1 -- 172.21.15.2:0/1342551620 shutdown_connections 2023-11-26T07:14:01.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.657+0000 7f450fbae700 1 -- 172.21.15.2:0/1342551620 wait complete. 2023-11-26T07:14:01.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.659+0000 7f450fbae700 1 Processor -- start 2023-11-26T07:14:01.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.659+0000 7f450fbae700 1 -- start start 2023-11-26T07:14:01.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.659+0000 7f450fbae700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44f4003fb0 0x7f450814d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:01.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.659+0000 7f450fbae700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f450814a890 0x7f450814bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:01.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.659+0000 7f450fbae700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45080afb20 0x7f450815b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:01.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.659+0000 7f450fbae700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45080aea80 con 0x7f45080afb20 2023-11-26T07:14:01.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.659+0000 7f450fbae700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45080aed60 con 0x7f44f4003fb0 2023-11-26T07:14:01.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.659+0000 7f450fbae700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45080af040 con 0x7f450814a890 2023-11-26T07:14:01.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.659+0000 7f450e14b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45080afb20 0x7f450815b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:01.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.659+0000 7f450e14b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45080afb20 0x7f450815b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42122/0 (socket says 172.21.15.2:42122) 2023-11-26T07:14:01.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.659+0000 7f450e14b700 1 -- 172.21.15.2:0/4042322663 learned_addr learned my addr 172.21.15.2:0/4042322663 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:01.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.660+0000 7f450d149700 1 --2- 172.21.15.2:0/4042322663 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f450814a890 0x7f450814bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:01.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.660+0000 7f450d94a700 1 --2- 172.21.15.2:0/4042322663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44f4003fb0 0x7f450814d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:01.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.660+0000 7f450e14b700 1 -- 172.21.15.2:0/4042322663 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f450814a890 msgr2=0x7f450814bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:01.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.660+0000 7f450e14b700 1 --2- 172.21.15.2:0/4042322663 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f450814a890 0x7f450814bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:01.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.660+0000 7f450e14b700 1 -- 172.21.15.2:0/4042322663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44f4003fb0 msgr2=0x7f450814d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:01.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.660+0000 7f450e14b700 1 --2- 172.21.15.2:0/4042322663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44f4003fb0 0x7f450814d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:01.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.660+0000 7f450e14b700 1 -- 172.21.15.2:0/4042322663 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45080af320 con 0x7f45080afb20 2023-11-26T07:14:01.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.660+0000 7f450e14b700 1 --2- 172.21.15.2:0/4042322663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45080afb20 0x7f450815b170 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f4508072f80 tx=0x7f45000104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:01.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.660+0000 7f44fe7fc700 1 -- 172.21.15.2:0/4042322663 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450001b070 con 0x7f45080afb20 2023-11-26T07:14:01.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.660+0000 7f44fe7fc700 1 -- 172.21.15.2:0/4042322663 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450000f040 con 0x7f45080afb20 2023-11-26T07:14:01.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.660+0000 7f450fbae700 1 -- 172.21.15.2:0/4042322663 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45080af600 con 0x7f45080afb20 2023-11-26T07:14:01.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.660+0000 7f44fe7fc700 1 -- 172.21.15.2:0/4042322663 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450000e050 con 0x7f45080afb20 2023-11-26T07:14:01.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.660+0000 7f450fbae700 1 -- 172.21.15.2:0/4042322663 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f450814c260 con 0x7f45080afb20 2023-11-26T07:14:01.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.661+0000 7f450fbae700 1 -- 172.21.15.2:0/4042322663 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4508068670 con 0x7f45080afb20 2023-11-26T07:14:01.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.662+0000 7f44fe7fc700 1 -- 172.21.15.2:0/4042322663 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f4500003a20 con 0x7f45080afb20 2023-11-26T07:14:01.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.663+0000 7f44fe7fc700 1 --2- 172.21.15.2:0/4042322663 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f44ec06b1d0 0x7f44ec06d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:01.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.663+0000 7f44fe7fc700 1 -- 172.21.15.2:0/4042322663 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f450008a840 con 0x7f45080afb20 2023-11-26T07:14:01.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.663+0000 7f450d94a700 1 --2- 172.21.15.2:0/4042322663 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f44ec06b1d0 0x7f44ec06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:01.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.664+0000 7f450d94a700 1 --2- 172.21.15.2:0/4042322663 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f44ec06b1d0 0x7f44ec06d690 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f44f8007fd0 tx=0x7f44f8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:01.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.667+0000 7f44fe7fc700 1 -- 172.21.15.2:0/4042322663 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4500055620 con 0x7f45080afb20 2023-11-26T07:14:01.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.917+0000 7f450fbae700 1 -- 172.21.15.2:0/4042322663 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f45080af970 con 0x7f45080afb20 2023-11-26T07:14:01.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.917+0000 7f44fe7fc700 1 -- 172.21.15.2:0/4042322663 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7f450005f030 con 0x7f45080afb20 2023-11-26T07:14:01.919 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-26T07:14:01.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.919+0000 7f450fbae700 1 -- 172.21.15.2:0/4042322663 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f44ec06b1d0 msgr2=0x7f44ec06d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:01.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.919+0000 7f450fbae700 1 --2- 172.21.15.2:0/4042322663 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f44ec06b1d0 0x7f44ec06d690 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f44f8007fd0 tx=0x7f44f8009040 comp rx=0 tx=0).stop 2023-11-26T07:14:01.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.919+0000 7f450fbae700 1 -- 172.21.15.2:0/4042322663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45080afb20 msgr2=0x7f450815b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:01.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.919+0000 7f450fbae700 1 --2- 172.21.15.2:0/4042322663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45080afb20 0x7f450815b170 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f4508072f80 tx=0x7f45000104a0 comp rx=0 tx=0).stop 2023-11-26T07:14:01.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.919+0000 7f450fbae700 1 -- 172.21.15.2:0/4042322663 shutdown_connections 2023-11-26T07:14:01.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.919+0000 7f450fbae700 1 --2- 172.21.15.2:0/4042322663 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f44ec06b1d0 0x7f44ec06d690 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:01.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.919+0000 7f450fbae700 1 --2- 172.21.15.2:0/4042322663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45080afb20 0x7f450815b170 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:01.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.919+0000 7f450fbae700 1 --2- 172.21.15.2:0/4042322663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44f4003fb0 0x7f450814d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:01.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.919+0000 7f450fbae700 1 --2- 172.21.15.2:0/4042322663 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f450814a890 0x7f450814bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:01.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.919+0000 7f450fbae700 1 -- 172.21.15.2:0/4042322663 >> 172.21.15.2:0/4042322663 conn(0x7f45080d0aa0 msgr2=0x7f450806b180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:01.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.919+0000 7f450fbae700 1 -- 172.21.15.2:0/4042322663 shutdown_connections 2023-11-26T07:14:01.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:01.919+0000 7f450fbae700 1 -- 172.21.15.2:0/4042322663 wait complete. 2023-11-26T07:14:01.933 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-26T07:14:01.933 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-26T07:14:01.933 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2023-11-26T07:14:01.933 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-26T07:14:01.933 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-26T07:14:01.933 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-26T07:14:01.933 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-26T07:14:01.933 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-26T07:14:01.933 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-26T07:14:01.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:01.934 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2023-11-26T07:14:01.955 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:14:01.955 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:14:01.955 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:14:01.955 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:14:01.956 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2023-11-26T07:14:01.956 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:14:01.956 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:14:01.956 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2023-11-26T07:14:01.956 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:14:01.956 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2023-11-26T07:14:01.956 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:14:01.956 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:14:01.956 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-26T07:14:01.956 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:14:01.956 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-26T07:14:01.957 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42259sec preferred_lft 42259sec 2023-11-26T07:14:01.957 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::4774:e26a:42bc:5f29/64 scope link noprefixroute 2023-11-26T07:14:01.957 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:14:01.957 INFO:teuthology.orchestra.run.smithi192.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-26T07:14:01.957 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 8a:29:a0:eb:3c:15 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:14:01.957 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-26T07:14:01.957 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:14:01.957 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::548b:6dff:fe7a:f7ca/64 scope link 2023-11-26T07:14:01.957 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:14:01.957 INFO:teuthology.orchestra.run.smithi192.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:14:01.957 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether a2:92:2e:43:f5:72 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:14:01.957 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::a092:2eff:fe43:f572/64 scope link 2023-11-26T07:14:01.958 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:14:01.958 INFO:teuthology.orchestra.run.smithi192.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:14:01.958 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 8a:29:a0:eb:3c:15 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-26T07:14:01.958 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::8829:a0ff:feeb:3c15/64 scope link 2023-11-26T07:14:01.958 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:14:01.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:01.958 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-26T07:14:02.025 INFO:teuthology.orchestra.run.smithi192.stdout:1 2023-11-26T07:14:02.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:02.027 DEBUG:teuthology.orchestra.run.smithi192:> route 2023-11-26T07:14:02.088 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2023-11-26T07:14:02.088 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-26T07:14:02.088 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-26T07:14:02.088 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-26T07:14:02.088 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-26T07:14:02.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:02.089 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-11-26T07:14:02.089 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-11-26T07:14:02.089 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-26T07:14:02.089 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-26T07:14:02.089 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-26T07:14:02.089 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-11-26T07:14:02.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:02.199 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2023-11-26T07:14:02.216 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-26T07:14:02.216 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-26T07:14:02.216 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-26T07:14:02.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:02.217 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2023-11-26T07:14:02.283 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:14:02.283 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-26T07:14:02.340 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-26T07:14:02.341 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:14:02.341 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-26T07:14:02.396 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-26T07:14:02.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:02.397 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-26T07:14:02.481 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-26T07:14:02.481 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-26T07:14:02.482 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2023-11-26T07:14:02.490 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-26T07:14:02.490 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-26T07:14:02.491 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2023-11-26T07:14:02.491 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-11-26T07:14:02.491 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:14:02.522 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-26T07:14:02.523 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-26T07:14:02.523 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2023-11-26T07:14:02.523 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-11-26T07:14:02.523 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:14:02.523 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.2:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-11-26T07:14:02.523 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.2:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-11-26T07:14:02.523 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=cb9817c7-f1ed-4745-9395-2760a3bb9712" will pass to kernel 2023-11-26T07:14:02.526 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-26T07:14:02.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:02.526 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-26T07:14:02.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:02.559 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-26T07:14:02.631 INFO:teuthology.orchestra.run.smithi192.stdout:client5503 2023-11-26T07:14:02.631 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:14:02.632 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:02.688 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-11-26T07:14:02.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.829+0000 7ff8d002a700 1 Processor -- start 2023-11-26T07:14:02.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.829+0000 7ff8d002a700 1 -- start start 2023-11-26T07:14:02.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.830+0000 7ff8d002a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff8c80b59d0 0x7ff8c815e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:02.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.830+0000 7ff8d002a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff8c8072350 0x7ff8c8072780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:02.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.830+0000 7ff8d002a700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8c8071ec0 con 0x7ff8c806afd0 2023-11-26T07:14:02.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.830+0000 7ff8d002a700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8c8071b90 con 0x7ff8c80b59d0 2023-11-26T07:14:02.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.830+0000 7ff8d002a700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8c815ed30 con 0x7ff8c8072350 2023-11-26T07:14:02.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.830+0000 7ff8cd5c5700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff8c80b59d0 0x7ff8c815e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:02.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.830+0000 7ff8cd5c5700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff8c80b59d0 0x7ff8c815e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42130/0 (socket says 172.21.15.2:42130) 2023-11-26T07:14:02.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.830+0000 7ff8cd5c5700 1 -- 172.21.15.2:0/12547508 learned_addr learned my addr 172.21.15.2:0/12547508 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:02.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.830+0000 7ff8ce5c7700 1 --2- 172.21.15.2:0/12547508 >> v2:172.21.15.192:3300/0 conn(0x7ff8c8072350 0x7ff8c8072780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:02.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.831+0000 7ff8cd5c5700 1 -- 172.21.15.2:0/12547508 >> v2:172.21.15.192:3300/0 conn(0x7ff8c8072350 msgr2=0x7ff8c8072780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:02.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.831+0000 7ff8cd5c5700 1 --2- 172.21.15.2:0/12547508 >> v2:172.21.15.192:3300/0 conn(0x7ff8c8072350 0x7ff8c8072780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:02.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.831+0000 7ff8cd5c5700 1 -- 172.21.15.2:0/12547508 >> v1:172.21.15.192:6789/0 conn(0x7ff8c806afd0 legacy=0x7ff8c806b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:02.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.831+0000 7ff8cd5c5700 1 -- 172.21.15.2:0/12547508 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c815f010 con 0x7ff8c80b59d0 2023-11-26T07:14:02.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.831+0000 7ff8cd5c5700 1 --2- 172.21.15.2:0/12547508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8c80b59d0 0x7ff8c815e470 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7ff8c81619a0 tx=0x7ff8c4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db640a229c1e48a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:02.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.831+0000 7ff8ccdc4700 1 -- 172.21.15.2:0/12547508 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c4011830 con 0x7ff8c80b59d0 2023-11-26T07:14:02.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.831+0000 7ff8ccdc4700 1 -- 172.21.15.2:0/12547508 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c4011990 con 0x7ff8c80b59d0 2023-11-26T07:14:02.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.831+0000 7ff8ccdc4700 1 -- 172.21.15.2:0/12547508 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c4011d20 con 0x7ff8c80b59d0 2023-11-26T07:14:02.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.832+0000 7ff8d002a700 1 -- 172.21.15.2:0/12547508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8c80b59d0 msgr2=0x7ff8c815e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:02.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.832+0000 7ff8d002a700 1 --2- 172.21.15.2:0/12547508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8c80b59d0 0x7ff8c815e470 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7ff8c81619a0 tx=0x7ff8c4009bd0 comp rx=0 tx=0).stop 2023-11-26T07:14:02.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.832+0000 7ff8d002a700 1 -- 172.21.15.2:0/12547508 shutdown_connections 2023-11-26T07:14:02.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.832+0000 7ff8d002a700 1 --2- 172.21.15.2:0/12547508 >> v2:172.21.15.192:3300/0 conn(0x7ff8c8072350 0x7ff8c8072780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:02.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.832+0000 7ff8d002a700 1 --2- 172.21.15.2:0/12547508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8c80b59d0 0x7ff8c815e470 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:02.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.832+0000 7ff8d002a700 1 -- 172.21.15.2:0/12547508 >> 172.21.15.2:0/12547508 conn(0x7ff8c80b2760 msgr2=0x7ff8c80b2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:02.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.832+0000 7ff8d002a700 1 -- 172.21.15.2:0/12547508 shutdown_connections 2023-11-26T07:14:02.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.832+0000 7ff8d002a700 1 -- 172.21.15.2:0/12547508 wait complete. 2023-11-26T07:14:02.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.833+0000 7ff8d002a700 1 Processor -- start 2023-11-26T07:14:02.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.833+0000 7ff8d002a700 1 -- start start 2023-11-26T07:14:02.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.834+0000 7ff8d002a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8c806afd0 0x7ff8c815d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:02.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.834+0000 7ff8d002a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8c8072350 0x7ff8c815f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:02.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.834+0000 7ff8d002a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8c80b59d0 0x7ff8c8160ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:02.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.834+0000 7ff8d002a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c8160770 con 0x7ff8c80b59d0 2023-11-26T07:14:02.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.834+0000 7ff8d002a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c813e160 con 0x7ff8c8072350 2023-11-26T07:14:02.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.834+0000 7ff8d002a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c815dc80 con 0x7ff8c806afd0 2023-11-26T07:14:02.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.834+0000 7ff8ce5c7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8c80b59d0 0x7ff8c8160ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:02.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.834+0000 7ff8ce5c7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8c80b59d0 0x7ff8c8160ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42134/0 (socket says 172.21.15.2:42134) 2023-11-26T07:14:02.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.834+0000 7ff8ce5c7700 1 -- 172.21.15.2:0/52907249 learned_addr learned my addr 172.21.15.2:0/52907249 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:02.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.834+0000 7ff8cd5c5700 1 --2- 172.21.15.2:0/52907249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8c8072350 0x7ff8c815f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:02.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.834+0000 7ff8cddc6700 1 --2- 172.21.15.2:0/52907249 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8c806afd0 0x7ff8c815d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:02.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.834+0000 7ff8ce5c7700 1 -- 172.21.15.2:0/52907249 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8c806afd0 msgr2=0x7ff8c815d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:02.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.834+0000 7ff8ce5c7700 1 --2- 172.21.15.2:0/52907249 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8c806afd0 0x7ff8c815d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:02.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.834+0000 7ff8ce5c7700 1 -- 172.21.15.2:0/52907249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8c8072350 msgr2=0x7ff8c815f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:02.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.834+0000 7ff8ce5c7700 1 --2- 172.21.15.2:0/52907249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8c8072350 0x7ff8c815f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:02.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.834+0000 7ff8ce5c7700 1 -- 172.21.15.2:0/52907249 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c4009550 con 0x7ff8c80b59d0 2023-11-26T07:14:02.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.834+0000 7ff8cddc6700 1 --2- 172.21.15.2:0/52907249 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8c806afd0 0x7ff8c815d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:14:02.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.834+0000 7ff8ce5c7700 1 --2- 172.21.15.2:0/52907249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8c80b59d0 0x7ff8c8160ad0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0009dd0 tx=0x7ff8c000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:02.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.835+0000 7ff8be7fc700 1 -- 172.21.15.2:0/52907249 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c000cd40 con 0x7ff8c80b59d0 2023-11-26T07:14:02.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.835+0000 7ff8be7fc700 1 -- 172.21.15.2:0/52907249 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c000f040 con 0x7ff8c80b59d0 2023-11-26T07:14:02.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.835+0000 7ff8d002a700 1 -- 172.21.15.2:0/52907249 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8c813de30 con 0x7ff8c80b59d0 2023-11-26T07:14:02.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.835+0000 7ff8be7fc700 1 -- 172.21.15.2:0/52907249 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c00146c0 con 0x7ff8c80b59d0 2023-11-26T07:14:02.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.835+0000 7ff8d002a700 1 -- 172.21.15.2:0/52907249 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8c81601b0 con 0x7ff8c80b59d0 2023-11-26T07:14:02.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.836+0000 7ff8d002a700 1 -- 172.21.15.2:0/52907249 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8c813e440 con 0x7ff8c80b59d0 2023-11-26T07:14:02.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.836+0000 7ff8be7fc700 1 -- 172.21.15.2:0/52907249 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7ff8c0014820 con 0x7ff8c80b59d0 2023-11-26T07:14:02.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.837+0000 7ff8be7fc700 1 --2- 172.21.15.2:0/52907249 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff8ac06b1a0 0x7ff8ac06d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:02.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.837+0000 7ff8be7fc700 1 -- 172.21.15.2:0/52907249 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff8c008a3d0 con 0x7ff8c80b59d0 2023-11-26T07:14:02.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.837+0000 7ff8cddc6700 1 --2- 172.21.15.2:0/52907249 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff8ac06b1a0 0x7ff8ac06d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:02.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.837+0000 7ff8cddc6700 1 --2- 172.21.15.2:0/52907249 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff8ac06b1a0 0x7ff8ac06d660 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8000f60 tx=0x7ff8b8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:02.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:02.841+0000 7ff8be7fc700 1 -- 172.21.15.2:0/52907249 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff8c00550b0 con 0x7ff8c80b59d0 2023-11-26T07:14:03.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.093+0000 7ff8d002a700 1 -- 172.21.15.2:0/52907249 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff8c80b5420 con 0x7ff8c80b59d0 2023-11-26T07:14:03.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.381+0000 7ff8be7fc700 1 -- 172.21.15.2:0/52907249 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v27) v1 ==== 136+0+0 (secure 0 0 0) 0x7ff8c000cea0 con 0x7ff8c80b59d0 2023-11-26T07:14:03.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.384+0000 7ff8d002a700 1 -- 172.21.15.2:0/52907249 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff8ac06b1a0 msgr2=0x7ff8ac06d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:03.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.384+0000 7ff8d002a700 1 --2- 172.21.15.2:0/52907249 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff8ac06b1a0 0x7ff8ac06d660 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8000f60 tx=0x7ff8b8009040 comp rx=0 tx=0).stop 2023-11-26T07:14:03.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.384+0000 7ff8d002a700 1 -- 172.21.15.2:0/52907249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8c80b59d0 msgr2=0x7ff8c8160ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:03.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.384+0000 7ff8d002a700 1 --2- 172.21.15.2:0/52907249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8c80b59d0 0x7ff8c8160ad0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0009dd0 tx=0x7ff8c000c3a0 comp rx=0 tx=0).stop 2023-11-26T07:14:03.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.384+0000 7ff8d002a700 1 -- 172.21.15.2:0/52907249 shutdown_connections 2023-11-26T07:14:03.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.384+0000 7ff8d002a700 1 --2- 172.21.15.2:0/52907249 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff8ac06b1a0 0x7ff8ac06d660 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:03.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.384+0000 7ff8d002a700 1 --2- 172.21.15.2:0/52907249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8c80b59d0 0x7ff8c8160ad0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:03.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.384+0000 7ff8d002a700 1 --2- 172.21.15.2:0/52907249 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8c806afd0 0x7ff8c815d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:03.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.384+0000 7ff8d002a700 1 --2- 172.21.15.2:0/52907249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8c8072350 0x7ff8c815f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:03.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.384+0000 7ff8d002a700 1 -- 172.21.15.2:0/52907249 >> 172.21.15.2:0/52907249 conn(0x7ff8c80b2760 msgr2=0x7ff8c806b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:03.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.384+0000 7ff8d002a700 1 -- 172.21.15.2:0/52907249 shutdown_connections 2023-11-26T07:14:03.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.384+0000 7ff8d002a700 1 -- 172.21.15.2:0/52907249 wait complete. 2023-11-26T07:14:03.399 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-26T07:14:03.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.524+0000 7f21dd35f700 1 Processor -- start 2023-11-26T07:14:03.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.524+0000 7f21dd35f700 1 -- start start 2023-11-26T07:14:03.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.525+0000 7f21dd35f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f21d80d49d0 0x7f21d80d2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:03.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.525+0000 7f21dd35f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f21d80d29d0 0x7f21d80b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:03.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.525+0000 7f21dd35f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21d80d4e50 con 0x7f21d815e460 2023-11-26T07:14:03.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.525+0000 7f21dd35f700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21d80d2e40 con 0x7f21d80d29d0 2023-11-26T07:14:03.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.525+0000 7f21dd35f700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21d80b3370 con 0x7f21d80d49d0 2023-11-26T07:14:03.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.525+0000 7f21d77fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f21d80d29d0 0x7f21d80b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:03.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.525+0000 7f21d77fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f21d80d29d0 0x7f21d80b40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42144/0 (socket says 172.21.15.2:42144) 2023-11-26T07:14:03.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.525+0000 7f21d77fe700 1 -- 172.21.15.2:0/1165917205 learned_addr learned my addr 172.21.15.2:0/1165917205 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:03.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.525+0000 7f21d67fc700 1 --2- 172.21.15.2:0/1165917205 >> v2:172.21.15.192:3300/0 conn(0x7f21d80d49d0 0x7f21d80d2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:03.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.525+0000 7f21d77fe700 1 -- 172.21.15.2:0/1165917205 >> v2:172.21.15.192:3300/0 conn(0x7f21d80d49d0 msgr2=0x7f21d80d2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:03.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.525+0000 7f21d77fe700 1 --2- 172.21.15.2:0/1165917205 >> v2:172.21.15.192:3300/0 conn(0x7f21d80d49d0 0x7f21d80d2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:03.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.525+0000 7f21d77fe700 1 -- 172.21.15.2:0/1165917205 >> v1:172.21.15.192:6789/0 conn(0x7f21d815e460 legacy=0x7f21d80cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:03.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.525+0000 7f21d77fe700 1 -- 172.21.15.2:0/1165917205 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d80cfc40 con 0x7f21d80d29d0 2023-11-26T07:14:03.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.526+0000 7f21d77fe700 1 --2- 172.21.15.2:0/1165917205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21d80d29d0 0x7f21d80b40a0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f21d808e2f0 tx=0x7f21d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba1b9722ea536535 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:03.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.526+0000 7f21d5ffb700 1 -- 172.21.15.2:0/1165917205 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d000e070 con 0x7f21d80d29d0 2023-11-26T07:14:03.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.526+0000 7f21d5ffb700 1 -- 172.21.15.2:0/1165917205 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d000b9c0 con 0x7f21d80d29d0 2023-11-26T07:14:03.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.526+0000 7f21d5ffb700 1 -- 172.21.15.2:0/1165917205 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d000bd70 con 0x7f21d80d29d0 2023-11-26T07:14:03.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.526+0000 7f21dd35f700 1 -- 172.21.15.2:0/1165917205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21d80d29d0 msgr2=0x7f21d80b40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:03.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.526+0000 7f21dd35f700 1 --2- 172.21.15.2:0/1165917205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21d80d29d0 0x7f21d80b40a0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f21d808e2f0 tx=0x7f21d000b330 comp rx=0 tx=0).stop 2023-11-26T07:14:03.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.526+0000 7f21dd35f700 1 -- 172.21.15.2:0/1165917205 shutdown_connections 2023-11-26T07:14:03.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.526+0000 7f21dd35f700 1 --2- 172.21.15.2:0/1165917205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21d80d29d0 0x7f21d80b40a0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:03.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.526+0000 7f21dd35f700 1 --2- 172.21.15.2:0/1165917205 >> v2:172.21.15.192:3300/0 conn(0x7f21d80d49d0 0x7f21d80d2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:03.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.526+0000 7f21dd35f700 1 -- 172.21.15.2:0/1165917205 >> 172.21.15.2:0/1165917205 conn(0x7f21d80d3eb0 msgr2=0x7f21d80d42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:03.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.526+0000 7f21dd35f700 1 -- 172.21.15.2:0/1165917205 shutdown_connections 2023-11-26T07:14:03.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.526+0000 7f21dd35f700 1 -- 172.21.15.2:0/1165917205 wait complete. 2023-11-26T07:14:03.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.528+0000 7f21dd35f700 1 Processor -- start 2023-11-26T07:14:03.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.528+0000 7f21dd35f700 1 -- start start 2023-11-26T07:14:03.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.528+0000 7f21dd35f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f21d80d29d0 0x7f21d815b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:03.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.528+0000 7f21dd35f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21d80d49d0 0x7f21d80b8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:03.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.528+0000 7f21dd35f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21d815e460 0x7f21d80c9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:03.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.529+0000 7f21dd35f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d80ca390 con 0x7f21d80d49d0 2023-11-26T07:14:03.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.529+0000 7f21dd35f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d80c9000 con 0x7f21d815e460 2023-11-26T07:14:03.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.529+0000 7f21dd35f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d815bdc0 con 0x7f21d80d29d0 2023-11-26T07:14:03.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.529+0000 7f21d67fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21d80d49d0 0x7f21d80b8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:03.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.529+0000 7f21d67fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21d80d49d0 0x7f21d80b8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42148/0 (socket says 172.21.15.2:42148) 2023-11-26T07:14:03.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.529+0000 7f21d67fc700 1 -- 172.21.15.2:0/1248015026 learned_addr learned my addr 172.21.15.2:0/1248015026 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:03.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.529+0000 7f21d77fe700 1 --2- 172.21.15.2:0/1248015026 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21d815e460 0x7f21d80c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:03.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.529+0000 7f21d6ffd700 1 --2- 172.21.15.2:0/1248015026 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f21d80d29d0 0x7f21d815b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:03.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.529+0000 7f21d67fc700 1 -- 172.21.15.2:0/1248015026 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f21d80d29d0 msgr2=0x7f21d815b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:03.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.529+0000 7f21d67fc700 1 --2- 172.21.15.2:0/1248015026 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f21d80d29d0 0x7f21d815b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:03.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.529+0000 7f21d67fc700 1 -- 172.21.15.2:0/1248015026 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21d815e460 msgr2=0x7f21d80c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:03.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.529+0000 7f21d67fc700 1 --2- 172.21.15.2:0/1248015026 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21d815e460 0x7f21d80c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:03.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.529+0000 7f21d67fc700 1 -- 172.21.15.2:0/1248015026 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d0009b30 con 0x7f21d80d49d0 2023-11-26T07:14:03.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.529+0000 7f21d67fc700 1 --2- 172.21.15.2:0/1248015026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21d80d49d0 0x7f21d80b8900 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f21c800e810 tx=0x7f21c800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:03.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.529+0000 7f21bf7fe700 1 -- 172.21.15.2:0/1248015026 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c800c070 con 0x7f21d80d49d0 2023-11-26T07:14:03.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.529+0000 7f21bf7fe700 1 -- 172.21.15.2:0/1248015026 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c8013610 con 0x7f21d80d49d0 2023-11-26T07:14:03.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.529+0000 7f21dd35f700 1 -- 172.21.15.2:0/1248015026 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d80c8760 con 0x7f21d80d49d0 2023-11-26T07:14:03.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.529+0000 7f21bf7fe700 1 -- 172.21.15.2:0/1248015026 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c80139c0 con 0x7f21d80d49d0 2023-11-26T07:14:03.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.529+0000 7f21dd35f700 1 -- 172.21.15.2:0/1248015026 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d80c8d20 con 0x7f21d80d49d0 2023-11-26T07:14:03.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.530+0000 7f21dd35f700 1 -- 172.21.15.2:0/1248015026 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d8067f60 con 0x7f21d80d49d0 2023-11-26T07:14:03.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.531+0000 7f21bf7fe700 1 -- 172.21.15.2:0/1248015026 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f21c8013b20 con 0x7f21d80d49d0 2023-11-26T07:14:03.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.531+0000 7f21bf7fe700 1 --2- 172.21.15.2:0/1248015026 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f21c406b1a0 0x7f21c406d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:03.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.531+0000 7f21bf7fe700 1 -- 172.21.15.2:0/1248015026 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21c80898a0 con 0x7f21d80d49d0 2023-11-26T07:14:03.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.531+0000 7f21d6ffd700 1 --2- 172.21.15.2:0/1248015026 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f21c406b1a0 0x7f21c406d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:03.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.532+0000 7f21d6ffd700 1 --2- 172.21.15.2:0/1248015026 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f21c406b1a0 0x7f21c406d660 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f21d80d4350 tx=0x7f21cc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:03.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.536+0000 7f21bf7fe700 1 -- 172.21.15.2:0/1248015026 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f21c8054500 con 0x7f21d80d49d0 2023-11-26T07:14:03.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.765+0000 7f21dd35f700 1 -- 172.21.15.2:0/1248015026 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f21d80b3b80 con 0x7f21c406b1a0 2023-11-26T07:14:03.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.767+0000 7f21bf7fe700 1 -- 172.21.15.2:0/1248015026 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f21cc001cc0 con 0x7f21c406b1a0 2023-11-26T07:14:03.769 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2023-11-26T07:14:03.769 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:14:03.769 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephfs" 2023-11-26T07:14:03.769 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:14:03.769 INFO:teuthology.orchestra.run.smithi002.stdout:] 2023-11-26T07:14:03.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.769+0000 7f21dd35f700 1 -- 172.21.15.2:0/1248015026 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f21c406b1a0 msgr2=0x7f21c406d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:03.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.769+0000 7f21dd35f700 1 --2- 172.21.15.2:0/1248015026 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f21c406b1a0 0x7f21c406d660 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f21d80d4350 tx=0x7f21cc009040 comp rx=0 tx=0).stop 2023-11-26T07:14:03.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.769+0000 7f21dd35f700 1 -- 172.21.15.2:0/1248015026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21d80d49d0 msgr2=0x7f21d80b8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:03.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.769+0000 7f21dd35f700 1 --2- 172.21.15.2:0/1248015026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21d80d49d0 0x7f21d80b8900 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f21c800e810 tx=0x7f21c800eb20 comp rx=0 tx=0).stop 2023-11-26T07:14:03.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.769+0000 7f21dd35f700 1 -- 172.21.15.2:0/1248015026 shutdown_connections 2023-11-26T07:14:03.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.769+0000 7f21dd35f700 1 --2- 172.21.15.2:0/1248015026 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f21c406b1a0 0x7f21c406d660 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:03.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.769+0000 7f21dd35f700 1 --2- 172.21.15.2:0/1248015026 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21d815e460 0x7f21d80c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:03.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.769+0000 7f21dd35f700 1 --2- 172.21.15.2:0/1248015026 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f21d80d29d0 0x7f21d815b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:03.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.769+0000 7f21dd35f700 1 --2- 172.21.15.2:0/1248015026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21d80d49d0 0x7f21d80b8900 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:03.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.769+0000 7f21dd35f700 1 -- 172.21.15.2:0/1248015026 >> 172.21.15.2:0/1248015026 conn(0x7f21d80d3eb0 msgr2=0x7f21d80ccf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:03.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.769+0000 7f21dd35f700 1 -- 172.21.15.2:0/1248015026 shutdown_connections 2023-11-26T07:14:03.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.769+0000 7f21dd35f700 1 -- 172.21.15.2:0/1248015026 wait complete. 2023-11-26T07:14:03.783 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-26T07:14:03.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.909+0000 7f183bd09700 1 Processor -- start 2023-11-26T07:14:03.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.909+0000 7f183bd09700 1 -- start start 2023-11-26T07:14:03.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.910+0000 7f183bd09700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f18340b4090 0x7f183415e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:03.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.910+0000 7f183bd09700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f18340d1010 0x7f18340d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:03.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.910+0000 7f183bd09700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18340d0b80 con 0x7f1834072a00 2023-11-26T07:14:03.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.910+0000 7f183bd09700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18340d1960 con 0x7f18340d1010 2023-11-26T07:14:03.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.910+0000 7f183bd09700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f183415ed60 con 0x7f18340b4090 2023-11-26T07:14:03.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.910+0000 7f183a2a6700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f18340d1010 0x7f18340d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:03.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.910+0000 7f18392a4700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f1834072a00 0x7f183406db60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33366/0 (socket says 172.21.15.2:33366) 2023-11-26T07:14:03.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.910+0000 7f18392a4700 1 -- 172.21.15.2:0/1928624400 learned_addr learned my addr 172.21.15.2:0/1928624400 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:14:03.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.911+0000 7f1839aa5700 1 --2- 172.21.15.2:0/1928624400 >> v2:172.21.15.192:3300/0 conn(0x7f18340b4090 0x7f183415e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:03.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.911+0000 7f183a2a6700 1 -- 172.21.15.2:0/1928624400 >> v2:172.21.15.192:3300/0 conn(0x7f18340b4090 msgr2=0x7f183415e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:03.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.911+0000 7f183a2a6700 1 --2- 172.21.15.2:0/1928624400 >> v2:172.21.15.192:3300/0 conn(0x7f18340b4090 0x7f183415e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:03.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.911+0000 7f183a2a6700 1 -- 172.21.15.2:0/1928624400 >> v1:172.21.15.2:6789/0 conn(0x7f1834072a00 legacy=0x7f183406db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:03.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.911+0000 7f183a2a6700 1 -- 172.21.15.2:0/1928624400 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f183415f040 con 0x7f18340d1010 2023-11-26T07:14:03.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.911+0000 7f1838aa3700 1 -- 172.21.15.2:0/1928624400 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 283828247 0 0) 0x7f18340d0b80 con 0x7f1834072a00 2023-11-26T07:14:03.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.911+0000 7f183a2a6700 1 --2- 172.21.15.2:0/1928624400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18340d1010 0x7f18340d1420 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f1834069590 tx=0x7f182c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=946b748963b47008 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:03.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.911+0000 7f1838aa3700 1 -- 172.21.15.2:0/1928624400 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182c00e070 con 0x7f18340d1010 2023-11-26T07:14:03.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.911+0000 7f1838aa3700 1 -- 172.21.15.2:0/1928624400 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182c00bbd0 con 0x7f18340d1010 2023-11-26T07:14:03.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.911+0000 7f1838aa3700 1 -- 172.21.15.2:0/1928624400 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182c012430 con 0x7f18340d1010 2023-11-26T07:14:03.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.912+0000 7f183bd09700 1 -- 172.21.15.2:0/1928624400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18340d1010 msgr2=0x7f18340d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:03.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.912+0000 7f183bd09700 1 --2- 172.21.15.2:0/1928624400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18340d1010 0x7f18340d1420 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f1834069590 tx=0x7f182c00b330 comp rx=0 tx=0).stop 2023-11-26T07:14:03.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.912+0000 7f183bd09700 1 -- 172.21.15.2:0/1928624400 shutdown_connections 2023-11-26T07:14:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.912+0000 7f183bd09700 1 --2- 172.21.15.2:0/1928624400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18340d1010 0x7f18340d1420 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.912+0000 7f183bd09700 1 --2- 172.21.15.2:0/1928624400 >> v2:172.21.15.192:3300/0 conn(0x7f18340b4090 0x7f183415e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.912+0000 7f183bd09700 1 -- 172.21.15.2:0/1928624400 >> 172.21.15.2:0/1928624400 conn(0x7f18340b2740 msgr2=0x7f18340b2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.912+0000 7f183bd09700 1 -- 172.21.15.2:0/1928624400 shutdown_connections 2023-11-26T07:14:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.912+0000 7f183bd09700 1 -- 172.21.15.2:0/1928624400 wait complete. 2023-11-26T07:14:03.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.913+0000 7f183bd09700 1 Processor -- start 2023-11-26T07:14:03.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.913+0000 7f183bd09700 1 -- start start 2023-11-26T07:14:03.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.914+0000 7f183bd09700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1834072a00 0x7f1834157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:03.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.914+0000 7f183bd09700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18340b4090 0x7f18341484c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:03.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.914+0000 7f183bd09700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18340d1010 0x7f1834148a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:03.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.914+0000 7f183bd09700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1834149bd0 con 0x7f1834072a00 2023-11-26T07:14:03.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.914+0000 7f183bd09700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183415b490 con 0x7f18340b4090 2023-11-26T07:14:03.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.914+0000 7f183bd09700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f183415b750 con 0x7f18340d1010 2023-11-26T07:14:03.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.914+0000 7f1839aa5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1834072a00 0x7f1834157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:03.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.914+0000 7f1839aa5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1834072a00 0x7f1834157d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42160/0 (socket says 172.21.15.2:42160) 2023-11-26T07:14:03.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.914+0000 7f1839aa5700 1 -- 172.21.15.2:0/4007130166 learned_addr learned my addr 172.21.15.2:0/4007130166 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:03.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.914+0000 7f18392a4700 1 --2- 172.21.15.2:0/4007130166 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18340b4090 0x7f18341484c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:03.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.914+0000 7f183a2a6700 1 --2- 172.21.15.2:0/4007130166 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18340d1010 0x7f1834148a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:03.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.914+0000 7f1839aa5700 1 -- 172.21.15.2:0/4007130166 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18340d1010 msgr2=0x7f1834148a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:03.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.914+0000 7f1839aa5700 1 --2- 172.21.15.2:0/4007130166 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18340d1010 0x7f1834148a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:03.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.914+0000 7f1839aa5700 1 -- 172.21.15.2:0/4007130166 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18340b4090 msgr2=0x7f18341484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:03.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.914+0000 7f1839aa5700 1 --2- 172.21.15.2:0/4007130166 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18340b4090 0x7f18341484c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:03.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.914+0000 7f1839aa5700 1 -- 172.21.15.2:0/4007130166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f182c009a70 con 0x7f1834072a00 2023-11-26T07:14:03.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.914+0000 7f1839aa5700 1 --2- 172.21.15.2:0/4007130166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1834072a00 0x7f1834157d30 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f182400e810 tx=0x7f182400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.914+0000 7f182a7fc700 1 -- 172.21.15.2:0/4007130166 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1824013610 con 0x7f1834072a00 2023-11-26T07:14:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.914+0000 7f182a7fc700 1 -- 172.21.15.2:0/4007130166 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1824013770 con 0x7f1834072a00 2023-11-26T07:14:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.914+0000 7f182a7fc700 1 -- 172.21.15.2:0/4007130166 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1824013b00 con 0x7f1834072a00 2023-11-26T07:14:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.915+0000 7f183bd09700 1 -- 172.21.15.2:0/4007130166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18341596d0 con 0x7f1834072a00 2023-11-26T07:14:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.915+0000 7f183bd09700 1 -- 172.21.15.2:0/4007130166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1834148f40 con 0x7f1834072a00 2023-11-26T07:14:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.916+0000 7f183bd09700 1 -- 172.21.15.2:0/4007130166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1834159520 con 0x7f1834072a00 2023-11-26T07:14:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.916+0000 7f182a7fc700 1 -- 172.21.15.2:0/4007130166 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7f1824013c60 con 0x7f1834072a00 2023-11-26T07:14:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.917+0000 7f182a7fc700 1 --2- 172.21.15.2:0/4007130166 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f181806b1a0 0x7f181806d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.917+0000 7f182a7fc700 1 -- 172.21.15.2:0/4007130166 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1824089820 con 0x7f1834072a00 2023-11-26T07:14:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.917+0000 7f18392a4700 1 --2- 172.21.15.2:0/4007130166 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f181806b1a0 0x7f181806d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:03.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.917+0000 7f18392a4700 1 --2- 172.21.15.2:0/4007130166 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f181806b1a0 0x7f181806d660 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1834157ce0 tx=0x7f1830007be0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:03.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:03.921+0000 7f182a7fc700 1 -- 172.21.15.2:0/4007130166 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f18240543f0 con 0x7f1834072a00 2023-11-26T07:14:04.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.120+0000 7f183bd09700 1 -- 172.21.15.2:0/4007130166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f1834075480 con 0x7f1834072a00 2023-11-26T07:14:04.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.121+0000 7f182a7fc700 1 -- 172.21.15.2:0/4007130166 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1824057a10 con 0x7f1834072a00 2023-11-26T07:14:04.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.123+0000 7f183bd09700 1 -- 172.21.15.2:0/4007130166 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f181806b1a0 msgr2=0x7f181806d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:04.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.123+0000 7f183bd09700 1 --2- 172.21.15.2:0/4007130166 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f181806b1a0 0x7f181806d660 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1834157ce0 tx=0x7f1830007be0 comp rx=0 tx=0).stop 2023-11-26T07:14:04.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.123+0000 7f183bd09700 1 -- 172.21.15.2:0/4007130166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1834072a00 msgr2=0x7f1834157d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:04.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.123+0000 7f183bd09700 1 --2- 172.21.15.2:0/4007130166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1834072a00 0x7f1834157d30 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f182400e810 tx=0x7f182400ebd0 comp rx=0 tx=0).stop 2023-11-26T07:14:04.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.123+0000 7f183bd09700 1 -- 172.21.15.2:0/4007130166 shutdown_connections 2023-11-26T07:14:04.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.123+0000 7f183bd09700 1 --2- 172.21.15.2:0/4007130166 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f181806b1a0 0x7f181806d660 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:04.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.123+0000 7f183bd09700 1 --2- 172.21.15.2:0/4007130166 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18340d1010 0x7f1834148a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:04.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.123+0000 7f183bd09700 1 --2- 172.21.15.2:0/4007130166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1834072a00 0x7f1834157d30 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:04.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.123+0000 7f183bd09700 1 --2- 172.21.15.2:0/4007130166 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18340b4090 0x7f18341484c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:04.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.123+0000 7f183bd09700 1 -- 172.21.15.2:0/4007130166 >> 172.21.15.2:0/4007130166 conn(0x7f18340b2740 msgr2=0x7f18341607c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:04.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.123+0000 7f183bd09700 1 -- 172.21.15.2:0/4007130166 shutdown_connections 2023-11-26T07:14:04.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.123+0000 7f183bd09700 1 -- 172.21.15.2:0/4007130166 wait complete. 2023-11-26T07:14:04.137 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol96280 --mode=777 2023-11-26T07:14:04.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.264+0000 7fd3d3106700 1 Processor -- start 2023-11-26T07:14:04.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.264+0000 7fd3d3106700 1 -- start start 2023-11-26T07:14:04.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.265+0000 7fd3d3106700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd3cc1447a0 0x7fd3cc071b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:04.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.265+0000 7fd3d3106700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd3cc06f070 0x7fd3cc0720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:04.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.265+0000 7fd3d3106700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3cc06dbd0 con 0x7fd3cc072ab0 2023-11-26T07:14:04.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.265+0000 7fd3d3106700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3cc15b700 con 0x7fd3cc06f070 2023-11-26T07:14:04.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.265+0000 7fd3d3106700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3cc15b9e0 con 0x7fd3cc1447a0 2023-11-26T07:14:04.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.265+0000 7fd3d16a3700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd3cc06f070 0x7fd3cc0720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:04.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.265+0000 7fd3d16a3700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd3cc06f070 0x7fd3cc0720d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42172/0 (socket says 172.21.15.2:42172) 2023-11-26T07:14:04.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.265+0000 7fd3d16a3700 1 -- 172.21.15.2:0/1446463725 learned_addr learned my addr 172.21.15.2:0/1446463725 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:04.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.265+0000 7fd3d0ea2700 1 --2- 172.21.15.2:0/1446463725 >> v2:172.21.15.192:3300/0 conn(0x7fd3cc1447a0 0x7fd3cc071b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:04.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.266+0000 7fd3d16a3700 1 -- 172.21.15.2:0/1446463725 >> v2:172.21.15.192:3300/0 conn(0x7fd3cc1447a0 msgr2=0x7fd3cc071b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:04.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.266+0000 7fd3d16a3700 1 --2- 172.21.15.2:0/1446463725 >> v2:172.21.15.192:3300/0 conn(0x7fd3cc1447a0 0x7fd3cc071b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:04.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.266+0000 7fd3d16a3700 1 -- 172.21.15.2:0/1446463725 >> v1:172.21.15.192:6789/0 conn(0x7fd3cc072ab0 legacy=0x7fd3cc15e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:04.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.266+0000 7fd3d16a3700 1 -- 172.21.15.2:0/1446463725 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3cc15bcc0 con 0x7fd3cc06f070 2023-11-26T07:14:04.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.266+0000 7fd3d0ea2700 1 --2- 172.21.15.2:0/1446463725 >> v2:172.21.15.192:3300/0 conn(0x7fd3cc1447a0 0x7fd3cc071b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:14:04.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.266+0000 7fd3d16a3700 1 --2- 172.21.15.2:0/1446463725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3cc06f070 0x7fd3cc0720d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc0b05a0 tx=0x7fd3c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e823a5f7583f1ea6 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:04.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.266+0000 7fd3cb7fe700 1 -- 172.21.15.2:0/1446463725 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c400e070 con 0x7fd3cc06f070 2023-11-26T07:14:04.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.266+0000 7fd3cb7fe700 1 -- 172.21.15.2:0/1446463725 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c400b9c0 con 0x7fd3cc06f070 2023-11-26T07:14:04.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.266+0000 7fd3cb7fe700 1 -- 172.21.15.2:0/1446463725 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c400bd70 con 0x7fd3cc06f070 2023-11-26T07:14:04.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.266+0000 7fd3d3106700 1 -- 172.21.15.2:0/1446463725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3cc06f070 msgr2=0x7fd3cc0720d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:04.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.266+0000 7fd3d3106700 1 --2- 172.21.15.2:0/1446463725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3cc06f070 0x7fd3cc0720d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc0b05a0 tx=0x7fd3c400b330 comp rx=0 tx=0).stop 2023-11-26T07:14:04.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.266+0000 7fd3d3106700 1 -- 172.21.15.2:0/1446463725 shutdown_connections 2023-11-26T07:14:04.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.266+0000 7fd3d3106700 1 --2- 172.21.15.2:0/1446463725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3cc06f070 0x7fd3cc0720d0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:04.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.266+0000 7fd3d3106700 1 --2- 172.21.15.2:0/1446463725 >> v2:172.21.15.192:3300/0 conn(0x7fd3cc1447a0 0x7fd3cc071b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:04.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.267+0000 7fd3d3106700 1 -- 172.21.15.2:0/1446463725 >> 172.21.15.2:0/1446463725 conn(0x7fd3cc0b2760 msgr2=0x7fd3cc0b2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:04.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.267+0000 7fd3d3106700 1 -- 172.21.15.2:0/1446463725 shutdown_connections 2023-11-26T07:14:04.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.267+0000 7fd3d3106700 1 -- 172.21.15.2:0/1446463725 wait complete. 2023-11-26T07:14:04.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.268+0000 7fd3d3106700 1 Processor -- start 2023-11-26T07:14:04.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.268+0000 7fd3d3106700 1 -- start start 2023-11-26T07:14:04.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.269+0000 7fd3d3106700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3cc06f070 0x7fd3cc15c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:04.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.269+0000 7fd3d3106700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3cc072ab0 0x7fd3cc13e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:04.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.269+0000 7fd3d3106700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3cc1447a0 0x7fd3cc13ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:04.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.269+0000 7fd3d3106700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc142410 con 0x7fd3cc072ab0 2023-11-26T07:14:04.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.269+0000 7fd3d3106700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc1426f0 con 0x7fd3cc1447a0 2023-11-26T07:14:04.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.269+0000 7fd3d3106700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc1429d0 con 0x7fd3cc06f070 2023-11-26T07:14:04.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.269+0000 7fd3cbfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3cc072ab0 0x7fd3cc13e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:04.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.269+0000 7fd3cbfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3cc072ab0 0x7fd3cc13e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42176/0 (socket says 172.21.15.2:42176) 2023-11-26T07:14:04.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.269+0000 7fd3cbfff700 1 -- 172.21.15.2:0/989651303 learned_addr learned my addr 172.21.15.2:0/989651303 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:04.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.269+0000 7fd3d16a3700 1 --2- 172.21.15.2:0/989651303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3cc1447a0 0x7fd3cc13ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:04.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.269+0000 7fd3d0ea2700 1 --2- 172.21.15.2:0/989651303 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3cc06f070 0x7fd3cc15c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:04.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.269+0000 7fd3cbfff700 1 -- 172.21.15.2:0/989651303 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3cc06f070 msgr2=0x7fd3cc15c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:04.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.269+0000 7fd3cbfff700 1 --2- 172.21.15.2:0/989651303 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3cc06f070 0x7fd3cc15c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:04.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.269+0000 7fd3cbfff700 1 -- 172.21.15.2:0/989651303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3cc1447a0 msgr2=0x7fd3cc13ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:04.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.269+0000 7fd3cbfff700 1 --2- 172.21.15.2:0/989651303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3cc1447a0 0x7fd3cc13ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:04.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.269+0000 7fd3cbfff700 1 -- 172.21.15.2:0/989651303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c4009b30 con 0x7fd3cc072ab0 2023-11-26T07:14:04.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.269+0000 7fd3d16a3700 1 --2- 172.21.15.2:0/989651303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3cc1447a0 0x7fd3cc13ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:14:04.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.269+0000 7fd3cbfff700 1 --2- 172.21.15.2:0/989651303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3cc072ab0 0x7fd3cc13e280 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd3b800c4e0 tx=0x7fd3b800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:04.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.269+0000 7fd3c97fa700 1 -- 172.21.15.2:0/989651303 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b80052d0 con 0x7fd3cc072ab0 2023-11-26T07:14:04.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.269+0000 7fd3c97fa700 1 -- 172.21.15.2:0/989651303 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b8005430 con 0x7fd3cc072ab0 2023-11-26T07:14:04.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.269+0000 7fd3d3106700 1 -- 172.21.15.2:0/989651303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3cc142cb0 con 0x7fd3cc072ab0 2023-11-26T07:14:04.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.269+0000 7fd3c97fa700 1 -- 172.21.15.2:0/989651303 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b80038c0 con 0x7fd3cc072ab0 2023-11-26T07:14:04.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.270+0000 7fd3d3106700 1 -- 172.21.15.2:0/989651303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3cc15cfe0 con 0x7fd3cc072ab0 2023-11-26T07:14:04.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.270+0000 7fd3d3106700 1 -- 172.21.15.2:0/989651303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3cc068670 con 0x7fd3cc072ab0 2023-11-26T07:14:04.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.271+0000 7fd3c97fa700 1 -- 172.21.15.2:0/989651303 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7fd3b8003a20 con 0x7fd3cc072ab0 2023-11-26T07:14:04.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.271+0000 7fd3c97fa700 1 --2- 172.21.15.2:0/989651303 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd3b006b1a0 0x7fd3b006d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:04.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.271+0000 7fd3c97fa700 1 -- 172.21.15.2:0/989651303 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd3b8088ee0 con 0x7fd3cc072ab0 2023-11-26T07:14:04.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.272+0000 7fd3d0ea2700 1 --2- 172.21.15.2:0/989651303 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd3b006b1a0 0x7fd3b006d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:04.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.272+0000 7fd3d0ea2700 1 --2- 172.21.15.2:0/989651303 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd3b006b1a0 0x7fd3b006d660 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0009750 tx=0x7fd3c0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:04.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.276+0000 7fd3c97fa700 1 -- 172.21.15.2:0/989651303 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd3b8053ad0 con 0x7fd3cc072ab0 2023-11-26T07:14:04.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.509+0000 7fd3d3106700 1 -- 172.21.15.2:0/989651303 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol96280", "mode": "777", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3cc142860 con 0x7fd3b006b1a0 2023-11-26T07:14:04.517 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:14:04.516+0000 7f8da6aa7700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:14:04.518 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:14:04.516+0000 7f8da6aa7700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:14:04.518 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:14:04.516+0000 7f8da6aa7700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:14:04.518 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:14:04.516+0000 7f8da6aa7700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:14:04.518 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:14:04.516+0000 7f8da6aa7700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:14:04.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.551+0000 7fd3c97fa700 1 -- 172.21.15.2:0/989651303 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fd3cc142860 con 0x7fd3b006b1a0 2023-11-26T07:14:04.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.553+0000 7fd3d3106700 1 -- 172.21.15.2:0/989651303 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd3b006b1a0 msgr2=0x7fd3b006d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:04.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.553+0000 7fd3d3106700 1 --2- 172.21.15.2:0/989651303 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd3b006b1a0 0x7fd3b006d660 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0009750 tx=0x7fd3c0008040 comp rx=0 tx=0).stop 2023-11-26T07:14:04.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.553+0000 7fd3d3106700 1 -- 172.21.15.2:0/989651303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3cc072ab0 msgr2=0x7fd3cc13e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:04.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.553+0000 7fd3d3106700 1 --2- 172.21.15.2:0/989651303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3cc072ab0 0x7fd3cc13e280 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd3b800c4e0 tx=0x7fd3b800c8a0 comp rx=0 tx=0).stop 2023-11-26T07:14:04.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.553+0000 7fd3d3106700 1 -- 172.21.15.2:0/989651303 shutdown_connections 2023-11-26T07:14:04.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.553+0000 7fd3d3106700 1 --2- 172.21.15.2:0/989651303 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd3b006b1a0 0x7fd3b006d660 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:04.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.553+0000 7fd3d3106700 1 --2- 172.21.15.2:0/989651303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3cc1447a0 0x7fd3cc13ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:04.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.553+0000 7fd3d3106700 1 --2- 172.21.15.2:0/989651303 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3cc06f070 0x7fd3cc15c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:04.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.553+0000 7fd3d3106700 1 --2- 172.21.15.2:0/989651303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3cc072ab0 0x7fd3cc13e280 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:04.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.553+0000 7fd3d3106700 1 -- 172.21.15.2:0/989651303 >> 172.21.15.2:0/989651303 conn(0x7fd3cc0b2760 msgr2=0x7fd3cc0b5350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:04.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.553+0000 7fd3d3106700 1 -- 172.21.15.2:0/989651303 shutdown_connections 2023-11-26T07:14:04.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.553+0000 7fd3d3106700 1 -- 172.21.15.2:0/989651303 wait complete. 2023-11-26T07:14:04.567 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol96280 2023-11-26T07:14:04.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.693+0000 7fe9d1fbf700 1 Processor -- start 2023-11-26T07:14:04.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.693+0000 7fe9d1fbf700 1 -- start start 2023-11-26T07:14:04.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.694+0000 7fe9d1fbf700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9cc142810 0x7fe9cc06afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:04.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.694+0000 7fe9d1fbf700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe9cc1459a0 0x7fe9cc06b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:04.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.694+0000 7fe9d1fbf700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9cc0cf5f0 con 0x7fe9cc06e580 2023-11-26T07:14:04.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.694+0000 7fe9d1fbf700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9cc06ea80 con 0x7fe9cc1459a0 2023-11-26T07:14:04.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.694+0000 7fe9d1fbf700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc06ed60 con 0x7fe9cc142810 2023-11-26T07:14:04.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.694+0000 7fe9caffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe9cc1459a0 0x7fe9cc06b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:04.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.695+0000 7fe9cbfff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe9cc06e580 0x7fe9cc071bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33396/0 (socket says 172.21.15.2:33396) 2023-11-26T07:14:04.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.695+0000 7fe9caffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe9cc1459a0 0x7fe9cc06b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42184/0 (socket says 172.21.15.2:42184) 2023-11-26T07:14:04.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.695+0000 7fe9cbfff700 1 -- 172.21.15.2:0/3712118998 learned_addr learned my addr 172.21.15.2:0/3712118998 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:14:04.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.695+0000 7fe9cb7fe700 1 --2- 172.21.15.2:0/3712118998 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9cc142810 0x7fe9cc06afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:04.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.695+0000 7fe9caffd700 1 -- 172.21.15.2:0/3712118998 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9cc142810 msgr2=0x7fe9cc06afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:04.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.695+0000 7fe9caffd700 1 --2- 172.21.15.2:0/3712118998 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9cc142810 0x7fe9cc06afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:04.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.695+0000 7fe9caffd700 1 -- 172.21.15.2:0/3712118998 >> v1:172.21.15.2:6789/0 conn(0x7fe9cc06e580 legacy=0x7fe9cc071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:04.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.695+0000 7fe9ca7fc700 1 -- 172.21.15.2:0/3712118998 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 682072079 0 0) 0x7fe9cc0cf5f0 con 0x7fe9cc06e580 2023-11-26T07:14:04.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.695+0000 7fe9caffd700 1 -- 172.21.15.2:0/3712118998 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9cc06f040 con 0x7fe9cc1459a0 2023-11-26T07:14:04.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.695+0000 7fe9caffd700 1 --2- 172.21.15.2:0/3712118998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9cc1459a0 0x7fe9cc06b510 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4009840 tx=0x7fe9b4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56dac12a8c15f579 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:04.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.695+0000 7fe9ca7fc700 1 -- 172.21.15.2:0/3712118998 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b4011830 con 0x7fe9cc1459a0 2023-11-26T07:14:04.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.695+0000 7fe9ca7fc700 1 -- 172.21.15.2:0/3712118998 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b4011990 con 0x7fe9cc1459a0 2023-11-26T07:14:04.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.695+0000 7fe9ca7fc700 1 -- 172.21.15.2:0/3712118998 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b4011d20 con 0x7fe9cc1459a0 2023-11-26T07:14:04.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.696+0000 7fe9d1fbf700 1 -- 172.21.15.2:0/3712118998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9cc1459a0 msgr2=0x7fe9cc06b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:04.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.696+0000 7fe9d1fbf700 1 --2- 172.21.15.2:0/3712118998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9cc1459a0 0x7fe9cc06b510 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4009840 tx=0x7fe9b4009b50 comp rx=0 tx=0).stop 2023-11-26T07:14:04.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.696+0000 7fe9d1fbf700 1 -- 172.21.15.2:0/3712118998 shutdown_connections 2023-11-26T07:14:04.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.696+0000 7fe9d1fbf700 1 --2- 172.21.15.2:0/3712118998 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9cc142810 0x7fe9cc06afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:04.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.696+0000 7fe9d1fbf700 1 --2- 172.21.15.2:0/3712118998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9cc1459a0 0x7fe9cc06b510 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:04.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.696+0000 7fe9d1fbf700 1 -- 172.21.15.2:0/3712118998 >> 172.21.15.2:0/3712118998 conn(0x7fe9cc0b2740 msgr2=0x7fe9cc0b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:04.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.696+0000 7fe9d1fbf700 1 -- 172.21.15.2:0/3712118998 shutdown_connections 2023-11-26T07:14:04.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.696+0000 7fe9d1fbf700 1 -- 172.21.15.2:0/3712118998 wait complete. 2023-11-26T07:14:04.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.697+0000 7fe9d1fbf700 1 Processor -- start 2023-11-26T07:14:04.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.697+0000 7fe9d1fbf700 1 -- start start 2023-11-26T07:14:04.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.698+0000 7fe9d1fbf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9cc06e580 0x7fe9cc15f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:04.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.698+0000 7fe9d1fbf700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9cc142810 0x7fe9cc12ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:04.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.698+0000 7fe9d1fbf700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9cc1459a0 0x7fe9cc1f0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:04.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.698+0000 7fe9d1fbf700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc1539c0 con 0x7fe9cc06e580 2023-11-26T07:14:04.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.698+0000 7fe9d1fbf700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc153c40 con 0x7fe9cc142810 2023-11-26T07:14:04.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.698+0000 7fe9d1fbf700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc153f20 con 0x7fe9cc1459a0 2023-11-26T07:14:04.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.698+0000 7fe9cb7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9cc06e580 0x7fe9cc15f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:04.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.698+0000 7fe9cb7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9cc06e580 0x7fe9cc15f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42188/0 (socket says 172.21.15.2:42188) 2023-11-26T07:14:04.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.698+0000 7fe9cb7fe700 1 -- 172.21.15.2:0/1957190854 learned_addr learned my addr 172.21.15.2:0/1957190854 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:04.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.698+0000 7fe9caffd700 1 --2- 172.21.15.2:0/1957190854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9cc142810 0x7fe9cc12ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:04.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.698+0000 7fe9cbfff700 1 --2- 172.21.15.2:0/1957190854 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9cc1459a0 0x7fe9cc1f0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:04.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.698+0000 7fe9cb7fe700 1 -- 172.21.15.2:0/1957190854 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9cc1459a0 msgr2=0x7fe9cc1f0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:04.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.698+0000 7fe9cb7fe700 1 --2- 172.21.15.2:0/1957190854 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9cc1459a0 0x7fe9cc1f0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:04.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.698+0000 7fe9cb7fe700 1 -- 172.21.15.2:0/1957190854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9cc142810 msgr2=0x7fe9cc12ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:04.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.698+0000 7fe9cb7fe700 1 --2- 172.21.15.2:0/1957190854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9cc142810 0x7fe9cc12ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:04.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.698+0000 7fe9cb7fe700 1 -- 172.21.15.2:0/1957190854 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b40094a0 con 0x7fe9cc06e580 2023-11-26T07:14:04.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.698+0000 7fe9cbfff700 1 --2- 172.21.15.2:0/1957190854 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9cc1459a0 0x7fe9cc1f0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:14:04.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.699+0000 7fe9cb7fe700 1 --2- 172.21.15.2:0/1957190854 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9cc06e580 0x7fe9cc15f200 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc00efc0 tx=0x7fe9bc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:04.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.699+0000 7fe9c3fff700 1 -- 172.21.15.2:0/1957190854 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc00cdc0 con 0x7fe9cc06e580 2023-11-26T07:14:04.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.699+0000 7fe9c3fff700 1 -- 172.21.15.2:0/1957190854 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9bc00f040 con 0x7fe9cc06e580 2023-11-26T07:14:04.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.699+0000 7fe9d1fbf700 1 -- 172.21.15.2:0/1957190854 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9cc154200 con 0x7fe9cc06e580 2023-11-26T07:14:04.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.699+0000 7fe9c3fff700 1 -- 172.21.15.2:0/1957190854 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc0146c0 con 0x7fe9cc06e580 2023-11-26T07:14:04.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.699+0000 7fe9d1fbf700 1 -- 172.21.15.2:0/1957190854 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9cc12f360 con 0x7fe9cc06e580 2023-11-26T07:14:04.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.700+0000 7fe9d1fbf700 1 -- 172.21.15.2:0/1957190854 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9cc075480 con 0x7fe9cc06e580 2023-11-26T07:14:04.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.700+0000 7fe9c3fff700 1 -- 172.21.15.2:0/1957190854 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 89486+0+0 (secure 0 0 0) 0x7fe9bc014820 con 0x7fe9cc06e580 2023-11-26T07:14:04.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.701+0000 7fe9c3fff700 1 --2- 172.21.15.2:0/1957190854 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe9ac06b1a0 0x7fe9ac06d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:04.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.701+0000 7fe9c3fff700 1 -- 172.21.15.2:0/1957190854 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe9bc08a610 con 0x7fe9cc06e580 2023-11-26T07:14:04.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.701+0000 7fe9caffd700 1 --2- 172.21.15.2:0/1957190854 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe9ac06b1a0 0x7fe9ac06d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:04.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.701+0000 7fe9caffd700 1 --2- 172.21.15.2:0/1957190854 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe9ac06b1a0 0x7fe9ac06d660 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4000c00 tx=0x7fe9b401c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:04.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.705+0000 7fe9c3fff700 1 -- 172.21.15.2:0/1957190854 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe9bc0551d0 con 0x7fe9cc06e580 2023-11-26T07:14:04.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.940+0000 7fe9d1fbf700 1 -- 172.21.15.2:0/1957190854 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol96280", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9cc0b1960 con 0x7fe9ac06b1a0 2023-11-26T07:14:04.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.946+0000 7fe9c3fff700 1 -- 172.21.15.2:0/1957190854 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+67 (secure 0 0 0) 0x7fe9cc0b1960 con 0x7fe9ac06b1a0 2023-11-26T07:14:04.947 INFO:teuthology.orchestra.run.smithi002.stdout:/volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38 2023-11-26T07:14:04.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.948+0000 7fe9d1fbf700 1 -- 172.21.15.2:0/1957190854 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe9ac06b1a0 msgr2=0x7fe9ac06d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:04.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.948+0000 7fe9d1fbf700 1 --2- 172.21.15.2:0/1957190854 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe9ac06b1a0 0x7fe9ac06d660 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4000c00 tx=0x7fe9b401c040 comp rx=0 tx=0).stop 2023-11-26T07:14:04.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.948+0000 7fe9d1fbf700 1 -- 172.21.15.2:0/1957190854 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9cc06e580 msgr2=0x7fe9cc15f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:04.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.948+0000 7fe9d1fbf700 1 --2- 172.21.15.2:0/1957190854 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9cc06e580 0x7fe9cc15f200 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc00efc0 tx=0x7fe9bc00c3a0 comp rx=0 tx=0).stop 2023-11-26T07:14:04.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.948+0000 7fe9d1fbf700 1 -- 172.21.15.2:0/1957190854 shutdown_connections 2023-11-26T07:14:04.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.948+0000 7fe9d1fbf700 1 --2- 172.21.15.2:0/1957190854 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe9ac06b1a0 0x7fe9ac06d660 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:04.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.948+0000 7fe9d1fbf700 1 --2- 172.21.15.2:0/1957190854 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9cc1459a0 0x7fe9cc1f0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:04.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.948+0000 7fe9d1fbf700 1 --2- 172.21.15.2:0/1957190854 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9cc06e580 0x7fe9cc15f200 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:04.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.948+0000 7fe9d1fbf700 1 --2- 172.21.15.2:0/1957190854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9cc142810 0x7fe9cc12ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:04.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.948+0000 7fe9d1fbf700 1 -- 172.21.15.2:0/1957190854 >> 172.21.15.2:0/1957190854 conn(0x7fe9cc0b2740 msgr2=0x7fe9cc141160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:04.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.948+0000 7fe9d1fbf700 1 -- 172.21.15.2:0/1957190854 shutdown_connections 2023-11-26T07:14:04.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:04.948+0000 7fe9d1fbf700 1 -- 172.21.15.2:0/1957190854 wait complete. 2023-11-26T07:14:04.962 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvol96280 with 200 files each 1MB size under directory volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38 2023-11-26T07:14:04.962 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:04.962 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:04.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:04.980 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:05.057 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:05.057 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:05.057 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124556 s, 84.2 MB/s 2023-11-26T07:14:05.058 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:05.058 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:05.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:05.116 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:05.186 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:05.186 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:05.186 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119955 s, 87.4 MB/s 2023-11-26T07:14:05.187 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:05.187 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:05.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:05.246 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:05.315 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:05.315 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:05.315 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100484 s, 104 MB/s 2023-11-26T07:14:05.315 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:05.316 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:05.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:05.373 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:05.442 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:05.442 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:05.442 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107801 s, 97.3 MB/s 2023-11-26T07:14:05.443 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:05.443 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:05.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:05.502 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:05.570 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:05.570 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:05.570 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00945553 s, 111 MB/s 2023-11-26T07:14:05.571 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:05.571 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:05.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:05.629 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:05.698 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:05.698 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:05.698 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105513 s, 99.4 MB/s 2023-11-26T07:14:05.699 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:05.699 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:05.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:05.756 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:05.826 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:05.826 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:05.826 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122626 s, 85.5 MB/s 2023-11-26T07:14:05.827 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:05.827 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:05.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:05.885 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:05.954 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:05.954 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:05.954 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117433 s, 89.3 MB/s 2023-11-26T07:14:05.954 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:05.955 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:06.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:06.012 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:06.081 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:06.082 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:06.082 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117974 s, 88.9 MB/s 2023-11-26T07:14:06.083 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:06.083 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:06.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:06.140 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:06.208 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:06.208 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:06.208 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00982126 s, 107 MB/s 2023-11-26T07:14:06.209 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:06.209 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:06.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:06.266 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.10 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:06.334 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:06.334 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:06.335 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107642 s, 97.4 MB/s 2023-11-26T07:14:06.335 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:06.335 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:06.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:06.393 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.11 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:06.462 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:06.462 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:06.462 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102683 s, 102 MB/s 2023-11-26T07:14:06.463 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:06.463 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:06.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:06.520 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.12 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:06.588 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:06.589 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:06.589 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101494 s, 103 MB/s 2023-11-26T07:14:06.589 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:06.590 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:06.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:06.647 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.13 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:06.716 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:06.716 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:06.716 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100531 s, 104 MB/s 2023-11-26T07:14:06.716 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:06.716 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:06.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:06.774 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.14 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:06.843 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:06.844 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:06.844 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00979488 s, 107 MB/s 2023-11-26T07:14:06.845 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:06.845 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:06.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:06.902 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.15 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:06.969 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:06.969 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:06.969 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00879672 s, 119 MB/s 2023-11-26T07:14:06.970 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:06.970 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:07.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:07.028 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.16 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:07.096 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:07.096 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:07.096 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106334 s, 98.6 MB/s 2023-11-26T07:14:07.097 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:07.097 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:07.128 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:14:07.140 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:14:07.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:07.156 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.17 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:07.262 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:07.262 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:07.263 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00800166 s, 131 MB/s 2023-11-26T07:14:07.263 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:07.263 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:07.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:07.321 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.18 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:07.390 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:07.390 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:07.390 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120019 s, 87.4 MB/s 2023-11-26T07:14:07.391 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:07.391 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:07.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:07.449 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.19 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:07.517 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:07.517 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:07.517 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101554 s, 103 MB/s 2023-11-26T07:14:07.518 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:07.518 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:07.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:07.576 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.20 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:07.644 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:07.644 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:07.644 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00890989 s, 118 MB/s 2023-11-26T07:14:07.645 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:07.645 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:07.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:07.702 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.21 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:07.770 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:07.770 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:07.770 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00998884 s, 105 MB/s 2023-11-26T07:14:07.771 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:07.771 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:07.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:07.830 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.22 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:07.898 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:07.898 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:07.898 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00966184 s, 109 MB/s 2023-11-26T07:14:07.898 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:07.898 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:07.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:07.955 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.23 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:08.022 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:08.022 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:08.023 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00966852 s, 108 MB/s 2023-11-26T07:14:08.023 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:08.024 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:08.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:08.081 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.24 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:08.151 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:08.152 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:08.152 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120111 s, 87.3 MB/s 2023-11-26T07:14:08.152 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:08.152 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:08.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:08.209 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.25 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:08.276 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:08.277 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:08.277 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00965915 s, 109 MB/s 2023-11-26T07:14:08.278 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:08.278 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:08.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:08.335 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.26 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:08.401 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:08.401 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:08.401 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00804404 s, 130 MB/s 2023-11-26T07:14:08.402 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:08.402 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:08.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:08.460 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.27 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:08.528 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:08.528 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:08.529 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010315 s, 102 MB/s 2023-11-26T07:14:08.529 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:08.529 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:08.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:08.586 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.28 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:08.655 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:08.655 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:08.655 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101614 s, 103 MB/s 2023-11-26T07:14:08.656 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:08.656 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:08.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:08.715 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.29 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:08.783 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:08.783 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:08.783 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105172 s, 99.7 MB/s 2023-11-26T07:14:08.783 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:08.784 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:08.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:08.842 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.30 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:08.910 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:08.910 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:08.910 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00970113 s, 108 MB/s 2023-11-26T07:14:08.910 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:08.910 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:08.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:08.967 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.31 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:09.035 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:09.035 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:09.035 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101094 s, 104 MB/s 2023-11-26T07:14:09.036 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:09.036 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:09.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:09.095 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.32 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:09.165 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:09.166 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:09.166 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133934 s, 78.3 MB/s 2023-11-26T07:14:09.167 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:09.167 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:09.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:09.224 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.33 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:09.290 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:09.291 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:09.291 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00849056 s, 123 MB/s 2023-11-26T07:14:09.291 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:09.292 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:09.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:09.349 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.34 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:09.418 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:09.418 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:09.418 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100509 s, 104 MB/s 2023-11-26T07:14:09.418 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:09.418 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:09.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:09.476 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.35 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:09.545 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:09.546 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:09.546 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116596 s, 89.9 MB/s 2023-11-26T07:14:09.546 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:09.547 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:09.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:09.604 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.36 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:09.673 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:09.673 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:09.673 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010474 s, 100 MB/s 2023-11-26T07:14:09.674 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:09.674 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:09.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:09.731 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.37 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:09.797 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:09.798 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:09.798 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0097506 s, 108 MB/s 2023-11-26T07:14:09.799 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:09.799 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:09.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:09.856 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.38 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:09.926 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:09.926 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:09.926 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118853 s, 88.2 MB/s 2023-11-26T07:14:09.927 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:09.927 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:09.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:09.985 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.39 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:10.052 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:10.052 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:10.052 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00869139 s, 121 MB/s 2023-11-26T07:14:10.053 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:10.053 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:10.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:10.110 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.40 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:10.176 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:10.176 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:10.176 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00807589 s, 130 MB/s 2023-11-26T07:14:10.177 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:10.177 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:10.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:10.236 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.41 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:10.303 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:10.303 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:10.304 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105093 s, 99.8 MB/s 2023-11-26T07:14:10.304 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:10.305 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:10.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:10.363 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.42 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:10.431 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:10.431 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:10.431 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00977818 s, 107 MB/s 2023-11-26T07:14:10.432 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:10.432 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:10.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:10.490 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.43 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:10.556 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:10.557 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:10.557 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00905996 s, 116 MB/s 2023-11-26T07:14:10.557 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:10.557 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:10.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:10.615 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.44 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:10.683 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:10.683 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:10.683 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100231 s, 105 MB/s 2023-11-26T07:14:10.684 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:10.684 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:10.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:10.743 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.45 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:10.809 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:10.809 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:10.809 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00875349 s, 120 MB/s 2023-11-26T07:14:10.810 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:10.810 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:10.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:10.869 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.46 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:10.935 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:10.935 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:10.935 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00817306 s, 128 MB/s 2023-11-26T07:14:10.935 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:10.936 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:10.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:10.993 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.47 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:11.061 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:11.061 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:11.061 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100812 s, 104 MB/s 2023-11-26T07:14:11.062 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:11.063 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:11.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:11.121 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.48 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:11.187 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:11.187 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:11.187 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007985 s, 131 MB/s 2023-11-26T07:14:11.188 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:11.189 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:11.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:11.246 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.49 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:11.313 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:11.314 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:11.314 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.008233 s, 127 MB/s 2023-11-26T07:14:11.314 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:11.314 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:11.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:11.371 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.50 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:11.439 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:11.439 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:11.439 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101065 s, 104 MB/s 2023-11-26T07:14:11.440 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:11.440 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:11.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:11.498 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.51 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:11.567 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:11.567 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:11.567 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101655 s, 103 MB/s 2023-11-26T07:14:11.568 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:11.568 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:11.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:11.626 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.52 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:11.692 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:11.692 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:11.692 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00835093 s, 126 MB/s 2023-11-26T07:14:11.693 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:11.693 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:11.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:11.751 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.53 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:11.819 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:11.819 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:11.819 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00976433 s, 107 MB/s 2023-11-26T07:14:11.820 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:11.820 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:11.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:11.878 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.54 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:11.947 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:11.947 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:11.947 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112886 s, 92.9 MB/s 2023-11-26T07:14:11.948 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:11.948 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:12.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:12.006 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.55 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:12.074 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:12.074 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:12.074 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102213 s, 103 MB/s 2023-11-26T07:14:12.075 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:12.075 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:12.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:12.133 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.56 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:12.201 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:12.201 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:12.201 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100831 s, 104 MB/s 2023-11-26T07:14:12.202 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:12.202 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:12.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:12.260 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.57 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:12.328 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:12.328 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:12.328 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108658 s, 96.5 MB/s 2023-11-26T07:14:12.329 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:12.329 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:12.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:12.386 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.58 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:12.455 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:12.455 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:12.455 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100788 s, 104 MB/s 2023-11-26T07:14:12.456 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:12.456 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:12.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:12.514 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.59 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:12.582 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:12.583 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:12.583 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00985509 s, 106 MB/s 2023-11-26T07:14:12.583 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:12.584 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:12.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:12.641 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.60 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:12.708 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:12.708 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:12.709 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00970693 s, 108 MB/s 2023-11-26T07:14:12.709 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:12.709 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:12.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:12.767 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.61 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:12.836 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:12.836 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:12.836 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011589 s, 90.5 MB/s 2023-11-26T07:14:12.837 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:12.837 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:12.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:12.895 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.62 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:12.963 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:12.963 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:12.964 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00989102 s, 106 MB/s 2023-11-26T07:14:12.964 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:12.965 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:13.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:13.022 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.63 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:13.092 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:13.092 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:13.092 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114409 s, 91.7 MB/s 2023-11-26T07:14:13.092 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:13.092 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:13.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:13.150 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.64 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:13.216 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:13.216 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:13.216 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00920399 s, 114 MB/s 2023-11-26T07:14:13.217 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:13.217 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:13.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:13.276 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.65 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:13.343 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:13.343 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:13.343 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010011 s, 105 MB/s 2023-11-26T07:14:13.344 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:13.344 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:13.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:13.403 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.66 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:13.469 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:13.469 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:13.469 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00884067 s, 119 MB/s 2023-11-26T07:14:13.470 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:13.470 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:13.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:13.528 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.67 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:13.596 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:13.596 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:13.597 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010158 s, 103 MB/s 2023-11-26T07:14:13.597 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:13.597 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:13.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:13.655 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.68 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:13.722 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:13.722 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:13.722 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104444 s, 100 MB/s 2023-11-26T07:14:13.723 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:13.723 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:13.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:13.781 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.69 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:13.850 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:13.850 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:13.850 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010515 s, 99.7 MB/s 2023-11-26T07:14:13.851 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:13.851 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:13.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:13.908 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.70 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:13.973 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:13.973 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:13.974 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00828223 s, 127 MB/s 2023-11-26T07:14:13.975 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:13.975 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:14.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:14.032 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.71 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:14.100 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:14.100 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:14.101 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010408 s, 101 MB/s 2023-11-26T07:14:14.101 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:14.102 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:14.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:14.159 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.72 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:14.227 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:14.227 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:14.227 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00972505 s, 108 MB/s 2023-11-26T07:14:14.228 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:14.228 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:14.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:14.286 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.73 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:14.351 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:14.351 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:14.351 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00826066 s, 127 MB/s 2023-11-26T07:14:14.352 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:14.352 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:14.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:14.410 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.74 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:14.478 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:14.478 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:14.478 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00994291 s, 105 MB/s 2023-11-26T07:14:14.479 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:14.479 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:14.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:14.536 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.75 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:14.605 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:14.605 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:14.605 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00991917 s, 106 MB/s 2023-11-26T07:14:14.605 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:14.605 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:14.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:14.664 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.76 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:14.731 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:14.731 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:14.731 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00965786 s, 109 MB/s 2023-11-26T07:14:14.732 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:14.732 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:14.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:14.789 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.77 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:14.857 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:14.857 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:14.857 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00980844 s, 107 MB/s 2023-11-26T07:14:14.857 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:14.858 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:14.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:14.915 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.78 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:14.983 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:14.983 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:14.984 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.009767 s, 107 MB/s 2023-11-26T07:14:14.984 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:14.984 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:15.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:15.042 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.79 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:15.112 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:15.112 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:15.113 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132481 s, 79.1 MB/s 2023-11-26T07:14:15.113 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:15.113 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:15.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:15.172 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.80 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:15.241 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:15.241 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:15.241 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117718 s, 89.1 MB/s 2023-11-26T07:14:15.242 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:15.242 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:15.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:15.309 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.81 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:15.366 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:15.366 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:15.366 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00950803 s, 110 MB/s 2023-11-26T07:14:15.367 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:15.367 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:15.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:15.425 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.82 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:15.494 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:15.494 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:15.494 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00990572 s, 106 MB/s 2023-11-26T07:14:15.494 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:15.494 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:15.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:15.551 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.83 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:15.619 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:15.620 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:15.620 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00942477 s, 111 MB/s 2023-11-26T07:14:15.620 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:15.620 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:15.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:15.677 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.84 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:15.744 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:15.744 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:15.744 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00965099 s, 109 MB/s 2023-11-26T07:14:15.745 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:15.745 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:15.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:15.803 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.85 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:15.871 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:15.871 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:15.871 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00912615 s, 115 MB/s 2023-11-26T07:14:15.871 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:15.871 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:15.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:15.928 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.86 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:15.994 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:15.995 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:15.995 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00860767 s, 122 MB/s 2023-11-26T07:14:15.995 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:15.996 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:16.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:16.053 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.87 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:16.119 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:16.119 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:16.119 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00804839 s, 130 MB/s 2023-11-26T07:14:16.120 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:16.120 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:16.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:16.178 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.88 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:16.244 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:16.245 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:16.245 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00871741 s, 120 MB/s 2023-11-26T07:14:16.245 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:16.245 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:16.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:16.303 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.89 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:16.369 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:16.369 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:16.370 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00949804 s, 110 MB/s 2023-11-26T07:14:16.371 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:16.371 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:16.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:16.428 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.90 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:16.496 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:16.496 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:16.496 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101106 s, 104 MB/s 2023-11-26T07:14:16.497 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:16.497 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:16.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:16.556 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.91 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:16.623 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:16.624 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:16.624 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00952518 s, 110 MB/s 2023-11-26T07:14:16.624 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:16.624 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:16.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:16.681 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.92 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:16.749 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:16.749 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:16.749 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00986296 s, 106 MB/s 2023-11-26T07:14:16.750 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:16.750 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:16.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:16.809 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.93 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:16.877 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:16.877 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:16.877 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00979266 s, 107 MB/s 2023-11-26T07:14:16.877 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:16.877 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:16.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:16.934 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.94 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:17.003 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:17.003 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:17.003 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101881 s, 103 MB/s 2023-11-26T07:14:17.003 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:17.003 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:17.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:17.060 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.95 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:17.127 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:17.127 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:17.128 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00867087 s, 121 MB/s 2023-11-26T07:14:17.128 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:17.128 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:17.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:17.185 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.96 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:17.252 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:17.252 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:17.252 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00925573 s, 113 MB/s 2023-11-26T07:14:17.253 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:17.253 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:17.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:17.311 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.97 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:17.379 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:17.379 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:17.379 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00994497 s, 105 MB/s 2023-11-26T07:14:17.380 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:17.380 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:17.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:17.438 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.98 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:17.505 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:17.505 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:17.506 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00939573 s, 112 MB/s 2023-11-26T07:14:17.506 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:17.507 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:17.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:17.565 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.99 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:17.633 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:17.633 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:17.634 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00990068 s, 106 MB/s 2023-11-26T07:14:17.635 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:17.635 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:17.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:17.692 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.100 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:17.758 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:17.758 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:17.758 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00863182 s, 121 MB/s 2023-11-26T07:14:17.759 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:17.759 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:17.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:17.817 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.101 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:17.884 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:17.884 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:17.884 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00889421 s, 118 MB/s 2023-11-26T07:14:17.885 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:17.885 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:17.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:17.943 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.102 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:18.009 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:18.009 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:18.009 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00830388 s, 126 MB/s 2023-11-26T07:14:18.010 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:18.010 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:18.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:18.067 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.103 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:18.133 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:18.134 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:18.134 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00819724 s, 128 MB/s 2023-11-26T07:14:18.135 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:18.135 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:18.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:18.192 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.104 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:18.258 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:18.258 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:18.258 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00827967 s, 127 MB/s 2023-11-26T07:14:18.259 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:18.259 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:18.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:18.318 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.105 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:18.384 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:18.384 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:18.384 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00823145 s, 127 MB/s 2023-11-26T07:14:18.385 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:18.385 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:18.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:18.443 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.106 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:18.512 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:18.512 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:18.512 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104994 s, 99.9 MB/s 2023-11-26T07:14:18.513 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:18.513 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:18.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:18.570 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.107 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:18.638 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:18.638 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:18.638 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00846799 s, 124 MB/s 2023-11-26T07:14:18.638 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:18.638 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:18.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:18.697 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.108 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:18.765 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:18.765 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:18.765 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107936 s, 97.1 MB/s 2023-11-26T07:14:18.766 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:18.766 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:18.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:18.823 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.109 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:18.890 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:18.890 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:18.890 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00933063 s, 112 MB/s 2023-11-26T07:14:18.891 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:18.891 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:18.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:18.950 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.110 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:19.018 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:19.018 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:19.018 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109134 s, 96.1 MB/s 2023-11-26T07:14:19.019 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:19.019 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:19.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:19.078 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.111 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:19.144 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:19.145 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:19.145 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00910571 s, 115 MB/s 2023-11-26T07:14:19.145 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:19.145 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:19.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:19.203 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.112 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:19.274 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:19.274 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:19.274 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121945 s, 86.0 MB/s 2023-11-26T07:14:19.274 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:19.275 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:19.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:19.332 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.113 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:19.400 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:19.400 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:19.400 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00936398 s, 112 MB/s 2023-11-26T07:14:19.400 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:19.400 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:19.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:19.459 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.114 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:19.525 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:19.525 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:19.525 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00846096 s, 124 MB/s 2023-11-26T07:14:19.526 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:19.526 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:19.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:19.584 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.115 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:19.652 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:19.652 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:19.652 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105517 s, 99.4 MB/s 2023-11-26T07:14:19.653 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:19.653 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:19.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:19.711 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.116 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:19.779 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:19.779 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:19.779 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101413 s, 103 MB/s 2023-11-26T07:14:19.780 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:19.780 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:19.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:19.839 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.117 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:19.907 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:19.907 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:19.908 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104496 s, 100 MB/s 2023-11-26T07:14:19.908 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:19.909 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:19.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:19.967 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.118 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:20.034 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:20.034 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:20.035 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00987495 s, 106 MB/s 2023-11-26T07:14:20.035 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:20.035 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:20.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:20.092 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.119 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:20.159 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:20.160 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:20.160 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00972695 s, 108 MB/s 2023-11-26T07:14:20.160 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:20.161 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:20.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:20.218 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.120 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:20.285 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:20.285 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:20.285 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00919629 s, 114 MB/s 2023-11-26T07:14:20.286 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:20.286 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:20.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:20.343 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.121 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:20.409 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:20.409 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:20.409 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00823712 s, 127 MB/s 2023-11-26T07:14:20.410 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:20.410 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:20.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:20.469 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.122 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:20.537 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:20.537 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:20.538 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113115 s, 92.7 MB/s 2023-11-26T07:14:20.538 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:20.539 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:20.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:20.597 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.123 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:20.664 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:20.664 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:20.664 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00951299 s, 110 MB/s 2023-11-26T07:14:20.665 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:20.665 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:20.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:20.724 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.124 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:20.789 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:20.790 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:20.790 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00833523 s, 126 MB/s 2023-11-26T07:14:20.790 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:20.790 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:20.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:20.847 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.125 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:20.914 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:20.914 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:20.914 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00899277 s, 117 MB/s 2023-11-26T07:14:20.915 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:20.915 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:20.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:20.973 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.126 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:21.041 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:21.041 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:21.041 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101097 s, 104 MB/s 2023-11-26T07:14:21.041 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:21.041 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:21.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:21.099 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.127 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:21.165 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:21.165 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:21.165 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00918387 s, 114 MB/s 2023-11-26T07:14:21.166 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:21.166 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:21.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:21.224 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.128 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:21.292 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:21.292 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:21.292 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100544 s, 104 MB/s 2023-11-26T07:14:21.293 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:21.293 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:21.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:21.351 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.129 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:21.418 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:21.418 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:21.418 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00946469 s, 111 MB/s 2023-11-26T07:14:21.419 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:21.419 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:21.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:21.478 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.130 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:21.547 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:21.547 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:21.547 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120909 s, 86.7 MB/s 2023-11-26T07:14:21.548 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:21.548 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:21.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:21.606 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.131 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:21.675 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:21.675 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:21.675 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102541 s, 102 MB/s 2023-11-26T07:14:21.676 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:21.676 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:21.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:21.734 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.132 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:21.801 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:21.801 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:21.801 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00882026 s, 119 MB/s 2023-11-26T07:14:21.802 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:21.802 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:21.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:21.859 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.133 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:21.925 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:21.925 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:21.926 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0089208 s, 118 MB/s 2023-11-26T07:14:21.926 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:21.927 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:21.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:21.985 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.134 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:22.051 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:22.051 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:22.051 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00898825 s, 117 MB/s 2023-11-26T07:14:22.052 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:22.052 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:22.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:22.109 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.135 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:22.176 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:22.176 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:22.176 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0087118 s, 120 MB/s 2023-11-26T07:14:22.177 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:22.177 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:22.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:22.235 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.136 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:22.303 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:22.303 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:22.304 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102816 s, 102 MB/s 2023-11-26T07:14:22.305 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:22.305 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:22.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:22.362 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.137 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:22.429 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:22.429 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:22.429 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00867491 s, 121 MB/s 2023-11-26T07:14:22.430 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:22.430 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:22.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:22.487 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.138 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:22.555 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:22.555 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:22.555 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0099987 s, 105 MB/s 2023-11-26T07:14:22.556 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:22.556 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:22.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:22.615 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.139 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:22.683 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:22.683 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:22.683 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00963744 s, 109 MB/s 2023-11-26T07:14:22.683 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:22.683 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:22.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:22.740 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.140 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:22.809 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:22.809 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:22.809 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115161 s, 91.1 MB/s 2023-11-26T07:14:22.810 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:22.810 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:22.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:22.869 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.141 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:22.938 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:22.938 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:22.938 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012227 s, 85.8 MB/s 2023-11-26T07:14:22.939 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:22.940 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:22.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:22.997 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.142 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:23.065 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:23.065 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:23.065 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00972066 s, 108 MB/s 2023-11-26T07:14:23.066 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:23.066 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:23.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:23.124 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.143 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:23.192 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:23.192 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:23.192 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010696 s, 98.0 MB/s 2023-11-26T07:14:23.193 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:23.193 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:23.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:23.252 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.144 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:23.319 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:23.320 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:23.320 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00963858 s, 109 MB/s 2023-11-26T07:14:23.320 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:23.320 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:23.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:23.377 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.145 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:23.454 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:23.454 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:23.454 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159397 s, 65.8 MB/s 2023-11-26T07:14:23.454 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:23.454 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:23.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:23.511 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.146 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:23.578 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:23.578 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:23.579 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00900367 s, 116 MB/s 2023-11-26T07:14:23.579 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:23.580 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:23.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:23.638 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.147 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:23.705 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:23.705 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:23.705 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0093832 s, 112 MB/s 2023-11-26T07:14:23.706 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:23.706 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:23.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:23.764 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.148 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:23.834 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:23.834 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:23.834 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125469 s, 83.6 MB/s 2023-11-26T07:14:23.835 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:23.835 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:23.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:23.893 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.149 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:23.961 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:23.961 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:23.961 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00994737 s, 105 MB/s 2023-11-26T07:14:23.962 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:23.962 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:24.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:24.021 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.150 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:24.088 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:24.089 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:24.089 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103012 s, 102 MB/s 2023-11-26T07:14:24.090 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:24.090 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:24.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:24.147 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.151 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:24.216 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:24.216 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:24.216 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109114 s, 96.1 MB/s 2023-11-26T07:14:24.217 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:24.217 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:24.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:24.275 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.152 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:24.344 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:24.344 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:24.344 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010462 s, 100 MB/s 2023-11-26T07:14:24.344 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:24.345 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:24.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:24.402 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.153 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:24.471 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:24.471 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:24.471 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101307 s, 104 MB/s 2023-11-26T07:14:24.472 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:24.472 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:24.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:24.530 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.154 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:24.598 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:24.598 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:24.598 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102549 s, 102 MB/s 2023-11-26T07:14:24.599 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:24.599 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:24.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:24.657 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.155 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:24.726 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:24.726 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:24.726 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106687 s, 98.3 MB/s 2023-11-26T07:14:24.726 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:24.726 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:24.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:24.783 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.156 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:24.854 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:24.854 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:24.854 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118632 s, 88.4 MB/s 2023-11-26T07:14:24.854 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:24.854 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:24.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:24.912 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.157 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:24.979 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:24.979 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:24.979 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102798 s, 102 MB/s 2023-11-26T07:14:24.980 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:24.980 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:25.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:25.038 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.158 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:25.108 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:25.108 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:25.108 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011286 s, 92.9 MB/s 2023-11-26T07:14:25.109 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:25.109 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:25.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:25.167 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.159 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:25.233 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:25.233 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:25.233 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00823232 s, 127 MB/s 2023-11-26T07:14:25.233 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:25.233 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:25.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:25.292 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.160 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:25.360 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:25.360 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:25.361 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00955407 s, 110 MB/s 2023-11-26T07:14:25.361 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:25.361 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:25.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:25.418 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.161 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:25.485 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:25.485 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:25.485 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00893295 s, 117 MB/s 2023-11-26T07:14:25.486 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:25.487 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:25.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:25.544 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.162 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:25.613 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:25.613 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:25.613 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103623 s, 101 MB/s 2023-11-26T07:14:25.613 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:25.614 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:25.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:25.672 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.163 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:25.739 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:25.739 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:25.739 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00963104 s, 109 MB/s 2023-11-26T07:14:25.740 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:25.740 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:25.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:25.798 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.164 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:25.867 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:25.868 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:25.868 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121123 s, 86.6 MB/s 2023-11-26T07:14:25.869 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:25.869 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:25.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:25.927 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.165 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:25.992 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:25.992 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:25.993 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00820579 s, 128 MB/s 2023-11-26T07:14:25.994 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:25.994 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:26.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:26.051 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.166 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:26.119 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:26.119 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:26.119 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00997566 s, 105 MB/s 2023-11-26T07:14:26.120 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:26.120 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:26.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:26.179 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.167 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:26.246 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:26.246 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:26.246 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00960021 s, 109 MB/s 2023-11-26T07:14:26.247 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:26.247 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:26.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:26.306 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.168 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:26.373 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:26.373 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:26.373 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00979695 s, 107 MB/s 2023-11-26T07:14:26.374 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:26.374 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:26.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:26.433 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.169 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:26.501 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:26.501 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:26.501 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00993269 s, 106 MB/s 2023-11-26T07:14:26.501 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:26.501 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:26.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:26.559 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.170 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:26.626 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:26.626 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:26.627 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00951443 s, 110 MB/s 2023-11-26T07:14:26.627 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:26.628 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:26.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:26.686 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.171 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:26.753 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:26.753 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:26.753 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100606 s, 104 MB/s 2023-11-26T07:14:26.754 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:26.754 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:26.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:26.812 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.172 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:26.881 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:26.881 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:26.881 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114565 s, 91.5 MB/s 2023-11-26T07:14:26.882 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:26.882 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:26.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:26.940 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.173 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:27.007 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:27.007 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:27.007 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0095755 s, 110 MB/s 2023-11-26T07:14:27.008 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:27.008 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:27.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:27.066 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.174 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:27.135 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:27.135 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:27.135 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107344 s, 97.7 MB/s 2023-11-26T07:14:27.136 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:27.136 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:27.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:27.194 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.175 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:27.261 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:27.261 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:27.261 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00836173 s, 125 MB/s 2023-11-26T07:14:27.262 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:27.262 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:27.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:27.319 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.176 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:27.386 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:27.386 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:27.386 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00865709 s, 121 MB/s 2023-11-26T07:14:27.387 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:27.387 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:27.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:27.446 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.177 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:27.513 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:27.513 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:27.513 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00939689 s, 112 MB/s 2023-11-26T07:14:27.513 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:27.513 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:27.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:27.571 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.178 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:27.637 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:27.637 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:27.637 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00877994 s, 119 MB/s 2023-11-26T07:14:27.638 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:27.638 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:27.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:27.695 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.179 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:27.762 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:27.762 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:27.762 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00933215 s, 112 MB/s 2023-11-26T07:14:27.763 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:27.763 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:27.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:27.821 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.180 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:27.888 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:27.888 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:27.888 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00899654 s, 117 MB/s 2023-11-26T07:14:27.889 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:27.889 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:27.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:27.947 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.181 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:28.013 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:28.013 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:28.013 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00796179 s, 132 MB/s 2023-11-26T07:14:28.014 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:28.014 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:28.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:28.072 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.182 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:28.138 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:28.138 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:28.138 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00843293 s, 124 MB/s 2023-11-26T07:14:28.139 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:28.139 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:28.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:28.197 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.183 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:28.265 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:28.265 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:28.266 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115648 s, 90.7 MB/s 2023-11-26T07:14:28.266 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:28.267 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:28.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:28.324 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.184 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:28.389 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:28.389 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:28.390 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00800516 s, 131 MB/s 2023-11-26T07:14:28.390 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:28.391 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:28.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:28.448 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.185 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:28.515 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:28.515 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:28.515 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.008151 s, 129 MB/s 2023-11-26T07:14:28.515 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:28.515 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:28.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:28.573 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.186 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:28.640 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:28.641 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:28.641 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00955468 s, 110 MB/s 2023-11-26T07:14:28.642 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:28.642 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:28.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:28.699 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.187 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:28.768 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:28.768 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:28.768 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00997476 s, 105 MB/s 2023-11-26T07:14:28.769 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:28.769 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:28.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:28.827 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.188 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:28.895 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:28.895 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:28.895 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103166 s, 102 MB/s 2023-11-26T07:14:28.896 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:28.896 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:28.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:28.954 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.189 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:29.024 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:29.024 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:29.024 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117445 s, 89.3 MB/s 2023-11-26T07:14:29.025 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:29.025 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:29.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:29.082 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.190 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:29.147 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:29.147 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:29.148 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00830412 s, 126 MB/s 2023-11-26T07:14:29.148 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:29.148 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:29.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:29.206 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.191 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:29.272 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:29.272 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:29.272 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00862563 s, 122 MB/s 2023-11-26T07:14:29.273 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:29.273 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:29.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:29.332 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.192 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:29.398 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:29.398 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:29.398 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00916654 s, 114 MB/s 2023-11-26T07:14:29.399 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:29.399 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:29.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:29.457 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.193 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:29.526 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:29.526 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:29.526 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112826 s, 92.9 MB/s 2023-11-26T07:14:29.527 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:29.527 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:29.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:29.585 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.194 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:29.651 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:29.651 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:29.651 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00871714 s, 120 MB/s 2023-11-26T07:14:29.652 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:29.652 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:29.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:29.711 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.195 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:29.777 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:29.777 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:29.777 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00818427 s, 128 MB/s 2023-11-26T07:14:29.778 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:29.778 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:29.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:29.835 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.196 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:29.905 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:29.905 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:29.905 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118973 s, 88.1 MB/s 2023-11-26T07:14:29.906 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:29.906 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:29.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:29.963 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.197 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:30.030 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:30.030 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:30.030 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00902896 s, 116 MB/s 2023-11-26T07:14:30.031 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:30.031 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:30.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:30.088 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.198 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:30.156 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:30.156 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:30.157 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105375 s, 99.5 MB/s 2023-11-26T07:14:30.157 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:30.158 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:30.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:30.215 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol96280/5c6c6fc8-9c27-4bd0-9de8-3891fd52de38/subvolume_file.199 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:14:30.283 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:14:30.283 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:14:30.283 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0099737 s, 105 MB/s 2023-11-26T07:14:30.284 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs subvol96280 subvol_snap26280 2023-11-26T07:14:30.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.451+0000 7fe67f50e700 1 Processor -- start 2023-11-26T07:14:30.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.451+0000 7fe67f50e700 1 -- start start 2023-11-26T07:14:30.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.452+0000 7fe67f50e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe67806b620 0x7fe6780b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:30.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.452+0000 7fe67f50e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe67806ee60 0x7fe6780b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:30.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.452+0000 7fe67f50e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe678071f50 con 0x7fe6780b5ab0 2023-11-26T07:14:30.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.452+0000 7fe67f50e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe678072230 con 0x7fe67806b620 2023-11-26T07:14:30.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.452+0000 7fe67f50e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe678072510 con 0x7fe67806ee60 2023-11-26T07:14:30.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.452+0000 7fe67d2aa700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe67806b620 0x7fe6780b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:30.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.452+0000 7fe67caa9700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe6780b5ab0 0x7fe678161ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33422/0 (socket says 172.21.15.2:33422) 2023-11-26T07:14:30.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.452+0000 7fe67caa9700 1 -- 172.21.15.2:0/18869205 learned_addr learned my addr 172.21.15.2:0/18869205 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:14:30.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.452+0000 7fe67d2aa700 1 -- 172.21.15.2:0/18869205 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe67806ee60 msgr2=0x7fe6780b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:30.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.452+0000 7fe67d2aa700 1 --2- 172.21.15.2:0/18869205 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe67806ee60 0x7fe6780b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:30.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.452+0000 7fe67d2aa700 1 -- 172.21.15.2:0/18869205 >> v1:172.21.15.2:6789/0 conn(0x7fe6780b5ab0 legacy=0x7fe678161ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:30.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.452+0000 7fe66ffff700 1 -- 172.21.15.2:0/18869205 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3161706356 0 0) 0x7fe678071f50 con 0x7fe6780b5ab0 2023-11-26T07:14:30.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.452+0000 7fe67d2aa700 1 -- 172.21.15.2:0/18869205 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6780727f0 con 0x7fe67806b620 2023-11-26T07:14:30.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.453+0000 7fe67d2aa700 1 --2- 172.21.15.2:0/18869205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe67806b620 0x7fe6780b3a40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fe668009840 tx=0x7fe668009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c5678f3111e77e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:30.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.453+0000 7fe66ffff700 1 -- 172.21.15.2:0/18869205 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe668011830 con 0x7fe67806b620 2023-11-26T07:14:30.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.453+0000 7fe66ffff700 1 -- 172.21.15.2:0/18869205 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe668011990 con 0x7fe67806b620 2023-11-26T07:14:30.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.453+0000 7fe66ffff700 1 -- 172.21.15.2:0/18869205 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe668011d20 con 0x7fe67806b620 2023-11-26T07:14:30.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.453+0000 7fe67f50e700 1 -- 172.21.15.2:0/18869205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe67806b620 msgr2=0x7fe6780b3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:30.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.453+0000 7fe67f50e700 1 --2- 172.21.15.2:0/18869205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe67806b620 0x7fe6780b3a40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fe668009840 tx=0x7fe668009b50 comp rx=0 tx=0).stop 2023-11-26T07:14:30.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.454+0000 7fe67f50e700 1 -- 172.21.15.2:0/18869205 shutdown_connections 2023-11-26T07:14:30.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.454+0000 7fe67f50e700 1 --2- 172.21.15.2:0/18869205 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe67806ee60 0x7fe6780b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:30.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.454+0000 7fe67f50e700 1 --2- 172.21.15.2:0/18869205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe67806b620 0x7fe6780b3a40 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:30.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.454+0000 7fe67f50e700 1 -- 172.21.15.2:0/18869205 >> 172.21.15.2:0/18869205 conn(0x7fe6780b2740 msgr2=0x7fe6780b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:30.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.454+0000 7fe67f50e700 1 -- 172.21.15.2:0/18869205 shutdown_connections 2023-11-26T07:14:30.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.454+0000 7fe67f50e700 1 -- 172.21.15.2:0/18869205 wait complete. 2023-11-26T07:14:30.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.455+0000 7fe67f50e700 1 Processor -- start 2023-11-26T07:14:30.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.455+0000 7fe67f50e700 1 -- start start 2023-11-26T07:14:30.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.456+0000 7fe67f50e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe67806b620 0x7fe678141720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:30.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.456+0000 7fe67f50e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe67806ee60 0x7fe6781e59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:30.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.456+0000 7fe67f50e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6780b5ab0 0x7fe678144220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:30.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.456+0000 7fe67f50e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6781e6a40 con 0x7fe6780b5ab0 2023-11-26T07:14:30.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.456+0000 7fe67f50e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe678141c60 con 0x7fe67806b620 2023-11-26T07:14:30.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.456+0000 7fe67f50e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6781e6480 con 0x7fe67806ee60 2023-11-26T07:14:30.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.456+0000 7fe67daab700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6780b5ab0 0x7fe678144220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:30.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.456+0000 7fe67daab700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6780b5ab0 0x7fe678144220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42220/0 (socket says 172.21.15.2:42220) 2023-11-26T07:14:30.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.456+0000 7fe67daab700 1 -- 172.21.15.2:0/311631278 learned_addr learned my addr 172.21.15.2:0/311631278 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:30.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.456+0000 7fe67caa9700 1 --2- 172.21.15.2:0/311631278 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe67806ee60 0x7fe6781e59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:30.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.456+0000 7fe67d2aa700 1 --2- 172.21.15.2:0/311631278 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe67806b620 0x7fe678141720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:30.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.456+0000 7fe67daab700 1 -- 172.21.15.2:0/311631278 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe67806ee60 msgr2=0x7fe6781e59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:30.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.456+0000 7fe67daab700 1 --2- 172.21.15.2:0/311631278 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe67806ee60 0x7fe6781e59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:30.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.456+0000 7fe67daab700 1 -- 172.21.15.2:0/311631278 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe67806b620 msgr2=0x7fe678141720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:30.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.456+0000 7fe67daab700 1 --2- 172.21.15.2:0/311631278 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe67806b620 0x7fe678141720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:30.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.456+0000 7fe67daab700 1 -- 172.21.15.2:0/311631278 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6680094a0 con 0x7fe6780b5ab0 2023-11-26T07:14:30.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.456+0000 7fe67daab700 1 --2- 172.21.15.2:0/311631278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6780b5ab0 0x7fe678144220 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fe67000b9e0 tx=0x7fe67000bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:30.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.456+0000 7fe66dffb700 1 -- 172.21.15.2:0/311631278 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67000c9b0 con 0x7fe6780b5ab0 2023-11-26T07:14:30.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.456+0000 7fe66dffb700 1 -- 172.21.15.2:0/311631278 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe67000cb50 con 0x7fe6780b5ab0 2023-11-26T07:14:30.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.456+0000 7fe67f50e700 1 -- 172.21.15.2:0/311631278 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6781e6760 con 0x7fe6780b5ab0 2023-11-26T07:14:30.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.457+0000 7fe66dffb700 1 -- 172.21.15.2:0/311631278 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe670014440 con 0x7fe6780b5ab0 2023-11-26T07:14:30.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.457+0000 7fe67f50e700 1 -- 172.21.15.2:0/311631278 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6781e7490 con 0x7fe6780b5ab0 2023-11-26T07:14:30.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.458+0000 7fe67f50e700 1 -- 172.21.15.2:0/311631278 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe678072d10 con 0x7fe6780b5ab0 2023-11-26T07:14:30.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.458+0000 7fe66dffb700 1 -- 172.21.15.2:0/311631278 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 9) v1 ==== 89537+0+0 (secure 0 0 0) 0x7fe6700145a0 con 0x7fe6780b5ab0 2023-11-26T07:14:30.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.459+0000 7fe66dffb700 1 --2- 172.21.15.2:0/311631278 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe65c06b230 0x7fe65c06d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:30.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.459+0000 7fe66dffb700 1 -- 172.21.15.2:0/311631278 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fe670006e40 con 0x7fe6780b5ab0 2023-11-26T07:14:30.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.459+0000 7fe67d2aa700 1 --2- 172.21.15.2:0/311631278 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe65c06b230 0x7fe65c06d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:30.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.459+0000 7fe67d2aa700 1 --2- 172.21.15.2:0/311631278 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe65c06b230 0x7fe65c06d6f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe6680090b0 tx=0x7fe668008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:30.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.463+0000 7fe66dffb700 1 -- 172.21.15.2:0/311631278 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe670054470 con 0x7fe6780b5ab0 2023-11-26T07:14:30.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.700+0000 7fe67f50e700 1 -- 172.21.15.2:0/311631278 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "subvol96280", "snap_name": "subvol_snap26280", "target": ["mon-mgr", ""]}) v1 -- 0x7fe67806ba00 con 0x7fe65c06b230 2023-11-26T07:14:30.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.724+0000 7fe66dffb700 1 -- 172.21.15.2:0/311631278 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe668011ce0 con 0x7fe65c06b230 2023-11-26T07:14:30.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.726+0000 7fe67f50e700 1 -- 172.21.15.2:0/311631278 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe65c06b230 msgr2=0x7fe65c06d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:30.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.726+0000 7fe67f50e700 1 --2- 172.21.15.2:0/311631278 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe65c06b230 0x7fe65c06d6f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe6680090b0 tx=0x7fe668008030 comp rx=0 tx=0).stop 2023-11-26T07:14:30.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.726+0000 7fe67f50e700 1 -- 172.21.15.2:0/311631278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6780b5ab0 msgr2=0x7fe678144220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:30.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.726+0000 7fe67f50e700 1 --2- 172.21.15.2:0/311631278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6780b5ab0 0x7fe678144220 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fe67000b9e0 tx=0x7fe67000bda0 comp rx=0 tx=0).stop 2023-11-26T07:14:30.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.726+0000 7fe67f50e700 1 -- 172.21.15.2:0/311631278 shutdown_connections 2023-11-26T07:14:30.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.726+0000 7fe67f50e700 1 --2- 172.21.15.2:0/311631278 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe65c06b230 0x7fe65c06d6f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:30.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.726+0000 7fe67f50e700 1 --2- 172.21.15.2:0/311631278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6780b5ab0 0x7fe678144220 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:30.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.727+0000 7fe67f50e700 1 --2- 172.21.15.2:0/311631278 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe67806b620 0x7fe678141720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:30.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.727+0000 7fe67f50e700 1 --2- 172.21.15.2:0/311631278 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe67806ee60 0x7fe6781e59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:30.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.727+0000 7fe67f50e700 1 -- 172.21.15.2:0/311631278 >> 172.21.15.2:0/311631278 conn(0x7fe6780b2740 msgr2=0x7fe6780aef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:30.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.727+0000 7fe67f50e700 1 -- 172.21.15.2:0/311631278 shutdown_connections 2023-11-26T07:14:30.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.727+0000 7fe67f50e700 1 -- 172.21.15.2:0/311631278 wait complete. 2023-11-26T07:14:30.741 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/snapshot_clone_delay 5 2023-11-26T07:14:30.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.866+0000 7f1c12c98700 1 Processor -- start 2023-11-26T07:14:30.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.866+0000 7f1c12c98700 1 -- start start 2023-11-26T07:14:30.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.867+0000 7f1c12c98700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1c0c06b620 0x7f1c0c0b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:30.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.867+0000 7f1c12c98700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c0c0b5ab0 0x7f1c0c0b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:30.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.867+0000 7f1c12c98700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c0c071f50 con 0x7f1c0c1478c0 2023-11-26T07:14:30.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.867+0000 7f1c12c98700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c0c072230 con 0x7f1c0c06b620 2023-11-26T07:14:30.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.867+0000 7f1c12c98700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c072510 con 0x7f1c0c0b5ab0 2023-11-26T07:14:30.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.867+0000 7f1c10a34700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1c0c06b620 0x7f1c0c0b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:30.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.867+0000 7f1c0bfff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c0c0b5ab0 0x7f1c0c0b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:30.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.867+0000 7f1c11235700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f1c0c1478c0 0x7f1c0c161ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.2:40808/0 (socket says 172.21.15.2:40808) 2023-11-26T07:14:30.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.867+0000 7f1c0bfff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c0c0b5ab0 0x7f1c0c0b3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.2:40306/0 (socket says 172.21.15.2:40306) 2023-11-26T07:14:30.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.867+0000 7f1c10a34700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1c0c06b620 0x7f1c0c0b3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.2:50810/0 (socket says 172.21.15.2:50810) 2023-11-26T07:14:30.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.867+0000 7f1c11235700 1 -- 172.21.15.2:0/1625762352 learned_addr learned my addr 172.21.15.2:0/1625762352 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:14:30.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.868+0000 7f1c10a34700 1 -- 172.21.15.2:0/1625762352 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c0c0b5ab0 msgr2=0x7f1c0c0b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:30.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.868+0000 7f1c10a34700 1 --2- 172.21.15.2:0/1625762352 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c0c0b5ab0 0x7f1c0c0b3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:30.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.868+0000 7f1c10a34700 1 -- 172.21.15.2:0/1625762352 >> v1:172.21.15.192:6789/0 conn(0x7f1c0c1478c0 legacy=0x7f1c0c161ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:30.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.868+0000 7f1c10a34700 1 -- 172.21.15.2:0/1625762352 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c0c0727f0 con 0x7f1c0c06b620 2023-11-26T07:14:30.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.868+0000 7f1c0bfff700 1 --2- 172.21.15.2:0/1625762352 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c0c0b5ab0 0x7f1c0c0b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:14:30.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.868+0000 7f1c10a34700 1 --2- 172.21.15.2:0/1625762352 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c0c06b620 0x7f1c0c0b3a40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1c00009840 tx=0x7f1c00009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17cd5e77f8b510c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:30.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.868+0000 7f1c0b7fe700 1 -- 172.21.15.2:0/1625762352 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c00011830 con 0x7f1c0c06b620 2023-11-26T07:14:30.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.868+0000 7f1c0b7fe700 1 -- 172.21.15.2:0/1625762352 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c00011990 con 0x7f1c0c06b620 2023-11-26T07:14:30.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.868+0000 7f1c0b7fe700 1 -- 172.21.15.2:0/1625762352 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c00011d20 con 0x7f1c0c06b620 2023-11-26T07:14:30.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.869+0000 7f1c12c98700 1 -- 172.21.15.2:0/1625762352 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c0c06b620 msgr2=0x7f1c0c0b3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:30.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.869+0000 7f1c12c98700 1 --2- 172.21.15.2:0/1625762352 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c0c06b620 0x7f1c0c0b3a40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1c00009840 tx=0x7f1c00009b50 comp rx=0 tx=0).stop 2023-11-26T07:14:30.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.869+0000 7f1c12c98700 1 -- 172.21.15.2:0/1625762352 shutdown_connections 2023-11-26T07:14:30.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.869+0000 7f1c12c98700 1 --2- 172.21.15.2:0/1625762352 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c0c06b620 0x7f1c0c0b3a40 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:30.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.869+0000 7f1c12c98700 1 --2- 172.21.15.2:0/1625762352 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c0c0b5ab0 0x7f1c0c0b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:30.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.869+0000 7f1c12c98700 1 -- 172.21.15.2:0/1625762352 >> 172.21.15.2:0/1625762352 conn(0x7f1c0c0b2740 msgr2=0x7f1c0c0b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:30.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.869+0000 7f1c12c98700 1 -- 172.21.15.2:0/1625762352 shutdown_connections 2023-11-26T07:14:30.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.869+0000 7f1c12c98700 1 -- 172.21.15.2:0/1625762352 wait complete. 2023-11-26T07:14:30.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.870+0000 7f1c12c98700 1 Processor -- start 2023-11-26T07:14:30.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.870+0000 7f1c12c98700 1 -- start start 2023-11-26T07:14:30.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.871+0000 7f1c12c98700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c0c06b620 0x7f1c0c0cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:30.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.871+0000 7f1c12c98700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c0c0b5ab0 0x7f1c0c0adf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:30.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.871+0000 7f1c12c98700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c0c1478c0 0x7f1c0c1f3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:30.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.871+0000 7f1c12c98700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c1e8640 con 0x7f1c0c06b620 2023-11-26T07:14:30.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.871+0000 7f1c12c98700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c0c7fd0 con 0x7f1c0c1478c0 2023-11-26T07:14:30.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.871+0000 7f1c12c98700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c0c82b0 con 0x7f1c0c0b5ab0 2023-11-26T07:14:30.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.872+0000 7f1c10a34700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c0c06b620 0x7f1c0c0cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:30.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.872+0000 7f1c10a34700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c0c06b620 0x7f1c0c0cfc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42230/0 (socket says 172.21.15.2:42230) 2023-11-26T07:14:30.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.872+0000 7f1c10a34700 1 -- 172.21.15.2:0/514240305 learned_addr learned my addr 172.21.15.2:0/514240305 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:30.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.872+0000 7f1c0bfff700 1 --2- 172.21.15.2:0/514240305 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c0c0b5ab0 0x7f1c0c0adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:30.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.872+0000 7f1c11235700 1 --2- 172.21.15.2:0/514240305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c0c1478c0 0x7f1c0c1f3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:30.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.872+0000 7f1c10a34700 1 -- 172.21.15.2:0/514240305 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c0c0b5ab0 msgr2=0x7f1c0c0adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:30.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.872+0000 7f1c10a34700 1 --2- 172.21.15.2:0/514240305 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c0c0b5ab0 0x7f1c0c0adf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:30.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.872+0000 7f1c10a34700 1 -- 172.21.15.2:0/514240305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c0c1478c0 msgr2=0x7f1c0c1f3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:30.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.872+0000 7f1c10a34700 1 --2- 172.21.15.2:0/514240305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c0c1478c0 0x7f1c0c1f3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:30.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.872+0000 7f1c10a34700 1 -- 172.21.15.2:0/514240305 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf80094a0 con 0x7f1c0c06b620 2023-11-26T07:14:30.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.872+0000 7f1c10a34700 1 --2- 172.21.15.2:0/514240305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c0c06b620 0x7f1c0c0cfc90 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1c00000c00 tx=0x7f1c00004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:30.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.872+0000 7f1c097fa700 1 -- 172.21.15.2:0/514240305 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c000036a0 con 0x7f1c0c06b620 2023-11-26T07:14:30.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.872+0000 7f1c097fa700 1 -- 172.21.15.2:0/514240305 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c0001f070 con 0x7f1c0c06b620 2023-11-26T07:14:30.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.872+0000 7f1c12c98700 1 -- 172.21.15.2:0/514240305 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c000094a0 con 0x7f1c0c06b620 2023-11-26T07:14:30.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.872+0000 7f1c097fa700 1 -- 172.21.15.2:0/514240305 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c00003a60 con 0x7f1c0c06b620 2023-11-26T07:14:30.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.872+0000 7f1c12c98700 1 -- 172.21.15.2:0/514240305 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c0c0c8870 con 0x7f1c0c06b620 2023-11-26T07:14:30.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.873+0000 7f1c12c98700 1 -- 172.21.15.2:0/514240305 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c0c0c8ec0 con 0x7f1c0c06b620 2023-11-26T07:14:30.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.874+0000 7f1c097fa700 1 -- 172.21.15.2:0/514240305 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 9) v1 ==== 89537+0+0 (secure 0 0 0) 0x7f1c00003bc0 con 0x7f1c0c06b620 2023-11-26T07:14:30.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.874+0000 7f1c097fa700 1 --2- 172.21.15.2:0/514240305 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f1bf006b230 0x7f1bf006d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:30.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.874+0000 7f1c097fa700 1 -- 172.21.15.2:0/514240305 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f1c00021070 con 0x7f1c0c06b620 2023-11-26T07:14:30.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.874+0000 7f1c0bfff700 1 --2- 172.21.15.2:0/514240305 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f1bf006b230 0x7f1bf006d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:30.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.875+0000 7f1c0bfff700 1 --2- 172.21.15.2:0/514240305 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f1bf006b230 0x7f1bf006d6f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c0b5f10 tx=0x7f1bf8009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:30.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:30.879+0000 7f1c097fa700 1 -- 172.21.15.2:0/514240305 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1c00056000 con 0x7f1c0c06b620 2023-11-26T07:14:31.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.081+0000 7f1c12c98700 1 -- 172.21.15.2:0/514240305 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}] v 0) v1 -- 0x7f1c0c075480 con 0x7f1c0c06b620 2023-11-26T07:14:31.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.084+0000 7f1c097fa700 1 -- 172.21.15.2:0/514240305 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}]=0 v15)=0 v15) v1 ==== 130+0+0 (secure 0 0 0) 0x7f1c00059620 con 0x7f1c0c06b620 2023-11-26T07:14:31.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.086+0000 7f1c12c98700 1 -- 172.21.15.2:0/514240305 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f1bf006b230 msgr2=0x7f1bf006d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:31.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.086+0000 7f1c12c98700 1 --2- 172.21.15.2:0/514240305 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f1bf006b230 0x7f1bf006d6f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c0b5f10 tx=0x7f1bf8009210 comp rx=0 tx=0).stop 2023-11-26T07:14:31.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.086+0000 7f1c12c98700 1 -- 172.21.15.2:0/514240305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c0c06b620 msgr2=0x7f1c0c0cfc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:31.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.086+0000 7f1c12c98700 1 --2- 172.21.15.2:0/514240305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c0c06b620 0x7f1c0c0cfc90 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1c00000c00 tx=0x7f1c00004750 comp rx=0 tx=0).stop 2023-11-26T07:14:31.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.086+0000 7f1c12c98700 1 -- 172.21.15.2:0/514240305 shutdown_connections 2023-11-26T07:14:31.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.086+0000 7f1c12c98700 1 --2- 172.21.15.2:0/514240305 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f1bf006b230 0x7f1bf006d6f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:31.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.086+0000 7f1c12c98700 1 --2- 172.21.15.2:0/514240305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c0c1478c0 0x7f1c0c1f3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:31.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.086+0000 7f1c12c98700 1 --2- 172.21.15.2:0/514240305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c0c06b620 0x7f1c0c0cfc90 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:31.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.086+0000 7f1c12c98700 1 --2- 172.21.15.2:0/514240305 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c0c0b5ab0 0x7f1c0c0adf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:31.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.086+0000 7f1c12c98700 1 -- 172.21.15.2:0/514240305 >> 172.21.15.2:0/514240305 conn(0x7f1c0c0b2740 msgr2=0x7f1c0c073f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:31.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.086+0000 7f1c12c98700 1 -- 172.21.15.2:0/514240305 shutdown_connections 2023-11-26T07:14:31.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.086+0000 7f1c12c98700 1 -- 172.21.15.2:0/514240305 wait complete. 2023-11-26T07:14:31.098 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:14:31.096+0000 7f8da8aab700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:14:31.098 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:14:31.096+0000 7f8da8aab700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:14:31.098 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:14:31.096+0000 7f8da8aab700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:14:31.099 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:14:31.096+0000 7f8da8aab700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:14:31.099 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:14:31.096+0000 7f8da8aab700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:14:31.101 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs subvol96280 subvol_snap26280 subvol_clone51880 2023-11-26T07:14:31.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.230+0000 7f80d9b86700 1 Processor -- start 2023-11-26T07:14:31.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.230+0000 7f80d9b86700 1 -- start start 2023-11-26T07:14:31.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.231+0000 7f80d9b86700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80d40722c0 0x7f80d40b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:31.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.231+0000 7f80d9b86700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f80d41440f0 0x7f80d406e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:31.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.231+0000 7f80d9b86700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d4143ec0 con 0x7f80d4143ae0 2023-11-26T07:14:31.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.231+0000 7f80d9b86700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d40b40a0 con 0x7f80d41440f0 2023-11-26T07:14:31.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.231+0000 7f80d9b86700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d40b3ae0 con 0x7f80d40722c0 2023-11-26T07:14:31.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.231+0000 7f80d37fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f80d4143ae0 0x7f80d4071bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33448/0 (socket says 172.21.15.2:33448) 2023-11-26T07:14:31.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.231+0000 7f80d37fe700 1 -- 172.21.15.2:0/3661284238 learned_addr learned my addr 172.21.15.2:0/3661284238 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:14:31.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.231+0000 7f80d2ffd700 1 --2- 172.21.15.2:0/3661284238 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80d40722c0 0x7f80d40b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:31.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.231+0000 7f80d3fff700 1 --2- 172.21.15.2:0/3661284238 >> v2:172.21.15.192:3300/0 conn(0x7f80d41440f0 0x7f80d406e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:31.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.231+0000 7f80d27fc700 1 -- 172.21.15.2:0/3661284238 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1240804456 0 0) 0x7f80d4143ec0 con 0x7f80d4143ae0 2023-11-26T07:14:31.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.231+0000 7f80d27fc700 1 -- 172.21.15.2:0/3661284238 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80bc0035b0 con 0x7f80d4143ae0 2023-11-26T07:14:31.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.231+0000 7f80d27fc700 1 -- 172.21.15.2:0/3661284238 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3480616735 0 0) 0x7f80bc0035b0 con 0x7f80d4143ae0 2023-11-26T07:14:31.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.231+0000 7f80d27fc700 1 -- 172.21.15.2:0/3661284238 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80d40722c0 msgr2=0x7f80d40b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:31.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.231+0000 7f80d27fc700 1 --2- 172.21.15.2:0/3661284238 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80d40722c0 0x7f80d40b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:31.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.231+0000 7f80d27fc700 1 -- 172.21.15.2:0/3661284238 >> v2:172.21.15.192:3300/0 conn(0x7f80d41440f0 msgr2=0x7f80d406e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:31.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.231+0000 7f80d27fc700 1 --2- 172.21.15.2:0/3661284238 >> v2:172.21.15.192:3300/0 conn(0x7f80d41440f0 0x7f80d406e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:31.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.231+0000 7f80d27fc700 1 -- 172.21.15.2:0/3661284238 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d40b3dc0 con 0x7f80d4143ae0 2023-11-26T07:14:31.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.231+0000 7f80d27fc700 1 -- 172.21.15.2:0/3661284238 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f80c4001670 con 0x7f80d4143ae0 2023-11-26T07:14:31.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.231+0000 7f80d27fc700 1 -- 172.21.15.2:0/3661284238 >> v1:172.21.15.2:6789/0 conn(0x7f80d4143ae0 legacy=0x7f80d4071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:31.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.231+0000 7f80d27fc700 1 --2- 172.21.15.2:0/3661284238 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80d40722c0 0x7f80bc003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:31.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.231+0000 7f80d27fc700 1 --2- 172.21.15.2:0/3661284238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80bc003f80 0x7f80bc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:31.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.231+0000 7f80d27fc700 1 --2- 172.21.15.2:0/3661284238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80bc004d90 0x7f80bc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:31.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.231+0000 7f80d27fc700 1 -- 172.21.15.2:0/3661284238 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d40b40a0 con 0x7f80bc003f80 2023-11-26T07:14:31.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.231+0000 7f80d27fc700 1 -- 172.21.15.2:0/3661284238 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d40b3ae0 con 0x7f80bc004d90 2023-11-26T07:14:31.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.231+0000 7f80d27fc700 1 -- 172.21.15.2:0/3661284238 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc00ba10 con 0x7f80d40722c0 2023-11-26T07:14:31.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.232+0000 7f80d2ffd700 1 --2- 172.21.15.2:0/3661284238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80bc003f80 0x7f80bc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:31.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.232+0000 7f80d37fe700 1 --2- 172.21.15.2:0/3661284238 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80d40722c0 0x7f80bc003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:31.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.232+0000 7f80d3fff700 1 --2- 172.21.15.2:0/3661284238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80bc004d90 0x7f80bc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:31.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.232+0000 7f80d2ffd700 1 -- 172.21.15.2:0/3661284238 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80d40722c0 msgr2=0x7f80bc003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:31.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.232+0000 7f80d2ffd700 1 --2- 172.21.15.2:0/3661284238 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80d40722c0 0x7f80bc003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:31.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.232+0000 7f80d2ffd700 1 -- 172.21.15.2:0/3661284238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80bc004d90 msgr2=0x7f80bc005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:31.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.232+0000 7f80d2ffd700 1 --2- 172.21.15.2:0/3661284238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80bc004d90 0x7f80bc005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:31.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.232+0000 7f80d2ffd700 1 -- 172.21.15.2:0/3661284238 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80bc0035b0 con 0x7f80bc003f80 2023-11-26T07:14:31.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.232+0000 7f80d2ffd700 1 --2- 172.21.15.2:0/3661284238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80bc003f80 0x7f80bc004850 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f80c8009b60 tx=0x7f80bc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9255ea5243c054ff server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:31.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.232+0000 7f80d27fc700 1 -- 172.21.15.2:0/3661284238 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c800e660 con 0x7f80bc003f80 2023-11-26T07:14:31.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.232+0000 7f80d27fc700 1 -- 172.21.15.2:0/3661284238 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c800e7c0 con 0x7f80bc003f80 2023-11-26T07:14:31.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.232+0000 7f80d27fc700 1 -- 172.21.15.2:0/3661284238 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c800eb30 con 0x7f80bc003f80 2023-11-26T07:14:31.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.233+0000 7f80d9b86700 1 -- 172.21.15.2:0/3661284238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80bc003f80 msgr2=0x7f80bc004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:31.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.233+0000 7f80d9b86700 1 --2- 172.21.15.2:0/3661284238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80bc003f80 0x7f80bc004850 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f80c8009b60 tx=0x7f80bc005880 comp rx=0 tx=0).stop 2023-11-26T07:14:31.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.233+0000 7f80d3fff700 1 -- 172.21.15.2:0/3661284238 reap_dead start 2023-11-26T07:14:31.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.233+0000 7f80d9b86700 1 -- 172.21.15.2:0/3661284238 shutdown_connections 2023-11-26T07:14:31.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.233+0000 7f80d9b86700 1 -- 172.21.15.2:0/3661284238 >> 172.21.15.2:0/3661284238 conn(0x7f80d40b2740 msgr2=0x7f80d40b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:31.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.233+0000 7f80d9b86700 1 -- 172.21.15.2:0/3661284238 shutdown_connections 2023-11-26T07:14:31.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.233+0000 7f80d9b86700 1 -- 172.21.15.2:0/3661284238 wait complete. 2023-11-26T07:14:31.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.234+0000 7f80d9b86700 1 Processor -- start 2023-11-26T07:14:31.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.234+0000 7f80d9b86700 1 -- start start 2023-11-26T07:14:31.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.235+0000 7f80d9b86700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80bc003f80 0x7f80d4141590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:31.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.235+0000 7f80d9b86700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80d41421c0 0x7f80d4152980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:31.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.235+0000 7f80d9b86700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80d4141c70 0x7f80d406ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:31.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.235+0000 7f80d9b86700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d4141ad0 con 0x7f80d41421c0 2023-11-26T07:14:31.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.235+0000 7f80d9b86700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d414f4a0 con 0x7f80d4141c70 2023-11-26T07:14:31.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.235+0000 7f80d9b86700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d414f780 con 0x7f80bc003f80 2023-11-26T07:14:31.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.236+0000 7f80d2ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80d41421c0 0x7f80d4152980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:31.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.236+0000 7f80d2ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80d41421c0 0x7f80d4152980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42252/0 (socket says 172.21.15.2:42252) 2023-11-26T07:14:31.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.236+0000 7f80d2ffd700 1 -- 172.21.15.2:0/1476874837 learned_addr learned my addr 172.21.15.2:0/1476874837 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:31.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.236+0000 7f80d37fe700 1 --2- 172.21.15.2:0/1476874837 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80bc003f80 0x7f80d4141590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:31.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.236+0000 7f80d3fff700 1 --2- 172.21.15.2:0/1476874837 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80d4141c70 0x7f80d406ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:31.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.236+0000 7f80d2ffd700 1 -- 172.21.15.2:0/1476874837 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80bc003f80 msgr2=0x7f80d4141590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:31.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.236+0000 7f80d2ffd700 1 --2- 172.21.15.2:0/1476874837 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80bc003f80 0x7f80d4141590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:31.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.236+0000 7f80d2ffd700 1 -- 172.21.15.2:0/1476874837 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80d4141c70 msgr2=0x7f80d406ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:31.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.236+0000 7f80d2ffd700 1 --2- 172.21.15.2:0/1476874837 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80d4141c70 0x7f80d406ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:31.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.236+0000 7f80d2ffd700 1 -- 172.21.15.2:0/1476874837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d414fa60 con 0x7f80d41421c0 2023-11-26T07:14:31.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.236+0000 7f80d2ffd700 1 --2- 172.21.15.2:0/1476874837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80d41421c0 0x7f80d4152980 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f80bc0046f0 tx=0x7f80c80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:31.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.236+0000 7f80bbfff700 1 -- 172.21.15.2:0/1476874837 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c800e660 con 0x7f80d41421c0 2023-11-26T07:14:31.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.236+0000 7f80bbfff700 1 -- 172.21.15.2:0/1476874837 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c80038a0 con 0x7f80d41421c0 2023-11-26T07:14:31.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.236+0000 7f80bbfff700 1 -- 172.21.15.2:0/1476874837 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c8003c30 con 0x7f80d41421c0 2023-11-26T07:14:31.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.236+0000 7f80d9b86700 1 -- 172.21.15.2:0/1476874837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80d414fd40 con 0x7f80d41421c0 2023-11-26T07:14:31.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.237+0000 7f80d9b86700 1 -- 172.21.15.2:0/1476874837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80d4152ec0 con 0x7f80d41421c0 2023-11-26T07:14:31.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.237+0000 7f80d9b86700 1 -- 172.21.15.2:0/1476874837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80d4075480 con 0x7f80d41421c0 2023-11-26T07:14:31.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.238+0000 7f80bbfff700 1 -- 172.21.15.2:0/1476874837 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 9) v1 ==== 89537+0+0 (secure 0 0 0) 0x7f80c8013470 con 0x7f80d41421c0 2023-11-26T07:14:31.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.238+0000 7f80bbfff700 1 --2- 172.21.15.2:0/1476874837 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f80c006b220 0x7f80c006d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:31.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.238+0000 7f80bbfff700 1 -- 172.21.15.2:0/1476874837 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f80c808b2d0 con 0x7f80d41421c0 2023-11-26T07:14:31.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.238+0000 7f80d37fe700 1 --2- 172.21.15.2:0/1476874837 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f80c006b220 0x7f80c006d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:31.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.239+0000 7f80d37fe700 1 --2- 172.21.15.2:0/1476874837 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f80c006b220 0x7f80c006d6e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f80c4000c00 tx=0x7f80c4007980 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:31.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.243+0000 7f80bbfff700 1 -- 172.21.15.2:0/1476874837 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f80c80560a0 con 0x7f80d41421c0 2023-11-26T07:14:31.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.485+0000 7f80d9b86700 1 -- 172.21.15.2:0/1476874837 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "subvol96280", "snap_name": "subvol_snap26280", "target_sub_name": "subvol_clone51880", "target": ["mon-mgr", ""]}) v1 -- 0x7f80d40cd940 con 0x7f80c006b220 2023-11-26T07:14:31.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.549+0000 7f80bbfff700 1 -- 172.21.15.2:0/1476874837 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f80d40cd940 con 0x7f80c006b220 2023-11-26T07:14:31.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.550+0000 7f80d9b86700 1 -- 172.21.15.2:0/1476874837 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f80c006b220 msgr2=0x7f80c006d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:31.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.550+0000 7f80d9b86700 1 --2- 172.21.15.2:0/1476874837 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f80c006b220 0x7f80c006d6e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f80c4000c00 tx=0x7f80c4007980 comp rx=0 tx=0).stop 2023-11-26T07:14:31.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.550+0000 7f80d9b86700 1 -- 172.21.15.2:0/1476874837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80d41421c0 msgr2=0x7f80d4152980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:31.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.550+0000 7f80d9b86700 1 --2- 172.21.15.2:0/1476874837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80d41421c0 0x7f80d4152980 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f80bc0046f0 tx=0x7f80c80047c0 comp rx=0 tx=0).stop 2023-11-26T07:14:31.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.551+0000 7f80d9b86700 1 -- 172.21.15.2:0/1476874837 shutdown_connections 2023-11-26T07:14:31.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.551+0000 7f80d9b86700 1 --2- 172.21.15.2:0/1476874837 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f80c006b220 0x7f80c006d6e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:31.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.551+0000 7f80d9b86700 1 --2- 172.21.15.2:0/1476874837 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80d4141c70 0x7f80d406ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:31.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.551+0000 7f80d9b86700 1 --2- 172.21.15.2:0/1476874837 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80bc003f80 0x7f80d4141590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:31.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.551+0000 7f80d9b86700 1 --2- 172.21.15.2:0/1476874837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80d41421c0 0x7f80d4152980 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:31.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.551+0000 7f80d9b86700 1 -- 172.21.15.2:0/1476874837 >> 172.21.15.2:0/1476874837 conn(0x7f80d40b2740 msgr2=0x7f80d406afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:31.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.551+0000 7f80d9b86700 1 -- 172.21.15.2:0/1476874837 shutdown_connections 2023-11-26T07:14:31.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.551+0000 7f80d9b86700 1 -- 172.21.15.2:0/1476874837 wait complete. 2023-11-26T07:14:31.555 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:14:31.552+0000 7f8dac2b2700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:14:31.555 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:14:31.553+0000 7f8dac2b2700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:14:31.556 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:14:31.553+0000 7f8dac2b2700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:14:31.556 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:14:31.553+0000 7f8dac2b2700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:14:31.556 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:14:31.553+0000 7f8dac2b2700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:14:31.566 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone51880 2023-11-26T07:14:31.567 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:14:31.566+0000 7f8dabab1700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:14:31.567 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:14:31.566+0000 7f8dabab1700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:14:31.568 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:14:31.566+0000 7f8dabab1700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:14:31.568 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:14:31.566+0000 7f8dabab1700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:14:31.568 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:14:31.566+0000 7f8dabab1700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:14:31.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.691+0000 7ff4ca26a700 1 Processor -- start 2023-11-26T07:14:31.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.691+0000 7ff4ca26a700 1 -- start start 2023-11-26T07:14:31.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.691+0000 7ff4ca26a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4c41623d0 0x7ff4c4168ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:31.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.691+0000 7ff4ca26a700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4c415e470 con 0x7ff4c415e090 2023-11-26T07:14:31.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.691+0000 7ff4ca26a700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4c41629f0 con 0x7ff4c406b6e0 2023-11-26T07:14:31.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.691+0000 7ff4ca26a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c40c6900 con 0x7ff4c41623d0 2023-11-26T07:14:31.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.692+0000 7ff4c3fff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff4c415e090 0x7ff4c406afd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33468/0 (socket says 172.21.15.2:33468) 2023-11-26T07:14:31.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.692+0000 7ff4c3fff700 1 -- 172.21.15.2:0/1988385156 learned_addr learned my addr 172.21.15.2:0/1988385156 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:14:31.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.692+0000 7ff4c8807700 1 --2- 172.21.15.2:0/1988385156 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4c41623d0 0x7ff4c4168ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:31.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.692+0000 7ff4c37fe700 1 -- 172.21.15.2:0/1988385156 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3998597148 0 0) 0x7ff4c415e470 con 0x7ff4c415e090 2023-11-26T07:14:31.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.692+0000 7ff4c37fe700 1 -- 172.21.15.2:0/1988385156 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4b00035b0 con 0x7ff4c415e090 2023-11-26T07:14:31.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.692+0000 7ff4c37fe700 1 -- 172.21.15.2:0/1988385156 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3620201116 0 0) 0x7ff4c41629f0 con 0x7ff4c406b6e0 2023-11-26T07:14:31.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.692+0000 7ff4c37fe700 1 -- 172.21.15.2:0/1988385156 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4c415e470 con 0x7ff4c406b6e0 2023-11-26T07:14:31.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.692+0000 7ff4c37fe700 1 -- 172.21.15.2:0/1988385156 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2798686694 0 0) 0x7ff4b00035b0 con 0x7ff4c415e090 2023-11-26T07:14:31.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.692+0000 7ff4c37fe700 1 -- 172.21.15.2:0/1988385156 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4c41623d0 msgr2=0x7ff4c4168ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:31.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.692+0000 7ff4c37fe700 1 --2- 172.21.15.2:0/1988385156 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4c41623d0 0x7ff4c4168ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:31.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.692+0000 7ff4c37fe700 1 -- 172.21.15.2:0/1988385156 >> v1:172.21.15.192:6789/0 conn(0x7ff4c406b6e0 legacy=0x7ff4c4161cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:31.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.692+0000 7ff4c37fe700 1 -- 172.21.15.2:0/1988385156 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c40c5f60 con 0x7ff4c415e090 2023-11-26T07:14:31.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.692+0000 7ff4c37fe700 1 -- 172.21.15.2:0/1988385156 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7ff4b4001670 con 0x7ff4c415e090 2023-11-26T07:14:31.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.692+0000 7ff4c37fe700 1 -- 172.21.15.2:0/1988385156 >> v1:172.21.15.2:6789/0 conn(0x7ff4c415e090 legacy=0x7ff4c406afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:31.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.692+0000 7ff4c37fe700 1 --2- 172.21.15.2:0/1988385156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4b0003bc0 0x7ff4b0003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:31.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.692+0000 7ff4c37fe700 1 --2- 172.21.15.2:0/1988385156 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4c41623d0 0x7ff4b0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:31.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.692+0000 7ff4c37fe700 1 --2- 172.21.15.2:0/1988385156 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4b0004d90 0x7ff4b0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:31.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.692+0000 7ff4c37fe700 1 -- 172.21.15.2:0/1988385156 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c40c6900 con 0x7ff4b0003bc0 2023-11-26T07:14:31.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.692+0000 7ff4c37fe700 1 -- 172.21.15.2:0/1988385156 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b000bac0 con 0x7ff4b0004d90 2023-11-26T07:14:31.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.692+0000 7ff4c37fe700 1 -- 172.21.15.2:0/1988385156 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b000bc80 con 0x7ff4c41623d0 2023-11-26T07:14:31.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.692+0000 7ff4c3fff700 1 --2- 172.21.15.2:0/1988385156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4b0003bc0 0x7ff4b0003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:31.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.692+0000 7ff4c8807700 1 --2- 172.21.15.2:0/1988385156 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4b0004d90 0x7ff4b0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:31.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.692+0000 7ff4bbfff700 1 --2- 172.21.15.2:0/1988385156 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4c41623d0 0x7ff4b0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:31.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.693+0000 7ff4c3fff700 1 -- 172.21.15.2:0/1988385156 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4c41623d0 msgr2=0x7ff4b0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:31.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.693+0000 7ff4c3fff700 1 --2- 172.21.15.2:0/1988385156 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4c41623d0 0x7ff4b0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:31.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.693+0000 7ff4c3fff700 1 -- 172.21.15.2:0/1988385156 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4b0004d90 msgr2=0x7ff4b0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:31.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.693+0000 7ff4c3fff700 1 --2- 172.21.15.2:0/1988385156 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4b0004d90 0x7ff4b0005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:31.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.693+0000 7ff4c3fff700 1 -- 172.21.15.2:0/1988385156 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b00035b0 con 0x7ff4b0003bc0 2023-11-26T07:14:31.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.693+0000 7ff4bbfff700 1 --2- 172.21.15.2:0/1988385156 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4c41623d0 0x7ff4b0004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:14:31.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.693+0000 7ff4c3fff700 1 --2- 172.21.15.2:0/1988385156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4b0003bc0 0x7ff4b0003fc0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff4b400c160 tx=0x7ff4b0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=636a83a7be2a7323 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:31.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.693+0000 7ff4c37fe700 1 -- 172.21.15.2:0/1988385156 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b400cca0 con 0x7ff4b0003bc0 2023-11-26T07:14:31.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.693+0000 7ff4c37fe700 1 -- 172.21.15.2:0/1988385156 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b400ce20 con 0x7ff4b0003bc0 2023-11-26T07:14:31.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.693+0000 7ff4c37fe700 1 -- 172.21.15.2:0/1988385156 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4005ba0 con 0x7ff4b0003bc0 2023-11-26T07:14:31.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.693+0000 7ff4ca26a700 1 -- 172.21.15.2:0/1988385156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4b0003bc0 msgr2=0x7ff4b0003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:31.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.693+0000 7ff4ca26a700 1 --2- 172.21.15.2:0/1988385156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4b0003bc0 0x7ff4b0003fc0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff4b400c160 tx=0x7ff4b0005880 comp rx=0 tx=0).stop 2023-11-26T07:14:31.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.693+0000 7ff4c8807700 1 -- 172.21.15.2:0/1988385156 reap_dead start 2023-11-26T07:14:31.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.693+0000 7ff4ca26a700 1 -- 172.21.15.2:0/1988385156 shutdown_connections 2023-11-26T07:14:31.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.693+0000 7ff4ca26a700 1 -- 172.21.15.2:0/1988385156 >> 172.21.15.2:0/1988385156 conn(0x7ff4c40d0b10 msgr2=0x7ff4c40d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:31.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.694+0000 7ff4ca26a700 1 -- 172.21.15.2:0/1988385156 shutdown_connections 2023-11-26T07:14:31.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.694+0000 7ff4ca26a700 1 -- 172.21.15.2:0/1988385156 wait complete. 2023-11-26T07:14:31.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.695+0000 7ff4ca26a700 1 Processor -- start 2023-11-26T07:14:31.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.695+0000 7ff4ca26a700 1 -- start start 2023-11-26T07:14:31.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.695+0000 7ff4ca26a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4b0003bc0 0x7ff4c41f10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:31.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.695+0000 7ff4ca26a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4c41f4880 0x7ff4c415e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:31.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.695+0000 7ff4ca26a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4c41f7150 0x7ff4c41f7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:31.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.695+0000 7ff4ca26a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c41600f0 con 0x7ff4b0003bc0 2023-11-26T07:14:31.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.695+0000 7ff4ca26a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c41f15f0 con 0x7ff4c41f7150 2023-11-26T07:14:31.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.695+0000 7ff4ca26a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c41f7b40 con 0x7ff4c41f4880 2023-11-26T07:14:31.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.696+0000 7ff4c3fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4b0003bc0 0x7ff4c41f10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:31.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.696+0000 7ff4c3fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4b0003bc0 0x7ff4c41f10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42270/0 (socket says 172.21.15.2:42270) 2023-11-26T07:14:31.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.696+0000 7ff4c3fff700 1 -- 172.21.15.2:0/242926730 learned_addr learned my addr 172.21.15.2:0/242926730 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:31.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.696+0000 7ff4bbfff700 1 --2- 172.21.15.2:0/242926730 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4c41f4880 0x7ff4c415e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:31.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.696+0000 7ff4c8807700 1 --2- 172.21.15.2:0/242926730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4c41f7150 0x7ff4c41f7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:31.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.696+0000 7ff4c3fff700 1 -- 172.21.15.2:0/242926730 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4c41f4880 msgr2=0x7ff4c415e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:31.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.696+0000 7ff4c3fff700 1 --2- 172.21.15.2:0/242926730 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4c41f4880 0x7ff4c415e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:31.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.696+0000 7ff4c3fff700 1 -- 172.21.15.2:0/242926730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4c41f7150 msgr2=0x7ff4c41f7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:31.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.696+0000 7ff4c3fff700 1 --2- 172.21.15.2:0/242926730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4c41f7150 0x7ff4c41f7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:31.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.696+0000 7ff4c3fff700 1 -- 172.21.15.2:0/242926730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c4160320 con 0x7ff4b0003bc0 2023-11-26T07:14:31.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.696+0000 7ff4c3fff700 1 --2- 172.21.15.2:0/242926730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4b0003bc0 0x7ff4c41f10b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff4b400c750 tx=0x7ff4b4001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:31.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.696+0000 7ff4c17fa700 1 -- 172.21.15.2:0/242926730 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b40070d0 con 0x7ff4b0003bc0 2023-11-26T07:14:31.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.696+0000 7ff4c17fa700 1 -- 172.21.15.2:0/242926730 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b4007230 con 0x7ff4b0003bc0 2023-11-26T07:14:31.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.696+0000 7ff4c17fa700 1 -- 172.21.15.2:0/242926730 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b40075a0 con 0x7ff4b0003bc0 2023-11-26T07:14:31.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.696+0000 7ff4ca26a700 1 -- 172.21.15.2:0/242926730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c4160600 con 0x7ff4b0003bc0 2023-11-26T07:14:31.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.696+0000 7ff4ca26a700 1 -- 172.21.15.2:0/242926730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c4160bc0 con 0x7ff4b0003bc0 2023-11-26T07:14:31.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.697+0000 7ff4ca26a700 1 -- 172.21.15.2:0/242926730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c41600f0 con 0x7ff4b0003bc0 2023-11-26T07:14:31.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.698+0000 7ff4c17fa700 1 -- 172.21.15.2:0/242926730 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 9) v1 ==== 89537+0+0 (secure 0 0 0) 0x7ff4b401e430 con 0x7ff4b0003bc0 2023-11-26T07:14:31.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.698+0000 7ff4c17fa700 1 --2- 172.21.15.2:0/242926730 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff4a406b230 0x7ff4a406d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:31.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.698+0000 7ff4c17fa700 1 -- 172.21.15.2:0/242926730 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ff4b408aae0 con 0x7ff4b0003bc0 2023-11-26T07:14:31.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.698+0000 7ff4bbfff700 1 --2- 172.21.15.2:0/242926730 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff4a406b230 0x7ff4a406d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:31.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.699+0000 7ff4bbfff700 1 --2- 172.21.15.2:0/242926730 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff4a406b230 0x7ff4a406d6f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff4c415bc10 tx=0x7ff4ac009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:31.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.703+0000 7ff4c17fa700 1 -- 172.21.15.2:0/242926730 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff4b40557d0 con 0x7ff4b0003bc0 2023-11-26T07:14:31.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.945+0000 7ff4ca26a700 1 -- 172.21.15.2:0/242926730 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone51880", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4c40cef50 con 0x7ff4a406b230 2023-11-26T07:14:31.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.952+0000 7ff4c17fa700 1 -- 172.21.15.2:0/242926730 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+165 (secure 0 0 0) 0x7ff4c40cef50 con 0x7ff4a406b230 2023-11-26T07:14:31.955 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-26T07:14:31.955 INFO:teuthology.orchestra.run.smithi002.stdout: "status": { 2023-11-26T07:14:31.955 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "pending", 2023-11-26T07:14:31.955 INFO:teuthology.orchestra.run.smithi002.stdout: "source": { 2023-11-26T07:14:31.955 INFO:teuthology.orchestra.run.smithi002.stdout: "volume": "cephfs", 2023-11-26T07:14:31.955 INFO:teuthology.orchestra.run.smithi002.stdout: "subvolume": "subvol96280", 2023-11-26T07:14:31.955 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot": "subvol_snap26280" 2023-11-26T07:14:31.955 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:14:31.955 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:14:31.955 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-26T07:14:31.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.954+0000 7ff4ca26a700 1 -- 172.21.15.2:0/242926730 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff4a406b230 msgr2=0x7ff4a406d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:31.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.954+0000 7ff4ca26a700 1 --2- 172.21.15.2:0/242926730 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff4a406b230 0x7ff4a406d6f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff4c415bc10 tx=0x7ff4ac009040 comp rx=0 tx=0).stop 2023-11-26T07:14:31.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.954+0000 7ff4ca26a700 1 -- 172.21.15.2:0/242926730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4b0003bc0 msgr2=0x7ff4c41f10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:31.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.954+0000 7ff4ca26a700 1 --2- 172.21.15.2:0/242926730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4b0003bc0 0x7ff4c41f10b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff4b400c750 tx=0x7ff4b4001930 comp rx=0 tx=0).stop 2023-11-26T07:14:31.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.954+0000 7ff4ca26a700 1 -- 172.21.15.2:0/242926730 shutdown_connections 2023-11-26T07:14:31.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.954+0000 7ff4ca26a700 1 --2- 172.21.15.2:0/242926730 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff4a406b230 0x7ff4a406d6f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:31.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.954+0000 7ff4ca26a700 1 --2- 172.21.15.2:0/242926730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4c41f7150 0x7ff4c41f7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:31.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.954+0000 7ff4ca26a700 1 --2- 172.21.15.2:0/242926730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4b0003bc0 0x7ff4c41f10b0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:31.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.954+0000 7ff4ca26a700 1 --2- 172.21.15.2:0/242926730 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4c41f4880 0x7ff4c415e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:31.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.954+0000 7ff4ca26a700 1 -- 172.21.15.2:0/242926730 >> 172.21.15.2:0/242926730 conn(0x7ff4c40d0b10 msgr2=0x7ff4c40af340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:31.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.954+0000 7ff4ca26a700 1 -- 172.21.15.2:0/242926730 shutdown_connections 2023-11-26T07:14:31.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:31.954+0000 7ff4ca26a700 1 -- 172.21.15.2:0/242926730 wait complete. 2023-11-26T07:14:32.969 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone51880 2023-11-26T07:14:33.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.108+0000 7f5b5a655700 1 Processor -- start 2023-11-26T07:14:33.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.108+0000 7f5b5a655700 1 -- start start 2023-11-26T07:14:33.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.109+0000 7f5b5a655700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54157c70 0x7f5b540b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:33.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.109+0000 7f5b5a655700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5b540cf100 0x7f5b540cf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:33.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.109+0000 7f5b5a655700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b540cfa60 con 0x7f5b5415b2d0 2023-11-26T07:14:33.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.109+0000 7f5b5a655700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b540b4b10 con 0x7f5b54157c70 2023-11-26T07:14:33.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.109+0000 7f5b5a655700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b540b4d30 con 0x7f5b540cf100 2023-11-26T07:14:33.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.109+0000 7f5b53fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54157c70 0x7f5b540b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:33.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.109+0000 7f5b53fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54157c70 0x7f5b540b3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42278/0 (socket says 172.21.15.2:42278) 2023-11-26T07:14:33.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.109+0000 7f5b53fff700 1 -- 172.21.15.2:0/2669282965 learned_addr learned my addr 172.21.15.2:0/2669282965 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:33.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.110+0000 7f5b58bf2700 1 --2- 172.21.15.2:0/2669282965 >> v2:172.21.15.192:3300/0 conn(0x7f5b540cf100 0x7f5b540cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:33.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.110+0000 7f5b53fff700 1 -- 172.21.15.2:0/2669282965 >> v2:172.21.15.192:3300/0 conn(0x7f5b540cf100 msgr2=0x7f5b540cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:33.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.110+0000 7f5b53fff700 1 --2- 172.21.15.2:0/2669282965 >> v2:172.21.15.192:3300/0 conn(0x7f5b540cf100 0x7f5b540cf520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:33.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.110+0000 7f5b53fff700 1 -- 172.21.15.2:0/2669282965 >> v1:172.21.15.192:6789/0 conn(0x7f5b5415b2d0 legacy=0x7f5b540b4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:33.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.110+0000 7f5b53fff700 1 -- 172.21.15.2:0/2669282965 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b540b5010 con 0x7f5b54157c70 2023-11-26T07:14:33.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.110+0000 7f5b53fff700 1 --2- 172.21.15.2:0/2669282965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b54157c70 0x7f5b540b3b40 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f5b540cee90 tx=0x7f5b44009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acd50adbfa267611 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:33.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.110+0000 7f5b52ffd700 1 -- 172.21.15.2:0/2669282965 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b44004230 con 0x7f5b54157c70 2023-11-26T07:14:33.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.110+0000 7f5b52ffd700 1 -- 172.21.15.2:0/2669282965 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b44004390 con 0x7f5b54157c70 2023-11-26T07:14:33.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.110+0000 7f5b52ffd700 1 -- 172.21.15.2:0/2669282965 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b440036a0 con 0x7f5b54157c70 2023-11-26T07:14:33.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.111+0000 7f5b5a655700 1 -- 172.21.15.2:0/2669282965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b54157c70 msgr2=0x7f5b540b3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:33.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.111+0000 7f5b5a655700 1 --2- 172.21.15.2:0/2669282965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b54157c70 0x7f5b540b3b40 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f5b540cee90 tx=0x7f5b44009bd0 comp rx=0 tx=0).stop 2023-11-26T07:14:33.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.111+0000 7f5b5a655700 1 -- 172.21.15.2:0/2669282965 shutdown_connections 2023-11-26T07:14:33.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.111+0000 7f5b5a655700 1 --2- 172.21.15.2:0/2669282965 >> v2:172.21.15.192:3300/0 conn(0x7f5b540cf100 0x7f5b540cf520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:33.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.111+0000 7f5b5a655700 1 --2- 172.21.15.2:0/2669282965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b54157c70 0x7f5b540b3b40 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:33.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.111+0000 7f5b5a655700 1 -- 172.21.15.2:0/2669282965 >> 172.21.15.2:0/2669282965 conn(0x7f5b540b1cc0 msgr2=0x7f5b540b20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:33.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.111+0000 7f5b5a655700 1 -- 172.21.15.2:0/2669282965 shutdown_connections 2023-11-26T07:14:33.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.111+0000 7f5b5a655700 1 -- 172.21.15.2:0/2669282965 wait complete. 2023-11-26T07:14:33.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.112+0000 7f5b5a655700 1 Processor -- start 2023-11-26T07:14:33.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.112+0000 7f5b5a655700 1 -- start start 2023-11-26T07:14:33.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.113+0000 7f5b5a655700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b540cf100 0x7f5b5413e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:33.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.113+0000 7f5b5a655700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b54157c70 0x7f5b540a9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:33.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.113+0000 7f5b5a655700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b5415b2d0 0x7f5b540aafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:33.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.113+0000 7f5b5a655700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b540a9c80 con 0x7f5b540cf100 2023-11-26T07:14:33.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.113+0000 7f5b5a655700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b540a9f60 con 0x7f5b5415b2d0 2023-11-26T07:14:33.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.113+0000 7f5b5a655700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b540aa240 con 0x7f5b54157c70 2023-11-26T07:14:33.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.113+0000 7f5b53fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b540cf100 0x7f5b5413e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:33.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.113+0000 7f5b53fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b540cf100 0x7f5b5413e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42284/0 (socket says 172.21.15.2:42284) 2023-11-26T07:14:33.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.113+0000 7f5b53fff700 1 -- 172.21.15.2:0/997417623 learned_addr learned my addr 172.21.15.2:0/997417623 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:33.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.113+0000 7f5b537fe700 1 --2- 172.21.15.2:0/997417623 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b54157c70 0x7f5b540a9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:33.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.113+0000 7f5b58bf2700 1 --2- 172.21.15.2:0/997417623 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b5415b2d0 0x7f5b540aafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:33.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.113+0000 7f5b53fff700 1 -- 172.21.15.2:0/997417623 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b54157c70 msgr2=0x7f5b540a9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:33.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.113+0000 7f5b53fff700 1 --2- 172.21.15.2:0/997417623 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b54157c70 0x7f5b540a9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:33.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.113+0000 7f5b53fff700 1 -- 172.21.15.2:0/997417623 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b5415b2d0 msgr2=0x7f5b540aafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:33.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.113+0000 7f5b53fff700 1 --2- 172.21.15.2:0/997417623 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b5415b2d0 0x7f5b540aafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:33.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.113+0000 7f5b53fff700 1 -- 172.21.15.2:0/997417623 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b44009550 con 0x7f5b540cf100 2023-11-26T07:14:33.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.113+0000 7f5b58bf2700 1 --2- 172.21.15.2:0/997417623 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b5415b2d0 0x7f5b540aafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:14:33.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.114+0000 7f5b537fe700 1 --2- 172.21.15.2:0/997417623 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b54157c70 0x7f5b540a9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:14:33.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.114+0000 7f5b53fff700 1 --2- 172.21.15.2:0/997417623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b540cf100 0x7f5b5413e970 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f5b44009130 tx=0x7f5b44004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:33.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.114+0000 7f5b50ff9700 1 -- 172.21.15.2:0/997417623 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4401d070 con 0x7f5b540cf100 2023-11-26T07:14:33.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.114+0000 7f5b50ff9700 1 -- 172.21.15.2:0/997417623 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b440041b0 con 0x7f5b540cf100 2023-11-26T07:14:33.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.114+0000 7f5b5a655700 1 -- 172.21.15.2:0/997417623 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b540aa520 con 0x7f5b540cf100 2023-11-26T07:14:33.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.114+0000 7f5b50ff9700 1 -- 172.21.15.2:0/997417623 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4400ba80 con 0x7f5b540cf100 2023-11-26T07:14:33.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.114+0000 7f5b5a655700 1 -- 172.21.15.2:0/997417623 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b540a9990 con 0x7f5b540cf100 2023-11-26T07:14:33.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.115+0000 7f5b5a655700 1 -- 172.21.15.2:0/997417623 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b54075480 con 0x7f5b540cf100 2023-11-26T07:14:33.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.115+0000 7f5b50ff9700 1 -- 172.21.15.2:0/997417623 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 10) v1 ==== 89588+0+0 (secure 0 0 0) 0x7f5b4400bbe0 con 0x7f5b540cf100 2023-11-26T07:14:33.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.116+0000 7f5b50ff9700 1 --2- 172.21.15.2:0/997417623 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5b3406b2c0 0x7f5b3406d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:33.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.116+0000 7f5b50ff9700 1 -- 172.21.15.2:0/997417623 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f5b4408aee0 con 0x7f5b540cf100 2023-11-26T07:14:33.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.116+0000 7f5b537fe700 1 --2- 172.21.15.2:0/997417623 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5b3406b2c0 0x7f5b3406d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:33.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.117+0000 7f5b537fe700 1 --2- 172.21.15.2:0/997417623 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5b3406b2c0 0x7f5b3406d780 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5b540afb20 tx=0x7f5b3c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:33.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.120+0000 7f5b50ff9700 1 -- 172.21.15.2:0/997417623 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5b44055970 con 0x7f5b540cf100 2023-11-26T07:14:33.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.366+0000 7f5b5a655700 1 -- 172.21.15.2:0/997417623 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone51880", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b540b3620 con 0x7f5b3406b2c0 2023-11-26T07:14:33.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.373+0000 7f5b50ff9700 1 -- 172.21.15.2:0/997417623 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+165 (secure 0 0 0) 0x7f5b3c009dd0 con 0x7f5b3406b2c0 2023-11-26T07:14:33.377 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-26T07:14:33.377 INFO:teuthology.orchestra.run.smithi002.stdout: "status": { 2023-11-26T07:14:33.377 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "pending", 2023-11-26T07:14:33.377 INFO:teuthology.orchestra.run.smithi002.stdout: "source": { 2023-11-26T07:14:33.377 INFO:teuthology.orchestra.run.smithi002.stdout: "volume": "cephfs", 2023-11-26T07:14:33.377 INFO:teuthology.orchestra.run.smithi002.stdout: "subvolume": "subvol96280", 2023-11-26T07:14:33.377 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot": "subvol_snap26280" 2023-11-26T07:14:33.377 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:14:33.377 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:14:33.377 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-26T07:14:33.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.375+0000 7f5b5a655700 1 -- 172.21.15.2:0/997417623 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5b3406b2c0 msgr2=0x7f5b3406d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:33.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.375+0000 7f5b5a655700 1 --2- 172.21.15.2:0/997417623 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5b3406b2c0 0x7f5b3406d780 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5b540afb20 tx=0x7f5b3c008040 comp rx=0 tx=0).stop 2023-11-26T07:14:33.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.375+0000 7f5b5a655700 1 -- 172.21.15.2:0/997417623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b540cf100 msgr2=0x7f5b5413e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:33.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.375+0000 7f5b5a655700 1 --2- 172.21.15.2:0/997417623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b540cf100 0x7f5b5413e970 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f5b44009130 tx=0x7f5b44004750 comp rx=0 tx=0).stop 2023-11-26T07:14:33.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.375+0000 7f5b5a655700 1 -- 172.21.15.2:0/997417623 shutdown_connections 2023-11-26T07:14:33.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.375+0000 7f5b5a655700 1 --2- 172.21.15.2:0/997417623 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5b3406b2c0 0x7f5b3406d780 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:33.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.375+0000 7f5b5a655700 1 --2- 172.21.15.2:0/997417623 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b5415b2d0 0x7f5b540aafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:33.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.375+0000 7f5b5a655700 1 --2- 172.21.15.2:0/997417623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b540cf100 0x7f5b5413e970 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:33.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.375+0000 7f5b5a655700 1 --2- 172.21.15.2:0/997417623 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b54157c70 0x7f5b540a9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:33.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.375+0000 7f5b5a655700 1 -- 172.21.15.2:0/997417623 >> 172.21.15.2:0/997417623 conn(0x7f5b540b1cc0 msgr2=0x7f5b541560d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:33.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.376+0000 7f5b5a655700 1 -- 172.21.15.2:0/997417623 shutdown_connections 2023-11-26T07:14:33.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:33.376+0000 7f5b5a655700 1 -- 172.21.15.2:0/997417623 wait complete. 2023-11-26T07:14:34.391 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone51880 2023-11-26T07:14:34.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.532+0000 7fe076250700 1 Processor -- start 2023-11-26T07:14:34.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.532+0000 7fe076250700 1 -- start start 2023-11-26T07:14:34.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.533+0000 7fe076250700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe0700d0870 0x7fe0700d26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:34.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.533+0000 7fe076250700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0700d4e20 con 0x7fe0700d49f0 2023-11-26T07:14:34.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.533+0000 7fe076250700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0700b5370 con 0x7fe0700d0c50 2023-11-26T07:14:34.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.533+0000 7fe076250700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0700d2f80 con 0x7fe0700d0870 2023-11-26T07:14:34.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.533+0000 7fe06ffff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe0700d49f0 0x7fe0700b6d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33506/0 (socket says 172.21.15.2:33506) 2023-11-26T07:14:34.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.533+0000 7fe06ffff700 1 -- 172.21.15.2:0/522898002 learned_addr learned my addr 172.21.15.2:0/522898002 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:14:34.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.534+0000 7fe06f7fe700 1 --2- 172.21.15.2:0/522898002 >> v2:172.21.15.192:3300/0 conn(0x7fe0700d0870 0x7fe0700d26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:34.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.534+0000 7fe06e7fc700 1 -- 172.21.15.2:0/522898002 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 752299684 0 0) 0x7fe0700d4e20 con 0x7fe0700d49f0 2023-11-26T07:14:34.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.534+0000 7fe06e7fc700 1 -- 172.21.15.2:0/522898002 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe05c0035b0 con 0x7fe0700d49f0 2023-11-26T07:14:34.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.534+0000 7fe06e7fc700 1 -- 172.21.15.2:0/522898002 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2653594188 0 0) 0x7fe05c0035b0 con 0x7fe0700d49f0 2023-11-26T07:14:34.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.534+0000 7fe06e7fc700 1 -- 172.21.15.2:0/522898002 >> v2:172.21.15.192:3300/0 conn(0x7fe0700d0870 msgr2=0x7fe0700d26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:34.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.534+0000 7fe06e7fc700 1 --2- 172.21.15.2:0/522898002 >> v2:172.21.15.192:3300/0 conn(0x7fe0700d0870 0x7fe0700d26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:34.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.534+0000 7fe06e7fc700 1 -- 172.21.15.2:0/522898002 >> v1:172.21.15.192:6789/0 conn(0x7fe0700d0c50 legacy=0x7fe0700cf860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:34.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.534+0000 7fe06e7fc700 1 -- 172.21.15.2:0/522898002 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0700ceae0 con 0x7fe0700d49f0 2023-11-26T07:14:34.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.534+0000 7fe06e7fc700 1 -- 172.21.15.2:0/522898002 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7fe0680019f0 con 0x7fe0700d49f0 2023-11-26T07:14:34.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.534+0000 7fe06e7fc700 1 -- 172.21.15.2:0/522898002 >> v1:172.21.15.2:6789/0 conn(0x7fe0700d49f0 legacy=0x7fe0700b6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:34.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.534+0000 7fe06e7fc700 1 --2- 172.21.15.2:0/522898002 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe05c003a00 0x7fe05c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:34.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.534+0000 7fe06e7fc700 1 --2- 172.21.15.2:0/522898002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe05c004400 0x7fe05c0048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:34.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.534+0000 7fe06e7fc700 1 --2- 172.21.15.2:0/522898002 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe05c0050d0 0x7fe05c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:34.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.534+0000 7fe06e7fc700 1 -- 172.21.15.2:0/522898002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0700d2f80 con 0x7fe05c004400 2023-11-26T07:14:34.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.534+0000 7fe06e7fc700 1 -- 172.21.15.2:0/522898002 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c00c030 con 0x7fe05c0050d0 2023-11-26T07:14:34.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.534+0000 7fe06e7fc700 1 -- 172.21.15.2:0/522898002 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c00c1f0 con 0x7fe05c003a00 2023-11-26T07:14:34.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.534+0000 7fe06effd700 1 --2- 172.21.15.2:0/522898002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe05c004400 0x7fe05c0048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:34.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.534+0000 7fe06f7fe700 1 --2- 172.21.15.2:0/522898002 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe05c003a00 0x7fe05c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:34.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.534+0000 7fe06ffff700 1 --2- 172.21.15.2:0/522898002 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe05c0050d0 0x7fe05c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:34.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.534+0000 7fe06effd700 1 -- 172.21.15.2:0/522898002 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe05c003a00 msgr2=0x7fe05c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:34.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.534+0000 7fe06effd700 1 --2- 172.21.15.2:0/522898002 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe05c003a00 0x7fe05c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:34.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.534+0000 7fe06effd700 1 -- 172.21.15.2:0/522898002 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe05c0050d0 msgr2=0x7fe05c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:34.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.534+0000 7fe06effd700 1 --2- 172.21.15.2:0/522898002 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe05c0050d0 0x7fe05c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:34.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.534+0000 7fe06ffff700 1 -- 172.21.15.2:0/522898002 reap_dead start 2023-11-26T07:14:34.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.534+0000 7fe06effd700 1 -- 172.21.15.2:0/522898002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe05c0035b0 con 0x7fe05c004400 2023-11-26T07:14:34.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.535+0000 7fe06effd700 1 --2- 172.21.15.2:0/522898002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe05c004400 0x7fe05c0048d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fe0700d1100 tx=0x7fe05c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35644b52c189f90f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:34.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.535+0000 7fe06e7fc700 1 -- 172.21.15.2:0/522898002 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0580052d0 con 0x7fe05c004400 2023-11-26T07:14:34.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.535+0000 7fe06e7fc700 1 -- 172.21.15.2:0/522898002 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe058005430 con 0x7fe05c004400 2023-11-26T07:14:34.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.535+0000 7fe06e7fc700 1 -- 172.21.15.2:0/522898002 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0580038a0 con 0x7fe05c004400 2023-11-26T07:14:34.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.535+0000 7fe076250700 1 -- 172.21.15.2:0/522898002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe05c004400 msgr2=0x7fe05c0048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:34.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.535+0000 7fe076250700 1 --2- 172.21.15.2:0/522898002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe05c004400 0x7fe05c0048d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fe0700d1100 tx=0x7fe05c005880 comp rx=0 tx=0).stop 2023-11-26T07:14:34.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.535+0000 7fe076250700 1 -- 172.21.15.2:0/522898002 shutdown_connections 2023-11-26T07:14:34.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.535+0000 7fe076250700 1 --2- 172.21.15.2:0/522898002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe05c004400 0x7fe05c0048d0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:34.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.535+0000 7fe076250700 1 -- 172.21.15.2:0/522898002 >> 172.21.15.2:0/522898002 conn(0x7fe0700d3ed0 msgr2=0x7fe0700d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:34.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.535+0000 7fe076250700 1 -- 172.21.15.2:0/522898002 shutdown_connections 2023-11-26T07:14:34.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.535+0000 7fe076250700 1 -- 172.21.15.2:0/522898002 wait complete. 2023-11-26T07:14:34.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.537+0000 7fe076250700 1 Processor -- start 2023-11-26T07:14:34.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.537+0000 7fe076250700 1 -- start start 2023-11-26T07:14:34.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.538+0000 7fe076250700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe05c004400 0x7fe070152350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:34.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.538+0000 7fe076250700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe070158fe0 0x7fe070154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:34.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.538+0000 7fe076250700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe070161230 0x7fe070155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:34.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.538+0000 7fe076250700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0700cff70 con 0x7fe070161230 2023-11-26T07:14:34.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.538+0000 7fe076250700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0700b3510 con 0x7fe070158fe0 2023-11-26T07:14:34.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.538+0000 7fe076250700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe070161ab0 con 0x7fe05c004400 2023-11-26T07:14:34.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.538+0000 7fe06ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe070161230 0x7fe070155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:34.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.538+0000 7fe06ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe070161230 0x7fe070155210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42308/0 (socket says 172.21.15.2:42308) 2023-11-26T07:14:34.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.538+0000 7fe06ffff700 1 -- 172.21.15.2:0/3217623112 learned_addr learned my addr 172.21.15.2:0/3217623112 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:34.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.538+0000 7fe06f7fe700 1 --2- 172.21.15.2:0/3217623112 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe05c004400 0x7fe070152350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:34.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.538+0000 7fe06effd700 1 --2- 172.21.15.2:0/3217623112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe070158fe0 0x7fe070154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:34.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.538+0000 7fe06ffff700 1 -- 172.21.15.2:0/3217623112 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe05c004400 msgr2=0x7fe070152350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:34.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.538+0000 7fe06ffff700 1 --2- 172.21.15.2:0/3217623112 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe05c004400 0x7fe070152350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:34.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.538+0000 7fe06ffff700 1 -- 172.21.15.2:0/3217623112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe070158fe0 msgr2=0x7fe070154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:34.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.538+0000 7fe06ffff700 1 --2- 172.21.15.2:0/3217623112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe070158fe0 0x7fe070154cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:34.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.538+0000 7fe06ffff700 1 -- 172.21.15.2:0/3217623112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0700b2e50 con 0x7fe070161230 2023-11-26T07:14:34.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.538+0000 7fe06ffff700 1 --2- 172.21.15.2:0/3217623112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe070161230 0x7fe070155210 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fe0700d30f0 tx=0x7fe06800e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:34.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.538+0000 7fe067fff700 1 -- 172.21.15.2:0/3217623112 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06800ec70 con 0x7fe070161230 2023-11-26T07:14:34.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.538+0000 7fe067fff700 1 -- 172.21.15.2:0/3217623112 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe06800edf0 con 0x7fe070161230 2023-11-26T07:14:34.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.538+0000 7fe067fff700 1 -- 172.21.15.2:0/3217623112 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe068013660 con 0x7fe070161230 2023-11-26T07:14:34.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.538+0000 7fe076250700 1 -- 172.21.15.2:0/3217623112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0700b3130 con 0x7fe070161230 2023-11-26T07:14:34.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.538+0000 7fe076250700 1 -- 172.21.15.2:0/3217623112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe070161780 con 0x7fe070161230 2023-11-26T07:14:34.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.539+0000 7fe076250700 1 -- 172.21.15.2:0/3217623112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0700b57c0 con 0x7fe070161230 2023-11-26T07:14:34.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.540+0000 7fe067fff700 1 -- 172.21.15.2:0/3217623112 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 11) v1 ==== 89690+0+0 (secure 0 0 0) 0x7fe0680137c0 con 0x7fe070161230 2023-11-26T07:14:34.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.540+0000 7fe067fff700 1 --2- 172.21.15.2:0/3217623112 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe05006b3e0 0x7fe05006d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:34.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.540+0000 7fe067fff700 1 -- 172.21.15.2:0/3217623112 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fe06808a270 con 0x7fe070161230 2023-11-26T07:14:34.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.540+0000 7fe06f7fe700 1 --2- 172.21.15.2:0/3217623112 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe05006b3e0 0x7fe05006d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:34.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.541+0000 7fe06f7fe700 1 --2- 172.21.15.2:0/3217623112 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe05006b3e0 0x7fe05006d8a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe060009ce0 tx=0x7fe060009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:34.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.545+0000 7fe067fff700 1 -- 172.21.15.2:0/3217623112 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe068054ce0 con 0x7fe070161230 2023-11-26T07:14:34.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.796+0000 7fe076250700 1 -- 172.21.15.2:0/3217623112 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone51880", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0700cf060 con 0x7fe05006b3e0 2023-11-26T07:14:34.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.804+0000 7fe067fff700 1 -- 172.21.15.2:0/3217623112 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+165 (secure 0 0 0) 0x7fe060019070 con 0x7fe05006b3e0 2023-11-26T07:14:34.806 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-26T07:14:34.806 INFO:teuthology.orchestra.run.smithi002.stdout: "status": { 2023-11-26T07:14:34.806 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "pending", 2023-11-26T07:14:34.806 INFO:teuthology.orchestra.run.smithi002.stdout: "source": { 2023-11-26T07:14:34.806 INFO:teuthology.orchestra.run.smithi002.stdout: "volume": "cephfs", 2023-11-26T07:14:34.806 INFO:teuthology.orchestra.run.smithi002.stdout: "subvolume": "subvol96280", 2023-11-26T07:14:34.807 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot": "subvol_snap26280" 2023-11-26T07:14:34.807 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:14:34.807 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:14:34.807 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-26T07:14:34.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.806+0000 7fe076250700 1 -- 172.21.15.2:0/3217623112 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe05006b3e0 msgr2=0x7fe05006d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:34.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.806+0000 7fe076250700 1 --2- 172.21.15.2:0/3217623112 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe05006b3e0 0x7fe05006d8a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe060009ce0 tx=0x7fe060009210 comp rx=0 tx=0).stop 2023-11-26T07:14:34.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.806+0000 7fe076250700 1 -- 172.21.15.2:0/3217623112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe070161230 msgr2=0x7fe070155210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:34.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.806+0000 7fe076250700 1 --2- 172.21.15.2:0/3217623112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe070161230 0x7fe070155210 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fe0700d30f0 tx=0x7fe06800e440 comp rx=0 tx=0).stop 2023-11-26T07:14:34.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.806+0000 7fe076250700 1 -- 172.21.15.2:0/3217623112 shutdown_connections 2023-11-26T07:14:34.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.806+0000 7fe076250700 1 --2- 172.21.15.2:0/3217623112 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe05006b3e0 0x7fe05006d8a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:34.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.806+0000 7fe076250700 1 --2- 172.21.15.2:0/3217623112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe070161230 0x7fe070155210 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:34.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.806+0000 7fe076250700 1 --2- 172.21.15.2:0/3217623112 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe05c004400 0x7fe070152350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:34.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.806+0000 7fe076250700 1 --2- 172.21.15.2:0/3217623112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe070158fe0 0x7fe070154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:34.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.806+0000 7fe076250700 1 -- 172.21.15.2:0/3217623112 >> 172.21.15.2:0/3217623112 conn(0x7fe0700d3ed0 msgr2=0x7fe0700d2200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:34.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.806+0000 7fe076250700 1 -- 172.21.15.2:0/3217623112 shutdown_connections 2023-11-26T07:14:34.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:34.806+0000 7fe076250700 1 -- 172.21.15.2:0/3217623112 wait complete. 2023-11-26T07:14:35.821 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone51880 2023-11-26T07:14:35.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.961+0000 7f7c805b3700 1 Processor -- start 2023-11-26T07:14:35.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.961+0000 7f7c805b3700 1 -- start start 2023-11-26T07:14:35.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.962+0000 7f7c805b3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c7806b450 0x7f7c780cf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:35.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.962+0000 7f7c805b3700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c781601a0 con 0x7f7c7806afd0 2023-11-26T07:14:35.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.962+0000 7f7c805b3700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c780d18c0 con 0x7f7c78145490 2023-11-26T07:14:35.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.962+0000 7f7c805b3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7806b8e0 con 0x7f7c7806b450 2023-11-26T07:14:35.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.962+0000 7f7c7db4e700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7c7806afd0 0x7f7c780cef40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33524/0 (socket says 172.21.15.2:33524) 2023-11-26T07:14:35.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.962+0000 7f7c7db4e700 1 -- 172.21.15.2:0/4012071741 learned_addr learned my addr 172.21.15.2:0/4012071741 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:14:35.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.962+0000 7f7c7eb50700 1 --2- 172.21.15.2:0/4012071741 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c7806b450 0x7f7c780cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:35.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.962+0000 7f7c7d34d700 1 -- 172.21.15.2:0/4012071741 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1164471310 0 0) 0x7f7c781601a0 con 0x7f7c7806afd0 2023-11-26T07:14:35.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.962+0000 7f7c7d34d700 1 -- 172.21.15.2:0/4012071741 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c640035b0 con 0x7f7c7806afd0 2023-11-26T07:14:35.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.963+0000 7f7c7d34d700 1 -- 172.21.15.2:0/4012071741 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2666567517 0 0) 0x7f7c780d18c0 con 0x7f7c78145490 2023-11-26T07:14:35.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.963+0000 7f7c7d34d700 1 -- 172.21.15.2:0/4012071741 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c781601a0 con 0x7f7c78145490 2023-11-26T07:14:35.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.963+0000 7f7c7d34d700 1 -- 172.21.15.2:0/4012071741 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2621936712 0 0) 0x7f7c640035b0 con 0x7f7c7806afd0 2023-11-26T07:14:35.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.963+0000 7f7c7d34d700 1 -- 172.21.15.2:0/4012071741 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c7806b450 msgr2=0x7f7c780cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:35.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.963+0000 7f7c7d34d700 1 --2- 172.21.15.2:0/4012071741 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c7806b450 0x7f7c780cf650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:35.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.963+0000 7f7c7d34d700 1 -- 172.21.15.2:0/4012071741 >> v1:172.21.15.192:6789/0 conn(0x7f7c78145490 legacy=0x7f7c7806ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:35.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.963+0000 7f7c7d34d700 1 -- 172.21.15.2:0/4012071741 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7806f8d0 con 0x7f7c7806afd0 2023-11-26T07:14:35.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.963+0000 7f7c7d34d700 1 -- 172.21.15.2:0/4012071741 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f7c740015f0 con 0x7f7c7806afd0 2023-11-26T07:14:35.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.963+0000 7f7c7d34d700 1 -- 172.21.15.2:0/4012071741 >> v1:172.21.15.2:6789/0 conn(0x7f7c7806afd0 legacy=0x7f7c780cef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:35.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.963+0000 7f7c7d34d700 1 --2- 172.21.15.2:0/4012071741 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c64003bc0 0x7f7c64003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:35.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.963+0000 7f7c7d34d700 1 --2- 172.21.15.2:0/4012071741 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c7806b450 0x7f7c64004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:35.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.963+0000 7f7c7d34d700 1 --2- 172.21.15.2:0/4012071741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c64004d90 0x7f7c64005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:35.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.963+0000 7f7c7d34d700 1 -- 172.21.15.2:0/4012071741 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7806b8e0 con 0x7f7c64004d90 2023-11-26T07:14:35.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.963+0000 7f7c7d34d700 1 -- 172.21.15.2:0/4012071741 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6400bac0 con 0x7f7c64003bc0 2023-11-26T07:14:35.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.963+0000 7f7c7d34d700 1 -- 172.21.15.2:0/4012071741 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6400bc80 con 0x7f7c7806b450 2023-11-26T07:14:35.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.963+0000 7f7c7eb50700 1 --2- 172.21.15.2:0/4012071741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c64004d90 0x7f7c64005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:35.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.963+0000 7f7c7e34f700 1 --2- 172.21.15.2:0/4012071741 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c64003bc0 0x7f7c64003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:35.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.963+0000 7f7c7db4e700 1 --2- 172.21.15.2:0/4012071741 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c7806b450 0x7f7c64004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:35.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.963+0000 7f7c7eb50700 1 -- 172.21.15.2:0/4012071741 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c7806b450 msgr2=0x7f7c64004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:35.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.963+0000 7f7c7eb50700 1 --2- 172.21.15.2:0/4012071741 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c7806b450 0x7f7c64004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:35.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.963+0000 7f7c7eb50700 1 -- 172.21.15.2:0/4012071741 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c64003bc0 msgr2=0x7f7c64003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:35.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.963+0000 7f7c7eb50700 1 --2- 172.21.15.2:0/4012071741 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c64003bc0 0x7f7c64003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:35.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.963+0000 7f7c7eb50700 1 -- 172.21.15.2:0/4012071741 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c640035b0 con 0x7f7c64004d90 2023-11-26T07:14:35.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.963+0000 7f7c7e34f700 1 --2- 172.21.15.2:0/4012071741 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c64003bc0 0x7f7c64003fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:14:35.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.963+0000 7f7c7eb50700 1 --2- 172.21.15.2:0/4012071741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c64004d90 0x7f7c64005210 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f7c70009fc0 tx=0x7f7c64005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4ae3ddc0408cfd4 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:35.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.963+0000 7f7c7d34d700 1 -- 172.21.15.2:0/4012071741 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7000ec30 con 0x7f7c64004d90 2023-11-26T07:14:35.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.964+0000 7f7c7d34d700 1 -- 172.21.15.2:0/4012071741 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7000f040 con 0x7f7c64004d90 2023-11-26T07:14:35.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.964+0000 7f7c7d34d700 1 -- 172.21.15.2:0/4012071741 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c70014480 con 0x7f7c64004d90 2023-11-26T07:14:35.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.964+0000 7f7c805b3700 1 -- 172.21.15.2:0/4012071741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c64004d90 msgr2=0x7f7c64005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:35.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.964+0000 7f7c805b3700 1 --2- 172.21.15.2:0/4012071741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c64004d90 0x7f7c64005210 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f7c70009fc0 tx=0x7f7c64005880 comp rx=0 tx=0).stop 2023-11-26T07:14:35.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.964+0000 7f7c7eb50700 1 -- 172.21.15.2:0/4012071741 reap_dead start 2023-11-26T07:14:35.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.964+0000 7f7c805b3700 1 -- 172.21.15.2:0/4012071741 shutdown_connections 2023-11-26T07:14:35.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.964+0000 7f7c805b3700 1 -- 172.21.15.2:0/4012071741 >> 172.21.15.2:0/4012071741 conn(0x7f7c780b2740 msgr2=0x7f7c780b2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:35.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.964+0000 7f7c805b3700 1 -- 172.21.15.2:0/4012071741 shutdown_connections 2023-11-26T07:14:35.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.964+0000 7f7c805b3700 1 -- 172.21.15.2:0/4012071741 wait complete. 2023-11-26T07:14:35.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.965+0000 7f7c805b3700 1 Processor -- start 2023-11-26T07:14:35.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.965+0000 7f7c805b3700 1 -- start start 2023-11-26T07:14:35.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.966+0000 7f7c805b3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c64004d90 0x7f7c780b1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:35.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.966+0000 7f7c805b3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c780a9450 0x7f7c780a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:35.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.966+0000 7f7c805b3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c7806c190 0x7f7c7806c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:35.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.966+0000 7f7c805b3700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c780aad50 con 0x7f7c64004d90 2023-11-26T07:14:35.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.966+0000 7f7c805b3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c780aa140 con 0x7f7c780a9450 2023-11-26T07:14:35.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.966+0000 7f7c805b3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c780aa420 con 0x7f7c7806c190 2023-11-26T07:14:35.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.966+0000 7f7c7e34f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c64004d90 0x7f7c780b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:35.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.966+0000 7f7c7e34f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c64004d90 0x7f7c780b1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42326/0 (socket says 172.21.15.2:42326) 2023-11-26T07:14:35.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.966+0000 7f7c7e34f700 1 -- 172.21.15.2:0/2611843399 learned_addr learned my addr 172.21.15.2:0/2611843399 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:35.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.967+0000 7f7c7eb50700 1 --2- 172.21.15.2:0/2611843399 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c7806c190 0x7f7c7806c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:35.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.967+0000 7f7c7e34f700 1 -- 172.21.15.2:0/2611843399 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c7806c190 msgr2=0x7f7c7806c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:35.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.967+0000 7f7c7e34f700 1 --2- 172.21.15.2:0/2611843399 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c7806c190 0x7f7c7806c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:35.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.967+0000 7f7c7e34f700 1 -- 172.21.15.2:0/2611843399 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c780a9450 msgr2=0x7f7c780a98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:35.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.967+0000 7f7c7e34f700 1 --2- 172.21.15.2:0/2611843399 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c780a9450 0x7f7c780a98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:35.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.967+0000 7f7c7e34f700 1 -- 172.21.15.2:0/2611843399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c780aa700 con 0x7f7c64004d90 2023-11-26T07:14:35.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.967+0000 7f7c7e34f700 1 --2- 172.21.15.2:0/2611843399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c64004d90 0x7f7c780b1460 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f7c6800e7b0 tx=0x7f7c6800eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:35.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.967+0000 7f7c6effd700 1 -- 172.21.15.2:0/2611843399 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c68017070 con 0x7f7c64004d90 2023-11-26T07:14:35.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.967+0000 7f7c6effd700 1 -- 172.21.15.2:0/2611843399 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c680052e0 con 0x7f7c64004d90 2023-11-26T07:14:35.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.967+0000 7f7c6effd700 1 -- 172.21.15.2:0/2611843399 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c68005470 con 0x7f7c64004d90 2023-11-26T07:14:35.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.967+0000 7f7c805b3700 1 -- 172.21.15.2:0/2611843399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c780aa9e0 con 0x7f7c64004d90 2023-11-26T07:14:35.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.967+0000 7f7c805b3700 1 -- 172.21.15.2:0/2611843399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c780b19a0 con 0x7f7c64004d90 2023-11-26T07:14:35.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.968+0000 7f7c805b3700 1 -- 172.21.15.2:0/2611843399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c780b1bc0 con 0x7f7c64004d90 2023-11-26T07:14:35.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.968+0000 7f7c6effd700 1 -- 172.21.15.2:0/2611843399 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 11) v1 ==== 89690+0+0 (secure 0 0 0) 0x7f7c68006860 con 0x7f7c64004d90 2023-11-26T07:14:35.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.969+0000 7f7c6effd700 1 --2- 172.21.15.2:0/2611843399 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7c5c06b3e0 0x7f7c5c06d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:35.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.969+0000 7f7c6effd700 1 -- 172.21.15.2:0/2611843399 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f7c680895a0 con 0x7f7c64004d90 2023-11-26T07:14:35.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.969+0000 7f7c7db4e700 1 --2- 172.21.15.2:0/2611843399 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7c5c06b3e0 0x7f7c5c06d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:35.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.970+0000 7f7c7db4e700 1 --2- 172.21.15.2:0/2611843399 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7c5c06b3e0 0x7f7c5c06d8a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7c7806bc40 tx=0x7f7c74001a40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:35.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:35.974+0000 7f7c6effd700 1 -- 172.21.15.2:0/2611843399 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7c68053fc0 con 0x7f7c64004d90 2023-11-26T07:14:36.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:36.218+0000 7f7c805b3700 1 -- 172.21.15.2:0/2611843399 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone51880", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c780b3790 con 0x7f7c5c06b3e0 2023-11-26T07:14:36.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:36.225+0000 7f7c6effd700 1 -- 172.21.15.2:0/2611843399 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+165 (secure 0 0 0) 0x7f7c780b3790 con 0x7f7c5c06b3e0 2023-11-26T07:14:36.227 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-26T07:14:36.227 INFO:teuthology.orchestra.run.smithi002.stdout: "status": { 2023-11-26T07:14:36.227 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "pending", 2023-11-26T07:14:36.227 INFO:teuthology.orchestra.run.smithi002.stdout: "source": { 2023-11-26T07:14:36.228 INFO:teuthology.orchestra.run.smithi002.stdout: "volume": "cephfs", 2023-11-26T07:14:36.228 INFO:teuthology.orchestra.run.smithi002.stdout: "subvolume": "subvol96280", 2023-11-26T07:14:36.228 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot": "subvol_snap26280" 2023-11-26T07:14:36.228 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:14:36.228 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:14:36.228 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-26T07:14:36.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:36.227+0000 7f7c805b3700 1 -- 172.21.15.2:0/2611843399 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7c5c06b3e0 msgr2=0x7f7c5c06d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:36.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:36.227+0000 7f7c805b3700 1 --2- 172.21.15.2:0/2611843399 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7c5c06b3e0 0x7f7c5c06d8a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7c7806bc40 tx=0x7f7c74001a40 comp rx=0 tx=0).stop 2023-11-26T07:14:36.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:36.227+0000 7f7c805b3700 1 -- 172.21.15.2:0/2611843399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c64004d90 msgr2=0x7f7c780b1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:36.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:36.227+0000 7f7c805b3700 1 --2- 172.21.15.2:0/2611843399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c64004d90 0x7f7c780b1460 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f7c6800e7b0 tx=0x7f7c6800eb70 comp rx=0 tx=0).stop 2023-11-26T07:14:36.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:36.227+0000 7f7c805b3700 1 -- 172.21.15.2:0/2611843399 shutdown_connections 2023-11-26T07:14:36.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:36.227+0000 7f7c805b3700 1 --2- 172.21.15.2:0/2611843399 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7c5c06b3e0 0x7f7c5c06d8a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:36.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:36.227+0000 7f7c805b3700 1 --2- 172.21.15.2:0/2611843399 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c7806c190 0x7f7c7806c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:36.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:36.227+0000 7f7c805b3700 1 --2- 172.21.15.2:0/2611843399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c64004d90 0x7f7c780b1460 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:36.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:36.227+0000 7f7c805b3700 1 --2- 172.21.15.2:0/2611843399 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c780a9450 0x7f7c780a98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:36.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:36.227+0000 7f7c805b3700 1 -- 172.21.15.2:0/2611843399 >> 172.21.15.2:0/2611843399 conn(0x7f7c780b2740 msgr2=0x7f7c7813fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:36.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:36.227+0000 7f7c805b3700 1 -- 172.21.15.2:0/2611843399 shutdown_connections 2023-11-26T07:14:36.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:36.227+0000 7f7c805b3700 1 -- 172.21.15.2:0/2611843399 wait complete. 2023-11-26T07:14:37.207 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:14:37.210 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:14:37.241 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone51880 2023-11-26T07:14:37.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.385+0000 7f222e243700 1 Processor -- start 2023-11-26T07:14:37.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.385+0000 7f222e243700 1 -- start start 2023-11-26T07:14:37.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.385+0000 7f222e243700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f22281472f0 0x7f22280b5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:37.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.385+0000 7f222e243700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2228147120 con 0x7f222806f680 2023-11-26T07:14:37.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.386+0000 7f222e243700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2228071b30 con 0x7f222806b6e0 2023-11-26T07:14:37.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.386+0000 7f222e243700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2228071e10 con 0x7f22281472f0 2023-11-26T07:14:37.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.386+0000 7f2227fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f22281472f0 0x7f22280b5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:37.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.386+0000 7f22277fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f222806f680 0x7f222806afd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33542/0 (socket says 172.21.15.2:33542) 2023-11-26T07:14:37.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.386+0000 7f22277fe700 1 -- 172.21.15.2:0/2076119690 learned_addr learned my addr 172.21.15.2:0/2076119690 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:14:37.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.386+0000 7f2227fff700 1 -- 172.21.15.2:0/2076119690 >> v1:172.21.15.192:6789/0 conn(0x7f222806b6e0 legacy=0x7f222806daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:37.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.386+0000 7f2227fff700 1 -- 172.21.15.2:0/2076119690 >> v1:172.21.15.2:6789/0 conn(0x7f222806f680 legacy=0x7f222806afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:37.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.386+0000 7f2227fff700 1 -- 172.21.15.2:0/2076119690 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22280720f0 con 0x7f22281472f0 2023-11-26T07:14:37.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.386+0000 7f22267fc700 1 -- 172.21.15.2:0/2076119690 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 931193146 0 0) 0x7f2228147120 con 0x7f222806f680 2023-11-26T07:14:37.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.386+0000 7f2227fff700 1 --2- 172.21.15.2:0/2076119690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22281472f0 0x7f22280b5940 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f2220009d90 tx=0x7f222000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5d05e528e833937 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:37.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.386+0000 7f22267fc700 1 -- 172.21.15.2:0/2076119690 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222000e070 con 0x7f22281472f0 2023-11-26T07:14:37.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.386+0000 7f22267fc700 1 -- 172.21.15.2:0/2076119690 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f222000bbd0 con 0x7f22281472f0 2023-11-26T07:14:37.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.386+0000 7f22267fc700 1 -- 172.21.15.2:0/2076119690 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2220012430 con 0x7f22281472f0 2023-11-26T07:14:37.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.387+0000 7f222e243700 1 -- 172.21.15.2:0/2076119690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22281472f0 msgr2=0x7f22280b5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:37.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.387+0000 7f222e243700 1 --2- 172.21.15.2:0/2076119690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22281472f0 0x7f22280b5940 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f2220009d90 tx=0x7f222000b330 comp rx=0 tx=0).stop 2023-11-26T07:14:37.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.387+0000 7f222e243700 1 -- 172.21.15.2:0/2076119690 shutdown_connections 2023-11-26T07:14:37.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.387+0000 7f222e243700 1 --2- 172.21.15.2:0/2076119690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22281472f0 0x7f22280b5940 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:37.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.387+0000 7f222e243700 1 -- 172.21.15.2:0/2076119690 >> 172.21.15.2:0/2076119690 conn(0x7f22280b27b0 msgr2=0x7f22280b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:37.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.387+0000 7f222e243700 1 -- 172.21.15.2:0/2076119690 shutdown_connections 2023-11-26T07:14:37.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.387+0000 7f222e243700 1 -- 172.21.15.2:0/2076119690 wait complete. 2023-11-26T07:14:37.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.388+0000 7f222e243700 1 Processor -- start 2023-11-26T07:14:37.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.388+0000 7f222e243700 1 -- start start 2023-11-26T07:14:37.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.389+0000 7f222e243700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f222806b6e0 0x7f22281f3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:37.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.389+0000 7f222e243700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f222806f680 0x7f222815e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:37.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.389+0000 7f222e243700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22281472f0 0x7f222815ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:37.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.389+0000 7f222e243700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2228161580 con 0x7f22281472f0 2023-11-26T07:14:37.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.389+0000 7f222e243700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2228160900 con 0x7f222806b6e0 2023-11-26T07:14:37.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.389+0000 7f222e243700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2228160be0 con 0x7f222806f680 2023-11-26T07:14:37.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.389+0000 7f2227fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22281472f0 0x7f222815ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:37.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.389+0000 7f2227fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22281472f0 0x7f222815ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42342/0 (socket says 172.21.15.2:42342) 2023-11-26T07:14:37.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.389+0000 7f2227fff700 1 -- 172.21.15.2:0/386563075 learned_addr learned my addr 172.21.15.2:0/386563075 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:37.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.389+0000 7f22277fe700 1 --2- 172.21.15.2:0/386563075 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f222806b6e0 0x7f22281f3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:37.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.389+0000 7f2226ffd700 1 --2- 172.21.15.2:0/386563075 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f222806f680 0x7f222815e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:37.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.390+0000 7f2227fff700 1 -- 172.21.15.2:0/386563075 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f222806f680 msgr2=0x7f222815e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:37.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.390+0000 7f2227fff700 1 --2- 172.21.15.2:0/386563075 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f222806f680 0x7f222815e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:37.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.390+0000 7f2227fff700 1 -- 172.21.15.2:0/386563075 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f222806b6e0 msgr2=0x7f22281f3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:37.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.390+0000 7f2227fff700 1 --2- 172.21.15.2:0/386563075 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f222806b6e0 0x7f22281f3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:37.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.390+0000 7f2227fff700 1 -- 172.21.15.2:0/386563075 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2220009a70 con 0x7f22281472f0 2023-11-26T07:14:37.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.390+0000 7f2226ffd700 1 --2- 172.21.15.2:0/386563075 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f222806f680 0x7f222815e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:14:37.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.390+0000 7f2227fff700 1 --2- 172.21.15.2:0/386563075 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22281472f0 0x7f222815ecc0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f2220014040 tx=0x7f2220004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:37.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.390+0000 7f220ffff700 1 -- 172.21.15.2:0/386563075 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222001b810 con 0x7f22281472f0 2023-11-26T07:14:37.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.390+0000 7f220ffff700 1 -- 172.21.15.2:0/386563075 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2220020070 con 0x7f22281472f0 2023-11-26T07:14:37.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.390+0000 7f222e243700 1 -- 172.21.15.2:0/386563075 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2228160ec0 con 0x7f22281472f0 2023-11-26T07:14:37.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.390+0000 7f220ffff700 1 -- 172.21.15.2:0/386563075 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222001bbb0 con 0x7f22281472f0 2023-11-26T07:14:37.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.390+0000 7f222e243700 1 -- 172.21.15.2:0/386563075 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22281604d0 con 0x7f22281472f0 2023-11-26T07:14:37.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.391+0000 7f222e243700 1 -- 172.21.15.2:0/386563075 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22281616c0 con 0x7f22281472f0 2023-11-26T07:14:37.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.391+0000 7f220ffff700 1 -- 172.21.15.2:0/386563075 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 11) v1 ==== 89690+0+0 (secure 0 0 0) 0x7f222001bd10 con 0x7f22281472f0 2023-11-26T07:14:37.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.392+0000 7f220ffff700 1 --2- 172.21.15.2:0/386563075 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f221406b3e0 0x7f221406d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:37.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.392+0000 7f220ffff700 1 -- 172.21.15.2:0/386563075 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f2220022070 con 0x7f22281472f0 2023-11-26T07:14:37.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.392+0000 7f22277fe700 1 --2- 172.21.15.2:0/386563075 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f221406b3e0 0x7f221406d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:37.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.392+0000 7f22277fe700 1 --2- 172.21.15.2:0/386563075 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f221406b3e0 0x7f221406d8a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2218007b10 tx=0x7f2218007a60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:37.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.396+0000 7f220ffff700 1 -- 172.21.15.2:0/386563075 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f22281616c0 con 0x7f22281472f0 2023-11-26T07:14:37.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:37.643+0000 7f222e243700 1 -- 172.21.15.2:0/386563075 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone51880", "target": ["mon-mgr", ""]}) v1 -- 0x7f222806b570 con 0x7f221406b3e0 2023-11-26T07:14:39.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.443+0000 7f220ffff700 1 -- 172.21.15.2:0/386563075 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+169 (secure 0 0 0) 0x7f222806b570 con 0x7f221406b3e0 2023-11-26T07:14:39.446 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-26T07:14:39.446 INFO:teuthology.orchestra.run.smithi002.stdout: "status": { 2023-11-26T07:14:39.446 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "in-progress", 2023-11-26T07:14:39.446 INFO:teuthology.orchestra.run.smithi002.stdout: "source": { 2023-11-26T07:14:39.446 INFO:teuthology.orchestra.run.smithi002.stdout: "volume": "cephfs", 2023-11-26T07:14:39.446 INFO:teuthology.orchestra.run.smithi002.stdout: "subvolume": "subvol96280", 2023-11-26T07:14:39.446 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot": "subvol_snap26280" 2023-11-26T07:14:39.446 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:14:39.446 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:14:39.446 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-26T07:14:39.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.446+0000 7f222e243700 1 -- 172.21.15.2:0/386563075 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f221406b3e0 msgr2=0x7f221406d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:39.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.446+0000 7f222e243700 1 --2- 172.21.15.2:0/386563075 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f221406b3e0 0x7f221406d8a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2218007b10 tx=0x7f2218007a60 comp rx=0 tx=0).stop 2023-11-26T07:14:39.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.446+0000 7f222e243700 1 -- 172.21.15.2:0/386563075 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22281472f0 msgr2=0x7f222815ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:39.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.446+0000 7f222e243700 1 --2- 172.21.15.2:0/386563075 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22281472f0 0x7f222815ecc0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f2220014040 tx=0x7f2220004ad0 comp rx=0 tx=0).stop 2023-11-26T07:14:39.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.446+0000 7f222e243700 1 -- 172.21.15.2:0/386563075 shutdown_connections 2023-11-26T07:14:39.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.446+0000 7f222e243700 1 --2- 172.21.15.2:0/386563075 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f221406b3e0 0x7f221406d8a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:39.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.446+0000 7f222e243700 1 --2- 172.21.15.2:0/386563075 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22281472f0 0x7f222815ecc0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:39.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.446+0000 7f222e243700 1 --2- 172.21.15.2:0/386563075 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f222806b6e0 0x7f22281f3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:39.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.446+0000 7f222e243700 1 --2- 172.21.15.2:0/386563075 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f222806f680 0x7f222815e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:39.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.446+0000 7f222e243700 1 -- 172.21.15.2:0/386563075 >> 172.21.15.2:0/386563075 conn(0x7f22280b27b0 msgr2=0x7f222806daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:39.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.446+0000 7f222e243700 1 -- 172.21.15.2:0/386563075 shutdown_connections 2023-11-26T07:14:39.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.446+0000 7f222e243700 1 -- 172.21.15.2:0/386563075 wait complete. 2023-11-26T07:14:39.463 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone51880 2023-11-26T07:14:39.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.607+0000 7fe52695b700 1 Processor -- start 2023-11-26T07:14:39.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.607+0000 7fe52695b700 1 -- start start 2023-11-26T07:14:39.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.608+0000 7fe52695b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe52015a820 0x7fe52006b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:39.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.608+0000 7fe52695b700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5200b05f0 con 0x7fe5200d06b0 2023-11-26T07:14:39.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.608+0000 7fe52695b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe52015f080 con 0x7fe52015a440 2023-11-26T07:14:39.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.608+0000 7fe52695b700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5200afd50 con 0x7fe52015a820 2023-11-26T07:14:39.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.608+0000 7fe524ef8700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe5200d06b0 0x7fe52006b880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33560/0 (socket says 172.21.15.2:33560) 2023-11-26T07:14:39.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.608+0000 7fe524ef8700 1 -- 172.21.15.2:0/990048989 learned_addr learned my addr 172.21.15.2:0/990048989 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:14:39.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.608+0000 7fe51f7fe700 1 --2- 172.21.15.2:0/990048989 >> v2:172.21.15.192:3300/0 conn(0x7fe52015a820 0x7fe52006b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:39.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.608+0000 7fe51effd700 1 -- 172.21.15.2:0/990048989 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2817660300 0 0) 0x7fe5200b05f0 con 0x7fe5200d06b0 2023-11-26T07:14:39.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.608+0000 7fe51effd700 1 -- 172.21.15.2:0/990048989 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5080035b0 con 0x7fe5200d06b0 2023-11-26T07:14:39.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.608+0000 7fe51f7fe700 1 -- 172.21.15.2:0/990048989 >> v1:172.21.15.192:6789/0 conn(0x7fe52015a440 legacy=0x7fe5200cffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:39.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.608+0000 7fe51effd700 1 -- 172.21.15.2:0/990048989 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 569008677 0 0) 0x7fe52015f080 con 0x7fe52015a440 2023-11-26T07:14:39.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.608+0000 7fe51f7fe700 1 -- 172.21.15.2:0/990048989 >> v1:172.21.15.2:6789/0 conn(0x7fe5200d06b0 legacy=0x7fe52006b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:39.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.608+0000 7fe51f7fe700 1 -- 172.21.15.2:0/990048989 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5200b0030 con 0x7fe52015a820 2023-11-26T07:14:39.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.609+0000 7fe51f7fe700 1 --2- 172.21.15.2:0/990048989 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe52015a820 0x7fe52006b340 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe514009840 tx=0x7fe514009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d5e631aea012f3c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:39.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.609+0000 7fe51effd700 1 -- 172.21.15.2:0/990048989 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe514011830 con 0x7fe52015a820 2023-11-26T07:14:39.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.609+0000 7fe51effd700 1 -- 172.21.15.2:0/990048989 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe514011990 con 0x7fe52015a820 2023-11-26T07:14:39.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.609+0000 7fe51effd700 1 -- 172.21.15.2:0/990048989 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe514011d00 con 0x7fe52015a820 2023-11-26T07:14:39.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.609+0000 7fe52695b700 1 -- 172.21.15.2:0/990048989 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe52015a820 msgr2=0x7fe52006b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:39.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.609+0000 7fe52695b700 1 --2- 172.21.15.2:0/990048989 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe52015a820 0x7fe52006b340 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe514009840 tx=0x7fe514009b50 comp rx=0 tx=0).stop 2023-11-26T07:14:39.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.609+0000 7fe52695b700 1 -- 172.21.15.2:0/990048989 shutdown_connections 2023-11-26T07:14:39.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.609+0000 7fe52695b700 1 --2- 172.21.15.2:0/990048989 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe52015a820 0x7fe52006b340 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:39.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.609+0000 7fe52695b700 1 -- 172.21.15.2:0/990048989 >> 172.21.15.2:0/990048989 conn(0x7fe5200b5070 msgr2=0x7fe5200b5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:39.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.609+0000 7fe52695b700 1 -- 172.21.15.2:0/990048989 shutdown_connections 2023-11-26T07:14:39.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.609+0000 7fe52695b700 1 -- 172.21.15.2:0/990048989 wait complete. 2023-11-26T07:14:39.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.611+0000 7fe52695b700 1 Processor -- start 2023-11-26T07:14:39.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.611+0000 7fe52695b700 1 -- start start 2023-11-26T07:14:39.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.611+0000 7fe52695b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5200d06b0 0x7fe520147880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:39.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.611+0000 7fe52695b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe52015a440 0x7fe52014f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:39.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.611+0000 7fe52695b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe52014f720 0x7fe5200ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:39.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.611+0000 7fe52695b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52014fbd0 con 0x7fe52014f720 2023-11-26T07:14:39.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.611+0000 7fe52695b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52015b950 con 0x7fe5200d06b0 2023-11-26T07:14:39.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.611+0000 7fe52695b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5200cd7a0 con 0x7fe52015a440 2023-11-26T07:14:39.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.612+0000 7fe524ef8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe52014f720 0x7fe5200ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:39.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.612+0000 7fe524ef8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe52014f720 0x7fe5200ceb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42356/0 (socket says 172.21.15.2:42356) 2023-11-26T07:14:39.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.612+0000 7fe524ef8700 1 -- 172.21.15.2:0/1741611961 learned_addr learned my addr 172.21.15.2:0/1741611961 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:39.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.612+0000 7fe51ffff700 1 --2- 172.21.15.2:0/1741611961 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5200d06b0 0x7fe520147880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:39.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.612+0000 7fe51f7fe700 1 --2- 172.21.15.2:0/1741611961 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe52015a440 0x7fe52014f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:39.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.612+0000 7fe524ef8700 1 -- 172.21.15.2:0/1741611961 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe52015a440 msgr2=0x7fe52014f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:39.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.612+0000 7fe524ef8700 1 --2- 172.21.15.2:0/1741611961 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe52015a440 0x7fe52014f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:39.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.612+0000 7fe524ef8700 1 -- 172.21.15.2:0/1741611961 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5200d06b0 msgr2=0x7fe520147880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:39.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.612+0000 7fe524ef8700 1 --2- 172.21.15.2:0/1741611961 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5200d06b0 0x7fe520147880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:39.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.612+0000 7fe524ef8700 1 -- 172.21.15.2:0/1741611961 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5140094a0 con 0x7fe52014f720 2023-11-26T07:14:39.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.612+0000 7fe524ef8700 1 --2- 172.21.15.2:0/1741611961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe52014f720 0x7fe5200ceb00 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fe51800cb40 tx=0x7fe51800ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:39.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.612+0000 7fe51cff9700 1 -- 172.21.15.2:0/1741611961 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51800a9e0 con 0x7fe52014f720 2023-11-26T07:14:39.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.612+0000 7fe51cff9700 1 -- 172.21.15.2:0/1741611961 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe51800ab40 con 0x7fe52014f720 2023-11-26T07:14:39.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.612+0000 7fe52695b700 1 -- 172.21.15.2:0/1741611961 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5200cda80 con 0x7fe52014f720 2023-11-26T07:14:39.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.612+0000 7fe51cff9700 1 -- 172.21.15.2:0/1741611961 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe518012400 con 0x7fe52014f720 2023-11-26T07:14:39.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.612+0000 7fe52695b700 1 -- 172.21.15.2:0/1741611961 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5200ce040 con 0x7fe52014f720 2023-11-26T07:14:39.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.613+0000 7fe52695b700 1 -- 172.21.15.2:0/1741611961 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe52015bae0 con 0x7fe52014f720 2023-11-26T07:14:39.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.614+0000 7fe51cff9700 1 -- 172.21.15.2:0/1741611961 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 11) v1 ==== 89690+0+0 (secure 0 0 0) 0x7fe51801b3b0 con 0x7fe52014f720 2023-11-26T07:14:39.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.614+0000 7fe51cff9700 1 --2- 172.21.15.2:0/1741611961 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe50c06b410 0x7fe50c06d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:39.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.614+0000 7fe51cff9700 1 -- 172.21.15.2:0/1741611961 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fe518089a00 con 0x7fe52014f720 2023-11-26T07:14:39.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.614+0000 7fe51ffff700 1 --2- 172.21.15.2:0/1741611961 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe50c06b410 0x7fe50c06d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:39.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.615+0000 7fe51ffff700 1 --2- 172.21.15.2:0/1741611961 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe50c06b410 0x7fe50c06d8d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe510007fd0 tx=0x7fe510009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:39.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.619+0000 7fe51cff9700 1 -- 172.21.15.2:0/1741611961 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe52015bae0 con 0x7fe52014f720 2023-11-26T07:14:39.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.884+0000 7fe52695b700 1 -- 172.21.15.2:0/1741611961 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone51880", "target": ["mon-mgr", ""]}) v1 -- 0x7fe520066ce0 con 0x7fe50c06b410 2023-11-26T07:14:39.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.974+0000 7fe51cff9700 1 -- 172.21.15.2:0/1741611961 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe520066ce0 con 0x7fe50c06b410 2023-11-26T07:14:39.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.977+0000 7fe52695b700 1 -- 172.21.15.2:0/1741611961 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe50c06b410 msgr2=0x7fe50c06d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:39.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.977+0000 7fe52695b700 1 --2- 172.21.15.2:0/1741611961 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe50c06b410 0x7fe50c06d8d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe510007fd0 tx=0x7fe510009040 comp rx=0 tx=0).stop 2023-11-26T07:14:39.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.977+0000 7fe52695b700 1 -- 172.21.15.2:0/1741611961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe52014f720 msgr2=0x7fe5200ceb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:39.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.977+0000 7fe52695b700 1 --2- 172.21.15.2:0/1741611961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe52014f720 0x7fe5200ceb00 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fe51800cb40 tx=0x7fe51800ce50 comp rx=0 tx=0).stop 2023-11-26T07:14:39.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.977+0000 7fe52695b700 1 -- 172.21.15.2:0/1741611961 shutdown_connections 2023-11-26T07:14:39.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.977+0000 7fe52695b700 1 --2- 172.21.15.2:0/1741611961 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe50c06b410 0x7fe50c06d8d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:39.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.977+0000 7fe52695b700 1 --2- 172.21.15.2:0/1741611961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe52014f720 0x7fe5200ceb00 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:39.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.977+0000 7fe52695b700 1 --2- 172.21.15.2:0/1741611961 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5200d06b0 0x7fe520147880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:39.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.977+0000 7fe52695b700 1 --2- 172.21.15.2:0/1741611961 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe52015a440 0x7fe52014f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:39.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.977+0000 7fe52695b700 1 -- 172.21.15.2:0/1741611961 >> 172.21.15.2:0/1741611961 conn(0x7fe5200b5070 msgr2=0x7fe52006bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:39.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.977+0000 7fe52695b700 1 -- 172.21.15.2:0/1741611961 shutdown_connections 2023-11-26T07:14:39.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:39.977+0000 7fe52695b700 1 -- 172.21.15.2:0/1741611961 wait complete. 2023-11-26T07:14:39.991 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone51880 2023-11-26T07:14:40.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.116+0000 7fa03a774700 1 Processor -- start 2023-11-26T07:14:40.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.117+0000 7fa03a774700 1 -- start start 2023-11-26T07:14:40.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.117+0000 7fa03a774700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa0340b4240 0x7fa034160330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:40.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.117+0000 7fa03a774700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0340ce140 0x7fa0340ce590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:40.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.117+0000 7fa03a774700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0340b14c0 con 0x7fa03415f410 2023-11-26T07:14:40.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.117+0000 7fa03a774700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0340b46f0 con 0x7fa0340b4240 2023-11-26T07:14:40.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.117+0000 7fa03a774700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0340b3070 con 0x7fa0340ce140 2023-11-26T07:14:40.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.118+0000 7fa0337fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa0340b4240 0x7fa034160330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:40.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.118+0000 7fa0337fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa0340b4240 0x7fa034160330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42360/0 (socket says 172.21.15.2:42360) 2023-11-26T07:14:40.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.118+0000 7fa0337fe700 1 -- 172.21.15.2:0/2466327679 learned_addr learned my addr 172.21.15.2:0/2466327679 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:40.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.118+0000 7fa038d11700 1 --2- 172.21.15.2:0/2466327679 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0340ce140 0x7fa0340ce590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:40.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.118+0000 7fa0337fe700 1 -- 172.21.15.2:0/2466327679 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0340ce140 msgr2=0x7fa0340ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:40.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.118+0000 7fa0337fe700 1 --2- 172.21.15.2:0/2466327679 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0340ce140 0x7fa0340ce590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:40.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.118+0000 7fa0337fe700 1 -- 172.21.15.2:0/2466327679 >> v1:172.21.15.192:6789/0 conn(0x7fa03415f410 legacy=0x7fa03415fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:40.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.118+0000 7fa0337fe700 1 -- 172.21.15.2:0/2466327679 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0340b3270 con 0x7fa0340b4240 2023-11-26T07:14:40.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.118+0000 7fa0337fe700 1 --2- 172.21.15.2:0/2466327679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0340b4240 0x7fa034160330 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa0280098f0 tx=0x7fa028009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b8199b3e51f408d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:40.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.118+0000 7fa032ffd700 1 -- 172.21.15.2:0/2466327679 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02800b8a0 con 0x7fa0340b4240 2023-11-26T07:14:40.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.118+0000 7fa032ffd700 1 -- 172.21.15.2:0/2466327679 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02800ba00 con 0x7fa0340b4240 2023-11-26T07:14:40.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.118+0000 7fa032ffd700 1 -- 172.21.15.2:0/2466327679 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02800bd90 con 0x7fa0340b4240 2023-11-26T07:14:40.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.119+0000 7fa03a774700 1 -- 172.21.15.2:0/2466327679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0340b4240 msgr2=0x7fa034160330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:40.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.119+0000 7fa03a774700 1 --2- 172.21.15.2:0/2466327679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0340b4240 0x7fa034160330 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa0280098f0 tx=0x7fa028009c00 comp rx=0 tx=0).stop 2023-11-26T07:14:40.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.119+0000 7fa03a774700 1 -- 172.21.15.2:0/2466327679 shutdown_connections 2023-11-26T07:14:40.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.119+0000 7fa03a774700 1 --2- 172.21.15.2:0/2466327679 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0340ce140 0x7fa0340ce590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:40.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.119+0000 7fa03a774700 1 --2- 172.21.15.2:0/2466327679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0340b4240 0x7fa034160330 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:40.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.119+0000 7fa03a774700 1 -- 172.21.15.2:0/2466327679 >> 172.21.15.2:0/2466327679 conn(0x7fa0340b3720 msgr2=0x7fa0340b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:40.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.119+0000 7fa03a774700 1 -- 172.21.15.2:0/2466327679 shutdown_connections 2023-11-26T07:14:40.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.119+0000 7fa03a774700 1 -- 172.21.15.2:0/2466327679 wait complete. 2023-11-26T07:14:40.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.120+0000 7fa03a774700 1 Processor -- start 2023-11-26T07:14:40.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.120+0000 7fa03a774700 1 -- start start 2023-11-26T07:14:40.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.121+0000 7fa03a774700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0340b4240 0x7fa0340c95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:40.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.121+0000 7fa03a774700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0340ce140 0x7fa0340b0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:40.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.121+0000 7fa03a774700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa03415f410 0x7fa034150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:40.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.121+0000 7fa03a774700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0340c9e40 con 0x7fa0340ce140 2023-11-26T07:14:40.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.121+0000 7fa03a774700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0341518c0 con 0x7fa0340b4240 2023-11-26T07:14:40.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.121+0000 7fa03a774700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa03406c280 con 0x7fa03415f410 2023-11-26T07:14:40.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.121+0000 7fa0337fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0340ce140 0x7fa0340b0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:40.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.121+0000 7fa0337fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0340ce140 0x7fa0340b0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42366/0 (socket says 172.21.15.2:42366) 2023-11-26T07:14:40.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.121+0000 7fa0337fe700 1 -- 172.21.15.2:0/563730616 learned_addr learned my addr 172.21.15.2:0/563730616 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:40.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.121+0000 7fa033fff700 1 --2- 172.21.15.2:0/563730616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0340b4240 0x7fa0340c95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:40.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.121+0000 7fa038d11700 1 --2- 172.21.15.2:0/563730616 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa03415f410 0x7fa034150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:40.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.121+0000 7fa0337fe700 1 -- 172.21.15.2:0/563730616 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa03415f410 msgr2=0x7fa034150c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:40.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.121+0000 7fa0337fe700 1 --2- 172.21.15.2:0/563730616 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa03415f410 0x7fa034150c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:40.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.121+0000 7fa0337fe700 1 -- 172.21.15.2:0/563730616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0340b4240 msgr2=0x7fa0340c95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:40.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.121+0000 7fa0337fe700 1 --2- 172.21.15.2:0/563730616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0340b4240 0x7fa0340c95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:40.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.121+0000 7fa0337fe700 1 -- 172.21.15.2:0/563730616 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa028009550 con 0x7fa0340ce140 2023-11-26T07:14:40.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.121+0000 7fa033fff700 1 --2- 172.21.15.2:0/563730616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0340b4240 0x7fa0340c95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:14:40.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.121+0000 7fa038d11700 1 --2- 172.21.15.2:0/563730616 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa03415f410 0x7fa034150c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:14:40.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.121+0000 7fa0337fe700 1 --2- 172.21.15.2:0/563730616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0340ce140 0x7fa0340b0390 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa028009c40 tx=0x7fa028004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:40.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.122+0000 7fa030ff9700 1 -- 172.21.15.2:0/563730616 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0280036a0 con 0x7fa0340ce140 2023-11-26T07:14:40.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.122+0000 7fa030ff9700 1 -- 172.21.15.2:0/563730616 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02801e070 con 0x7fa0340ce140 2023-11-26T07:14:40.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.122+0000 7fa03a774700 1 -- 172.21.15.2:0/563730616 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa03406c560 con 0x7fa0340ce140 2023-11-26T07:14:40.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.122+0000 7fa030ff9700 1 -- 172.21.15.2:0/563730616 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa028003a60 con 0x7fa0340ce140 2023-11-26T07:14:40.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.122+0000 7fa03a774700 1 -- 172.21.15.2:0/563730616 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa03406cb20 con 0x7fa0340ce140 2023-11-26T07:14:40.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.123+0000 7fa03a774700 1 -- 172.21.15.2:0/563730616 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa03406ccb0 con 0x7fa0340ce140 2023-11-26T07:14:40.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.123+0000 7fa030ff9700 1 -- 172.21.15.2:0/563730616 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 11) v1 ==== 89690+0+0 (secure 0 0 0) 0x7fa028003bc0 con 0x7fa0340ce140 2023-11-26T07:14:40.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.124+0000 7fa030ff9700 1 --2- 172.21.15.2:0/563730616 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa02006b3e0 0x7fa02006d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:40.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.124+0000 7fa030ff9700 1 -- 172.21.15.2:0/563730616 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fa028020070 con 0x7fa0340ce140 2023-11-26T07:14:40.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.124+0000 7fa033fff700 1 --2- 172.21.15.2:0/563730616 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa02006b3e0 0x7fa02006d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:40.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.124+0000 7fa033fff700 1 --2- 172.21.15.2:0/563730616 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa02006b3e0 0x7fa02006d8a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa024000f60 tx=0x7fa024009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:40.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.128+0000 7fa030ff9700 1 -- 172.21.15.2:0/563730616 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa028055d50 con 0x7fa0340ce140 2023-11-26T07:14:40.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.376+0000 7fa03a774700 1 -- 172.21.15.2:0/563730616 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone51880", "target": ["mon-mgr", ""]}) v1 -- 0x7fa0340cd6d0 con 0x7fa02006b3e0 2023-11-26T07:14:40.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.989+0000 7fa030ff9700 1 -- 172.21.15.2:0/563730616 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+264 (secure 0 0 0) 0x7fa024001440 con 0x7fa02006b3e0 2023-11-26T07:14:40.991 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-26T07:14:40.991 INFO:teuthology.orchestra.run.smithi002.stdout: "status": { 2023-11-26T07:14:40.991 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "canceled", 2023-11-26T07:14:40.991 INFO:teuthology.orchestra.run.smithi002.stdout: "source": { 2023-11-26T07:14:40.992 INFO:teuthology.orchestra.run.smithi002.stdout: "volume": "cephfs", 2023-11-26T07:14:40.992 INFO:teuthology.orchestra.run.smithi002.stdout: "subvolume": "subvol96280", 2023-11-26T07:14:40.992 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot": "subvol_snap26280" 2023-11-26T07:14:40.992 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:14:40.992 INFO:teuthology.orchestra.run.smithi002.stdout: "failure": { 2023-11-26T07:14:40.992 INFO:teuthology.orchestra.run.smithi002.stdout: "errno": "4", 2023-11-26T07:14:40.992 INFO:teuthology.orchestra.run.smithi002.stdout: "error_msg": "user interrupted clone operation" 2023-11-26T07:14:40.992 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:14:40.992 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:14:40.992 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-26T07:14:40.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.992+0000 7fa03a774700 1 -- 172.21.15.2:0/563730616 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa02006b3e0 msgr2=0x7fa02006d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:40.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.992+0000 7fa03a774700 1 --2- 172.21.15.2:0/563730616 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa02006b3e0 0x7fa02006d8a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa024000f60 tx=0x7fa024009040 comp rx=0 tx=0).stop 2023-11-26T07:14:40.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.992+0000 7fa03a774700 1 -- 172.21.15.2:0/563730616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0340ce140 msgr2=0x7fa0340b0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:40.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.992+0000 7fa03a774700 1 --2- 172.21.15.2:0/563730616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0340ce140 0x7fa0340b0390 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa028009c40 tx=0x7fa028004750 comp rx=0 tx=0).stop 2023-11-26T07:14:40.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.992+0000 7fa03a774700 1 -- 172.21.15.2:0/563730616 shutdown_connections 2023-11-26T07:14:40.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.992+0000 7fa03a774700 1 --2- 172.21.15.2:0/563730616 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa02006b3e0 0x7fa02006d8a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:40.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.992+0000 7fa03a774700 1 --2- 172.21.15.2:0/563730616 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa03415f410 0x7fa034150c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:40.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.992+0000 7fa03a774700 1 --2- 172.21.15.2:0/563730616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0340b4240 0x7fa0340c95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:40.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.992+0000 7fa03a774700 1 --2- 172.21.15.2:0/563730616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0340ce140 0x7fa0340b0390 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:40.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.992+0000 7fa03a774700 1 -- 172.21.15.2:0/563730616 >> 172.21.15.2:0/563730616 conn(0x7fa0340b3720 msgr2=0x7fa0340b3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:40.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.992+0000 7fa03a774700 1 -- 172.21.15.2:0/563730616 shutdown_connections 2023-11-26T07:14:40.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:40.992+0000 7fa03a774700 1 -- 172.21.15.2:0/563730616 wait complete. 2023-11-26T07:14:41.009 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol_clone51880 --force 2023-11-26T07:14:41.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.142+0000 7f040cde3700 1 Processor -- start 2023-11-26T07:14:41.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.142+0000 7f040cde3700 1 -- start start 2023-11-26T07:14:41.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.143+0000 7f040cde3700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f040806b6e0 0x7f04080aff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:41.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.143+0000 7f040cde3700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f040806ffa0 0x7f040815e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:41.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.143+0000 7f040cde3700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f040806f710 con 0x7f040806f330 2023-11-26T07:14:41.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.143+0000 7f040cde3700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04080b44c0 con 0x7f040806b6e0 2023-11-26T07:14:41.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.143+0000 7f040cde3700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f040815bf70 con 0x7f040806ffa0 2023-11-26T07:14:41.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.143+0000 7f0405d9b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f040806b6e0 0x7f04080aff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:41.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.143+0000 7f040659c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f040806f330 0x7f040806afd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33582/0 (socket says 172.21.15.2:33582) 2023-11-26T07:14:41.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.143+0000 7f040659c700 1 -- 172.21.15.2:0/1819018208 learned_addr learned my addr 172.21.15.2:0/1819018208 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:14:41.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.143+0000 7f0406d9d700 1 --2- 172.21.15.2:0/1819018208 >> v2:172.21.15.192:3300/0 conn(0x7f040806ffa0 0x7f040815e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:41.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.143+0000 7f040559a700 1 -- 172.21.15.2:0/1819018208 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2275696085 0 0) 0x7f040806f710 con 0x7f040806f330 2023-11-26T07:14:41.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.143+0000 7f040559a700 1 -- 172.21.15.2:0/1819018208 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03f00035b0 con 0x7f040806f330 2023-11-26T07:14:41.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.143+0000 7f0405d9b700 1 -- 172.21.15.2:0/1819018208 >> v2:172.21.15.192:3300/0 conn(0x7f040806ffa0 msgr2=0x7f040815e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:41.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.143+0000 7f0405d9b700 1 --2- 172.21.15.2:0/1819018208 >> v2:172.21.15.192:3300/0 conn(0x7f040806ffa0 0x7f040815e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:41.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.143+0000 7f0405d9b700 1 -- 172.21.15.2:0/1819018208 >> v1:172.21.15.2:6789/0 conn(0x7f040806f330 legacy=0x7f040806afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:41.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.143+0000 7f0405d9b700 1 -- 172.21.15.2:0/1819018208 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04080b05c0 con 0x7f040806b6e0 2023-11-26T07:14:41.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.144+0000 7f0405d9b700 1 --2- 172.21.15.2:0/1819018208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f040806b6e0 0x7f04080aff50 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f0408069510 tx=0x7f03f8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f41240dbe48ac4b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:41.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.144+0000 7f040559a700 1 -- 172.21.15.2:0/1819018208 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f8011830 con 0x7f040806b6e0 2023-11-26T07:14:41.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.144+0000 7f040559a700 1 -- 172.21.15.2:0/1819018208 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f8011990 con 0x7f040806b6e0 2023-11-26T07:14:41.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.144+0000 7f040559a700 1 -- 172.21.15.2:0/1819018208 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f8011d20 con 0x7f040806b6e0 2023-11-26T07:14:41.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.144+0000 7f040cde3700 1 -- 172.21.15.2:0/1819018208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f040806b6e0 msgr2=0x7f04080aff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:41.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.144+0000 7f040cde3700 1 --2- 172.21.15.2:0/1819018208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f040806b6e0 0x7f04080aff50 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f0408069510 tx=0x7f03f8009b20 comp rx=0 tx=0).stop 2023-11-26T07:14:41.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.144+0000 7f040cde3700 1 -- 172.21.15.2:0/1819018208 shutdown_connections 2023-11-26T07:14:41.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.144+0000 7f040cde3700 1 --2- 172.21.15.2:0/1819018208 >> v2:172.21.15.192:3300/0 conn(0x7f040806ffa0 0x7f040815e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:41.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.144+0000 7f040cde3700 1 --2- 172.21.15.2:0/1819018208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f040806b6e0 0x7f04080aff50 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:41.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.144+0000 7f040cde3700 1 -- 172.21.15.2:0/1819018208 >> 172.21.15.2:0/1819018208 conn(0x7f04080b2840 msgr2=0x7f04080b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:41.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.144+0000 7f040cde3700 1 -- 172.21.15.2:0/1819018208 shutdown_connections 2023-11-26T07:14:41.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.144+0000 7f040cde3700 1 -- 172.21.15.2:0/1819018208 wait complete. 2023-11-26T07:14:41.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.146+0000 7f040cde3700 1 Processor -- start 2023-11-26T07:14:41.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.146+0000 7f040cde3700 1 -- start start 2023-11-26T07:14:41.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.146+0000 7f040cde3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f040806b6e0 0x7f04080b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:41.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.146+0000 7f040cde3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f040806f330 0x7f04081f4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:41.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.146+0000 7f040cde3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f040806ffa0 0x7f04081522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:41.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.146+0000 7f040cde3700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040815fd40 con 0x7f040806f330 2023-11-26T07:14:41.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.146+0000 7f040cde3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0408160020 con 0x7f040806ffa0 2023-11-26T07:14:41.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.146+0000 7f040cde3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0408160300 con 0x7f040806b6e0 2023-11-26T07:14:41.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.147+0000 7f0405d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f040806f330 0x7f04081f4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:41.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.147+0000 7f0405d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f040806f330 0x7f04081f4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42380/0 (socket says 172.21.15.2:42380) 2023-11-26T07:14:41.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.147+0000 7f0405d9b700 1 -- 172.21.15.2:0/3962611384 learned_addr learned my addr 172.21.15.2:0/3962611384 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:41.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.147+0000 7f0406d9d700 1 --2- 172.21.15.2:0/3962611384 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f040806ffa0 0x7f04081522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:41.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.147+0000 7f040659c700 1 --2- 172.21.15.2:0/3962611384 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f040806b6e0 0x7f04080b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:41.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.147+0000 7f0405d9b700 1 -- 172.21.15.2:0/3962611384 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f040806b6e0 msgr2=0x7f04080b1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:41.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.147+0000 7f0405d9b700 1 --2- 172.21.15.2:0/3962611384 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f040806b6e0 0x7f04080b1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:41.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.147+0000 7f0405d9b700 1 -- 172.21.15.2:0/3962611384 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f040806ffa0 msgr2=0x7f04081522c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:41.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.147+0000 7f0405d9b700 1 --2- 172.21.15.2:0/3962611384 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f040806ffa0 0x7f04081522c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:41.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.147+0000 7f0405d9b700 1 -- 172.21.15.2:0/3962611384 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f80094a0 con 0x7f040806f330 2023-11-26T07:14:41.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.147+0000 7f0406d9d700 1 --2- 172.21.15.2:0/3962611384 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f040806ffa0 0x7f04081522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:14:41.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.147+0000 7f0405d9b700 1 --2- 172.21.15.2:0/3962611384 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f040806f330 0x7f04081f4070 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f03f8000c00 tx=0x7f03f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:41.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.147+0000 7f03f6ffd700 1 -- 172.21.15.2:0/3962611384 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f80036a0 con 0x7f040806f330 2023-11-26T07:14:41.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.147+0000 7f03f6ffd700 1 -- 172.21.15.2:0/3962611384 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f801e070 con 0x7f040806f330 2023-11-26T07:14:41.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.147+0000 7f040cde3700 1 -- 172.21.15.2:0/3962611384 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04081605e0 con 0x7f040806f330 2023-11-26T07:14:41.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.147+0000 7f03f6ffd700 1 -- 172.21.15.2:0/3962611384 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f8003a60 con 0x7f040806f330 2023-11-26T07:14:41.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.147+0000 7f040cde3700 1 -- 172.21.15.2:0/3962611384 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04080b20e0 con 0x7f040806f330 2023-11-26T07:14:41.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.148+0000 7f040cde3700 1 -- 172.21.15.2:0/3962611384 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04080af290 con 0x7f040806f330 2023-11-26T07:14:41.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.149+0000 7f03f6ffd700 1 -- 172.21.15.2:0/3962611384 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 11) v1 ==== 89690+0+0 (secure 0 0 0) 0x7f03f8003bc0 con 0x7f040806f330 2023-11-26T07:14:41.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.149+0000 7f03f6ffd700 1 --2- 172.21.15.2:0/3962611384 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f03e806b3e0 0x7f03e806d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:41.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.149+0000 7f03f6ffd700 1 -- 172.21.15.2:0/3962611384 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f03f808ada0 con 0x7f040806f330 2023-11-26T07:14:41.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.150+0000 7f040659c700 1 --2- 172.21.15.2:0/3962611384 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f03e806b3e0 0x7f03e806d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:41.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.150+0000 7f040659c700 1 --2- 172.21.15.2:0/3962611384 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f03e806b3e0 0x7f03e806d8a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f03fc0011e0 tx=0x7f03fc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:41.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.154+0000 7f03f6ffd700 1 -- 172.21.15.2:0/3962611384 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f03f8055850 con 0x7f040806f330 2023-11-26T07:14:41.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.387+0000 7f040cde3700 1 -- 172.21.15.2:0/3962611384 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol_clone51880", "force": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f040815b060 con 0x7f03e806b3e0 2023-11-26T07:14:41.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.404+0000 7f03f6ffd700 1 -- 172.21.15.2:0/3962611384 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f040815b060 con 0x7f03e806b3e0 2023-11-26T07:14:41.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.406+0000 7f040cde3700 1 -- 172.21.15.2:0/3962611384 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f03e806b3e0 msgr2=0x7f03e806d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:41.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.406+0000 7f040cde3700 1 --2- 172.21.15.2:0/3962611384 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f03e806b3e0 0x7f03e806d8a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f03fc0011e0 tx=0x7f03fc009040 comp rx=0 tx=0).stop 2023-11-26T07:14:41.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.406+0000 7f040cde3700 1 -- 172.21.15.2:0/3962611384 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f040806f330 msgr2=0x7f04081f4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:41.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.406+0000 7f040cde3700 1 --2- 172.21.15.2:0/3962611384 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f040806f330 0x7f04081f4070 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f03f8000c00 tx=0x7f03f8004750 comp rx=0 tx=0).stop 2023-11-26T07:14:41.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.407+0000 7f040cde3700 1 -- 172.21.15.2:0/3962611384 shutdown_connections 2023-11-26T07:14:41.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.407+0000 7f040cde3700 1 --2- 172.21.15.2:0/3962611384 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f03e806b3e0 0x7f03e806d8a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:41.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.407+0000 7f040cde3700 1 --2- 172.21.15.2:0/3962611384 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f040806ffa0 0x7f04081522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:41.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.407+0000 7f040cde3700 1 --2- 172.21.15.2:0/3962611384 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f040806b6e0 0x7f04080b1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:41.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.407+0000 7f040cde3700 1 --2- 172.21.15.2:0/3962611384 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f040806f330 0x7f04081f4070 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:41.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.407+0000 7f040cde3700 1 -- 172.21.15.2:0/3962611384 >> 172.21.15.2:0/3962611384 conn(0x7f04080b2840 msgr2=0x7f040815c170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:41.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.407+0000 7f040cde3700 1 -- 172.21.15.2:0/3962611384 shutdown_connections 2023-11-26T07:14:41.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.407+0000 7f040cde3700 1 -- 172.21.15.2:0/3962611384 wait complete. 2023-11-26T07:14:41.417 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:14:41.416+0000 7f8da9aad700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:14:41.417 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:14:41.416+0000 7f8da9aad700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:14:41.418 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:14:41.416+0000 7f8da9aad700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:14:41.418 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:14:41.416+0000 7f8da9aad700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:14:41.418 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:14:41.416+0000 7f8da9aad700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:14:41.421 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvol96280 subvol_snap26280 2023-11-26T07:14:41.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.550+0000 7f35fe23c700 1 Processor -- start 2023-11-26T07:14:41.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.550+0000 7f35fe23c700 1 -- start start 2023-11-26T07:14:41.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.551+0000 7f35fe23c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f35f815dd30 0x7f35f815e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:41.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.551+0000 7f35fe23c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f35f80d2490 0x7f35f80d28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:41.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.551+0000 7f35fe23c700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35f80d22b0 con 0x7f35f80cea30 2023-11-26T07:14:41.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.551+0000 7f35fe23c700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35f80d2e20 con 0x7f35f80d2490 2023-11-26T07:14:41.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.551+0000 7f35fe23c700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35f815e650 con 0x7f35f815dd30 2023-11-26T07:14:41.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.551+0000 7f35f7fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f35f80d2490 0x7f35f80d28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:41.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.551+0000 7f35f7fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f35f80d2490 0x7f35f80d28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42390/0 (socket says 172.21.15.2:42390) 2023-11-26T07:14:41.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.551+0000 7f35f7fff700 1 -- 172.21.15.2:0/1043823862 learned_addr learned my addr 172.21.15.2:0/1043823862 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:41.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.551+0000 7f35f77fe700 1 --2- 172.21.15.2:0/1043823862 >> v2:172.21.15.192:3300/0 conn(0x7f35f815dd30 0x7f35f815e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:41.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.551+0000 7f35f7fff700 1 -- 172.21.15.2:0/1043823862 >> v2:172.21.15.192:3300/0 conn(0x7f35f815dd30 msgr2=0x7f35f815e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:41.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.551+0000 7f35f7fff700 1 --2- 172.21.15.2:0/1043823862 >> v2:172.21.15.192:3300/0 conn(0x7f35f815dd30 0x7f35f815e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:41.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.551+0000 7f35f7fff700 1 -- 172.21.15.2:0/1043823862 >> v1:172.21.15.192:6789/0 conn(0x7f35f80cea30 legacy=0x7f35f80d1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:41.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.551+0000 7f35f7fff700 1 -- 172.21.15.2:0/1043823862 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f80cef10 con 0x7f35f80d2490 2023-11-26T07:14:41.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.551+0000 7f35f7fff700 1 --2- 172.21.15.2:0/1043823862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35f80d2490 0x7f35f80d28e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f35f806b170 tx=0x7f35f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c172dbf331c44429 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:41.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.551+0000 7f35f67fc700 1 -- 172.21.15.2:0/1043823862 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f000e070 con 0x7f35f80d2490 2023-11-26T07:14:41.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.551+0000 7f35f67fc700 1 -- 172.21.15.2:0/1043823862 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f0003a20 con 0x7f35f80d2490 2023-11-26T07:14:41.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.551+0000 7f35f67fc700 1 -- 172.21.15.2:0/1043823862 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f0003dd0 con 0x7f35f80d2490 2023-11-26T07:14:41.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.552+0000 7f35fe23c700 1 -- 172.21.15.2:0/1043823862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35f80d2490 msgr2=0x7f35f80d28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:41.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.552+0000 7f35fe23c700 1 --2- 172.21.15.2:0/1043823862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35f80d2490 0x7f35f80d28e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f35f806b170 tx=0x7f35f000b330 comp rx=0 tx=0).stop 2023-11-26T07:14:41.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.552+0000 7f35fe23c700 1 -- 172.21.15.2:0/1043823862 shutdown_connections 2023-11-26T07:14:41.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.552+0000 7f35fe23c700 1 --2- 172.21.15.2:0/1043823862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35f80d2490 0x7f35f80d28e0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:41.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.552+0000 7f35fe23c700 1 --2- 172.21.15.2:0/1043823862 >> v2:172.21.15.192:3300/0 conn(0x7f35f815dd30 0x7f35f815e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:41.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.552+0000 7f35fe23c700 1 -- 172.21.15.2:0/1043823862 >> 172.21.15.2:0/1043823862 conn(0x7f35f809d110 msgr2=0x7f35f80d3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:41.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.552+0000 7f35fe23c700 1 -- 172.21.15.2:0/1043823862 shutdown_connections 2023-11-26T07:14:41.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.552+0000 7f35fe23c700 1 -- 172.21.15.2:0/1043823862 wait complete. 2023-11-26T07:14:41.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.553+0000 7f35fe23c700 1 Processor -- start 2023-11-26T07:14:41.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.553+0000 7f35fe23c700 1 -- start start 2023-11-26T07:14:41.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.554+0000 7f35fe23c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f35f80cea30 0x7f35f814be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:41.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.554+0000 7f35fe23c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35f80d2490 0x7f35f814e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:41.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.554+0000 7f35fe23c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35f815dd30 0x7f35f814eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:41.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.554+0000 7f35fe23c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f814d0e0 con 0x7f35f80d2490 2023-11-26T07:14:41.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.554+0000 7f35fe23c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f814c7d0 con 0x7f35f815dd30 2023-11-26T07:14:41.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.554+0000 7f35fe23c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f80c8770 con 0x7f35f80cea30 2023-11-26T07:14:41.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.554+0000 7f35f6ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35f80d2490 0x7f35f814e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:41.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.554+0000 7f35f6ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35f80d2490 0x7f35f814e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42394/0 (socket says 172.21.15.2:42394) 2023-11-26T07:14:41.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.554+0000 7f35f6ffd700 1 -- 172.21.15.2:0/3800775754 learned_addr learned my addr 172.21.15.2:0/3800775754 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:41.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.554+0000 7f35f77fe700 1 --2- 172.21.15.2:0/3800775754 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f35f80cea30 0x7f35f814be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:41.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.554+0000 7f35f7fff700 1 --2- 172.21.15.2:0/3800775754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35f815dd30 0x7f35f814eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:41.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.555+0000 7f35f6ffd700 1 -- 172.21.15.2:0/3800775754 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f35f80cea30 msgr2=0x7f35f814be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:41.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.555+0000 7f35f6ffd700 1 --2- 172.21.15.2:0/3800775754 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f35f80cea30 0x7f35f814be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:41.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.555+0000 7f35f6ffd700 1 -- 172.21.15.2:0/3800775754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35f815dd30 msgr2=0x7f35f814eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:41.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.555+0000 7f35f6ffd700 1 --2- 172.21.15.2:0/3800775754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35f815dd30 0x7f35f814eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:41.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.555+0000 7f35f6ffd700 1 -- 172.21.15.2:0/3800775754 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f0009b30 con 0x7f35f80d2490 2023-11-26T07:14:41.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.555+0000 7f35f6ffd700 1 --2- 172.21.15.2:0/3800775754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35f80d2490 0x7f35f814e860 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f35ec00b480 tx=0x7f35ec00b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:41.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.555+0000 7f35dffff700 1 -- 172.21.15.2:0/3800775754 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ec011830 con 0x7f35f80d2490 2023-11-26T07:14:41.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.555+0000 7f35dffff700 1 -- 172.21.15.2:0/3800775754 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35ec011990 con 0x7f35f80d2490 2023-11-26T07:14:41.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.555+0000 7f35fe23c700 1 -- 172.21.15.2:0/3800775754 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35f809df20 con 0x7f35f80d2490 2023-11-26T07:14:41.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.555+0000 7f35dffff700 1 -- 172.21.15.2:0/3800775754 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ec011d40 con 0x7f35f80d2490 2023-11-26T07:14:41.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.555+0000 7f35fe23c700 1 -- 172.21.15.2:0/3800775754 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35f814ca20 con 0x7f35f80d2490 2023-11-26T07:14:41.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.556+0000 7f35fe23c700 1 -- 172.21.15.2:0/3800775754 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35f814d220 con 0x7f35f80d2490 2023-11-26T07:14:41.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.556+0000 7f35dffff700 1 -- 172.21.15.2:0/3800775754 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 11) v1 ==== 89690+0+0 (secure 0 0 0) 0x7f35ec01a400 con 0x7f35f80d2490 2023-11-26T07:14:41.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.557+0000 7f35dffff700 1 --2- 172.21.15.2:0/3800775754 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f35e406b3e0 0x7f35e406d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:41.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.557+0000 7f35dffff700 1 -- 172.21.15.2:0/3800775754 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f35ec089980 con 0x7f35f80d2490 2023-11-26T07:14:41.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.557+0000 7f35f77fe700 1 --2- 172.21.15.2:0/3800775754 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f35e406b3e0 0x7f35e406d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:41.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.557+0000 7f35f77fe700 1 --2- 172.21.15.2:0/3800775754 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f35e406b3e0 0x7f35e406d8a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f35f80ce310 tx=0x7f35e8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:41.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.562+0000 7f35dffff700 1 -- 172.21.15.2:0/3800775754 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f35f814d220 con 0x7f35f80d2490 2023-11-26T07:14:41.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.803+0000 7f35fe23c700 1 -- 172.21.15.2:0/3800775754 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvol96280", "snap_name": "subvol_snap26280", "target": ["mon-mgr", ""]}) v1 -- 0x7f35f80cf7b0 con 0x7f35e406b3e0 2023-11-26T07:14:41.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.832+0000 7f35dffff700 1 -- 172.21.15.2:0/3800775754 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f35e8009e40 con 0x7f35e406b3e0 2023-11-26T07:14:41.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.834+0000 7f35fe23c700 1 -- 172.21.15.2:0/3800775754 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f35e406b3e0 msgr2=0x7f35e406d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:41.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.834+0000 7f35fe23c700 1 --2- 172.21.15.2:0/3800775754 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f35e406b3e0 0x7f35e406d8a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f35f80ce310 tx=0x7f35e8008040 comp rx=0 tx=0).stop 2023-11-26T07:14:41.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.834+0000 7f35fe23c700 1 -- 172.21.15.2:0/3800775754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35f80d2490 msgr2=0x7f35f814e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:41.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.834+0000 7f35fe23c700 1 --2- 172.21.15.2:0/3800775754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35f80d2490 0x7f35f814e860 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f35ec00b480 tx=0x7f35ec00b790 comp rx=0 tx=0).stop 2023-11-26T07:14:41.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.834+0000 7f35fe23c700 1 -- 172.21.15.2:0/3800775754 shutdown_connections 2023-11-26T07:14:41.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.834+0000 7f35fe23c700 1 --2- 172.21.15.2:0/3800775754 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f35e406b3e0 0x7f35e406d8a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:41.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.834+0000 7f35fe23c700 1 --2- 172.21.15.2:0/3800775754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35f815dd30 0x7f35f814eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:41.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.834+0000 7f35fe23c700 1 --2- 172.21.15.2:0/3800775754 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f35f80cea30 0x7f35f814be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:41.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.835+0000 7f35fe23c700 1 --2- 172.21.15.2:0/3800775754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35f80d2490 0x7f35f814e860 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:41.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.835+0000 7f35fe23c700 1 -- 172.21.15.2:0/3800775754 >> 172.21.15.2:0/3800775754 conn(0x7f35f809d110 msgr2=0x7f35f80b85e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:41.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.835+0000 7f35fe23c700 1 -- 172.21.15.2:0/3800775754 shutdown_connections 2023-11-26T07:14:41.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.835+0000 7f35fe23c700 1 -- 172.21.15.2:0/3800775754 wait complete. 2023-11-26T07:14:41.848 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol96280 2023-11-26T07:14:41.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.974+0000 7ff8d6ddc700 1 Processor -- start 2023-11-26T07:14:41.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.974+0000 7ff8d6ddc700 1 -- start start 2023-11-26T07:14:41.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.975+0000 7ff8d6ddc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff8d0143ae0 0x7ff8d00b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:41.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.975+0000 7ff8d6ddc700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8d0143ec0 con 0x7ff8d00722c0 2023-11-26T07:14:41.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.975+0000 7ff8d6ddc700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8d00b3ae0 con 0x7ff8d01440f0 2023-11-26T07:14:41.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.975+0000 7ff8d6ddc700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8d00b40a0 con 0x7ff8d0143ae0 2023-11-26T07:14:41.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.975+0000 7ff8d4b78700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff8d0143ae0 0x7ff8d00b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:41.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.975+0000 7ff8d5379700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff8d00722c0 0x7ff8d006e510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33612/0 (socket says 172.21.15.2:33612) 2023-11-26T07:14:41.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.975+0000 7ff8d5379700 1 -- 172.21.15.2:0/4016984352 learned_addr learned my addr 172.21.15.2:0/4016984352 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:14:41.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.976+0000 7ff8d4b78700 1 -- 172.21.15.2:0/4016984352 >> v1:172.21.15.192:6789/0 conn(0x7ff8d01440f0 legacy=0x7ff8d0071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:41.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.976+0000 7ff8d4b78700 1 -- 172.21.15.2:0/4016984352 >> v1:172.21.15.2:6789/0 conn(0x7ff8d00722c0 legacy=0x7ff8d006e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:41.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.976+0000 7ff8d4b78700 1 -- 172.21.15.2:0/4016984352 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d00b3dc0 con 0x7ff8d0143ae0 2023-11-26T07:14:41.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.976+0000 7ff8cf7fe700 1 -- 172.21.15.2:0/4016984352 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2375788447 0 0) 0x7ff8d0143ec0 con 0x7ff8d00722c0 2023-11-26T07:14:41.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.976+0000 7ff8d4b78700 1 --2- 172.21.15.2:0/4016984352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8d0143ae0 0x7ff8d00b51b0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4009840 tx=0x7ff8c4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aa224686b81c5be server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:41.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.976+0000 7ff8cf7fe700 1 -- 172.21.15.2:0/4016984352 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c4011830 con 0x7ff8d0143ae0 2023-11-26T07:14:41.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.976+0000 7ff8cf7fe700 1 -- 172.21.15.2:0/4016984352 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c4011990 con 0x7ff8d0143ae0 2023-11-26T07:14:41.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.976+0000 7ff8cf7fe700 1 -- 172.21.15.2:0/4016984352 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c4011d20 con 0x7ff8d0143ae0 2023-11-26T07:14:41.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.976+0000 7ff8d6ddc700 1 -- 172.21.15.2:0/4016984352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8d0143ae0 msgr2=0x7ff8d00b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:41.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.976+0000 7ff8d6ddc700 1 --2- 172.21.15.2:0/4016984352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8d0143ae0 0x7ff8d00b51b0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4009840 tx=0x7ff8c4009b50 comp rx=0 tx=0).stop 2023-11-26T07:14:41.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.977+0000 7ff8d6ddc700 1 -- 172.21.15.2:0/4016984352 shutdown_connections 2023-11-26T07:14:41.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.977+0000 7ff8d6ddc700 1 --2- 172.21.15.2:0/4016984352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8d0143ae0 0x7ff8d00b51b0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:41.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.977+0000 7ff8d6ddc700 1 -- 172.21.15.2:0/4016984352 >> 172.21.15.2:0/4016984352 conn(0x7ff8d00b2740 msgr2=0x7ff8d00b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:41.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.977+0000 7ff8d6ddc700 1 -- 172.21.15.2:0/4016984352 shutdown_connections 2023-11-26T07:14:41.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.977+0000 7ff8d6ddc700 1 -- 172.21.15.2:0/4016984352 wait complete. 2023-11-26T07:14:41.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.978+0000 7ff8d6ddc700 1 Processor -- start 2023-11-26T07:14:41.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.978+0000 7ff8d6ddc700 1 -- start start 2023-11-26T07:14:41.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.979+0000 7ff8d6ddc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8d00722c0 0x7ff8d013be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:41.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.979+0000 7ff8d6ddc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8d0143ae0 0x7ff8d006b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:41.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.979+0000 7ff8d6ddc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8d01440f0 0x7ff8d0153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:41.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.979+0000 7ff8d6ddc700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d0139ac0 con 0x7ff8d0143ae0 2023-11-26T07:14:41.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.979+0000 7ff8d6ddc700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d013d0f0 con 0x7ff8d01440f0 2023-11-26T07:14:41.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.979+0000 7ff8d6ddc700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d006bef0 con 0x7ff8d00722c0 2023-11-26T07:14:41.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.979+0000 7ff8cffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8d0143ae0 0x7ff8d006b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:41.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.979+0000 7ff8cffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8d0143ae0 0x7ff8d006b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42406/0 (socket says 172.21.15.2:42406) 2023-11-26T07:14:41.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.979+0000 7ff8cffff700 1 -- 172.21.15.2:0/501884593 learned_addr learned my addr 172.21.15.2:0/501884593 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:41.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.980+0000 7ff8d4b78700 1 --2- 172.21.15.2:0/501884593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8d00722c0 0x7ff8d013be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:41.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.980+0000 7ff8cffff700 1 -- 172.21.15.2:0/501884593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8d00722c0 msgr2=0x7ff8d013be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:41.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.980+0000 7ff8d5379700 1 --2- 172.21.15.2:0/501884593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8d01440f0 0x7ff8d0153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:41.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.980+0000 7ff8cffff700 1 --2- 172.21.15.2:0/501884593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8d00722c0 0x7ff8d013be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:41.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.980+0000 7ff8cffff700 1 -- 172.21.15.2:0/501884593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8d01440f0 msgr2=0x7ff8d0153340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:41.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.980+0000 7ff8cffff700 1 --2- 172.21.15.2:0/501884593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8d01440f0 0x7ff8d0153340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:41.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.980+0000 7ff8cffff700 1 -- 172.21.15.2:0/501884593 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c40094a0 con 0x7ff8d0143ae0 2023-11-26T07:14:41.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.980+0000 7ff8d5379700 1 --2- 172.21.15.2:0/501884593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8d01440f0 0x7ff8d0153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:14:41.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.980+0000 7ff8cffff700 1 --2- 172.21.15.2:0/501884593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8d0143ae0 0x7ff8d006b9b0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc00c450 tx=0x7ff8bc00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:41.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.980+0000 7ff8cd7fa700 1 -- 172.21.15.2:0/501884593 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc0052d0 con 0x7ff8d0143ae0 2023-11-26T07:14:41.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.980+0000 7ff8cd7fa700 1 -- 172.21.15.2:0/501884593 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8bc005430 con 0x7ff8d0143ae0 2023-11-26T07:14:41.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.980+0000 7ff8d6ddc700 1 -- 172.21.15.2:0/501884593 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8d013c4e0 con 0x7ff8d0143ae0 2023-11-26T07:14:41.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.980+0000 7ff8cd7fa700 1 -- 172.21.15.2:0/501884593 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc0038c0 con 0x7ff8d0143ae0 2023-11-26T07:14:41.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.980+0000 7ff8d6ddc700 1 -- 172.21.15.2:0/501884593 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8d013caa0 con 0x7ff8d0143ae0 2023-11-26T07:14:41.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.981+0000 7ff8d6ddc700 1 -- 172.21.15.2:0/501884593 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8d0075480 con 0x7ff8d0143ae0 2023-11-26T07:14:41.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.981+0000 7ff8cd7fa700 1 -- 172.21.15.2:0/501884593 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 11) v1 ==== 89690+0+0 (secure 0 0 0) 0x7ff8bc003a20 con 0x7ff8d0143ae0 2023-11-26T07:14:41.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.982+0000 7ff8cd7fa700 1 --2- 172.21.15.2:0/501884593 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff8b406b3e0 0x7ff8b406d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:41.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.982+0000 7ff8cd7fa700 1 -- 172.21.15.2:0/501884593 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ff8bc0892e0 con 0x7ff8d0143ae0 2023-11-26T07:14:41.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.982+0000 7ff8d4b78700 1 --2- 172.21.15.2:0/501884593 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff8b406b3e0 0x7ff8b406d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:41.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.983+0000 7ff8d4b78700 1 --2- 172.21.15.2:0/501884593 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff8b406b3e0 0x7ff8b406d8a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4009b90 tx=0x7ff8c401c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:41.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:41.986+0000 7ff8cd7fa700 1 -- 172.21.15.2:0/501884593 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff8bc053c30 con 0x7ff8d0143ae0 2023-11-26T07:14:42.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:42.220+0000 7ff8d6ddc700 1 -- 172.21.15.2:0/501884593 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol96280", "target": ["mon-mgr", ""]}) v1 -- 0x7ff8d006dff0 con 0x7ff8b406b3e0 2023-11-26T07:14:42.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:42.237+0000 7ff8cd7fa700 1 -- 172.21.15.2:0/501884593 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7ff8c4011b00 con 0x7ff8b406b3e0 2023-11-26T07:14:42.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:42.239+0000 7ff8d6ddc700 1 -- 172.21.15.2:0/501884593 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff8b406b3e0 msgr2=0x7ff8b406d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:42.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:42.239+0000 7ff8d6ddc700 1 --2- 172.21.15.2:0/501884593 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff8b406b3e0 0x7ff8b406d8a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4009b90 tx=0x7ff8c401c040 comp rx=0 tx=0).stop 2023-11-26T07:14:42.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:42.239+0000 7ff8d6ddc700 1 -- 172.21.15.2:0/501884593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8d0143ae0 msgr2=0x7ff8d006b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:42.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:42.239+0000 7ff8d6ddc700 1 --2- 172.21.15.2:0/501884593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8d0143ae0 0x7ff8d006b9b0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc00c450 tx=0x7ff8bc00c810 comp rx=0 tx=0).stop 2023-11-26T07:14:42.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:42.239+0000 7ff8d6ddc700 1 -- 172.21.15.2:0/501884593 shutdown_connections 2023-11-26T07:14:42.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:42.239+0000 7ff8d6ddc700 1 --2- 172.21.15.2:0/501884593 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff8b406b3e0 0x7ff8b406d8a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:42.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:42.239+0000 7ff8d6ddc700 1 --2- 172.21.15.2:0/501884593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8d01440f0 0x7ff8d0153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:42.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:42.239+0000 7ff8d6ddc700 1 --2- 172.21.15.2:0/501884593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8d00722c0 0x7ff8d013be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:42.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:42.239+0000 7ff8d6ddc700 1 --2- 172.21.15.2:0/501884593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8d0143ae0 0x7ff8d006b9b0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:42.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:42.239+0000 7ff8d6ddc700 1 -- 172.21.15.2:0/501884593 >> 172.21.15.2:0/501884593 conn(0x7ff8d00b2740 msgr2=0x7ff8d00b4430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:42.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:42.239+0000 7ff8d6ddc700 1 -- 172.21.15.2:0/501884593 shutdown_connections 2023-11-26T07:14:42.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:42.239+0000 7ff8d6ddc700 1 -- 172.21.15.2:0/501884593 wait complete. 2023-11-26T07:14:42.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:42.253 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-11-26T07:14:42.286 INFO:teuthology.orchestra.run.smithi002.stdout:3 2023-11-26T07:14:47.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:47.287 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-11-26T07:14:47.327 INFO:teuthology.orchestra.run.smithi002.stdout:2 2023-11-26T07:14:47.328 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-26T07:14:47.328 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:14:47.418 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:14:47.472 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-26T07:14:47.472 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:47.472 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:47.492 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:47.493 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:47.552 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:14:47.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.723+0000 7fbc796a4700 1 Processor -- start 2023-11-26T07:14:47.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.723+0000 7fbc796a4700 1 -- start start 2023-11-26T07:14:47.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.724+0000 7fbc796a4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc7415e460 0x7fbc740d49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:47.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.724+0000 7fbc796a4700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbc740cf480 0x7fbc740d2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:47.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.724+0000 7fbc796a4700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc740b3370 con 0x7fbc740d29d0 2023-11-26T07:14:47.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.724+0000 7fbc796a4700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc740d2e60 con 0x7fbc740cf480 2023-11-26T07:14:47.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.724+0000 7fbc796a4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc740cfc40 con 0x7fbc7415e460 2023-11-26T07:14:47.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.724+0000 7fbc727fc700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbc740cf480 0x7fbc740d2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:47.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.724+0000 7fbc72ffd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc7415e460 0x7fbc740d49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:47.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.724+0000 7fbc737fe700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fbc740d29d0 0x7fbc740d0550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.2:40996/0 (socket says 172.21.15.2:40996) 2023-11-26T07:14:47.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.724+0000 7fbc727fc700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbc740cf480 0x7fbc740d2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.2:50998/0 (socket says 172.21.15.2:50998) 2023-11-26T07:14:47.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.724+0000 7fbc737fe700 1 -- 172.21.15.2:0/1260792777 learned_addr learned my addr 172.21.15.2:0/1260792777 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:14:47.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.724+0000 7fbc71ffb700 1 -- 172.21.15.2:0/1260792777 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2862472073 0 0) 0x7fbc740b3370 con 0x7fbc740d29d0 2023-11-26T07:14:47.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.724+0000 7fbc71ffb700 1 -- 172.21.15.2:0/1260792777 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc5c0035b0 con 0x7fbc740d29d0 2023-11-26T07:14:47.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.724+0000 7fbc72ffd700 1 -- 172.21.15.2:0/1260792777 >> v2:172.21.15.192:3300/0 conn(0x7fbc740cf480 msgr2=0x7fbc740d2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:47.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.724+0000 7fbc72ffd700 1 --2- 172.21.15.2:0/1260792777 >> v2:172.21.15.192:3300/0 conn(0x7fbc740cf480 0x7fbc740d2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:47.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.724+0000 7fbc72ffd700 1 -- 172.21.15.2:0/1260792777 >> v1:172.21.15.192:6789/0 conn(0x7fbc740d29d0 legacy=0x7fbc740d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:47.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.725+0000 7fbc72ffd700 1 -- 172.21.15.2:0/1260792777 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc740b35c0 con 0x7fbc7415e460 2023-11-26T07:14:47.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.725+0000 7fbc72ffd700 1 --2- 172.21.15.2:0/1260792777 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc7415e460 0x7fbc740d49d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbc64009840 tx=0x7fbc64009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ef97264d9a58417 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:47.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.725+0000 7fbc71ffb700 1 -- 172.21.15.2:0/1260792777 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc64011830 con 0x7fbc7415e460 2023-11-26T07:14:47.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.725+0000 7fbc71ffb700 1 -- 172.21.15.2:0/1260792777 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc64011990 con 0x7fbc7415e460 2023-11-26T07:14:47.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.725+0000 7fbc71ffb700 1 -- 172.21.15.2:0/1260792777 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc64011d20 con 0x7fbc7415e460 2023-11-26T07:14:47.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.725+0000 7fbc796a4700 1 -- 172.21.15.2:0/1260792777 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc7415e460 msgr2=0x7fbc740d49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:47.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.725+0000 7fbc796a4700 1 --2- 172.21.15.2:0/1260792777 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc7415e460 0x7fbc740d49d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbc64009840 tx=0x7fbc64009b50 comp rx=0 tx=0).stop 2023-11-26T07:14:47.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.725+0000 7fbc796a4700 1 -- 172.21.15.2:0/1260792777 shutdown_connections 2023-11-26T07:14:47.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.725+0000 7fbc796a4700 1 --2- 172.21.15.2:0/1260792777 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc7415e460 0x7fbc740d49d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:47.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.725+0000 7fbc796a4700 1 --2- 172.21.15.2:0/1260792777 >> v2:172.21.15.192:3300/0 conn(0x7fbc740cf480 0x7fbc740d2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:47.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.725+0000 7fbc796a4700 1 -- 172.21.15.2:0/1260792777 >> 172.21.15.2:0/1260792777 conn(0x7fbc740d3eb0 msgr2=0x7fbc740d42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:47.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.726+0000 7fbc796a4700 1 -- 172.21.15.2:0/1260792777 shutdown_connections 2023-11-26T07:14:47.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.726+0000 7fbc796a4700 1 -- 172.21.15.2:0/1260792777 wait complete. 2023-11-26T07:14:47.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.727+0000 7fbc796a4700 1 Processor -- start 2023-11-26T07:14:47.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.727+0000 7fbc796a4700 1 -- start start 2023-11-26T07:14:47.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.728+0000 7fbc796a4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc740cf480 0x7fbc7415ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:47.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.728+0000 7fbc796a4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc740d29d0 0x7fbc740d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:47.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.728+0000 7fbc796a4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc7415e460 0x7fbc740b91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:47.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.728+0000 7fbc796a4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc740c7dc0 con 0x7fbc7415e460 2023-11-26T07:14:47.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.728+0000 7fbc796a4700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc740c80a0 con 0x7fbc740cf480 2023-11-26T07:14:47.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.728+0000 7fbc796a4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc740c8380 con 0x7fbc740d29d0 2023-11-26T07:14:47.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.728+0000 7fbc737fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc7415e460 0x7fbc740b91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:47.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.728+0000 7fbc737fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc7415e460 0x7fbc740b91f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42422/0 (socket says 172.21.15.2:42422) 2023-11-26T07:14:47.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.728+0000 7fbc737fe700 1 -- 172.21.15.2:0/4193227573 learned_addr learned my addr 172.21.15.2:0/4193227573 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:47.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.728+0000 7fbc72ffd700 1 --2- 172.21.15.2:0/4193227573 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc740cf480 0x7fbc7415ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:47.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.728+0000 7fbc727fc700 1 --2- 172.21.15.2:0/4193227573 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc740d29d0 0x7fbc740d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:47.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.728+0000 7fbc737fe700 1 -- 172.21.15.2:0/4193227573 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc740d29d0 msgr2=0x7fbc740d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:47.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.728+0000 7fbc737fe700 1 --2- 172.21.15.2:0/4193227573 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc740d29d0 0x7fbc740d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:47.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.728+0000 7fbc737fe700 1 -- 172.21.15.2:0/4193227573 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc740cf480 msgr2=0x7fbc7415ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:47.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.728+0000 7fbc737fe700 1 --2- 172.21.15.2:0/4193227573 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc740cf480 0x7fbc7415ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:47.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.728+0000 7fbc737fe700 1 -- 172.21.15.2:0/4193227573 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc640094a0 con 0x7fbc7415e460 2023-11-26T07:14:47.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.728+0000 7fbc737fe700 1 --2- 172.21.15.2:0/4193227573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc7415e460 0x7fbc740b91f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c00cb40 tx=0x7fbc6c00ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:47.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.728+0000 7fbc5b7fe700 1 -- 172.21.15.2:0/4193227573 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c00a9e0 con 0x7fbc7415e460 2023-11-26T07:14:47.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.728+0000 7fbc5b7fe700 1 -- 172.21.15.2:0/4193227573 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6c00ab40 con 0x7fbc7415e460 2023-11-26T07:14:47.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.729+0000 7fbc5b7fe700 1 -- 172.21.15.2:0/4193227573 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c012400 con 0x7fbc7415e460 2023-11-26T07:14:47.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.729+0000 7fbc796a4700 1 -- 172.21.15.2:0/4193227573 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc740c8660 con 0x7fbc7415e460 2023-11-26T07:14:47.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.729+0000 7fbc796a4700 1 -- 172.21.15.2:0/4193227573 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc7415f1a0 con 0x7fbc7415e460 2023-11-26T07:14:47.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.729+0000 7fbc796a4700 1 -- 172.21.15.2:0/4193227573 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc740c8cb0 con 0x7fbc7415e460 2023-11-26T07:14:47.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.730+0000 7fbc5b7fe700 1 -- 172.21.15.2:0/4193227573 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7fbc6c01b3b0 con 0x7fbc7415e460 2023-11-26T07:14:47.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.730+0000 7fbc5b7fe700 1 --2- 172.21.15.2:0/4193227573 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fbc6006b470 0x7fbc6006d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:47.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.731+0000 7fbc5b7fe700 1 -- 172.21.15.2:0/4193227573 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5823+0+0 (secure 0 0 0) 0x7fbc6c089c40 con 0x7fbc7415e460 2023-11-26T07:14:47.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.731+0000 7fbc72ffd700 1 --2- 172.21.15.2:0/4193227573 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fbc6006b470 0x7fbc6006d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:47.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.731+0000 7fbc72ffd700 1 --2- 172.21.15.2:0/4193227573 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fbc6006b470 0x7fbc6006d930 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbc64009fd0 tx=0x7fbc6401c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:47.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.735+0000 7fbc5b7fe700 1 -- 172.21.15.2:0/4193227573 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbc6c0544c0 con 0x7fbc7415e460 2023-11-26T07:14:47.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.938+0000 7fbc796a4700 1 -- 172.21.15.2:0/4193227573 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc740ce270 con 0x7fbc7415e460 2023-11-26T07:14:47.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.939+0000 7fbc5b7fe700 1 -- 172.21.15.2:0/4193227573 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+16669 (secure 0 0 0) 0x7fbc6c057ae0 con 0x7fbc7415e460 2023-11-26T07:14:47.941 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:14:47.941 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":48,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:14:44.488625+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:13:52.197275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-26T07:13:52.705487+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":48,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2e","mappings":[{"from":0,"to":5}]},{"pgid":"7.3e","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:14:47.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.941+0000 7fbc796a4700 1 -- 172.21.15.2:0/4193227573 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fbc6006b470 msgr2=0x7fbc6006d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:47.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.941+0000 7fbc796a4700 1 --2- 172.21.15.2:0/4193227573 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fbc6006b470 0x7fbc6006d930 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbc64009fd0 tx=0x7fbc6401c040 comp rx=0 tx=0).stop 2023-11-26T07:14:47.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.941+0000 7fbc796a4700 1 -- 172.21.15.2:0/4193227573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc7415e460 msgr2=0x7fbc740b91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:47.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.941+0000 7fbc796a4700 1 --2- 172.21.15.2:0/4193227573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc7415e460 0x7fbc740b91f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c00cb40 tx=0x7fbc6c00ce50 comp rx=0 tx=0).stop 2023-11-26T07:14:47.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.941+0000 7fbc796a4700 1 -- 172.21.15.2:0/4193227573 shutdown_connections 2023-11-26T07:14:47.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.941+0000 7fbc796a4700 1 --2- 172.21.15.2:0/4193227573 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fbc6006b470 0x7fbc6006d930 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:47.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.941+0000 7fbc796a4700 1 --2- 172.21.15.2:0/4193227573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc7415e460 0x7fbc740b91f0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:47.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.941+0000 7fbc796a4700 1 --2- 172.21.15.2:0/4193227573 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc740cf480 0x7fbc7415ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:47.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.941+0000 7fbc796a4700 1 --2- 172.21.15.2:0/4193227573 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc740d29d0 0x7fbc740d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:47.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.941+0000 7fbc796a4700 1 -- 172.21.15.2:0/4193227573 >> 172.21.15.2:0/4193227573 conn(0x7fbc740d3eb0 msgr2=0x7fbc7406c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:47.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.941+0000 7fbc796a4700 1 -- 172.21.15.2:0/4193227573 shutdown_connections 2023-11-26T07:14:47.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:47.941+0000 7fbc796a4700 1 -- 172.21.15.2:0/4193227573 wait complete. 2023-11-26T07:14:47.956 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:11:28.205739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:13:52.197275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:13:52.705487+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 48, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:14:47.956 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:14:48.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.082+0000 7f5b0805b700 1 Processor -- start 2023-11-26T07:14:48.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.082+0000 7f5b0805b700 1 -- start start 2023-11-26T07:14:48.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.083+0000 7f5b0805b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b0015e190 0x7f5b000d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:48.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.083+0000 7f5b0805b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b000d1490 0x7f5b000d24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:48.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.083+0000 7f5b0805b700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b000b7810 con 0x7f5b000cfde0 2023-11-26T07:14:48.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.083+0000 7f5b0805b700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b000d1930 con 0x7f5b000d1490 2023-11-26T07:14:48.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.083+0000 7f5b0805b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b000b6ee0 con 0x7f5b0015e190 2023-11-26T07:14:48.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.083+0000 7f5b055f6700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b000d1490 0x7f5b000d24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:48.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.083+0000 7f5b065f8700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f5b000cfde0 0x7f5b000b4ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33640/0 (socket says 172.21.15.2:33640) 2023-11-26T07:14:48.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.083+0000 7f5b065f8700 1 -- 172.21.15.2:0/2079021568 learned_addr learned my addr 172.21.15.2:0/2079021568 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:14:48.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.083+0000 7f5b05df7700 1 --2- 172.21.15.2:0/2079021568 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b0015e190 0x7f5b000d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:48.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.083+0000 7f5b055f6700 1 -- 172.21.15.2:0/2079021568 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b0015e190 msgr2=0x7f5b000d0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:48.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.083+0000 7f5b055f6700 1 --2- 172.21.15.2:0/2079021568 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b0015e190 0x7f5b000d0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:48.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.083+0000 7f5b055f6700 1 -- 172.21.15.2:0/2079021568 >> v1:172.21.15.2:6789/0 conn(0x7f5b000cfde0 legacy=0x7f5b000b4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:48.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.083+0000 7f5b055f6700 1 -- 172.21.15.2:0/2079021568 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b000b71c0 con 0x7f5b000d1490 2023-11-26T07:14:48.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.083+0000 7f5b055f6700 1 --2- 172.21.15.2:0/2079021568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b000d1490 0x7f5b000d24d0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f5afc009840 tx=0x7f5afc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c11f35d2cf1255 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:48.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.084+0000 7f5b04df5700 1 -- 172.21.15.2:0/2079021568 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc011830 con 0x7f5b000d1490 2023-11-26T07:14:48.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.084+0000 7f5b04df5700 1 -- 172.21.15.2:0/2079021568 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5afc011990 con 0x7f5b000d1490 2023-11-26T07:14:48.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.084+0000 7f5b04df5700 1 -- 172.21.15.2:0/2079021568 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc011d20 con 0x7f5b000d1490 2023-11-26T07:14:48.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.084+0000 7f5b0805b700 1 -- 172.21.15.2:0/2079021568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b000d1490 msgr2=0x7f5b000d24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:48.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.084+0000 7f5b0805b700 1 --2- 172.21.15.2:0/2079021568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b000d1490 0x7f5b000d24d0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f5afc009840 tx=0x7f5afc009b50 comp rx=0 tx=0).stop 2023-11-26T07:14:48.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.084+0000 7f5b0805b700 1 -- 172.21.15.2:0/2079021568 shutdown_connections 2023-11-26T07:14:48.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.084+0000 7f5b0805b700 1 --2- 172.21.15.2:0/2079021568 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b0015e190 0x7f5b000d0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:48.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.084+0000 7f5b0805b700 1 --2- 172.21.15.2:0/2079021568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b000d1490 0x7f5b000d24d0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:48.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.084+0000 7f5b0805b700 1 -- 172.21.15.2:0/2079021568 >> 172.21.15.2:0/2079021568 conn(0x7f5b0009d180 msgr2=0x7f5b000d3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:48.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.084+0000 7f5b0805b700 1 -- 172.21.15.2:0/2079021568 shutdown_connections 2023-11-26T07:14:48.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.084+0000 7f5b0805b700 1 -- 172.21.15.2:0/2079021568 wait complete. 2023-11-26T07:14:48.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.085+0000 7f5b0805b700 1 Processor -- start 2023-11-26T07:14:48.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.086+0000 7f5b0805b700 1 -- start start 2023-11-26T07:14:48.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.086+0000 7f5b0805b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b000cfde0 0x7f5b0015f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:48.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.086+0000 7f5b0805b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b000d1490 0x7f5b00153cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:48.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.086+0000 7f5b0805b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b0015e190 0x7f5b0015fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:48.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.086+0000 7f5b0805b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b00160520 con 0x7f5b0015e190 2023-11-26T07:14:48.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.086+0000 7f5b0805b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0015e6f0 con 0x7f5b000cfde0 2023-11-26T07:14:48.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.086+0000 7f5b0805b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0015e9d0 con 0x7f5b000d1490 2023-11-26T07:14:48.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.086+0000 7f5b065f8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b0015e190 0x7f5b0015fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:48.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.086+0000 7f5b065f8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b0015e190 0x7f5b0015fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42436/0 (socket says 172.21.15.2:42436) 2023-11-26T07:14:48.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.086+0000 7f5b065f8700 1 -- 172.21.15.2:0/3017178769 learned_addr learned my addr 172.21.15.2:0/3017178769 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:48.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.086+0000 7f5b05df7700 1 --2- 172.21.15.2:0/3017178769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b000cfde0 0x7f5b0015f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:48.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.086+0000 7f5b055f6700 1 --2- 172.21.15.2:0/3017178769 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b000d1490 0x7f5b00153cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:48.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.087+0000 7f5b065f8700 1 -- 172.21.15.2:0/3017178769 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b000d1490 msgr2=0x7f5b00153cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:48.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.087+0000 7f5b065f8700 1 --2- 172.21.15.2:0/3017178769 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b000d1490 0x7f5b00153cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:48.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.087+0000 7f5b065f8700 1 -- 172.21.15.2:0/3017178769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b000cfde0 msgr2=0x7f5b0015f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:48.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.087+0000 7f5b065f8700 1 --2- 172.21.15.2:0/3017178769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b000cfde0 0x7f5b0015f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:48.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.087+0000 7f5b065f8700 1 -- 172.21.15.2:0/3017178769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5afc0094a0 con 0x7f5b0015e190 2023-11-26T07:14:48.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.087+0000 7f5b065f8700 1 --2- 172.21.15.2:0/3017178769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b0015e190 0x7f5b0015fb60 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f5af800cbc0 tx=0x7f5af800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:48.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.087+0000 7f5af67fc700 1 -- 172.21.15.2:0/3017178769 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af800a9e0 con 0x7f5b0015e190 2023-11-26T07:14:48.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.087+0000 7f5af67fc700 1 -- 172.21.15.2:0/3017178769 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af800ab40 con 0x7f5b0015e190 2023-11-26T07:14:48.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.087+0000 7f5b0805b700 1 -- 172.21.15.2:0/3017178769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b0015ecb0 con 0x7f5b0015e190 2023-11-26T07:14:48.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.087+0000 7f5af67fc700 1 -- 172.21.15.2:0/3017178769 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af8012400 con 0x7f5b0015e190 2023-11-26T07:14:48.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.087+0000 7f5b0805b700 1 -- 172.21.15.2:0/3017178769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b0015a980 con 0x7f5b0015e190 2023-11-26T07:14:48.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.088+0000 7f5b0805b700 1 -- 172.21.15.2:0/3017178769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b0015abd0 con 0x7f5b0015e190 2023-11-26T07:14:48.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.089+0000 7f5af67fc700 1 -- 172.21.15.2:0/3017178769 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f5af801b3b0 con 0x7f5b0015e190 2023-11-26T07:14:48.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.089+0000 7f5af67fc700 1 --2- 172.21.15.2:0/3017178769 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5ae406b470 0x7f5ae406d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:48.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.089+0000 7f5af67fc700 1 -- 172.21.15.2:0/3017178769 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5823+0+0 (secure 0 0 0) 0x7f5af8089b30 con 0x7f5b0015e190 2023-11-26T07:14:48.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.089+0000 7f5b05df7700 1 --2- 172.21.15.2:0/3017178769 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5ae406b470 0x7f5ae406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:48.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.090+0000 7f5b05df7700 1 --2- 172.21.15.2:0/3017178769 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5ae406b470 0x7f5ae406d930 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5b000ca400 tx=0x7f5af0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:48.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.094+0000 7f5af67fc700 1 -- 172.21.15.2:0/3017178769 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5af8054440 con 0x7f5b0015e190 2023-11-26T07:14:48.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.294+0000 7f5b0805b700 1 -- 172.21.15.2:0/3017178769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5b0015f1d0 con 0x7f5b0015e190 2023-11-26T07:14:48.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.294+0000 7f5af67fc700 1 -- 172.21.15.2:0/3017178769 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v48) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5af8017020 con 0x7f5b0015e190 2023-11-26T07:14:48.296 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-26T07:14:48.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.296+0000 7f5b0805b700 1 -- 172.21.15.2:0/3017178769 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5ae406b470 msgr2=0x7f5ae406d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:48.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.296+0000 7f5b0805b700 1 --2- 172.21.15.2:0/3017178769 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5ae406b470 0x7f5ae406d930 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5b000ca400 tx=0x7f5af0008040 comp rx=0 tx=0).stop 2023-11-26T07:14:48.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.296+0000 7f5b0805b700 1 -- 172.21.15.2:0/3017178769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b0015e190 msgr2=0x7f5b0015fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:48.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.296+0000 7f5b0805b700 1 --2- 172.21.15.2:0/3017178769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b0015e190 0x7f5b0015fb60 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f5af800cbc0 tx=0x7f5af800ced0 comp rx=0 tx=0).stop 2023-11-26T07:14:48.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.296+0000 7f5b0805b700 1 -- 172.21.15.2:0/3017178769 shutdown_connections 2023-11-26T07:14:48.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.296+0000 7f5b0805b700 1 --2- 172.21.15.2:0/3017178769 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5ae406b470 0x7f5ae406d930 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:48.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.296+0000 7f5b0805b700 1 --2- 172.21.15.2:0/3017178769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b0015e190 0x7f5b0015fb60 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:48.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.296+0000 7f5b0805b700 1 --2- 172.21.15.2:0/3017178769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b000cfde0 0x7f5b0015f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:48.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.296+0000 7f5b0805b700 1 --2- 172.21.15.2:0/3017178769 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b000d1490 0x7f5b00153cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:48.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.296+0000 7f5b0805b700 1 -- 172.21.15.2:0/3017178769 >> 172.21.15.2:0/3017178769 conn(0x7f5b0009d180 msgr2=0x7f5b000d3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:48.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.296+0000 7f5b0805b700 1 -- 172.21.15.2:0/3017178769 shutdown_connections 2023-11-26T07:14:48.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.296+0000 7f5b0805b700 1 -- 172.21.15.2:0/3017178769 wait complete. 2023-11-26T07:14:48.310 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:14:48.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.436+0000 7f9a55b0c700 1 Processor -- start 2023-11-26T07:14:48.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.436+0000 7f9a55b0c700 1 -- start start 2023-11-26T07:14:48.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.437+0000 7f9a55b0c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a5006b620 0x7f9a500b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:48.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.437+0000 7f9a55b0c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9a500b5ab0 0x7f9a500b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:48.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.437+0000 7f9a55b0c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9a501478c0 0x7f9a50161ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:48.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.437+0000 7f9a55b0c700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a50071f50 con 0x7f9a500b5ab0 2023-11-26T07:14:48.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.437+0000 7f9a55b0c700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a50072230 con 0x7f9a501478c0 2023-11-26T07:14:48.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.437+0000 7f9a55b0c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a50072510 con 0x7f9a5006b620 2023-11-26T07:14:48.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.437+0000 7f9a4effd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9a500b5ab0 0x7f9a500b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:48.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.437+0000 7f9a4effd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9a500b5ab0 0x7f9a500b3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42440/0 (socket says 172.21.15.2:42440) 2023-11-26T07:14:48.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.437+0000 7f9a4effd700 1 -- 172.21.15.2:0/425100538 learned_addr learned my addr 172.21.15.2:0/425100538 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:48.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.437+0000 7f9a4f7fe700 1 --2- 172.21.15.2:0/425100538 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a5006b620 0x7f9a500b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:48.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.437+0000 7f9a4effd700 1 -- 172.21.15.2:0/425100538 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a5006b620 msgr2=0x7f9a500b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:48.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.437+0000 7f9a4ffff700 1 --2- 172.21.15.2:0/425100538 >> v2:172.21.15.192:3300/0 conn(0x7f9a501478c0 0x7f9a50161ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:48.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.437+0000 7f9a4effd700 1 --2- 172.21.15.2:0/425100538 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a5006b620 0x7f9a500b3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:48.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.437+0000 7f9a4effd700 1 -- 172.21.15.2:0/425100538 >> v2:172.21.15.192:3300/0 conn(0x7f9a501478c0 msgr2=0x7f9a50161ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:48.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.437+0000 7f9a4effd700 1 --2- 172.21.15.2:0/425100538 >> v2:172.21.15.192:3300/0 conn(0x7f9a501478c0 0x7f9a50161ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:48.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.438+0000 7f9a4effd700 1 -- 172.21.15.2:0/425100538 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a500727f0 con 0x7f9a500b5ab0 2023-11-26T07:14:48.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.438+0000 7f9a4f7fe700 1 --2- 172.21.15.2:0/425100538 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a5006b620 0x7f9a500b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:14:48.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.438+0000 7f9a4ffff700 1 --2- 172.21.15.2:0/425100538 >> v2:172.21.15.192:3300/0 conn(0x7f9a501478c0 0x7f9a50161ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:14:48.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.438+0000 7f9a4effd700 1 --2- 172.21.15.2:0/425100538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a500b5ab0 0x7f9a500b3f80 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f9a500747c0 tx=0x7f9a38009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be0832ba2056e987 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:48.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.438+0000 7f9a4e7fc700 1 -- 172.21.15.2:0/425100538 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3800b870 con 0x7f9a500b5ab0 2023-11-26T07:14:48.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.438+0000 7f9a4e7fc700 1 -- 172.21.15.2:0/425100538 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3800b9d0 con 0x7f9a500b5ab0 2023-11-26T07:14:48.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.438+0000 7f9a4e7fc700 1 -- 172.21.15.2:0/425100538 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3800bd60 con 0x7f9a500b5ab0 2023-11-26T07:14:48.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.438+0000 7f9a55b0c700 1 -- 172.21.15.2:0/425100538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a500b5ab0 msgr2=0x7f9a500b3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:48.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.438+0000 7f9a55b0c700 1 --2- 172.21.15.2:0/425100538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a500b5ab0 0x7f9a500b3f80 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f9a500747c0 tx=0x7f9a38009bd0 comp rx=0 tx=0).stop 2023-11-26T07:14:48.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.438+0000 7f9a55b0c700 1 -- 172.21.15.2:0/425100538 shutdown_connections 2023-11-26T07:14:48.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.438+0000 7f9a55b0c700 1 --2- 172.21.15.2:0/425100538 >> v2:172.21.15.192:3300/0 conn(0x7f9a501478c0 0x7f9a50161ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:48.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.438+0000 7f9a55b0c700 1 --2- 172.21.15.2:0/425100538 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a5006b620 0x7f9a500b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:48.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.438+0000 7f9a55b0c700 1 --2- 172.21.15.2:0/425100538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a500b5ab0 0x7f9a500b3f80 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:48.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.438+0000 7f9a55b0c700 1 -- 172.21.15.2:0/425100538 >> 172.21.15.2:0/425100538 conn(0x7f9a500b2740 msgr2=0x7f9a500b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:48.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.438+0000 7f9a55b0c700 1 -- 172.21.15.2:0/425100538 shutdown_connections 2023-11-26T07:14:48.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.438+0000 7f9a55b0c700 1 -- 172.21.15.2:0/425100538 wait complete. 2023-11-26T07:14:48.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.440+0000 7f9a55b0c700 1 Processor -- start 2023-11-26T07:14:48.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.440+0000 7f9a55b0c700 1 -- start start 2023-11-26T07:14:48.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.441+0000 7f9a55b0c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a5006b620 0x7f9a5006e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:48.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.441+0000 7f9a55b0c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a500b5ab0 0x7f9a501f7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:48.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.441+0000 7f9a55b0c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a501478c0 0x7f9a501f7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:48.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.441+0000 7f9a55b0c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a501f80d0 con 0x7f9a501478c0 2023-11-26T07:14:48.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.441+0000 7f9a55b0c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a500c6910 con 0x7f9a5006b620 2023-11-26T07:14:48.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.441+0000 7f9a55b0c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a500c9990 con 0x7f9a500b5ab0 2023-11-26T07:14:48.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.441+0000 7f9a4ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a501478c0 0x7f9a501f7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:48.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.441+0000 7f9a4ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a501478c0 0x7f9a501f7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42450/0 (socket says 172.21.15.2:42450) 2023-11-26T07:14:48.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.441+0000 7f9a4ffff700 1 -- 172.21.15.2:0/3693499287 learned_addr learned my addr 172.21.15.2:0/3693499287 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:48.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.441+0000 7f9a4f7fe700 1 --2- 172.21.15.2:0/3693499287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a5006b620 0x7f9a5006e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:48.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.441+0000 7f9a4effd700 1 --2- 172.21.15.2:0/3693499287 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a500b5ab0 0x7f9a501f7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:48.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.441+0000 7f9a4ffff700 1 -- 172.21.15.2:0/3693499287 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a500b5ab0 msgr2=0x7f9a501f7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:48.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.441+0000 7f9a4ffff700 1 --2- 172.21.15.2:0/3693499287 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a500b5ab0 0x7f9a501f7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:48.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.441+0000 7f9a4ffff700 1 -- 172.21.15.2:0/3693499287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a5006b620 msgr2=0x7f9a5006e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:48.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.441+0000 7f9a4ffff700 1 --2- 172.21.15.2:0/3693499287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a5006b620 0x7f9a5006e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:48.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.441+0000 7f9a4ffff700 1 -- 172.21.15.2:0/3693499287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a38009550 con 0x7f9a501478c0 2023-11-26T07:14:48.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.441+0000 7f9a4ffff700 1 --2- 172.21.15.2:0/3693499287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a501478c0 0x7f9a501f7b90 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f9a4800cd50 tx=0x7f9a4800a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:48.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.441+0000 7f9a47fff700 1 -- 172.21.15.2:0/3693499287 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4800cea0 con 0x7f9a501478c0 2023-11-26T07:14:48.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.441+0000 7f9a47fff700 1 -- 172.21.15.2:0/3693499287 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a4800f480 con 0x7f9a501478c0 2023-11-26T07:14:48.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.441+0000 7f9a55b0c700 1 -- 172.21.15.2:0/3693499287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a500c9c70 con 0x7f9a501478c0 2023-11-26T07:14:48.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.441+0000 7f9a47fff700 1 -- 172.21.15.2:0/3693499287 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4800f830 con 0x7f9a501478c0 2023-11-26T07:14:48.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.441+0000 7f9a55b0c700 1 -- 172.21.15.2:0/3693499287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a500ca230 con 0x7f9a501478c0 2023-11-26T07:14:48.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.442+0000 7f9a55b0c700 1 -- 172.21.15.2:0/3693499287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a500ca5a0 con 0x7f9a501478c0 2023-11-26T07:14:48.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.443+0000 7f9a47fff700 1 -- 172.21.15.2:0/3693499287 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f9a4800b040 con 0x7f9a501478c0 2023-11-26T07:14:48.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.443+0000 7f9a47fff700 1 --2- 172.21.15.2:0/3693499287 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9a3006b470 0x7f9a3006d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:48.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.443+0000 7f9a47fff700 1 -- 172.21.15.2:0/3693499287 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5823+0+0 (secure 0 0 0) 0x7f9a4808a700 con 0x7f9a501478c0 2023-11-26T07:14:48.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.444+0000 7f9a4f7fe700 1 --2- 172.21.15.2:0/3693499287 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9a3006b470 0x7f9a3006d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:48.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.444+0000 7f9a4f7fe700 1 --2- 172.21.15.2:0/3693499287 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9a3006b470 0x7f9a3006d930 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9a40006ba0 tx=0x7f9a40008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:48.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.448+0000 7f9a47fff700 1 -- 172.21.15.2:0/3693499287 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9a48054f50 con 0x7f9a501478c0 2023-11-26T07:14:48.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.653+0000 7f9a55b0c700 1 -- 172.21.15.2:0/3693499287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9a50075480 con 0x7f9a501478c0 2023-11-26T07:14:48.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.653+0000 7f9a47fff700 1 -- 172.21.15.2:0/3693499287 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v48) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9a48058570 con 0x7f9a501478c0 2023-11-26T07:14:48.655 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-26T07:14:48.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.655+0000 7f9a55b0c700 1 -- 172.21.15.2:0/3693499287 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9a3006b470 msgr2=0x7f9a3006d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:48.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.655+0000 7f9a55b0c700 1 --2- 172.21.15.2:0/3693499287 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9a3006b470 0x7f9a3006d930 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9a40006ba0 tx=0x7f9a40008040 comp rx=0 tx=0).stop 2023-11-26T07:14:48.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.655+0000 7f9a55b0c700 1 -- 172.21.15.2:0/3693499287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a501478c0 msgr2=0x7f9a501f7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:48.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.655+0000 7f9a55b0c700 1 --2- 172.21.15.2:0/3693499287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a501478c0 0x7f9a501f7b90 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f9a4800cd50 tx=0x7f9a4800a560 comp rx=0 tx=0).stop 2023-11-26T07:14:48.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.655+0000 7f9a55b0c700 1 -- 172.21.15.2:0/3693499287 shutdown_connections 2023-11-26T07:14:48.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.655+0000 7f9a55b0c700 1 --2- 172.21.15.2:0/3693499287 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9a3006b470 0x7f9a3006d930 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:48.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.655+0000 7f9a55b0c700 1 --2- 172.21.15.2:0/3693499287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a501478c0 0x7f9a501f7b90 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:48.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.655+0000 7f9a55b0c700 1 --2- 172.21.15.2:0/3693499287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a5006b620 0x7f9a5006e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:48.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.655+0000 7f9a55b0c700 1 --2- 172.21.15.2:0/3693499287 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a500b5ab0 0x7f9a501f7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:48.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.655+0000 7f9a55b0c700 1 -- 172.21.15.2:0/3693499287 >> 172.21.15.2:0/3693499287 conn(0x7f9a500b2740 msgr2=0x7f9a500aed20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:48.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.655+0000 7f9a55b0c700 1 -- 172.21.15.2:0/3693499287 shutdown_connections 2023-11-26T07:14:48.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.655+0000 7f9a55b0c700 1 -- 172.21.15.2:0/3693499287 wait complete. 2023-11-26T07:14:48.669 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:14:48.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.795+0000 7fd527de8700 1 Processor -- start 2023-11-26T07:14:48.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.795+0000 7fd527de8700 1 -- start start 2023-11-26T07:14:48.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.796+0000 7fd527de8700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd5200b21d0 0x7fd5200b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:48.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.796+0000 7fd527de8700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd5200d0ff0 0x7fd5200cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:48.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.796+0000 7fd527de8700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd52006caf0 con 0x7fd5200b28a0 2023-11-26T07:14:48.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.796+0000 7fd527de8700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5200cf250 con 0x7fd5200b21d0 2023-11-26T07:14:48.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.796+0000 7fd527de8700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd52006cdb0 con 0x7fd5200d0ff0 2023-11-26T07:14:48.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.796+0000 7fd525b84700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd5200b21d0 0x7fd5200b2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:48.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.796+0000 7fd525b84700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd5200b21d0 0x7fd5200b2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42454/0 (socket says 172.21.15.2:42454) 2023-11-26T07:14:48.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.796+0000 7fd525b84700 1 -- 172.21.15.2:0/391185304 learned_addr learned my addr 172.21.15.2:0/391185304 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:48.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.797+0000 7fd526385700 1 --2- 172.21.15.2:0/391185304 >> v2:172.21.15.192:3300/0 conn(0x7fd5200d0ff0 0x7fd5200cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:48.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.797+0000 7fd525b84700 1 -- 172.21.15.2:0/391185304 >> v2:172.21.15.192:3300/0 conn(0x7fd5200d0ff0 msgr2=0x7fd5200cebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:48.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.797+0000 7fd525b84700 1 --2- 172.21.15.2:0/391185304 >> v2:172.21.15.192:3300/0 conn(0x7fd5200d0ff0 0x7fd5200cebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:48.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.797+0000 7fd525b84700 1 -- 172.21.15.2:0/391185304 >> v1:172.21.15.192:6789/0 conn(0x7fd5200b28a0 legacy=0x7fd5200ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:48.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.797+0000 7fd525b84700 1 -- 172.21.15.2:0/391185304 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd52006d090 con 0x7fd5200b21d0 2023-11-26T07:14:48.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.797+0000 7fd526385700 1 --2- 172.21.15.2:0/391185304 >> v2:172.21.15.192:3300/0 conn(0x7fd5200d0ff0 0x7fd5200cebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:14:48.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.797+0000 7fd525b84700 1 --2- 172.21.15.2:0/391185304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5200b21d0 0x7fd5200b2dd0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fd5200c5730 tx=0x7fd510009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4547f3ea589e8d4d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:48.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.797+0000 7fd524b82700 1 -- 172.21.15.2:0/391185304 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd510004230 con 0x7fd5200b21d0 2023-11-26T07:14:48.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.797+0000 7fd524b82700 1 -- 172.21.15.2:0/391185304 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd510004390 con 0x7fd5200b21d0 2023-11-26T07:14:48.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.797+0000 7fd524b82700 1 -- 172.21.15.2:0/391185304 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5100036a0 con 0x7fd5200b21d0 2023-11-26T07:14:48.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.797+0000 7fd527de8700 1 -- 172.21.15.2:0/391185304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5200b21d0 msgr2=0x7fd5200b2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:48.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.797+0000 7fd527de8700 1 --2- 172.21.15.2:0/391185304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5200b21d0 0x7fd5200b2dd0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fd5200c5730 tx=0x7fd510009bd0 comp rx=0 tx=0).stop 2023-11-26T07:14:48.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.798+0000 7fd527de8700 1 -- 172.21.15.2:0/391185304 shutdown_connections 2023-11-26T07:14:48.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.798+0000 7fd527de8700 1 --2- 172.21.15.2:0/391185304 >> v2:172.21.15.192:3300/0 conn(0x7fd5200d0ff0 0x7fd5200cebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:48.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.798+0000 7fd527de8700 1 --2- 172.21.15.2:0/391185304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5200b21d0 0x7fd5200b2dd0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:48.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.798+0000 7fd527de8700 1 -- 172.21.15.2:0/391185304 >> 172.21.15.2:0/391185304 conn(0x7fd5200b3800 msgr2=0x7fd5200b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:48.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.798+0000 7fd527de8700 1 -- 172.21.15.2:0/391185304 shutdown_connections 2023-11-26T07:14:48.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.798+0000 7fd527de8700 1 -- 172.21.15.2:0/391185304 wait complete. 2023-11-26T07:14:48.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.799+0000 7fd527de8700 1 Processor -- start 2023-11-26T07:14:48.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.799+0000 7fd527de8700 1 -- start start 2023-11-26T07:14:48.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.800+0000 7fd527de8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5200b21d0 0x7fd5200c9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:48.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.800+0000 7fd527de8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5200d0ff0 0x7fd5200b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:48.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.800+0000 7fd527de8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd52015e2a0 0x7fd5200c7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:48.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.800+0000 7fd527de8700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5200c9d40 con 0x7fd5200d0ff0 2023-11-26T07:14:48.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.800+0000 7fd527de8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5200b7520 con 0x7fd52015e2a0 2023-11-26T07:14:48.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.800+0000 7fd527de8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5200b7800 con 0x7fd5200b21d0 2023-11-26T07:14:48.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.800+0000 7fd525383700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5200d0ff0 0x7fd5200b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:48.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.800+0000 7fd525383700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5200d0ff0 0x7fd5200b6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42462/0 (socket says 172.21.15.2:42462) 2023-11-26T07:14:48.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.800+0000 7fd525383700 1 -- 172.21.15.2:0/1860653111 learned_addr learned my addr 172.21.15.2:0/1860653111 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:48.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.800+0000 7fd526385700 1 --2- 172.21.15.2:0/1860653111 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd52015e2a0 0x7fd5200c7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:48.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.800+0000 7fd525b84700 1 --2- 172.21.15.2:0/1860653111 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5200b21d0 0x7fd5200c9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:48.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.800+0000 7fd525383700 1 -- 172.21.15.2:0/1860653111 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5200b21d0 msgr2=0x7fd5200c9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:48.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.800+0000 7fd525383700 1 --2- 172.21.15.2:0/1860653111 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5200b21d0 0x7fd5200c9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:48.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.800+0000 7fd525383700 1 -- 172.21.15.2:0/1860653111 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd52015e2a0 msgr2=0x7fd5200c7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:48.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.800+0000 7fd525383700 1 --2- 172.21.15.2:0/1860653111 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd52015e2a0 0x7fd5200c7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:48.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.800+0000 7fd525383700 1 -- 172.21.15.2:0/1860653111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd510009550 con 0x7fd5200d0ff0 2023-11-26T07:14:48.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.800+0000 7fd526385700 1 --2- 172.21.15.2:0/1860653111 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd52015e2a0 0x7fd5200c7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:14:48.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.800+0000 7fd525383700 1 --2- 172.21.15.2:0/1860653111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5200d0ff0 0x7fd5200b6bf0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fd51c00c4d0 tx=0x7fd51c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:48.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.800+0000 7fd5167fc700 1 -- 172.21.15.2:0/1860653111 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c011790 con 0x7fd5200d0ff0 2023-11-26T07:14:48.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.800+0000 7fd5167fc700 1 -- 172.21.15.2:0/1860653111 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51c0118f0 con 0x7fd5200d0ff0 2023-11-26T07:14:48.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.800+0000 7fd527de8700 1 -- 172.21.15.2:0/1860653111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5200c8d20 con 0x7fd5200d0ff0 2023-11-26T07:14:48.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.800+0000 7fd5167fc700 1 -- 172.21.15.2:0/1860653111 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c011ca0 con 0x7fd5200d0ff0 2023-11-26T07:14:48.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.800+0000 7fd527de8700 1 -- 172.21.15.2:0/1860653111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5200c92e0 con 0x7fd5200d0ff0 2023-11-26T07:14:48.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.801+0000 7fd527de8700 1 -- 172.21.15.2:0/1860653111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5200c94a0 con 0x7fd5200d0ff0 2023-11-26T07:14:48.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.802+0000 7fd5167fc700 1 -- 172.21.15.2:0/1860653111 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7fd51c01c460 con 0x7fd5200d0ff0 2023-11-26T07:14:48.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.802+0000 7fd5167fc700 1 --2- 172.21.15.2:0/1860653111 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd50406b470 0x7fd50406d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:48.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.802+0000 7fd5167fc700 1 -- 172.21.15.2:0/1860653111 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5823+0+0 (secure 0 0 0) 0x7fd51c089fd0 con 0x7fd5200d0ff0 2023-11-26T07:14:48.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.802+0000 7fd525b84700 1 --2- 172.21.15.2:0/1860653111 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd50406b470 0x7fd50406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:48.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.803+0000 7fd525b84700 1 --2- 172.21.15.2:0/1860653111 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd50406b470 0x7fd50406d930 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd510009130 tx=0x7fd510008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:48.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:48.807+0000 7fd5167fc700 1 -- 172.21.15.2:0/1860653111 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd51c054760 con 0x7fd5200d0ff0 2023-11-26T07:14:49.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.007+0000 7fd527de8700 1 -- 172.21.15.2:0/1860653111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd520075480 con 0x7fd5200d0ff0 2023-11-26T07:14:49.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.007+0000 7fd5167fc700 1 -- 172.21.15.2:0/1860653111 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v48) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd51c057d80 con 0x7fd5200d0ff0 2023-11-26T07:14:49.009 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-26T07:14:49.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.009+0000 7fd527de8700 1 -- 172.21.15.2:0/1860653111 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd50406b470 msgr2=0x7fd50406d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:49.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.009+0000 7fd527de8700 1 --2- 172.21.15.2:0/1860653111 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd50406b470 0x7fd50406d930 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd510009130 tx=0x7fd510008030 comp rx=0 tx=0).stop 2023-11-26T07:14:49.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.009+0000 7fd527de8700 1 -- 172.21.15.2:0/1860653111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5200d0ff0 msgr2=0x7fd5200b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:49.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.009+0000 7fd527de8700 1 --2- 172.21.15.2:0/1860653111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5200d0ff0 0x7fd5200b6bf0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fd51c00c4d0 tx=0x7fd51c00c890 comp rx=0 tx=0).stop 2023-11-26T07:14:49.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.009+0000 7fd527de8700 1 -- 172.21.15.2:0/1860653111 shutdown_connections 2023-11-26T07:14:49.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.009+0000 7fd527de8700 1 --2- 172.21.15.2:0/1860653111 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd50406b470 0x7fd50406d930 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:49.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.009+0000 7fd527de8700 1 --2- 172.21.15.2:0/1860653111 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd52015e2a0 0x7fd5200c7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:49.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.009+0000 7fd527de8700 1 --2- 172.21.15.2:0/1860653111 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5200b21d0 0x7fd5200c9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:49.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.009+0000 7fd527de8700 1 --2- 172.21.15.2:0/1860653111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5200d0ff0 0x7fd5200b6bf0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:49.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.009+0000 7fd527de8700 1 -- 172.21.15.2:0/1860653111 >> 172.21.15.2:0/1860653111 conn(0x7fd5200b3800 msgr2=0x7fd52006f240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:49.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.009+0000 7fd527de8700 1 -- 172.21.15.2:0/1860653111 shutdown_connections 2023-11-26T07:14:49.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.009+0000 7fd527de8700 1 -- 172.21.15.2:0/1860653111 wait complete. 2023-11-26T07:14:49.023 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-26T07:14:49.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.147+0000 7f91c330e700 1 Processor -- start 2023-11-26T07:14:49.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.147+0000 7f91c330e700 1 -- start start 2023-11-26T07:14:49.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.148+0000 7f91c330e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91bc0722c0 0x7f91bc0b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:49.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.148+0000 7f91c330e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91bc143ec0 con 0x7f91bc143ae0 2023-11-26T07:14:49.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.148+0000 7f91c330e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91bc0b3ae0 con 0x7f91bc1440f0 2023-11-26T07:14:49.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.148+0000 7f91c330e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc0b40a0 con 0x7f91bc0722c0 2023-11-26T07:14:49.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.148+0000 7f91c10aa700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f91bc143ae0 0x7f91bc071bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33678/0 (socket says 172.21.15.2:33678) 2023-11-26T07:14:49.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.148+0000 7f91c10aa700 1 -- 172.21.15.2:0/3981359788 learned_addr learned my addr 172.21.15.2:0/3981359788 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:14:49.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.148+0000 7f91c08a9700 1 --2- 172.21.15.2:0/3981359788 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91bc0722c0 0x7f91bc0b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:49.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.148+0000 7f91b3fff700 1 -- 172.21.15.2:0/3981359788 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2557172193 0 0) 0x7f91bc143ec0 con 0x7f91bc143ae0 2023-11-26T07:14:49.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.148+0000 7f91b3fff700 1 -- 172.21.15.2:0/3981359788 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91a80035b0 con 0x7f91bc143ae0 2023-11-26T07:14:49.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.148+0000 7f91b3fff700 1 -- 172.21.15.2:0/3981359788 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3643852141 0 0) 0x7f91bc0b3ae0 con 0x7f91bc1440f0 2023-11-26T07:14:49.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.149+0000 7f91b3fff700 1 -- 172.21.15.2:0/3981359788 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91bc143ec0 con 0x7f91bc1440f0 2023-11-26T07:14:49.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.149+0000 7f91b3fff700 1 -- 172.21.15.2:0/3981359788 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3198233859 0 0) 0x7f91a80035b0 con 0x7f91bc143ae0 2023-11-26T07:14:49.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.149+0000 7f91c08a9700 1 -- 172.21.15.2:0/3981359788 >> v1:172.21.15.192:6789/0 conn(0x7f91bc1440f0 legacy=0x7f91bc06e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:49.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.149+0000 7f91c08a9700 1 -- 172.21.15.2:0/3981359788 >> v1:172.21.15.2:6789/0 conn(0x7f91bc143ae0 legacy=0x7f91bc071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:49.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.149+0000 7f91c08a9700 1 -- 172.21.15.2:0/3981359788 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91bc0b3dc0 con 0x7f91bc0722c0 2023-11-26T07:14:49.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.149+0000 7f91c08a9700 1 --2- 172.21.15.2:0/3981359788 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91bc0722c0 0x7f91bc0b51b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f91b8009870 tx=0x7f91b8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac2862826e17ff01 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:49.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.149+0000 7f91b3fff700 1 -- 172.21.15.2:0/3981359788 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ac001670 con 0x7f91bc0722c0 2023-11-26T07:14:49.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.149+0000 7f91b3fff700 1 -- 172.21.15.2:0/3981359788 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b8004030 con 0x7f91bc0722c0 2023-11-26T07:14:49.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.149+0000 7f91b3fff700 1 -- 172.21.15.2:0/3981359788 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b80043c0 con 0x7f91bc0722c0 2023-11-26T07:14:49.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.150+0000 7f91c330e700 1 -- 172.21.15.2:0/3981359788 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91bc0722c0 msgr2=0x7f91bc0b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:49.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.150+0000 7f91c330e700 1 --2- 172.21.15.2:0/3981359788 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91bc0722c0 0x7f91bc0b51b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f91b8009870 tx=0x7f91b8009b80 comp rx=0 tx=0).stop 2023-11-26T07:14:49.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.150+0000 7f91c330e700 1 -- 172.21.15.2:0/3981359788 shutdown_connections 2023-11-26T07:14:49.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.150+0000 7f91c330e700 1 --2- 172.21.15.2:0/3981359788 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91bc0722c0 0x7f91bc0b51b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:49.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.150+0000 7f91c330e700 1 -- 172.21.15.2:0/3981359788 >> 172.21.15.2:0/3981359788 conn(0x7f91bc0b2740 msgr2=0x7f91bc0b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:49.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.150+0000 7f91c330e700 1 -- 172.21.15.2:0/3981359788 shutdown_connections 2023-11-26T07:14:49.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.150+0000 7f91c330e700 1 -- 172.21.15.2:0/3981359788 wait complete. 2023-11-26T07:14:49.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.151+0000 7f91c330e700 1 Processor -- start 2023-11-26T07:14:49.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.151+0000 7f91c330e700 1 -- start start 2023-11-26T07:14:49.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.152+0000 7f91c330e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91bc0722c0 0x7f91bc153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:49.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.152+0000 7f91c330e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91bc143ae0 0x7f91bc13eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:49.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.152+0000 7f91c330e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91bc1440f0 0x7f91bc151270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:49.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.152+0000 7f91c330e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc13f060 con 0x7f91bc1440f0 2023-11-26T07:14:49.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.152+0000 7f91c330e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc15cdb0 con 0x7f91bc143ae0 2023-11-26T07:14:49.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.152+0000 7f91c330e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc151ac0 con 0x7f91bc0722c0 2023-11-26T07:14:49.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.152+0000 7f91c18ab700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91bc1440f0 0x7f91bc151270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:49.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.152+0000 7f91c18ab700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91bc1440f0 0x7f91bc151270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42478/0 (socket says 172.21.15.2:42478) 2023-11-26T07:14:49.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.152+0000 7f91c18ab700 1 -- 172.21.15.2:0/1830638012 learned_addr learned my addr 172.21.15.2:0/1830638012 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:49.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.152+0000 7f91c10aa700 1 --2- 172.21.15.2:0/1830638012 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91bc0722c0 0x7f91bc153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:49.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.152+0000 7f91c08a9700 1 --2- 172.21.15.2:0/1830638012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91bc143ae0 0x7f91bc13eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:49.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.152+0000 7f91c18ab700 1 -- 172.21.15.2:0/1830638012 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91bc0722c0 msgr2=0x7f91bc153580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:49.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.152+0000 7f91c18ab700 1 --2- 172.21.15.2:0/1830638012 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91bc0722c0 0x7f91bc153580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:49.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.152+0000 7f91c18ab700 1 -- 172.21.15.2:0/1830638012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91bc143ae0 msgr2=0x7f91bc13eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:49.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.152+0000 7f91c18ab700 1 --2- 172.21.15.2:0/1830638012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91bc143ae0 0x7f91bc13eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:49.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.152+0000 7f91c18ab700 1 -- 172.21.15.2:0/1830638012 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b80094a0 con 0x7f91bc1440f0 2023-11-26T07:14:49.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.152+0000 7f91c18ab700 1 --2- 172.21.15.2:0/1830638012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91bc1440f0 0x7f91bc151270 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f91b400ee60 tx=0x7f91b400c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:49.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.152+0000 7f91b1ffb700 1 -- 172.21.15.2:0/1830638012 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b4003a00 con 0x7f91bc1440f0 2023-11-26T07:14:49.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.153+0000 7f91b1ffb700 1 -- 172.21.15.2:0/1830638012 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b4003b60 con 0x7f91bc1440f0 2023-11-26T07:14:49.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.153+0000 7f91c330e700 1 -- 172.21.15.2:0/1830638012 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91bc151da0 con 0x7f91bc1440f0 2023-11-26T07:14:49.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.153+0000 7f91b1ffb700 1 -- 172.21.15.2:0/1830638012 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b40050d0 con 0x7f91bc1440f0 2023-11-26T07:14:49.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.153+0000 7f91c330e700 1 -- 172.21.15.2:0/1830638012 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91bc15ca40 con 0x7f91bc1440f0 2023-11-26T07:14:49.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.154+0000 7f91c330e700 1 -- 172.21.15.2:0/1830638012 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91bc0cd8d0 con 0x7f91bc1440f0 2023-11-26T07:14:49.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.154+0000 7f91b1ffb700 1 -- 172.21.15.2:0/1830638012 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f91b4005230 con 0x7f91bc1440f0 2023-11-26T07:14:49.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.155+0000 7f91b1ffb700 1 --2- 172.21.15.2:0/1830638012 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f91a006b470 0x7f91a006d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:49.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.155+0000 7f91b1ffb700 1 -- 172.21.15.2:0/1830638012 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5823+0+0 (secure 0 0 0) 0x7f91b408c8d0 con 0x7f91bc1440f0 2023-11-26T07:14:49.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.155+0000 7f91c10aa700 1 --2- 172.21.15.2:0/1830638012 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f91a006b470 0x7f91a006d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:49.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.156+0000 7f91c10aa700 1 --2- 172.21.15.2:0/1830638012 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f91a006b470 0x7f91a006d930 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f91ac000f60 tx=0x7f91ac000bc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:49.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.159+0000 7f91b1ffb700 1 -- 172.21.15.2:0/1830638012 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f91b4056f50 con 0x7f91bc1440f0 2023-11-26T07:14:49.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.379+0000 7f91c330e700 1 -- 172.21.15.2:0/1830638012 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f91bc067a00 con 0x7f91bc1440f0 2023-11-26T07:14:49.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.379+0000 7f91b1ffb700 1 -- 172.21.15.2:0/1830638012 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v48) v1 ==== 80+0+0 (secure 0 0 0) 0x7f91b401f080 con 0x7f91bc1440f0 2023-11-26T07:14:49.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.381+0000 7f91c330e700 1 -- 172.21.15.2:0/1830638012 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f91a006b470 msgr2=0x7f91a006d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:49.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.381+0000 7f91c330e700 1 --2- 172.21.15.2:0/1830638012 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f91a006b470 0x7f91a006d930 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f91ac000f60 tx=0x7f91ac000bc0 comp rx=0 tx=0).stop 2023-11-26T07:14:49.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.381+0000 7f91c330e700 1 -- 172.21.15.2:0/1830638012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91bc1440f0 msgr2=0x7f91bc151270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:49.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.381+0000 7f91c330e700 1 --2- 172.21.15.2:0/1830638012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91bc1440f0 0x7f91bc151270 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f91b400ee60 tx=0x7f91b400c550 comp rx=0 tx=0).stop 2023-11-26T07:14:49.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.381+0000 7f91c330e700 1 -- 172.21.15.2:0/1830638012 shutdown_connections 2023-11-26T07:14:49.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.381+0000 7f91c330e700 1 --2- 172.21.15.2:0/1830638012 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f91a006b470 0x7f91a006d930 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:49.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.381+0000 7f91c330e700 1 --2- 172.21.15.2:0/1830638012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91bc1440f0 0x7f91bc151270 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:49.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.381+0000 7f91c330e700 1 --2- 172.21.15.2:0/1830638012 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91bc0722c0 0x7f91bc153580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:49.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.382+0000 7f91c330e700 1 --2- 172.21.15.2:0/1830638012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91bc143ae0 0x7f91bc13eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:49.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.382+0000 7f91c330e700 1 -- 172.21.15.2:0/1830638012 >> 172.21.15.2:0/1830638012 conn(0x7f91bc0b2740 msgr2=0x7f91bc1418c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:49.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.382+0000 7f91c330e700 1 -- 172.21.15.2:0/1830638012 shutdown_connections 2023-11-26T07:14:49.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.382+0000 7f91c330e700 1 -- 172.21.15.2:0/1830638012 wait complete. 2023-11-26T07:14:49.385 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2023-11-26T07:14:49.395 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-26T07:14:49.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:49.396 DEBUG:teuthology.orchestra.run.smithi002:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-26T07:14:49.467 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2023-11-26T07:14:49.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:49.468 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-26T07:14:49.489 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:14:49.490 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:49.508 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:14:49.508 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:49.566 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:14:49.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.688+0000 7fb58ec7b700 1 Processor -- start 2023-11-26T07:14:49.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.689+0000 7fb58ec7b700 1 -- start start 2023-11-26T07:14:49.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.689+0000 7fb58ec7b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb58815abb0 0x7fb5880b4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:49.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.689+0000 7fb58ec7b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5880724a0 0x7fb5880cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:49.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.689+0000 7fb58ec7b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb58806e550 con 0x7fb5880b4d50 2023-11-26T07:14:49.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.689+0000 7fb58ec7b700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5880b51d0 con 0x7fb58815abb0 2023-11-26T07:14:49.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.689+0000 7fb58ec7b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb58806f3b0 con 0x7fb5880724a0 2023-11-26T07:14:49.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.690+0000 7fb58ca17700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb58815abb0 0x7fb5880b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:49.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.690+0000 7fb58ca17700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb58815abb0 0x7fb5880b4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42482/0 (socket says 172.21.15.2:42482) 2023-11-26T07:14:49.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.690+0000 7fb58ca17700 1 -- 172.21.15.2:0/559681478 learned_addr learned my addr 172.21.15.2:0/559681478 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:49.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.690+0000 7fb58d218700 1 --2- 172.21.15.2:0/559681478 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5880724a0 0x7fb5880cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:49.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.690+0000 7fb58ca17700 1 -- 172.21.15.2:0/559681478 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5880724a0 msgr2=0x7fb5880cdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:49.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.690+0000 7fb58ca17700 1 --2- 172.21.15.2:0/559681478 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5880724a0 0x7fb5880cdee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:49.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.690+0000 7fb58ca17700 1 -- 172.21.15.2:0/559681478 >> v1:172.21.15.192:6789/0 conn(0x7fb5880b4d50 legacy=0x7fb588071d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:49.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.690+0000 7fb58ca17700 1 -- 172.21.15.2:0/559681478 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb58806e7a0 con 0x7fb58815abb0 2023-11-26T07:14:49.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.690+0000 7fb58d218700 1 --2- 172.21.15.2:0/559681478 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5880724a0 0x7fb5880cdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:14:49.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.690+0000 7fb58ca17700 1 --2- 172.21.15.2:0/559681478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb58815abb0 0x7fb5880b4810 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fb57c0098f0 tx=0x7fb57c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a663e9edb998df04 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:49.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.690+0000 7fb5877fe700 1 -- 172.21.15.2:0/559681478 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c004230 con 0x7fb58815abb0 2023-11-26T07:14:49.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.690+0000 7fb5877fe700 1 -- 172.21.15.2:0/559681478 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb57c004390 con 0x7fb58815abb0 2023-11-26T07:14:49.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.690+0000 7fb5877fe700 1 -- 172.21.15.2:0/559681478 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c0036a0 con 0x7fb58815abb0 2023-11-26T07:14:49.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.691+0000 7fb58ec7b700 1 -- 172.21.15.2:0/559681478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb58815abb0 msgr2=0x7fb5880b4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:49.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.691+0000 7fb58ec7b700 1 --2- 172.21.15.2:0/559681478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb58815abb0 0x7fb5880b4810 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fb57c0098f0 tx=0x7fb57c009c00 comp rx=0 tx=0).stop 2023-11-26T07:14:49.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.691+0000 7fb58ec7b700 1 -- 172.21.15.2:0/559681478 shutdown_connections 2023-11-26T07:14:49.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.691+0000 7fb58ec7b700 1 --2- 172.21.15.2:0/559681478 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5880724a0 0x7fb5880cdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:49.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.691+0000 7fb58ec7b700 1 --2- 172.21.15.2:0/559681478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb58815abb0 0x7fb5880b4810 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:49.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.691+0000 7fb58ec7b700 1 -- 172.21.15.2:0/559681478 >> 172.21.15.2:0/559681478 conn(0x7fb5880d0aa0 msgr2=0x7fb5880d0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:49.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.691+0000 7fb58ec7b700 1 -- 172.21.15.2:0/559681478 shutdown_connections 2023-11-26T07:14:49.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.691+0000 7fb58ec7b700 1 -- 172.21.15.2:0/559681478 wait complete. 2023-11-26T07:14:49.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.692+0000 7fb58ec7b700 1 Processor -- start 2023-11-26T07:14:49.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.692+0000 7fb58ec7b700 1 -- start start 2023-11-26T07:14:49.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.693+0000 7fb58ec7b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5880724a0 0x7fb588143e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:49.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.693+0000 7fb58ec7b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5880b4d50 0x7fb588158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:49.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.693+0000 7fb58ec7b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb58815abb0 0x7fb5881597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:49.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.693+0000 7fb58ec7b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5880b0380 con 0x7fb5880724a0 2023-11-26T07:14:49.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.693+0000 7fb58ec7b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5880a9990 con 0x7fb58815abb0 2023-11-26T07:14:49.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.693+0000 7fb58ec7b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb588159d20 con 0x7fb5880b4d50 2023-11-26T07:14:49.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.693+0000 7fb58ca17700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5880724a0 0x7fb588143e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:49.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.693+0000 7fb58ca17700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5880724a0 0x7fb588143e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42488/0 (socket says 172.21.15.2:42488) 2023-11-26T07:14:49.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.693+0000 7fb58ca17700 1 -- 172.21.15.2:0/3721064735 learned_addr learned my addr 172.21.15.2:0/3721064735 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:49.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.693+0000 7fb58d218700 1 --2- 172.21.15.2:0/3721064735 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb58815abb0 0x7fb5881597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:49.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.693+0000 7fb587fff700 1 --2- 172.21.15.2:0/3721064735 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5880b4d50 0x7fb588158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:49.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.693+0000 7fb58ca17700 1 -- 172.21.15.2:0/3721064735 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5880b4d50 msgr2=0x7fb588158740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:49.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.694+0000 7fb58ca17700 1 --2- 172.21.15.2:0/3721064735 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5880b4d50 0x7fb588158740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:49.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.694+0000 7fb58ca17700 1 -- 172.21.15.2:0/3721064735 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb58815abb0 msgr2=0x7fb5881597e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:49.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.694+0000 7fb58ca17700 1 --2- 172.21.15.2:0/3721064735 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb58815abb0 0x7fb5881597e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:49.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.694+0000 7fb58ca17700 1 -- 172.21.15.2:0/3721064735 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57c009550 con 0x7fb5880724a0 2023-11-26T07:14:49.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.694+0000 7fb587fff700 1 --2- 172.21.15.2:0/3721064735 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5880b4d50 0x7fb588158740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:14:49.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.694+0000 7fb58ca17700 1 --2- 172.21.15.2:0/3721064735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5880724a0 0x7fb588143e80 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fb5880717b0 tx=0x7fb57c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:49.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.694+0000 7fb5857fa700 1 -- 172.21.15.2:0/3721064735 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c003e70 con 0x7fb5880724a0 2023-11-26T07:14:49.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.694+0000 7fb5857fa700 1 -- 172.21.15.2:0/3721064735 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb57c01f070 con 0x7fb5880724a0 2023-11-26T07:14:49.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.694+0000 7fb58ec7b700 1 -- 172.21.15.2:0/3721064735 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5880a95d0 con 0x7fb5880724a0 2023-11-26T07:14:49.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.694+0000 7fb5857fa700 1 -- 172.21.15.2:0/3721064735 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c00b8a0 con 0x7fb5880724a0 2023-11-26T07:14:49.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.694+0000 7fb58ec7b700 1 -- 172.21.15.2:0/3721064735 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb58815a1f0 con 0x7fb5880724a0 2023-11-26T07:14:49.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.695+0000 7fb58ec7b700 1 -- 172.21.15.2:0/3721064735 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb58806f8d0 con 0x7fb5880724a0 2023-11-26T07:14:49.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.695+0000 7fb5857fa700 1 -- 172.21.15.2:0/3721064735 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7fb57c021030 con 0x7fb5880724a0 2023-11-26T07:14:49.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.696+0000 7fb5857fa700 1 --2- 172.21.15.2:0/3721064735 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb56c06b470 0x7fb56c06d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:49.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.696+0000 7fb5857fa700 1 -- 172.21.15.2:0/3721064735 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5823+0+0 (secure 0 0 0) 0x7fb57c08b910 con 0x7fb5880724a0 2023-11-26T07:14:49.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.696+0000 7fb587fff700 1 --2- 172.21.15.2:0/3721064735 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb56c06b470 0x7fb56c06d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:49.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.696+0000 7fb587fff700 1 --2- 172.21.15.2:0/3721064735 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb56c06b470 0x7fb56c06d930 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb58815e830 tx=0x7fb574009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:49.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.700+0000 7fb5857fa700 1 -- 172.21.15.2:0/3721064735 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb57c056290 con 0x7fb5880724a0 2023-11-26T07:14:49.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.903+0000 7fb58ec7b700 1 -- 172.21.15.2:0/3721064735 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb58806f8d0 con 0x7fb5880724a0 2023-11-26T07:14:49.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.905+0000 7fb5857fa700 1 -- 172.21.15.2:0/3721064735 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+16669 (secure 0 0 0) 0x7fb57c0598b0 con 0x7fb5880724a0 2023-11-26T07:14:49.907 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:14:49.907 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":48,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:14:44.488625+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:13:52.197275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-26T07:13:52.705487+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":48,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2e","mappings":[{"from":0,"to":5}]},{"pgid":"7.3e","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:14:49.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.907+0000 7fb58ec7b700 1 -- 172.21.15.2:0/3721064735 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb56c06b470 msgr2=0x7fb56c06d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:49.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.907+0000 7fb58ec7b700 1 --2- 172.21.15.2:0/3721064735 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb56c06b470 0x7fb56c06d930 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb58815e830 tx=0x7fb574009040 comp rx=0 tx=0).stop 2023-11-26T07:14:49.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.907+0000 7fb58ec7b700 1 -- 172.21.15.2:0/3721064735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5880724a0 msgr2=0x7fb588143e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:49.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.907+0000 7fb58ec7b700 1 --2- 172.21.15.2:0/3721064735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5880724a0 0x7fb588143e80 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fb5880717b0 tx=0x7fb57c004750 comp rx=0 tx=0).stop 2023-11-26T07:14:49.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.907+0000 7fb58ec7b700 1 -- 172.21.15.2:0/3721064735 shutdown_connections 2023-11-26T07:14:49.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.907+0000 7fb58ec7b700 1 --2- 172.21.15.2:0/3721064735 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb56c06b470 0x7fb56c06d930 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:49.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.907+0000 7fb58ec7b700 1 --2- 172.21.15.2:0/3721064735 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb58815abb0 0x7fb5881597e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:49.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.907+0000 7fb58ec7b700 1 --2- 172.21.15.2:0/3721064735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5880724a0 0x7fb588143e80 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:49.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.907+0000 7fb58ec7b700 1 --2- 172.21.15.2:0/3721064735 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5880b4d50 0x7fb588158740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:49.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.907+0000 7fb58ec7b700 1 -- 172.21.15.2:0/3721064735 >> 172.21.15.2:0/3721064735 conn(0x7fb5880d0aa0 msgr2=0x7fb5880cdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:49.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.907+0000 7fb58ec7b700 1 -- 172.21.15.2:0/3721064735 shutdown_connections 2023-11-26T07:14:49.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:49.907+0000 7fb58ec7b700 1 -- 172.21.15.2:0/3721064735 wait complete. 2023-11-26T07:14:49.921 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:11:28.205739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:13:52.197275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:13:52.705487+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 48, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:14:49.921 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:14:50.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.048+0000 7efc6c9ce700 1 Processor -- start 2023-11-26T07:14:50.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.048+0000 7efc6c9ce700 1 -- start start 2023-11-26T07:14:50.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.049+0000 7efc6c9ce700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efc68143840 0x7efc68072810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:50.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.049+0000 7efc6c9ce700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7efc680721e0 0x7efc6806e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:50.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.049+0000 7efc6c9ce700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc6806d8f0 con 0x7efc68143c20 2023-11-26T07:14:50.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.049+0000 7efc6c9ce700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc6806db90 con 0x7efc68143840 2023-11-26T07:14:50.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.049+0000 7efc6c9ce700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc6806de70 con 0x7efc680721e0 2023-11-26T07:14:50.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.049+0000 7efc6659c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efc68143840 0x7efc68072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:50.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.049+0000 7efc6659c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efc68143840 0x7efc68072810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42496/0 (socket says 172.21.15.2:42496) 2023-11-26T07:14:50.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.049+0000 7efc6659c700 1 -- 172.21.15.2:0/3720095289 learned_addr learned my addr 172.21.15.2:0/3720095289 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:50.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.049+0000 7efc66d9d700 1 --2- 172.21.15.2:0/3720095289 >> v2:172.21.15.192:3300/0 conn(0x7efc680721e0 0x7efc6806e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:50.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.049+0000 7efc6659c700 1 -- 172.21.15.2:0/3720095289 >> v2:172.21.15.192:3300/0 conn(0x7efc680721e0 msgr2=0x7efc6806e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:50.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.049+0000 7efc6659c700 1 --2- 172.21.15.2:0/3720095289 >> v2:172.21.15.192:3300/0 conn(0x7efc680721e0 0x7efc6806e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:50.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.049+0000 7efc6659c700 1 -- 172.21.15.2:0/3720095289 >> v1:172.21.15.192:6789/0 conn(0x7efc68143c20 legacy=0x7efc68071ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:50.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.049+0000 7efc6659c700 1 -- 172.21.15.2:0/3720095289 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6806e150 con 0x7efc68143840 2023-11-26T07:14:50.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.049+0000 7efc6659c700 1 --2- 172.21.15.2:0/3720095289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc68143840 0x7efc68072810 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7efc680cd750 tx=0x7efc58009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a3e285d649fe019 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:50.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.049+0000 7efc6559a700 1 -- 172.21.15.2:0/3720095289 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc58004230 con 0x7efc68143840 2023-11-26T07:14:50.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.049+0000 7efc6559a700 1 -- 172.21.15.2:0/3720095289 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc58004390 con 0x7efc68143840 2023-11-26T07:14:50.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.049+0000 7efc6559a700 1 -- 172.21.15.2:0/3720095289 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc580036a0 con 0x7efc68143840 2023-11-26T07:14:50.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.050+0000 7efc6c9ce700 1 -- 172.21.15.2:0/3720095289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc68143840 msgr2=0x7efc68072810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:50.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.050+0000 7efc6c9ce700 1 --2- 172.21.15.2:0/3720095289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc68143840 0x7efc68072810 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7efc680cd750 tx=0x7efc58009bd0 comp rx=0 tx=0).stop 2023-11-26T07:14:50.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.050+0000 7efc6c9ce700 1 -- 172.21.15.2:0/3720095289 shutdown_connections 2023-11-26T07:14:50.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.050+0000 7efc6c9ce700 1 --2- 172.21.15.2:0/3720095289 >> v2:172.21.15.192:3300/0 conn(0x7efc680721e0 0x7efc6806e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:50.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.050+0000 7efc6c9ce700 1 --2- 172.21.15.2:0/3720095289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc68143840 0x7efc68072810 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:50.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.050+0000 7efc6c9ce700 1 -- 172.21.15.2:0/3720095289 >> 172.21.15.2:0/3720095289 conn(0x7efc680b2740 msgr2=0x7efc680b2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:50.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.050+0000 7efc6c9ce700 1 -- 172.21.15.2:0/3720095289 shutdown_connections 2023-11-26T07:14:50.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.050+0000 7efc6c9ce700 1 -- 172.21.15.2:0/3720095289 wait complete. 2023-11-26T07:14:50.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.051+0000 7efc6c9ce700 1 Processor -- start 2023-11-26T07:14:50.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.051+0000 7efc6c9ce700 1 -- start start 2023-11-26T07:14:50.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.052+0000 7efc6c9ce700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc680721e0 0x7efc6813f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:50.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.052+0000 7efc6c9ce700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc68143840 0x7efc680d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:50.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.052+0000 7efc6c9ce700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc68143c20 0x7efc680d12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:50.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.052+0000 7efc6c9ce700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc68156500 con 0x7efc68143840 2023-11-26T07:14:50.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.052+0000 7efc6c9ce700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc68153df0 con 0x7efc680721e0 2023-11-26T07:14:50.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.052+0000 7efc6c9ce700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc68153b10 con 0x7efc68143c20 2023-11-26T07:14:50.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.052+0000 7efc65d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc68143840 0x7efc680d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:50.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.052+0000 7efc65d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc68143840 0x7efc680d0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42504/0 (socket says 172.21.15.2:42504) 2023-11-26T07:14:50.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.052+0000 7efc65d9b700 1 -- 172.21.15.2:0/2998376101 learned_addr learned my addr 172.21.15.2:0/2998376101 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:50.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.053+0000 7efc6659c700 1 --2- 172.21.15.2:0/2998376101 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc680721e0 0x7efc6813f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:50.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.053+0000 7efc65d9b700 1 -- 172.21.15.2:0/2998376101 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc68143c20 msgr2=0x7efc680d12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:50.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.053+0000 7efc65d9b700 1 --2- 172.21.15.2:0/2998376101 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc68143c20 0x7efc680d12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:50.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.053+0000 7efc65d9b700 1 -- 172.21.15.2:0/2998376101 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc680721e0 msgr2=0x7efc6813f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:50.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.053+0000 7efc65d9b700 1 --2- 172.21.15.2:0/2998376101 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc680721e0 0x7efc6813f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:50.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.053+0000 7efc65d9b700 1 -- 172.21.15.2:0/2998376101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc58009550 con 0x7efc68143840 2023-11-26T07:14:50.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.053+0000 7efc65d9b700 1 --2- 172.21.15.2:0/2998376101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc68143840 0x7efc680d0d70 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7efc5c00b4a0 tx=0x7efc5c00b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:50.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.053+0000 7efc56ffd700 1 -- 172.21.15.2:0/2998376101 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5c011830 con 0x7efc68143840 2023-11-26T07:14:50.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.053+0000 7efc56ffd700 1 -- 172.21.15.2:0/2998376101 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5c011990 con 0x7efc68143840 2023-11-26T07:14:50.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.053+0000 7efc56ffd700 1 -- 172.21.15.2:0/2998376101 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5c011d40 con 0x7efc68143840 2023-11-26T07:14:50.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.053+0000 7efc6c9ce700 1 -- 172.21.15.2:0/2998376101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc681f6ed0 con 0x7efc68143840 2023-11-26T07:14:50.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.053+0000 7efc6c9ce700 1 -- 172.21.15.2:0/2998376101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc681f7490 con 0x7efc68143840 2023-11-26T07:14:50.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.054+0000 7efc6c9ce700 1 -- 172.21.15.2:0/2998376101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc68075480 con 0x7efc68143840 2023-11-26T07:14:50.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.054+0000 7efc56ffd700 1 -- 172.21.15.2:0/2998376101 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7efc5c01a400 con 0x7efc68143840 2023-11-26T07:14:50.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.055+0000 7efc56ffd700 1 --2- 172.21.15.2:0/2998376101 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7efc4806b470 0x7efc4806d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:50.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.055+0000 7efc56ffd700 1 -- 172.21.15.2:0/2998376101 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5823+0+0 (secure 0 0 0) 0x7efc5c089e10 con 0x7efc68143840 2023-11-26T07:14:50.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.055+0000 7efc6659c700 1 --2- 172.21.15.2:0/2998376101 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7efc4806b470 0x7efc4806d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:50.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.055+0000 7efc6659c700 1 --2- 172.21.15.2:0/2998376101 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7efc4806b470 0x7efc4806d930 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7efc58000c00 tx=0x7efc58008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:50.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.059+0000 7efc56ffd700 1 -- 172.21.15.2:0/2998376101 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efc5c0545e0 con 0x7efc68143840 2023-11-26T07:14:50.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.263+0000 7efc6c9ce700 1 -- 172.21.15.2:0/2998376101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efc6806f850 con 0x7efc68143840 2023-11-26T07:14:50.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.263+0000 7efc56ffd700 1 -- 172.21.15.2:0/2998376101 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v48) v1 ==== 93+0+10 (secure 0 0 0) 0x7efc5c0150a0 con 0x7efc68143840 2023-11-26T07:14:50.265 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-26T07:14:50.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.266+0000 7efc6c9ce700 1 -- 172.21.15.2:0/2998376101 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7efc4806b470 msgr2=0x7efc4806d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:50.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.266+0000 7efc6c9ce700 1 --2- 172.21.15.2:0/2998376101 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7efc4806b470 0x7efc4806d930 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7efc58000c00 tx=0x7efc58008030 comp rx=0 tx=0).stop 2023-11-26T07:14:50.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.266+0000 7efc6c9ce700 1 -- 172.21.15.2:0/2998376101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc68143840 msgr2=0x7efc680d0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:50.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.266+0000 7efc6c9ce700 1 --2- 172.21.15.2:0/2998376101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc68143840 0x7efc680d0d70 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7efc5c00b4a0 tx=0x7efc5c00b860 comp rx=0 tx=0).stop 2023-11-26T07:14:50.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.266+0000 7efc6c9ce700 1 -- 172.21.15.2:0/2998376101 shutdown_connections 2023-11-26T07:14:50.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.266+0000 7efc6c9ce700 1 --2- 172.21.15.2:0/2998376101 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7efc4806b470 0x7efc4806d930 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:50.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.266+0000 7efc6c9ce700 1 --2- 172.21.15.2:0/2998376101 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc68143c20 0x7efc680d12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:50.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.266+0000 7efc6c9ce700 1 --2- 172.21.15.2:0/2998376101 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc680721e0 0x7efc6813f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:50.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.266+0000 7efc6c9ce700 1 --2- 172.21.15.2:0/2998376101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc68143840 0x7efc680d0d70 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:50.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.266+0000 7efc6c9ce700 1 -- 172.21.15.2:0/2998376101 >> 172.21.15.2:0/2998376101 conn(0x7efc680b2740 msgr2=0x7efc680cd000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:50.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.266+0000 7efc6c9ce700 1 -- 172.21.15.2:0/2998376101 shutdown_connections 2023-11-26T07:14:50.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.266+0000 7efc6c9ce700 1 -- 172.21.15.2:0/2998376101 wait complete. 2023-11-26T07:14:50.280 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:14:50.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.408+0000 7f23ddb3a700 1 Processor -- start 2023-11-26T07:14:50.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.408+0000 7f23ddb3a700 1 -- start start 2023-11-26T07:14:50.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.408+0000 7f23ddb3a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f23d80b4150 0x7f23d806de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:50.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.408+0000 7f23ddb3a700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23d8071f50 con 0x7f23d80b5ab0 2023-11-26T07:14:50.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.408+0000 7f23ddb3a700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23d8072230 con 0x7f23d806b620 2023-11-26T07:14:50.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.408+0000 7f23ddb3a700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23d8072510 con 0x7f23d80b4150 2023-11-26T07:14:50.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.409+0000 7f23d6ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f23d80b4150 0x7f23d806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:50.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.409+0000 7f23d6ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f23d80b4150 0x7f23d806de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42512/0 (socket says 172.21.15.2:42512) 2023-11-26T07:14:50.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.409+0000 7f23d7fff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f23d80b5ab0 0x7f23d806e390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33724/0 (socket says 172.21.15.2:33724) 2023-11-26T07:14:50.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.409+0000 7f23d6ffd700 1 -- 172.21.15.2:0/2616825487 learned_addr learned my addr 172.21.15.2:0/2616825487 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:50.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.409+0000 7f23d6ffd700 1 -- 172.21.15.2:0/2616825487 >> v1:172.21.15.192:6789/0 conn(0x7f23d806b620 legacy=0x7f23d80b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:50.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.409+0000 7f23d6ffd700 1 -- 172.21.15.2:0/2616825487 >> v1:172.21.15.2:6789/0 conn(0x7f23d80b5ab0 legacy=0x7f23d806e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:50.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.409+0000 7f23d6ffd700 1 -- 172.21.15.2:0/2616825487 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d80727f0 con 0x7f23d80b4150 2023-11-26T07:14:50.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.409+0000 7f23d67fc700 1 -- 172.21.15.2:0/2616825487 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2444357623 0 0) 0x7f23d8071f50 con 0x7f23d80b5ab0 2023-11-26T07:14:50.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.409+0000 7f23d6ffd700 1 --2- 172.21.15.2:0/2616825487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23d80b4150 0x7f23d806de50 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f23cc0098f0 tx=0x7f23cc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed76ac95dea26b13 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:50.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.409+0000 7f23d67fc700 1 -- 172.21.15.2:0/2616825487 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc00b8a0 con 0x7f23d80b4150 2023-11-26T07:14:50.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.409+0000 7f23d67fc700 1 -- 172.21.15.2:0/2616825487 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23cc00ba00 con 0x7f23d80b4150 2023-11-26T07:14:50.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.409+0000 7f23d67fc700 1 -- 172.21.15.2:0/2616825487 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc00bd90 con 0x7f23d80b4150 2023-11-26T07:14:50.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.410+0000 7f23ddb3a700 1 -- 172.21.15.2:0/2616825487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23d80b4150 msgr2=0x7f23d806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:50.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.410+0000 7f23ddb3a700 1 --2- 172.21.15.2:0/2616825487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23d80b4150 0x7f23d806de50 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f23cc0098f0 tx=0x7f23cc009c00 comp rx=0 tx=0).stop 2023-11-26T07:14:50.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.410+0000 7f23ddb3a700 1 -- 172.21.15.2:0/2616825487 shutdown_connections 2023-11-26T07:14:50.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.410+0000 7f23ddb3a700 1 --2- 172.21.15.2:0/2616825487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23d80b4150 0x7f23d806de50 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:50.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.410+0000 7f23ddb3a700 1 -- 172.21.15.2:0/2616825487 >> 172.21.15.2:0/2616825487 conn(0x7f23d80b2740 msgr2=0x7f23d80b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:50.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.410+0000 7f23ddb3a700 1 -- 172.21.15.2:0/2616825487 shutdown_connections 2023-11-26T07:14:50.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.410+0000 7f23ddb3a700 1 -- 172.21.15.2:0/2616825487 wait complete. 2023-11-26T07:14:50.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.411+0000 7f23ddb3a700 1 Processor -- start 2023-11-26T07:14:50.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.411+0000 7f23ddb3a700 1 -- start start 2023-11-26T07:14:50.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.412+0000 7f23ddb3a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23d806b620 0x7f23d8143850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:50.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.412+0000 7f23ddb3a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23d80b4150 0x7f23d80c7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:50.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.412+0000 7f23ddb3a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23d80b5ab0 0x7f23d81e48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:50.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.412+0000 7f23ddb3a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d80c81a0 con 0x7f23d806b620 2023-11-26T07:14:50.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.412+0000 7f23ddb3a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d8144ad0 con 0x7f23d80b4150 2023-11-26T07:14:50.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.412+0000 7f23ddb3a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d8143f50 con 0x7f23d80b5ab0 2023-11-26T07:14:50.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.412+0000 7f23d77fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23d806b620 0x7f23d8143850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:50.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.412+0000 7f23d77fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23d806b620 0x7f23d8143850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42516/0 (socket says 172.21.15.2:42516) 2023-11-26T07:14:50.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.412+0000 7f23d77fe700 1 -- 172.21.15.2:0/4221939476 learned_addr learned my addr 172.21.15.2:0/4221939476 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:50.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.412+0000 7f23d6ffd700 1 --2- 172.21.15.2:0/4221939476 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23d80b4150 0x7f23d80c7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:50.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.412+0000 7f23d7fff700 1 --2- 172.21.15.2:0/4221939476 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23d80b5ab0 0x7f23d81e48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:50.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.412+0000 7f23d77fe700 1 -- 172.21.15.2:0/4221939476 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23d80b5ab0 msgr2=0x7f23d81e48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:50.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.412+0000 7f23d77fe700 1 --2- 172.21.15.2:0/4221939476 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23d80b5ab0 0x7f23d81e48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:50.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.412+0000 7f23d77fe700 1 -- 172.21.15.2:0/4221939476 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23d80b4150 msgr2=0x7f23d80c7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:50.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.412+0000 7f23d77fe700 1 --2- 172.21.15.2:0/4221939476 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23d80b4150 0x7f23d80c7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:50.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.412+0000 7f23d77fe700 1 -- 172.21.15.2:0/4221939476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23cc009550 con 0x7f23d806b620 2023-11-26T07:14:50.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.413+0000 7f23d77fe700 1 --2- 172.21.15.2:0/4221939476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23d806b620 0x7f23d8143850 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f23c800c4e0 tx=0x7f23c800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:50.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.413+0000 7f23bffff700 1 -- 172.21.15.2:0/4221939476 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c80052d0 con 0x7f23d806b620 2023-11-26T07:14:50.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.413+0000 7f23bffff700 1 -- 172.21.15.2:0/4221939476 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c8005430 con 0x7f23d806b620 2023-11-26T07:14:50.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.413+0000 7f23ddb3a700 1 -- 172.21.15.2:0/4221939476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23d8144230 con 0x7f23d806b620 2023-11-26T07:14:50.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.413+0000 7f23bffff700 1 -- 172.21.15.2:0/4221939476 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c80038c0 con 0x7f23d806b620 2023-11-26T07:14:50.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.413+0000 7f23ddb3a700 1 -- 172.21.15.2:0/4221939476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23d81447f0 con 0x7f23d806b620 2023-11-26T07:14:50.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.414+0000 7f23ddb3a700 1 -- 172.21.15.2:0/4221939476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23d8075480 con 0x7f23d806b620 2023-11-26T07:14:50.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.414+0000 7f23bffff700 1 -- 172.21.15.2:0/4221939476 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f23c8003a20 con 0x7f23d806b620 2023-11-26T07:14:50.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.415+0000 7f23bffff700 1 --2- 172.21.15.2:0/4221939476 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f23c406b470 0x7f23c406d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:50.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.415+0000 7f23bffff700 1 -- 172.21.15.2:0/4221939476 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5823+0+0 (secure 0 0 0) 0x7f23c8089500 con 0x7f23d806b620 2023-11-26T07:14:50.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.415+0000 7f23d6ffd700 1 --2- 172.21.15.2:0/4221939476 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f23c406b470 0x7f23c406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:50.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.416+0000 7f23d6ffd700 1 --2- 172.21.15.2:0/4221939476 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f23c406b470 0x7f23c406d930 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f23d8144d60 tx=0x7f23cc008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:50.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.419+0000 7f23bffff700 1 -- 172.21.15.2:0/4221939476 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f23c8053d60 con 0x7f23d806b620 2023-11-26T07:14:50.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.622+0000 7f23ddb3a700 1 -- 172.21.15.2:0/4221939476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f23d806bd40 con 0x7f23d806b620 2023-11-26T07:14:50.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.623+0000 7f23bffff700 1 -- 172.21.15.2:0/4221939476 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v48) v1 ==== 104+0+11 (secure 0 0 0) 0x7f23c8057380 con 0x7f23d806b620 2023-11-26T07:14:50.625 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-26T07:14:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.625+0000 7f23ddb3a700 1 -- 172.21.15.2:0/4221939476 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f23c406b470 msgr2=0x7f23c406d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.625+0000 7f23ddb3a700 1 --2- 172.21.15.2:0/4221939476 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f23c406b470 0x7f23c406d930 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f23d8144d60 tx=0x7f23cc008030 comp rx=0 tx=0).stop 2023-11-26T07:14:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.625+0000 7f23ddb3a700 1 -- 172.21.15.2:0/4221939476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23d806b620 msgr2=0x7f23d8143850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.625+0000 7f23ddb3a700 1 --2- 172.21.15.2:0/4221939476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23d806b620 0x7f23d8143850 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f23c800c4e0 tx=0x7f23c800c8a0 comp rx=0 tx=0).stop 2023-11-26T07:14:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.625+0000 7f23ddb3a700 1 -- 172.21.15.2:0/4221939476 shutdown_connections 2023-11-26T07:14:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.625+0000 7f23ddb3a700 1 --2- 172.21.15.2:0/4221939476 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f23c406b470 0x7f23c406d930 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.625+0000 7f23ddb3a700 1 --2- 172.21.15.2:0/4221939476 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23d80b5ab0 0x7f23d81e48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.625+0000 7f23ddb3a700 1 --2- 172.21.15.2:0/4221939476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23d806b620 0x7f23d8143850 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.625+0000 7f23ddb3a700 1 --2- 172.21.15.2:0/4221939476 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23d80b4150 0x7f23d80c7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.625+0000 7f23ddb3a700 1 -- 172.21.15.2:0/4221939476 >> 172.21.15.2:0/4221939476 conn(0x7f23d80b2740 msgr2=0x7f23d80b2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.625+0000 7f23ddb3a700 1 -- 172.21.15.2:0/4221939476 shutdown_connections 2023-11-26T07:14:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.625+0000 7f23ddb3a700 1 -- 172.21.15.2:0/4221939476 wait complete. 2023-11-26T07:14:50.639 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:14:50.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.764+0000 7f0f1a30b700 1 Processor -- start 2023-11-26T07:14:50.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.764+0000 7f0f1a30b700 1 -- start start 2023-11-26T07:14:50.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.765+0000 7f0f1a30b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0f141440f0 0x7f0f140b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:50.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.765+0000 7f0f1a30b700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f14143ec0 con 0x7f0f14143ae0 2023-11-26T07:14:50.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.765+0000 7f0f1a30b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f140b3ae0 con 0x7f0f140722c0 2023-11-26T07:14:50.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.765+0000 7f0f1a30b700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f140b40a0 con 0x7f0f141440f0 2023-11-26T07:14:50.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.765+0000 7f0f13fff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f0f14143ae0 0x7f0f14071bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33734/0 (socket says 172.21.15.2:33734) 2023-11-26T07:14:50.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.765+0000 7f0f13fff700 1 -- 172.21.15.2:0/3000730633 learned_addr learned my addr 172.21.15.2:0/3000730633 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:14:50.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.765+0000 7f0f188a8700 1 --2- 172.21.15.2:0/3000730633 >> v2:172.21.15.192:3300/0 conn(0x7f0f141440f0 0x7f0f140b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:50.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.766+0000 7f0f12ffd700 1 -- 172.21.15.2:0/3000730633 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1852589063 0 0) 0x7f0f14143ec0 con 0x7f0f14143ae0 2023-11-26T07:14:50.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.766+0000 7f0f12ffd700 1 -- 172.21.15.2:0/3000730633 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f000035b0 con 0x7f0f14143ae0 2023-11-26T07:14:50.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.766+0000 7f0f188a8700 1 -- 172.21.15.2:0/3000730633 >> v1:172.21.15.192:6789/0 conn(0x7f0f140722c0 legacy=0x7f0f1406e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:50.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.766+0000 7f0f188a8700 1 -- 172.21.15.2:0/3000730633 >> v1:172.21.15.2:6789/0 conn(0x7f0f14143ae0 legacy=0x7f0f14071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:50.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.766+0000 7f0f188a8700 1 -- 172.21.15.2:0/3000730633 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f140b3dc0 con 0x7f0f141440f0 2023-11-26T07:14:50.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.766+0000 7f0f188a8700 1 --2- 172.21.15.2:0/3000730633 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f141440f0 0x7f0f140b51b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c009d90 tx=0x7f0f0c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84d99a8ac0fddf59 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:50.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.766+0000 7f0f12ffd700 1 -- 172.21.15.2:0/3000730633 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c00e070 con 0x7f0f141440f0 2023-11-26T07:14:50.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.766+0000 7f0f12ffd700 1 -- 172.21.15.2:0/3000730633 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f0c00bb20 con 0x7f0f141440f0 2023-11-26T07:14:50.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.766+0000 7f0f12ffd700 1 -- 172.21.15.2:0/3000730633 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c012430 con 0x7f0f141440f0 2023-11-26T07:14:50.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.767+0000 7f0f1a30b700 1 -- 172.21.15.2:0/3000730633 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f141440f0 msgr2=0x7f0f140b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:50.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.767+0000 7f0f1a30b700 1 --2- 172.21.15.2:0/3000730633 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f141440f0 0x7f0f140b51b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c009d90 tx=0x7f0f0c00b330 comp rx=0 tx=0).stop 2023-11-26T07:14:50.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.767+0000 7f0f1a30b700 1 -- 172.21.15.2:0/3000730633 shutdown_connections 2023-11-26T07:14:50.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.767+0000 7f0f1a30b700 1 --2- 172.21.15.2:0/3000730633 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f141440f0 0x7f0f140b51b0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:50.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.767+0000 7f0f1a30b700 1 -- 172.21.15.2:0/3000730633 >> 172.21.15.2:0/3000730633 conn(0x7f0f140b2740 msgr2=0x7f0f140b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:50.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.767+0000 7f0f1a30b700 1 -- 172.21.15.2:0/3000730633 shutdown_connections 2023-11-26T07:14:50.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.767+0000 7f0f1a30b700 1 -- 172.21.15.2:0/3000730633 wait complete. 2023-11-26T07:14:50.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.768+0000 7f0f1a30b700 1 Processor -- start 2023-11-26T07:14:50.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.768+0000 7f0f1a30b700 1 -- start start 2023-11-26T07:14:50.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.769+0000 7f0f1a30b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f140722c0 0x7f0f141545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:50.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.769+0000 7f0f1a30b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f14143ae0 0x7f0f14155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:50.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.769+0000 7f0f1a30b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f141440f0 0x7f0f14159c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:50.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.769+0000 7f0f1a30b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f14154b20 con 0x7f0f140722c0 2023-11-26T07:14:50.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.769+0000 7f0f1a30b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f141563a0 con 0x7f0f141440f0 2023-11-26T07:14:50.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.769+0000 7f0f1a30b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f14154dc0 con 0x7f0f14143ae0 2023-11-26T07:14:50.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.769+0000 7f0f13fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f140722c0 0x7f0f141545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:50.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.769+0000 7f0f13fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f140722c0 0x7f0f141545e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42530/0 (socket says 172.21.15.2:42530) 2023-11-26T07:14:50.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.769+0000 7f0f13fff700 1 -- 172.21.15.2:0/552462419 learned_addr learned my addr 172.21.15.2:0/552462419 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:50.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.769+0000 7f0f188a8700 1 --2- 172.21.15.2:0/552462419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f141440f0 0x7f0f14159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:50.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.769+0000 7f0f137fe700 1 --2- 172.21.15.2:0/552462419 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f14143ae0 0x7f0f14155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:50.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.769+0000 7f0f13fff700 1 -- 172.21.15.2:0/552462419 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f14143ae0 msgr2=0x7f0f14155e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:50.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.769+0000 7f0f13fff700 1 --2- 172.21.15.2:0/552462419 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f14143ae0 0x7f0f14155e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:50.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.769+0000 7f0f13fff700 1 -- 172.21.15.2:0/552462419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f141440f0 msgr2=0x7f0f14159c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:50.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.769+0000 7f0f13fff700 1 --2- 172.21.15.2:0/552462419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f141440f0 0x7f0f14159c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:50.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.769+0000 7f0f13fff700 1 -- 172.21.15.2:0/552462419 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f0c009a70 con 0x7f0f140722c0 2023-11-26T07:14:50.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.769+0000 7f0f137fe700 1 --2- 172.21.15.2:0/552462419 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f14143ae0 0x7f0f14155e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:14:50.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.770+0000 7f0f13fff700 1 --2- 172.21.15.2:0/552462419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f140722c0 0x7f0f141545e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f0f0400c700 tx=0x7f0f0400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:50.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.770+0000 7f0f10ff9700 1 -- 172.21.15.2:0/552462419 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f04005d70 con 0x7f0f140722c0 2023-11-26T07:14:50.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.770+0000 7f0f10ff9700 1 -- 172.21.15.2:0/552462419 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f040070d0 con 0x7f0f140722c0 2023-11-26T07:14:50.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.770+0000 7f0f1a30b700 1 -- 172.21.15.2:0/552462419 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f141550a0 con 0x7f0f140722c0 2023-11-26T07:14:50.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.770+0000 7f0f10ff9700 1 -- 172.21.15.2:0/552462419 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f04007460 con 0x7f0f140722c0 2023-11-26T07:14:50.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.770+0000 7f0f1a30b700 1 -- 172.21.15.2:0/552462419 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f14155660 con 0x7f0f140722c0 2023-11-26T07:14:50.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.771+0000 7f0f1a30b700 1 -- 172.21.15.2:0/552462419 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f140cd8d0 con 0x7f0f140722c0 2023-11-26T07:14:50.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.771+0000 7f0f10ff9700 1 -- 172.21.15.2:0/552462419 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f0f040075c0 con 0x7f0f140722c0 2023-11-26T07:14:50.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.772+0000 7f0f10ff9700 1 --2- 172.21.15.2:0/552462419 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0ef406b470 0x7f0ef406d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:50.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.772+0000 7f0f10ff9700 1 -- 172.21.15.2:0/552462419 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5823+0+0 (secure 0 0 0) 0x7f0f04089520 con 0x7f0f140722c0 2023-11-26T07:14:50.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.772+0000 7f0f137fe700 1 --2- 172.21.15.2:0/552462419 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0ef406b470 0x7f0ef406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:50.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.772+0000 7f0f137fe700 1 --2- 172.21.15.2:0/552462419 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0ef406b470 0x7f0ef406d930 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0f141581c0 tx=0x7f0efc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:50.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.776+0000 7f0f10ff9700 1 -- 172.21.15.2:0/552462419 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0f04053d80 con 0x7f0f140722c0 2023-11-26T07:14:50.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.977+0000 7f0f1a30b700 1 -- 172.21.15.2:0/552462419 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0f14075480 con 0x7f0f140722c0 2023-11-26T07:14:50.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.977+0000 7f0f10ff9700 1 -- 172.21.15.2:0/552462419 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v48) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0f040573a0 con 0x7f0f140722c0 2023-11-26T07:14:50.980 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-26T07:14:50.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.979+0000 7f0f1a30b700 1 -- 172.21.15.2:0/552462419 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0ef406b470 msgr2=0x7f0ef406d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:50.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.979+0000 7f0f1a30b700 1 --2- 172.21.15.2:0/552462419 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0ef406b470 0x7f0ef406d930 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0f141581c0 tx=0x7f0efc009040 comp rx=0 tx=0).stop 2023-11-26T07:14:50.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.979+0000 7f0f1a30b700 1 -- 172.21.15.2:0/552462419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f140722c0 msgr2=0x7f0f141545e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:50.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.979+0000 7f0f1a30b700 1 --2- 172.21.15.2:0/552462419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f140722c0 0x7f0f141545e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f0f0400c700 tx=0x7f0f0400ca10 comp rx=0 tx=0).stop 2023-11-26T07:14:50.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.980+0000 7f0f1a30b700 1 -- 172.21.15.2:0/552462419 shutdown_connections 2023-11-26T07:14:50.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.980+0000 7f0f1a30b700 1 --2- 172.21.15.2:0/552462419 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0ef406b470 0x7f0ef406d930 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:50.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.980+0000 7f0f1a30b700 1 --2- 172.21.15.2:0/552462419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f141440f0 0x7f0f14159c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:50.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.980+0000 7f0f1a30b700 1 --2- 172.21.15.2:0/552462419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f140722c0 0x7f0f141545e0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:50.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.980+0000 7f0f1a30b700 1 --2- 172.21.15.2:0/552462419 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f14143ae0 0x7f0f14155e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:50.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.980+0000 7f0f1a30b700 1 -- 172.21.15.2:0/552462419 >> 172.21.15.2:0/552462419 conn(0x7f0f140b2740 msgr2=0x7f0f1406e410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:50.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.980+0000 7f0f1a30b700 1 -- 172.21.15.2:0/552462419 shutdown_connections 2023-11-26T07:14:50.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:50.980+0000 7f0f1a30b700 1 -- 172.21.15.2:0/552462419 wait complete. 2023-11-26T07:14:50.994 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-26T07:14:51.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.117+0000 7f02ecaaa700 1 Processor -- start 2023-11-26T07:14:51.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.117+0000 7f02ecaaa700 1 -- start start 2023-11-26T07:14:51.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.118+0000 7f02ecaaa700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02e806b620 0x7f02e80b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:51.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.118+0000 7f02ecaaa700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f02e806ee60 0x7f02e80b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:51.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.118+0000 7f02ecaaa700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02e8071f50 con 0x7f02e80b5ab0 2023-11-26T07:14:51.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.119+0000 7f02ecaaa700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02e8072230 con 0x7f02e806ee60 2023-11-26T07:14:51.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.119+0000 7f02ecaaa700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e8072510 con 0x7f02e806b620 2023-11-26T07:14:51.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.119+0000 7f02e5d9b700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f02e80b5ab0 0x7f02e8161ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33748/0 (socket says 172.21.15.2:33748) 2023-11-26T07:14:51.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.119+0000 7f02e5d9b700 1 -- 172.21.15.2:0/2096447843 learned_addr learned my addr 172.21.15.2:0/2096447843 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:14:51.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.119+0000 7f02e6d9d700 1 --2- 172.21.15.2:0/2096447843 >> v2:172.21.15.192:3300/0 conn(0x7f02e806ee60 0x7f02e80b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:51.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.119+0000 7f02e659c700 1 --2- 172.21.15.2:0/2096447843 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02e806b620 0x7f02e80b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:51.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.119+0000 7f02e559a700 1 -- 172.21.15.2:0/2096447843 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2621049120 0 0) 0x7f02e8071f50 con 0x7f02e80b5ab0 2023-11-26T07:14:51.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.119+0000 7f02e559a700 1 -- 172.21.15.2:0/2096447843 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02d00035b0 con 0x7f02e80b5ab0 2023-11-26T07:14:51.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.119+0000 7f02e559a700 1 -- 172.21.15.2:0/2096447843 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1064802827 0 0) 0x7f02d00035b0 con 0x7f02e80b5ab0 2023-11-26T07:14:51.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.119+0000 7f02e6d9d700 1 -- 172.21.15.2:0/2096447843 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02e806b620 msgr2=0x7f02e80b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:51.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.119+0000 7f02e6d9d700 1 --2- 172.21.15.2:0/2096447843 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02e806b620 0x7f02e80b3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:51.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.119+0000 7f02e6d9d700 1 -- 172.21.15.2:0/2096447843 >> v1:172.21.15.2:6789/0 conn(0x7f02e80b5ab0 legacy=0x7f02e8161ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:51.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.119+0000 7f02e6d9d700 1 -- 172.21.15.2:0/2096447843 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e80727f0 con 0x7f02e806ee60 2023-11-26T07:14:51.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.119+0000 7f02e6d9d700 1 --2- 172.21.15.2:0/2096447843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02e806ee60 0x7f02e80b3f80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f02e0009d90 tx=0x7f02e000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d5d09f6190071b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:51.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.120+0000 7f02e559a700 1 -- 172.21.15.2:0/2096447843 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e000e070 con 0x7f02e806ee60 2023-11-26T07:14:51.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.120+0000 7f02e559a700 1 -- 172.21.15.2:0/2096447843 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e0003a20 con 0x7f02e806ee60 2023-11-26T07:14:51.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.120+0000 7f02e559a700 1 -- 172.21.15.2:0/2096447843 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d8001670 con 0x7f02e806ee60 2023-11-26T07:14:51.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.120+0000 7f02ecaaa700 1 -- 172.21.15.2:0/2096447843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02e806ee60 msgr2=0x7f02e80b3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:51.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.120+0000 7f02ecaaa700 1 --2- 172.21.15.2:0/2096447843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02e806ee60 0x7f02e80b3f80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f02e0009d90 tx=0x7f02e000b330 comp rx=0 tx=0).stop 2023-11-26T07:14:51.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.120+0000 7f02ecaaa700 1 -- 172.21.15.2:0/2096447843 shutdown_connections 2023-11-26T07:14:51.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.120+0000 7f02ecaaa700 1 --2- 172.21.15.2:0/2096447843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02e806ee60 0x7f02e80b3f80 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:51.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.120+0000 7f02ecaaa700 1 --2- 172.21.15.2:0/2096447843 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02e806b620 0x7f02e80b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:51.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.120+0000 7f02ecaaa700 1 -- 172.21.15.2:0/2096447843 >> 172.21.15.2:0/2096447843 conn(0x7f02e80b2740 msgr2=0x7f02e80b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:51.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.120+0000 7f02ecaaa700 1 -- 172.21.15.2:0/2096447843 shutdown_connections 2023-11-26T07:14:51.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.120+0000 7f02ecaaa700 1 -- 172.21.15.2:0/2096447843 wait complete. 2023-11-26T07:14:51.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.122+0000 7f02ecaaa700 1 Processor -- start 2023-11-26T07:14:51.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.122+0000 7f02ecaaa700 1 -- start start 2023-11-26T07:14:51.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.123+0000 7f02ecaaa700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02e806b620 0x7f02e8143d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:51.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.123+0000 7f02ecaaa700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02e806ee60 0x7f02e80d0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:51.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.123+0000 7f02ecaaa700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02e80b5ab0 0x7f02e80d0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:51.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.123+0000 7f02ecaaa700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e80c65a0 con 0x7f02e80b5ab0 2023-11-26T07:14:51.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.123+0000 7f02ecaaa700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e80c85c0 con 0x7f02e806b620 2023-11-26T07:14:51.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.123+0000 7f02ecaaa700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e80c59b0 con 0x7f02e806ee60 2023-11-26T07:14:51.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.123+0000 7f02e6d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02e80b5ab0 0x7f02e80d0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:51.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.123+0000 7f02e6d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02e80b5ab0 0x7f02e80d0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42548/0 (socket says 172.21.15.2:42548) 2023-11-26T07:14:51.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.123+0000 7f02e6d9d700 1 -- 172.21.15.2:0/1306274508 learned_addr learned my addr 172.21.15.2:0/1306274508 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:51.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.123+0000 7f02e5d9b700 1 --2- 172.21.15.2:0/1306274508 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02e806ee60 0x7f02e80d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:51.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.123+0000 7f02e659c700 1 --2- 172.21.15.2:0/1306274508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02e806b620 0x7f02e8143d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:51.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.123+0000 7f02e6d9d700 1 -- 172.21.15.2:0/1306274508 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02e806ee60 msgr2=0x7f02e80d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:51.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.123+0000 7f02e6d9d700 1 --2- 172.21.15.2:0/1306274508 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02e806ee60 0x7f02e80d0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:51.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.123+0000 7f02e6d9d700 1 -- 172.21.15.2:0/1306274508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02e806b620 msgr2=0x7f02e8143d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:51.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.123+0000 7f02e6d9d700 1 --2- 172.21.15.2:0/1306274508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02e806b620 0x7f02e8143d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:51.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.123+0000 7f02e6d9d700 1 -- 172.21.15.2:0/1306274508 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e0009a70 con 0x7f02e80b5ab0 2023-11-26T07:14:51.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.124+0000 7f02e6d9d700 1 --2- 172.21.15.2:0/1306274508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02e80b5ab0 0x7f02e80d0d60 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f02e80d1bd0 tx=0x7f02e0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:51.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.124+0000 7f02d6ffd700 1 -- 172.21.15.2:0/1306274508 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e0009410 con 0x7f02e80b5ab0 2023-11-26T07:14:51.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.124+0000 7f02d6ffd700 1 -- 172.21.15.2:0/1306274508 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e0004460 con 0x7f02e80b5ab0 2023-11-26T07:14:51.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.124+0000 7f02ecaaa700 1 -- 172.21.15.2:0/1306274508 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02e80c5c00 con 0x7f02e80b5ab0 2023-11-26T07:14:51.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.124+0000 7f02d6ffd700 1 -- 172.21.15.2:0/1306274508 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e0004810 con 0x7f02e80b5ab0 2023-11-26T07:14:51.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.124+0000 7f02ecaaa700 1 -- 172.21.15.2:0/1306274508 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02e80c61c0 con 0x7f02e80b5ab0 2023-11-26T07:14:51.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.125+0000 7f02ecaaa700 1 -- 172.21.15.2:0/1306274508 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02e8068670 con 0x7f02e80b5ab0 2023-11-26T07:14:51.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.125+0000 7f02d6ffd700 1 -- 172.21.15.2:0/1306274508 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f02e0012430 con 0x7f02e80b5ab0 2023-11-26T07:14:51.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.126+0000 7f02d6ffd700 1 --2- 172.21.15.2:0/1306274508 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f02c806b470 0x7f02c806d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:51.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.126+0000 7f02d6ffd700 1 -- 172.21.15.2:0/1306274508 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5823+0+0 (secure 0 0 0) 0x7f02e008c480 con 0x7f02e80b5ab0 2023-11-26T07:14:51.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.126+0000 7f02e659c700 1 --2- 172.21.15.2:0/1306274508 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f02c806b470 0x7f02c806d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:51.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.126+0000 7f02e659c700 1 --2- 172.21.15.2:0/1306274508 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f02c806b470 0x7f02c806d930 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f02dc009be0 tx=0x7f02dc009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:51.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.130+0000 7f02d6ffd700 1 -- 172.21.15.2:0/1306274508 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f02e0056bd0 con 0x7f02e80b5ab0 2023-11-26T07:14:51.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.354+0000 7f02ecaaa700 1 -- 172.21.15.2:0/1306274508 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f02e806bd40 con 0x7f02e80b5ab0 2023-11-26T07:14:51.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.355+0000 7f02d6ffd700 1 -- 172.21.15.2:0/1306274508 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v49) v1 ==== 80+0+0 (secure 0 0 0) 0x7f02e005a1f0 con 0x7f02e80b5ab0 2023-11-26T07:14:51.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.357+0000 7f02ecaaa700 1 -- 172.21.15.2:0/1306274508 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f02c806b470 msgr2=0x7f02c806d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:51.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.357+0000 7f02ecaaa700 1 --2- 172.21.15.2:0/1306274508 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f02c806b470 0x7f02c806d930 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f02dc009be0 tx=0x7f02dc009210 comp rx=0 tx=0).stop 2023-11-26T07:14:51.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.357+0000 7f02ecaaa700 1 -- 172.21.15.2:0/1306274508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02e80b5ab0 msgr2=0x7f02e80d0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:51.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.357+0000 7f02ecaaa700 1 --2- 172.21.15.2:0/1306274508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02e80b5ab0 0x7f02e80d0d60 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f02e80d1bd0 tx=0x7f02e0004ad0 comp rx=0 tx=0).stop 2023-11-26T07:14:51.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.357+0000 7f02ecaaa700 1 -- 172.21.15.2:0/1306274508 shutdown_connections 2023-11-26T07:14:51.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.357+0000 7f02ecaaa700 1 --2- 172.21.15.2:0/1306274508 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f02c806b470 0x7f02c806d930 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:51.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.357+0000 7f02ecaaa700 1 --2- 172.21.15.2:0/1306274508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02e80b5ab0 0x7f02e80d0d60 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:51.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.357+0000 7f02ecaaa700 1 --2- 172.21.15.2:0/1306274508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02e806b620 0x7f02e8143d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:51.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.357+0000 7f02ecaaa700 1 --2- 172.21.15.2:0/1306274508 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02e806ee60 0x7f02e80d0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:51.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.357+0000 7f02ecaaa700 1 -- 172.21.15.2:0/1306274508 >> 172.21.15.2:0/1306274508 conn(0x7f02e80b2740 msgr2=0x7f02e80b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:51.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.357+0000 7f02ecaaa700 1 -- 172.21.15.2:0/1306274508 shutdown_connections 2023-11-26T07:14:51.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.357+0000 7f02ecaaa700 1 -- 172.21.15.2:0/1306274508 wait complete. 2023-11-26T07:14:51.360 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2023-11-26T07:14:51.371 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-26T07:14:51.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:51.371 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-26T07:14:51.417 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2023-11-26T07:14:51.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:14:51.417 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-26T07:14:51.436 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:14:51.436 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:51.453 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19704 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-26T07:14:51.454 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:14:51.454 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:14:51.495 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284224k,nr_inodes=4071056,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3837 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260544k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-26T07:14:51.495 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:14:51.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.618+0000 7f77bf8b4700 1 Processor -- start 2023-11-26T07:14:51.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.618+0000 7f77bf8b4700 1 -- start start 2023-11-26T07:14:51.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.619+0000 7f77bf8b4700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f77b8143ae0 0x7f77b80b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:51.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.619+0000 7f77bf8b4700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77b8143ec0 con 0x7f77b81440f0 2023-11-26T07:14:51.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.619+0000 7f77bf8b4700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77b80b3ae0 con 0x7f77b80722c0 2023-11-26T07:14:51.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.619+0000 7f77bf8b4700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77b80b40a0 con 0x7f77b8143ae0 2023-11-26T07:14:51.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.619+0000 7f77bd650700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f77b8143ae0 0x7f77b80b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:51.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.619+0000 7f77bce4f700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f77b81440f0 0x7f77b8071bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33764/0 (socket says 172.21.15.2:33764) 2023-11-26T07:14:51.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.619+0000 7f77bce4f700 1 -- 172.21.15.2:0/4201987073 learned_addr learned my addr 172.21.15.2:0/4201987073 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:14:51.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.619+0000 7f77bd650700 1 -- 172.21.15.2:0/4201987073 >> v1:172.21.15.192:6789/0 conn(0x7f77b80722c0 legacy=0x7f77b806e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:51.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.619+0000 7f77bd650700 1 -- 172.21.15.2:0/4201987073 >> v1:172.21.15.2:6789/0 conn(0x7f77b81440f0 legacy=0x7f77b8071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:51.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.619+0000 7f77affff700 1 -- 172.21.15.2:0/4201987073 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2167137295 0 0) 0x7f77b8143ec0 con 0x7f77b81440f0 2023-11-26T07:14:51.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.619+0000 7f77bd650700 1 -- 172.21.15.2:0/4201987073 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b80b3dc0 con 0x7f77b8143ae0 2023-11-26T07:14:51.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.620+0000 7f77bd650700 1 --2- 172.21.15.2:0/4201987073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77b8143ae0 0x7f77b80b51b0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f77a8009840 tx=0x7f77a8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2aaf7822215d609 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:51.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.620+0000 7f77affff700 1 -- 172.21.15.2:0/4201987073 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a8004230 con 0x7f77b8143ae0 2023-11-26T07:14:51.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.620+0000 7f77affff700 1 -- 172.21.15.2:0/4201987073 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a8004390 con 0x7f77b8143ae0 2023-11-26T07:14:51.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.620+0000 7f77affff700 1 -- 172.21.15.2:0/4201987073 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a80036a0 con 0x7f77b8143ae0 2023-11-26T07:14:51.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.620+0000 7f77bf8b4700 1 -- 172.21.15.2:0/4201987073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77b8143ae0 msgr2=0x7f77b80b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:51.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.620+0000 7f77bf8b4700 1 --2- 172.21.15.2:0/4201987073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77b8143ae0 0x7f77b80b51b0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f77a8009840 tx=0x7f77a8009b50 comp rx=0 tx=0).stop 2023-11-26T07:14:51.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.620+0000 7f77bf8b4700 1 -- 172.21.15.2:0/4201987073 shutdown_connections 2023-11-26T07:14:51.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.620+0000 7f77bf8b4700 1 --2- 172.21.15.2:0/4201987073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77b8143ae0 0x7f77b80b51b0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:51.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.620+0000 7f77bf8b4700 1 -- 172.21.15.2:0/4201987073 >> 172.21.15.2:0/4201987073 conn(0x7f77b80b2740 msgr2=0x7f77b80b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:51.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.620+0000 7f77bf8b4700 1 -- 172.21.15.2:0/4201987073 shutdown_connections 2023-11-26T07:14:51.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.620+0000 7f77bf8b4700 1 -- 172.21.15.2:0/4201987073 wait complete. 2023-11-26T07:14:51.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.622+0000 7f77bf8b4700 1 Processor -- start 2023-11-26T07:14:51.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.622+0000 7f77bf8b4700 1 -- start start 2023-11-26T07:14:51.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.622+0000 7f77bf8b4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77b80722c0 0x7f77b8158d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:51.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.622+0000 7f77bf8b4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77b8143ae0 0x7f77b80c6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:51.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.622+0000 7f77bf8b4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77b81440f0 0x7f77b80cc000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:51.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.622+0000 7f77bf8b4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b80cbbe0 con 0x7f77b80722c0 2023-11-26T07:14:51.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.622+0000 7f77bf8b4700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b81f60b0 con 0x7f77b8143ae0 2023-11-26T07:14:51.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.622+0000 7f77bf8b4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b80cb240 con 0x7f77b81440f0 2023-11-26T07:14:51.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.622+0000 7f77bd650700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77b80722c0 0x7f77b8158d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:51.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.622+0000 7f77bd650700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77b80722c0 0x7f77b8158d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42558/0 (socket says 172.21.15.2:42558) 2023-11-26T07:14:51.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.622+0000 7f77bd650700 1 -- 172.21.15.2:0/4003537339 learned_addr learned my addr 172.21.15.2:0/4003537339 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:51.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.623+0000 7f77bce4f700 1 --2- 172.21.15.2:0/4003537339 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77b8143ae0 0x7f77b80c6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:51.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.623+0000 7f77bde51700 1 --2- 172.21.15.2:0/4003537339 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77b81440f0 0x7f77b80cc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:51.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.623+0000 7f77bd650700 1 -- 172.21.15.2:0/4003537339 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77b81440f0 msgr2=0x7f77b80cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:51.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.623+0000 7f77bd650700 1 --2- 172.21.15.2:0/4003537339 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77b81440f0 0x7f77b80cc000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:51.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.623+0000 7f77bd650700 1 -- 172.21.15.2:0/4003537339 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77b8143ae0 msgr2=0x7f77b80c6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:51.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.623+0000 7f77bd650700 1 --2- 172.21.15.2:0/4003537339 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77b8143ae0 0x7f77b80c6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:51.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.623+0000 7f77bd650700 1 -- 172.21.15.2:0/4003537339 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a80094a0 con 0x7f77b80722c0 2023-11-26T07:14:51.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.623+0000 7f77bd650700 1 --2- 172.21.15.2:0/4003537339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77b80722c0 0x7f77b8158d70 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f77a80090b0 tx=0x7f77a8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:51.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.623+0000 7f77adffb700 1 -- 172.21.15.2:0/4003537339 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a8011830 con 0x7f77b80722c0 2023-11-26T07:14:51.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.623+0000 7f77adffb700 1 -- 172.21.15.2:0/4003537339 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a801e070 con 0x7f77b80722c0 2023-11-26T07:14:51.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.623+0000 7f77bf8b4700 1 -- 172.21.15.2:0/4003537339 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77b80cb520 con 0x7f77b80722c0 2023-11-26T07:14:51.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.623+0000 7f77adffb700 1 -- 172.21.15.2:0/4003537339 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a8011bb0 con 0x7f77b80722c0 2023-11-26T07:14:51.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.623+0000 7f77bf8b4700 1 -- 172.21.15.2:0/4003537339 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77b81592b0 con 0x7f77b80722c0 2023-11-26T07:14:51.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.624+0000 7f77bf8b4700 1 -- 172.21.15.2:0/4003537339 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77b80cbe50 con 0x7f77b80722c0 2023-11-26T07:14:51.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.625+0000 7f77adffb700 1 -- 172.21.15.2:0/4003537339 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f77a8011d10 con 0x7f77b80722c0 2023-11-26T07:14:51.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.625+0000 7f77adffb700 1 --2- 172.21.15.2:0/4003537339 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f779c06b470 0x7f779c06d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:51.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.625+0000 7f77adffb700 1 -- 172.21.15.2:0/4003537339 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f77a808b400 con 0x7f77b80722c0 2023-11-26T07:14:51.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.625+0000 7f77bce4f700 1 --2- 172.21.15.2:0/4003537339 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f779c06b470 0x7f779c06d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:51.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.626+0000 7f77bce4f700 1 --2- 172.21.15.2:0/4003537339 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f779c06b470 0x7f779c06d930 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f77b815b090 tx=0x7f77b4007c90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:51.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.630+0000 7f77adffb700 1 -- 172.21.15.2:0/4003537339 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f77a8055c70 con 0x7f77b80722c0 2023-11-26T07:14:51.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.877+0000 7f77bf8b4700 1 -- 172.21.15.2:0/4003537339 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f77b8068670 con 0x7f77b80722c0 2023-11-26T07:14:51.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.877+0000 7f77adffb700 1 -- 172.21.15.2:0/4003537339 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f77a8059290 con 0x7f77b80722c0 2023-11-26T07:14:51.880 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:14:51.880 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5051,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2052180749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":2052180749},{"type":"v1","addr":"172.21.15.2:6835","nonce":2052180749}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/1795687093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1795687093},{"type":"v1","addr":"172.21.15.2:6834","nonce":1795687093}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5646,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2009465289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2009465289},{"type":"v1","addr":"172.21.15.192:6837","nonce":2009465289}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:13:53.741450+0000","modified":"2023-11-26T07:13:56.778566+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5649},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5649":{"gid":5649,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6836/2352660671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2352660671},{"type":"v1","addr":"172.21.15.192:6836","nonce":2352660671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-26T07:14:51.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.879+0000 7f77bf8b4700 1 -- 172.21.15.2:0/4003537339 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f779c06b470 msgr2=0x7f779c06d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:51.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.879+0000 7f77bf8b4700 1 --2- 172.21.15.2:0/4003537339 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f779c06b470 0x7f779c06d930 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f77b815b090 tx=0x7f77b4007c90 comp rx=0 tx=0).stop 2023-11-26T07:14:51.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.880+0000 7f77bf8b4700 1 -- 172.21.15.2:0/4003537339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77b80722c0 msgr2=0x7f77b8158d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:51.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.880+0000 7f77bf8b4700 1 --2- 172.21.15.2:0/4003537339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77b80722c0 0x7f77b8158d70 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f77a80090b0 tx=0x7f77a8004750 comp rx=0 tx=0).stop 2023-11-26T07:14:51.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.880+0000 7f77bf8b4700 1 -- 172.21.15.2:0/4003537339 shutdown_connections 2023-11-26T07:14:51.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.880+0000 7f77bf8b4700 1 --2- 172.21.15.2:0/4003537339 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f779c06b470 0x7f779c06d930 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:51.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.880+0000 7f77bf8b4700 1 --2- 172.21.15.2:0/4003537339 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77b81440f0 0x7f77b80cc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:51.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.880+0000 7f77bf8b4700 1 --2- 172.21.15.2:0/4003537339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77b80722c0 0x7f77b8158d70 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:51.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.880+0000 7f77bf8b4700 1 --2- 172.21.15.2:0/4003537339 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77b8143ae0 0x7f77b80c6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:51.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.880+0000 7f77bf8b4700 1 -- 172.21.15.2:0/4003537339 >> 172.21.15.2:0/4003537339 conn(0x7f77b80b2740 msgr2=0x7f77b8142e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:51.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.880+0000 7f77bf8b4700 1 -- 172.21.15.2:0/4003537339 shutdown_connections 2023-11-26T07:14:51.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:51.880+0000 7f77bf8b4700 1 -- 172.21.15.2:0/4003537339 wait complete. 2023-11-26T07:14:51.883 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 27 2023-11-26T07:14:51.894 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:14:52.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.016+0000 7f6fdd76d700 1 Processor -- start 2023-11-26T07:14:52.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.016+0000 7f6fdd76d700 1 -- start start 2023-11-26T07:14:52.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.017+0000 7f6fdd76d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6fd815e460 0x7f6fd80d49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:52.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.017+0000 7f6fdd76d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6fd80cf480 0x7f6fd80d2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:52.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.017+0000 7f6fdd76d700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fd80b3370 con 0x7f6fd80d29d0 2023-11-26T07:14:52.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.017+0000 7f6fdd76d700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fd80d2e60 con 0x7f6fd80cf480 2023-11-26T07:14:52.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.017+0000 7f6fdd76d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd80cfc40 con 0x7f6fd815e460 2023-11-26T07:14:52.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.017+0000 7f6fd67fc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6fd80cf480 0x7f6fd80d2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:52.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.017+0000 7f6fd67fc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6fd80cf480 0x7f6fd80d2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42568/0 (socket says 172.21.15.2:42568) 2023-11-26T07:14:52.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.017+0000 7f6fd77fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f6fd80d29d0 0x7f6fd80d0550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33780/0 (socket says 172.21.15.2:33780) 2023-11-26T07:14:52.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.017+0000 7f6fd67fc700 1 -- 172.21.15.2:0/775756942 learned_addr learned my addr 172.21.15.2:0/775756942 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:52.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.017+0000 7f6fd6ffd700 1 --2- 172.21.15.2:0/775756942 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6fd815e460 0x7f6fd80d49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:52.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.017+0000 7f6fd67fc700 1 -- 172.21.15.2:0/775756942 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6fd815e460 msgr2=0x7f6fd80d49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:52.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.017+0000 7f6fd67fc700 1 --2- 172.21.15.2:0/775756942 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6fd815e460 0x7f6fd80d49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:52.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.017+0000 7f6fd67fc700 1 -- 172.21.15.2:0/775756942 >> v1:172.21.15.2:6789/0 conn(0x7f6fd80d29d0 legacy=0x7f6fd80d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:52.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.017+0000 7f6fd5ffb700 1 -- 172.21.15.2:0/775756942 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 540937623 0 0) 0x7f6fd80b3370 con 0x7f6fd80d29d0 2023-11-26T07:14:52.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.017+0000 7f6fd67fc700 1 -- 172.21.15.2:0/775756942 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd80b35c0 con 0x7f6fd80cf480 2023-11-26T07:14:52.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.017+0000 7f6fd6ffd700 1 --2- 172.21.15.2:0/775756942 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6fd815e460 0x7f6fd80d49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:14:52.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.017+0000 7f6fd67fc700 1 --2- 172.21.15.2:0/775756942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fd80cf480 0x7f6fd80d2490 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f6fc80098f0 tx=0x7f6fc8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=826c077dfb11f5bf server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:52.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.018+0000 7f6fd5ffb700 1 -- 172.21.15.2:0/775756942 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc800b8a0 con 0x7f6fd80cf480 2023-11-26T07:14:52.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.018+0000 7f6fd5ffb700 1 -- 172.21.15.2:0/775756942 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc800ba00 con 0x7f6fd80cf480 2023-11-26T07:14:52.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.018+0000 7f6fd5ffb700 1 -- 172.21.15.2:0/775756942 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc800bd90 con 0x7f6fd80cf480 2023-11-26T07:14:52.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.018+0000 7f6fdd76d700 1 -- 172.21.15.2:0/775756942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fd80cf480 msgr2=0x7f6fd80d2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:52.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.018+0000 7f6fdd76d700 1 --2- 172.21.15.2:0/775756942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fd80cf480 0x7f6fd80d2490 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f6fc80098f0 tx=0x7f6fc8009c00 comp rx=0 tx=0).stop 2023-11-26T07:14:52.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.018+0000 7f6fdd76d700 1 -- 172.21.15.2:0/775756942 shutdown_connections 2023-11-26T07:14:52.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.018+0000 7f6fdd76d700 1 --2- 172.21.15.2:0/775756942 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6fd815e460 0x7f6fd80d49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:52.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.018+0000 7f6fdd76d700 1 --2- 172.21.15.2:0/775756942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fd80cf480 0x7f6fd80d2490 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:52.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.018+0000 7f6fdd76d700 1 -- 172.21.15.2:0/775756942 >> 172.21.15.2:0/775756942 conn(0x7f6fd80d3eb0 msgr2=0x7f6fd80d42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:52.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.018+0000 7f6fdd76d700 1 -- 172.21.15.2:0/775756942 shutdown_connections 2023-11-26T07:14:52.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.018+0000 7f6fdd76d700 1 -- 172.21.15.2:0/775756942 wait complete. 2023-11-26T07:14:52.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.020+0000 7f6fdd76d700 1 Processor -- start 2023-11-26T07:14:52.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.020+0000 7f6fdd76d700 1 -- start start 2023-11-26T07:14:52.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.020+0000 7f6fdd76d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fd80cf480 0x7f6fd80caf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:52.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.020+0000 7f6fdd76d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6fd80d29d0 0x7f6fd815ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:52.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.020+0000 7f6fdd76d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fd815e460 0x7f6fd8160490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:52.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.020+0000 7f6fdd76d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd80cb7d0 con 0x7f6fd80cf480 2023-11-26T07:14:52.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.020+0000 7f6fdd76d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd80cbab0 con 0x7f6fd815e460 2023-11-26T07:14:52.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.020+0000 7f6fdd76d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd80cbd90 con 0x7f6fd80d29d0 2023-11-26T07:14:52.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.020+0000 7f6fd6ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fd80cf480 0x7f6fd80caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:52.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.020+0000 7f6fd6ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fd80cf480 0x7f6fd80caf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42572/0 (socket says 172.21.15.2:42572) 2023-11-26T07:14:52.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.021+0000 7f6fd6ffd700 1 -- 172.21.15.2:0/2801383409 learned_addr learned my addr 172.21.15.2:0/2801383409 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:52.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.021+0000 7f6fd67fc700 1 --2- 172.21.15.2:0/2801383409 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6fd80d29d0 0x7f6fd815ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:52.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.021+0000 7f6fd77fe700 1 --2- 172.21.15.2:0/2801383409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fd815e460 0x7f6fd8160490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:52.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.021+0000 7f6fd6ffd700 1 -- 172.21.15.2:0/2801383409 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6fd80d29d0 msgr2=0x7f6fd815ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:52.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.021+0000 7f6fd6ffd700 1 --2- 172.21.15.2:0/2801383409 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6fd80d29d0 0x7f6fd815ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:52.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.021+0000 7f6fd6ffd700 1 -- 172.21.15.2:0/2801383409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fd815e460 msgr2=0x7f6fd8160490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:52.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.021+0000 7f6fd6ffd700 1 --2- 172.21.15.2:0/2801383409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fd815e460 0x7f6fd8160490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:52.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.021+0000 7f6fd6ffd700 1 -- 172.21.15.2:0/2801383409 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc8009550 con 0x7f6fd80cf480 2023-11-26T07:14:52.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.021+0000 7f6fd77fe700 1 --2- 172.21.15.2:0/2801383409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fd815e460 0x7f6fd8160490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:14:52.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.021+0000 7f6fd6ffd700 1 --2- 172.21.15.2:0/2801383409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fd80cf480 0x7f6fd80caf80 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc00c7f0 tx=0x7f6fcc00cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:52.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.021+0000 7f6fbf7fe700 1 -- 172.21.15.2:0/2801383409 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc011800 con 0x7f6fd80cf480 2023-11-26T07:14:52.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.021+0000 7f6fbf7fe700 1 -- 172.21.15.2:0/2801383409 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fcc011960 con 0x7f6fd80cf480 2023-11-26T07:14:52.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.021+0000 7f6fdd76d700 1 -- 172.21.15.2:0/2801383409 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fd80cc070 con 0x7f6fd80cf480 2023-11-26T07:14:52.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.021+0000 7f6fbf7fe700 1 -- 172.21.15.2:0/2801383409 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc011cf0 con 0x7f6fd80cf480 2023-11-26T07:14:52.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.021+0000 7f6fdd76d700 1 -- 172.21.15.2:0/2801383409 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fd80cb4c0 con 0x7f6fd80cf480 2023-11-26T07:14:52.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.022+0000 7f6fdd76d700 1 -- 172.21.15.2:0/2801383409 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fd8067f60 con 0x7f6fd80cf480 2023-11-26T07:14:52.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.023+0000 7f6fbf7fe700 1 -- 172.21.15.2:0/2801383409 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f6fcc018360 con 0x7f6fd80cf480 2023-11-26T07:14:52.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.023+0000 7f6fbf7fe700 1 --2- 172.21.15.2:0/2801383409 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6fc406b470 0x7f6fc406d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:52.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.023+0000 7f6fbf7fe700 1 -- 172.21.15.2:0/2801383409 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f6fcc08a0f0 con 0x7f6fd80cf480 2023-11-26T07:14:52.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.023+0000 7f6fd67fc700 1 --2- 172.21.15.2:0/2801383409 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6fc406b470 0x7f6fc406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:52.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.024+0000 7f6fd67fc700 1 --2- 172.21.15.2:0/2801383409 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6fc406b470 0x7f6fc406d930 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8000c00 tx=0x7f6fc8008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:52.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.028+0000 7f6fbf7fe700 1 -- 172.21.15.2:0/2801383409 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6fcc0bce90 con 0x7f6fd80cf480 2023-11-26T07:14:52.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.231+0000 7f6fdd76d700 1 -- 172.21.15.2:0/2801383409 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6fd81f5180 con 0x7f6fd80cf480 2023-11-26T07:14:52.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.232+0000 7f6fbf7fe700 1 -- 172.21.15.2:0/2801383409 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16626 (secure 0 0 0) 0x7f6fcc0547d0 con 0x7f6fd80cf480 2023-11-26T07:14:52.234 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:14:52.234 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":49,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:14:51.238862+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:13:52.197275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-26T07:13:52.705487+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":48,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2e","mappings":[{"from":0,"to":5}]},{"pgid":"7.3e","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:14:52.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.234+0000 7f6fdd76d700 1 -- 172.21.15.2:0/2801383409 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6fc406b470 msgr2=0x7f6fc406d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:52.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.234+0000 7f6fdd76d700 1 --2- 172.21.15.2:0/2801383409 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6fc406b470 0x7f6fc406d930 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8000c00 tx=0x7f6fc8008030 comp rx=0 tx=0).stop 2023-11-26T07:14:52.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.234+0000 7f6fdd76d700 1 -- 172.21.15.2:0/2801383409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fd80cf480 msgr2=0x7f6fd80caf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:52.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.234+0000 7f6fdd76d700 1 --2- 172.21.15.2:0/2801383409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fd80cf480 0x7f6fd80caf80 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc00c7f0 tx=0x7f6fcc00cb00 comp rx=0 tx=0).stop 2023-11-26T07:14:52.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.234+0000 7f6fdd76d700 1 -- 172.21.15.2:0/2801383409 shutdown_connections 2023-11-26T07:14:52.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.234+0000 7f6fdd76d700 1 --2- 172.21.15.2:0/2801383409 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6fc406b470 0x7f6fc406d930 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:52.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.234+0000 7f6fdd76d700 1 --2- 172.21.15.2:0/2801383409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fd815e460 0x7f6fd8160490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:52.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.234+0000 7f6fdd76d700 1 --2- 172.21.15.2:0/2801383409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fd80cf480 0x7f6fd80caf80 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:52.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.234+0000 7f6fdd76d700 1 --2- 172.21.15.2:0/2801383409 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6fd80d29d0 0x7f6fd815ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:52.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.234+0000 7f6fdd76d700 1 -- 172.21.15.2:0/2801383409 >> 172.21.15.2:0/2801383409 conn(0x7f6fd80d3eb0 msgr2=0x7f6fd80cebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:52.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.235+0000 7f6fdd76d700 1 -- 172.21.15.2:0/2801383409 shutdown_connections 2023-11-26T07:14:52.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.235+0000 7f6fdd76d700 1 -- 172.21.15.2:0/2801383409 wait complete. 2023-11-26T07:14:52.249 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:11:28.205739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:13:52.197275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:13:52.705487+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 48, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:14:52.249 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:14:52.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.375+0000 7f9f877a7700 1 Processor -- start 2023-11-26T07:14:52.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.376+0000 7f9f877a7700 1 -- start start 2023-11-26T07:14:52.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.376+0000 7f9f877a7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f8006afd0 0x7f9f800b5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:52.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.377+0000 7f9f877a7700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f80162200 con 0x7f9f8006e400 2023-11-26T07:14:52.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.377+0000 7f9f877a7700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f801624e0 con 0x7f9f8006b3b0 2023-11-26T07:14:52.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.377+0000 7f9f877a7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f801627c0 con 0x7f9f8006afd0 2023-11-26T07:14:52.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.377+0000 7f9f85d44700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f9f8006e400 0x7f9f8006e890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33794/0 (socket says 172.21.15.2:33794) 2023-11-26T07:14:52.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.377+0000 7f9f85d44700 1 -- 172.21.15.2:0/3782485314 learned_addr learned my addr 172.21.15.2:0/3782485314 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:14:52.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.377+0000 7f9f85543700 1 --2- 172.21.15.2:0/3782485314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f8006afd0 0x7f9f800b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:52.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.377+0000 7f9f77fff700 1 -- 172.21.15.2:0/3782485314 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 469537597 0 0) 0x7f9f80162200 con 0x7f9f8006e400 2023-11-26T07:14:52.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.377+0000 7f9f77fff700 1 -- 172.21.15.2:0/3782485314 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f6c0035b0 con 0x7f9f8006e400 2023-11-26T07:14:52.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.377+0000 7f9f77fff700 1 -- 172.21.15.2:0/3782485314 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1432525782 0 0) 0x7f9f6c0035b0 con 0x7f9f8006e400 2023-11-26T07:14:52.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.377+0000 7f9f77fff700 1 -- 172.21.15.2:0/3782485314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f8006afd0 msgr2=0x7f9f800b5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:52.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.377+0000 7f9f77fff700 1 --2- 172.21.15.2:0/3782485314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f8006afd0 0x7f9f800b5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:52.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.377+0000 7f9f77fff700 1 -- 172.21.15.2:0/3782485314 >> v1:172.21.15.192:6789/0 conn(0x7f9f8006b3b0 legacy=0x7f9f801619b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:52.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.377+0000 7f9f77fff700 1 -- 172.21.15.2:0/3782485314 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f8006dc00 con 0x7f9f8006e400 2023-11-26T07:14:52.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.377+0000 7f9f77fff700 1 -- 172.21.15.2:0/3782485314 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f9f780019f0 con 0x7f9f8006e400 2023-11-26T07:14:52.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.377+0000 7f9f77fff700 1 -- 172.21.15.2:0/3782485314 >> v1:172.21.15.2:6789/0 conn(0x7f9f8006e400 legacy=0x7f9f8006e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:52.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.377+0000 7f9f77fff700 1 --2- 172.21.15.2:0/3782485314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f6c003a30 0x7f9f6c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:52.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.377+0000 7f9f77fff700 1 --2- 172.21.15.2:0/3782485314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f6c0043e0 0x7f9f6c0048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:52.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.377+0000 7f9f77fff700 1 --2- 172.21.15.2:0/3782485314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f8006afd0 0x7f9f6c005110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:52.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.377+0000 7f9f77fff700 1 -- 172.21.15.2:0/3782485314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f801627c0 con 0x7f9f6c0043e0 2023-11-26T07:14:52.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.377+0000 7f9f77fff700 1 -- 172.21.15.2:0/3782485314 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6c00ba10 con 0x7f9f6c003a30 2023-11-26T07:14:52.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.377+0000 7f9f77fff700 1 -- 172.21.15.2:0/3782485314 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6c00bbd0 con 0x7f9f8006afd0 2023-11-26T07:14:52.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.377+0000 7f9f84d42700 1 --2- 172.21.15.2:0/3782485314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f6c0043e0 0x7f9f6c0048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:52.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.378+0000 7f9f85543700 1 --2- 172.21.15.2:0/3782485314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f6c003a30 0x7f9f6c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:52.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.378+0000 7f9f85d44700 1 --2- 172.21.15.2:0/3782485314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f8006afd0 0x7f9f6c005110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:52.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.378+0000 7f9f84d42700 1 -- 172.21.15.2:0/3782485314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f8006afd0 msgr2=0x7f9f6c005110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:52.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.378+0000 7f9f84d42700 1 --2- 172.21.15.2:0/3782485314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f8006afd0 0x7f9f6c005110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:52.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.378+0000 7f9f84d42700 1 -- 172.21.15.2:0/3782485314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f6c003a30 msgr2=0x7f9f6c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:52.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.378+0000 7f9f84d42700 1 --2- 172.21.15.2:0/3782485314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f6c003a30 0x7f9f6c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:52.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.378+0000 7f9f84d42700 1 -- 172.21.15.2:0/3782485314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f6c0035b0 con 0x7f9f6c0043e0 2023-11-26T07:14:52.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.378+0000 7f9f84d42700 1 --2- 172.21.15.2:0/3782485314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f6c0043e0 0x7f9f6c0048b0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c0018d0 tx=0x7f9f6c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3074d6b4cba56453 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:52.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.378+0000 7f9f77fff700 1 -- 172.21.15.2:0/3782485314 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c00c690 con 0x7f9f6c0043e0 2023-11-26T07:14:52.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.378+0000 7f9f77fff700 1 -- 172.21.15.2:0/3782485314 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7c00c7f0 con 0x7f9f6c0043e0 2023-11-26T07:14:52.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.378+0000 7f9f77fff700 1 -- 172.21.15.2:0/3782485314 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c00cba0 con 0x7f9f6c0043e0 2023-11-26T07:14:52.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.379+0000 7f9f877a7700 1 -- 172.21.15.2:0/3782485314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f6c0043e0 msgr2=0x7f9f6c0048b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:52.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.379+0000 7f9f877a7700 1 --2- 172.21.15.2:0/3782485314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f6c0043e0 0x7f9f6c0048b0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c0018d0 tx=0x7f9f6c005880 comp rx=0 tx=0).stop 2023-11-26T07:14:52.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.379+0000 7f9f85d44700 1 -- 172.21.15.2:0/3782485314 reap_dead start 2023-11-26T07:14:52.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.379+0000 7f9f877a7700 1 -- 172.21.15.2:0/3782485314 shutdown_connections 2023-11-26T07:14:52.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.379+0000 7f9f877a7700 1 -- 172.21.15.2:0/3782485314 >> 172.21.15.2:0/3782485314 conn(0x7f9f8006c0e0 msgr2=0x7f9f8006c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:52.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.379+0000 7f9f877a7700 1 -- 172.21.15.2:0/3782485314 shutdown_connections 2023-11-26T07:14:52.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.379+0000 7f9f877a7700 1 -- 172.21.15.2:0/3782485314 wait complete. 2023-11-26T07:14:52.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.380+0000 7f9f877a7700 1 Processor -- start 2023-11-26T07:14:52.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.380+0000 7f9f877a7700 1 -- start start 2023-11-26T07:14:52.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.381+0000 7f9f877a7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f6c0043e0 0x7f9f8015d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:52.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.381+0000 7f9f877a7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f800b1ed0 0x7f9f800aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:52.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.381+0000 7f9f877a7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f801583a0 0x7f9f80158820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:52.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.381+0000 7f9f877a7700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8015b4d0 con 0x7f9f800b1ed0 2023-11-26T07:14:52.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.381+0000 7f9f877a7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8015d9d0 con 0x7f9f6c0043e0 2023-11-26T07:14:52.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.381+0000 7f9f877a7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8015abc0 con 0x7f9f801583a0 2023-11-26T07:14:52.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.381+0000 7f9f84d42700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f800b1ed0 0x7f9f800aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:52.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.381+0000 7f9f84d42700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f800b1ed0 0x7f9f800aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42594/0 (socket says 172.21.15.2:42594) 2023-11-26T07:14:52.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.381+0000 7f9f84d42700 1 -- 172.21.15.2:0/2396882661 learned_addr learned my addr 172.21.15.2:0/2396882661 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:52.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.381+0000 7f9f85543700 1 --2- 172.21.15.2:0/2396882661 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f6c0043e0 0x7f9f8015d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:52.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.381+0000 7f9f85d44700 1 --2- 172.21.15.2:0/2396882661 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f801583a0 0x7f9f80158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:52.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.381+0000 7f9f84d42700 1 -- 172.21.15.2:0/2396882661 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f801583a0 msgr2=0x7f9f80158820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:52.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.381+0000 7f9f84d42700 1 --2- 172.21.15.2:0/2396882661 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f801583a0 0x7f9f80158820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:52.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.381+0000 7f9f84d42700 1 -- 172.21.15.2:0/2396882661 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f6c0043e0 msgr2=0x7f9f8015d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:52.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.381+0000 7f9f84d42700 1 --2- 172.21.15.2:0/2396882661 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f6c0043e0 0x7f9f8015d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:52.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.381+0000 7f9f84d42700 1 -- 172.21.15.2:0/2396882661 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f80143660 con 0x7f9f800b1ed0 2023-11-26T07:14:52.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.381+0000 7f9f84d42700 1 --2- 172.21.15.2:0/2396882661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f800b1ed0 0x7f9f800aed60 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c005360 tx=0x7f9f7c001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:52.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.381+0000 7f9f75ffb700 1 -- 172.21.15.2:0/2396882661 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c00cb60 con 0x7f9f800b1ed0 2023-11-26T07:14:52.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.382+0000 7f9f75ffb700 1 -- 172.21.15.2:0/2396882661 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7c021070 con 0x7f9f800b1ed0 2023-11-26T07:14:52.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.382+0000 7f9f877a7700 1 -- 172.21.15.2:0/2396882661 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f800b23c0 con 0x7f9f800b1ed0 2023-11-26T07:14:52.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.382+0000 7f9f75ffb700 1 -- 172.21.15.2:0/2396882661 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c001330 con 0x7f9f800b1ed0 2023-11-26T07:14:52.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.382+0000 7f9f877a7700 1 -- 172.21.15.2:0/2396882661 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f8015b0f0 con 0x7f9f800b1ed0 2023-11-26T07:14:52.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.383+0000 7f9f877a7700 1 -- 172.21.15.2:0/2396882661 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f80075480 con 0x7f9f800b1ed0 2023-11-26T07:14:52.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.383+0000 7f9f75ffb700 1 -- 172.21.15.2:0/2396882661 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f9f7c023030 con 0x7f9f800b1ed0 2023-11-26T07:14:52.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.384+0000 7f9f75ffb700 1 --2- 172.21.15.2:0/2396882661 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9f6406b470 0x7f9f6406d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:52.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.384+0000 7f9f75ffb700 1 -- 172.21.15.2:0/2396882661 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f9f7c08b0d0 con 0x7f9f800b1ed0 2023-11-26T07:14:52.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.384+0000 7f9f85543700 1 --2- 172.21.15.2:0/2396882661 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9f6406b470 0x7f9f6406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:52.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.385+0000 7f9f85543700 1 --2- 172.21.15.2:0/2396882661 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9f6406b470 0x7f9f6406d930 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9f70009b20 tx=0x7f9f70008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:52.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.388+0000 7f9f75ffb700 1 -- 172.21.15.2:0/2396882661 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9f7c0bde90 con 0x7f9f800b1ed0 2023-11-26T07:14:52.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.589+0000 7f9f877a7700 1 -- 172.21.15.2:0/2396882661 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9f8006cde0 con 0x7f9f800b1ed0 2023-11-26T07:14:52.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.590+0000 7f9f75ffb700 1 -- 172.21.15.2:0/2396882661 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9f7c055940 con 0x7f9f800b1ed0 2023-11-26T07:14:52.592 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-26T07:14:52.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.592+0000 7f9f877a7700 1 -- 172.21.15.2:0/2396882661 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9f6406b470 msgr2=0x7f9f6406d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:52.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.592+0000 7f9f877a7700 1 --2- 172.21.15.2:0/2396882661 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9f6406b470 0x7f9f6406d930 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9f70009b20 tx=0x7f9f70008040 comp rx=0 tx=0).stop 2023-11-26T07:14:52.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.592+0000 7f9f877a7700 1 -- 172.21.15.2:0/2396882661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f800b1ed0 msgr2=0x7f9f800aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:52.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.592+0000 7f9f877a7700 1 --2- 172.21.15.2:0/2396882661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f800b1ed0 0x7f9f800aed60 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c005360 tx=0x7f9f7c001230 comp rx=0 tx=0).stop 2023-11-26T07:14:52.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.592+0000 7f9f877a7700 1 -- 172.21.15.2:0/2396882661 shutdown_connections 2023-11-26T07:14:52.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.592+0000 7f9f877a7700 1 --2- 172.21.15.2:0/2396882661 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9f6406b470 0x7f9f6406d930 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:52.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.592+0000 7f9f877a7700 1 --2- 172.21.15.2:0/2396882661 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f801583a0 0x7f9f80158820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:52.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.592+0000 7f9f877a7700 1 --2- 172.21.15.2:0/2396882661 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f6c0043e0 0x7f9f8015d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:52.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.592+0000 7f9f877a7700 1 --2- 172.21.15.2:0/2396882661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f800b1ed0 0x7f9f800aed60 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:52.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.592+0000 7f9f877a7700 1 -- 172.21.15.2:0/2396882661 >> 172.21.15.2:0/2396882661 conn(0x7f9f8006c0e0 msgr2=0x7f9f80145c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:52.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.592+0000 7f9f877a7700 1 -- 172.21.15.2:0/2396882661 shutdown_connections 2023-11-26T07:14:52.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.592+0000 7f9f877a7700 1 -- 172.21.15.2:0/2396882661 wait complete. 2023-11-26T07:14:52.606 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:14:52.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.732+0000 7f3799dbe700 1 Processor -- start 2023-11-26T07:14:52.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.732+0000 7f3799dbe700 1 -- start start 2023-11-26T07:14:52.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.732+0000 7f3799dbe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3794072250 0x7f37940cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:52.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.732+0000 7f3799dbe700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f379415f5b0 con 0x7f379413dd00 2023-11-26T07:14:52.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.732+0000 7f3799dbe700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f379413e0e0 con 0x7f37940cf970 2023-11-26T07:14:52.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.732+0000 7f3799dbe700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37940d0690 con 0x7f3794072250 2023-11-26T07:14:52.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.733+0000 7f37937fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f379413dd00 0x7f37940cff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33810/0 (socket says 172.21.15.2:33810) 2023-11-26T07:14:52.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.733+0000 7f37937fe700 1 -- 172.21.15.2:0/3263859576 learned_addr learned my addr 172.21.15.2:0/3263859576 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:14:52.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.733+0000 7f3793fff700 1 --2- 172.21.15.2:0/3263859576 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3794072250 0x7f37940cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:52.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.733+0000 7f37927fc700 1 -- 172.21.15.2:0/3263859576 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3772316351 0 0) 0x7f379415f5b0 con 0x7f379413dd00 2023-11-26T07:14:52.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.733+0000 7f37927fc700 1 -- 172.21.15.2:0/3263859576 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37800035b0 con 0x7f379413dd00 2023-11-26T07:14:52.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.733+0000 7f37927fc700 1 -- 172.21.15.2:0/3263859576 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1530287959 0 0) 0x7f37800035b0 con 0x7f379413dd00 2023-11-26T07:14:52.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.733+0000 7f37927fc700 1 -- 172.21.15.2:0/3263859576 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3794072250 msgr2=0x7f37940cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:52.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.733+0000 7f37927fc700 1 --2- 172.21.15.2:0/3263859576 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3794072250 0x7f37940cc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:52.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.733+0000 7f37927fc700 1 -- 172.21.15.2:0/3263859576 >> v1:172.21.15.192:6789/0 conn(0x7f37940cf970 legacy=0x7f3794071b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:52.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.733+0000 7f37927fc700 1 -- 172.21.15.2:0/3263859576 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f379415e9a0 con 0x7f379413dd00 2023-11-26T07:14:52.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.733+0000 7f37927fc700 1 -- 172.21.15.2:0/3263859576 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f3784001670 con 0x7f379413dd00 2023-11-26T07:14:52.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.733+0000 7f37927fc700 1 -- 172.21.15.2:0/3263859576 >> v1:172.21.15.2:6789/0 conn(0x7f379413dd00 legacy=0x7f37940cff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:52.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.733+0000 7f37927fc700 1 --2- 172.21.15.2:0/3263859576 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3794072250 0x7f3780003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:52.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.733+0000 7f37927fc700 1 --2- 172.21.15.2:0/3263859576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3780003fb0 0x7f3780004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:52.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.733+0000 7f37927fc700 1 --2- 172.21.15.2:0/3263859576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3780004d90 0x7f3780005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:52.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.733+0000 7f37927fc700 1 -- 172.21.15.2:0/3263859576 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37940d0690 con 0x7f3780003fb0 2023-11-26T07:14:52.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.733+0000 7f37927fc700 1 -- 172.21.15.2:0/3263859576 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378000baf0 con 0x7f3780004d90 2023-11-26T07:14:52.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.733+0000 7f37927fc700 1 -- 172.21.15.2:0/3263859576 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f378000dec0 con 0x7f3794072250 2023-11-26T07:14:52.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.733+0000 7f3792ffd700 1 --2- 172.21.15.2:0/3263859576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3780003fb0 0x7f3780004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:52.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.734+0000 7f37937fe700 1 --2- 172.21.15.2:0/3263859576 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3794072250 0x7f3780003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:52.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.734+0000 7f3793fff700 1 --2- 172.21.15.2:0/3263859576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3780004d90 0x7f3780005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:52.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.734+0000 7f3792ffd700 1 -- 172.21.15.2:0/3263859576 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3794072250 msgr2=0x7f3780003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:52.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.734+0000 7f3792ffd700 1 --2- 172.21.15.2:0/3263859576 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3794072250 0x7f3780003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:52.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.734+0000 7f3792ffd700 1 -- 172.21.15.2:0/3263859576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3780004d90 msgr2=0x7f3780005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:52.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.734+0000 7f3792ffd700 1 --2- 172.21.15.2:0/3263859576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3780004d90 0x7f3780005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:52.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.734+0000 7f3792ffd700 1 -- 172.21.15.2:0/3263859576 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37800035b0 con 0x7f3780003fb0 2023-11-26T07:14:52.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.734+0000 7f3793fff700 1 --2- 172.21.15.2:0/3263859576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3780004d90 0x7f3780005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:14:52.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.734+0000 7f3792ffd700 1 --2- 172.21.15.2:0/3263859576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3780003fb0 0x7f3780004850 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f377c0017c0 tx=0x7f3780005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55856858fcf7130c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:52.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.734+0000 7f37927fc700 1 -- 172.21.15.2:0/3263859576 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c0052d0 con 0x7f3780003fb0 2023-11-26T07:14:52.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.734+0000 7f37927fc700 1 -- 172.21.15.2:0/3263859576 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377c005430 con 0x7f3780003fb0 2023-11-26T07:14:52.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.734+0000 7f37927fc700 1 -- 172.21.15.2:0/3263859576 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c0038c0 con 0x7f3780003fb0 2023-11-26T07:14:52.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.734+0000 7f3799dbe700 1 -- 172.21.15.2:0/3263859576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3780003fb0 msgr2=0x7f3780004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:52.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.734+0000 7f3799dbe700 1 --2- 172.21.15.2:0/3263859576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3780003fb0 0x7f3780004850 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f377c0017c0 tx=0x7f3780005880 comp rx=0 tx=0).stop 2023-11-26T07:14:52.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.734+0000 7f3793fff700 1 -- 172.21.15.2:0/3263859576 reap_dead start 2023-11-26T07:14:52.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.735+0000 7f3799dbe700 1 -- 172.21.15.2:0/3263859576 shutdown_connections 2023-11-26T07:14:52.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.735+0000 7f3799dbe700 1 -- 172.21.15.2:0/3263859576 >> 172.21.15.2:0/3263859576 conn(0x7f37940d0b10 msgr2=0x7f37940d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:52.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.735+0000 7f3799dbe700 1 -- 172.21.15.2:0/3263859576 shutdown_connections 2023-11-26T07:14:52.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.735+0000 7f3799dbe700 1 -- 172.21.15.2:0/3263859576 wait complete. 2023-11-26T07:14:52.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.736+0000 7f3799dbe700 1 Processor -- start 2023-11-26T07:14:52.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.736+0000 7f3799dbe700 1 -- start start 2023-11-26T07:14:52.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.737+0000 7f3799dbe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3780003fb0 0x7f379406f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:52.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.737+0000 7f3799dbe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f379413bd50 0x7f3794154230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:52.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.737+0000 7f3799dbe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f379413c1d0 0x7f3794154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:52.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.737+0000 7f3799dbe700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37940c9570 con 0x7f3780003fb0 2023-11-26T07:14:52.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.737+0000 7f3799dbe700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379413c880 con 0x7f379413bd50 2023-11-26T07:14:52.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.737+0000 7f3799dbe700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37940c8960 con 0x7f379413c1d0 2023-11-26T07:14:52.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.737+0000 7f37937fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3780003fb0 0x7f379406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:52.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.737+0000 7f37937fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3780003fb0 0x7f379406f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42612/0 (socket says 172.21.15.2:42612) 2023-11-26T07:14:52.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.737+0000 7f37937fe700 1 -- 172.21.15.2:0/2697257883 learned_addr learned my addr 172.21.15.2:0/2697257883 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:52.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.738+0000 7f37937fe700 1 -- 172.21.15.2:0/2697257883 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f379413c1d0 msgr2=0x7f3794154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:52.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.738+0000 7f37937fe700 1 --2- 172.21.15.2:0/2697257883 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f379413c1d0 0x7f3794154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:52.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.738+0000 7f37937fe700 1 -- 172.21.15.2:0/2697257883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f379413bd50 msgr2=0x7f3794154230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:52.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.738+0000 7f3792ffd700 1 --2- 172.21.15.2:0/2697257883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f379413bd50 0x7f3794154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:52.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.738+0000 7f37937fe700 1 --2- 172.21.15.2:0/2697257883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f379413bd50 0x7f3794154230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:52.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.738+0000 7f37937fe700 1 -- 172.21.15.2:0/2697257883 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37940c8c40 con 0x7f3780003fb0 2023-11-26T07:14:52.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.738+0000 7f37937fe700 1 --2- 172.21.15.2:0/2697257883 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3780003fb0 0x7f379406f080 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f378400e750 tx=0x7f378400eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:52.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.738+0000 7f378bfff700 1 -- 172.21.15.2:0/2697257883 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3784012590 con 0x7f3780003fb0 2023-11-26T07:14:52.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.738+0000 7f378bfff700 1 -- 172.21.15.2:0/2697257883 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3784012710 con 0x7f3780003fb0 2023-11-26T07:14:52.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.738+0000 7f3799dbe700 1 -- 172.21.15.2:0/2697257883 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37940c8f20 con 0x7f3780003fb0 2023-11-26T07:14:52.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.738+0000 7f378bfff700 1 -- 172.21.15.2:0/2697257883 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3784012ac0 con 0x7f3780003fb0 2023-11-26T07:14:52.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.738+0000 7f3799dbe700 1 -- 172.21.15.2:0/2697257883 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f379406f5c0 con 0x7f3780003fb0 2023-11-26T07:14:52.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.739+0000 7f3799dbe700 1 -- 172.21.15.2:0/2697257883 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37940c9850 con 0x7f3780003fb0 2023-11-26T07:14:52.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.740+0000 7f378bfff700 1 -- 172.21.15.2:0/2697257883 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f3784012c20 con 0x7f3780003fb0 2023-11-26T07:14:52.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.740+0000 7f378bfff700 1 --2- 172.21.15.2:0/2697257883 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f377406b470 0x7f377406d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:52.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.740+0000 7f378bfff700 1 -- 172.21.15.2:0/2697257883 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f3784089ed0 con 0x7f3780003fb0 2023-11-26T07:14:52.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.740+0000 7f3792ffd700 1 --2- 172.21.15.2:0/2697257883 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f377406b470 0x7f377406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:52.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.741+0000 7f3792ffd700 1 --2- 172.21.15.2:0/2697257883 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f377406b470 0x7f377406d930 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3794154f60 tx=0x7f377c009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:52.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.745+0000 7f378bfff700 1 -- 172.21.15.2:0/2697257883 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f37840546b0 con 0x7f3780003fb0 2023-11-26T07:14:52.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.944+0000 7f3799dbe700 1 -- 172.21.15.2:0/2697257883 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3794075480 con 0x7f3780003fb0 2023-11-26T07:14:52.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.944+0000 7f378bfff700 1 -- 172.21.15.2:0/2697257883 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v49) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3784012ed0 con 0x7f3780003fb0 2023-11-26T07:14:52.946 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-26T07:14:52.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.946+0000 7f3799dbe700 1 -- 172.21.15.2:0/2697257883 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f377406b470 msgr2=0x7f377406d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:52.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.946+0000 7f3799dbe700 1 --2- 172.21.15.2:0/2697257883 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f377406b470 0x7f377406d930 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3794154f60 tx=0x7f377c009030 comp rx=0 tx=0).stop 2023-11-26T07:14:52.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.946+0000 7f3799dbe700 1 -- 172.21.15.2:0/2697257883 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3780003fb0 msgr2=0x7f379406f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:52.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.946+0000 7f3799dbe700 1 --2- 172.21.15.2:0/2697257883 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3780003fb0 0x7f379406f080 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f378400e750 tx=0x7f378400eb10 comp rx=0 tx=0).stop 2023-11-26T07:14:52.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.946+0000 7f3799dbe700 1 -- 172.21.15.2:0/2697257883 shutdown_connections 2023-11-26T07:14:52.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.946+0000 7f3799dbe700 1 --2- 172.21.15.2:0/2697257883 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f377406b470 0x7f377406d930 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:52.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.946+0000 7f3799dbe700 1 --2- 172.21.15.2:0/2697257883 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f379413c1d0 0x7f3794154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:52.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.946+0000 7f3799dbe700 1 --2- 172.21.15.2:0/2697257883 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3780003fb0 0x7f379406f080 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:52.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.946+0000 7f3799dbe700 1 --2- 172.21.15.2:0/2697257883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f379413bd50 0x7f3794154230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:52.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.946+0000 7f3799dbe700 1 -- 172.21.15.2:0/2697257883 >> 172.21.15.2:0/2697257883 conn(0x7f37940d0b10 msgr2=0x7f37940c5ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:52.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.946+0000 7f3799dbe700 1 -- 172.21.15.2:0/2697257883 shutdown_connections 2023-11-26T07:14:52.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:52.946+0000 7f3799dbe700 1 -- 172.21.15.2:0/2697257883 wait complete. 2023-11-26T07:14:52.960 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:14:53.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.085+0000 7f5008150700 1 Processor -- start 2023-11-26T07:14:53.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.086+0000 7f5008150700 1 -- start start 2023-11-26T07:14:53.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.086+0000 7f5008150700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f500006b620 0x7f50000b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:53.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.086+0000 7f5008150700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f50000b5ab0 0x7f50000b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:53.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.086+0000 7f5008150700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5000071f50 con 0x7f50001478c0 2023-11-26T07:14:53.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.086+0000 7f5008150700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5000072230 con 0x7f500006b620 2023-11-26T07:14:53.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.086+0000 7f5008150700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5000072510 con 0x7f50000b5ab0 2023-11-26T07:14:53.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.087+0000 7f50056eb700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f50000b5ab0 0x7f50000b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:53.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.087+0000 7f5005eec700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f500006b620 0x7f50000b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:53.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.087+0000 7f50056eb700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f50000b5ab0 0x7f50000b3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.2:40700/0 (socket says 172.21.15.2:40700) 2023-11-26T07:14:53.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.087+0000 7f50056eb700 1 -- 172.21.15.2:0/1667752822 learned_addr learned my addr 172.21.15.2:0/1667752822 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:53.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.087+0000 7f5005eec700 1 -- 172.21.15.2:0/1667752822 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f50000b5ab0 msgr2=0x7f50000b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:53.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.087+0000 7f5005eec700 1 --2- 172.21.15.2:0/1667752822 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f50000b5ab0 0x7f50000b3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:53.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.087+0000 7f5005eec700 1 -- 172.21.15.2:0/1667752822 >> v1:172.21.15.192:6789/0 conn(0x7f50001478c0 legacy=0x7f5000161ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:53.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.087+0000 7f5005eec700 1 -- 172.21.15.2:0/1667752822 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50000727f0 con 0x7f500006b620 2023-11-26T07:14:53.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.087+0000 7f5004eea700 1 -- 172.21.15.2:0/1667752822 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 422423867 0 0) 0x7f5000071f50 con 0x7f50001478c0 2023-11-26T07:14:53.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.087+0000 7f50056eb700 1 --2- 172.21.15.2:0/1667752822 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f50000b5ab0 0x7f50000b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:14:53.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.087+0000 7f5005eec700 1 --2- 172.21.15.2:0/1667752822 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f500006b620 0x7f50000b3a40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0009840 tx=0x7f4ff0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f3c8127dd962570 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:53.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.087+0000 7f5004eea700 1 -- 172.21.15.2:0/1667752822 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0011830 con 0x7f500006b620 2023-11-26T07:14:53.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.087+0000 7f5004eea700 1 -- 172.21.15.2:0/1667752822 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff0011990 con 0x7f500006b620 2023-11-26T07:14:53.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.088+0000 7f5004eea700 1 -- 172.21.15.2:0/1667752822 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0011d20 con 0x7f500006b620 2023-11-26T07:14:53.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.088+0000 7f5008150700 1 -- 172.21.15.2:0/1667752822 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f500006b620 msgr2=0x7f50000b3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:53.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.088+0000 7f5008150700 1 --2- 172.21.15.2:0/1667752822 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f500006b620 0x7f50000b3a40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0009840 tx=0x7f4ff0009b50 comp rx=0 tx=0).stop 2023-11-26T07:14:53.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.088+0000 7f5008150700 1 -- 172.21.15.2:0/1667752822 shutdown_connections 2023-11-26T07:14:53.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.088+0000 7f5008150700 1 --2- 172.21.15.2:0/1667752822 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f500006b620 0x7f50000b3a40 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:53.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.088+0000 7f5008150700 1 --2- 172.21.15.2:0/1667752822 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f50000b5ab0 0x7f50000b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:53.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.088+0000 7f5008150700 1 -- 172.21.15.2:0/1667752822 >> 172.21.15.2:0/1667752822 conn(0x7f50000b2740 msgr2=0x7f50000b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:53.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.088+0000 7f5008150700 1 -- 172.21.15.2:0/1667752822 shutdown_connections 2023-11-26T07:14:53.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.088+0000 7f5008150700 1 -- 172.21.15.2:0/1667752822 wait complete. 2023-11-26T07:14:53.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.090+0000 7f5008150700 1 Processor -- start 2023-11-26T07:14:53.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.090+0000 7f5008150700 1 -- start start 2023-11-26T07:14:53.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.091+0000 7f5008150700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f500006b620 0x7f50000ce5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:53.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.091+0000 7f5008150700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f50000b5ab0 0x7f50000cba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:53.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.091+0000 7f5008150700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50001478c0 0x7f50000cbf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:53.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.091+0000 7f5008150700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50000cf020 con 0x7f50001478c0 2023-11-26T07:14:53.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.091+0000 7f5008150700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50000cf300 con 0x7f500006b620 2023-11-26T07:14:53.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.091+0000 7f5008150700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50000c6bd0 con 0x7f50000b5ab0 2023-11-26T07:14:53.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.091+0000 7f50066ed700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50001478c0 0x7f50000cbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:53.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.091+0000 7f50066ed700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50001478c0 0x7f50000cbf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42630/0 (socket says 172.21.15.2:42630) 2023-11-26T07:14:53.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.091+0000 7f50066ed700 1 -- 172.21.15.2:0/1831658991 learned_addr learned my addr 172.21.15.2:0/1831658991 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:53.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.091+0000 7f5005eec700 1 --2- 172.21.15.2:0/1831658991 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f500006b620 0x7f50000ce5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:53.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.091+0000 7f50056eb700 1 --2- 172.21.15.2:0/1831658991 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f50000b5ab0 0x7f50000cba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:53.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.091+0000 7f50066ed700 1 -- 172.21.15.2:0/1831658991 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f50000b5ab0 msgr2=0x7f50000cba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:53.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.091+0000 7f50066ed700 1 --2- 172.21.15.2:0/1831658991 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f50000b5ab0 0x7f50000cba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:53.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.091+0000 7f50066ed700 1 -- 172.21.15.2:0/1831658991 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f500006b620 msgr2=0x7f50000ce5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:53.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.091+0000 7f50066ed700 1 --2- 172.21.15.2:0/1831658991 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f500006b620 0x7f50000ce5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:53.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.091+0000 7f50066ed700 1 -- 172.21.15.2:0/1831658991 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ffc009550 con 0x7f50001478c0 2023-11-26T07:14:53.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.091+0000 7f50066ed700 1 --2- 172.21.15.2:0/1831658991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50001478c0 0x7f50000cbf90 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f4ff800c760 tx=0x7f4ff800ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:53.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.092+0000 7f4ff67fc700 1 -- 172.21.15.2:0/1831658991 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff8003e30 con 0x7f50001478c0 2023-11-26T07:14:53.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.092+0000 7f5008150700 1 -- 172.21.15.2:0/1831658991 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ff00094a0 con 0x7f50001478c0 2023-11-26T07:14:53.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.092+0000 7f4ff67fc700 1 -- 172.21.15.2:0/1831658991 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff8005070 con 0x7f50001478c0 2023-11-26T07:14:53.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.092+0000 7f4ff67fc700 1 -- 172.21.15.2:0/1831658991 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff8005400 con 0x7f50001478c0 2023-11-26T07:14:53.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.092+0000 7f5008150700 1 -- 172.21.15.2:0/1831658991 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50000c7190 con 0x7f50001478c0 2023-11-26T07:14:53.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.093+0000 7f5008150700 1 -- 172.21.15.2:0/1831658991 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5000075480 con 0x7f50001478c0 2023-11-26T07:14:53.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.093+0000 7f4ff67fc700 1 -- 172.21.15.2:0/1831658991 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f4ff8005560 con 0x7f50001478c0 2023-11-26T07:14:53.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.094+0000 7f4ff67fc700 1 --2- 172.21.15.2:0/1831658991 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4fe406b470 0x7f4fe406d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:53.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.094+0000 7f4ff67fc700 1 -- 172.21.15.2:0/1831658991 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f4ff8089c90 con 0x7f50001478c0 2023-11-26T07:14:53.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.094+0000 7f5005eec700 1 --2- 172.21.15.2:0/1831658991 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4fe406b470 0x7f4fe406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:53.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.094+0000 7f5005eec700 1 --2- 172.21.15.2:0/1831658991 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4fe406b470 0x7f4fe406d930 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0009fd0 tx=0x7f4ff0008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:53.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.098+0000 7f4ff67fc700 1 -- 172.21.15.2:0/1831658991 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4ff8054480 con 0x7f50001478c0 2023-11-26T07:14:53.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.297+0000 7f5008150700 1 -- 172.21.15.2:0/1831658991 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f50000c73b0 con 0x7f50001478c0 2023-11-26T07:14:53.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.298+0000 7f4ff67fc700 1 -- 172.21.15.2:0/1831658991 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v49) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4ff8057aa0 con 0x7f50001478c0 2023-11-26T07:14:53.300 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-26T07:14:53.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.300+0000 7f5008150700 1 -- 172.21.15.2:0/1831658991 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4fe406b470 msgr2=0x7f4fe406d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:53.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.300+0000 7f5008150700 1 --2- 172.21.15.2:0/1831658991 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4fe406b470 0x7f4fe406d930 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0009fd0 tx=0x7f4ff0008030 comp rx=0 tx=0).stop 2023-11-26T07:14:53.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.300+0000 7f5008150700 1 -- 172.21.15.2:0/1831658991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50001478c0 msgr2=0x7f50000cbf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:53.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.300+0000 7f5008150700 1 --2- 172.21.15.2:0/1831658991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50001478c0 0x7f50000cbf90 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f4ff800c760 tx=0x7f4ff800ca70 comp rx=0 tx=0).stop 2023-11-26T07:14:53.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.300+0000 7f5008150700 1 -- 172.21.15.2:0/1831658991 shutdown_connections 2023-11-26T07:14:53.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.300+0000 7f5008150700 1 --2- 172.21.15.2:0/1831658991 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4fe406b470 0x7f4fe406d930 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:53.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.300+0000 7f5008150700 1 --2- 172.21.15.2:0/1831658991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50001478c0 0x7f50000cbf90 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:53.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.300+0000 7f5008150700 1 --2- 172.21.15.2:0/1831658991 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f500006b620 0x7f50000ce5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:53.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.300+0000 7f5008150700 1 --2- 172.21.15.2:0/1831658991 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f50000b5ab0 0x7f50000cba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:53.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.300+0000 7f5008150700 1 -- 172.21.15.2:0/1831658991 >> 172.21.15.2:0/1831658991 conn(0x7f50000b2740 msgr2=0x7f5000073f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:53.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.300+0000 7f5008150700 1 -- 172.21.15.2:0/1831658991 shutdown_connections 2023-11-26T07:14:53.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.300+0000 7f5008150700 1 -- 172.21.15.2:0/1831658991 wait complete. 2023-11-26T07:14:53.314 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:14:53.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.436+0000 7f6c8e79f700 1 Processor -- start 2023-11-26T07:14:53.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.437+0000 7f6c8e79f700 1 -- start start 2023-11-26T07:14:53.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.437+0000 7f6c8e79f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6c880cfaa0 0x7f6c8806f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:53.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.437+0000 7f6c8e79f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6c880cd030 0x7f6c880cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:53.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.438+0000 7f6c8e79f700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c8806f7f0 con 0x7f6c88072310 2023-11-26T07:14:53.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.438+0000 7f6c8e79f700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c880ce980 con 0x7f6c880cfaa0 2023-11-26T07:14:53.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.438+0000 7f6c8e79f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c880cec60 con 0x7f6c880cd030 2023-11-26T07:14:53.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.438+0000 7f6c8d79d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6c880cfaa0 0x7f6c8806f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:53.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.438+0000 7f6c8cf9c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f6c88072310 0x7f6c880cfe80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33844/0 (socket says 172.21.15.2:33844) 2023-11-26T07:14:53.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.438+0000 7f6c8cf9c700 1 -- 172.21.15.2:0/1363183882 learned_addr learned my addr 172.21.15.2:0/1363183882 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:14:53.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.438+0000 7f6c8d79d700 1 -- 172.21.15.2:0/1363183882 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6c880cd030 msgr2=0x7f6c880cd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:53.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.438+0000 7f6c8df9e700 1 --2- 172.21.15.2:0/1363183882 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6c880cd030 0x7f6c880cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:53.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.438+0000 7f6c8d79d700 1 --2- 172.21.15.2:0/1363183882 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6c880cd030 0x7f6c880cd4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:53.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.438+0000 7f6c7bfff700 1 -- 172.21.15.2:0/1363183882 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1936924696 0 0) 0x7f6c8806f7f0 con 0x7f6c88072310 2023-11-26T07:14:53.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.438+0000 7f6c8d79d700 1 -- 172.21.15.2:0/1363183882 >> v1:172.21.15.2:6789/0 conn(0x7f6c88072310 legacy=0x7f6c880cfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:53.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.438+0000 7f6c8d79d700 1 -- 172.21.15.2:0/1363183882 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c880cef40 con 0x7f6c880cfaa0 2023-11-26T07:14:53.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.438+0000 7f6c8d79d700 1 --2- 172.21.15.2:0/1363183882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c880cfaa0 0x7f6c8806f150 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f6c84009840 tx=0x7f6c84009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63a2a6c2885b6a2b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:53.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.438+0000 7f6c7bfff700 1 -- 172.21.15.2:0/1363183882 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c84011830 con 0x7f6c880cfaa0 2023-11-26T07:14:53.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.438+0000 7f6c7bfff700 1 -- 172.21.15.2:0/1363183882 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c84011990 con 0x7f6c880cfaa0 2023-11-26T07:14:53.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.438+0000 7f6c7bfff700 1 -- 172.21.15.2:0/1363183882 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c84011d20 con 0x7f6c880cfaa0 2023-11-26T07:14:53.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.439+0000 7f6c8e79f700 1 -- 172.21.15.2:0/1363183882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c880cfaa0 msgr2=0x7f6c8806f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:53.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.439+0000 7f6c8e79f700 1 --2- 172.21.15.2:0/1363183882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c880cfaa0 0x7f6c8806f150 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f6c84009840 tx=0x7f6c84009b50 comp rx=0 tx=0).stop 2023-11-26T07:14:53.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.439+0000 7f6c8e79f700 1 -- 172.21.15.2:0/1363183882 shutdown_connections 2023-11-26T07:14:53.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.439+0000 7f6c8e79f700 1 --2- 172.21.15.2:0/1363183882 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6c880cd030 0x7f6c880cd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:53.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.439+0000 7f6c8e79f700 1 --2- 172.21.15.2:0/1363183882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c880cfaa0 0x7f6c8806f150 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:53.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.439+0000 7f6c8e79f700 1 -- 172.21.15.2:0/1363183882 >> 172.21.15.2:0/1363183882 conn(0x7f6c880b2660 msgr2=0x7f6c880b2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:53.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.439+0000 7f6c8e79f700 1 -- 172.21.15.2:0/1363183882 shutdown_connections 2023-11-26T07:14:53.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.439+0000 7f6c8e79f700 1 -- 172.21.15.2:0/1363183882 wait complete. 2023-11-26T07:14:53.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.441+0000 7f6c8e79f700 1 Processor -- start 2023-11-26T07:14:53.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.441+0000 7f6c8e79f700 1 -- start start 2023-11-26T07:14:53.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.442+0000 7f6c8e79f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6c88072310 0x7f6c880cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:53.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.442+0000 7f6c8e79f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6c880cd030 0x7f6c880ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:53.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.442+0000 7f6c8e79f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c880cfaa0 0x7f6c8814a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:53.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.442+0000 7f6c8e79f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c880cc830 con 0x7f6c880cfaa0 2023-11-26T07:14:53.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.442+0000 7f6c8e79f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c881f46a0 con 0x7f6c880cd030 2023-11-26T07:14:53.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.442+0000 7f6c8e79f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c881f4980 con 0x7f6c88072310 2023-11-26T07:14:53.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.442+0000 7f6c8df9e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c880cfaa0 0x7f6c8814a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:53.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.442+0000 7f6c8df9e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c880cfaa0 0x7f6c8814a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42642/0 (socket says 172.21.15.2:42642) 2023-11-26T07:14:53.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.442+0000 7f6c8df9e700 1 -- 172.21.15.2:0/593125639 learned_addr learned my addr 172.21.15.2:0/593125639 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:53.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.442+0000 7f6c8d79d700 1 --2- 172.21.15.2:0/593125639 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6c88072310 0x7f6c880cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:53.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.442+0000 7f6c8cf9c700 1 --2- 172.21.15.2:0/593125639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6c880cd030 0x7f6c880ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:53.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.442+0000 7f6c8df9e700 1 -- 172.21.15.2:0/593125639 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6c88072310 msgr2=0x7f6c880cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:53.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.442+0000 7f6c8df9e700 1 --2- 172.21.15.2:0/593125639 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6c88072310 0x7f6c880cc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:53.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.442+0000 7f6c8df9e700 1 -- 172.21.15.2:0/593125639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6c880cd030 msgr2=0x7f6c880ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:53.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.442+0000 7f6c8df9e700 1 --2- 172.21.15.2:0/593125639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6c880cd030 0x7f6c880ca4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:53.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.442+0000 7f6c8df9e700 1 -- 172.21.15.2:0/593125639 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c840094a0 con 0x7f6c880cfaa0 2023-11-26T07:14:53.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.442+0000 7f6c8d79d700 1 --2- 172.21.15.2:0/593125639 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6c88072310 0x7f6c880cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:14:53.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.442+0000 7f6c8df9e700 1 --2- 172.21.15.2:0/593125639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c880cfaa0 0x7f6c8814a600 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f6c8000cd70 tx=0x7f6c8000a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:53.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.442+0000 7f6c79ffb700 1 -- 172.21.15.2:0/593125639 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c80003a20 con 0x7f6c880cfaa0 2023-11-26T07:14:53.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.442+0000 7f6c79ffb700 1 -- 172.21.15.2:0/593125639 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c80003b80 con 0x7f6c880cfaa0 2023-11-26T07:14:53.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.442+0000 7f6c8e79f700 1 -- 172.21.15.2:0/593125639 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c881f4c60 con 0x7f6c880cfaa0 2023-11-26T07:14:53.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.442+0000 7f6c79ffb700 1 -- 172.21.15.2:0/593125639 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c80004020 con 0x7f6c880cfaa0 2023-11-26T07:14:53.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.443+0000 7f6c8e79f700 1 -- 172.21.15.2:0/593125639 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c8814c730 con 0x7f6c880cfaa0 2023-11-26T07:14:53.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.444+0000 7f6c8e79f700 1 -- 172.21.15.2:0/593125639 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c8814c8f0 con 0x7f6c880cfaa0 2023-11-26T07:14:53.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.444+0000 7f6c79ffb700 1 -- 172.21.15.2:0/593125639 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f6c80004180 con 0x7f6c880cfaa0 2023-11-26T07:14:53.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.444+0000 7f6c79ffb700 1 --2- 172.21.15.2:0/593125639 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6c6c06b470 0x7f6c6c06d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:53.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.444+0000 7f6c79ffb700 1 -- 172.21.15.2:0/593125639 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f6c8008c620 con 0x7f6c880cfaa0 2023-11-26T07:14:53.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.445+0000 7f6c8d79d700 1 --2- 172.21.15.2:0/593125639 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6c6c06b470 0x7f6c6c06d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:53.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.445+0000 7f6c8d79d700 1 --2- 172.21.15.2:0/593125639 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6c6c06b470 0x7f6c6c06d930 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6c840090b0 tx=0x7f6c84008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:53.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.449+0000 7f6c79ffb700 1 -- 172.21.15.2:0/593125639 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6c80056e80 con 0x7f6c880cfaa0 2023-11-26T07:14:53.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.697+0000 7f6c8e79f700 1 -- 172.21.15.2:0/593125639 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c88075300 con 0x7f6c880cfaa0 2023-11-26T07:14:53.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.697+0000 7f6c79ffb700 1 -- 172.21.15.2:0/593125639 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f6c8005a4a0 con 0x7f6c880cfaa0 2023-11-26T07:14:53.699 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:14:53.699 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5051,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2052180749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":2052180749},{"type":"v1","addr":"172.21.15.2:6835","nonce":2052180749}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/1795687093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1795687093},{"type":"v1","addr":"172.21.15.2:6834","nonce":1795687093}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5646,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2009465289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2009465289},{"type":"v1","addr":"172.21.15.192:6837","nonce":2009465289}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:13:53.741450+0000","modified":"2023-11-26T07:13:56.778566+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5649},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5649":{"gid":5649,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6836/2352660671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2352660671},{"type":"v1","addr":"172.21.15.192:6836","nonce":2352660671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-26T07:14:53.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.700+0000 7f6c8e79f700 1 -- 172.21.15.2:0/593125639 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6c6c06b470 msgr2=0x7f6c6c06d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:53.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.700+0000 7f6c8e79f700 1 --2- 172.21.15.2:0/593125639 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6c6c06b470 0x7f6c6c06d930 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6c840090b0 tx=0x7f6c84008030 comp rx=0 tx=0).stop 2023-11-26T07:14:53.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.700+0000 7f6c8e79f700 1 -- 172.21.15.2:0/593125639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c880cfaa0 msgr2=0x7f6c8814a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:53.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.700+0000 7f6c8e79f700 1 --2- 172.21.15.2:0/593125639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c880cfaa0 0x7f6c8814a600 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f6c8000cd70 tx=0x7f6c8000a570 comp rx=0 tx=0).stop 2023-11-26T07:14:53.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.700+0000 7f6c8e79f700 1 -- 172.21.15.2:0/593125639 shutdown_connections 2023-11-26T07:14:53.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.700+0000 7f6c8e79f700 1 --2- 172.21.15.2:0/593125639 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6c6c06b470 0x7f6c6c06d930 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:53.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.700+0000 7f6c8e79f700 1 --2- 172.21.15.2:0/593125639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c880cfaa0 0x7f6c8814a600 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:53.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.700+0000 7f6c8e79f700 1 --2- 172.21.15.2:0/593125639 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6c88072310 0x7f6c880cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:53.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.700+0000 7f6c8e79f700 1 --2- 172.21.15.2:0/593125639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6c880cd030 0x7f6c880ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:53.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.700+0000 7f6c8e79f700 1 -- 172.21.15.2:0/593125639 >> 172.21.15.2:0/593125639 conn(0x7f6c880b2660 msgr2=0x7f6c88071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:53.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.700+0000 7f6c8e79f700 1 -- 172.21.15.2:0/593125639 shutdown_connections 2023-11-26T07:14:53.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.700+0000 7f6c8e79f700 1 -- 172.21.15.2:0/593125639 wait complete. 2023-11-26T07:14:53.703 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 27 2023-11-26T07:14:53.714 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:14:53.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.837+0000 7f6356133700 1 Processor -- start 2023-11-26T07:14:53.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.837+0000 7f6356133700 1 -- start start 2023-11-26T07:14:53.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.837+0000 7f6356133700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f635015bde0 0x7f635015c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:53.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.837+0000 7f6356133700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63500cf2b0 0x7f63500d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:53.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.837+0000 7f6356133700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f63500ce5c0 0x7f63500cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:53.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.837+0000 7f6356133700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63500cefb0 con 0x7f63500ce5c0 2023-11-26T07:14:53.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.837+0000 7f6356133700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63500d0a90 con 0x7f635015bde0 2023-11-26T07:14:53.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.837+0000 7f6356133700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f635006ee10 con 0x7f63500cf2b0 2023-11-26T07:14:53.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.838+0000 7f634ffff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f63500ce5c0 0x7f63500cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:53.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.838+0000 7f634ffff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f63500ce5c0 0x7f63500cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42650/0 (socket says 172.21.15.2:42650) 2023-11-26T07:14:53.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.838+0000 7f634ffff700 1 -- 172.21.15.2:0/1556685105 learned_addr learned my addr 172.21.15.2:0/1556685105 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:53.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.838+0000 7f634f7fe700 1 --2- 172.21.15.2:0/1556685105 >> v2:172.21.15.192:3300/0 conn(0x7f635015bde0 0x7f635015c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:53.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.838+0000 7f634effd700 1 --2- 172.21.15.2:0/1556685105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63500cf2b0 0x7f63500d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:53.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.838+0000 7f634ffff700 1 -- 172.21.15.2:0/1556685105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63500cf2b0 msgr2=0x7f63500d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:53.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.838+0000 7f634ffff700 1 --2- 172.21.15.2:0/1556685105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63500cf2b0 0x7f63500d01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:53.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.838+0000 7f634ffff700 1 -- 172.21.15.2:0/1556685105 >> v2:172.21.15.192:3300/0 conn(0x7f635015bde0 msgr2=0x7f635015c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:53.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.838+0000 7f634ffff700 1 --2- 172.21.15.2:0/1556685105 >> v2:172.21.15.192:3300/0 conn(0x7f635015bde0 0x7f635015c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:53.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.838+0000 7f634ffff700 1 -- 172.21.15.2:0/1556685105 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f635006f0f0 con 0x7f63500ce5c0 2023-11-26T07:14:53.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.838+0000 7f634f7fe700 1 --2- 172.21.15.2:0/1556685105 >> v2:172.21.15.192:3300/0 conn(0x7f635015bde0 0x7f635015c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:14:53.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.838+0000 7f634ffff700 1 --2- 172.21.15.2:0/1556685105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63500ce5c0 0x7f63500cea70 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f6350072370 tx=0x7f634800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5aaceb9eb2cbde5 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:53.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.838+0000 7f634e7fc700 1 -- 172.21.15.2:0/1556685105 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634800e070 con 0x7f63500ce5c0 2023-11-26T07:14:53.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.838+0000 7f634e7fc700 1 -- 172.21.15.2:0/1556685105 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f634800b9c0 con 0x7f63500ce5c0 2023-11-26T07:14:53.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.838+0000 7f634e7fc700 1 -- 172.21.15.2:0/1556685105 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634800bd70 con 0x7f63500ce5c0 2023-11-26T07:14:53.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.839+0000 7f6356133700 1 -- 172.21.15.2:0/1556685105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63500ce5c0 msgr2=0x7f63500cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:53.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.839+0000 7f6356133700 1 --2- 172.21.15.2:0/1556685105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63500ce5c0 0x7f63500cea70 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f6350072370 tx=0x7f634800b330 comp rx=0 tx=0).stop 2023-11-26T07:14:53.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.839+0000 7f6356133700 1 -- 172.21.15.2:0/1556685105 shutdown_connections 2023-11-26T07:14:53.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.839+0000 7f6356133700 1 --2- 172.21.15.2:0/1556685105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63500ce5c0 0x7f63500cea70 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:53.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.839+0000 7f6356133700 1 --2- 172.21.15.2:0/1556685105 >> v2:172.21.15.192:3300/0 conn(0x7f635015bde0 0x7f635015c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:53.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.839+0000 7f6356133700 1 --2- 172.21.15.2:0/1556685105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63500cf2b0 0x7f63500d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:53.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.839+0000 7f6356133700 1 -- 172.21.15.2:0/1556685105 >> 172.21.15.2:0/1556685105 conn(0x7f63500b3720 msgr2=0x7f63500b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:53.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.839+0000 7f6356133700 1 -- 172.21.15.2:0/1556685105 shutdown_connections 2023-11-26T07:14:53.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.839+0000 7f6356133700 1 -- 172.21.15.2:0/1556685105 wait complete. 2023-11-26T07:14:53.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.840+0000 7f6356133700 1 Processor -- start 2023-11-26T07:14:53.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.840+0000 7f6356133700 1 -- start start 2023-11-26T07:14:53.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.841+0000 7f6356133700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63500ce5c0 0x7f63500b7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:53.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.841+0000 7f6356133700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63500cf2b0 0x7f63500c81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:53.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.841+0000 7f6356133700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f635015bde0 0x7f635015dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:53.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.841+0000 7f6356133700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f635015e0f0 con 0x7f635015bde0 2023-11-26T07:14:53.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.841+0000 7f6356133700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63500b71e0 con 0x7f63500cf2b0 2023-11-26T07:14:53.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.841+0000 7f6356133700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63500b65d0 con 0x7f63500ce5c0 2023-11-26T07:14:53.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.841+0000 7f634ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f635015bde0 0x7f635015dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:53.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.841+0000 7f634ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f635015bde0 0x7f635015dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42656/0 (socket says 172.21.15.2:42656) 2023-11-26T07:14:53.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.841+0000 7f634ffff700 1 -- 172.21.15.2:0/1736290978 learned_addr learned my addr 172.21.15.2:0/1736290978 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:53.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.841+0000 7f634ffff700 1 -- 172.21.15.2:0/1736290978 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63500ce5c0 msgr2=0x7f63500b7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:53.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.841+0000 7f634ffff700 1 --2- 172.21.15.2:0/1736290978 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63500ce5c0 0x7f63500b7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:53.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.841+0000 7f634ffff700 1 -- 172.21.15.2:0/1736290978 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63500cf2b0 msgr2=0x7f63500c81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:53.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.841+0000 7f634ffff700 1 --2- 172.21.15.2:0/1736290978 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63500cf2b0 0x7f63500c81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:53.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.841+0000 7f634ffff700 1 -- 172.21.15.2:0/1736290978 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6348009b30 con 0x7f635015bde0 2023-11-26T07:14:53.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.841+0000 7f634ffff700 1 --2- 172.21.15.2:0/1736290978 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f635015bde0 0x7f635015dbb0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f6350072340 tx=0x7f6348004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:53.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.842+0000 7f6337fff700 1 -- 172.21.15.2:0/1736290978 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6348004250 con 0x7f635015bde0 2023-11-26T07:14:53.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.842+0000 7f6337fff700 1 -- 172.21.15.2:0/1736290978 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63480043d0 con 0x7f635015bde0 2023-11-26T07:14:53.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.842+0000 7f6356133700 1 -- 172.21.15.2:0/1736290978 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63500b68b0 con 0x7f635015bde0 2023-11-26T07:14:53.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.842+0000 7f6337fff700 1 -- 172.21.15.2:0/1736290978 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6348004780 con 0x7f635015bde0 2023-11-26T07:14:53.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.842+0000 7f6356133700 1 -- 172.21.15.2:0/1736290978 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63500b6e70 con 0x7f635015bde0 2023-11-26T07:14:53.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.843+0000 7f6356133700 1 -- 172.21.15.2:0/1736290978 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6350068670 con 0x7f635015bde0 2023-11-26T07:14:53.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.843+0000 7f6337fff700 1 -- 172.21.15.2:0/1736290978 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f634801c440 con 0x7f635015bde0 2023-11-26T07:14:53.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.844+0000 7f6337fff700 1 --2- 172.21.15.2:0/1736290978 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f633c06b470 0x7f633c06d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:53.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.844+0000 7f6337fff700 1 -- 172.21.15.2:0/1736290978 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f634808ba20 con 0x7f635015bde0 2023-11-26T07:14:53.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.844+0000 7f634f7fe700 1 --2- 172.21.15.2:0/1736290978 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f633c06b470 0x7f633c06d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:53.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.844+0000 7f634f7fe700 1 --2- 172.21.15.2:0/1736290978 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f633c06b470 0x7f633c06d930 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f63400098f0 tx=0x7f6340008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:53.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:53.848+0000 7f6337fff700 1 -- 172.21.15.2:0/1736290978 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6348056180 con 0x7f635015bde0 2023-11-26T07:14:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.049+0000 7f6356133700 1 -- 172.21.15.2:0/1736290978 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6350070730 con 0x7f635015bde0 2023-11-26T07:14:54.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.050+0000 7f6337fff700 1 -- 172.21.15.2:0/1736290978 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16626 (secure 0 0 0) 0x7f6348020090 con 0x7f635015bde0 2023-11-26T07:14:54.053 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:14:54.053 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":49,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:14:51.238862+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:13:52.197275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-26T07:13:52.705487+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":48,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2e","mappings":[{"from":0,"to":5}]},{"pgid":"7.3e","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:14:54.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.052+0000 7f6356133700 1 -- 172.21.15.2:0/1736290978 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f633c06b470 msgr2=0x7f633c06d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:54.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.052+0000 7f6356133700 1 --2- 172.21.15.2:0/1736290978 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f633c06b470 0x7f633c06d930 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f63400098f0 tx=0x7f6340008040 comp rx=0 tx=0).stop 2023-11-26T07:14:54.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.052+0000 7f6356133700 1 -- 172.21.15.2:0/1736290978 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f635015bde0 msgr2=0x7f635015dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:54.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.052+0000 7f6356133700 1 --2- 172.21.15.2:0/1736290978 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f635015bde0 0x7f635015dbb0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f6350072340 tx=0x7f6348004ad0 comp rx=0 tx=0).stop 2023-11-26T07:14:54.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.053+0000 7f6356133700 1 -- 172.21.15.2:0/1736290978 shutdown_connections 2023-11-26T07:14:54.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.053+0000 7f6356133700 1 --2- 172.21.15.2:0/1736290978 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f633c06b470 0x7f633c06d930 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:54.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.053+0000 7f6356133700 1 --2- 172.21.15.2:0/1736290978 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f635015bde0 0x7f635015dbb0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:54.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.053+0000 7f6356133700 1 --2- 172.21.15.2:0/1736290978 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63500ce5c0 0x7f63500b7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:54.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.053+0000 7f6356133700 1 --2- 172.21.15.2:0/1736290978 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63500cf2b0 0x7f63500c81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:54.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.053+0000 7f6356133700 1 -- 172.21.15.2:0/1736290978 >> 172.21.15.2:0/1736290978 conn(0x7f63500b3720 msgr2=0x7f63500b2920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:54.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.053+0000 7f6356133700 1 -- 172.21.15.2:0/1736290978 shutdown_connections 2023-11-26T07:14:54.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.053+0000 7f6356133700 1 -- 172.21.15.2:0/1736290978 wait complete. 2023-11-26T07:14:54.067 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-26T07:14:54.067 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:14:54.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.189+0000 7f40ebd7b700 1 Processor -- start 2023-11-26T07:14:54.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.189+0000 7f40ebd7b700 1 -- start start 2023-11-26T07:14:54.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.190+0000 7f40ebd7b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f40e4143ae0 0x7f40e40b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:54.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.190+0000 7f40ebd7b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40e40722c0 0x7f40e406e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:54.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.190+0000 7f40ebd7b700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40e4143ec0 con 0x7f40e41440f0 2023-11-26T07:14:54.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.190+0000 7f40ebd7b700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e40b40a0 con 0x7f40e4143ae0 2023-11-26T07:14:54.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.190+0000 7f40ebd7b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e40b3ae0 con 0x7f40e40722c0 2023-11-26T07:14:54.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.190+0000 7f40e9b17700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f40e4143ae0 0x7f40e40b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:54.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.190+0000 7f40e9316700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f40e41440f0 0x7f40e4071bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33870/0 (socket says 172.21.15.2:33870) 2023-11-26T07:14:54.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.190+0000 7f40e9316700 1 -- 172.21.15.2:0/772520823 learned_addr learned my addr 172.21.15.2:0/772520823 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:14:54.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.191+0000 7f40ea318700 1 --2- 172.21.15.2:0/772520823 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40e40722c0 0x7f40e406e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:54.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.191+0000 7f40e9b17700 1 -- 172.21.15.2:0/772520823 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40e40722c0 msgr2=0x7f40e406e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:54.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.191+0000 7f40e9b17700 1 --2- 172.21.15.2:0/772520823 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40e40722c0 0x7f40e406e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:54.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.191+0000 7f40e9b17700 1 -- 172.21.15.2:0/772520823 >> v1:172.21.15.2:6789/0 conn(0x7f40e41440f0 legacy=0x7f40e4071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:54.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.191+0000 7f40e9b17700 1 -- 172.21.15.2:0/772520823 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e40b3dc0 con 0x7f40e4143ae0 2023-11-26T07:14:54.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.191+0000 7f40e8b15700 1 -- 172.21.15.2:0/772520823 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3688554912 0 0) 0x7f40e4143ec0 con 0x7f40e41440f0 2023-11-26T07:14:54.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.191+0000 7f40ea318700 1 --2- 172.21.15.2:0/772520823 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40e40722c0 0x7f40e406e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:14:54.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.191+0000 7f40e9b17700 1 --2- 172.21.15.2:0/772520823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40e4143ae0 0x7f40e40b51b0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f40d4009840 tx=0x7f40d4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e97f4988216f9af5 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:54.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.191+0000 7f40e8b15700 1 -- 172.21.15.2:0/772520823 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d4011830 con 0x7f40e4143ae0 2023-11-26T07:14:54.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.191+0000 7f40e8b15700 1 -- 172.21.15.2:0/772520823 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d4011990 con 0x7f40e4143ae0 2023-11-26T07:14:54.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.191+0000 7f40e8b15700 1 -- 172.21.15.2:0/772520823 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d4011d20 con 0x7f40e4143ae0 2023-11-26T07:14:54.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.192+0000 7f40ebd7b700 1 -- 172.21.15.2:0/772520823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40e4143ae0 msgr2=0x7f40e40b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:54.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.192+0000 7f40ebd7b700 1 --2- 172.21.15.2:0/772520823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40e4143ae0 0x7f40e40b51b0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f40d4009840 tx=0x7f40d4009b50 comp rx=0 tx=0).stop 2023-11-26T07:14:54.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.192+0000 7f40ebd7b700 1 -- 172.21.15.2:0/772520823 shutdown_connections 2023-11-26T07:14:54.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.192+0000 7f40ebd7b700 1 --2- 172.21.15.2:0/772520823 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40e40722c0 0x7f40e406e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:54.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.192+0000 7f40ebd7b700 1 --2- 172.21.15.2:0/772520823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40e4143ae0 0x7f40e40b51b0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:54.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.192+0000 7f40ebd7b700 1 -- 172.21.15.2:0/772520823 >> 172.21.15.2:0/772520823 conn(0x7f40e40b2740 msgr2=0x7f40e40b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:54.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.192+0000 7f40ebd7b700 1 -- 172.21.15.2:0/772520823 shutdown_connections 2023-11-26T07:14:54.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.192+0000 7f40ebd7b700 1 -- 172.21.15.2:0/772520823 wait complete. 2023-11-26T07:14:54.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.193+0000 7f40ebd7b700 1 Processor -- start 2023-11-26T07:14:54.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.193+0000 7f40ebd7b700 1 -- start start 2023-11-26T07:14:54.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.194+0000 7f40ebd7b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40e40722c0 0x7f40e40c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:54.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.194+0000 7f40ebd7b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40e4143ae0 0x7f40e413f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:54.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.194+0000 7f40ebd7b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40e41440f0 0x7f40e4153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:54.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.194+0000 7f40ebd7b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e413fb20 con 0x7f40e40722c0 2023-11-26T07:14:54.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.194+0000 7f40ebd7b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e4153970 con 0x7f40e41440f0 2023-11-26T07:14:54.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.194+0000 7f40ebd7b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e40ca3a0 con 0x7f40e4143ae0 2023-11-26T07:14:54.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.194+0000 7f40e9b17700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40e40722c0 0x7f40e40c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:54.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.194+0000 7f40e9b17700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40e40722c0 0x7f40e40c9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42666/0 (socket says 172.21.15.2:42666) 2023-11-26T07:14:54.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.194+0000 7f40e9b17700 1 -- 172.21.15.2:0/3933449819 learned_addr learned my addr 172.21.15.2:0/3933449819 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:54.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.194+0000 7f40e9316700 1 --2- 172.21.15.2:0/3933449819 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40e4143ae0 0x7f40e413f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:54.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.194+0000 7f40ea318700 1 --2- 172.21.15.2:0/3933449819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40e41440f0 0x7f40e4153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:54.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.194+0000 7f40e9b17700 1 -- 172.21.15.2:0/3933449819 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40e4143ae0 msgr2=0x7f40e413f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:54.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.194+0000 7f40e9b17700 1 --2- 172.21.15.2:0/3933449819 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40e4143ae0 0x7f40e413f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:54.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.194+0000 7f40e9b17700 1 -- 172.21.15.2:0/3933449819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40e41440f0 msgr2=0x7f40e4153430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:54.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.194+0000 7f40e9b17700 1 --2- 172.21.15.2:0/3933449819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40e41440f0 0x7f40e4153430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:54.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.194+0000 7f40e9b17700 1 -- 172.21.15.2:0/3933449819 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d40094a0 con 0x7f40e40722c0 2023-11-26T07:14:54.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.194+0000 7f40ea318700 1 --2- 172.21.15.2:0/3933449819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40e41440f0 0x7f40e4153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:14:54.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.194+0000 7f40e9b17700 1 --2- 172.21.15.2:0/3933449819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40e40722c0 0x7f40e40c9dc0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f40d4000c00 tx=0x7f40d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:54.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.194+0000 7f40da7fc700 1 -- 172.21.15.2:0/3933449819 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d40036a0 con 0x7f40e40722c0 2023-11-26T07:14:54.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.195+0000 7f40da7fc700 1 -- 172.21.15.2:0/3933449819 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d401f070 con 0x7f40e40722c0 2023-11-26T07:14:54.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.195+0000 7f40ebd7b700 1 -- 172.21.15.2:0/3933449819 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40e40ca680 con 0x7f40e40722c0 2023-11-26T07:14:54.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.195+0000 7f40da7fc700 1 -- 172.21.15.2:0/3933449819 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d4003a40 con 0x7f40e40722c0 2023-11-26T07:14:54.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.195+0000 7f40ebd7b700 1 -- 172.21.15.2:0/3933449819 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e40cac40 con 0x7f40e40722c0 2023-11-26T07:14:54.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.195+0000 7f40ebd7b700 1 -- 172.21.15.2:0/3933449819 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40e40cd8d0 con 0x7f40e40722c0 2023-11-26T07:14:54.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.196+0000 7f40da7fc700 1 -- 172.21.15.2:0/3933449819 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f40d4003ba0 con 0x7f40e40722c0 2023-11-26T07:14:54.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.196+0000 7f40da7fc700 1 --2- 172.21.15.2:0/3933449819 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f40c806b470 0x7f40c806d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:54.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.196+0000 7f40da7fc700 1 -- 172.21.15.2:0/3933449819 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f40d4021070 con 0x7f40e40722c0 2023-11-26T07:14:54.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.197+0000 7f40e9316700 1 --2- 172.21.15.2:0/3933449819 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f40c806b470 0x7f40c806d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:54.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.197+0000 7f40e9316700 1 --2- 172.21.15.2:0/3933449819 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f40c806b470 0x7f40c806d930 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f40e406c0b0 tx=0x7f40e0007e70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:54.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.201+0000 7f40da7fc700 1 -- 172.21.15.2:0/3933449819 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f40d40562b0 con 0x7f40e40722c0 2023-11-26T07:14:54.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.446+0000 7f40ebd7b700 1 -- 172.21.15.2:0/3933449819 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40e4068670 con 0x7f40e40722c0 2023-11-26T07:14:54.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.447+0000 7f40da7fc700 1 -- 172.21.15.2:0/3933449819 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f40d4015090 con 0x7f40e40722c0 2023-11-26T07:14:54.449 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:14:54.449 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5051,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2052180749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":2052180749},{"type":"v1","addr":"172.21.15.2:6835","nonce":2052180749}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/1795687093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1795687093},{"type":"v1","addr":"172.21.15.2:6834","nonce":1795687093}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5646,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2009465289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2009465289},{"type":"v1","addr":"172.21.15.192:6837","nonce":2009465289}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:13:53.741450+0000","modified":"2023-11-26T07:13:56.778566+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5649},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5649":{"gid":5649,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6836/2352660671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2352660671},{"type":"v1","addr":"172.21.15.192:6836","nonce":2352660671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-26T07:14:54.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.449+0000 7f40ebd7b700 1 -- 172.21.15.2:0/3933449819 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f40c806b470 msgr2=0x7f40c806d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:54.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.449+0000 7f40ebd7b700 1 --2- 172.21.15.2:0/3933449819 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f40c806b470 0x7f40c806d930 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f40e406c0b0 tx=0x7f40e0007e70 comp rx=0 tx=0).stop 2023-11-26T07:14:54.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.449+0000 7f40ebd7b700 1 -- 172.21.15.2:0/3933449819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40e40722c0 msgr2=0x7f40e40c9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:54.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.449+0000 7f40ebd7b700 1 --2- 172.21.15.2:0/3933449819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40e40722c0 0x7f40e40c9dc0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f40d4000c00 tx=0x7f40d4004750 comp rx=0 tx=0).stop 2023-11-26T07:14:54.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.449+0000 7f40ebd7b700 1 -- 172.21.15.2:0/3933449819 shutdown_connections 2023-11-26T07:14:54.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.449+0000 7f40ebd7b700 1 --2- 172.21.15.2:0/3933449819 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f40c806b470 0x7f40c806d930 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:54.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.449+0000 7f40ebd7b700 1 --2- 172.21.15.2:0/3933449819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40e41440f0 0x7f40e4153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:54.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.449+0000 7f40ebd7b700 1 --2- 172.21.15.2:0/3933449819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40e40722c0 0x7f40e40c9dc0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:54.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.449+0000 7f40ebd7b700 1 --2- 172.21.15.2:0/3933449819 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40e4143ae0 0x7f40e413f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:54.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.449+0000 7f40ebd7b700 1 -- 172.21.15.2:0/3933449819 >> 172.21.15.2:0/3933449819 conn(0x7f40e40b2740 msgr2=0x7f40e406ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:54.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.449+0000 7f40ebd7b700 1 -- 172.21.15.2:0/3933449819 shutdown_connections 2023-11-26T07:14:54.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.449+0000 7f40ebd7b700 1 -- 172.21.15.2:0/3933449819 wait complete. 2023-11-26T07:14:54.452 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 27 2023-11-26T07:14:54.463 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:14:54.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.586+0000 7f91cd0b9700 1 Processor -- start 2023-11-26T07:14:54.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.586+0000 7f91cd0b9700 1 -- start start 2023-11-26T07:14:54.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.587+0000 7f91cd0b9700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f91c81475d0 0x7f91c80d0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:54.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.587+0000 7f91cd0b9700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f91c806b6e0 0x7f91c806e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:54.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.587+0000 7f91cd0b9700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91c81479b0 con 0x7f91c80d0cb0 2023-11-26T07:14:54.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.587+0000 7f91cd0b9700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91c80d11c0 con 0x7f91c806b6e0 2023-11-26T07:14:54.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.587+0000 7f91cd0b9700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91c80d14a0 con 0x7f91c81475d0 2023-11-26T07:14:54.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.587+0000 7f91c759e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f91c806b6e0 0x7f91c806e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:54.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.587+0000 7f91c659c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f91c80d0cb0 0x7f91c806afd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33884/0 (socket says 172.21.15.2:33884) 2023-11-26T07:14:54.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.587+0000 7f91c659c700 1 -- 172.21.15.2:0/4018408372 learned_addr learned my addr 172.21.15.2:0/4018408372 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:14:54.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.588+0000 7f91c6d9d700 1 --2- 172.21.15.2:0/4018408372 >> v2:172.21.15.192:3300/0 conn(0x7f91c81475d0 0x7f91c80d0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:54.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.588+0000 7f91c759e700 1 -- 172.21.15.2:0/4018408372 >> v2:172.21.15.192:3300/0 conn(0x7f91c81475d0 msgr2=0x7f91c80d0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:54.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.588+0000 7f91c759e700 1 --2- 172.21.15.2:0/4018408372 >> v2:172.21.15.192:3300/0 conn(0x7f91c81475d0 0x7f91c80d0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:54.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.588+0000 7f91c759e700 1 -- 172.21.15.2:0/4018408372 >> v1:172.21.15.2:6789/0 conn(0x7f91c80d0cb0 legacy=0x7f91c806afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:54.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.588+0000 7f91c759e700 1 -- 172.21.15.2:0/4018408372 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c80d1780 con 0x7f91c806b6e0 2023-11-26T07:14:54.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.588+0000 7f91c5d9b700 1 -- 172.21.15.2:0/4018408372 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4259778541 0 0) 0x7f91c81479b0 con 0x7f91c80d0cb0 2023-11-26T07:14:54.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.588+0000 7f91c759e700 1 --2- 172.21.15.2:0/4018408372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91c806b6e0 0x7f91c806e360 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f91c806bcb0 tx=0x7f91c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46ee5a817937bd4a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:54.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.588+0000 7f91c5d9b700 1 -- 172.21.15.2:0/4018408372 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c000e070 con 0x7f91c806b6e0 2023-11-26T07:14:54.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.588+0000 7f91c5d9b700 1 -- 172.21.15.2:0/4018408372 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c000bbd0 con 0x7f91c806b6e0 2023-11-26T07:14:54.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.588+0000 7f91c5d9b700 1 -- 172.21.15.2:0/4018408372 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c0012430 con 0x7f91c806b6e0 2023-11-26T07:14:54.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.588+0000 7f91cd0b9700 1 -- 172.21.15.2:0/4018408372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91c806b6e0 msgr2=0x7f91c806e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:54.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.588+0000 7f91cd0b9700 1 --2- 172.21.15.2:0/4018408372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91c806b6e0 0x7f91c806e360 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f91c806bcb0 tx=0x7f91c000b330 comp rx=0 tx=0).stop 2023-11-26T07:14:54.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.588+0000 7f91cd0b9700 1 -- 172.21.15.2:0/4018408372 shutdown_connections 2023-11-26T07:14:54.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.588+0000 7f91cd0b9700 1 --2- 172.21.15.2:0/4018408372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91c806b6e0 0x7f91c806e360 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:54.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.589+0000 7f91cd0b9700 1 --2- 172.21.15.2:0/4018408372 >> v2:172.21.15.192:3300/0 conn(0x7f91c81475d0 0x7f91c80d0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:54.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.589+0000 7f91cd0b9700 1 -- 172.21.15.2:0/4018408372 >> 172.21.15.2:0/4018408372 conn(0x7f91c806c0e0 msgr2=0x7f91c806c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:54.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.589+0000 7f91cd0b9700 1 -- 172.21.15.2:0/4018408372 shutdown_connections 2023-11-26T07:14:54.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.589+0000 7f91cd0b9700 1 -- 172.21.15.2:0/4018408372 wait complete. 2023-11-26T07:14:54.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.590+0000 7f91cd0b9700 1 Processor -- start 2023-11-26T07:14:54.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.590+0000 7f91cd0b9700 1 -- start start 2023-11-26T07:14:54.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.591+0000 7f91cd0b9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91c806b6e0 0x7f91c8161bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:54.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.591+0000 7f91cd0b9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91c80d0cb0 0x7f91c813e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:54.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.591+0000 7f91cd0b9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91c81475d0 0x7f91c813ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:54.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.591+0000 7f91cd0b9700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c815d710 con 0x7f91c81475d0 2023-11-26T07:14:54.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.591+0000 7f91cd0b9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c815e450 con 0x7f91c806b6e0 2023-11-26T07:14:54.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.591+0000 7f91cd0b9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c815e6a0 con 0x7f91c80d0cb0 2023-11-26T07:14:54.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.591+0000 7f91c759e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91c81475d0 0x7f91c813ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:54.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.591+0000 7f91c759e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91c81475d0 0x7f91c813ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42684/0 (socket says 172.21.15.2:42684) 2023-11-26T07:14:54.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.591+0000 7f91c759e700 1 -- 172.21.15.2:0/793415693 learned_addr learned my addr 172.21.15.2:0/793415693 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:54.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.591+0000 7f91c6d9d700 1 --2- 172.21.15.2:0/793415693 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91c806b6e0 0x7f91c8161bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:54.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.591+0000 7f91c659c700 1 --2- 172.21.15.2:0/793415693 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91c80d0cb0 0x7f91c813e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:54.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.591+0000 7f91c759e700 1 -- 172.21.15.2:0/793415693 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91c80d0cb0 msgr2=0x7f91c813e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:54.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.591+0000 7f91c759e700 1 --2- 172.21.15.2:0/793415693 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91c80d0cb0 0x7f91c813e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:54.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.591+0000 7f91c759e700 1 -- 172.21.15.2:0/793415693 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91c806b6e0 msgr2=0x7f91c8161bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:54.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.591+0000 7f91c759e700 1 --2- 172.21.15.2:0/793415693 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91c806b6e0 0x7f91c8161bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:54.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.591+0000 7f91c759e700 1 -- 172.21.15.2:0/793415693 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c0009a70 con 0x7f91c81475d0 2023-11-26T07:14:54.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.591+0000 7f91c759e700 1 --2- 172.21.15.2:0/793415693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91c81475d0 0x7f91c813ea10 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f91c0013000 tx=0x7f91c0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:54.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.592+0000 7f91bf7fe700 1 -- 172.21.15.2:0/793415693 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c0012430 con 0x7f91c81475d0 2023-11-26T07:14:54.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.592+0000 7f91bf7fe700 1 -- 172.21.15.2:0/793415693 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c0020070 con 0x7f91c81475d0 2023-11-26T07:14:54.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.592+0000 7f91cd0b9700 1 -- 172.21.15.2:0/793415693 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91c815e980 con 0x7f91c81475d0 2023-11-26T07:14:54.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.592+0000 7f91bf7fe700 1 -- 172.21.15.2:0/793415693 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c0004280 con 0x7f91c81475d0 2023-11-26T07:14:54.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.592+0000 7f91cd0b9700 1 -- 172.21.15.2:0/793415693 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c815ef40 con 0x7f91c81475d0 2023-11-26T07:14:54.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.593+0000 7f91cd0b9700 1 -- 172.21.15.2:0/793415693 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91c815f100 con 0x7f91c81475d0 2023-11-26T07:14:54.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.593+0000 7f91bf7fe700 1 -- 172.21.15.2:0/793415693 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f91c00043e0 con 0x7f91c81475d0 2023-11-26T07:14:54.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.593+0000 7f91bf7fe700 1 --2- 172.21.15.2:0/793415693 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f91a806b470 0x7f91a806d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:54.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.594+0000 7f91bf7fe700 1 -- 172.21.15.2:0/793415693 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f91c0022070 con 0x7f91c81475d0 2023-11-26T07:14:54.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.594+0000 7f91c6d9d700 1 --2- 172.21.15.2:0/793415693 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f91a806b470 0x7f91a806d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:54.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.594+0000 7f91c6d9d700 1 --2- 172.21.15.2:0/793415693 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f91a806b470 0x7f91a806d930 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f91b8006b20 tx=0x7f91b8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:54.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.598+0000 7f91bf7fe700 1 -- 172.21.15.2:0/793415693 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f91c00565e0 con 0x7f91c81475d0 2023-11-26T07:14:54.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.844+0000 7f91cd0b9700 1 -- 172.21.15.2:0/793415693 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91c8068670 con 0x7f91c81475d0 2023-11-26T07:14:54.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.845+0000 7f91bf7fe700 1 -- 172.21.15.2:0/793415693 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f91c0059c00 con 0x7f91c81475d0 2023-11-26T07:14:54.847 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:14:54.847 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5051,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2052180749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":2052180749},{"type":"v1","addr":"172.21.15.2:6835","nonce":2052180749}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/1795687093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1795687093},{"type":"v1","addr":"172.21.15.2:6834","nonce":1795687093}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5646,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2009465289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2009465289},{"type":"v1","addr":"172.21.15.192:6837","nonce":2009465289}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:13:53.741450+0000","modified":"2023-11-26T07:13:56.778566+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5649},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5649":{"gid":5649,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6836/2352660671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2352660671},{"type":"v1","addr":"172.21.15.192:6836","nonce":2352660671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-26T07:14:54.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.847+0000 7f91cd0b9700 1 -- 172.21.15.2:0/793415693 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f91a806b470 msgr2=0x7f91a806d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:54.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.847+0000 7f91cd0b9700 1 --2- 172.21.15.2:0/793415693 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f91a806b470 0x7f91a806d930 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f91b8006b20 tx=0x7f91b8008040 comp rx=0 tx=0).stop 2023-11-26T07:14:54.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.847+0000 7f91cd0b9700 1 -- 172.21.15.2:0/793415693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91c81475d0 msgr2=0x7f91c813ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:54.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.847+0000 7f91cd0b9700 1 --2- 172.21.15.2:0/793415693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91c81475d0 0x7f91c813ea10 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f91c0013000 tx=0x7f91c0004ad0 comp rx=0 tx=0).stop 2023-11-26T07:14:54.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.847+0000 7f91cd0b9700 1 -- 172.21.15.2:0/793415693 shutdown_connections 2023-11-26T07:14:54.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.847+0000 7f91cd0b9700 1 --2- 172.21.15.2:0/793415693 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f91a806b470 0x7f91a806d930 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:54.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.847+0000 7f91cd0b9700 1 --2- 172.21.15.2:0/793415693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91c81475d0 0x7f91c813ea10 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:54.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.847+0000 7f91cd0b9700 1 --2- 172.21.15.2:0/793415693 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91c806b6e0 0x7f91c8161bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:54.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.847+0000 7f91cd0b9700 1 --2- 172.21.15.2:0/793415693 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91c80d0cb0 0x7f91c813e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:54.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.847+0000 7f91cd0b9700 1 -- 172.21.15.2:0/793415693 >> 172.21.15.2:0/793415693 conn(0x7f91c806c0e0 msgr2=0x7f91c80afe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:54.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.847+0000 7f91cd0b9700 1 -- 172.21.15.2:0/793415693 shutdown_connections 2023-11-26T07:14:54.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.847+0000 7f91cd0b9700 1 -- 172.21.15.2:0/793415693 wait complete. 2023-11-26T07:14:54.851 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 27 2023-11-26T07:14:54.862 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:14:54.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.984+0000 7f551463b700 1 Processor -- start 2023-11-26T07:14:54.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.984+0000 7f551463b700 1 -- start start 2023-11-26T07:14:54.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.985+0000 7f551463b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f550c143ae0 0x7f550c0b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:54.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.985+0000 7f551463b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f550c0722c0 0x7f550c06e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:54.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.985+0000 7f551463b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f550c143ec0 con 0x7f550c1440f0 2023-11-26T07:14:54.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.985+0000 7f551463b700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f550c0b40a0 con 0x7f550c0722c0 2023-11-26T07:14:54.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.985+0000 7f551463b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f550c0b3ae0 con 0x7f550c143ae0 2023-11-26T07:14:54.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.986+0000 7f5512bd8700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f550c0722c0 0x7f550c06e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:54.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.986+0000 7f55123d7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f550c143ae0 0x7f550c0b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:54.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.986+0000 7f5512bd8700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f550c0722c0 0x7f550c06e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.2:51278/0 (socket says 172.21.15.2:51278) 2023-11-26T07:14:54.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.986+0000 7f5512bd8700 1 -- 172.21.15.2:0/1792465360 learned_addr learned my addr 172.21.15.2:0/1792465360 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:54.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.986+0000 7f5512bd8700 1 -- 172.21.15.2:0/1792465360 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f550c143ae0 msgr2=0x7f550c0b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:54.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.986+0000 7f5512bd8700 1 --2- 172.21.15.2:0/1792465360 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f550c143ae0 0x7f550c0b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:54.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.986+0000 7f5512bd8700 1 -- 172.21.15.2:0/1792465360 >> v1:172.21.15.192:6789/0 conn(0x7f550c1440f0 legacy=0x7f550c071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:54.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.986+0000 7f5512bd8700 1 -- 172.21.15.2:0/1792465360 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f550c0b3dc0 con 0x7f550c0722c0 2023-11-26T07:14:54.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.986+0000 7f55123d7700 1 --2- 172.21.15.2:0/1792465360 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f550c143ae0 0x7f550c0b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:14:54.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.986+0000 7f5512bd8700 1 --2- 172.21.15.2:0/1792465360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f550c0722c0 0x7f550c06e510 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f550400d150 tx=0x7f550400d460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1983711622dd8fd4 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:54.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.986+0000 7f55113d5700 1 -- 172.21.15.2:0/1792465360 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5504010070 con 0x7f550c0722c0 2023-11-26T07:14:54.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.986+0000 7f55113d5700 1 -- 172.21.15.2:0/1792465360 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550400dd10 con 0x7f550c0722c0 2023-11-26T07:14:54.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.986+0000 7f55113d5700 1 -- 172.21.15.2:0/1792465360 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550400b310 con 0x7f550c0722c0 2023-11-26T07:14:54.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.987+0000 7f551463b700 1 -- 172.21.15.2:0/1792465360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f550c0722c0 msgr2=0x7f550c06e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:54.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.987+0000 7f551463b700 1 --2- 172.21.15.2:0/1792465360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f550c0722c0 0x7f550c06e510 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f550400d150 tx=0x7f550400d460 comp rx=0 tx=0).stop 2023-11-26T07:14:54.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.987+0000 7f551463b700 1 -- 172.21.15.2:0/1792465360 shutdown_connections 2023-11-26T07:14:54.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.987+0000 7f551463b700 1 --2- 172.21.15.2:0/1792465360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f550c0722c0 0x7f550c06e510 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:54.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.987+0000 7f551463b700 1 --2- 172.21.15.2:0/1792465360 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f550c143ae0 0x7f550c0b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:54.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.987+0000 7f551463b700 1 -- 172.21.15.2:0/1792465360 >> 172.21.15.2:0/1792465360 conn(0x7f550c0b2740 msgr2=0x7f550c0b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:54.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.987+0000 7f551463b700 1 -- 172.21.15.2:0/1792465360 shutdown_connections 2023-11-26T07:14:54.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.987+0000 7f551463b700 1 -- 172.21.15.2:0/1792465360 wait complete. 2023-11-26T07:14:54.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.988+0000 7f551463b700 1 Processor -- start 2023-11-26T07:14:54.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.988+0000 7f551463b700 1 -- start start 2023-11-26T07:14:54.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.989+0000 7f551463b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f550c0722c0 0x7f550c0cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:54.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.989+0000 7f551463b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f550c143ae0 0x7f550c0ca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:54.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.989+0000 7f551463b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f550c1440f0 0x7f550c141c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:54.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.989+0000 7f551463b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550c0cc1c0 con 0x7f550c0722c0 2023-11-26T07:14:54.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.989+0000 7f551463b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550c154b30 con 0x7f550c1440f0 2023-11-26T07:14:54.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.989+0000 7f551463b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f550c0ccfc0 con 0x7f550c143ae0 2023-11-26T07:14:54.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.989+0000 7f55123d7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f550c0722c0 0x7f550c0cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:54.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.989+0000 7f55123d7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f550c0722c0 0x7f550c0cc6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42694/0 (socket says 172.21.15.2:42694) 2023-11-26T07:14:54.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.989+0000 7f55123d7700 1 -- 172.21.15.2:0/2813596574 learned_addr learned my addr 172.21.15.2:0/2813596574 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:54.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.989+0000 7f5511bd6700 1 --2- 172.21.15.2:0/2813596574 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f550c143ae0 0x7f550c0ca9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:54.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.990+0000 7f5512bd8700 1 --2- 172.21.15.2:0/2813596574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f550c1440f0 0x7f550c141c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:54.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.990+0000 7f55123d7700 1 -- 172.21.15.2:0/2813596574 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f550c143ae0 msgr2=0x7f550c0ca9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:54.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.990+0000 7f55123d7700 1 --2- 172.21.15.2:0/2813596574 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f550c143ae0 0x7f550c0ca9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:54.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.990+0000 7f55123d7700 1 -- 172.21.15.2:0/2813596574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f550c1440f0 msgr2=0x7f550c141c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:54.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.990+0000 7f55123d7700 1 --2- 172.21.15.2:0/2813596574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f550c1440f0 0x7f550c141c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:54.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.990+0000 7f55123d7700 1 -- 172.21.15.2:0/2813596574 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54fc0094a0 con 0x7f550c0722c0 2023-11-26T07:14:54.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.990+0000 7f55123d7700 1 --2- 172.21.15.2:0/2813596574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f550c0722c0 0x7f550c0cc6e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f54fc00ebe0 tx=0x7f54fc009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:54.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.990+0000 7f5502ffd700 1 -- 172.21.15.2:0/2813596574 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54fc00c910 con 0x7f550c0722c0 2023-11-26T07:14:54.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.990+0000 7f5502ffd700 1 -- 172.21.15.2:0/2813596574 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54fc00ca70 con 0x7f550c0722c0 2023-11-26T07:14:54.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.990+0000 7f551463b700 1 -- 172.21.15.2:0/2813596574 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f550400bd40 con 0x7f550c0722c0 2023-11-26T07:14:54.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.990+0000 7f5502ffd700 1 -- 172.21.15.2:0/2813596574 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54fc00cde0 con 0x7f550c0722c0 2023-11-26T07:14:54.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.990+0000 7f551463b700 1 -- 172.21.15.2:0/2813596574 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f550c0cd2a0 con 0x7f550c0722c0 2023-11-26T07:14:54.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.991+0000 7f551463b700 1 -- 172.21.15.2:0/2813596574 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f550c068670 con 0x7f550c0722c0 2023-11-26T07:14:54.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.991+0000 7f5502ffd700 1 -- 172.21.15.2:0/2813596574 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f54fc013470 con 0x7f550c0722c0 2023-11-26T07:14:54.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.992+0000 7f5502ffd700 1 --2- 172.21.15.2:0/2813596574 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f54f006b470 0x7f54f006d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:54.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.992+0000 7f5502ffd700 1 -- 172.21.15.2:0/2813596574 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f54fc08a1c0 con 0x7f550c0722c0 2023-11-26T07:14:54.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.992+0000 7f5511bd6700 1 --2- 172.21.15.2:0/2813596574 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f54f006b470 0x7f54f006d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:54.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.993+0000 7f5511bd6700 1 --2- 172.21.15.2:0/2813596574 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f54f006b470 0x7f54f006d930 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5508000f60 tx=0x7f5508009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:54.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:54.996+0000 7f5502ffd700 1 -- 172.21.15.2:0/2813596574 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f54fc054a30 con 0x7f550c0722c0 2023-11-26T07:14:55.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.198+0000 7f551463b700 1 -- 172.21.15.2:0/2813596574 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f550c0b5d20 con 0x7f550c0722c0 2023-11-26T07:14:55.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.199+0000 7f5502ffd700 1 -- 172.21.15.2:0/2813596574 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16626 (secure 0 0 0) 0x7f54fc058050 con 0x7f550c0722c0 2023-11-26T07:14:55.202 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:14:55.202 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":49,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:14:51.238862+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:13:52.197275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-26T07:13:52.705487+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":48,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2e","mappings":[{"from":0,"to":5}]},{"pgid":"7.3e","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:14:55.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.202+0000 7f551463b700 1 -- 172.21.15.2:0/2813596574 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f54f006b470 msgr2=0x7f54f006d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:55.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.202+0000 7f551463b700 1 --2- 172.21.15.2:0/2813596574 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f54f006b470 0x7f54f006d930 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5508000f60 tx=0x7f5508009040 comp rx=0 tx=0).stop 2023-11-26T07:14:55.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.202+0000 7f551463b700 1 -- 172.21.15.2:0/2813596574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f550c0722c0 msgr2=0x7f550c0cc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:55.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.202+0000 7f551463b700 1 --2- 172.21.15.2:0/2813596574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f550c0722c0 0x7f550c0cc6e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f54fc00ebe0 tx=0x7f54fc009ec0 comp rx=0 tx=0).stop 2023-11-26T07:14:55.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.202+0000 7f551463b700 1 -- 172.21.15.2:0/2813596574 shutdown_connections 2023-11-26T07:14:55.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.202+0000 7f551463b700 1 --2- 172.21.15.2:0/2813596574 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f54f006b470 0x7f54f006d930 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:55.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.202+0000 7f551463b700 1 --2- 172.21.15.2:0/2813596574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f550c1440f0 0x7f550c141c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:55.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.202+0000 7f551463b700 1 --2- 172.21.15.2:0/2813596574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f550c0722c0 0x7f550c0cc6e0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:55.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.202+0000 7f551463b700 1 --2- 172.21.15.2:0/2813596574 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f550c143ae0 0x7f550c0ca9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:55.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.202+0000 7f551463b700 1 -- 172.21.15.2:0/2813596574 >> 172.21.15.2:0/2813596574 conn(0x7f550c0b2740 msgr2=0x7f550c0cf210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:55.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.202+0000 7f551463b700 1 -- 172.21.15.2:0/2813596574 shutdown_connections 2023-11-26T07:14:55.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.202+0000 7f551463b700 1 -- 172.21.15.2:0/2813596574 wait complete. 2023-11-26T07:14:55.216 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-26T07:14:55.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.339+0000 7f335e457700 1 Processor -- start 2023-11-26T07:14:55.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.339+0000 7f335e457700 1 -- start start 2023-11-26T07:14:55.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.340+0000 7f335e457700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f335815dfc0 0x7f33580d4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:55.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.340+0000 7f335e457700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33580d2790 con 0x7f33580d1440 2023-11-26T07:14:55.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.340+0000 7f335e457700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33580d2a70 con 0x7f335815e3a0 2023-11-26T07:14:55.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.340+0000 7f335e457700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33580c7a30 con 0x7f335815dfc0 2023-11-26T07:14:55.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.340+0000 7f33577fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f33580d1440 0x7f33580d0830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33912/0 (socket says 172.21.15.2:33912) 2023-11-26T07:14:55.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.340+0000 7f33577fe700 1 -- 172.21.15.2:0/333377858 learned_addr learned my addr 172.21.15.2:0/333377858 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:14:55.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.340+0000 7f3356ffd700 1 -- 172.21.15.2:0/333377858 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 501720427 0 0) 0x7f33580d2790 con 0x7f33580d1440 2023-11-26T07:14:55.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.340+0000 7f3357fff700 1 --2- 172.21.15.2:0/333377858 >> v2:172.21.15.192:3300/0 conn(0x7f335815dfc0 0x7f33580d4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:55.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.340+0000 7f3356ffd700 1 -- 172.21.15.2:0/333377858 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33400035b0 con 0x7f33580d1440 2023-11-26T07:14:55.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.341+0000 7f3356ffd700 1 -- 172.21.15.2:0/333377858 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 445650614 0 0) 0x7f33400035b0 con 0x7f33580d1440 2023-11-26T07:14:55.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.341+0000 7f3356ffd700 1 -- 172.21.15.2:0/333377858 >> v2:172.21.15.192:3300/0 conn(0x7f335815dfc0 msgr2=0x7f33580d4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:55.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.341+0000 7f3356ffd700 1 --2- 172.21.15.2:0/333377858 >> v2:172.21.15.192:3300/0 conn(0x7f335815dfc0 0x7f33580d4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:55.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.341+0000 7f3356ffd700 1 -- 172.21.15.2:0/333377858 >> v1:172.21.15.192:6789/0 conn(0x7f335815e3a0 legacy=0x7f33580c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:55.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.341+0000 7f3356ffd700 1 -- 172.21.15.2:0/333377858 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33580c7d10 con 0x7f33580d1440 2023-11-26T07:14:55.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.341+0000 7f3356ffd700 1 -- 172.21.15.2:0/333377858 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f334c001670 con 0x7f33580d1440 2023-11-26T07:14:55.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.341+0000 7f3356ffd700 1 -- 172.21.15.2:0/333377858 >> v1:172.21.15.2:6789/0 conn(0x7f33580d1440 legacy=0x7f33580d0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:55.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.341+0000 7f3356ffd700 1 --2- 172.21.15.2:0/333377858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3340003a00 0x7f3340003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:55.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.341+0000 7f3356ffd700 1 --2- 172.21.15.2:0/333377858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3340004850 0x7f3340004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:55.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.341+0000 7f3356ffd700 1 --2- 172.21.15.2:0/333377858 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3340005210 0x7f334000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:55.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.341+0000 7f3356ffd700 1 -- 172.21.15.2:0/333377858 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33580c7a30 con 0x7f3340004850 2023-11-26T07:14:55.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.341+0000 7f3356ffd700 1 -- 172.21.15.2:0/333377858 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f334000c0b0 con 0x7f3340003a00 2023-11-26T07:14:55.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.341+0000 7f3356ffd700 1 -- 172.21.15.2:0/333377858 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f334000c270 con 0x7f3340005210 2023-11-26T07:14:55.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.341+0000 7f33577fe700 1 --2- 172.21.15.2:0/333377858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3340004850 0x7f3340004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:55.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.341+0000 7f3357fff700 1 --2- 172.21.15.2:0/333377858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3340003a00 0x7f3340003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:55.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.341+0000 7f335c9f4700 1 --2- 172.21.15.2:0/333377858 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3340005210 0x7f334000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:55.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.341+0000 7f33577fe700 1 -- 172.21.15.2:0/333377858 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3340005210 msgr2=0x7f334000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:55.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.341+0000 7f33577fe700 1 --2- 172.21.15.2:0/333377858 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3340005210 0x7f334000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:55.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.341+0000 7f33577fe700 1 -- 172.21.15.2:0/333377858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3340003a00 msgr2=0x7f3340003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:55.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.341+0000 7f33577fe700 1 --2- 172.21.15.2:0/333377858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3340003a00 0x7f3340003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:55.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.341+0000 7f33577fe700 1 -- 172.21.15.2:0/333377858 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33400035b0 con 0x7f3340004850 2023-11-26T07:14:55.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.341+0000 7f335c9f4700 1 --2- 172.21.15.2:0/333377858 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3340005210 0x7f334000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:14:55.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.341+0000 7f335c9f4700 1 -- 172.21.15.2:0/333377858 reap_dead start 2023-11-26T07:14:55.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.342+0000 7f33577fe700 1 --2- 172.21.15.2:0/333377858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3340004850 0x7f3340004cd0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f334c00c240 tx=0x7f3340005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d61d5a04698fbeeb server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:55.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.342+0000 7f3356ffd700 1 -- 172.21.15.2:0/333377858 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c007c10 con 0x7f3340004850 2023-11-26T07:14:55.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.342+0000 7f3356ffd700 1 -- 172.21.15.2:0/333377858 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334c00cde0 con 0x7f3340004850 2023-11-26T07:14:55.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.342+0000 7f3356ffd700 1 -- 172.21.15.2:0/333377858 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c005ba0 con 0x7f3340004850 2023-11-26T07:14:55.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.342+0000 7f335e457700 1 -- 172.21.15.2:0/333377858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3340004850 msgr2=0x7f3340004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:55.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.342+0000 7f335e457700 1 --2- 172.21.15.2:0/333377858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3340004850 0x7f3340004cd0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f334c00c240 tx=0x7f3340005880 comp rx=0 tx=0).stop 2023-11-26T07:14:55.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.342+0000 7f335e457700 1 -- 172.21.15.2:0/333377858 shutdown_connections 2023-11-26T07:14:55.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.342+0000 7f335e457700 1 --2- 172.21.15.2:0/333377858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3340004850 0x7f3340004cd0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:55.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.342+0000 7f335e457700 1 -- 172.21.15.2:0/333377858 >> 172.21.15.2:0/333377858 conn(0x7f33580d3e40 msgr2=0x7f33580d4250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:55.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.342+0000 7f335e457700 1 -- 172.21.15.2:0/333377858 shutdown_connections 2023-11-26T07:14:55.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.342+0000 7f335e457700 1 -- 172.21.15.2:0/333377858 wait complete. 2023-11-26T07:14:55.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.343+0000 7f335e457700 1 Processor -- start 2023-11-26T07:14:55.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.344+0000 7f335e457700 1 -- start start 2023-11-26T07:14:55.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.344+0000 7f335e457700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3340004850 0x7f335814a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:55.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.344+0000 7f335e457700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33581530b0 0x7f33580b9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:55.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.344+0000 7f335e457700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3358160940 0x7f3358160dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:55.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.344+0000 7f335e457700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33581604b0 con 0x7f3358160940 2023-11-26T07:14:55.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.344+0000 7f335e457700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335814a650 con 0x7f33581530b0 2023-11-26T07:14:55.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.344+0000 7f335e457700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f335815f8a0 con 0x7f3340004850 2023-11-26T07:14:55.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.345+0000 7f335c9f4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3358160940 0x7f3358160dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:55.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.345+0000 7f335c9f4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3358160940 0x7f3358160dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42718/0 (socket says 172.21.15.2:42718) 2023-11-26T07:14:55.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.345+0000 7f335c9f4700 1 -- 172.21.15.2:0/13598171 learned_addr learned my addr 172.21.15.2:0/13598171 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:55.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.345+0000 7f3357fff700 1 --2- 172.21.15.2:0/13598171 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3340004850 0x7f335814a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:55.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.345+0000 7f33577fe700 1 --2- 172.21.15.2:0/13598171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33581530b0 0x7f33580b9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:55.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.345+0000 7f335c9f4700 1 -- 172.21.15.2:0/13598171 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3340004850 msgr2=0x7f335814a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:55.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.345+0000 7f335c9f4700 1 --2- 172.21.15.2:0/13598171 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3340004850 0x7f335814a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:55.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.345+0000 7f335c9f4700 1 -- 172.21.15.2:0/13598171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33581530b0 msgr2=0x7f33580b9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:55.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.345+0000 7f335c9f4700 1 --2- 172.21.15.2:0/13598171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33581530b0 0x7f33580b9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:55.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.345+0000 7f335c9f4700 1 -- 172.21.15.2:0/13598171 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f335815fb80 con 0x7f3358160940 2023-11-26T07:14:55.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.345+0000 7f335c9f4700 1 --2- 172.21.15.2:0/13598171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3358160940 0x7f3358160dc0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f33580cae90 tx=0x7f335000ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:55.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.345+0000 7f3354ff9700 1 -- 172.21.15.2:0/13598171 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335000eed0 con 0x7f3358160940 2023-11-26T07:14:55.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.345+0000 7f3354ff9700 1 -- 172.21.15.2:0/13598171 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3350003c10 con 0x7f3358160940 2023-11-26T07:14:55.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.345+0000 7f3354ff9700 1 -- 172.21.15.2:0/13598171 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33500050d0 con 0x7f3358160940 2023-11-26T07:14:55.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.345+0000 7f335e457700 1 -- 172.21.15.2:0/13598171 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f335815fe60 con 0x7f3358160940 2023-11-26T07:14:55.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.345+0000 7f335e457700 1 -- 172.21.15.2:0/13598171 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33580b9cd0 con 0x7f3358160940 2023-11-26T07:14:55.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.346+0000 7f335e457700 1 -- 172.21.15.2:0/13598171 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3358068670 con 0x7f3358160940 2023-11-26T07:14:55.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.347+0000 7f3354ff9700 1 -- 172.21.15.2:0/13598171 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f3350005230 con 0x7f3358160940 2023-11-26T07:14:55.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.347+0000 7f3354ff9700 1 --2- 172.21.15.2:0/13598171 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f334406b470 0x7f334406d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:55.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.347+0000 7f3354ff9700 1 -- 172.21.15.2:0/13598171 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f3350089e50 con 0x7f3358160940 2023-11-26T07:14:55.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.347+0000 7f3357fff700 1 --2- 172.21.15.2:0/13598171 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f334406b470 0x7f334406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:55.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.348+0000 7f3357fff700 1 --2- 172.21.15.2:0/13598171 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f334406b470 0x7f334406d930 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3348009ce0 tx=0x7f3348009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:55.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.352+0000 7f3354ff9700 1 -- 172.21.15.2:0/13598171 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f33500546c0 con 0x7f3358160940 2023-11-26T07:14:55.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.603+0000 7f335e457700 1 -- 172.21.15.2:0/13598171 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f33580d2780 con 0x7f3358160940 2023-11-26T07:14:55.605 INFO:tasks.ceph.mon.a.smithi002.stderr:2023-11-26T07:14:55.603+0000 7f35cd3c3700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-26T07:14:55.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.604+0000 7f3354ff9700 1 -- 172.21.15.2:0/13598171 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v28) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3350057ce0 con 0x7f3358160940 2023-11-26T07:14:55.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.608+0000 7f335e457700 1 -- 172.21.15.2:0/13598171 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f334406b470 msgr2=0x7f334406d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:55.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.608+0000 7f335e457700 1 --2- 172.21.15.2:0/13598171 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f334406b470 0x7f334406d930 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3348009ce0 tx=0x7f3348009210 comp rx=0 tx=0).stop 2023-11-26T07:14:55.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.608+0000 7f335e457700 1 -- 172.21.15.2:0/13598171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3358160940 msgr2=0x7f3358160dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:55.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.608+0000 7f335e457700 1 --2- 172.21.15.2:0/13598171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3358160940 0x7f3358160dc0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f33580cae90 tx=0x7f335000ed50 comp rx=0 tx=0).stop 2023-11-26T07:14:55.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.608+0000 7f335e457700 1 -- 172.21.15.2:0/13598171 shutdown_connections 2023-11-26T07:14:55.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.608+0000 7f335e457700 1 --2- 172.21.15.2:0/13598171 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f334406b470 0x7f334406d930 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:55.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.608+0000 7f335e457700 1 --2- 172.21.15.2:0/13598171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3358160940 0x7f3358160dc0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:55.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.608+0000 7f335e457700 1 --2- 172.21.15.2:0/13598171 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3340004850 0x7f335814a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:55.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.608+0000 7f335e457700 1 --2- 172.21.15.2:0/13598171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33581530b0 0x7f33580b9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:55.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.608+0000 7f335e457700 1 -- 172.21.15.2:0/13598171 >> 172.21.15.2:0/13598171 conn(0x7f33580d3e40 msgr2=0x7f33580cef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:55.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.608+0000 7f335e457700 1 -- 172.21.15.2:0/13598171 shutdown_connections 2023-11-26T07:14:55.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.608+0000 7f335e457700 1 -- 172.21.15.2:0/13598171 wait complete. 2023-11-26T07:14:55.611 INFO:teuthology.orchestra.run.smithi002.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-26T07:14:55.622 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-26T07:14:55.649 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2023-11-26T07:14:55.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.748+0000 7f2554697700 1 Processor -- start 2023-11-26T07:14:55.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.749+0000 7f2554697700 1 -- start start 2023-11-26T07:14:55.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.749+0000 7f2554697700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f254c06b620 0x7f254c0b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:55.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.749+0000 7f2554697700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f254c06ee60 0x7f254c0b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:55.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.749+0000 7f2554697700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f254c071f50 con 0x7f254c0b5ab0 2023-11-26T07:14:55.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.749+0000 7f2554697700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f254c072230 con 0x7f254c06ee60 2023-11-26T07:14:55.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.749+0000 7f2554697700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f254c072510 con 0x7f254c06b620 2023-11-26T07:14:55.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.750+0000 7f2552433700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f254c06b620 0x7f254c0b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:55.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.750+0000 7f2552c34700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f254c06ee60 0x7f254c0b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:55.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.750+0000 7f2551c32700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f254c0b5ab0 0x7f254c161ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.2:41304/0 (socket says 172.21.15.2:41304) 2023-11-26T07:14:55.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.750+0000 7f2551c32700 1 -- 172.21.15.2:0/209447241 learned_addr learned my addr 172.21.15.2:0/209447241 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:14:55.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.750+0000 7f2552c34700 1 --2- 172.21.15.2:0/209447241 >> v2:172.21.15.192:3300/0 conn(0x7f254c06ee60 0x7f254c0b3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.2:51312/0 (socket says 172.21.15.2:51312) 2023-11-26T07:14:55.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.750+0000 7f2552433700 1 --2- 172.21.15.2:0/209447241 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f254c06b620 0x7f254c0b3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.2:40802/0 (socket says 172.21.15.2:40802) 2023-11-26T07:14:55.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.750+0000 7f2551431700 1 -- 172.21.15.2:0/209447241 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2464687051 0 0) 0x7f254c071f50 con 0x7f254c0b5ab0 2023-11-26T07:14:55.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.750+0000 7f2551431700 1 -- 172.21.15.2:0/209447241 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25380035b0 con 0x7f254c0b5ab0 2023-11-26T07:14:55.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.750+0000 7f2552433700 1 -- 172.21.15.2:0/209447241 >> v2:172.21.15.192:3300/0 conn(0x7f254c06ee60 msgr2=0x7f254c0b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:55.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.750+0000 7f2552433700 1 --2- 172.21.15.2:0/209447241 >> v2:172.21.15.192:3300/0 conn(0x7f254c06ee60 0x7f254c0b3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:55.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.750+0000 7f2552433700 1 -- 172.21.15.2:0/209447241 >> v1:172.21.15.192:6789/0 conn(0x7f254c0b5ab0 legacy=0x7f254c161ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:55.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.750+0000 7f2552433700 1 -- 172.21.15.2:0/209447241 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f254c0727f0 con 0x7f254c06b620 2023-11-26T07:14:55.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.750+0000 7f2552c34700 1 --2- 172.21.15.2:0/209447241 >> v2:172.21.15.192:3300/0 conn(0x7f254c06ee60 0x7f254c0b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:14:55.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.750+0000 7f2552433700 1 --2- 172.21.15.2:0/209447241 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f254c06b620 0x7f254c0b3a40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2540009840 tx=0x7f2540009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e28372fabdd9267 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:55.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.751+0000 7f2551431700 1 -- 172.21.15.2:0/209447241 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2540011830 con 0x7f254c06b620 2023-11-26T07:14:55.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.751+0000 7f2551431700 1 -- 172.21.15.2:0/209447241 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2540011990 con 0x7f254c06b620 2023-11-26T07:14:55.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.751+0000 7f2551431700 1 -- 172.21.15.2:0/209447241 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2540011d00 con 0x7f254c06b620 2023-11-26T07:14:55.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.751+0000 7f2554697700 1 -- 172.21.15.2:0/209447241 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f254c06b620 msgr2=0x7f254c0b3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:55.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.751+0000 7f2554697700 1 --2- 172.21.15.2:0/209447241 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f254c06b620 0x7f254c0b3a40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2540009840 tx=0x7f2540009b50 comp rx=0 tx=0).stop 2023-11-26T07:14:55.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.751+0000 7f2554697700 1 -- 172.21.15.2:0/209447241 shutdown_connections 2023-11-26T07:14:55.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.751+0000 7f2554697700 1 --2- 172.21.15.2:0/209447241 >> v2:172.21.15.192:3300/0 conn(0x7f254c06ee60 0x7f254c0b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:55.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.751+0000 7f2554697700 1 --2- 172.21.15.2:0/209447241 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f254c06b620 0x7f254c0b3a40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:55.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.751+0000 7f2554697700 1 -- 172.21.15.2:0/209447241 >> 172.21.15.2:0/209447241 conn(0x7f254c0b2740 msgr2=0x7f254c0b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:55.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.751+0000 7f2554697700 1 -- 172.21.15.2:0/209447241 shutdown_connections 2023-11-26T07:14:55.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.751+0000 7f2554697700 1 -- 172.21.15.2:0/209447241 wait complete. 2023-11-26T07:14:55.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.752+0000 7f2554697700 1 Processor -- start 2023-11-26T07:14:55.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.753+0000 7f2554697700 1 -- start start 2023-11-26T07:14:55.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.753+0000 7f2554697700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f254c06b620 0x7f254c1e6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:55.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.753+0000 7f2554697700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f254c06ee60 0x7f254c1e8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:55.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.753+0000 7f2554697700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f254c0b5ab0 0x7f254c1e8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:55.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.753+0000 7f2554697700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f254c1e8290 con 0x7f254c0b5ab0 2023-11-26T07:14:55.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.753+0000 7f2554697700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f254c1e3620 con 0x7f254c06ee60 2023-11-26T07:14:55.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.753+0000 7f2554697700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f254c1e79f0 con 0x7f254c06b620 2023-11-26T07:14:55.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.753+0000 7f2552c34700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f254c0b5ab0 0x7f254c1e8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:55.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.753+0000 7f2552c34700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f254c0b5ab0 0x7f254c1e8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42732/0 (socket says 172.21.15.2:42732) 2023-11-26T07:14:55.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.753+0000 7f2552c34700 1 -- 172.21.15.2:0/516768675 learned_addr learned my addr 172.21.15.2:0/516768675 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:55.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.753+0000 7f2552433700 1 --2- 172.21.15.2:0/516768675 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f254c06b620 0x7f254c1e6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:55.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.753+0000 7f2551c32700 1 --2- 172.21.15.2:0/516768675 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f254c06ee60 0x7f254c1e8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:55.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.754+0000 7f2552c34700 1 -- 172.21.15.2:0/516768675 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f254c06b620 msgr2=0x7f254c1e6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:55.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.754+0000 7f2552c34700 1 --2- 172.21.15.2:0/516768675 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f254c06b620 0x7f254c1e6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:55.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.754+0000 7f2552c34700 1 -- 172.21.15.2:0/516768675 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f254c06ee60 msgr2=0x7f254c1e8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:55.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.754+0000 7f2552c34700 1 --2- 172.21.15.2:0/516768675 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f254c06ee60 0x7f254c1e8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:55.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.754+0000 7f2552c34700 1 -- 172.21.15.2:0/516768675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2544009a70 con 0x7f254c0b5ab0 2023-11-26T07:14:55.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.754+0000 7f2552c34700 1 --2- 172.21.15.2:0/516768675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f254c0b5ab0 0x7f254c1e8a80 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f254400ef90 tx=0x7f254400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:55.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.754+0000 7f253effd700 1 -- 172.21.15.2:0/516768675 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254400cc90 con 0x7f254c0b5ab0 2023-11-26T07:14:55.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.754+0000 7f253effd700 1 -- 172.21.15.2:0/516768675 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254400f040 con 0x7f254c0b5ab0 2023-11-26T07:14:55.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.754+0000 7f2554697700 1 -- 172.21.15.2:0/516768675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25400094a0 con 0x7f254c0b5ab0 2023-11-26T07:14:55.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.754+0000 7f253effd700 1 -- 172.21.15.2:0/516768675 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25440146c0 con 0x7f254c0b5ab0 2023-11-26T07:14:55.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.754+0000 7f2554697700 1 -- 172.21.15.2:0/516768675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f254c1e7fb0 con 0x7f254c0b5ab0 2023-11-26T07:14:55.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.755+0000 7f2554697700 1 -- 172.21.15.2:0/516768675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f254c1e37d0 con 0x7f254c0b5ab0 2023-11-26T07:14:55.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.755+0000 7f253effd700 1 -- 172.21.15.2:0/516768675 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f2544014820 con 0x7f254c0b5ab0 2023-11-26T07:14:55.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.756+0000 7f253effd700 1 --2- 172.21.15.2:0/516768675 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f253006b470 0x7f253006d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:55.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.756+0000 7f253effd700 1 -- 172.21.15.2:0/516768675 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f254408ae20 con 0x7f254c0b5ab0 2023-11-26T07:14:55.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.756+0000 7f2552433700 1 --2- 172.21.15.2:0/516768675 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f253006b470 0x7f253006d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:55.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.757+0000 7f2552433700 1 --2- 172.21.15.2:0/516768675 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f253006b470 0x7f253006d930 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2540000c00 tx=0x7f2540008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:55.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:55.761+0000 7f253effd700 1 -- 172.21.15.2:0/516768675 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f254c1e37d0 con 0x7f254c0b5ab0 2023-11-26T07:14:56.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.017+0000 7f2554697700 1 -- 172.21.15.2:0/516768675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f254c1e3790 con 0x7f254c0b5ab0 2023-11-26T07:14:56.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.608+0000 7f253effd700 1 -- 172.21.15.2:0/516768675 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v29) v1 ==== 104+0+0 (secure 0 0 0) 0x7f25440554d0 con 0x7f254c0b5ab0 2023-11-26T07:14:56.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.611+0000 7f2554697700 1 -- 172.21.15.2:0/516768675 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f253006b470 msgr2=0x7f253006d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:56.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.611+0000 7f2554697700 1 --2- 172.21.15.2:0/516768675 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f253006b470 0x7f253006d930 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2540000c00 tx=0x7f2540008030 comp rx=0 tx=0).stop 2023-11-26T07:14:56.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.611+0000 7f2554697700 1 -- 172.21.15.2:0/516768675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f254c0b5ab0 msgr2=0x7f254c1e8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:56.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.611+0000 7f2554697700 1 --2- 172.21.15.2:0/516768675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f254c0b5ab0 0x7f254c1e8a80 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f254400ef90 tx=0x7f254400c3a0 comp rx=0 tx=0).stop 2023-11-26T07:14:56.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.611+0000 7f2554697700 1 -- 172.21.15.2:0/516768675 shutdown_connections 2023-11-26T07:14:56.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.611+0000 7f2554697700 1 --2- 172.21.15.2:0/516768675 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f253006b470 0x7f253006d930 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:56.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.611+0000 7f2554697700 1 --2- 172.21.15.2:0/516768675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f254c0b5ab0 0x7f254c1e8a80 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:56.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.611+0000 7f2554697700 1 --2- 172.21.15.2:0/516768675 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f254c06b620 0x7f254c1e6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:56.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.611+0000 7f2554697700 1 --2- 172.21.15.2:0/516768675 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f254c06ee60 0x7f254c1e8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:56.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.611+0000 7f2554697700 1 -- 172.21.15.2:0/516768675 >> 172.21.15.2:0/516768675 conn(0x7f254c0b2740 msgr2=0x7f254c0aeec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:56.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.611+0000 7f2554697700 1 -- 172.21.15.2:0/516768675 shutdown_connections 2023-11-26T07:14:56.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.611+0000 7f2554697700 1 -- 172.21.15.2:0/516768675 wait complete. 2023-11-26T07:14:56.628 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-26T07:14:56.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.761+0000 7f48cfbe2700 1 Processor -- start 2023-11-26T07:14:56.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.762+0000 7f48cfbe2700 1 -- start start 2023-11-26T07:14:56.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.762+0000 7f48cfbe2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48c80b11d0 0x7f48c80cfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:56.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.762+0000 7f48cfbe2700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f48c80cecc0 0x7f48c8167c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:56.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.762+0000 7f48cfbe2700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48c806f110 con 0x7f48c806fcb0 2023-11-26T07:14:56.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.762+0000 7f48cfbe2700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48c8161a10 con 0x7f48c80cecc0 2023-11-26T07:14:56.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.762+0000 7f48cfbe2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48c80d1010 con 0x7f48c80b11d0 2023-11-26T07:14:56.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.763+0000 7f48cd17d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f48c806fcb0 0x7f48c80ce5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33946/0 (socket says 172.21.15.2:33946) 2023-11-26T07:14:56.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.763+0000 7f48cd17d700 1 -- 172.21.15.2:0/3474497849 learned_addr learned my addr 172.21.15.2:0/3474497849 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:14:56.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.763+0000 7f48cc97c700 1 -- 172.21.15.2:0/3474497849 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1208883969 0 0) 0x7f48c806f110 con 0x7f48c806fcb0 2023-11-26T07:14:56.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.763+0000 7f48ce17f700 1 --2- 172.21.15.2:0/3474497849 >> v2:172.21.15.192:3300/0 conn(0x7f48c80cecc0 0x7f48c8167c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:56.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.763+0000 7f48cc97c700 1 -- 172.21.15.2:0/3474497849 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48b40035b0 con 0x7f48c806fcb0 2023-11-26T07:14:56.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.763+0000 7f48cd97e700 1 --2- 172.21.15.2:0/3474497849 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48c80b11d0 0x7f48c80cfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:56.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.763+0000 7f48cc97c700 1 -- 172.21.15.2:0/3474497849 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3581664899 0 0) 0x7f48b40035b0 con 0x7f48c806fcb0 2023-11-26T07:14:56.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.763+0000 7f48cc97c700 1 -- 172.21.15.2:0/3474497849 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48c80b11d0 msgr2=0x7f48c80cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:56.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.763+0000 7f48cc97c700 1 --2- 172.21.15.2:0/3474497849 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48c80b11d0 0x7f48c80cfd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:56.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.763+0000 7f48cc97c700 1 -- 172.21.15.2:0/3474497849 >> v2:172.21.15.192:3300/0 conn(0x7f48c80cecc0 msgr2=0x7f48c8167c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:56.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.763+0000 7f48cc97c700 1 --2- 172.21.15.2:0/3474497849 >> v2:172.21.15.192:3300/0 conn(0x7f48c80cecc0 0x7f48c8167c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:56.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.763+0000 7f48cc97c700 1 -- 172.21.15.2:0/3474497849 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c80d0400 con 0x7f48c806fcb0 2023-11-26T07:14:56.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.763+0000 7f48cc97c700 1 -- 172.21.15.2:0/3474497849 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f48c4001670 con 0x7f48c806fcb0 2023-11-26T07:14:56.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.763+0000 7f48cc97c700 1 -- 172.21.15.2:0/3474497849 >> v1:172.21.15.2:6789/0 conn(0x7f48c806fcb0 legacy=0x7f48c80ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:56.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.763+0000 7f48cc97c700 1 --2- 172.21.15.2:0/3474497849 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48b4003a00 0x7f48b4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:56.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.763+0000 7f48cc97c700 1 --2- 172.21.15.2:0/3474497849 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48c80b11d0 0x7f48b4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:56.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.763+0000 7f48cc97c700 1 --2- 172.21.15.2:0/3474497849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48b4004d90 0x7f48b4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:56.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.763+0000 7f48cc97c700 1 -- 172.21.15.2:0/3474497849 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c8161a10 con 0x7f48b4004d90 2023-11-26T07:14:56.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.763+0000 7f48cc97c700 1 -- 172.21.15.2:0/3474497849 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c80d1010 con 0x7f48b4003a00 2023-11-26T07:14:56.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.763+0000 7f48cc97c700 1 -- 172.21.15.2:0/3474497849 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b400ba10 con 0x7f48c80b11d0 2023-11-26T07:14:56.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.763+0000 7f48ce17f700 1 --2- 172.21.15.2:0/3474497849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48b4004d90 0x7f48b4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:56.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.763+0000 7f48cd97e700 1 --2- 172.21.15.2:0/3474497849 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48b4003a00 0x7f48b4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:56.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.763+0000 7f48cd17d700 1 --2- 172.21.15.2:0/3474497849 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48c80b11d0 0x7f48b4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:56.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.764+0000 7f48ce17f700 1 -- 172.21.15.2:0/3474497849 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48c80b11d0 msgr2=0x7f48b4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:56.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.764+0000 7f48ce17f700 1 --2- 172.21.15.2:0/3474497849 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48c80b11d0 0x7f48b4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:56.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.764+0000 7f48ce17f700 1 -- 172.21.15.2:0/3474497849 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48b4003a00 msgr2=0x7f48b4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:56.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.764+0000 7f48ce17f700 1 --2- 172.21.15.2:0/3474497849 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48b4003a00 0x7f48b4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:56.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.764+0000 7f48ce17f700 1 -- 172.21.15.2:0/3474497849 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b40035b0 con 0x7f48b4004d90 2023-11-26T07:14:56.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.764+0000 7f48cd17d700 1 --2- 172.21.15.2:0/3474497849 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48c80b11d0 0x7f48b4004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:14:56.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.764+0000 7f48ce17f700 1 --2- 172.21.15.2:0/3474497849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48b4004d90 0x7f48b4005210 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f48c0009fc0 tx=0x7f48b4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78d074b717fd2611 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:56.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.764+0000 7f48cc97c700 1 -- 172.21.15.2:0/3474497849 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c000ec30 con 0x7f48b4004d90 2023-11-26T07:14:56.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.764+0000 7f48cc97c700 1 -- 172.21.15.2:0/3474497849 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c000f040 con 0x7f48b4004d90 2023-11-26T07:14:56.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.764+0000 7f48cc97c700 1 -- 172.21.15.2:0/3474497849 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c0014480 con 0x7f48b4004d90 2023-11-26T07:14:56.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.764+0000 7f48cfbe2700 1 -- 172.21.15.2:0/3474497849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48b4004d90 msgr2=0x7f48b4005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:56.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.764+0000 7f48cfbe2700 1 --2- 172.21.15.2:0/3474497849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48b4004d90 0x7f48b4005210 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f48c0009fc0 tx=0x7f48b4005880 comp rx=0 tx=0).stop 2023-11-26T07:14:56.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.764+0000 7f48ce17f700 1 -- 172.21.15.2:0/3474497849 reap_dead start 2023-11-26T07:14:56.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.765+0000 7f48cfbe2700 1 -- 172.21.15.2:0/3474497849 shutdown_connections 2023-11-26T07:14:56.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.765+0000 7f48cfbe2700 1 -- 172.21.15.2:0/3474497849 >> 172.21.15.2:0/3474497849 conn(0x7f48c80b3700 msgr2=0x7f48c80b3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:56.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.765+0000 7f48cfbe2700 1 -- 172.21.15.2:0/3474497849 shutdown_connections 2023-11-26T07:14:56.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.765+0000 7f48cfbe2700 1 -- 172.21.15.2:0/3474497849 wait complete. 2023-11-26T07:14:56.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.766+0000 7f48cfbe2700 1 Processor -- start 2023-11-26T07:14:56.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.766+0000 7f48cfbe2700 1 -- start start 2023-11-26T07:14:56.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.767+0000 7f48cfbe2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48c81571c0 0x7f48c815ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:56.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.767+0000 7f48cfbe2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48c80caac0 0x7f48c80b5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:56.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.767+0000 7f48cfbe2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48c80b59c0 0x7f48c80c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:56.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.767+0000 7f48cfbe2700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c80b5e70 con 0x7f48c81571c0 2023-11-26T07:14:56.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.767+0000 7f48cfbe2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c80caf40 con 0x7f48c80caac0 2023-11-26T07:14:56.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.767+0000 7f48cfbe2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48c81575a0 con 0x7f48c80b59c0 2023-11-26T07:14:56.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.767+0000 7f48cd97e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48c81571c0 0x7f48c815ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:56.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.767+0000 7f48cd97e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48c81571c0 0x7f48c815ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42748/0 (socket says 172.21.15.2:42748) 2023-11-26T07:14:56.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.767+0000 7f48cd97e700 1 -- 172.21.15.2:0/2466136430 learned_addr learned my addr 172.21.15.2:0/2466136430 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:56.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.767+0000 7f48cd97e700 1 -- 172.21.15.2:0/2466136430 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48c80b59c0 msgr2=0x7f48c80c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:56.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.767+0000 7f48cd97e700 1 --2- 172.21.15.2:0/2466136430 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48c80b59c0 0x7f48c80c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:56.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.767+0000 7f48cd97e700 1 -- 172.21.15.2:0/2466136430 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48c80caac0 msgr2=0x7f48c80b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:56.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.767+0000 7f48cd97e700 1 --2- 172.21.15.2:0/2466136430 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48c80caac0 0x7f48c80b5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:56.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.767+0000 7f48cd97e700 1 -- 172.21.15.2:0/2466136430 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c81f3bb0 con 0x7f48c81571c0 2023-11-26T07:14:56.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.767+0000 7f48cd97e700 1 --2- 172.21.15.2:0/2466136430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48c81571c0 0x7f48c815ffd0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f48b8011920 tx=0x7f48b8011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:56.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.767+0000 7f48be7fc700 1 -- 172.21.15.2:0/2466136430 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b800f940 con 0x7f48c81571c0 2023-11-26T07:14:56.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.767+0000 7f48be7fc700 1 -- 172.21.15.2:0/2466136430 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b800faa0 con 0x7f48c81571c0 2023-11-26T07:14:56.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.767+0000 7f48cfbe2700 1 -- 172.21.15.2:0/2466136430 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48c80cb1c0 con 0x7f48c81571c0 2023-11-26T07:14:56.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.767+0000 7f48be7fc700 1 -- 172.21.15.2:0/2466136430 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b800fe30 con 0x7f48c81571c0 2023-11-26T07:14:56.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.767+0000 7f48cfbe2700 1 -- 172.21.15.2:0/2466136430 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48c80cb780 con 0x7f48c81571c0 2023-11-26T07:14:56.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.768+0000 7f48cfbe2700 1 -- 172.21.15.2:0/2466136430 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48c806bc40 con 0x7f48c81571c0 2023-11-26T07:14:56.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.769+0000 7f48be7fc700 1 -- 172.21.15.2:0/2466136430 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f48b8014440 con 0x7f48c81571c0 2023-11-26T07:14:56.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.769+0000 7f48be7fc700 1 --2- 172.21.15.2:0/2466136430 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f48ac06b470 0x7f48ac06d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:56.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.769+0000 7f48be7fc700 1 -- 172.21.15.2:0/2466136430 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f48b808a700 con 0x7f48c81571c0 2023-11-26T07:14:56.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.770+0000 7f48cd17d700 1 --2- 172.21.15.2:0/2466136430 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f48ac06b470 0x7f48ac06d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:56.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.770+0000 7f48cd17d700 1 --2- 172.21.15.2:0/2466136430 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f48ac06b470 0x7f48ac06d930 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f48c8160900 tx=0x7f48c4004890 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:56.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.774+0000 7f48be7fc700 1 -- 172.21.15.2:0/2466136430 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f48b8054f30 con 0x7f48c81571c0 2023-11-26T07:14:56.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:56.978+0000 7f48cfbe2700 1 -- 172.21.15.2:0/2466136430 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f48c81f3d40 con 0x7f48c81571c0 2023-11-26T07:14:57.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.610+0000 7f48be7fc700 1 -- 172.21.15.2:0/2466136430 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v51) v1 ==== 181+0+0 (secure 0 0 0) 0x7f48c81f3d40 con 0x7f48c81571c0 2023-11-26T07:14:57.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.613+0000 7f48cfbe2700 1 -- 172.21.15.2:0/2466136430 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f48ac06b470 msgr2=0x7f48ac06d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:57.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.613+0000 7f48cfbe2700 1 --2- 172.21.15.2:0/2466136430 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f48ac06b470 0x7f48ac06d930 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f48c8160900 tx=0x7f48c4004890 comp rx=0 tx=0).stop 2023-11-26T07:14:57.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.613+0000 7f48cfbe2700 1 -- 172.21.15.2:0/2466136430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48c81571c0 msgr2=0x7f48c815ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:57.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.614+0000 7f48cfbe2700 1 --2- 172.21.15.2:0/2466136430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48c81571c0 0x7f48c815ffd0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f48b8011920 tx=0x7f48b8011ce0 comp rx=0 tx=0).stop 2023-11-26T07:14:57.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.614+0000 7f48cfbe2700 1 -- 172.21.15.2:0/2466136430 shutdown_connections 2023-11-26T07:14:57.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.614+0000 7f48cfbe2700 1 --2- 172.21.15.2:0/2466136430 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f48ac06b470 0x7f48ac06d930 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:57.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.614+0000 7f48cfbe2700 1 --2- 172.21.15.2:0/2466136430 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48c80b59c0 0x7f48c80c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:57.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.614+0000 7f48cfbe2700 1 --2- 172.21.15.2:0/2466136430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48c81571c0 0x7f48c815ffd0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:57.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.614+0000 7f48cfbe2700 1 --2- 172.21.15.2:0/2466136430 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48c80caac0 0x7f48c80b5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:57.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.614+0000 7f48cfbe2700 1 -- 172.21.15.2:0/2466136430 >> 172.21.15.2:0/2466136430 conn(0x7f48c80b3700 msgr2=0x7f48c80cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:57.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.614+0000 7f48cfbe2700 1 -- 172.21.15.2:0/2466136430 shutdown_connections 2023-11-26T07:14:57.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.614+0000 7f48cfbe2700 1 -- 172.21.15.2:0/2466136430 wait complete. 2023-11-26T07:14:57.617 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' removed 2023-11-26T07:14:57.631 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-26T07:14:57.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.765+0000 7f6d6b67d700 1 Processor -- start 2023-11-26T07:14:57.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.765+0000 7f6d6b67d700 1 -- start start 2023-11-26T07:14:57.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.766+0000 7f6d6b67d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6d641457b0 0x7f6d640725a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:57.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.766+0000 7f6d6b67d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d6406f580 0x7f6d6406e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:57.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.766+0000 7f6d6b67d700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d640cd490 con 0x7f6d6406e910 2023-11-26T07:14:57.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.766+0000 7f6d6b67d700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d6406fa00 con 0x7f6d641457b0 2023-11-26T07:14:57.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.766+0000 7f6d6b67d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d640cd6e0 con 0x7f6d6406f580 2023-11-26T07:14:57.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.766+0000 7f6d69c1a700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f6d6406e910 0x7f6d640cf020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33970/0 (socket says 172.21.15.2:33970) 2023-11-26T07:14:57.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.766+0000 7f6d69c1a700 1 -- 172.21.15.2:0/635448151 learned_addr learned my addr 172.21.15.2:0/635448151 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:14:57.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.766+0000 7f6d69419700 1 --2- 172.21.15.2:0/635448151 >> v2:172.21.15.192:3300/0 conn(0x7f6d641457b0 0x7f6d640725a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:57.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.766+0000 7f6d68c18700 1 --2- 172.21.15.2:0/635448151 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d6406f580 0x7f6d6406e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:57.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.766+0000 7f6d5bfff700 1 -- 172.21.15.2:0/635448151 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2592381510 0 0) 0x7f6d640cd490 con 0x7f6d6406e910 2023-11-26T07:14:57.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.767+0000 7f6d5bfff700 1 -- 172.21.15.2:0/635448151 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d500035b0 con 0x7f6d6406e910 2023-11-26T07:14:57.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.767+0000 7f6d68c18700 1 -- 172.21.15.2:0/635448151 >> v2:172.21.15.192:3300/0 conn(0x7f6d641457b0 msgr2=0x7f6d640725a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:57.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.767+0000 7f6d68c18700 1 --2- 172.21.15.2:0/635448151 >> v2:172.21.15.192:3300/0 conn(0x7f6d641457b0 0x7f6d640725a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:57.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.767+0000 7f6d68c18700 1 -- 172.21.15.2:0/635448151 >> v1:172.21.15.2:6789/0 conn(0x7f6d6406e910 legacy=0x7f6d640cf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:57.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.767+0000 7f6d68c18700 1 -- 172.21.15.2:0/635448151 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d640cd9c0 con 0x7f6d6406f580 2023-11-26T07:14:57.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.767+0000 7f6d69419700 1 --2- 172.21.15.2:0/635448151 >> v2:172.21.15.192:3300/0 conn(0x7f6d641457b0 0x7f6d640725a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:14:57.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.767+0000 7f6d68c18700 1 --2- 172.21.15.2:0/635448151 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d6406f580 0x7f6d6406e3d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6d60009840 tx=0x7f6d60009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93c51af693c851df server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:57.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.767+0000 7f6d5bfff700 1 -- 172.21.15.2:0/635448151 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d60011830 con 0x7f6d6406f580 2023-11-26T07:14:57.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.767+0000 7f6d5bfff700 1 -- 172.21.15.2:0/635448151 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d60011990 con 0x7f6d6406f580 2023-11-26T07:14:57.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.767+0000 7f6d5bfff700 1 -- 172.21.15.2:0/635448151 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d60011d20 con 0x7f6d6406f580 2023-11-26T07:14:57.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.768+0000 7f6d6b67d700 1 -- 172.21.15.2:0/635448151 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d6406f580 msgr2=0x7f6d6406e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:57.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.768+0000 7f6d6b67d700 1 --2- 172.21.15.2:0/635448151 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d6406f580 0x7f6d6406e3d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6d60009840 tx=0x7f6d60009b50 comp rx=0 tx=0).stop 2023-11-26T07:14:57.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.768+0000 7f6d6b67d700 1 -- 172.21.15.2:0/635448151 shutdown_connections 2023-11-26T07:14:57.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.768+0000 7f6d6b67d700 1 --2- 172.21.15.2:0/635448151 >> v2:172.21.15.192:3300/0 conn(0x7f6d641457b0 0x7f6d640725a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:57.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.768+0000 7f6d6b67d700 1 --2- 172.21.15.2:0/635448151 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d6406f580 0x7f6d6406e3d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:57.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.768+0000 7f6d6b67d700 1 -- 172.21.15.2:0/635448151 >> 172.21.15.2:0/635448151 conn(0x7f6d640b2760 msgr2=0x7f6d640b2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:57.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.768+0000 7f6d6b67d700 1 -- 172.21.15.2:0/635448151 shutdown_connections 2023-11-26T07:14:57.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.768+0000 7f6d6b67d700 1 -- 172.21.15.2:0/635448151 wait complete. 2023-11-26T07:14:57.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.769+0000 7f6d6b67d700 1 Processor -- start 2023-11-26T07:14:57.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.769+0000 7f6d6b67d700 1 -- start start 2023-11-26T07:14:57.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.770+0000 7f6d6b67d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d6406e910 0x7f6d6415af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:57.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.770+0000 7f6d6b67d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d6406f580 0x7f6d6415c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:57.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.770+0000 7f6d6b67d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d641457b0 0x7f6d6415c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:57.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.770+0000 7f6d6b67d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d640c9fe0 con 0x7f6d6406f580 2023-11-26T07:14:57.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.770+0000 7f6d6b67d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d640ca2c0 con 0x7f6d641457b0 2023-11-26T07:14:57.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.770+0000 7f6d6b67d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d640ca5a0 con 0x7f6d6406e910 2023-11-26T07:14:57.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.770+0000 7f6d68c18700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d6406f580 0x7f6d6415c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:57.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.770+0000 7f6d68c18700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d6406f580 0x7f6d6415c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42764/0 (socket says 172.21.15.2:42764) 2023-11-26T07:14:57.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.770+0000 7f6d68c18700 1 -- 172.21.15.2:0/2879679404 learned_addr learned my addr 172.21.15.2:0/2879679404 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:57.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.770+0000 7f6d69419700 1 --2- 172.21.15.2:0/2879679404 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d6406e910 0x7f6d6415af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:57.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.770+0000 7f6d69c1a700 1 --2- 172.21.15.2:0/2879679404 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d641457b0 0x7f6d6415c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:57.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.770+0000 7f6d68c18700 1 -- 172.21.15.2:0/2879679404 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d6406e910 msgr2=0x7f6d6415af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:57.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.770+0000 7f6d68c18700 1 --2- 172.21.15.2:0/2879679404 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d6406e910 0x7f6d6415af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:57.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.770+0000 7f6d68c18700 1 -- 172.21.15.2:0/2879679404 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d641457b0 msgr2=0x7f6d6415c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:57.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.770+0000 7f6d68c18700 1 --2- 172.21.15.2:0/2879679404 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d641457b0 0x7f6d6415c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:57.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.770+0000 7f6d68c18700 1 -- 172.21.15.2:0/2879679404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d540094a0 con 0x7f6d6406f580 2023-11-26T07:14:57.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.770+0000 7f6d68c18700 1 --2- 172.21.15.2:0/2879679404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d6406f580 0x7f6d6415c370 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f6d600090b0 tx=0x7f6d60004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:57.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.771+0000 7f6d59ffb700 1 -- 172.21.15.2:0/2879679404 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d60004590 con 0x7f6d6406f580 2023-11-26T07:14:57.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.771+0000 7f6d59ffb700 1 -- 172.21.15.2:0/2879679404 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6001f070 con 0x7f6d6406f580 2023-11-26T07:14:57.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.771+0000 7f6d6b67d700 1 -- 172.21.15.2:0/2879679404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d600094a0 con 0x7f6d6406f580 2023-11-26T07:14:57.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.771+0000 7f6d59ffb700 1 -- 172.21.15.2:0/2879679404 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d600038e0 con 0x7f6d6406f580 2023-11-26T07:14:57.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.771+0000 7f6d6b67d700 1 -- 172.21.15.2:0/2879679404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d640cab60 con 0x7f6d6406f580 2023-11-26T07:14:57.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.772+0000 7f6d6b67d700 1 -- 172.21.15.2:0/2879679404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d64068670 con 0x7f6d6406f580 2023-11-26T07:14:57.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.772+0000 7f6d59ffb700 1 -- 172.21.15.2:0/2879679404 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f6d60003a40 con 0x7f6d6406f580 2023-11-26T07:14:57.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.773+0000 7f6d59ffb700 1 --2- 172.21.15.2:0/2879679404 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6d4806b470 0x7f6d4806d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:57.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.773+0000 7f6d59ffb700 1 -- 172.21.15.2:0/2879679404 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5415+0+0 (secure 0 0 0) 0x7f6d60021070 con 0x7f6d6406f580 2023-11-26T07:14:57.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.773+0000 7f6d69419700 1 --2- 172.21.15.2:0/2879679404 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6d4806b470 0x7f6d4806d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:57.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.773+0000 7f6d69419700 1 --2- 172.21.15.2:0/2879679404 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6d4806b470 0x7f6d4806d930 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6d640afe90 tx=0x7f6d54009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:57.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.777+0000 7f6d59ffb700 1 -- 172.21.15.2:0/2879679404 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6d60056020 con 0x7f6d6406f580 2023-11-26T07:14:57.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:57.981+0000 7f6d6b67d700 1 -- 172.21.15.2:0/2879679404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6d640b38c0 con 0x7f6d6406f580 2023-11-26T07:14:58.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.614+0000 7f6d59ffb700 1 -- 172.21.15.2:0/2879679404 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v52) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6d60059640 con 0x7f6d6406f580 2023-11-26T07:14:58.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.617+0000 7f6d6b67d700 1 -- 172.21.15.2:0/2879679404 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6d4806b470 msgr2=0x7f6d4806d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:58.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.617+0000 7f6d6b67d700 1 --2- 172.21.15.2:0/2879679404 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6d4806b470 0x7f6d4806d930 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6d640afe90 tx=0x7f6d54009210 comp rx=0 tx=0).stop 2023-11-26T07:14:58.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.617+0000 7f6d6b67d700 1 -- 172.21.15.2:0/2879679404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d6406f580 msgr2=0x7f6d6415c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:58.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.617+0000 7f6d6b67d700 1 --2- 172.21.15.2:0/2879679404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d6406f580 0x7f6d6415c370 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f6d600090b0 tx=0x7f6d60004750 comp rx=0 tx=0).stop 2023-11-26T07:14:58.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.617+0000 7f6d6b67d700 1 -- 172.21.15.2:0/2879679404 shutdown_connections 2023-11-26T07:14:58.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.617+0000 7f6d6b67d700 1 --2- 172.21.15.2:0/2879679404 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6d4806b470 0x7f6d4806d930 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:58.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.617+0000 7f6d6b67d700 1 --2- 172.21.15.2:0/2879679404 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d641457b0 0x7f6d6415c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:58.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.617+0000 7f6d6b67d700 1 --2- 172.21.15.2:0/2879679404 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d6406e910 0x7f6d6415af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:58.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.617+0000 7f6d6b67d700 1 --2- 172.21.15.2:0/2879679404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d6406f580 0x7f6d6415c370 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:58.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.617+0000 7f6d6b67d700 1 -- 172.21.15.2:0/2879679404 >> 172.21.15.2:0/2879679404 conn(0x7f6d640b2760 msgr2=0x7f6d6406b860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:58.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.617+0000 7f6d6b67d700 1 -- 172.21.15.2:0/2879679404 shutdown_connections 2023-11-26T07:14:58.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.617+0000 7f6d6b67d700 1 -- 172.21.15.2:0/2879679404 wait complete. 2023-11-26T07:14:58.620 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' removed 2023-11-26T07:14:58.632 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/volumes/snapshot_clone_delay 2023-11-26T07:14:58.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.761+0000 7fc166bad700 1 Processor -- start 2023-11-26T07:14:58.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.761+0000 7fc166bad700 1 -- start start 2023-11-26T07:14:58.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.762+0000 7fc166bad700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc1600af980 0x7fc160066ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:58.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.762+0000 7fc166bad700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc16006b7c0 0x7fc16006bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:58.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.762+0000 7fc166bad700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1600b10c0 con 0x7fc16015bf10 2023-11-26T07:14:58.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.762+0000 7fc166bad700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc16006c190 con 0x7fc1600af980 2023-11-26T07:14:58.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.762+0000 7fc166bad700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1600af730 con 0x7fc16006b7c0 2023-11-26T07:14:58.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.762+0000 7fc16514a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc16006b7c0 0x7fc16006bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:58.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.763+0000 7fc15ffff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc1600af980 0x7fc160066ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:58.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.763+0000 7fc16514a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc16006b7c0 0x7fc16006bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.2:40854/0 (socket says 172.21.15.2:40854) 2023-11-26T07:14:58.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.763+0000 7fc16514a700 1 -- 172.21.15.2:0/1586746429 learned_addr learned my addr 172.21.15.2:0/1586746429 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:58.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.763+0000 7fc164949700 1 --1- 172.21.15.2:0/1586746429 >> v1:172.21.15.192:6789/0 conn(0x7fc16015bf10 0x7fc1600b1550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.2:41350/0 (socket says 172.21.15.2:41350) 2023-11-26T07:14:58.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.763+0000 7fc16514a700 1 -- 172.21.15.2:0/1586746429 >> v2:172.21.15.192:3300/0 conn(0x7fc1600af980 msgr2=0x7fc160066ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:58.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.763+0000 7fc16514a700 1 --2- 172.21.15.2:0/1586746429 >> v2:172.21.15.192:3300/0 conn(0x7fc1600af980 0x7fc160066ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:58.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.763+0000 7fc16514a700 1 -- 172.21.15.2:0/1586746429 >> v1:172.21.15.192:6789/0 conn(0x7fc16015bf10 legacy=0x7fc1600b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:58.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.763+0000 7fc16514a700 1 -- 172.21.15.2:0/1586746429 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1600b1c60 con 0x7fc16006b7c0 2023-11-26T07:14:58.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.763+0000 7fc15ffff700 1 --2- 172.21.15.2:0/1586746429 >> v2:172.21.15.192:3300/0 conn(0x7fc1600af980 0x7fc160066ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:14:58.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.763+0000 7fc16514a700 1 --2- 172.21.15.2:0/1586746429 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc16006b7c0 0x7fc16006bc50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc158009e50 tx=0x7fc15800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=828a75729622e2b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:58.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.763+0000 7fc15f7fe700 1 -- 172.21.15.2:0/1586746429 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15800e070 con 0x7fc16006b7c0 2023-11-26T07:14:58.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.763+0000 7fc15f7fe700 1 -- 172.21.15.2:0/1586746429 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc15800b910 con 0x7fc16006b7c0 2023-11-26T07:14:58.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.763+0000 7fc15f7fe700 1 -- 172.21.15.2:0/1586746429 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15800bcc0 con 0x7fc16006b7c0 2023-11-26T07:14:58.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.764+0000 7fc166bad700 1 -- 172.21.15.2:0/1586746429 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc16006b7c0 msgr2=0x7fc16006bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:58.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.764+0000 7fc166bad700 1 --2- 172.21.15.2:0/1586746429 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc16006b7c0 0x7fc16006bc50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc158009e50 tx=0x7fc15800b330 comp rx=0 tx=0).stop 2023-11-26T07:14:58.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.764+0000 7fc166bad700 1 -- 172.21.15.2:0/1586746429 shutdown_connections 2023-11-26T07:14:58.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.764+0000 7fc166bad700 1 --2- 172.21.15.2:0/1586746429 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc16006b7c0 0x7fc16006bc50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:58.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.764+0000 7fc166bad700 1 --2- 172.21.15.2:0/1586746429 >> v2:172.21.15.192:3300/0 conn(0x7fc1600af980 0x7fc160066ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:58.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.764+0000 7fc166bad700 1 -- 172.21.15.2:0/1586746429 >> 172.21.15.2:0/1586746429 conn(0x7fc1600b5070 msgr2=0x7fc1600b5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:58.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.764+0000 7fc166bad700 1 -- 172.21.15.2:0/1586746429 shutdown_connections 2023-11-26T07:14:58.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.764+0000 7fc166bad700 1 -- 172.21.15.2:0/1586746429 wait complete. 2023-11-26T07:14:58.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.765+0000 7fc166bad700 1 Processor -- start 2023-11-26T07:14:58.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.765+0000 7fc166bad700 1 -- start start 2023-11-26T07:14:58.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.766+0000 7fc166bad700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc16006b7c0 0x7fc1601f5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:58.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.766+0000 7fc166bad700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc1600af980 0x7fc16009a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:58.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.766+0000 7fc166bad700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc16015bf10 0x7fc16009c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:58.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.766+0000 7fc166bad700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16009a7b0 con 0x7fc16006b7c0 2023-11-26T07:14:58.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.766+0000 7fc166bad700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16009aa80 con 0x7fc1600af980 2023-11-26T07:14:58.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.766+0000 7fc166bad700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc16009ad60 con 0x7fc16015bf10 2023-11-26T07:14:58.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.766+0000 7fc164949700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc16006b7c0 0x7fc1601f5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:58.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.766+0000 7fc164949700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc16006b7c0 0x7fc1601f5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42776/0 (socket says 172.21.15.2:42776) 2023-11-26T07:14:58.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.766+0000 7fc164949700 1 -- 172.21.15.2:0/2513222004 learned_addr learned my addr 172.21.15.2:0/2513222004 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:58.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.766+0000 7fc16514a700 1 --2- 172.21.15.2:0/2513222004 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc16015bf10 0x7fc16009c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:58.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.766+0000 7fc15ffff700 1 --2- 172.21.15.2:0/2513222004 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc1600af980 0x7fc16009a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:58.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.766+0000 7fc164949700 1 -- 172.21.15.2:0/2513222004 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc16015bf10 msgr2=0x7fc16009c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:58.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.766+0000 7fc164949700 1 --2- 172.21.15.2:0/2513222004 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc16015bf10 0x7fc16009c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:58.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.766+0000 7fc164949700 1 -- 172.21.15.2:0/2513222004 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc1600af980 msgr2=0x7fc16009a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:58.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.766+0000 7fc164949700 1 --2- 172.21.15.2:0/2513222004 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc1600af980 0x7fc16009a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:58.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.766+0000 7fc164949700 1 -- 172.21.15.2:0/2513222004 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc14c0094a0 con 0x7fc16006b7c0 2023-11-26T07:14:58.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.767+0000 7fc164949700 1 --2- 172.21.15.2:0/2513222004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc16006b7c0 0x7fc1601f5780 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fc15400c430 tx=0x7fc15400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:58.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.767+0000 7fc15d7fa700 1 -- 172.21.15.2:0/2513222004 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc154005cb0 con 0x7fc16006b7c0 2023-11-26T07:14:58.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.767+0000 7fc15d7fa700 1 -- 172.21.15.2:0/2513222004 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc154005e10 con 0x7fc16006b7c0 2023-11-26T07:14:58.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.767+0000 7fc166bad700 1 -- 172.21.15.2:0/2513222004 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc158009b30 con 0x7fc16006b7c0 2023-11-26T07:14:58.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.767+0000 7fc15d7fa700 1 -- 172.21.15.2:0/2513222004 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1540072d0 con 0x7fc16006b7c0 2023-11-26T07:14:58.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.767+0000 7fc166bad700 1 -- 172.21.15.2:0/2513222004 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc16009b320 con 0x7fc16006b7c0 2023-11-26T07:14:58.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.768+0000 7fc166bad700 1 -- 172.21.15.2:0/2513222004 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc160075480 con 0x7fc16006b7c0 2023-11-26T07:14:58.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.768+0000 7fc15d7fa700 1 -- 172.21.15.2:0/2513222004 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7fc154007430 con 0x7fc16006b7c0 2023-11-26T07:14:58.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.769+0000 7fc15d7fa700 1 --2- 172.21.15.2:0/2513222004 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc14406b470 0x7fc14406d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:58.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.769+0000 7fc15d7fa700 1 -- 172.21.15.2:0/2513222004 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc154089010 con 0x7fc16006b7c0 2023-11-26T07:14:58.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.769+0000 7fc15ffff700 1 --2- 172.21.15.2:0/2513222004 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc14406b470 0x7fc14406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:58.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.769+0000 7fc15ffff700 1 --2- 172.21.15.2:0/2513222004 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc14406b470 0x7fc14406d930 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc16015b920 tx=0x7fc14c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:58.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.773+0000 7fc15d7fa700 1 -- 172.21.15.2:0/2513222004 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc154053c00 con 0x7fc16006b7c0 2023-11-26T07:14:58.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.985+0000 7fc166bad700 1 -- 172.21.15.2:0/2513222004 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_delay"} v 0) v1 -- 0x7fc16006e980 con 0x7fc16006b7c0 2023-11-26T07:14:58.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.989+0000 7fc15d7fa700 1 -- 172.21.15.2:0/2513222004 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_delay"}]=0 v16) v1 ==== 115+0+0 (secure 0 0 0) 0x7fc154017020 con 0x7fc16006b7c0 2023-11-26T07:14:58.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.991+0000 7fc166bad700 1 -- 172.21.15.2:0/2513222004 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc14406b470 msgr2=0x7fc14406d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:58.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.991+0000 7fc166bad700 1 --2- 172.21.15.2:0/2513222004 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc14406b470 0x7fc14406d930 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc16015b920 tx=0x7fc14c008040 comp rx=0 tx=0).stop 2023-11-26T07:14:58.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.991+0000 7fc166bad700 1 -- 172.21.15.2:0/2513222004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc16006b7c0 msgr2=0x7fc1601f5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:58.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.991+0000 7fc166bad700 1 --2- 172.21.15.2:0/2513222004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc16006b7c0 0x7fc1601f5780 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fc15400c430 tx=0x7fc15400c7f0 comp rx=0 tx=0).stop 2023-11-26T07:14:58.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.991+0000 7fc166bad700 1 -- 172.21.15.2:0/2513222004 shutdown_connections 2023-11-26T07:14:58.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.991+0000 7fc166bad700 1 --2- 172.21.15.2:0/2513222004 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc14406b470 0x7fc14406d930 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:58.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.991+0000 7fc166bad700 1 --2- 172.21.15.2:0/2513222004 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc16015bf10 0x7fc16009c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:58.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.991+0000 7fc166bad700 1 --2- 172.21.15.2:0/2513222004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc16006b7c0 0x7fc1601f5780 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:58.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.991+0000 7fc166bad700 1 --2- 172.21.15.2:0/2513222004 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc1600af980 0x7fc16009a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:58.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.991+0000 7fc166bad700 1 -- 172.21.15.2:0/2513222004 >> 172.21.15.2:0/2513222004 conn(0x7fc1600b5070 msgr2=0x7fc16015a070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:58.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.991+0000 7fc166bad700 1 -- 172.21.15.2:0/2513222004 shutdown_connections 2023-11-26T07:14:58.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:58.991+0000 7fc166bad700 1 -- 172.21.15.2:0/2513222004 wait complete. 2023-11-26T07:14:59.005 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-26T07:14:59.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.129+0000 7ff37a893700 1 Processor -- start 2023-11-26T07:14:59.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.129+0000 7ff37a893700 1 -- start start 2023-11-26T07:14:59.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.130+0000 7ff37a893700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff3740b4150 0x7ff37406de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:59.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.130+0000 7ff37a893700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff3740b5ab0 0x7ff37406e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:59.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.130+0000 7ff37a893700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff374071f50 con 0x7ff37406b620 2023-11-26T07:14:59.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.130+0000 7ff37a893700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff374072230 con 0x7ff3740b5ab0 2023-11-26T07:14:59.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.130+0000 7ff37a893700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff374072510 con 0x7ff3740b4150 2023-11-26T07:14:59.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.130+0000 7ff378e30700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff3740b5ab0 0x7ff37406e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:59.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.130+0000 7ff378e30700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff3740b5ab0 0x7ff37406e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42788/0 (socket says 172.21.15.2:42788) 2023-11-26T07:14:59.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.130+0000 7ff378e30700 1 -- 172.21.15.2:0/469356480 learned_addr learned my addr 172.21.15.2:0/469356480 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:59.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.131+0000 7ff3737fe700 1 --2- 172.21.15.2:0/469356480 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff3740b4150 0x7ff37406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:59.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.131+0000 7ff378e30700 1 -- 172.21.15.2:0/469356480 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff3740b4150 msgr2=0x7ff37406de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:59.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.131+0000 7ff378e30700 1 --2- 172.21.15.2:0/469356480 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff3740b4150 0x7ff37406de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:59.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.131+0000 7ff378e30700 1 -- 172.21.15.2:0/469356480 >> v1:172.21.15.192:6789/0 conn(0x7ff37406b620 legacy=0x7ff3740b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:59.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.131+0000 7ff378e30700 1 -- 172.21.15.2:0/469356480 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3740727f0 con 0x7ff3740b5ab0 2023-11-26T07:14:59.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.131+0000 7ff3737fe700 1 --2- 172.21.15.2:0/469356480 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff3740b4150 0x7ff37406de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:14:59.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.131+0000 7ff378e30700 1 --2- 172.21.15.2:0/469356480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3740b5ab0 0x7ff37406e390 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7ff36c009e50 tx=0x7ff36c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1de51d00621203f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:59.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.131+0000 7ff372ffd700 1 -- 172.21.15.2:0/469356480 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36c00e070 con 0x7ff3740b5ab0 2023-11-26T07:14:59.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.131+0000 7ff372ffd700 1 -- 172.21.15.2:0/469356480 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36c00b9c0 con 0x7ff3740b5ab0 2023-11-26T07:14:59.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.131+0000 7ff372ffd700 1 -- 172.21.15.2:0/469356480 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36c00bd70 con 0x7ff3740b5ab0 2023-11-26T07:14:59.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.132+0000 7ff37a893700 1 -- 172.21.15.2:0/469356480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3740b5ab0 msgr2=0x7ff37406e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:59.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.132+0000 7ff37a893700 1 --2- 172.21.15.2:0/469356480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3740b5ab0 0x7ff37406e390 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7ff36c009e50 tx=0x7ff36c00b330 comp rx=0 tx=0).stop 2023-11-26T07:14:59.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.132+0000 7ff37a893700 1 -- 172.21.15.2:0/469356480 shutdown_connections 2023-11-26T07:14:59.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.132+0000 7ff37a893700 1 --2- 172.21.15.2:0/469356480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3740b5ab0 0x7ff37406e390 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:59.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.132+0000 7ff37a893700 1 --2- 172.21.15.2:0/469356480 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff3740b4150 0x7ff37406de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:59.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.132+0000 7ff37a893700 1 -- 172.21.15.2:0/469356480 >> 172.21.15.2:0/469356480 conn(0x7ff3740b2740 msgr2=0x7ff3740b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:59.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.132+0000 7ff37a893700 1 -- 172.21.15.2:0/469356480 shutdown_connections 2023-11-26T07:14:59.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.132+0000 7ff37a893700 1 -- 172.21.15.2:0/469356480 wait complete. 2023-11-26T07:14:59.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.133+0000 7ff37a893700 1 Processor -- start 2023-11-26T07:14:59.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.133+0000 7ff37a893700 1 -- start start 2023-11-26T07:14:59.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.134+0000 7ff37a893700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff37406b620 0x7ff3741f3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:59.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.134+0000 7ff37a893700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff3740b4150 0x7ff37413f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:59.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.134+0000 7ff37a893700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3740b5ab0 0x7ff37413f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:59.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.134+0000 7ff37a893700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3741400c0 con 0x7ff3740b5ab0 2023-11-26T07:14:59.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.134+0000 7ff37a893700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3741403a0 con 0x7ff37406b620 2023-11-26T07:14:59.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.134+0000 7ff37a893700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff374140680 con 0x7ff3740b4150 2023-11-26T07:14:59.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.134+0000 7ff378e30700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3740b5ab0 0x7ff37413f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:59.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.134+0000 7ff378e30700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3740b5ab0 0x7ff37413f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42794/0 (socket says 172.21.15.2:42794) 2023-11-26T07:14:59.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.134+0000 7ff378e30700 1 -- 172.21.15.2:0/11788440 learned_addr learned my addr 172.21.15.2:0/11788440 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:59.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.134+0000 7ff3737fe700 1 --2- 172.21.15.2:0/11788440 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff3740b4150 0x7ff37413f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:59.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.134+0000 7ff373fff700 1 --2- 172.21.15.2:0/11788440 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff37406b620 0x7ff3741f3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:59.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.134+0000 7ff378e30700 1 -- 172.21.15.2:0/11788440 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff3740b4150 msgr2=0x7ff37413f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:59.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.134+0000 7ff378e30700 1 --2- 172.21.15.2:0/11788440 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff3740b4150 0x7ff37413f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:59.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.134+0000 7ff378e30700 1 -- 172.21.15.2:0/11788440 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff37406b620 msgr2=0x7ff3741f3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:59.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.134+0000 7ff378e30700 1 --2- 172.21.15.2:0/11788440 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff37406b620 0x7ff3741f3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:59.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.134+0000 7ff378e30700 1 -- 172.21.15.2:0/11788440 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff36c009b30 con 0x7ff3740b5ab0 2023-11-26T07:14:59.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.134+0000 7ff378e30700 1 --2- 172.21.15.2:0/11788440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3740b5ab0 0x7ff37413f880 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7ff36c012000 tx=0x7ff36c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:59.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.135+0000 7ff370ff9700 1 -- 172.21.15.2:0/11788440 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36c004800 con 0x7ff3740b5ab0 2023-11-26T07:14:59.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.135+0000 7ff370ff9700 1 -- 172.21.15.2:0/11788440 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36c004960 con 0x7ff3740b5ab0 2023-11-26T07:14:59.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.135+0000 7ff37a893700 1 -- 172.21.15.2:0/11788440 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff374140960 con 0x7ff3740b5ab0 2023-11-26T07:14:59.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.135+0000 7ff370ff9700 1 -- 172.21.15.2:0/11788440 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36c01c680 con 0x7ff3740b5ab0 2023-11-26T07:14:59.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.135+0000 7ff37a893700 1 -- 172.21.15.2:0/11788440 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff37413fdc0 con 0x7ff3740b5ab0 2023-11-26T07:14:59.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.136+0000 7ff37a893700 1 -- 172.21.15.2:0/11788440 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff374075480 con 0x7ff3740b5ab0 2023-11-26T07:14:59.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.136+0000 7ff370ff9700 1 -- 172.21.15.2:0/11788440 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7ff36c01c7e0 con 0x7ff3740b5ab0 2023-11-26T07:14:59.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.137+0000 7ff370ff9700 1 --2- 172.21.15.2:0/11788440 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff35406b470 0x7ff35406d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:59.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.137+0000 7ff370ff9700 1 -- 172.21.15.2:0/11788440 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff36c08b9b0 con 0x7ff3740b5ab0 2023-11-26T07:14:59.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.137+0000 7ff373fff700 1 --2- 172.21.15.2:0/11788440 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff35406b470 0x7ff35406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:59.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.137+0000 7ff373fff700 1 --2- 172.21.15.2:0/11788440 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff35406b470 0x7ff35406d930 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff35c007fd0 tx=0x7ff35c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:59.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.141+0000 7ff370ff9700 1 -- 172.21.15.2:0/11788440 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff36c056470 con 0x7ff3740b5ab0 2023-11-26T07:14:59.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.340+0000 7ff37a893700 1 -- 172.21.15.2:0/11788440 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff37406e540 con 0x7ff3740b5ab0 2023-11-26T07:14:59.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.343+0000 7ff370ff9700 1 -- 172.21.15.2:0/11788440 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff36c059a90 con 0x7ff3740b5ab0 2023-11-26T07:14:59.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.345+0000 7ff37a893700 1 -- 172.21.15.2:0/11788440 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff35406b470 msgr2=0x7ff35406d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:59.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.345+0000 7ff37a893700 1 --2- 172.21.15.2:0/11788440 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff35406b470 0x7ff35406d930 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff35c007fd0 tx=0x7ff35c009040 comp rx=0 tx=0).stop 2023-11-26T07:14:59.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.345+0000 7ff37a893700 1 -- 172.21.15.2:0/11788440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3740b5ab0 msgr2=0x7ff37413f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:59.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.345+0000 7ff37a893700 1 --2- 172.21.15.2:0/11788440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3740b5ab0 0x7ff37413f880 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7ff36c012000 tx=0x7ff36c004ad0 comp rx=0 tx=0).stop 2023-11-26T07:14:59.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.345+0000 7ff37a893700 1 -- 172.21.15.2:0/11788440 shutdown_connections 2023-11-26T07:14:59.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.345+0000 7ff37a893700 1 --2- 172.21.15.2:0/11788440 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff35406b470 0x7ff35406d930 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:59.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.345+0000 7ff37a893700 1 --2- 172.21.15.2:0/11788440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3740b5ab0 0x7ff37413f880 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:59.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.345+0000 7ff37a893700 1 --2- 172.21.15.2:0/11788440 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff37406b620 0x7ff3741f3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:59.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.345+0000 7ff37a893700 1 --2- 172.21.15.2:0/11788440 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff3740b4150 0x7ff37413f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:59.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.345+0000 7ff37a893700 1 -- 172.21.15.2:0/11788440 >> 172.21.15.2:0/11788440 conn(0x7ff3740b2740 msgr2=0x7ff3740afe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:59.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.345+0000 7ff37a893700 1 -- 172.21.15.2:0/11788440 shutdown_connections 2023-11-26T07:14:59.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.345+0000 7ff37a893700 1 -- 172.21.15.2:0/11788440 wait complete. 2023-11-26T07:14:59.359 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_in_progress_cancelled' 2023-11-26T07:14:59.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.482+0000 7f2489a66700 1 Processor -- start 2023-11-26T07:14:59.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.482+0000 7f2489a66700 1 -- start start 2023-11-26T07:14:59.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.483+0000 7f2489a66700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f248415bde0 0x7f248415c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:59.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.483+0000 7f2489a66700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f24840ce5c0 0x7f24840cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:59.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.483+0000 7f2489a66700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24840d0a90 con 0x7f24840cf2b0 2023-11-26T07:14:59.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.483+0000 7f2489a66700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24840cef70 con 0x7f248415bde0 2023-11-26T07:14:59.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.483+0000 7f2489a66700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f248406ee10 con 0x7f24840ce5c0 2023-11-26T07:14:59.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.483+0000 7f24837fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f248415bde0 0x7f248415c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:59.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.483+0000 7f2482ffd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f24840cf2b0 0x7f24840d01b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34008/0 (socket says 172.21.15.2:34008) 2023-11-26T07:14:59.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.483+0000 7f24837fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f248415bde0 0x7f248415c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42798/0 (socket says 172.21.15.2:42798) 2023-11-26T07:14:59.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.483+0000 7f2482ffd700 1 -- 172.21.15.2:0/637933281 learned_addr learned my addr 172.21.15.2:0/637933281 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:14:59.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.483+0000 7f2483fff700 1 --2- 172.21.15.2:0/637933281 >> v2:172.21.15.192:3300/0 conn(0x7f24840ce5c0 0x7f24840cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:59.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.483+0000 7f24837fe700 1 -- 172.21.15.2:0/637933281 >> v2:172.21.15.192:3300/0 conn(0x7f24840ce5c0 msgr2=0x7f24840cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:14:59.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.483+0000 7f24837fe700 1 --2- 172.21.15.2:0/637933281 >> v2:172.21.15.192:3300/0 conn(0x7f24840ce5c0 0x7f24840cea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:59.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.483+0000 7f24837fe700 1 -- 172.21.15.2:0/637933281 >> v1:172.21.15.2:6789/0 conn(0x7f24840cf2b0 legacy=0x7f24840d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:59.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.484+0000 7f24837fe700 1 -- 172.21.15.2:0/637933281 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f248406f0f0 con 0x7f248415bde0 2023-11-26T07:14:59.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.483+0000 7f24827fc700 1 -- 172.21.15.2:0/637933281 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2722320543 0 0) 0x7f24840d0a90 con 0x7f24840cf2b0 2023-11-26T07:14:59.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.484+0000 7f24837fe700 1 --2- 172.21.15.2:0/637933281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f248415bde0 0x7f248415c1c0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f2484068360 tx=0x7f2474009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4e7e07b72e9e38c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:59.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.484+0000 7f24827fc700 1 -- 172.21.15.2:0/637933281 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2474011830 con 0x7f248415bde0 2023-11-26T07:14:59.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.484+0000 7f24827fc700 1 -- 172.21.15.2:0/637933281 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2474011990 con 0x7f248415bde0 2023-11-26T07:14:59.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.484+0000 7f24827fc700 1 -- 172.21.15.2:0/637933281 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2474011d20 con 0x7f248415bde0 2023-11-26T07:14:59.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.484+0000 7f2489a66700 1 -- 172.21.15.2:0/637933281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f248415bde0 msgr2=0x7f248415c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:59.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.484+0000 7f2489a66700 1 --2- 172.21.15.2:0/637933281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f248415bde0 0x7f248415c1c0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f2484068360 tx=0x7f2474009b20 comp rx=0 tx=0).stop 2023-11-26T07:14:59.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.484+0000 7f2489a66700 1 -- 172.21.15.2:0/637933281 shutdown_connections 2023-11-26T07:14:59.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.484+0000 7f2489a66700 1 --2- 172.21.15.2:0/637933281 >> v2:172.21.15.192:3300/0 conn(0x7f24840ce5c0 0x7f24840cea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:59.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.484+0000 7f2489a66700 1 --2- 172.21.15.2:0/637933281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f248415bde0 0x7f248415c1c0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:59.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.484+0000 7f2489a66700 1 -- 172.21.15.2:0/637933281 >> 172.21.15.2:0/637933281 conn(0x7f24840b3720 msgr2=0x7f24840b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:14:59.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.484+0000 7f2489a66700 1 -- 172.21.15.2:0/637933281 shutdown_connections 2023-11-26T07:14:59.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.484+0000 7f2489a66700 1 -- 172.21.15.2:0/637933281 wait complete. 2023-11-26T07:14:59.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.486+0000 7f2489a66700 1 Processor -- start 2023-11-26T07:14:59.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.486+0000 7f2489a66700 1 -- start start 2023-11-26T07:14:59.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.486+0000 7f2489a66700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24840ce5c0 0x7f248415ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:59.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.486+0000 7f2489a66700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24840cf2b0 0x7f24840b4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:59.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.487+0000 7f2489a66700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f248415bde0 0x7f248415a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:59.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.487+0000 7f2489a66700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24840b76e0 con 0x7f24840cf2b0 2023-11-26T07:14:59.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.487+0000 7f2489a66700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24840b6410 con 0x7f248415bde0 2023-11-26T07:14:59.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.487+0000 7f2489a66700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24840b6640 con 0x7f24840ce5c0 2023-11-26T07:14:59.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.487+0000 7f2482ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24840cf2b0 0x7f24840b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:59.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.487+0000 7f2482ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24840cf2b0 0x7f24840b4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42806/0 (socket says 172.21.15.2:42806) 2023-11-26T07:14:59.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.487+0000 7f2482ffd700 1 -- 172.21.15.2:0/3282411084 learned_addr learned my addr 172.21.15.2:0/3282411084 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:14:59.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.487+0000 7f2483fff700 1 --2- 172.21.15.2:0/3282411084 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f248415bde0 0x7f248415a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:59.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.487+0000 7f24837fe700 1 --2- 172.21.15.2:0/3282411084 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24840ce5c0 0x7f248415ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:59.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.487+0000 7f2482ffd700 1 -- 172.21.15.2:0/3282411084 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24840ce5c0 msgr2=0x7f248415ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:59.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.487+0000 7f2482ffd700 1 --2- 172.21.15.2:0/3282411084 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24840ce5c0 0x7f248415ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:59.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.487+0000 7f2482ffd700 1 -- 172.21.15.2:0/3282411084 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f248415bde0 msgr2=0x7f248415a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:14:59.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.487+0000 7f2482ffd700 1 --2- 172.21.15.2:0/3282411084 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f248415bde0 0x7f248415a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:14:59.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.487+0000 7f2482ffd700 1 -- 172.21.15.2:0/3282411084 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24740094a0 con 0x7f24840cf2b0 2023-11-26T07:14:59.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.487+0000 7f2482ffd700 1 --2- 172.21.15.2:0/3282411084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24840cf2b0 0x7f24840b4810 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f246c00c540 tx=0x7f246c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:59.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.487+0000 7f247bfff700 1 -- 172.21.15.2:0/3282411084 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246c004c80 con 0x7f24840cf2b0 2023-11-26T07:14:59.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.487+0000 7f247bfff700 1 -- 172.21.15.2:0/3282411084 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f246c004de0 con 0x7f24840cf2b0 2023-11-26T07:14:59.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.487+0000 7f247bfff700 1 -- 172.21.15.2:0/3282411084 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246c007310 con 0x7f24840cf2b0 2023-11-26T07:14:59.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.487+0000 7f2489a66700 1 -- 172.21.15.2:0/3282411084 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24840b6920 con 0x7f24840cf2b0 2023-11-26T07:14:59.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.487+0000 7f2489a66700 1 -- 172.21.15.2:0/3282411084 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24840b6ee0 con 0x7f24840cf2b0 2023-11-26T07:14:59.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.488+0000 7f2489a66700 1 -- 172.21.15.2:0/3282411084 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2484068670 con 0x7f24840cf2b0 2023-11-26T07:14:59.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.489+0000 7f247bfff700 1 -- 172.21.15.2:0/3282411084 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f246c007470 con 0x7f24840cf2b0 2023-11-26T07:14:59.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.489+0000 7f247bfff700 1 --2- 172.21.15.2:0/3282411084 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f246406b470 0x7f246406d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:14:59.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.489+0000 7f247bfff700 1 -- 172.21.15.2:0/3282411084 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f246c0899d0 con 0x7f24840cf2b0 2023-11-26T07:14:59.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.490+0000 7f24837fe700 1 --2- 172.21.15.2:0/3282411084 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f246406b470 0x7f246406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:14:59.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.490+0000 7f24837fe700 1 --2- 172.21.15.2:0/3282411084 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f246406b470 0x7f246406d930 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f24740090b0 tx=0x7f247401c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:14:59.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.494+0000 7f247bfff700 1 -- 172.21.15.2:0/3282411084 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f246c0544d0 con 0x7f24840cf2b0 2023-11-26T07:14:59.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:14:59.780+0000 7f2489a66700 1 -- 172.21.15.2:0/3282411084 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_in_progress_cancelled"]} v 0) v1 -- 0x7f24840af550 con 0x7f24840cf2b0 2023-11-26T07:15:00.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.620+0000 7f247bfff700 1 -- 172.21.15.2:0/3282411084 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_in_progress_cancelled"]}]=0 v186) v1 ==== 180+0+0 (secure 0 0 0) 0x7f246c057af0 con 0x7f24840cf2b0 2023-11-26T07:15:00.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.623+0000 7f2489a66700 1 -- 172.21.15.2:0/3282411084 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f246406b470 msgr2=0x7f246406d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:00.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.623+0000 7f2489a66700 1 --2- 172.21.15.2:0/3282411084 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f246406b470 0x7f246406d930 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f24740090b0 tx=0x7f247401c040 comp rx=0 tx=0).stop 2023-11-26T07:15:00.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.623+0000 7f2489a66700 1 -- 172.21.15.2:0/3282411084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24840cf2b0 msgr2=0x7f24840b4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:00.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.623+0000 7f2489a66700 1 --2- 172.21.15.2:0/3282411084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24840cf2b0 0x7f24840b4810 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f246c00c540 tx=0x7f246c00c850 comp rx=0 tx=0).stop 2023-11-26T07:15:00.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.623+0000 7f2489a66700 1 -- 172.21.15.2:0/3282411084 shutdown_connections 2023-11-26T07:15:00.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.623+0000 7f2489a66700 1 --2- 172.21.15.2:0/3282411084 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f246406b470 0x7f246406d930 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:00.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.623+0000 7f2489a66700 1 --2- 172.21.15.2:0/3282411084 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f248415bde0 0x7f248415a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:00.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.623+0000 7f2489a66700 1 --2- 172.21.15.2:0/3282411084 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24840ce5c0 0x7f248415ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:00.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.623+0000 7f2489a66700 1 --2- 172.21.15.2:0/3282411084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24840cf2b0 0x7f24840b4810 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:00.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.623+0000 7f2489a66700 1 -- 172.21.15.2:0/3282411084 >> 172.21.15.2:0/3282411084 conn(0x7f24840b3720 msgr2=0x7f24840b0490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:00.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.623+0000 7f2489a66700 1 -- 172.21.15.2:0/3282411084 shutdown_connections 2023-11-26T07:15:00.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.623+0000 7f2489a66700 1 -- 172.21.15.2:0/3282411084 wait complete. 2023-11-26T07:15:00.640 INFO:tasks.cephfs_test_runner:ensure failure status is shown when clone is cancelled during in-progress state and validate the reason ... ok 2023-11-26T07:15:00.640 INFO:tasks.cephfs_test_runner:Starting test: test_clone_failure_status_pending_cancelled (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) ensure failure status is shown when clone is cancelled during pending state and validate the reason 2023-11-26T07:15:00.640 INFO:tasks.cephfs_test_runner:test_clone_failure_status_pending_cancelled (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2023-11-26T07:15:00.641 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:15:00.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.772+0000 7faf504e7700 1 Processor -- start 2023-11-26T07:15:00.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.772+0000 7faf504e7700 1 -- start start 2023-11-26T07:15:00.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.773+0000 7faf504e7700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faf4815bde0 0x7faf4815c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:00.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.773+0000 7faf504e7700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf480d0a90 con 0x7faf480ce5c0 2023-11-26T07:15:00.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.773+0000 7faf504e7700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf4806ee10 con 0x7faf480cf2b0 2023-11-26T07:15:00.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.773+0000 7faf504e7700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf4806f0f0 con 0x7faf4815bde0 2023-11-26T07:15:00.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.773+0000 7faf4e283700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faf4815bde0 0x7faf4815c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:00.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.773+0000 7faf4e283700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faf4815bde0 0x7faf4815c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42812/0 (socket says 172.21.15.2:42812) 2023-11-26T07:15:00.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.773+0000 7faf4e283700 1 -- 172.21.15.2:0/3205689251 learned_addr learned my addr 172.21.15.2:0/3205689251 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:00.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.774+0000 7faf4e283700 1 -- 172.21.15.2:0/3205689251 >> v1:172.21.15.192:6789/0 conn(0x7faf480cf2b0 legacy=0x7faf480d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:00.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.774+0000 7faf4e283700 1 -- 172.21.15.2:0/3205689251 >> v1:172.21.15.2:6789/0 conn(0x7faf480ce5c0 legacy=0x7faf4806fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:00.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.774+0000 7faf4e283700 1 -- 172.21.15.2:0/3205689251 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf4806f3d0 con 0x7faf4815bde0 2023-11-26T07:15:00.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.774+0000 7faf4e283700 1 --2- 172.21.15.2:0/3205689251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf4815bde0 0x7faf4815c1c0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7faf380098f0 tx=0x7faf38009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=addf90f5a9d04701 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:00.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.774+0000 7faf4d281700 1 -- 172.21.15.2:0/3205689251 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf38004230 con 0x7faf4815bde0 2023-11-26T07:15:00.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.774+0000 7faf4d281700 1 -- 172.21.15.2:0/3205689251 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf38004390 con 0x7faf4815bde0 2023-11-26T07:15:00.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.774+0000 7faf4d281700 1 -- 172.21.15.2:0/3205689251 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf380036a0 con 0x7faf4815bde0 2023-11-26T07:15:00.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.775+0000 7faf504e7700 1 -- 172.21.15.2:0/3205689251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf4815bde0 msgr2=0x7faf4815c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:00.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.775+0000 7faf504e7700 1 --2- 172.21.15.2:0/3205689251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf4815bde0 0x7faf4815c1c0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7faf380098f0 tx=0x7faf38009c00 comp rx=0 tx=0).stop 2023-11-26T07:15:00.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.775+0000 7faf504e7700 1 -- 172.21.15.2:0/3205689251 shutdown_connections 2023-11-26T07:15:00.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.775+0000 7faf504e7700 1 --2- 172.21.15.2:0/3205689251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf4815bde0 0x7faf4815c1c0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:00.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.775+0000 7faf504e7700 1 -- 172.21.15.2:0/3205689251 >> 172.21.15.2:0/3205689251 conn(0x7faf480b3720 msgr2=0x7faf480b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:00.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.775+0000 7faf504e7700 1 -- 172.21.15.2:0/3205689251 shutdown_connections 2023-11-26T07:15:00.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.775+0000 7faf504e7700 1 -- 172.21.15.2:0/3205689251 wait complete. 2023-11-26T07:15:00.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.776+0000 7faf504e7700 1 Processor -- start 2023-11-26T07:15:00.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.776+0000 7faf504e7700 1 -- start start 2023-11-26T07:15:00.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.777+0000 7faf504e7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf480ce5c0 0x7faf480b7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:00.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.777+0000 7faf504e7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf480cf2b0 0x7faf480b5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:00.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.777+0000 7faf504e7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf4815bde0 0x7faf480cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:00.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.777+0000 7faf504e7700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf480c8ca0 con 0x7faf4815bde0 2023-11-26T07:15:00.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.777+0000 7faf504e7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf480b5a70 con 0x7faf480ce5c0 2023-11-26T07:15:00.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.777+0000 7faf504e7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf480b5d50 con 0x7faf480cf2b0 2023-11-26T07:15:00.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.777+0000 7faf4ea84700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf4815bde0 0x7faf480cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:00.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.777+0000 7faf4ea84700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf4815bde0 0x7faf480cabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42822/0 (socket says 172.21.15.2:42822) 2023-11-26T07:15:00.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.777+0000 7faf4ea84700 1 -- 172.21.15.2:0/722818212 learned_addr learned my addr 172.21.15.2:0/722818212 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:00.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.777+0000 7faf4e283700 1 --2- 172.21.15.2:0/722818212 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf480ce5c0 0x7faf480b7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:00.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.777+0000 7faf4da82700 1 --2- 172.21.15.2:0/722818212 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf480cf2b0 0x7faf480b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:00.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.777+0000 7faf4ea84700 1 -- 172.21.15.2:0/722818212 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf480cf2b0 msgr2=0x7faf480b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:00.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.777+0000 7faf4ea84700 1 --2- 172.21.15.2:0/722818212 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf480cf2b0 0x7faf480b5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:00.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.777+0000 7faf4ea84700 1 -- 172.21.15.2:0/722818212 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf480ce5c0 msgr2=0x7faf480b7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:00.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.777+0000 7faf4ea84700 1 --2- 172.21.15.2:0/722818212 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf480ce5c0 0x7faf480b7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:00.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.777+0000 7faf4ea84700 1 -- 172.21.15.2:0/722818212 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf38009550 con 0x7faf4815bde0 2023-11-26T07:15:00.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.777+0000 7faf4e283700 1 --2- 172.21.15.2:0/722818212 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf480ce5c0 0x7faf480b7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:15:00.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.777+0000 7faf4ea84700 1 --2- 172.21.15.2:0/722818212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf4815bde0 0x7faf480cabf0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7faf4000cc50 tx=0x7faf4000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:00.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.777+0000 7faf3effd700 1 -- 172.21.15.2:0/722818212 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4000ad80 con 0x7faf4815bde0 2023-11-26T07:15:00.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.777+0000 7faf3effd700 1 -- 172.21.15.2:0/722818212 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf4000ce50 con 0x7faf4815bde0 2023-11-26T07:15:00.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.777+0000 7faf504e7700 1 -- 172.21.15.2:0/722818212 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf480b6030 con 0x7faf4815bde0 2023-11-26T07:15:00.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.777+0000 7faf3effd700 1 -- 172.21.15.2:0/722818212 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf40003c40 con 0x7faf4815bde0 2023-11-26T07:15:00.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.778+0000 7faf504e7700 1 -- 172.21.15.2:0/722818212 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf480b5760 con 0x7faf4815bde0 2023-11-26T07:15:00.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.778+0000 7faf504e7700 1 -- 172.21.15.2:0/722818212 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf4815f420 con 0x7faf4815bde0 2023-11-26T07:15:00.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.779+0000 7faf3effd700 1 -- 172.21.15.2:0/722818212 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7faf400050d0 con 0x7faf4815bde0 2023-11-26T07:15:00.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.779+0000 7faf3effd700 1 --2- 172.21.15.2:0/722818212 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7faf2c06b470 0x7faf2c06d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:00.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.779+0000 7faf3effd700 1 -- 172.21.15.2:0/722818212 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7faf40089e70 con 0x7faf4815bde0 2023-11-26T07:15:00.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.780+0000 7faf4e283700 1 --2- 172.21.15.2:0/722818212 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7faf2c06b470 0x7faf2c06d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:00.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.780+0000 7faf4e283700 1 --2- 172.21.15.2:0/722818212 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7faf2c06b470 0x7faf2c06d930 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7faf4809f310 tx=0x7faf38008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:00.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.784+0000 7faf3effd700 1 -- 172.21.15.2:0/722818212 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faf400549b0 con 0x7faf4815bde0 2023-11-26T07:15:00.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.986+0000 7faf504e7700 1 -- 172.21.15.2:0/722818212 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf480c9090 con 0x7faf4815bde0 2023-11-26T07:15:00.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.987+0000 7faf3effd700 1 -- 172.21.15.2:0/722818212 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+12940 (secure 0 0 0) 0x7faf40057fd0 con 0x7faf4815bde0 2023-11-26T07:15:00.989 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:15:00.989 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":52,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:14:58.611070+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.192:6836/2352660671":"2023-11-27T07:14:55.604237+0000","172.21.15.192:6834/2352660671":"2023-11-27T07:14:55.604237+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:15:00.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.989+0000 7faf504e7700 1 -- 172.21.15.2:0/722818212 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7faf2c06b470 msgr2=0x7faf2c06d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:00.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.989+0000 7faf504e7700 1 --2- 172.21.15.2:0/722818212 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7faf2c06b470 0x7faf2c06d930 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7faf4809f310 tx=0x7faf38008030 comp rx=0 tx=0).stop 2023-11-26T07:15:00.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.989+0000 7faf504e7700 1 -- 172.21.15.2:0/722818212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf4815bde0 msgr2=0x7faf480cabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:00.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.989+0000 7faf504e7700 1 --2- 172.21.15.2:0/722818212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf4815bde0 0x7faf480cabf0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7faf4000cc50 tx=0x7faf4000a340 comp rx=0 tx=0).stop 2023-11-26T07:15:00.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.989+0000 7faf504e7700 1 -- 172.21.15.2:0/722818212 shutdown_connections 2023-11-26T07:15:00.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.989+0000 7faf504e7700 1 --2- 172.21.15.2:0/722818212 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7faf2c06b470 0x7faf2c06d930 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:00.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.989+0000 7faf504e7700 1 --2- 172.21.15.2:0/722818212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf4815bde0 0x7faf480cabf0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:00.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.989+0000 7faf504e7700 1 --2- 172.21.15.2:0/722818212 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf480ce5c0 0x7faf480b7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:00.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.989+0000 7faf504e7700 1 --2- 172.21.15.2:0/722818212 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf480cf2b0 0x7faf480b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:00.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.989+0000 7faf504e7700 1 -- 172.21.15.2:0/722818212 >> 172.21.15.2:0/722818212 conn(0x7faf480b3720 msgr2=0x7faf480cc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:00.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.989+0000 7faf504e7700 1 -- 172.21.15.2:0/722818212 shutdown_connections 2023-11-26T07:15:00.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:00.989+0000 7faf504e7700 1 -- 172.21.15.2:0/722818212 wait complete. 2023-11-26T07:15:01.003 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:11:28.205739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:15:01.004 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:15:01.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.129+0000 7ff903f07700 1 Processor -- start 2023-11-26T07:15:01.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.129+0000 7ff903f07700 1 -- start start 2023-11-26T07:15:01.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.130+0000 7ff903f07700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8fc144610 0x7ff8fc0d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:01.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.130+0000 7ff903f07700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8fc06e9d0 con 0x7ff8fc15eed0 2023-11-26T07:15:01.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.130+0000 7ff903f07700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8fc06f270 con 0x7ff8fc06f700 2023-11-26T07:15:01.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.130+0000 7ff903f07700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8fc1449f0 con 0x7ff8fc144610 2023-11-26T07:15:01.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.130+0000 7ff9024a4700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff8fc15eed0 0x7ff8fc0cde80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34040/0 (socket says 172.21.15.2:34040) 2023-11-26T07:15:01.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.130+0000 7ff9024a4700 1 -- 172.21.15.2:0/2927274683 learned_addr learned my addr 172.21.15.2:0/2927274683 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:15:01.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.131+0000 7ff901ca3700 1 --2- 172.21.15.2:0/2927274683 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8fc144610 0x7ff8fc0d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:01.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.131+0000 7ff900ca1700 1 -- 172.21.15.2:0/2927274683 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3875567421 0 0) 0x7ff8fc06e9d0 con 0x7ff8fc15eed0 2023-11-26T07:15:01.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.131+0000 7ff900ca1700 1 -- 172.21.15.2:0/2927274683 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8e80035b0 con 0x7ff8fc15eed0 2023-11-26T07:15:01.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.131+0000 7ff900ca1700 1 -- 172.21.15.2:0/2927274683 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2082172369 0 0) 0x7ff8fc06f270 con 0x7ff8fc06f700 2023-11-26T07:15:01.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.131+0000 7ff900ca1700 1 -- 172.21.15.2:0/2927274683 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8fc06e9d0 con 0x7ff8fc06f700 2023-11-26T07:15:01.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.131+0000 7ff901ca3700 1 -- 172.21.15.2:0/2927274683 >> v1:172.21.15.192:6789/0 conn(0x7ff8fc06f700 legacy=0x7ff8fc15e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:01.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.131+0000 7ff901ca3700 1 -- 172.21.15.2:0/2927274683 >> v1:172.21.15.2:6789/0 conn(0x7ff8fc15eed0 legacy=0x7ff8fc0cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:01.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.131+0000 7ff900ca1700 1 -- 172.21.15.2:0/2927274683 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 52955008 0 0) 0x7ff8e80035b0 con 0x7ff8fc15eed0 2023-11-26T07:15:01.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.131+0000 7ff901ca3700 1 -- 172.21.15.2:0/2927274683 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8fc15f530 con 0x7ff8fc144610 2023-11-26T07:15:01.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.131+0000 7ff901ca3700 1 --2- 172.21.15.2:0/2927274683 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8fc144610 0x7ff8fc0d09f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec0098a0 tx=0x7ff8ec009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad4f1848924cdd6b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:01.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.131+0000 7ff900ca1700 1 -- 172.21.15.2:0/2927274683 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f40019f0 con 0x7ff8fc144610 2023-11-26T07:15:01.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.131+0000 7ff900ca1700 1 -- 172.21.15.2:0/2927274683 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8ec004030 con 0x7ff8fc144610 2023-11-26T07:15:01.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.131+0000 7ff900ca1700 1 -- 172.21.15.2:0/2927274683 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec0043a0 con 0x7ff8fc144610 2023-11-26T07:15:01.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.132+0000 7ff903f07700 1 -- 172.21.15.2:0/2927274683 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8fc144610 msgr2=0x7ff8fc0d09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:01.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.132+0000 7ff903f07700 1 --2- 172.21.15.2:0/2927274683 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8fc144610 0x7ff8fc0d09f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec0098a0 tx=0x7ff8ec009bb0 comp rx=0 tx=0).stop 2023-11-26T07:15:01.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.132+0000 7ff903f07700 1 -- 172.21.15.2:0/2927274683 shutdown_connections 2023-11-26T07:15:01.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.132+0000 7ff903f07700 1 --2- 172.21.15.2:0/2927274683 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8fc144610 0x7ff8fc0d09f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:01.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.132+0000 7ff903f07700 1 -- 172.21.15.2:0/2927274683 >> 172.21.15.2:0/2927274683 conn(0x7ff8fc0b2740 msgr2=0x7ff8fc0b2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:01.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.132+0000 7ff903f07700 1 -- 172.21.15.2:0/2927274683 shutdown_connections 2023-11-26T07:15:01.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.132+0000 7ff903f07700 1 -- 172.21.15.2:0/2927274683 wait complete. 2023-11-26T07:15:01.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.133+0000 7ff903f07700 1 Processor -- start 2023-11-26T07:15:01.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.133+0000 7ff903f07700 1 -- start start 2023-11-26T07:15:01.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.134+0000 7ff903f07700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8fc06f700 0x7ff8fc15a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:01.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.134+0000 7ff903f07700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8fc144610 0x7ff8fc0ced60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:01.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.134+0000 7ff903f07700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8fc15eed0 0x7ff8fc0adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:01.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.134+0000 7ff903f07700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8fc13db50 con 0x7ff8fc06f700 2023-11-26T07:15:01.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.134+0000 7ff903f07700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8fc0cf780 con 0x7ff8fc15eed0 2023-11-26T07:15:01.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.134+0000 7ff903f07700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8fc13de10 con 0x7ff8fc144610 2023-11-26T07:15:01.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.134+0000 7ff901ca3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8fc06f700 0x7ff8fc15a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:01.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.134+0000 7ff901ca3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8fc06f700 0x7ff8fc15a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42832/0 (socket says 172.21.15.2:42832) 2023-11-26T07:15:01.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.134+0000 7ff901ca3700 1 -- 172.21.15.2:0/1481592372 learned_addr learned my addr 172.21.15.2:0/1481592372 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:01.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.134+0000 7ff9014a2700 1 --2- 172.21.15.2:0/1481592372 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8fc144610 0x7ff8fc0ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:01.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.134+0000 7ff9024a4700 1 --2- 172.21.15.2:0/1481592372 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8fc15eed0 0x7ff8fc0adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:01.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.134+0000 7ff901ca3700 1 -- 172.21.15.2:0/1481592372 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8fc144610 msgr2=0x7ff8fc0ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:01.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.134+0000 7ff901ca3700 1 --2- 172.21.15.2:0/1481592372 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8fc144610 0x7ff8fc0ced60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:01.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.134+0000 7ff901ca3700 1 -- 172.21.15.2:0/1481592372 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8fc15eed0 msgr2=0x7ff8fc0adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:01.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.134+0000 7ff901ca3700 1 --2- 172.21.15.2:0/1481592372 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8fc15eed0 0x7ff8fc0adfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:01.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.134+0000 7ff901ca3700 1 -- 172.21.15.2:0/1481592372 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ec0094a0 con 0x7ff8fc06f700 2023-11-26T07:15:01.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.134+0000 7ff9014a2700 1 --2- 172.21.15.2:0/1481592372 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8fc144610 0x7ff8fc0ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:15:01.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.135+0000 7ff901ca3700 1 --2- 172.21.15.2:0/1481592372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8fc06f700 0x7ff8fc15a4c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec0097c0 tx=0x7ff8ec0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:01.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.135+0000 7ff8f27fc700 1 -- 172.21.15.2:0/1481592372 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec011630 con 0x7ff8fc06f700 2023-11-26T07:15:01.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.135+0000 7ff8f27fc700 1 -- 172.21.15.2:0/1481592372 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8ec011790 con 0x7ff8fc06f700 2023-11-26T07:15:01.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.135+0000 7ff903f07700 1 -- 172.21.15.2:0/1481592372 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8fc13e0f0 con 0x7ff8fc06f700 2023-11-26T07:15:01.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.135+0000 7ff8f27fc700 1 -- 172.21.15.2:0/1481592372 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec011920 con 0x7ff8fc06f700 2023-11-26T07:15:01.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.135+0000 7ff903f07700 1 -- 172.21.15.2:0/1481592372 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8fc0cdfd0 con 0x7ff8fc06f700 2023-11-26T07:15:01.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.136+0000 7ff903f07700 1 -- 172.21.15.2:0/1481592372 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8fc13d9a0 con 0x7ff8fc06f700 2023-11-26T07:15:01.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.136+0000 7ff8f27fc700 1 -- 172.21.15.2:0/1481592372 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7ff8ec011a80 con 0x7ff8fc06f700 2023-11-26T07:15:01.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.137+0000 7ff8f27fc700 1 --2- 172.21.15.2:0/1481592372 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff8e006b470 0x7ff8e006d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:01.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.137+0000 7ff8f27fc700 1 -- 172.21.15.2:0/1481592372 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff8ec08b290 con 0x7ff8fc06f700 2023-11-26T07:15:01.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.137+0000 7ff9014a2700 1 --2- 172.21.15.2:0/1481592372 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff8e006b470 0x7ff8e006d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:01.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.137+0000 7ff9014a2700 1 --2- 172.21.15.2:0/1481592372 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff8e006b470 0x7ff8e006d930 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc143990 tx=0x7ff8f8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:01.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.141+0000 7ff8f27fc700 1 -- 172.21.15.2:0/1481592372 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff8ec055e60 con 0x7ff8fc06f700 2023-11-26T07:15:01.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.341+0000 7ff903f07700 1 -- 172.21.15.2:0/1481592372 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff8fc13e280 con 0x7ff8fc06f700 2023-11-26T07:15:01.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.342+0000 7ff8f27fc700 1 -- 172.21.15.2:0/1481592372 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v52) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff8ec059480 con 0x7ff8fc06f700 2023-11-26T07:15:01.344 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-26T07:15:01.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.344+0000 7ff903f07700 1 -- 172.21.15.2:0/1481592372 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff8e006b470 msgr2=0x7ff8e006d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:01.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.344+0000 7ff903f07700 1 --2- 172.21.15.2:0/1481592372 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff8e006b470 0x7ff8e006d930 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc143990 tx=0x7ff8f8009040 comp rx=0 tx=0).stop 2023-11-26T07:15:01.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.344+0000 7ff903f07700 1 -- 172.21.15.2:0/1481592372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8fc06f700 msgr2=0x7ff8fc15a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:01.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.344+0000 7ff903f07700 1 --2- 172.21.15.2:0/1481592372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8fc06f700 0x7ff8fc15a4c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec0097c0 tx=0x7ff8ec0047c0 comp rx=0 tx=0).stop 2023-11-26T07:15:01.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.344+0000 7ff903f07700 1 -- 172.21.15.2:0/1481592372 shutdown_connections 2023-11-26T07:15:01.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.344+0000 7ff903f07700 1 --2- 172.21.15.2:0/1481592372 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff8e006b470 0x7ff8e006d930 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:01.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.344+0000 7ff903f07700 1 --2- 172.21.15.2:0/1481592372 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8fc15eed0 0x7ff8fc0adfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:01.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.344+0000 7ff903f07700 1 --2- 172.21.15.2:0/1481592372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8fc06f700 0x7ff8fc15a4c0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:01.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.344+0000 7ff903f07700 1 --2- 172.21.15.2:0/1481592372 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8fc144610 0x7ff8fc0ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:01.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.344+0000 7ff903f07700 1 -- 172.21.15.2:0/1481592372 >> 172.21.15.2:0/1481592372 conn(0x7ff8fc0b2740 msgr2=0x7ff8fc0b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:01.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.344+0000 7ff903f07700 1 -- 172.21.15.2:0/1481592372 shutdown_connections 2023-11-26T07:15:01.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.344+0000 7ff903f07700 1 -- 172.21.15.2:0/1481592372 wait complete. 2023-11-26T07:15:01.358 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_cancelled' 2023-11-26T07:15:01.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.481+0000 7fd3206d2700 1 Processor -- start 2023-11-26T07:15:01.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.481+0000 7fd3206d2700 1 -- start start 2023-11-26T07:15:01.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.482+0000 7fd3206d2700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd31815e460 0x7fd3180d49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:01.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.482+0000 7fd3206d2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3180cf480 0x7fd3180d2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:01.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.482+0000 7fd3206d2700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3180b3370 con 0x7fd3180d29d0 2023-11-26T07:15:01.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.482+0000 7fd3206d2700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3180d2e60 con 0x7fd31815e460 2023-11-26T07:15:01.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.482+0000 7fd3206d2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3180cfc40 con 0x7fd3180cf480 2023-11-26T07:15:01.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.482+0000 7fd31e46e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd31815e460 0x7fd3180d49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:01.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.482+0000 7fd31ec6f700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd3180d29d0 0x7fd3180d0550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34054/0 (socket says 172.21.15.2:34054) 2023-11-26T07:15:01.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.482+0000 7fd31e46e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd31815e460 0x7fd3180d49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42840/0 (socket says 172.21.15.2:42840) 2023-11-26T07:15:01.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.482+0000 7fd31ec6f700 1 -- 172.21.15.2:0/1516605428 learned_addr learned my addr 172.21.15.2:0/1516605428 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:15:01.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.483+0000 7fd31dc6d700 1 --2- 172.21.15.2:0/1516605428 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3180cf480 0x7fd3180d2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:01.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.483+0000 7fd31e46e700 1 -- 172.21.15.2:0/1516605428 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3180cf480 msgr2=0x7fd3180d2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:01.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.483+0000 7fd31e46e700 1 --2- 172.21.15.2:0/1516605428 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3180cf480 0x7fd3180d2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:01.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.483+0000 7fd31e46e700 1 -- 172.21.15.2:0/1516605428 >> v1:172.21.15.2:6789/0 conn(0x7fd3180d29d0 legacy=0x7fd3180d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:01.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.483+0000 7fd31e46e700 1 -- 172.21.15.2:0/1516605428 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3180b35c0 con 0x7fd31815e460 2023-11-26T07:15:01.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.483+0000 7fd31dc6d700 1 --2- 172.21.15.2:0/1516605428 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3180cf480 0x7fd3180d2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:15:01.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.483+0000 7fd31e46e700 1 --2- 172.21.15.2:0/1516605428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd31815e460 0x7fd3180d49d0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fd308009840 tx=0x7fd308009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=828e963cb41ab473 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:01.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.483+0000 7fd31d46c700 1 -- 172.21.15.2:0/1516605428 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd308011830 con 0x7fd31815e460 2023-11-26T07:15:01.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.483+0000 7fd31d46c700 1 -- 172.21.15.2:0/1516605428 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd308011990 con 0x7fd31815e460 2023-11-26T07:15:01.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.483+0000 7fd31d46c700 1 -- 172.21.15.2:0/1516605428 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd308011d20 con 0x7fd31815e460 2023-11-26T07:15:01.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.484+0000 7fd3206d2700 1 -- 172.21.15.2:0/1516605428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd31815e460 msgr2=0x7fd3180d49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:01.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.484+0000 7fd3206d2700 1 --2- 172.21.15.2:0/1516605428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd31815e460 0x7fd3180d49d0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fd308009840 tx=0x7fd308009b50 comp rx=0 tx=0).stop 2023-11-26T07:15:01.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.484+0000 7fd3206d2700 1 -- 172.21.15.2:0/1516605428 shutdown_connections 2023-11-26T07:15:01.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.484+0000 7fd3206d2700 1 --2- 172.21.15.2:0/1516605428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd31815e460 0x7fd3180d49d0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:01.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.484+0000 7fd3206d2700 1 --2- 172.21.15.2:0/1516605428 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3180cf480 0x7fd3180d2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:01.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.484+0000 7fd3206d2700 1 -- 172.21.15.2:0/1516605428 >> 172.21.15.2:0/1516605428 conn(0x7fd3180d3eb0 msgr2=0x7fd3180d42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:01.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.484+0000 7fd3206d2700 1 -- 172.21.15.2:0/1516605428 shutdown_connections 2023-11-26T07:15:01.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.484+0000 7fd3206d2700 1 -- 172.21.15.2:0/1516605428 wait complete. 2023-11-26T07:15:01.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.485+0000 7fd3206d2700 1 Processor -- start 2023-11-26T07:15:01.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.485+0000 7fd3206d2700 1 -- start start 2023-11-26T07:15:01.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.486+0000 7fd3206d2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3180cf480 0x7fd31815a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:01.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.486+0000 7fd3206d2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3180d29d0 0x7fd318160aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:01.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.486+0000 7fd3206d2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd31815e460 0x7fd3180cd520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:01.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.486+0000 7fd3206d2700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd318160fe0 con 0x7fd31815e460 2023-11-26T07:15:01.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.486+0000 7fd3206d2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3180cdfa0 con 0x7fd3180d29d0 2023-11-26T07:15:01.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.486+0000 7fd3206d2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd31815fce0 con 0x7fd3180cf480 2023-11-26T07:15:01.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.486+0000 7fd31ec6f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd31815e460 0x7fd3180cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:01.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.486+0000 7fd31ec6f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd31815e460 0x7fd3180cd520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42850/0 (socket says 172.21.15.2:42850) 2023-11-26T07:15:01.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.486+0000 7fd31ec6f700 1 -- 172.21.15.2:0/1717686921 learned_addr learned my addr 172.21.15.2:0/1717686921 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:01.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.486+0000 7fd31e46e700 1 --2- 172.21.15.2:0/1717686921 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3180cf480 0x7fd31815a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:01.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.486+0000 7fd31dc6d700 1 --2- 172.21.15.2:0/1717686921 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3180d29d0 0x7fd318160aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:01.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.486+0000 7fd31ec6f700 1 -- 172.21.15.2:0/1717686921 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3180cf480 msgr2=0x7fd31815a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:01.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.486+0000 7fd31ec6f700 1 --2- 172.21.15.2:0/1717686921 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3180cf480 0x7fd31815a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:01.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.486+0000 7fd31ec6f700 1 -- 172.21.15.2:0/1717686921 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3180d29d0 msgr2=0x7fd318160aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:01.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.486+0000 7fd31ec6f700 1 --2- 172.21.15.2:0/1717686921 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3180d29d0 0x7fd318160aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:01.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.486+0000 7fd31ec6f700 1 -- 172.21.15.2:0/1717686921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3080094a0 con 0x7fd31815e460 2023-11-26T07:15:01.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.486+0000 7fd31ec6f700 1 --2- 172.21.15.2:0/1717686921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd31815e460 0x7fd3180cd520 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fd31000cbc0 tx=0x7fd31000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:01.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.486+0000 7fd30effd700 1 -- 172.21.15.2:0/1717686921 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31000ab50 con 0x7fd31815e460 2023-11-26T07:15:01.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.486+0000 7fd30effd700 1 -- 172.21.15.2:0/1717686921 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31000acb0 con 0x7fd31815e460 2023-11-26T07:15:01.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.487+0000 7fd3206d2700 1 -- 172.21.15.2:0/1717686921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd31815ffc0 con 0x7fd31815e460 2023-11-26T07:15:01.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.487+0000 7fd30effd700 1 -- 172.21.15.2:0/1717686921 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd310012600 con 0x7fd31815e460 2023-11-26T07:15:01.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.487+0000 7fd3206d2700 1 -- 172.21.15.2:0/1717686921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd318160580 con 0x7fd31815e460 2023-11-26T07:15:01.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.488+0000 7fd3206d2700 1 -- 172.21.15.2:0/1717686921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd318067f60 con 0x7fd31815e460 2023-11-26T07:15:01.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.488+0000 7fd30effd700 1 -- 172.21.15.2:0/1717686921 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7fd31001b3b0 con 0x7fd31815e460 2023-11-26T07:15:01.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.489+0000 7fd30effd700 1 --2- 172.21.15.2:0/1717686921 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd2fc06b470 0x7fd2fc06d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:01.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.489+0000 7fd30effd700 1 -- 172.21.15.2:0/1717686921 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd3100899f0 con 0x7fd31815e460 2023-11-26T07:15:01.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.489+0000 7fd31e46e700 1 --2- 172.21.15.2:0/1717686921 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd2fc06b470 0x7fd2fc06d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:01.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.490+0000 7fd31e46e700 1 --2- 172.21.15.2:0/1717686921 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd2fc06b470 0x7fd2fc06d930 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd308000c00 tx=0x7fd30801c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:01.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.494+0000 7fd30effd700 1 -- 172.21.15.2:0/1717686921 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd3100545e0 con 0x7fd31815e460 2023-11-26T07:15:01.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:01.788+0000 7fd3206d2700 1 -- 172.21.15.2:0/1717686921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_cancelled"]} v 0) v1 -- 0x7fd318160770 con 0x7fd31815e460 2023-11-26T07:15:02.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.626+0000 7fd30effd700 1 -- 172.21.15.2:0/1717686921 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_cancelled"]}]=0 v188) v1 ==== 179+0+0 (secure 0 0 0) 0x7fd3100170f0 con 0x7fd31815e460 2023-11-26T07:15:02.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.629+0000 7fd3206d2700 1 -- 172.21.15.2:0/1717686921 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd2fc06b470 msgr2=0x7fd2fc06d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:02.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.629+0000 7fd3206d2700 1 --2- 172.21.15.2:0/1717686921 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd2fc06b470 0x7fd2fc06d930 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd308000c00 tx=0x7fd30801c040 comp rx=0 tx=0).stop 2023-11-26T07:15:02.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.629+0000 7fd3206d2700 1 -- 172.21.15.2:0/1717686921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd31815e460 msgr2=0x7fd3180cd520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:02.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.629+0000 7fd3206d2700 1 --2- 172.21.15.2:0/1717686921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd31815e460 0x7fd3180cd520 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fd31000cbc0 tx=0x7fd31000cf80 comp rx=0 tx=0).stop 2023-11-26T07:15:02.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.629+0000 7fd3206d2700 1 -- 172.21.15.2:0/1717686921 shutdown_connections 2023-11-26T07:15:02.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.629+0000 7fd3206d2700 1 --2- 172.21.15.2:0/1717686921 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd2fc06b470 0x7fd2fc06d930 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:02.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.629+0000 7fd3206d2700 1 --2- 172.21.15.2:0/1717686921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd31815e460 0x7fd3180cd520 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:02.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.629+0000 7fd3206d2700 1 --2- 172.21.15.2:0/1717686921 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3180cf480 0x7fd31815a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:02.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.629+0000 7fd3206d2700 1 --2- 172.21.15.2:0/1717686921 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3180d29d0 0x7fd318160aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:02.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.629+0000 7fd3206d2700 1 -- 172.21.15.2:0/1717686921 >> 172.21.15.2:0/1717686921 conn(0x7fd3180d3eb0 msgr2=0x7fd3180b1130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:02.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.629+0000 7fd3206d2700 1 -- 172.21.15.2:0/1717686921 shutdown_connections 2023-11-26T07:15:02.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.629+0000 7fd3206d2700 1 -- 172.21.15.2:0/1717686921 wait complete. 2023-11-26T07:15:02.646 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-26T07:15:02.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.779+0000 7fdb4db6d700 1 Processor -- start 2023-11-26T07:15:02.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.779+0000 7fdb4db6d700 1 -- start start 2023-11-26T07:15:02.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.780+0000 7fdb4db6d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdb48145690 0x7fdb4806afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:02.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.780+0000 7fdb4db6d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb4806f490 0x7fdb480d0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:02.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.780+0000 7fdb4db6d700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb48145a70 con 0x7fdb4806b510 2023-11-26T07:15:02.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.780+0000 7fdb4db6d700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb4806b9c0 con 0x7fdb48145690 2023-11-26T07:15:02.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.780+0000 7fdb4db6d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb48160710 con 0x7fdb4806f490 2023-11-26T07:15:02.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.780+0000 7fdb477fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdb48145690 0x7fdb4806afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:02.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.780+0000 7fdb477fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdb48145690 0x7fdb4806afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42854/0 (socket says 172.21.15.2:42854) 2023-11-26T07:15:02.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.780+0000 7fdb477fe700 1 -- 172.21.15.2:0/4052064618 learned_addr learned my addr 172.21.15.2:0/4052064618 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:02.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.781+0000 7fdb47fff700 1 --2- 172.21.15.2:0/4052064618 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb4806f490 0x7fdb480d0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:02.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.781+0000 7fdb477fe700 1 -- 172.21.15.2:0/4052064618 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb4806f490 msgr2=0x7fdb480d0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:02.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.781+0000 7fdb477fe700 1 --2- 172.21.15.2:0/4052064618 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb4806f490 0x7fdb480d0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:02.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.781+0000 7fdb477fe700 1 -- 172.21.15.2:0/4052064618 >> v1:172.21.15.192:6789/0 conn(0x7fdb4806b510 legacy=0x7fdb4806ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:02.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.781+0000 7fdb477fe700 1 -- 172.21.15.2:0/4052064618 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb4815f950 con 0x7fdb48145690 2023-11-26T07:15:02.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.781+0000 7fdb47fff700 1 --2- 172.21.15.2:0/4052064618 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb4806f490 0x7fdb480d0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:15:02.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.781+0000 7fdb477fe700 1 --2- 172.21.15.2:0/4052064618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb48145690 0x7fdb4806afd0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fdb380098f0 tx=0x7fdb38009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbe98534d0ae74db server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:02.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.781+0000 7fdb467fc700 1 -- 172.21.15.2:0/4052064618 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3800b8a0 con 0x7fdb48145690 2023-11-26T07:15:02.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.781+0000 7fdb467fc700 1 -- 172.21.15.2:0/4052064618 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3800ba00 con 0x7fdb48145690 2023-11-26T07:15:02.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.781+0000 7fdb467fc700 1 -- 172.21.15.2:0/4052064618 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3800bd90 con 0x7fdb48145690 2023-11-26T07:15:02.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.782+0000 7fdb4db6d700 1 -- 172.21.15.2:0/4052064618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb48145690 msgr2=0x7fdb4806afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:02.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.782+0000 7fdb4db6d700 1 --2- 172.21.15.2:0/4052064618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb48145690 0x7fdb4806afd0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fdb380098f0 tx=0x7fdb38009c00 comp rx=0 tx=0).stop 2023-11-26T07:15:02.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.782+0000 7fdb4db6d700 1 -- 172.21.15.2:0/4052064618 shutdown_connections 2023-11-26T07:15:02.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.782+0000 7fdb4db6d700 1 --2- 172.21.15.2:0/4052064618 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb4806f490 0x7fdb480d0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:02.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.782+0000 7fdb4db6d700 1 --2- 172.21.15.2:0/4052064618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb48145690 0x7fdb4806afd0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:02.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.782+0000 7fdb4db6d700 1 -- 172.21.15.2:0/4052064618 >> 172.21.15.2:0/4052064618 conn(0x7fdb480b2740 msgr2=0x7fdb480b2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:02.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.782+0000 7fdb4db6d700 1 -- 172.21.15.2:0/4052064618 shutdown_connections 2023-11-26T07:15:02.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.782+0000 7fdb4db6d700 1 -- 172.21.15.2:0/4052064618 wait complete. 2023-11-26T07:15:02.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.783+0000 7fdb4db6d700 1 Processor -- start 2023-11-26T07:15:02.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.783+0000 7fdb4db6d700 1 -- start start 2023-11-26T07:15:02.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.784+0000 7fdb4db6d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb4806b510 0x7fdb4813ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:02.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.784+0000 7fdb4db6d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb4806f490 0x7fdb4815e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:02.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.784+0000 7fdb4db6d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb4815eeb0 0x7fdb480b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:02.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.784+0000 7fdb4db6d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb480b4ae0 con 0x7fdb4806f490 2023-11-26T07:15:02.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.784+0000 7fdb4db6d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4815f330 con 0x7fdb4815eeb0 2023-11-26T07:15:02.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.784+0000 7fdb4db6d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb48156a20 con 0x7fdb4806b510 2023-11-26T07:15:02.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.784+0000 7fdb46ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb4806f490 0x7fdb4815e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:02.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.784+0000 7fdb46ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb4806f490 0x7fdb4815e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42864/0 (socket says 172.21.15.2:42864) 2023-11-26T07:15:02.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.784+0000 7fdb46ffd700 1 -- 172.21.15.2:0/4138900411 learned_addr learned my addr 172.21.15.2:0/4138900411 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:02.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.784+0000 7fdb477fe700 1 --2- 172.21.15.2:0/4138900411 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb4806b510 0x7fdb4813ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:02.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.784+0000 7fdb47fff700 1 --2- 172.21.15.2:0/4138900411 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb4815eeb0 0x7fdb480b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:02.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.784+0000 7fdb46ffd700 1 -- 172.21.15.2:0/4138900411 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb4806b510 msgr2=0x7fdb4813ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:02.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.784+0000 7fdb46ffd700 1 --2- 172.21.15.2:0/4138900411 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb4806b510 0x7fdb4813ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:02.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.784+0000 7fdb46ffd700 1 -- 172.21.15.2:0/4138900411 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb4815eeb0 msgr2=0x7fdb480b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:02.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.784+0000 7fdb46ffd700 1 --2- 172.21.15.2:0/4138900411 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb4815eeb0 0x7fdb480b3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:02.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.784+0000 7fdb46ffd700 1 -- 172.21.15.2:0/4138900411 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb38009550 con 0x7fdb4806f490 2023-11-26T07:15:02.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.785+0000 7fdb46ffd700 1 --2- 172.21.15.2:0/4138900411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb4806f490 0x7fdb4815e970 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fdb3000c490 tx=0x7fdb3000c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:02.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.785+0000 7fdb3ffff700 1 -- 172.21.15.2:0/4138900411 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3000cea0 con 0x7fdb4806f490 2023-11-26T07:15:02.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.785+0000 7fdb3ffff700 1 -- 172.21.15.2:0/4138900411 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb300052f0 con 0x7fdb4806f490 2023-11-26T07:15:02.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.785+0000 7fdb4db6d700 1 -- 172.21.15.2:0/4138900411 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb48156d00 con 0x7fdb4806f490 2023-11-26T07:15:02.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.785+0000 7fdb3ffff700 1 -- 172.21.15.2:0/4138900411 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb30006860 con 0x7fdb4806f490 2023-11-26T07:15:02.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.785+0000 7fdb4db6d700 1 -- 172.21.15.2:0/4138900411 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb481572c0 con 0x7fdb4806f490 2023-11-26T07:15:02.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.786+0000 7fdb4db6d700 1 -- 172.21.15.2:0/4138900411 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb48157450 con 0x7fdb4806f490 2023-11-26T07:15:02.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.786+0000 7fdb3ffff700 1 -- 172.21.15.2:0/4138900411 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7fdb30003680 con 0x7fdb4806f490 2023-11-26T07:15:02.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.786+0000 7fdb3ffff700 1 --2- 172.21.15.2:0/4138900411 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fdb2806b470 0x7fdb2806d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:02.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.787+0000 7fdb3ffff700 1 -- 172.21.15.2:0/4138900411 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fdb30088f00 con 0x7fdb4806f490 2023-11-26T07:15:02.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.787+0000 7fdb477fe700 1 --2- 172.21.15.2:0/4138900411 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fdb2806b470 0x7fdb2806d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:02.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.787+0000 7fdb477fe700 1 --2- 172.21.15.2:0/4138900411 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fdb2806b470 0x7fdb2806d930 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdb48071df0 tx=0x7fdb38008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:02.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.791+0000 7fdb3ffff700 1 -- 172.21.15.2:0/4138900411 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdb30053a40 con 0x7fdb4806f490 2023-11-26T07:15:02.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.991+0000 7fdb4db6d700 1 -- 172.21.15.2:0/4138900411 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fdb48075480 con 0x7fdb4806f490 2023-11-26T07:15:02.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.994+0000 7fdb3ffff700 1 -- 172.21.15.2:0/4138900411 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdb30057060 con 0x7fdb4806f490 2023-11-26T07:15:02.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.996+0000 7fdb4db6d700 1 -- 172.21.15.2:0/4138900411 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fdb2806b470 msgr2=0x7fdb2806d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:02.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.996+0000 7fdb4db6d700 1 --2- 172.21.15.2:0/4138900411 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fdb2806b470 0x7fdb2806d930 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdb48071df0 tx=0x7fdb38008030 comp rx=0 tx=0).stop 2023-11-26T07:15:02.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.996+0000 7fdb4db6d700 1 -- 172.21.15.2:0/4138900411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb4806f490 msgr2=0x7fdb4815e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:02.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.996+0000 7fdb4db6d700 1 --2- 172.21.15.2:0/4138900411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb4806f490 0x7fdb4815e970 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fdb3000c490 tx=0x7fdb3000c7a0 comp rx=0 tx=0).stop 2023-11-26T07:15:02.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.996+0000 7fdb4db6d700 1 -- 172.21.15.2:0/4138900411 shutdown_connections 2023-11-26T07:15:02.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.996+0000 7fdb4db6d700 1 --2- 172.21.15.2:0/4138900411 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fdb2806b470 0x7fdb2806d930 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:02.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.996+0000 7fdb4db6d700 1 --2- 172.21.15.2:0/4138900411 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb4815eeb0 0x7fdb480b3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:02.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.996+0000 7fdb4db6d700 1 --2- 172.21.15.2:0/4138900411 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb4806b510 0x7fdb4813ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:02.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.996+0000 7fdb4db6d700 1 --2- 172.21.15.2:0/4138900411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb4806f490 0x7fdb4815e970 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:02.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.996+0000 7fdb4db6d700 1 -- 172.21.15.2:0/4138900411 >> 172.21.15.2:0/4138900411 conn(0x7fdb480b2740 msgr2=0x7fdb480b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:02.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.996+0000 7fdb4db6d700 1 -- 172.21.15.2:0/4138900411 shutdown_connections 2023-11-26T07:15:03.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:02.996+0000 7fdb4db6d700 1 -- 172.21.15.2:0/4138900411 wait complete. 2023-11-26T07:15:03.013 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-26T07:15:03.013 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:15:03.049 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:15:03.090 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-26T07:15:03.090 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:03.090 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:03.108 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19704 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-26T07:15:03.108 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:15:03.108 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:03.150 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284224k,nr_inodes=4071056,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3837 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260544k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-26T07:15:08.170 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:08.192 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:08.193 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:15:08.196 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:15:08.214 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19704 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-26T07:15:08.214 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:15:08.214 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:08.258 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284224k,nr_inodes=4071056,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3837 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260544k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-26T07:15:08.258 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-26T07:15:08.258 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:15:08.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.427+0000 7f83ec1e4700 1 Processor -- start 2023-11-26T07:15:08.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.427+0000 7f83ec1e4700 1 -- start start 2023-11-26T07:15:08.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.428+0000 7f83ec1e4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83e4143ae0 0x7f83e40b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:08.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.428+0000 7f83ec1e4700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f83e40722c0 0x7f83e406e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:08.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.428+0000 7f83ec1e4700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83e4143ec0 con 0x7f83e41440f0 2023-11-26T07:15:08.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.428+0000 7f83ec1e4700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83e40b40a0 con 0x7f83e40722c0 2023-11-26T07:15:08.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.428+0000 7f83ec1e4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e40b3ae0 con 0x7f83e4143ae0 2023-11-26T07:15:08.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.428+0000 7f83ea781700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f83e40722c0 0x7f83e406e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:08.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.428+0000 7f83e977f700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f83e41440f0 0x7f83e4071bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34078/0 (socket says 172.21.15.2:34078) 2023-11-26T07:15:08.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.428+0000 7f83e977f700 1 -- 172.21.15.2:0/3201473829 learned_addr learned my addr 172.21.15.2:0/3201473829 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:15:08.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.428+0000 7f83e9f80700 1 --2- 172.21.15.2:0/3201473829 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83e4143ae0 0x7f83e40b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:08.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.428+0000 7f83ea781700 1 -- 172.21.15.2:0/3201473829 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83e4143ae0 msgr2=0x7f83e40b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:08.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.428+0000 7f83ea781700 1 --2- 172.21.15.2:0/3201473829 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83e4143ae0 0x7f83e40b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:08.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.428+0000 7f83ea781700 1 -- 172.21.15.2:0/3201473829 >> v1:172.21.15.2:6789/0 conn(0x7f83e41440f0 legacy=0x7f83e4071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:08.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.428+0000 7f83e8f7e700 1 -- 172.21.15.2:0/3201473829 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1478674953 0 0) 0x7f83e4143ec0 con 0x7f83e41440f0 2023-11-26T07:15:08.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.428+0000 7f83ea781700 1 -- 172.21.15.2:0/3201473829 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e40b3dc0 con 0x7f83e40722c0 2023-11-26T07:15:08.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.428+0000 7f83e9f80700 1 --2- 172.21.15.2:0/3201473829 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83e4143ae0 0x7f83e40b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:15:08.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.429+0000 7f83ea781700 1 --2- 172.21.15.2:0/3201473829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83e40722c0 0x7f83e406e510 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f83dc009d90 tx=0x7f83dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80083b6d38cc4361 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:08.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.429+0000 7f83e8f7e700 1 -- 172.21.15.2:0/3201473829 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83dc00e070 con 0x7f83e40722c0 2023-11-26T07:15:08.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.429+0000 7f83e8f7e700 1 -- 172.21.15.2:0/3201473829 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83dc00bbd0 con 0x7f83e40722c0 2023-11-26T07:15:08.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.429+0000 7f83e8f7e700 1 -- 172.21.15.2:0/3201473829 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83dc012430 con 0x7f83e40722c0 2023-11-26T07:15:08.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.429+0000 7f83ec1e4700 1 -- 172.21.15.2:0/3201473829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83e40722c0 msgr2=0x7f83e406e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:08.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.429+0000 7f83ec1e4700 1 --2- 172.21.15.2:0/3201473829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83e40722c0 0x7f83e406e510 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f83dc009d90 tx=0x7f83dc00b330 comp rx=0 tx=0).stop 2023-11-26T07:15:08.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.429+0000 7f83ec1e4700 1 -- 172.21.15.2:0/3201473829 shutdown_connections 2023-11-26T07:15:08.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.429+0000 7f83ec1e4700 1 --2- 172.21.15.2:0/3201473829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83e40722c0 0x7f83e406e510 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:08.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.429+0000 7f83ec1e4700 1 --2- 172.21.15.2:0/3201473829 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83e4143ae0 0x7f83e40b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:08.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.429+0000 7f83ec1e4700 1 -- 172.21.15.2:0/3201473829 >> 172.21.15.2:0/3201473829 conn(0x7f83e40b2740 msgr2=0x7f83e40b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:08.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.429+0000 7f83ec1e4700 1 -- 172.21.15.2:0/3201473829 shutdown_connections 2023-11-26T07:15:08.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.429+0000 7f83ec1e4700 1 -- 172.21.15.2:0/3201473829 wait complete. 2023-11-26T07:15:08.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.431+0000 7f83ec1e4700 1 Processor -- start 2023-11-26T07:15:08.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.431+0000 7f83ec1e4700 1 -- start start 2023-11-26T07:15:08.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.431+0000 7f83ec1e4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83e40722c0 0x7f83e4157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:08.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.431+0000 7f83ec1e4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83e4143ae0 0x7f83e40c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:08.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.431+0000 7f83ec1e4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83e41440f0 0x7f83e406afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:08.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.431+0000 7f83ec1e4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e40ca770 con 0x7f83e41440f0 2023-11-26T07:15:08.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.431+0000 7f83ec1e4700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e40c7370 con 0x7f83e40722c0 2023-11-26T07:15:08.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.431+0000 7f83ec1e4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e40c7650 con 0x7f83e4143ae0 2023-11-26T07:15:08.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.431+0000 7f83ea781700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83e41440f0 0x7f83e406afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:08.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.432+0000 7f83ea781700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83e41440f0 0x7f83e406afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42878/0 (socket says 172.21.15.2:42878) 2023-11-26T07:15:08.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.432+0000 7f83ea781700 1 -- 172.21.15.2:0/4134738683 learned_addr learned my addr 172.21.15.2:0/4134738683 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:08.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.432+0000 7f83e977f700 1 --2- 172.21.15.2:0/4134738683 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83e4143ae0 0x7f83e40c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:08.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.432+0000 7f83e9f80700 1 --2- 172.21.15.2:0/4134738683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83e40722c0 0x7f83e4157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:08.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.432+0000 7f83ea781700 1 -- 172.21.15.2:0/4134738683 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83e4143ae0 msgr2=0x7f83e40c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:08.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.432+0000 7f83ea781700 1 --2- 172.21.15.2:0/4134738683 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83e4143ae0 0x7f83e40c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:08.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.432+0000 7f83ea781700 1 -- 172.21.15.2:0/4134738683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83e40722c0 msgr2=0x7f83e4157610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:08.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.432+0000 7f83ea781700 1 --2- 172.21.15.2:0/4134738683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83e40722c0 0x7f83e4157610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:08.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.432+0000 7f83ea781700 1 -- 172.21.15.2:0/4134738683 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83dc009a70 con 0x7f83e41440f0 2023-11-26T07:15:08.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.432+0000 7f83e9f80700 1 --2- 172.21.15.2:0/4134738683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83e40722c0 0x7f83e4157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:15:08.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.432+0000 7f83e977f700 1 --2- 172.21.15.2:0/4134738683 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83e4143ae0 0x7f83e40c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:15:08.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.432+0000 7f83ea781700 1 --2- 172.21.15.2:0/4134738683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83e41440f0 0x7f83e406afd0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f83dc013000 tx=0x7f83dc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:08.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.432+0000 7f83da7fc700 1 -- 172.21.15.2:0/4134738683 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83dc012430 con 0x7f83e41440f0 2023-11-26T07:15:08.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.432+0000 7f83da7fc700 1 -- 172.21.15.2:0/4134738683 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83dc020070 con 0x7f83e41440f0 2023-11-26T07:15:08.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.432+0000 7f83da7fc700 1 -- 172.21.15.2:0/4134738683 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83dc004260 con 0x7f83e41440f0 2023-11-26T07:15:08.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.432+0000 7f83ec1e4700 1 -- 172.21.15.2:0/4134738683 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83e40c7930 con 0x7f83e41440f0 2023-11-26T07:15:08.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.432+0000 7f83ec1e4700 1 -- 172.21.15.2:0/4134738683 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83e40ccde0 con 0x7f83e41440f0 2023-11-26T07:15:08.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.433+0000 7f83ec1e4700 1 -- 172.21.15.2:0/4134738683 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83e4068670 con 0x7f83e41440f0 2023-11-26T07:15:08.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.434+0000 7f83da7fc700 1 -- 172.21.15.2:0/4134738683 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f83dc0043c0 con 0x7f83e41440f0 2023-11-26T07:15:08.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.434+0000 7f83da7fc700 1 --2- 172.21.15.2:0/4134738683 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f83c806b470 0x7f83c806d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:08.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.434+0000 7f83da7fc700 1 -- 172.21.15.2:0/4134738683 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f83dc022070 con 0x7f83e41440f0 2023-11-26T07:15:08.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.434+0000 7f83e9f80700 1 --2- 172.21.15.2:0/4134738683 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f83c806b470 0x7f83c806d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:08.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.435+0000 7f83e9f80700 1 --2- 172.21.15.2:0/4134738683 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f83c806b470 0x7f83c806d930 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f83d4006fd0 tx=0x7f83d4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:08.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.439+0000 7f83da7fc700 1 -- 172.21.15.2:0/4134738683 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f83dc056870 con 0x7f83e41440f0 2023-11-26T07:15:08.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.685+0000 7f83ec1e4700 1 -- 172.21.15.2:0/4134738683 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83e40c7e50 con 0x7f83e41440f0 2023-11-26T07:15:08.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.686+0000 7f83da7fc700 1 -- 172.21.15.2:0/4134738683 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+3699 (secure 0 0 0) 0x7f83e40c7e50 con 0x7f83e41440f0 2023-11-26T07:15:08.689 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:15:08.689 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":29,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5051,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2052180749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":2052180749},{"type":"v1","addr":"172.21.15.2:6835","nonce":2052180749}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3592145320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3592145320},{"type":"v1","addr":"172.21.15.192:6836","nonce":3592145320}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":5631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/1795687093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1795687093},{"type":"v1","addr":"172.21.15.2:6834","nonce":1795687093}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5646,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2009465289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2009465289},{"type":"v1","addr":"172.21.15.192:6837","nonce":2009465289}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[]} 2023-11-26T07:15:08.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.688+0000 7f83ec1e4700 1 -- 172.21.15.2:0/4134738683 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f83c806b470 msgr2=0x7f83c806d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:08.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.688+0000 7f83ec1e4700 1 --2- 172.21.15.2:0/4134738683 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f83c806b470 0x7f83c806d930 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f83d4006fd0 tx=0x7f83d4008040 comp rx=0 tx=0).stop 2023-11-26T07:15:08.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.688+0000 7f83ec1e4700 1 -- 172.21.15.2:0/4134738683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83e41440f0 msgr2=0x7f83e406afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:08.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.688+0000 7f83ec1e4700 1 --2- 172.21.15.2:0/4134738683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83e41440f0 0x7f83e406afd0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f83dc013000 tx=0x7f83dc004ad0 comp rx=0 tx=0).stop 2023-11-26T07:15:08.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.688+0000 7f83ec1e4700 1 -- 172.21.15.2:0/4134738683 shutdown_connections 2023-11-26T07:15:08.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.688+0000 7f83ec1e4700 1 --2- 172.21.15.2:0/4134738683 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f83c806b470 0x7f83c806d930 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:08.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.688+0000 7f83ec1e4700 1 --2- 172.21.15.2:0/4134738683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83e41440f0 0x7f83e406afd0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:08.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.688+0000 7f83ec1e4700 1 --2- 172.21.15.2:0/4134738683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83e40722c0 0x7f83e4157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:08.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.688+0000 7f83ec1e4700 1 --2- 172.21.15.2:0/4134738683 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83e4143ae0 0x7f83e40c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:08.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.688+0000 7f83ec1e4700 1 -- 172.21.15.2:0/4134738683 >> 172.21.15.2:0/4134738683 conn(0x7f83e40b2740 msgr2=0x7f83e415b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:08.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.688+0000 7f83ec1e4700 1 -- 172.21.15.2:0/4134738683 shutdown_connections 2023-11-26T07:15:08.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.688+0000 7f83ec1e4700 1 -- 172.21.15.2:0/4134738683 wait complete. 2023-11-26T07:15:08.692 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 29 2023-11-26T07:15:08.703 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-26T07:15:08.703 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-26T07:15:08.703 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-26T07:15:08.704 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:15:08.704 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-26T07:15:08.704 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-26T07:15:08.704 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-26T07:15:08.704 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:15:08.704 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-26T07:15:08.704 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-26T07:15:08.705 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-26T07:15:08.705 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:15:08.705 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-26T07:15:08.705 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-26T07:15:08.705 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-26T07:15:08.705 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:15:08.713 INFO:tasks.ceph.mds.a:Stopped 2023-11-26T07:15:08.713 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-26T07:15:08.713 INFO:tasks.ceph.mds.c:Stopped 2023-11-26T07:15:08.714 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-26T07:15:08.716 INFO:tasks.ceph.mds.b:Stopped 2023-11-26T07:15:08.716 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-26T07:15:08.717 INFO:tasks.ceph.mds.d:Stopped 2023-11-26T07:15:08.717 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-26T07:15:08.755 INFO:tasks.ceph.mds.a:Started 2023-11-26T07:15:08.755 DEBUG:teuthology.parallel:result is None 2023-11-26T07:15:08.755 INFO:tasks.ceph.mds.c:Started 2023-11-26T07:15:08.756 DEBUG:teuthology.parallel:result is None 2023-11-26T07:15:08.759 INFO:tasks.ceph.mds.b:Started 2023-11-26T07:15:08.759 DEBUG:teuthology.parallel:result is None 2023-11-26T07:15:08.759 INFO:tasks.ceph.mds.d:Started 2023-11-26T07:15:08.760 DEBUG:teuthology.parallel:result is None 2023-11-26T07:15:08.760 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-26T07:15:08.836 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2023-11-26T07:15:08.837 INFO:tasks.ceph.mds.c.smithi002.stdout:starting mds.c at 2023-11-26T07:15:08.843 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2023-11-26T07:15:08.843 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2023-11-26T07:15:08.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.888+0000 7f936dc9a700 1 Processor -- start 2023-11-26T07:15:08.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.888+0000 7f936dc9a700 1 -- start start 2023-11-26T07:15:08.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.889+0000 7f936dc9a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93680722c0 0x7f93680b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:08.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.889+0000 7f936dc9a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f93681440f0 0x7f936806e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:08.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.889+0000 7f936dc9a700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9368143ec0 con 0x7f9368143ae0 2023-11-26T07:15:08.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.889+0000 7f936dc9a700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93680b40a0 con 0x7f93681440f0 2023-11-26T07:15:08.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.889+0000 7f936dc9a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93680b3ae0 con 0x7f93680722c0 2023-11-26T07:15:08.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.889+0000 7f9367fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f93681440f0 0x7f936806e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:08.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.889+0000 7f93677fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f9368143ae0 0x7f9368071bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34116/0 (socket says 172.21.15.2:34116) 2023-11-26T07:15:08.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.889+0000 7f93677fe700 1 -- 172.21.15.2:0/1837138158 learned_addr learned my addr 172.21.15.2:0/1837138158 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:15:08.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.889+0000 7f9366ffd700 1 --2- 172.21.15.2:0/1837138158 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93680722c0 0x7f93680b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:08.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.889+0000 7f9367fff700 1 -- 172.21.15.2:0/1837138158 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93680722c0 msgr2=0x7f93680b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:08.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.889+0000 7f9367fff700 1 --2- 172.21.15.2:0/1837138158 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93680722c0 0x7f93680b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:08.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.889+0000 7f9367fff700 1 -- 172.21.15.2:0/1837138158 >> v1:172.21.15.2:6789/0 conn(0x7f9368143ae0 legacy=0x7f9368071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:08.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.889+0000 7f9367fff700 1 -- 172.21.15.2:0/1837138158 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93680b3dc0 con 0x7f93681440f0 2023-11-26T07:15:08.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.889+0000 7f93667fc700 1 -- 172.21.15.2:0/1837138158 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 856464727 0 0) 0x7f9368143ec0 con 0x7f9368143ae0 2023-11-26T07:15:08.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.889+0000 7f9366ffd700 1 --2- 172.21.15.2:0/1837138158 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93680722c0 0x7f93680b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:15:08.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.889+0000 7f9367fff700 1 --2- 172.21.15.2:0/1837138158 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93681440f0 0x7f936806e510 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f9360009d90 tx=0x7f936000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe797f35bb3b3ec6 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:08.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.889+0000 7f93667fc700 1 -- 172.21.15.2:0/1837138158 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936000e070 con 0x7f93681440f0 2023-11-26T07:15:08.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.890+0000 7f93667fc700 1 -- 172.21.15.2:0/1837138158 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f936000bbd0 con 0x7f93681440f0 2023-11-26T07:15:08.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.890+0000 7f93667fc700 1 -- 172.21.15.2:0/1837138158 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9360012430 con 0x7f93681440f0 2023-11-26T07:15:08.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.890+0000 7f936dc9a700 1 -- 172.21.15.2:0/1837138158 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93681440f0 msgr2=0x7f936806e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:08.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.890+0000 7f936dc9a700 1 --2- 172.21.15.2:0/1837138158 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93681440f0 0x7f936806e510 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f9360009d90 tx=0x7f936000b330 comp rx=0 tx=0).stop 2023-11-26T07:15:08.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.890+0000 7f936dc9a700 1 -- 172.21.15.2:0/1837138158 shutdown_connections 2023-11-26T07:15:08.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.890+0000 7f936dc9a700 1 --2- 172.21.15.2:0/1837138158 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93681440f0 0x7f936806e510 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:08.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.890+0000 7f936dc9a700 1 --2- 172.21.15.2:0/1837138158 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93680722c0 0x7f93680b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:08.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.890+0000 7f936dc9a700 1 -- 172.21.15.2:0/1837138158 >> 172.21.15.2:0/1837138158 conn(0x7f93680b2740 msgr2=0x7f93680b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:08.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.890+0000 7f936dc9a700 1 -- 172.21.15.2:0/1837138158 shutdown_connections 2023-11-26T07:15:08.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.890+0000 7f936dc9a700 1 -- 172.21.15.2:0/1837138158 wait complete. 2023-11-26T07:15:08.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.891+0000 7f936dc9a700 1 Processor -- start 2023-11-26T07:15:08.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.892+0000 7f936dc9a700 1 -- start start 2023-11-26T07:15:08.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.892+0000 7f936dc9a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93680722c0 0x7f936814bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:08.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.892+0000 7f936dc9a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9368143ae0 0x7f9368159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:08.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.892+0000 7f936dc9a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93681440f0 0x7f93680c59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:08.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.892+0000 7f936dc9a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936815c410 con 0x7f93681440f0 2023-11-26T07:15:08.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.892+0000 7f936dc9a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936815c6f0 con 0x7f93680722c0 2023-11-26T07:15:08.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.892+0000 7f936dc9a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f936815c9d0 con 0x7f9368143ae0 2023-11-26T07:15:08.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.892+0000 7f9367fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93681440f0 0x7f93680c59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:08.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.893+0000 7f9367fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93681440f0 0x7f93680c59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42916/0 (socket says 172.21.15.2:42916) 2023-11-26T07:15:08.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.893+0000 7f9367fff700 1 -- 172.21.15.2:0/1128639868 learned_addr learned my addr 172.21.15.2:0/1128639868 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:08.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.893+0000 7f9366ffd700 1 --2- 172.21.15.2:0/1128639868 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9368143ae0 0x7f9368159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:08.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.893+0000 7f93677fe700 1 --2- 172.21.15.2:0/1128639868 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93680722c0 0x7f936814bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:08.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.893+0000 7f9367fff700 1 -- 172.21.15.2:0/1128639868 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9368143ae0 msgr2=0x7f9368159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:08.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.893+0000 7f9367fff700 1 --2- 172.21.15.2:0/1128639868 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9368143ae0 0x7f9368159b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:08.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.893+0000 7f9367fff700 1 -- 172.21.15.2:0/1128639868 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93680722c0 msgr2=0x7f936814bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:08.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.893+0000 7f9367fff700 1 --2- 172.21.15.2:0/1128639868 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93680722c0 0x7f936814bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:08.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.893+0000 7f9367fff700 1 -- 172.21.15.2:0/1128639868 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9360009a70 con 0x7f93681440f0 2023-11-26T07:15:08.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.893+0000 7f93677fe700 1 --2- 172.21.15.2:0/1128639868 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93680722c0 0x7f936814bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:15:08.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.893+0000 7f9367fff700 1 --2- 172.21.15.2:0/1128639868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93681440f0 0x7f93680c59b0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f9360014040 tx=0x7f9360004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:08.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.893+0000 7f934ffff700 1 -- 172.21.15.2:0/1128639868 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9360012430 con 0x7f93681440f0 2023-11-26T07:15:08.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.893+0000 7f934ffff700 1 -- 172.21.15.2:0/1128639868 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9360020070 con 0x7f93681440f0 2023-11-26T07:15:08.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.893+0000 7f936dc9a700 1 -- 172.21.15.2:0/1128639868 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f936815ccb0 con 0x7f93681440f0 2023-11-26T07:15:08.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.893+0000 7f934ffff700 1 -- 172.21.15.2:0/1128639868 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9360004260 con 0x7f93681440f0 2023-11-26T07:15:08.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.893+0000 7f936dc9a700 1 -- 172.21.15.2:0/1128639868 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f936815a060 con 0x7f93681440f0 2023-11-26T07:15:08.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.894+0000 7f936dc9a700 1 -- 172.21.15.2:0/1128639868 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f936815a220 con 0x7f93681440f0 2023-11-26T07:15:08.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.895+0000 7f934ffff700 1 -- 172.21.15.2:0/1128639868 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f93600043c0 con 0x7f93681440f0 2023-11-26T07:15:08.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.895+0000 7f934ffff700 1 --2- 172.21.15.2:0/1128639868 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f935406b470 0x7f935406d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:08.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.895+0000 7f934ffff700 1 -- 172.21.15.2:0/1128639868 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9360022070 con 0x7f93681440f0 2023-11-26T07:15:08.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.895+0000 7f93677fe700 1 --2- 172.21.15.2:0/1128639868 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f935406b470 0x7f935406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:08.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.896+0000 7f93677fe700 1 --2- 172.21.15.2:0/1128639868 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f935406b470 0x7f935406d930 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9358000f60 tx=0x7f9358007ca0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:08.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:08.899+0000 7f934ffff700 1 -- 172.21.15.2:0/1128639868 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9360056c70 con 0x7f93681440f0 2023-11-26T07:15:09.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.116+0000 7f936dc9a700 1 -- 172.21.15.2:0/1128639868 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f9368068670 con 0x7f93681440f0 2023-11-26T07:15:09.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.269+0000 7f934ffff700 1 -- 172.21.15.2:0/1128639868 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v54) v1 ==== 97+0+0 (secure 0 0 0) 0x7f936005a290 con 0x7f93681440f0 2023-11-26T07:15:09.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.272+0000 7f936dc9a700 1 -- 172.21.15.2:0/1128639868 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f935406b470 msgr2=0x7f935406d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:09.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.272+0000 7f936dc9a700 1 --2- 172.21.15.2:0/1128639868 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f935406b470 0x7f935406d930 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9358000f60 tx=0x7f9358007ca0 comp rx=0 tx=0).stop 2023-11-26T07:15:09.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.272+0000 7f936dc9a700 1 -- 172.21.15.2:0/1128639868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93681440f0 msgr2=0x7f93680c59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:09.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.272+0000 7f936dc9a700 1 --2- 172.21.15.2:0/1128639868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93681440f0 0x7f93680c59b0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f9360014040 tx=0x7f9360004ad0 comp rx=0 tx=0).stop 2023-11-26T07:15:09.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.272+0000 7f936dc9a700 1 -- 172.21.15.2:0/1128639868 shutdown_connections 2023-11-26T07:15:09.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.272+0000 7f936dc9a700 1 --2- 172.21.15.2:0/1128639868 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f935406b470 0x7f935406d930 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:09.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.272+0000 7f936dc9a700 1 --2- 172.21.15.2:0/1128639868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93681440f0 0x7f93680c59b0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:09.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.272+0000 7f936dc9a700 1 --2- 172.21.15.2:0/1128639868 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93680722c0 0x7f936814bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:09.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.272+0000 7f936dc9a700 1 --2- 172.21.15.2:0/1128639868 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9368143ae0 0x7f9368159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:09.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.272+0000 7f936dc9a700 1 -- 172.21.15.2:0/1128639868 >> 172.21.15.2:0/1128639868 conn(0x7f93680b2740 msgr2=0x7f93681410d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:09.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.272+0000 7f936dc9a700 1 -- 172.21.15.2:0/1128639868 shutdown_connections 2023-11-26T07:15:09.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.272+0000 7f936dc9a700 1 -- 172.21.15.2:0/1128639868 wait complete. 2023-11-26T07:15:09.277 INFO:teuthology.orchestra.run.smithi002.stderr: removed all blocklist entries 2023-11-26T07:15:09.288 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-26T07:15:09.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.411+0000 7f4019f3a700 1 Processor -- start 2023-11-26T07:15:09.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.411+0000 7f4019f3a700 1 -- start start 2023-11-26T07:15:09.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.412+0000 7f4019f3a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f401406afd0 0x7f40140b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:09.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.412+0000 7f4019f3a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f401406edc0 0x7f401406b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:09.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.412+0000 7f4019f3a700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40140ad860 con 0x7f401406dba0 2023-11-26T07:15:09.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.412+0000 7f4019f3a700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f401406f830 con 0x7f401406afd0 2023-11-26T07:15:09.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.412+0000 7f4019f3a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40140d0a20 con 0x7f401406edc0 2023-11-26T07:15:09.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.412+0000 7f40137fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f401406afd0 0x7f40140b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:09.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.412+0000 7f4013fff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f401406dba0 0x7f401406e050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34136/0 (socket says 172.21.15.2:34136) 2023-11-26T07:15:09.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.412+0000 7f4013fff700 1 -- 172.21.15.2:0/3376698711 learned_addr learned my addr 172.21.15.2:0/3376698711 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:15:09.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.412+0000 7f4012ffd700 1 --2- 172.21.15.2:0/3376698711 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f401406edc0 0x7f401406b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:09.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.412+0000 7f40137fe700 1 -- 172.21.15.2:0/3376698711 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f401406edc0 msgr2=0x7f401406b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:09.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.412+0000 7f40137fe700 1 --2- 172.21.15.2:0/3376698711 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f401406edc0 0x7f401406b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:09.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.412+0000 7f40137fe700 1 -- 172.21.15.2:0/3376698711 >> v1:172.21.15.2:6789/0 conn(0x7f401406dba0 legacy=0x7f401406e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:09.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.412+0000 7f40127fc700 1 -- 172.21.15.2:0/3376698711 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 313315189 0 0) 0x7f40140ad860 con 0x7f401406dba0 2023-11-26T07:15:09.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.412+0000 7f40137fe700 1 -- 172.21.15.2:0/3376698711 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4014072b50 con 0x7f401406afd0 2023-11-26T07:15:09.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.412+0000 7f40137fe700 1 --2- 172.21.15.2:0/3376698711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f401406afd0 0x7f40140b5a70 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f4008009840 tx=0x7f4008009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f2f7d73f0ee59d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:09.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.413+0000 7f40127fc700 1 -- 172.21.15.2:0/3376698711 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4008011830 con 0x7f401406afd0 2023-11-26T07:15:09.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.413+0000 7f40127fc700 1 -- 172.21.15.2:0/3376698711 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4008011990 con 0x7f401406afd0 2023-11-26T07:15:09.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.413+0000 7f40127fc700 1 -- 172.21.15.2:0/3376698711 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4008011d20 con 0x7f401406afd0 2023-11-26T07:15:09.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.413+0000 7f4019f3a700 1 -- 172.21.15.2:0/3376698711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f401406afd0 msgr2=0x7f40140b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:09.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.413+0000 7f4019f3a700 1 --2- 172.21.15.2:0/3376698711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f401406afd0 0x7f40140b5a70 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f4008009840 tx=0x7f4008009b50 comp rx=0 tx=0).stop 2023-11-26T07:15:09.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.413+0000 7f4019f3a700 1 -- 172.21.15.2:0/3376698711 shutdown_connections 2023-11-26T07:15:09.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.413+0000 7f4019f3a700 1 --2- 172.21.15.2:0/3376698711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f401406afd0 0x7f40140b5a70 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:09.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.413+0000 7f4019f3a700 1 --2- 172.21.15.2:0/3376698711 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f401406edc0 0x7f401406b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:09.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.413+0000 7f4019f3a700 1 -- 172.21.15.2:0/3376698711 >> 172.21.15.2:0/3376698711 conn(0x7f40140b2840 msgr2=0x7f40140b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:09.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.413+0000 7f4019f3a700 1 -- 172.21.15.2:0/3376698711 shutdown_connections 2023-11-26T07:15:09.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.413+0000 7f4019f3a700 1 -- 172.21.15.2:0/3376698711 wait complete. 2023-11-26T07:15:09.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.415+0000 7f4019f3a700 1 Processor -- start 2023-11-26T07:15:09.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.415+0000 7f4019f3a700 1 -- start start 2023-11-26T07:15:09.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.416+0000 7f4019f3a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f401406afd0 0x7f401415f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:09.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.416+0000 7f4019f3a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f401406dba0 0x7f40141543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:09.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.416+0000 7f4019f3a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f401406edc0 0x7f4014142420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:09.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.416+0000 7f4019f3a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40141606d0 con 0x7f401406dba0 2023-11-26T07:15:09.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.416+0000 7f4019f3a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401415f860 con 0x7f401406edc0 2023-11-26T07:15:09.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.416+0000 7f4019f3a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f401415fac0 con 0x7f401406afd0 2023-11-26T07:15:09.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.416+0000 7f4012ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f401406dba0 0x7f40141543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:09.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.416+0000 7f4012ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f401406dba0 0x7f40141543d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42930/0 (socket says 172.21.15.2:42930) 2023-11-26T07:15:09.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.416+0000 7f4012ffd700 1 -- 172.21.15.2:0/4133165513 learned_addr learned my addr 172.21.15.2:0/4133165513 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:09.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.416+0000 7f40137fe700 1 --2- 172.21.15.2:0/4133165513 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f401406afd0 0x7f401415f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:09.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.416+0000 7f4013fff700 1 --2- 172.21.15.2:0/4133165513 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f401406edc0 0x7f4014142420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:09.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.416+0000 7f4012ffd700 1 -- 172.21.15.2:0/4133165513 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f401406afd0 msgr2=0x7f401415f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:09.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.416+0000 7f4012ffd700 1 --2- 172.21.15.2:0/4133165513 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f401406afd0 0x7f401415f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:09.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.416+0000 7f4012ffd700 1 -- 172.21.15.2:0/4133165513 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f401406edc0 msgr2=0x7f4014142420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:09.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.416+0000 7f4012ffd700 1 --2- 172.21.15.2:0/4133165513 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f401406edc0 0x7f4014142420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:09.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.416+0000 7f4012ffd700 1 -- 172.21.15.2:0/4133165513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40080094a0 con 0x7f401406dba0 2023-11-26T07:15:09.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.416+0000 7f4012ffd700 1 --2- 172.21.15.2:0/4133165513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f401406dba0 0x7f40141543d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f400400d800 tx=0x7f400400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:09.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.417+0000 7f3ffbfff700 1 -- 172.21.15.2:0/4133165513 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40040126b0 con 0x7f401406dba0 2023-11-26T07:15:09.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.417+0000 7f3ffbfff700 1 -- 172.21.15.2:0/4133165513 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4004012810 con 0x7f401406dba0 2023-11-26T07:15:09.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.417+0000 7f4019f3a700 1 -- 172.21.15.2:0/4133165513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f401415fda0 con 0x7f401406dba0 2023-11-26T07:15:09.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.417+0000 7f3ffbfff700 1 -- 172.21.15.2:0/4133165513 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4004012ba0 con 0x7f401406dba0 2023-11-26T07:15:09.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.417+0000 7f4019f3a700 1 -- 172.21.15.2:0/4133165513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4014160360 con 0x7f401406dba0 2023-11-26T07:15:09.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.418+0000 7f4019f3a700 1 -- 172.21.15.2:0/4133165513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40140754d0 con 0x7f401406dba0 2023-11-26T07:15:09.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.418+0000 7f3ffbfff700 1 -- 172.21.15.2:0/4133165513 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f4004012d00 con 0x7f401406dba0 2023-11-26T07:15:09.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.418+0000 7f3ffbfff700 1 --2- 172.21.15.2:0/4133165513 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f400006b470 0x7f400006d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:09.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.419+0000 7f3ffbfff700 1 -- 172.21.15.2:0/4133165513 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4004089de0 con 0x7f401406dba0 2023-11-26T07:15:09.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.419+0000 7f40137fe700 1 --2- 172.21.15.2:0/4133165513 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f400006b470 0x7f400006d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:09.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.419+0000 7f40137fe700 1 --2- 172.21.15.2:0/4133165513 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f400006b470 0x7f400006d930 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f40080090b0 tx=0x7f4008008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:09.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.423+0000 7f3ffbfff700 1 -- 172.21.15.2:0/4133165513 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4004054970 con 0x7f401406dba0 2023-11-26T07:15:09.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.704+0000 7f4019f3a700 1 -- 172.21.15.2:0/4133165513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f4014068670 con 0x7f401406dba0 2023-11-26T07:15:09.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.704+0000 7f3ffbfff700 1 -- 172.21.15.2:0/4133165513 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f4004057f90 con 0x7f401406dba0 2023-11-26T07:15:09.707 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:15:09.707 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-26T07:15:09.708 INFO:teuthology.orchestra.run.smithi002.stdout: "auth_dump": [ 2023-11-26T07:15:09.708 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:15:09.708 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.a", 2023-11-26T07:15:09.708 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBv72JlhmTiEhAA/g3oblyy8oWp0Ha83rXvJw==", 2023-11-26T07:15:09.708 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:15:09.708 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-26T07:15:09.708 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-26T07:15:09.708 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-26T07:15:09.708 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:15:09.708 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:15:09.708 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:15:09.708 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:15:09.709 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.b", 2023-11-26T07:15:09.709 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBv72Jlq7BeHxAAOcHBt+2M+s3xqG9k14Oong==", 2023-11-26T07:15:09.709 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:15:09.709 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-26T07:15:09.709 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-26T07:15:09.709 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-26T07:15:09.709 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:15:09.709 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:15:09.709 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:15:09.709 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:15:09.709 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.c", 2023-11-26T07:15:09.709 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBv72Jl5jJFGhAAni1U32wc8K7h2w2Uri/P1Q==", 2023-11-26T07:15:09.709 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:15:09.710 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-26T07:15:09.710 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-26T07:15:09.710 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-26T07:15:09.710 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:15:09.710 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:15:09.710 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:15:09.710 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:15:09.710 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.d", 2023-11-26T07:15:09.710 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBv72JlhpKzJhAAp75J2TEPTop+Zj8ziajW1w==", 2023-11-26T07:15:09.710 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:15:09.710 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-26T07:15:09.710 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-26T07:15:09.711 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-26T07:15:09.711 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:15:09.711 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:15:09.711 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:15:09.711 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:15:09.711 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.0", 2023-11-26T07:15:09.711 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBx72JlnIatFhAAQQkaBQT0iVGJLFeE3ITlAQ==", 2023-11-26T07:15:09.711 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:15:09.711 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-26T07:15:09.711 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-26T07:15:09.711 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:15:09.711 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:15:09.711 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:15:09.712 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:15:09.712 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.1", 2023-11-26T07:15:09.712 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQB072JlXBpBFhAAAEeTzgDMWrtz6OM1Xt6AQg==", 2023-11-26T07:15:09.712 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:15:09.712 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-26T07:15:09.712 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-26T07:15:09.712 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:15:09.712 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:15:09.712 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:15:09.712 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:15:09.712 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.2", 2023-11-26T07:15:09.712 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQB372Jl4nopFhAAYua4b0EX2F1ldmd/00FcUA==", 2023-11-26T07:15:09.712 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:15:09.713 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-26T07:15:09.713 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-26T07:15:09.713 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:15:09.713 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:15:09.713 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:15:09.713 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:15:09.713 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.3", 2023-11-26T07:15:09.713 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQB672Jl73zLFRAATTzBUJUAS8/WHwoQZWQX1w==", 2023-11-26T07:15:09.713 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:15:09.713 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-26T07:15:09.713 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-26T07:15:09.713 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:15:09.713 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:15:09.714 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:15:09.714 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:15:09.714 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.4", 2023-11-26T07:15:09.714 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQCA72JlEqEZGhAAp//g7ZC8YUXoQhoKZKtcDA==", 2023-11-26T07:15:09.714 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:15:09.714 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-26T07:15:09.714 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-26T07:15:09.714 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:15:09.714 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:15:09.714 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:15:09.714 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:15:09.714 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.5", 2023-11-26T07:15:09.715 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQCD72JlGuu/GRAAQb5WygMoPJ7mjB2fR8N3+g==", 2023-11-26T07:15:09.715 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:15:09.715 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-26T07:15:09.715 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-26T07:15:09.715 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:15:09.715 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:15:09.715 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:15:09.715 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:15:09.715 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.6", 2023-11-26T07:15:09.715 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQCG72JlLHYCGRAAEDOtGcsGAVuKMSaXdJdgXg==", 2023-11-26T07:15:09.715 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:15:09.715 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-26T07:15:09.715 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-26T07:15:09.715 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:15:09.716 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:15:09.716 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:15:09.716 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:15:09.716 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.7", 2023-11-26T07:15:09.716 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQCJ72JlKmUJGRAAG7LL7Ath8gv2/HwbKsXYbg==", 2023-11-26T07:15:09.716 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:15:09.716 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-26T07:15:09.716 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-26T07:15:09.716 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:15:09.716 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:15:09.716 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:15:09.716 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:15:09.716 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.0", 2023-11-26T07:15:09.717 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBv72JlaEgQKxAA4cVx4nUFgqn0HvVBJdVHVg==", 2023-11-26T07:15:09.717 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:15:09.717 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-26T07:15:09.717 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow r", 2023-11-26T07:15:09.717 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-26T07:15:09.717 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:15:09.717 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:15:09.717 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:15:09.717 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.1", 2023-11-26T07:15:09.717 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBv72Jl/WHJMRAAcXuo1XInXpAErMaGOhvpBA==", 2023-11-26T07:15:09.717 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:15:09.717 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-26T07:15:09.717 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2023-11-26T07:15:09.718 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2023-11-26T07:15:09.718 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2023-11-26T07:15:09.718 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:15:09.718 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:15:09.718 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:15:09.718 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.2", 2023-11-26T07:15:09.718 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBv72Jl859vLhAAX9K4SuB6kAi/thy6EVKwWA==", 2023-11-26T07:15:09.718 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:15:09.718 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-26T07:15:09.718 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2023-11-26T07:15:09.718 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2023-11-26T07:15:09.718 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2023-11-26T07:15:09.718 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:15:09.719 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:15:09.719 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:15:09.719 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.3", 2023-11-26T07:15:09.719 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBv72JlRDh9NxAAgWUYNNwgFOantC7zH0fC8g==", 2023-11-26T07:15:09.719 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:15:09.719 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-26T07:15:09.719 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2023-11-26T07:15:09.719 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2023-11-26T07:15:09.719 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2023-11-26T07:15:09.719 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:15:09.719 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:15:09.719 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:15:09.719 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.admin", 2023-11-26T07:15:09.719 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBu72JlGFz7MBAA3accSSm2BS7VSUwOhEVnRQ==", 2023-11-26T07:15:09.720 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:15:09.720 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2023-11-26T07:15:09.720 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-26T07:15:09.720 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-26T07:15:09.720 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:15:09.720 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:15:09.720 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:15:09.720 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:15:09.720 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.x", 2023-11-26T07:15:09.720 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBv72Jlq5FrDxAAoovK02XkZdaKmOAgVyJKWw==", 2023-11-26T07:15:09.720 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:15:09.720 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2023-11-26T07:15:09.720 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2023-11-26T07:15:09.720 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:15:09.721 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:15:09.721 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:15:09.721 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:15:09.721 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.y", 2023-11-26T07:15:09.721 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBv72Jl5jZZCxAANtm1EyG6Goa1xfuH6Mcy2g==", 2023-11-26T07:15:09.721 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:15:09.721 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2023-11-26T07:15:09.721 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2023-11-26T07:15:09.721 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:15:09.721 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:15:09.721 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:15:09.721 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2023-11-26T07:15:09.721 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-26T07:15:09.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.707+0000 7f4019f3a700 1 -- 172.21.15.2:0/4133165513 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f400006b470 msgr2=0x7f400006d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:09.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.707+0000 7f4019f3a700 1 --2- 172.21.15.2:0/4133165513 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f400006b470 0x7f400006d930 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f40080090b0 tx=0x7f4008008030 comp rx=0 tx=0).stop 2023-11-26T07:15:09.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.707+0000 7f4019f3a700 1 -- 172.21.15.2:0/4133165513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f401406dba0 msgr2=0x7f40141543d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:09.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.707+0000 7f4019f3a700 1 --2- 172.21.15.2:0/4133165513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f401406dba0 0x7f40141543d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f400400d800 tx=0x7f400400db10 comp rx=0 tx=0).stop 2023-11-26T07:15:09.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.707+0000 7f4019f3a700 1 -- 172.21.15.2:0/4133165513 shutdown_connections 2023-11-26T07:15:09.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.707+0000 7f4019f3a700 1 --2- 172.21.15.2:0/4133165513 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f400006b470 0x7f400006d930 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:09.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.707+0000 7f4019f3a700 1 --2- 172.21.15.2:0/4133165513 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f401406edc0 0x7f4014142420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:09.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.707+0000 7f4019f3a700 1 --2- 172.21.15.2:0/4133165513 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f401406afd0 0x7f401415f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:09.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.707+0000 7f4019f3a700 1 --2- 172.21.15.2:0/4133165513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f401406dba0 0x7f40141543d0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:09.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.707+0000 7f4019f3a700 1 -- 172.21.15.2:0/4133165513 >> 172.21.15.2:0/4133165513 conn(0x7f40140b2840 msgr2=0x7f40140b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:09.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.707+0000 7f4019f3a700 1 -- 172.21.15.2:0/4133165513 shutdown_connections 2023-11-26T07:15:09.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.707+0000 7f4019f3a700 1 -- 172.21.15.2:0/4133165513 wait complete. 2023-11-26T07:15:09.724 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:15:09.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.846+0000 7f28295e3700 1 Processor -- start 2023-11-26T07:15:09.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.846+0000 7f28295e3700 1 -- start start 2023-11-26T07:15:09.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.846+0000 7f28295e3700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f282415bde0 0x7f282415c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:09.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.846+0000 7f28295e3700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f28240cf2b0 0x7f28240d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:09.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.846+0000 7f28295e3700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28240d0a90 con 0x7f28240ce5c0 2023-11-26T07:15:09.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.846+0000 7f28295e3700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f282406ee10 con 0x7f282415bde0 2023-11-26T07:15:09.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.847+0000 7f28295e3700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f282406f0f0 con 0x7f28240cf2b0 2023-11-26T07:15:09.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.847+0000 7f2822ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f282415bde0 0x7f282415c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:09.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.847+0000 7f28237fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f28240ce5c0 0x7f28240cc670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34150/0 (socket says 172.21.15.2:34150) 2023-11-26T07:15:09.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.847+0000 7f2822ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f282415bde0 0x7f282415c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42936/0 (socket says 172.21.15.2:42936) 2023-11-26T07:15:09.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.847+0000 7f28237fe700 1 -- 172.21.15.2:0/3573746747 learned_addr learned my addr 172.21.15.2:0/3573746747 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:15:09.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.847+0000 7f28227fc700 1 --2- 172.21.15.2:0/3573746747 >> v2:172.21.15.192:3300/0 conn(0x7f28240cf2b0 0x7f28240d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:09.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.847+0000 7f2822ffd700 1 -- 172.21.15.2:0/3573746747 >> v2:172.21.15.192:3300/0 conn(0x7f28240cf2b0 msgr2=0x7f28240d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:09.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.847+0000 7f2822ffd700 1 --2- 172.21.15.2:0/3573746747 >> v2:172.21.15.192:3300/0 conn(0x7f28240cf2b0 0x7f28240d01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:09.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.847+0000 7f2821ffb700 1 -- 172.21.15.2:0/3573746747 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 804261421 0 0) 0x7f28240d0a90 con 0x7f28240ce5c0 2023-11-26T07:15:09.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.847+0000 7f2822ffd700 1 -- 172.21.15.2:0/3573746747 >> v1:172.21.15.2:6789/0 conn(0x7f28240ce5c0 legacy=0x7f28240cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:09.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.847+0000 7f2822ffd700 1 -- 172.21.15.2:0/3573746747 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f282406f3d0 con 0x7f282415bde0 2023-11-26T07:15:09.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.847+0000 7f2822ffd700 1 --2- 172.21.15.2:0/3573746747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f282415bde0 0x7f282415c1c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f282406e780 tx=0x7f2814009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a382b857a820c4b4 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:09.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.847+0000 7f2821ffb700 1 -- 172.21.15.2:0/3573746747 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2814011830 con 0x7f282415bde0 2023-11-26T07:15:09.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.847+0000 7f2821ffb700 1 -- 172.21.15.2:0/3573746747 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2814011990 con 0x7f282415bde0 2023-11-26T07:15:09.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.847+0000 7f2821ffb700 1 -- 172.21.15.2:0/3573746747 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2814011d20 con 0x7f282415bde0 2023-11-26T07:15:09.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.848+0000 7f28295e3700 1 -- 172.21.15.2:0/3573746747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f282415bde0 msgr2=0x7f282415c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:09.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.848+0000 7f28295e3700 1 --2- 172.21.15.2:0/3573746747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f282415bde0 0x7f282415c1c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f282406e780 tx=0x7f2814009b20 comp rx=0 tx=0).stop 2023-11-26T07:15:09.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.848+0000 7f28295e3700 1 -- 172.21.15.2:0/3573746747 shutdown_connections 2023-11-26T07:15:09.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.848+0000 7f28295e3700 1 --2- 172.21.15.2:0/3573746747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f282415bde0 0x7f282415c1c0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:09.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.848+0000 7f28295e3700 1 --2- 172.21.15.2:0/3573746747 >> v2:172.21.15.192:3300/0 conn(0x7f28240cf2b0 0x7f28240d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:09.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.848+0000 7f28295e3700 1 -- 172.21.15.2:0/3573746747 >> 172.21.15.2:0/3573746747 conn(0x7f28240b3720 msgr2=0x7f28240b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:09.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.848+0000 7f28295e3700 1 -- 172.21.15.2:0/3573746747 shutdown_connections 2023-11-26T07:15:09.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.848+0000 7f28295e3700 1 -- 172.21.15.2:0/3573746747 wait complete. 2023-11-26T07:15:09.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.849+0000 7f28295e3700 1 Processor -- start 2023-11-26T07:15:09.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.849+0000 7f28295e3700 1 -- start start 2023-11-26T07:15:09.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.850+0000 7f28295e3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28240ce5c0 0x7f28240b5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:09.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.850+0000 7f28295e3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28240cf2b0 0x7f282415cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:09.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.850+0000 7f28295e3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f282415bde0 0x7f2824157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:09.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.850+0000 7f28295e3700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282415a7a0 con 0x7f28240cf2b0 2023-11-26T07:15:09.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.850+0000 7f28295e3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282415d260 con 0x7f282415bde0 2023-11-26T07:15:09.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.850+0000 7f28295e3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f282415d540 con 0x7f28240ce5c0 2023-11-26T07:15:09.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.850+0000 7f28227fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28240cf2b0 0x7f282415cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:09.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.850+0000 7f28227fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28240cf2b0 0x7f282415cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42944/0 (socket says 172.21.15.2:42944) 2023-11-26T07:15:09.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.850+0000 7f28227fc700 1 -- 172.21.15.2:0/3475504484 learned_addr learned my addr 172.21.15.2:0/3475504484 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:09.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.850+0000 7f28237fe700 1 --2- 172.21.15.2:0/3475504484 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f282415bde0 0x7f2824157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:09.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.850+0000 7f2822ffd700 1 --2- 172.21.15.2:0/3475504484 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28240ce5c0 0x7f28240b5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:09.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.851+0000 7f28227fc700 1 -- 172.21.15.2:0/3475504484 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28240ce5c0 msgr2=0x7f28240b5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:09.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.851+0000 7f28227fc700 1 --2- 172.21.15.2:0/3475504484 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28240ce5c0 0x7f28240b5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:09.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.851+0000 7f28227fc700 1 -- 172.21.15.2:0/3475504484 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f282415bde0 msgr2=0x7f2824157ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:09.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.851+0000 7f28227fc700 1 --2- 172.21.15.2:0/3475504484 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f282415bde0 0x7f2824157ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:09.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.851+0000 7f28227fc700 1 -- 172.21.15.2:0/3475504484 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28140094a0 con 0x7f28240cf2b0 2023-11-26T07:15:09.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.851+0000 7f2822ffd700 1 --2- 172.21.15.2:0/3475504484 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28240ce5c0 0x7f28240b5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:15:09.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.851+0000 7f28227fc700 1 --2- 172.21.15.2:0/3475504484 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28240cf2b0 0x7f282415cbd0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f281800c7f0 tx=0x7f281800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:09.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.851+0000 7f280b7fe700 1 -- 172.21.15.2:0/3475504484 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2818004220 con 0x7f28240cf2b0 2023-11-26T07:15:09.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.851+0000 7f280b7fe700 1 -- 172.21.15.2:0/3475504484 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2818004380 con 0x7f28240cf2b0 2023-11-26T07:15:09.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.851+0000 7f28295e3700 1 -- 172.21.15.2:0/3475504484 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28240ca650 con 0x7f28240cf2b0 2023-11-26T07:15:09.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.851+0000 7f280b7fe700 1 -- 172.21.15.2:0/3475504484 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28180036a0 con 0x7f28240cf2b0 2023-11-26T07:15:09.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.851+0000 7f28295e3700 1 -- 172.21.15.2:0/3475504484 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28241583e0 con 0x7f28240cf2b0 2023-11-26T07:15:09.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.852+0000 7f28295e3700 1 -- 172.21.15.2:0/3475504484 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28240caca0 con 0x7f28240cf2b0 2023-11-26T07:15:09.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.852+0000 7f280b7fe700 1 -- 172.21.15.2:0/3475504484 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f2818003800 con 0x7f28240cf2b0 2023-11-26T07:15:09.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.853+0000 7f280b7fe700 1 --2- 172.21.15.2:0/3475504484 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f281006b470 0x7f281006d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:09.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.853+0000 7f280b7fe700 1 -- 172.21.15.2:0/3475504484 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2818089a30 con 0x7f28240cf2b0 2023-11-26T07:15:09.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.853+0000 7f2822ffd700 1 --2- 172.21.15.2:0/3475504484 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f281006b470 0x7f281006d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:09.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.854+0000 7f2822ffd700 1 --2- 172.21.15.2:0/3475504484 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f281006b470 0x7f281006d930 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f28140090b0 tx=0x7f2814008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:09.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:09.857+0000 7f280b7fe700 1 -- 172.21.15.2:0/3475504484 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f28180544c0 con 0x7f28240cf2b0 2023-11-26T07:15:10.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.059+0000 7f28295e3700 1 -- 172.21.15.2:0/3475504484 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2824068670 con 0x7f28240cf2b0 2023-11-26T07:15:10.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.060+0000 7f280b7fe700 1 -- 172.21.15.2:0/3475504484 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+12809 (secure 0 0 0) 0x7f281801e090 con 0x7f28240cf2b0 2023-11-26T07:15:10.063 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:15:10.063 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":56,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:15:09.276176+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:15:10.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.062+0000 7f28295e3700 1 -- 172.21.15.2:0/3475504484 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f281006b470 msgr2=0x7f281006d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:10.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.062+0000 7f28295e3700 1 --2- 172.21.15.2:0/3475504484 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f281006b470 0x7f281006d930 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f28140090b0 tx=0x7f2814008030 comp rx=0 tx=0).stop 2023-11-26T07:15:10.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.062+0000 7f28295e3700 1 -- 172.21.15.2:0/3475504484 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28240cf2b0 msgr2=0x7f282415cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:10.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.062+0000 7f28295e3700 1 --2- 172.21.15.2:0/3475504484 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28240cf2b0 0x7f282415cbd0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f281800c7f0 tx=0x7f281800cbb0 comp rx=0 tx=0).stop 2023-11-26T07:15:10.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.062+0000 7f28295e3700 1 -- 172.21.15.2:0/3475504484 shutdown_connections 2023-11-26T07:15:10.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.062+0000 7f28295e3700 1 --2- 172.21.15.2:0/3475504484 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f281006b470 0x7f281006d930 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:10.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.062+0000 7f28295e3700 1 --2- 172.21.15.2:0/3475504484 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f282415bde0 0x7f2824157ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:10.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.062+0000 7f28295e3700 1 --2- 172.21.15.2:0/3475504484 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28240ce5c0 0x7f28240b5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:10.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.062+0000 7f28295e3700 1 --2- 172.21.15.2:0/3475504484 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28240cf2b0 0x7f282415cbd0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:10.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.062+0000 7f28295e3700 1 -- 172.21.15.2:0/3475504484 >> 172.21.15.2:0/3475504484 conn(0x7f28240b3720 msgr2=0x7f28240b3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:10.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.062+0000 7f28295e3700 1 -- 172.21.15.2:0/3475504484 shutdown_connections 2023-11-26T07:15:10.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.062+0000 7f28295e3700 1 -- 172.21.15.2:0/3475504484 wait complete. 2023-11-26T07:15:10.078 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:11:28.205739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:15:10.078 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:15:10.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.203+0000 7f65be34b700 1 Processor -- start 2023-11-26T07:15:10.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.203+0000 7f65be34b700 1 -- start start 2023-11-26T07:15:10.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.204+0000 7f65be34b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f65b815e090 0x7f65b806afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:10.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.204+0000 7f65be34b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65b81623d0 0x7f65b80cb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:10.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.204+0000 7f65be34b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65b815e470 con 0x7f65b806b510 2023-11-26T07:15:10.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.204+0000 7f65be34b700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65b80c6900 con 0x7f65b815e090 2023-11-26T07:15:10.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.204+0000 7f65be34b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65b806b990 con 0x7f65b81623d0 2023-11-26T07:15:10.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.204+0000 7f65b7fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f65b815e090 0x7f65b806afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:10.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.204+0000 7f65b7fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f65b815e090 0x7f65b806afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42950/0 (socket says 172.21.15.2:42950) 2023-11-26T07:15:10.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.204+0000 7f65b7fff700 1 -- 172.21.15.2:0/1693211087 learned_addr learned my addr 172.21.15.2:0/1693211087 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:10.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.204+0000 7f65bc8e8700 1 --2- 172.21.15.2:0/1693211087 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65b81623d0 0x7f65b80cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:10.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.204+0000 7f65b7fff700 1 -- 172.21.15.2:0/1693211087 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65b81623d0 msgr2=0x7f65b80cb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:10.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.204+0000 7f65b7fff700 1 --2- 172.21.15.2:0/1693211087 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65b81623d0 0x7f65b80cb160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:10.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.204+0000 7f65b7fff700 1 -- 172.21.15.2:0/1693211087 >> v1:172.21.15.192:6789/0 conn(0x7f65b806b510 legacy=0x7f65b8161cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:10.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.204+0000 7f65b7fff700 1 -- 172.21.15.2:0/1693211087 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b81629f0 con 0x7f65b815e090 2023-11-26T07:15:10.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.204+0000 7f65bc8e8700 1 --2- 172.21.15.2:0/1693211087 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65b81623d0 0x7f65b80cb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:15:10.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.205+0000 7f65b7fff700 1 --2- 172.21.15.2:0/1693211087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65b815e090 0x7f65b806afd0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f65ac0098f0 tx=0x7f65ac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd39adddd6b1fdd server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:10.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.205+0000 7f65b6ffd700 1 -- 172.21.15.2:0/1693211087 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac00b8a0 con 0x7f65b815e090 2023-11-26T07:15:10.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.205+0000 7f65b6ffd700 1 -- 172.21.15.2:0/1693211087 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ac00ba00 con 0x7f65b815e090 2023-11-26T07:15:10.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.205+0000 7f65b6ffd700 1 -- 172.21.15.2:0/1693211087 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac00bd90 con 0x7f65b815e090 2023-11-26T07:15:10.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.205+0000 7f65be34b700 1 -- 172.21.15.2:0/1693211087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65b815e090 msgr2=0x7f65b806afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:10.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.205+0000 7f65be34b700 1 --2- 172.21.15.2:0/1693211087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65b815e090 0x7f65b806afd0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f65ac0098f0 tx=0x7f65ac009c00 comp rx=0 tx=0).stop 2023-11-26T07:15:10.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.205+0000 7f65be34b700 1 -- 172.21.15.2:0/1693211087 shutdown_connections 2023-11-26T07:15:10.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.205+0000 7f65be34b700 1 --2- 172.21.15.2:0/1693211087 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65b81623d0 0x7f65b80cb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:10.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.205+0000 7f65be34b700 1 --2- 172.21.15.2:0/1693211087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65b815e090 0x7f65b806afd0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:10.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.205+0000 7f65be34b700 1 -- 172.21.15.2:0/1693211087 >> 172.21.15.2:0/1693211087 conn(0x7f65b80d0b10 msgr2=0x7f65b80d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:10.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.205+0000 7f65be34b700 1 -- 172.21.15.2:0/1693211087 shutdown_connections 2023-11-26T07:15:10.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.205+0000 7f65be34b700 1 -- 172.21.15.2:0/1693211087 wait complete. 2023-11-26T07:15:10.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.207+0000 7f65be34b700 1 Processor -- start 2023-11-26T07:15:10.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.207+0000 7f65be34b700 1 -- start start 2023-11-26T07:15:10.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.208+0000 7f65be34b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65b806b510 0x7f65b8160d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:10.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.208+0000 7f65be34b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65b815e090 0x7f65b8155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:10.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.208+0000 7f65be34b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65b81623d0 0x7f65b8156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:10.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.208+0000 7f65be34b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b815f140 con 0x7f65b815e090 2023-11-26T07:15:10.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.208+0000 7f65be34b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b80b5c10 con 0x7f65b806b510 2023-11-26T07:15:10.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.208+0000 7f65be34b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65b80b5eb0 con 0x7f65b81623d0 2023-11-26T07:15:10.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.208+0000 7f65b77fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65b815e090 0x7f65b8155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:10.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.208+0000 7f65b77fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65b815e090 0x7f65b8155d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42958/0 (socket says 172.21.15.2:42958) 2023-11-26T07:15:10.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.208+0000 7f65b77fe700 1 -- 172.21.15.2:0/2917062185 learned_addr learned my addr 172.21.15.2:0/2917062185 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:10.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.208+0000 7f65bc8e8700 1 --2- 172.21.15.2:0/2917062185 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65b81623d0 0x7f65b8156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:10.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.208+0000 7f65b7fff700 1 --2- 172.21.15.2:0/2917062185 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65b806b510 0x7f65b8160d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:10.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.208+0000 7f65b77fe700 1 -- 172.21.15.2:0/2917062185 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65b81623d0 msgr2=0x7f65b8156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:10.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.208+0000 7f65b77fe700 1 --2- 172.21.15.2:0/2917062185 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65b81623d0 0x7f65b8156240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:10.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.208+0000 7f65b77fe700 1 -- 172.21.15.2:0/2917062185 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65b806b510 msgr2=0x7f65b8160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:10.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.208+0000 7f65b77fe700 1 --2- 172.21.15.2:0/2917062185 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65b806b510 0x7f65b8160d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:10.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.208+0000 7f65b77fe700 1 -- 172.21.15.2:0/2917062185 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ac009550 con 0x7f65b815e090 2023-11-26T07:15:10.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.208+0000 7f65b77fe700 1 --2- 172.21.15.2:0/2917062185 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65b815e090 0x7f65b8155d00 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f65a800c4e0 tx=0x7f65a800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:10.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.208+0000 7f65b4ff9700 1 -- 172.21.15.2:0/2917062185 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a80052d0 con 0x7f65b815e090 2023-11-26T07:15:10.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.208+0000 7f65b4ff9700 1 -- 172.21.15.2:0/2917062185 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a8005430 con 0x7f65b815e090 2023-11-26T07:15:10.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.208+0000 7f65be34b700 1 -- 172.21.15.2:0/2917062185 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65b80b6190 con 0x7f65b815e090 2023-11-26T07:15:10.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.208+0000 7f65b4ff9700 1 -- 172.21.15.2:0/2917062185 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a80038c0 con 0x7f65b815e090 2023-11-26T07:15:10.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.208+0000 7f65be34b700 1 -- 172.21.15.2:0/2917062185 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65b80b6750 con 0x7f65b815e090 2023-11-26T07:15:10.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.209+0000 7f65be34b700 1 -- 172.21.15.2:0/2917062185 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65b8075480 con 0x7f65b815e090 2023-11-26T07:15:10.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.210+0000 7f65b4ff9700 1 -- 172.21.15.2:0/2917062185 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f65a8003a20 con 0x7f65b815e090 2023-11-26T07:15:10.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.210+0000 7f65b4ff9700 1 --2- 172.21.15.2:0/2917062185 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f65a406b470 0x7f65a406d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:10.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.210+0000 7f65b4ff9700 1 -- 172.21.15.2:0/2917062185 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f65a8089070 con 0x7f65b815e090 2023-11-26T07:15:10.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.211+0000 7f65b7fff700 1 --2- 172.21.15.2:0/2917062185 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f65a406b470 0x7f65a406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:10.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.211+0000 7f65b7fff700 1 --2- 172.21.15.2:0/2917062185 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f65a406b470 0x7f65a406d930 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f65ac009c40 tx=0x7f65ac008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:10.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.215+0000 7f65b4ff9700 1 -- 172.21.15.2:0/2917062185 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f65a8053bc0 con 0x7f65b815e090 2023-11-26T07:15:10.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.416+0000 7f65be34b700 1 -- 172.21.15.2:0/2917062185 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f65b80d1810 con 0x7f65b815e090 2023-11-26T07:15:10.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.416+0000 7f65b4ff9700 1 -- 172.21.15.2:0/2917062185 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) v1 ==== 93+0+10 (secure 0 0 0) 0x7f65a8017020 con 0x7f65b815e090 2023-11-26T07:15:10.419 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-26T07:15:10.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.418+0000 7f65be34b700 1 -- 172.21.15.2:0/2917062185 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f65a406b470 msgr2=0x7f65a406d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:10.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.418+0000 7f65be34b700 1 --2- 172.21.15.2:0/2917062185 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f65a406b470 0x7f65a406d930 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f65ac009c40 tx=0x7f65ac008030 comp rx=0 tx=0).stop 2023-11-26T07:15:10.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.418+0000 7f65be34b700 1 -- 172.21.15.2:0/2917062185 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65b815e090 msgr2=0x7f65b8155d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:10.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.418+0000 7f65be34b700 1 --2- 172.21.15.2:0/2917062185 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65b815e090 0x7f65b8155d00 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f65a800c4e0 tx=0x7f65a800c7f0 comp rx=0 tx=0).stop 2023-11-26T07:15:10.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.418+0000 7f65be34b700 1 -- 172.21.15.2:0/2917062185 shutdown_connections 2023-11-26T07:15:10.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.418+0000 7f65be34b700 1 --2- 172.21.15.2:0/2917062185 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f65a406b470 0x7f65a406d930 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:10.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.418+0000 7f65be34b700 1 --2- 172.21.15.2:0/2917062185 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65b81623d0 0x7f65b8156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:10.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.418+0000 7f65be34b700 1 --2- 172.21.15.2:0/2917062185 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65b806b510 0x7f65b8160d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:10.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.418+0000 7f65be34b700 1 --2- 172.21.15.2:0/2917062185 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65b815e090 0x7f65b8155d00 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:10.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.418+0000 7f65be34b700 1 -- 172.21.15.2:0/2917062185 >> 172.21.15.2:0/2917062185 conn(0x7f65b80d0b10 msgr2=0x7f65b80afb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:10.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.418+0000 7f65be34b700 1 -- 172.21.15.2:0/2917062185 shutdown_connections 2023-11-26T07:15:10.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.418+0000 7f65be34b700 1 -- 172.21.15.2:0/2917062185 wait complete. 2023-11-26T07:15:10.433 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-26T07:15:10.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.555+0000 7f023ec33700 1 Processor -- start 2023-11-26T07:15:10.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.555+0000 7f023ec33700 1 -- start start 2023-11-26T07:15:10.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.556+0000 7f023ec33700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f02380af980 0x7f0238066ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:10.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.556+0000 7f023ec33700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f023806b7c0 0x7f023806bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:10.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.556+0000 7f023ec33700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02380b10c0 con 0x7f023815bf10 2023-11-26T07:15:10.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.556+0000 7f023ec33700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f023806c170 con 0x7f02380af980 2023-11-26T07:15:10.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.556+0000 7f023ec33700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02380af730 con 0x7f023806b7c0 2023-11-26T07:15:10.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.556+0000 7f0237fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f02380af980 0x7f0238066ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:10.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.556+0000 7f023c9cf700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f023815bf10 0x7f02380b1550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34176/0 (socket says 172.21.15.2:34176) 2023-11-26T07:15:10.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.556+0000 7f023c9cf700 1 -- 172.21.15.2:0/2675024695 learned_addr learned my addr 172.21.15.2:0/2675024695 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:15:10.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.557+0000 7f0237fff700 1 -- 172.21.15.2:0/2675024695 >> v2:172.21.15.192:3300/0 conn(0x7f023806b7c0 msgr2=0x7f023806bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:10.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.557+0000 7f023d1d0700 1 --2- 172.21.15.2:0/2675024695 >> v2:172.21.15.192:3300/0 conn(0x7f023806b7c0 0x7f023806bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:10.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.557+0000 7f02377fe700 1 -- 172.21.15.2:0/2675024695 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3841564882 0 0) 0x7f02380b10c0 con 0x7f023815bf10 2023-11-26T07:15:10.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.557+0000 7f0237fff700 1 --2- 172.21.15.2:0/2675024695 >> v2:172.21.15.192:3300/0 conn(0x7f023806b7c0 0x7f023806bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:10.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.557+0000 7f0237fff700 1 -- 172.21.15.2:0/2675024695 >> v1:172.21.15.2:6789/0 conn(0x7f023815bf10 legacy=0x7f02380b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:10.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.557+0000 7f0237fff700 1 -- 172.21.15.2:0/2675024695 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02380b1c60 con 0x7f02380af980 2023-11-26T07:15:10.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.557+0000 7f023d1d0700 1 --2- 172.21.15.2:0/2675024695 >> v2:172.21.15.192:3300/0 conn(0x7f023806b7c0 0x7f023806bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:15:10.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.557+0000 7f0237fff700 1 --2- 172.21.15.2:0/2675024695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02380af980 0x7f0238066ce0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f0238071720 tx=0x7f0224009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=316b9b88d9b2c698 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:10.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.557+0000 7f02377fe700 1 -- 172.21.15.2:0/2675024695 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0224011830 con 0x7f02380af980 2023-11-26T07:15:10.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.557+0000 7f02377fe700 1 -- 172.21.15.2:0/2675024695 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0224011990 con 0x7f02380af980 2023-11-26T07:15:10.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.557+0000 7f02377fe700 1 -- 172.21.15.2:0/2675024695 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0224011d20 con 0x7f02380af980 2023-11-26T07:15:10.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.558+0000 7f023ec33700 1 -- 172.21.15.2:0/2675024695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02380af980 msgr2=0x7f0238066ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:10.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.558+0000 7f023ec33700 1 --2- 172.21.15.2:0/2675024695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02380af980 0x7f0238066ce0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f0238071720 tx=0x7f0224009b20 comp rx=0 tx=0).stop 2023-11-26T07:15:10.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.558+0000 7f023ec33700 1 -- 172.21.15.2:0/2675024695 shutdown_connections 2023-11-26T07:15:10.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.558+0000 7f023ec33700 1 --2- 172.21.15.2:0/2675024695 >> v2:172.21.15.192:3300/0 conn(0x7f023806b7c0 0x7f023806bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:10.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.558+0000 7f023ec33700 1 --2- 172.21.15.2:0/2675024695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02380af980 0x7f0238066ce0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:10.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.558+0000 7f023ec33700 1 -- 172.21.15.2:0/2675024695 >> 172.21.15.2:0/2675024695 conn(0x7f02380b5070 msgr2=0x7f02380b5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:10.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.558+0000 7f023ec33700 1 -- 172.21.15.2:0/2675024695 shutdown_connections 2023-11-26T07:15:10.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.558+0000 7f023ec33700 1 -- 172.21.15.2:0/2675024695 wait complete. 2023-11-26T07:15:10.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.559+0000 7f023ec33700 1 Processor -- start 2023-11-26T07:15:10.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.559+0000 7f023ec33700 1 -- start start 2023-11-26T07:15:10.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.560+0000 7f023ec33700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f023806b7c0 0x7f02381f4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:10.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.560+0000 7f023ec33700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02380af980 0x7f02381f7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:10.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.560+0000 7f023ec33700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f023815bf10 0x7f02380ae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:10.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.560+0000 7f023ec33700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02381f45d0 con 0x7f023806b7c0 2023-11-26T07:15:10.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.560+0000 7f023ec33700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02381f8450 con 0x7f02380af980 2023-11-26T07:15:10.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.560+0000 7f023ec33700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f023815ea60 con 0x7f023815bf10 2023-11-26T07:15:10.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.560+0000 7f023c9cf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f023806b7c0 0x7f02381f4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:10.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.560+0000 7f023c9cf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f023806b7c0 0x7f02381f4a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42972/0 (socket says 172.21.15.2:42972) 2023-11-26T07:15:10.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.560+0000 7f023c9cf700 1 -- 172.21.15.2:0/3081378247 learned_addr learned my addr 172.21.15.2:0/3081378247 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:10.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.560+0000 7f023d1d0700 1 --2- 172.21.15.2:0/3081378247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f023815bf10 0x7f02380ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:10.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.560+0000 7f0237fff700 1 --2- 172.21.15.2:0/3081378247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02380af980 0x7f02381f7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:10.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.560+0000 7f023c9cf700 1 -- 172.21.15.2:0/3081378247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f023815bf10 msgr2=0x7f02380ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:10.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.560+0000 7f023c9cf700 1 --2- 172.21.15.2:0/3081378247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f023815bf10 0x7f02380ae870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:10.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.560+0000 7f023c9cf700 1 -- 172.21.15.2:0/3081378247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02380af980 msgr2=0x7f02381f7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:10.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.560+0000 7f023c9cf700 1 --2- 172.21.15.2:0/3081378247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02380af980 0x7f02381f7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:10.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.560+0000 7f023c9cf700 1 -- 172.21.15.2:0/3081378247 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02240094a0 con 0x7f023806b7c0 2023-11-26T07:15:10.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.560+0000 7f023c9cf700 1 --2- 172.21.15.2:0/3081378247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f023806b7c0 0x7f02381f4a60 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f022c00c550 tx=0x7f022c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:10.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.561+0000 7f02357fa700 1 -- 172.21.15.2:0/3081378247 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022c004c80 con 0x7f023806b7c0 2023-11-26T07:15:10.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.561+0000 7f02357fa700 1 -- 172.21.15.2:0/3081378247 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022c004e00 con 0x7f023806b7c0 2023-11-26T07:15:10.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.561+0000 7f023ec33700 1 -- 172.21.15.2:0/3081378247 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f023815ed00 con 0x7f023806b7c0 2023-11-26T07:15:10.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.561+0000 7f02357fa700 1 -- 172.21.15.2:0/3081378247 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022c007310 con 0x7f023806b7c0 2023-11-26T07:15:10.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.561+0000 7f023ec33700 1 -- 172.21.15.2:0/3081378247 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02381f4260 con 0x7f023806b7c0 2023-11-26T07:15:10.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.562+0000 7f023ec33700 1 -- 172.21.15.2:0/3081378247 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02381f48b0 con 0x7f023806b7c0 2023-11-26T07:15:10.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.562+0000 7f02357fa700 1 -- 172.21.15.2:0/3081378247 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f022c007470 con 0x7f023806b7c0 2023-11-26T07:15:10.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.563+0000 7f02357fa700 1 --2- 172.21.15.2:0/3081378247 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f021c06b470 0x7f021c06d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:10.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.563+0000 7f02357fa700 1 -- 172.21.15.2:0/3081378247 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f022c0899d0 con 0x7f023806b7c0 2023-11-26T07:15:10.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.563+0000 7f0237fff700 1 --2- 172.21.15.2:0/3081378247 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f021c06b470 0x7f021c06d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:10.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.563+0000 7f0237fff700 1 --2- 172.21.15.2:0/3081378247 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f021c06b470 0x7f021c06d930 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f02240090b0 tx=0x7f0224008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:10.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.567+0000 7f02357fa700 1 -- 172.21.15.2:0/3081378247 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f022c0545f0 con 0x7f023806b7c0 2023-11-26T07:15:10.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.768+0000 7f023ec33700 1 -- 172.21.15.2:0/3081378247 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0238068670 con 0x7f023806b7c0 2023-11-26T07:15:10.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.769+0000 7f02357fa700 1 -- 172.21.15.2:0/3081378247 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v56) v1 ==== 84+0+65 (secure 0 0 0) 0x7f022c057c10 con 0x7f023806b7c0 2023-11-26T07:15:10.772 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:15:10.772 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2023-11-26T07:15:10.772 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:15:10.772 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 1, 2023-11-26T07:15:10.772 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": ".mgr" 2023-11-26T07:15:10.772 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:15:10.772 INFO:teuthology.orchestra.run.smithi002.stdout:] 2023-11-26T07:15:10.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.771+0000 7f023ec33700 1 -- 172.21.15.2:0/3081378247 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f021c06b470 msgr2=0x7f021c06d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:10.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.771+0000 7f023ec33700 1 --2- 172.21.15.2:0/3081378247 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f021c06b470 0x7f021c06d930 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f02240090b0 tx=0x7f0224008030 comp rx=0 tx=0).stop 2023-11-26T07:15:10.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.771+0000 7f023ec33700 1 -- 172.21.15.2:0/3081378247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f023806b7c0 msgr2=0x7f02381f4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:10.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.771+0000 7f023ec33700 1 --2- 172.21.15.2:0/3081378247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f023806b7c0 0x7f02381f4a60 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f022c00c550 tx=0x7f022c00c910 comp rx=0 tx=0).stop 2023-11-26T07:15:10.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.771+0000 7f023ec33700 1 -- 172.21.15.2:0/3081378247 shutdown_connections 2023-11-26T07:15:10.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.771+0000 7f023ec33700 1 --2- 172.21.15.2:0/3081378247 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f021c06b470 0x7f021c06d930 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:10.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.771+0000 7f023ec33700 1 --2- 172.21.15.2:0/3081378247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f023815bf10 0x7f02380ae870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:10.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.771+0000 7f023ec33700 1 --2- 172.21.15.2:0/3081378247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f023806b7c0 0x7f02381f4a60 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:10.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.771+0000 7f023ec33700 1 --2- 172.21.15.2:0/3081378247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02380af980 0x7f02381f7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:10.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.771+0000 7f023ec33700 1 -- 172.21.15.2:0/3081378247 >> 172.21.15.2:0/3081378247 conn(0x7f02380b5070 msgr2=0x7f02381599a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:10.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.771+0000 7f023ec33700 1 -- 172.21.15.2:0/3081378247 shutdown_connections 2023-11-26T07:15:10.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.771+0000 7f023ec33700 1 -- 172.21.15.2:0/3081378247 wait complete. 2023-11-26T07:15:10.786 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-26T07:15:10.786 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-26T07:15:10.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.912+0000 7f09072ae700 1 Processor -- start 2023-11-26T07:15:10.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.912+0000 7f09072ae700 1 -- start start 2023-11-26T07:15:10.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.913+0000 7f09072ae700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f090015a440 0x7f09000b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:10.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.913+0000 7f09072ae700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f09000ad1f0 0x7f09000d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:10.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.913+0000 7f09072ae700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f090006c310 0x7f09000d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:10.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.913+0000 7f09072ae700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09000b6380 con 0x7f090015a440 2023-11-26T07:15:10.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.913+0000 7f09072ae700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f090006bd80 con 0x7f09000ad1f0 2023-11-26T07:15:10.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.913+0000 7f09072ae700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f090006b170 con 0x7f090006c310 2023-11-26T07:15:10.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.913+0000 7f090504a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f090015a440 0x7f09000b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:10.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.913+0000 7f090504a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f090015a440 0x7f09000b5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42980/0 (socket says 172.21.15.2:42980) 2023-11-26T07:15:10.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.913+0000 7f090504a700 1 -- 172.21.15.2:0/798266932 learned_addr learned my addr 172.21.15.2:0/798266932 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:10.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.913+0000 7f090584b700 1 --2- 172.21.15.2:0/798266932 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f090006c310 0x7f09000d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:10.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.913+0000 7f0904849700 1 --2- 172.21.15.2:0/798266932 >> v2:172.21.15.192:3300/0 conn(0x7f09000ad1f0 0x7f09000d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:10.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.914+0000 7f090504a700 1 -- 172.21.15.2:0/798266932 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f090006c310 msgr2=0x7f09000d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:10.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.914+0000 7f090504a700 1 --2- 172.21.15.2:0/798266932 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f090006c310 0x7f09000d07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:10.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.914+0000 7f090504a700 1 -- 172.21.15.2:0/798266932 >> v2:172.21.15.192:3300/0 conn(0x7f09000ad1f0 msgr2=0x7f09000d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:10.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.914+0000 7f090504a700 1 --2- 172.21.15.2:0/798266932 >> v2:172.21.15.192:3300/0 conn(0x7f09000ad1f0 0x7f09000d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:10.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.914+0000 7f090504a700 1 -- 172.21.15.2:0/798266932 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f090006b450 con 0x7f090015a440 2023-11-26T07:15:10.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.914+0000 7f090584b700 1 --2- 172.21.15.2:0/798266932 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f090006c310 0x7f09000d07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:15:10.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.914+0000 7f090504a700 1 --2- 172.21.15.2:0/798266932 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f090015a440 0x7f09000b5e40 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f09000b32e0 tx=0x7f08f0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5884c76b889c6cc server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:10.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.914+0000 7f08f7fff700 1 -- 172.21.15.2:0/798266932 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f000b870 con 0x7f090015a440 2023-11-26T07:15:10.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.914+0000 7f08f7fff700 1 -- 172.21.15.2:0/798266932 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f000b9d0 con 0x7f090015a440 2023-11-26T07:15:10.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.914+0000 7f08f7fff700 1 -- 172.21.15.2:0/798266932 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f000bd60 con 0x7f090015a440 2023-11-26T07:15:10.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.914+0000 7f09072ae700 1 -- 172.21.15.2:0/798266932 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f090015a440 msgr2=0x7f09000b5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:10.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.914+0000 7f09072ae700 1 --2- 172.21.15.2:0/798266932 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f090015a440 0x7f09000b5e40 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f09000b32e0 tx=0x7f08f0009bd0 comp rx=0 tx=0).stop 2023-11-26T07:15:10.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.914+0000 7f09072ae700 1 -- 172.21.15.2:0/798266932 shutdown_connections 2023-11-26T07:15:10.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.914+0000 7f09072ae700 1 --2- 172.21.15.2:0/798266932 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f090006c310 0x7f09000d07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:10.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.914+0000 7f09072ae700 1 --2- 172.21.15.2:0/798266932 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f090015a440 0x7f09000b5e40 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:10.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.914+0000 7f09072ae700 1 --2- 172.21.15.2:0/798266932 >> v2:172.21.15.192:3300/0 conn(0x7f09000ad1f0 0x7f09000d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:10.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.915+0000 7f09072ae700 1 -- 172.21.15.2:0/798266932 >> 172.21.15.2:0/798266932 conn(0x7f09000b5070 msgr2=0x7f09000b5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:10.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.915+0000 7f09072ae700 1 -- 172.21.15.2:0/798266932 shutdown_connections 2023-11-26T07:15:10.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.915+0000 7f09072ae700 1 -- 172.21.15.2:0/798266932 wait complete. 2023-11-26T07:15:10.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.916+0000 7f09072ae700 1 Processor -- start 2023-11-26T07:15:10.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.916+0000 7f09072ae700 1 -- start start 2023-11-26T07:15:10.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.917+0000 7f09072ae700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f090006c310 0x7f09001f27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:10.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.917+0000 7f09072ae700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09000ad1f0 0x7f0900155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:10.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.917+0000 7f09072ae700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f090015a440 0x7f090014c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:10.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.917+0000 7f09072ae700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09001566b0 con 0x7f090006c310 2023-11-26T07:15:10.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.917+0000 7f09072ae700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09001f2d30 con 0x7f09000ad1f0 2023-11-26T07:15:10.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.917+0000 7f09072ae700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0900153db0 con 0x7f090015a440 2023-11-26T07:15:10.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.917+0000 7f090504a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f090006c310 0x7f09001f27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:10.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.917+0000 7f090504a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f090006c310 0x7f09001f27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42986/0 (socket says 172.21.15.2:42986) 2023-11-26T07:15:10.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.917+0000 7f090504a700 1 -- 172.21.15.2:0/3807544708 learned_addr learned my addr 172.21.15.2:0/3807544708 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:10.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.917+0000 7f090584b700 1 --2- 172.21.15.2:0/3807544708 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f090015a440 0x7f090014c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:10.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.917+0000 7f0904849700 1 --2- 172.21.15.2:0/3807544708 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09000ad1f0 0x7f0900155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:10.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.917+0000 7f090504a700 1 -- 172.21.15.2:0/3807544708 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f090015a440 msgr2=0x7f090014c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:10.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.917+0000 7f090504a700 1 --2- 172.21.15.2:0/3807544708 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f090015a440 0x7f090014c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:10.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.917+0000 7f090504a700 1 -- 172.21.15.2:0/3807544708 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09000ad1f0 msgr2=0x7f0900155c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:10.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.917+0000 7f090504a700 1 --2- 172.21.15.2:0/3807544708 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09000ad1f0 0x7f0900155c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:10.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.917+0000 7f090504a700 1 -- 172.21.15.2:0/3807544708 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f0009550 con 0x7f090006c310 2023-11-26T07:15:10.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.917+0000 7f090584b700 1 --2- 172.21.15.2:0/3807544708 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f090015a440 0x7f090014c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:15:10.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.917+0000 7f090504a700 1 --2- 172.21.15.2:0/3807544708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f090006c310 0x7f09001f27f0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f08f0014040 tx=0x7f08f0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:10.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.917+0000 7f08f5ffb700 1 -- 172.21.15.2:0/3807544708 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f0004520 con 0x7f090006c310 2023-11-26T07:15:10.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.917+0000 7f08f5ffb700 1 -- 172.21.15.2:0/3807544708 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f001e070 con 0x7f090006c310 2023-11-26T07:15:10.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.917+0000 7f09072ae700 1 -- 172.21.15.2:0/3807544708 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0900156180 con 0x7f090006c310 2023-11-26T07:15:10.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.917+0000 7f08f5ffb700 1 -- 172.21.15.2:0/3807544708 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f00038e0 con 0x7f090006c310 2023-11-26T07:15:10.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.918+0000 7f09072ae700 1 -- 172.21.15.2:0/3807544708 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09001563d0 con 0x7f090006c310 2023-11-26T07:15:10.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.918+0000 7f09072ae700 1 -- 172.21.15.2:0/3807544708 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f090006ebf0 con 0x7f090006c310 2023-11-26T07:15:10.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.919+0000 7f08f5ffb700 1 -- 172.21.15.2:0/3807544708 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f08f0003a40 con 0x7f090006c310 2023-11-26T07:15:10.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.919+0000 7f08f5ffb700 1 --2- 172.21.15.2:0/3807544708 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f08e406b470 0x7f08e406d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:10.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.919+0000 7f08f5ffb700 1 -- 172.21.15.2:0/3807544708 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f08f0020070 con 0x7f090006c310 2023-11-26T07:15:10.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.920+0000 7f0904849700 1 --2- 172.21.15.2:0/3807544708 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f08e406b470 0x7f08e406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:10.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.920+0000 7f0904849700 1 --2- 172.21.15.2:0/3807544708 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f08e406b470 0x7f08e406d930 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f090015afe0 tx=0x7f08fc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:10.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:10.924+0000 7f08f5ffb700 1 -- 172.21.15.2:0/3807544708 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f08f00bde90 con 0x7f090006c310 2023-11-26T07:15:11.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.124+0000 7f09072ae700 1 -- 172.21.15.2:0/3807544708 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f0900068670 con 0x7f090006c310 2023-11-26T07:15:11.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.277+0000 7f08f5ffb700 1 -- 172.21.15.2:0/3807544708 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v57) v1 ==== 138+0+0 (secure 0 0 0) 0x7f08f00150b0 con 0x7f090006c310 2023-11-26T07:15:11.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.279+0000 7f09072ae700 1 -- 172.21.15.2:0/3807544708 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f08e406b470 msgr2=0x7f08e406d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:11.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.279+0000 7f09072ae700 1 --2- 172.21.15.2:0/3807544708 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f08e406b470 0x7f08e406d930 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f090015afe0 tx=0x7f08fc008040 comp rx=0 tx=0).stop 2023-11-26T07:15:11.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.279+0000 7f09072ae700 1 -- 172.21.15.2:0/3807544708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f090006c310 msgr2=0x7f09001f27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:11.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.279+0000 7f09072ae700 1 --2- 172.21.15.2:0/3807544708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f090006c310 0x7f09001f27f0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f08f0014040 tx=0x7f08f0004750 comp rx=0 tx=0).stop 2023-11-26T07:15:11.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.280+0000 7f09072ae700 1 -- 172.21.15.2:0/3807544708 shutdown_connections 2023-11-26T07:15:11.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.280+0000 7f09072ae700 1 --2- 172.21.15.2:0/3807544708 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f08e406b470 0x7f08e406d930 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:11.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.280+0000 7f09072ae700 1 --2- 172.21.15.2:0/3807544708 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f090015a440 0x7f090014c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:11.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.280+0000 7f09072ae700 1 --2- 172.21.15.2:0/3807544708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f090006c310 0x7f09001f27f0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:11.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.280+0000 7f09072ae700 1 --2- 172.21.15.2:0/3807544708 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09000ad1f0 0x7f0900155c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:11.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.280+0000 7f09072ae700 1 -- 172.21.15.2:0/3807544708 >> 172.21.15.2:0/3807544708 conn(0x7f09000b5070 msgr2=0x7f090014eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:11.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.280+0000 7f09072ae700 1 -- 172.21.15.2:0/3807544708 shutdown_connections 2023-11-26T07:15:11.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.281+0000 7f09072ae700 1 -- 172.21.15.2:0/3807544708 wait complete. 2023-11-26T07:15:11.285 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' created 2023-11-26T07:15:11.298 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-26T07:15:11.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.427+0000 7f7ac8d85700 1 Processor -- start 2023-11-26T07:15:11.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.427+0000 7f7ac8d85700 1 -- start start 2023-11-26T07:15:11.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.428+0000 7f7ac8d85700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7ac40b4150 0x7f7ac406de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:11.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.428+0000 7f7ac8d85700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ac4071f50 con 0x7f7ac406b620 2023-11-26T07:15:11.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.428+0000 7f7ac8d85700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ac4072230 con 0x7f7ac40b5ab0 2023-11-26T07:15:11.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.428+0000 7f7ac8d85700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ac4072510 con 0x7f7ac40b4150 2023-11-26T07:15:11.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.428+0000 7f7ac259c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7ac406b620 0x7f7ac40b3a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34204/0 (socket says 172.21.15.2:34204) 2023-11-26T07:15:11.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.428+0000 7f7ac259c700 1 -- 172.21.15.2:0/2450227920 learned_addr learned my addr 172.21.15.2:0/2450227920 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:15:11.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.429+0000 7f7ac1d9b700 1 --2- 172.21.15.2:0/2450227920 >> v2:172.21.15.192:3300/0 conn(0x7f7ac40b4150 0x7f7ac406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:11.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.429+0000 7f7ac159a700 1 -- 172.21.15.2:0/2450227920 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 858296555 0 0) 0x7f7ac4071f50 con 0x7f7ac406b620 2023-11-26T07:15:11.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.429+0000 7f7ac159a700 1 -- 172.21.15.2:0/2450227920 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7aac0035b0 con 0x7f7ac406b620 2023-11-26T07:15:11.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.429+0000 7f7ac159a700 1 -- 172.21.15.2:0/2450227920 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1441027227 0 0) 0x7f7ac4072230 con 0x7f7ac40b5ab0 2023-11-26T07:15:11.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.429+0000 7f7ac159a700 1 -- 172.21.15.2:0/2450227920 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ac4071f50 con 0x7f7ac40b5ab0 2023-11-26T07:15:11.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.429+0000 7f7ac159a700 1 -- 172.21.15.2:0/2450227920 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3766783448 0 0) 0x7f7aac0035b0 con 0x7f7ac406b620 2023-11-26T07:15:11.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.429+0000 7f7ac159a700 1 -- 172.21.15.2:0/2450227920 >> v2:172.21.15.192:3300/0 conn(0x7f7ac40b4150 msgr2=0x7f7ac406de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:11.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.429+0000 7f7ac159a700 1 --2- 172.21.15.2:0/2450227920 >> v2:172.21.15.192:3300/0 conn(0x7f7ac40b4150 0x7f7ac406de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:11.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.429+0000 7f7ac159a700 1 -- 172.21.15.2:0/2450227920 >> v1:172.21.15.192:6789/0 conn(0x7f7ac40b5ab0 legacy=0x7f7ac406e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:11.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.429+0000 7f7ac159a700 1 -- 172.21.15.2:0/2450227920 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac40727f0 con 0x7f7ac406b620 2023-11-26T07:15:11.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.429+0000 7f7ac159a700 1 -- 172.21.15.2:0/2450227920 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f7ab8001670 con 0x7f7ac406b620 2023-11-26T07:15:11.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.429+0000 7f7ac159a700 1 -- 172.21.15.2:0/2450227920 >> v1:172.21.15.2:6789/0 conn(0x7f7ac406b620 legacy=0x7f7ac40b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:11.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.429+0000 7f7ac159a700 1 --2- 172.21.15.2:0/2450227920 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aac003b90 0x7f7aac003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:11.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.429+0000 7f7ac159a700 1 --2- 172.21.15.2:0/2450227920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7aac004850 0x7f7aac004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:11.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.429+0000 7f7ac159a700 1 --2- 172.21.15.2:0/2450227920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7aac005210 0x7f7aac00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:11.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.429+0000 7f7ac159a700 1 -- 172.21.15.2:0/2450227920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac4072510 con 0x7f7aac005210 2023-11-26T07:15:11.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.429+0000 7f7ac159a700 1 -- 172.21.15.2:0/2450227920 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aac00c090 con 0x7f7aac004850 2023-11-26T07:15:11.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.429+0000 7f7ac159a700 1 -- 172.21.15.2:0/2450227920 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aac00c250 con 0x7f7aac003b90 2023-11-26T07:15:11.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.429+0000 7f7ac2d9d700 1 --2- 172.21.15.2:0/2450227920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7aac005210 0x7f7aac00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:11.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.429+0000 7f7ac1d9b700 1 --2- 172.21.15.2:0/2450227920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7aac004850 0x7f7aac004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:11.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.429+0000 7f7ac259c700 1 --2- 172.21.15.2:0/2450227920 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aac003b90 0x7f7aac003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:11.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.430+0000 7f7ac2d9d700 1 -- 172.21.15.2:0/2450227920 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aac003b90 msgr2=0x7f7aac003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:11.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.430+0000 7f7ac2d9d700 1 --2- 172.21.15.2:0/2450227920 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aac003b90 0x7f7aac003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:11.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.430+0000 7f7ac2d9d700 1 -- 172.21.15.2:0/2450227920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7aac004850 msgr2=0x7f7aac004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:11.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.430+0000 7f7ac2d9d700 1 --2- 172.21.15.2:0/2450227920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7aac004850 0x7f7aac004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:11.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.430+0000 7f7ac2d9d700 1 -- 172.21.15.2:0/2450227920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aac0035b0 con 0x7f7aac005210 2023-11-26T07:15:11.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.430+0000 7f7ac2d9d700 1 -- 172.21.15.2:0/2450227920 reap_dead start 2023-11-26T07:15:11.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.430+0000 7f7ac2d9d700 1 --2- 172.21.15.2:0/2450227920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7aac005210 0x7f7aac00ba10 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f7abc00c2f0 tx=0x7f7aac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd79ae468960574 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:11.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.430+0000 7f7ac159a700 1 -- 172.21.15.2:0/2450227920 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7abc001f30 con 0x7f7aac005210 2023-11-26T07:15:11.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.430+0000 7f7ac159a700 1 -- 172.21.15.2:0/2450227920 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7abc003a00 con 0x7f7aac005210 2023-11-26T07:15:11.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.430+0000 7f7ac159a700 1 -- 172.21.15.2:0/2450227920 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7abc003db0 con 0x7f7aac005210 2023-11-26T07:15:11.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.430+0000 7f7ac8d85700 1 -- 172.21.15.2:0/2450227920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7aac005210 msgr2=0x7f7aac00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:11.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.430+0000 7f7ac8d85700 1 --2- 172.21.15.2:0/2450227920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7aac005210 0x7f7aac00ba10 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f7abc00c2f0 tx=0x7f7aac005880 comp rx=0 tx=0).stop 2023-11-26T07:15:11.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.430+0000 7f7ac8d85700 1 -- 172.21.15.2:0/2450227920 shutdown_connections 2023-11-26T07:15:11.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.431+0000 7f7ac8d85700 1 --2- 172.21.15.2:0/2450227920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7aac005210 0x7f7aac00ba10 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:11.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.431+0000 7f7ac8d85700 1 -- 172.21.15.2:0/2450227920 >> 172.21.15.2:0/2450227920 conn(0x7f7ac40b2740 msgr2=0x7f7ac40b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:11.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.431+0000 7f7ac8d85700 1 -- 172.21.15.2:0/2450227920 shutdown_connections 2023-11-26T07:15:11.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.431+0000 7f7ac8d85700 1 -- 172.21.15.2:0/2450227920 wait complete. 2023-11-26T07:15:11.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.432+0000 7f7ac8d85700 1 Processor -- start 2023-11-26T07:15:11.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.432+0000 7f7ac8d85700 1 -- start start 2023-11-26T07:15:11.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.433+0000 7f7ac8d85700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7aac005210 0x7f7ac41f7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:11.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.433+0000 7f7ac8d85700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ac41f7570 0x7f7ac406e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:11.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.433+0000 7f7ac8d85700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ac406ee30 0x7f7ac4136fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:11.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.433+0000 7f7ac8d85700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac40cfb70 con 0x7f7aac005210 2023-11-26T07:15:11.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.433+0000 7f7ac8d85700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac41f79f0 con 0x7f7ac406ee30 2023-11-26T07:15:11.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.433+0000 7f7ac8d85700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac4134d60 con 0x7f7ac41f7570 2023-11-26T07:15:11.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.433+0000 7f7ac259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7aac005210 0x7f7ac41f7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:11.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.433+0000 7f7ac259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7aac005210 0x7f7ac41f7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43006/0 (socket says 172.21.15.2:43006) 2023-11-26T07:15:11.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.433+0000 7f7ac259c700 1 -- 172.21.15.2:0/3454842199 learned_addr learned my addr 172.21.15.2:0/3454842199 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:11.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.433+0000 7f7ac259c700 1 -- 172.21.15.2:0/3454842199 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ac41f7570 msgr2=0x7f7ac406e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:11.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.433+0000 7f7ac259c700 1 --2- 172.21.15.2:0/3454842199 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ac41f7570 0x7f7ac406e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:11.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.433+0000 7f7ac259c700 1 -- 172.21.15.2:0/3454842199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ac406ee30 msgr2=0x7f7ac4136fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:11.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.433+0000 7f7ac259c700 1 --2- 172.21.15.2:0/3454842199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ac406ee30 0x7f7ac4136fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:11.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.433+0000 7f7ac259c700 1 -- 172.21.15.2:0/3454842199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac406f690 con 0x7f7aac005210 2023-11-26T07:15:11.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.433+0000 7f7ac259c700 1 --2- 172.21.15.2:0/3454842199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7aac005210 0x7f7ac41f7030 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8007340 tx=0x7f7ab8007650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:11.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.433+0000 7f7ab2ffd700 1 -- 172.21.15.2:0/3454842199 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab800f660 con 0x7f7aac005210 2023-11-26T07:15:11.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.434+0000 7f7ab2ffd700 1 -- 172.21.15.2:0/3454842199 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab800f800 con 0x7f7aac005210 2023-11-26T07:15:11.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.434+0000 7f7ac8d85700 1 -- 172.21.15.2:0/3454842199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ac40c5a50 con 0x7f7aac005210 2023-11-26T07:15:11.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.434+0000 7f7ab2ffd700 1 -- 172.21.15.2:0/3454842199 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab800fbb0 con 0x7f7aac005210 2023-11-26T07:15:11.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.434+0000 7f7ac8d85700 1 -- 172.21.15.2:0/3454842199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ac40c6010 con 0x7f7aac005210 2023-11-26T07:15:11.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.434+0000 7f7ac8d85700 1 -- 172.21.15.2:0/3454842199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ac4075480 con 0x7f7aac005210 2023-11-26T07:15:11.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.435+0000 7f7ab2ffd700 1 -- 172.21.15.2:0/3454842199 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f7ab800fd10 con 0x7f7aac005210 2023-11-26T07:15:11.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.435+0000 7f7ab2ffd700 1 --2- 172.21.15.2:0/3454842199 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7aa406b470 0x7f7aa406d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:11.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.436+0000 7f7ab2ffd700 1 -- 172.21.15.2:0/3454842199 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f7ab8089e50 con 0x7f7aac005210 2023-11-26T07:15:11.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.436+0000 7f7ac1d9b700 1 --2- 172.21.15.2:0/3454842199 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7aa406b470 0x7f7aa406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:11.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.436+0000 7f7ac1d9b700 1 --2- 172.21.15.2:0/3454842199 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7aa406b470 0x7f7aa406d930 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7ac40cff00 tx=0x7f7ab40093c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:11.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.440+0000 7f7ab2ffd700 1 -- 172.21.15.2:0/3454842199 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7ab8054870 con 0x7f7aac005210 2023-11-26T07:15:11.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:11.641+0000 7f7ac8d85700 1 -- 172.21.15.2:0/3454842199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7ac406bd40 con 0x7f7aac005210 2023-11-26T07:15:12.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.282+0000 7f7ab2ffd700 1 -- 172.21.15.2:0/3454842199 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v58) v1 ==== 170+0+0 (secure 0 0 0) 0x7f7ab8057e90 con 0x7f7aac005210 2023-11-26T07:15:12.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.285+0000 7f7ac8d85700 1 -- 172.21.15.2:0/3454842199 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7aa406b470 msgr2=0x7f7aa406d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:12.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.285+0000 7f7ac8d85700 1 --2- 172.21.15.2:0/3454842199 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7aa406b470 0x7f7aa406d930 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7ac40cff00 tx=0x7f7ab40093c0 comp rx=0 tx=0).stop 2023-11-26T07:15:12.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.285+0000 7f7ac8d85700 1 -- 172.21.15.2:0/3454842199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7aac005210 msgr2=0x7f7ac41f7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:12.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.285+0000 7f7ac8d85700 1 --2- 172.21.15.2:0/3454842199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7aac005210 0x7f7ac41f7030 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8007340 tx=0x7f7ab8007650 comp rx=0 tx=0).stop 2023-11-26T07:15:12.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.285+0000 7f7ac8d85700 1 -- 172.21.15.2:0/3454842199 shutdown_connections 2023-11-26T07:15:12.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.285+0000 7f7ac8d85700 1 --2- 172.21.15.2:0/3454842199 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7aa406b470 0x7f7aa406d930 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:12.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.285+0000 7f7ac8d85700 1 --2- 172.21.15.2:0/3454842199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ac406ee30 0x7f7ac4136fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:12.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.285+0000 7f7ac8d85700 1 --2- 172.21.15.2:0/3454842199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7aac005210 0x7f7ac41f7030 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:12.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.285+0000 7f7ac8d85700 1 --2- 172.21.15.2:0/3454842199 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ac41f7570 0x7f7ac406e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:12.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.285+0000 7f7ac8d85700 1 -- 172.21.15.2:0/3454842199 >> 172.21.15.2:0/3454842199 conn(0x7f7ac40b2740 msgr2=0x7f7ac40b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:12.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.285+0000 7f7ac8d85700 1 -- 172.21.15.2:0/3454842199 shutdown_connections 2023-11-26T07:15:12.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.286+0000 7f7ac8d85700 1 -- 172.21.15.2:0/3454842199 wait complete. 2023-11-26T07:15:12.297 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' created 2023-11-26T07:15:12.318 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-26T07:15:12.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.446+0000 7f8792b05700 1 Processor -- start 2023-11-26T07:15:12.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.446+0000 7f8792b05700 1 -- start start 2023-11-26T07:15:12.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.447+0000 7f8792b05700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f878c06fc50 0x7f878c06eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:12.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.447+0000 7f8792b05700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f878c0d1230 con 0x7f878c15e1c0 2023-11-26T07:15:12.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.447+0000 7f8792b05700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f878c0d0c70 con 0x7f878c0b0e90 2023-11-26T07:15:12.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.447+0000 7f8792b05700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f878c0d0f50 con 0x7f878c06fc50 2023-11-26T07:15:12.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.447+0000 7f878bfff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f878c06fc50 0x7f878c06eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:12.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.447+0000 7f87908a1700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f878c15e1c0 0x7f878c06f540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34224/0 (socket says 172.21.15.2:34224) 2023-11-26T07:15:12.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.447+0000 7f87908a1700 1 -- 172.21.15.2:0/4086904383 learned_addr learned my addr 172.21.15.2:0/4086904383 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:15:12.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.447+0000 7f878bfff700 1 --2- 172.21.15.2:0/4086904383 >> v2:172.21.15.2:3300/0 conn(0x7f878c06fc50 0x7f878c06eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43014/0 (socket says 172.21.15.2:43014) 2023-11-26T07:15:12.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.448+0000 7f878bfff700 1 -- 172.21.15.2:0/4086904383 >> v1:172.21.15.192:6789/0 conn(0x7f878c0b0e90 legacy=0x7f878c06ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:12.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.448+0000 7f878bfff700 1 -- 172.21.15.2:0/4086904383 >> v1:172.21.15.2:6789/0 conn(0x7f878c15e1c0 legacy=0x7f878c06f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:12.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.448+0000 7f878bfff700 1 -- 172.21.15.2:0/4086904383 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878c06c210 con 0x7f878c06fc50 2023-11-26T07:15:12.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.448+0000 7f878b7fe700 1 -- 172.21.15.2:0/4086904383 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3804021913 0 0) 0x7f878c0d1230 con 0x7f878c15e1c0 2023-11-26T07:15:12.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.448+0000 7f878bfff700 1 --2- 172.21.15.2:0/4086904383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f878c06fc50 0x7f878c06eef0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f8778009840 tx=0x7f8778009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d51021f8d80fa804 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:12.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.448+0000 7f878b7fe700 1 -- 172.21.15.2:0/4086904383 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8778004230 con 0x7f878c06fc50 2023-11-26T07:15:12.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.448+0000 7f878b7fe700 1 -- 172.21.15.2:0/4086904383 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8778004390 con 0x7f878c06fc50 2023-11-26T07:15:12.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.448+0000 7f878b7fe700 1 -- 172.21.15.2:0/4086904383 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87780036a0 con 0x7f878c06fc50 2023-11-26T07:15:12.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.449+0000 7f8792b05700 1 -- 172.21.15.2:0/4086904383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f878c06fc50 msgr2=0x7f878c06eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:12.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.449+0000 7f8792b05700 1 --2- 172.21.15.2:0/4086904383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f878c06fc50 0x7f878c06eef0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f8778009840 tx=0x7f8778009b50 comp rx=0 tx=0).stop 2023-11-26T07:15:12.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.449+0000 7f8792b05700 1 -- 172.21.15.2:0/4086904383 shutdown_connections 2023-11-26T07:15:12.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.449+0000 7f8792b05700 1 --2- 172.21.15.2:0/4086904383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f878c06fc50 0x7f878c06eef0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:12.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.449+0000 7f8792b05700 1 -- 172.21.15.2:0/4086904383 >> 172.21.15.2:0/4086904383 conn(0x7f878c0b3720 msgr2=0x7f878c0b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:12.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.449+0000 7f8792b05700 1 -- 172.21.15.2:0/4086904383 shutdown_connections 2023-11-26T07:15:12.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.449+0000 7f8792b05700 1 -- 172.21.15.2:0/4086904383 wait complete. 2023-11-26T07:15:12.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.450+0000 7f8792b05700 1 Processor -- start 2023-11-26T07:15:12.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.450+0000 7f8792b05700 1 -- start start 2023-11-26T07:15:12.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.451+0000 7f8792b05700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f878c06fc50 0x7f878c1f7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:12.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.451+0000 7f8792b05700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f878c0b0e90 0x7f878c0b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:12.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.451+0000 7f8792b05700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f878c15e1c0 0x7f878c158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:12.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.451+0000 7f8792b05700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878c1f7ff0 con 0x7f878c0b0e90 2023-11-26T07:15:12.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.451+0000 7f8792b05700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878c15eac0 con 0x7f878c06fc50 2023-11-26T07:15:12.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.451+0000 7f8792b05700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f878c15eda0 con 0x7f878c15e1c0 2023-11-26T07:15:12.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.452+0000 7f878bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f878c0b0e90 0x7f878c0b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:12.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.452+0000 7f878bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f878c0b0e90 0x7f878c0b2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43020/0 (socket says 172.21.15.2:43020) 2023-11-26T07:15:12.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.452+0000 7f878bfff700 1 -- 172.21.15.2:0/1686526148 learned_addr learned my addr 172.21.15.2:0/1686526148 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:12.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.452+0000 7f87910a2700 1 --2- 172.21.15.2:0/1686526148 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f878c15e1c0 0x7f878c158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:12.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.452+0000 7f878bfff700 1 -- 172.21.15.2:0/1686526148 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f878c15e1c0 msgr2=0x7f878c158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:12.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.452+0000 7f878bfff700 1 --2- 172.21.15.2:0/1686526148 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f878c15e1c0 0x7f878c158080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:12.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.452+0000 7f87908a1700 1 --2- 172.21.15.2:0/1686526148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f878c06fc50 0x7f878c1f7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:12.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.452+0000 7f878bfff700 1 -- 172.21.15.2:0/1686526148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f878c06fc50 msgr2=0x7f878c1f7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:12.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.452+0000 7f878bfff700 1 --2- 172.21.15.2:0/1686526148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f878c06fc50 0x7f878c1f7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:12.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.452+0000 7f878bfff700 1 -- 172.21.15.2:0/1686526148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87780094a0 con 0x7f878c0b0e90 2023-11-26T07:15:12.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.452+0000 7f87910a2700 1 --2- 172.21.15.2:0/1686526148 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f878c15e1c0 0x7f878c158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:15:12.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.452+0000 7f87908a1700 1 --2- 172.21.15.2:0/1686526148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f878c06fc50 0x7f878c1f7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:15:12.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.452+0000 7f878bfff700 1 --2- 172.21.15.2:0/1686526148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f878c0b0e90 0x7f878c0b2a00 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f8778000c00 tx=0x7f8778004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:12.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.452+0000 7f87897fa700 1 -- 172.21.15.2:0/1686526148 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8778011630 con 0x7f878c0b0e90 2023-11-26T07:15:12.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.452+0000 7f87897fa700 1 -- 172.21.15.2:0/1686526148 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877801e070 con 0x7f878c0b0e90 2023-11-26T07:15:12.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.452+0000 7f87897fa700 1 -- 172.21.15.2:0/1686526148 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87780119f0 con 0x7f878c0b0e90 2023-11-26T07:15:12.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.452+0000 7f8792b05700 1 -- 172.21.15.2:0/1686526148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f878c15f080 con 0x7f878c0b0e90 2023-11-26T07:15:12.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.452+0000 7f8792b05700 1 -- 172.21.15.2:0/1686526148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f878c15f640 con 0x7f878c0b0e90 2023-11-26T07:15:12.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.453+0000 7f8792b05700 1 -- 172.21.15.2:0/1686526148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f878c15f9b0 con 0x7f878c0b0e90 2023-11-26T07:15:12.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.454+0000 7f87897fa700 1 -- 172.21.15.2:0/1686526148 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f8778011b50 con 0x7f878c0b0e90 2023-11-26T07:15:12.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.454+0000 7f87897fa700 1 --2- 172.21.15.2:0/1686526148 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f877006b470 0x7f877006d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:12.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.454+0000 7f87897fa700 1 -- 172.21.15.2:0/1686526148 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f877808b360 con 0x7f878c0b0e90 2023-11-26T07:15:12.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.455+0000 7f87908a1700 1 --2- 172.21.15.2:0/1686526148 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f877006b470 0x7f877006d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:12.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.455+0000 7f87908a1700 1 --2- 172.21.15.2:0/1686526148 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f877006b470 0x7f877006d930 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8780000f60 tx=0x7f8780009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:12.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.459+0000 7f87897fa700 1 -- 172.21.15.2:0/1686526148 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8778055c90 con 0x7f878c0b0e90 2023-11-26T07:15:12.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:12.711+0000 7f8792b05700 1 -- 172.21.15.2:0/1686526148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f878c0d0900 con 0x7f878c0b0e90 2023-11-26T07:15:13.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.283+0000 7f87897fa700 1 -- 172.21.15.2:0/1686526148 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v32) v1 ==== 172+0+0 (secure 0 0 0) 0x7f878c0d0900 con 0x7f878c0b0e90 2023-11-26T07:15:13.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.288+0000 7f8792b05700 1 -- 172.21.15.2:0/1686526148 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f877006b470 msgr2=0x7f877006d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:13.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.288+0000 7f8792b05700 1 --2- 172.21.15.2:0/1686526148 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f877006b470 0x7f877006d930 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8780000f60 tx=0x7f8780009040 comp rx=0 tx=0).stop 2023-11-26T07:15:13.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.288+0000 7f8792b05700 1 -- 172.21.15.2:0/1686526148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f878c0b0e90 msgr2=0x7f878c0b2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:13.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.288+0000 7f8792b05700 1 --2- 172.21.15.2:0/1686526148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f878c0b0e90 0x7f878c0b2a00 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f8778000c00 tx=0x7f8778004750 comp rx=0 tx=0).stop 2023-11-26T07:15:13.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.288+0000 7f8792b05700 1 -- 172.21.15.2:0/1686526148 shutdown_connections 2023-11-26T07:15:13.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.288+0000 7f8792b05700 1 --2- 172.21.15.2:0/1686526148 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f877006b470 0x7f877006d930 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:13.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.288+0000 7f8792b05700 1 --2- 172.21.15.2:0/1686526148 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f878c15e1c0 0x7f878c158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:13.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.288+0000 7f8792b05700 1 --2- 172.21.15.2:0/1686526148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f878c06fc50 0x7f878c1f7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:13.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.288+0000 7f8792b05700 1 --2- 172.21.15.2:0/1686526148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f878c0b0e90 0x7f878c0b2a00 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:13.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.288+0000 7f8792b05700 1 -- 172.21.15.2:0/1686526148 >> 172.21.15.2:0/1686526148 conn(0x7f878c0b3720 msgr2=0x7f878c0b3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:13.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.297+0000 7f8792b05700 1 -- 172.21.15.2:0/1686526148 shutdown_connections 2023-11-26T07:15:13.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.297+0000 7f8792b05700 1 -- 172.21.15.2:0/1686526148 wait complete. 2023-11-26T07:15:13.315 INFO:teuthology.orchestra.run.smithi002.stderr:new fs with metadata pool 8 and data pool 9 2023-11-26T07:15:13.330 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:15:13.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.454+0000 7f7385da2700 1 Processor -- start 2023-11-26T07:15:13.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.454+0000 7f7385da2700 1 -- start start 2023-11-26T07:15:13.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.455+0000 7f7385da2700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f738006fc50 0x7f738006eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:13.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.455+0000 7f7385da2700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f73800b0e90 0x7f738006ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:13.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.455+0000 7f7385da2700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73800d1230 con 0x7f738015e1c0 2023-11-26T07:15:13.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.455+0000 7f7385da2700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73800d0c70 con 0x7f73800b0e90 2023-11-26T07:15:13.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.455+0000 7f7385da2700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73800d0f50 con 0x7f738006fc50 2023-11-26T07:15:13.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.455+0000 7f737ffff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f73800b0e90 0x7f738006ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:13.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.455+0000 7f737ffff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f73800b0e90 0x7f738006ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43040/0 (socket says 172.21.15.2:43040) 2023-11-26T07:15:13.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.455+0000 7f737ffff700 1 -- 172.21.15.2:0/169043284 learned_addr learned my addr 172.21.15.2:0/169043284 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:13.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.456+0000 7f737effd700 1 --2- 172.21.15.2:0/169043284 >> v2:172.21.15.192:3300/0 conn(0x7f738006fc50 0x7f738006eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:13.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.456+0000 7f737ffff700 1 -- 172.21.15.2:0/169043284 >> v2:172.21.15.192:3300/0 conn(0x7f738006fc50 msgr2=0x7f738006eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:13.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.456+0000 7f737ffff700 1 --2- 172.21.15.2:0/169043284 >> v2:172.21.15.192:3300/0 conn(0x7f738006fc50 0x7f738006eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:13.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.456+0000 7f737ffff700 1 -- 172.21.15.2:0/169043284 >> v1:172.21.15.192:6789/0 conn(0x7f738015e1c0 legacy=0x7f738006f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:13.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.456+0000 7f737ffff700 1 -- 172.21.15.2:0/169043284 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f738006c210 con 0x7f73800b0e90 2023-11-26T07:15:13.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.456+0000 7f737ffff700 1 --2- 172.21.15.2:0/169043284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73800b0e90 0x7f738006ca10 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f7380071ba0 tx=0x7f737800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b2e9e20166568f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:13.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.456+0000 7f737e7fc700 1 -- 172.21.15.2:0/169043284 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737800e070 con 0x7f73800b0e90 2023-11-26T07:15:13.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.456+0000 7f737e7fc700 1 -- 172.21.15.2:0/169043284 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f737800b9c0 con 0x7f73800b0e90 2023-11-26T07:15:13.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.456+0000 7f737e7fc700 1 -- 172.21.15.2:0/169043284 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737800bd70 con 0x7f73800b0e90 2023-11-26T07:15:13.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.457+0000 7f7385da2700 1 -- 172.21.15.2:0/169043284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73800b0e90 msgr2=0x7f738006ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:13.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.457+0000 7f7385da2700 1 --2- 172.21.15.2:0/169043284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73800b0e90 0x7f738006ca10 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f7380071ba0 tx=0x7f737800b330 comp rx=0 tx=0).stop 2023-11-26T07:15:13.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.457+0000 7f7385da2700 1 -- 172.21.15.2:0/169043284 shutdown_connections 2023-11-26T07:15:13.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.457+0000 7f7385da2700 1 --2- 172.21.15.2:0/169043284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73800b0e90 0x7f738006ca10 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:13.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.457+0000 7f7385da2700 1 --2- 172.21.15.2:0/169043284 >> v2:172.21.15.192:3300/0 conn(0x7f738006fc50 0x7f738006eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:13.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.457+0000 7f7385da2700 1 -- 172.21.15.2:0/169043284 >> 172.21.15.2:0/169043284 conn(0x7f73800b3720 msgr2=0x7f73800b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:13.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.457+0000 7f7385da2700 1 -- 172.21.15.2:0/169043284 shutdown_connections 2023-11-26T07:15:13.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.457+0000 7f7385da2700 1 -- 172.21.15.2:0/169043284 wait complete. 2023-11-26T07:15:13.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.458+0000 7f7385da2700 1 Processor -- start 2023-11-26T07:15:13.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.458+0000 7f7385da2700 1 -- start start 2023-11-26T07:15:13.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.459+0000 7f7385da2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f738006fc50 0x7f7380159070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:13.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.459+0000 7f7385da2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73800b0e90 0x7f73801f4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:13.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.459+0000 7f7385da2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f738015e1c0 0x7f73800b16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:13.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.459+0000 7f7385da2700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73800b01f0 con 0x7f73800b0e90 2023-11-26T07:15:13.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.459+0000 7f7385da2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73801595b0 con 0x7f738015e1c0 2023-11-26T07:15:13.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.459+0000 7f7385da2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73801f5230 con 0x7f738006fc50 2023-11-26T07:15:13.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.459+0000 7f737effd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73800b0e90 0x7f73801f4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:13.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.459+0000 7f737effd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73800b0e90 0x7f73801f4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43042/0 (socket says 172.21.15.2:43042) 2023-11-26T07:15:13.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.459+0000 7f737effd700 1 -- 172.21.15.2:0/2345241923 learned_addr learned my addr 172.21.15.2:0/2345241923 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:13.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.459+0000 7f737ffff700 1 --2- 172.21.15.2:0/2345241923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f738015e1c0 0x7f73800b16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:13.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.459+0000 7f737effd700 1 -- 172.21.15.2:0/2345241923 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f738006fc50 msgr2=0x7f7380159070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:13.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.459+0000 7f737f7fe700 1 --2- 172.21.15.2:0/2345241923 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f738006fc50 0x7f7380159070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:13.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.459+0000 7f737effd700 1 --2- 172.21.15.2:0/2345241923 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f738006fc50 0x7f7380159070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:13.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.459+0000 7f737effd700 1 -- 172.21.15.2:0/2345241923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f738015e1c0 msgr2=0x7f73800b16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:13.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.459+0000 7f737effd700 1 --2- 172.21.15.2:0/2345241923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f738015e1c0 0x7f73800b16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:13.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.459+0000 7f737effd700 1 -- 172.21.15.2:0/2345241923 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7378009b30 con 0x7f73800b0e90 2023-11-26T07:15:13.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.459+0000 7f737ffff700 1 --2- 172.21.15.2:0/2345241923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f738015e1c0 0x7f73800b16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:15:13.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.459+0000 7f737f7fe700 1 --2- 172.21.15.2:0/2345241923 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f738006fc50 0x7f7380159070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:15:13.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.459+0000 7f737effd700 1 --2- 172.21.15.2:0/2345241923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73800b0e90 0x7f73801f4340 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f736800e810 tx=0x7f736800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:13.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.460+0000 7f7377fff700 1 -- 172.21.15.2:0/2345241923 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7368013610 con 0x7f73800b0e90 2023-11-26T07:15:13.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.460+0000 7f7377fff700 1 -- 172.21.15.2:0/2345241923 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7368013770 con 0x7f73800b0e90 2023-11-26T07:15:13.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.460+0000 7f7385da2700 1 -- 172.21.15.2:0/2345241923 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73800b7360 con 0x7f73800b0e90 2023-11-26T07:15:13.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.460+0000 7f7377fff700 1 -- 172.21.15.2:0/2345241923 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7368013b20 con 0x7f73800b0e90 2023-11-26T07:15:13.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.460+0000 7f7385da2700 1 -- 172.21.15.2:0/2345241923 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73801f4c20 con 0x7f73800b0e90 2023-11-26T07:15:13.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.461+0000 7f7385da2700 1 -- 172.21.15.2:0/2345241923 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73801f4a80 con 0x7f73800b0e90 2023-11-26T07:15:13.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.461+0000 7f7377fff700 1 -- 172.21.15.2:0/2345241923 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f7368013c80 con 0x7f73800b0e90 2023-11-26T07:15:13.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.462+0000 7f7377fff700 1 --2- 172.21.15.2:0/2345241923 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f736006b470 0x7f736006d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:13.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.462+0000 7f7377fff700 1 -- 172.21.15.2:0/2345241923 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7368089e40 con 0x7f73800b0e90 2023-11-26T07:15:13.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.462+0000 7f737f7fe700 1 --2- 172.21.15.2:0/2345241923 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f736006b470 0x7f736006d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:13.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.462+0000 7f737f7fe700 1 --2- 172.21.15.2:0/2345241923 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f736006b470 0x7f736006d930 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7370000f60 tx=0x7f7370009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:13.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.466+0000 7f7377fff700 1 -- 172.21.15.2:0/2345241923 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f73801f4a80 con 0x7f73800b0e90 2023-11-26T07:15:13.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.670+0000 7f7385da2700 1 -- 172.21.15.2:0/2345241923 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73801f4a80 con 0x7f73800b0e90 2023-11-26T07:15:13.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.671+0000 7f7377fff700 1 -- 172.21.15.2:0/2345241923 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16530 (secure 0 0 0) 0x7f73801f4a80 con 0x7f73800b0e90 2023-11-26T07:15:13.674 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:15:13.674 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":59,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:15:12.714084+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:15:11.156119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-26T07:15:11.674003+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:15:13.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.673+0000 7f7385da2700 1 -- 172.21.15.2:0/2345241923 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f736006b470 msgr2=0x7f736006d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:13.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.673+0000 7f7385da2700 1 --2- 172.21.15.2:0/2345241923 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f736006b470 0x7f736006d930 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7370000f60 tx=0x7f7370009040 comp rx=0 tx=0).stop 2023-11-26T07:15:13.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.673+0000 7f7385da2700 1 -- 172.21.15.2:0/2345241923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73800b0e90 msgr2=0x7f73801f4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:13.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.673+0000 7f7385da2700 1 --2- 172.21.15.2:0/2345241923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73800b0e90 0x7f73801f4340 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f736800e810 tx=0x7f736800ebd0 comp rx=0 tx=0).stop 2023-11-26T07:15:13.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.673+0000 7f7385da2700 1 -- 172.21.15.2:0/2345241923 shutdown_connections 2023-11-26T07:15:13.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.673+0000 7f7385da2700 1 --2- 172.21.15.2:0/2345241923 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f736006b470 0x7f736006d930 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:13.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.673+0000 7f7385da2700 1 --2- 172.21.15.2:0/2345241923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f738015e1c0 0x7f73800b16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:13.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.673+0000 7f7385da2700 1 --2- 172.21.15.2:0/2345241923 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f738006fc50 0x7f7380159070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:13.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.673+0000 7f7385da2700 1 --2- 172.21.15.2:0/2345241923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73800b0e90 0x7f73801f4340 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:13.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.673+0000 7f7385da2700 1 -- 172.21.15.2:0/2345241923 >> 172.21.15.2:0/2345241923 conn(0x7f73800b3720 msgr2=0x7f73800b3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:13.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.673+0000 7f7385da2700 1 -- 172.21.15.2:0/2345241923 shutdown_connections 2023-11-26T07:15:13.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.673+0000 7f7385da2700 1 -- 172.21.15.2:0/2345241923 wait complete. 2023-11-26T07:15:13.689 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:15:13.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.810+0000 7fdca66e8700 1 Processor -- start 2023-11-26T07:15:13.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.811+0000 7fdca66e8700 1 -- start start 2023-11-26T07:15:13.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.811+0000 7fdca66e8700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdca006fc50 0x7fdca006eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:13.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.811+0000 7fdca66e8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdca00b0e90 0x7fdca006ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:13.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.811+0000 7fdca66e8700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca00d1230 con 0x7fdca015e1c0 2023-11-26T07:15:13.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.811+0000 7fdca66e8700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca00d0c70 con 0x7fdca006fc50 2023-11-26T07:15:13.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.811+0000 7fdca66e8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca00d0f50 con 0x7fdca00b0e90 2023-11-26T07:15:13.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.812+0000 7fdca4c85700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdca00b0e90 0x7fdca006ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:13.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.812+0000 7fdc9f7fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdca006fc50 0x7fdca006eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:13.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.812+0000 7fdca4c85700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdca00b0e90 0x7fdca006ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.2:41134/0 (socket says 172.21.15.2:41134) 2023-11-26T07:15:13.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.812+0000 7fdca4c85700 1 -- 172.21.15.2:0/2633738733 learned_addr learned my addr 172.21.15.2:0/2633738733 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:13.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.812+0000 7fdc9ffff700 1 --1- 172.21.15.2:0/2633738733 >> v1:172.21.15.192:6789/0 conn(0x7fdca015e1c0 0x7fdca006f540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.2:41630/0 (socket says 172.21.15.2:41630) 2023-11-26T07:15:13.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.812+0000 7fdc9f7fe700 1 -- 172.21.15.2:0/2633738733 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdca00b0e90 msgr2=0x7fdca006ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:13.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.812+0000 7fdc9f7fe700 1 --2- 172.21.15.2:0/2633738733 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdca00b0e90 0x7fdca006ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:13.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.812+0000 7fdc9f7fe700 1 -- 172.21.15.2:0/2633738733 >> v1:172.21.15.192:6789/0 conn(0x7fdca015e1c0 legacy=0x7fdca006f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:13.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.812+0000 7fdc9f7fe700 1 -- 172.21.15.2:0/2633738733 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca006c210 con 0x7fdca006fc50 2023-11-26T07:15:13.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.812+0000 7fdca4c85700 1 --2- 172.21.15.2:0/2633738733 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdca00b0e90 0x7fdca006ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:15:13.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.812+0000 7fdc9f7fe700 1 --2- 172.21.15.2:0/2633738733 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdca006fc50 0x7fdca006eef0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fdc88009840 tx=0x7fdc88009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7d403e6814acd78 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:13.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.813+0000 7fdc9effd700 1 -- 172.21.15.2:0/2633738733 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc88004230 con 0x7fdca006fc50 2023-11-26T07:15:13.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.813+0000 7fdc9effd700 1 -- 172.21.15.2:0/2633738733 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc88004390 con 0x7fdca006fc50 2023-11-26T07:15:13.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.813+0000 7fdc9effd700 1 -- 172.21.15.2:0/2633738733 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc880036a0 con 0x7fdca006fc50 2023-11-26T07:15:13.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.813+0000 7fdca66e8700 1 -- 172.21.15.2:0/2633738733 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdca006fc50 msgr2=0x7fdca006eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:13.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.813+0000 7fdca66e8700 1 --2- 172.21.15.2:0/2633738733 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdca006fc50 0x7fdca006eef0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fdc88009840 tx=0x7fdc88009b50 comp rx=0 tx=0).stop 2023-11-26T07:15:13.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.813+0000 7fdca66e8700 1 -- 172.21.15.2:0/2633738733 shutdown_connections 2023-11-26T07:15:13.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.813+0000 7fdca66e8700 1 --2- 172.21.15.2:0/2633738733 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdca00b0e90 0x7fdca006ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:13.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.813+0000 7fdca66e8700 1 --2- 172.21.15.2:0/2633738733 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdca006fc50 0x7fdca006eef0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:13.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.813+0000 7fdca66e8700 1 -- 172.21.15.2:0/2633738733 >> 172.21.15.2:0/2633738733 conn(0x7fdca00b3720 msgr2=0x7fdca00b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:13.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.813+0000 7fdca66e8700 1 -- 172.21.15.2:0/2633738733 shutdown_connections 2023-11-26T07:15:13.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.813+0000 7fdca66e8700 1 -- 172.21.15.2:0/2633738733 wait complete. 2023-11-26T07:15:13.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.815+0000 7fdca66e8700 1 Processor -- start 2023-11-26T07:15:13.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.815+0000 7fdca66e8700 1 -- start start 2023-11-26T07:15:13.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.816+0000 7fdca66e8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdca006fc50 0x7fdca015f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:13.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.816+0000 7fdca66e8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdca00b0e90 0x7fdca0155330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:13.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.816+0000 7fdca66e8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdca015e1c0 0x7fdca01606c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:13.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.816+0000 7fdca66e8700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca01f3cc0 con 0x7fdca00b0e90 2023-11-26T07:15:13.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.816+0000 7fdca66e8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca00b48b0 con 0x7fdca006fc50 2023-11-26T07:15:13.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.816+0000 7fdca66e8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca00b7110 con 0x7fdca015e1c0 2023-11-26T07:15:13.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.816+0000 7fdc9f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdca00b0e90 0x7fdca0155330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:13.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.816+0000 7fdc9f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdca00b0e90 0x7fdca0155330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43058/0 (socket says 172.21.15.2:43058) 2023-11-26T07:15:13.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.816+0000 7fdc9f7fe700 1 -- 172.21.15.2:0/1367445297 learned_addr learned my addr 172.21.15.2:0/1367445297 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:13.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.816+0000 7fdca4c85700 1 --2- 172.21.15.2:0/1367445297 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdca015e1c0 0x7fdca01606c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:13.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.816+0000 7fdc9ffff700 1 --2- 172.21.15.2:0/1367445297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdca006fc50 0x7fdca015f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:13.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.816+0000 7fdc9f7fe700 1 -- 172.21.15.2:0/1367445297 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdca015e1c0 msgr2=0x7fdca01606c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:13.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.816+0000 7fdc9f7fe700 1 --2- 172.21.15.2:0/1367445297 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdca015e1c0 0x7fdca01606c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:13.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.816+0000 7fdc9f7fe700 1 -- 172.21.15.2:0/1367445297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdca006fc50 msgr2=0x7fdca015f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:13.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.816+0000 7fdc9f7fe700 1 --2- 172.21.15.2:0/1367445297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdca006fc50 0x7fdca015f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:13.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.816+0000 7fdc9f7fe700 1 -- 172.21.15.2:0/1367445297 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc98009b30 con 0x7fdca00b0e90 2023-11-26T07:15:13.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.817+0000 7fdc9f7fe700 1 --2- 172.21.15.2:0/1367445297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdca00b0e90 0x7fdca0155330 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fdc88009790 tx=0x7fdc88004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:13.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.817+0000 7fdc9cff9700 1 -- 172.21.15.2:0/1367445297 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc88011830 con 0x7fdca00b0e90 2023-11-26T07:15:13.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.817+0000 7fdc9cff9700 1 -- 172.21.15.2:0/1367445297 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8801f070 con 0x7fdca00b0e90 2023-11-26T07:15:13.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.817+0000 7fdc9cff9700 1 -- 172.21.15.2:0/1367445297 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc88011bf0 con 0x7fdca00b0e90 2023-11-26T07:15:13.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.817+0000 7fdca66e8700 1 -- 172.21.15.2:0/1367445297 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc880094a0 con 0x7fdca00b0e90 2023-11-26T07:15:13.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.817+0000 7fdca66e8700 1 -- 172.21.15.2:0/1367445297 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca00b4b50 con 0x7fdca00b0e90 2023-11-26T07:15:13.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.818+0000 7fdca66e8700 1 -- 172.21.15.2:0/1367445297 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdca00b4ce0 con 0x7fdca00b0e90 2023-11-26T07:15:13.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.818+0000 7fdc9cff9700 1 -- 172.21.15.2:0/1367445297 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7fdc88011d50 con 0x7fdca00b0e90 2023-11-26T07:15:13.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.819+0000 7fdc9cff9700 1 --2- 172.21.15.2:0/1367445297 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fdc8006b470 0x7fdc8006d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:13.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.819+0000 7fdc9cff9700 1 -- 172.21.15.2:0/1367445297 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc88021070 con 0x7fdca00b0e90 2023-11-26T07:15:13.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.819+0000 7fdc9ffff700 1 --2- 172.21.15.2:0/1367445297 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fdc8006b470 0x7fdc8006d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:13.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.819+0000 7fdc9ffff700 1 --2- 172.21.15.2:0/1367445297 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fdc8006b470 0x7fdc8006d930 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fdc90007c20 tx=0x7fdc90007d70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:13.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:13.823+0000 7fdc9cff9700 1 -- 172.21.15.2:0/1367445297 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdc88056280 con 0x7fdca00b0e90 2023-11-26T07:15:14.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.024+0000 7fdca66e8700 1 -- 172.21.15.2:0/1367445297 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdca00b7da0 con 0x7fdca00b0e90 2023-11-26T07:15:14.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.026+0000 7fdc9cff9700 1 -- 172.21.15.2:0/1367445297 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16530 (secure 0 0 0) 0x7fdc880598a0 con 0x7fdca00b0e90 2023-11-26T07:15:14.029 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:15:14.029 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":59,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:15:12.714084+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:15:11.156119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-26T07:15:11.674003+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:15:14.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.028+0000 7fdca66e8700 1 -- 172.21.15.2:0/1367445297 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fdc8006b470 msgr2=0x7fdc8006d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:14.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.028+0000 7fdca66e8700 1 --2- 172.21.15.2:0/1367445297 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fdc8006b470 0x7fdc8006d930 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fdc90007c20 tx=0x7fdc90007d70 comp rx=0 tx=0).stop 2023-11-26T07:15:14.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.028+0000 7fdca66e8700 1 -- 172.21.15.2:0/1367445297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdca00b0e90 msgr2=0x7fdca0155330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:14.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.028+0000 7fdca66e8700 1 --2- 172.21.15.2:0/1367445297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdca00b0e90 0x7fdca0155330 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fdc88009790 tx=0x7fdc88004750 comp rx=0 tx=0).stop 2023-11-26T07:15:14.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.028+0000 7fdca66e8700 1 -- 172.21.15.2:0/1367445297 shutdown_connections 2023-11-26T07:15:14.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.028+0000 7fdca66e8700 1 --2- 172.21.15.2:0/1367445297 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fdc8006b470 0x7fdc8006d930 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:14.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.028+0000 7fdca66e8700 1 --2- 172.21.15.2:0/1367445297 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdca015e1c0 0x7fdca01606c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:14.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.028+0000 7fdca66e8700 1 --2- 172.21.15.2:0/1367445297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdca006fc50 0x7fdca015f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:14.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.028+0000 7fdca66e8700 1 --2- 172.21.15.2:0/1367445297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdca00b0e90 0x7fdca0155330 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:14.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.028+0000 7fdca66e8700 1 -- 172.21.15.2:0/1367445297 >> 172.21.15.2:0/1367445297 conn(0x7fdca00b3720 msgr2=0x7fdca00b3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:14.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.028+0000 7fdca66e8700 1 -- 172.21.15.2:0/1367445297 shutdown_connections 2023-11-26T07:15:14.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.028+0000 7fdca66e8700 1 -- 172.21.15.2:0/1367445297 wait complete. 2023-11-26T07:15:14.043 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-26T07:15:14.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.168+0000 7fd1b394b700 1 Processor -- start 2023-11-26T07:15:14.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.168+0000 7fd1b394b700 1 -- start start 2023-11-26T07:15:14.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.169+0000 7fd1b394b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd1ac0b28a0 0x7fd1ac0b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:14.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.169+0000 7fd1b394b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd1ac0d0ff0 0x7fd1ac0cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:14.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.169+0000 7fd1b394b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1ac06caf0 con 0x7fd1ac0b21d0 2023-11-26T07:15:14.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.169+0000 7fd1b394b700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1ac0cf250 con 0x7fd1ac0d0ff0 2023-11-26T07:15:14.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.169+0000 7fd1b394b700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1ac06cdb0 con 0x7fd1ac0b28a0 2023-11-26T07:15:14.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.169+0000 7fd1b1ee8700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd1ac0d0ff0 0x7fd1ac0cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:14.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.169+0000 7fd1b1ee8700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd1ac0d0ff0 0x7fd1ac0cebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43068/0 (socket says 172.21.15.2:43068) 2023-11-26T07:15:14.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.169+0000 7fd1b1ee8700 1 -- 172.21.15.2:0/900554441 learned_addr learned my addr 172.21.15.2:0/900554441 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:14.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.169+0000 7fd1b0ee6700 1 --2- 172.21.15.2:0/900554441 >> v2:172.21.15.192:3300/0 conn(0x7fd1ac0b28a0 0x7fd1ac0b2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:14.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.170+0000 7fd1b1ee8700 1 -- 172.21.15.2:0/900554441 >> v2:172.21.15.192:3300/0 conn(0x7fd1ac0b28a0 msgr2=0x7fd1ac0b2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:14.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.170+0000 7fd1b1ee8700 1 --2- 172.21.15.2:0/900554441 >> v2:172.21.15.192:3300/0 conn(0x7fd1ac0b28a0 0x7fd1ac0b2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:14.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.170+0000 7fd1b1ee8700 1 -- 172.21.15.2:0/900554441 >> v1:172.21.15.192:6789/0 conn(0x7fd1ac0b21d0 legacy=0x7fd1ac0ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:14.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.170+0000 7fd1b1ee8700 1 -- 172.21.15.2:0/900554441 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ac06d090 con 0x7fd1ac0d0ff0 2023-11-26T07:15:14.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.170+0000 7fd1b1ee8700 1 --2- 172.21.15.2:0/900554441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1ac0d0ff0 0x7fd1ac0cebe0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac0b48c0 tx=0x7fd1a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f91be556486f602a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:14.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.170+0000 7fd1a3fff700 1 -- 172.21.15.2:0/900554441 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a400e070 con 0x7fd1ac0d0ff0 2023-11-26T07:15:14.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.170+0000 7fd1a3fff700 1 -- 172.21.15.2:0/900554441 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a4003a20 con 0x7fd1ac0d0ff0 2023-11-26T07:15:14.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.170+0000 7fd1a3fff700 1 -- 172.21.15.2:0/900554441 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a4003dd0 con 0x7fd1ac0d0ff0 2023-11-26T07:15:14.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.170+0000 7fd1b394b700 1 -- 172.21.15.2:0/900554441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1ac0d0ff0 msgr2=0x7fd1ac0cebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:14.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.170+0000 7fd1b394b700 1 --2- 172.21.15.2:0/900554441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1ac0d0ff0 0x7fd1ac0cebe0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac0b48c0 tx=0x7fd1a400b330 comp rx=0 tx=0).stop 2023-11-26T07:15:14.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.170+0000 7fd1b394b700 1 -- 172.21.15.2:0/900554441 shutdown_connections 2023-11-26T07:15:14.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.170+0000 7fd1b394b700 1 --2- 172.21.15.2:0/900554441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1ac0d0ff0 0x7fd1ac0cebe0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:14.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.170+0000 7fd1b394b700 1 --2- 172.21.15.2:0/900554441 >> v2:172.21.15.192:3300/0 conn(0x7fd1ac0b28a0 0x7fd1ac0b2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:14.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.170+0000 7fd1b394b700 1 -- 172.21.15.2:0/900554441 >> 172.21.15.2:0/900554441 conn(0x7fd1ac0b3800 msgr2=0x7fd1ac0b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:14.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.171+0000 7fd1b394b700 1 -- 172.21.15.2:0/900554441 shutdown_connections 2023-11-26T07:15:14.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.171+0000 7fd1b394b700 1 -- 172.21.15.2:0/900554441 wait complete. 2023-11-26T07:15:14.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.172+0000 7fd1b394b700 1 Processor -- start 2023-11-26T07:15:14.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.172+0000 7fd1b394b700 1 -- start start 2023-11-26T07:15:14.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.172+0000 7fd1b394b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd1ac0b21d0 0x7fd1ac1f6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:14.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.172+0000 7fd1b394b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd1ac0d0ff0 0x7fd1ac0c9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:14.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.172+0000 7fd1b394b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1ac0b5530 0x7fd1ac0b0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:14.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.172+0000 7fd1b394b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac0ca5c0 con 0x7fd1ac0b5530 2023-11-26T07:15:14.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.172+0000 7fd1b394b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac0ca8a0 con 0x7fd1ac0d0ff0 2023-11-26T07:15:14.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.172+0000 7fd1b394b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac0cab80 con 0x7fd1ac0b21d0 2023-11-26T07:15:14.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.173+0000 7fd1b1ee8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1ac0b5530 0x7fd1ac0b0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:14.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.173+0000 7fd1b1ee8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1ac0b5530 0x7fd1ac0b0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43074/0 (socket says 172.21.15.2:43074) 2023-11-26T07:15:14.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.173+0000 7fd1b1ee8700 1 -- 172.21.15.2:0/1552853705 learned_addr learned my addr 172.21.15.2:0/1552853705 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:14.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.173+0000 7fd1b0ee6700 1 --2- 172.21.15.2:0/1552853705 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd1ac0d0ff0 0x7fd1ac0c9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:14.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.173+0000 7fd1b16e7700 1 --2- 172.21.15.2:0/1552853705 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd1ac0b21d0 0x7fd1ac1f6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:14.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.173+0000 7fd1b1ee8700 1 -- 172.21.15.2:0/1552853705 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd1ac0b21d0 msgr2=0x7fd1ac1f6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:14.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.173+0000 7fd1b1ee8700 1 --2- 172.21.15.2:0/1552853705 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd1ac0b21d0 0x7fd1ac1f6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:14.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.173+0000 7fd1b1ee8700 1 -- 172.21.15.2:0/1552853705 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd1ac0d0ff0 msgr2=0x7fd1ac0c9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:14.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.173+0000 7fd1b1ee8700 1 --2- 172.21.15.2:0/1552853705 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd1ac0d0ff0 0x7fd1ac0c9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:14.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.173+0000 7fd1b1ee8700 1 -- 172.21.15.2:0/1552853705 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a4009b30 con 0x7fd1ac0b5530 2023-11-26T07:15:14.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.173+0000 7fd1b1ee8700 1 --2- 172.21.15.2:0/1552853705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1ac0b5530 0x7fd1ac0b0a80 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4015040 tx=0x7fd1a4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:14.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.173+0000 7fd1a1ffb700 1 -- 172.21.15.2:0/1552853705 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a4004440 con 0x7fd1ac0b5530 2023-11-26T07:15:14.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.173+0000 7fd1a1ffb700 1 -- 172.21.15.2:0/1552853705 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a40045a0 con 0x7fd1ac0b5530 2023-11-26T07:15:14.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.173+0000 7fd1b394b700 1 -- 172.21.15.2:0/1552853705 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1ac0cae60 con 0x7fd1ac0b5530 2023-11-26T07:15:14.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.173+0000 7fd1a1ffb700 1 -- 172.21.15.2:0/1552853705 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a4004950 con 0x7fd1ac0b5530 2023-11-26T07:15:14.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.174+0000 7fd1b394b700 1 -- 172.21.15.2:0/1552853705 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1ac0ca2b0 con 0x7fd1ac0b5530 2023-11-26T07:15:14.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.175+0000 7fd1b394b700 1 -- 172.21.15.2:0/1552853705 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1ac075480 con 0x7fd1ac0b5530 2023-11-26T07:15:14.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.175+0000 7fd1a1ffb700 1 -- 172.21.15.2:0/1552853705 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7fd1a4012430 con 0x7fd1ac0b5530 2023-11-26T07:15:14.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.176+0000 7fd1a1ffb700 1 --2- 172.21.15.2:0/1552853705 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd19006b470 0x7fd19006d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:14.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.176+0000 7fd1a1ffb700 1 -- 172.21.15.2:0/1552853705 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd1a408b5d0 con 0x7fd1ac0b5530 2023-11-26T07:15:14.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.176+0000 7fd1b16e7700 1 --2- 172.21.15.2:0/1552853705 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd19006b470 0x7fd19006d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:14.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.176+0000 7fd1b16e7700 1 --2- 172.21.15.2:0/1552853705 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd19006b470 0x7fd19006d930 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac06f7a0 tx=0x7fd19c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:14.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.180+0000 7fd1a1ffb700 1 -- 172.21.15.2:0/1552853705 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd1a4055d10 con 0x7fd1ac0b5530 2023-11-26T07:15:14.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:14.430+0000 7fd1b394b700 1 -- 172.21.15.2:0/1552853705 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd1ac0d1800 con 0x7fd1ac0b5530 2023-11-26T07:15:15.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.310+0000 7fd1a1ffb700 1 -- 172.21.15.2:0/1552853705 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v35) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd1a4059330 con 0x7fd1ac0b5530 2023-11-26T07:15:15.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.312+0000 7fd1b394b700 1 -- 172.21.15.2:0/1552853705 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd19006b470 msgr2=0x7fd19006d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:15.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.312+0000 7fd1b394b700 1 --2- 172.21.15.2:0/1552853705 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd19006b470 0x7fd19006d930 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac06f7a0 tx=0x7fd19c009040 comp rx=0 tx=0).stop 2023-11-26T07:15:15.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.312+0000 7fd1b394b700 1 -- 172.21.15.2:0/1552853705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1ac0b5530 msgr2=0x7fd1ac0b0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:15.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.312+0000 7fd1b394b700 1 --2- 172.21.15.2:0/1552853705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1ac0b5530 0x7fd1ac0b0a80 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4015040 tx=0x7fd1a4004ad0 comp rx=0 tx=0).stop 2023-11-26T07:15:15.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.312+0000 7fd1b394b700 1 -- 172.21.15.2:0/1552853705 shutdown_connections 2023-11-26T07:15:15.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.312+0000 7fd1b394b700 1 --2- 172.21.15.2:0/1552853705 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd19006b470 0x7fd19006d930 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:15.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.312+0000 7fd1b394b700 1 --2- 172.21.15.2:0/1552853705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1ac0b5530 0x7fd1ac0b0a80 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:15.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.312+0000 7fd1b394b700 1 --2- 172.21.15.2:0/1552853705 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd1ac0b21d0 0x7fd1ac1f6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:15.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.312+0000 7fd1b394b700 1 --2- 172.21.15.2:0/1552853705 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd1ac0d0ff0 0x7fd1ac0c9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:15.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.312+0000 7fd1b394b700 1 -- 172.21.15.2:0/1552853705 >> 172.21.15.2:0/1552853705 conn(0x7fd1ac0b3800 msgr2=0x7fd1ac161220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:15.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.312+0000 7fd1b394b700 1 -- 172.21.15.2:0/1552853705 shutdown_connections 2023-11-26T07:15:15.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.313+0000 7fd1b394b700 1 -- 172.21.15.2:0/1552853705 wait complete. 2023-11-26T07:15:15.330 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-26T07:15:15.331 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-26T07:15:15.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.463+0000 7f7e95019700 1 Processor -- start 2023-11-26T07:15:15.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.463+0000 7f7e95019700 1 -- start start 2023-11-26T07:15:15.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.463+0000 7f7e95019700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7e9015bde0 0x7f7e9015c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:15.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.463+0000 7f7e95019700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e900cf2b0 0x7f7e900d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:15.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.463+0000 7f7e95019700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e900d0a90 con 0x7f7e900ce5c0 2023-11-26T07:15:15.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.464+0000 7f7e95019700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e9006ee10 con 0x7f7e9015bde0 2023-11-26T07:15:15.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.464+0000 7f7e95019700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9006f0f0 con 0x7f7e900cf2b0 2023-11-26T07:15:15.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.464+0000 7f7e8ed9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7e9015bde0 0x7f7e9015c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:15.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.464+0000 7f7e8ed9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7e9015bde0 0x7f7e9015c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43078/0 (socket says 172.21.15.2:43078) 2023-11-26T07:15:15.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.464+0000 7f7e8ed9d700 1 -- 172.21.15.2:0/3723978755 learned_addr learned my addr 172.21.15.2:0/3723978755 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:15.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.464+0000 7f7e8f59e700 1 --1- 172.21.15.2:0/3723978755 >> v1:172.21.15.2:6789/0 conn(0x7f7e900ce5c0 0x7f7e900cc670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34292/0 (socket says 172.21.15.2:34292) 2023-11-26T07:15:15.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.464+0000 7f7e8e59c700 1 --2- 172.21.15.2:0/3723978755 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e900cf2b0 0x7f7e900d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:15.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.464+0000 7f7e8ed9d700 1 -- 172.21.15.2:0/3723978755 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e900cf2b0 msgr2=0x7f7e900d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:15.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.464+0000 7f7e8ed9d700 1 --2- 172.21.15.2:0/3723978755 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e900cf2b0 0x7f7e900d01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:15.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.464+0000 7f7e8ed9d700 1 -- 172.21.15.2:0/3723978755 >> v1:172.21.15.2:6789/0 conn(0x7f7e900ce5c0 legacy=0x7f7e900cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:15.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.464+0000 7f7e8dd9b700 1 -- 172.21.15.2:0/3723978755 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3937685588 0 0) 0x7f7e900d0a90 con 0x7f7e900ce5c0 2023-11-26T07:15:15.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.464+0000 7f7e8ed9d700 1 -- 172.21.15.2:0/3723978755 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e9006f3d0 con 0x7f7e9015bde0 2023-11-26T07:15:15.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.464+0000 7f7e8ed9d700 1 --2- 172.21.15.2:0/3723978755 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e9015bde0 0x7f7e9015c1c0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f7e800098f0 tx=0x7f7e80009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eeab37869afe1e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:15.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.464+0000 7f7e8dd9b700 1 -- 172.21.15.2:0/3723978755 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e80011830 con 0x7f7e9015bde0 2023-11-26T07:15:15.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.464+0000 7f7e8dd9b700 1 -- 172.21.15.2:0/3723978755 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e80011990 con 0x7f7e9015bde0 2023-11-26T07:15:15.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.464+0000 7f7e8dd9b700 1 -- 172.21.15.2:0/3723978755 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e80011d20 con 0x7f7e9015bde0 2023-11-26T07:15:15.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.465+0000 7f7e95019700 1 -- 172.21.15.2:0/3723978755 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e9015bde0 msgr2=0x7f7e9015c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:15.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.465+0000 7f7e95019700 1 --2- 172.21.15.2:0/3723978755 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e9015bde0 0x7f7e9015c1c0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f7e800098f0 tx=0x7f7e80009c00 comp rx=0 tx=0).stop 2023-11-26T07:15:15.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.465+0000 7f7e95019700 1 -- 172.21.15.2:0/3723978755 shutdown_connections 2023-11-26T07:15:15.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.465+0000 7f7e95019700 1 --2- 172.21.15.2:0/3723978755 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e9015bde0 0x7f7e9015c1c0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:15.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.465+0000 7f7e95019700 1 --2- 172.21.15.2:0/3723978755 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e900cf2b0 0x7f7e900d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:15.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.465+0000 7f7e95019700 1 -- 172.21.15.2:0/3723978755 >> 172.21.15.2:0/3723978755 conn(0x7f7e900b3720 msgr2=0x7f7e900b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:15.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.465+0000 7f7e95019700 1 -- 172.21.15.2:0/3723978755 shutdown_connections 2023-11-26T07:15:15.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.465+0000 7f7e95019700 1 -- 172.21.15.2:0/3723978755 wait complete. 2023-11-26T07:15:15.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.466+0000 7f7e95019700 1 Processor -- start 2023-11-26T07:15:15.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.466+0000 7f7e95019700 1 -- start start 2023-11-26T07:15:15.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.467+0000 7f7e95019700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e900ce5c0 0x7f7e901593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:15.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.467+0000 7f7e95019700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e900cf2b0 0x7f7e900c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:15.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.467+0000 7f7e95019700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e9015bde0 0x7f7e900b4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:15.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.467+0000 7f7e95019700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9015efe0 con 0x7f7e900ce5c0 2023-11-26T07:15:15.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.467+0000 7f7e95019700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9015c260 con 0x7f7e900cf2b0 2023-11-26T07:15:15.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.467+0000 7f7e95019700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e900b5310 con 0x7f7e9015bde0 2023-11-26T07:15:15.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.467+0000 7f7e8ed9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e900ce5c0 0x7f7e901593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:15.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.467+0000 7f7e8ed9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e900ce5c0 0x7f7e901593c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43084/0 (socket says 172.21.15.2:43084) 2023-11-26T07:15:15.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.467+0000 7f7e8ed9d700 1 -- 172.21.15.2:0/1471356746 learned_addr learned my addr 172.21.15.2:0/1471356746 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:15.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.468+0000 7f7e8f59e700 1 --2- 172.21.15.2:0/1471356746 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e9015bde0 0x7f7e900b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:15.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.468+0000 7f7e8ed9d700 1 -- 172.21.15.2:0/1471356746 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e9015bde0 msgr2=0x7f7e900b4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:15.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.468+0000 7f7e8e59c700 1 --2- 172.21.15.2:0/1471356746 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e900cf2b0 0x7f7e900c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:15.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.468+0000 7f7e8ed9d700 1 --2- 172.21.15.2:0/1471356746 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e9015bde0 0x7f7e900b4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:15.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.468+0000 7f7e8ed9d700 1 -- 172.21.15.2:0/1471356746 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e900cf2b0 msgr2=0x7f7e900c90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:15.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.468+0000 7f7e8ed9d700 1 --2- 172.21.15.2:0/1471356746 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e900cf2b0 0x7f7e900c90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:15.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.468+0000 7f7e8ed9d700 1 -- 172.21.15.2:0/1471356746 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e80009550 con 0x7f7e900ce5c0 2023-11-26T07:15:15.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.468+0000 7f7e8f59e700 1 --2- 172.21.15.2:0/1471356746 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e9015bde0 0x7f7e900b4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:15:15.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.468+0000 7f7e8e59c700 1 --2- 172.21.15.2:0/1471356746 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e900cf2b0 0x7f7e900c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:15:15.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.468+0000 7f7e8ed9d700 1 --2- 172.21.15.2:0/1471356746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e900ce5c0 0x7f7e901593c0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f7e80014040 tx=0x7f7e80004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:15.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.468+0000 7f7e777fe700 1 -- 172.21.15.2:0/1471356746 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e800036a0 con 0x7f7e900ce5c0 2023-11-26T07:15:15.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.468+0000 7f7e777fe700 1 -- 172.21.15.2:0/1471356746 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8001e070 con 0x7f7e900ce5c0 2023-11-26T07:15:15.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.468+0000 7f7e95019700 1 -- 172.21.15.2:0/1471356746 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e900b55f0 con 0x7f7e900ce5c0 2023-11-26T07:15:15.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.468+0000 7f7e777fe700 1 -- 172.21.15.2:0/1471356746 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e80003a20 con 0x7f7e900ce5c0 2023-11-26T07:15:15.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.468+0000 7f7e95019700 1 -- 172.21.15.2:0/1471356746 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e900b58d0 con 0x7f7e900ce5c0 2023-11-26T07:15:15.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.469+0000 7f7e95019700 1 -- 172.21.15.2:0/1471356746 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e90075480 con 0x7f7e900ce5c0 2023-11-26T07:15:15.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.469+0000 7f7e777fe700 1 -- 172.21.15.2:0/1471356746 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f7e80003b80 con 0x7f7e900ce5c0 2023-11-26T07:15:15.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.470+0000 7f7e777fe700 1 --2- 172.21.15.2:0/1471356746 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7e7c06b470 0x7f7e7c06d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:15.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.470+0000 7f7e777fe700 1 -- 172.21.15.2:0/1471356746 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e8008b070 con 0x7f7e900ce5c0 2023-11-26T07:15:15.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.470+0000 7f7e8e59c700 1 --2- 172.21.15.2:0/1471356746 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7e7c06b470 0x7f7e7c06d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:15.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.470+0000 7f7e8e59c700 1 --2- 172.21.15.2:0/1471356746 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7e7c06b470 0x7f7e7c06d930 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7e900b6ca0 tx=0x7f7e84008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:15.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.474+0000 7f7e777fe700 1 -- 172.21.15.2:0/1471356746 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7e80055940 con 0x7f7e900ce5c0 2023-11-26T07:15:15.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:15.723+0000 7f7e95019700 1 -- 172.21.15.2:0/1471356746 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7e90070770 con 0x7f7e900ce5c0 2023-11-26T07:15:16.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.317+0000 7f7e777fe700 1 -- 172.21.15.2:0/1471356746 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v36) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7e800200c0 con 0x7f7e900ce5c0 2023-11-26T07:15:16.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.319+0000 7f7e95019700 1 -- 172.21.15.2:0/1471356746 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7e7c06b470 msgr2=0x7f7e7c06d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:16.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.319+0000 7f7e95019700 1 --2- 172.21.15.2:0/1471356746 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7e7c06b470 0x7f7e7c06d930 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7e900b6ca0 tx=0x7f7e84008040 comp rx=0 tx=0).stop 2023-11-26T07:15:16.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.319+0000 7f7e95019700 1 -- 172.21.15.2:0/1471356746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e900ce5c0 msgr2=0x7f7e901593c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:16.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.319+0000 7f7e95019700 1 --2- 172.21.15.2:0/1471356746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e900ce5c0 0x7f7e901593c0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f7e80014040 tx=0x7f7e80004750 comp rx=0 tx=0).stop 2023-11-26T07:15:16.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.319+0000 7f7e95019700 1 -- 172.21.15.2:0/1471356746 shutdown_connections 2023-11-26T07:15:16.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.319+0000 7f7e95019700 1 --2- 172.21.15.2:0/1471356746 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7e7c06b470 0x7f7e7c06d930 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:16.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.319+0000 7f7e95019700 1 --2- 172.21.15.2:0/1471356746 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e9015bde0 0x7f7e900b4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:16.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.319+0000 7f7e95019700 1 --2- 172.21.15.2:0/1471356746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e900ce5c0 0x7f7e901593c0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:16.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.319+0000 7f7e95019700 1 --2- 172.21.15.2:0/1471356746 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e900cf2b0 0x7f7e900c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:16.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.319+0000 7f7e95019700 1 -- 172.21.15.2:0/1471356746 >> 172.21.15.2:0/1471356746 conn(0x7f7e900b3720 msgr2=0x7f7e900b01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:16.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.319+0000 7f7e95019700 1 -- 172.21.15.2:0/1471356746 shutdown_connections 2023-11-26T07:15:16.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.319+0000 7f7e95019700 1 -- 172.21.15.2:0/1471356746 wait complete. 2023-11-26T07:15:16.337 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-26T07:15:16.337 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:15:16.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.466+0000 7f85ec198700 1 Processor -- start 2023-11-26T07:15:16.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.466+0000 7f85ec198700 1 -- start start 2023-11-26T07:15:16.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.467+0000 7f85ec198700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85e406b620 0x7f85e40b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:16.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.467+0000 7f85ec198700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f85e40b5ab0 0x7f85e40b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:16.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.467+0000 7f85ec198700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e4071f50 con 0x7f85e41478c0 2023-11-26T07:15:16.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.467+0000 7f85ec198700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85e4072230 con 0x7f85e40b5ab0 2023-11-26T07:15:16.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.467+0000 7f85ec198700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e4072510 con 0x7f85e406b620 2023-11-26T07:15:16.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.468+0000 7f85e9733700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f85e40b5ab0 0x7f85e40b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:16.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.468+0000 7f85e9f34700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85e406b620 0x7f85e40b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:16.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.468+0000 7f85e9733700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f85e40b5ab0 0x7f85e40b3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.2:51680/0 (socket says 172.21.15.2:51680) 2023-11-26T07:15:16.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.468+0000 7f85e9f34700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85e406b620 0x7f85e40b3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.2:41172/0 (socket says 172.21.15.2:41172) 2023-11-26T07:15:16.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.468+0000 7f85e9733700 1 -- 172.21.15.2:0/3536905854 learned_addr learned my addr 172.21.15.2:0/3536905854 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:16.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.468+0000 7f85ea735700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f85e41478c0 0x7f85e4161ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.2:41676/0 (socket says 172.21.15.2:41676) 2023-11-26T07:15:16.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.468+0000 7f85e9f34700 1 -- 172.21.15.2:0/3536905854 >> v2:172.21.15.192:3300/0 conn(0x7f85e40b5ab0 msgr2=0x7f85e40b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:16.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.468+0000 7f85e9f34700 1 --2- 172.21.15.2:0/3536905854 >> v2:172.21.15.192:3300/0 conn(0x7f85e40b5ab0 0x7f85e40b3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:16.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.468+0000 7f85e9f34700 1 -- 172.21.15.2:0/3536905854 >> v1:172.21.15.192:6789/0 conn(0x7f85e41478c0 legacy=0x7f85e4161ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:16.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.468+0000 7f85e9f34700 1 -- 172.21.15.2:0/3536905854 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e40727f0 con 0x7f85e406b620 2023-11-26T07:15:16.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.468+0000 7f85e9733700 1 --2- 172.21.15.2:0/3536905854 >> v2:172.21.15.192:3300/0 conn(0x7f85e40b5ab0 0x7f85e40b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:15:16.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.468+0000 7f85e9f34700 1 --2- 172.21.15.2:0/3536905854 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85e406b620 0x7f85e40b3a40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f85d4009840 tx=0x7f85d4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=588b5b0c67e11889 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:16.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.469+0000 7f85e8f32700 1 -- 172.21.15.2:0/3536905854 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d4004230 con 0x7f85e406b620 2023-11-26T07:15:16.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.469+0000 7f85e8f32700 1 -- 172.21.15.2:0/3536905854 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d4004390 con 0x7f85e406b620 2023-11-26T07:15:16.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.469+0000 7f85e8f32700 1 -- 172.21.15.2:0/3536905854 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d40036a0 con 0x7f85e406b620 2023-11-26T07:15:16.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.469+0000 7f85ec198700 1 -- 172.21.15.2:0/3536905854 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85e406b620 msgr2=0x7f85e40b3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:16.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.469+0000 7f85ec198700 1 --2- 172.21.15.2:0/3536905854 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85e406b620 0x7f85e40b3a40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f85d4009840 tx=0x7f85d4009b50 comp rx=0 tx=0).stop 2023-11-26T07:15:16.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.469+0000 7f85ec198700 1 -- 172.21.15.2:0/3536905854 shutdown_connections 2023-11-26T07:15:16.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.469+0000 7f85ec198700 1 --2- 172.21.15.2:0/3536905854 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85e406b620 0x7f85e40b3a40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:16.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.469+0000 7f85ec198700 1 --2- 172.21.15.2:0/3536905854 >> v2:172.21.15.192:3300/0 conn(0x7f85e40b5ab0 0x7f85e40b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:16.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.469+0000 7f85ec198700 1 -- 172.21.15.2:0/3536905854 >> 172.21.15.2:0/3536905854 conn(0x7f85e40b2740 msgr2=0x7f85e40b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:16.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.469+0000 7f85ec198700 1 -- 172.21.15.2:0/3536905854 shutdown_connections 2023-11-26T07:15:16.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.469+0000 7f85ec198700 1 -- 172.21.15.2:0/3536905854 wait complete. 2023-11-26T07:15:16.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.470+0000 7f85ec198700 1 Processor -- start 2023-11-26T07:15:16.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.471+0000 7f85ec198700 1 -- start start 2023-11-26T07:15:16.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.471+0000 7f85ec198700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85e406b620 0x7f85e4141820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:16.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.471+0000 7f85ec198700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85e40b5ab0 0x7f85e41d3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:16.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.471+0000 7f85ec198700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85e41478c0 0x7f85e41d4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:16.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.471+0000 7f85ec198700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e41d5720 con 0x7f85e41478c0 2023-11-26T07:15:16.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.471+0000 7f85ec198700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e41e4f70 con 0x7f85e406b620 2023-11-26T07:15:16.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.471+0000 7f85ec198700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e41d4770 con 0x7f85e40b5ab0 2023-11-26T07:15:16.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.471+0000 7f85ea735700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85e41478c0 0x7f85e41d4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:16.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.472+0000 7f85ea735700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85e41478c0 0x7f85e41d4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43102/0 (socket says 172.21.15.2:43102) 2023-11-26T07:15:16.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.472+0000 7f85ea735700 1 -- 172.21.15.2:0/2878329410 learned_addr learned my addr 172.21.15.2:0/2878329410 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:16.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.472+0000 7f85e9f34700 1 --2- 172.21.15.2:0/2878329410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85e406b620 0x7f85e4141820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:16.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.472+0000 7f85e9733700 1 --2- 172.21.15.2:0/2878329410 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85e40b5ab0 0x7f85e41d3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:16.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.472+0000 7f85ea735700 1 -- 172.21.15.2:0/2878329410 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85e40b5ab0 msgr2=0x7f85e41d3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:16.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.472+0000 7f85ea735700 1 --2- 172.21.15.2:0/2878329410 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85e40b5ab0 0x7f85e41d3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:16.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.472+0000 7f85ea735700 1 -- 172.21.15.2:0/2878329410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85e406b620 msgr2=0x7f85e4141820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:16.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.472+0000 7f85ea735700 1 --2- 172.21.15.2:0/2878329410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85e406b620 0x7f85e4141820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:16.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.472+0000 7f85ea735700 1 -- 172.21.15.2:0/2878329410 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e0009550 con 0x7f85e41478c0 2023-11-26T07:15:16.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.472+0000 7f85ea735700 1 --2- 172.21.15.2:0/2878329410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85e41478c0 0x7f85e41d4140 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f85dc00cca0 tx=0x7f85dc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:16.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.472+0000 7f85da7fc700 1 -- 172.21.15.2:0/2878329410 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc00ab30 con 0x7f85e41478c0 2023-11-26T07:15:16.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.472+0000 7f85da7fc700 1 -- 172.21.15.2:0/2878329410 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85dc00ac90 con 0x7f85e41478c0 2023-11-26T07:15:16.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.472+0000 7f85ec198700 1 -- 172.21.15.2:0/2878329410 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85d40094a0 con 0x7f85e41478c0 2023-11-26T07:15:16.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.472+0000 7f85da7fc700 1 -- 172.21.15.2:0/2878329410 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc0070d0 con 0x7f85e41478c0 2023-11-26T07:15:16.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.472+0000 7f85ec198700 1 -- 172.21.15.2:0/2878329410 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e41d5060 con 0x7f85e41478c0 2023-11-26T07:15:16.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.473+0000 7f85ec198700 1 -- 172.21.15.2:0/2878329410 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85e41d5860 con 0x7f85e41478c0 2023-11-26T07:15:16.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.474+0000 7f85da7fc700 1 -- 172.21.15.2:0/2878329410 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f85dc007250 con 0x7f85e41478c0 2023-11-26T07:15:16.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.474+0000 7f85da7fc700 1 --2- 172.21.15.2:0/2878329410 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f85c806b470 0x7f85c806d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:16.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.474+0000 7f85da7fc700 1 -- 172.21.15.2:0/2878329410 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f85dc089a10 con 0x7f85e41478c0 2023-11-26T07:15:16.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.474+0000 7f85e9f34700 1 --2- 172.21.15.2:0/2878329410 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f85c806b470 0x7f85c806d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:16.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.475+0000 7f85e9f34700 1 --2- 172.21.15.2:0/2878329410 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f85c806b470 0x7f85c806d930 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f85d4009840 tx=0x7f85d4008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:16.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.479+0000 7f85da7fc700 1 -- 172.21.15.2:0/2878329410 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f85e41d5860 con 0x7f85e41478c0 2023-11-26T07:15:16.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.726+0000 7f85ec198700 1 -- 172.21.15.2:0/2878329410 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f85e41d5860 con 0x7f85e41478c0 2023-11-26T07:15:16.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.727+0000 7f85da7fc700 1 -- 172.21.15.2:0/2878329410 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f85e41d5860 con 0x7f85e41478c0 2023-11-26T07:15:16.730 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:15:16.730 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5384,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3283211322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3283211322},{"type":"v1","addr":"172.21.15.192:6837","nonce":3283211322}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":5833,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/4149545589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":4149545589},{"type":"v1","addr":"172.21.15.192:6836","nonce":4149545589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":6171,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/1422633843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1422633843},{"type":"v1","addr":"172.21.15.2:6834","nonce":1422633843}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:15:12.714394+0000","modified":"2023-11-26T07:15:15.725909+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6174},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6174":{"gid":6174,"name":"a","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6835/1251532899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":1251532899},{"type":"v1","addr":"172.21.15.2:6835","nonce":1251532899}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-26T07:15:16.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.729+0000 7f85ec198700 1 -- 172.21.15.2:0/2878329410 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f85c806b470 msgr2=0x7f85c806d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:16.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.729+0000 7f85ec198700 1 --2- 172.21.15.2:0/2878329410 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f85c806b470 0x7f85c806d930 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f85d4009840 tx=0x7f85d4008030 comp rx=0 tx=0).stop 2023-11-26T07:15:16.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.729+0000 7f85ec198700 1 -- 172.21.15.2:0/2878329410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85e41478c0 msgr2=0x7f85e41d4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:16.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.729+0000 7f85ec198700 1 --2- 172.21.15.2:0/2878329410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85e41478c0 0x7f85e41d4140 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f85dc00cca0 tx=0x7f85dc00a060 comp rx=0 tx=0).stop 2023-11-26T07:15:16.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.729+0000 7f85ec198700 1 -- 172.21.15.2:0/2878329410 shutdown_connections 2023-11-26T07:15:16.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.729+0000 7f85ec198700 1 --2- 172.21.15.2:0/2878329410 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f85c806b470 0x7f85c806d930 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:16.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.729+0000 7f85ec198700 1 --2- 172.21.15.2:0/2878329410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85e41478c0 0x7f85e41d4140 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:16.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.729+0000 7f85ec198700 1 --2- 172.21.15.2:0/2878329410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85e406b620 0x7f85e4141820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:16.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.729+0000 7f85ec198700 1 --2- 172.21.15.2:0/2878329410 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85e40b5ab0 0x7f85e41d3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:16.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.729+0000 7f85ec198700 1 -- 172.21.15.2:0/2878329410 >> 172.21.15.2:0/2878329410 conn(0x7f85e40b2740 msgr2=0x7f85e40af0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:16.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.729+0000 7f85ec198700 1 -- 172.21.15.2:0/2878329410 shutdown_connections 2023-11-26T07:15:16.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.729+0000 7f85ec198700 1 -- 172.21.15.2:0/2878329410 wait complete. 2023-11-26T07:15:16.733 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 36 2023-11-26T07:15:16.744 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:15:16.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.866+0000 7fbeaad10700 1 Processor -- start 2023-11-26T07:15:16.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.866+0000 7fbeaad10700 1 -- start start 2023-11-26T07:15:16.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.866+0000 7fbeaad10700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbea406afd0 0x7fbea40b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:16.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.866+0000 7fbeaad10700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbea406edc0 0x7fbea406b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:16.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.866+0000 7fbeaad10700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbea406dba0 0x7fbea406e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:16.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.866+0000 7fbeaad10700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbea406f830 con 0x7fbea406dba0 2023-11-26T07:15:16.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.866+0000 7fbeaad10700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbea40ad860 con 0x7fbea406edc0 2023-11-26T07:15:16.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.866+0000 7fbeaad10700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea40d0a20 con 0x7fbea406afd0 2023-11-26T07:15:16.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.866+0000 7fbea92ad700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbea406dba0 0x7fbea406e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:16.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.866+0000 7fbea92ad700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbea406dba0 0x7fbea406e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43108/0 (socket says 172.21.15.2:43108) 2023-11-26T07:15:16.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.866+0000 7fbea92ad700 1 -- 172.21.15.2:0/3309980931 learned_addr learned my addr 172.21.15.2:0/3309980931 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:16.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.867+0000 7fbea8aac700 1 --2- 172.21.15.2:0/3309980931 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbea406afd0 0x7fbea40b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:16.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.867+0000 7fbea92ad700 1 -- 172.21.15.2:0/3309980931 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbea406afd0 msgr2=0x7fbea40b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:16.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.867+0000 7fbea92ad700 1 --2- 172.21.15.2:0/3309980931 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbea406afd0 0x7fbea40b5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:16.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.867+0000 7fbea92ad700 1 -- 172.21.15.2:0/3309980931 >> v2:172.21.15.192:3300/0 conn(0x7fbea406edc0 msgr2=0x7fbea406b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:16.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.867+0000 7fbea92ad700 1 --2- 172.21.15.2:0/3309980931 >> v2:172.21.15.192:3300/0 conn(0x7fbea406edc0 0x7fbea406b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:16.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.867+0000 7fbea92ad700 1 -- 172.21.15.2:0/3309980931 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea4162a70 con 0x7fbea406dba0 2023-11-26T07:15:16.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.867+0000 7fbea92ad700 1 --2- 172.21.15.2:0/3309980931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbea406dba0 0x7fbea406e050 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fbea4074f80 tx=0x7fbe9c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d845cb723b5c802 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:16.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.867+0000 7fbea37fe700 1 -- 172.21.15.2:0/3309980931 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c00e070 con 0x7fbea406dba0 2023-11-26T07:15:16.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.867+0000 7fbea37fe700 1 -- 172.21.15.2:0/3309980931 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe9c00b9c0 con 0x7fbea406dba0 2023-11-26T07:15:16.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.867+0000 7fbea37fe700 1 -- 172.21.15.2:0/3309980931 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c00bd70 con 0x7fbea406dba0 2023-11-26T07:15:16.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.868+0000 7fbeaad10700 1 -- 172.21.15.2:0/3309980931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbea406dba0 msgr2=0x7fbea406e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:16.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.868+0000 7fbeaad10700 1 --2- 172.21.15.2:0/3309980931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbea406dba0 0x7fbea406e050 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fbea4074f80 tx=0x7fbe9c00b330 comp rx=0 tx=0).stop 2023-11-26T07:15:16.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.868+0000 7fbeaad10700 1 -- 172.21.15.2:0/3309980931 shutdown_connections 2023-11-26T07:15:16.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.868+0000 7fbeaad10700 1 --2- 172.21.15.2:0/3309980931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbea406dba0 0x7fbea406e050 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:16.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.868+0000 7fbeaad10700 1 --2- 172.21.15.2:0/3309980931 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbea406afd0 0x7fbea40b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:16.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.868+0000 7fbeaad10700 1 --2- 172.21.15.2:0/3309980931 >> v2:172.21.15.192:3300/0 conn(0x7fbea406edc0 0x7fbea406b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:16.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.868+0000 7fbeaad10700 1 -- 172.21.15.2:0/3309980931 >> 172.21.15.2:0/3309980931 conn(0x7fbea40b2840 msgr2=0x7fbea40b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:16.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.868+0000 7fbeaad10700 1 -- 172.21.15.2:0/3309980931 shutdown_connections 2023-11-26T07:15:16.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.868+0000 7fbeaad10700 1 -- 172.21.15.2:0/3309980931 wait complete. 2023-11-26T07:15:16.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.869+0000 7fbeaad10700 1 Processor -- start 2023-11-26T07:15:16.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.869+0000 7fbeaad10700 1 -- start start 2023-11-26T07:15:16.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.870+0000 7fbeaad10700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbea406afd0 0x7fbea415ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:16.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.870+0000 7fbeaad10700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbea406dba0 0x7fbea40aefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:16.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.870+0000 7fbeaad10700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbea406edc0 0x7fbea40af520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:16.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.870+0000 7fbeaad10700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea415e2d0 con 0x7fbea406dba0 2023-11-26T07:15:16.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.870+0000 7fbeaad10700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea4158340 con 0x7fbea406edc0 2023-11-26T07:15:16.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.870+0000 7fbeaad10700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea4158900 con 0x7fbea406afd0 2023-11-26T07:15:16.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.870+0000 7fbea3fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbea406dba0 0x7fbea40aefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:16.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.870+0000 7fbea3fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbea406dba0 0x7fbea40aefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43112/0 (socket says 172.21.15.2:43112) 2023-11-26T07:15:16.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.870+0000 7fbea3fff700 1 -- 172.21.15.2:0/3351910771 learned_addr learned my addr 172.21.15.2:0/3351910771 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:16.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.870+0000 7fbea8aac700 1 --2- 172.21.15.2:0/3351910771 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbea406afd0 0x7fbea415ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:16.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.870+0000 7fbea92ad700 1 --2- 172.21.15.2:0/3351910771 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbea406edc0 0x7fbea40af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:16.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.870+0000 7fbea3fff700 1 -- 172.21.15.2:0/3351910771 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbea406afd0 msgr2=0x7fbea415ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:16.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.870+0000 7fbea3fff700 1 --2- 172.21.15.2:0/3351910771 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbea406afd0 0x7fbea415ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:16.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.870+0000 7fbea3fff700 1 -- 172.21.15.2:0/3351910771 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbea406edc0 msgr2=0x7fbea40af520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:16.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.870+0000 7fbea3fff700 1 --2- 172.21.15.2:0/3351910771 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbea406edc0 0x7fbea40af520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:16.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.870+0000 7fbea3fff700 1 -- 172.21.15.2:0/3351910771 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe9c009b30 con 0x7fbea406dba0 2023-11-26T07:15:16.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.870+0000 7fbea3fff700 1 --2- 172.21.15.2:0/3351910771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbea406dba0 0x7fbea40aefe0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fbe9000b4b0 tx=0x7fbe9000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:16.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.870+0000 7fbea17fa700 1 -- 172.21.15.2:0/3351910771 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe90011830 con 0x7fbea406dba0 2023-11-26T07:15:16.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.870+0000 7fbea17fa700 1 -- 172.21.15.2:0/3351910771 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe90011990 con 0x7fbea406dba0 2023-11-26T07:15:16.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.871+0000 7fbeaad10700 1 -- 172.21.15.2:0/3351910771 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbea415e520 con 0x7fbea406dba0 2023-11-26T07:15:16.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.871+0000 7fbea17fa700 1 -- 172.21.15.2:0/3351910771 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe90011d40 con 0x7fbea406dba0 2023-11-26T07:15:16.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.871+0000 7fbeaad10700 1 -- 172.21.15.2:0/3351910771 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbea4158590 con 0x7fbea406dba0 2023-11-26T07:15:16.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.871+0000 7fbeaad10700 1 -- 172.21.15.2:0/3351910771 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbea4073340 con 0x7fbea406dba0 2023-11-26T07:15:16.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.872+0000 7fbea17fa700 1 -- 172.21.15.2:0/3351910771 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7fbe9001a400 con 0x7fbea406dba0 2023-11-26T07:15:16.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.872+0000 7fbea17fa700 1 --2- 172.21.15.2:0/3351910771 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fbe8806b470 0x7fbe8806d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:16.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.873+0000 7fbea17fa700 1 -- 172.21.15.2:0/3351910771 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe9008a010 con 0x7fbea406dba0 2023-11-26T07:15:16.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.873+0000 7fbea8aac700 1 --2- 172.21.15.2:0/3351910771 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fbe8806b470 0x7fbe8806d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:16.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.873+0000 7fbea8aac700 1 --2- 172.21.15.2:0/3351910771 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fbe8806b470 0x7fbe8806d930 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fbe98008850 tx=0x7fbe98008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:16.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:16.877+0000 7fbea17fa700 1 -- 172.21.15.2:0/3351910771 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbe90054850 con 0x7fbea406dba0 2023-11-26T07:15:17.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.077+0000 7fbeaad10700 1 -- 172.21.15.2:0/3351910771 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbea4068670 con 0x7fbea406dba0 2023-11-26T07:15:17.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.078+0000 7fbea17fa700 1 -- 172.21.15.2:0/3351910771 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16517 (secure 0 0 0) 0x7fbe90015020 con 0x7fbea406dba0 2023-11-26T07:15:17.081 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:15:17.081 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":60,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:15:14.285600+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:15:11.156119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-26T07:15:11.674003+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:15:17.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.081+0000 7fbeaad10700 1 -- 172.21.15.2:0/3351910771 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fbe8806b470 msgr2=0x7fbe8806d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:17.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.081+0000 7fbeaad10700 1 --2- 172.21.15.2:0/3351910771 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fbe8806b470 0x7fbe8806d930 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fbe98008850 tx=0x7fbe98008040 comp rx=0 tx=0).stop 2023-11-26T07:15:17.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.081+0000 7fbeaad10700 1 -- 172.21.15.2:0/3351910771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbea406dba0 msgr2=0x7fbea40aefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:17.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.081+0000 7fbeaad10700 1 --2- 172.21.15.2:0/3351910771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbea406dba0 0x7fbea40aefe0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fbe9000b4b0 tx=0x7fbe9000b870 comp rx=0 tx=0).stop 2023-11-26T07:15:17.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.081+0000 7fbeaad10700 1 -- 172.21.15.2:0/3351910771 shutdown_connections 2023-11-26T07:15:17.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.081+0000 7fbeaad10700 1 --2- 172.21.15.2:0/3351910771 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fbe8806b470 0x7fbe8806d930 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:17.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.081+0000 7fbeaad10700 1 --2- 172.21.15.2:0/3351910771 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbea406edc0 0x7fbea40af520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:17.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.081+0000 7fbeaad10700 1 --2- 172.21.15.2:0/3351910771 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbea406afd0 0x7fbea415ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:17.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.081+0000 7fbeaad10700 1 --2- 172.21.15.2:0/3351910771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbea406dba0 0x7fbea40aefe0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:17.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.081+0000 7fbeaad10700 1 -- 172.21.15.2:0/3351910771 >> 172.21.15.2:0/3351910771 conn(0x7fbea40b2840 msgr2=0x7fbea406df80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:17.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.081+0000 7fbeaad10700 1 -- 172.21.15.2:0/3351910771 shutdown_connections 2023-11-26T07:15:17.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.081+0000 7fbeaad10700 1 -- 172.21.15.2:0/3351910771 wait complete. 2023-11-26T07:15:17.096 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-26T07:15:17.096 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:15:17.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.219+0000 7f855d3f6700 1 Processor -- start 2023-11-26T07:15:17.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.219+0000 7f855d3f6700 1 -- start start 2023-11-26T07:15:17.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.220+0000 7f855d3f6700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f855806fc50 0x7f855806eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:17.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.220+0000 7f855d3f6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85580b0e90 0x7f855806ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:17.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.220+0000 7f855d3f6700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85580d1230 con 0x7f855815e1c0 2023-11-26T07:15:17.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.220+0000 7f855d3f6700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85580d0c70 con 0x7f855806fc50 2023-11-26T07:15:17.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.220+0000 7f855d3f6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85580d0f50 con 0x7f85580b0e90 2023-11-26T07:15:17.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.220+0000 7f8556ffd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f855815e1c0 0x7f855806f540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34328/0 (socket says 172.21.15.2:34328) 2023-11-26T07:15:17.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.220+0000 7f8556ffd700 1 -- 172.21.15.2:0/2799809226 learned_addr learned my addr 172.21.15.2:0/2799809226 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:15:17.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.221+0000 7f85577fe700 1 --2- 172.21.15.2:0/2799809226 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85580b0e90 0x7f855806ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:17.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.221+0000 7f8555ffb700 1 -- 172.21.15.2:0/2799809226 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2043957877 0 0) 0x7f85580d1230 con 0x7f855815e1c0 2023-11-26T07:15:17.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.221+0000 7f85567fc700 1 --2- 172.21.15.2:0/2799809226 >> v2:172.21.15.192:3300/0 conn(0x7f855806fc50 0x7f855806eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:17.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.221+0000 7f8555ffb700 1 -- 172.21.15.2:0/2799809226 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85400035b0 con 0x7f855815e1c0 2023-11-26T07:15:17.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.221+0000 7f8555ffb700 1 -- 172.21.15.2:0/2799809226 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3895607797 0 0) 0x7f85400035b0 con 0x7f855815e1c0 2023-11-26T07:15:17.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.221+0000 7f8555ffb700 1 -- 172.21.15.2:0/2799809226 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85580b0e90 msgr2=0x7f855806ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:17.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.221+0000 7f8555ffb700 1 --2- 172.21.15.2:0/2799809226 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85580b0e90 0x7f855806ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:17.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.221+0000 7f8555ffb700 1 -- 172.21.15.2:0/2799809226 >> v2:172.21.15.192:3300/0 conn(0x7f855806fc50 msgr2=0x7f855806eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:17.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.221+0000 7f8555ffb700 1 --2- 172.21.15.2:0/2799809226 >> v2:172.21.15.192:3300/0 conn(0x7f855806fc50 0x7f855806eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:17.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.221+0000 7f8555ffb700 1 -- 172.21.15.2:0/2799809226 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f855806c210 con 0x7f855815e1c0 2023-11-26T07:15:17.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.221+0000 7f8555ffb700 1 -- 172.21.15.2:0/2799809226 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f854c001670 con 0x7f855815e1c0 2023-11-26T07:15:17.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.221+0000 7f8555ffb700 1 -- 172.21.15.2:0/2799809226 >> v1:172.21.15.2:6789/0 conn(0x7f855815e1c0 legacy=0x7f855806f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:17.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.221+0000 7f8555ffb700 1 --2- 172.21.15.2:0/2799809226 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85580b0e90 0x7f8540003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:17.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.221+0000 7f8555ffb700 1 --2- 172.21.15.2:0/2799809226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8540003f80 0x7f8540004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:17.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.221+0000 7f8555ffb700 1 --2- 172.21.15.2:0/2799809226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8540004d90 0x7f8540005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:17.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.221+0000 7f8555ffb700 1 -- 172.21.15.2:0/2799809226 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85580d0c70 con 0x7f8540003f80 2023-11-26T07:15:17.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.221+0000 7f8555ffb700 1 -- 172.21.15.2:0/2799809226 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85580d0f50 con 0x7f8540004d90 2023-11-26T07:15:17.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.221+0000 7f8555ffb700 1 -- 172.21.15.2:0/2799809226 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f854000ba60 con 0x7f85580b0e90 2023-11-26T07:15:17.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.221+0000 7f85567fc700 1 --2- 172.21.15.2:0/2799809226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8540003f80 0x7f8540004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:17.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.221+0000 7f8556ffd700 1 --2- 172.21.15.2:0/2799809226 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85580b0e90 0x7f8540003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:17.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.221+0000 7f85577fe700 1 --2- 172.21.15.2:0/2799809226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8540004d90 0x7f8540005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:17.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.221+0000 7f85567fc700 1 -- 172.21.15.2:0/2799809226 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85580b0e90 msgr2=0x7f8540003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:17.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.221+0000 7f85567fc700 1 --2- 172.21.15.2:0/2799809226 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85580b0e90 0x7f8540003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:17.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.221+0000 7f85567fc700 1 -- 172.21.15.2:0/2799809226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8540004d90 msgr2=0x7f8540005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:17.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.221+0000 7f85567fc700 1 --2- 172.21.15.2:0/2799809226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8540004d90 0x7f8540005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:17.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.221+0000 7f85567fc700 1 -- 172.21.15.2:0/2799809226 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85400035b0 con 0x7f8540003f80 2023-11-26T07:15:17.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.222+0000 7f85567fc700 1 --2- 172.21.15.2:0/2799809226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8540003f80 0x7f8540004850 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f8548009b90 tx=0x7f8540005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8626f57bb6e37d59 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:17.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.222+0000 7f8555ffb700 1 -- 172.21.15.2:0/2799809226 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854800e6c0 con 0x7f8540003f80 2023-11-26T07:15:17.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.222+0000 7f8555ffb700 1 -- 172.21.15.2:0/2799809226 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854800e820 con 0x7f8540003f80 2023-11-26T07:15:17.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.222+0000 7f8555ffb700 1 -- 172.21.15.2:0/2799809226 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854800eb90 con 0x7f8540003f80 2023-11-26T07:15:17.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.222+0000 7f855d3f6700 1 -- 172.21.15.2:0/2799809226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8540003f80 msgr2=0x7f8540004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:17.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.222+0000 7f855d3f6700 1 --2- 172.21.15.2:0/2799809226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8540003f80 0x7f8540004850 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f8548009b90 tx=0x7f8540005880 comp rx=0 tx=0).stop 2023-11-26T07:15:17.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.222+0000 7f85577fe700 1 -- 172.21.15.2:0/2799809226 reap_dead start 2023-11-26T07:15:17.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.222+0000 7f855d3f6700 1 -- 172.21.15.2:0/2799809226 shutdown_connections 2023-11-26T07:15:17.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.222+0000 7f855d3f6700 1 -- 172.21.15.2:0/2799809226 >> 172.21.15.2:0/2799809226 conn(0x7f85580b3720 msgr2=0x7f85580b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:17.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.222+0000 7f855d3f6700 1 -- 172.21.15.2:0/2799809226 shutdown_connections 2023-11-26T07:15:17.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.222+0000 7f855d3f6700 1 -- 172.21.15.2:0/2799809226 wait complete. 2023-11-26T07:15:17.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.224+0000 7f855d3f6700 1 Processor -- start 2023-11-26T07:15:17.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.224+0000 7f855d3f6700 1 -- start start 2023-11-26T07:15:17.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.225+0000 7f855d3f6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8540003f80 0x7f85580b6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:17.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.225+0000 7f855d3f6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85580ce590 0x7f855809da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:17.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.225+0000 7f855d3f6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f855809f320 0x7f85580c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:17.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.225+0000 7f855d3f6700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855809e280 con 0x7f8540003f80 2023-11-26T07:15:17.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.225+0000 7f855d3f6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855809e560 con 0x7f85580ce590 2023-11-26T07:15:17.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.225+0000 7f855d3f6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f855809e840 con 0x7f855809f320 2023-11-26T07:15:17.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.225+0000 7f8556ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8540003f80 0x7f85580b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:17.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.225+0000 7f8556ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8540003f80 0x7f85580b6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43130/0 (socket says 172.21.15.2:43130) 2023-11-26T07:15:17.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.225+0000 7f8556ffd700 1 -- 172.21.15.2:0/2162772336 learned_addr learned my addr 172.21.15.2:0/2162772336 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:17.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.225+0000 7f85577fe700 1 --2- 172.21.15.2:0/2162772336 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f855809f320 0x7f85580c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:17.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.225+0000 7f85567fc700 1 --2- 172.21.15.2:0/2162772336 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85580ce590 0x7f855809da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:17.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.226+0000 7f8556ffd700 1 -- 172.21.15.2:0/2162772336 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f855809f320 msgr2=0x7f85580c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:17.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.226+0000 7f8556ffd700 1 --2- 172.21.15.2:0/2162772336 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f855809f320 0x7f85580c8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:17.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.226+0000 7f8556ffd700 1 -- 172.21.15.2:0/2162772336 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85580ce590 msgr2=0x7f855809da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:17.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.226+0000 7f8556ffd700 1 --2- 172.21.15.2:0/2162772336 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85580ce590 0x7f855809da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:17.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.226+0000 7f8556ffd700 1 -- 172.21.15.2:0/2162772336 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f855809eb20 con 0x7f8540003f80 2023-11-26T07:15:17.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.226+0000 7f85567fc700 1 --2- 172.21.15.2:0/2162772336 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85580ce590 0x7f855809da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:15:17.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.226+0000 7f8556ffd700 1 --2- 172.21.15.2:0/2162772336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8540003f80 0x7f85580b6780 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f854c007340 tx=0x7f854c007650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:17.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.226+0000 7f853f7fe700 1 -- 172.21.15.2:0/2162772336 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c00f6c0 con 0x7f8540003f80 2023-11-26T07:15:17.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.226+0000 7f853f7fe700 1 -- 172.21.15.2:0/2162772336 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854c00f820 con 0x7f8540003f80 2023-11-26T07:15:17.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.226+0000 7f855d3f6700 1 -- 172.21.15.2:0/2162772336 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f855809ee00 con 0x7f8540003f80 2023-11-26T07:15:17.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.226+0000 7f853f7fe700 1 -- 172.21.15.2:0/2162772336 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c00fbd0 con 0x7f8540003f80 2023-11-26T07:15:17.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.226+0000 7f855d3f6700 1 -- 172.21.15.2:0/2162772336 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f855809f7d0 con 0x7f8540003f80 2023-11-26T07:15:17.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.227+0000 7f855d3f6700 1 -- 172.21.15.2:0/2162772336 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85580ce970 con 0x7f8540003f80 2023-11-26T07:15:17.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.227+0000 7f853f7fe700 1 -- 172.21.15.2:0/2162772336 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f854c00fd30 con 0x7f8540003f80 2023-11-26T07:15:17.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.228+0000 7f853f7fe700 1 --2- 172.21.15.2:0/2162772336 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f854406b470 0x7f854406d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:17.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.228+0000 7f853f7fe700 1 -- 172.21.15.2:0/2162772336 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f854c089f70 con 0x7f8540003f80 2023-11-26T07:15:17.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.228+0000 7f85567fc700 1 --2- 172.21.15.2:0/2162772336 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f854406b470 0x7f854406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:17.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.229+0000 7f85567fc700 1 --2- 172.21.15.2:0/2162772336 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f854406b470 0x7f854406d930 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f85480090b0 tx=0x7f8548008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:17.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.232+0000 7f853f7fe700 1 -- 172.21.15.2:0/2162772336 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f854c054840 con 0x7f8540003f80 2023-11-26T07:15:17.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.429+0000 7f855d3f6700 1 -- 172.21.15.2:0/2162772336 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f855809e6d0 con 0x7f854406b470 2023-11-26T07:15:17.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.437+0000 7f853f7fe700 1 -- 172.21.15.2:0/2162772336 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277111 (secure 0 0 0) 0x7f855809e6d0 con 0x7f854406b470 2023-11-26T07:15:17.442 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:15:17.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.440+0000 7f855d3f6700 1 -- 172.21.15.2:0/2162772336 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f854406b470 msgr2=0x7f854406d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:17.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.440+0000 7f855d3f6700 1 --2- 172.21.15.2:0/2162772336 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f854406b470 0x7f854406d930 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f85480090b0 tx=0x7f8548008030 comp rx=0 tx=0).stop 2023-11-26T07:15:17.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.440+0000 7f855d3f6700 1 -- 172.21.15.2:0/2162772336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8540003f80 msgr2=0x7f85580b6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:17.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.440+0000 7f855d3f6700 1 --2- 172.21.15.2:0/2162772336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8540003f80 0x7f85580b6780 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f854c007340 tx=0x7f854c007650 comp rx=0 tx=0).stop 2023-11-26T07:15:17.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.440+0000 7f855d3f6700 1 -- 172.21.15.2:0/2162772336 shutdown_connections 2023-11-26T07:15:17.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.440+0000 7f855d3f6700 1 --2- 172.21.15.2:0/2162772336 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f854406b470 0x7f854406d930 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:17.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.440+0000 7f855d3f6700 1 --2- 172.21.15.2:0/2162772336 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f855809f320 0x7f85580c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:17.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.440+0000 7f855d3f6700 1 --2- 172.21.15.2:0/2162772336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8540003f80 0x7f85580b6780 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:17.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.440+0000 7f855d3f6700 1 --2- 172.21.15.2:0/2162772336 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85580ce590 0x7f855809da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:17.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.440+0000 7f855d3f6700 1 -- 172.21.15.2:0/2162772336 >> 172.21.15.2:0/2162772336 conn(0x7f85580b3720 msgr2=0x7f855806eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:17.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.440+0000 7f855d3f6700 1 -- 172.21.15.2:0/2162772336 shutdown_connections 2023-11-26T07:15:17.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.440+0000 7f855d3f6700 1 -- 172.21.15.2:0/2162772336 wait complete. 2023-11-26T07:15:17.445 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-26T07:15:17.454 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":168,"stamp":"2023-11-26T07:15:16.209173+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":243480,"kb_used_data":6504,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754731240,"statfs":{"total":773094113280,"available":772844789760,"internally_reserved":0,"allocated":6660096,"data_stored":3443032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.929183"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.283823+0000","last_change":"2023-11-26T07:15:11.283823+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.283823+0000","last_undegraded":"2023-11-26T07:15:11.283823+0000","last_fullsized":"2023-11-26T07:15:11.283823+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.286333+0000","last_change":"2023-11-26T07:15:11.286333+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.286333+0000","last_undegraded":"2023-11-26T07:15:11.286333+0000","last_fullsized":"2023-11-26T07:15:11.286333+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.283770+0000","last_change":"2023-11-26T07:15:11.283770+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.283770+0000","last_undegraded":"2023-11-26T07:15:11.283770+0000","last_fullsized":"2023-11-26T07:15:11.283770+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.287402+0000","last_change":"2023-11-26T07:15:11.287402+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.287402+0000","last_undegraded":"2023-11-26T07:15:11.287402+0000","last_fullsized":"2023-11-26T07:15:11.287402+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.284915+0000","last_change":"2023-11-26T07:15:11.284915+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.284915+0000","last_undegraded":"2023-11-26T07:15:11.284915+0000","last_fullsized":"2023-11-26T07:15:11.284915+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.284109+0000","last_change":"2023-11-26T07:15:11.284109+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.284109+0000","last_undegraded":"2023-11-26T07:15:11.284109+0000","last_fullsized":"2023-11-26T07:15:11.284109+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.286778+0000","last_change":"2023-11-26T07:15:11.286778+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.286778+0000","last_undegraded":"2023-11-26T07:15:11.286778+0000","last_fullsized":"2023-11-26T07:15:11.286778+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.285330+0000","last_change":"2023-11-26T07:15:11.285330+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.285330+0000","last_undegraded":"2023-11-26T07:15:11.285330+0000","last_fullsized":"2023-11-26T07:15:11.285330+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.284133+0000","last_change":"2023-11-26T07:15:11.284133+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.284133+0000","last_undegraded":"2023-11-26T07:15:11.284133+0000","last_fullsized":"2023-11-26T07:15:11.284133+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.285488+0000","last_change":"2023-11-26T07:15:11.285488+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.285488+0000","last_undegraded":"2023-11-26T07:15:11.285488+0000","last_fullsized":"2023-11-26T07:15:11.285488+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.284120+0000","last_change":"2023-11-26T07:15:11.284120+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.284120+0000","last_undegraded":"2023-11-26T07:15:11.284120+0000","last_fullsized":"2023-11-26T07:15:11.284120+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.284992+0000","last_change":"2023-11-26T07:15:11.284992+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.284992+0000","last_undegraded":"2023-11-26T07:15:11.284992+0000","last_fullsized":"2023-11-26T07:15:11.284992+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.285639+0000","last_change":"2023-11-26T07:15:11.285639+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.285639+0000","last_undegraded":"2023-11-26T07:15:11.285639+0000","last_fullsized":"2023-11-26T07:15:11.285639+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.282095+0000","last_change":"2023-11-26T07:15:11.282095+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.282095+0000","last_undegraded":"2023-11-26T07:15:11.282095+0000","last_fullsized":"2023-11-26T07:15:11.282095+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.286316+0000","last_change":"2023-11-26T07:15:11.286316+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.286316+0000","last_undegraded":"2023-11-26T07:15:11.286316+0000","last_fullsized":"2023-11-26T07:15:11.286316+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.284146+0000","last_change":"2023-11-26T07:15:11.284146+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.284146+0000","last_undegraded":"2023-11-26T07:15:11.284146+0000","last_fullsized":"2023-11-26T07:15:11.284146+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.285115+0000","last_change":"2023-11-26T07:15:11.285115+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.285115+0000","last_undegraded":"2023-11-26T07:15:11.285115+0000","last_fullsized":"2023-11-26T07:15:11.285115+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.284266+0000","last_change":"2023-11-26T07:15:11.284266+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.284266+0000","last_undegraded":"2023-11-26T07:15:11.284266+0000","last_fullsized":"2023-11-26T07:15:11.284266+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.286926+0000","last_change":"2023-11-26T07:15:11.286926+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.286926+0000","last_undegraded":"2023-11-26T07:15:11.286926+0000","last_fullsized":"2023-11-26T07:15:11.286926+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.283755+0000","last_change":"2023-11-26T07:15:11.283755+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.283755+0000","last_undegraded":"2023-11-26T07:15:11.283755+0000","last_fullsized":"2023-11-26T07:15:11.283755+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.285007+0000","last_change":"2023-11-26T07:15:11.285007+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.285007+0000","last_undegraded":"2023-11-26T07:15:11.285007+0000","last_fullsized":"2023-11-26T07:15:11.285007+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.282355+0000","last_change":"2023-11-26T07:15:11.282355+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.282355+0000","last_undegraded":"2023-11-26T07:15:11.282355+0000","last_fullsized":"2023-11-26T07:15:11.282355+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.285700+0000","last_change":"2023-11-26T07:15:11.285700+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.285700+0000","last_undegraded":"2023-11-26T07:15:11.285700+0000","last_fullsized":"2023-11-26T07:15:11.285700+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.282195+0000","last_change":"2023-11-26T07:15:11.282195+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.282195+0000","last_undegraded":"2023-11-26T07:15:11.282195+0000","last_fullsized":"2023-11-26T07:15:11.282195+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.283748+0000","last_change":"2023-11-26T07:15:11.283748+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.283748+0000","last_undegraded":"2023-11-26T07:15:11.283748+0000","last_fullsized":"2023-11-26T07:15:11.283748+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.282162+0000","last_change":"2023-11-26T07:15:11.282162+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.282162+0000","last_undegraded":"2023-11-26T07:15:11.282162+0000","last_fullsized":"2023-11-26T07:15:11.282162+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.286991+0000","last_change":"2023-11-26T07:15:11.286991+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.286991+0000","last_undegraded":"2023-11-26T07:15:11.286991+0000","last_fullsized":"2023-11-26T07:15:11.286991+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.282130+0000","last_change":"2023-11-26T07:15:11.282130+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.282130+0000","last_undegraded":"2023-11-26T07:15:11.282130+0000","last_fullsized":"2023-11-26T07:15:11.282130+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.284903+0000","last_change":"2023-11-26T07:15:11.284903+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.284903+0000","last_undegraded":"2023-11-26T07:15:11.284903+0000","last_fullsized":"2023-11-26T07:15:11.284903+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.282122+0000","last_change":"2023-11-26T07:15:11.282122+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.282122+0000","last_undegraded":"2023-11-26T07:15:11.282122+0000","last_fullsized":"2023-11-26T07:15:11.282122+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.284999+0000","last_change":"2023-11-26T07:15:11.284999+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.284999+0000","last_undegraded":"2023-11-26T07:15:11.284999+0000","last_fullsized":"2023-11-26T07:15:11.284999+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.282095+0000","last_change":"2023-11-26T07:15:11.282095+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.282095+0000","last_undegraded":"2023-11-26T07:15:11.282095+0000","last_fullsized":"2023-11-26T07:15:11.282095+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":196,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-26T07:15:09.714992+0000","last_change":"2023-11-26T07:11:29.855919+0000","last_active":"2023-11-26T07:15:09.714992+0000","last_peered":"2023-11-26T07:15:09.714992+0000","last_clean":"2023-11-26T07:15:09.714992+0000","last_became_active":"2023-11-26T07:11:29.854903+0000","last_became_peered":"2023-11-26T07:11:29.854903+0000","last_unstale":"2023-11-26T07:15:09.714992+0000","last_undegraded":"2023-11-26T07:15:09.714992+0000","last_fullsized":"2023-11-26T07:15:09.714992+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:28.594252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:28.594252+0000","last_clean_scrub_stamp":"2023-11-26T07:11:28.594252+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:33:34.642696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574898,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28268,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343572,"statfs":{"total":96636764160,"available":96607817728,"internally_reserved":0,"allocated":1277952,"data_stored":873155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:14:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.35899999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.73699999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51300000000000001,"15min":0.505},"min":{"1min":0.38700000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.65600000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.433}]},{"osd":1,"last update":"Sun Nov 26 07:14:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.84799999999999998,"15min":0.97999999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.71499999999999997,"5min":9.5600000000000005,"15min":9.5600000000000005},"last":0.626},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.56899999999999995,"15min":0.57999999999999996},"min":{"1min":0.41599999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.70199999999999996,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.48599999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:14:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59599999999999997,"15min":0.60199999999999998},"min":{"1min":0.36799999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73299999999999998,"5min":1.569,"15min":1.569},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.63900000000000001,"15min":0.64900000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.85699999999999998,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.50900000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:14:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.59599999999999997,"15min":0.60399999999999998},"min":{"1min":0.42899999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68200000000000005,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.498},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57899999999999996,"15min":0.56699999999999995},"min":{"1min":0.44700000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78500000000000003,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.66400000000000003}]},{"osd":4,"last update":"Sun Nov 26 07:14:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.372,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70399999999999996,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53500000000000003,"15min":0.51500000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.82999999999999996,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.39500000000000002}]},{"osd":5,"last update":"Sun Nov 26 07:14:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.37,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63,"15min":0.63300000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80900000000000005,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.61499999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:14:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59499999999999997,"15min":0.59099999999999997},"min":{"1min":0.437,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60299999999999998,"15min":0.59299999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89100000000000001,"5min":1.552,"15min":1.552},"last":0.47099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":282787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.503,"15min":0.48399999999999999},"min":{"1min":0.311,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.76700000000000002,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.501},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.504,"15min":0.47599999999999998},"min":{"1min":0.38200000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.69899999999999995,"5min":0.871,"15min":0.871},"last":0.51300000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52300000000000002,"15min":0.51100000000000001},"min":{"1min":0.35199999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.73599999999999999,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55000000000000004,"15min":0.54400000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.83599999999999997,"5min":1.198,"15min":1.198},"last":0.56899999999999995}]},{"osd":2,"last update":"Sun Nov 26 07:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51600000000000001,"15min":0.495},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.71899999999999997,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.435},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.54800000000000004,"15min":0.52300000000000002},"min":{"1min":0.437,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.59999999999999998}]},{"osd":3,"last update":"Sun Nov 26 07:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.57499999999999996,"15min":0.55100000000000005},"min":{"1min":0.435,"5min":0.373,"15min":0.373},"max":{"1min":0.81999999999999995,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.60099999999999998,"15min":0.58299999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79100000000000004,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.58699999999999997}]},{"osd":4,"last update":"Sun Nov 26 07:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.52800000000000002,"15min":0.53200000000000003},"min":{"1min":0.33600000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70599999999999996,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.34100000000000003,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.78900000000000003,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.61699999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56399999999999995,"15min":0.56000000000000005},"min":{"1min":0.40200000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.71599999999999997,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58399999999999996,"15min":0.58799999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77300000000000002,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.46700000000000003}]},{"osd":7,"last update":"Sun Nov 26 07:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59299999999999997,"15min":0.59099999999999997},"min":{"1min":0.42799999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73899999999999999,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.628,"15min":0.626},"min":{"1min":0.45800000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.75700000000000001,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.67900000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31848,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339992,"statfs":{"total":96636764160,"available":96604151808,"internally_reserved":0,"allocated":684032,"data_stored":282787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.35499999999999998,"15min":0.36399999999999999},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.437},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.68400000000000005,"15min":0.83399999999999996},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.496,"5min":11.922000000000001,"15min":11.922000000000001},"last":0.378}]},{"osd":2,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.36199999999999999,"15min":0.373},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.52600000000000002,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.40200000000000002,"15min":0.40799999999999997},"min":{"1min":0.27400000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.59099999999999997,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.48999999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.45000000000000001,"15min":0.45800000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.61799999999999999,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.435,"15min":0.441},"min":{"1min":0.313,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.59899999999999998,"5min":1.101,"15min":1.101},"last":0.47799999999999998}]},{"osd":4,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.80100000000000005,"15min":0.88500000000000001},"min":{"1min":0.44700000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.97299999999999998,"5min":6.8979999999999997,"15min":6.8979999999999997},"last":0.755},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.65700000000000003,"15min":0.66500000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.80000000000000004}]},{"osd":5,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.622,"15min":0.628},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.05,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.80800000000000005,"15min":0.89200000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.087,"5min":6.9480000000000004,"15min":6.9480000000000004},"last":0.68899999999999995}]},{"osd":6,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.65200000000000002,"15min":0.66200000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.80600000000000005,"5min":1.194,"15min":1.194},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.82299999999999995,"15min":0.91700000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.89300000000000002,"5min":6.9800000000000004,"15min":6.9800000000000004},"last":0.72399999999999998}]},{"osd":7,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65700000000000003,"15min":0.66000000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67200000000000004,"15min":0.68500000000000005},"min":{"1min":0.48699999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.91200000000000003,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.70399999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32428,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339412,"statfs":{"total":96636764160,"available":96603557888,"internally_reserved":0,"allocated":1277952,"data_stored":873155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.35399999999999998,"15min":0.372},"min":{"1min":0.23400000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.42399999999999999,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.70499999999999996,"15min":0.86099999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.42099999999999999,"5min":11.987,"15min":11.987},"last":0.28499999999999998}]},{"osd":2,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.41099999999999998,"15min":0.437},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.432,"5min":1.607,"15min":1.607},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.40200000000000002,"15min":0.41399999999999998},"min":{"1min":0.27700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.54300000000000004,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.35299999999999998}]},{"osd":3,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.38100000000000001,"15min":0.38900000000000001},"min":{"1min":0.27800000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.497,"5min":0.752,"15min":0.752},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.45400000000000001,"15min":0.47399999999999998},"min":{"1min":0.32500000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.51500000000000001,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.41099999999999998}]},{"osd":4,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.64100000000000001,"15min":0.65800000000000003},"min":{"1min":0.432,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.753,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.81599999999999995,"15min":0.90600000000000003},"min":{"1min":0.42999999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.75700000000000001,"5min":6.5279999999999996,"15min":6.5279999999999996},"last":0.57399999999999995}]},{"osd":5,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.64200000000000002,"15min":0.65400000000000003},"min":{"1min":0.46400000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.77100000000000002,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.68000000000000005,"15min":0.69899999999999995},"min":{"1min":0.51700000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.81799999999999995,"5min":1.508,"15min":1.508},"last":0.56299999999999994}]},{"osd":6,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.84999999999999998,"15min":0.94299999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.79400000000000004,"5min":6.5419999999999998,"15min":6.5419999999999998},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.66000000000000003,"15min":0.68000000000000005},"min":{"1min":0.48299999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.755,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.59499999999999997}]},{"osd":7,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.68400000000000005,"15min":0.70399999999999996},"min":{"1min":0.48399999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.74299999999999999,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.65500000000000003,"15min":0.66700000000000004},"min":{"1min":0.44800000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.82299999999999995,"5min":1.155,"15min":1.155},"last":0.66300000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574897,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31856,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":684032,"data_stored":282787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:14:36 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.34000000000000002,"15min":0.34599999999999997},"min":{"1min":0.24199999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.39500000000000002,"15min":0.39900000000000002},"min":{"1min":0.32100000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.49099999999999999,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.39100000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:14:36 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34399999999999997,"15min":0.34799999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.373,"15min":0.376},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.57199999999999995,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.33800000000000002}]},{"osd":3,"last update":"Sun Nov 26 07:14:36 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.40200000000000002,"15min":0.41299999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.51000000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.377,"15min":0.38300000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.52500000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.378}]},{"osd":4,"last update":"Sun Nov 26 07:14:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.73999999999999999,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.57599999999999996,"15min":0.57799999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.49099999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:14:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57299999999999995,"15min":0.57399999999999995},"min":{"1min":0.39500000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.621,"15min":0.63300000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.86299999999999999,"5min":1.002,"15min":1.002},"last":0.54000000000000004}]},{"osd":6,"last update":"Sun Nov 26 07:14:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.60699999999999998,"15min":0.61099999999999999},"min":{"1min":0.42199999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77500000000000002,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.628,"15min":0.63400000000000001},"min":{"1min":0.45600000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.83099999999999996,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.52600000000000002}]},{"osd":7,"last update":"Sun Nov 26 07:14:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.62,"15min":0.629},"min":{"1min":0.41999999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.76700000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.621,"15min":0.623},"min":{"1min":0.47399999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.85199999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.51300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574897,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31848,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339992,"statfs":{"total":96636764160,"available":96604151808,"internally_reserved":0,"allocated":684032,"data_stored":282787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:14:33 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.35199999999999998,"15min":0.36899999999999999},"min":{"1min":0.23400000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.48499999999999999,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.40200000000000002,"15min":0.42199999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.52900000000000003,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.26500000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:14:33 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.38600000000000001,"15min":0.40699999999999997},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.47799999999999998,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.46600000000000003,"15min":0.50900000000000001},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.55100000000000005,"5min":2.903,"15min":2.903},"last":0.42499999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:14:33 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.39600000000000002,"15min":0.40500000000000003},"min":{"1min":0.28100000000000003,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.503,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.313},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.40600000000000003,"15min":0.41799999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.53900000000000003,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.32600000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:14:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.67300000000000004,"15min":0.71299999999999997},"min":{"1min":0.41399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80900000000000005,"5min":2.9609999999999999,"15min":2.9609999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.629,"15min":0.64300000000000002},"min":{"1min":0.40600000000000003,"5min":0.373,"15min":0.373},"max":{"1min":0.79400000000000004,"5min":1.163,"15min":1.163},"last":0.437}]},{"osd":5,"last update":"Sun Nov 26 07:14:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66200000000000003,"15min":0.67600000000000005},"min":{"1min":0.42599999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.496},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.64900000000000002,"15min":0.66700000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.871,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.51900000000000002}]},{"osd":6,"last update":"Sun Nov 26 07:14:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.65000000000000002,"15min":0.67300000000000004},"min":{"1min":0.45500000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.83499999999999996,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.66000000000000003,"15min":0.68200000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.76400000000000001,"5min":1.258,"15min":1.258},"last":0.44900000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:14:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.66000000000000003,"15min":0.68500000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.82199999999999995,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.72399999999999998,"15min":0.76100000000000001},"min":{"1min":0.48599999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0780000000000001,"5min":2.9969999999999999,"15min":2.9969999999999999},"last":0.505}]}]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31856,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":684032,"data_stored":282787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.82299999999999995,"15min":0.94099999999999995},"min":{"1min":0.39700000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.70199999999999996,"5min":8.7539999999999996,"15min":8.7539999999999996},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.84599999999999997,"15min":0.95999999999999996},"min":{"1min":0.40500000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.88200000000000001,"5min":8.7390000000000008,"15min":8.7390000000000008},"last":0.64900000000000002}]},{"osd":1,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.86299999999999999,"15min":0.99399999999999999},"min":{"1min":0.40999999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.77400000000000002,"5min":9.7720000000000002,"15min":9.7720000000000002},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.34699999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.80000000000000004,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.45800000000000002}]},{"osd":2,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.83199999999999996,"15min":0.94799999999999995},"min":{"1min":0.42999999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.73199999999999998,"5min":9.8119999999999994,"15min":9.8119999999999994},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.76800000000000002,"15min":0.84399999999999997},"min":{"1min":0.38800000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78700000000000003,"5min":3.645,"15min":3.645},"last":0.48699999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.874,"15min":0.98999999999999999},"min":{"1min":0.436,"5min":0.434,"15min":0.434},"max":{"1min":0.76500000000000001,"5min":8.8089999999999993,"15min":8.8089999999999993},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.77400000000000002,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.58499999999999996}]},{"osd":5,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.51400000000000001,"15min":0.502},"min":{"1min":0.32700000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.55800000000000005,"15min":0.55300000000000005},"min":{"1min":0.39800000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.60999999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58799999999999997,"15min":0.58099999999999996},"min":{"1min":0.48099999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56799999999999995,"15min":0.57399999999999995},"min":{"1min":0.34899999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.74399999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.74299999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59499999999999997,"15min":0.59399999999999997},"min":{"1min":0.41899999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.81100000000000005,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.60499999999999998,"15min":0.60399999999999998},"min":{"1min":0.40200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.91000000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":282787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.56399999999999995,"15min":0.53200000000000003},"min":{"1min":0.36099999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":7.1500000000000004,"5min":7.1500000000000004,"15min":7.1500000000000004},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.59899999999999998,"15min":0.57299999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":6.8470000000000004,"5min":6.8470000000000004,"15min":6.8470000000000004},"last":0.57599999999999996}]},{"osd":1,"last update":"Sun Nov 26 07:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.58799999999999997,"15min":0.55600000000000005},"min":{"1min":0.372,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":7.1269999999999998,"5min":7.1269999999999998,"15min":7.1269999999999998},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.34499999999999997,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.64000000000000001}]},{"osd":2,"last update":"Sun Nov 26 07:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.629,"15min":0.59299999999999997},"min":{"1min":0.40100000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":7.2000000000000002,"5min":7.2000000000000002,"15min":7.2000000000000002},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.65400000000000003,"15min":0.61799999999999999},"min":{"1min":0.46100000000000002,"5min":0.379,"15min":0.379},"max":{"1min":7.8259999999999996,"5min":7.8259999999999996,"15min":7.8259999999999996},"last":0.628}]},{"osd":3,"last update":"Sun Nov 26 07:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.57399999999999995,"15min":0.56299999999999994},"min":{"1min":0.39000000000000001,"5min":0.372,"15min":0.372},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.879,"5min":0.64200000000000002,"15min":0.60499999999999998},"min":{"1min":0.40200000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":6.9240000000000004,"5min":6.9240000000000004,"15min":6.9240000000000004},"last":0.42599999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.55400000000000005,"15min":0.51000000000000001},"min":{"1min":0.36399999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":7.2830000000000004,"5min":7.2830000000000004,"15min":7.2830000000000004},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.57999999999999996,"15min":0.57499999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.40500000000000003}]},{"osd":6,"last update":"Sun Nov 26 07:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.61799999999999999,"15min":0.57099999999999995},"min":{"1min":0.35599999999999998,"5min":0.308,"15min":0.308},"max":{"1min":6.8890000000000002,"5min":6.8890000000000002,"15min":6.8890000000000002},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.63,"15min":0.58899999999999997},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":7.2430000000000003,"5min":7.2430000000000003,"15min":7.2430000000000003},"last":0.58599999999999997}]},{"osd":7,"last update":"Sun Nov 26 07:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.64900000000000002,"15min":0.60599999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":6.9880000000000004,"5min":6.9880000000000004,"15min":6.9880000000000004},"last":0.53000000000000003},{"interface":"front","average":{"1min":1.1519999999999999,"5min":0.72799999999999998,"15min":0.65700000000000003},"min":{"1min":0.44800000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":11.874000000000001,"5min":11.874000000000001,"15min":11.874000000000001},"last":0.38}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:15:17.459 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:15:17.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.618+0000 7feb93a77700 1 Processor -- start 2023-11-26T07:15:17.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.618+0000 7feb93a77700 1 -- start start 2023-11-26T07:15:17.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.619+0000 7feb93a77700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7feb8c06b6e0 0x7feb8c06db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:17.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.619+0000 7feb93a77700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7feb8c145100 0x7feb8c06e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:17.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.619+0000 7feb93a77700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb8c160720 con 0x7feb8c144c10 2023-11-26T07:15:17.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.619+0000 7feb93a77700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb8c06f500 con 0x7feb8c06b6e0 2023-11-26T07:15:17.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.619+0000 7feb93a77700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb8c0cd610 con 0x7feb8c145100 2023-11-26T07:15:17.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.619+0000 7feb91012700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7feb8c06b6e0 0x7feb8c06db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:17.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.619+0000 7feb91012700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7feb8c06b6e0 0x7feb8c06db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43140/0 (socket says 172.21.15.2:43140) 2023-11-26T07:15:17.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.619+0000 7feb91012700 1 -- 172.21.15.2:0/3154465473 learned_addr learned my addr 172.21.15.2:0/3154465473 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:17.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.619+0000 7feb92014700 1 --2- 172.21.15.2:0/3154465473 >> v2:172.21.15.192:3300/0 conn(0x7feb8c145100 0x7feb8c06e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:17.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.619+0000 7feb91012700 1 -- 172.21.15.2:0/3154465473 >> v2:172.21.15.192:3300/0 conn(0x7feb8c145100 msgr2=0x7feb8c06e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:17.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.619+0000 7feb91012700 1 --2- 172.21.15.2:0/3154465473 >> v2:172.21.15.192:3300/0 conn(0x7feb8c145100 0x7feb8c06e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:17.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.619+0000 7feb91012700 1 -- 172.21.15.2:0/3154465473 >> v1:172.21.15.192:6789/0 conn(0x7feb8c144c10 legacy=0x7feb8c06afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:17.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.619+0000 7feb91012700 1 -- 172.21.15.2:0/3154465473 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8c06f710 con 0x7feb8c06b6e0 2023-11-26T07:15:17.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.619+0000 7feb91012700 1 --2- 172.21.15.2:0/3154465473 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb8c06b6e0 0x7feb8c06db70 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7feb8c15c410 tx=0x7feb7c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9789f78567b8dc5 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:17.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.619+0000 7feb90811700 1 -- 172.21.15.2:0/3154465473 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c004230 con 0x7feb8c06b6e0 2023-11-26T07:15:17.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.619+0000 7feb90811700 1 -- 172.21.15.2:0/3154465473 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7c004390 con 0x7feb8c06b6e0 2023-11-26T07:15:17.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.619+0000 7feb90811700 1 -- 172.21.15.2:0/3154465473 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c0036a0 con 0x7feb8c06b6e0 2023-11-26T07:15:17.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.620+0000 7feb93a77700 1 -- 172.21.15.2:0/3154465473 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb8c06b6e0 msgr2=0x7feb8c06db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:17.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.620+0000 7feb93a77700 1 --2- 172.21.15.2:0/3154465473 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb8c06b6e0 0x7feb8c06db70 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7feb8c15c410 tx=0x7feb7c009bd0 comp rx=0 tx=0).stop 2023-11-26T07:15:17.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.620+0000 7feb93a77700 1 -- 172.21.15.2:0/3154465473 shutdown_connections 2023-11-26T07:15:17.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.620+0000 7feb93a77700 1 --2- 172.21.15.2:0/3154465473 >> v2:172.21.15.192:3300/0 conn(0x7feb8c145100 0x7feb8c06e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:17.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.620+0000 7feb93a77700 1 --2- 172.21.15.2:0/3154465473 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb8c06b6e0 0x7feb8c06db70 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:17.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.620+0000 7feb93a77700 1 -- 172.21.15.2:0/3154465473 >> 172.21.15.2:0/3154465473 conn(0x7feb8c0b2740 msgr2=0x7feb8c0b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:17.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.620+0000 7feb93a77700 1 -- 172.21.15.2:0/3154465473 shutdown_connections 2023-11-26T07:15:17.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.620+0000 7feb93a77700 1 -- 172.21.15.2:0/3154465473 wait complete. 2023-11-26T07:15:17.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.621+0000 7feb93a77700 1 Processor -- start 2023-11-26T07:15:17.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.621+0000 7feb93a77700 1 -- start start 2023-11-26T07:15:17.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.622+0000 7feb93a77700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb8c06b6e0 0x7feb8c15b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:17.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.622+0000 7feb93a77700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb8c144c10 0x7feb8c1f5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:17.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.622+0000 7feb93a77700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb8c145100 0x7feb8c1f1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:17.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.622+0000 7feb93a77700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8c1f28e0 con 0x7feb8c06b6e0 2023-11-26T07:15:17.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.622+0000 7feb93a77700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8c1f2320 con 0x7feb8c144c10 2023-11-26T07:15:17.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.622+0000 7feb93a77700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb8c1f2600 con 0x7feb8c145100 2023-11-26T07:15:17.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.622+0000 7feb91813700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb8c06b6e0 0x7feb8c15b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:17.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.622+0000 7feb91813700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb8c06b6e0 0x7feb8c15b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43144/0 (socket says 172.21.15.2:43144) 2023-11-26T07:15:17.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.622+0000 7feb91813700 1 -- 172.21.15.2:0/3795922912 learned_addr learned my addr 172.21.15.2:0/3795922912 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:17.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.622+0000 7feb92014700 1 --2- 172.21.15.2:0/3795922912 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb8c145100 0x7feb8c1f1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:17.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.622+0000 7feb91813700 1 -- 172.21.15.2:0/3795922912 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb8c145100 msgr2=0x7feb8c1f1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:17.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.622+0000 7feb91012700 1 --2- 172.21.15.2:0/3795922912 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb8c144c10 0x7feb8c1f5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:17.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.622+0000 7feb91813700 1 --2- 172.21.15.2:0/3795922912 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb8c145100 0x7feb8c1f1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:17.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.622+0000 7feb91813700 1 -- 172.21.15.2:0/3795922912 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb8c144c10 msgr2=0x7feb8c1f5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:17.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.622+0000 7feb91813700 1 --2- 172.21.15.2:0/3795922912 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb8c144c10 0x7feb8c1f5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:17.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.622+0000 7feb91813700 1 -- 172.21.15.2:0/3795922912 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb7c009550 con 0x7feb8c06b6e0 2023-11-26T07:15:17.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.622+0000 7feb92014700 1 --2- 172.21.15.2:0/3795922912 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb8c145100 0x7feb8c1f1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:15:17.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.622+0000 7feb91012700 1 --2- 172.21.15.2:0/3795922912 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb8c144c10 0x7feb8c1f5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:15:17.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.623+0000 7feb91813700 1 --2- 172.21.15.2:0/3795922912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb8c06b6e0 0x7feb8c15b630 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7feb8800c4d0 tx=0x7feb8800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:17.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.623+0000 7feb827fc700 1 -- 172.21.15.2:0/3795922912 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb88011790 con 0x7feb8c06b6e0 2023-11-26T07:15:17.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.623+0000 7feb827fc700 1 -- 172.21.15.2:0/3795922912 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb880118f0 con 0x7feb8c06b6e0 2023-11-26T07:15:17.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.623+0000 7feb93a77700 1 -- 172.21.15.2:0/3795922912 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb8c1f5040 con 0x7feb8c06b6e0 2023-11-26T07:15:17.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.623+0000 7feb827fc700 1 -- 172.21.15.2:0/3795922912 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb88011ca0 con 0x7feb8c06b6e0 2023-11-26T07:15:17.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.623+0000 7feb93a77700 1 -- 172.21.15.2:0/3795922912 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb8c1f5d80 con 0x7feb8c06b6e0 2023-11-26T07:15:17.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.624+0000 7feb93a77700 1 -- 172.21.15.2:0/3795922912 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb8c1f5560 con 0x7feb8c06b6e0 2023-11-26T07:15:17.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.624+0000 7feb827fc700 1 -- 172.21.15.2:0/3795922912 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7feb8801c460 con 0x7feb8c06b6e0 2023-11-26T07:15:17.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.625+0000 7feb827fc700 1 --2- 172.21.15.2:0/3795922912 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7feb7006b470 0x7feb7006d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:17.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.625+0000 7feb827fc700 1 -- 172.21.15.2:0/3795922912 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feb88089f10 con 0x7feb8c06b6e0 2023-11-26T07:15:17.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.625+0000 7feb91012700 1 --2- 172.21.15.2:0/3795922912 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7feb7006b470 0x7feb7006d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:17.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.625+0000 7feb91012700 1 --2- 172.21.15.2:0/3795922912 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7feb7006b470 0x7feb7006d930 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7feb8c0c7aa0 tx=0x7feb7c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:17.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.629+0000 7feb827fc700 1 -- 172.21.15.2:0/3795922912 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7feb8c1f5560 con 0x7feb8c06b6e0 2023-11-26T07:15:17.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.826+0000 7feb93a77700 1 -- 172.21.15.2:0/3795922912 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feb8c1603b0 con 0x7feb7006b470 2023-11-26T07:15:17.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.834+0000 7feb827fc700 1 -- 172.21.15.2:0/3795922912 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277111 (secure 0 0 0) 0x7feb7c020070 con 0x7feb7006b470 2023-11-26T07:15:17.839 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:15:17.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.838+0000 7feb93a77700 1 -- 172.21.15.2:0/3795922912 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7feb7006b470 msgr2=0x7feb7006d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:17.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.838+0000 7feb93a77700 1 --2- 172.21.15.2:0/3795922912 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7feb7006b470 0x7feb7006d930 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7feb8c0c7aa0 tx=0x7feb7c008030 comp rx=0 tx=0).stop 2023-11-26T07:15:17.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.838+0000 7feb93a77700 1 -- 172.21.15.2:0/3795922912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb8c06b6e0 msgr2=0x7feb8c15b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:17.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.838+0000 7feb93a77700 1 --2- 172.21.15.2:0/3795922912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb8c06b6e0 0x7feb8c15b630 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7feb8800c4d0 tx=0x7feb8800c890 comp rx=0 tx=0).stop 2023-11-26T07:15:17.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.838+0000 7feb93a77700 1 -- 172.21.15.2:0/3795922912 shutdown_connections 2023-11-26T07:15:17.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.838+0000 7feb93a77700 1 --2- 172.21.15.2:0/3795922912 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7feb7006b470 0x7feb7006d930 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:17.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.838+0000 7feb93a77700 1 --2- 172.21.15.2:0/3795922912 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb8c145100 0x7feb8c1f1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:17.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.838+0000 7feb93a77700 1 --2- 172.21.15.2:0/3795922912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb8c06b6e0 0x7feb8c15b630 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:17.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.838+0000 7feb93a77700 1 --2- 172.21.15.2:0/3795922912 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb8c144c10 0x7feb8c1f5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:17.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.838+0000 7feb93a77700 1 -- 172.21.15.2:0/3795922912 >> 172.21.15.2:0/3795922912 conn(0x7feb8c0b2740 msgr2=0x7feb8c0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:17.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.838+0000 7feb93a77700 1 -- 172.21.15.2:0/3795922912 shutdown_connections 2023-11-26T07:15:17.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:17.838+0000 7feb93a77700 1 -- 172.21.15.2:0/3795922912 wait complete. 2023-11-26T07:15:17.842 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-26T07:15:17.852 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":168,"stamp":"2023-11-26T07:15:16.209173+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":243480,"kb_used_data":6504,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754731240,"statfs":{"total":773094113280,"available":772844789760,"internally_reserved":0,"allocated":6660096,"data_stored":3443032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.929183"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.283823+0000","last_change":"2023-11-26T07:15:11.283823+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.283823+0000","last_undegraded":"2023-11-26T07:15:11.283823+0000","last_fullsized":"2023-11-26T07:15:11.283823+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.286333+0000","last_change":"2023-11-26T07:15:11.286333+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.286333+0000","last_undegraded":"2023-11-26T07:15:11.286333+0000","last_fullsized":"2023-11-26T07:15:11.286333+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.283770+0000","last_change":"2023-11-26T07:15:11.283770+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.283770+0000","last_undegraded":"2023-11-26T07:15:11.283770+0000","last_fullsized":"2023-11-26T07:15:11.283770+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.287402+0000","last_change":"2023-11-26T07:15:11.287402+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.287402+0000","last_undegraded":"2023-11-26T07:15:11.287402+0000","last_fullsized":"2023-11-26T07:15:11.287402+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.284915+0000","last_change":"2023-11-26T07:15:11.284915+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.284915+0000","last_undegraded":"2023-11-26T07:15:11.284915+0000","last_fullsized":"2023-11-26T07:15:11.284915+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.284109+0000","last_change":"2023-11-26T07:15:11.284109+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.284109+0000","last_undegraded":"2023-11-26T07:15:11.284109+0000","last_fullsized":"2023-11-26T07:15:11.284109+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.286778+0000","last_change":"2023-11-26T07:15:11.286778+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.286778+0000","last_undegraded":"2023-11-26T07:15:11.286778+0000","last_fullsized":"2023-11-26T07:15:11.286778+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.285330+0000","last_change":"2023-11-26T07:15:11.285330+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.285330+0000","last_undegraded":"2023-11-26T07:15:11.285330+0000","last_fullsized":"2023-11-26T07:15:11.285330+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.284133+0000","last_change":"2023-11-26T07:15:11.284133+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.284133+0000","last_undegraded":"2023-11-26T07:15:11.284133+0000","last_fullsized":"2023-11-26T07:15:11.284133+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.285488+0000","last_change":"2023-11-26T07:15:11.285488+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.285488+0000","last_undegraded":"2023-11-26T07:15:11.285488+0000","last_fullsized":"2023-11-26T07:15:11.285488+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.284120+0000","last_change":"2023-11-26T07:15:11.284120+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.284120+0000","last_undegraded":"2023-11-26T07:15:11.284120+0000","last_fullsized":"2023-11-26T07:15:11.284120+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.284992+0000","last_change":"2023-11-26T07:15:11.284992+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.284992+0000","last_undegraded":"2023-11-26T07:15:11.284992+0000","last_fullsized":"2023-11-26T07:15:11.284992+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.285639+0000","last_change":"2023-11-26T07:15:11.285639+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.285639+0000","last_undegraded":"2023-11-26T07:15:11.285639+0000","last_fullsized":"2023-11-26T07:15:11.285639+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.282095+0000","last_change":"2023-11-26T07:15:11.282095+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.282095+0000","last_undegraded":"2023-11-26T07:15:11.282095+0000","last_fullsized":"2023-11-26T07:15:11.282095+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.286316+0000","last_change":"2023-11-26T07:15:11.286316+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.286316+0000","last_undegraded":"2023-11-26T07:15:11.286316+0000","last_fullsized":"2023-11-26T07:15:11.286316+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.284146+0000","last_change":"2023-11-26T07:15:11.284146+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.284146+0000","last_undegraded":"2023-11-26T07:15:11.284146+0000","last_fullsized":"2023-11-26T07:15:11.284146+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.285115+0000","last_change":"2023-11-26T07:15:11.285115+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.285115+0000","last_undegraded":"2023-11-26T07:15:11.285115+0000","last_fullsized":"2023-11-26T07:15:11.285115+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.284266+0000","last_change":"2023-11-26T07:15:11.284266+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.284266+0000","last_undegraded":"2023-11-26T07:15:11.284266+0000","last_fullsized":"2023-11-26T07:15:11.284266+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.286926+0000","last_change":"2023-11-26T07:15:11.286926+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.286926+0000","last_undegraded":"2023-11-26T07:15:11.286926+0000","last_fullsized":"2023-11-26T07:15:11.286926+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.283755+0000","last_change":"2023-11-26T07:15:11.283755+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.283755+0000","last_undegraded":"2023-11-26T07:15:11.283755+0000","last_fullsized":"2023-11-26T07:15:11.283755+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.285007+0000","last_change":"2023-11-26T07:15:11.285007+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.285007+0000","last_undegraded":"2023-11-26T07:15:11.285007+0000","last_fullsized":"2023-11-26T07:15:11.285007+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.282355+0000","last_change":"2023-11-26T07:15:11.282355+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.282355+0000","last_undegraded":"2023-11-26T07:15:11.282355+0000","last_fullsized":"2023-11-26T07:15:11.282355+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.285700+0000","last_change":"2023-11-26T07:15:11.285700+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.285700+0000","last_undegraded":"2023-11-26T07:15:11.285700+0000","last_fullsized":"2023-11-26T07:15:11.285700+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.282195+0000","last_change":"2023-11-26T07:15:11.282195+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.282195+0000","last_undegraded":"2023-11-26T07:15:11.282195+0000","last_fullsized":"2023-11-26T07:15:11.282195+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.283748+0000","last_change":"2023-11-26T07:15:11.283748+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.283748+0000","last_undegraded":"2023-11-26T07:15:11.283748+0000","last_fullsized":"2023-11-26T07:15:11.283748+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.282162+0000","last_change":"2023-11-26T07:15:11.282162+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.282162+0000","last_undegraded":"2023-11-26T07:15:11.282162+0000","last_fullsized":"2023-11-26T07:15:11.282162+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.286991+0000","last_change":"2023-11-26T07:15:11.286991+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.286991+0000","last_undegraded":"2023-11-26T07:15:11.286991+0000","last_fullsized":"2023-11-26T07:15:11.286991+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.282130+0000","last_change":"2023-11-26T07:15:11.282130+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.282130+0000","last_undegraded":"2023-11-26T07:15:11.282130+0000","last_fullsized":"2023-11-26T07:15:11.282130+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.284903+0000","last_change":"2023-11-26T07:15:11.284903+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.284903+0000","last_undegraded":"2023-11-26T07:15:11.284903+0000","last_fullsized":"2023-11-26T07:15:11.284903+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.282122+0000","last_change":"2023-11-26T07:15:11.282122+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.282122+0000","last_undegraded":"2023-11-26T07:15:11.282122+0000","last_fullsized":"2023-11-26T07:15:11.282122+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.284999+0000","last_change":"2023-11-26T07:15:11.284999+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.284999+0000","last_undegraded":"2023-11-26T07:15:11.284999+0000","last_fullsized":"2023-11-26T07:15:11.284999+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-26T07:15:12.279644+0000","last_change":"2023-11-26T07:15:12.279644+0000","last_active":"2023-11-26T07:15:12.279644+0000","last_peered":"2023-11-26T07:15:12.279644+0000","last_clean":"2023-11-26T07:15:12.279644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:12.279644+0000","last_undegraded":"2023-11-26T07:15:12.279644+0000","last_fullsized":"2023-11-26T07:15:12.279644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2023-11-26T07:15:11.282095+0000","last_change":"2023-11-26T07:15:11.282095+0000","last_active":"2023-11-26T07:15:11.278070+0000","last_peered":"2023-11-26T07:15:11.278070+0000","last_clean":"2023-11-26T07:15:11.278070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:15:11.282095+0000","last_undegraded":"2023-11-26T07:15:11.282095+0000","last_fullsized":"2023-11-26T07:15:11.282095+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":196,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-11-26T07:15:09.714992+0000","last_change":"2023-11-26T07:11:29.855919+0000","last_active":"2023-11-26T07:15:09.714992+0000","last_peered":"2023-11-26T07:15:09.714992+0000","last_clean":"2023-11-26T07:15:09.714992+0000","last_became_active":"2023-11-26T07:11:29.854903+0000","last_became_peered":"2023-11-26T07:11:29.854903+0000","last_unstale":"2023-11-26T07:15:09.714992+0000","last_undegraded":"2023-11-26T07:15:09.714992+0000","last_fullsized":"2023-11-26T07:15:09.714992+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:28.594252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:28.594252+0000","last_clean_scrub_stamp":"2023-11-26T07:11:28.594252+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:33:34.642696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574898,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28268,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343572,"statfs":{"total":96636764160,"available":96607817728,"internally_reserved":0,"allocated":1277952,"data_stored":873155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:14:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.35899999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.73699999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51300000000000001,"15min":0.505},"min":{"1min":0.38700000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.65600000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.433}]},{"osd":1,"last update":"Sun Nov 26 07:14:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.84799999999999998,"15min":0.97999999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.71499999999999997,"5min":9.5600000000000005,"15min":9.5600000000000005},"last":0.626},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.56899999999999995,"15min":0.57999999999999996},"min":{"1min":0.41599999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.70199999999999996,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.48599999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:14:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59599999999999997,"15min":0.60199999999999998},"min":{"1min":0.36799999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73299999999999998,"5min":1.569,"15min":1.569},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.63900000000000001,"15min":0.64900000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.85699999999999998,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.50900000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:14:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.59599999999999997,"15min":0.60399999999999998},"min":{"1min":0.42899999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68200000000000005,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.498},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57899999999999996,"15min":0.56699999999999995},"min":{"1min":0.44700000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78500000000000003,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.66400000000000003}]},{"osd":4,"last update":"Sun Nov 26 07:14:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.372,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70399999999999996,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53500000000000003,"15min":0.51500000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.82999999999999996,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.39500000000000002}]},{"osd":5,"last update":"Sun Nov 26 07:14:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.37,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63,"15min":0.63300000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80900000000000005,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.61499999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:14:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59499999999999997,"15min":0.59099999999999997},"min":{"1min":0.437,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60299999999999998,"15min":0.59299999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89100000000000001,"5min":1.552,"15min":1.552},"last":0.47099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":282787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.503,"15min":0.48399999999999999},"min":{"1min":0.311,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.76700000000000002,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.501},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.504,"15min":0.47599999999999998},"min":{"1min":0.38200000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.69899999999999995,"5min":0.871,"15min":0.871},"last":0.51300000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52300000000000002,"15min":0.51100000000000001},"min":{"1min":0.35199999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.73599999999999999,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55000000000000004,"15min":0.54400000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.83599999999999997,"5min":1.198,"15min":1.198},"last":0.56899999999999995}]},{"osd":2,"last update":"Sun Nov 26 07:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51600000000000001,"15min":0.495},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.71899999999999997,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.435},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.54800000000000004,"15min":0.52300000000000002},"min":{"1min":0.437,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.59999999999999998}]},{"osd":3,"last update":"Sun Nov 26 07:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.57499999999999996,"15min":0.55100000000000005},"min":{"1min":0.435,"5min":0.373,"15min":0.373},"max":{"1min":0.81999999999999995,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.60099999999999998,"15min":0.58299999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79100000000000004,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.58699999999999997}]},{"osd":4,"last update":"Sun Nov 26 07:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.52800000000000002,"15min":0.53200000000000003},"min":{"1min":0.33600000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70599999999999996,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.34100000000000003,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.78900000000000003,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.61699999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56399999999999995,"15min":0.56000000000000005},"min":{"1min":0.40200000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.71599999999999997,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58399999999999996,"15min":0.58799999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77300000000000002,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.46700000000000003}]},{"osd":7,"last update":"Sun Nov 26 07:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59299999999999997,"15min":0.59099999999999997},"min":{"1min":0.42799999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73899999999999999,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.628,"15min":0.626},"min":{"1min":0.45800000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.75700000000000001,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.67900000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31848,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339992,"statfs":{"total":96636764160,"available":96604151808,"internally_reserved":0,"allocated":684032,"data_stored":282787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.35499999999999998,"15min":0.36399999999999999},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.437},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.68400000000000005,"15min":0.83399999999999996},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.496,"5min":11.922000000000001,"15min":11.922000000000001},"last":0.378}]},{"osd":2,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.36199999999999999,"15min":0.373},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.52600000000000002,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.40200000000000002,"15min":0.40799999999999997},"min":{"1min":0.27400000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.59099999999999997,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.48999999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.45000000000000001,"15min":0.45800000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.61799999999999999,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.435,"15min":0.441},"min":{"1min":0.313,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.59899999999999998,"5min":1.101,"15min":1.101},"last":0.47799999999999998}]},{"osd":4,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.80100000000000005,"15min":0.88500000000000001},"min":{"1min":0.44700000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.97299999999999998,"5min":6.8979999999999997,"15min":6.8979999999999997},"last":0.755},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.65700000000000003,"15min":0.66500000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.80000000000000004}]},{"osd":5,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.622,"15min":0.628},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.05,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.80800000000000005,"15min":0.89200000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.087,"5min":6.9480000000000004,"15min":6.9480000000000004},"last":0.68899999999999995}]},{"osd":6,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.65200000000000002,"15min":0.66200000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.80600000000000005,"5min":1.194,"15min":1.194},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.82299999999999995,"15min":0.91700000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.89300000000000002,"5min":6.9800000000000004,"15min":6.9800000000000004},"last":0.72399999999999998}]},{"osd":7,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65700000000000003,"15min":0.66000000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67200000000000004,"15min":0.68500000000000005},"min":{"1min":0.48699999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.91200000000000003,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.70399999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32428,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339412,"statfs":{"total":96636764160,"available":96603557888,"internally_reserved":0,"allocated":1277952,"data_stored":873155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.35399999999999998,"15min":0.372},"min":{"1min":0.23400000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.42399999999999999,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.70499999999999996,"15min":0.86099999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.42099999999999999,"5min":11.987,"15min":11.987},"last":0.28499999999999998}]},{"osd":2,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.41099999999999998,"15min":0.437},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.432,"5min":1.607,"15min":1.607},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.40200000000000002,"15min":0.41399999999999998},"min":{"1min":0.27700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.54300000000000004,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.35299999999999998}]},{"osd":3,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.38100000000000001,"15min":0.38900000000000001},"min":{"1min":0.27800000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.497,"5min":0.752,"15min":0.752},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.45400000000000001,"15min":0.47399999999999998},"min":{"1min":0.32500000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.51500000000000001,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.41099999999999998}]},{"osd":4,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.64100000000000001,"15min":0.65800000000000003},"min":{"1min":0.432,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.753,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.81599999999999995,"15min":0.90600000000000003},"min":{"1min":0.42999999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.75700000000000001,"5min":6.5279999999999996,"15min":6.5279999999999996},"last":0.57399999999999995}]},{"osd":5,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.64200000000000002,"15min":0.65400000000000003},"min":{"1min":0.46400000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.77100000000000002,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.68000000000000005,"15min":0.69899999999999995},"min":{"1min":0.51700000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.81799999999999995,"5min":1.508,"15min":1.508},"last":0.56299999999999994}]},{"osd":6,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.84999999999999998,"15min":0.94299999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.79400000000000004,"5min":6.5419999999999998,"15min":6.5419999999999998},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.66000000000000003,"15min":0.68000000000000005},"min":{"1min":0.48299999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.755,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.59499999999999997}]},{"osd":7,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.68400000000000005,"15min":0.70399999999999996},"min":{"1min":0.48399999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.74299999999999999,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.65500000000000003,"15min":0.66700000000000004},"min":{"1min":0.44800000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.82299999999999995,"5min":1.155,"15min":1.155},"last":0.66300000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574897,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31856,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":684032,"data_stored":282787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:14:36 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.34000000000000002,"15min":0.34599999999999997},"min":{"1min":0.24199999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.39500000000000002,"15min":0.39900000000000002},"min":{"1min":0.32100000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.49099999999999999,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.39100000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:14:36 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34399999999999997,"15min":0.34799999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.373,"15min":0.376},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.57199999999999995,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.33800000000000002}]},{"osd":3,"last update":"Sun Nov 26 07:14:36 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.40200000000000002,"15min":0.41299999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.51000000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.377,"15min":0.38300000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.52500000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.378}]},{"osd":4,"last update":"Sun Nov 26 07:14:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.73999999999999999,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.57599999999999996,"15min":0.57799999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.49099999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:14:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57299999999999995,"15min":0.57399999999999995},"min":{"1min":0.39500000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.621,"15min":0.63300000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.86299999999999999,"5min":1.002,"15min":1.002},"last":0.54000000000000004}]},{"osd":6,"last update":"Sun Nov 26 07:14:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.60699999999999998,"15min":0.61099999999999999},"min":{"1min":0.42199999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77500000000000002,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.628,"15min":0.63400000000000001},"min":{"1min":0.45600000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.83099999999999996,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.52600000000000002}]},{"osd":7,"last update":"Sun Nov 26 07:14:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.62,"15min":0.629},"min":{"1min":0.41999999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.76700000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.621,"15min":0.623},"min":{"1min":0.47399999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.85199999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.51300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574897,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31848,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339992,"statfs":{"total":96636764160,"available":96604151808,"internally_reserved":0,"allocated":684032,"data_stored":282787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:14:33 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.35199999999999998,"15min":0.36899999999999999},"min":{"1min":0.23400000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.48499999999999999,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.40200000000000002,"15min":0.42199999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.52900000000000003,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.26500000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:14:33 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.38600000000000001,"15min":0.40699999999999997},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.47799999999999998,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.46600000000000003,"15min":0.50900000000000001},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.55100000000000005,"5min":2.903,"15min":2.903},"last":0.42499999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:14:33 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.39600000000000002,"15min":0.40500000000000003},"min":{"1min":0.28100000000000003,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.503,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.313},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.40600000000000003,"15min":0.41799999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.53900000000000003,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.32600000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:14:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.67300000000000004,"15min":0.71299999999999997},"min":{"1min":0.41399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80900000000000005,"5min":2.9609999999999999,"15min":2.9609999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.629,"15min":0.64300000000000002},"min":{"1min":0.40600000000000003,"5min":0.373,"15min":0.373},"max":{"1min":0.79400000000000004,"5min":1.163,"15min":1.163},"last":0.437}]},{"osd":5,"last update":"Sun Nov 26 07:14:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66200000000000003,"15min":0.67600000000000005},"min":{"1min":0.42599999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.496},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.64900000000000002,"15min":0.66700000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.871,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.51900000000000002}]},{"osd":6,"last update":"Sun Nov 26 07:14:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.65000000000000002,"15min":0.67300000000000004},"min":{"1min":0.45500000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.83499999999999996,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.66000000000000003,"15min":0.68200000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.76400000000000001,"5min":1.258,"15min":1.258},"last":0.44900000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:14:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.66000000000000003,"15min":0.68500000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.82199999999999995,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.72399999999999998,"15min":0.76100000000000001},"min":{"1min":0.48599999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0780000000000001,"5min":2.9969999999999999,"15min":2.9969999999999999},"last":0.505}]}]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31856,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":684032,"data_stored":282787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.82299999999999995,"15min":0.94099999999999995},"min":{"1min":0.39700000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.70199999999999996,"5min":8.7539999999999996,"15min":8.7539999999999996},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.84599999999999997,"15min":0.95999999999999996},"min":{"1min":0.40500000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.88200000000000001,"5min":8.7390000000000008,"15min":8.7390000000000008},"last":0.64900000000000002}]},{"osd":1,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.86299999999999999,"15min":0.99399999999999999},"min":{"1min":0.40999999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.77400000000000002,"5min":9.7720000000000002,"15min":9.7720000000000002},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.34699999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.80000000000000004,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.45800000000000002}]},{"osd":2,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.83199999999999996,"15min":0.94799999999999995},"min":{"1min":0.42999999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.73199999999999998,"5min":9.8119999999999994,"15min":9.8119999999999994},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.76800000000000002,"15min":0.84399999999999997},"min":{"1min":0.38800000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78700000000000003,"5min":3.645,"15min":3.645},"last":0.48699999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.874,"15min":0.98999999999999999},"min":{"1min":0.436,"5min":0.434,"15min":0.434},"max":{"1min":0.76500000000000001,"5min":8.8089999999999993,"15min":8.8089999999999993},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.77400000000000002,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.58499999999999996}]},{"osd":5,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.51400000000000001,"15min":0.502},"min":{"1min":0.32700000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.55800000000000005,"15min":0.55300000000000005},"min":{"1min":0.39800000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.60999999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58799999999999997,"15min":0.58099999999999996},"min":{"1min":0.48099999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56799999999999995,"15min":0.57399999999999995},"min":{"1min":0.34899999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.74399999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.74299999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59499999999999997,"15min":0.59399999999999997},"min":{"1min":0.41899999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.81100000000000005,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.60499999999999998,"15min":0.60399999999999998},"min":{"1min":0.40200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.91000000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":282787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.56399999999999995,"15min":0.53200000000000003},"min":{"1min":0.36099999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":7.1500000000000004,"5min":7.1500000000000004,"15min":7.1500000000000004},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.59899999999999998,"15min":0.57299999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":6.8470000000000004,"5min":6.8470000000000004,"15min":6.8470000000000004},"last":0.57599999999999996}]},{"osd":1,"last update":"Sun Nov 26 07:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.58799999999999997,"15min":0.55600000000000005},"min":{"1min":0.372,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":7.1269999999999998,"5min":7.1269999999999998,"15min":7.1269999999999998},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.34499999999999997,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.64000000000000001}]},{"osd":2,"last update":"Sun Nov 26 07:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.629,"15min":0.59299999999999997},"min":{"1min":0.40100000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":7.2000000000000002,"5min":7.2000000000000002,"15min":7.2000000000000002},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.65400000000000003,"15min":0.61799999999999999},"min":{"1min":0.46100000000000002,"5min":0.379,"15min":0.379},"max":{"1min":7.8259999999999996,"5min":7.8259999999999996,"15min":7.8259999999999996},"last":0.628}]},{"osd":3,"last update":"Sun Nov 26 07:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.57399999999999995,"15min":0.56299999999999994},"min":{"1min":0.39000000000000001,"5min":0.372,"15min":0.372},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.879,"5min":0.64200000000000002,"15min":0.60499999999999998},"min":{"1min":0.40200000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":6.9240000000000004,"5min":6.9240000000000004,"15min":6.9240000000000004},"last":0.42599999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.55400000000000005,"15min":0.51000000000000001},"min":{"1min":0.36399999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":7.2830000000000004,"5min":7.2830000000000004,"15min":7.2830000000000004},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.57999999999999996,"15min":0.57499999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.40500000000000003}]},{"osd":6,"last update":"Sun Nov 26 07:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.61799999999999999,"15min":0.57099999999999995},"min":{"1min":0.35599999999999998,"5min":0.308,"15min":0.308},"max":{"1min":6.8890000000000002,"5min":6.8890000000000002,"15min":6.8890000000000002},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.63,"15min":0.58899999999999997},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":7.2430000000000003,"5min":7.2430000000000003,"15min":7.2430000000000003},"last":0.58599999999999997}]},{"osd":7,"last update":"Sun Nov 26 07:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.64900000000000002,"15min":0.60599999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":6.9880000000000004,"5min":6.9880000000000004,"15min":6.9880000000000004},"last":0.53000000000000003},{"interface":"front","average":{"1min":1.1519999999999999,"5min":0.72799999999999998,"15min":0.65700000000000003},"min":{"1min":0.44800000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":11.874000000000001,"5min":11.874000000000001,"15min":11.874000000000001},"last":0.38}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:15:17.856 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:15:18.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.015+0000 7f134ad27700 1 Processor -- start 2023-11-26T07:15:18.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.015+0000 7f134ad27700 1 -- start start 2023-11-26T07:15:18.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.016+0000 7f134ad27700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f134406b620 0x7f13440b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:18.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.016+0000 7f134ad27700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f13440b5ab0 0x7f13440b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:18.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.016+0000 7f134ad27700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f13441478c0 0x7f1344161ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:18.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.016+0000 7f134ad27700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1344071f50 con 0x7f13441478c0 2023-11-26T07:15:18.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.016+0000 7f134ad27700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1344072230 con 0x7f134406b620 2023-11-26T07:15:18.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.016+0000 7f134ad27700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1344072510 con 0x7f13440b5ab0 2023-11-26T07:15:18.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.016+0000 7f13492c4700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f13441478c0 0x7f1344161ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:18.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.016+0000 7f13492c4700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f13441478c0 0x7f1344161ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43156/0 (socket says 172.21.15.2:43156) 2023-11-26T07:15:18.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.016+0000 7f13492c4700 1 -- 172.21.15.2:0/390150235 learned_addr learned my addr 172.21.15.2:0/390150235 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:18.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.016+0000 7f1343fff700 1 --2- 172.21.15.2:0/390150235 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f13440b5ab0 0x7f13440b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:18.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.016+0000 7f1348ac3700 1 --2- 172.21.15.2:0/390150235 >> v2:172.21.15.192:3300/0 conn(0x7f134406b620 0x7f13440b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:18.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.016+0000 7f13492c4700 1 -- 172.21.15.2:0/390150235 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f13440b5ab0 msgr2=0x7f13440b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:18.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.016+0000 7f13492c4700 1 --2- 172.21.15.2:0/390150235 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f13440b5ab0 0x7f13440b3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:18.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.016+0000 7f13492c4700 1 -- 172.21.15.2:0/390150235 >> v2:172.21.15.192:3300/0 conn(0x7f134406b620 msgr2=0x7f13440b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:18.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.016+0000 7f13492c4700 1 --2- 172.21.15.2:0/390150235 >> v2:172.21.15.192:3300/0 conn(0x7f134406b620 0x7f13440b3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:18.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.016+0000 7f13492c4700 1 -- 172.21.15.2:0/390150235 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13440727f0 con 0x7f13441478c0 2023-11-26T07:15:18.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.016+0000 7f1343fff700 1 --2- 172.21.15.2:0/390150235 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f13440b5ab0 0x7f13440b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:15:18.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.016+0000 7f1348ac3700 1 --2- 172.21.15.2:0/390150235 >> v2:172.21.15.192:3300/0 conn(0x7f134406b620 0x7f13440b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:15:18.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.016+0000 7f13492c4700 1 --2- 172.21.15.2:0/390150235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13441478c0 0x7f1344161ba0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f134406d2e0 tx=0x7f133c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7e284a89161694 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:18.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.016+0000 7f13437fe700 1 -- 172.21.15.2:0/390150235 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133c00e070 con 0x7f13441478c0 2023-11-26T07:15:18.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.016+0000 7f13437fe700 1 -- 172.21.15.2:0/390150235 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133c00b9c0 con 0x7f13441478c0 2023-11-26T07:15:18.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.016+0000 7f13437fe700 1 -- 172.21.15.2:0/390150235 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133c00bd70 con 0x7f13441478c0 2023-11-26T07:15:18.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.017+0000 7f134ad27700 1 -- 172.21.15.2:0/390150235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13441478c0 msgr2=0x7f1344161ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:18.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.017+0000 7f134ad27700 1 --2- 172.21.15.2:0/390150235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13441478c0 0x7f1344161ba0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f134406d2e0 tx=0x7f133c00b330 comp rx=0 tx=0).stop 2023-11-26T07:15:18.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.017+0000 7f134ad27700 1 -- 172.21.15.2:0/390150235 shutdown_connections 2023-11-26T07:15:18.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.017+0000 7f134ad27700 1 --2- 172.21.15.2:0/390150235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13441478c0 0x7f1344161ba0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:18.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.017+0000 7f134ad27700 1 --2- 172.21.15.2:0/390150235 >> v2:172.21.15.192:3300/0 conn(0x7f134406b620 0x7f13440b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:18.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.017+0000 7f134ad27700 1 --2- 172.21.15.2:0/390150235 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f13440b5ab0 0x7f13440b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:18.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.017+0000 7f134ad27700 1 -- 172.21.15.2:0/390150235 >> 172.21.15.2:0/390150235 conn(0x7f13440b2740 msgr2=0x7f13440b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:18.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.017+0000 7f134ad27700 1 -- 172.21.15.2:0/390150235 shutdown_connections 2023-11-26T07:15:18.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.017+0000 7f134ad27700 1 -- 172.21.15.2:0/390150235 wait complete. 2023-11-26T07:15:18.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.018+0000 7f134ad27700 1 Processor -- start 2023-11-26T07:15:18.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.018+0000 7f134ad27700 1 -- start start 2023-11-26T07:15:18.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.019+0000 7f134ad27700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f134406b620 0x7f13440c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:18.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.019+0000 7f134ad27700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13440b5ab0 0x7f13440af1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:18.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.019+0000 7f134ad27700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13441478c0 0x7f1344143c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:18.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.019+0000 7f134ad27700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13440c5e10 con 0x7f13441478c0 2023-11-26T07:15:18.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.019+0000 7f134ad27700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13440c5ae0 con 0x7f13440b5ab0 2023-11-26T07:15:18.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.019+0000 7f134ad27700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13440c9200 con 0x7f134406b620 2023-11-26T07:15:18.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.019+0000 7f13492c4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13441478c0 0x7f1344143c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:18.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.019+0000 7f13492c4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13441478c0 0x7f1344143c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43162/0 (socket says 172.21.15.2:43162) 2023-11-26T07:15:18.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.019+0000 7f13492c4700 1 -- 172.21.15.2:0/523162069 learned_addr learned my addr 172.21.15.2:0/523162069 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:18.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.019+0000 7f1348ac3700 1 --2- 172.21.15.2:0/523162069 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f134406b620 0x7f13440c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:18.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.019+0000 7f1343fff700 1 --2- 172.21.15.2:0/523162069 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13440b5ab0 0x7f13440af1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:18.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.020+0000 7f13492c4700 1 -- 172.21.15.2:0/523162069 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f134406b620 msgr2=0x7f13440c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:18.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.020+0000 7f13492c4700 1 --2- 172.21.15.2:0/523162069 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f134406b620 0x7f13440c8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:18.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.020+0000 7f13492c4700 1 -- 172.21.15.2:0/523162069 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13440b5ab0 msgr2=0x7f13440af1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:18.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.020+0000 7f13492c4700 1 --2- 172.21.15.2:0/523162069 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13440b5ab0 0x7f13440af1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:18.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.020+0000 7f13492c4700 1 -- 172.21.15.2:0/523162069 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f133c009b30 con 0x7f13441478c0 2023-11-26T07:15:18.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.020+0000 7f13492c4700 1 --2- 172.21.15.2:0/523162069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13441478c0 0x7f1344143c40 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f133c00b370 tx=0x7f133c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:18.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.020+0000 7f13417fa700 1 -- 172.21.15.2:0/523162069 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133c0099b0 con 0x7f13441478c0 2023-11-26T07:15:18.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.020+0000 7f13417fa700 1 -- 172.21.15.2:0/523162069 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133c0092e0 con 0x7f13441478c0 2023-11-26T07:15:18.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.020+0000 7f134ad27700 1 -- 172.21.15.2:0/523162069 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13440c94e0 con 0x7f13441478c0 2023-11-26T07:15:18.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.020+0000 7f13417fa700 1 -- 172.21.15.2:0/523162069 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133c01c640 con 0x7f13441478c0 2023-11-26T07:15:18.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.020+0000 7f134ad27700 1 -- 172.21.15.2:0/523162069 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1344144180 con 0x7f13441478c0 2023-11-26T07:15:18.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.021+0000 7f134ad27700 1 -- 172.21.15.2:0/523162069 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13440c5fc0 con 0x7f13441478c0 2023-11-26T07:15:18.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.021+0000 7f13417fa700 1 -- 172.21.15.2:0/523162069 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f133c01c7a0 con 0x7f13441478c0 2023-11-26T07:15:18.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.022+0000 7f13417fa700 1 --2- 172.21.15.2:0/523162069 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f132806b470 0x7f132806d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:18.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.022+0000 7f13417fa700 1 -- 172.21.15.2:0/523162069 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f133c08bf00 con 0x7f13441478c0 2023-11-26T07:15:18.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.022+0000 7f1348ac3700 1 --2- 172.21.15.2:0/523162069 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f132806b470 0x7f132806d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:18.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.022+0000 7f1348ac3700 1 --2- 172.21.15.2:0/523162069 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f132806b470 0x7f132806d930 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f133800aa10 tx=0x7f1338008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:18.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.026+0000 7f13417fa700 1 -- 172.21.15.2:0/523162069 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f13440c5fc0 con 0x7f13441478c0 2023-11-26T07:15:18.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.223+0000 7f134ad27700 1 -- 172.21.15.2:0/523162069 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f134406ba00 con 0x7f132806b470 2023-11-26T07:15:18.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.231+0000 7f13417fa700 1 -- 172.21.15.2:0/523162069 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289231 (secure 0 0 0) 0x7f133800c050 con 0x7f132806b470 2023-11-26T07:15:18.236 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:15:18.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.234+0000 7f134ad27700 1 -- 172.21.15.2:0/523162069 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f132806b470 msgr2=0x7f132806d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:18.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.234+0000 7f134ad27700 1 --2- 172.21.15.2:0/523162069 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f132806b470 0x7f132806d930 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f133800aa10 tx=0x7f1338008040 comp rx=0 tx=0).stop 2023-11-26T07:15:18.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.234+0000 7f134ad27700 1 -- 172.21.15.2:0/523162069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13441478c0 msgr2=0x7f1344143c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:18.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.234+0000 7f134ad27700 1 --2- 172.21.15.2:0/523162069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13441478c0 0x7f1344143c40 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f133c00b370 tx=0x7f133c004ad0 comp rx=0 tx=0).stop 2023-11-26T07:15:18.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.234+0000 7f134ad27700 1 -- 172.21.15.2:0/523162069 shutdown_connections 2023-11-26T07:15:18.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.234+0000 7f134ad27700 1 --2- 172.21.15.2:0/523162069 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f132806b470 0x7f132806d930 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:18.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.234+0000 7f134ad27700 1 --2- 172.21.15.2:0/523162069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13441478c0 0x7f1344143c40 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:18.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.234+0000 7f134ad27700 1 --2- 172.21.15.2:0/523162069 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f134406b620 0x7f13440c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:18.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.234+0000 7f134ad27700 1 --2- 172.21.15.2:0/523162069 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13440b5ab0 0x7f13440af1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:18.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.234+0000 7f134ad27700 1 -- 172.21.15.2:0/523162069 >> 172.21.15.2:0/523162069 conn(0x7f13440b2740 msgr2=0x7f13440b18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:18.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.234+0000 7f134ad27700 1 -- 172.21.15.2:0/523162069 shutdown_connections 2023-11-26T07:15:18.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.234+0000 7f134ad27700 1 -- 172.21.15.2:0/523162069 wait complete. 2023-11-26T07:15:18.239 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-26T07:15:18.248 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":169,"stamp":"2023-11-26T07:15:18.209724+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243824,"kb_used_data":6856,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754730896,"statfs":{"total":773094113280,"available":772844437504,"internally_reserved":0,"allocated":7020544,"data_stored":3602588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001477"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:16.145159+0000","last_change":"2023-11-26T07:15:13.308114+0000","last_active":"2023-11-26T07:15:16.145159+0000","last_peered":"2023-11-26T07:15:16.145159+0000","last_clean":"2023-11-26T07:15:16.145159+0000","last_became_active":"2023-11-26T07:15:13.307813+0000","last_became_peered":"2023-11-26T07:15:13.307813+0000","last_unstale":"2023-11-26T07:15:16.145159+0000","last_undegraded":"2023-11-26T07:15:16.145159+0000","last_fullsized":"2023-11-26T07:15:16.145159+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:06:11.773814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.289297+0000","last_change":"2023-11-26T07:15:13.303293+0000","last_active":"2023-11-26T07:15:14.289297+0000","last_peered":"2023-11-26T07:15:14.289297+0000","last_clean":"2023-11-26T07:15:14.289297+0000","last_became_active":"2023-11-26T07:15:13.302966+0000","last_became_peered":"2023-11-26T07:15:13.302966+0000","last_unstale":"2023-11-26T07:15:14.289297+0000","last_undegraded":"2023-11-26T07:15:14.289297+0000","last_fullsized":"2023-11-26T07:15:14.289297+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:43:51.404914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.464607+0000","last_change":"2023-11-26T07:15:13.307638+0000","last_active":"2023-11-26T07:15:14.464607+0000","last_peered":"2023-11-26T07:15:14.464607+0000","last_clean":"2023-11-26T07:15:14.464607+0000","last_became_active":"2023-11-26T07:15:13.307218+0000","last_became_peered":"2023-11-26T07:15:13.307218+0000","last_unstale":"2023-11-26T07:15:14.464607+0000","last_undegraded":"2023-11-26T07:15:14.464607+0000","last_fullsized":"2023-11-26T07:15:14.464607+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:32:00.657764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:16.145589+0000","last_change":"2023-11-26T07:15:13.293974+0000","last_active":"2023-11-26T07:15:16.145589+0000","last_peered":"2023-11-26T07:15:16.145589+0000","last_clean":"2023-11-26T07:15:16.145589+0000","last_became_active":"2023-11-26T07:15:13.293509+0000","last_became_peered":"2023-11-26T07:15:13.293509+0000","last_unstale":"2023-11-26T07:15:16.145589+0000","last_undegraded":"2023-11-26T07:15:16.145589+0000","last_fullsized":"2023-11-26T07:15:16.145589+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:42:21.390076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:16.144987+0000","last_change":"2023-11-26T07:15:13.303952+0000","last_active":"2023-11-26T07:15:16.144987+0000","last_peered":"2023-11-26T07:15:16.144987+0000","last_clean":"2023-11-26T07:15:16.144987+0000","last_became_active":"2023-11-26T07:15:13.303507+0000","last_became_peered":"2023-11-26T07:15:13.303507+0000","last_unstale":"2023-11-26T07:15:16.144987+0000","last_undegraded":"2023-11-26T07:15:16.144987+0000","last_fullsized":"2023-11-26T07:15:16.144987+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:26:27.330842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.716188+0000","last_change":"2023-11-26T07:15:13.317626+0000","last_active":"2023-11-26T07:15:14.716188+0000","last_peered":"2023-11-26T07:15:14.716188+0000","last_clean":"2023-11-26T07:15:14.716188+0000","last_became_active":"2023-11-26T07:15:13.317335+0000","last_became_peered":"2023-11-26T07:15:13.317335+0000","last_unstale":"2023-11-26T07:15:14.716188+0000","last_undegraded":"2023-11-26T07:15:14.716188+0000","last_fullsized":"2023-11-26T07:15:14.716188+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:29:58.803265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.289649+0000","last_change":"2023-11-26T07:15:13.298258+0000","last_active":"2023-11-26T07:15:14.289649+0000","last_peered":"2023-11-26T07:15:14.289649+0000","last_clean":"2023-11-26T07:15:14.289649+0000","last_became_active":"2023-11-26T07:15:13.297971+0000","last_became_peered":"2023-11-26T07:15:13.297971+0000","last_unstale":"2023-11-26T07:15:14.289649+0000","last_undegraded":"2023-11-26T07:15:14.289649+0000","last_fullsized":"2023-11-26T07:15:14.289649+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:44:33.820633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.288797+0000","last_change":"2023-11-26T07:15:13.306149+0000","last_active":"2023-11-26T07:15:14.288797+0000","last_peered":"2023-11-26T07:15:14.288797+0000","last_clean":"2023-11-26T07:15:14.288797+0000","last_became_active":"2023-11-26T07:15:13.305847+0000","last_became_peered":"2023-11-26T07:15:13.305847+0000","last_unstale":"2023-11-26T07:15:14.288797+0000","last_undegraded":"2023-11-26T07:15:14.288797+0000","last_fullsized":"2023-11-26T07:15:14.288797+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:58:21.942488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.289871+0000","last_change":"2023-11-26T07:15:13.310617+0000","last_active":"2023-11-26T07:15:14.289871+0000","last_peered":"2023-11-26T07:15:14.289871+0000","last_clean":"2023-11-26T07:15:14.289871+0000","last_became_active":"2023-11-26T07:15:13.310363+0000","last_became_peered":"2023-11-26T07:15:13.310363+0000","last_unstale":"2023-11-26T07:15:14.289871+0000","last_undegraded":"2023-11-26T07:15:14.289871+0000","last_fullsized":"2023-11-26T07:15:14.289871+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:21:16.538514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:15.182523+0000","last_change":"2023-11-26T07:15:13.307979+0000","last_active":"2023-11-26T07:15:15.182523+0000","last_peered":"2023-11-26T07:15:15.182523+0000","last_clean":"2023-11-26T07:15:15.182523+0000","last_became_active":"2023-11-26T07:15:13.307720+0000","last_became_peered":"2023-11-26T07:15:13.307720+0000","last_unstale":"2023-11-26T07:15:15.182523+0000","last_undegraded":"2023-11-26T07:15:15.182523+0000","last_fullsized":"2023-11-26T07:15:15.182523+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:19:25.531893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:15.182598+0000","last_change":"2023-11-26T07:15:13.304004+0000","last_active":"2023-11-26T07:15:15.182598+0000","last_peered":"2023-11-26T07:15:15.182598+0000","last_clean":"2023-11-26T07:15:15.182598+0000","last_became_active":"2023-11-26T07:15:13.303719+0000","last_became_peered":"2023-11-26T07:15:13.303719+0000","last_unstale":"2023-11-26T07:15:15.182598+0000","last_undegraded":"2023-11-26T07:15:15.182598+0000","last_fullsized":"2023-11-26T07:15:15.182598+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:29:11.229380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:16.145741+0000","last_change":"2023-11-26T07:15:13.298878+0000","last_active":"2023-11-26T07:15:16.145741+0000","last_peered":"2023-11-26T07:15:16.145741+0000","last_clean":"2023-11-26T07:15:16.145741+0000","last_became_active":"2023-11-26T07:15:13.298585+0000","last_became_peered":"2023-11-26T07:15:13.298585+0000","last_unstale":"2023-11-26T07:15:16.145741+0000","last_undegraded":"2023-11-26T07:15:16.145741+0000","last_fullsized":"2023-11-26T07:15:16.145741+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:20:56.131760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:15.186635+0000","last_change":"2023-11-26T07:15:13.311040+0000","last_active":"2023-11-26T07:15:15.186635+0000","last_peered":"2023-11-26T07:15:15.186635+0000","last_clean":"2023-11-26T07:15:15.186635+0000","last_became_active":"2023-11-26T07:15:13.310713+0000","last_became_peered":"2023-11-26T07:15:13.310713+0000","last_unstale":"2023-11-26T07:15:15.186635+0000","last_undegraded":"2023-11-26T07:15:15.186635+0000","last_fullsized":"2023-11-26T07:15:15.186635+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:36:08.844248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.289904+0000","last_change":"2023-11-26T07:15:13.302245+0000","last_active":"2023-11-26T07:15:14.289904+0000","last_peered":"2023-11-26T07:15:14.289904+0000","last_clean":"2023-11-26T07:15:14.289904+0000","last_became_active":"2023-11-26T07:15:13.301967+0000","last_became_peered":"2023-11-26T07:15:13.301967+0000","last_unstale":"2023-11-26T07:15:14.289904+0000","last_undegraded":"2023-11-26T07:15:14.289904+0000","last_fullsized":"2023-11-26T07:15:14.289904+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:15:04.254627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.289738+0000","last_change":"2023-11-26T07:15:13.300428+0000","last_active":"2023-11-26T07:15:14.289738+0000","last_peered":"2023-11-26T07:15:14.289738+0000","last_clean":"2023-11-26T07:15:14.289738+0000","last_became_active":"2023-11-26T07:15:13.300103+0000","last_became_peered":"2023-11-26T07:15:13.300103+0000","last_unstale":"2023-11-26T07:15:14.289738+0000","last_undegraded":"2023-11-26T07:15:14.289738+0000","last_fullsized":"2023-11-26T07:15:14.289738+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:55:35.150250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.716044+0000","last_change":"2023-11-26T07:15:13.311434+0000","last_active":"2023-11-26T07:15:14.716044+0000","last_peered":"2023-11-26T07:15:14.716044+0000","last_clean":"2023-11-26T07:15:14.716044+0000","last_became_active":"2023-11-26T07:15:13.311043+0000","last_became_peered":"2023-11-26T07:15:13.311043+0000","last_unstale":"2023-11-26T07:15:14.716044+0000","last_undegraded":"2023-11-26T07:15:14.716044+0000","last_fullsized":"2023-11-26T07:15:14.716044+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:46:11.849131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.289136+0000","last_change":"2023-11-26T07:15:13.315444+0000","last_active":"2023-11-26T07:15:14.289136+0000","last_peered":"2023-11-26T07:15:14.289136+0000","last_clean":"2023-11-26T07:15:14.289136+0000","last_became_active":"2023-11-26T07:15:13.313428+0000","last_became_peered":"2023-11-26T07:15:13.313428+0000","last_unstale":"2023-11-26T07:15:14.289136+0000","last_undegraded":"2023-11-26T07:15:14.289136+0000","last_fullsized":"2023-11-26T07:15:14.289136+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:12:33.505942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.464896+0000","last_change":"2023-11-26T07:15:13.310021+0000","last_active":"2023-11-26T07:15:14.464896+0000","last_peered":"2023-11-26T07:15:14.464896+0000","last_clean":"2023-11-26T07:15:14.464896+0000","last_became_active":"2023-11-26T07:15:13.309683+0000","last_became_peered":"2023-11-26T07:15:13.309683+0000","last_unstale":"2023-11-26T07:15:14.464896+0000","last_undegraded":"2023-11-26T07:15:14.464896+0000","last_fullsized":"2023-11-26T07:15:14.464896+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:29:58.803265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:16.145091+0000","last_change":"2023-11-26T07:15:13.316644+0000","last_active":"2023-11-26T07:15:16.145091+0000","last_peered":"2023-11-26T07:15:16.145091+0000","last_clean":"2023-11-26T07:15:16.145091+0000","last_became_active":"2023-11-26T07:15:13.316335+0000","last_became_peered":"2023-11-26T07:15:13.316335+0000","last_unstale":"2023-11-26T07:15:16.145091+0000","last_undegraded":"2023-11-26T07:15:16.145091+0000","last_fullsized":"2023-11-26T07:15:16.145091+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:44:48.042431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.288963+0000","last_change":"2023-11-26T07:15:13.312661+0000","last_active":"2023-11-26T07:15:14.288963+0000","last_peered":"2023-11-26T07:15:14.288963+0000","last_clean":"2023-11-26T07:15:14.288963+0000","last_became_active":"2023-11-26T07:15:13.312329+0000","last_became_peered":"2023-11-26T07:15:13.312329+0000","last_unstale":"2023-11-26T07:15:14.288963+0000","last_undegraded":"2023-11-26T07:15:14.288963+0000","last_fullsized":"2023-11-26T07:15:14.288963+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:47:55.592557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.464766+0000","last_change":"2023-11-26T07:15:13.301613+0000","last_active":"2023-11-26T07:15:14.464766+0000","last_peered":"2023-11-26T07:15:14.464766+0000","last_clean":"2023-11-26T07:15:14.464766+0000","last_became_active":"2023-11-26T07:15:13.301116+0000","last_became_peered":"2023-11-26T07:15:13.301116+0000","last_unstale":"2023-11-26T07:15:14.464766+0000","last_undegraded":"2023-11-26T07:15:14.464766+0000","last_fullsized":"2023-11-26T07:15:14.464766+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:46:11.849131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.288909+0000","last_change":"2023-11-26T07:15:13.307609+0000","last_active":"2023-11-26T07:15:14.288909+0000","last_peered":"2023-11-26T07:15:14.288909+0000","last_clean":"2023-11-26T07:15:14.288909+0000","last_became_active":"2023-11-26T07:15:13.307352+0000","last_became_peered":"2023-11-26T07:15:13.307352+0000","last_unstale":"2023-11-26T07:15:14.288909+0000","last_undegraded":"2023-11-26T07:15:14.288909+0000","last_fullsized":"2023-11-26T07:15:14.288909+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:19:47.275564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.464682+0000","last_change":"2023-11-26T07:15:13.308524+0000","last_active":"2023-11-26T07:15:14.464682+0000","last_peered":"2023-11-26T07:15:14.464682+0000","last_clean":"2023-11-26T07:15:14.464682+0000","last_became_active":"2023-11-26T07:15:13.307898+0000","last_became_peered":"2023-11-26T07:15:13.307898+0000","last_unstale":"2023-11-26T07:15:14.464682+0000","last_undegraded":"2023-11-26T07:15:14.464682+0000","last_fullsized":"2023-11-26T07:15:14.464682+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:59:19.037305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:15.186443+0000","last_change":"2023-11-26T07:15:13.314831+0000","last_active":"2023-11-26T07:15:15.186443+0000","last_peered":"2023-11-26T07:15:15.186443+0000","last_clean":"2023-11-26T07:15:15.186443+0000","last_became_active":"2023-11-26T07:15:13.314613+0000","last_became_peered":"2023-11-26T07:15:13.314613+0000","last_unstale":"2023-11-26T07:15:15.186443+0000","last_undegraded":"2023-11-26T07:15:15.186443+0000","last_fullsized":"2023-11-26T07:15:15.186443+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:55:31.988300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:16.145261+0000","last_change":"2023-11-26T07:15:13.302505+0000","last_active":"2023-11-26T07:15:16.145261+0000","last_peered":"2023-11-26T07:15:16.145261+0000","last_clean":"2023-11-26T07:15:16.145261+0000","last_became_active":"2023-11-26T07:15:13.302219+0000","last_became_peered":"2023-11-26T07:15:13.302219+0000","last_unstale":"2023-11-26T07:15:16.145261+0000","last_undegraded":"2023-11-26T07:15:16.145261+0000","last_fullsized":"2023-11-26T07:15:16.145261+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:20:03.025839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:16.145853+0000","last_change":"2023-11-26T07:15:13.298297+0000","last_active":"2023-11-26T07:15:16.145853+0000","last_peered":"2023-11-26T07:15:16.145853+0000","last_clean":"2023-11-26T07:15:16.145853+0000","last_became_active":"2023-11-26T07:15:13.298019+0000","last_became_peered":"2023-11-26T07:15:13.298019+0000","last_unstale":"2023-11-26T07:15:16.145853+0000","last_undegraded":"2023-11-26T07:15:16.145853+0000","last_fullsized":"2023-11-26T07:15:16.145853+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:34:55.081476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.716400+0000","last_change":"2023-11-26T07:15:13.311021+0000","last_active":"2023-11-26T07:15:14.716400+0000","last_peered":"2023-11-26T07:15:14.716400+0000","last_clean":"2023-11-26T07:15:14.716400+0000","last_became_active":"2023-11-26T07:15:13.310518+0000","last_became_peered":"2023-11-26T07:15:13.310518+0000","last_unstale":"2023-11-26T07:15:14.716400+0000","last_undegraded":"2023-11-26T07:15:14.716400+0000","last_fullsized":"2023-11-26T07:15:14.716400+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:20:22.142720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:16.145092+0000","last_change":"2023-11-26T07:15:13.303957+0000","last_active":"2023-11-26T07:15:16.145092+0000","last_peered":"2023-11-26T07:15:16.145092+0000","last_clean":"2023-11-26T07:15:16.145092+0000","last_became_active":"2023-11-26T07:15:13.303560+0000","last_became_peered":"2023-11-26T07:15:13.303560+0000","last_unstale":"2023-11-26T07:15:16.145092+0000","last_undegraded":"2023-11-26T07:15:16.145092+0000","last_fullsized":"2023-11-26T07:15:16.145092+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:04:05.590262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.289555+0000","last_change":"2023-11-26T07:15:13.309584+0000","last_active":"2023-11-26T07:15:14.289555+0000","last_peered":"2023-11-26T07:15:14.289555+0000","last_clean":"2023-11-26T07:15:14.289555+0000","last_became_active":"2023-11-26T07:15:13.309317+0000","last_became_peered":"2023-11-26T07:15:13.309317+0000","last_unstale":"2023-11-26T07:15:14.289555+0000","last_undegraded":"2023-11-26T07:15:14.289555+0000","last_fullsized":"2023-11-26T07:15:14.289555+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:32:16.307775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.464583+0000","last_change":"2023-11-26T07:15:13.304470+0000","last_active":"2023-11-26T07:15:14.464583+0000","last_peered":"2023-11-26T07:15:14.464583+0000","last_clean":"2023-11-26T07:15:14.464583+0000","last_became_active":"2023-11-26T07:15:13.304187+0000","last_became_peered":"2023-11-26T07:15:13.304187+0000","last_unstale":"2023-11-26T07:15:14.464583+0000","last_undegraded":"2023-11-26T07:15:14.464583+0000","last_fullsized":"2023-11-26T07:15:14.464583+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:32:58.450755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:16.144866+0000","last_change":"2023-11-26T07:15:13.301409+0000","last_active":"2023-11-26T07:15:16.144866+0000","last_peered":"2023-11-26T07:15:16.144866+0000","last_clean":"2023-11-26T07:15:16.144866+0000","last_became_active":"2023-11-26T07:15:13.301099+0000","last_became_peered":"2023-11-26T07:15:13.301099+0000","last_unstale":"2023-11-26T07:15:16.144866+0000","last_undegraded":"2023-11-26T07:15:16.144866+0000","last_fullsized":"2023-11-26T07:15:16.144866+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:49:03.762354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.716176+0000","last_change":"2023-11-26T07:15:13.311998+0000","last_active":"2023-11-26T07:15:14.716176+0000","last_peered":"2023-11-26T07:15:14.716176+0000","last_clean":"2023-11-26T07:15:14.716176+0000","last_became_active":"2023-11-26T07:15:13.311715+0000","last_became_peered":"2023-11-26T07:15:13.311715+0000","last_unstale":"2023-11-26T07:15:14.716176+0000","last_undegraded":"2023-11-26T07:15:14.716176+0000","last_fullsized":"2023-11-26T07:15:14.716176+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:05:41.521323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.716357+0000","last_change":"2023-11-26T07:15:13.309239+0000","last_active":"2023-11-26T07:15:14.716357+0000","last_peered":"2023-11-26T07:15:14.716357+0000","last_clean":"2023-11-26T07:15:14.716357+0000","last_became_active":"2023-11-26T07:15:13.308871+0000","last_became_peered":"2023-11-26T07:15:13.308871+0000","last_unstale":"2023-11-26T07:15:14.716357+0000","last_undegraded":"2023-11-26T07:15:14.716357+0000","last_fullsized":"2023-11-26T07:15:14.716357+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:05:29.806891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"59'4","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.319919+0000","last_change":"2023-11-26T07:15:12.298413+0000","last_active":"2023-11-26T07:15:13.319919+0000","last_peered":"2023-11-26T07:15:13.319919+0000","last_clean":"2023-11-26T07:15:13.319919+0000","last_became_active":"2023-11-26T07:15:12.298102+0000","last_became_peered":"2023-11-26T07:15:12.298102+0000","last_unstale":"2023-11-26T07:15:13.319919+0000","last_undegraded":"2023-11-26T07:15:13.319919+0000","last_fullsized":"2023-11-26T07:15:13.319919+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:51:39.947535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:15.182607+0000","last_change":"2023-11-26T07:15:13.303110+0000","last_active":"2023-11-26T07:15:15.182607+0000","last_peered":"2023-11-26T07:15:15.182607+0000","last_clean":"2023-11-26T07:15:15.182607+0000","last_became_active":"2023-11-26T07:15:13.302787+0000","last_became_peered":"2023-11-26T07:15:13.302787+0000","last_unstale":"2023-11-26T07:15:15.182607+0000","last_undegraded":"2023-11-26T07:15:15.182607+0000","last_fullsized":"2023-11-26T07:15:15.182607+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:05:49.340343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"59'1","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.319113+0000","last_change":"2023-11-26T07:15:12.302787+0000","last_active":"2023-11-26T07:15:13.319113+0000","last_peered":"2023-11-26T07:15:13.319113+0000","last_clean":"2023-11-26T07:15:13.319113+0000","last_became_active":"2023-11-26T07:15:12.302489+0000","last_became_peered":"2023-11-26T07:15:12.302489+0000","last_unstale":"2023-11-26T07:15:13.319113+0000","last_undegraded":"2023-11-26T07:15:13.319113+0000","last_fullsized":"2023-11-26T07:15:13.319113+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:05:40.519750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.716470+0000","last_change":"2023-11-26T07:15:13.310946+0000","last_active":"2023-11-26T07:15:14.716470+0000","last_peered":"2023-11-26T07:15:14.716470+0000","last_clean":"2023-11-26T07:15:14.716470+0000","last_became_active":"2023-11-26T07:15:13.310654+0000","last_became_peered":"2023-11-26T07:15:13.310654+0000","last_unstale":"2023-11-26T07:15:14.716470+0000","last_undegraded":"2023-11-26T07:15:14.716470+0000","last_fullsized":"2023-11-26T07:15:14.716470+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:48:20.118670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"59'2","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.320380+0000","last_change":"2023-11-26T07:15:12.302483+0000","last_active":"2023-11-26T07:15:13.320380+0000","last_peered":"2023-11-26T07:15:13.320380+0000","last_clean":"2023-11-26T07:15:13.320380+0000","last_became_active":"2023-11-26T07:15:12.302095+0000","last_became_peered":"2023-11-26T07:15:12.302095+0000","last_unstale":"2023-11-26T07:15:13.320380+0000","last_undegraded":"2023-11-26T07:15:13.320380+0000","last_fullsized":"2023-11-26T07:15:13.320380+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:34:54.079903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.716503+0000","last_change":"2023-11-26T07:15:13.310225+0000","last_active":"2023-11-26T07:15:14.716503+0000","last_peered":"2023-11-26T07:15:14.716503+0000","last_clean":"2023-11-26T07:15:14.716503+0000","last_became_active":"2023-11-26T07:15:13.309592+0000","last_became_peered":"2023-11-26T07:15:13.309592+0000","last_unstale":"2023-11-26T07:15:14.716503+0000","last_undegraded":"2023-11-26T07:15:14.716503+0000","last_fullsized":"2023-11-26T07:15:14.716503+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:49:43.683710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"59'2","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.318366+0000","last_change":"2023-11-26T07:15:12.300835+0000","last_active":"2023-11-26T07:15:13.318366+0000","last_peered":"2023-11-26T07:15:13.318366+0000","last_clean":"2023-11-26T07:15:13.318366+0000","last_became_active":"2023-11-26T07:15:12.300536+0000","last_became_peered":"2023-11-26T07:15:12.300536+0000","last_unstale":"2023-11-26T07:15:13.318366+0000","last_undegraded":"2023-11-26T07:15:13.318366+0000","last_fullsized":"2023-11-26T07:15:13.318366+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:12:07.949999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.289030+0000","last_change":"2023-11-26T07:15:13.317611+0000","last_active":"2023-11-26T07:15:14.289030+0000","last_peered":"2023-11-26T07:15:14.289030+0000","last_clean":"2023-11-26T07:15:14.289030+0000","last_became_active":"2023-11-26T07:15:13.317271+0000","last_became_peered":"2023-11-26T07:15:13.317271+0000","last_unstale":"2023-11-26T07:15:14.289030+0000","last_undegraded":"2023-11-26T07:15:14.289030+0000","last_fullsized":"2023-11-26T07:15:14.289030+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:06:49.653826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"59'1","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.317299+0000","last_change":"2023-11-26T07:15:12.301249+0000","last_active":"2023-11-26T07:15:13.317299+0000","last_peered":"2023-11-26T07:15:13.317299+0000","last_clean":"2023-11-26T07:15:13.317299+0000","last_became_active":"2023-11-26T07:15:12.300848+0000","last_became_peered":"2023-11-26T07:15:12.300848+0000","last_unstale":"2023-11-26T07:15:13.317299+0000","last_undegraded":"2023-11-26T07:15:13.317299+0000","last_fullsized":"2023-11-26T07:15:13.317299+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:29:22.469437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.289245+0000","last_change":"2023-11-26T07:15:13.314640+0000","last_active":"2023-11-26T07:15:14.289245+0000","last_peered":"2023-11-26T07:15:14.289245+0000","last_clean":"2023-11-26T07:15:14.289245+0000","last_became_active":"2023-11-26T07:15:13.314376+0000","last_became_peered":"2023-11-26T07:15:13.314376+0000","last_unstale":"2023-11-26T07:15:14.289245+0000","last_undegraded":"2023-11-26T07:15:14.289245+0000","last_fullsized":"2023-11-26T07:15:14.289245+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:56:39.679237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"59'1","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.319533+0000","last_change":"2023-11-26T07:15:12.304914+0000","last_active":"2023-11-26T07:15:13.319533+0000","last_peered":"2023-11-26T07:15:13.319533+0000","last_clean":"2023-11-26T07:15:13.319533+0000","last_became_active":"2023-11-26T07:15:12.304622+0000","last_became_peered":"2023-11-26T07:15:12.304622+0000","last_unstale":"2023-11-26T07:15:13.319533+0000","last_undegraded":"2023-11-26T07:15:13.319533+0000","last_fullsized":"2023-11-26T07:15:13.319533+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:42:20.388503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:15.186532+0000","last_change":"2023-11-26T07:15:13.299138+0000","last_active":"2023-11-26T07:15:15.186532+0000","last_peered":"2023-11-26T07:15:15.186532+0000","last_clean":"2023-11-26T07:15:15.186532+0000","last_became_active":"2023-11-26T07:15:13.298666+0000","last_became_peered":"2023-11-26T07:15:13.298666+0000","last_unstale":"2023-11-26T07:15:15.186532+0000","last_undegraded":"2023-11-26T07:15:15.186532+0000","last_fullsized":"2023-11-26T07:15:15.186532+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:41:32.866173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.288643+0000","last_change":"2023-11-26T07:15:12.297245+0000","last_active":"2023-11-26T07:15:13.288643+0000","last_peered":"2023-11-26T07:15:13.288643+0000","last_clean":"2023-11-26T07:15:13.288643+0000","last_became_active":"2023-11-26T07:15:12.296904+0000","last_became_peered":"2023-11-26T07:15:12.296904+0000","last_unstale":"2023-11-26T07:15:13.288643+0000","last_undegraded":"2023-11-26T07:15:13.288643+0000","last_fullsized":"2023-11-26T07:15:13.288643+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:55:34.148677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.288834+0000","last_change":"2023-11-26T07:15:13.312997+0000","last_active":"2023-11-26T07:15:14.288834+0000","last_peered":"2023-11-26T07:15:14.288834+0000","last_clean":"2023-11-26T07:15:14.288834+0000","last_became_active":"2023-11-26T07:15:13.311781+0000","last_became_peered":"2023-11-26T07:15:13.311781+0000","last_unstale":"2023-11-26T07:15:14.288834+0000","last_undegraded":"2023-11-26T07:15:14.288834+0000","last_fullsized":"2023-11-26T07:15:14.288834+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:13:54.735452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.291691+0000","last_change":"2023-11-26T07:15:12.303096+0000","last_active":"2023-11-26T07:15:13.291691+0000","last_peered":"2023-11-26T07:15:13.291691+0000","last_clean":"2023-11-26T07:15:13.291691+0000","last_became_active":"2023-11-26T07:15:12.302747+0000","last_became_peered":"2023-11-26T07:15:12.302747+0000","last_unstale":"2023-11-26T07:15:13.291691+0000","last_undegraded":"2023-11-26T07:15:13.291691+0000","last_fullsized":"2023-11-26T07:15:13.291691+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:43:46.409969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.290030+0000","last_change":"2023-11-26T07:15:13.298953+0000","last_active":"2023-11-26T07:15:14.290030+0000","last_peered":"2023-11-26T07:15:14.290030+0000","last_clean":"2023-11-26T07:15:14.290030+0000","last_became_active":"2023-11-26T07:15:13.298685+0000","last_became_peered":"2023-11-26T07:15:13.298685+0000","last_unstale":"2023-11-26T07:15:14.290030+0000","last_undegraded":"2023-11-26T07:15:14.290030+0000","last_fullsized":"2023-11-26T07:15:14.290030+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:37:44.542461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.295003+0000","last_change":"2023-11-26T07:15:12.298615+0000","last_active":"2023-11-26T07:15:13.295003+0000","last_peered":"2023-11-26T07:15:13.295003+0000","last_clean":"2023-11-26T07:15:13.295003+0000","last_became_active":"2023-11-26T07:15:12.298325+0000","last_became_peered":"2023-11-26T07:15:12.298325+0000","last_unstale":"2023-11-26T07:15:13.295003+0000","last_undegraded":"2023-11-26T07:15:13.295003+0000","last_fullsized":"2023-11-26T07:15:13.295003+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:37:31.449723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.464903+0000","last_change":"2023-11-26T07:15:13.302881+0000","last_active":"2023-11-26T07:15:14.464903+0000","last_peered":"2023-11-26T07:15:14.464903+0000","last_clean":"2023-11-26T07:15:14.464903+0000","last_became_active":"2023-11-26T07:15:13.302613+0000","last_became_peered":"2023-11-26T07:15:13.302613+0000","last_unstale":"2023-11-26T07:15:14.464903+0000","last_undegraded":"2023-11-26T07:15:14.464903+0000","last_fullsized":"2023-11-26T07:15:14.464903+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:05:29.806891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.292754+0000","last_change":"2023-11-26T07:15:12.307002+0000","last_active":"2023-11-26T07:15:13.292754+0000","last_peered":"2023-11-26T07:15:13.292754+0000","last_clean":"2023-11-26T07:15:13.292754+0000","last_became_active":"2023-11-26T07:15:12.306612+0000","last_became_peered":"2023-11-26T07:15:12.306612+0000","last_unstale":"2023-11-26T07:15:13.292754+0000","last_undegraded":"2023-11-26T07:15:13.292754+0000","last_fullsized":"2023-11-26T07:15:13.292754+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:05:28.805318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:15.182426+0000","last_change":"2023-11-26T07:15:13.305034+0000","last_active":"2023-11-26T07:15:15.182426+0000","last_peered":"2023-11-26T07:15:15.182426+0000","last_clean":"2023-11-26T07:15:15.182426+0000","last_became_active":"2023-11-26T07:15:13.304552+0000","last_became_peered":"2023-11-26T07:15:13.304552+0000","last_unstale":"2023-11-26T07:15:15.182426+0000","last_undegraded":"2023-11-26T07:15:15.182426+0000","last_fullsized":"2023-11-26T07:15:15.182426+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:33:53.753478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"59'3","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.316562+0000","last_change":"2023-11-26T07:15:12.299169+0000","last_active":"2023-11-26T07:15:13.316562+0000","last_peered":"2023-11-26T07:15:13.316562+0000","last_clean":"2023-11-26T07:15:13.316562+0000","last_became_active":"2023-11-26T07:15:12.298742+0000","last_became_peered":"2023-11-26T07:15:12.298742+0000","last_unstale":"2023-11-26T07:15:13.316562+0000","last_undegraded":"2023-11-26T07:15:13.316562+0000","last_fullsized":"2023-11-26T07:15:13.316562+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:47:26.695306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.464749+0000","last_change":"2023-11-26T07:15:13.303083+0000","last_active":"2023-11-26T07:15:14.464749+0000","last_peered":"2023-11-26T07:15:14.464749+0000","last_clean":"2023-11-26T07:15:14.464749+0000","last_became_active":"2023-11-26T07:15:13.302828+0000","last_became_peered":"2023-11-26T07:15:13.302828+0000","last_unstale":"2023-11-26T07:15:14.464749+0000","last_undegraded":"2023-11-26T07:15:14.464749+0000","last_fullsized":"2023-11-26T07:15:14.464749+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:55:51.646081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"59'6","reported_seq":18,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.324593+0000","last_change":"2023-11-26T07:15:12.301922+0000","last_active":"2023-11-26T07:15:13.324593+0000","last_peered":"2023-11-26T07:15:13.324593+0000","last_clean":"2023-11-26T07:15:13.324593+0000","last_became_active":"2023-11-26T07:15:12.301636+0000","last_became_peered":"2023-11-26T07:15:12.301636+0000","last_unstale":"2023-11-26T07:15:13.324593+0000","last_undegraded":"2023-11-26T07:15:13.324593+0000","last_fullsized":"2023-11-26T07:15:13.324593+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:36:07.842675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:16.145469+0000","last_change":"2023-11-26T07:15:13.297153+0000","last_active":"2023-11-26T07:15:16.145469+0000","last_peered":"2023-11-26T07:15:16.145469+0000","last_clean":"2023-11-26T07:15:16.145469+0000","last_became_active":"2023-11-26T07:15:13.296658+0000","last_became_peered":"2023-11-26T07:15:13.296658+0000","last_unstale":"2023-11-26T07:15:16.145469+0000","last_undegraded":"2023-11-26T07:15:16.145469+0000","last_fullsized":"2023-11-26T07:15:16.145469+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:02:14.657926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"59'2","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.319606+0000","last_change":"2023-11-26T07:15:12.306177+0000","last_active":"2023-11-26T07:15:13.319606+0000","last_peered":"2023-11-26T07:15:13.319606+0000","last_clean":"2023-11-26T07:15:13.319606+0000","last_became_active":"2023-11-26T07:15:12.304698+0000","last_became_peered":"2023-11-26T07:15:12.304698+0000","last_unstale":"2023-11-26T07:15:13.319606+0000","last_undegraded":"2023-11-26T07:15:13.319606+0000","last_fullsized":"2023-11-26T07:15:13.319606+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:37:05.995766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.464589+0000","last_change":"2023-11-26T07:15:13.301706+0000","last_active":"2023-11-26T07:15:14.464589+0000","last_peered":"2023-11-26T07:15:14.464589+0000","last_clean":"2023-11-26T07:15:14.464589+0000","last_became_active":"2023-11-26T07:15:13.301439+0000","last_became_peered":"2023-11-26T07:15:13.301439+0000","last_unstale":"2023-11-26T07:15:14.464589+0000","last_undegraded":"2023-11-26T07:15:14.464589+0000","last_fullsized":"2023-11-26T07:15:14.464589+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:34:55.081476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.292700+0000","last_change":"2023-11-26T07:15:12.304899+0000","last_active":"2023-11-26T07:15:13.292700+0000","last_peered":"2023-11-26T07:15:13.292700+0000","last_clean":"2023-11-26T07:15:13.292700+0000","last_became_active":"2023-11-26T07:15:12.304628+0000","last_became_peered":"2023-11-26T07:15:12.304628+0000","last_unstale":"2023-11-26T07:15:13.292700+0000","last_undegraded":"2023-11-26T07:15:13.292700+0000","last_fullsized":"2023-11-26T07:15:13.292700+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:57:19.000626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.289589+0000","last_change":"2023-11-26T07:15:13.302613+0000","last_active":"2023-11-26T07:15:14.289589+0000","last_peered":"2023-11-26T07:15:14.289589+0000","last_clean":"2023-11-26T07:15:14.289589+0000","last_became_active":"2023-11-26T07:15:13.302388+0000","last_became_peered":"2023-11-26T07:15:13.302388+0000","last_unstale":"2023-11-26T07:15:14.289589+0000","last_undegraded":"2023-11-26T07:15:14.289589+0000","last_fullsized":"2023-11-26T07:15:14.289589+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:58:02.591422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.288482+0000","last_change":"2023-11-26T07:15:12.300289+0000","last_active":"2023-11-26T07:15:13.288482+0000","last_peered":"2023-11-26T07:15:13.288482+0000","last_clean":"2023-11-26T07:15:13.288482+0000","last_became_active":"2023-11-26T07:15:12.299999+0000","last_became_peered":"2023-11-26T07:15:12.299999+0000","last_unstale":"2023-11-26T07:15:13.288482+0000","last_undegraded":"2023-11-26T07:15:13.288482+0000","last_fullsized":"2023-11-26T07:15:13.288482+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:58:01.589849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.464559+0000","last_change":"2023-11-26T07:15:13.308709+0000","last_active":"2023-11-26T07:15:14.464559+0000","last_peered":"2023-11-26T07:15:14.464559+0000","last_clean":"2023-11-26T07:15:14.464559+0000","last_became_active":"2023-11-26T07:15:13.308241+0000","last_became_peered":"2023-11-26T07:15:13.308241+0000","last_unstale":"2023-11-26T07:15:14.464559+0000","last_undegraded":"2023-11-26T07:15:14.464559+0000","last_fullsized":"2023-11-26T07:15:14.464559+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:51:40.949108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"59'8","reported_seq":20,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.309018+0000","last_change":"2023-11-26T07:15:12.297008+0000","last_active":"2023-11-26T07:15:13.309018+0000","last_peered":"2023-11-26T07:15:13.309018+0000","last_clean":"2023-11-26T07:15:13.309018+0000","last_became_active":"2023-11-26T07:15:12.296711+0000","last_became_peered":"2023-11-26T07:15:12.296711+0000","last_unstale":"2023-11-26T07:15:13.309018+0000","last_undegraded":"2023-11-26T07:15:13.309018+0000","last_fullsized":"2023-11-26T07:15:13.309018+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:44:32.819060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.464970+0000","last_change":"2023-11-26T07:15:13.309049+0000","last_active":"2023-11-26T07:15:14.464970+0000","last_peered":"2023-11-26T07:15:14.464970+0000","last_clean":"2023-11-26T07:15:14.464970+0000","last_became_active":"2023-11-26T07:15:13.308790+0000","last_became_peered":"2023-11-26T07:15:13.308790+0000","last_unstale":"2023-11-26T07:15:14.464970+0000","last_undegraded":"2023-11-26T07:15:14.464970+0000","last_fullsized":"2023-11-26T07:15:14.464970+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:20:22.142720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"59'1","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.317211+0000","last_change":"2023-11-26T07:15:12.306635+0000","last_active":"2023-11-26T07:15:13.317211+0000","last_peered":"2023-11-26T07:15:13.317211+0000","last_clean":"2023-11-26T07:15:13.317211+0000","last_became_active":"2023-11-26T07:15:12.304730+0000","last_became_peered":"2023-11-26T07:15:12.304730+0000","last_unstale":"2023-11-26T07:15:13.317211+0000","last_undegraded":"2023-11-26T07:15:13.317211+0000","last_fullsized":"2023-11-26T07:15:13.317211+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:14:33.732928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:16.145847+0000","last_change":"2023-11-26T07:15:13.300658+0000","last_active":"2023-11-26T07:15:16.145847+0000","last_peered":"2023-11-26T07:15:16.145847+0000","last_clean":"2023-11-26T07:15:16.145847+0000","last_became_active":"2023-11-26T07:15:13.299648+0000","last_became_peered":"2023-11-26T07:15:13.299648+0000","last_unstale":"2023-11-26T07:15:16.145847+0000","last_undegraded":"2023-11-26T07:15:16.145847+0000","last_fullsized":"2023-11-26T07:15:16.145847+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:32:58.450755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"59'2","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.320053+0000","last_change":"2023-11-26T07:15:12.300625+0000","last_active":"2023-11-26T07:15:13.320053+0000","last_peered":"2023-11-26T07:15:13.320053+0000","last_clean":"2023-11-26T07:15:13.320053+0000","last_became_active":"2023-11-26T07:15:12.300272+0000","last_became_peered":"2023-11-26T07:15:12.300272+0000","last_unstale":"2023-11-26T07:15:13.320053+0000","last_undegraded":"2023-11-26T07:15:13.320053+0000","last_fullsized":"2023-11-26T07:15:13.320053+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:20:55.130187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.289039+0000","last_change":"2023-11-26T07:15:13.307083+0000","last_active":"2023-11-26T07:15:14.289039+0000","last_peered":"2023-11-26T07:15:14.289039+0000","last_clean":"2023-11-26T07:15:14.289039+0000","last_became_active":"2023-11-26T07:15:13.306892+0000","last_became_peered":"2023-11-26T07:15:13.306892+0000","last_unstale":"2023-11-26T07:15:14.289039+0000","last_undegraded":"2023-11-26T07:15:14.289039+0000","last_fullsized":"2023-11-26T07:15:14.289039+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:20:11.009773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"59'1","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.315568+0000","last_change":"2023-11-26T07:15:12.300331+0000","last_active":"2023-11-26T07:15:13.315568+0000","last_peered":"2023-11-26T07:15:13.315568+0000","last_clean":"2023-11-26T07:15:13.315568+0000","last_became_active":"2023-11-26T07:15:12.300143+0000","last_became_peered":"2023-11-26T07:15:12.300143+0000","last_unstale":"2023-11-26T07:15:13.315568+0000","last_undegraded":"2023-11-26T07:15:13.315568+0000","last_fullsized":"2023-11-26T07:15:13.315568+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:37:43.540888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.464868+0000","last_change":"2023-11-26T07:15:13.303403+0000","last_active":"2023-11-26T07:15:14.464868+0000","last_peered":"2023-11-26T07:15:14.464868+0000","last_clean":"2023-11-26T07:15:14.464868+0000","last_became_active":"2023-11-26T07:15:13.303147+0000","last_became_peered":"2023-11-26T07:15:13.303147+0000","last_unstale":"2023-11-26T07:15:14.464868+0000","last_undegraded":"2023-11-26T07:15:14.464868+0000","last_fullsized":"2023-11-26T07:15:14.464868+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:05:41.521323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.308325+0000","last_change":"2023-11-26T07:15:12.305011+0000","last_active":"2023-11-26T07:15:13.308325+0000","last_peered":"2023-11-26T07:15:13.308325+0000","last_clean":"2023-11-26T07:15:13.308325+0000","last_became_active":"2023-11-26T07:15:12.304401+0000","last_became_peered":"2023-11-26T07:15:12.304401+0000","last_unstale":"2023-11-26T07:15:13.308325+0000","last_undegraded":"2023-11-26T07:15:13.308325+0000","last_fullsized":"2023-11-26T07:15:13.308325+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:31:59.656191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:16.145469+0000","last_change":"2023-11-26T07:15:13.296963+0000","last_active":"2023-11-26T07:15:16.145469+0000","last_peered":"2023-11-26T07:15:16.145469+0000","last_clean":"2023-11-26T07:15:16.145469+0000","last_became_active":"2023-11-26T07:15:13.296302+0000","last_became_peered":"2023-11-26T07:15:13.296302+0000","last_unstale":"2023-11-26T07:15:16.145469+0000","last_undegraded":"2023-11-26T07:15:16.145469+0000","last_fullsized":"2023-11-26T07:15:16.145469+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:47:27.696879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"59'2","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.319494+0000","last_change":"2023-11-26T07:15:12.303649+0000","last_active":"2023-11-26T07:15:13.319494+0000","last_peered":"2023-11-26T07:15:13.319494+0000","last_clean":"2023-11-26T07:15:13.319494+0000","last_became_active":"2023-11-26T07:15:12.303351+0000","last_became_peered":"2023-11-26T07:15:12.303351+0000","last_unstale":"2023-11-26T07:15:13.319494+0000","last_undegraded":"2023-11-26T07:15:13.319494+0000","last_fullsized":"2023-11-26T07:15:13.319494+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:09:12.614053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.716441+0000","last_change":"2023-11-26T07:15:13.310492+0000","last_active":"2023-11-26T07:15:14.716441+0000","last_peered":"2023-11-26T07:15:14.716441+0000","last_clean":"2023-11-26T07:15:14.716441+0000","last_became_active":"2023-11-26T07:15:13.310204+0000","last_became_peered":"2023-11-26T07:15:13.310204+0000","last_unstale":"2023-11-26T07:15:14.716441+0000","last_undegraded":"2023-11-26T07:15:14.716441+0000","last_fullsized":"2023-11-26T07:15:14.716441+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:34:11.863914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.292902+0000","last_change":"2023-11-26T07:15:12.305367+0000","last_active":"2023-11-26T07:15:13.292902+0000","last_peered":"2023-11-26T07:15:13.292902+0000","last_clean":"2023-11-26T07:15:13.292902+0000","last_became_active":"2023-11-26T07:15:12.305106+0000","last_became_peered":"2023-11-26T07:15:12.305106+0000","last_unstale":"2023-11-26T07:15:13.292902+0000","last_undegraded":"2023-11-26T07:15:13.292902+0000","last_fullsized":"2023-11-26T07:15:13.292902+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:35:32.544576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.716139+0000","last_change":"2023-11-26T07:15:13.309012+0000","last_active":"2023-11-26T07:15:14.716139+0000","last_peered":"2023-11-26T07:15:14.716139+0000","last_clean":"2023-11-26T07:15:14.716139+0000","last_became_active":"2023-11-26T07:15:13.308718+0000","last_became_peered":"2023-11-26T07:15:13.308718+0000","last_unstale":"2023-11-26T07:15:14.716139+0000","last_undegraded":"2023-11-26T07:15:14.716139+0000","last_fullsized":"2023-11-26T07:15:14.716139+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:36:54.675012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.288447+0000","last_change":"2023-11-26T07:15:12.302509+0000","last_active":"2023-11-26T07:15:13.288447+0000","last_peered":"2023-11-26T07:15:13.288447+0000","last_clean":"2023-11-26T07:15:13.288447+0000","last_became_active":"2023-11-26T07:15:12.302212+0000","last_became_peered":"2023-11-26T07:15:12.302212+0000","last_unstale":"2023-11-26T07:15:13.288447+0000","last_undegraded":"2023-11-26T07:15:13.288447+0000","last_fullsized":"2023-11-26T07:15:13.288447+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:19:24.338719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:16.145828+0000","last_change":"2023-11-26T07:15:13.297274+0000","last_active":"2023-11-26T07:15:16.145828+0000","last_peered":"2023-11-26T07:15:16.145828+0000","last_clean":"2023-11-26T07:15:16.145828+0000","last_became_active":"2023-11-26T07:15:13.296997+0000","last_became_peered":"2023-11-26T07:15:13.296997+0000","last_unstale":"2023-11-26T07:15:16.145828+0000","last_undegraded":"2023-11-26T07:15:16.145828+0000","last_fullsized":"2023-11-26T07:15:16.145828+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:51:40.949108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"59'2","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.319838+0000","last_change":"2023-11-26T07:15:12.303860+0000","last_active":"2023-11-26T07:15:13.319838+0000","last_peered":"2023-11-26T07:15:13.319838+0000","last_clean":"2023-11-26T07:15:13.319838+0000","last_became_active":"2023-11-26T07:15:12.303589+0000","last_became_peered":"2023-11-26T07:15:12.303589+0000","last_unstale":"2023-11-26T07:15:13.319838+0000","last_undegraded":"2023-11-26T07:15:13.319838+0000","last_fullsized":"2023-11-26T07:15:13.319838+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:59:59.911203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:16.145943+0000","last_change":"2023-11-26T07:15:13.298956+0000","last_active":"2023-11-26T07:15:16.145943+0000","last_peered":"2023-11-26T07:15:16.145943+0000","last_clean":"2023-11-26T07:15:16.145943+0000","last_became_active":"2023-11-26T07:15:13.298625+0000","last_became_peered":"2023-11-26T07:15:13.298625+0000","last_unstale":"2023-11-26T07:15:16.145943+0000","last_undegraded":"2023-11-26T07:15:16.145943+0000","last_fullsized":"2023-11-26T07:15:16.145943+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:32:00.657764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.301431+0000","last_change":"2023-11-26T07:15:12.304842+0000","last_active":"2023-11-26T07:15:13.301431+0000","last_peered":"2023-11-26T07:15:13.301431+0000","last_clean":"2023-11-26T07:15:13.301431+0000","last_became_active":"2023-11-26T07:15:12.304528+0000","last_became_peered":"2023-11-26T07:15:12.304528+0000","last_unstale":"2023-11-26T07:15:13.301431+0000","last_undegraded":"2023-11-26T07:15:13.301431+0000","last_fullsized":"2023-11-26T07:15:13.301431+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:32:57.449182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:15.182389+0000","last_change":"2023-11-26T07:15:13.304849+0000","last_active":"2023-11-26T07:15:15.182389+0000","last_peered":"2023-11-26T07:15:15.182389+0000","last_clean":"2023-11-26T07:15:15.182389+0000","last_became_active":"2023-11-26T07:15:13.304198+0000","last_became_peered":"2023-11-26T07:15:13.304198+0000","last_unstale":"2023-11-26T07:15:15.182389+0000","last_undegraded":"2023-11-26T07:15:15.182389+0000","last_fullsized":"2023-11-26T07:15:15.182389+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:57:20.002200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.292659+0000","last_change":"2023-11-26T07:15:12.305532+0000","last_active":"2023-11-26T07:15:13.292659+0000","last_peered":"2023-11-26T07:15:13.292659+0000","last_clean":"2023-11-26T07:15:13.292659+0000","last_became_active":"2023-11-26T07:15:12.305279+0000","last_became_peered":"2023-11-26T07:15:12.305279+0000","last_unstale":"2023-11-26T07:15:13.292659+0000","last_undegraded":"2023-11-26T07:15:13.292659+0000","last_fullsized":"2023-11-26T07:15:13.292659+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:40:48.323276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.716583+0000","last_change":"2023-11-26T07:15:13.310815+0000","last_active":"2023-11-26T07:15:14.716583+0000","last_peered":"2023-11-26T07:15:14.716583+0000","last_clean":"2023-11-26T07:15:14.716583+0000","last_became_active":"2023-11-26T07:15:13.309943+0000","last_became_peered":"2023-11-26T07:15:13.309943+0000","last_unstale":"2023-11-26T07:15:14.716583+0000","last_undegraded":"2023-11-26T07:15:14.716583+0000","last_fullsized":"2023-11-26T07:15:14.716583+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:14:34.734501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.289823+0000","last_change":"2023-11-26T07:15:12.297147+0000","last_active":"2023-11-26T07:15:13.289823+0000","last_peered":"2023-11-26T07:15:13.289823+0000","last_clean":"2023-11-26T07:15:13.289823+0000","last_became_active":"2023-11-26T07:15:12.296860+0000","last_became_peered":"2023-11-26T07:15:12.296860+0000","last_unstale":"2023-11-26T07:15:13.289823+0000","last_undegraded":"2023-11-26T07:15:13.289823+0000","last_fullsized":"2023-11-26T07:15:13.289823+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:56:56.583112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.289107+0000","last_change":"2023-11-26T07:15:13.308321+0000","last_active":"2023-11-26T07:15:14.289107+0000","last_peered":"2023-11-26T07:15:14.289107+0000","last_clean":"2023-11-26T07:15:14.289107+0000","last_became_active":"2023-11-26T07:15:13.308047+0000","last_became_peered":"2023-11-26T07:15:13.308047+0000","last_unstale":"2023-11-26T07:15:14.289107+0000","last_undegraded":"2023-11-26T07:15:14.289107+0000","last_fullsized":"2023-11-26T07:15:14.289107+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:26:05.233782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.291276+0000","last_change":"2023-11-26T07:15:12.303276+0000","last_active":"2023-11-26T07:15:13.291276+0000","last_peered":"2023-11-26T07:15:13.291276+0000","last_clean":"2023-11-26T07:15:13.291276+0000","last_became_active":"2023-11-26T07:15:12.302970+0000","last_became_peered":"2023-11-26T07:15:12.302970+0000","last_unstale":"2023-11-26T07:15:13.291276+0000","last_undegraded":"2023-11-26T07:15:13.291276+0000","last_fullsized":"2023-11-26T07:15:13.291276+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:45:41.712084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.464768+0000","last_change":"2023-11-26T07:15:13.316490+0000","last_active":"2023-11-26T07:15:14.464768+0000","last_peered":"2023-11-26T07:15:14.464768+0000","last_clean":"2023-11-26T07:15:14.464768+0000","last_became_active":"2023-11-26T07:15:13.316274+0000","last_became_peered":"2023-11-26T07:15:13.316274+0000","last_unstale":"2023-11-26T07:15:14.464768+0000","last_undegraded":"2023-11-26T07:15:14.464768+0000","last_fullsized":"2023-11-26T07:15:14.464768+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:36:54.675012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.291809+0000","last_change":"2023-11-26T07:15:12.301634+0000","last_active":"2023-11-26T07:15:13.291809+0000","last_peered":"2023-11-26T07:15:13.291809+0000","last_clean":"2023-11-26T07:15:13.291809+0000","last_became_active":"2023-11-26T07:15:12.301275+0000","last_became_peered":"2023-11-26T07:15:12.301275+0000","last_unstale":"2023-11-26T07:15:13.291809+0000","last_undegraded":"2023-11-26T07:15:13.291809+0000","last_fullsized":"2023-11-26T07:15:13.291809+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:29:51.899488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:15.182121+0000","last_change":"2023-11-26T07:15:13.298793+0000","last_active":"2023-11-26T07:15:15.182121+0000","last_peered":"2023-11-26T07:15:15.182121+0000","last_clean":"2023-11-26T07:15:15.182121+0000","last_became_active":"2023-11-26T07:15:13.298514+0000","last_became_peered":"2023-11-26T07:15:13.298514+0000","last_unstale":"2023-11-26T07:15:15.182121+0000","last_undegraded":"2023-11-26T07:15:15.182121+0000","last_fullsized":"2023-11-26T07:15:15.182121+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:05:42.391837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.292412+0000","last_change":"2023-11-26T07:15:12.299479+0000","last_active":"2023-11-26T07:15:13.292412+0000","last_peered":"2023-11-26T07:15:13.292412+0000","last_clean":"2023-11-26T07:15:13.292412+0000","last_became_active":"2023-11-26T07:15:12.299200+0000","last_became_peered":"2023-11-26T07:15:12.299200+0000","last_unstale":"2023-11-26T07:15:13.292412+0000","last_undegraded":"2023-11-26T07:15:13.292412+0000","last_fullsized":"2023-11-26T07:15:13.292412+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:13:53.960381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.288981+0000","last_change":"2023-11-26T07:15:13.313200+0000","last_active":"2023-11-26T07:15:14.288981+0000","last_peered":"2023-11-26T07:15:14.288981+0000","last_clean":"2023-11-26T07:15:14.288981+0000","last_became_active":"2023-11-26T07:15:13.312135+0000","last_became_peered":"2023-11-26T07:15:13.312135+0000","last_unstale":"2023-11-26T07:15:14.288981+0000","last_undegraded":"2023-11-26T07:15:14.288981+0000","last_fullsized":"2023-11-26T07:15:14.288981+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:58:56.123349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.292376+0000","last_change":"2023-11-26T07:15:12.303516+0000","last_active":"2023-11-26T07:15:13.292376+0000","last_peered":"2023-11-26T07:15:13.292376+0000","last_clean":"2023-11-26T07:15:13.292376+0000","last_became_active":"2023-11-26T07:15:12.302063+0000","last_became_peered":"2023-11-26T07:15:12.302063+0000","last_unstale":"2023-11-26T07:15:13.292376+0000","last_undegraded":"2023-11-26T07:15:13.292376+0000","last_fullsized":"2023-11-26T07:15:13.292376+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:46:10.847558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.288816+0000","last_change":"2023-11-26T07:15:13.312690+0000","last_active":"2023-11-26T07:15:14.288816+0000","last_peered":"2023-11-26T07:15:14.288816+0000","last_clean":"2023-11-26T07:15:14.288816+0000","last_became_active":"2023-11-26T07:15:13.312231+0000","last_became_peered":"2023-11-26T07:15:13.312231+0000","last_unstale":"2023-11-26T07:15:14.288816+0000","last_undegraded":"2023-11-26T07:15:14.288816+0000","last_fullsized":"2023-11-26T07:15:14.288816+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:06:10.287535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.292682+0000","last_change":"2023-11-26T07:15:12.300358+0000","last_active":"2023-11-26T07:15:13.292682+0000","last_peered":"2023-11-26T07:15:13.292682+0000","last_clean":"2023-11-26T07:15:13.292682+0000","last_became_active":"2023-11-26T07:15:12.300179+0000","last_became_peered":"2023-11-26T07:15:12.300179+0000","last_unstale":"2023-11-26T07:15:13.292682+0000","last_undegraded":"2023-11-26T07:15:13.292682+0000","last_fullsized":"2023-11-26T07:15:13.292682+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:05:41.390264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":199,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.293338+0000","last_change":"2023-11-26T07:11:29.855919+0000","last_active":"2023-11-26T07:15:13.293338+0000","last_peered":"2023-11-26T07:15:13.293338+0000","last_clean":"2023-11-26T07:15:13.293338+0000","last_became_active":"2023-11-26T07:11:29.854903+0000","last_became_peered":"2023-11-26T07:11:29.854903+0000","last_unstale":"2023-11-26T07:15:13.293338+0000","last_undegraded":"2023-11-26T07:15:13.293338+0000","last_fullsized":"2023-11-26T07:15:13.293338+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:28.594252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:28.594252+0000","last_clean_scrub_stamp":"2023-11-26T07:11:28.594252+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:33:34.642696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28312,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343528,"statfs":{"total":96636764160,"available":96607772672,"internally_reserved":0,"allocated":1323008,"data_stored":892657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:14:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.35899999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.73699999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51300000000000001,"15min":0.505},"min":{"1min":0.38700000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.65600000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.48799999999999999}]},{"osd":1,"last update":"Sun Nov 26 07:14:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.84799999999999998,"15min":0.97999999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.71499999999999997,"5min":9.5600000000000005,"15min":9.5600000000000005},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.56899999999999995,"15min":0.57999999999999996},"min":{"1min":0.41599999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.70199999999999996,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.64700000000000002}]},{"osd":2,"last update":"Sun Nov 26 07:14:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59599999999999997,"15min":0.60199999999999998},"min":{"1min":0.36799999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73299999999999998,"5min":1.569,"15min":1.569},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.63900000000000001,"15min":0.64900000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.85699999999999998,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.50900000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:14:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.59599999999999997,"15min":0.60399999999999998},"min":{"1min":0.42899999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68200000000000005,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57899999999999996,"15min":0.56699999999999995},"min":{"1min":0.44700000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78500000000000003,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.59599999999999997}]},{"osd":4,"last update":"Sun Nov 26 07:14:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.372,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70399999999999996,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53500000000000003,"15min":0.51500000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.82999999999999996,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.46800000000000003}]},{"osd":5,"last update":"Sun Nov 26 07:14:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.37,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63,"15min":0.63300000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80900000000000005,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.58299999999999996}]},{"osd":6,"last update":"Sun Nov 26 07:14:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59499999999999997,"15min":0.59099999999999997},"min":{"1min":0.437,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60299999999999998,"15min":0.59299999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89100000000000001,"5min":1.552,"15min":1.552},"last":0.56899999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":720896,"data_stored":302129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.503,"15min":0.48399999999999999},"min":{"1min":0.311,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.76700000000000002,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.504,"15min":0.47599999999999998},"min":{"1min":0.38200000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.69899999999999995,"5min":0.871,"15min":0.871},"last":0.56100000000000005}]},{"osd":1,"last update":"Sun Nov 26 07:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52300000000000002,"15min":0.51100000000000001},"min":{"1min":0.35199999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.73599999999999999,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.442},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55000000000000004,"15min":0.54400000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.83599999999999997,"5min":1.198,"15min":1.198},"last":0.54000000000000004}]},{"osd":2,"last update":"Sun Nov 26 07:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51600000000000001,"15min":0.495},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.71899999999999997,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.54800000000000004,"15min":0.52300000000000002},"min":{"1min":0.437,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.495}]},{"osd":3,"last update":"Sun Nov 26 07:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.57499999999999996,"15min":0.55100000000000005},"min":{"1min":0.435,"5min":0.373,"15min":0.373},"max":{"1min":0.81999999999999995,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.629},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.60099999999999998,"15min":0.58299999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79100000000000004,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.59499999999999997}]},{"osd":4,"last update":"Sun Nov 26 07:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.52800000000000002,"15min":0.53200000000000003},"min":{"1min":0.33600000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70599999999999996,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.34100000000000003,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.78900000000000003,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.52200000000000002}]},{"osd":5,"last update":"Sun Nov 26 07:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56399999999999995,"15min":0.56000000000000005},"min":{"1min":0.40200000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.71599999999999997,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58399999999999996,"15min":0.58799999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77300000000000002,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.61099999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59299999999999997,"15min":0.59099999999999997},"min":{"1min":0.42799999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73899999999999999,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.628,"15min":0.626},"min":{"1min":0.45800000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.75700000000000001,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.68999999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31888,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339952,"statfs":{"total":96636764160,"available":96604110848,"internally_reserved":0,"allocated":724992,"data_stored":302219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.35499999999999998,"15min":0.36399999999999999},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.68400000000000005,"15min":0.83399999999999996},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.496,"5min":11.922000000000001,"15min":11.922000000000001},"last":0.45300000000000001}]},{"osd":2,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.36199999999999999,"15min":0.373},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.52600000000000002,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.318},{"interface":"front","average":{"1min":0.379,"5min":0.40200000000000002,"15min":0.40799999999999997},"min":{"1min":0.27400000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.59099999999999997,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.435}]},{"osd":3,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.45000000000000001,"15min":0.45800000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.61799999999999999,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.435,"15min":0.441},"min":{"1min":0.313,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.59899999999999998,"5min":1.101,"15min":1.101},"last":0.41599999999999998}]},{"osd":4,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.80100000000000005,"15min":0.88500000000000001},"min":{"1min":0.44700000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.97299999999999998,"5min":6.8979999999999997,"15min":6.8979999999999997},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.65700000000000003,"15min":0.66500000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.66300000000000003}]},{"osd":5,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.622,"15min":0.628},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.05,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.497},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.80800000000000005,"15min":0.89200000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.087,"5min":6.9480000000000004,"15min":6.9480000000000004},"last":0.55200000000000005}]},{"osd":6,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.65200000000000002,"15min":0.66200000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.80600000000000005,"5min":1.194,"15min":1.194},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.82299999999999995,"15min":0.91700000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.89300000000000002,"5min":6.9800000000000004,"15min":6.9800000000000004},"last":0.63300000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65700000000000003,"15min":0.66000000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67200000000000004,"15min":0.68500000000000005},"min":{"1min":0.48699999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.91200000000000003,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.57899999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32480,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339360,"statfs":{"total":96636764160,"available":96603504640,"internally_reserved":0,"allocated":1331200,"data_stored":894691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.35399999999999998,"15min":0.372},"min":{"1min":0.23400000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.42399999999999999,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.70499999999999996,"15min":0.86099999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.42099999999999999,"5min":11.987,"15min":11.987},"last":0.33400000000000002}]},{"osd":2,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.41099999999999998,"15min":0.437},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.432,"5min":1.607,"15min":1.607},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.375,"5min":0.40200000000000002,"15min":0.41399999999999998},"min":{"1min":0.27700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.54300000000000004,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.29099999999999998}]},{"osd":3,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.38100000000000001,"15min":0.38900000000000001},"min":{"1min":0.27800000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.497,"5min":0.752,"15min":0.752},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.45400000000000001,"15min":0.47399999999999998},"min":{"1min":0.32500000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.51500000000000001,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.38700000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.64100000000000001,"15min":0.65800000000000003},"min":{"1min":0.432,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.753,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.81599999999999995,"15min":0.90600000000000003},"min":{"1min":0.42999999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.75700000000000001,"5min":6.5279999999999996,"15min":6.5279999999999996},"last":0.55100000000000005}]},{"osd":5,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.64200000000000002,"15min":0.65400000000000003},"min":{"1min":0.46400000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.77100000000000002,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.68000000000000005,"15min":0.69899999999999995},"min":{"1min":0.51700000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.81799999999999995,"5min":1.508,"15min":1.508},"last":0.59199999999999997}]},{"osd":6,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.84999999999999998,"15min":0.94299999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.79400000000000004,"5min":6.5419999999999998,"15min":6.5419999999999998},"last":0.505},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.66000000000000003,"15min":0.68000000000000005},"min":{"1min":0.48299999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.755,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.626}]},{"osd":7,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.68400000000000005,"15min":0.70399999999999996},"min":{"1min":0.48399999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.74299999999999999,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.65500000000000003,"15min":0.66700000000000004},"min":{"1min":0.44800000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.82299999999999995,"5min":1.155,"15min":1.155},"last":0.60999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31892,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339948,"statfs":{"total":96636764160,"available":96604106752,"internally_reserved":0,"allocated":729088,"data_stored":302185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:14:36 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.34000000000000002,"15min":0.34599999999999997},"min":{"1min":0.24199999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.25},{"interface":"front","average":{"1min":0.375,"5min":0.39500000000000002,"15min":0.39900000000000002},"min":{"1min":0.32100000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.49099999999999999,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.36399999999999999}]},{"osd":1,"last update":"Sun Nov 26 07:14:36 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34399999999999997,"15min":0.34799999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.373,"15min":0.376},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.57199999999999995,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.32700000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:14:36 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.40200000000000002,"15min":0.41299999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.51000000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.377,"15min":0.38300000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.52500000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.29699999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:14:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.73999999999999999,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.57599999999999996,"15min":0.57799999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.91500000000000004}]},{"osd":5,"last update":"Sun Nov 26 07:14:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57299999999999995,"15min":0.57399999999999995},"min":{"1min":0.39500000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.621,"15min":0.63300000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.86299999999999999,"5min":1.002,"15min":1.002},"last":0.63500000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:14:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.60699999999999998,"15min":0.61099999999999999},"min":{"1min":0.42199999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77500000000000002,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.628,"15min":0.63400000000000001},"min":{"1min":0.45600000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.83099999999999996,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.74399999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:14:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.62,"15min":0.629},"min":{"1min":0.41999999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.76700000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.621,"15min":0.623},"min":{"1min":0.47399999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.85199999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.97699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574898,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31892,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339948,"statfs":{"total":96636764160,"available":96604106752,"internally_reserved":0,"allocated":729088,"data_stored":302185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:14:33 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.35199999999999998,"15min":0.36899999999999999},"min":{"1min":0.23400000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.48499999999999999,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.313},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.40200000000000002,"15min":0.42199999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.52900000000000003,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.443}]},{"osd":1,"last update":"Sun Nov 26 07:14:33 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.38600000000000001,"15min":0.40699999999999997},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.47799999999999998,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.46600000000000003,"15min":0.50900000000000001},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.55100000000000005,"5min":2.903,"15min":2.903},"last":0.39500000000000002}]},{"osd":2,"last update":"Sun Nov 26 07:14:33 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.39600000000000002,"15min":0.40500000000000003},"min":{"1min":0.28100000000000003,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.503,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.40600000000000003,"15min":0.41799999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.53900000000000003,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.41599999999999998}]},{"osd":4,"last update":"Sun Nov 26 07:14:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.67300000000000004,"15min":0.71299999999999997},"min":{"1min":0.41399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80900000000000005,"5min":2.9609999999999999,"15min":2.9609999999999999},"last":0.502},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.629,"15min":0.64300000000000002},"min":{"1min":0.40600000000000003,"5min":0.373,"15min":0.373},"max":{"1min":0.79400000000000004,"5min":1.163,"15min":1.163},"last":0.57099999999999995}]},{"osd":5,"last update":"Sun Nov 26 07:14:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66200000000000003,"15min":0.67600000000000005},"min":{"1min":0.42599999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.64900000000000002,"15min":0.66700000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.871,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.46400000000000002}]},{"osd":6,"last update":"Sun Nov 26 07:14:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.65000000000000002,"15min":0.67300000000000004},"min":{"1min":0.45500000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.83499999999999996,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.66000000000000003,"15min":0.68200000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.76400000000000001,"5min":1.258,"15min":1.258},"last":0.55600000000000005}]},{"osd":7,"last update":"Sun Nov 26 07:14:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.66000000000000003,"15min":0.68500000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.82199999999999995,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.624},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.72399999999999998,"15min":0.76100000000000001},"min":{"1min":0.48599999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0780000000000001,"5min":2.9969999999999999,"15min":2.9969999999999999},"last":0.54400000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31904,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339936,"statfs":{"total":96636764160,"available":96604094464,"internally_reserved":0,"allocated":733184,"data_stored":303741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.82299999999999995,"15min":0.94099999999999995},"min":{"1min":0.39700000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.70199999999999996,"5min":8.7539999999999996,"15min":8.7539999999999996},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.84599999999999997,"15min":0.95999999999999996},"min":{"1min":0.40500000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.88200000000000001,"5min":8.7390000000000008,"15min":8.7390000000000008},"last":0.625}]},{"osd":1,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.86299999999999999,"15min":0.99399999999999999},"min":{"1min":0.40999999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.77400000000000002,"5min":9.7720000000000002,"15min":9.7720000000000002},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.34699999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.80000000000000004,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.53600000000000003}]},{"osd":2,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.83199999999999996,"15min":0.94799999999999995},"min":{"1min":0.42999999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.73199999999999998,"5min":9.8119999999999994,"15min":9.8119999999999994},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.76800000000000002,"15min":0.84399999999999997},"min":{"1min":0.38800000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78700000000000003,"5min":3.645,"15min":3.645},"last":0.51300000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.874,"15min":0.98999999999999999},"min":{"1min":0.436,"5min":0.434,"15min":0.434},"max":{"1min":0.76500000000000001,"5min":8.8089999999999993,"15min":8.8089999999999993},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.77400000000000002,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.60499999999999998}]},{"osd":5,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.51400000000000001,"15min":0.502},"min":{"1min":0.32700000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.55800000000000005,"15min":0.55300000000000005},"min":{"1min":0.39800000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.65800000000000003}]},{"osd":6,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58799999999999997,"15min":0.58099999999999996},"min":{"1min":0.48099999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56799999999999995,"15min":0.57399999999999995},"min":{"1min":0.34899999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.74399999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.79600000000000004}]},{"osd":7,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59499999999999997,"15min":0.59399999999999997},"min":{"1min":0.41899999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.81100000000000005,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.60499999999999998,"15min":0.60399999999999998},"min":{"1min":0.40200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.82899999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":729088,"data_stored":302781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.56399999999999995,"15min":0.53200000000000003},"min":{"1min":0.36099999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":7.1500000000000004,"5min":7.1500000000000004,"15min":7.1500000000000004},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.59899999999999998,"15min":0.57299999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":6.8470000000000004,"5min":6.8470000000000004,"15min":6.8470000000000004},"last":0.58399999999999996}]},{"osd":1,"last update":"Sun Nov 26 07:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.58799999999999997,"15min":0.55600000000000005},"min":{"1min":0.372,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":7.1269999999999998,"5min":7.1269999999999998,"15min":7.1269999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.34499999999999997,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.47699999999999998}]},{"osd":2,"last update":"Sun Nov 26 07:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.629,"15min":0.59299999999999997},"min":{"1min":0.40100000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":7.2000000000000002,"5min":7.2000000000000002,"15min":7.2000000000000002},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.65400000000000003,"15min":0.61799999999999999},"min":{"1min":0.46100000000000002,"5min":0.379,"15min":0.379},"max":{"1min":7.8259999999999996,"5min":7.8259999999999996,"15min":7.8259999999999996},"last":0.67900000000000005}]},{"osd":3,"last update":"Sun Nov 26 07:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.57399999999999995,"15min":0.56299999999999994},"min":{"1min":0.39000000000000001,"5min":0.372,"15min":0.372},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.879,"5min":0.64200000000000002,"15min":0.60499999999999998},"min":{"1min":0.40200000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":6.9240000000000004,"5min":6.9240000000000004,"15min":6.9240000000000004},"last":0.502}]},{"osd":4,"last update":"Sun Nov 26 07:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.55400000000000005,"15min":0.51000000000000001},"min":{"1min":0.36399999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":7.2830000000000004,"5min":7.2830000000000004,"15min":7.2830000000000004},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.57999999999999996,"15min":0.57499999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.66500000000000004}]},{"osd":6,"last update":"Sun Nov 26 07:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.61799999999999999,"15min":0.57099999999999995},"min":{"1min":0.35599999999999998,"5min":0.308,"15min":0.308},"max":{"1min":6.8890000000000002,"5min":6.8890000000000002,"15min":6.8890000000000002},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.63,"15min":0.58899999999999997},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":7.2430000000000003,"5min":7.2430000000000003,"15min":7.2430000000000003},"last":0.72399999999999998}]},{"osd":7,"last update":"Sun Nov 26 07:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.64900000000000002,"15min":0.60599999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":6.9880000000000004,"5min":6.9880000000000004,"15min":6.9880000000000004},"last":0.69199999999999995},{"interface":"front","average":{"1min":1.1519999999999999,"5min":0.72799999999999998,"15min":0.65700000000000003},"min":{"1min":0.44800000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":11.874000000000001,"5min":11.874000000000001,"15min":11.874000000000001},"last":0.754}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:15:18.252 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-26T07:15:18.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.412+0000 7f7eee99e700 1 Processor -- start 2023-11-26T07:15:18.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.412+0000 7f7eee99e700 1 -- start start 2023-11-26T07:15:18.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.412+0000 7f7eee99e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7ee806b6e0 0x7f7ee806db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:18.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.412+0000 7f7eee99e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7ee8145100 0x7f7ee806e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:18.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.412+0000 7f7eee99e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee8160720 con 0x7f7ee8144c10 2023-11-26T07:15:18.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.412+0000 7f7eee99e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ee806f500 con 0x7f7ee806b6e0 2023-11-26T07:15:18.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.412+0000 7f7eee99e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ee80cd610 con 0x7f7ee8145100 2023-11-26T07:15:18.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.413+0000 7f7ee77fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7ee806b6e0 0x7f7ee806db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:18.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.413+0000 7f7ee77fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7ee806b6e0 0x7f7ee806db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43166/0 (socket says 172.21.15.2:43166) 2023-11-26T07:15:18.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.413+0000 7f7ee77fe700 1 -- 172.21.15.2:0/2684938179 learned_addr learned my addr 172.21.15.2:0/2684938179 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:18.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.413+0000 7f7eecf3b700 1 --2- 172.21.15.2:0/2684938179 >> v2:172.21.15.192:3300/0 conn(0x7f7ee8145100 0x7f7ee806e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:18.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.413+0000 7f7ee77fe700 1 -- 172.21.15.2:0/2684938179 >> v2:172.21.15.192:3300/0 conn(0x7f7ee8145100 msgr2=0x7f7ee806e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:18.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.413+0000 7f7ee77fe700 1 --2- 172.21.15.2:0/2684938179 >> v2:172.21.15.192:3300/0 conn(0x7f7ee8145100 0x7f7ee806e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:18.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.413+0000 7f7ee77fe700 1 -- 172.21.15.2:0/2684938179 >> v1:172.21.15.192:6789/0 conn(0x7f7ee8144c10 legacy=0x7f7ee806afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:18.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.413+0000 7f7ee77fe700 1 -- 172.21.15.2:0/2684938179 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee806f710 con 0x7f7ee806b6e0 2023-11-26T07:15:18.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.413+0000 7f7ee77fe700 1 --2- 172.21.15.2:0/2684938179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ee806b6e0 0x7f7ee806db70 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f7ee815c410 tx=0x7f7ed8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7140b5c8d9e56cf server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:18.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.413+0000 7f7ee6ffd700 1 -- 172.21.15.2:0/2684938179 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed8004230 con 0x7f7ee806b6e0 2023-11-26T07:15:18.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.413+0000 7f7ee6ffd700 1 -- 172.21.15.2:0/2684938179 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed8004390 con 0x7f7ee806b6e0 2023-11-26T07:15:18.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.413+0000 7f7ee6ffd700 1 -- 172.21.15.2:0/2684938179 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed80036a0 con 0x7f7ee806b6e0 2023-11-26T07:15:18.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.414+0000 7f7eee99e700 1 -- 172.21.15.2:0/2684938179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ee806b6e0 msgr2=0x7f7ee806db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:18.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.414+0000 7f7eee99e700 1 --2- 172.21.15.2:0/2684938179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ee806b6e0 0x7f7ee806db70 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f7ee815c410 tx=0x7f7ed8009bd0 comp rx=0 tx=0).stop 2023-11-26T07:15:18.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.414+0000 7f7eee99e700 1 -- 172.21.15.2:0/2684938179 shutdown_connections 2023-11-26T07:15:18.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.414+0000 7f7eee99e700 1 --2- 172.21.15.2:0/2684938179 >> v2:172.21.15.192:3300/0 conn(0x7f7ee8145100 0x7f7ee806e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:18.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.414+0000 7f7eee99e700 1 --2- 172.21.15.2:0/2684938179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ee806b6e0 0x7f7ee806db70 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:18.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.414+0000 7f7eee99e700 1 -- 172.21.15.2:0/2684938179 >> 172.21.15.2:0/2684938179 conn(0x7f7ee80b2740 msgr2=0x7f7ee80b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:18.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.414+0000 7f7eee99e700 1 -- 172.21.15.2:0/2684938179 shutdown_connections 2023-11-26T07:15:18.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.414+0000 7f7eee99e700 1 -- 172.21.15.2:0/2684938179 wait complete. 2023-11-26T07:15:18.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.415+0000 7f7eee99e700 1 Processor -- start 2023-11-26T07:15:18.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.415+0000 7f7eee99e700 1 -- start start 2023-11-26T07:15:18.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.416+0000 7f7eee99e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ee806b6e0 0x7f7ee80cb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:18.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.416+0000 7f7eee99e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ee8144c10 0x7f7ee80cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:18.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.416+0000 7f7eee99e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ee8145100 0x7f7ee81351d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:18.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.416+0000 7f7eee99e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee80c6b80 con 0x7f7ee8145100 2023-11-26T07:15:18.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.416+0000 7f7eee99e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee8135f60 con 0x7f7ee8144c10 2023-11-26T07:15:18.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.416+0000 7f7eee99e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee80c6e40 con 0x7f7ee806b6e0 2023-11-26T07:15:18.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.416+0000 7f7eecf3b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ee8145100 0x7f7ee81351d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:18.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.416+0000 7f7eecf3b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ee8145100 0x7f7ee81351d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43176/0 (socket says 172.21.15.2:43176) 2023-11-26T07:15:18.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.416+0000 7f7eecf3b700 1 -- 172.21.15.2:0/3543323513 learned_addr learned my addr 172.21.15.2:0/3543323513 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:18.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.417+0000 7f7ee77fe700 1 --2- 172.21.15.2:0/3543323513 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ee8144c10 0x7f7ee80cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:18.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.417+0000 7f7eecf3b700 1 -- 172.21.15.2:0/3543323513 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ee806b6e0 msgr2=0x7f7ee80cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:18.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.417+0000 7f7ee7fff700 1 --2- 172.21.15.2:0/3543323513 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ee806b6e0 0x7f7ee80cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:18.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.417+0000 7f7eecf3b700 1 --2- 172.21.15.2:0/3543323513 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ee806b6e0 0x7f7ee80cb980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:18.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.417+0000 7f7eecf3b700 1 -- 172.21.15.2:0/3543323513 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ee8144c10 msgr2=0x7f7ee80cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:18.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.417+0000 7f7eecf3b700 1 --2- 172.21.15.2:0/3543323513 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ee8144c10 0x7f7ee80cbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:18.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.417+0000 7f7eecf3b700 1 -- 172.21.15.2:0/3543323513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed8009550 con 0x7f7ee8145100 2023-11-26T07:15:18.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.417+0000 7f7ee77fe700 1 --2- 172.21.15.2:0/3543323513 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ee8144c10 0x7f7ee80cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:15:18.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.417+0000 7f7eecf3b700 1 --2- 172.21.15.2:0/3543323513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ee8145100 0x7f7ee81351d0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0009fd0 tx=0x7f7ee000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:18.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.417+0000 7f7ee4ff9700 1 -- 172.21.15.2:0/3543323513 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee000ede0 con 0x7f7ee8145100 2023-11-26T07:15:18.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.417+0000 7f7ee4ff9700 1 -- 172.21.15.2:0/3543323513 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee0014420 con 0x7f7ee8145100 2023-11-26T07:15:18.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.417+0000 7f7eee99e700 1 -- 172.21.15.2:0/3543323513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee80c7120 con 0x7f7ee8145100 2023-11-26T07:15:18.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.417+0000 7f7ee4ff9700 1 -- 172.21.15.2:0/3543323513 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee00147d0 con 0x7f7ee8145100 2023-11-26T07:15:18.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.417+0000 7f7eee99e700 1 -- 172.21.15.2:0/3543323513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee815bac0 con 0x7f7ee8145100 2023-11-26T07:15:18.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.418+0000 7f7eee99e700 1 -- 172.21.15.2:0/3543323513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ee80c7360 con 0x7f7ee8145100 2023-11-26T07:15:18.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.418+0000 7f7ee4ff9700 1 -- 172.21.15.2:0/3543323513 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f7ee0014930 con 0x7f7ee8145100 2023-11-26T07:15:18.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.419+0000 7f7ee4ff9700 1 --2- 172.21.15.2:0/3543323513 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7ec806b470 0x7f7ec806d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:18.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.419+0000 7f7ee4ff9700 1 -- 172.21.15.2:0/3543323513 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ee008a650 con 0x7f7ee8145100 2023-11-26T07:15:18.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.419+0000 7f7ee7fff700 1 --2- 172.21.15.2:0/3543323513 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7ec806b470 0x7f7ec806d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:18.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.420+0000 7f7ee7fff700 1 --2- 172.21.15.2:0/3543323513 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7ec806b470 0x7f7ec806d930 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0003e60 tx=0x7f7ed0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:18.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.423+0000 7f7ee4ff9700 1 -- 172.21.15.2:0/3543323513 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7ee80c7360 con 0x7f7ee8145100 2023-11-26T07:15:18.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.708+0000 7f7eee99e700 1 -- 172.21.15.2:0/3543323513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f7ee80c7360 con 0x7f7ee8145100 2023-11-26T07:15:18.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.709+0000 7f7ee4ff9700 1 -- 172.21.15.2:0/3543323513 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1012 (secure 0 0 0) 0x7f7ee80c7360 con 0x7f7ee8145100 2023-11-26T07:15:18.710 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:15:18.711 INFO:teuthology.orchestra.run.smithi002.stdout:{"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":242,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":60,"num_osds":8,"num_up_osds":8,"osd_up_since":1700982686,"num_in_osds":8,"osd_in_since":1700982678,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592778,"bytes_used":249675776,"bytes_avail":772844437504,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":36,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"a","status":"up:active","gid":6174}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2023-11-26T07:14:56.204697+0000","services":{}},"progress_events":{}} 2023-11-26T07:15:18.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.711+0000 7f7eee99e700 1 -- 172.21.15.2:0/3543323513 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7ec806b470 msgr2=0x7f7ec806d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:18.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.711+0000 7f7eee99e700 1 --2- 172.21.15.2:0/3543323513 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7ec806b470 0x7f7ec806d930 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0003e60 tx=0x7f7ed0009040 comp rx=0 tx=0).stop 2023-11-26T07:15:18.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.711+0000 7f7eee99e700 1 -- 172.21.15.2:0/3543323513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ee8145100 msgr2=0x7f7ee81351d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:18.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.711+0000 7f7eee99e700 1 --2- 172.21.15.2:0/3543323513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ee8145100 0x7f7ee81351d0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0009fd0 tx=0x7f7ee000e3c0 comp rx=0 tx=0).stop 2023-11-26T07:15:18.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.711+0000 7f7eee99e700 1 -- 172.21.15.2:0/3543323513 shutdown_connections 2023-11-26T07:15:18.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.711+0000 7f7eee99e700 1 --2- 172.21.15.2:0/3543323513 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7ec806b470 0x7f7ec806d930 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:18.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.711+0000 7f7eee99e700 1 --2- 172.21.15.2:0/3543323513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ee8145100 0x7f7ee81351d0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:18.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.711+0000 7f7eee99e700 1 --2- 172.21.15.2:0/3543323513 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ee806b6e0 0x7f7ee80cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:18.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.711+0000 7f7eee99e700 1 --2- 172.21.15.2:0/3543323513 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ee8144c10 0x7f7ee80cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:18.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.711+0000 7f7eee99e700 1 -- 172.21.15.2:0/3543323513 >> 172.21.15.2:0/3543323513 conn(0x7f7ee80b2740 msgr2=0x7f7ee80cf140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:18.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.711+0000 7f7eee99e700 1 -- 172.21.15.2:0/3543323513 shutdown_connections 2023-11-26T07:15:18.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.711+0000 7f7eee99e700 1 -- 172.21.15.2:0/3543323513 wait complete. 2023-11-26T07:15:18.725 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-26T07:15:18.725 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:15:18.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.847+0000 7f114c8d3700 1 Processor -- start 2023-11-26T07:15:18.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.847+0000 7f114c8d3700 1 -- start start 2023-11-26T07:15:18.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.848+0000 7f114c8d3700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f114806b620 0x7f11480b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:18.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.848+0000 7f114c8d3700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f11480b5ab0 0x7f11480b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:18.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.848+0000 7f114c8d3700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1148071f50 con 0x7f11481478c0 2023-11-26T07:15:18.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.848+0000 7f114c8d3700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1148072230 con 0x7f114806b620 2023-11-26T07:15:18.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.848+0000 7f114c8d3700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1148072510 con 0x7f11480b5ab0 2023-11-26T07:15:18.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.849+0000 7f114659c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f114806b620 0x7f11480b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:18.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.849+0000 7f1146d9d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f11481478c0 0x7f1148161ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34390/0 (socket says 172.21.15.2:34390) 2023-11-26T07:15:18.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.849+0000 7f1146d9d700 1 -- 172.21.15.2:0/2123976772 learned_addr learned my addr 172.21.15.2:0/2123976772 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:15:18.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.849+0000 7f114659c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f114806b620 0x7f11480b3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43180/0 (socket says 172.21.15.2:43180) 2023-11-26T07:15:18.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.849+0000 7f1145d9b700 1 --2- 172.21.15.2:0/2123976772 >> v2:172.21.15.192:3300/0 conn(0x7f11480b5ab0 0x7f11480b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:18.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.849+0000 7f114659c700 1 -- 172.21.15.2:0/2123976772 >> v2:172.21.15.192:3300/0 conn(0x7f11480b5ab0 msgr2=0x7f11480b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:18.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.849+0000 7f114659c700 1 --2- 172.21.15.2:0/2123976772 >> v2:172.21.15.192:3300/0 conn(0x7f11480b5ab0 0x7f11480b3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:18.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.849+0000 7f114659c700 1 -- 172.21.15.2:0/2123976772 >> v1:172.21.15.2:6789/0 conn(0x7f11481478c0 legacy=0x7f1148161ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:18.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.849+0000 7f114559a700 1 -- 172.21.15.2:0/2123976772 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1258131163 0 0) 0x7f1148071f50 con 0x7f11481478c0 2023-11-26T07:15:18.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.849+0000 7f114659c700 1 -- 172.21.15.2:0/2123976772 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11480727f0 con 0x7f114806b620 2023-11-26T07:15:18.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.849+0000 7f114659c700 1 --2- 172.21.15.2:0/2123976772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f114806b620 0x7f11480b3a40 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f114806d6f0 tx=0x7f1138009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97daaa3aca53cd5d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:18.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.849+0000 7f114559a700 1 -- 172.21.15.2:0/2123976772 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1138011830 con 0x7f114806b620 2023-11-26T07:15:18.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.849+0000 7f114559a700 1 -- 172.21.15.2:0/2123976772 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1138011990 con 0x7f114806b620 2023-11-26T07:15:18.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.849+0000 7f114559a700 1 -- 172.21.15.2:0/2123976772 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1138011d20 con 0x7f114806b620 2023-11-26T07:15:18.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.850+0000 7f114c8d3700 1 -- 172.21.15.2:0/2123976772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f114806b620 msgr2=0x7f11480b3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:18.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.850+0000 7f114c8d3700 1 --2- 172.21.15.2:0/2123976772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f114806b620 0x7f11480b3a40 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f114806d6f0 tx=0x7f1138009b20 comp rx=0 tx=0).stop 2023-11-26T07:15:18.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.850+0000 7f114c8d3700 1 -- 172.21.15.2:0/2123976772 shutdown_connections 2023-11-26T07:15:18.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.850+0000 7f114c8d3700 1 --2- 172.21.15.2:0/2123976772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f114806b620 0x7f11480b3a40 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:18.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.850+0000 7f114c8d3700 1 --2- 172.21.15.2:0/2123976772 >> v2:172.21.15.192:3300/0 conn(0x7f11480b5ab0 0x7f11480b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:18.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.850+0000 7f114c8d3700 1 -- 172.21.15.2:0/2123976772 >> 172.21.15.2:0/2123976772 conn(0x7f11480b2740 msgr2=0x7f11480b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:18.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.850+0000 7f114c8d3700 1 -- 172.21.15.2:0/2123976772 shutdown_connections 2023-11-26T07:15:18.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.850+0000 7f114c8d3700 1 -- 172.21.15.2:0/2123976772 wait complete. 2023-11-26T07:15:18.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.851+0000 7f114c8d3700 1 Processor -- start 2023-11-26T07:15:18.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.851+0000 7f114c8d3700 1 -- start start 2023-11-26T07:15:18.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.852+0000 7f114c8d3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f114806b620 0x7f11481e7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:18.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.852+0000 7f114c8d3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11480b5ab0 0x7f11481e5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:18.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.852+0000 7f114c8d3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11481478c0 0x7f11481e5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:18.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.852+0000 7f114c8d3700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114813f020 con 0x7f11480b5ab0 2023-11-26T07:15:18.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.852+0000 7f114c8d3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114813ed10 con 0x7f11481478c0 2023-11-26T07:15:18.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.852+0000 7f114c8d3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11481d8900 con 0x7f114806b620 2023-11-26T07:15:18.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.852+0000 7f1145d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11480b5ab0 0x7f11481e5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:18.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.852+0000 7f1145d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11480b5ab0 0x7f11481e5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43184/0 (socket says 172.21.15.2:43184) 2023-11-26T07:15:18.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.852+0000 7f1145d9b700 1 -- 172.21.15.2:0/4179194862 learned_addr learned my addr 172.21.15.2:0/4179194862 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:18.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.852+0000 7f1145d9b700 1 -- 172.21.15.2:0/4179194862 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f114806b620 msgr2=0x7f11481e7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:18.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.852+0000 7f1145d9b700 1 --2- 172.21.15.2:0/4179194862 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f114806b620 0x7f11481e7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:18.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.852+0000 7f1145d9b700 1 -- 172.21.15.2:0/4179194862 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11481478c0 msgr2=0x7f11481e5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:18.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.852+0000 7f1145d9b700 1 --2- 172.21.15.2:0/4179194862 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11481478c0 0x7f11481e5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:18.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.852+0000 7f1145d9b700 1 -- 172.21.15.2:0/4179194862 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11380094a0 con 0x7f11480b5ab0 2023-11-26T07:15:18.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.853+0000 7f1145d9b700 1 --2- 172.21.15.2:0/4179194862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11480b5ab0 0x7f11481e5930 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f113000c820 tx=0x7f113000cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:18.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.853+0000 7f113effd700 1 -- 172.21.15.2:0/4179194862 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1130011800 con 0x7f11480b5ab0 2023-11-26T07:15:18.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.853+0000 7f113effd700 1 -- 172.21.15.2:0/4179194862 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1130011960 con 0x7f11480b5ab0 2023-11-26T07:15:18.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.853+0000 7f114c8d3700 1 -- 172.21.15.2:0/4179194862 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11481e7d60 con 0x7f11480b5ab0 2023-11-26T07:15:18.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.853+0000 7f113effd700 1 -- 172.21.15.2:0/4179194862 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1130011cf0 con 0x7f11480b5ab0 2023-11-26T07:15:18.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.853+0000 7f114c8d3700 1 -- 172.21.15.2:0/4179194862 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11481e65f0 con 0x7f11480b5ab0 2023-11-26T07:15:18.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.854+0000 7f114c8d3700 1 -- 172.21.15.2:0/4179194862 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f114813f160 con 0x7f11480b5ab0 2023-11-26T07:15:18.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.854+0000 7f113effd700 1 -- 172.21.15.2:0/4179194862 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f1130018360 con 0x7f11480b5ab0 2023-11-26T07:15:18.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.855+0000 7f113effd700 1 --2- 172.21.15.2:0/4179194862 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f112806b470 0x7f112806d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:18.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.855+0000 7f113effd700 1 -- 172.21.15.2:0/4179194862 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f113008a120 con 0x7f11480b5ab0 2023-11-26T07:15:18.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.855+0000 7f114659c700 1 --2- 172.21.15.2:0/4179194862 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f112806b470 0x7f112806d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:18.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.856+0000 7f114659c700 1 --2- 172.21.15.2:0/4179194862 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f112806b470 0x7f112806d930 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f11380090b0 tx=0x7f1138010000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:18.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:18.859+0000 7f113effd700 1 -- 172.21.15.2:0/4179194862 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f11300bce90 con 0x7f11480b5ab0 2023-11-26T07:15:19.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:19.055+0000 7f114c8d3700 1 -- 172.21.15.2:0/4179194862 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f114806ba00 con 0x7f112806b470 2023-11-26T07:15:19.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:19.063+0000 7f113effd700 1 -- 172.21.15.2:0/4179194862 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289231 (secure 0 0 0) 0x7f113801f070 con 0x7f112806b470 2023-11-26T07:15:19.068 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:15:19.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:19.066+0000 7f114c8d3700 1 -- 172.21.15.2:0/4179194862 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f112806b470 msgr2=0x7f112806d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:19.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:19.066+0000 7f114c8d3700 1 --2- 172.21.15.2:0/4179194862 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f112806b470 0x7f112806d930 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f11380090b0 tx=0x7f1138010000 comp rx=0 tx=0).stop 2023-11-26T07:15:19.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:19.066+0000 7f114c8d3700 1 -- 172.21.15.2:0/4179194862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11480b5ab0 msgr2=0x7f11481e5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:19.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:19.066+0000 7f114c8d3700 1 --2- 172.21.15.2:0/4179194862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11480b5ab0 0x7f11481e5930 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f113000c820 tx=0x7f113000cbe0 comp rx=0 tx=0).stop 2023-11-26T07:15:19.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:19.066+0000 7f114c8d3700 1 -- 172.21.15.2:0/4179194862 shutdown_connections 2023-11-26T07:15:19.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:19.066+0000 7f114c8d3700 1 --2- 172.21.15.2:0/4179194862 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f112806b470 0x7f112806d930 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:19.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:19.066+0000 7f114c8d3700 1 --2- 172.21.15.2:0/4179194862 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11481478c0 0x7f11481e5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:19.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:19.066+0000 7f114c8d3700 1 --2- 172.21.15.2:0/4179194862 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f114806b620 0x7f11481e7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:19.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:19.066+0000 7f114c8d3700 1 --2- 172.21.15.2:0/4179194862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11480b5ab0 0x7f11481e5930 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:19.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:19.066+0000 7f114c8d3700 1 -- 172.21.15.2:0/4179194862 >> 172.21.15.2:0/4179194862 conn(0x7f11480b2740 msgr2=0x7f1148144850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:19.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:19.067+0000 7f114c8d3700 1 -- 172.21.15.2:0/4179194862 shutdown_connections 2023-11-26T07:15:19.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:19.067+0000 7f114c8d3700 1 -- 172.21.15.2:0/4179194862 wait complete. 2023-11-26T07:15:19.071 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-26T07:15:19.080 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":169,"stamp":"2023-11-26T07:15:18.209724+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243824,"kb_used_data":6856,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754730896,"statfs":{"total":773094113280,"available":772844437504,"internally_reserved":0,"allocated":7020544,"data_stored":3602588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001477"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:16.145159+0000","last_change":"2023-11-26T07:15:13.308114+0000","last_active":"2023-11-26T07:15:16.145159+0000","last_peered":"2023-11-26T07:15:16.145159+0000","last_clean":"2023-11-26T07:15:16.145159+0000","last_became_active":"2023-11-26T07:15:13.307813+0000","last_became_peered":"2023-11-26T07:15:13.307813+0000","last_unstale":"2023-11-26T07:15:16.145159+0000","last_undegraded":"2023-11-26T07:15:16.145159+0000","last_fullsized":"2023-11-26T07:15:16.145159+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:06:11.773814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.289297+0000","last_change":"2023-11-26T07:15:13.303293+0000","last_active":"2023-11-26T07:15:14.289297+0000","last_peered":"2023-11-26T07:15:14.289297+0000","last_clean":"2023-11-26T07:15:14.289297+0000","last_became_active":"2023-11-26T07:15:13.302966+0000","last_became_peered":"2023-11-26T07:15:13.302966+0000","last_unstale":"2023-11-26T07:15:14.289297+0000","last_undegraded":"2023-11-26T07:15:14.289297+0000","last_fullsized":"2023-11-26T07:15:14.289297+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:43:51.404914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.464607+0000","last_change":"2023-11-26T07:15:13.307638+0000","last_active":"2023-11-26T07:15:14.464607+0000","last_peered":"2023-11-26T07:15:14.464607+0000","last_clean":"2023-11-26T07:15:14.464607+0000","last_became_active":"2023-11-26T07:15:13.307218+0000","last_became_peered":"2023-11-26T07:15:13.307218+0000","last_unstale":"2023-11-26T07:15:14.464607+0000","last_undegraded":"2023-11-26T07:15:14.464607+0000","last_fullsized":"2023-11-26T07:15:14.464607+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:32:00.657764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:16.145589+0000","last_change":"2023-11-26T07:15:13.293974+0000","last_active":"2023-11-26T07:15:16.145589+0000","last_peered":"2023-11-26T07:15:16.145589+0000","last_clean":"2023-11-26T07:15:16.145589+0000","last_became_active":"2023-11-26T07:15:13.293509+0000","last_became_peered":"2023-11-26T07:15:13.293509+0000","last_unstale":"2023-11-26T07:15:16.145589+0000","last_undegraded":"2023-11-26T07:15:16.145589+0000","last_fullsized":"2023-11-26T07:15:16.145589+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:42:21.390076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:16.144987+0000","last_change":"2023-11-26T07:15:13.303952+0000","last_active":"2023-11-26T07:15:16.144987+0000","last_peered":"2023-11-26T07:15:16.144987+0000","last_clean":"2023-11-26T07:15:16.144987+0000","last_became_active":"2023-11-26T07:15:13.303507+0000","last_became_peered":"2023-11-26T07:15:13.303507+0000","last_unstale":"2023-11-26T07:15:16.144987+0000","last_undegraded":"2023-11-26T07:15:16.144987+0000","last_fullsized":"2023-11-26T07:15:16.144987+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:26:27.330842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.716188+0000","last_change":"2023-11-26T07:15:13.317626+0000","last_active":"2023-11-26T07:15:14.716188+0000","last_peered":"2023-11-26T07:15:14.716188+0000","last_clean":"2023-11-26T07:15:14.716188+0000","last_became_active":"2023-11-26T07:15:13.317335+0000","last_became_peered":"2023-11-26T07:15:13.317335+0000","last_unstale":"2023-11-26T07:15:14.716188+0000","last_undegraded":"2023-11-26T07:15:14.716188+0000","last_fullsized":"2023-11-26T07:15:14.716188+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:29:58.803265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.289649+0000","last_change":"2023-11-26T07:15:13.298258+0000","last_active":"2023-11-26T07:15:14.289649+0000","last_peered":"2023-11-26T07:15:14.289649+0000","last_clean":"2023-11-26T07:15:14.289649+0000","last_became_active":"2023-11-26T07:15:13.297971+0000","last_became_peered":"2023-11-26T07:15:13.297971+0000","last_unstale":"2023-11-26T07:15:14.289649+0000","last_undegraded":"2023-11-26T07:15:14.289649+0000","last_fullsized":"2023-11-26T07:15:14.289649+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:44:33.820633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.288797+0000","last_change":"2023-11-26T07:15:13.306149+0000","last_active":"2023-11-26T07:15:14.288797+0000","last_peered":"2023-11-26T07:15:14.288797+0000","last_clean":"2023-11-26T07:15:14.288797+0000","last_became_active":"2023-11-26T07:15:13.305847+0000","last_became_peered":"2023-11-26T07:15:13.305847+0000","last_unstale":"2023-11-26T07:15:14.288797+0000","last_undegraded":"2023-11-26T07:15:14.288797+0000","last_fullsized":"2023-11-26T07:15:14.288797+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:58:21.942488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.289871+0000","last_change":"2023-11-26T07:15:13.310617+0000","last_active":"2023-11-26T07:15:14.289871+0000","last_peered":"2023-11-26T07:15:14.289871+0000","last_clean":"2023-11-26T07:15:14.289871+0000","last_became_active":"2023-11-26T07:15:13.310363+0000","last_became_peered":"2023-11-26T07:15:13.310363+0000","last_unstale":"2023-11-26T07:15:14.289871+0000","last_undegraded":"2023-11-26T07:15:14.289871+0000","last_fullsized":"2023-11-26T07:15:14.289871+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:21:16.538514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:15.182523+0000","last_change":"2023-11-26T07:15:13.307979+0000","last_active":"2023-11-26T07:15:15.182523+0000","last_peered":"2023-11-26T07:15:15.182523+0000","last_clean":"2023-11-26T07:15:15.182523+0000","last_became_active":"2023-11-26T07:15:13.307720+0000","last_became_peered":"2023-11-26T07:15:13.307720+0000","last_unstale":"2023-11-26T07:15:15.182523+0000","last_undegraded":"2023-11-26T07:15:15.182523+0000","last_fullsized":"2023-11-26T07:15:15.182523+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:19:25.531893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:15.182598+0000","last_change":"2023-11-26T07:15:13.304004+0000","last_active":"2023-11-26T07:15:15.182598+0000","last_peered":"2023-11-26T07:15:15.182598+0000","last_clean":"2023-11-26T07:15:15.182598+0000","last_became_active":"2023-11-26T07:15:13.303719+0000","last_became_peered":"2023-11-26T07:15:13.303719+0000","last_unstale":"2023-11-26T07:15:15.182598+0000","last_undegraded":"2023-11-26T07:15:15.182598+0000","last_fullsized":"2023-11-26T07:15:15.182598+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:29:11.229380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:16.145741+0000","last_change":"2023-11-26T07:15:13.298878+0000","last_active":"2023-11-26T07:15:16.145741+0000","last_peered":"2023-11-26T07:15:16.145741+0000","last_clean":"2023-11-26T07:15:16.145741+0000","last_became_active":"2023-11-26T07:15:13.298585+0000","last_became_peered":"2023-11-26T07:15:13.298585+0000","last_unstale":"2023-11-26T07:15:16.145741+0000","last_undegraded":"2023-11-26T07:15:16.145741+0000","last_fullsized":"2023-11-26T07:15:16.145741+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:20:56.131760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:15.186635+0000","last_change":"2023-11-26T07:15:13.311040+0000","last_active":"2023-11-26T07:15:15.186635+0000","last_peered":"2023-11-26T07:15:15.186635+0000","last_clean":"2023-11-26T07:15:15.186635+0000","last_became_active":"2023-11-26T07:15:13.310713+0000","last_became_peered":"2023-11-26T07:15:13.310713+0000","last_unstale":"2023-11-26T07:15:15.186635+0000","last_undegraded":"2023-11-26T07:15:15.186635+0000","last_fullsized":"2023-11-26T07:15:15.186635+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:36:08.844248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.289904+0000","last_change":"2023-11-26T07:15:13.302245+0000","last_active":"2023-11-26T07:15:14.289904+0000","last_peered":"2023-11-26T07:15:14.289904+0000","last_clean":"2023-11-26T07:15:14.289904+0000","last_became_active":"2023-11-26T07:15:13.301967+0000","last_became_peered":"2023-11-26T07:15:13.301967+0000","last_unstale":"2023-11-26T07:15:14.289904+0000","last_undegraded":"2023-11-26T07:15:14.289904+0000","last_fullsized":"2023-11-26T07:15:14.289904+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:15:04.254627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.289738+0000","last_change":"2023-11-26T07:15:13.300428+0000","last_active":"2023-11-26T07:15:14.289738+0000","last_peered":"2023-11-26T07:15:14.289738+0000","last_clean":"2023-11-26T07:15:14.289738+0000","last_became_active":"2023-11-26T07:15:13.300103+0000","last_became_peered":"2023-11-26T07:15:13.300103+0000","last_unstale":"2023-11-26T07:15:14.289738+0000","last_undegraded":"2023-11-26T07:15:14.289738+0000","last_fullsized":"2023-11-26T07:15:14.289738+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:55:35.150250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.716044+0000","last_change":"2023-11-26T07:15:13.311434+0000","last_active":"2023-11-26T07:15:14.716044+0000","last_peered":"2023-11-26T07:15:14.716044+0000","last_clean":"2023-11-26T07:15:14.716044+0000","last_became_active":"2023-11-26T07:15:13.311043+0000","last_became_peered":"2023-11-26T07:15:13.311043+0000","last_unstale":"2023-11-26T07:15:14.716044+0000","last_undegraded":"2023-11-26T07:15:14.716044+0000","last_fullsized":"2023-11-26T07:15:14.716044+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:46:11.849131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.289136+0000","last_change":"2023-11-26T07:15:13.315444+0000","last_active":"2023-11-26T07:15:14.289136+0000","last_peered":"2023-11-26T07:15:14.289136+0000","last_clean":"2023-11-26T07:15:14.289136+0000","last_became_active":"2023-11-26T07:15:13.313428+0000","last_became_peered":"2023-11-26T07:15:13.313428+0000","last_unstale":"2023-11-26T07:15:14.289136+0000","last_undegraded":"2023-11-26T07:15:14.289136+0000","last_fullsized":"2023-11-26T07:15:14.289136+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:12:33.505942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.464896+0000","last_change":"2023-11-26T07:15:13.310021+0000","last_active":"2023-11-26T07:15:14.464896+0000","last_peered":"2023-11-26T07:15:14.464896+0000","last_clean":"2023-11-26T07:15:14.464896+0000","last_became_active":"2023-11-26T07:15:13.309683+0000","last_became_peered":"2023-11-26T07:15:13.309683+0000","last_unstale":"2023-11-26T07:15:14.464896+0000","last_undegraded":"2023-11-26T07:15:14.464896+0000","last_fullsized":"2023-11-26T07:15:14.464896+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:29:58.803265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:16.145091+0000","last_change":"2023-11-26T07:15:13.316644+0000","last_active":"2023-11-26T07:15:16.145091+0000","last_peered":"2023-11-26T07:15:16.145091+0000","last_clean":"2023-11-26T07:15:16.145091+0000","last_became_active":"2023-11-26T07:15:13.316335+0000","last_became_peered":"2023-11-26T07:15:13.316335+0000","last_unstale":"2023-11-26T07:15:16.145091+0000","last_undegraded":"2023-11-26T07:15:16.145091+0000","last_fullsized":"2023-11-26T07:15:16.145091+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:44:48.042431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.288963+0000","last_change":"2023-11-26T07:15:13.312661+0000","last_active":"2023-11-26T07:15:14.288963+0000","last_peered":"2023-11-26T07:15:14.288963+0000","last_clean":"2023-11-26T07:15:14.288963+0000","last_became_active":"2023-11-26T07:15:13.312329+0000","last_became_peered":"2023-11-26T07:15:13.312329+0000","last_unstale":"2023-11-26T07:15:14.288963+0000","last_undegraded":"2023-11-26T07:15:14.288963+0000","last_fullsized":"2023-11-26T07:15:14.288963+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:47:55.592557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.464766+0000","last_change":"2023-11-26T07:15:13.301613+0000","last_active":"2023-11-26T07:15:14.464766+0000","last_peered":"2023-11-26T07:15:14.464766+0000","last_clean":"2023-11-26T07:15:14.464766+0000","last_became_active":"2023-11-26T07:15:13.301116+0000","last_became_peered":"2023-11-26T07:15:13.301116+0000","last_unstale":"2023-11-26T07:15:14.464766+0000","last_undegraded":"2023-11-26T07:15:14.464766+0000","last_fullsized":"2023-11-26T07:15:14.464766+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:46:11.849131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.288909+0000","last_change":"2023-11-26T07:15:13.307609+0000","last_active":"2023-11-26T07:15:14.288909+0000","last_peered":"2023-11-26T07:15:14.288909+0000","last_clean":"2023-11-26T07:15:14.288909+0000","last_became_active":"2023-11-26T07:15:13.307352+0000","last_became_peered":"2023-11-26T07:15:13.307352+0000","last_unstale":"2023-11-26T07:15:14.288909+0000","last_undegraded":"2023-11-26T07:15:14.288909+0000","last_fullsized":"2023-11-26T07:15:14.288909+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:19:47.275564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.464682+0000","last_change":"2023-11-26T07:15:13.308524+0000","last_active":"2023-11-26T07:15:14.464682+0000","last_peered":"2023-11-26T07:15:14.464682+0000","last_clean":"2023-11-26T07:15:14.464682+0000","last_became_active":"2023-11-26T07:15:13.307898+0000","last_became_peered":"2023-11-26T07:15:13.307898+0000","last_unstale":"2023-11-26T07:15:14.464682+0000","last_undegraded":"2023-11-26T07:15:14.464682+0000","last_fullsized":"2023-11-26T07:15:14.464682+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:59:19.037305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:15.186443+0000","last_change":"2023-11-26T07:15:13.314831+0000","last_active":"2023-11-26T07:15:15.186443+0000","last_peered":"2023-11-26T07:15:15.186443+0000","last_clean":"2023-11-26T07:15:15.186443+0000","last_became_active":"2023-11-26T07:15:13.314613+0000","last_became_peered":"2023-11-26T07:15:13.314613+0000","last_unstale":"2023-11-26T07:15:15.186443+0000","last_undegraded":"2023-11-26T07:15:15.186443+0000","last_fullsized":"2023-11-26T07:15:15.186443+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:55:31.988300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:16.145261+0000","last_change":"2023-11-26T07:15:13.302505+0000","last_active":"2023-11-26T07:15:16.145261+0000","last_peered":"2023-11-26T07:15:16.145261+0000","last_clean":"2023-11-26T07:15:16.145261+0000","last_became_active":"2023-11-26T07:15:13.302219+0000","last_became_peered":"2023-11-26T07:15:13.302219+0000","last_unstale":"2023-11-26T07:15:16.145261+0000","last_undegraded":"2023-11-26T07:15:16.145261+0000","last_fullsized":"2023-11-26T07:15:16.145261+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:20:03.025839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:16.145853+0000","last_change":"2023-11-26T07:15:13.298297+0000","last_active":"2023-11-26T07:15:16.145853+0000","last_peered":"2023-11-26T07:15:16.145853+0000","last_clean":"2023-11-26T07:15:16.145853+0000","last_became_active":"2023-11-26T07:15:13.298019+0000","last_became_peered":"2023-11-26T07:15:13.298019+0000","last_unstale":"2023-11-26T07:15:16.145853+0000","last_undegraded":"2023-11-26T07:15:16.145853+0000","last_fullsized":"2023-11-26T07:15:16.145853+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:34:55.081476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.716400+0000","last_change":"2023-11-26T07:15:13.311021+0000","last_active":"2023-11-26T07:15:14.716400+0000","last_peered":"2023-11-26T07:15:14.716400+0000","last_clean":"2023-11-26T07:15:14.716400+0000","last_became_active":"2023-11-26T07:15:13.310518+0000","last_became_peered":"2023-11-26T07:15:13.310518+0000","last_unstale":"2023-11-26T07:15:14.716400+0000","last_undegraded":"2023-11-26T07:15:14.716400+0000","last_fullsized":"2023-11-26T07:15:14.716400+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:20:22.142720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:16.145092+0000","last_change":"2023-11-26T07:15:13.303957+0000","last_active":"2023-11-26T07:15:16.145092+0000","last_peered":"2023-11-26T07:15:16.145092+0000","last_clean":"2023-11-26T07:15:16.145092+0000","last_became_active":"2023-11-26T07:15:13.303560+0000","last_became_peered":"2023-11-26T07:15:13.303560+0000","last_unstale":"2023-11-26T07:15:16.145092+0000","last_undegraded":"2023-11-26T07:15:16.145092+0000","last_fullsized":"2023-11-26T07:15:16.145092+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:04:05.590262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.289555+0000","last_change":"2023-11-26T07:15:13.309584+0000","last_active":"2023-11-26T07:15:14.289555+0000","last_peered":"2023-11-26T07:15:14.289555+0000","last_clean":"2023-11-26T07:15:14.289555+0000","last_became_active":"2023-11-26T07:15:13.309317+0000","last_became_peered":"2023-11-26T07:15:13.309317+0000","last_unstale":"2023-11-26T07:15:14.289555+0000","last_undegraded":"2023-11-26T07:15:14.289555+0000","last_fullsized":"2023-11-26T07:15:14.289555+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:32:16.307775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.464583+0000","last_change":"2023-11-26T07:15:13.304470+0000","last_active":"2023-11-26T07:15:14.464583+0000","last_peered":"2023-11-26T07:15:14.464583+0000","last_clean":"2023-11-26T07:15:14.464583+0000","last_became_active":"2023-11-26T07:15:13.304187+0000","last_became_peered":"2023-11-26T07:15:13.304187+0000","last_unstale":"2023-11-26T07:15:14.464583+0000","last_undegraded":"2023-11-26T07:15:14.464583+0000","last_fullsized":"2023-11-26T07:15:14.464583+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:32:58.450755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:16.144866+0000","last_change":"2023-11-26T07:15:13.301409+0000","last_active":"2023-11-26T07:15:16.144866+0000","last_peered":"2023-11-26T07:15:16.144866+0000","last_clean":"2023-11-26T07:15:16.144866+0000","last_became_active":"2023-11-26T07:15:13.301099+0000","last_became_peered":"2023-11-26T07:15:13.301099+0000","last_unstale":"2023-11-26T07:15:16.144866+0000","last_undegraded":"2023-11-26T07:15:16.144866+0000","last_fullsized":"2023-11-26T07:15:16.144866+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:49:03.762354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.716176+0000","last_change":"2023-11-26T07:15:13.311998+0000","last_active":"2023-11-26T07:15:14.716176+0000","last_peered":"2023-11-26T07:15:14.716176+0000","last_clean":"2023-11-26T07:15:14.716176+0000","last_became_active":"2023-11-26T07:15:13.311715+0000","last_became_peered":"2023-11-26T07:15:13.311715+0000","last_unstale":"2023-11-26T07:15:14.716176+0000","last_undegraded":"2023-11-26T07:15:14.716176+0000","last_fullsized":"2023-11-26T07:15:14.716176+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:05:41.521323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.716357+0000","last_change":"2023-11-26T07:15:13.309239+0000","last_active":"2023-11-26T07:15:14.716357+0000","last_peered":"2023-11-26T07:15:14.716357+0000","last_clean":"2023-11-26T07:15:14.716357+0000","last_became_active":"2023-11-26T07:15:13.308871+0000","last_became_peered":"2023-11-26T07:15:13.308871+0000","last_unstale":"2023-11-26T07:15:14.716357+0000","last_undegraded":"2023-11-26T07:15:14.716357+0000","last_fullsized":"2023-11-26T07:15:14.716357+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:05:29.806891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"59'4","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.319919+0000","last_change":"2023-11-26T07:15:12.298413+0000","last_active":"2023-11-26T07:15:13.319919+0000","last_peered":"2023-11-26T07:15:13.319919+0000","last_clean":"2023-11-26T07:15:13.319919+0000","last_became_active":"2023-11-26T07:15:12.298102+0000","last_became_peered":"2023-11-26T07:15:12.298102+0000","last_unstale":"2023-11-26T07:15:13.319919+0000","last_undegraded":"2023-11-26T07:15:13.319919+0000","last_fullsized":"2023-11-26T07:15:13.319919+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:51:39.947535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:15.182607+0000","last_change":"2023-11-26T07:15:13.303110+0000","last_active":"2023-11-26T07:15:15.182607+0000","last_peered":"2023-11-26T07:15:15.182607+0000","last_clean":"2023-11-26T07:15:15.182607+0000","last_became_active":"2023-11-26T07:15:13.302787+0000","last_became_peered":"2023-11-26T07:15:13.302787+0000","last_unstale":"2023-11-26T07:15:15.182607+0000","last_undegraded":"2023-11-26T07:15:15.182607+0000","last_fullsized":"2023-11-26T07:15:15.182607+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:05:49.340343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"59'1","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.319113+0000","last_change":"2023-11-26T07:15:12.302787+0000","last_active":"2023-11-26T07:15:13.319113+0000","last_peered":"2023-11-26T07:15:13.319113+0000","last_clean":"2023-11-26T07:15:13.319113+0000","last_became_active":"2023-11-26T07:15:12.302489+0000","last_became_peered":"2023-11-26T07:15:12.302489+0000","last_unstale":"2023-11-26T07:15:13.319113+0000","last_undegraded":"2023-11-26T07:15:13.319113+0000","last_fullsized":"2023-11-26T07:15:13.319113+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:05:40.519750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.716470+0000","last_change":"2023-11-26T07:15:13.310946+0000","last_active":"2023-11-26T07:15:14.716470+0000","last_peered":"2023-11-26T07:15:14.716470+0000","last_clean":"2023-11-26T07:15:14.716470+0000","last_became_active":"2023-11-26T07:15:13.310654+0000","last_became_peered":"2023-11-26T07:15:13.310654+0000","last_unstale":"2023-11-26T07:15:14.716470+0000","last_undegraded":"2023-11-26T07:15:14.716470+0000","last_fullsized":"2023-11-26T07:15:14.716470+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:48:20.118670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"59'2","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.320380+0000","last_change":"2023-11-26T07:15:12.302483+0000","last_active":"2023-11-26T07:15:13.320380+0000","last_peered":"2023-11-26T07:15:13.320380+0000","last_clean":"2023-11-26T07:15:13.320380+0000","last_became_active":"2023-11-26T07:15:12.302095+0000","last_became_peered":"2023-11-26T07:15:12.302095+0000","last_unstale":"2023-11-26T07:15:13.320380+0000","last_undegraded":"2023-11-26T07:15:13.320380+0000","last_fullsized":"2023-11-26T07:15:13.320380+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:34:54.079903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.716503+0000","last_change":"2023-11-26T07:15:13.310225+0000","last_active":"2023-11-26T07:15:14.716503+0000","last_peered":"2023-11-26T07:15:14.716503+0000","last_clean":"2023-11-26T07:15:14.716503+0000","last_became_active":"2023-11-26T07:15:13.309592+0000","last_became_peered":"2023-11-26T07:15:13.309592+0000","last_unstale":"2023-11-26T07:15:14.716503+0000","last_undegraded":"2023-11-26T07:15:14.716503+0000","last_fullsized":"2023-11-26T07:15:14.716503+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:49:43.683710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"59'2","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.318366+0000","last_change":"2023-11-26T07:15:12.300835+0000","last_active":"2023-11-26T07:15:13.318366+0000","last_peered":"2023-11-26T07:15:13.318366+0000","last_clean":"2023-11-26T07:15:13.318366+0000","last_became_active":"2023-11-26T07:15:12.300536+0000","last_became_peered":"2023-11-26T07:15:12.300536+0000","last_unstale":"2023-11-26T07:15:13.318366+0000","last_undegraded":"2023-11-26T07:15:13.318366+0000","last_fullsized":"2023-11-26T07:15:13.318366+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:12:07.949999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.289030+0000","last_change":"2023-11-26T07:15:13.317611+0000","last_active":"2023-11-26T07:15:14.289030+0000","last_peered":"2023-11-26T07:15:14.289030+0000","last_clean":"2023-11-26T07:15:14.289030+0000","last_became_active":"2023-11-26T07:15:13.317271+0000","last_became_peered":"2023-11-26T07:15:13.317271+0000","last_unstale":"2023-11-26T07:15:14.289030+0000","last_undegraded":"2023-11-26T07:15:14.289030+0000","last_fullsized":"2023-11-26T07:15:14.289030+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:06:49.653826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"59'1","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.317299+0000","last_change":"2023-11-26T07:15:12.301249+0000","last_active":"2023-11-26T07:15:13.317299+0000","last_peered":"2023-11-26T07:15:13.317299+0000","last_clean":"2023-11-26T07:15:13.317299+0000","last_became_active":"2023-11-26T07:15:12.300848+0000","last_became_peered":"2023-11-26T07:15:12.300848+0000","last_unstale":"2023-11-26T07:15:13.317299+0000","last_undegraded":"2023-11-26T07:15:13.317299+0000","last_fullsized":"2023-11-26T07:15:13.317299+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:29:22.469437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.289245+0000","last_change":"2023-11-26T07:15:13.314640+0000","last_active":"2023-11-26T07:15:14.289245+0000","last_peered":"2023-11-26T07:15:14.289245+0000","last_clean":"2023-11-26T07:15:14.289245+0000","last_became_active":"2023-11-26T07:15:13.314376+0000","last_became_peered":"2023-11-26T07:15:13.314376+0000","last_unstale":"2023-11-26T07:15:14.289245+0000","last_undegraded":"2023-11-26T07:15:14.289245+0000","last_fullsized":"2023-11-26T07:15:14.289245+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:56:39.679237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"59'1","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.319533+0000","last_change":"2023-11-26T07:15:12.304914+0000","last_active":"2023-11-26T07:15:13.319533+0000","last_peered":"2023-11-26T07:15:13.319533+0000","last_clean":"2023-11-26T07:15:13.319533+0000","last_became_active":"2023-11-26T07:15:12.304622+0000","last_became_peered":"2023-11-26T07:15:12.304622+0000","last_unstale":"2023-11-26T07:15:13.319533+0000","last_undegraded":"2023-11-26T07:15:13.319533+0000","last_fullsized":"2023-11-26T07:15:13.319533+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:42:20.388503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:15.186532+0000","last_change":"2023-11-26T07:15:13.299138+0000","last_active":"2023-11-26T07:15:15.186532+0000","last_peered":"2023-11-26T07:15:15.186532+0000","last_clean":"2023-11-26T07:15:15.186532+0000","last_became_active":"2023-11-26T07:15:13.298666+0000","last_became_peered":"2023-11-26T07:15:13.298666+0000","last_unstale":"2023-11-26T07:15:15.186532+0000","last_undegraded":"2023-11-26T07:15:15.186532+0000","last_fullsized":"2023-11-26T07:15:15.186532+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:41:32.866173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.288643+0000","last_change":"2023-11-26T07:15:12.297245+0000","last_active":"2023-11-26T07:15:13.288643+0000","last_peered":"2023-11-26T07:15:13.288643+0000","last_clean":"2023-11-26T07:15:13.288643+0000","last_became_active":"2023-11-26T07:15:12.296904+0000","last_became_peered":"2023-11-26T07:15:12.296904+0000","last_unstale":"2023-11-26T07:15:13.288643+0000","last_undegraded":"2023-11-26T07:15:13.288643+0000","last_fullsized":"2023-11-26T07:15:13.288643+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:55:34.148677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.288834+0000","last_change":"2023-11-26T07:15:13.312997+0000","last_active":"2023-11-26T07:15:14.288834+0000","last_peered":"2023-11-26T07:15:14.288834+0000","last_clean":"2023-11-26T07:15:14.288834+0000","last_became_active":"2023-11-26T07:15:13.311781+0000","last_became_peered":"2023-11-26T07:15:13.311781+0000","last_unstale":"2023-11-26T07:15:14.288834+0000","last_undegraded":"2023-11-26T07:15:14.288834+0000","last_fullsized":"2023-11-26T07:15:14.288834+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:13:54.735452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.291691+0000","last_change":"2023-11-26T07:15:12.303096+0000","last_active":"2023-11-26T07:15:13.291691+0000","last_peered":"2023-11-26T07:15:13.291691+0000","last_clean":"2023-11-26T07:15:13.291691+0000","last_became_active":"2023-11-26T07:15:12.302747+0000","last_became_peered":"2023-11-26T07:15:12.302747+0000","last_unstale":"2023-11-26T07:15:13.291691+0000","last_undegraded":"2023-11-26T07:15:13.291691+0000","last_fullsized":"2023-11-26T07:15:13.291691+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:43:46.409969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.290030+0000","last_change":"2023-11-26T07:15:13.298953+0000","last_active":"2023-11-26T07:15:14.290030+0000","last_peered":"2023-11-26T07:15:14.290030+0000","last_clean":"2023-11-26T07:15:14.290030+0000","last_became_active":"2023-11-26T07:15:13.298685+0000","last_became_peered":"2023-11-26T07:15:13.298685+0000","last_unstale":"2023-11-26T07:15:14.290030+0000","last_undegraded":"2023-11-26T07:15:14.290030+0000","last_fullsized":"2023-11-26T07:15:14.290030+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:37:44.542461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.295003+0000","last_change":"2023-11-26T07:15:12.298615+0000","last_active":"2023-11-26T07:15:13.295003+0000","last_peered":"2023-11-26T07:15:13.295003+0000","last_clean":"2023-11-26T07:15:13.295003+0000","last_became_active":"2023-11-26T07:15:12.298325+0000","last_became_peered":"2023-11-26T07:15:12.298325+0000","last_unstale":"2023-11-26T07:15:13.295003+0000","last_undegraded":"2023-11-26T07:15:13.295003+0000","last_fullsized":"2023-11-26T07:15:13.295003+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:37:31.449723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.464903+0000","last_change":"2023-11-26T07:15:13.302881+0000","last_active":"2023-11-26T07:15:14.464903+0000","last_peered":"2023-11-26T07:15:14.464903+0000","last_clean":"2023-11-26T07:15:14.464903+0000","last_became_active":"2023-11-26T07:15:13.302613+0000","last_became_peered":"2023-11-26T07:15:13.302613+0000","last_unstale":"2023-11-26T07:15:14.464903+0000","last_undegraded":"2023-11-26T07:15:14.464903+0000","last_fullsized":"2023-11-26T07:15:14.464903+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:05:29.806891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.292754+0000","last_change":"2023-11-26T07:15:12.307002+0000","last_active":"2023-11-26T07:15:13.292754+0000","last_peered":"2023-11-26T07:15:13.292754+0000","last_clean":"2023-11-26T07:15:13.292754+0000","last_became_active":"2023-11-26T07:15:12.306612+0000","last_became_peered":"2023-11-26T07:15:12.306612+0000","last_unstale":"2023-11-26T07:15:13.292754+0000","last_undegraded":"2023-11-26T07:15:13.292754+0000","last_fullsized":"2023-11-26T07:15:13.292754+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:05:28.805318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:15.182426+0000","last_change":"2023-11-26T07:15:13.305034+0000","last_active":"2023-11-26T07:15:15.182426+0000","last_peered":"2023-11-26T07:15:15.182426+0000","last_clean":"2023-11-26T07:15:15.182426+0000","last_became_active":"2023-11-26T07:15:13.304552+0000","last_became_peered":"2023-11-26T07:15:13.304552+0000","last_unstale":"2023-11-26T07:15:15.182426+0000","last_undegraded":"2023-11-26T07:15:15.182426+0000","last_fullsized":"2023-11-26T07:15:15.182426+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:33:53.753478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"59'3","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.316562+0000","last_change":"2023-11-26T07:15:12.299169+0000","last_active":"2023-11-26T07:15:13.316562+0000","last_peered":"2023-11-26T07:15:13.316562+0000","last_clean":"2023-11-26T07:15:13.316562+0000","last_became_active":"2023-11-26T07:15:12.298742+0000","last_became_peered":"2023-11-26T07:15:12.298742+0000","last_unstale":"2023-11-26T07:15:13.316562+0000","last_undegraded":"2023-11-26T07:15:13.316562+0000","last_fullsized":"2023-11-26T07:15:13.316562+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:47:26.695306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.464749+0000","last_change":"2023-11-26T07:15:13.303083+0000","last_active":"2023-11-26T07:15:14.464749+0000","last_peered":"2023-11-26T07:15:14.464749+0000","last_clean":"2023-11-26T07:15:14.464749+0000","last_became_active":"2023-11-26T07:15:13.302828+0000","last_became_peered":"2023-11-26T07:15:13.302828+0000","last_unstale":"2023-11-26T07:15:14.464749+0000","last_undegraded":"2023-11-26T07:15:14.464749+0000","last_fullsized":"2023-11-26T07:15:14.464749+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:55:51.646081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"59'6","reported_seq":18,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.324593+0000","last_change":"2023-11-26T07:15:12.301922+0000","last_active":"2023-11-26T07:15:13.324593+0000","last_peered":"2023-11-26T07:15:13.324593+0000","last_clean":"2023-11-26T07:15:13.324593+0000","last_became_active":"2023-11-26T07:15:12.301636+0000","last_became_peered":"2023-11-26T07:15:12.301636+0000","last_unstale":"2023-11-26T07:15:13.324593+0000","last_undegraded":"2023-11-26T07:15:13.324593+0000","last_fullsized":"2023-11-26T07:15:13.324593+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:36:07.842675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:16.145469+0000","last_change":"2023-11-26T07:15:13.297153+0000","last_active":"2023-11-26T07:15:16.145469+0000","last_peered":"2023-11-26T07:15:16.145469+0000","last_clean":"2023-11-26T07:15:16.145469+0000","last_became_active":"2023-11-26T07:15:13.296658+0000","last_became_peered":"2023-11-26T07:15:13.296658+0000","last_unstale":"2023-11-26T07:15:16.145469+0000","last_undegraded":"2023-11-26T07:15:16.145469+0000","last_fullsized":"2023-11-26T07:15:16.145469+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:02:14.657926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"59'2","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.319606+0000","last_change":"2023-11-26T07:15:12.306177+0000","last_active":"2023-11-26T07:15:13.319606+0000","last_peered":"2023-11-26T07:15:13.319606+0000","last_clean":"2023-11-26T07:15:13.319606+0000","last_became_active":"2023-11-26T07:15:12.304698+0000","last_became_peered":"2023-11-26T07:15:12.304698+0000","last_unstale":"2023-11-26T07:15:13.319606+0000","last_undegraded":"2023-11-26T07:15:13.319606+0000","last_fullsized":"2023-11-26T07:15:13.319606+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:37:05.995766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.464589+0000","last_change":"2023-11-26T07:15:13.301706+0000","last_active":"2023-11-26T07:15:14.464589+0000","last_peered":"2023-11-26T07:15:14.464589+0000","last_clean":"2023-11-26T07:15:14.464589+0000","last_became_active":"2023-11-26T07:15:13.301439+0000","last_became_peered":"2023-11-26T07:15:13.301439+0000","last_unstale":"2023-11-26T07:15:14.464589+0000","last_undegraded":"2023-11-26T07:15:14.464589+0000","last_fullsized":"2023-11-26T07:15:14.464589+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:34:55.081476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.292700+0000","last_change":"2023-11-26T07:15:12.304899+0000","last_active":"2023-11-26T07:15:13.292700+0000","last_peered":"2023-11-26T07:15:13.292700+0000","last_clean":"2023-11-26T07:15:13.292700+0000","last_became_active":"2023-11-26T07:15:12.304628+0000","last_became_peered":"2023-11-26T07:15:12.304628+0000","last_unstale":"2023-11-26T07:15:13.292700+0000","last_undegraded":"2023-11-26T07:15:13.292700+0000","last_fullsized":"2023-11-26T07:15:13.292700+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:57:19.000626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.289589+0000","last_change":"2023-11-26T07:15:13.302613+0000","last_active":"2023-11-26T07:15:14.289589+0000","last_peered":"2023-11-26T07:15:14.289589+0000","last_clean":"2023-11-26T07:15:14.289589+0000","last_became_active":"2023-11-26T07:15:13.302388+0000","last_became_peered":"2023-11-26T07:15:13.302388+0000","last_unstale":"2023-11-26T07:15:14.289589+0000","last_undegraded":"2023-11-26T07:15:14.289589+0000","last_fullsized":"2023-11-26T07:15:14.289589+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:58:02.591422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.288482+0000","last_change":"2023-11-26T07:15:12.300289+0000","last_active":"2023-11-26T07:15:13.288482+0000","last_peered":"2023-11-26T07:15:13.288482+0000","last_clean":"2023-11-26T07:15:13.288482+0000","last_became_active":"2023-11-26T07:15:12.299999+0000","last_became_peered":"2023-11-26T07:15:12.299999+0000","last_unstale":"2023-11-26T07:15:13.288482+0000","last_undegraded":"2023-11-26T07:15:13.288482+0000","last_fullsized":"2023-11-26T07:15:13.288482+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:58:01.589849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.464559+0000","last_change":"2023-11-26T07:15:13.308709+0000","last_active":"2023-11-26T07:15:14.464559+0000","last_peered":"2023-11-26T07:15:14.464559+0000","last_clean":"2023-11-26T07:15:14.464559+0000","last_became_active":"2023-11-26T07:15:13.308241+0000","last_became_peered":"2023-11-26T07:15:13.308241+0000","last_unstale":"2023-11-26T07:15:14.464559+0000","last_undegraded":"2023-11-26T07:15:14.464559+0000","last_fullsized":"2023-11-26T07:15:14.464559+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:51:40.949108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"59'8","reported_seq":20,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.309018+0000","last_change":"2023-11-26T07:15:12.297008+0000","last_active":"2023-11-26T07:15:13.309018+0000","last_peered":"2023-11-26T07:15:13.309018+0000","last_clean":"2023-11-26T07:15:13.309018+0000","last_became_active":"2023-11-26T07:15:12.296711+0000","last_became_peered":"2023-11-26T07:15:12.296711+0000","last_unstale":"2023-11-26T07:15:13.309018+0000","last_undegraded":"2023-11-26T07:15:13.309018+0000","last_fullsized":"2023-11-26T07:15:13.309018+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:44:32.819060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.464970+0000","last_change":"2023-11-26T07:15:13.309049+0000","last_active":"2023-11-26T07:15:14.464970+0000","last_peered":"2023-11-26T07:15:14.464970+0000","last_clean":"2023-11-26T07:15:14.464970+0000","last_became_active":"2023-11-26T07:15:13.308790+0000","last_became_peered":"2023-11-26T07:15:13.308790+0000","last_unstale":"2023-11-26T07:15:14.464970+0000","last_undegraded":"2023-11-26T07:15:14.464970+0000","last_fullsized":"2023-11-26T07:15:14.464970+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:20:22.142720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"59'1","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.317211+0000","last_change":"2023-11-26T07:15:12.306635+0000","last_active":"2023-11-26T07:15:13.317211+0000","last_peered":"2023-11-26T07:15:13.317211+0000","last_clean":"2023-11-26T07:15:13.317211+0000","last_became_active":"2023-11-26T07:15:12.304730+0000","last_became_peered":"2023-11-26T07:15:12.304730+0000","last_unstale":"2023-11-26T07:15:13.317211+0000","last_undegraded":"2023-11-26T07:15:13.317211+0000","last_fullsized":"2023-11-26T07:15:13.317211+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:14:33.732928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:16.145847+0000","last_change":"2023-11-26T07:15:13.300658+0000","last_active":"2023-11-26T07:15:16.145847+0000","last_peered":"2023-11-26T07:15:16.145847+0000","last_clean":"2023-11-26T07:15:16.145847+0000","last_became_active":"2023-11-26T07:15:13.299648+0000","last_became_peered":"2023-11-26T07:15:13.299648+0000","last_unstale":"2023-11-26T07:15:16.145847+0000","last_undegraded":"2023-11-26T07:15:16.145847+0000","last_fullsized":"2023-11-26T07:15:16.145847+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:32:58.450755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"59'2","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.320053+0000","last_change":"2023-11-26T07:15:12.300625+0000","last_active":"2023-11-26T07:15:13.320053+0000","last_peered":"2023-11-26T07:15:13.320053+0000","last_clean":"2023-11-26T07:15:13.320053+0000","last_became_active":"2023-11-26T07:15:12.300272+0000","last_became_peered":"2023-11-26T07:15:12.300272+0000","last_unstale":"2023-11-26T07:15:13.320053+0000","last_undegraded":"2023-11-26T07:15:13.320053+0000","last_fullsized":"2023-11-26T07:15:13.320053+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:20:55.130187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.289039+0000","last_change":"2023-11-26T07:15:13.307083+0000","last_active":"2023-11-26T07:15:14.289039+0000","last_peered":"2023-11-26T07:15:14.289039+0000","last_clean":"2023-11-26T07:15:14.289039+0000","last_became_active":"2023-11-26T07:15:13.306892+0000","last_became_peered":"2023-11-26T07:15:13.306892+0000","last_unstale":"2023-11-26T07:15:14.289039+0000","last_undegraded":"2023-11-26T07:15:14.289039+0000","last_fullsized":"2023-11-26T07:15:14.289039+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:20:11.009773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"59'1","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.315568+0000","last_change":"2023-11-26T07:15:12.300331+0000","last_active":"2023-11-26T07:15:13.315568+0000","last_peered":"2023-11-26T07:15:13.315568+0000","last_clean":"2023-11-26T07:15:13.315568+0000","last_became_active":"2023-11-26T07:15:12.300143+0000","last_became_peered":"2023-11-26T07:15:12.300143+0000","last_unstale":"2023-11-26T07:15:13.315568+0000","last_undegraded":"2023-11-26T07:15:13.315568+0000","last_fullsized":"2023-11-26T07:15:13.315568+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:37:43.540888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.464868+0000","last_change":"2023-11-26T07:15:13.303403+0000","last_active":"2023-11-26T07:15:14.464868+0000","last_peered":"2023-11-26T07:15:14.464868+0000","last_clean":"2023-11-26T07:15:14.464868+0000","last_became_active":"2023-11-26T07:15:13.303147+0000","last_became_peered":"2023-11-26T07:15:13.303147+0000","last_unstale":"2023-11-26T07:15:14.464868+0000","last_undegraded":"2023-11-26T07:15:14.464868+0000","last_fullsized":"2023-11-26T07:15:14.464868+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:05:41.521323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.308325+0000","last_change":"2023-11-26T07:15:12.305011+0000","last_active":"2023-11-26T07:15:13.308325+0000","last_peered":"2023-11-26T07:15:13.308325+0000","last_clean":"2023-11-26T07:15:13.308325+0000","last_became_active":"2023-11-26T07:15:12.304401+0000","last_became_peered":"2023-11-26T07:15:12.304401+0000","last_unstale":"2023-11-26T07:15:13.308325+0000","last_undegraded":"2023-11-26T07:15:13.308325+0000","last_fullsized":"2023-11-26T07:15:13.308325+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:31:59.656191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:16.145469+0000","last_change":"2023-11-26T07:15:13.296963+0000","last_active":"2023-11-26T07:15:16.145469+0000","last_peered":"2023-11-26T07:15:16.145469+0000","last_clean":"2023-11-26T07:15:16.145469+0000","last_became_active":"2023-11-26T07:15:13.296302+0000","last_became_peered":"2023-11-26T07:15:13.296302+0000","last_unstale":"2023-11-26T07:15:16.145469+0000","last_undegraded":"2023-11-26T07:15:16.145469+0000","last_fullsized":"2023-11-26T07:15:16.145469+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:47:27.696879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"59'2","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.319494+0000","last_change":"2023-11-26T07:15:12.303649+0000","last_active":"2023-11-26T07:15:13.319494+0000","last_peered":"2023-11-26T07:15:13.319494+0000","last_clean":"2023-11-26T07:15:13.319494+0000","last_became_active":"2023-11-26T07:15:12.303351+0000","last_became_peered":"2023-11-26T07:15:12.303351+0000","last_unstale":"2023-11-26T07:15:13.319494+0000","last_undegraded":"2023-11-26T07:15:13.319494+0000","last_fullsized":"2023-11-26T07:15:13.319494+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:09:12.614053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.716441+0000","last_change":"2023-11-26T07:15:13.310492+0000","last_active":"2023-11-26T07:15:14.716441+0000","last_peered":"2023-11-26T07:15:14.716441+0000","last_clean":"2023-11-26T07:15:14.716441+0000","last_became_active":"2023-11-26T07:15:13.310204+0000","last_became_peered":"2023-11-26T07:15:13.310204+0000","last_unstale":"2023-11-26T07:15:14.716441+0000","last_undegraded":"2023-11-26T07:15:14.716441+0000","last_fullsized":"2023-11-26T07:15:14.716441+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:34:11.863914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.292902+0000","last_change":"2023-11-26T07:15:12.305367+0000","last_active":"2023-11-26T07:15:13.292902+0000","last_peered":"2023-11-26T07:15:13.292902+0000","last_clean":"2023-11-26T07:15:13.292902+0000","last_became_active":"2023-11-26T07:15:12.305106+0000","last_became_peered":"2023-11-26T07:15:12.305106+0000","last_unstale":"2023-11-26T07:15:13.292902+0000","last_undegraded":"2023-11-26T07:15:13.292902+0000","last_fullsized":"2023-11-26T07:15:13.292902+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:35:32.544576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.716139+0000","last_change":"2023-11-26T07:15:13.309012+0000","last_active":"2023-11-26T07:15:14.716139+0000","last_peered":"2023-11-26T07:15:14.716139+0000","last_clean":"2023-11-26T07:15:14.716139+0000","last_became_active":"2023-11-26T07:15:13.308718+0000","last_became_peered":"2023-11-26T07:15:13.308718+0000","last_unstale":"2023-11-26T07:15:14.716139+0000","last_undegraded":"2023-11-26T07:15:14.716139+0000","last_fullsized":"2023-11-26T07:15:14.716139+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:36:54.675012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.288447+0000","last_change":"2023-11-26T07:15:12.302509+0000","last_active":"2023-11-26T07:15:13.288447+0000","last_peered":"2023-11-26T07:15:13.288447+0000","last_clean":"2023-11-26T07:15:13.288447+0000","last_became_active":"2023-11-26T07:15:12.302212+0000","last_became_peered":"2023-11-26T07:15:12.302212+0000","last_unstale":"2023-11-26T07:15:13.288447+0000","last_undegraded":"2023-11-26T07:15:13.288447+0000","last_fullsized":"2023-11-26T07:15:13.288447+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:19:24.338719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:16.145828+0000","last_change":"2023-11-26T07:15:13.297274+0000","last_active":"2023-11-26T07:15:16.145828+0000","last_peered":"2023-11-26T07:15:16.145828+0000","last_clean":"2023-11-26T07:15:16.145828+0000","last_became_active":"2023-11-26T07:15:13.296997+0000","last_became_peered":"2023-11-26T07:15:13.296997+0000","last_unstale":"2023-11-26T07:15:16.145828+0000","last_undegraded":"2023-11-26T07:15:16.145828+0000","last_fullsized":"2023-11-26T07:15:16.145828+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:51:40.949108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"59'2","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.319838+0000","last_change":"2023-11-26T07:15:12.303860+0000","last_active":"2023-11-26T07:15:13.319838+0000","last_peered":"2023-11-26T07:15:13.319838+0000","last_clean":"2023-11-26T07:15:13.319838+0000","last_became_active":"2023-11-26T07:15:12.303589+0000","last_became_peered":"2023-11-26T07:15:12.303589+0000","last_unstale":"2023-11-26T07:15:13.319838+0000","last_undegraded":"2023-11-26T07:15:13.319838+0000","last_fullsized":"2023-11-26T07:15:13.319838+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:59:59.911203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:16.145943+0000","last_change":"2023-11-26T07:15:13.298956+0000","last_active":"2023-11-26T07:15:16.145943+0000","last_peered":"2023-11-26T07:15:16.145943+0000","last_clean":"2023-11-26T07:15:16.145943+0000","last_became_active":"2023-11-26T07:15:13.298625+0000","last_became_peered":"2023-11-26T07:15:13.298625+0000","last_unstale":"2023-11-26T07:15:16.145943+0000","last_undegraded":"2023-11-26T07:15:16.145943+0000","last_fullsized":"2023-11-26T07:15:16.145943+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:32:00.657764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.301431+0000","last_change":"2023-11-26T07:15:12.304842+0000","last_active":"2023-11-26T07:15:13.301431+0000","last_peered":"2023-11-26T07:15:13.301431+0000","last_clean":"2023-11-26T07:15:13.301431+0000","last_became_active":"2023-11-26T07:15:12.304528+0000","last_became_peered":"2023-11-26T07:15:12.304528+0000","last_unstale":"2023-11-26T07:15:13.301431+0000","last_undegraded":"2023-11-26T07:15:13.301431+0000","last_fullsized":"2023-11-26T07:15:13.301431+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:32:57.449182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:15.182389+0000","last_change":"2023-11-26T07:15:13.304849+0000","last_active":"2023-11-26T07:15:15.182389+0000","last_peered":"2023-11-26T07:15:15.182389+0000","last_clean":"2023-11-26T07:15:15.182389+0000","last_became_active":"2023-11-26T07:15:13.304198+0000","last_became_peered":"2023-11-26T07:15:13.304198+0000","last_unstale":"2023-11-26T07:15:15.182389+0000","last_undegraded":"2023-11-26T07:15:15.182389+0000","last_fullsized":"2023-11-26T07:15:15.182389+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:57:20.002200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.292659+0000","last_change":"2023-11-26T07:15:12.305532+0000","last_active":"2023-11-26T07:15:13.292659+0000","last_peered":"2023-11-26T07:15:13.292659+0000","last_clean":"2023-11-26T07:15:13.292659+0000","last_became_active":"2023-11-26T07:15:12.305279+0000","last_became_peered":"2023-11-26T07:15:12.305279+0000","last_unstale":"2023-11-26T07:15:13.292659+0000","last_undegraded":"2023-11-26T07:15:13.292659+0000","last_fullsized":"2023-11-26T07:15:13.292659+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:40:48.323276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.716583+0000","last_change":"2023-11-26T07:15:13.310815+0000","last_active":"2023-11-26T07:15:14.716583+0000","last_peered":"2023-11-26T07:15:14.716583+0000","last_clean":"2023-11-26T07:15:14.716583+0000","last_became_active":"2023-11-26T07:15:13.309943+0000","last_became_peered":"2023-11-26T07:15:13.309943+0000","last_unstale":"2023-11-26T07:15:14.716583+0000","last_undegraded":"2023-11-26T07:15:14.716583+0000","last_fullsized":"2023-11-26T07:15:14.716583+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:14:34.734501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.289823+0000","last_change":"2023-11-26T07:15:12.297147+0000","last_active":"2023-11-26T07:15:13.289823+0000","last_peered":"2023-11-26T07:15:13.289823+0000","last_clean":"2023-11-26T07:15:13.289823+0000","last_became_active":"2023-11-26T07:15:12.296860+0000","last_became_peered":"2023-11-26T07:15:12.296860+0000","last_unstale":"2023-11-26T07:15:13.289823+0000","last_undegraded":"2023-11-26T07:15:13.289823+0000","last_fullsized":"2023-11-26T07:15:13.289823+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:56:56.583112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.289107+0000","last_change":"2023-11-26T07:15:13.308321+0000","last_active":"2023-11-26T07:15:14.289107+0000","last_peered":"2023-11-26T07:15:14.289107+0000","last_clean":"2023-11-26T07:15:14.289107+0000","last_became_active":"2023-11-26T07:15:13.308047+0000","last_became_peered":"2023-11-26T07:15:13.308047+0000","last_unstale":"2023-11-26T07:15:14.289107+0000","last_undegraded":"2023-11-26T07:15:14.289107+0000","last_fullsized":"2023-11-26T07:15:14.289107+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:26:05.233782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.291276+0000","last_change":"2023-11-26T07:15:12.303276+0000","last_active":"2023-11-26T07:15:13.291276+0000","last_peered":"2023-11-26T07:15:13.291276+0000","last_clean":"2023-11-26T07:15:13.291276+0000","last_became_active":"2023-11-26T07:15:12.302970+0000","last_became_peered":"2023-11-26T07:15:12.302970+0000","last_unstale":"2023-11-26T07:15:13.291276+0000","last_undegraded":"2023-11-26T07:15:13.291276+0000","last_fullsized":"2023-11-26T07:15:13.291276+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:45:41.712084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.464768+0000","last_change":"2023-11-26T07:15:13.316490+0000","last_active":"2023-11-26T07:15:14.464768+0000","last_peered":"2023-11-26T07:15:14.464768+0000","last_clean":"2023-11-26T07:15:14.464768+0000","last_became_active":"2023-11-26T07:15:13.316274+0000","last_became_peered":"2023-11-26T07:15:13.316274+0000","last_unstale":"2023-11-26T07:15:14.464768+0000","last_undegraded":"2023-11-26T07:15:14.464768+0000","last_fullsized":"2023-11-26T07:15:14.464768+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:36:54.675012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.291809+0000","last_change":"2023-11-26T07:15:12.301634+0000","last_active":"2023-11-26T07:15:13.291809+0000","last_peered":"2023-11-26T07:15:13.291809+0000","last_clean":"2023-11-26T07:15:13.291809+0000","last_became_active":"2023-11-26T07:15:12.301275+0000","last_became_peered":"2023-11-26T07:15:12.301275+0000","last_unstale":"2023-11-26T07:15:13.291809+0000","last_undegraded":"2023-11-26T07:15:13.291809+0000","last_fullsized":"2023-11-26T07:15:13.291809+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:29:51.899488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:15.182121+0000","last_change":"2023-11-26T07:15:13.298793+0000","last_active":"2023-11-26T07:15:15.182121+0000","last_peered":"2023-11-26T07:15:15.182121+0000","last_clean":"2023-11-26T07:15:15.182121+0000","last_became_active":"2023-11-26T07:15:13.298514+0000","last_became_peered":"2023-11-26T07:15:13.298514+0000","last_unstale":"2023-11-26T07:15:15.182121+0000","last_undegraded":"2023-11-26T07:15:15.182121+0000","last_fullsized":"2023-11-26T07:15:15.182121+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:05:42.391837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.292412+0000","last_change":"2023-11-26T07:15:12.299479+0000","last_active":"2023-11-26T07:15:13.292412+0000","last_peered":"2023-11-26T07:15:13.292412+0000","last_clean":"2023-11-26T07:15:13.292412+0000","last_became_active":"2023-11-26T07:15:12.299200+0000","last_became_peered":"2023-11-26T07:15:12.299200+0000","last_unstale":"2023-11-26T07:15:13.292412+0000","last_undegraded":"2023-11-26T07:15:13.292412+0000","last_fullsized":"2023-11-26T07:15:13.292412+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:13:53.960381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.288981+0000","last_change":"2023-11-26T07:15:13.313200+0000","last_active":"2023-11-26T07:15:14.288981+0000","last_peered":"2023-11-26T07:15:14.288981+0000","last_clean":"2023-11-26T07:15:14.288981+0000","last_became_active":"2023-11-26T07:15:13.312135+0000","last_became_peered":"2023-11-26T07:15:13.312135+0000","last_unstale":"2023-11-26T07:15:14.288981+0000","last_undegraded":"2023-11-26T07:15:14.288981+0000","last_fullsized":"2023-11-26T07:15:14.288981+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:58:56.123349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.292376+0000","last_change":"2023-11-26T07:15:12.303516+0000","last_active":"2023-11-26T07:15:13.292376+0000","last_peered":"2023-11-26T07:15:13.292376+0000","last_clean":"2023-11-26T07:15:13.292376+0000","last_became_active":"2023-11-26T07:15:12.302063+0000","last_became_peered":"2023-11-26T07:15:12.302063+0000","last_unstale":"2023-11-26T07:15:13.292376+0000","last_undegraded":"2023-11-26T07:15:13.292376+0000","last_fullsized":"2023-11-26T07:15:13.292376+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:46:10.847558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.288816+0000","last_change":"2023-11-26T07:15:13.312690+0000","last_active":"2023-11-26T07:15:14.288816+0000","last_peered":"2023-11-26T07:15:14.288816+0000","last_clean":"2023-11-26T07:15:14.288816+0000","last_became_active":"2023-11-26T07:15:13.312231+0000","last_became_peered":"2023-11-26T07:15:13.312231+0000","last_unstale":"2023-11-26T07:15:14.288816+0000","last_undegraded":"2023-11-26T07:15:14.288816+0000","last_fullsized":"2023-11-26T07:15:14.288816+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:06:10.287535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.292682+0000","last_change":"2023-11-26T07:15:12.300358+0000","last_active":"2023-11-26T07:15:13.292682+0000","last_peered":"2023-11-26T07:15:13.292682+0000","last_clean":"2023-11-26T07:15:13.292682+0000","last_became_active":"2023-11-26T07:15:12.300179+0000","last_became_peered":"2023-11-26T07:15:12.300179+0000","last_unstale":"2023-11-26T07:15:13.292682+0000","last_undegraded":"2023-11-26T07:15:13.292682+0000","last_fullsized":"2023-11-26T07:15:13.292682+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:05:41.390264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":199,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.293338+0000","last_change":"2023-11-26T07:11:29.855919+0000","last_active":"2023-11-26T07:15:13.293338+0000","last_peered":"2023-11-26T07:15:13.293338+0000","last_clean":"2023-11-26T07:15:13.293338+0000","last_became_active":"2023-11-26T07:11:29.854903+0000","last_became_peered":"2023-11-26T07:11:29.854903+0000","last_unstale":"2023-11-26T07:15:13.293338+0000","last_undegraded":"2023-11-26T07:15:13.293338+0000","last_fullsized":"2023-11-26T07:15:13.293338+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:28.594252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:28.594252+0000","last_clean_scrub_stamp":"2023-11-26T07:11:28.594252+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:33:34.642696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28312,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343528,"statfs":{"total":96636764160,"available":96607772672,"internally_reserved":0,"allocated":1323008,"data_stored":892657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:14:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.35899999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.73699999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51300000000000001,"15min":0.505},"min":{"1min":0.38700000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.65600000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.48799999999999999}]},{"osd":1,"last update":"Sun Nov 26 07:14:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.84799999999999998,"15min":0.97999999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.71499999999999997,"5min":9.5600000000000005,"15min":9.5600000000000005},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.56899999999999995,"15min":0.57999999999999996},"min":{"1min":0.41599999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.70199999999999996,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.64700000000000002}]},{"osd":2,"last update":"Sun Nov 26 07:14:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59599999999999997,"15min":0.60199999999999998},"min":{"1min":0.36799999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73299999999999998,"5min":1.569,"15min":1.569},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.63900000000000001,"15min":0.64900000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.85699999999999998,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.50900000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:14:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.59599999999999997,"15min":0.60399999999999998},"min":{"1min":0.42899999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68200000000000005,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57899999999999996,"15min":0.56699999999999995},"min":{"1min":0.44700000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78500000000000003,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.59599999999999997}]},{"osd":4,"last update":"Sun Nov 26 07:14:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.372,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70399999999999996,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53500000000000003,"15min":0.51500000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.82999999999999996,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.46800000000000003}]},{"osd":5,"last update":"Sun Nov 26 07:14:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.37,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63,"15min":0.63300000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80900000000000005,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.58299999999999996}]},{"osd":6,"last update":"Sun Nov 26 07:14:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59499999999999997,"15min":0.59099999999999997},"min":{"1min":0.437,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60299999999999998,"15min":0.59299999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89100000000000001,"5min":1.552,"15min":1.552},"last":0.56899999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":720896,"data_stored":302129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.503,"15min":0.48399999999999999},"min":{"1min":0.311,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.76700000000000002,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.504,"15min":0.47599999999999998},"min":{"1min":0.38200000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.69899999999999995,"5min":0.871,"15min":0.871},"last":0.56100000000000005}]},{"osd":1,"last update":"Sun Nov 26 07:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52300000000000002,"15min":0.51100000000000001},"min":{"1min":0.35199999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.73599999999999999,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.442},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55000000000000004,"15min":0.54400000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.83599999999999997,"5min":1.198,"15min":1.198},"last":0.54000000000000004}]},{"osd":2,"last update":"Sun Nov 26 07:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51600000000000001,"15min":0.495},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.71899999999999997,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.54800000000000004,"15min":0.52300000000000002},"min":{"1min":0.437,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.495}]},{"osd":3,"last update":"Sun Nov 26 07:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.57499999999999996,"15min":0.55100000000000005},"min":{"1min":0.435,"5min":0.373,"15min":0.373},"max":{"1min":0.81999999999999995,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.629},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.60099999999999998,"15min":0.58299999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79100000000000004,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.59499999999999997}]},{"osd":4,"last update":"Sun Nov 26 07:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.52800000000000002,"15min":0.53200000000000003},"min":{"1min":0.33600000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70599999999999996,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.34100000000000003,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.78900000000000003,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.52200000000000002}]},{"osd":5,"last update":"Sun Nov 26 07:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56399999999999995,"15min":0.56000000000000005},"min":{"1min":0.40200000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.71599999999999997,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58399999999999996,"15min":0.58799999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77300000000000002,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.61099999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59299999999999997,"15min":0.59099999999999997},"min":{"1min":0.42799999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73899999999999999,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.628,"15min":0.626},"min":{"1min":0.45800000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.75700000000000001,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.68999999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31888,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339952,"statfs":{"total":96636764160,"available":96604110848,"internally_reserved":0,"allocated":724992,"data_stored":302219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.35499999999999998,"15min":0.36399999999999999},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.68400000000000005,"15min":0.83399999999999996},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.496,"5min":11.922000000000001,"15min":11.922000000000001},"last":0.45300000000000001}]},{"osd":2,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.36199999999999999,"15min":0.373},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.52600000000000002,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.318},{"interface":"front","average":{"1min":0.379,"5min":0.40200000000000002,"15min":0.40799999999999997},"min":{"1min":0.27400000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.59099999999999997,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.435}]},{"osd":3,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.45000000000000001,"15min":0.45800000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.61799999999999999,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.435,"15min":0.441},"min":{"1min":0.313,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.59899999999999998,"5min":1.101,"15min":1.101},"last":0.41599999999999998}]},{"osd":4,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.80100000000000005,"15min":0.88500000000000001},"min":{"1min":0.44700000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.97299999999999998,"5min":6.8979999999999997,"15min":6.8979999999999997},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.65700000000000003,"15min":0.66500000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.66300000000000003}]},{"osd":5,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.622,"15min":0.628},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.05,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.497},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.80800000000000005,"15min":0.89200000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.087,"5min":6.9480000000000004,"15min":6.9480000000000004},"last":0.55200000000000005}]},{"osd":6,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.65200000000000002,"15min":0.66200000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.80600000000000005,"5min":1.194,"15min":1.194},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.82299999999999995,"15min":0.91700000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.89300000000000002,"5min":6.9800000000000004,"15min":6.9800000000000004},"last":0.63300000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65700000000000003,"15min":0.66000000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67200000000000004,"15min":0.68500000000000005},"min":{"1min":0.48699999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.91200000000000003,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.57899999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32480,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339360,"statfs":{"total":96636764160,"available":96603504640,"internally_reserved":0,"allocated":1331200,"data_stored":894691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.35399999999999998,"15min":0.372},"min":{"1min":0.23400000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.42399999999999999,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.70499999999999996,"15min":0.86099999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.42099999999999999,"5min":11.987,"15min":11.987},"last":0.33400000000000002}]},{"osd":2,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.41099999999999998,"15min":0.437},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.432,"5min":1.607,"15min":1.607},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.375,"5min":0.40200000000000002,"15min":0.41399999999999998},"min":{"1min":0.27700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.54300000000000004,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.29099999999999998}]},{"osd":3,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.38100000000000001,"15min":0.38900000000000001},"min":{"1min":0.27800000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.497,"5min":0.752,"15min":0.752},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.45400000000000001,"15min":0.47399999999999998},"min":{"1min":0.32500000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.51500000000000001,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.38700000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.64100000000000001,"15min":0.65800000000000003},"min":{"1min":0.432,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.753,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.81599999999999995,"15min":0.90600000000000003},"min":{"1min":0.42999999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.75700000000000001,"5min":6.5279999999999996,"15min":6.5279999999999996},"last":0.55100000000000005}]},{"osd":5,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.64200000000000002,"15min":0.65400000000000003},"min":{"1min":0.46400000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.77100000000000002,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.68000000000000005,"15min":0.69899999999999995},"min":{"1min":0.51700000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.81799999999999995,"5min":1.508,"15min":1.508},"last":0.59199999999999997}]},{"osd":6,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.84999999999999998,"15min":0.94299999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.79400000000000004,"5min":6.5419999999999998,"15min":6.5419999999999998},"last":0.505},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.66000000000000003,"15min":0.68000000000000005},"min":{"1min":0.48299999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.755,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.626}]},{"osd":7,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.68400000000000005,"15min":0.70399999999999996},"min":{"1min":0.48399999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.74299999999999999,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.65500000000000003,"15min":0.66700000000000004},"min":{"1min":0.44800000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.82299999999999995,"5min":1.155,"15min":1.155},"last":0.60999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31892,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339948,"statfs":{"total":96636764160,"available":96604106752,"internally_reserved":0,"allocated":729088,"data_stored":302185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:14:36 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.34000000000000002,"15min":0.34599999999999997},"min":{"1min":0.24199999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.25},{"interface":"front","average":{"1min":0.375,"5min":0.39500000000000002,"15min":0.39900000000000002},"min":{"1min":0.32100000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.49099999999999999,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.36399999999999999}]},{"osd":1,"last update":"Sun Nov 26 07:14:36 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34399999999999997,"15min":0.34799999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.373,"15min":0.376},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.57199999999999995,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.32700000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:14:36 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.40200000000000002,"15min":0.41299999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.51000000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.377,"15min":0.38300000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.52500000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.29699999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:14:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.73999999999999999,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.57599999999999996,"15min":0.57799999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.91500000000000004}]},{"osd":5,"last update":"Sun Nov 26 07:14:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57299999999999995,"15min":0.57399999999999995},"min":{"1min":0.39500000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.621,"15min":0.63300000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.86299999999999999,"5min":1.002,"15min":1.002},"last":0.63500000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:14:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.60699999999999998,"15min":0.61099999999999999},"min":{"1min":0.42199999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77500000000000002,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.628,"15min":0.63400000000000001},"min":{"1min":0.45600000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.83099999999999996,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.74399999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:14:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.62,"15min":0.629},"min":{"1min":0.41999999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.76700000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.621,"15min":0.623},"min":{"1min":0.47399999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.85199999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.97699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574898,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31892,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339948,"statfs":{"total":96636764160,"available":96604106752,"internally_reserved":0,"allocated":729088,"data_stored":302185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:14:33 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.35199999999999998,"15min":0.36899999999999999},"min":{"1min":0.23400000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.48499999999999999,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.313},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.40200000000000002,"15min":0.42199999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.52900000000000003,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.443}]},{"osd":1,"last update":"Sun Nov 26 07:14:33 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.38600000000000001,"15min":0.40699999999999997},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.47799999999999998,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.46600000000000003,"15min":0.50900000000000001},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.55100000000000005,"5min":2.903,"15min":2.903},"last":0.39500000000000002}]},{"osd":2,"last update":"Sun Nov 26 07:14:33 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.39600000000000002,"15min":0.40500000000000003},"min":{"1min":0.28100000000000003,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.503,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.40600000000000003,"15min":0.41799999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.53900000000000003,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.41599999999999998}]},{"osd":4,"last update":"Sun Nov 26 07:14:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.67300000000000004,"15min":0.71299999999999997},"min":{"1min":0.41399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80900000000000005,"5min":2.9609999999999999,"15min":2.9609999999999999},"last":0.502},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.629,"15min":0.64300000000000002},"min":{"1min":0.40600000000000003,"5min":0.373,"15min":0.373},"max":{"1min":0.79400000000000004,"5min":1.163,"15min":1.163},"last":0.57099999999999995}]},{"osd":5,"last update":"Sun Nov 26 07:14:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66200000000000003,"15min":0.67600000000000005},"min":{"1min":0.42599999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.64900000000000002,"15min":0.66700000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.871,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.46400000000000002}]},{"osd":6,"last update":"Sun Nov 26 07:14:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.65000000000000002,"15min":0.67300000000000004},"min":{"1min":0.45500000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.83499999999999996,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.66000000000000003,"15min":0.68200000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.76400000000000001,"5min":1.258,"15min":1.258},"last":0.55600000000000005}]},{"osd":7,"last update":"Sun Nov 26 07:14:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.66000000000000003,"15min":0.68500000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.82199999999999995,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.624},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.72399999999999998,"15min":0.76100000000000001},"min":{"1min":0.48599999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0780000000000001,"5min":2.9969999999999999,"15min":2.9969999999999999},"last":0.54400000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31904,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339936,"statfs":{"total":96636764160,"available":96604094464,"internally_reserved":0,"allocated":733184,"data_stored":303741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.82299999999999995,"15min":0.94099999999999995},"min":{"1min":0.39700000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.70199999999999996,"5min":8.7539999999999996,"15min":8.7539999999999996},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.84599999999999997,"15min":0.95999999999999996},"min":{"1min":0.40500000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.88200000000000001,"5min":8.7390000000000008,"15min":8.7390000000000008},"last":0.625}]},{"osd":1,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.86299999999999999,"15min":0.99399999999999999},"min":{"1min":0.40999999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.77400000000000002,"5min":9.7720000000000002,"15min":9.7720000000000002},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.34699999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.80000000000000004,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.53600000000000003}]},{"osd":2,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.83199999999999996,"15min":0.94799999999999995},"min":{"1min":0.42999999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.73199999999999998,"5min":9.8119999999999994,"15min":9.8119999999999994},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.76800000000000002,"15min":0.84399999999999997},"min":{"1min":0.38800000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78700000000000003,"5min":3.645,"15min":3.645},"last":0.51300000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.874,"15min":0.98999999999999999},"min":{"1min":0.436,"5min":0.434,"15min":0.434},"max":{"1min":0.76500000000000001,"5min":8.8089999999999993,"15min":8.8089999999999993},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.77400000000000002,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.60499999999999998}]},{"osd":5,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.51400000000000001,"15min":0.502},"min":{"1min":0.32700000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.55800000000000005,"15min":0.55300000000000005},"min":{"1min":0.39800000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.65800000000000003}]},{"osd":6,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58799999999999997,"15min":0.58099999999999996},"min":{"1min":0.48099999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56799999999999995,"15min":0.57399999999999995},"min":{"1min":0.34899999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.74399999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.79600000000000004}]},{"osd":7,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59499999999999997,"15min":0.59399999999999997},"min":{"1min":0.41899999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.81100000000000005,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.60499999999999998,"15min":0.60399999999999998},"min":{"1min":0.40200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.82899999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":729088,"data_stored":302781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.56399999999999995,"15min":0.53200000000000003},"min":{"1min":0.36099999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":7.1500000000000004,"5min":7.1500000000000004,"15min":7.1500000000000004},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.59899999999999998,"15min":0.57299999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":6.8470000000000004,"5min":6.8470000000000004,"15min":6.8470000000000004},"last":0.58399999999999996}]},{"osd":1,"last update":"Sun Nov 26 07:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.58799999999999997,"15min":0.55600000000000005},"min":{"1min":0.372,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":7.1269999999999998,"5min":7.1269999999999998,"15min":7.1269999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.34499999999999997,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.47699999999999998}]},{"osd":2,"last update":"Sun Nov 26 07:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.629,"15min":0.59299999999999997},"min":{"1min":0.40100000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":7.2000000000000002,"5min":7.2000000000000002,"15min":7.2000000000000002},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.65400000000000003,"15min":0.61799999999999999},"min":{"1min":0.46100000000000002,"5min":0.379,"15min":0.379},"max":{"1min":7.8259999999999996,"5min":7.8259999999999996,"15min":7.8259999999999996},"last":0.67900000000000005}]},{"osd":3,"last update":"Sun Nov 26 07:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.57399999999999995,"15min":0.56299999999999994},"min":{"1min":0.39000000000000001,"5min":0.372,"15min":0.372},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.879,"5min":0.64200000000000002,"15min":0.60499999999999998},"min":{"1min":0.40200000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":6.9240000000000004,"5min":6.9240000000000004,"15min":6.9240000000000004},"last":0.502}]},{"osd":4,"last update":"Sun Nov 26 07:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.55400000000000005,"15min":0.51000000000000001},"min":{"1min":0.36399999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":7.2830000000000004,"5min":7.2830000000000004,"15min":7.2830000000000004},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.57999999999999996,"15min":0.57499999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.66500000000000004}]},{"osd":6,"last update":"Sun Nov 26 07:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.61799999999999999,"15min":0.57099999999999995},"min":{"1min":0.35599999999999998,"5min":0.308,"15min":0.308},"max":{"1min":6.8890000000000002,"5min":6.8890000000000002,"15min":6.8890000000000002},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.63,"15min":0.58899999999999997},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":7.2430000000000003,"5min":7.2430000000000003,"15min":7.2430000000000003},"last":0.72399999999999998}]},{"osd":7,"last update":"Sun Nov 26 07:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.64900000000000002,"15min":0.60599999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":6.9880000000000004,"5min":6.9880000000000004,"15min":6.9880000000000004},"last":0.69199999999999995},{"interface":"front","average":{"1min":1.1519999999999999,"5min":0.72799999999999998,"15min":0.65700000000000003},"min":{"1min":0.44800000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":11.874000000000001,"5min":11.874000000000001,"15min":11.874000000000001},"last":0.754}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:15:19.271 INFO:tasks.ceph.mds.a.smithi002.stderr:2023-11-26T07:15:19.269+0000 7fc01c6b6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-26T07:15:22.085 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:15:22.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.223+0000 7f516ddf1700 1 Processor -- start 2023-11-26T07:15:22.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.223+0000 7f516ddf1700 1 -- start start 2023-11-26T07:15:22.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.224+0000 7f516ddf1700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f516815a570 0x7f51680ad1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:22.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.224+0000 7f516ddf1700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f51680b0490 0x7f51680ae900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:22.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.224+0000 7f516ddf1700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51680ae470 con 0x7f516806bae0 2023-11-26T07:15:22.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.224+0000 7f516ddf1700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51680ad860 con 0x7f51680b0490 2023-11-26T07:15:22.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.224+0000 7f516ddf1700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51680adb40 con 0x7f516815a570 2023-11-26T07:15:22.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.224+0000 7f5167fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f51680b0490 0x7f51680ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:22.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.224+0000 7f5167fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f51680b0490 0x7f51680ae900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43194/0 (socket says 172.21.15.2:43194) 2023-11-26T07:15:22.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.224+0000 7f5167fff700 1 -- 172.21.15.2:0/1974956697 learned_addr learned my addr 172.21.15.2:0/1974956697 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:22.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.224+0000 7f51677fe700 1 --2- 172.21.15.2:0/1974956697 >> v2:172.21.15.192:3300/0 conn(0x7f516815a570 0x7f51680ad1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:22.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.224+0000 7f5167fff700 1 -- 172.21.15.2:0/1974956697 >> v2:172.21.15.192:3300/0 conn(0x7f516815a570 msgr2=0x7f51680ad1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:22.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.224+0000 7f5167fff700 1 --2- 172.21.15.2:0/1974956697 >> v2:172.21.15.192:3300/0 conn(0x7f516815a570 0x7f51680ad1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:22.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.224+0000 7f5167fff700 1 -- 172.21.15.2:0/1974956697 >> v1:172.21.15.192:6789/0 conn(0x7f516806bae0 legacy=0x7f51680afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:22.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.224+0000 7f5167fff700 1 -- 172.21.15.2:0/1974956697 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51680ade20 con 0x7f51680b0490 2023-11-26T07:15:22.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.225+0000 7f5167fff700 1 --2- 172.21.15.2:0/1974956697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51680b0490 0x7f51680ae900 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f51680737e0 tx=0x7f516000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70b622a9c864bf00 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:22.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.225+0000 7f51667fc700 1 -- 172.21.15.2:0/1974956697 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516000f070 con 0x7f51680b0490 2023-11-26T07:15:22.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.225+0000 7f51667fc700 1 -- 172.21.15.2:0/1974956697 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516000a2e0 con 0x7f51680b0490 2023-11-26T07:15:22.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.225+0000 7f51667fc700 1 -- 172.21.15.2:0/1974956697 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516000ccc0 con 0x7f51680b0490 2023-11-26T07:15:22.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.225+0000 7f516ddf1700 1 -- 172.21.15.2:0/1974956697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51680b0490 msgr2=0x7f51680ae900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:22.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.225+0000 7f516ddf1700 1 --2- 172.21.15.2:0/1974956697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51680b0490 0x7f51680ae900 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f51680737e0 tx=0x7f516000c330 comp rx=0 tx=0).stop 2023-11-26T07:15:22.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.225+0000 7f516ddf1700 1 -- 172.21.15.2:0/1974956697 shutdown_connections 2023-11-26T07:15:22.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.225+0000 7f516ddf1700 1 --2- 172.21.15.2:0/1974956697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51680b0490 0x7f51680ae900 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:22.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.225+0000 7f516ddf1700 1 --2- 172.21.15.2:0/1974956697 >> v2:172.21.15.192:3300/0 conn(0x7f516815a570 0x7f51680ad1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:22.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.225+0000 7f516ddf1700 1 -- 172.21.15.2:0/1974956697 >> 172.21.15.2:0/1974956697 conn(0x7f51680717f0 msgr2=0x7f51680b5070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:22.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.226+0000 7f516ddf1700 1 -- 172.21.15.2:0/1974956697 shutdown_connections 2023-11-26T07:15:22.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.226+0000 7f516ddf1700 1 -- 172.21.15.2:0/1974956697 wait complete. 2023-11-26T07:15:22.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.227+0000 7f516ddf1700 1 Processor -- start 2023-11-26T07:15:22.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.227+0000 7f516ddf1700 1 -- start start 2023-11-26T07:15:22.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.228+0000 7f516ddf1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f516806bae0 0x7f51681549f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:22.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.228+0000 7f516ddf1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51680b0490 0x7f5168157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:22.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.228+0000 7f516ddf1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f516815a570 0x7f5168153370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:22.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.228+0000 7f516ddf1700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5168158970 con 0x7f516806bae0 2023-11-26T07:15:22.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.228+0000 7f516ddf1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51680d0260 con 0x7f516815a570 2023-11-26T07:15:22.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.228+0000 7f516ddf1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51681580d0 con 0x7f51680b0490 2023-11-26T07:15:22.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.228+0000 7f51677fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f516806bae0 0x7f51681549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:22.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.228+0000 7f51677fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f516806bae0 0x7f51681549f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43196/0 (socket says 172.21.15.2:43196) 2023-11-26T07:15:22.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.228+0000 7f51677fe700 1 -- 172.21.15.2:0/3821337850 learned_addr learned my addr 172.21.15.2:0/3821337850 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:22.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.228+0000 7f5167fff700 1 --2- 172.21.15.2:0/3821337850 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f516815a570 0x7f5168153370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:22.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.228+0000 7f5166ffd700 1 --2- 172.21.15.2:0/3821337850 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51680b0490 0x7f5168157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:22.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.228+0000 7f51677fe700 1 -- 172.21.15.2:0/3821337850 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51680b0490 msgr2=0x7f5168157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:22.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.228+0000 7f51677fe700 1 --2- 172.21.15.2:0/3821337850 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51680b0490 0x7f5168157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:22.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.228+0000 7f51677fe700 1 -- 172.21.15.2:0/3821337850 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f516815a570 msgr2=0x7f5168153370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:22.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.228+0000 7f51677fe700 1 --2- 172.21.15.2:0/3821337850 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f516815a570 0x7f5168153370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:22.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.228+0000 7f51677fe700 1 -- 172.21.15.2:0/3821337850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f516000ac40 con 0x7f516806bae0 2023-11-26T07:15:22.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.228+0000 7f5166ffd700 1 --2- 172.21.15.2:0/3821337850 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51680b0490 0x7f5168157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:15:22.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.228+0000 7f51677fe700 1 --2- 172.21.15.2:0/3821337850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f516806bae0 0x7f51681549f0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f515800d800 tx=0x7f515800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:22.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.228+0000 7f515ffff700 1 -- 172.21.15.2:0/3821337850 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51580125f0 con 0x7f516806bae0 2023-11-26T07:15:22.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.229+0000 7f515ffff700 1 -- 172.21.15.2:0/3821337850 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5158012750 con 0x7f516806bae0 2023-11-26T07:15:22.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.229+0000 7f516ddf1700 1 -- 172.21.15.2:0/3821337850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51681583b0 con 0x7f516806bae0 2023-11-26T07:15:22.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.229+0000 7f515ffff700 1 -- 172.21.15.2:0/3821337850 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5158012b00 con 0x7f516806bae0 2023-11-26T07:15:22.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.229+0000 7f516ddf1700 1 -- 172.21.15.2:0/3821337850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f516809a4a0 con 0x7f516806bae0 2023-11-26T07:15:22.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.229+0000 7f516ddf1700 1 -- 172.21.15.2:0/3821337850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5168068670 con 0x7f516806bae0 2023-11-26T07:15:22.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.230+0000 7f515ffff700 1 -- 172.21.15.2:0/3821337850 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f5158012c60 con 0x7f516806bae0 2023-11-26T07:15:22.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.230+0000 7f515ffff700 1 --2- 172.21.15.2:0/3821337850 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f514806b470 0x7f514806d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:22.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.231+0000 7f515ffff700 1 -- 172.21.15.2:0/3821337850 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f515808a3d0 con 0x7f516806bae0 2023-11-26T07:15:22.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.231+0000 7f5166ffd700 1 --2- 172.21.15.2:0/3821337850 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f514806b470 0x7f514806d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:22.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.231+0000 7f5166ffd700 1 --2- 172.21.15.2:0/3821337850 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f514806b470 0x7f514806d930 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5168158b70 tx=0x7f5150009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:22.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.236+0000 7f515ffff700 1 -- 172.21.15.2:0/3821337850 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5158054ca0 con 0x7f516806bae0 2023-11-26T07:15:22.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.433+0000 7f516ddf1700 1 -- 172.21.15.2:0/3821337850 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f516815a950 con 0x7f514806b470 2023-11-26T07:15:22.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.442+0000 7f515ffff700 1 -- 172.21.15.2:0/3821337850 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289231 (secure 0 0 0) 0x7f5150014420 con 0x7f514806b470 2023-11-26T07:15:22.448 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:15:22.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.445+0000 7f516ddf1700 1 -- 172.21.15.2:0/3821337850 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f514806b470 msgr2=0x7f514806d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:22.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.445+0000 7f516ddf1700 1 --2- 172.21.15.2:0/3821337850 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f514806b470 0x7f514806d930 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5168158b70 tx=0x7f5150009040 comp rx=0 tx=0).stop 2023-11-26T07:15:22.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.445+0000 7f516ddf1700 1 -- 172.21.15.2:0/3821337850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f516806bae0 msgr2=0x7f51681549f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:22.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.445+0000 7f516ddf1700 1 --2- 172.21.15.2:0/3821337850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f516806bae0 0x7f51681549f0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f515800d800 tx=0x7f515800dbc0 comp rx=0 tx=0).stop 2023-11-26T07:15:22.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.445+0000 7f516ddf1700 1 -- 172.21.15.2:0/3821337850 shutdown_connections 2023-11-26T07:15:22.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.445+0000 7f516ddf1700 1 --2- 172.21.15.2:0/3821337850 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f514806b470 0x7f514806d930 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:22.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.445+0000 7f516ddf1700 1 --2- 172.21.15.2:0/3821337850 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f516815a570 0x7f5168153370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:22.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.445+0000 7f516ddf1700 1 --2- 172.21.15.2:0/3821337850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f516806bae0 0x7f51681549f0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:22.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.445+0000 7f516ddf1700 1 --2- 172.21.15.2:0/3821337850 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51680b0490 0x7f5168157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:22.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.445+0000 7f516ddf1700 1 -- 172.21.15.2:0/3821337850 >> 172.21.15.2:0/3821337850 conn(0x7f51680717f0 msgr2=0x7f516806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:22.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.445+0000 7f516ddf1700 1 -- 172.21.15.2:0/3821337850 shutdown_connections 2023-11-26T07:15:22.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.446+0000 7f516ddf1700 1 -- 172.21.15.2:0/3821337850 wait complete. 2023-11-26T07:15:22.451 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-26T07:15:22.459 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":171,"stamp":"2023-11-26T07:15:22.210771+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243824,"kb_used_data":6856,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754730896,"statfs":{"total":773094113280,"available":772844437504,"internally_reserved":0,"allocated":7020544,"data_stored":3602588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.923908"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:16.145159+0000","last_change":"2023-11-26T07:15:13.308114+0000","last_active":"2023-11-26T07:15:16.145159+0000","last_peered":"2023-11-26T07:15:16.145159+0000","last_clean":"2023-11-26T07:15:16.145159+0000","last_became_active":"2023-11-26T07:15:13.307813+0000","last_became_peered":"2023-11-26T07:15:13.307813+0000","last_unstale":"2023-11-26T07:15:16.145159+0000","last_undegraded":"2023-11-26T07:15:16.145159+0000","last_fullsized":"2023-11-26T07:15:16.145159+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:06:11.773814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.289297+0000","last_change":"2023-11-26T07:15:13.303293+0000","last_active":"2023-11-26T07:15:14.289297+0000","last_peered":"2023-11-26T07:15:14.289297+0000","last_clean":"2023-11-26T07:15:14.289297+0000","last_became_active":"2023-11-26T07:15:13.302966+0000","last_became_peered":"2023-11-26T07:15:13.302966+0000","last_unstale":"2023-11-26T07:15:14.289297+0000","last_undegraded":"2023-11-26T07:15:14.289297+0000","last_fullsized":"2023-11-26T07:15:14.289297+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:43:51.404914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.464607+0000","last_change":"2023-11-26T07:15:13.307638+0000","last_active":"2023-11-26T07:15:14.464607+0000","last_peered":"2023-11-26T07:15:14.464607+0000","last_clean":"2023-11-26T07:15:14.464607+0000","last_became_active":"2023-11-26T07:15:13.307218+0000","last_became_peered":"2023-11-26T07:15:13.307218+0000","last_unstale":"2023-11-26T07:15:14.464607+0000","last_undegraded":"2023-11-26T07:15:14.464607+0000","last_fullsized":"2023-11-26T07:15:14.464607+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:32:00.657764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:16.145589+0000","last_change":"2023-11-26T07:15:13.293974+0000","last_active":"2023-11-26T07:15:16.145589+0000","last_peered":"2023-11-26T07:15:16.145589+0000","last_clean":"2023-11-26T07:15:16.145589+0000","last_became_active":"2023-11-26T07:15:13.293509+0000","last_became_peered":"2023-11-26T07:15:13.293509+0000","last_unstale":"2023-11-26T07:15:16.145589+0000","last_undegraded":"2023-11-26T07:15:16.145589+0000","last_fullsized":"2023-11-26T07:15:16.145589+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:42:21.390076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:16.144987+0000","last_change":"2023-11-26T07:15:13.303952+0000","last_active":"2023-11-26T07:15:16.144987+0000","last_peered":"2023-11-26T07:15:16.144987+0000","last_clean":"2023-11-26T07:15:16.144987+0000","last_became_active":"2023-11-26T07:15:13.303507+0000","last_became_peered":"2023-11-26T07:15:13.303507+0000","last_unstale":"2023-11-26T07:15:16.144987+0000","last_undegraded":"2023-11-26T07:15:16.144987+0000","last_fullsized":"2023-11-26T07:15:16.144987+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:26:27.330842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.716188+0000","last_change":"2023-11-26T07:15:13.317626+0000","last_active":"2023-11-26T07:15:14.716188+0000","last_peered":"2023-11-26T07:15:14.716188+0000","last_clean":"2023-11-26T07:15:14.716188+0000","last_became_active":"2023-11-26T07:15:13.317335+0000","last_became_peered":"2023-11-26T07:15:13.317335+0000","last_unstale":"2023-11-26T07:15:14.716188+0000","last_undegraded":"2023-11-26T07:15:14.716188+0000","last_fullsized":"2023-11-26T07:15:14.716188+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:29:58.803265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.289649+0000","last_change":"2023-11-26T07:15:13.298258+0000","last_active":"2023-11-26T07:15:14.289649+0000","last_peered":"2023-11-26T07:15:14.289649+0000","last_clean":"2023-11-26T07:15:14.289649+0000","last_became_active":"2023-11-26T07:15:13.297971+0000","last_became_peered":"2023-11-26T07:15:13.297971+0000","last_unstale":"2023-11-26T07:15:14.289649+0000","last_undegraded":"2023-11-26T07:15:14.289649+0000","last_fullsized":"2023-11-26T07:15:14.289649+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:44:33.820633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.288797+0000","last_change":"2023-11-26T07:15:13.306149+0000","last_active":"2023-11-26T07:15:14.288797+0000","last_peered":"2023-11-26T07:15:14.288797+0000","last_clean":"2023-11-26T07:15:14.288797+0000","last_became_active":"2023-11-26T07:15:13.305847+0000","last_became_peered":"2023-11-26T07:15:13.305847+0000","last_unstale":"2023-11-26T07:15:14.288797+0000","last_undegraded":"2023-11-26T07:15:14.288797+0000","last_fullsized":"2023-11-26T07:15:14.288797+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:58:21.942488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.289871+0000","last_change":"2023-11-26T07:15:13.310617+0000","last_active":"2023-11-26T07:15:14.289871+0000","last_peered":"2023-11-26T07:15:14.289871+0000","last_clean":"2023-11-26T07:15:14.289871+0000","last_became_active":"2023-11-26T07:15:13.310363+0000","last_became_peered":"2023-11-26T07:15:13.310363+0000","last_unstale":"2023-11-26T07:15:14.289871+0000","last_undegraded":"2023-11-26T07:15:14.289871+0000","last_fullsized":"2023-11-26T07:15:14.289871+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:21:16.538514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:15.182523+0000","last_change":"2023-11-26T07:15:13.307979+0000","last_active":"2023-11-26T07:15:15.182523+0000","last_peered":"2023-11-26T07:15:15.182523+0000","last_clean":"2023-11-26T07:15:15.182523+0000","last_became_active":"2023-11-26T07:15:13.307720+0000","last_became_peered":"2023-11-26T07:15:13.307720+0000","last_unstale":"2023-11-26T07:15:15.182523+0000","last_undegraded":"2023-11-26T07:15:15.182523+0000","last_fullsized":"2023-11-26T07:15:15.182523+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:19:25.531893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:15.182598+0000","last_change":"2023-11-26T07:15:13.304004+0000","last_active":"2023-11-26T07:15:15.182598+0000","last_peered":"2023-11-26T07:15:15.182598+0000","last_clean":"2023-11-26T07:15:15.182598+0000","last_became_active":"2023-11-26T07:15:13.303719+0000","last_became_peered":"2023-11-26T07:15:13.303719+0000","last_unstale":"2023-11-26T07:15:15.182598+0000","last_undegraded":"2023-11-26T07:15:15.182598+0000","last_fullsized":"2023-11-26T07:15:15.182598+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:29:11.229380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:16.145741+0000","last_change":"2023-11-26T07:15:13.298878+0000","last_active":"2023-11-26T07:15:16.145741+0000","last_peered":"2023-11-26T07:15:16.145741+0000","last_clean":"2023-11-26T07:15:16.145741+0000","last_became_active":"2023-11-26T07:15:13.298585+0000","last_became_peered":"2023-11-26T07:15:13.298585+0000","last_unstale":"2023-11-26T07:15:16.145741+0000","last_undegraded":"2023-11-26T07:15:16.145741+0000","last_fullsized":"2023-11-26T07:15:16.145741+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:20:56.131760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:15.186635+0000","last_change":"2023-11-26T07:15:13.311040+0000","last_active":"2023-11-26T07:15:15.186635+0000","last_peered":"2023-11-26T07:15:15.186635+0000","last_clean":"2023-11-26T07:15:15.186635+0000","last_became_active":"2023-11-26T07:15:13.310713+0000","last_became_peered":"2023-11-26T07:15:13.310713+0000","last_unstale":"2023-11-26T07:15:15.186635+0000","last_undegraded":"2023-11-26T07:15:15.186635+0000","last_fullsized":"2023-11-26T07:15:15.186635+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:36:08.844248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.289904+0000","last_change":"2023-11-26T07:15:13.302245+0000","last_active":"2023-11-26T07:15:14.289904+0000","last_peered":"2023-11-26T07:15:14.289904+0000","last_clean":"2023-11-26T07:15:14.289904+0000","last_became_active":"2023-11-26T07:15:13.301967+0000","last_became_peered":"2023-11-26T07:15:13.301967+0000","last_unstale":"2023-11-26T07:15:14.289904+0000","last_undegraded":"2023-11-26T07:15:14.289904+0000","last_fullsized":"2023-11-26T07:15:14.289904+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:15:04.254627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.289738+0000","last_change":"2023-11-26T07:15:13.300428+0000","last_active":"2023-11-26T07:15:14.289738+0000","last_peered":"2023-11-26T07:15:14.289738+0000","last_clean":"2023-11-26T07:15:14.289738+0000","last_became_active":"2023-11-26T07:15:13.300103+0000","last_became_peered":"2023-11-26T07:15:13.300103+0000","last_unstale":"2023-11-26T07:15:14.289738+0000","last_undegraded":"2023-11-26T07:15:14.289738+0000","last_fullsized":"2023-11-26T07:15:14.289738+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:55:35.150250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.716044+0000","last_change":"2023-11-26T07:15:13.311434+0000","last_active":"2023-11-26T07:15:14.716044+0000","last_peered":"2023-11-26T07:15:14.716044+0000","last_clean":"2023-11-26T07:15:14.716044+0000","last_became_active":"2023-11-26T07:15:13.311043+0000","last_became_peered":"2023-11-26T07:15:13.311043+0000","last_unstale":"2023-11-26T07:15:14.716044+0000","last_undegraded":"2023-11-26T07:15:14.716044+0000","last_fullsized":"2023-11-26T07:15:14.716044+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:46:11.849131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.289136+0000","last_change":"2023-11-26T07:15:13.315444+0000","last_active":"2023-11-26T07:15:14.289136+0000","last_peered":"2023-11-26T07:15:14.289136+0000","last_clean":"2023-11-26T07:15:14.289136+0000","last_became_active":"2023-11-26T07:15:13.313428+0000","last_became_peered":"2023-11-26T07:15:13.313428+0000","last_unstale":"2023-11-26T07:15:14.289136+0000","last_undegraded":"2023-11-26T07:15:14.289136+0000","last_fullsized":"2023-11-26T07:15:14.289136+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:12:33.505942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.464896+0000","last_change":"2023-11-26T07:15:13.310021+0000","last_active":"2023-11-26T07:15:14.464896+0000","last_peered":"2023-11-26T07:15:14.464896+0000","last_clean":"2023-11-26T07:15:14.464896+0000","last_became_active":"2023-11-26T07:15:13.309683+0000","last_became_peered":"2023-11-26T07:15:13.309683+0000","last_unstale":"2023-11-26T07:15:14.464896+0000","last_undegraded":"2023-11-26T07:15:14.464896+0000","last_fullsized":"2023-11-26T07:15:14.464896+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:29:58.803265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:16.145091+0000","last_change":"2023-11-26T07:15:13.316644+0000","last_active":"2023-11-26T07:15:16.145091+0000","last_peered":"2023-11-26T07:15:16.145091+0000","last_clean":"2023-11-26T07:15:16.145091+0000","last_became_active":"2023-11-26T07:15:13.316335+0000","last_became_peered":"2023-11-26T07:15:13.316335+0000","last_unstale":"2023-11-26T07:15:16.145091+0000","last_undegraded":"2023-11-26T07:15:16.145091+0000","last_fullsized":"2023-11-26T07:15:16.145091+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:44:48.042431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.288963+0000","last_change":"2023-11-26T07:15:13.312661+0000","last_active":"2023-11-26T07:15:14.288963+0000","last_peered":"2023-11-26T07:15:14.288963+0000","last_clean":"2023-11-26T07:15:14.288963+0000","last_became_active":"2023-11-26T07:15:13.312329+0000","last_became_peered":"2023-11-26T07:15:13.312329+0000","last_unstale":"2023-11-26T07:15:14.288963+0000","last_undegraded":"2023-11-26T07:15:14.288963+0000","last_fullsized":"2023-11-26T07:15:14.288963+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:47:55.592557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.464766+0000","last_change":"2023-11-26T07:15:13.301613+0000","last_active":"2023-11-26T07:15:14.464766+0000","last_peered":"2023-11-26T07:15:14.464766+0000","last_clean":"2023-11-26T07:15:14.464766+0000","last_became_active":"2023-11-26T07:15:13.301116+0000","last_became_peered":"2023-11-26T07:15:13.301116+0000","last_unstale":"2023-11-26T07:15:14.464766+0000","last_undegraded":"2023-11-26T07:15:14.464766+0000","last_fullsized":"2023-11-26T07:15:14.464766+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:46:11.849131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.288909+0000","last_change":"2023-11-26T07:15:13.307609+0000","last_active":"2023-11-26T07:15:14.288909+0000","last_peered":"2023-11-26T07:15:14.288909+0000","last_clean":"2023-11-26T07:15:14.288909+0000","last_became_active":"2023-11-26T07:15:13.307352+0000","last_became_peered":"2023-11-26T07:15:13.307352+0000","last_unstale":"2023-11-26T07:15:14.288909+0000","last_undegraded":"2023-11-26T07:15:14.288909+0000","last_fullsized":"2023-11-26T07:15:14.288909+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:19:47.275564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.464682+0000","last_change":"2023-11-26T07:15:13.308524+0000","last_active":"2023-11-26T07:15:14.464682+0000","last_peered":"2023-11-26T07:15:14.464682+0000","last_clean":"2023-11-26T07:15:14.464682+0000","last_became_active":"2023-11-26T07:15:13.307898+0000","last_became_peered":"2023-11-26T07:15:13.307898+0000","last_unstale":"2023-11-26T07:15:14.464682+0000","last_undegraded":"2023-11-26T07:15:14.464682+0000","last_fullsized":"2023-11-26T07:15:14.464682+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:59:19.037305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:15.186443+0000","last_change":"2023-11-26T07:15:13.314831+0000","last_active":"2023-11-26T07:15:15.186443+0000","last_peered":"2023-11-26T07:15:15.186443+0000","last_clean":"2023-11-26T07:15:15.186443+0000","last_became_active":"2023-11-26T07:15:13.314613+0000","last_became_peered":"2023-11-26T07:15:13.314613+0000","last_unstale":"2023-11-26T07:15:15.186443+0000","last_undegraded":"2023-11-26T07:15:15.186443+0000","last_fullsized":"2023-11-26T07:15:15.186443+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:55:31.988300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:16.145261+0000","last_change":"2023-11-26T07:15:13.302505+0000","last_active":"2023-11-26T07:15:16.145261+0000","last_peered":"2023-11-26T07:15:16.145261+0000","last_clean":"2023-11-26T07:15:16.145261+0000","last_became_active":"2023-11-26T07:15:13.302219+0000","last_became_peered":"2023-11-26T07:15:13.302219+0000","last_unstale":"2023-11-26T07:15:16.145261+0000","last_undegraded":"2023-11-26T07:15:16.145261+0000","last_fullsized":"2023-11-26T07:15:16.145261+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:20:03.025839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:16.145853+0000","last_change":"2023-11-26T07:15:13.298297+0000","last_active":"2023-11-26T07:15:16.145853+0000","last_peered":"2023-11-26T07:15:16.145853+0000","last_clean":"2023-11-26T07:15:16.145853+0000","last_became_active":"2023-11-26T07:15:13.298019+0000","last_became_peered":"2023-11-26T07:15:13.298019+0000","last_unstale":"2023-11-26T07:15:16.145853+0000","last_undegraded":"2023-11-26T07:15:16.145853+0000","last_fullsized":"2023-11-26T07:15:16.145853+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:34:55.081476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.716400+0000","last_change":"2023-11-26T07:15:13.311021+0000","last_active":"2023-11-26T07:15:14.716400+0000","last_peered":"2023-11-26T07:15:14.716400+0000","last_clean":"2023-11-26T07:15:14.716400+0000","last_became_active":"2023-11-26T07:15:13.310518+0000","last_became_peered":"2023-11-26T07:15:13.310518+0000","last_unstale":"2023-11-26T07:15:14.716400+0000","last_undegraded":"2023-11-26T07:15:14.716400+0000","last_fullsized":"2023-11-26T07:15:14.716400+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:20:22.142720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:16.145092+0000","last_change":"2023-11-26T07:15:13.303957+0000","last_active":"2023-11-26T07:15:16.145092+0000","last_peered":"2023-11-26T07:15:16.145092+0000","last_clean":"2023-11-26T07:15:16.145092+0000","last_became_active":"2023-11-26T07:15:13.303560+0000","last_became_peered":"2023-11-26T07:15:13.303560+0000","last_unstale":"2023-11-26T07:15:16.145092+0000","last_undegraded":"2023-11-26T07:15:16.145092+0000","last_fullsized":"2023-11-26T07:15:16.145092+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:04:05.590262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.289555+0000","last_change":"2023-11-26T07:15:13.309584+0000","last_active":"2023-11-26T07:15:14.289555+0000","last_peered":"2023-11-26T07:15:14.289555+0000","last_clean":"2023-11-26T07:15:14.289555+0000","last_became_active":"2023-11-26T07:15:13.309317+0000","last_became_peered":"2023-11-26T07:15:13.309317+0000","last_unstale":"2023-11-26T07:15:14.289555+0000","last_undegraded":"2023-11-26T07:15:14.289555+0000","last_fullsized":"2023-11-26T07:15:14.289555+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:32:16.307775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.464583+0000","last_change":"2023-11-26T07:15:13.304470+0000","last_active":"2023-11-26T07:15:14.464583+0000","last_peered":"2023-11-26T07:15:14.464583+0000","last_clean":"2023-11-26T07:15:14.464583+0000","last_became_active":"2023-11-26T07:15:13.304187+0000","last_became_peered":"2023-11-26T07:15:13.304187+0000","last_unstale":"2023-11-26T07:15:14.464583+0000","last_undegraded":"2023-11-26T07:15:14.464583+0000","last_fullsized":"2023-11-26T07:15:14.464583+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:32:58.450755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:16.144866+0000","last_change":"2023-11-26T07:15:13.301409+0000","last_active":"2023-11-26T07:15:16.144866+0000","last_peered":"2023-11-26T07:15:16.144866+0000","last_clean":"2023-11-26T07:15:16.144866+0000","last_became_active":"2023-11-26T07:15:13.301099+0000","last_became_peered":"2023-11-26T07:15:13.301099+0000","last_unstale":"2023-11-26T07:15:16.144866+0000","last_undegraded":"2023-11-26T07:15:16.144866+0000","last_fullsized":"2023-11-26T07:15:16.144866+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:49:03.762354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.716176+0000","last_change":"2023-11-26T07:15:13.311998+0000","last_active":"2023-11-26T07:15:14.716176+0000","last_peered":"2023-11-26T07:15:14.716176+0000","last_clean":"2023-11-26T07:15:14.716176+0000","last_became_active":"2023-11-26T07:15:13.311715+0000","last_became_peered":"2023-11-26T07:15:13.311715+0000","last_unstale":"2023-11-26T07:15:14.716176+0000","last_undegraded":"2023-11-26T07:15:14.716176+0000","last_fullsized":"2023-11-26T07:15:14.716176+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:05:41.521323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.716357+0000","last_change":"2023-11-26T07:15:13.309239+0000","last_active":"2023-11-26T07:15:14.716357+0000","last_peered":"2023-11-26T07:15:14.716357+0000","last_clean":"2023-11-26T07:15:14.716357+0000","last_became_active":"2023-11-26T07:15:13.308871+0000","last_became_peered":"2023-11-26T07:15:13.308871+0000","last_unstale":"2023-11-26T07:15:14.716357+0000","last_undegraded":"2023-11-26T07:15:14.716357+0000","last_fullsized":"2023-11-26T07:15:14.716357+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:05:29.806891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"59'4","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.319919+0000","last_change":"2023-11-26T07:15:12.298413+0000","last_active":"2023-11-26T07:15:13.319919+0000","last_peered":"2023-11-26T07:15:13.319919+0000","last_clean":"2023-11-26T07:15:13.319919+0000","last_became_active":"2023-11-26T07:15:12.298102+0000","last_became_peered":"2023-11-26T07:15:12.298102+0000","last_unstale":"2023-11-26T07:15:13.319919+0000","last_undegraded":"2023-11-26T07:15:13.319919+0000","last_fullsized":"2023-11-26T07:15:13.319919+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:51:39.947535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:15.182607+0000","last_change":"2023-11-26T07:15:13.303110+0000","last_active":"2023-11-26T07:15:15.182607+0000","last_peered":"2023-11-26T07:15:15.182607+0000","last_clean":"2023-11-26T07:15:15.182607+0000","last_became_active":"2023-11-26T07:15:13.302787+0000","last_became_peered":"2023-11-26T07:15:13.302787+0000","last_unstale":"2023-11-26T07:15:15.182607+0000","last_undegraded":"2023-11-26T07:15:15.182607+0000","last_fullsized":"2023-11-26T07:15:15.182607+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:05:49.340343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"59'1","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.319113+0000","last_change":"2023-11-26T07:15:12.302787+0000","last_active":"2023-11-26T07:15:13.319113+0000","last_peered":"2023-11-26T07:15:13.319113+0000","last_clean":"2023-11-26T07:15:13.319113+0000","last_became_active":"2023-11-26T07:15:12.302489+0000","last_became_peered":"2023-11-26T07:15:12.302489+0000","last_unstale":"2023-11-26T07:15:13.319113+0000","last_undegraded":"2023-11-26T07:15:13.319113+0000","last_fullsized":"2023-11-26T07:15:13.319113+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:05:40.519750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.716470+0000","last_change":"2023-11-26T07:15:13.310946+0000","last_active":"2023-11-26T07:15:14.716470+0000","last_peered":"2023-11-26T07:15:14.716470+0000","last_clean":"2023-11-26T07:15:14.716470+0000","last_became_active":"2023-11-26T07:15:13.310654+0000","last_became_peered":"2023-11-26T07:15:13.310654+0000","last_unstale":"2023-11-26T07:15:14.716470+0000","last_undegraded":"2023-11-26T07:15:14.716470+0000","last_fullsized":"2023-11-26T07:15:14.716470+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:48:20.118670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"59'2","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.320380+0000","last_change":"2023-11-26T07:15:12.302483+0000","last_active":"2023-11-26T07:15:13.320380+0000","last_peered":"2023-11-26T07:15:13.320380+0000","last_clean":"2023-11-26T07:15:13.320380+0000","last_became_active":"2023-11-26T07:15:12.302095+0000","last_became_peered":"2023-11-26T07:15:12.302095+0000","last_unstale":"2023-11-26T07:15:13.320380+0000","last_undegraded":"2023-11-26T07:15:13.320380+0000","last_fullsized":"2023-11-26T07:15:13.320380+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:34:54.079903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.716503+0000","last_change":"2023-11-26T07:15:13.310225+0000","last_active":"2023-11-26T07:15:14.716503+0000","last_peered":"2023-11-26T07:15:14.716503+0000","last_clean":"2023-11-26T07:15:14.716503+0000","last_became_active":"2023-11-26T07:15:13.309592+0000","last_became_peered":"2023-11-26T07:15:13.309592+0000","last_unstale":"2023-11-26T07:15:14.716503+0000","last_undegraded":"2023-11-26T07:15:14.716503+0000","last_fullsized":"2023-11-26T07:15:14.716503+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:49:43.683710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"59'2","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.318366+0000","last_change":"2023-11-26T07:15:12.300835+0000","last_active":"2023-11-26T07:15:13.318366+0000","last_peered":"2023-11-26T07:15:13.318366+0000","last_clean":"2023-11-26T07:15:13.318366+0000","last_became_active":"2023-11-26T07:15:12.300536+0000","last_became_peered":"2023-11-26T07:15:12.300536+0000","last_unstale":"2023-11-26T07:15:13.318366+0000","last_undegraded":"2023-11-26T07:15:13.318366+0000","last_fullsized":"2023-11-26T07:15:13.318366+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:12:07.949999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.289030+0000","last_change":"2023-11-26T07:15:13.317611+0000","last_active":"2023-11-26T07:15:14.289030+0000","last_peered":"2023-11-26T07:15:14.289030+0000","last_clean":"2023-11-26T07:15:14.289030+0000","last_became_active":"2023-11-26T07:15:13.317271+0000","last_became_peered":"2023-11-26T07:15:13.317271+0000","last_unstale":"2023-11-26T07:15:14.289030+0000","last_undegraded":"2023-11-26T07:15:14.289030+0000","last_fullsized":"2023-11-26T07:15:14.289030+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:06:49.653826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"59'1","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.317299+0000","last_change":"2023-11-26T07:15:12.301249+0000","last_active":"2023-11-26T07:15:13.317299+0000","last_peered":"2023-11-26T07:15:13.317299+0000","last_clean":"2023-11-26T07:15:13.317299+0000","last_became_active":"2023-11-26T07:15:12.300848+0000","last_became_peered":"2023-11-26T07:15:12.300848+0000","last_unstale":"2023-11-26T07:15:13.317299+0000","last_undegraded":"2023-11-26T07:15:13.317299+0000","last_fullsized":"2023-11-26T07:15:13.317299+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:29:22.469437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.289245+0000","last_change":"2023-11-26T07:15:13.314640+0000","last_active":"2023-11-26T07:15:14.289245+0000","last_peered":"2023-11-26T07:15:14.289245+0000","last_clean":"2023-11-26T07:15:14.289245+0000","last_became_active":"2023-11-26T07:15:13.314376+0000","last_became_peered":"2023-11-26T07:15:13.314376+0000","last_unstale":"2023-11-26T07:15:14.289245+0000","last_undegraded":"2023-11-26T07:15:14.289245+0000","last_fullsized":"2023-11-26T07:15:14.289245+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:56:39.679237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"59'1","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.319533+0000","last_change":"2023-11-26T07:15:12.304914+0000","last_active":"2023-11-26T07:15:13.319533+0000","last_peered":"2023-11-26T07:15:13.319533+0000","last_clean":"2023-11-26T07:15:13.319533+0000","last_became_active":"2023-11-26T07:15:12.304622+0000","last_became_peered":"2023-11-26T07:15:12.304622+0000","last_unstale":"2023-11-26T07:15:13.319533+0000","last_undegraded":"2023-11-26T07:15:13.319533+0000","last_fullsized":"2023-11-26T07:15:13.319533+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:42:20.388503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:15.186532+0000","last_change":"2023-11-26T07:15:13.299138+0000","last_active":"2023-11-26T07:15:15.186532+0000","last_peered":"2023-11-26T07:15:15.186532+0000","last_clean":"2023-11-26T07:15:15.186532+0000","last_became_active":"2023-11-26T07:15:13.298666+0000","last_became_peered":"2023-11-26T07:15:13.298666+0000","last_unstale":"2023-11-26T07:15:15.186532+0000","last_undegraded":"2023-11-26T07:15:15.186532+0000","last_fullsized":"2023-11-26T07:15:15.186532+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:41:32.866173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.288643+0000","last_change":"2023-11-26T07:15:12.297245+0000","last_active":"2023-11-26T07:15:13.288643+0000","last_peered":"2023-11-26T07:15:13.288643+0000","last_clean":"2023-11-26T07:15:13.288643+0000","last_became_active":"2023-11-26T07:15:12.296904+0000","last_became_peered":"2023-11-26T07:15:12.296904+0000","last_unstale":"2023-11-26T07:15:13.288643+0000","last_undegraded":"2023-11-26T07:15:13.288643+0000","last_fullsized":"2023-11-26T07:15:13.288643+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:55:34.148677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.288834+0000","last_change":"2023-11-26T07:15:13.312997+0000","last_active":"2023-11-26T07:15:14.288834+0000","last_peered":"2023-11-26T07:15:14.288834+0000","last_clean":"2023-11-26T07:15:14.288834+0000","last_became_active":"2023-11-26T07:15:13.311781+0000","last_became_peered":"2023-11-26T07:15:13.311781+0000","last_unstale":"2023-11-26T07:15:14.288834+0000","last_undegraded":"2023-11-26T07:15:14.288834+0000","last_fullsized":"2023-11-26T07:15:14.288834+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:13:54.735452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.291691+0000","last_change":"2023-11-26T07:15:12.303096+0000","last_active":"2023-11-26T07:15:13.291691+0000","last_peered":"2023-11-26T07:15:13.291691+0000","last_clean":"2023-11-26T07:15:13.291691+0000","last_became_active":"2023-11-26T07:15:12.302747+0000","last_became_peered":"2023-11-26T07:15:12.302747+0000","last_unstale":"2023-11-26T07:15:13.291691+0000","last_undegraded":"2023-11-26T07:15:13.291691+0000","last_fullsized":"2023-11-26T07:15:13.291691+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:43:46.409969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.290030+0000","last_change":"2023-11-26T07:15:13.298953+0000","last_active":"2023-11-26T07:15:14.290030+0000","last_peered":"2023-11-26T07:15:14.290030+0000","last_clean":"2023-11-26T07:15:14.290030+0000","last_became_active":"2023-11-26T07:15:13.298685+0000","last_became_peered":"2023-11-26T07:15:13.298685+0000","last_unstale":"2023-11-26T07:15:14.290030+0000","last_undegraded":"2023-11-26T07:15:14.290030+0000","last_fullsized":"2023-11-26T07:15:14.290030+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:37:44.542461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.295003+0000","last_change":"2023-11-26T07:15:12.298615+0000","last_active":"2023-11-26T07:15:13.295003+0000","last_peered":"2023-11-26T07:15:13.295003+0000","last_clean":"2023-11-26T07:15:13.295003+0000","last_became_active":"2023-11-26T07:15:12.298325+0000","last_became_peered":"2023-11-26T07:15:12.298325+0000","last_unstale":"2023-11-26T07:15:13.295003+0000","last_undegraded":"2023-11-26T07:15:13.295003+0000","last_fullsized":"2023-11-26T07:15:13.295003+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:37:31.449723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.464903+0000","last_change":"2023-11-26T07:15:13.302881+0000","last_active":"2023-11-26T07:15:14.464903+0000","last_peered":"2023-11-26T07:15:14.464903+0000","last_clean":"2023-11-26T07:15:14.464903+0000","last_became_active":"2023-11-26T07:15:13.302613+0000","last_became_peered":"2023-11-26T07:15:13.302613+0000","last_unstale":"2023-11-26T07:15:14.464903+0000","last_undegraded":"2023-11-26T07:15:14.464903+0000","last_fullsized":"2023-11-26T07:15:14.464903+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:05:29.806891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.292754+0000","last_change":"2023-11-26T07:15:12.307002+0000","last_active":"2023-11-26T07:15:13.292754+0000","last_peered":"2023-11-26T07:15:13.292754+0000","last_clean":"2023-11-26T07:15:13.292754+0000","last_became_active":"2023-11-26T07:15:12.306612+0000","last_became_peered":"2023-11-26T07:15:12.306612+0000","last_unstale":"2023-11-26T07:15:13.292754+0000","last_undegraded":"2023-11-26T07:15:13.292754+0000","last_fullsized":"2023-11-26T07:15:13.292754+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:05:28.805318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:15.182426+0000","last_change":"2023-11-26T07:15:13.305034+0000","last_active":"2023-11-26T07:15:15.182426+0000","last_peered":"2023-11-26T07:15:15.182426+0000","last_clean":"2023-11-26T07:15:15.182426+0000","last_became_active":"2023-11-26T07:15:13.304552+0000","last_became_peered":"2023-11-26T07:15:13.304552+0000","last_unstale":"2023-11-26T07:15:15.182426+0000","last_undegraded":"2023-11-26T07:15:15.182426+0000","last_fullsized":"2023-11-26T07:15:15.182426+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:33:53.753478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"59'3","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.316562+0000","last_change":"2023-11-26T07:15:12.299169+0000","last_active":"2023-11-26T07:15:13.316562+0000","last_peered":"2023-11-26T07:15:13.316562+0000","last_clean":"2023-11-26T07:15:13.316562+0000","last_became_active":"2023-11-26T07:15:12.298742+0000","last_became_peered":"2023-11-26T07:15:12.298742+0000","last_unstale":"2023-11-26T07:15:13.316562+0000","last_undegraded":"2023-11-26T07:15:13.316562+0000","last_fullsized":"2023-11-26T07:15:13.316562+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:47:26.695306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.464749+0000","last_change":"2023-11-26T07:15:13.303083+0000","last_active":"2023-11-26T07:15:14.464749+0000","last_peered":"2023-11-26T07:15:14.464749+0000","last_clean":"2023-11-26T07:15:14.464749+0000","last_became_active":"2023-11-26T07:15:13.302828+0000","last_became_peered":"2023-11-26T07:15:13.302828+0000","last_unstale":"2023-11-26T07:15:14.464749+0000","last_undegraded":"2023-11-26T07:15:14.464749+0000","last_fullsized":"2023-11-26T07:15:14.464749+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:55:51.646081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"59'6","reported_seq":18,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.324593+0000","last_change":"2023-11-26T07:15:12.301922+0000","last_active":"2023-11-26T07:15:13.324593+0000","last_peered":"2023-11-26T07:15:13.324593+0000","last_clean":"2023-11-26T07:15:13.324593+0000","last_became_active":"2023-11-26T07:15:12.301636+0000","last_became_peered":"2023-11-26T07:15:12.301636+0000","last_unstale":"2023-11-26T07:15:13.324593+0000","last_undegraded":"2023-11-26T07:15:13.324593+0000","last_fullsized":"2023-11-26T07:15:13.324593+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:36:07.842675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:16.145469+0000","last_change":"2023-11-26T07:15:13.297153+0000","last_active":"2023-11-26T07:15:16.145469+0000","last_peered":"2023-11-26T07:15:16.145469+0000","last_clean":"2023-11-26T07:15:16.145469+0000","last_became_active":"2023-11-26T07:15:13.296658+0000","last_became_peered":"2023-11-26T07:15:13.296658+0000","last_unstale":"2023-11-26T07:15:16.145469+0000","last_undegraded":"2023-11-26T07:15:16.145469+0000","last_fullsized":"2023-11-26T07:15:16.145469+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:02:14.657926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"59'2","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.319606+0000","last_change":"2023-11-26T07:15:12.306177+0000","last_active":"2023-11-26T07:15:13.319606+0000","last_peered":"2023-11-26T07:15:13.319606+0000","last_clean":"2023-11-26T07:15:13.319606+0000","last_became_active":"2023-11-26T07:15:12.304698+0000","last_became_peered":"2023-11-26T07:15:12.304698+0000","last_unstale":"2023-11-26T07:15:13.319606+0000","last_undegraded":"2023-11-26T07:15:13.319606+0000","last_fullsized":"2023-11-26T07:15:13.319606+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:37:05.995766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.464589+0000","last_change":"2023-11-26T07:15:13.301706+0000","last_active":"2023-11-26T07:15:14.464589+0000","last_peered":"2023-11-26T07:15:14.464589+0000","last_clean":"2023-11-26T07:15:14.464589+0000","last_became_active":"2023-11-26T07:15:13.301439+0000","last_became_peered":"2023-11-26T07:15:13.301439+0000","last_unstale":"2023-11-26T07:15:14.464589+0000","last_undegraded":"2023-11-26T07:15:14.464589+0000","last_fullsized":"2023-11-26T07:15:14.464589+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:34:55.081476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.292700+0000","last_change":"2023-11-26T07:15:12.304899+0000","last_active":"2023-11-26T07:15:13.292700+0000","last_peered":"2023-11-26T07:15:13.292700+0000","last_clean":"2023-11-26T07:15:13.292700+0000","last_became_active":"2023-11-26T07:15:12.304628+0000","last_became_peered":"2023-11-26T07:15:12.304628+0000","last_unstale":"2023-11-26T07:15:13.292700+0000","last_undegraded":"2023-11-26T07:15:13.292700+0000","last_fullsized":"2023-11-26T07:15:13.292700+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:57:19.000626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.289589+0000","last_change":"2023-11-26T07:15:13.302613+0000","last_active":"2023-11-26T07:15:14.289589+0000","last_peered":"2023-11-26T07:15:14.289589+0000","last_clean":"2023-11-26T07:15:14.289589+0000","last_became_active":"2023-11-26T07:15:13.302388+0000","last_became_peered":"2023-11-26T07:15:13.302388+0000","last_unstale":"2023-11-26T07:15:14.289589+0000","last_undegraded":"2023-11-26T07:15:14.289589+0000","last_fullsized":"2023-11-26T07:15:14.289589+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:58:02.591422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.288482+0000","last_change":"2023-11-26T07:15:12.300289+0000","last_active":"2023-11-26T07:15:13.288482+0000","last_peered":"2023-11-26T07:15:13.288482+0000","last_clean":"2023-11-26T07:15:13.288482+0000","last_became_active":"2023-11-26T07:15:12.299999+0000","last_became_peered":"2023-11-26T07:15:12.299999+0000","last_unstale":"2023-11-26T07:15:13.288482+0000","last_undegraded":"2023-11-26T07:15:13.288482+0000","last_fullsized":"2023-11-26T07:15:13.288482+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:58:01.589849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.464559+0000","last_change":"2023-11-26T07:15:13.308709+0000","last_active":"2023-11-26T07:15:14.464559+0000","last_peered":"2023-11-26T07:15:14.464559+0000","last_clean":"2023-11-26T07:15:14.464559+0000","last_became_active":"2023-11-26T07:15:13.308241+0000","last_became_peered":"2023-11-26T07:15:13.308241+0000","last_unstale":"2023-11-26T07:15:14.464559+0000","last_undegraded":"2023-11-26T07:15:14.464559+0000","last_fullsized":"2023-11-26T07:15:14.464559+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:51:40.949108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"59'8","reported_seq":20,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.309018+0000","last_change":"2023-11-26T07:15:12.297008+0000","last_active":"2023-11-26T07:15:13.309018+0000","last_peered":"2023-11-26T07:15:13.309018+0000","last_clean":"2023-11-26T07:15:13.309018+0000","last_became_active":"2023-11-26T07:15:12.296711+0000","last_became_peered":"2023-11-26T07:15:12.296711+0000","last_unstale":"2023-11-26T07:15:13.309018+0000","last_undegraded":"2023-11-26T07:15:13.309018+0000","last_fullsized":"2023-11-26T07:15:13.309018+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:44:32.819060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.464970+0000","last_change":"2023-11-26T07:15:13.309049+0000","last_active":"2023-11-26T07:15:14.464970+0000","last_peered":"2023-11-26T07:15:14.464970+0000","last_clean":"2023-11-26T07:15:14.464970+0000","last_became_active":"2023-11-26T07:15:13.308790+0000","last_became_peered":"2023-11-26T07:15:13.308790+0000","last_unstale":"2023-11-26T07:15:14.464970+0000","last_undegraded":"2023-11-26T07:15:14.464970+0000","last_fullsized":"2023-11-26T07:15:14.464970+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:20:22.142720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"59'1","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.317211+0000","last_change":"2023-11-26T07:15:12.306635+0000","last_active":"2023-11-26T07:15:13.317211+0000","last_peered":"2023-11-26T07:15:13.317211+0000","last_clean":"2023-11-26T07:15:13.317211+0000","last_became_active":"2023-11-26T07:15:12.304730+0000","last_became_peered":"2023-11-26T07:15:12.304730+0000","last_unstale":"2023-11-26T07:15:13.317211+0000","last_undegraded":"2023-11-26T07:15:13.317211+0000","last_fullsized":"2023-11-26T07:15:13.317211+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:14:33.732928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:16.145847+0000","last_change":"2023-11-26T07:15:13.300658+0000","last_active":"2023-11-26T07:15:16.145847+0000","last_peered":"2023-11-26T07:15:16.145847+0000","last_clean":"2023-11-26T07:15:16.145847+0000","last_became_active":"2023-11-26T07:15:13.299648+0000","last_became_peered":"2023-11-26T07:15:13.299648+0000","last_unstale":"2023-11-26T07:15:16.145847+0000","last_undegraded":"2023-11-26T07:15:16.145847+0000","last_fullsized":"2023-11-26T07:15:16.145847+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:32:58.450755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"59'2","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.320053+0000","last_change":"2023-11-26T07:15:12.300625+0000","last_active":"2023-11-26T07:15:13.320053+0000","last_peered":"2023-11-26T07:15:13.320053+0000","last_clean":"2023-11-26T07:15:13.320053+0000","last_became_active":"2023-11-26T07:15:12.300272+0000","last_became_peered":"2023-11-26T07:15:12.300272+0000","last_unstale":"2023-11-26T07:15:13.320053+0000","last_undegraded":"2023-11-26T07:15:13.320053+0000","last_fullsized":"2023-11-26T07:15:13.320053+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:20:55.130187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.289039+0000","last_change":"2023-11-26T07:15:13.307083+0000","last_active":"2023-11-26T07:15:14.289039+0000","last_peered":"2023-11-26T07:15:14.289039+0000","last_clean":"2023-11-26T07:15:14.289039+0000","last_became_active":"2023-11-26T07:15:13.306892+0000","last_became_peered":"2023-11-26T07:15:13.306892+0000","last_unstale":"2023-11-26T07:15:14.289039+0000","last_undegraded":"2023-11-26T07:15:14.289039+0000","last_fullsized":"2023-11-26T07:15:14.289039+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:20:11.009773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"59'1","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.315568+0000","last_change":"2023-11-26T07:15:12.300331+0000","last_active":"2023-11-26T07:15:13.315568+0000","last_peered":"2023-11-26T07:15:13.315568+0000","last_clean":"2023-11-26T07:15:13.315568+0000","last_became_active":"2023-11-26T07:15:12.300143+0000","last_became_peered":"2023-11-26T07:15:12.300143+0000","last_unstale":"2023-11-26T07:15:13.315568+0000","last_undegraded":"2023-11-26T07:15:13.315568+0000","last_fullsized":"2023-11-26T07:15:13.315568+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:37:43.540888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.464868+0000","last_change":"2023-11-26T07:15:13.303403+0000","last_active":"2023-11-26T07:15:14.464868+0000","last_peered":"2023-11-26T07:15:14.464868+0000","last_clean":"2023-11-26T07:15:14.464868+0000","last_became_active":"2023-11-26T07:15:13.303147+0000","last_became_peered":"2023-11-26T07:15:13.303147+0000","last_unstale":"2023-11-26T07:15:14.464868+0000","last_undegraded":"2023-11-26T07:15:14.464868+0000","last_fullsized":"2023-11-26T07:15:14.464868+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:05:41.521323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.308325+0000","last_change":"2023-11-26T07:15:12.305011+0000","last_active":"2023-11-26T07:15:13.308325+0000","last_peered":"2023-11-26T07:15:13.308325+0000","last_clean":"2023-11-26T07:15:13.308325+0000","last_became_active":"2023-11-26T07:15:12.304401+0000","last_became_peered":"2023-11-26T07:15:12.304401+0000","last_unstale":"2023-11-26T07:15:13.308325+0000","last_undegraded":"2023-11-26T07:15:13.308325+0000","last_fullsized":"2023-11-26T07:15:13.308325+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:31:59.656191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:16.145469+0000","last_change":"2023-11-26T07:15:13.296963+0000","last_active":"2023-11-26T07:15:16.145469+0000","last_peered":"2023-11-26T07:15:16.145469+0000","last_clean":"2023-11-26T07:15:16.145469+0000","last_became_active":"2023-11-26T07:15:13.296302+0000","last_became_peered":"2023-11-26T07:15:13.296302+0000","last_unstale":"2023-11-26T07:15:16.145469+0000","last_undegraded":"2023-11-26T07:15:16.145469+0000","last_fullsized":"2023-11-26T07:15:16.145469+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:47:27.696879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"59'2","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.319494+0000","last_change":"2023-11-26T07:15:12.303649+0000","last_active":"2023-11-26T07:15:13.319494+0000","last_peered":"2023-11-26T07:15:13.319494+0000","last_clean":"2023-11-26T07:15:13.319494+0000","last_became_active":"2023-11-26T07:15:12.303351+0000","last_became_peered":"2023-11-26T07:15:12.303351+0000","last_unstale":"2023-11-26T07:15:13.319494+0000","last_undegraded":"2023-11-26T07:15:13.319494+0000","last_fullsized":"2023-11-26T07:15:13.319494+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:09:12.614053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.716441+0000","last_change":"2023-11-26T07:15:13.310492+0000","last_active":"2023-11-26T07:15:14.716441+0000","last_peered":"2023-11-26T07:15:14.716441+0000","last_clean":"2023-11-26T07:15:14.716441+0000","last_became_active":"2023-11-26T07:15:13.310204+0000","last_became_peered":"2023-11-26T07:15:13.310204+0000","last_unstale":"2023-11-26T07:15:14.716441+0000","last_undegraded":"2023-11-26T07:15:14.716441+0000","last_fullsized":"2023-11-26T07:15:14.716441+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:34:11.863914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.292902+0000","last_change":"2023-11-26T07:15:12.305367+0000","last_active":"2023-11-26T07:15:13.292902+0000","last_peered":"2023-11-26T07:15:13.292902+0000","last_clean":"2023-11-26T07:15:13.292902+0000","last_became_active":"2023-11-26T07:15:12.305106+0000","last_became_peered":"2023-11-26T07:15:12.305106+0000","last_unstale":"2023-11-26T07:15:13.292902+0000","last_undegraded":"2023-11-26T07:15:13.292902+0000","last_fullsized":"2023-11-26T07:15:13.292902+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:35:32.544576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.716139+0000","last_change":"2023-11-26T07:15:13.309012+0000","last_active":"2023-11-26T07:15:14.716139+0000","last_peered":"2023-11-26T07:15:14.716139+0000","last_clean":"2023-11-26T07:15:14.716139+0000","last_became_active":"2023-11-26T07:15:13.308718+0000","last_became_peered":"2023-11-26T07:15:13.308718+0000","last_unstale":"2023-11-26T07:15:14.716139+0000","last_undegraded":"2023-11-26T07:15:14.716139+0000","last_fullsized":"2023-11-26T07:15:14.716139+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:36:54.675012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.288447+0000","last_change":"2023-11-26T07:15:12.302509+0000","last_active":"2023-11-26T07:15:13.288447+0000","last_peered":"2023-11-26T07:15:13.288447+0000","last_clean":"2023-11-26T07:15:13.288447+0000","last_became_active":"2023-11-26T07:15:12.302212+0000","last_became_peered":"2023-11-26T07:15:12.302212+0000","last_unstale":"2023-11-26T07:15:13.288447+0000","last_undegraded":"2023-11-26T07:15:13.288447+0000","last_fullsized":"2023-11-26T07:15:13.288447+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:19:24.338719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:16.145828+0000","last_change":"2023-11-26T07:15:13.297274+0000","last_active":"2023-11-26T07:15:16.145828+0000","last_peered":"2023-11-26T07:15:16.145828+0000","last_clean":"2023-11-26T07:15:16.145828+0000","last_became_active":"2023-11-26T07:15:13.296997+0000","last_became_peered":"2023-11-26T07:15:13.296997+0000","last_unstale":"2023-11-26T07:15:16.145828+0000","last_undegraded":"2023-11-26T07:15:16.145828+0000","last_fullsized":"2023-11-26T07:15:16.145828+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:51:40.949108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"59'2","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.319838+0000","last_change":"2023-11-26T07:15:12.303860+0000","last_active":"2023-11-26T07:15:13.319838+0000","last_peered":"2023-11-26T07:15:13.319838+0000","last_clean":"2023-11-26T07:15:13.319838+0000","last_became_active":"2023-11-26T07:15:12.303589+0000","last_became_peered":"2023-11-26T07:15:12.303589+0000","last_unstale":"2023-11-26T07:15:13.319838+0000","last_undegraded":"2023-11-26T07:15:13.319838+0000","last_fullsized":"2023-11-26T07:15:13.319838+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:59:59.911203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:16.145943+0000","last_change":"2023-11-26T07:15:13.298956+0000","last_active":"2023-11-26T07:15:16.145943+0000","last_peered":"2023-11-26T07:15:16.145943+0000","last_clean":"2023-11-26T07:15:16.145943+0000","last_became_active":"2023-11-26T07:15:13.298625+0000","last_became_peered":"2023-11-26T07:15:13.298625+0000","last_unstale":"2023-11-26T07:15:16.145943+0000","last_undegraded":"2023-11-26T07:15:16.145943+0000","last_fullsized":"2023-11-26T07:15:16.145943+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:32:00.657764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.301431+0000","last_change":"2023-11-26T07:15:12.304842+0000","last_active":"2023-11-26T07:15:13.301431+0000","last_peered":"2023-11-26T07:15:13.301431+0000","last_clean":"2023-11-26T07:15:13.301431+0000","last_became_active":"2023-11-26T07:15:12.304528+0000","last_became_peered":"2023-11-26T07:15:12.304528+0000","last_unstale":"2023-11-26T07:15:13.301431+0000","last_undegraded":"2023-11-26T07:15:13.301431+0000","last_fullsized":"2023-11-26T07:15:13.301431+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:32:57.449182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:15.182389+0000","last_change":"2023-11-26T07:15:13.304849+0000","last_active":"2023-11-26T07:15:15.182389+0000","last_peered":"2023-11-26T07:15:15.182389+0000","last_clean":"2023-11-26T07:15:15.182389+0000","last_became_active":"2023-11-26T07:15:13.304198+0000","last_became_peered":"2023-11-26T07:15:13.304198+0000","last_unstale":"2023-11-26T07:15:15.182389+0000","last_undegraded":"2023-11-26T07:15:15.182389+0000","last_fullsized":"2023-11-26T07:15:15.182389+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:57:20.002200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.292659+0000","last_change":"2023-11-26T07:15:12.305532+0000","last_active":"2023-11-26T07:15:13.292659+0000","last_peered":"2023-11-26T07:15:13.292659+0000","last_clean":"2023-11-26T07:15:13.292659+0000","last_became_active":"2023-11-26T07:15:12.305279+0000","last_became_peered":"2023-11-26T07:15:12.305279+0000","last_unstale":"2023-11-26T07:15:13.292659+0000","last_undegraded":"2023-11-26T07:15:13.292659+0000","last_fullsized":"2023-11-26T07:15:13.292659+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:40:48.323276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.716583+0000","last_change":"2023-11-26T07:15:13.310815+0000","last_active":"2023-11-26T07:15:14.716583+0000","last_peered":"2023-11-26T07:15:14.716583+0000","last_clean":"2023-11-26T07:15:14.716583+0000","last_became_active":"2023-11-26T07:15:13.309943+0000","last_became_peered":"2023-11-26T07:15:13.309943+0000","last_unstale":"2023-11-26T07:15:14.716583+0000","last_undegraded":"2023-11-26T07:15:14.716583+0000","last_fullsized":"2023-11-26T07:15:14.716583+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:14:34.734501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.289823+0000","last_change":"2023-11-26T07:15:12.297147+0000","last_active":"2023-11-26T07:15:13.289823+0000","last_peered":"2023-11-26T07:15:13.289823+0000","last_clean":"2023-11-26T07:15:13.289823+0000","last_became_active":"2023-11-26T07:15:12.296860+0000","last_became_peered":"2023-11-26T07:15:12.296860+0000","last_unstale":"2023-11-26T07:15:13.289823+0000","last_undegraded":"2023-11-26T07:15:13.289823+0000","last_fullsized":"2023-11-26T07:15:13.289823+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:56:56.583112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.289107+0000","last_change":"2023-11-26T07:15:13.308321+0000","last_active":"2023-11-26T07:15:14.289107+0000","last_peered":"2023-11-26T07:15:14.289107+0000","last_clean":"2023-11-26T07:15:14.289107+0000","last_became_active":"2023-11-26T07:15:13.308047+0000","last_became_peered":"2023-11-26T07:15:13.308047+0000","last_unstale":"2023-11-26T07:15:14.289107+0000","last_undegraded":"2023-11-26T07:15:14.289107+0000","last_fullsized":"2023-11-26T07:15:14.289107+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:26:05.233782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.291276+0000","last_change":"2023-11-26T07:15:12.303276+0000","last_active":"2023-11-26T07:15:13.291276+0000","last_peered":"2023-11-26T07:15:13.291276+0000","last_clean":"2023-11-26T07:15:13.291276+0000","last_became_active":"2023-11-26T07:15:12.302970+0000","last_became_peered":"2023-11-26T07:15:12.302970+0000","last_unstale":"2023-11-26T07:15:13.291276+0000","last_undegraded":"2023-11-26T07:15:13.291276+0000","last_fullsized":"2023-11-26T07:15:13.291276+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:45:41.712084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.464768+0000","last_change":"2023-11-26T07:15:13.316490+0000","last_active":"2023-11-26T07:15:14.464768+0000","last_peered":"2023-11-26T07:15:14.464768+0000","last_clean":"2023-11-26T07:15:14.464768+0000","last_became_active":"2023-11-26T07:15:13.316274+0000","last_became_peered":"2023-11-26T07:15:13.316274+0000","last_unstale":"2023-11-26T07:15:14.464768+0000","last_undegraded":"2023-11-26T07:15:14.464768+0000","last_fullsized":"2023-11-26T07:15:14.464768+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:36:54.675012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.291809+0000","last_change":"2023-11-26T07:15:12.301634+0000","last_active":"2023-11-26T07:15:13.291809+0000","last_peered":"2023-11-26T07:15:13.291809+0000","last_clean":"2023-11-26T07:15:13.291809+0000","last_became_active":"2023-11-26T07:15:12.301275+0000","last_became_peered":"2023-11-26T07:15:12.301275+0000","last_unstale":"2023-11-26T07:15:13.291809+0000","last_undegraded":"2023-11-26T07:15:13.291809+0000","last_fullsized":"2023-11-26T07:15:13.291809+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:29:51.899488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:15.182121+0000","last_change":"2023-11-26T07:15:13.298793+0000","last_active":"2023-11-26T07:15:15.182121+0000","last_peered":"2023-11-26T07:15:15.182121+0000","last_clean":"2023-11-26T07:15:15.182121+0000","last_became_active":"2023-11-26T07:15:13.298514+0000","last_became_peered":"2023-11-26T07:15:13.298514+0000","last_unstale":"2023-11-26T07:15:15.182121+0000","last_undegraded":"2023-11-26T07:15:15.182121+0000","last_fullsized":"2023-11-26T07:15:15.182121+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:05:42.391837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.292412+0000","last_change":"2023-11-26T07:15:12.299479+0000","last_active":"2023-11-26T07:15:13.292412+0000","last_peered":"2023-11-26T07:15:13.292412+0000","last_clean":"2023-11-26T07:15:13.292412+0000","last_became_active":"2023-11-26T07:15:12.299200+0000","last_became_peered":"2023-11-26T07:15:12.299200+0000","last_unstale":"2023-11-26T07:15:13.292412+0000","last_undegraded":"2023-11-26T07:15:13.292412+0000","last_fullsized":"2023-11-26T07:15:13.292412+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:13:53.960381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.288981+0000","last_change":"2023-11-26T07:15:13.313200+0000","last_active":"2023-11-26T07:15:14.288981+0000","last_peered":"2023-11-26T07:15:14.288981+0000","last_clean":"2023-11-26T07:15:14.288981+0000","last_became_active":"2023-11-26T07:15:13.312135+0000","last_became_peered":"2023-11-26T07:15:13.312135+0000","last_unstale":"2023-11-26T07:15:14.288981+0000","last_undegraded":"2023-11-26T07:15:14.288981+0000","last_fullsized":"2023-11-26T07:15:14.288981+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:58:56.123349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.292376+0000","last_change":"2023-11-26T07:15:12.303516+0000","last_active":"2023-11-26T07:15:13.292376+0000","last_peered":"2023-11-26T07:15:13.292376+0000","last_clean":"2023-11-26T07:15:13.292376+0000","last_became_active":"2023-11-26T07:15:12.302063+0000","last_became_peered":"2023-11-26T07:15:12.302063+0000","last_unstale":"2023-11-26T07:15:13.292376+0000","last_undegraded":"2023-11-26T07:15:13.292376+0000","last_fullsized":"2023-11-26T07:15:13.292376+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:46:10.847558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-26T07:15:14.288816+0000","last_change":"2023-11-26T07:15:13.312690+0000","last_active":"2023-11-26T07:15:14.288816+0000","last_peered":"2023-11-26T07:15:14.288816+0000","last_clean":"2023-11-26T07:15:14.288816+0000","last_became_active":"2023-11-26T07:15:13.312231+0000","last_became_peered":"2023-11-26T07:15:13.312231+0000","last_unstale":"2023-11-26T07:15:14.288816+0000","last_undegraded":"2023-11-26T07:15:14.288816+0000","last_fullsized":"2023-11-26T07:15:14.288816+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:12.279644+0000","last_clean_scrub_stamp":"2023-11-26T07:15:12.279644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:06:10.287535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.292682+0000","last_change":"2023-11-26T07:15:12.300358+0000","last_active":"2023-11-26T07:15:13.292682+0000","last_peered":"2023-11-26T07:15:13.292682+0000","last_clean":"2023-11-26T07:15:13.292682+0000","last_became_active":"2023-11-26T07:15:12.300179+0000","last_became_peered":"2023-11-26T07:15:12.300179+0000","last_unstale":"2023-11-26T07:15:13.292682+0000","last_undegraded":"2023-11-26T07:15:13.292682+0000","last_fullsized":"2023-11-26T07:15:13.292682+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:15:11.278070+0000","last_clean_scrub_stamp":"2023-11-26T07:15:11.278070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:05:41.390264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":199,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-26T07:15:13.293338+0000","last_change":"2023-11-26T07:11:29.855919+0000","last_active":"2023-11-26T07:15:13.293338+0000","last_peered":"2023-11-26T07:15:13.293338+0000","last_clean":"2023-11-26T07:15:13.293338+0000","last_became_active":"2023-11-26T07:11:29.854903+0000","last_became_peered":"2023-11-26T07:11:29.854903+0000","last_unstale":"2023-11-26T07:15:13.293338+0000","last_undegraded":"2023-11-26T07:15:13.293338+0000","last_fullsized":"2023-11-26T07:15:13.293338+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:28.594252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:28.594252+0000","last_clean_scrub_stamp":"2023-11-26T07:11:28.594252+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:33:34.642696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28312,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343528,"statfs":{"total":96636764160,"available":96607772672,"internally_reserved":0,"allocated":1323008,"data_stored":892657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:14:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.35899999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.73699999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51300000000000001,"15min":0.505},"min":{"1min":0.38700000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.65600000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.48799999999999999}]},{"osd":1,"last update":"Sun Nov 26 07:14:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.84799999999999998,"15min":0.97999999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.71499999999999997,"5min":9.5600000000000005,"15min":9.5600000000000005},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.56899999999999995,"15min":0.57999999999999996},"min":{"1min":0.41599999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.70199999999999996,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.64700000000000002}]},{"osd":2,"last update":"Sun Nov 26 07:14:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59599999999999997,"15min":0.60199999999999998},"min":{"1min":0.36799999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73299999999999998,"5min":1.569,"15min":1.569},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.63900000000000001,"15min":0.64900000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.85699999999999998,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.50900000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:14:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.59599999999999997,"15min":0.60399999999999998},"min":{"1min":0.42899999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68200000000000005,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57899999999999996,"15min":0.56699999999999995},"min":{"1min":0.44700000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78500000000000003,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.59599999999999997}]},{"osd":4,"last update":"Sun Nov 26 07:14:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.372,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70399999999999996,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53500000000000003,"15min":0.51500000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.82999999999999996,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.46800000000000003}]},{"osd":5,"last update":"Sun Nov 26 07:14:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.37,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63,"15min":0.63300000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80900000000000005,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.58299999999999996}]},{"osd":6,"last update":"Sun Nov 26 07:14:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59499999999999997,"15min":0.59099999999999997},"min":{"1min":0.437,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60299999999999998,"15min":0.59299999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89100000000000001,"5min":1.552,"15min":1.552},"last":0.56899999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":720896,"data_stored":302129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.503,"15min":0.48399999999999999},"min":{"1min":0.311,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.76700000000000002,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.504,"15min":0.47599999999999998},"min":{"1min":0.38200000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.69899999999999995,"5min":0.871,"15min":0.871},"last":0.56100000000000005}]},{"osd":1,"last update":"Sun Nov 26 07:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52300000000000002,"15min":0.51100000000000001},"min":{"1min":0.35199999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.73599999999999999,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.442},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55000000000000004,"15min":0.54400000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.83599999999999997,"5min":1.198,"15min":1.198},"last":0.54000000000000004}]},{"osd":2,"last update":"Sun Nov 26 07:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51600000000000001,"15min":0.495},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.71899999999999997,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.54800000000000004,"15min":0.52300000000000002},"min":{"1min":0.437,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.495}]},{"osd":3,"last update":"Sun Nov 26 07:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.57499999999999996,"15min":0.55100000000000005},"min":{"1min":0.435,"5min":0.373,"15min":0.373},"max":{"1min":0.81999999999999995,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.629},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.60099999999999998,"15min":0.58299999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79100000000000004,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.59499999999999997}]},{"osd":4,"last update":"Sun Nov 26 07:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.52800000000000002,"15min":0.53200000000000003},"min":{"1min":0.33600000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70599999999999996,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.34100000000000003,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.78900000000000003,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.52200000000000002}]},{"osd":5,"last update":"Sun Nov 26 07:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56399999999999995,"15min":0.56000000000000005},"min":{"1min":0.40200000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.71599999999999997,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58399999999999996,"15min":0.58799999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77300000000000002,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.61099999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59299999999999997,"15min":0.59099999999999997},"min":{"1min":0.42799999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73899999999999999,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.628,"15min":0.626},"min":{"1min":0.45800000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.75700000000000001,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.68999999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31888,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339952,"statfs":{"total":96636764160,"available":96604110848,"internally_reserved":0,"allocated":724992,"data_stored":302219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.35499999999999998,"15min":0.36399999999999999},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.68400000000000005,"15min":0.83399999999999996},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.496,"5min":11.922000000000001,"15min":11.922000000000001},"last":0.45300000000000001}]},{"osd":2,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.36199999999999999,"15min":0.373},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.52600000000000002,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.318},{"interface":"front","average":{"1min":0.379,"5min":0.40200000000000002,"15min":0.40799999999999997},"min":{"1min":0.27400000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.59099999999999997,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.435}]},{"osd":3,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.45000000000000001,"15min":0.45800000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.61799999999999999,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.435,"15min":0.441},"min":{"1min":0.313,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.59899999999999998,"5min":1.101,"15min":1.101},"last":0.41599999999999998}]},{"osd":4,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.80100000000000005,"15min":0.88500000000000001},"min":{"1min":0.44700000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.97299999999999998,"5min":6.8979999999999997,"15min":6.8979999999999997},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.65700000000000003,"15min":0.66500000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.66300000000000003}]},{"osd":5,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.622,"15min":0.628},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.05,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.497},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.80800000000000005,"15min":0.89200000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.087,"5min":6.9480000000000004,"15min":6.9480000000000004},"last":0.55200000000000005}]},{"osd":6,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.65200000000000002,"15min":0.66200000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.80600000000000005,"5min":1.194,"15min":1.194},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.82299999999999995,"15min":0.91700000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.89300000000000002,"5min":6.9800000000000004,"15min":6.9800000000000004},"last":0.63300000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65700000000000003,"15min":0.66000000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67200000000000004,"15min":0.68500000000000005},"min":{"1min":0.48699999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.91200000000000003,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.57899999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32480,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339360,"statfs":{"total":96636764160,"available":96603504640,"internally_reserved":0,"allocated":1331200,"data_stored":894691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.35399999999999998,"15min":0.372},"min":{"1min":0.23400000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.42399999999999999,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.70499999999999996,"15min":0.86099999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.42099999999999999,"5min":11.987,"15min":11.987},"last":0.33400000000000002}]},{"osd":2,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.41099999999999998,"15min":0.437},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.432,"5min":1.607,"15min":1.607},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.375,"5min":0.40200000000000002,"15min":0.41399999999999998},"min":{"1min":0.27700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.54300000000000004,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.29099999999999998}]},{"osd":3,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.38100000000000001,"15min":0.38900000000000001},"min":{"1min":0.27800000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.497,"5min":0.752,"15min":0.752},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.45400000000000001,"15min":0.47399999999999998},"min":{"1min":0.32500000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.51500000000000001,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.38700000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.64100000000000001,"15min":0.65800000000000003},"min":{"1min":0.432,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.753,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.81599999999999995,"15min":0.90600000000000003},"min":{"1min":0.42999999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.75700000000000001,"5min":6.5279999999999996,"15min":6.5279999999999996},"last":0.55100000000000005}]},{"osd":5,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.64200000000000002,"15min":0.65400000000000003},"min":{"1min":0.46400000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.77100000000000002,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.68000000000000005,"15min":0.69899999999999995},"min":{"1min":0.51700000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.81799999999999995,"5min":1.508,"15min":1.508},"last":0.59199999999999997}]},{"osd":6,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.84999999999999998,"15min":0.94299999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.79400000000000004,"5min":6.5419999999999998,"15min":6.5419999999999998},"last":0.505},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.66000000000000003,"15min":0.68000000000000005},"min":{"1min":0.48299999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.755,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.626}]},{"osd":7,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.68400000000000005,"15min":0.70399999999999996},"min":{"1min":0.48399999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.74299999999999999,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.65500000000000003,"15min":0.66700000000000004},"min":{"1min":0.44800000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.82299999999999995,"5min":1.155,"15min":1.155},"last":0.60999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31892,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339948,"statfs":{"total":96636764160,"available":96604106752,"internally_reserved":0,"allocated":729088,"data_stored":302185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:14:36 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.34000000000000002,"15min":0.34599999999999997},"min":{"1min":0.24199999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.25},{"interface":"front","average":{"1min":0.375,"5min":0.39500000000000002,"15min":0.39900000000000002},"min":{"1min":0.32100000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.49099999999999999,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.36399999999999999}]},{"osd":1,"last update":"Sun Nov 26 07:14:36 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34399999999999997,"15min":0.34799999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.373,"15min":0.376},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.57199999999999995,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.32700000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:14:36 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.40200000000000002,"15min":0.41299999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.51000000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.377,"15min":0.38300000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.52500000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.29699999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:14:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.73999999999999999,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.57599999999999996,"15min":0.57799999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.91500000000000004}]},{"osd":5,"last update":"Sun Nov 26 07:14:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57299999999999995,"15min":0.57399999999999995},"min":{"1min":0.39500000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.621,"15min":0.63300000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.86299999999999999,"5min":1.002,"15min":1.002},"last":0.63500000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:14:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.60699999999999998,"15min":0.61099999999999999},"min":{"1min":0.42199999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77500000000000002,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.628,"15min":0.63400000000000001},"min":{"1min":0.45600000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.83099999999999996,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.74399999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:14:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.62,"15min":0.629},"min":{"1min":0.41999999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.76700000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.621,"15min":0.623},"min":{"1min":0.47399999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.85199999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.97699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574898,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31892,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339948,"statfs":{"total":96636764160,"available":96604106752,"internally_reserved":0,"allocated":729088,"data_stored":302185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:14:33 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.35199999999999998,"15min":0.36899999999999999},"min":{"1min":0.23400000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.48499999999999999,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.313},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.40200000000000002,"15min":0.42199999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.52900000000000003,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.443}]},{"osd":1,"last update":"Sun Nov 26 07:14:33 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.38600000000000001,"15min":0.40699999999999997},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.47799999999999998,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.46600000000000003,"15min":0.50900000000000001},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.55100000000000005,"5min":2.903,"15min":2.903},"last":0.39500000000000002}]},{"osd":2,"last update":"Sun Nov 26 07:14:33 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.39600000000000002,"15min":0.40500000000000003},"min":{"1min":0.28100000000000003,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.503,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.40600000000000003,"15min":0.41799999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.53900000000000003,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.41599999999999998}]},{"osd":4,"last update":"Sun Nov 26 07:14:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.67300000000000004,"15min":0.71299999999999997},"min":{"1min":0.41399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80900000000000005,"5min":2.9609999999999999,"15min":2.9609999999999999},"last":0.502},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.629,"15min":0.64300000000000002},"min":{"1min":0.40600000000000003,"5min":0.373,"15min":0.373},"max":{"1min":0.79400000000000004,"5min":1.163,"15min":1.163},"last":0.57099999999999995}]},{"osd":5,"last update":"Sun Nov 26 07:14:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66200000000000003,"15min":0.67600000000000005},"min":{"1min":0.42599999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.64900000000000002,"15min":0.66700000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.871,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.46400000000000002}]},{"osd":6,"last update":"Sun Nov 26 07:14:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.65000000000000002,"15min":0.67300000000000004},"min":{"1min":0.45500000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.83499999999999996,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.66000000000000003,"15min":0.68200000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.76400000000000001,"5min":1.258,"15min":1.258},"last":0.55600000000000005}]},{"osd":7,"last update":"Sun Nov 26 07:14:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.66000000000000003,"15min":0.68500000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.82199999999999995,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.624},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.72399999999999998,"15min":0.76100000000000001},"min":{"1min":0.48599999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0780000000000001,"5min":2.9969999999999999,"15min":2.9969999999999999},"last":0.54400000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31904,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339936,"statfs":{"total":96636764160,"available":96604094464,"internally_reserved":0,"allocated":733184,"data_stored":303741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.82299999999999995,"15min":0.94099999999999995},"min":{"1min":0.39700000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.70199999999999996,"5min":8.7539999999999996,"15min":8.7539999999999996},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.84599999999999997,"15min":0.95999999999999996},"min":{"1min":0.40500000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.88200000000000001,"5min":8.7390000000000008,"15min":8.7390000000000008},"last":0.625}]},{"osd":1,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.86299999999999999,"15min":0.99399999999999999},"min":{"1min":0.40999999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.77400000000000002,"5min":9.7720000000000002,"15min":9.7720000000000002},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.34699999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.80000000000000004,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.53600000000000003}]},{"osd":2,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.83199999999999996,"15min":0.94799999999999995},"min":{"1min":0.42999999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.73199999999999998,"5min":9.8119999999999994,"15min":9.8119999999999994},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.76800000000000002,"15min":0.84399999999999997},"min":{"1min":0.38800000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78700000000000003,"5min":3.645,"15min":3.645},"last":0.51300000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.874,"15min":0.98999999999999999},"min":{"1min":0.436,"5min":0.434,"15min":0.434},"max":{"1min":0.76500000000000001,"5min":8.8089999999999993,"15min":8.8089999999999993},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.77400000000000002,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.60499999999999998}]},{"osd":5,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.51400000000000001,"15min":0.502},"min":{"1min":0.32700000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.55800000000000005,"15min":0.55300000000000005},"min":{"1min":0.39800000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.65800000000000003}]},{"osd":6,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58799999999999997,"15min":0.58099999999999996},"min":{"1min":0.48099999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56799999999999995,"15min":0.57399999999999995},"min":{"1min":0.34899999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.74399999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.79600000000000004}]},{"osd":7,"last update":"Sun Nov 26 07:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59499999999999997,"15min":0.59399999999999997},"min":{"1min":0.41899999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.81100000000000005,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.60499999999999998,"15min":0.60399999999999998},"min":{"1min":0.40200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.82899999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":729088,"data_stored":302781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.56399999999999995,"15min":0.53200000000000003},"min":{"1min":0.36099999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":7.1500000000000004,"5min":7.1500000000000004,"15min":7.1500000000000004},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.59899999999999998,"15min":0.57299999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":6.8470000000000004,"5min":6.8470000000000004,"15min":6.8470000000000004},"last":0.58399999999999996}]},{"osd":1,"last update":"Sun Nov 26 07:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.58799999999999997,"15min":0.55600000000000005},"min":{"1min":0.372,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":7.1269999999999998,"5min":7.1269999999999998,"15min":7.1269999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.34499999999999997,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.47699999999999998}]},{"osd":2,"last update":"Sun Nov 26 07:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.629,"15min":0.59299999999999997},"min":{"1min":0.40100000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":7.2000000000000002,"5min":7.2000000000000002,"15min":7.2000000000000002},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.65400000000000003,"15min":0.61799999999999999},"min":{"1min":0.46100000000000002,"5min":0.379,"15min":0.379},"max":{"1min":7.8259999999999996,"5min":7.8259999999999996,"15min":7.8259999999999996},"last":0.67900000000000005}]},{"osd":3,"last update":"Sun Nov 26 07:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.57399999999999995,"15min":0.56299999999999994},"min":{"1min":0.39000000000000001,"5min":0.372,"15min":0.372},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.879,"5min":0.64200000000000002,"15min":0.60499999999999998},"min":{"1min":0.40200000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":6.9240000000000004,"5min":6.9240000000000004,"15min":6.9240000000000004},"last":0.502}]},{"osd":4,"last update":"Sun Nov 26 07:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.55400000000000005,"15min":0.51000000000000001},"min":{"1min":0.36399999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":7.2830000000000004,"5min":7.2830000000000004,"15min":7.2830000000000004},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.57999999999999996,"15min":0.57499999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.66500000000000004}]},{"osd":6,"last update":"Sun Nov 26 07:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.61799999999999999,"15min":0.57099999999999995},"min":{"1min":0.35599999999999998,"5min":0.308,"15min":0.308},"max":{"1min":6.8890000000000002,"5min":6.8890000000000002,"15min":6.8890000000000002},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.63,"15min":0.58899999999999997},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":7.2430000000000003,"5min":7.2430000000000003,"15min":7.2430000000000003},"last":0.72399999999999998}]},{"osd":7,"last update":"Sun Nov 26 07:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.64900000000000002,"15min":0.60599999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":6.9880000000000004,"5min":6.9880000000000004,"15min":6.9880000000000004},"last":0.69199999999999995},{"interface":"front","average":{"1min":1.1519999999999999,"5min":0.72799999999999998,"15min":0.65700000000000003},"min":{"1min":0.44800000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":11.874000000000001,"5min":11.874000000000001,"15min":11.874000000000001},"last":0.754}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:15:22.465 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-26T07:15:22.465 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-26T07:15:22.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.630+0000 7f101a09f700 1 Processor -- start 2023-11-26T07:15:22.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.630+0000 7f101a09f700 1 -- start start 2023-11-26T07:15:22.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.631+0000 7f101a09f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f10141564e0 0x7f101406e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:22.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.631+0000 7f101a09f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f101415cca0 0x7f10140cf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:22.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.631+0000 7f101a09f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f101406e770 con 0x7f101406afd0 2023-11-26T07:15:22.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.631+0000 7f101a09f700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f101406ea50 con 0x7f10141564e0 2023-11-26T07:15:22.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.631+0000 7f101a09f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f101406ed30 con 0x7f101415cca0 2023-11-26T07:15:22.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.631+0000 7f1012ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f10141564e0 0x7f101406e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:22.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.631+0000 7f1012ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f10141564e0 0x7f101406e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43204/0 (socket says 172.21.15.2:43204) 2023-11-26T07:15:22.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.631+0000 7f1012ffd700 1 -- 172.21.15.2:0/548553249 learned_addr learned my addr 172.21.15.2:0/548553249 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:22.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.632+0000 7f1012ffd700 1 -- 172.21.15.2:0/548553249 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f101415cca0 msgr2=0x7f10140cf2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:22.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.632+0000 7f1013fff700 1 --2- 172.21.15.2:0/548553249 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f101415cca0 0x7f10140cf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:22.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.632+0000 7f1012ffd700 1 --2- 172.21.15.2:0/548553249 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f101415cca0 0x7f10140cf2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:22.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.632+0000 7f1012ffd700 1 -- 172.21.15.2:0/548553249 >> v1:172.21.15.192:6789/0 conn(0x7f101406afd0 legacy=0x7f101406b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:22.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.632+0000 7f1012ffd700 1 -- 172.21.15.2:0/548553249 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f101406f010 con 0x7f10141564e0 2023-11-26T07:15:22.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.632+0000 7f1012ffd700 1 --2- 172.21.15.2:0/548553249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10141564e0 0x7f101406e0e0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc0098f0 tx=0x7f0ffc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d23bcb50de56a08d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:22.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.632+0000 7f10127fc700 1 -- 172.21.15.2:0/548553249 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc004230 con 0x7f10141564e0 2023-11-26T07:15:22.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.632+0000 7f10127fc700 1 -- 172.21.15.2:0/548553249 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ffc004390 con 0x7f10141564e0 2023-11-26T07:15:22.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.632+0000 7f10127fc700 1 -- 172.21.15.2:0/548553249 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc0036a0 con 0x7f10141564e0 2023-11-26T07:15:22.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.633+0000 7f101a09f700 1 -- 172.21.15.2:0/548553249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10141564e0 msgr2=0x7f101406e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:22.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.633+0000 7f101a09f700 1 --2- 172.21.15.2:0/548553249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10141564e0 0x7f101406e0e0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc0098f0 tx=0x7f0ffc009c00 comp rx=0 tx=0).stop 2023-11-26T07:15:22.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.633+0000 7f101a09f700 1 -- 172.21.15.2:0/548553249 shutdown_connections 2023-11-26T07:15:22.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.633+0000 7f101a09f700 1 --2- 172.21.15.2:0/548553249 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f101415cca0 0x7f10140cf2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:22.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.633+0000 7f101a09f700 1 --2- 172.21.15.2:0/548553249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10141564e0 0x7f101406e0e0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:22.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.633+0000 7f101a09f700 1 -- 172.21.15.2:0/548553249 >> 172.21.15.2:0/548553249 conn(0x7f10140b27b0 msgr2=0x7f10140b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:22.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.633+0000 7f101a09f700 1 -- 172.21.15.2:0/548553249 shutdown_connections 2023-11-26T07:15:22.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.633+0000 7f101a09f700 1 -- 172.21.15.2:0/548553249 wait complete. 2023-11-26T07:15:22.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.634+0000 7f101a09f700 1 Processor -- start 2023-11-26T07:15:22.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.634+0000 7f101a09f700 1 -- start start 2023-11-26T07:15:22.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.635+0000 7f101a09f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f101406afd0 0x7f101414ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:22.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.635+0000 7f101a09f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10141564e0 0x7f101413f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:22.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.635+0000 7f101a09f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f101415cca0 0x7f10141f56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:22.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.635+0000 7f101a09f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10141f5280 con 0x7f10141564e0 2023-11-26T07:15:22.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.635+0000 7f101a09f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101415ea80 con 0x7f101415cca0 2023-11-26T07:15:22.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.635+0000 7f101a09f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f101414cf30 con 0x7f101406afd0 2023-11-26T07:15:22.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.635+0000 7f1012ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10141564e0 0x7f101413f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:22.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.635+0000 7f1012ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10141564e0 0x7f101413f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43212/0 (socket says 172.21.15.2:43212) 2023-11-26T07:15:22.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.635+0000 7f1012ffd700 1 -- 172.21.15.2:0/300902722 learned_addr learned my addr 172.21.15.2:0/300902722 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:22.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.635+0000 7f1013fff700 1 --2- 172.21.15.2:0/300902722 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f101415cca0 0x7f10141f56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:22.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.635+0000 7f10137fe700 1 --2- 172.21.15.2:0/300902722 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f101406afd0 0x7f101414ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:22.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.635+0000 7f1012ffd700 1 -- 172.21.15.2:0/300902722 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f101406afd0 msgr2=0x7f101414ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:22.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.635+0000 7f1012ffd700 1 --2- 172.21.15.2:0/300902722 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f101406afd0 0x7f101414ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:22.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.635+0000 7f1012ffd700 1 -- 172.21.15.2:0/300902722 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f101415cca0 msgr2=0x7f10141f56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:22.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.635+0000 7f1012ffd700 1 --2- 172.21.15.2:0/300902722 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f101415cca0 0x7f10141f56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:22.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.635+0000 7f1012ffd700 1 -- 172.21.15.2:0/300902722 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ffc009550 con 0x7f10141564e0 2023-11-26T07:15:22.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.635+0000 7f1012ffd700 1 --2- 172.21.15.2:0/300902722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10141564e0 0x7f101413f810 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc009130 tx=0x7f0ffc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:22.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.635+0000 7f100bfff700 1 -- 172.21.15.2:0/300902722 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc003e30 con 0x7f10141564e0 2023-11-26T07:15:22.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.636+0000 7f100bfff700 1 -- 172.21.15.2:0/300902722 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ffc01f070 con 0x7f10141564e0 2023-11-26T07:15:22.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.636+0000 7f101a09f700 1 -- 172.21.15.2:0/300902722 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f101414c970 con 0x7f10141564e0 2023-11-26T07:15:22.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.636+0000 7f100bfff700 1 -- 172.21.15.2:0/300902722 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc00b8a0 con 0x7f10141564e0 2023-11-26T07:15:22.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.636+0000 7f101a09f700 1 -- 172.21.15.2:0/300902722 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10141f4ea0 con 0x7f10141564e0 2023-11-26T07:15:22.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.637+0000 7f101a09f700 1 -- 172.21.15.2:0/300902722 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1014075480 con 0x7f10141564e0 2023-11-26T07:15:22.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.637+0000 7f100bfff700 1 -- 172.21.15.2:0/300902722 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f0ffc021030 con 0x7f10141564e0 2023-11-26T07:15:22.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.637+0000 7f100bfff700 1 --2- 172.21.15.2:0/300902722 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0ff406b470 0x7f0ff406d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:22.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.637+0000 7f100bfff700 1 -- 172.21.15.2:0/300902722 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ffc08b660 con 0x7f10141564e0 2023-11-26T07:15:22.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.638+0000 7f10137fe700 1 --2- 172.21.15.2:0/300902722 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0ff406b470 0x7f0ff406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:22.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.638+0000 7f10137fe700 1 --2- 172.21.15.2:0/300902722 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0ff406b470 0x7f0ff406d930 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1004003e60 tx=0x7f1004009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:22.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.642+0000 7f100bfff700 1 -- 172.21.15.2:0/300902722 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0ffc055f30 con 0x7f10141564e0 2023-11-26T07:15:22.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.927+0000 7f101a09f700 1 -- 172.21.15.2:0/300902722 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f1014075480 con 0x7f10141564e0 2023-11-26T07:15:22.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.929+0000 7f100bfff700 1 -- 172.21.15.2:0/300902722 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+147 (secure 0 0 0) 0x7f0ffc00ba00 con 0x7f10141564e0 2023-11-26T07:15:22.930 INFO:teuthology.orchestra.run.smithi002.stdout:[client.0] 2023-11-26T07:15:22.931 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBv72JlaEgQKxAA4cVx4nUFgqn0HvVBJdVHVg== 2023-11-26T07:15:22.931 INFO:teuthology.orchestra.run.smithi002.stdout: caps mds = "allow" 2023-11-26T07:15:22.931 INFO:teuthology.orchestra.run.smithi002.stdout: caps mon = "allow r" 2023-11-26T07:15:22.931 INFO:teuthology.orchestra.run.smithi002.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-26T07:15:22.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.931+0000 7f101a09f700 1 -- 172.21.15.2:0/300902722 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0ff406b470 msgr2=0x7f0ff406d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:22.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.931+0000 7f101a09f700 1 --2- 172.21.15.2:0/300902722 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0ff406b470 0x7f0ff406d930 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1004003e60 tx=0x7f1004009040 comp rx=0 tx=0).stop 2023-11-26T07:15:22.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.931+0000 7f101a09f700 1 -- 172.21.15.2:0/300902722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10141564e0 msgr2=0x7f101413f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:22.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.931+0000 7f101a09f700 1 --2- 172.21.15.2:0/300902722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10141564e0 0x7f101413f810 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc009130 tx=0x7f0ffc004750 comp rx=0 tx=0).stop 2023-11-26T07:15:22.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.931+0000 7f101a09f700 1 -- 172.21.15.2:0/300902722 shutdown_connections 2023-11-26T07:15:22.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.931+0000 7f101a09f700 1 --2- 172.21.15.2:0/300902722 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0ff406b470 0x7f0ff406d930 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:22.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.931+0000 7f101a09f700 1 --2- 172.21.15.2:0/300902722 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f101415cca0 0x7f10141f56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:22.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.931+0000 7f101a09f700 1 --2- 172.21.15.2:0/300902722 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f101406afd0 0x7f101414ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:22.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.931+0000 7f101a09f700 1 --2- 172.21.15.2:0/300902722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10141564e0 0x7f101413f810 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:22.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.931+0000 7f101a09f700 1 -- 172.21.15.2:0/300902722 >> 172.21.15.2:0/300902722 conn(0x7f10140b27b0 msgr2=0x7f10140b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:22.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.931+0000 7f101a09f700 1 -- 172.21.15.2:0/300902722 shutdown_connections 2023-11-26T07:15:22.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:22.931+0000 7f101a09f700 1 -- 172.21.15.2:0/300902722 wait complete. 2023-11-26T07:15:22.935 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.0 2023-11-26T07:15:22.945 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:15:23.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.068+0000 7f891ff38700 1 Processor -- start 2023-11-26T07:15:23.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.068+0000 7f891ff38700 1 -- start start 2023-11-26T07:15:23.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.069+0000 7f891ff38700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f89181440f0 0x7f89180b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:23.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.069+0000 7f891ff38700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8918143ec0 con 0x7f8918143ae0 2023-11-26T07:15:23.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.069+0000 7f891ff38700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89180b3ae0 con 0x7f89180722c0 2023-11-26T07:15:23.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.069+0000 7f891ff38700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89180b40a0 con 0x7f89181440f0 2023-11-26T07:15:23.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.069+0000 7f891e4d5700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f89181440f0 0x7f89180b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:23.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.069+0000 7f891e4d5700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f89181440f0 0x7f89180b51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43222/0 (socket says 172.21.15.2:43222) 2023-11-26T07:15:23.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.069+0000 7f891e4d5700 1 -- 172.21.15.2:0/2735904659 learned_addr learned my addr 172.21.15.2:0/2735904659 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:23.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.069+0000 7f891dcd4700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f8918143ae0 0x7f8918071bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34428/0 (socket says 172.21.15.2:34428) 2023-11-26T07:15:23.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.069+0000 7f891e4d5700 1 -- 172.21.15.2:0/2735904659 >> v1:172.21.15.192:6789/0 conn(0x7f89180722c0 legacy=0x7f891806e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:23.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.069+0000 7f891e4d5700 1 -- 172.21.15.2:0/2735904659 >> v1:172.21.15.2:6789/0 conn(0x7f8918143ae0 legacy=0x7f8918071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:23.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.069+0000 7f891ccd2700 1 -- 172.21.15.2:0/2735904659 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1320669556 0 0) 0x7f8918143ec0 con 0x7f8918143ae0 2023-11-26T07:15:23.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.069+0000 7f891e4d5700 1 -- 172.21.15.2:0/2735904659 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89180b3dc0 con 0x7f89181440f0 2023-11-26T07:15:23.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.069+0000 7f891e4d5700 1 --2- 172.21.15.2:0/2735904659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89181440f0 0x7f89180b51b0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f8910009e50 tx=0x7f891000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af0903833569cd99 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:23.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.069+0000 7f891ccd2700 1 -- 172.21.15.2:0/2735904659 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891000e070 con 0x7f89181440f0 2023-11-26T07:15:23.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.070+0000 7f891ccd2700 1 -- 172.21.15.2:0/2735904659 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8910003a20 con 0x7f89181440f0 2023-11-26T07:15:23.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.070+0000 7f891ccd2700 1 -- 172.21.15.2:0/2735904659 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8910003dd0 con 0x7f89181440f0 2023-11-26T07:15:23.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.070+0000 7f891ff38700 1 -- 172.21.15.2:0/2735904659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89181440f0 msgr2=0x7f89180b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:23.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.070+0000 7f891ff38700 1 --2- 172.21.15.2:0/2735904659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89181440f0 0x7f89180b51b0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f8910009e50 tx=0x7f891000b330 comp rx=0 tx=0).stop 2023-11-26T07:15:23.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.070+0000 7f891ff38700 1 -- 172.21.15.2:0/2735904659 shutdown_connections 2023-11-26T07:15:23.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.070+0000 7f891ff38700 1 --2- 172.21.15.2:0/2735904659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89181440f0 0x7f89180b51b0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:23.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.070+0000 7f891ff38700 1 -- 172.21.15.2:0/2735904659 >> 172.21.15.2:0/2735904659 conn(0x7f89180b2740 msgr2=0x7f89180b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:23.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.070+0000 7f891ff38700 1 -- 172.21.15.2:0/2735904659 shutdown_connections 2023-11-26T07:15:23.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.070+0000 7f891ff38700 1 -- 172.21.15.2:0/2735904659 wait complete. 2023-11-26T07:15:23.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.071+0000 7f891ff38700 1 Processor -- start 2023-11-26T07:15:23.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.071+0000 7f891ff38700 1 -- start start 2023-11-26T07:15:23.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.072+0000 7f891ff38700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89180722c0 0x7f8918159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:23.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.072+0000 7f891ff38700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8918143ae0 0x7f891813ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:23.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.072+0000 7f891ff38700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f89181440f0 0x7f89180c59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:23.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.072+0000 7f891ff38700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89180cc7c0 con 0x7f89180722c0 2023-11-26T07:15:23.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.072+0000 7f891ff38700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89180c7e60 con 0x7f89181440f0 2023-11-26T07:15:23.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.072+0000 7f891ff38700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89180c7250 con 0x7f8918143ae0 2023-11-26T07:15:23.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.072+0000 7f891dcd4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89180722c0 0x7f8918159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:23.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.072+0000 7f891dcd4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89180722c0 0x7f8918159fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43224/0 (socket says 172.21.15.2:43224) 2023-11-26T07:15:23.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.072+0000 7f891dcd4700 1 -- 172.21.15.2:0/3306634232 learned_addr learned my addr 172.21.15.2:0/3306634232 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:23.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.072+0000 7f891d4d3700 1 --2- 172.21.15.2:0/3306634232 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8918143ae0 0x7f891813ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:23.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.072+0000 7f891e4d5700 1 --2- 172.21.15.2:0/3306634232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f89181440f0 0x7f89180c59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:23.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.072+0000 7f891dcd4700 1 -- 172.21.15.2:0/3306634232 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8918143ae0 msgr2=0x7f891813ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:23.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.072+0000 7f891dcd4700 1 --2- 172.21.15.2:0/3306634232 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8918143ae0 0x7f891813ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:23.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.072+0000 7f891dcd4700 1 -- 172.21.15.2:0/3306634232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f89181440f0 msgr2=0x7f89180c59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:23.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.072+0000 7f891dcd4700 1 --2- 172.21.15.2:0/3306634232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f89181440f0 0x7f89180c59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:23.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.072+0000 7f891dcd4700 1 -- 172.21.15.2:0/3306634232 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8910009b30 con 0x7f89180722c0 2023-11-26T07:15:23.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.072+0000 7f891e4d5700 1 --2- 172.21.15.2:0/3306634232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f89181440f0 0x7f89180c59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:15:23.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.072+0000 7f891d4d3700 1 --2- 172.21.15.2:0/3306634232 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8918143ae0 0x7f891813ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:15:23.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.073+0000 7f891dcd4700 1 --2- 172.21.15.2:0/3306634232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89180722c0 0x7f8918159fd0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f89080011e0 tx=0x7f890800cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:23.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.073+0000 7f890e7fc700 1 -- 172.21.15.2:0/3306634232 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8908004c80 con 0x7f89180722c0 2023-11-26T07:15:23.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.073+0000 7f890e7fc700 1 -- 172.21.15.2:0/3306634232 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8908004e00 con 0x7f89180722c0 2023-11-26T07:15:23.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.073+0000 7f891ff38700 1 -- 172.21.15.2:0/3306634232 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89180c7530 con 0x7f89180722c0 2023-11-26T07:15:23.079 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.073+0000 7f890e7fc700 1 -- 172.21.15.2:0/3306634232 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8908007310 con 0x7f89180722c0 2023-11-26T07:15:23.079 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.073+0000 7f891ff38700 1 -- 172.21.15.2:0/3306634232 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89180c7af0 con 0x7f89180722c0 2023-11-26T07:15:23.079 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.074+0000 7f891ff38700 1 -- 172.21.15.2:0/3306634232 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89180c8140 con 0x7f89180722c0 2023-11-26T07:15:23.079 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.074+0000 7f890e7fc700 1 -- 172.21.15.2:0/3306634232 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f8908007470 con 0x7f89180722c0 2023-11-26T07:15:23.079 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.075+0000 7f890e7fc700 1 --2- 172.21.15.2:0/3306634232 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f88fc06b470 0x7f88fc06d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:23.079 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.075+0000 7f890e7fc700 1 -- 172.21.15.2:0/3306634232 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f890808a310 con 0x7f89180722c0 2023-11-26T07:15:23.079 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.075+0000 7f891d4d3700 1 --2- 172.21.15.2:0/3306634232 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f88fc06b470 0x7f88fc06d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:23.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.076+0000 7f891d4d3700 1 --2- 172.21.15.2:0/3306634232 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f88fc06b470 0x7f88fc06d930 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f89180c9740 tx=0x7f8914009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:23.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.079+0000 7f890e7fc700 1 -- 172.21.15.2:0/3306634232 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8908054ce0 con 0x7f89180722c0 2023-11-26T07:15:23.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.328+0000 7f891ff38700 1 -- 172.21.15.2:0/3306634232 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8918068670 con 0x7f89180722c0 2023-11-26T07:15:23.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.328+0000 7f890e7fc700 1 -- 172.21.15.2:0/3306634232 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f8908058300 con 0x7f89180722c0 2023-11-26T07:15:23.330 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:15:23.330 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5384,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3283211322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3283211322},{"type":"v1","addr":"172.21.15.192:6837","nonce":3283211322}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":5833,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/4149545589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":4149545589},{"type":"v1","addr":"172.21.15.192:6836","nonce":4149545589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":6171,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/1422633843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1422633843},{"type":"v1","addr":"172.21.15.2:6834","nonce":1422633843}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:15:12.714394+0000","modified":"2023-11-26T07:15:15.725909+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6174},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6174":{"gid":6174,"name":"a","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6835/1251532899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":1251532899},{"type":"v1","addr":"172.21.15.2:6835","nonce":1251532899}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-26T07:15:23.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.330+0000 7f891ff38700 1 -- 172.21.15.2:0/3306634232 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f88fc06b470 msgr2=0x7f88fc06d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:23.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.330+0000 7f891ff38700 1 --2- 172.21.15.2:0/3306634232 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f88fc06b470 0x7f88fc06d930 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f89180c9740 tx=0x7f8914009040 comp rx=0 tx=0).stop 2023-11-26T07:15:23.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.330+0000 7f891ff38700 1 -- 172.21.15.2:0/3306634232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89180722c0 msgr2=0x7f8918159fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:23.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.330+0000 7f891ff38700 1 --2- 172.21.15.2:0/3306634232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89180722c0 0x7f8918159fd0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f89080011e0 tx=0x7f890800cae0 comp rx=0 tx=0).stop 2023-11-26T07:15:23.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.330+0000 7f891ff38700 1 -- 172.21.15.2:0/3306634232 shutdown_connections 2023-11-26T07:15:23.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.330+0000 7f891ff38700 1 --2- 172.21.15.2:0/3306634232 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f88fc06b470 0x7f88fc06d930 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:23.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.330+0000 7f891ff38700 1 --2- 172.21.15.2:0/3306634232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f89181440f0 0x7f89180c59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:23.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.330+0000 7f891ff38700 1 --2- 172.21.15.2:0/3306634232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89180722c0 0x7f8918159fd0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:23.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.330+0000 7f891ff38700 1 --2- 172.21.15.2:0/3306634232 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8918143ae0 0x7f891813ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:23.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.330+0000 7f891ff38700 1 -- 172.21.15.2:0/3306634232 >> 172.21.15.2:0/3306634232 conn(0x7f89180b2740 msgr2=0x7f89180cdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:23.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.330+0000 7f891ff38700 1 -- 172.21.15.2:0/3306634232 shutdown_connections 2023-11-26T07:15:23.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.331+0000 7f891ff38700 1 -- 172.21.15.2:0/3306634232 wait complete. 2023-11-26T07:15:23.334 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 36 2023-11-26T07:15:23.746 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 36, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-26T07:15:12.714394+0000', 'modified': '2023-11-26T07:15:15.725909+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6174}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6174': {'gid': 6174, 'name': 'a', 'rank': 0, 'incarnation': 32, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6835/1251532899', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6833', 'nonce': 1251532899}, {'type': 'v1', 'addr': '172.21.15.2:6835', 'nonce': 1251532899}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-26T07:15:23.747 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-26T07:15:23.747 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-26T07:15:23.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.876+0000 7ffb3792a700 1 Processor -- start 2023-11-26T07:15:23.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.877+0000 7ffb3792a700 1 -- start start 2023-11-26T07:15:23.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.877+0000 7ffb3792a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb300ad1f0 0x7ffb300afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:23.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.877+0000 7ffb3792a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ffb300b02c0 0x7ffb300ae900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:23.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.877+0000 7ffb3792a700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb300ae470 con 0x7ffb3015a570 2023-11-26T07:15:23.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.877+0000 7ffb3792a700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb300b0750 con 0x7ffb300b02c0 2023-11-26T07:15:23.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.877+0000 7ffb3792a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb300ad650 con 0x7ffb300ad1f0 2023-11-26T07:15:23.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.877+0000 7ffb356c6700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ffb3015a570 0x7ffb3006bae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34442/0 (socket says 172.21.15.2:34442) 2023-11-26T07:15:23.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.877+0000 7ffb356c6700 1 -- 172.21.15.2:0/1997830845 learned_addr learned my addr 172.21.15.2:0/1997830845 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:15:23.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.878+0000 7ffb35ec7700 1 --2- 172.21.15.2:0/1997830845 >> v2:172.21.15.192:3300/0 conn(0x7ffb300b02c0 0x7ffb300ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:23.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.878+0000 7ffb34ec5700 1 --2- 172.21.15.2:0/1997830845 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb300ad1f0 0x7ffb300afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:23.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.878+0000 7ffb27fff700 1 -- 172.21.15.2:0/1997830845 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2641143467 0 0) 0x7ffb300ae470 con 0x7ffb3015a570 2023-11-26T07:15:23.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.878+0000 7ffb27fff700 1 -- 172.21.15.2:0/1997830845 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb1c0035b0 con 0x7ffb3015a570 2023-11-26T07:15:23.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.878+0000 7ffb27fff700 1 -- 172.21.15.2:0/1997830845 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2105080368 0 0) 0x7ffb1c0035b0 con 0x7ffb3015a570 2023-11-26T07:15:23.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.878+0000 7ffb27fff700 1 -- 172.21.15.2:0/1997830845 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb300ad1f0 msgr2=0x7ffb300afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:23.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.878+0000 7ffb27fff700 1 --2- 172.21.15.2:0/1997830845 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb300ad1f0 0x7ffb300afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:23.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.878+0000 7ffb27fff700 1 -- 172.21.15.2:0/1997830845 >> v2:172.21.15.192:3300/0 conn(0x7ffb300b02c0 msgr2=0x7ffb300ae900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:23.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.878+0000 7ffb27fff700 1 --2- 172.21.15.2:0/1997830845 >> v2:172.21.15.192:3300/0 conn(0x7ffb300b02c0 0x7ffb300ae900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:23.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.878+0000 7ffb27fff700 1 -- 172.21.15.2:0/1997830845 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb300ad860 con 0x7ffb3015a570 2023-11-26T07:15:23.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.878+0000 7ffb27fff700 1 -- 172.21.15.2:0/1997830845 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7ffb20001670 con 0x7ffb3015a570 2023-11-26T07:15:23.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.878+0000 7ffb34ec5700 1 --2- 172.21.15.2:0/1997830845 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb300ad1f0 0x7ffb300afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:15:23.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.878+0000 7ffb35ec7700 1 --2- 172.21.15.2:0/1997830845 >> v2:172.21.15.192:3300/0 conn(0x7ffb300b02c0 0x7ffb300ae900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:15:23.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.878+0000 7ffb27fff700 1 -- 172.21.15.2:0/1997830845 >> v1:172.21.15.2:6789/0 conn(0x7ffb3015a570 legacy=0x7ffb3006bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:23.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.878+0000 7ffb27fff700 1 --2- 172.21.15.2:0/1997830845 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb300ad1f0 0x7ffb1c003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:23.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.878+0000 7ffb27fff700 1 --2- 172.21.15.2:0/1997830845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb1c003f40 0x7ffb1c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:23.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.878+0000 7ffb27fff700 1 --2- 172.21.15.2:0/1997830845 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb1c004d90 0x7ffb1c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:23.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.878+0000 7ffb27fff700 1 -- 172.21.15.2:0/1997830845 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb300b0750 con 0x7ffb1c003f40 2023-11-26T07:15:23.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.878+0000 7ffb27fff700 1 -- 172.21.15.2:0/1997830845 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb300ad650 con 0x7ffb1c004d90 2023-11-26T07:15:23.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.878+0000 7ffb27fff700 1 -- 172.21.15.2:0/1997830845 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c00dc20 con 0x7ffb300ad1f0 2023-11-26T07:15:23.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.878+0000 7ffb34ec5700 1 --2- 172.21.15.2:0/1997830845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb1c003f40 0x7ffb1c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:23.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.878+0000 7ffb356c6700 1 --2- 172.21.15.2:0/1997830845 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb300ad1f0 0x7ffb1c003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:23.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.878+0000 7ffb35ec7700 1 --2- 172.21.15.2:0/1997830845 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb1c004d90 0x7ffb1c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:23.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.879+0000 7ffb34ec5700 1 -- 172.21.15.2:0/1997830845 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb300ad1f0 msgr2=0x7ffb1c003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:23.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.879+0000 7ffb34ec5700 1 --2- 172.21.15.2:0/1997830845 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb300ad1f0 0x7ffb1c003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:23.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.879+0000 7ffb34ec5700 1 -- 172.21.15.2:0/1997830845 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb1c004d90 msgr2=0x7ffb1c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:23.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.879+0000 7ffb34ec5700 1 --2- 172.21.15.2:0/1997830845 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb1c004d90 0x7ffb1c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:23.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.879+0000 7ffb34ec5700 1 -- 172.21.15.2:0/1997830845 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb2c00a640 con 0x7ffb1c003f40 2023-11-26T07:15:23.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.879+0000 7ffb34ec5700 1 --2- 172.21.15.2:0/1997830845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb1c003f40 0x7ffb1c004850 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c00ac90 tx=0x7ffb1c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fc36d482f6c1fe1 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:23.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.879+0000 7ffb27fff700 1 -- 172.21.15.2:0/1997830845 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c00ea20 con 0x7ffb1c003f40 2023-11-26T07:15:23.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.879+0000 7ffb27fff700 1 -- 172.21.15.2:0/1997830845 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2c00eb80 con 0x7ffb1c003f40 2023-11-26T07:15:23.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.879+0000 7ffb27fff700 1 -- 172.21.15.2:0/1997830845 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c0113f0 con 0x7ffb1c003f40 2023-11-26T07:15:23.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.879+0000 7ffb3792a700 1 -- 172.21.15.2:0/1997830845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb1c003f40 msgr2=0x7ffb1c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:23.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.879+0000 7ffb3792a700 1 --2- 172.21.15.2:0/1997830845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb1c003f40 0x7ffb1c004850 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c00ac90 tx=0x7ffb1c005880 comp rx=0 tx=0).stop 2023-11-26T07:15:23.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.879+0000 7ffb35ec7700 1 -- 172.21.15.2:0/1997830845 reap_dead start 2023-11-26T07:15:23.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.879+0000 7ffb3792a700 1 -- 172.21.15.2:0/1997830845 shutdown_connections 2023-11-26T07:15:23.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.879+0000 7ffb3792a700 1 -- 172.21.15.2:0/1997830845 >> 172.21.15.2:0/1997830845 conn(0x7ffb300717f0 msgr2=0x7ffb300b5070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:23.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.880+0000 7ffb3792a700 1 -- 172.21.15.2:0/1997830845 shutdown_connections 2023-11-26T07:15:23.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.880+0000 7ffb3792a700 1 -- 172.21.15.2:0/1997830845 wait complete. 2023-11-26T07:15:23.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.881+0000 7ffb3792a700 1 Processor -- start 2023-11-26T07:15:23.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.881+0000 7ffb3792a700 1 -- start start 2023-11-26T07:15:23.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.882+0000 7ffb3792a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb1c003f40 0x7ffb3015cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:23.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.882+0000 7ffb3792a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb30156970 0x7ffb30155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:23.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.882+0000 7ffb3792a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb301463e0 0x7ffb301579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:23.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.882+0000 7ffb3792a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb30156df0 con 0x7ffb1c003f40 2023-11-26T07:15:23.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.882+0000 7ffb3792a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb30155650 con 0x7ffb301463e0 2023-11-26T07:15:23.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.882+0000 7ffb3792a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb301558d0 con 0x7ffb30156970 2023-11-26T07:15:23.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.882+0000 7ffb356c6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb1c003f40 0x7ffb3015cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:23.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.882+0000 7ffb356c6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb1c003f40 0x7ffb3015cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43244/0 (socket says 172.21.15.2:43244) 2023-11-26T07:15:23.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.882+0000 7ffb356c6700 1 -- 172.21.15.2:0/1656455644 learned_addr learned my addr 172.21.15.2:0/1656455644 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:23.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.882+0000 7ffb35ec7700 1 --2- 172.21.15.2:0/1656455644 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb301463e0 0x7ffb301579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:23.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.882+0000 7ffb34ec5700 1 --2- 172.21.15.2:0/1656455644 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb30156970 0x7ffb30155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:23.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.882+0000 7ffb356c6700 1 -- 172.21.15.2:0/1656455644 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb30156970 msgr2=0x7ffb30155110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:23.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.882+0000 7ffb356c6700 1 --2- 172.21.15.2:0/1656455644 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb30156970 0x7ffb30155110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:23.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.882+0000 7ffb356c6700 1 -- 172.21.15.2:0/1656455644 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb301463e0 msgr2=0x7ffb301579d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:23.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.882+0000 7ffb356c6700 1 --2- 172.21.15.2:0/1656455644 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb301463e0 0x7ffb301579d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:23.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.882+0000 7ffb356c6700 1 -- 172.21.15.2:0/1656455644 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb30155bb0 con 0x7ffb1c003f40 2023-11-26T07:15:23.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.882+0000 7ffb356c6700 1 --2- 172.21.15.2:0/1656455644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb1c003f40 0x7ffb3015cdf0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7ffb20007310 tx=0x7ffb20007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:23.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.882+0000 7ffb25ffb700 1 -- 172.21.15.2:0/1656455644 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb20011580 con 0x7ffb1c003f40 2023-11-26T07:15:23.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.882+0000 7ffb25ffb700 1 -- 172.21.15.2:0/1656455644 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb20011700 con 0x7ffb1c003f40 2023-11-26T07:15:23.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.882+0000 7ffb25ffb700 1 -- 172.21.15.2:0/1656455644 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb20011ab0 con 0x7ffb1c003f40 2023-11-26T07:15:23.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.882+0000 7ffb3792a700 1 -- 172.21.15.2:0/1656455644 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb30155e90 con 0x7ffb1c003f40 2023-11-26T07:15:23.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.883+0000 7ffb3792a700 1 -- 172.21.15.2:0/1656455644 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb30156450 con 0x7ffb1c003f40 2023-11-26T07:15:23.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.884+0000 7ffb25ffb700 1 -- 172.21.15.2:0/1656455644 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7ffb20011c10 con 0x7ffb1c003f40 2023-11-26T07:15:23.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.884+0000 7ffb25ffb700 1 --2- 172.21.15.2:0/1656455644 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ffb1406b4a0 0x7ffb1406d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:23.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.884+0000 7ffb25ffb700 1 -- 172.21.15.2:0/1656455644 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffb20089fd0 con 0x7ffb1c003f40 2023-11-26T07:15:23.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.885+0000 7ffb34ec5700 1 --2- 172.21.15.2:0/1656455644 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ffb1406b4a0 0x7ffb1406d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:23.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.885+0000 7ffb34ec5700 1 --2- 172.21.15.2:0/1656455644 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ffb1406b4a0 0x7ffb1406d960 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c000c00 tx=0x7ffb2c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:23.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.886+0000 7ffb43b23b80 1 Processor -- start 2023-11-26T07:15:23.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.886+0000 7ffb43b23b80 1 -- start start 2023-11-26T07:15:23.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.887+0000 7ffb43b23b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x559c4bdf0080 0x559c4be36840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:23.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.887+0000 7ffb43b23b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c4be05ed0 0x559c4be36d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:23.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.887+0000 7ffb43b23b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c4bded490 0x559c4be19e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:23.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.887+0000 7ffb43b23b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c4bd63770 con 0x559c4be05ed0 2023-11-26T07:15:23.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.887+0000 7ffb43b23b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c4bd4a750 con 0x559c4bded490 2023-11-26T07:15:23.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.887+0000 7ffb43b23b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x559c4bd48070 con 0x559c4bdf0080 2023-11-26T07:15:23.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.887+0000 7ffb34ec5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c4be05ed0 0x559c4be36d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:23.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.887+0000 7ffb34ec5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c4be05ed0 0x559c4be36d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43254/0 (socket says 172.21.15.2:43254) 2023-11-26T07:15:23.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.887+0000 7ffb34ec5700 1 -- 172.21.15.2:0/4197937979 learned_addr learned my addr 172.21.15.2:0/4197937979 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:23.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.887+0000 7ffb35ec7700 1 --2- 172.21.15.2:0/4197937979 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c4bded490 0x559c4be19e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:23.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.887+0000 7ffb356c6700 1 --2- 172.21.15.2:0/4197937979 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x559c4bdf0080 0x559c4be36840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:23.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.887+0000 7ffb34ec5700 1 -- 172.21.15.2:0/4197937979 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x559c4bdf0080 msgr2=0x559c4be36840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:23.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.887+0000 7ffb34ec5700 1 --2- 172.21.15.2:0/4197937979 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x559c4bdf0080 0x559c4be36840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:23.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.887+0000 7ffb34ec5700 1 -- 172.21.15.2:0/4197937979 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c4bded490 msgr2=0x559c4be19e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:23.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.887+0000 7ffb34ec5700 1 --2- 172.21.15.2:0/4197937979 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c4bded490 0x559c4be19e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:23.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.887+0000 7ffb34ec5700 1 -- 172.21.15.2:0/4197937979 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c4bbc05e0 con 0x559c4be05ed0 2023-11-26T07:15:23.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.887+0000 7ffb356c6700 1 --2- 172.21.15.2:0/4197937979 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x559c4bdf0080 0x559c4be36840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:15:23.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.888+0000 7ffb34ec5700 1 --2- 172.21.15.2:0/4197937979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c4be05ed0 0x559c4be36d80 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c00e550 tx=0x7ffb2c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e1644d7f7d5d38 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:23.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.888+0000 7ffb12ffd700 1 -- 172.21.15.2:0/4197937979 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c02f070 con 0x559c4be05ed0 2023-11-26T07:15:23.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.888+0000 7ffb12ffd700 1 -- 172.21.15.2:0/4197937979 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2c022040 con 0x559c4be05ed0 2023-11-26T07:15:23.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.888+0000 7ffb12ffd700 1 -- 172.21.15.2:0/4197937979 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c0043a0 con 0x559c4be05ed0 2023-11-26T07:15:23.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.888+0000 7ffb43b23b80 1 -- 172.21.15.2:0/4197937979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c4be05ed0 msgr2=0x559c4be36d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:23.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.888+0000 7ffb43b23b80 1 --2- 172.21.15.2:0/4197937979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c4be05ed0 0x559c4be36d80 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c00e550 tx=0x7ffb2c013000 comp rx=0 tx=0).stop 2023-11-26T07:15:23.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.889+0000 7ffb43b23b80 1 -- 172.21.15.2:0/4197937979 shutdown_connections 2023-11-26T07:15:23.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.889+0000 7ffb43b23b80 1 --2- 172.21.15.2:0/4197937979 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c4bded490 0x559c4be19e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:23.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.889+0000 7ffb43b23b80 1 --2- 172.21.15.2:0/4197937979 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x559c4bdf0080 0x559c4be36840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:23.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.889+0000 7ffb43b23b80 1 --2- 172.21.15.2:0/4197937979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c4be05ed0 0x559c4be36d80 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:23.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.889+0000 7ffb43b23b80 1 -- 172.21.15.2:0/4197937979 >> 172.21.15.2:0/4197937979 conn(0x559c4bd1e310 msgr2=0x559c4be34e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:23.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.889+0000 7ffb43b23b80 1 -- 172.21.15.2:0/4197937979 shutdown_connections 2023-11-26T07:15:23.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.889+0000 7ffb43b23b80 1 -- 172.21.15.2:0/4197937979 wait complete. 2023-11-26T07:15:23.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.889+0000 7ffb43b23b80 1 -- start start 2023-11-26T07:15:23.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.889+0000 7ffb43b23b80 1 Processor -- start 2023-11-26T07:15:23.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.890+0000 7ffb43b23b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c4bded490 0x559c4be43da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:23.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.890+0000 7ffb43b23b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x559c4bdf0080 0x559c4be445b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:23.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.890+0000 7ffb43b23b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c4be05ed0 0x559c4be44af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:23.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.890+0000 7ffb43b23b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c4bd43960 con 0x559c4be05ed0 2023-11-26T07:15:23.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.890+0000 7ffb43b23b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c4bcfd510 con 0x559c4bded490 2023-11-26T07:15:23.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.890+0000 7ffb43b23b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x559c4bcfd1b0 con 0x559c4bdf0080 2023-11-26T07:15:23.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.890+0000 7ffb43b23b80 10 client.0 _ll_register_callbacks cb 0x559c4bc28a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-26T07:15:23.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.890+0000 7ffb35ec7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c4be05ed0 0x559c4be44af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:23.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.890+0000 7ffb356c6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c4bded490 0x559c4be43da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:23.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.890+0000 7ffb356c6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c4bded490 0x559c4be43da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.2:51844/0 (socket says 172.21.15.2:51844) 2023-11-26T07:15:23.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.890+0000 7ffb35ec7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c4be05ed0 0x559c4be44af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43262/0 (socket says 172.21.15.2:43262) 2023-11-26T07:15:23.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.890+0000 7ffb356c6700 1 -- 172.21.15.2:0/283938257 learned_addr learned my addr 172.21.15.2:0/283938257 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:23.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.891+0000 7ffb34ec5700 1 --2- 172.21.15.2:0/283938257 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x559c4bdf0080 0x559c4be445b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:23.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.891+0000 7ffb35ec7700 1 -- 172.21.15.2:0/283938257 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x559c4bdf0080 msgr2=0x559c4be445b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:23.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.891+0000 7ffb35ec7700 1 --2- 172.21.15.2:0/283938257 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x559c4bdf0080 0x559c4be445b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:23.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.891+0000 7ffb35ec7700 1 -- 172.21.15.2:0/283938257 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c4bded490 msgr2=0x559c4be43da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:23.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.891+0000 7ffb35ec7700 1 --2- 172.21.15.2:0/283938257 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c4bded490 0x559c4be43da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:23.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.891+0000 7ffb35ec7700 1 -- 172.21.15.2:0/283938257 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb2c00a640 con 0x559c4be05ed0 2023-11-26T07:15:23.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.891+0000 7ffb35ec7700 1 --2- 172.21.15.2:0/283938257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c4be05ed0 0x559c4be44af0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7ffb30073740 tx=0x7ffb280176f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d079eadea6712626 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:23.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.891+0000 7ffb0bfff700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-26T07:15:23.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.891+0000 7ffb0bfff700 1 -- 172.21.15.2:0/283938257 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2800e040 con 0x559c4be05ed0 2023-11-26T07:15:23.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.891+0000 7ffb0bfff700 1 -- 172.21.15.2:0/283938257 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffb28020aa0 con 0x559c4be05ed0 2023-11-26T07:15:23.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.891+0000 7ffb43b23b80 1 -- 172.21.15.2:0/283938257 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559c4bde2a40 con 0x559c4be05ed0 2023-11-26T07:15:23.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.891+0000 7ffb0bfff700 1 -- 172.21.15.2:0/283938257 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb28020c60 con 0x559c4be05ed0 2023-11-26T07:15:23.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.891+0000 7ffb43b23b80 10 client.6345 fetch_fsmap learned FSMap version 36 2023-11-26T07:15:23.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.891+0000 7ffb43b23b80 1 -- 172.21.15.2:0/283938257 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x559c4bb6cd90 con 0x559c4be05ed0 2023-11-26T07:15:23.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.891+0000 7ffb0bfff700 1 -- 172.21.15.2:0/283938257 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559c4bde2a40 con 0x559c4be05ed0 2023-11-26T07:15:23.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.891+0000 7ffb0bfff700 1 -- 172.21.15.2:0/283938257 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 36) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ffb28003a20 con 0x559c4be05ed0 2023-11-26T07:15:23.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.891+0000 7ffb43b23b80 10 client.6345 fetch_fsmap finished waiting for FSMap version 36 2023-11-26T07:15:23.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.891+0000 7ffb43b23b80 10 client.6345 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-26T07:15:23.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.892+0000 7ffb43b23b80 20 client.6345 populate_metadata read hostname 'smithi002' 2023-11-26T07:15:23.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.892+0000 7ffb43b23b80 1 --2- 172.21.15.2:0/283938257 >> [v2:172.21.15.2:6833/1251532899,v1:172.21.15.2:6835/1251532899] conn(0x559c4bde4820 0x559c4bdf65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:23.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.892+0000 7ffb43b23b80 4 client.6345 mds_command: new command op to 6174 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-26T07:15:23.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.892+0000 7ffb43b23b80 1 -- 172.21.15.2:0/283938257 --> [v2:172.21.15.2:6833/1251532899,v1:172.21.15.2:6835/1251532899] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559c4bdbe840 con 0x559c4bde4820 2023-11-26T07:15:23.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.892+0000 7ffb356c6700 1 --2- 172.21.15.2:0/283938257 >> [v2:172.21.15.2:6833/1251532899,v1:172.21.15.2:6835/1251532899] conn(0x559c4bde4820 0x559c4bdf65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:23.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.892+0000 7ffb0bfff700 10 client.6345 ms_handle_connect on v2:172.21.15.2:6833/1251532899 2023-11-26T07:15:23.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.892+0000 7ffb356c6700 1 --2- 172.21.15.2:0/283938257 >> [v2:172.21.15.2:6833/1251532899,v1:172.21.15.2:6835/1251532899] conn(0x559c4bde4820 0x559c4bdf65f0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13b7b0f2b2a5d51f server_cookie=fc338600447ad27a in_seq=0 out_seq=0 2023-11-26T07:15:23.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.892+0000 7ffb0bfff700 1 -- 172.21.15.2:0/283938257 <== mds.0 v2:172.21.15.2:6833/1251532899 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559c4bdbe840 con 0x559c4bde4820 2023-11-26T07:15:23.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.892+0000 7ffb0bfff700 10 client.6345 handle_command_reply: tid=0 2023-11-26T07:15:23.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.893+0000 7ffb43b23b80 1 client.6345 shutdown 2023-11-26T07:15:23.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.893+0000 7ffb43b23b80 1 -- 172.21.15.2:0/283938257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c4be05ed0 msgr2=0x559c4be44af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:23.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.893+0000 7ffb43b23b80 1 --2- 172.21.15.2:0/283938257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c4be05ed0 0x559c4be44af0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7ffb30073740 tx=0x7ffb280176f0 comp rx=0 tx=0).stop 2023-11-26T07:15:23.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.893+0000 7ffb43b23b80 1 -- 172.21.15.2:0/283938257 shutdown_connections 2023-11-26T07:15:23.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.893+0000 7ffb43b23b80 1 --2- 172.21.15.2:0/283938257 >> [v2:172.21.15.2:6833/1251532899,v1:172.21.15.2:6835/1251532899] conn(0x559c4bde4820 0x559c4bdf65f0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:23.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.893+0000 7ffb43b23b80 1 --2- 172.21.15.2:0/283938257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c4be05ed0 0x559c4be44af0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:23.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.893+0000 7ffb43b23b80 1 --2- 172.21.15.2:0/283938257 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c4bded490 0x559c4be43da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:23.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.893+0000 7ffb0bfff700 0 client.6345 ms_handle_reset on v2:172.21.15.2:6833/1251532899 2023-11-26T07:15:23.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.893+0000 7ffb43b23b80 1 --2- 172.21.15.2:0/283938257 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x559c4bdf0080 0x559c4be445b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:23.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.893+0000 7ffb43b23b80 1 -- 172.21.15.2:0/283938257 >> 172.21.15.2:0/283938257 conn(0x559c4bd1e310 msgr2=0x559c4be38c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:23.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.893+0000 7ffb43b23b80 1 -- 172.21.15.2:0/283938257 shutdown_connections 2023-11-26T07:15:23.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.893+0000 7ffb43b23b80 1 -- 172.21.15.2:0/283938257 wait complete. 2023-11-26T07:15:23.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.893+0000 7ffb43b23b80 20 client.6345 trim_cache size 0 max 16384 2023-11-26T07:15:23.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.911+0000 7ffb43b23b80 1 Processor -- start 2023-11-26T07:15:23.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.911+0000 7ffb43b23b80 1 -- start start 2023-11-26T07:15:23.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.912+0000 7ffb43b23b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x559c4bded490 0x559c4be2c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:23.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.912+0000 7ffb43b23b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c4bdf0080 0x559c4be58010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:23.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.912+0000 7ffb43b23b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c4be05ed0 0x559c4be443a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:23.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.912+0000 7ffb43b23b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c4bbc28d0 con 0x559c4be05ed0 2023-11-26T07:15:23.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.912+0000 7ffb43b23b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c4be43510 con 0x559c4bdf0080 2023-11-26T07:15:23.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.912+0000 7ffb43b23b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x559c4be2c0f0 con 0x559c4bded490 2023-11-26T07:15:23.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.912+0000 7ffb35ec7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c4be05ed0 0x559c4be443a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:23.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.912+0000 7ffb35ec7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c4be05ed0 0x559c4be443a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43268/0 (socket says 172.21.15.2:43268) 2023-11-26T07:15:23.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.912+0000 7ffb35ec7700 1 -- 172.21.15.2:0/828831068 learned_addr learned my addr 172.21.15.2:0/828831068 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:23.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.912+0000 7ffb356c6700 1 --2- 172.21.15.2:0/828831068 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x559c4bded490 0x559c4be2c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:23.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.912+0000 7ffb34ec5700 1 --2- 172.21.15.2:0/828831068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c4bdf0080 0x559c4be58010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:23.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.912+0000 7ffb35ec7700 1 -- 172.21.15.2:0/828831068 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x559c4bded490 msgr2=0x559c4be2c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:23.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.912+0000 7ffb35ec7700 1 --2- 172.21.15.2:0/828831068 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x559c4bded490 0x559c4be2c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:23.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.912+0000 7ffb35ec7700 1 -- 172.21.15.2:0/828831068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c4bdf0080 msgr2=0x559c4be58010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:23.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.912+0000 7ffb35ec7700 1 --2- 172.21.15.2:0/828831068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c4bdf0080 0x559c4be58010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:23.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.912+0000 7ffb35ec7700 1 -- 172.21.15.2:0/828831068 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c4bb55c10 con 0x559c4be05ed0 2023-11-26T07:15:23.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.912+0000 7ffb35ec7700 1 --2- 172.21.15.2:0/828831068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c4be05ed0 0x559c4be443a0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7ffb28009490 tx=0x7ffb2801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=424012286fd1021d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:23.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.912+0000 7ffb137fe700 1 -- 172.21.15.2:0/828831068 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2800e070 con 0x559c4be05ed0 2023-11-26T07:15:23.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.913+0000 7ffb137fe700 1 -- 172.21.15.2:0/828831068 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2800f040 con 0x559c4be05ed0 2023-11-26T07:15:23.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.913+0000 7ffb137fe700 1 -- 172.21.15.2:0/828831068 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb28029470 con 0x559c4be05ed0 2023-11-26T07:15:23.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.913+0000 7ffb43b23b80 1 -- 172.21.15.2:0/828831068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c4be05ed0 msgr2=0x559c4be443a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:23.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.913+0000 7ffb43b23b80 1 --2- 172.21.15.2:0/828831068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c4be05ed0 0x559c4be443a0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7ffb28009490 tx=0x7ffb2801a000 comp rx=0 tx=0).stop 2023-11-26T07:15:23.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.913+0000 7ffb43b23b80 1 -- 172.21.15.2:0/828831068 shutdown_connections 2023-11-26T07:15:23.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.913+0000 7ffb43b23b80 1 --2- 172.21.15.2:0/828831068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c4be05ed0 0x559c4be443a0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:23.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.913+0000 7ffb43b23b80 1 --2- 172.21.15.2:0/828831068 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x559c4bded490 0x559c4be2c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:23.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.913+0000 7ffb43b23b80 1 --2- 172.21.15.2:0/828831068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c4bdf0080 0x559c4be58010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:23.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.913+0000 7ffb43b23b80 1 -- 172.21.15.2:0/828831068 >> 172.21.15.2:0/828831068 conn(0x559c4bd1e310 msgr2=0x559c4be31b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:23.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.913+0000 7ffb43b23b80 1 -- 172.21.15.2:0/828831068 shutdown_connections 2023-11-26T07:15:23.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.913+0000 7ffb43b23b80 1 -- 172.21.15.2:0/828831068 wait complete. 2023-11-26T07:15:23.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.914+0000 7ffb43b23b80 1 -- start start 2023-11-26T07:15:23.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.914+0000 7ffb43b23b80 1 Processor -- start 2023-11-26T07:15:23.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.915+0000 7ffb43b23b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c4bded490 0x559c4be9ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:23.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.915+0000 7ffb43b23b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x559c4bdf0080 0x559c4bdf9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:23.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.915+0000 7ffb43b23b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c4be05ed0 0x559c4be58010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:23.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.915+0000 7ffb43b23b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c4bdea890 con 0x559c4bded490 2023-11-26T07:15:23.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.915+0000 7ffb43b23b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c4bea2940 con 0x559c4be05ed0 2023-11-26T07:15:23.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.915+0000 7ffb43b23b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x559c4be2b410 con 0x559c4bdf0080 2023-11-26T07:15:23.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.915+0000 7ffb43b23b80 10 client.0 _ll_register_callbacks cb 0x559c4bc28a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-26T07:15:23.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.915+0000 7ffb356c6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c4bded490 0x559c4be9ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:23.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.915+0000 7ffb356c6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c4bded490 0x559c4be9ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43272/0 (socket says 172.21.15.2:43272) 2023-11-26T07:15:23.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.915+0000 7ffb356c6700 1 -- 172.21.15.2:0/1342908010 learned_addr learned my addr 172.21.15.2:0/1342908010 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:23.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.915+0000 7ffb34ec5700 1 --2- 172.21.15.2:0/1342908010 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x559c4bdf0080 0x559c4bdf9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:23.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.915+0000 7ffb35ec7700 1 --2- 172.21.15.2:0/1342908010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c4be05ed0 0x559c4be58010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:23.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.915+0000 7ffb356c6700 1 -- 172.21.15.2:0/1342908010 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x559c4bdf0080 msgr2=0x559c4bdf9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:23.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.915+0000 7ffb356c6700 1 --2- 172.21.15.2:0/1342908010 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x559c4bdf0080 0x559c4bdf9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:23.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.915+0000 7ffb356c6700 1 -- 172.21.15.2:0/1342908010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c4be05ed0 msgr2=0x559c4be58010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:23.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.915+0000 7ffb356c6700 1 --2- 172.21.15.2:0/1342908010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c4be05ed0 0x559c4be58010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:23.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.915+0000 7ffb356c6700 1 -- 172.21.15.2:0/1342908010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559c4bb6cd90 con 0x559c4bded490 2023-11-26T07:15:23.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.915+0000 7ffb356c6700 1 --2- 172.21.15.2:0/1342908010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c4bded490 0x559c4be9ca50 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7ffb20054900 tx=0x7ffb20009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e037d63a62c752e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:23.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.915+0000 7ffb0bfff700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-26T07:15:23.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.915+0000 7ffb0bfff700 1 -- 172.21.15.2:0/1342908010 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb20086040 con 0x559c4bded490 2023-11-26T07:15:23.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.915+0000 7ffb0bfff700 1 -- 172.21.15.2:0/1342908010 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffb20058660 con 0x559c4bded490 2023-11-26T07:15:23.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.915+0000 7ffb43b23b80 1 -- 172.21.15.2:0/1342908010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffb2c022040 con 0x559c4bded490 2023-11-26T07:15:23.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.916+0000 7ffb0bfff700 1 -- 172.21.15.2:0/1342908010 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb20087b20 con 0x559c4bded490 2023-11-26T07:15:23.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.916+0000 7ffb43b23b80 10 client.6351 fetch_fsmap learned FSMap version 36 2023-11-26T07:15:23.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.916+0000 7ffb43b23b80 1 -- 172.21.15.2:0/1342908010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x559c4bb93200 con 0x559c4bded490 2023-11-26T07:15:23.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.916+0000 7ffb0bfff700 1 -- 172.21.15.2:0/1342908010 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2c022040 con 0x559c4bded490 2023-11-26T07:15:23.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.916+0000 7ffb0bfff700 1 -- 172.21.15.2:0/1342908010 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 36) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ffb200578f0 con 0x559c4bded490 2023-11-26T07:15:23.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.916+0000 7ffb43b23b80 10 client.6351 fetch_fsmap finished waiting for FSMap version 36 2023-11-26T07:15:23.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.916+0000 7ffb43b23b80 10 client.6351 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-26T07:15:23.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.916+0000 7ffb43b23b80 20 client.6351 populate_metadata read hostname 'smithi002' 2023-11-26T07:15:23.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.916+0000 7ffb43b23b80 1 --2- 172.21.15.2:0/1342908010 >> [v2:172.21.15.2:6833/1251532899,v1:172.21.15.2:6835/1251532899] conn(0x559c4be44430 0x559c4be44810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:23.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.916+0000 7ffb43b23b80 4 client.6351 mds_command: new command op to 6174 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-26T07:15:23.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.916+0000 7ffb43b23b80 1 -- 172.21.15.2:0/1342908010 --> [v2:172.21.15.2:6833/1251532899,v1:172.21.15.2:6835/1251532899] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559c4bd09f80 con 0x559c4be44430 2023-11-26T07:15:23.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.916+0000 7ffb34ec5700 1 --2- 172.21.15.2:0/1342908010 >> [v2:172.21.15.2:6833/1251532899,v1:172.21.15.2:6835/1251532899] conn(0x559c4be44430 0x559c4be44810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:23.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.916+0000 7ffb0bfff700 10 client.6351 ms_handle_connect on v2:172.21.15.2:6833/1251532899 2023-11-26T07:15:23.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.916+0000 7ffb34ec5700 1 --2- 172.21.15.2:0/1342908010 >> [v2:172.21.15.2:6833/1251532899,v1:172.21.15.2:6835/1251532899] conn(0x559c4be44430 0x559c4be44810 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2786e8fef63a828e server_cookie=b2932dd0eefff5c7 in_seq=0 out_seq=0 2023-11-26T07:15:23.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.917+0000 7ffb0bfff700 1 -- 172.21.15.2:0/1342908010 <== mds.0 v2:172.21.15.2:6833/1251532899 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x559c4bd09f80 con 0x559c4be44430 2023-11-26T07:15:23.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.917+0000 7ffb0bfff700 10 client.6351 handle_command_reply: tid=0 2023-11-26T07:15:23.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.917+0000 7ffb43b23b80 1 client.6351 shutdown 2023-11-26T07:15:23.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.917+0000 7ffb43b23b80 1 -- 172.21.15.2:0/1342908010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c4bded490 msgr2=0x559c4be9ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:23.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.917+0000 7ffb43b23b80 1 --2- 172.21.15.2:0/1342908010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c4bded490 0x559c4be9ca50 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7ffb20054900 tx=0x7ffb20009040 comp rx=0 tx=0).stop 2023-11-26T07:15:23.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.917+0000 7ffb43b23b80 1 -- 172.21.15.2:0/1342908010 shutdown_connections 2023-11-26T07:15:23.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.917+0000 7ffb43b23b80 1 --2- 172.21.15.2:0/1342908010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c4be05ed0 0x559c4be58010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:23.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.917+0000 7ffb43b23b80 1 --2- 172.21.15.2:0/1342908010 >> [v2:172.21.15.2:6833/1251532899,v1:172.21.15.2:6835/1251532899] conn(0x559c4be44430 0x559c4be44810 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:23.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.917+0000 7ffb43b23b80 1 --2- 172.21.15.2:0/1342908010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c4bded490 0x559c4be9ca50 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:23.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.917+0000 7ffb43b23b80 1 --2- 172.21.15.2:0/1342908010 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x559c4bdf0080 0x559c4bdf9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:23.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.917+0000 7ffb0bfff700 0 client.6351 ms_handle_reset on v2:172.21.15.2:6833/1251532899 2023-11-26T07:15:23.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.917+0000 7ffb43b23b80 1 -- 172.21.15.2:0/1342908010 >> 172.21.15.2:0/1342908010 conn(0x559c4bd1e310 msgr2=0x559c4be31b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:23.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.917+0000 7ffb43b23b80 1 -- 172.21.15.2:0/1342908010 shutdown_connections 2023-11-26T07:15:23.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.917+0000 7ffb43b23b80 1 -- 172.21.15.2:0/1342908010 wait complete. 2023-11-26T07:15:23.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.917+0000 7ffb43b23b80 20 client.6351 trim_cache size 0 max 16384 2023-11-26T07:15:23.927 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-26T07:15:23.927 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "cb9817c7-f1ed-4745-9395-2760a3bb9712", 2023-11-26T07:15:23.927 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2023-11-26T07:15:23.927 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 6174, 2023-11-26T07:15:23.927 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2023-11-26T07:15:23.927 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2023-11-26T07:15:23.927 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2023-11-26T07:15:23.927 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 10.631508133000001, 2023-11-26T07:15:23.928 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 36, 2023-11-26T07:15:23.928 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 60, 2023-11-26T07:15:23.928 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 60, 2023-11-26T07:15:23.928 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 15.07978541 2023-11-26T07:15:23.928 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-26T07:15:23.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.917+0000 7ffb3792a700 1 -- 172.21.15.2:0/1656455644 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ffb1406b4a0 msgr2=0x7ffb1406d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:23.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.917+0000 7ffb3792a700 1 --2- 172.21.15.2:0/1656455644 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ffb1406b4a0 0x7ffb1406d960 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c000c00 tx=0x7ffb2c008030 comp rx=0 tx=0).stop 2023-11-26T07:15:23.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.918+0000 7ffb3792a700 1 -- 172.21.15.2:0/1656455644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb1c003f40 msgr2=0x7ffb3015cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:23.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.918+0000 7ffb3792a700 1 --2- 172.21.15.2:0/1656455644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb1c003f40 0x7ffb3015cdf0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7ffb20007310 tx=0x7ffb20007620 comp rx=0 tx=0).stop 2023-11-26T07:15:23.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.918+0000 7ffb3792a700 1 -- 172.21.15.2:0/1656455644 shutdown_connections 2023-11-26T07:15:23.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.918+0000 7ffb3792a700 1 --2- 172.21.15.2:0/1656455644 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ffb1406b4a0 0x7ffb1406d960 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:23.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.918+0000 7ffb3792a700 1 --2- 172.21.15.2:0/1656455644 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb301463e0 0x7ffb301579d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:23.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.918+0000 7ffb3792a700 1 --2- 172.21.15.2:0/1656455644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb1c003f40 0x7ffb3015cdf0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:23.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.918+0000 7ffb3792a700 1 --2- 172.21.15.2:0/1656455644 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb30156970 0x7ffb30155110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:23.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.918+0000 7ffb3792a700 1 -- 172.21.15.2:0/1656455644 >> 172.21.15.2:0/1656455644 conn(0x7ffb300717f0 msgr2=0x7ffb3006bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:23.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.918+0000 7ffb3792a700 1 -- 172.21.15.2:0/1656455644 shutdown_connections 2023-11-26T07:15:23.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:23.918+0000 7ffb3792a700 1 -- 172.21.15.2:0/1656455644 wait complete. 2023-11-26T07:15:23.931 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-26T07:15:24.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.054+0000 7fe6f0088700 1 Processor -- start 2023-11-26T07:15:24.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.054+0000 7fe6f0088700 1 -- start start 2023-11-26T07:15:24.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.055+0000 7fe6f0088700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6e806b620 0x7fe6e80b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:24.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.055+0000 7fe6f0088700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6e81629c0 con 0x7fe6e806ee60 2023-11-26T07:15:24.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.055+0000 7fe6f0088700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6e8071f50 con 0x7fe6e80b5ab0 2023-11-26T07:15:24.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.055+0000 7fe6f0088700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e8072230 con 0x7fe6e806b620 2023-11-26T07:15:24.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.055+0000 7fe6ee625700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe6e806ee60 0x7fe6e81622b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34494/0 (socket says 172.21.15.2:34494) 2023-11-26T07:15:24.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.055+0000 7fe6ee625700 1 -- 172.21.15.2:0/1386640810 learned_addr learned my addr 172.21.15.2:0/1386640810 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:15:24.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.056+0000 7fe6ece22700 1 -- 172.21.15.2:0/1386640810 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2937930017 0 0) 0x7fe6e81629c0 con 0x7fe6e806ee60 2023-11-26T07:15:24.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.056+0000 7fe6ede24700 1 --2- 172.21.15.2:0/1386640810 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6e806b620 0x7fe6e80b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:24.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.056+0000 7fe6ece22700 1 -- 172.21.15.2:0/1386640810 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6d40035b0 con 0x7fe6e806ee60 2023-11-26T07:15:24.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.056+0000 7fe6ece22700 1 -- 172.21.15.2:0/1386640810 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3040871389 0 0) 0x7fe6d40035b0 con 0x7fe6e806ee60 2023-11-26T07:15:24.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.056+0000 7fe6ece22700 1 -- 172.21.15.2:0/1386640810 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6e806b620 msgr2=0x7fe6e80b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:24.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.056+0000 7fe6ece22700 1 --2- 172.21.15.2:0/1386640810 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6e806b620 0x7fe6e80b3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:24.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.056+0000 7fe6ece22700 1 -- 172.21.15.2:0/1386640810 >> v1:172.21.15.192:6789/0 conn(0x7fe6e80b5ab0 legacy=0x7fe6e8161ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:24.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.056+0000 7fe6ece22700 1 -- 172.21.15.2:0/1386640810 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e8072510 con 0x7fe6e806ee60 2023-11-26T07:15:24.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.056+0000 7fe6ece22700 1 -- 172.21.15.2:0/1386640810 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7fe6e00019f0 con 0x7fe6e806ee60 2023-11-26T07:15:24.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.056+0000 7fe6ece22700 1 -- 172.21.15.2:0/1386640810 >> v1:172.21.15.2:6789/0 conn(0x7fe6e806ee60 legacy=0x7fe6e81622b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:24.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.056+0000 7fe6ece22700 1 --2- 172.21.15.2:0/1386640810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6d4003a30 0x7fe6d4003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:24.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.056+0000 7fe6ece22700 1 --2- 172.21.15.2:0/1386640810 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6e806b620 0x7fe6d4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:24.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.056+0000 7fe6ece22700 1 --2- 172.21.15.2:0/1386640810 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6d4004d90 0x7fe6d4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:24.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.056+0000 7fe6ece22700 1 -- 172.21.15.2:0/1386640810 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e8072230 con 0x7fe6d4003a30 2023-11-26T07:15:24.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.056+0000 7fe6ece22700 1 -- 172.21.15.2:0/1386640810 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d400bac0 con 0x7fe6d4004d90 2023-11-26T07:15:24.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.056+0000 7fe6ece22700 1 -- 172.21.15.2:0/1386640810 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d400bc80 con 0x7fe6e806b620 2023-11-26T07:15:24.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.056+0000 7fe6ede24700 1 --2- 172.21.15.2:0/1386640810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6d4003a30 0x7fe6d4003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:24.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.056+0000 7fe6ed623700 1 --2- 172.21.15.2:0/1386640810 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6e806b620 0x7fe6d4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:24.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.056+0000 7fe6ee625700 1 --2- 172.21.15.2:0/1386640810 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6d4004d90 0x7fe6d4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:24.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.056+0000 7fe6ede24700 1 -- 172.21.15.2:0/1386640810 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6e806b620 msgr2=0x7fe6d4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:24.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.056+0000 7fe6ede24700 1 --2- 172.21.15.2:0/1386640810 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6e806b620 0x7fe6d4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:24.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.056+0000 7fe6ede24700 1 -- 172.21.15.2:0/1386640810 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6d4004d90 msgr2=0x7fe6d4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:24.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.056+0000 7fe6ede24700 1 --2- 172.21.15.2:0/1386640810 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6d4004d90 0x7fe6d4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:24.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.056+0000 7fe6ede24700 1 -- 172.21.15.2:0/1386640810 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d40035b0 con 0x7fe6d4003a30 2023-11-26T07:15:24.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.056+0000 7fe6ed623700 1 --2- 172.21.15.2:0/1386640810 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6e806b620 0x7fe6d4004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:15:24.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.056+0000 7fe6ee625700 1 --2- 172.21.15.2:0/1386640810 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6d4004d90 0x7fe6d4005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:15:24.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.056+0000 7fe6ede24700 1 --2- 172.21.15.2:0/1386640810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6d4003a30 0x7fe6d4003e50 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8009b30 tx=0x7fe6d4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3e47010c564922a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:24.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.057+0000 7fe6ece22700 1 -- 172.21.15.2:0/1386640810 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d800e6c0 con 0x7fe6d4003a30 2023-11-26T07:15:24.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.057+0000 7fe6ece22700 1 -- 172.21.15.2:0/1386640810 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d800e820 con 0x7fe6d4003a30 2023-11-26T07:15:24.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.057+0000 7fe6ece22700 1 -- 172.21.15.2:0/1386640810 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d800eb90 con 0x7fe6d4003a30 2023-11-26T07:15:24.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.057+0000 7fe6f0088700 1 -- 172.21.15.2:0/1386640810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6d4003a30 msgr2=0x7fe6d4003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:24.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.057+0000 7fe6f0088700 1 --2- 172.21.15.2:0/1386640810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6d4003a30 0x7fe6d4003e50 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8009b30 tx=0x7fe6d4005880 comp rx=0 tx=0).stop 2023-11-26T07:15:24.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.057+0000 7fe6ee625700 1 -- 172.21.15.2:0/1386640810 reap_dead start 2023-11-26T07:15:24.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.057+0000 7fe6f0088700 1 -- 172.21.15.2:0/1386640810 shutdown_connections 2023-11-26T07:15:24.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.057+0000 7fe6f0088700 1 -- 172.21.15.2:0/1386640810 >> 172.21.15.2:0/1386640810 conn(0x7fe6e80b2740 msgr2=0x7fe6e80b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:24.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.057+0000 7fe6f0088700 1 -- 172.21.15.2:0/1386640810 shutdown_connections 2023-11-26T07:15:24.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.057+0000 7fe6f0088700 1 -- 172.21.15.2:0/1386640810 wait complete. 2023-11-26T07:15:24.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.058+0000 7fe6f0088700 1 Processor -- start 2023-11-26T07:15:24.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.058+0000 7fe6f0088700 1 -- start start 2023-11-26T07:15:24.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.059+0000 7fe6f0088700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6d4003a30 0x7fe6e8161250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:24.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.059+0000 7fe6f0088700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6e81467a0 0x7fe6e8146c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:24.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.059+0000 7fe6f0088700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6e8159340 0x7fe6e81597c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:24.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.059+0000 7fe6f0088700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e8147d20 con 0x7fe6e81467a0 2023-11-26T07:15:24.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.059+0000 7fe6f0088700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e8147410 con 0x7fe6e8159340 2023-11-26T07:15:24.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.059+0000 7fe6f0088700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e8147160 con 0x7fe6d4003a30 2023-11-26T07:15:24.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.059+0000 7fe6ed623700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6e81467a0 0x7fe6e8146c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:24.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.059+0000 7fe6ed623700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6e81467a0 0x7fe6e8146c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43294/0 (socket says 172.21.15.2:43294) 2023-11-26T07:15:24.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.059+0000 7fe6ed623700 1 -- 172.21.15.2:0/2691283481 learned_addr learned my addr 172.21.15.2:0/2691283481 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:24.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.059+0000 7fe6ede24700 1 --2- 172.21.15.2:0/2691283481 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6d4003a30 0x7fe6e8161250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:24.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.060+0000 7fe6ee625700 1 --2- 172.21.15.2:0/2691283481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6e8159340 0x7fe6e81597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:24.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.060+0000 7fe6ed623700 1 -- 172.21.15.2:0/2691283481 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6d4003a30 msgr2=0x7fe6e8161250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:24.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.060+0000 7fe6ed623700 1 --2- 172.21.15.2:0/2691283481 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6d4003a30 0x7fe6e8161250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:24.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.060+0000 7fe6ed623700 1 -- 172.21.15.2:0/2691283481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6e8159340 msgr2=0x7fe6e81597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:24.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.060+0000 7fe6ed623700 1 --2- 172.21.15.2:0/2691283481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6e8159340 0x7fe6e81597c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:24.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.060+0000 7fe6ed623700 1 -- 172.21.15.2:0/2691283481 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e815b410 con 0x7fe6e81467a0 2023-11-26T07:15:24.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.060+0000 7fe6ed623700 1 --2- 172.21.15.2:0/2691283481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6e81467a0 0x7fe6e8146c20 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fe6e400e780 tx=0x7fe6e400eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:24.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.060+0000 7fe6de7fc700 1 -- 172.21.15.2:0/2691283481 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e40052e0 con 0x7fe6e81467a0 2023-11-26T07:15:24.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.060+0000 7fe6de7fc700 1 -- 172.21.15.2:0/2691283481 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e4005440 con 0x7fe6e81467a0 2023-11-26T07:15:24.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.060+0000 7fe6f0088700 1 -- 172.21.15.2:0/2691283481 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6e815a100 con 0x7fe6e81467a0 2023-11-26T07:15:24.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.060+0000 7fe6de7fc700 1 -- 172.21.15.2:0/2691283481 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e40038a0 con 0x7fe6e81467a0 2023-11-26T07:15:24.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.060+0000 7fe6f0088700 1 -- 172.21.15.2:0/2691283481 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6e8147940 con 0x7fe6e81467a0 2023-11-26T07:15:24.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.061+0000 7fe6f0088700 1 -- 172.21.15.2:0/2691283481 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6e8068670 con 0x7fe6e81467a0 2023-11-26T07:15:24.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.061+0000 7fe6de7fc700 1 -- 172.21.15.2:0/2691283481 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7fe6e4003a00 con 0x7fe6e81467a0 2023-11-26T07:15:24.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.062+0000 7fe6de7fc700 1 --2- 172.21.15.2:0/2691283481 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe6cc06b470 0x7fe6cc06d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:24.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.062+0000 7fe6de7fc700 1 -- 172.21.15.2:0/2691283481 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe6e4089650 con 0x7fe6e81467a0 2023-11-26T07:15:24.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.062+0000 7fe6ede24700 1 --2- 172.21.15.2:0/2691283481 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe6cc06b470 0x7fe6cc06d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:24.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.062+0000 7fe6ede24700 1 --2- 172.21.15.2:0/2691283481 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe6cc06b470 0x7fe6cc06d930 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe6d80090b0 tx=0x7fe6d8008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:24.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.066+0000 7fe6de7fc700 1 -- 172.21.15.2:0/2691283481 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe6e4054050 con 0x7fe6e81467a0 2023-11-26T07:15:24.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.313+0000 7fe6f0088700 1 -- 172.21.15.2:0/2691283481 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe6e8147e60 con 0x7fe6e81467a0 2023-11-26T07:15:24.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.314+0000 7fe6de7fc700 1 -- 172.21.15.2:0/2691283481 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v36) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe6e8147e60 con 0x7fe6e81467a0 2023-11-26T07:15:24.315 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-26T07:15:24.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.315+0000 7fe6f0088700 1 -- 172.21.15.2:0/2691283481 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe6cc06b470 msgr2=0x7fe6cc06d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.315+0000 7fe6f0088700 1 --2- 172.21.15.2:0/2691283481 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe6cc06b470 0x7fe6cc06d930 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe6d80090b0 tx=0x7fe6d8008030 comp rx=0 tx=0).stop 2023-11-26T07:15:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.315+0000 7fe6f0088700 1 -- 172.21.15.2:0/2691283481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6e81467a0 msgr2=0x7fe6e8146c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.315+0000 7fe6f0088700 1 --2- 172.21.15.2:0/2691283481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6e81467a0 0x7fe6e8146c20 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fe6e400e780 tx=0x7fe6e400eb40 comp rx=0 tx=0).stop 2023-11-26T07:15:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.315+0000 7fe6f0088700 1 -- 172.21.15.2:0/2691283481 shutdown_connections 2023-11-26T07:15:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.315+0000 7fe6f0088700 1 --2- 172.21.15.2:0/2691283481 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe6cc06b470 0x7fe6cc06d930 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.315+0000 7fe6f0088700 1 --2- 172.21.15.2:0/2691283481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6e8159340 0x7fe6e81597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.316+0000 7fe6f0088700 1 --2- 172.21.15.2:0/2691283481 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6d4003a30 0x7fe6e8161250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.316+0000 7fe6f0088700 1 --2- 172.21.15.2:0/2691283481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6e81467a0 0x7fe6e8146c20 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.316+0000 7fe6f0088700 1 -- 172.21.15.2:0/2691283481 >> 172.21.15.2:0/2691283481 conn(0x7fe6e80b2740 msgr2=0x7fe6e806f440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.316+0000 7fe6f0088700 1 -- 172.21.15.2:0/2691283481 shutdown_connections 2023-11-26T07:15:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:24.316+0000 7fe6f0088700 1 -- 172.21.15.2:0/2691283481 wait complete. 2023-11-26T07:15:24.329 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-26T07:15:24.329 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-26T07:15:24.330 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2023-11-26T07:15:24.330 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-26T07:15:24.330 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-26T07:15:24.330 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-26T07:15:24.330 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-26T07:15:24.330 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-26T07:15:24.330 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-26T07:15:24.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:24.330 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2023-11-26T07:15:24.348 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:15:24.348 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:15:24.348 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:15:24.348 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:15:24.348 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2023-11-26T07:15:24.348 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:15:24.348 INFO:teuthology.orchestra.run.smithi002.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:15:24.348 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:15:24.348 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:15:24.348 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:15:24.348 INFO:teuthology.orchestra.run.smithi002.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-26T07:15:24.348 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:15:24.349 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-26T07:15:24.349 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 42099sec preferred_lft 42099sec 2023-11-26T07:15:24.349 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link 2023-11-26T07:15:24.349 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:15:24.349 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:15:24.349 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:15:24.349 INFO:teuthology.orchestra.run.smithi002.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-26T07:15:24.349 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0a:57:c2:51:2c:98 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:15:24.349 INFO:teuthology.orchestra.run.smithi002.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-26T07:15:24.349 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:15:24.349 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::60ae:c7ff:fe6a:97cb/64 scope link 2023-11-26T07:15:24.349 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:15:24.349 INFO:teuthology.orchestra.run.smithi002.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:15:24.350 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0a:57:c2:51:2c:98 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:15:24.350 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::857:c2ff:fe51:2c98/64 scope link 2023-11-26T07:15:24.350 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:15:24.350 INFO:teuthology.orchestra.run.smithi002.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:15:24.350 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether a2:e0:b8:ef:39:07 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-26T07:15:24.350 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::a0e0:b8ff:feef:3907/64 scope link 2023-11-26T07:15:24.350 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:15:24.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:24.350 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-26T07:15:24.413 INFO:teuthology.orchestra.run.smithi002.stdout:1 2023-11-26T07:15:24.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:24.415 DEBUG:teuthology.orchestra.run.smithi002:> route 2023-11-26T07:15:24.474 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2023-11-26T07:15:24.474 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-26T07:15:24.475 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-26T07:15:24.475 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-26T07:15:24.475 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-26T07:15:24.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:24.475 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-11-26T07:15:24.475 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-11-26T07:15:24.475 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-26T07:15:24.475 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-26T07:15:24.475 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-26T07:15:24.476 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-11-26T07:15:24.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:24.581 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2023-11-26T07:15:24.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-26T07:15:24.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-26T07:15:24.598 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-26T07:15:24.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:24.598 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 up 2023-11-26T07:15:24.665 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:15:24.665 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-26T07:15:24.721 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-26T07:15:24.721 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:15:24.722 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-26T07:15:24.778 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-26T07:15:24.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:24.778 DEBUG:teuthology.orchestra.run.smithi002:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-26T07:15:24.865 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-26T07:15:24.865 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-26T07:15:24.865 INFO:teuthology.orchestra.run.smithi002.stdout:invalid new device string format 2023-11-26T07:15:24.874 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-26T07:15:24.874 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-26T07:15:24.875 INFO:teuthology.orchestra.run.smithi002.stdout:invalid new device string format 2023-11-26T07:15:24.875 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-11-26T07:15:24.875 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:15:24.948 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-26T07:15:24.948 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-26T07:15:24.948 INFO:teuthology.orchestra.run.smithi002.stdout:invalid new device string format 2023-11-26T07:15:24.948 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-11-26T07:15:24.948 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:15:24.948 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: resolved to: "172.21.15.2:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-11-26T07:15:24.948 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.2:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-11-26T07:15:24.949 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=cb9817c7-f1ed-4745-9395-2760a3bb9712" will pass to kernel 2023-11-26T07:15:24.951 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-26T07:15:24.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:24.951 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-26T07:15:24.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:24.978 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-26T07:15:25.060 INFO:teuthology.orchestra.run.smithi002.stdout:client5938 2023-11-26T07:15:25.060 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:25.061 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:25.118 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-26T07:15:25.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.280+0000 7f5d91432700 1 Processor -- start 2023-11-26T07:15:25.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.280+0000 7f5d91432700 1 -- start start 2023-11-26T07:15:25.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.281+0000 7f5d91432700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5d8c06afd0 0x7f5d8c0d16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:25.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.281+0000 7f5d91432700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5d8c0ada10 0x7f5d8c0adea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:25.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.281+0000 7f5d91432700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d8c070490 con 0x7f5d8c0affb0 2023-11-26T07:15:25.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.281+0000 7f5d91432700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d8c0b0410 con 0x7f5d8c0ada10 2023-11-26T07:15:25.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.281+0000 7f5d91432700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d8c0af9f0 con 0x7f5d8c06afd0 2023-11-26T07:15:25.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.281+0000 7f5d8b7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5d8c0ada10 0x7f5d8c0adea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:25.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.281+0000 7f5d8b7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5d8c0ada10 0x7f5d8c0adea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43308/0 (socket says 172.21.15.2:43308) 2023-11-26T07:15:25.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.281+0000 7f5d8b7fe700 1 -- 172.21.15.2:0/665479666 learned_addr learned my addr 172.21.15.2:0/665479666 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:25.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.281+0000 7f5d8affd700 1 --2- 172.21.15.2:0/665479666 >> v2:172.21.15.192:3300/0 conn(0x7f5d8c06afd0 0x7f5d8c0d16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:25.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.282+0000 7f5d8b7fe700 1 -- 172.21.15.2:0/665479666 >> v2:172.21.15.192:3300/0 conn(0x7f5d8c06afd0 msgr2=0x7f5d8c0d16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:25.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.282+0000 7f5d8b7fe700 1 --2- 172.21.15.2:0/665479666 >> v2:172.21.15.192:3300/0 conn(0x7f5d8c06afd0 0x7f5d8c0d16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:25.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.282+0000 7f5d8b7fe700 1 -- 172.21.15.2:0/665479666 >> v1:172.21.15.192:6789/0 conn(0x7f5d8c0affb0 legacy=0x7f5d8c06b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:25.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.282+0000 7f5d8b7fe700 1 -- 172.21.15.2:0/665479666 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d8c0afcd0 con 0x7f5d8c0ada10 2023-11-26T07:15:25.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.282+0000 7f5d8affd700 1 --2- 172.21.15.2:0/665479666 >> v2:172.21.15.192:3300/0 conn(0x7f5d8c06afd0 0x7f5d8c0d16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:15:25.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.282+0000 7f5d8b7fe700 1 --2- 172.21.15.2:0/665479666 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d8c0ada10 0x7f5d8c0adea0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c06d4b0 tx=0x7f5d8400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31da65e72b737bc server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:25.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.282+0000 7f5d89ffb700 1 -- 172.21.15.2:0/665479666 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8400e070 con 0x7f5d8c0ada10 2023-11-26T07:15:25.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.282+0000 7f5d89ffb700 1 -- 172.21.15.2:0/665479666 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d8400b9c0 con 0x7f5d8c0ada10 2023-11-26T07:15:25.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.282+0000 7f5d89ffb700 1 -- 172.21.15.2:0/665479666 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8400bd70 con 0x7f5d8c0ada10 2023-11-26T07:15:25.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.282+0000 7f5d91432700 1 -- 172.21.15.2:0/665479666 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d8c0ada10 msgr2=0x7f5d8c0adea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:25.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.282+0000 7f5d91432700 1 --2- 172.21.15.2:0/665479666 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d8c0ada10 0x7f5d8c0adea0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c06d4b0 tx=0x7f5d8400b330 comp rx=0 tx=0).stop 2023-11-26T07:15:25.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.283+0000 7f5d91432700 1 -- 172.21.15.2:0/665479666 shutdown_connections 2023-11-26T07:15:25.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.283+0000 7f5d91432700 1 --2- 172.21.15.2:0/665479666 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d8c0ada10 0x7f5d8c0adea0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:25.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.283+0000 7f5d91432700 1 --2- 172.21.15.2:0/665479666 >> v2:172.21.15.192:3300/0 conn(0x7f5d8c06afd0 0x7f5d8c0d16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:25.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.283+0000 7f5d91432700 1 -- 172.21.15.2:0/665479666 >> 172.21.15.2:0/665479666 conn(0x7f5d8c0d0bc0 msgr2=0x7f5d8c0d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:25.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.283+0000 7f5d91432700 1 -- 172.21.15.2:0/665479666 shutdown_connections 2023-11-26T07:15:25.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.283+0000 7f5d91432700 1 -- 172.21.15.2:0/665479666 wait complete. 2023-11-26T07:15:25.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.284+0000 7f5d91432700 1 Processor -- start 2023-11-26T07:15:25.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.284+0000 7f5d91432700 1 -- start start 2023-11-26T07:15:25.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.285+0000 7f5d91432700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d8c06afd0 0x7f5d8c0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:25.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.285+0000 7f5d91432700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5d8c0ada10 0x7f5d8c15b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:25.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.285+0000 7f5d91432700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d8c0affb0 0x7f5d8c1f6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:25.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.285+0000 7f5d91432700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8c0d0130 con 0x7f5d8c0affb0 2023-11-26T07:15:25.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.285+0000 7f5d91432700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8c0d03c0 con 0x7f5d8c06afd0 2023-11-26T07:15:25.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.285+0000 7f5d91432700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8c155670 con 0x7f5d8c0ada10 2023-11-26T07:15:25.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.285+0000 7f5d8b7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d8c0affb0 0x7f5d8c1f6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:25.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.285+0000 7f5d8b7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d8c0affb0 0x7f5d8c1f6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43314/0 (socket says 172.21.15.2:43314) 2023-11-26T07:15:25.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.285+0000 7f5d8b7fe700 1 -- 172.21.15.2:0/1329945022 learned_addr learned my addr 172.21.15.2:0/1329945022 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:25.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.286+0000 7f5d8a7fc700 1 --2- 172.21.15.2:0/1329945022 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5d8c0ada10 0x7f5d8c15b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:25.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.286+0000 7f5d8affd700 1 --2- 172.21.15.2:0/1329945022 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d8c06afd0 0x7f5d8c0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:25.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.286+0000 7f5d8b7fe700 1 -- 172.21.15.2:0/1329945022 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5d8c0ada10 msgr2=0x7f5d8c15b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:25.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.286+0000 7f5d8b7fe700 1 --2- 172.21.15.2:0/1329945022 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5d8c0ada10 0x7f5d8c15b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:25.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.286+0000 7f5d8b7fe700 1 -- 172.21.15.2:0/1329945022 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d8c06afd0 msgr2=0x7f5d8c0cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:25.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.286+0000 7f5d8b7fe700 1 --2- 172.21.15.2:0/1329945022 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d8c06afd0 0x7f5d8c0cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:25.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.286+0000 7f5d8b7fe700 1 -- 172.21.15.2:0/1329945022 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d84009b30 con 0x7f5d8c0affb0 2023-11-26T07:15:25.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.286+0000 7f5d8b7fe700 1 --2- 172.21.15.2:0/1329945022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d8c0affb0 0x7f5d8c1f6d00 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f5d8400b370 tx=0x7f5d84004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:25.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.286+0000 7f5d737fe700 1 -- 172.21.15.2:0/1329945022 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d840099b0 con 0x7f5d8c0affb0 2023-11-26T07:15:25.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.286+0000 7f5d737fe700 1 -- 172.21.15.2:0/1329945022 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d840092e0 con 0x7f5d8c0affb0 2023-11-26T07:15:25.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.286+0000 7f5d91432700 1 -- 172.21.15.2:0/1329945022 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d8c15f470 con 0x7f5d8c0affb0 2023-11-26T07:15:25.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.286+0000 7f5d737fe700 1 -- 172.21.15.2:0/1329945022 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8401c660 con 0x7f5d8c0affb0 2023-11-26T07:15:25.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.286+0000 7f5d91432700 1 -- 172.21.15.2:0/1329945022 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d8c155c30 con 0x7f5d8c0affb0 2023-11-26T07:15:25.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.287+0000 7f5d91432700 1 -- 172.21.15.2:0/1329945022 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d8c068670 con 0x7f5d8c0affb0 2023-11-26T07:15:25.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.288+0000 7f5d737fe700 1 -- 172.21.15.2:0/1329945022 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f5d8401c7c0 con 0x7f5d8c0affb0 2023-11-26T07:15:25.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.288+0000 7f5d737fe700 1 --2- 172.21.15.2:0/1329945022 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5d7806b470 0x7f5d7806d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:25.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.288+0000 7f5d737fe700 1 -- 172.21.15.2:0/1329945022 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5d8408bbb0 con 0x7f5d8c0affb0 2023-11-26T07:15:25.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.288+0000 7f5d8affd700 1 --2- 172.21.15.2:0/1329945022 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5d7806b470 0x7f5d7806d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:25.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.289+0000 7f5d8affd700 1 --2- 172.21.15.2:0/1329945022 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5d7806b470 0x7f5d7806d930 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c15b310 tx=0x7f5d80008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:25.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.292+0000 7f5d737fe700 1 -- 172.21.15.2:0/1329945022 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5d840562f0 con 0x7f5d8c0affb0 2023-11-26T07:15:25.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.538+0000 7f5d91432700 1 -- 172.21.15.2:0/1329945022 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5d8c06f960 con 0x7f5d8c0affb0 2023-11-26T07:15:25.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.538+0000 7f5d737fe700 1 -- 172.21.15.2:0/1329945022 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v36) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5d84059910 con 0x7f5d8c0affb0 2023-11-26T07:15:25.540 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-26T07:15:25.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.540+0000 7f5d91432700 1 -- 172.21.15.2:0/1329945022 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5d7806b470 msgr2=0x7f5d7806d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:25.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.540+0000 7f5d91432700 1 --2- 172.21.15.2:0/1329945022 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5d7806b470 0x7f5d7806d930 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c15b310 tx=0x7f5d80008040 comp rx=0 tx=0).stop 2023-11-26T07:15:25.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.540+0000 7f5d91432700 1 -- 172.21.15.2:0/1329945022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d8c0affb0 msgr2=0x7f5d8c1f6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:25.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.540+0000 7f5d91432700 1 --2- 172.21.15.2:0/1329945022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d8c0affb0 0x7f5d8c1f6d00 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f5d8400b370 tx=0x7f5d84004ad0 comp rx=0 tx=0).stop 2023-11-26T07:15:25.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.540+0000 7f5d91432700 1 -- 172.21.15.2:0/1329945022 shutdown_connections 2023-11-26T07:15:25.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.540+0000 7f5d91432700 1 --2- 172.21.15.2:0/1329945022 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5d7806b470 0x7f5d7806d930 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:25.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.540+0000 7f5d91432700 1 --2- 172.21.15.2:0/1329945022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d8c0affb0 0x7f5d8c1f6d00 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:25.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.540+0000 7f5d91432700 1 --2- 172.21.15.2:0/1329945022 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d8c06afd0 0x7f5d8c0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:25.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.540+0000 7f5d91432700 1 --2- 172.21.15.2:0/1329945022 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5d8c0ada10 0x7f5d8c15b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:25.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.540+0000 7f5d91432700 1 -- 172.21.15.2:0/1329945022 >> 172.21.15.2:0/1329945022 conn(0x7f5d8c0d0bc0 msgr2=0x7f5d8c071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:25.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.540+0000 7f5d91432700 1 -- 172.21.15.2:0/1329945022 shutdown_connections 2023-11-26T07:15:25.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:25.540+0000 7f5d91432700 1 -- 172.21.15.2:0/1329945022 wait complete. 2023-11-26T07:15:25.554 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-26T07:15:25.554 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-26T07:15:25.555 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2023-11-26T07:15:25.555 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-26T07:15:25.555 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-26T07:15:25.555 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-26T07:15:25.555 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-26T07:15:25.555 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-26T07:15:25.555 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-26T07:15:25.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:25.555 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2023-11-26T07:15:25.577 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:15:25.577 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:15:25.577 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:15:25.577 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:15:25.577 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2023-11-26T07:15:25.577 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:15:25.577 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:15:25.578 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2023-11-26T07:15:25.578 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:15:25.578 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2023-11-26T07:15:25.578 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:15:25.578 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:15:25.578 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-26T07:15:25.578 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:15:25.578 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-26T07:15:25.578 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42175sec preferred_lft 42175sec 2023-11-26T07:15:25.578 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::4774:e26a:42bc:5f29/64 scope link noprefixroute 2023-11-26T07:15:25.578 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:15:25.579 INFO:teuthology.orchestra.run.smithi192.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-26T07:15:25.579 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 8a:29:a0:eb:3c:15 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:15:25.579 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-26T07:15:25.579 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:15:25.579 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::548b:6dff:fe7a:f7ca/64 scope link 2023-11-26T07:15:25.579 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:15:25.579 INFO:teuthology.orchestra.run.smithi192.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:15:25.579 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether a2:92:2e:43:f5:72 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:15:25.579 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::a092:2eff:fe43:f572/64 scope link 2023-11-26T07:15:25.579 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:15:25.579 INFO:teuthology.orchestra.run.smithi192.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:15:25.579 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 8a:29:a0:eb:3c:15 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-26T07:15:25.580 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::8829:a0ff:feeb:3c15/64 scope link 2023-11-26T07:15:25.580 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:15:25.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:25.580 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-26T07:15:25.647 INFO:teuthology.orchestra.run.smithi192.stdout:1 2023-11-26T07:15:25.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:25.649 DEBUG:teuthology.orchestra.run.smithi192:> route 2023-11-26T07:15:25.711 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2023-11-26T07:15:25.711 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-26T07:15:25.711 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-26T07:15:25.711 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-26T07:15:25.711 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-26T07:15:25.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:25.711 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-11-26T07:15:25.711 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-11-26T07:15:25.712 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-26T07:15:25.712 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-26T07:15:25.712 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-26T07:15:25.712 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-11-26T07:15:25.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:25.822 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2023-11-26T07:15:25.838 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-26T07:15:25.838 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-26T07:15:25.839 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-26T07:15:25.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:25.839 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2023-11-26T07:15:25.905 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:15:25.906 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-26T07:15:25.962 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-26T07:15:25.962 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:15:25.963 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-26T07:15:26.018 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-26T07:15:26.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:26.019 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-26T07:15:26.103 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-26T07:15:26.103 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-26T07:15:26.103 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2023-11-26T07:15:26.112 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-26T07:15:26.112 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-26T07:15:26.112 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2023-11-26T07:15:26.112 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-11-26T07:15:26.112 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:15:26.149 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-26T07:15:26.149 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-26T07:15:26.149 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2023-11-26T07:15:26.149 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-11-26T07:15:26.149 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:15:26.149 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.2:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-11-26T07:15:26.149 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.2:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-11-26T07:15:26.149 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=cb9817c7-f1ed-4745-9395-2760a3bb9712" will pass to kernel 2023-11-26T07:15:26.152 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-26T07:15:26.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:26.152 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-26T07:15:26.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:26.192 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-26T07:15:26.263 INFO:teuthology.orchestra.run.smithi192.stdout:client6366 2023-11-26T07:15:26.264 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:15:26.264 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:26.321 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-11-26T07:15:26.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.462+0000 7f93b53b1700 1 Processor -- start 2023-11-26T07:15:26.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.462+0000 7f93b53b1700 1 -- start start 2023-11-26T07:15:26.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.463+0000 7f93b53b1700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f93b01447a0 0x7f93b0071b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:26.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.463+0000 7f93b53b1700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f93b0072ab0 0x7f93b00720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:26.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.463+0000 7f93b53b1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93b015b130 0x7f93b015e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:26.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.463+0000 7f93b53b1700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93b006dbd0 con 0x7f93b01447a0 2023-11-26T07:15:26.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.463+0000 7f93b53b1700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93b015b700 con 0x7f93b0072ab0 2023-11-26T07:15:26.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.463+0000 7f93b53b1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b015b9e0 con 0x7f93b015b130 2023-11-26T07:15:26.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.463+0000 7f93aeffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f93b01447a0 0x7f93b0071b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:26.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.463+0000 7f93aeffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f93b01447a0 0x7f93b0071b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43318/0 (socket says 172.21.15.2:43318) 2023-11-26T07:15:26.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.463+0000 7f93aeffd700 1 -- 172.21.15.2:0/806659335 learned_addr learned my addr 172.21.15.2:0/806659335 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:26.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.464+0000 7f93af7fe700 1 --2- 172.21.15.2:0/806659335 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93b015b130 0x7f93b015e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:26.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.464+0000 7f93ae7fc700 1 --2- 172.21.15.2:0/806659335 >> v2:172.21.15.192:3300/0 conn(0x7f93b0072ab0 0x7f93b00720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:26.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.464+0000 7f93aeffd700 1 -- 172.21.15.2:0/806659335 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93b015b130 msgr2=0x7f93b015e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:26.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.464+0000 7f93aeffd700 1 --2- 172.21.15.2:0/806659335 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93b015b130 0x7f93b015e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:26.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.464+0000 7f93aeffd700 1 -- 172.21.15.2:0/806659335 >> v2:172.21.15.192:3300/0 conn(0x7f93b0072ab0 msgr2=0x7f93b00720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:26.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.464+0000 7f93aeffd700 1 --2- 172.21.15.2:0/806659335 >> v2:172.21.15.192:3300/0 conn(0x7f93b0072ab0 0x7f93b00720d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:26.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.464+0000 7f93aeffd700 1 -- 172.21.15.2:0/806659335 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b015bcc0 con 0x7f93b01447a0 2023-11-26T07:15:26.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.464+0000 7f93aeffd700 1 --2- 172.21.15.2:0/806659335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93b01447a0 0x7f93b0071b90 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f93b0071520 tx=0x7f93a4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32d5da2e207752bd server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:26.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.464+0000 7f93adffb700 1 -- 172.21.15.2:0/806659335 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a400b870 con 0x7f93b01447a0 2023-11-26T07:15:26.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.464+0000 7f93adffb700 1 -- 172.21.15.2:0/806659335 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a400b9d0 con 0x7f93b01447a0 2023-11-26T07:15:26.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.464+0000 7f93adffb700 1 -- 172.21.15.2:0/806659335 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a400bd60 con 0x7f93b01447a0 2023-11-26T07:15:26.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.465+0000 7f93b53b1700 1 -- 172.21.15.2:0/806659335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93b01447a0 msgr2=0x7f93b0071b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:26.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.465+0000 7f93b53b1700 1 --2- 172.21.15.2:0/806659335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93b01447a0 0x7f93b0071b90 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f93b0071520 tx=0x7f93a4009bd0 comp rx=0 tx=0).stop 2023-11-26T07:15:26.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.465+0000 7f93b53b1700 1 -- 172.21.15.2:0/806659335 shutdown_connections 2023-11-26T07:15:26.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.465+0000 7f93b53b1700 1 --2- 172.21.15.2:0/806659335 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93b015b130 0x7f93b015e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:26.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.465+0000 7f93b53b1700 1 --2- 172.21.15.2:0/806659335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93b01447a0 0x7f93b0071b90 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:26.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.465+0000 7f93b53b1700 1 --2- 172.21.15.2:0/806659335 >> v2:172.21.15.192:3300/0 conn(0x7f93b0072ab0 0x7f93b00720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:26.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.465+0000 7f93b53b1700 1 -- 172.21.15.2:0/806659335 >> 172.21.15.2:0/806659335 conn(0x7f93b00b2760 msgr2=0x7f93b00b2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:26.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.465+0000 7f93b53b1700 1 -- 172.21.15.2:0/806659335 shutdown_connections 2023-11-26T07:15:26.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.465+0000 7f93b53b1700 1 -- 172.21.15.2:0/806659335 wait complete. 2023-11-26T07:15:26.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.466+0000 7f93b53b1700 1 Processor -- start 2023-11-26T07:15:26.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.466+0000 7f93b53b1700 1 -- start start 2023-11-26T07:15:26.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.467+0000 7f93b53b1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93b0072ab0 0x7f93b006e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:26.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.467+0000 7f93b53b1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93b01447a0 0x7f93b01610c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:26.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.467+0000 7f93b53b1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93b015b130 0x7f93b0161600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:26.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.467+0000 7f93b53b1700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b006e6f0 con 0x7f93b015b130 2023-11-26T07:15:26.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.467+0000 7f93b53b1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b006e9d0 con 0x7f93b01447a0 2023-11-26T07:15:26.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.467+0000 7f93b53b1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b006ecb0 con 0x7f93b0072ab0 2023-11-26T07:15:26.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.467+0000 7f93af7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93b015b130 0x7f93b0161600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:26.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.467+0000 7f93af7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93b015b130 0x7f93b0161600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43328/0 (socket says 172.21.15.2:43328) 2023-11-26T07:15:26.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.467+0000 7f93af7fe700 1 -- 172.21.15.2:0/313171271 learned_addr learned my addr 172.21.15.2:0/313171271 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:26.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.467+0000 7f93aeffd700 1 --2- 172.21.15.2:0/313171271 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93b0072ab0 0x7f93b006e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:26.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.467+0000 7f93ae7fc700 1 --2- 172.21.15.2:0/313171271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93b01447a0 0x7f93b01610c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:26.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.467+0000 7f93af7fe700 1 -- 172.21.15.2:0/313171271 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93b0072ab0 msgr2=0x7f93b006e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:26.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.467+0000 7f93af7fe700 1 --2- 172.21.15.2:0/313171271 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93b0072ab0 0x7f93b006e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:26.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.467+0000 7f93af7fe700 1 -- 172.21.15.2:0/313171271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93b01447a0 msgr2=0x7f93b01610c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:26.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.467+0000 7f93af7fe700 1 --2- 172.21.15.2:0/313171271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93b01447a0 0x7f93b01610c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:26.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.467+0000 7f93af7fe700 1 -- 172.21.15.2:0/313171271 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a4009550 con 0x7f93b015b130 2023-11-26T07:15:26.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.468+0000 7f93af7fe700 1 --2- 172.21.15.2:0/313171271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93b015b130 0x7f93b0161600 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f93a8007e60 tx=0x7f93a800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:26.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.468+0000 7f93977fe700 1 -- 172.21.15.2:0/313171271 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a800ede0 con 0x7f93b015b130 2023-11-26T07:15:26.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.468+0000 7f93977fe700 1 -- 172.21.15.2:0/313171271 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a8014420 con 0x7f93b015b130 2023-11-26T07:15:26.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.468+0000 7f93b53b1700 1 -- 172.21.15.2:0/313171271 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93b006ef90 con 0x7f93b015b130 2023-11-26T07:15:26.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.468+0000 7f93977fe700 1 -- 172.21.15.2:0/313171271 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a80147d0 con 0x7f93b015b130 2023-11-26T07:15:26.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.468+0000 7f93b53b1700 1 -- 172.21.15.2:0/313171271 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93b00cfd70 con 0x7f93b015b130 2023-11-26T07:15:26.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.469+0000 7f93b53b1700 1 -- 172.21.15.2:0/313171271 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93b0068670 con 0x7f93b015b130 2023-11-26T07:15:26.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.469+0000 7f93977fe700 1 -- 172.21.15.2:0/313171271 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f93a8014930 con 0x7f93b015b130 2023-11-26T07:15:26.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.470+0000 7f93977fe700 1 --2- 172.21.15.2:0/313171271 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f939c06b470 0x7f939c06d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:26.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.470+0000 7f93977fe700 1 -- 172.21.15.2:0/313171271 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f93a808a650 con 0x7f93b015b130 2023-11-26T07:15:26.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.470+0000 7f93aeffd700 1 --2- 172.21.15.2:0/313171271 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f939c06b470 0x7f939c06d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:26.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.470+0000 7f93aeffd700 1 --2- 172.21.15.2:0/313171271 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f939c06b470 0x7f939c06d930 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f93a4000c00 tx=0x7f93a4008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:26.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.474+0000 7f93977fe700 1 -- 172.21.15.2:0/313171271 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f93a8054f20 con 0x7f93b015b130 2023-11-26T07:15:26.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:26.721+0000 7f93b53b1700 1 -- 172.21.15.2:0/313171271 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f93b006f4b0 con 0x7f93b015b130 2023-11-26T07:15:27.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.345+0000 7f93977fe700 1 -- 172.21.15.2:0/313171271 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v37) v1 ==== 136+0+0 (secure 0 0 0) 0x7f93a8058540 con 0x7f93b015b130 2023-11-26T07:15:27.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.348+0000 7f93b53b1700 1 -- 172.21.15.2:0/313171271 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f939c06b470 msgr2=0x7f939c06d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:27.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.348+0000 7f93b53b1700 1 --2- 172.21.15.2:0/313171271 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f939c06b470 0x7f939c06d930 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f93a4000c00 tx=0x7f93a4008030 comp rx=0 tx=0).stop 2023-11-26T07:15:27.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.348+0000 7f93b53b1700 1 -- 172.21.15.2:0/313171271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93b015b130 msgr2=0x7f93b0161600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:27.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.348+0000 7f93b53b1700 1 --2- 172.21.15.2:0/313171271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93b015b130 0x7f93b0161600 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f93a8007e60 tx=0x7f93a800e3c0 comp rx=0 tx=0).stop 2023-11-26T07:15:27.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.348+0000 7f93b53b1700 1 -- 172.21.15.2:0/313171271 shutdown_connections 2023-11-26T07:15:27.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.348+0000 7f93b53b1700 1 --2- 172.21.15.2:0/313171271 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f939c06b470 0x7f939c06d930 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:27.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.348+0000 7f93b53b1700 1 --2- 172.21.15.2:0/313171271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93b015b130 0x7f93b0161600 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:27.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.348+0000 7f93b53b1700 1 --2- 172.21.15.2:0/313171271 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93b0072ab0 0x7f93b006e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:27.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.348+0000 7f93b53b1700 1 --2- 172.21.15.2:0/313171271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93b01447a0 0x7f93b01610c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:27.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.348+0000 7f93b53b1700 1 -- 172.21.15.2:0/313171271 >> 172.21.15.2:0/313171271 conn(0x7f93b00b2760 msgr2=0x7f93b00b48d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:27.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.348+0000 7f93b53b1700 1 -- 172.21.15.2:0/313171271 shutdown_connections 2023-11-26T07:15:27.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.348+0000 7f93b53b1700 1 -- 172.21.15.2:0/313171271 wait complete. 2023-11-26T07:15:27.365 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-26T07:15:27.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.496+0000 7f74aba46700 1 Processor -- start 2023-11-26T07:15:27.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.496+0000 7f74aba46700 1 -- start start 2023-11-26T07:15:27.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.497+0000 7f74aba46700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f74a415e260 0x7f74a406eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:27.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.497+0000 7f74aba46700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a40d0f50 con 0x7f74a40d09e0 2023-11-26T07:15:27.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.497+0000 7f74aba46700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a40d1230 con 0x7f74a40ccdd0 2023-11-26T07:15:27.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.497+0000 7f74aba46700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a40cc2f0 con 0x7f74a415e260 2023-11-26T07:15:27.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.497+0000 7f74a97e2700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f74a415e260 0x7f74a406eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:27.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.497+0000 7f74a8fe1700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f74a40d09e0 0x7f74a406f430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34542/0 (socket says 172.21.15.2:34542) 2023-11-26T07:15:27.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.497+0000 7f74a8fe1700 1 -- 172.21.15.2:0/862748356 learned_addr learned my addr 172.21.15.2:0/862748356 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:15:27.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.497+0000 7f74a97e2700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f74a415e260 0x7f74a406eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43332/0 (socket says 172.21.15.2:43332) 2023-11-26T07:15:27.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.498+0000 7f74a97e2700 1 -- 172.21.15.2:0/862748356 >> v1:172.21.15.192:6789/0 conn(0x7f74a40ccdd0 legacy=0x7f74a40cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:27.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.498+0000 7f74a97e2700 1 -- 172.21.15.2:0/862748356 >> v1:172.21.15.2:6789/0 conn(0x7f74a40d09e0 legacy=0x7f74a406f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:27.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.498+0000 7f749bfff700 1 -- 172.21.15.2:0/862748356 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4059014075 0 0) 0x7f74a40d0f50 con 0x7f74a40d09e0 2023-11-26T07:15:27.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.498+0000 7f74a97e2700 1 -- 172.21.15.2:0/862748356 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a40cc5d0 con 0x7f74a415e260 2023-11-26T07:15:27.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.498+0000 7f74a97e2700 1 --2- 172.21.15.2:0/862748356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74a415e260 0x7f74a406eef0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f7494009840 tx=0x7f7494009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75f2e40962e8887a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:27.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.498+0000 7f749bfff700 1 -- 172.21.15.2:0/862748356 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7494011830 con 0x7f74a415e260 2023-11-26T07:15:27.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.498+0000 7f749bfff700 1 -- 172.21.15.2:0/862748356 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7494011990 con 0x7f74a415e260 2023-11-26T07:15:27.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.498+0000 7f749bfff700 1 -- 172.21.15.2:0/862748356 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7494011d20 con 0x7f74a415e260 2023-11-26T07:15:27.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.499+0000 7f74aba46700 1 -- 172.21.15.2:0/862748356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74a415e260 msgr2=0x7f74a406eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:27.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.499+0000 7f74aba46700 1 --2- 172.21.15.2:0/862748356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74a415e260 0x7f74a406eef0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f7494009840 tx=0x7f7494009b50 comp rx=0 tx=0).stop 2023-11-26T07:15:27.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.499+0000 7f74aba46700 1 -- 172.21.15.2:0/862748356 shutdown_connections 2023-11-26T07:15:27.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.499+0000 7f74aba46700 1 --2- 172.21.15.2:0/862748356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74a415e260 0x7f74a406eef0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:27.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.499+0000 7f74aba46700 1 -- 172.21.15.2:0/862748356 >> 172.21.15.2:0/862748356 conn(0x7f74a40b3790 msgr2=0x7f74a40b3ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:27.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.499+0000 7f74aba46700 1 -- 172.21.15.2:0/862748356 shutdown_connections 2023-11-26T07:15:27.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.499+0000 7f74aba46700 1 -- 172.21.15.2:0/862748356 wait complete. 2023-11-26T07:15:27.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.500+0000 7f74aba46700 1 Processor -- start 2023-11-26T07:15:27.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.500+0000 7f74aba46700 1 -- start start 2023-11-26T07:15:27.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.501+0000 7f74aba46700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74a40ccdd0 0x7f74a40c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:27.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.501+0000 7f74aba46700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74a40d09e0 0x7f74a40c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:27.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.501+0000 7f74aba46700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74a415e260 0x7f74a40c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:27.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.501+0000 7f74aba46700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a40b5d10 con 0x7f74a415e260 2023-11-26T07:15:27.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.501+0000 7f74aba46700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a40c76b0 con 0x7f74a40d09e0 2023-11-26T07:15:27.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.501+0000 7f74aba46700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a40c70f0 con 0x7f74a40ccdd0 2023-11-26T07:15:27.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.501+0000 7f74a9fe3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74a415e260 0x7f74a40c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:27.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.501+0000 7f74a9fe3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74a415e260 0x7f74a40c8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43342/0 (socket says 172.21.15.2:43342) 2023-11-26T07:15:27.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.501+0000 7f74a9fe3700 1 -- 172.21.15.2:0/471110614 learned_addr learned my addr 172.21.15.2:0/471110614 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:27.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.501+0000 7f74a97e2700 1 --2- 172.21.15.2:0/471110614 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74a40ccdd0 0x7f74a40c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:27.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.501+0000 7f74a8fe1700 1 --2- 172.21.15.2:0/471110614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74a40d09e0 0x7f74a40c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:27.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.501+0000 7f74a9fe3700 1 -- 172.21.15.2:0/471110614 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74a40ccdd0 msgr2=0x7f74a40c80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:27.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.501+0000 7f74a9fe3700 1 --2- 172.21.15.2:0/471110614 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74a40ccdd0 0x7f74a40c80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:27.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.501+0000 7f74a9fe3700 1 -- 172.21.15.2:0/471110614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74a40d09e0 msgr2=0x7f74a40c68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:27.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.501+0000 7f74a9fe3700 1 --2- 172.21.15.2:0/471110614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74a40d09e0 0x7f74a40c68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:27.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.501+0000 7f74a9fe3700 1 -- 172.21.15.2:0/471110614 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74940094a0 con 0x7f74a415e260 2023-11-26T07:15:27.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.502+0000 7f74a9fe3700 1 --2- 172.21.15.2:0/471110614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74a415e260 0x7f74a40c8cd0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f749c00cba0 tx=0x7f749c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:27.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.502+0000 7f7499ffb700 1 -- 172.21.15.2:0/471110614 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749c003c00 con 0x7f74a415e260 2023-11-26T07:15:27.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.502+0000 7f7499ffb700 1 -- 172.21.15.2:0/471110614 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f749c003d60 con 0x7f74a415e260 2023-11-26T07:15:27.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.502+0000 7f7499ffb700 1 -- 172.21.15.2:0/471110614 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749c00aba0 con 0x7f74a415e260 2023-11-26T07:15:27.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.502+0000 7f74aba46700 1 -- 172.21.15.2:0/471110614 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a40c73d0 con 0x7f74a415e260 2023-11-26T07:15:27.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.502+0000 7f74aba46700 1 -- 172.21.15.2:0/471110614 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a40c6de0 con 0x7f74a415e260 2023-11-26T07:15:27.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.503+0000 7f74aba46700 1 -- 172.21.15.2:0/471110614 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a40b5ec0 con 0x7f74a415e260 2023-11-26T07:15:27.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.503+0000 7f7499ffb700 1 -- 172.21.15.2:0/471110614 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f749c00ad00 con 0x7f74a415e260 2023-11-26T07:15:27.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.503+0000 7f7499ffb700 1 --2- 172.21.15.2:0/471110614 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f748806b470 0x7f748806d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:27.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.504+0000 7f7499ffb700 1 -- 172.21.15.2:0/471110614 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f749c08a050 con 0x7f74a415e260 2023-11-26T07:15:27.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.504+0000 7f74a97e2700 1 --2- 172.21.15.2:0/471110614 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f748806b470 0x7f748806d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:27.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.504+0000 7f74a97e2700 1 --2- 172.21.15.2:0/471110614 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f748806b470 0x7f748806d930 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f74a409f870 tx=0x7f749401c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:27.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.508+0000 7f7499ffb700 1 -- 172.21.15.2:0/471110614 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f74a40b5ec0 con 0x7f74a415e260 2023-11-26T07:15:27.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.736+0000 7f74aba46700 1 -- 172.21.15.2:0/471110614 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f74a40b4550 con 0x7f748806b470 2023-11-26T07:15:27.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.738+0000 7f7499ffb700 1 -- 172.21.15.2:0/471110614 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f7494006c60 con 0x7f748806b470 2023-11-26T07:15:27.740 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2023-11-26T07:15:27.740 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:15:27.740 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephfs" 2023-11-26T07:15:27.740 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:15:27.740 INFO:teuthology.orchestra.run.smithi002.stdout:] 2023-11-26T07:15:27.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.740+0000 7f74aba46700 1 -- 172.21.15.2:0/471110614 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f748806b470 msgr2=0x7f748806d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:27.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.740+0000 7f74aba46700 1 --2- 172.21.15.2:0/471110614 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f748806b470 0x7f748806d930 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f74a409f870 tx=0x7f749401c040 comp rx=0 tx=0).stop 2023-11-26T07:15:27.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.740+0000 7f74aba46700 1 -- 172.21.15.2:0/471110614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74a415e260 msgr2=0x7f74a40c8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:27.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.740+0000 7f74aba46700 1 --2- 172.21.15.2:0/471110614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74a415e260 0x7f74a40c8cd0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f749c00cba0 tx=0x7f749c00cf60 comp rx=0 tx=0).stop 2023-11-26T07:15:27.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.740+0000 7f74aba46700 1 -- 172.21.15.2:0/471110614 shutdown_connections 2023-11-26T07:15:27.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.740+0000 7f74aba46700 1 --2- 172.21.15.2:0/471110614 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f748806b470 0x7f748806d930 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:27.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.740+0000 7f74aba46700 1 --2- 172.21.15.2:0/471110614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74a415e260 0x7f74a40c8cd0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:27.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.740+0000 7f74aba46700 1 --2- 172.21.15.2:0/471110614 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74a40ccdd0 0x7f74a40c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:27.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.740+0000 7f74aba46700 1 --2- 172.21.15.2:0/471110614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74a40d09e0 0x7f74a40c68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:27.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.740+0000 7f74aba46700 1 -- 172.21.15.2:0/471110614 >> 172.21.15.2:0/471110614 conn(0x7f74a40b3790 msgr2=0x7f74a40b16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:27.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.741+0000 7f74aba46700 1 -- 172.21.15.2:0/471110614 shutdown_connections 2023-11-26T07:15:27.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.741+0000 7f74aba46700 1 -- 172.21.15.2:0/471110614 wait complete. 2023-11-26T07:15:27.754 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-26T07:15:27.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.881+0000 7f6ef0333700 1 Processor -- start 2023-11-26T07:15:27.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.881+0000 7f6ef0333700 1 -- start start 2023-11-26T07:15:27.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.882+0000 7f6ef0333700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6ee815e360 0x7f6ee80cff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:27.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.882+0000 7f6ef0333700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ee80b3070 0x7f6ee80d0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:27.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.882+0000 7f6ef0333700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6ee806c2f0 0x7f6ee80b1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:27.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.882+0000 7f6ef0333700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ee80b35c0 con 0x7f6ee806c2f0 2023-11-26T07:15:27.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.882+0000 7f6ef0333700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ee80d0d10 con 0x7f6ee815e360 2023-11-26T07:15:27.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.882+0000 7f6ef0333700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee80d09c0 con 0x7f6ee80b3070 2023-11-26T07:15:27.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.882+0000 7f6eee8d0700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6ee806c2f0 0x7f6ee80b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:27.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.882+0000 7f6eee8d0700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6ee806c2f0 0x7f6ee80b1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43350/0 (socket says 172.21.15.2:43350) 2023-11-26T07:15:27.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.882+0000 7f6eee8d0700 1 -- 172.21.15.2:0/3548759517 learned_addr learned my addr 172.21.15.2:0/3548759517 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:27.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.882+0000 7f6eed8ce700 1 --2- 172.21.15.2:0/3548759517 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ee80b3070 0x7f6ee80d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:27.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.882+0000 7f6eee0cf700 1 --2- 172.21.15.2:0/3548759517 >> v2:172.21.15.192:3300/0 conn(0x7f6ee815e360 0x7f6ee80cff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:27.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.882+0000 7f6eee8d0700 1 -- 172.21.15.2:0/3548759517 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ee80b3070 msgr2=0x7f6ee80d0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:27.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.882+0000 7f6eee8d0700 1 --2- 172.21.15.2:0/3548759517 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ee80b3070 0x7f6ee80d0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:27.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.882+0000 7f6eee8d0700 1 -- 172.21.15.2:0/3548759517 >> v2:172.21.15.192:3300/0 conn(0x7f6ee815e360 msgr2=0x7f6ee80cff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:27.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.882+0000 7f6eee8d0700 1 --2- 172.21.15.2:0/3548759517 >> v2:172.21.15.192:3300/0 conn(0x7f6ee815e360 0x7f6ee80cff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:27.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.882+0000 7f6eee8d0700 1 -- 172.21.15.2:0/3548759517 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee806cc90 con 0x7f6ee806c2f0 2023-11-26T07:15:27.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.882+0000 7f6eee8d0700 1 --2- 172.21.15.2:0/3548759517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ee806c2f0 0x7f6ee80b1650 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8072010 tx=0x7f6ee000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68a16a44580b3739 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:27.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.882+0000 7f6eed0cd700 1 -- 172.21.15.2:0/3548759517 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee000e070 con 0x7f6ee806c2f0 2023-11-26T07:15:27.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.882+0000 7f6eed0cd700 1 -- 172.21.15.2:0/3548759517 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee000b9c0 con 0x7f6ee806c2f0 2023-11-26T07:15:27.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.882+0000 7f6eed0cd700 1 -- 172.21.15.2:0/3548759517 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee000bd70 con 0x7f6ee806c2f0 2023-11-26T07:15:27.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.883+0000 7f6ef0333700 1 -- 172.21.15.2:0/3548759517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ee806c2f0 msgr2=0x7f6ee80b1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:27.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.883+0000 7f6ef0333700 1 --2- 172.21.15.2:0/3548759517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ee806c2f0 0x7f6ee80b1650 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8072010 tx=0x7f6ee000b330 comp rx=0 tx=0).stop 2023-11-26T07:15:27.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.883+0000 7f6ef0333700 1 -- 172.21.15.2:0/3548759517 shutdown_connections 2023-11-26T07:15:27.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.883+0000 7f6ef0333700 1 --2- 172.21.15.2:0/3548759517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ee806c2f0 0x7f6ee80b1650 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:27.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.883+0000 7f6ef0333700 1 --2- 172.21.15.2:0/3548759517 >> v2:172.21.15.192:3300/0 conn(0x7f6ee815e360 0x7f6ee80cff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:27.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.883+0000 7f6ef0333700 1 --2- 172.21.15.2:0/3548759517 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ee80b3070 0x7f6ee80d0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:27.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.883+0000 7f6ef0333700 1 -- 172.21.15.2:0/3548759517 >> 172.21.15.2:0/3548759517 conn(0x7f6ee80b3800 msgr2=0x7f6ee80b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:27.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.883+0000 7f6ef0333700 1 -- 172.21.15.2:0/3548759517 shutdown_connections 2023-11-26T07:15:27.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.883+0000 7f6ef0333700 1 -- 172.21.15.2:0/3548759517 wait complete. 2023-11-26T07:15:27.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.885+0000 7f6ef0333700 1 Processor -- start 2023-11-26T07:15:27.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.885+0000 7f6ef0333700 1 -- start start 2023-11-26T07:15:27.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.886+0000 7f6ef0333700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ee806c2f0 0x7f6ee8160b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:27.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.886+0000 7f6ef0333700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ee80b3070 0x7f6ee8150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:27.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.886+0000 7f6ef0333700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ee815e360 0x7f6ee80c5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:27.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.886+0000 7f6ef0333700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee81513e0 con 0x7f6ee815e360 2023-11-26T07:15:27.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.886+0000 7f6ef0333700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee81516c0 con 0x7f6ee806c2f0 2023-11-26T07:15:27.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.886+0000 7f6ef0333700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee81519a0 con 0x7f6ee80b3070 2023-11-26T07:15:27.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.886+0000 7f6eee8d0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ee815e360 0x7f6ee80c5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:27.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.886+0000 7f6eee8d0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ee815e360 0x7f6ee80c5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43356/0 (socket says 172.21.15.2:43356) 2023-11-26T07:15:27.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.886+0000 7f6eee8d0700 1 -- 172.21.15.2:0/3654681235 learned_addr learned my addr 172.21.15.2:0/3654681235 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:27.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.886+0000 7f6eee0cf700 1 --2- 172.21.15.2:0/3654681235 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ee806c2f0 0x7f6ee8160b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:27.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.886+0000 7f6eed8ce700 1 --2- 172.21.15.2:0/3654681235 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ee80b3070 0x7f6ee8150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:27.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.886+0000 7f6eee8d0700 1 -- 172.21.15.2:0/3654681235 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ee80b3070 msgr2=0x7f6ee8150a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:27.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.886+0000 7f6eee8d0700 1 --2- 172.21.15.2:0/3654681235 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ee80b3070 0x7f6ee8150a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:27.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.886+0000 7f6eee8d0700 1 -- 172.21.15.2:0/3654681235 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ee806c2f0 msgr2=0x7f6ee8160b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:27.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.886+0000 7f6eee8d0700 1 --2- 172.21.15.2:0/3654681235 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ee806c2f0 0x7f6ee8160b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:27.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.886+0000 7f6eee8d0700 1 -- 172.21.15.2:0/3654681235 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee0009b30 con 0x7f6ee815e360 2023-11-26T07:15:27.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.886+0000 7f6eee0cf700 1 --2- 172.21.15.2:0/3654681235 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ee806c2f0 0x7f6ee8160b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:15:27.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.886+0000 7f6eed8ce700 1 --2- 172.21.15.2:0/3654681235 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ee80b3070 0x7f6ee8150a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:15:27.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.886+0000 7f6eee8d0700 1 --2- 172.21.15.2:0/3654681235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ee815e360 0x7f6ee80c5760 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8071f10 tx=0x7f6ee0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:27.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.886+0000 7f6edeffd700 1 -- 172.21.15.2:0/3654681235 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0004250 con 0x7f6ee815e360 2023-11-26T07:15:27.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.886+0000 7f6edeffd700 1 -- 172.21.15.2:0/3654681235 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee00043d0 con 0x7f6ee815e360 2023-11-26T07:15:27.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.886+0000 7f6ef0333700 1 -- 172.21.15.2:0/3654681235 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ee8158b60 con 0x7f6ee815e360 2023-11-26T07:15:27.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.886+0000 7f6edeffd700 1 -- 172.21.15.2:0/3654681235 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0004780 con 0x7f6ee815e360 2023-11-26T07:15:27.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.887+0000 7f6ef0333700 1 -- 172.21.15.2:0/3654681235 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ee81f75a0 con 0x7f6ee815e360 2023-11-26T07:15:27.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.887+0000 7f6ef0333700 1 -- 172.21.15.2:0/3654681235 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ee8158d20 con 0x7f6ee815e360 2023-11-26T07:15:27.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.888+0000 7f6edeffd700 1 -- 172.21.15.2:0/3654681235 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f6ee001c440 con 0x7f6ee815e360 2023-11-26T07:15:27.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.888+0000 7f6edeffd700 1 --2- 172.21.15.2:0/3654681235 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6ecc06b470 0x7f6ecc06d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:27.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.888+0000 7f6edeffd700 1 -- 172.21.15.2:0/3654681235 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ee008b6a0 con 0x7f6ee815e360 2023-11-26T07:15:27.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.889+0000 7f6eee0cf700 1 --2- 172.21.15.2:0/3654681235 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6ecc06b470 0x7f6ecc06d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:27.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.889+0000 7f6eee0cf700 1 --2- 172.21.15.2:0/3654681235 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6ecc06b470 0x7f6ecc06d930 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6ee400a9b0 tx=0x7f6ee4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:27.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:27.893+0000 7f6edeffd700 1 -- 172.21.15.2:0/3654681235 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6ee0055e60 con 0x7f6ee815e360 2023-11-26T07:15:28.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.096+0000 7f6ef0333700 1 -- 172.21.15.2:0/3654681235 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6ee81589c0 con 0x7f6ee815e360 2023-11-26T07:15:28.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.096+0000 7f6edeffd700 1 -- 172.21.15.2:0/3654681235 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6ee81589c0 con 0x7f6ee815e360 2023-11-26T07:15:28.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.098+0000 7f6ef0333700 1 -- 172.21.15.2:0/3654681235 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6ecc06b470 msgr2=0x7f6ecc06d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:28.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.098+0000 7f6ef0333700 1 --2- 172.21.15.2:0/3654681235 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6ecc06b470 0x7f6ecc06d930 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6ee400a9b0 tx=0x7f6ee4008040 comp rx=0 tx=0).stop 2023-11-26T07:15:28.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.098+0000 7f6ef0333700 1 -- 172.21.15.2:0/3654681235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ee815e360 msgr2=0x7f6ee80c5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:28.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.098+0000 7f6ef0333700 1 --2- 172.21.15.2:0/3654681235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ee815e360 0x7f6ee80c5760 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8071f10 tx=0x7f6ee0004ad0 comp rx=0 tx=0).stop 2023-11-26T07:15:28.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.098+0000 7f6ef0333700 1 -- 172.21.15.2:0/3654681235 shutdown_connections 2023-11-26T07:15:28.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.098+0000 7f6ef0333700 1 --2- 172.21.15.2:0/3654681235 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6ecc06b470 0x7f6ecc06d930 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:28.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.098+0000 7f6ef0333700 1 --2- 172.21.15.2:0/3654681235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ee815e360 0x7f6ee80c5760 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:28.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.098+0000 7f6ef0333700 1 --2- 172.21.15.2:0/3654681235 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ee806c2f0 0x7f6ee8160b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:28.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.098+0000 7f6ef0333700 1 --2- 172.21.15.2:0/3654681235 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ee80b3070 0x7f6ee8150a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:28.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.098+0000 7f6ef0333700 1 -- 172.21.15.2:0/3654681235 >> 172.21.15.2:0/3654681235 conn(0x7f6ee80b3800 msgr2=0x7f6ee815c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:28.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.098+0000 7f6ef0333700 1 -- 172.21.15.2:0/3654681235 shutdown_connections 2023-11-26T07:15:28.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.098+0000 7f6ef0333700 1 -- 172.21.15.2:0/3654681235 wait complete. 2023-11-26T07:15:28.112 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol52070 --mode=777 2023-11-26T07:15:28.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.239+0000 7f3c64b40700 1 Processor -- start 2023-11-26T07:15:28.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.239+0000 7f3c64b40700 1 -- start start 2023-11-26T07:15:28.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.240+0000 7f3c64b40700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c600b59d0 0x7f3c6015e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:28.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.240+0000 7f3c64b40700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3c60072350 0x7f3c600727c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:28.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.240+0000 7f3c64b40700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c60071ec0 con 0x7f3c6006afd0 2023-11-26T07:15:28.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.240+0000 7f3c64b40700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c60071b90 con 0x7f3c60072350 2023-11-26T07:15:28.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.240+0000 7f3c64b40700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6015ed30 con 0x7f3c600b59d0 2023-11-26T07:15:28.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.241+0000 7f3c5ed9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3c60072350 0x7f3c600727c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:28.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.241+0000 7f3c5ed9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3c60072350 0x7f3c600727c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43364/0 (socket says 172.21.15.2:43364) 2023-11-26T07:15:28.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.241+0000 7f3c5ed9d700 1 -- 172.21.15.2:0/658937634 learned_addr learned my addr 172.21.15.2:0/658937634 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:28.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.241+0000 7f3c5dd9b700 1 --2- 172.21.15.2:0/658937634 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c600b59d0 0x7f3c6015e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:28.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.241+0000 7f3c5ed9d700 1 -- 172.21.15.2:0/658937634 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c600b59d0 msgr2=0x7f3c6015e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:28.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.241+0000 7f3c5ed9d700 1 --2- 172.21.15.2:0/658937634 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c600b59d0 0x7f3c6015e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:28.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.241+0000 7f3c5ed9d700 1 -- 172.21.15.2:0/658937634 >> v1:172.21.15.192:6789/0 conn(0x7f3c6006afd0 legacy=0x7f3c6006b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:28.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.241+0000 7f3c5ed9d700 1 -- 172.21.15.2:0/658937634 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c6015f010 con 0x7f3c60072350 2023-11-26T07:15:28.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.241+0000 7f3c5ed9d700 1 --2- 172.21.15.2:0/658937634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c60072350 0x7f3c600727c0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f3c58009e50 tx=0x7f3c5800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69a2f44f6c210215 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:28.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.241+0000 7f3c5d59a700 1 -- 172.21.15.2:0/658937634 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5800e070 con 0x7f3c60072350 2023-11-26T07:15:28.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.241+0000 7f3c5d59a700 1 -- 172.21.15.2:0/658937634 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c58003a20 con 0x7f3c60072350 2023-11-26T07:15:28.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.241+0000 7f3c5d59a700 1 -- 172.21.15.2:0/658937634 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c58003dd0 con 0x7f3c60072350 2023-11-26T07:15:28.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.242+0000 7f3c64b40700 1 -- 172.21.15.2:0/658937634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c60072350 msgr2=0x7f3c600727c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:28.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.242+0000 7f3c64b40700 1 --2- 172.21.15.2:0/658937634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c60072350 0x7f3c600727c0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f3c58009e50 tx=0x7f3c5800b330 comp rx=0 tx=0).stop 2023-11-26T07:15:28.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.242+0000 7f3c64b40700 1 -- 172.21.15.2:0/658937634 shutdown_connections 2023-11-26T07:15:28.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.242+0000 7f3c64b40700 1 --2- 172.21.15.2:0/658937634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c60072350 0x7f3c600727c0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:28.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.242+0000 7f3c64b40700 1 --2- 172.21.15.2:0/658937634 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c600b59d0 0x7f3c6015e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:28.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.242+0000 7f3c64b40700 1 -- 172.21.15.2:0/658937634 >> 172.21.15.2:0/658937634 conn(0x7f3c600b2760 msgr2=0x7f3c600b2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:28.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.242+0000 7f3c64b40700 1 -- 172.21.15.2:0/658937634 shutdown_connections 2023-11-26T07:15:28.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.242+0000 7f3c64b40700 1 -- 172.21.15.2:0/658937634 wait complete. 2023-11-26T07:15:28.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.243+0000 7f3c64b40700 1 Processor -- start 2023-11-26T07:15:28.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.243+0000 7f3c64b40700 1 -- start start 2023-11-26T07:15:28.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.244+0000 7f3c64b40700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c6006afd0 0x7f3c6015c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:28.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.244+0000 7f3c64b40700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c60072350 0x7f3c6015cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:28.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.244+0000 7f3c64b40700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c600b59d0 0x7f3c601e83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:28.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.244+0000 7f3c64b40700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c601f4d90 con 0x7f3c60072350 2023-11-26T07:15:28.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.244+0000 7f3c64b40700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c601f3cf0 con 0x7f3c6006afd0 2023-11-26T07:15:28.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.244+0000 7f3c64b40700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c601f3fd0 con 0x7f3c600b59d0 2023-11-26T07:15:28.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.244+0000 7f3c5dd9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c60072350 0x7f3c6015cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:28.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.244+0000 7f3c5dd9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c60072350 0x7f3c6015cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43368/0 (socket says 172.21.15.2:43368) 2023-11-26T07:15:28.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.244+0000 7f3c5dd9b700 1 -- 172.21.15.2:0/1527657493 learned_addr learned my addr 172.21.15.2:0/1527657493 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:28.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.244+0000 7f3c5ed9d700 1 --2- 172.21.15.2:0/1527657493 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c600b59d0 0x7f3c601e83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:28.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.244+0000 7f3c5e59c700 1 --2- 172.21.15.2:0/1527657493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c6006afd0 0x7f3c6015c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:28.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.244+0000 7f3c5dd9b700 1 -- 172.21.15.2:0/1527657493 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c600b59d0 msgr2=0x7f3c601e83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:28.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.244+0000 7f3c5dd9b700 1 --2- 172.21.15.2:0/1527657493 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c600b59d0 0x7f3c601e83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:28.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.244+0000 7f3c5dd9b700 1 -- 172.21.15.2:0/1527657493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c6006afd0 msgr2=0x7f3c6015c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:28.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.244+0000 7f3c5dd9b700 1 --2- 172.21.15.2:0/1527657493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c6006afd0 0x7f3c6015c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:28.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.244+0000 7f3c5dd9b700 1 -- 172.21.15.2:0/1527657493 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c58009b30 con 0x7f3c60072350 2023-11-26T07:15:28.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.244+0000 7f3c5e59c700 1 --2- 172.21.15.2:0/1527657493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c6006afd0 0x7f3c6015c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:15:28.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.245+0000 7f3c5dd9b700 1 --2- 172.21.15.2:0/1527657493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c60072350 0x7f3c6015cfe0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f3c5400c7f0 tx=0x7f3c5400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:28.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.245+0000 7f3c4effd700 1 -- 172.21.15.2:0/1527657493 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c54011800 con 0x7f3c60072350 2023-11-26T07:15:28.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.245+0000 7f3c4effd700 1 -- 172.21.15.2:0/1527657493 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c54011960 con 0x7f3c60072350 2023-11-26T07:15:28.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.245+0000 7f3c64b40700 1 -- 172.21.15.2:0/1527657493 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c601f42b0 con 0x7f3c60072350 2023-11-26T07:15:28.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.245+0000 7f3c4effd700 1 -- 172.21.15.2:0/1527657493 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c54011cf0 con 0x7f3c60072350 2023-11-26T07:15:28.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.245+0000 7f3c64b40700 1 -- 172.21.15.2:0/1527657493 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c601f4870 con 0x7f3c60072350 2023-11-26T07:15:28.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.246+0000 7f3c64b40700 1 -- 172.21.15.2:0/1527657493 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c601f4a00 con 0x7f3c60072350 2023-11-26T07:15:28.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.246+0000 7f3c4effd700 1 -- 172.21.15.2:0/1527657493 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7f3c54018360 con 0x7f3c60072350 2023-11-26T07:15:28.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.247+0000 7f3c4effd700 1 --2- 172.21.15.2:0/1527657493 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3c4006b470 0x7f3c4006d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:28.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.247+0000 7f3c4effd700 1 -- 172.21.15.2:0/1527657493 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c5408a070 con 0x7f3c60072350 2023-11-26T07:15:28.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.247+0000 7f3c5e59c700 1 --2- 172.21.15.2:0/1527657493 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3c4006b470 0x7f3c4006d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:28.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.247+0000 7f3c5e59c700 1 --2- 172.21.15.2:0/1527657493 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3c4006b470 0x7f3c4006d930 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3c601618a0 tx=0x7f3c50009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:28.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.251+0000 7f3c4effd700 1 -- 172.21.15.2:0/1527657493 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3c540547a0 con 0x7f3c60072350 2023-11-26T07:15:28.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.486+0000 7f3c64b40700 1 -- 172.21.15.2:0/1527657493 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol52070", "mode": "777", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c6015e9b0 con 0x7f3c4006b470 2023-11-26T07:15:28.495 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:15:28.492+0000 7f8da6aa7700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:15:28.495 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:15:28.492+0000 7f8da6aa7700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:15:28.495 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:15:28.492+0000 7f8da6aa7700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:15:28.495 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:15:28.492+0000 7f8da6aa7700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:15:28.495 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:15:28.492+0000 7f8da6aa7700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:15:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.526+0000 7f3c4effd700 1 -- 172.21.15.2:0/1527657493 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f3c50003ba0 con 0x7f3c4006b470 2023-11-26T07:15:28.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.528+0000 7f3c64b40700 1 -- 172.21.15.2:0/1527657493 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3c4006b470 msgr2=0x7f3c4006d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:28.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.528+0000 7f3c64b40700 1 --2- 172.21.15.2:0/1527657493 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3c4006b470 0x7f3c4006d930 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3c601618a0 tx=0x7f3c50009040 comp rx=0 tx=0).stop 2023-11-26T07:15:28.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.528+0000 7f3c64b40700 1 -- 172.21.15.2:0/1527657493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c60072350 msgr2=0x7f3c6015cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:28.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.528+0000 7f3c64b40700 1 --2- 172.21.15.2:0/1527657493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c60072350 0x7f3c6015cfe0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f3c5400c7f0 tx=0x7f3c5400cbb0 comp rx=0 tx=0).stop 2023-11-26T07:15:28.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.528+0000 7f3c64b40700 1 -- 172.21.15.2:0/1527657493 shutdown_connections 2023-11-26T07:15:28.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.528+0000 7f3c64b40700 1 --2- 172.21.15.2:0/1527657493 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3c4006b470 0x7f3c4006d930 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:28.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.528+0000 7f3c64b40700 1 --2- 172.21.15.2:0/1527657493 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c600b59d0 0x7f3c601e83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:28.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.528+0000 7f3c64b40700 1 --2- 172.21.15.2:0/1527657493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c6006afd0 0x7f3c6015c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:28.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.528+0000 7f3c64b40700 1 --2- 172.21.15.2:0/1527657493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c60072350 0x7f3c6015cfe0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:28.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.528+0000 7f3c64b40700 1 -- 172.21.15.2:0/1527657493 >> 172.21.15.2:0/1527657493 conn(0x7f3c600b2760 msgr2=0x7f3c600b1550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:28.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.528+0000 7f3c64b40700 1 -- 172.21.15.2:0/1527657493 shutdown_connections 2023-11-26T07:15:28.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.528+0000 7f3c64b40700 1 -- 172.21.15.2:0/1527657493 wait complete. 2023-11-26T07:15:28.542 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol52070 2023-11-26T07:15:28.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.668+0000 7ff28a33b700 1 Processor -- start 2023-11-26T07:15:28.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.669+0000 7ff28a33b700 1 -- start start 2023-11-26T07:15:28.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.669+0000 7ff28a33b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2840cf970 0x7ff2840cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:28.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.669+0000 7ff28a33b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff284071b40 0x7ff284071fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:28.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.669+0000 7ff28a33b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff28415f5b0 con 0x7ff28413dd00 2023-11-26T07:15:28.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.669+0000 7ff28a33b700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2840d0690 con 0x7ff284071b40 2023-11-26T07:15:28.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.669+0000 7ff28a33b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2840724f0 con 0x7ff2840cf970 2023-11-26T07:15:28.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.670+0000 7ff2888d8700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff284071b40 0x7ff284071fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:28.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.670+0000 7ff2888d8700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff284071b40 0x7ff284071fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43378/0 (socket says 172.21.15.2:43378) 2023-11-26T07:15:28.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.670+0000 7ff2888d8700 1 -- 172.21.15.2:0/3962349984 learned_addr learned my addr 172.21.15.2:0/3962349984 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:28.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.670+0000 7ff2837fe700 1 --2- 172.21.15.2:0/3962349984 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2840cf970 0x7ff2840cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:28.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.670+0000 7ff2888d8700 1 -- 172.21.15.2:0/3962349984 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2840cf970 msgr2=0x7ff2840cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:28.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.670+0000 7ff2888d8700 1 --2- 172.21.15.2:0/3962349984 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2840cf970 0x7ff2840cc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:28.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.670+0000 7ff2888d8700 1 -- 172.21.15.2:0/3962349984 >> v1:172.21.15.192:6789/0 conn(0x7ff28413dd00 legacy=0x7ff2840cff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:28.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.670+0000 7ff2888d8700 1 -- 172.21.15.2:0/3962349984 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff28413e0e0 con 0x7ff284071b40 2023-11-26T07:15:28.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.670+0000 7ff2888d8700 1 --2- 172.21.15.2:0/3962349984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff284071b40 0x7ff284071fb0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7ff27c009e80 tx=0x7ff27c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc71c17daee836e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:28.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.670+0000 7ff282ffd700 1 -- 172.21.15.2:0/3962349984 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27c00e070 con 0x7ff284071b40 2023-11-26T07:15:28.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.670+0000 7ff282ffd700 1 -- 172.21.15.2:0/3962349984 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27c00b8d0 con 0x7ff284071b40 2023-11-26T07:15:28.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.670+0000 7ff282ffd700 1 -- 172.21.15.2:0/3962349984 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27c00bc80 con 0x7ff284071b40 2023-11-26T07:15:28.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.671+0000 7ff28a33b700 1 -- 172.21.15.2:0/3962349984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff284071b40 msgr2=0x7ff284071fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:28.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.671+0000 7ff28a33b700 1 --2- 172.21.15.2:0/3962349984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff284071b40 0x7ff284071fb0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7ff27c009e80 tx=0x7ff27c00b330 comp rx=0 tx=0).stop 2023-11-26T07:15:28.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.671+0000 7ff28a33b700 1 -- 172.21.15.2:0/3962349984 shutdown_connections 2023-11-26T07:15:28.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.671+0000 7ff28a33b700 1 --2- 172.21.15.2:0/3962349984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff284071b40 0x7ff284071fb0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:28.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.671+0000 7ff28a33b700 1 --2- 172.21.15.2:0/3962349984 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2840cf970 0x7ff2840cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:28.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.671+0000 7ff28a33b700 1 -- 172.21.15.2:0/3962349984 >> 172.21.15.2:0/3962349984 conn(0x7ff2840d0b10 msgr2=0x7ff2840d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:28.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.671+0000 7ff28a33b700 1 -- 172.21.15.2:0/3962349984 shutdown_connections 2023-11-26T07:15:28.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.671+0000 7ff28a33b700 1 -- 172.21.15.2:0/3962349984 wait complete. 2023-11-26T07:15:28.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.672+0000 7ff28a33b700 1 Processor -- start 2023-11-26T07:15:28.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.672+0000 7ff28a33b700 1 -- start start 2023-11-26T07:15:28.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.673+0000 7ff28a33b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff284071b40 0x7ff2840b56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:28.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.673+0000 7ff28a33b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2840cf970 0x7ff2840cc890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:28.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.673+0000 7ff28a33b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff28413dd00 0x7ff2840b3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:28.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.673+0000 7ff28a33b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2840b5d80 con 0x7ff28413dd00 2023-11-26T07:15:28.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.673+0000 7ff28a33b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2840b6060 con 0x7ff284071b40 2023-11-26T07:15:28.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.673+0000 7ff28a33b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2840b6340 con 0x7ff2840cf970 2023-11-26T07:15:28.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.673+0000 7ff2888d8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff28413dd00 0x7ff2840b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:28.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.673+0000 7ff2888d8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff28413dd00 0x7ff2840b3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43384/0 (socket says 172.21.15.2:43384) 2023-11-26T07:15:28.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.673+0000 7ff2888d8700 1 -- 172.21.15.2:0/4242836971 learned_addr learned my addr 172.21.15.2:0/4242836971 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:28.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.673+0000 7ff2837fe700 1 --2- 172.21.15.2:0/4242836971 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2840cf970 0x7ff2840cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:28.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.673+0000 7ff283fff700 1 --2- 172.21.15.2:0/4242836971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff284071b40 0x7ff2840b56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:28.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.673+0000 7ff2888d8700 1 -- 172.21.15.2:0/4242836971 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2840cf970 msgr2=0x7ff2840cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:28.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.673+0000 7ff2888d8700 1 --2- 172.21.15.2:0/4242836971 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2840cf970 0x7ff2840cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:28.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.673+0000 7ff2888d8700 1 -- 172.21.15.2:0/4242836971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff284071b40 msgr2=0x7ff2840b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:28.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.673+0000 7ff2888d8700 1 --2- 172.21.15.2:0/4242836971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff284071b40 0x7ff2840b56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:28.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.673+0000 7ff2888d8700 1 -- 172.21.15.2:0/4242836971 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff27c009b30 con 0x7ff28413dd00 2023-11-26T07:15:28.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.673+0000 7ff283fff700 1 --2- 172.21.15.2:0/4242836971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff284071b40 0x7ff2840b56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:15:28.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.674+0000 7ff2888d8700 1 --2- 172.21.15.2:0/4242836971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff28413dd00 0x7ff2840b3830 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7ff284073280 tx=0x7ff27c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:28.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.674+0000 7ff280ff9700 1 -- 172.21.15.2:0/4242836971 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27c0048b0 con 0x7ff28413dd00 2023-11-26T07:15:28.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.674+0000 7ff280ff9700 1 -- 172.21.15.2:0/4242836971 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27c0099b0 con 0x7ff28413dd00 2023-11-26T07:15:28.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.674+0000 7ff28a33b700 1 -- 172.21.15.2:0/4242836971 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2840b6620 con 0x7ff28413dd00 2023-11-26T07:15:28.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.674+0000 7ff280ff9700 1 -- 172.21.15.2:0/4242836971 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27c01c680 con 0x7ff28413dd00 2023-11-26T07:15:28.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.674+0000 7ff28a33b700 1 -- 172.21.15.2:0/4242836971 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff284158520 con 0x7ff28413dd00 2023-11-26T07:15:28.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.675+0000 7ff28a33b700 1 -- 172.21.15.2:0/4242836971 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff284075480 con 0x7ff28413dd00 2023-11-26T07:15:28.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.675+0000 7ff280ff9700 1 -- 172.21.15.2:0/4242836971 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 89741+0+0 (secure 0 0 0) 0x7ff27c01c7e0 con 0x7ff28413dd00 2023-11-26T07:15:28.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.676+0000 7ff280ff9700 1 --2- 172.21.15.2:0/4242836971 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff26406b470 0x7ff26406d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:28.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.676+0000 7ff280ff9700 1 -- 172.21.15.2:0/4242836971 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff27c08b7f0 con 0x7ff28413dd00 2023-11-26T07:15:28.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.676+0000 7ff283fff700 1 --2- 172.21.15.2:0/4242836971 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff26406b470 0x7ff26406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:28.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.676+0000 7ff283fff700 1 --2- 172.21.15.2:0/4242836971 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff26406b470 0x7ff26406d930 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff26c000f60 tx=0x7ff26c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:28.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.680+0000 7ff280ff9700 1 -- 172.21.15.2:0/4242836971 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff27c055f20 con 0x7ff28413dd00 2023-11-26T07:15:28.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.920+0000 7ff28a33b700 1 -- 172.21.15.2:0/4242836971 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol52070", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2840b61d0 con 0x7ff26406b470 2023-11-26T07:15:28.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.926+0000 7ff280ff9700 1 -- 172.21.15.2:0/4242836971 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+67 (secure 0 0 0) 0x7ff2840b61d0 con 0x7ff26406b470 2023-11-26T07:15:28.928 INFO:teuthology.orchestra.run.smithi002.stdout:/volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609 2023-11-26T07:15:28.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.928+0000 7ff28a33b700 1 -- 172.21.15.2:0/4242836971 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff26406b470 msgr2=0x7ff26406d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:28.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.928+0000 7ff28a33b700 1 --2- 172.21.15.2:0/4242836971 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff26406b470 0x7ff26406d930 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff26c000f60 tx=0x7ff26c009040 comp rx=0 tx=0).stop 2023-11-26T07:15:28.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.928+0000 7ff28a33b700 1 -- 172.21.15.2:0/4242836971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff28413dd00 msgr2=0x7ff2840b3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:28.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.928+0000 7ff28a33b700 1 --2- 172.21.15.2:0/4242836971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff28413dd00 0x7ff2840b3830 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7ff284073280 tx=0x7ff27c004ad0 comp rx=0 tx=0).stop 2023-11-26T07:15:28.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.928+0000 7ff28a33b700 1 -- 172.21.15.2:0/4242836971 shutdown_connections 2023-11-26T07:15:28.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.928+0000 7ff28a33b700 1 --2- 172.21.15.2:0/4242836971 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff26406b470 0x7ff26406d930 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:28.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.928+0000 7ff28a33b700 1 --2- 172.21.15.2:0/4242836971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff28413dd00 0x7ff2840b3830 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:28.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.928+0000 7ff28a33b700 1 --2- 172.21.15.2:0/4242836971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff284071b40 0x7ff2840b56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:28.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.928+0000 7ff28a33b700 1 --2- 172.21.15.2:0/4242836971 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2840cf970 0x7ff2840cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:28.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.928+0000 7ff28a33b700 1 -- 172.21.15.2:0/4242836971 >> 172.21.15.2:0/4242836971 conn(0x7ff2840d0b10 msgr2=0x7ff2840b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:28.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.929+0000 7ff28a33b700 1 -- 172.21.15.2:0/4242836971 shutdown_connections 2023-11-26T07:15:28.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:28.929+0000 7ff28a33b700 1 -- 172.21.15.2:0/4242836971 wait complete. 2023-11-26T07:15:28.942 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvol52070 with 200 files each 1MB size under directory volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609 2023-11-26T07:15:28.942 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:28.943 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:28.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:28.960 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:29.035 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:29.035 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:29.035 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127767 s, 82.1 MB/s 2023-11-26T07:15:29.036 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:29.036 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:29.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:29.094 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:29.162 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:29.162 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:29.162 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00993784 s, 106 MB/s 2023-11-26T07:15:29.163 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:29.163 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:29.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:29.222 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:29.289 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:29.289 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:29.289 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101022 s, 104 MB/s 2023-11-26T07:15:29.289 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:29.290 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:29.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:29.347 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:29.414 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:29.414 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:29.414 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00902497 s, 116 MB/s 2023-11-26T07:15:29.415 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:29.415 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:29.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:29.474 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103715 s, 101 MB/s 2023-11-26T07:15:29.543 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:29.543 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:29.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:29.601 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:29.670 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:29.670 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:29.670 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120413 s, 87.1 MB/s 2023-11-26T07:15:29.671 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:29.671 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:29.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:29.729 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:29.798 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:29.798 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:29.798 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106854 s, 98.1 MB/s 2023-11-26T07:15:29.798 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:29.798 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:29.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:29.855 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:29.925 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:29.925 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:29.925 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122097 s, 85.9 MB/s 2023-11-26T07:15:29.926 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:29.926 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:29.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:29.984 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:30.054 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:30.054 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:30.055 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124494 s, 84.2 MB/s 2023-11-26T07:15:30.055 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:30.055 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:30.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:30.112 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:30.181 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:30.181 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:30.181 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112945 s, 92.8 MB/s 2023-11-26T07:15:30.182 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:30.182 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:30.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:30.240 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.10 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:30.307 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:30.308 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:30.308 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00964624 s, 109 MB/s 2023-11-26T07:15:30.308 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:30.308 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:30.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:30.367 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.11 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:30.434 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:30.434 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:30.434 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00965421 s, 109 MB/s 2023-11-26T07:15:30.435 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:30.435 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:30.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:30.492 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.12 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:30.561 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:30.561 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:30.561 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115251 s, 91.0 MB/s 2023-11-26T07:15:30.562 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:30.562 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:30.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:30.620 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.13 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:30.687 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:30.687 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:30.687 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00900516 s, 116 MB/s 2023-11-26T07:15:30.688 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:30.688 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:30.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:30.745 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.14 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:30.812 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:30.812 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:30.812 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.009679 s, 108 MB/s 2023-11-26T07:15:30.813 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:30.813 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:30.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:30.872 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.15 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:30.938 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:30.938 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:30.939 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00874051 s, 120 MB/s 2023-11-26T07:15:30.939 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:30.940 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:30.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:30.997 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.16 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:31.064 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:31.064 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:31.064 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00986392 s, 106 MB/s 2023-11-26T07:15:31.065 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:31.065 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:31.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:31.123 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.17 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:31.189 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:31.189 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:31.189 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00846387 s, 124 MB/s 2023-11-26T07:15:31.190 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:31.190 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:31.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:31.248 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.18 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:31.319 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:31.319 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:31.319 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134648 s, 77.9 MB/s 2023-11-26T07:15:31.320 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:31.320 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:31.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:31.378 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.19 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:31.445 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:31.445 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:31.446 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114625 s, 91.5 MB/s 2023-11-26T07:15:31.446 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:31.447 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:31.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:31.504 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.20 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:31.572 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:31.573 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:31.573 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103354 s, 101 MB/s 2023-11-26T07:15:31.573 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:31.573 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:31.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:31.631 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.21 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:31.699 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:31.699 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:31.699 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107273 s, 97.7 MB/s 2023-11-26T07:15:31.700 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:31.700 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:31.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:31.758 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.22 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:31.825 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:31.825 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:31.826 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101122 s, 104 MB/s 2023-11-26T07:15:31.826 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:31.826 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:31.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:31.884 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.23 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:31.953 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:31.953 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:31.953 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110214 s, 95.1 MB/s 2023-11-26T07:15:31.954 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:31.954 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:32.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:32.012 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.24 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:32.079 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:32.079 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:32.079 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00988773 s, 106 MB/s 2023-11-26T07:15:32.080 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:32.080 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:32.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:32.137 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.25 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:32.203 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:32.203 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:32.203 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00853077 s, 123 MB/s 2023-11-26T07:15:32.204 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:32.204 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:32.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:32.262 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.26 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:32.329 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:32.329 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:32.329 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00933657 s, 112 MB/s 2023-11-26T07:15:32.330 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:32.330 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:32.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:32.387 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.27 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:32.453 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:32.453 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:32.453 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00853361 s, 123 MB/s 2023-11-26T07:15:32.454 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:32.454 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:32.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:32.512 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.28 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:32.578 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:32.578 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:32.578 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00802731 s, 131 MB/s 2023-11-26T07:15:32.579 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:32.579 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:32.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:32.637 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.29 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:32.703 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:32.704 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:32.704 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00922842 s, 114 MB/s 2023-11-26T07:15:32.705 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:32.705 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:32.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:32.762 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.30 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:32.832 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:32.832 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:32.832 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113723 s, 92.2 MB/s 2023-11-26T07:15:32.832 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:32.832 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:32.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:32.890 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.31 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:32.958 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:32.958 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:32.958 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0099695 s, 105 MB/s 2023-11-26T07:15:32.958 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:32.959 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:33.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:33.016 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.32 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:33.083 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:33.083 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:33.083 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00963747 s, 109 MB/s 2023-11-26T07:15:33.084 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:33.084 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:33.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:33.142 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.33 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:33.209 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:33.209 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:33.209 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00869666 s, 121 MB/s 2023-11-26T07:15:33.209 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:33.209 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:33.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:33.267 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.34 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:33.334 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:33.334 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:33.334 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00919445 s, 114 MB/s 2023-11-26T07:15:33.335 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:33.335 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:33.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:33.392 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.35 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:33.459 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:33.459 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:33.459 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00915318 s, 115 MB/s 2023-11-26T07:15:33.460 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:33.460 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:33.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:33.518 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.36 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:33.585 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:33.585 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:33.585 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00898325 s, 117 MB/s 2023-11-26T07:15:33.586 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:33.586 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:33.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:33.644 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.37 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:33.712 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:33.713 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:33.713 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101252 s, 104 MB/s 2023-11-26T07:15:33.713 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:33.713 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:33.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:33.771 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.38 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:33.836 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:33.836 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:33.836 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00874482 s, 120 MB/s 2023-11-26T07:15:33.837 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:33.837 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:33.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:33.896 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.39 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:33.963 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:33.963 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:33.963 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103319 s, 101 MB/s 2023-11-26T07:15:33.964 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:33.964 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:34.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:34.022 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.40 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:34.089 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:34.089 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:34.089 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00975936 s, 107 MB/s 2023-11-26T07:15:34.090 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:34.090 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:34.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:34.148 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.41 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:34.215 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:34.215 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:34.215 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00973977 s, 108 MB/s 2023-11-26T07:15:34.216 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:34.216 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:34.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:34.274 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.42 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:34.344 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:34.344 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:34.344 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119944 s, 87.4 MB/s 2023-11-26T07:15:34.345 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:34.345 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:34.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:34.402 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.43 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:34.467 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:34.467 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:34.467 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00838425 s, 125 MB/s 2023-11-26T07:15:34.468 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:34.468 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:34.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:34.526 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.44 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:34.592 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:34.592 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:34.592 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0083942 s, 125 MB/s 2023-11-26T07:15:34.593 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:34.593 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:34.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:34.651 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.45 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:34.717 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:34.717 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:34.717 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00796801 s, 132 MB/s 2023-11-26T07:15:34.717 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:34.717 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:34.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:34.775 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.46 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:34.843 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:34.843 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:34.843 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100644 s, 104 MB/s 2023-11-26T07:15:34.843 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:34.843 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:34.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:34.902 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.47 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:34.969 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:34.969 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:34.969 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106649 s, 98.3 MB/s 2023-11-26T07:15:34.970 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:34.970 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:35.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:35.028 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.48 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:35.095 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:35.095 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:35.096 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00985989 s, 106 MB/s 2023-11-26T07:15:35.096 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:35.097 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:35.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:35.154 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.49 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:35.223 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:35.223 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:35.223 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103292 s, 102 MB/s 2023-11-26T07:15:35.223 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:35.223 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:35.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:35.280 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.50 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:35.347 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:35.347 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:35.347 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00945566 s, 111 MB/s 2023-11-26T07:15:35.348 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:35.348 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:35.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:35.407 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.51 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:35.473 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:35.473 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:35.474 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00969039 s, 108 MB/s 2023-11-26T07:15:35.474 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:35.474 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:35.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:35.532 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.52 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:35.601 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:35.601 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:35.601 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111702 s, 93.9 MB/s 2023-11-26T07:15:35.602 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:35.602 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:35.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:35.660 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.53 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:35.728 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:35.728 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:35.728 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00947942 s, 111 MB/s 2023-11-26T07:15:35.728 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:35.728 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:35.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:35.785 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.54 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:35.854 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:35.855 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:35.855 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113772 s, 92.2 MB/s 2023-11-26T07:15:35.855 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:35.855 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:35.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:35.915 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.55 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:35.981 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:35.981 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:35.981 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00835383 s, 126 MB/s 2023-11-26T07:15:35.982 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:35.982 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:36.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:36.041 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.56 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:36.108 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:36.108 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:36.108 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00916972 s, 114 MB/s 2023-11-26T07:15:36.108 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:36.109 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:36.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:36.167 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.57 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:36.234 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:36.234 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:36.234 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00976041 s, 107 MB/s 2023-11-26T07:15:36.235 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:36.235 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:36.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:36.292 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.58 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:36.359 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:36.359 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:36.359 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00971836 s, 108 MB/s 2023-11-26T07:15:36.360 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:36.361 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:36.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:36.419 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.59 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:36.486 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:36.486 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:36.486 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101263 s, 104 MB/s 2023-11-26T07:15:36.487 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:36.487 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:36.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:36.545 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.60 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:36.612 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:36.612 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:36.612 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0089701 s, 117 MB/s 2023-11-26T07:15:36.613 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:36.613 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:36.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:36.672 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.61 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:36.738 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:36.738 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:36.738 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00915413 s, 115 MB/s 2023-11-26T07:15:36.740 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:36.740 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:36.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:36.797 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.62 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:36.867 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:36.867 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:36.867 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117408 s, 89.3 MB/s 2023-11-26T07:15:36.867 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:36.867 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:36.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:36.925 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.63 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:36.993 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:36.993 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:36.994 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109107 s, 96.1 MB/s 2023-11-26T07:15:36.994 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:36.995 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:37.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:37.052 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.64 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:37.120 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:37.121 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:37.121 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00865859 s, 121 MB/s 2023-11-26T07:15:37.121 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:37.121 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:37.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:37.176 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.65 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:37.244 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:37.244 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:37.244 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100318 s, 105 MB/s 2023-11-26T07:15:37.245 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:37.245 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:37.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:37.304 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.66 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:37.371 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:37.371 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:37.371 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101428 s, 103 MB/s 2023-11-26T07:15:37.372 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:37.372 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:37.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:37.429 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.67 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:37.496 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:37.496 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:37.496 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100044 s, 105 MB/s 2023-11-26T07:15:37.497 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:37.497 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:37.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:37.555 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.68 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:37.621 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:37.621 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:37.621 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00803441 s, 131 MB/s 2023-11-26T07:15:37.622 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:37.622 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:37.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:37.680 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.69 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:37.747 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:37.747 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:37.747 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00917359 s, 114 MB/s 2023-11-26T07:15:37.748 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:37.748 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:37.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:37.806 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.70 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:37.876 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:37.877 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:37.877 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124942 s, 83.9 MB/s 2023-11-26T07:15:37.877 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:37.878 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:37.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:37.936 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.71 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:38.003 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:38.003 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:38.003 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00931587 s, 113 MB/s 2023-11-26T07:15:38.003 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:38.003 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:38.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:38.060 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.72 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:38.128 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:38.128 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:38.128 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103563 s, 101 MB/s 2023-11-26T07:15:38.129 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:38.129 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:38.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:38.187 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.73 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:38.255 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:38.255 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:38.255 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100225 s, 105 MB/s 2023-11-26T07:15:38.256 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:38.256 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:38.256 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:15:38.299 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:15:38.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:38.314 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.74 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:38.379 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:38.380 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:38.380 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00834929 s, 126 MB/s 2023-11-26T07:15:38.380 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:38.381 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:38.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:38.438 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.75 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:38.506 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:38.506 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:38.506 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00970559 s, 108 MB/s 2023-11-26T07:15:38.507 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:38.507 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:38.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:38.566 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.76 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:38.637 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:38.637 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:38.637 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111953 s, 93.7 MB/s 2023-11-26T07:15:38.637 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:38.637 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:38.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:38.695 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.77 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:38.763 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:38.764 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:38.764 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00996184 s, 105 MB/s 2023-11-26T07:15:38.764 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:38.764 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:38.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:38.821 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.78 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:38.889 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:38.889 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:38.889 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0097299 s, 108 MB/s 2023-11-26T07:15:38.890 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:38.890 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:38.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:38.948 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.79 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:39.016 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:39.016 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:39.016 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104294 s, 101 MB/s 2023-11-26T07:15:39.017 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:39.017 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:39.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:39.075 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.80 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:39.143 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:39.143 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:39.143 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100294 s, 105 MB/s 2023-11-26T07:15:39.145 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:39.145 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:39.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:39.202 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.81 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:39.270 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:39.271 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:39.271 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0099355 s, 106 MB/s 2023-11-26T07:15:39.271 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:39.271 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:39.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:39.329 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.82 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:39.395 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:39.396 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:39.396 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010027 s, 105 MB/s 2023-11-26T07:15:39.397 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:39.397 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:39.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:39.454 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.83 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:39.520 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:39.520 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:39.520 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00827627 s, 127 MB/s 2023-11-26T07:15:39.521 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:39.521 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:39.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:39.579 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.84 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:39.647 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:39.647 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:39.648 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00945257 s, 111 MB/s 2023-11-26T07:15:39.648 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:39.648 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:39.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:39.705 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.85 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:39.774 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:39.774 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:39.775 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011467 s, 91.4 MB/s 2023-11-26T07:15:39.776 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:39.776 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:39.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:39.833 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.86 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:39.901 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:39.901 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:39.901 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954788 s, 110 MB/s 2023-11-26T07:15:39.902 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:39.902 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:39.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:39.959 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.87 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:40.026 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:40.026 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:40.026 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00925077 s, 113 MB/s 2023-11-26T07:15:40.027 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:40.027 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:40.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:40.086 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.88 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:40.153 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:40.153 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:40.153 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101565 s, 103 MB/s 2023-11-26T07:15:40.154 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:40.154 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:40.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:40.212 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.89 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:40.280 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:40.281 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:40.281 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0098627 s, 106 MB/s 2023-11-26T07:15:40.281 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:40.281 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:40.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:40.338 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.90 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:40.407 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:40.407 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:40.407 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01108 s, 94.6 MB/s 2023-11-26T07:15:40.408 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:40.408 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:40.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:40.466 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.91 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:40.534 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:40.534 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:40.534 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102097 s, 103 MB/s 2023-11-26T07:15:40.535 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:40.535 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:40.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:40.593 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.92 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:40.660 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:40.660 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:40.660 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00965275 s, 109 MB/s 2023-11-26T07:15:40.661 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:40.662 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:40.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:40.719 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.93 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:40.786 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:40.786 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:40.786 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00923786 s, 114 MB/s 2023-11-26T07:15:40.787 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:40.787 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:40.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:40.845 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.94 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:40.912 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:40.912 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:40.912 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00936218 s, 112 MB/s 2023-11-26T07:15:40.913 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:40.913 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:40.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:40.971 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.95 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:41.037 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:41.038 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:41.038 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00816852 s, 128 MB/s 2023-11-26T07:15:41.038 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:41.038 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:41.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:41.095 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.96 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:41.162 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:41.162 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:41.162 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00903127 s, 116 MB/s 2023-11-26T07:15:41.163 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:41.163 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:41.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:41.221 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.97 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:41.288 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:41.288 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:41.288 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00847676 s, 124 MB/s 2023-11-26T07:15:41.289 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:41.289 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:41.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:41.346 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.98 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:41.413 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:41.413 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:41.413 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00935077 s, 112 MB/s 2023-11-26T07:15:41.414 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:41.415 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:41.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:41.472 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.99 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:41.542 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:41.542 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:41.542 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119311 s, 87.9 MB/s 2023-11-26T07:15:41.543 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:41.543 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:41.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:41.600 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.100 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:41.667 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:41.667 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:41.667 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00828398 s, 127 MB/s 2023-11-26T07:15:41.668 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:41.668 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:41.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:41.726 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.101 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:41.793 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:41.794 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:41.794 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00996222 s, 105 MB/s 2023-11-26T07:15:41.794 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:41.794 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:41.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:41.851 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.102 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:41.919 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:41.919 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:41.919 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100203 s, 105 MB/s 2023-11-26T07:15:41.920 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:41.920 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:41.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:41.978 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.103 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:42.046 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:42.046 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:42.046 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00946684 s, 111 MB/s 2023-11-26T07:15:42.046 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:42.046 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:42.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:42.103 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.104 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:42.170 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:42.171 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:42.171 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0091952 s, 114 MB/s 2023-11-26T07:15:42.171 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:42.171 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:42.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:42.228 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.105 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:42.294 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:42.294 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:42.294 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00842875 s, 124 MB/s 2023-11-26T07:15:42.295 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:42.295 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:42.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:42.352 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.106 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:42.418 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:42.418 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:42.418 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00800826 s, 131 MB/s 2023-11-26T07:15:42.419 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:42.419 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:42.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:42.476 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.107 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:42.544 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:42.544 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:42.545 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100813 s, 104 MB/s 2023-11-26T07:15:42.545 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:42.545 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:42.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:42.602 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.108 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:42.670 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:42.670 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:42.670 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103074 s, 102 MB/s 2023-11-26T07:15:42.671 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:42.671 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:42.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:42.731 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.109 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:42.798 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:42.798 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:42.798 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0094748 s, 111 MB/s 2023-11-26T07:15:42.798 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:42.798 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:42.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:42.856 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.110 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:42.924 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:42.924 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:42.924 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010357 s, 101 MB/s 2023-11-26T07:15:42.925 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:42.925 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:42.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:42.982 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.111 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:43.049 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:43.049 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:43.049 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00922329 s, 114 MB/s 2023-11-26T07:15:43.050 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:43.050 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:43.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:43.107 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.112 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:43.175 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:43.175 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:43.175 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00976514 s, 107 MB/s 2023-11-26T07:15:43.175 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:43.175 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:43.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:43.233 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.113 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:43.299 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:43.300 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:43.300 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00997775 s, 105 MB/s 2023-11-26T07:15:43.301 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:43.301 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:43.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:43.358 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.114 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:43.425 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:43.425 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:43.425 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00922644 s, 114 MB/s 2023-11-26T07:15:43.426 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:43.426 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:43.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:43.483 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.115 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:43.549 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:43.550 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:43.550 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00917627 s, 114 MB/s 2023-11-26T07:15:43.550 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:43.551 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:43.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:43.608 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.116 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:43.677 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:43.677 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:43.678 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113448 s, 92.4 MB/s 2023-11-26T07:15:43.678 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:43.679 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:43.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:43.736 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.117 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:43.802 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:43.802 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:43.802 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00899362 s, 117 MB/s 2023-11-26T07:15:43.802 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:43.803 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:43.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:43.861 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.118 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:43.927 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:43.927 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:43.927 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0092173 s, 114 MB/s 2023-11-26T07:15:43.928 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:43.928 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:43.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:43.986 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.119 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:44.055 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:44.055 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:44.055 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112786 s, 93.0 MB/s 2023-11-26T07:15:44.055 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:44.055 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:44.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:44.113 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.120 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:44.181 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:44.181 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:44.181 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101522 s, 103 MB/s 2023-11-26T07:15:44.181 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:44.182 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:44.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:44.239 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.121 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:44.307 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:44.307 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:44.307 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00978347 s, 107 MB/s 2023-11-26T07:15:44.307 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:44.308 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:44.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:44.365 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.122 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:44.433 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:44.433 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:44.433 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00996793 s, 105 MB/s 2023-11-26T07:15:44.434 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:44.434 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:44.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:44.492 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.123 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:44.558 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:44.558 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:44.558 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00908365 s, 115 MB/s 2023-11-26T07:15:44.559 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:44.559 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:44.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:44.616 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.124 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:44.682 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:44.682 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:44.682 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0079524 s, 132 MB/s 2023-11-26T07:15:44.683 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:44.683 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:44.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:44.741 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.125 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:44.811 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:44.811 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:44.811 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116886 s, 89.7 MB/s 2023-11-26T07:15:44.812 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:44.812 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:44.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:44.869 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.126 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:44.940 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:44.940 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:44.940 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113745 s, 92.2 MB/s 2023-11-26T07:15:44.940 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:44.940 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:44.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:44.997 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.127 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:45.063 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:45.063 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:45.063 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00866711 s, 121 MB/s 2023-11-26T07:15:45.064 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:45.064 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:45.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:45.122 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.128 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:45.190 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:45.190 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:45.190 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010125 s, 104 MB/s 2023-11-26T07:15:45.190 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:45.190 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:45.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:45.248 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.129 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:45.315 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:45.315 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:45.315 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00901326 s, 116 MB/s 2023-11-26T07:15:45.316 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:45.316 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:45.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:45.374 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.130 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:45.442 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:45.442 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:45.442 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00961106 s, 109 MB/s 2023-11-26T07:15:45.442 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:45.442 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:45.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:45.500 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.131 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:45.567 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:45.567 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:45.567 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00941251 s, 111 MB/s 2023-11-26T07:15:45.568 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:45.568 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:45.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:45.626 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.132 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:45.694 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:45.694 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:45.694 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100342 s, 105 MB/s 2023-11-26T07:15:45.695 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:45.695 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:45.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:45.753 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.133 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:45.823 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:45.823 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:45.823 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119198 s, 88.0 MB/s 2023-11-26T07:15:45.823 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:45.823 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:45.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:45.881 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.134 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:45.951 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:45.951 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:45.951 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011574 s, 90.6 MB/s 2023-11-26T07:15:45.951 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:45.951 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:46.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:46.008 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.135 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:46.074 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:46.074 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:46.074 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00882619 s, 119 MB/s 2023-11-26T07:15:46.075 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:46.075 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:46.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:46.133 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.136 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:46.199 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:46.199 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:46.199 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00869027 s, 121 MB/s 2023-11-26T07:15:46.200 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:46.200 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:46.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:46.259 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.137 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:46.325 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:46.325 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:46.325 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00963673 s, 109 MB/s 2023-11-26T07:15:46.326 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:46.326 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:46.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:46.384 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.138 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:46.452 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:46.452 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:46.452 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00932895 s, 112 MB/s 2023-11-26T07:15:46.452 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:46.452 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:46.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:46.510 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.139 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:46.577 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:46.577 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:46.577 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00904347 s, 116 MB/s 2023-11-26T07:15:46.578 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:46.578 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:46.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:46.635 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.140 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:46.703 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:46.703 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:46.703 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00936241 s, 112 MB/s 2023-11-26T07:15:46.704 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:46.704 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:46.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:46.761 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.141 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114073 s, 91.9 MB/s 2023-11-26T07:15:46.831 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:46.831 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:46.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:46.888 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.142 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:46.958 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:46.958 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:46.958 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117838 s, 89.0 MB/s 2023-11-26T07:15:46.958 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:46.959 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:47.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:47.016 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.143 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:47.084 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:47.084 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:47.084 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010342 s, 101 MB/s 2023-11-26T07:15:47.084 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:47.085 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:47.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:47.142 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.144 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:47.211 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:47.211 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:47.211 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107531 s, 97.5 MB/s 2023-11-26T07:15:47.211 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:47.211 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:47.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:47.268 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.145 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:47.333 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:47.333 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:47.334 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00942322 s, 111 MB/s 2023-11-26T07:15:47.334 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:47.335 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:47.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:47.393 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.146 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:47.459 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:47.460 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:47.460 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00989032 s, 106 MB/s 2023-11-26T07:15:47.461 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:47.461 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:47.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:47.518 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.147 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:47.585 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:47.585 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:47.585 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00965161 s, 109 MB/s 2023-11-26T07:15:47.586 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:47.586 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:47.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:47.645 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.148 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:47.711 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:47.711 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:47.712 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00945153 s, 111 MB/s 2023-11-26T07:15:47.712 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:47.713 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:47.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:47.770 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.149 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:47.836 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:47.837 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:47.837 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00902267 s, 116 MB/s 2023-11-26T07:15:47.837 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:47.838 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:47.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:47.895 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.150 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:47.964 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:47.964 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:47.964 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115957 s, 90.4 MB/s 2023-11-26T07:15:47.965 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:47.965 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:48.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:48.023 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.151 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:48.091 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:48.091 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:48.091 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00980553 s, 107 MB/s 2023-11-26T07:15:48.091 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:48.091 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:48.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:48.149 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.152 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:48.216 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:48.216 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:48.216 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00918978 s, 114 MB/s 2023-11-26T07:15:48.217 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:48.217 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:48.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:48.275 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.153 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:48.341 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:48.341 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:48.341 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00941735 s, 111 MB/s 2023-11-26T07:15:48.342 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:48.342 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:48.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:48.399 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.154 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:48.467 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:48.467 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:48.467 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102124 s, 103 MB/s 2023-11-26T07:15:48.468 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:48.468 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:48.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:48.525 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.155 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:48.594 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:48.595 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:48.595 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120456 s, 87.1 MB/s 2023-11-26T07:15:48.596 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:48.596 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:48.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:48.654 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.156 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:48.723 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:48.723 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:48.723 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118524 s, 88.5 MB/s 2023-11-26T07:15:48.724 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:48.724 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:48.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:48.783 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.157 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:48.850 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:48.850 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:48.850 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102521 s, 102 MB/s 2023-11-26T07:15:48.851 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:48.851 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:48.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:48.908 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.158 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:48.974 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:48.974 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:48.974 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00862344 s, 122 MB/s 2023-11-26T07:15:48.975 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:48.975 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:49.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:49.033 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.159 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:49.100 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:49.101 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:49.101 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00947062 s, 111 MB/s 2023-11-26T07:15:49.101 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:49.101 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:49.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:49.158 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.160 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:49.226 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:49.227 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:49.227 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102935 s, 102 MB/s 2023-11-26T07:15:49.227 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:49.227 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:49.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:49.284 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.161 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:49.353 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:49.353 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:49.353 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114466 s, 91.6 MB/s 2023-11-26T07:15:49.354 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:49.354 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:49.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:49.413 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.162 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:49.479 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:49.479 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:49.479 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00959556 s, 109 MB/s 2023-11-26T07:15:49.480 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:49.480 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:49.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:49.539 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.163 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:49.608 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:49.609 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:49.609 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121162 s, 86.5 MB/s 2023-11-26T07:15:49.609 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:49.609 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:49.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:49.666 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.164 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:49.734 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:49.735 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:49.735 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101012 s, 104 MB/s 2023-11-26T07:15:49.735 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:49.735 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:49.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:49.793 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.165 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:49.859 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:49.859 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:49.859 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0094097 s, 111 MB/s 2023-11-26T07:15:49.860 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:49.860 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:49.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:49.918 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.166 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:49.986 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:49.986 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:49.986 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00968719 s, 108 MB/s 2023-11-26T07:15:49.987 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:49.987 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:50.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:50.044 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.167 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:50.110 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:50.110 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:50.110 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00871506 s, 120 MB/s 2023-11-26T07:15:50.111 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:50.111 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:50.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:50.169 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.168 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:50.237 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:50.237 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:50.238 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112246 s, 93.4 MB/s 2023-11-26T07:15:50.238 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:50.239 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:50.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:50.297 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.169 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:50.364 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:50.364 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:50.364 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0096838 s, 108 MB/s 2023-11-26T07:15:50.364 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:50.364 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:50.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:50.423 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.170 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:50.488 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:50.488 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:50.488 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00827899 s, 127 MB/s 2023-11-26T07:15:50.489 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:50.489 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:50.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:50.548 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.171 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:50.614 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:50.614 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:50.614 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00984327 s, 107 MB/s 2023-11-26T07:15:50.615 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:50.615 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:50.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:50.674 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.172 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:50.742 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:50.743 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:50.743 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115707 s, 90.6 MB/s 2023-11-26T07:15:50.744 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:50.744 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:50.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:50.801 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.173 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:50.867 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:50.867 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:50.867 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00907864 s, 115 MB/s 2023-11-26T07:15:50.868 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:50.868 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:50.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:50.926 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.174 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:50.995 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:50.995 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:50.995 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102981 s, 102 MB/s 2023-11-26T07:15:50.995 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:50.995 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:51.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:51.053 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.175 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:51.119 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:51.120 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:51.120 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00984146 s, 107 MB/s 2023-11-26T07:15:51.120 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:51.121 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:51.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:51.178 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.176 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:51.246 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:51.246 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:51.246 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101249 s, 104 MB/s 2023-11-26T07:15:51.247 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:51.247 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:51.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:51.305 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.177 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:51.372 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:51.372 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:51.372 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00979524 s, 107 MB/s 2023-11-26T07:15:51.372 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:51.372 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:51.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:51.430 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.178 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:51.495 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:51.496 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:51.496 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00804492 s, 130 MB/s 2023-11-26T07:15:51.497 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:51.497 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:51.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:51.554 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.179 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:51.621 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:51.621 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:51.621 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00865349 s, 121 MB/s 2023-11-26T07:15:51.622 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:51.622 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:51.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:51.681 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.180 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:51.751 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:51.751 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:51.751 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120589 s, 87.0 MB/s 2023-11-26T07:15:51.751 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:51.751 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:51.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:51.808 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.181 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:51.875 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:51.875 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:51.875 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00950754 s, 110 MB/s 2023-11-26T07:15:51.876 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:51.876 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:51.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:51.934 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.182 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:52.002 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:52.002 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:52.002 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00993876 s, 106 MB/s 2023-11-26T07:15:52.002 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:52.003 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:52.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:52.060 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.183 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:52.126 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:52.127 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:52.127 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00930427 s, 113 MB/s 2023-11-26T07:15:52.127 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:52.128 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:52.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:52.186 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.184 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:52.251 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:52.251 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:52.252 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00877683 s, 119 MB/s 2023-11-26T07:15:52.252 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:52.252 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:52.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:52.311 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.185 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:52.379 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:52.379 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:52.379 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0094479 s, 111 MB/s 2023-11-26T07:15:52.379 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:52.379 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:52.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:52.436 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.186 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:52.502 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:52.502 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:52.502 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00803963 s, 130 MB/s 2023-11-26T07:15:52.503 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:52.503 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:52.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:52.572 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.187 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:52.625 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:52.626 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:52.626 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00813541 s, 129 MB/s 2023-11-26T07:15:52.627 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:52.627 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:52.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:52.684 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.188 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:52.752 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:52.752 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:52.752 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00989064 s, 106 MB/s 2023-11-26T07:15:52.753 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:52.753 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:52.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:52.811 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.189 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:52.877 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:52.877 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:52.878 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00966745 s, 108 MB/s 2023-11-26T07:15:52.878 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:52.878 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:52.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:52.936 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.190 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:53.002 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:53.002 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:53.002 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00857055 s, 122 MB/s 2023-11-26T07:15:53.003 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:53.003 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:53.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:53.061 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.191 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:53.128 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:53.128 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:53.128 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0092598 s, 113 MB/s 2023-11-26T07:15:53.129 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:53.129 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:53.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:53.187 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.192 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:53.255 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:53.255 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:53.255 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103082 s, 102 MB/s 2023-11-26T07:15:53.256 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:53.256 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:53.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:53.314 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.193 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:53.380 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:53.380 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:53.380 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00827696 s, 127 MB/s 2023-11-26T07:15:53.381 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:53.381 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:53.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:53.439 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.194 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:53.506 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:53.506 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:53.506 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100571 s, 104 MB/s 2023-11-26T07:15:53.507 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:53.507 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:53.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:53.565 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.195 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:53.631 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:53.631 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:53.631 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00829376 s, 126 MB/s 2023-11-26T07:15:53.632 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:53.632 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:53.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:53.689 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.196 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:53.755 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:53.755 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:53.755 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00807903 s, 130 MB/s 2023-11-26T07:15:53.756 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:53.756 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:53.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:53.813 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.197 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:53.881 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:53.881 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:53.881 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00958955 s, 109 MB/s 2023-11-26T07:15:53.881 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:53.881 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:53.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:53.938 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.198 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:54.006 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:54.006 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:54.006 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00937909 s, 112 MB/s 2023-11-26T07:15:54.006 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:15:54.007 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:15:54.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:15:54.064 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol52070/4ed53523-8cca-4dfc-9b71-22067d598609/subvolume_file.199 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:15:54.131 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:15:54.131 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:15:54.131 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00912182 s, 115 MB/s 2023-11-26T07:15:54.131 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs subvol52070 subvol_snap97620 2023-11-26T07:15:54.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.299+0000 7f53e1700700 1 Processor -- start 2023-11-26T07:15:54.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.299+0000 7f53e1700700 1 -- start start 2023-11-26T07:15:54.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.300+0000 7f53e1700700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f53dc15dd30 0x7f53dc15e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:54.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.300+0000 7f53e1700700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53dc0d22b0 con 0x7f53dc0cea30 2023-11-26T07:15:54.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.300+0000 7f53e1700700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53dc15e650 con 0x7f53dc0d2490 2023-11-26T07:15:54.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.300+0000 7f53e1700700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53dc0cef10 con 0x7f53dc15dd30 2023-11-26T07:15:54.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.300+0000 7f53da7fc700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f53dc0cea30 0x7f53dc0d1ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34614/0 (socket says 172.21.15.2:34614) 2023-11-26T07:15:54.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.300+0000 7f53da7fc700 1 -- 172.21.15.2:0/1461537617 learned_addr learned my addr 172.21.15.2:0/1461537617 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:15:54.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.300+0000 7f53daffd700 1 --2- 172.21.15.2:0/1461537617 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f53dc15dd30 0x7f53dc15e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:54.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.300+0000 7f53d9ffb700 1 -- 172.21.15.2:0/1461537617 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 359982030 0 0) 0x7f53dc0d22b0 con 0x7f53dc0cea30 2023-11-26T07:15:54.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.300+0000 7f53d9ffb700 1 -- 172.21.15.2:0/1461537617 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53c40035b0 con 0x7f53dc0cea30 2023-11-26T07:15:54.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.301+0000 7f53d9ffb700 1 -- 172.21.15.2:0/1461537617 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2228201503 0 0) 0x7f53dc15e650 con 0x7f53dc0d2490 2023-11-26T07:15:54.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.301+0000 7f53d9ffb700 1 -- 172.21.15.2:0/1461537617 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53dc0d22b0 con 0x7f53dc0d2490 2023-11-26T07:15:54.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.301+0000 7f53d9ffb700 1 -- 172.21.15.2:0/1461537617 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 679623966 0 0) 0x7f53c40035b0 con 0x7f53dc0cea30 2023-11-26T07:15:54.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.301+0000 7f53d9ffb700 1 -- 172.21.15.2:0/1461537617 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f53dc15dd30 msgr2=0x7f53dc15e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:54.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.301+0000 7f53d9ffb700 1 --2- 172.21.15.2:0/1461537617 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f53dc15dd30 0x7f53dc15e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:54.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.301+0000 7f53d9ffb700 1 -- 172.21.15.2:0/1461537617 >> v1:172.21.15.192:6789/0 conn(0x7f53dc0d2490 legacy=0x7f53dc0b4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:54.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.301+0000 7f53d9ffb700 1 -- 172.21.15.2:0/1461537617 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53dc0cf1f0 con 0x7f53dc0cea30 2023-11-26T07:15:54.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.301+0000 7f53d9ffb700 1 -- 172.21.15.2:0/1461537617 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f53cc001670 con 0x7f53dc0cea30 2023-11-26T07:15:54.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.301+0000 7f53d9ffb700 1 -- 172.21.15.2:0/1461537617 >> v1:172.21.15.2:6789/0 conn(0x7f53dc0cea30 legacy=0x7f53dc0d1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:54.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.301+0000 7f53d9ffb700 1 --2- 172.21.15.2:0/1461537617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53c4003bc0 0x7f53c4003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:54.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.301+0000 7f53d9ffb700 1 --2- 172.21.15.2:0/1461537617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53c4004850 0x7f53c4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:54.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.301+0000 7f53d9ffb700 1 --2- 172.21.15.2:0/1461537617 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f53dc15dd30 0x7f53c4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:54.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.301+0000 7f53d9ffb700 1 -- 172.21.15.2:0/1461537617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53dc0cef10 con 0x7f53c4004850 2023-11-26T07:15:54.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.301+0000 7f53d9ffb700 1 -- 172.21.15.2:0/1461537617 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c400bac0 con 0x7f53c4003bc0 2023-11-26T07:15:54.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.301+0000 7f53d9ffb700 1 -- 172.21.15.2:0/1461537617 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c400bc50 con 0x7f53dc15dd30 2023-11-26T07:15:54.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.301+0000 7f53da7fc700 1 --2- 172.21.15.2:0/1461537617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53c4004850 0x7f53c4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:54.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.301+0000 7f53daffd700 1 --2- 172.21.15.2:0/1461537617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53c4003bc0 0x7f53c4003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:54.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.301+0000 7f53db7fe700 1 --2- 172.21.15.2:0/1461537617 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f53dc15dd30 0x7f53c4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:54.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.301+0000 7f53da7fc700 1 -- 172.21.15.2:0/1461537617 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f53dc15dd30 msgr2=0x7f53c4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:54.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.301+0000 7f53da7fc700 1 --2- 172.21.15.2:0/1461537617 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f53dc15dd30 0x7f53c4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:54.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.301+0000 7f53da7fc700 1 -- 172.21.15.2:0/1461537617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53c4003bc0 msgr2=0x7f53c4003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:54.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.301+0000 7f53da7fc700 1 --2- 172.21.15.2:0/1461537617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53c4003bc0 0x7f53c4003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:54.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.301+0000 7f53da7fc700 1 -- 172.21.15.2:0/1461537617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c40035b0 con 0x7f53c4004850 2023-11-26T07:15:54.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.301+0000 7f53da7fc700 1 --2- 172.21.15.2:0/1461537617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53c4004850 0x7f53c4004cd0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f53cc00c210 tx=0x7f53c4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44c692587e4ae43a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:54.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.301+0000 7f53d9ffb700 1 -- 172.21.15.2:0/1461537617 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc00cd10 con 0x7f53c4004850 2023-11-26T07:15:54.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.302+0000 7f53d9ffb700 1 -- 172.21.15.2:0/1461537617 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53cc00ce90 con 0x7f53c4004850 2023-11-26T07:15:54.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.302+0000 7f53d9ffb700 1 -- 172.21.15.2:0/1461537617 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc005ba0 con 0x7f53c4004850 2023-11-26T07:15:54.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.302+0000 7f53e1700700 1 -- 172.21.15.2:0/1461537617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53c4004850 msgr2=0x7f53c4004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:54.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.302+0000 7f53e1700700 1 --2- 172.21.15.2:0/1461537617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53c4004850 0x7f53c4004cd0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f53cc00c210 tx=0x7f53c4005880 comp rx=0 tx=0).stop 2023-11-26T07:15:54.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.302+0000 7f53db7fe700 1 -- 172.21.15.2:0/1461537617 reap_dead start 2023-11-26T07:15:54.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.302+0000 7f53e1700700 1 -- 172.21.15.2:0/1461537617 shutdown_connections 2023-11-26T07:15:54.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.302+0000 7f53e1700700 1 -- 172.21.15.2:0/1461537617 >> 172.21.15.2:0/1461537617 conn(0x7f53dc09d110 msgr2=0x7f53dc0d3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:54.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.302+0000 7f53e1700700 1 -- 172.21.15.2:0/1461537617 shutdown_connections 2023-11-26T07:15:54.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.302+0000 7f53e1700700 1 -- 172.21.15.2:0/1461537617 wait complete. 2023-11-26T07:15:54.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.304+0000 7f53e1700700 1 Processor -- start 2023-11-26T07:15:54.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.304+0000 7f53e1700700 1 -- start start 2023-11-26T07:15:54.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.304+0000 7f53e1700700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53c4004850 0x7f53dc158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:54.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.304+0000 7f53e1700700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f53dc0cdd30 0x7f53dc148c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:54.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.304+0000 7f53e1700700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53dc149350 0x7f53dc14b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:54.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.304+0000 7f53e1700700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53dc0c94e0 con 0x7f53c4004850 2023-11-26T07:15:54.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.304+0000 7f53e1700700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53dc0ce220 con 0x7f53dc149350 2023-11-26T07:15:54.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.304+0000 7f53e1700700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53dc0c8b40 con 0x7f53dc0cdd30 2023-11-26T07:15:54.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.304+0000 7f53daffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53c4004850 0x7f53dc158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:54.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.304+0000 7f53daffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53c4004850 0x7f53dc158b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43414/0 (socket says 172.21.15.2:43414) 2023-11-26T07:15:54.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.304+0000 7f53daffd700 1 -- 172.21.15.2:0/3611611222 learned_addr learned my addr 172.21.15.2:0/3611611222 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:54.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.305+0000 7f53db7fe700 1 --2- 172.21.15.2:0/3611611222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53dc149350 0x7f53dc14b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:54.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.305+0000 7f53da7fc700 1 --2- 172.21.15.2:0/3611611222 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f53dc0cdd30 0x7f53dc148c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:54.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.305+0000 7f53daffd700 1 -- 172.21.15.2:0/3611611222 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f53dc0cdd30 msgr2=0x7f53dc148c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:54.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.305+0000 7f53daffd700 1 --2- 172.21.15.2:0/3611611222 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f53dc0cdd30 0x7f53dc148c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:54.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.305+0000 7f53daffd700 1 -- 172.21.15.2:0/3611611222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53dc149350 msgr2=0x7f53dc14b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:54.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.305+0000 7f53daffd700 1 --2- 172.21.15.2:0/3611611222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53dc149350 0x7f53dc14b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:54.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.305+0000 7f53daffd700 1 -- 172.21.15.2:0/3611611222 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53dc0c8e20 con 0x7f53c4004850 2023-11-26T07:15:54.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.305+0000 7f53da7fc700 1 --2- 172.21.15.2:0/3611611222 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f53dc0cdd30 0x7f53dc148c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:15:54.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.305+0000 7f53daffd700 1 --2- 172.21.15.2:0/3611611222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53c4004850 0x7f53dc158b40 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f53d0011aa0 tx=0x7f53d0011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:54.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.305+0000 7f53c37fe700 1 -- 172.21.15.2:0/3611611222 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d000f940 con 0x7f53c4004850 2023-11-26T07:15:54.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.305+0000 7f53c37fe700 1 -- 172.21.15.2:0/3611611222 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d000faa0 con 0x7f53c4004850 2023-11-26T07:15:54.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.305+0000 7f53e1700700 1 -- 172.21.15.2:0/3611611222 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53dc0c9100 con 0x7f53c4004850 2023-11-26T07:15:54.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.305+0000 7f53c37fe700 1 -- 172.21.15.2:0/3611611222 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d000fe50 con 0x7f53c4004850 2023-11-26T07:15:54.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.305+0000 7f53e1700700 1 -- 172.21.15.2:0/3611611222 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53dc149800 con 0x7f53c4004850 2023-11-26T07:15:54.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.306+0000 7f53e1700700 1 -- 172.21.15.2:0/3611611222 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53dc067f60 con 0x7f53c4004850 2023-11-26T07:15:54.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.307+0000 7f53c37fe700 1 -- 172.21.15.2:0/3611611222 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 89792+0+0 (secure 0 0 0) 0x7f53d0014440 con 0x7f53c4004850 2023-11-26T07:15:54.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.307+0000 7f53c37fe700 1 --2- 172.21.15.2:0/3611611222 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f53c806b500 0x7f53c806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:54.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.307+0000 7f53c37fe700 1 -- 172.21.15.2:0/3611611222 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f53d008a860 con 0x7f53c4004850 2023-11-26T07:15:54.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.307+0000 7f53da7fc700 1 --2- 172.21.15.2:0/3611611222 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f53c806b500 0x7f53c806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:54.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.308+0000 7f53da7fc700 1 --2- 172.21.15.2:0/3611611222 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f53c806b500 0x7f53c806d9c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f53cc0018b0 tx=0x7f53cc00a000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:54.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.312+0000 7f53c37fe700 1 -- 172.21.15.2:0/3611611222 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f53d0055140 con 0x7f53c4004850 2023-11-26T07:15:54.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.555+0000 7f53e1700700 1 -- 172.21.15.2:0/3611611222 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "subvol52070", "snap_name": "subvol_snap97620", "target": ["mon-mgr", ""]}) v1 -- 0x7f53dc0c8cb0 con 0x7f53c806b500 2023-11-26T07:15:54.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.575+0000 7f53c37fe700 1 -- 172.21.15.2:0/3611611222 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f53dc0c8cb0 con 0x7f53c806b500 2023-11-26T07:15:54.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.577+0000 7f53e1700700 1 -- 172.21.15.2:0/3611611222 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f53c806b500 msgr2=0x7f53c806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:54.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.577+0000 7f53e1700700 1 --2- 172.21.15.2:0/3611611222 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f53c806b500 0x7f53c806d9c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f53cc0018b0 tx=0x7f53cc00a000 comp rx=0 tx=0).stop 2023-11-26T07:15:54.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.577+0000 7f53e1700700 1 -- 172.21.15.2:0/3611611222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53c4004850 msgr2=0x7f53dc158b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:54.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.577+0000 7f53e1700700 1 --2- 172.21.15.2:0/3611611222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53c4004850 0x7f53dc158b40 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f53d0011aa0 tx=0x7f53d0011db0 comp rx=0 tx=0).stop 2023-11-26T07:15:54.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.577+0000 7f53e1700700 1 -- 172.21.15.2:0/3611611222 shutdown_connections 2023-11-26T07:15:54.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.577+0000 7f53e1700700 1 --2- 172.21.15.2:0/3611611222 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f53c806b500 0x7f53c806d9c0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:54.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.577+0000 7f53e1700700 1 --2- 172.21.15.2:0/3611611222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53dc149350 0x7f53dc14b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:54.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.577+0000 7f53e1700700 1 --2- 172.21.15.2:0/3611611222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53c4004850 0x7f53dc158b40 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:54.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.577+0000 7f53e1700700 1 --2- 172.21.15.2:0/3611611222 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f53dc0cdd30 0x7f53dc148c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:54.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.577+0000 7f53e1700700 1 -- 172.21.15.2:0/3611611222 >> 172.21.15.2:0/3611611222 conn(0x7f53dc09d110 msgr2=0x7f53dc0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:54.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.577+0000 7f53e1700700 1 -- 172.21.15.2:0/3611611222 shutdown_connections 2023-11-26T07:15:54.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.577+0000 7f53e1700700 1 -- 172.21.15.2:0/3611611222 wait complete. 2023-11-26T07:15:54.595 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/snapshot_clone_delay 5 2023-11-26T07:15:54.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.720+0000 7f46fdd58700 1 Processor -- start 2023-11-26T07:15:54.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.720+0000 7f46fdd58700 1 -- start start 2023-11-26T07:15:54.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.721+0000 7f46fdd58700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46f8143ae0 0x7f46f80b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:54.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.721+0000 7f46fdd58700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f46f81440f0 0x7f46f8071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:54.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.721+0000 7f46fdd58700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46f8143ec0 con 0x7f46f80720f0 2023-11-26T07:15:54.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.721+0000 7f46fdd58700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46f80b40a0 con 0x7f46f81440f0 2023-11-26T07:15:54.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.721+0000 7f46fdd58700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46f8072580 con 0x7f46f8143ae0 2023-11-26T07:15:54.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.721+0000 7f46f6ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f46f81440f0 0x7f46f8071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:54.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.721+0000 7f46f6ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f46f81440f0 0x7f46f8071bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43422/0 (socket says 172.21.15.2:43422) 2023-11-26T07:15:54.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.721+0000 7f46f6ffd700 1 -- 172.21.15.2:0/1270684531 learned_addr learned my addr 172.21.15.2:0/1270684531 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:54.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.721+0000 7f46f77fe700 1 --2- 172.21.15.2:0/1270684531 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46f8143ae0 0x7f46f80b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:54.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.721+0000 7f46f6ffd700 1 -- 172.21.15.2:0/1270684531 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46f8143ae0 msgr2=0x7f46f80b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:54.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.721+0000 7f46f6ffd700 1 --2- 172.21.15.2:0/1270684531 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46f8143ae0 0x7f46f80b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:54.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.721+0000 7f46f6ffd700 1 -- 172.21.15.2:0/1270684531 >> v1:172.21.15.192:6789/0 conn(0x7f46f80720f0 legacy=0x7f46f815e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:54.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.721+0000 7f46f6ffd700 1 -- 172.21.15.2:0/1270684531 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f80b3ae0 con 0x7f46f81440f0 2023-11-26T07:15:54.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.721+0000 7f46f6ffd700 1 --2- 172.21.15.2:0/1270684531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46f81440f0 0x7f46f8071bb0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f46ec00bb90 tx=0x7f46ec00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac597233174dd9b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:54.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.722+0000 7f46f67fc700 1 -- 172.21.15.2:0/1270684531 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ec00dd50 con 0x7f46f81440f0 2023-11-26T07:15:54.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.722+0000 7f46f67fc700 1 -- 172.21.15.2:0/1270684531 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46ec010470 con 0x7f46f81440f0 2023-11-26T07:15:54.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.722+0000 7f46f67fc700 1 -- 172.21.15.2:0/1270684531 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ec010800 con 0x7f46f81440f0 2023-11-26T07:15:54.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.722+0000 7f46fdd58700 1 -- 172.21.15.2:0/1270684531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46f81440f0 msgr2=0x7f46f8071bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:54.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.722+0000 7f46fdd58700 1 --2- 172.21.15.2:0/1270684531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46f81440f0 0x7f46f8071bb0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f46ec00bb90 tx=0x7f46ec00bea0 comp rx=0 tx=0).stop 2023-11-26T07:15:54.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.722+0000 7f46fdd58700 1 -- 172.21.15.2:0/1270684531 shutdown_connections 2023-11-26T07:15:54.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.722+0000 7f46fdd58700 1 --2- 172.21.15.2:0/1270684531 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46f8143ae0 0x7f46f80b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:54.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.722+0000 7f46fdd58700 1 --2- 172.21.15.2:0/1270684531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46f81440f0 0x7f46f8071bb0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:54.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.722+0000 7f46fdd58700 1 -- 172.21.15.2:0/1270684531 >> 172.21.15.2:0/1270684531 conn(0x7f46f80b2740 msgr2=0x7f46f80b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:54.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.722+0000 7f46fdd58700 1 -- 172.21.15.2:0/1270684531 shutdown_connections 2023-11-26T07:15:54.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.722+0000 7f46fdd58700 1 -- 172.21.15.2:0/1270684531 wait complete. 2023-11-26T07:15:54.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.723+0000 7f46fdd58700 1 Processor -- start 2023-11-26T07:15:54.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.724+0000 7f46fdd58700 1 -- start start 2023-11-26T07:15:54.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.724+0000 7f46fdd58700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46f80720f0 0x7f46f8157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:54.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.724+0000 7f46fdd58700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46f8143ae0 0x7f46f8159600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:54.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.724+0000 7f46fdd58700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46f81440f0 0x7f46f8159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:54.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.724+0000 7f46fdd58700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f80cb5c0 con 0x7f46f8143ae0 2023-11-26T07:15:54.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.724+0000 7f46fdd58700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f80cad20 con 0x7f46f81440f0 2023-11-26T07:15:54.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.724+0000 7f46fdd58700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46f8158350 con 0x7f46f80720f0 2023-11-26T07:15:54.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.724+0000 7f46f6ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46f8143ae0 0x7f46f8159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:54.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.724+0000 7f46f6ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46f8143ae0 0x7f46f8159600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43430/0 (socket says 172.21.15.2:43430) 2023-11-26T07:15:54.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.724+0000 7f46f6ffd700 1 -- 172.21.15.2:0/1500864234 learned_addr learned my addr 172.21.15.2:0/1500864234 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:54.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.725+0000 7f46f7fff700 1 --2- 172.21.15.2:0/1500864234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46f81440f0 0x7f46f8159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:54.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.725+0000 7f46f77fe700 1 --2- 172.21.15.2:0/1500864234 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46f80720f0 0x7f46f8157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:54.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.725+0000 7f46f6ffd700 1 -- 172.21.15.2:0/1500864234 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46f80720f0 msgr2=0x7f46f8157e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:54.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.725+0000 7f46f6ffd700 1 --2- 172.21.15.2:0/1500864234 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46f80720f0 0x7f46f8157e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:54.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.725+0000 7f46f6ffd700 1 -- 172.21.15.2:0/1500864234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46f81440f0 msgr2=0x7f46f8159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:54.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.725+0000 7f46f6ffd700 1 --2- 172.21.15.2:0/1500864234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46f81440f0 0x7f46f8159b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:54.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.725+0000 7f46f6ffd700 1 -- 172.21.15.2:0/1500864234 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ec00b7f0 con 0x7f46f8143ae0 2023-11-26T07:15:54.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.725+0000 7f46f7fff700 1 --2- 172.21.15.2:0/1500864234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46f81440f0 0x7f46f8159b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:15:54.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.725+0000 7f46f77fe700 1 --2- 172.21.15.2:0/1500864234 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46f80720f0 0x7f46f8157e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:15:54.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.725+0000 7f46f6ffd700 1 --2- 172.21.15.2:0/1500864234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46f8143ae0 0x7f46f8159600 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f46f80d1bd0 tx=0x7f46ec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:54.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.725+0000 7f46dffff700 1 -- 172.21.15.2:0/1500864234 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ec003bf0 con 0x7f46f8143ae0 2023-11-26T07:15:54.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.725+0000 7f46dffff700 1 -- 172.21.15.2:0/1500864234 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46ec003d50 con 0x7f46f8143ae0 2023-11-26T07:15:54.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.725+0000 7f46fdd58700 1 -- 172.21.15.2:0/1500864234 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46f80cb7a0 con 0x7f46f8143ae0 2023-11-26T07:15:54.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.725+0000 7f46dffff700 1 -- 172.21.15.2:0/1500864234 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ec010820 con 0x7f46f8143ae0 2023-11-26T07:15:54.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.725+0000 7f46fdd58700 1 -- 172.21.15.2:0/1500864234 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46f80cbd60 con 0x7f46f8143ae0 2023-11-26T07:15:54.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.726+0000 7f46fdd58700 1 -- 172.21.15.2:0/1500864234 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46f8075480 con 0x7f46f8143ae0 2023-11-26T07:15:54.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.726+0000 7f46dffff700 1 -- 172.21.15.2:0/1500864234 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 89792+0+0 (secure 0 0 0) 0x7f46ec019400 con 0x7f46f8143ae0 2023-11-26T07:15:54.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.727+0000 7f46dffff700 1 --2- 172.21.15.2:0/1500864234 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f46e406b500 0x7f46e406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:54.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.727+0000 7f46dffff700 1 -- 172.21.15.2:0/1500864234 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f46ec08b5b0 con 0x7f46f8143ae0 2023-11-26T07:15:54.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.727+0000 7f46f77fe700 1 --2- 172.21.15.2:0/1500864234 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f46e406b500 0x7f46e406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:54.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.728+0000 7f46f77fe700 1 --2- 172.21.15.2:0/1500864234 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f46e406b500 0x7f46e406d9c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f46f815a970 tx=0x7f46e8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:54.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.732+0000 7f46dffff700 1 -- 172.21.15.2:0/1500864234 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f46ec055da0 con 0x7f46f8143ae0 2023-11-26T07:15:54.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.935+0000 7f46fdd58700 1 -- 172.21.15.2:0/1500864234 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}] v 0) v1 -- 0x7f46f8144830 con 0x7f46f8143ae0 2023-11-26T07:15:54.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.938+0000 7f46dffff700 1 -- 172.21.15.2:0/1500864234 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}]=0 v19)=0 v19) v1 ==== 130+0+0 (secure 0 0 0) 0x7f46ec0593c0 con 0x7f46f8143ae0 2023-11-26T07:15:54.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.940+0000 7f46fdd58700 1 -- 172.21.15.2:0/1500864234 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f46e406b500 msgr2=0x7f46e406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:54.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.941+0000 7f46fdd58700 1 --2- 172.21.15.2:0/1500864234 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f46e406b500 0x7f46e406d9c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f46f815a970 tx=0x7f46e8008040 comp rx=0 tx=0).stop 2023-11-26T07:15:54.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.941+0000 7f46fdd58700 1 -- 172.21.15.2:0/1500864234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46f8143ae0 msgr2=0x7f46f8159600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:54.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.941+0000 7f46fdd58700 1 --2- 172.21.15.2:0/1500864234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46f8143ae0 0x7f46f8159600 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f46f80d1bd0 tx=0x7f46ec004750 comp rx=0 tx=0).stop 2023-11-26T07:15:54.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.941+0000 7f46fdd58700 1 -- 172.21.15.2:0/1500864234 shutdown_connections 2023-11-26T07:15:54.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.941+0000 7f46fdd58700 1 --2- 172.21.15.2:0/1500864234 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f46e406b500 0x7f46e406d9c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:54.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.941+0000 7f46fdd58700 1 --2- 172.21.15.2:0/1500864234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46f81440f0 0x7f46f8159b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:54.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.941+0000 7f46fdd58700 1 --2- 172.21.15.2:0/1500864234 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46f80720f0 0x7f46f8157e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:54.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.941+0000 7f46fdd58700 1 --2- 172.21.15.2:0/1500864234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46f8143ae0 0x7f46f8159600 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:54.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.941+0000 7f46fdd58700 1 -- 172.21.15.2:0/1500864234 >> 172.21.15.2:0/1500864234 conn(0x7f46f80b2740 msgr2=0x7f46f80cf1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:54.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.941+0000 7f46fdd58700 1 -- 172.21.15.2:0/1500864234 shutdown_connections 2023-11-26T07:15:54.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:54.941+0000 7f46fdd58700 1 -- 172.21.15.2:0/1500864234 wait complete. 2023-11-26T07:15:54.954 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:15:54.951+0000 7f8da92ac700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:15:54.954 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:15:54.951+0000 7f8da92ac700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:15:54.954 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:15:54.951+0000 7f8da92ac700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:15:54.954 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:15:54.951+0000 7f8da92ac700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:15:54.954 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:15:54.951+0000 7f8da92ac700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:15:54.955 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs subvol52070 subvol_snap97620 subvol_clone34300 2023-11-26T07:15:55.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.085+0000 7fc3566c2700 1 Processor -- start 2023-11-26T07:15:55.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.085+0000 7fc3566c2700 1 -- start start 2023-11-26T07:15:55.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.086+0000 7fc3566c2700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc3500b28a0 0x7fc3500b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:55.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.086+0000 7fc3566c2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3500d0ff0 0x7fc3500cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:55.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.086+0000 7fc3566c2700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc35006caf0 con 0x7fc3500b21d0 2023-11-26T07:15:55.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.086+0000 7fc3566c2700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3500cf250 con 0x7fc3500b28a0 2023-11-26T07:15:55.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.086+0000 7fc3566c2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc35006cdb0 con 0x7fc3500d0ff0 2023-11-26T07:15:55.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.086+0000 7fc34f7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc3500b28a0 0x7fc3500b2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:55.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.086+0000 7fc34f7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc3500b28a0 0x7fc3500b2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43438/0 (socket says 172.21.15.2:43438) 2023-11-26T07:15:55.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.086+0000 7fc34f7fe700 1 -- 172.21.15.2:0/186702929 learned_addr learned my addr 172.21.15.2:0/186702929 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:55.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.086+0000 7fc354c5f700 1 --2- 172.21.15.2:0/186702929 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3500d0ff0 0x7fc3500cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:55.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.086+0000 7fc34f7fe700 1 -- 172.21.15.2:0/186702929 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3500d0ff0 msgr2=0x7fc3500cebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:55.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.086+0000 7fc34f7fe700 1 --2- 172.21.15.2:0/186702929 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3500d0ff0 0x7fc3500cebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:55.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.086+0000 7fc34f7fe700 1 -- 172.21.15.2:0/186702929 >> v1:172.21.15.192:6789/0 conn(0x7fc3500b21d0 legacy=0x7fc3500ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:15:55.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.086+0000 7fc34f7fe700 1 -- 172.21.15.2:0/186702929 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc35006d090 con 0x7fc3500b28a0 2023-11-26T07:15:55.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.087+0000 7fc34f7fe700 1 --2- 172.21.15.2:0/186702929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3500b28a0 0x7fc3500b2dd0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fc3380098f0 tx=0x7fc338009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ba691cf3ac3b27f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:55.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.087+0000 7fc34effd700 1 -- 172.21.15.2:0/186702929 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc338004230 con 0x7fc3500b28a0 2023-11-26T07:15:55.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.087+0000 7fc34effd700 1 -- 172.21.15.2:0/186702929 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc338004390 con 0x7fc3500b28a0 2023-11-26T07:15:55.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.087+0000 7fc34effd700 1 -- 172.21.15.2:0/186702929 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3380036a0 con 0x7fc3500b28a0 2023-11-26T07:15:55.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.087+0000 7fc3566c2700 1 -- 172.21.15.2:0/186702929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3500b28a0 msgr2=0x7fc3500b2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:55.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.087+0000 7fc3566c2700 1 --2- 172.21.15.2:0/186702929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3500b28a0 0x7fc3500b2dd0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fc3380098f0 tx=0x7fc338009c00 comp rx=0 tx=0).stop 2023-11-26T07:15:55.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.087+0000 7fc3566c2700 1 -- 172.21.15.2:0/186702929 shutdown_connections 2023-11-26T07:15:55.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.087+0000 7fc3566c2700 1 --2- 172.21.15.2:0/186702929 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3500d0ff0 0x7fc3500cebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:55.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.087+0000 7fc3566c2700 1 --2- 172.21.15.2:0/186702929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3500b28a0 0x7fc3500b2dd0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:55.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.087+0000 7fc3566c2700 1 -- 172.21.15.2:0/186702929 >> 172.21.15.2:0/186702929 conn(0x7fc3500b3800 msgr2=0x7fc3500b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:55.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.087+0000 7fc3566c2700 1 -- 172.21.15.2:0/186702929 shutdown_connections 2023-11-26T07:15:55.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.087+0000 7fc3566c2700 1 -- 172.21.15.2:0/186702929 wait complete. 2023-11-26T07:15:55.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.088+0000 7fc3566c2700 1 Processor -- start 2023-11-26T07:15:55.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.089+0000 7fc3566c2700 1 -- start start 2023-11-26T07:15:55.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.089+0000 7fc3566c2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3500b21d0 0x7fc3500b15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:55.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.089+0000 7fc3566c2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc3500d0ff0 0x7fc3500aea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:55.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.089+0000 7fc3566c2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3500cb2a0 0x7fc3500cb710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:55.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.089+0000 7fc3566c2700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc350159c60 con 0x7fc3500b21d0 2023-11-26T07:15:55.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.089+0000 7fc3566c2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3500c9710 con 0x7fc3500d0ff0 2023-11-26T07:15:55.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.089+0000 7fc3566c2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3500b4a40 con 0x7fc3500cb2a0 2023-11-26T07:15:55.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.089+0000 7fc34ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3500b21d0 0x7fc3500b15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:55.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.090+0000 7fc34ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3500b21d0 0x7fc3500b15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43442/0 (socket says 172.21.15.2:43442) 2023-11-26T07:15:55.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.090+0000 7fc34ffff700 1 -- 172.21.15.2:0/2289638684 learned_addr learned my addr 172.21.15.2:0/2289638684 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:55.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.090+0000 7fc354c5f700 1 --2- 172.21.15.2:0/2289638684 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3500cb2a0 0x7fc3500cb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:55.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.090+0000 7fc34f7fe700 1 --2- 172.21.15.2:0/2289638684 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc3500d0ff0 0x7fc3500aea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:55.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.090+0000 7fc34ffff700 1 -- 172.21.15.2:0/2289638684 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3500cb2a0 msgr2=0x7fc3500cb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:55.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.090+0000 7fc34ffff700 1 --2- 172.21.15.2:0/2289638684 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3500cb2a0 0x7fc3500cb710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:55.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.090+0000 7fc34ffff700 1 -- 172.21.15.2:0/2289638684 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc3500d0ff0 msgr2=0x7fc3500aea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:55.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.090+0000 7fc34ffff700 1 --2- 172.21.15.2:0/2289638684 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc3500d0ff0 0x7fc3500aea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:55.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.090+0000 7fc34ffff700 1 -- 172.21.15.2:0/2289638684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc338009550 con 0x7fc3500b21d0 2023-11-26T07:15:55.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.090+0000 7fc34ffff700 1 --2- 172.21.15.2:0/2289638684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3500b21d0 0x7fc3500b15a0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fc34000c4d0 tx=0x7fc34000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:55.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.090+0000 7fc34cff9700 1 -- 172.21.15.2:0/2289638684 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc340011790 con 0x7fc3500b21d0 2023-11-26T07:15:55.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.090+0000 7fc34cff9700 1 -- 172.21.15.2:0/2289638684 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3400118f0 con 0x7fc3500b21d0 2023-11-26T07:15:55.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.090+0000 7fc3566c2700 1 -- 172.21.15.2:0/2289638684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3500cbc50 con 0x7fc3500b21d0 2023-11-26T07:15:55.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.090+0000 7fc34cff9700 1 -- 172.21.15.2:0/2289638684 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc340011ca0 con 0x7fc3500b21d0 2023-11-26T07:15:55.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.090+0000 7fc3566c2700 1 -- 172.21.15.2:0/2289638684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc35015abf0 con 0x7fc3500b21d0 2023-11-26T07:15:55.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.091+0000 7fc3566c2700 1 -- 172.21.15.2:0/2289638684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc350075480 con 0x7fc3500b21d0 2023-11-26T07:15:55.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.092+0000 7fc34cff9700 1 -- 172.21.15.2:0/2289638684 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 89792+0+0 (secure 0 0 0) 0x7fc34001c460 con 0x7fc3500b21d0 2023-11-26T07:15:55.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.092+0000 7fc34cff9700 1 --2- 172.21.15.2:0/2289638684 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc33006b500 0x7fc33006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:55.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.092+0000 7fc34cff9700 1 -- 172.21.15.2:0/2289638684 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc340089de0 con 0x7fc3500b21d0 2023-11-26T07:15:55.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.092+0000 7fc34f7fe700 1 --2- 172.21.15.2:0/2289638684 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc33006b500 0x7fc33006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:55.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.093+0000 7fc34f7fe700 1 --2- 172.21.15.2:0/2289638684 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc33006b500 0x7fc33006d9c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc338009130 tx=0x7fc338008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:55.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.096+0000 7fc34cff9700 1 -- 172.21.15.2:0/2289638684 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc3400545e0 con 0x7fc3500b21d0 2023-11-26T07:15:55.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.339+0000 7fc3566c2700 1 -- 172.21.15.2:0/2289638684 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "subvol52070", "snap_name": "subvol_snap97620", "target_sub_name": "subvol_clone34300", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3500cfac0 con 0x7fc33006b500 2023-11-26T07:15:55.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.403+0000 7fc34cff9700 1 -- 172.21.15.2:0/2289638684 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fc3500cfac0 con 0x7fc33006b500 2023-11-26T07:15:55.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.405+0000 7fc3566c2700 1 -- 172.21.15.2:0/2289638684 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc33006b500 msgr2=0x7fc33006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:55.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.405+0000 7fc3566c2700 1 --2- 172.21.15.2:0/2289638684 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc33006b500 0x7fc33006d9c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc338009130 tx=0x7fc338008030 comp rx=0 tx=0).stop 2023-11-26T07:15:55.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.405+0000 7fc3566c2700 1 -- 172.21.15.2:0/2289638684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3500b21d0 msgr2=0x7fc3500b15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:55.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.405+0000 7fc3566c2700 1 --2- 172.21.15.2:0/2289638684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3500b21d0 0x7fc3500b15a0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fc34000c4d0 tx=0x7fc34000c7e0 comp rx=0 tx=0).stop 2023-11-26T07:15:55.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.405+0000 7fc3566c2700 1 -- 172.21.15.2:0/2289638684 shutdown_connections 2023-11-26T07:15:55.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.405+0000 7fc3566c2700 1 --2- 172.21.15.2:0/2289638684 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc33006b500 0x7fc33006d9c0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:55.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.405+0000 7fc3566c2700 1 --2- 172.21.15.2:0/2289638684 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3500cb2a0 0x7fc3500cb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:55.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.405+0000 7fc3566c2700 1 --2- 172.21.15.2:0/2289638684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3500b21d0 0x7fc3500b15a0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:55.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.405+0000 7fc3566c2700 1 --2- 172.21.15.2:0/2289638684 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc3500d0ff0 0x7fc3500aea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:55.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.405+0000 7fc3566c2700 1 -- 172.21.15.2:0/2289638684 >> 172.21.15.2:0/2289638684 conn(0x7fc3500b3800 msgr2=0x7fc35006f050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:55.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.405+0000 7fc3566c2700 1 -- 172.21.15.2:0/2289638684 shutdown_connections 2023-11-26T07:15:55.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.405+0000 7fc3566c2700 1 -- 172.21.15.2:0/2289638684 wait complete. 2023-11-26T07:15:55.409 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:15:55.406+0000 7f8dabab1700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:15:55.409 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:15:55.406+0000 7f8dabab1700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:15:55.410 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:15:55.406+0000 7f8dabab1700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:15:55.410 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:15:55.406+0000 7f8dabab1700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:15:55.410 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:15:55.406+0000 7f8dabab1700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:15:55.421 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone34300 2023-11-26T07:15:55.423 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:15:55.420+0000 7f8dab2b0700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:15:55.423 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:15:55.420+0000 7f8dab2b0700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:15:55.423 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:15:55.420+0000 7f8dab2b0700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:15:55.423 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:15:55.420+0000 7f8dab2b0700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:15:55.423 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:15:55.420+0000 7f8dab2b0700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:15:55.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.546+0000 7fdc8abaf700 1 Processor -- start 2023-11-26T07:15:55.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.546+0000 7fdc8abaf700 1 -- start start 2023-11-26T07:15:55.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.547+0000 7fdc8abaf700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdc840b4150 0x7fdc8406de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:55.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.547+0000 7fdc8abaf700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc84071f50 con 0x7fdc840b5ab0 2023-11-26T07:15:55.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.547+0000 7fdc8abaf700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc84072230 con 0x7fdc8406b620 2023-11-26T07:15:55.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.547+0000 7fdc8abaf700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc84072510 con 0x7fdc840b4150 2023-11-26T07:15:55.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.547+0000 7fdc83fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdc840b4150 0x7fdc8406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:55.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.547+0000 7fdc8914c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fdc840b5ab0 0x7fdc8406e390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34664/0 (socket says 172.21.15.2:34664) 2023-11-26T07:15:55.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.547+0000 7fdc8914c700 1 -- 172.21.15.2:0/1378877517 learned_addr learned my addr 172.21.15.2:0/1378877517 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:15:55.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.548+0000 7fdc83fff700 1 -- 172.21.15.2:0/1378877517 >> v1:172.21.15.192:6789/0 conn(0x7fdc8406b620 legacy=0x7fdc840b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:55.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.548+0000 7fdc83fff700 1 -- 172.21.15.2:0/1378877517 >> v1:172.21.15.2:6789/0 conn(0x7fdc840b5ab0 legacy=0x7fdc8406e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:55.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.548+0000 7fdc837fe700 1 -- 172.21.15.2:0/1378877517 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2931990293 0 0) 0x7fdc84071f50 con 0x7fdc840b5ab0 2023-11-26T07:15:55.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.548+0000 7fdc83fff700 1 -- 172.21.15.2:0/1378877517 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc840727f0 con 0x7fdc840b4150 2023-11-26T07:15:55.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.548+0000 7fdc83fff700 1 --2- 172.21.15.2:0/1378877517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc840b4150 0x7fdc8406de50 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fdc70009840 tx=0x7fdc70009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3023e342c7abaf0c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:55.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.548+0000 7fdc837fe700 1 -- 172.21.15.2:0/1378877517 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc70011830 con 0x7fdc840b4150 2023-11-26T07:15:55.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.548+0000 7fdc837fe700 1 -- 172.21.15.2:0/1378877517 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc70011990 con 0x7fdc840b4150 2023-11-26T07:15:55.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.548+0000 7fdc837fe700 1 -- 172.21.15.2:0/1378877517 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc70011d20 con 0x7fdc840b4150 2023-11-26T07:15:55.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.549+0000 7fdc8abaf700 1 -- 172.21.15.2:0/1378877517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc840b4150 msgr2=0x7fdc8406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:55.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.549+0000 7fdc8abaf700 1 --2- 172.21.15.2:0/1378877517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc840b4150 0x7fdc8406de50 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fdc70009840 tx=0x7fdc70009b50 comp rx=0 tx=0).stop 2023-11-26T07:15:55.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.549+0000 7fdc8abaf700 1 -- 172.21.15.2:0/1378877517 shutdown_connections 2023-11-26T07:15:55.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.549+0000 7fdc8abaf700 1 --2- 172.21.15.2:0/1378877517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc840b4150 0x7fdc8406de50 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:55.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.549+0000 7fdc8abaf700 1 -- 172.21.15.2:0/1378877517 >> 172.21.15.2:0/1378877517 conn(0x7fdc840b2740 msgr2=0x7fdc840b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:15:55.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.549+0000 7fdc8abaf700 1 -- 172.21.15.2:0/1378877517 shutdown_connections 2023-11-26T07:15:55.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.549+0000 7fdc8abaf700 1 -- 172.21.15.2:0/1378877517 wait complete. 2023-11-26T07:15:55.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.550+0000 7fdc8abaf700 1 Processor -- start 2023-11-26T07:15:55.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.550+0000 7fdc8abaf700 1 -- start start 2023-11-26T07:15:55.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.551+0000 7fdc8abaf700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc8406b620 0x7fdc84145860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:55.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.551+0000 7fdc8abaf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc840b4150 0x7fdc840c7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:55.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.551+0000 7fdc8abaf700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc840b5ab0 0x7fdc8406eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:55.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.551+0000 7fdc8abaf700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc840c7f10 con 0x7fdc840b4150 2023-11-26T07:15:55.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.551+0000 7fdc8abaf700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc840c81f0 con 0x7fdc8406b620 2023-11-26T07:15:55.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.551+0000 7fdc8abaf700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc840c84d0 con 0x7fdc840b5ab0 2023-11-26T07:15:55.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.552+0000 7fdc83fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc840b4150 0x7fdc840c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:55.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.552+0000 7fdc83fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc840b4150 0x7fdc840c7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43456/0 (socket says 172.21.15.2:43456) 2023-11-26T07:15:55.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.552+0000 7fdc83fff700 1 -- 172.21.15.2:0/3861186800 learned_addr learned my addr 172.21.15.2:0/3861186800 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:15:55.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.552+0000 7fdc8894b700 1 --2- 172.21.15.2:0/3861186800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc8406b620 0x7fdc84145860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:55.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.552+0000 7fdc8914c700 1 --2- 172.21.15.2:0/3861186800 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc840b5ab0 0x7fdc8406eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:55.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.552+0000 7fdc83fff700 1 -- 172.21.15.2:0/3861186800 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc840b5ab0 msgr2=0x7fdc8406eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:55.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.552+0000 7fdc83fff700 1 --2- 172.21.15.2:0/3861186800 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc840b5ab0 0x7fdc8406eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:55.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.552+0000 7fdc83fff700 1 -- 172.21.15.2:0/3861186800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc8406b620 msgr2=0x7fdc84145860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:15:55.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.552+0000 7fdc83fff700 1 --2- 172.21.15.2:0/3861186800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc8406b620 0x7fdc84145860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:15:55.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.552+0000 7fdc83fff700 1 -- 172.21.15.2:0/3861186800 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc700094a0 con 0x7fdc840b4150 2023-11-26T07:15:55.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.552+0000 7fdc8914c700 1 --2- 172.21.15.2:0/3861186800 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc840b5ab0 0x7fdc8406eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:15:55.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.552+0000 7fdc8894b700 1 --2- 172.21.15.2:0/3861186800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc8406b620 0x7fdc84145860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:15:55.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.552+0000 7fdc83fff700 1 --2- 172.21.15.2:0/3861186800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc840b4150 0x7fdc840c7630 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fdc700090b0 tx=0x7fdc70004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:55.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.552+0000 7fdc817fa700 1 -- 172.21.15.2:0/3861186800 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7001a900 con 0x7fdc840b4150 2023-11-26T07:15:55.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.552+0000 7fdc817fa700 1 -- 172.21.15.2:0/3861186800 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc7001aa60 con 0x7fdc840b4150 2023-11-26T07:15:55.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.552+0000 7fdc8abaf700 1 -- 172.21.15.2:0/3861186800 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc840c87b0 con 0x7fdc840b4150 2023-11-26T07:15:55.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.552+0000 7fdc817fa700 1 -- 172.21.15.2:0/3861186800 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7001add0 con 0x7fdc840b4150 2023-11-26T07:15:55.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.552+0000 7fdc8abaf700 1 -- 172.21.15.2:0/3861186800 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc840c7b70 con 0x7fdc840b4150 2023-11-26T07:15:55.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.553+0000 7fdc8abaf700 1 -- 172.21.15.2:0/3861186800 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc840c8e00 con 0x7fdc840b4150 2023-11-26T07:15:55.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.554+0000 7fdc817fa700 1 -- 172.21.15.2:0/3861186800 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 89792+0+0 (secure 0 0 0) 0x7fdc70022070 con 0x7fdc840b4150 2023-11-26T07:15:55.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.554+0000 7fdc817fa700 1 --2- 172.21.15.2:0/3861186800 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fdc6806b500 0x7fdc6806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:15:55.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.554+0000 7fdc817fa700 1 -- 172.21.15.2:0/3861186800 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc7008b3a0 con 0x7fdc840b4150 2023-11-26T07:15:55.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.554+0000 7fdc8894b700 1 --2- 172.21.15.2:0/3861186800 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fdc6806b500 0x7fdc6806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:15:55.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.555+0000 7fdc8894b700 1 --2- 172.21.15.2:0/3861186800 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fdc6806b500 0x7fdc6806d9c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdc78000f60 tx=0x7fdc78009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:15:55.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.559+0000 7fdc817fa700 1 -- 172.21.15.2:0/3861186800 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdc70055c10 con 0x7fdc840b4150 2023-11-26T07:15:55.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:55.808+0000 7fdc8abaf700 1 -- 172.21.15.2:0/3861186800 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone34300", "target": ["mon-mgr", ""]}) v1 -- 0x7fdc840c7d00 con 0x7fdc6806b500 2023-11-26T07:15:56.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:15:56.399+0000 7fdc817fa700 1 -- 172.21.15.2:0/3861186800 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 14) v1 ==== 89945+0+0 (secure 0 0 0) 0x7fdc70055fe0 con 0x7fdc840b4150 2023-11-26T07:16:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:03.915+0000 7fdc817fa700 1 -- 172.21.15.2:0/3861186800 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fdc840c7d00 con 0x7fdc6806b500 2023-11-26T07:16:03.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:03.917+0000 7fdc8abaf700 1 -- 172.21.15.2:0/3861186800 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fdc6806b500 msgr2=0x7fdc6806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:03.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:03.917+0000 7fdc8abaf700 1 --2- 172.21.15.2:0/3861186800 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fdc6806b500 0x7fdc6806d9c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdc78000f60 tx=0x7fdc78009040 comp rx=0 tx=0).stop 2023-11-26T07:16:03.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:03.917+0000 7fdc8abaf700 1 -- 172.21.15.2:0/3861186800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc840b4150 msgr2=0x7fdc840c7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:03.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:03.917+0000 7fdc8abaf700 1 --2- 172.21.15.2:0/3861186800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc840b4150 0x7fdc840c7630 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fdc700090b0 tx=0x7fdc70004750 comp rx=0 tx=0).stop 2023-11-26T07:16:03.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:03.917+0000 7fdc8abaf700 1 -- 172.21.15.2:0/3861186800 shutdown_connections 2023-11-26T07:16:03.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:03.917+0000 7fdc8abaf700 1 --2- 172.21.15.2:0/3861186800 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fdc6806b500 0x7fdc6806d9c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:03.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:03.917+0000 7fdc8abaf700 1 --2- 172.21.15.2:0/3861186800 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc840b5ab0 0x7fdc8406eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:03.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:03.917+0000 7fdc8abaf700 1 --2- 172.21.15.2:0/3861186800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc8406b620 0x7fdc84145860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:03.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:03.917+0000 7fdc8abaf700 1 --2- 172.21.15.2:0/3861186800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc840b4150 0x7fdc840c7630 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:03.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:03.917+0000 7fdc8abaf700 1 -- 172.21.15.2:0/3861186800 >> 172.21.15.2:0/3861186800 conn(0x7fdc840b2740 msgr2=0x7fdc840ae960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:03.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:03.917+0000 7fdc8abaf700 1 -- 172.21.15.2:0/3861186800 shutdown_connections 2023-11-26T07:16:03.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:03.917+0000 7fdc8abaf700 1 -- 172.21.15.2:0/3861186800 wait complete. 2023-11-26T07:16:03.933 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone34300 2023-11-26T07:16:04.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.064+0000 7fc485992700 1 Processor -- start 2023-11-26T07:16:04.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.064+0000 7fc485992700 1 -- start start 2023-11-26T07:16:04.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.065+0000 7fc485992700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc4800d0c50 0x7fc4800d26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:04.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.065+0000 7fc485992700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4800d4e20 con 0x7fc4800d0870 2023-11-26T07:16:04.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.065+0000 7fc485992700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4800b5370 con 0x7fc4800d49f0 2023-11-26T07:16:04.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.065+0000 7fc485992700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4800d2f80 con 0x7fc4800d0c50 2023-11-26T07:16:04.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.065+0000 7fc47e7fc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc4800d0c50 0x7fc4800d26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:04.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.065+0000 7fc47effd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc4800d0870 0x7fc4800cf860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34674/0 (socket says 172.21.15.2:34674) 2023-11-26T07:16:04.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.065+0000 7fc47effd700 1 -- 172.21.15.2:0/4154815735 learned_addr learned my addr 172.21.15.2:0/4154815735 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:16:04.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.065+0000 7fc47e7fc700 1 -- 172.21.15.2:0/4154815735 >> v1:172.21.15.192:6789/0 conn(0x7fc4800d49f0 legacy=0x7fc4800b6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:04.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.065+0000 7fc47e7fc700 1 -- 172.21.15.2:0/4154815735 >> v1:172.21.15.2:6789/0 conn(0x7fc4800d0870 legacy=0x7fc4800cf860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:04.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.065+0000 7fc47e7fc700 1 -- 172.21.15.2:0/4154815735 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4800ceae0 con 0x7fc4800d0c50 2023-11-26T07:16:04.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.065+0000 7fc47dffb700 1 -- 172.21.15.2:0/4154815735 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3134023988 0 0) 0x7fc4800d4e20 con 0x7fc4800d0870 2023-11-26T07:16:04.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.066+0000 7fc47e7fc700 1 --2- 172.21.15.2:0/4154815735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4800d0c50 0x7fc4800d26c0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fc470009840 tx=0x7fc470009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42f365b9676a5dbf server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:04.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.066+0000 7fc47dffb700 1 -- 172.21.15.2:0/4154815735 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc470011830 con 0x7fc4800d0c50 2023-11-26T07:16:04.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.066+0000 7fc47dffb700 1 -- 172.21.15.2:0/4154815735 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc470011990 con 0x7fc4800d0c50 2023-11-26T07:16:04.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.066+0000 7fc47dffb700 1 -- 172.21.15.2:0/4154815735 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc470011d20 con 0x7fc4800d0c50 2023-11-26T07:16:04.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.066+0000 7fc485992700 1 -- 172.21.15.2:0/4154815735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4800d0c50 msgr2=0x7fc4800d26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:04.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.066+0000 7fc485992700 1 --2- 172.21.15.2:0/4154815735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4800d0c50 0x7fc4800d26c0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fc470009840 tx=0x7fc470009b50 comp rx=0 tx=0).stop 2023-11-26T07:16:04.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.066+0000 7fc485992700 1 -- 172.21.15.2:0/4154815735 shutdown_connections 2023-11-26T07:16:04.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.066+0000 7fc485992700 1 --2- 172.21.15.2:0/4154815735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4800d0c50 0x7fc4800d26c0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:04.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.066+0000 7fc485992700 1 -- 172.21.15.2:0/4154815735 >> 172.21.15.2:0/4154815735 conn(0x7fc4800d3ed0 msgr2=0x7fc4800d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:04.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.066+0000 7fc485992700 1 -- 172.21.15.2:0/4154815735 shutdown_connections 2023-11-26T07:16:04.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.066+0000 7fc485992700 1 -- 172.21.15.2:0/4154815735 wait complete. 2023-11-26T07:16:04.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.068+0000 7fc485992700 1 Processor -- start 2023-11-26T07:16:04.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.068+0000 7fc485992700 1 -- start start 2023-11-26T07:16:04.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.069+0000 7fc485992700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc4800d0870 0x7fc48006c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:04.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.069+0000 7fc485992700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4800d0c50 0x7fc48006cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:04.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.069+0000 7fc485992700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc4800d49f0 0x7fc4800c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:04.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.069+0000 7fc485992700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4800cff70 con 0x7fc4800d0c50 2023-11-26T07:16:04.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.069+0000 7fc485992700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4800b6670 con 0x7fc4800d49f0 2023-11-26T07:16:04.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.069+0000 7fc485992700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4800b9030 con 0x7fc4800d0870 2023-11-26T07:16:04.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.069+0000 7fc47e7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4800d0c50 0x7fc48006cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:04.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.069+0000 7fc47e7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4800d0c50 0x7fc48006cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43472/0 (socket says 172.21.15.2:43472) 2023-11-26T07:16:04.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.069+0000 7fc47e7fc700 1 -- 172.21.15.2:0/2278106948 learned_addr learned my addr 172.21.15.2:0/2278106948 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:04.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.069+0000 7fc47effd700 1 --2- 172.21.15.2:0/2278106948 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc4800d0870 0x7fc48006c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:04.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.069+0000 7fc47f7fe700 1 --2- 172.21.15.2:0/2278106948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc4800d49f0 0x7fc4800c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:04.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.069+0000 7fc47e7fc700 1 -- 172.21.15.2:0/2278106948 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc4800d0870 msgr2=0x7fc48006c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:04.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.069+0000 7fc47e7fc700 1 --2- 172.21.15.2:0/2278106948 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc4800d0870 0x7fc48006c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:04.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.069+0000 7fc47e7fc700 1 -- 172.21.15.2:0/2278106948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc4800d49f0 msgr2=0x7fc4800c97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:04.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.069+0000 7fc47e7fc700 1 --2- 172.21.15.2:0/2278106948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc4800d49f0 0x7fc4800c97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:04.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.069+0000 7fc47e7fc700 1 -- 172.21.15.2:0/2278106948 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4700094a0 con 0x7fc4800d0c50 2023-11-26T07:16:04.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.070+0000 7fc47f7fe700 1 --2- 172.21.15.2:0/2278106948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc4800d49f0 0x7fc4800c97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:16:04.075 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.070+0000 7fc47e7fc700 1 --2- 172.21.15.2:0/2278106948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4800d0c50 0x7fc48006cd30 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fc4700090b0 tx=0x7fc470004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:04.075 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.070+0000 7fc467fff700 1 -- 172.21.15.2:0/2278106948 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4700036a0 con 0x7fc4800d0c50 2023-11-26T07:16:04.075 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.070+0000 7fc467fff700 1 -- 172.21.15.2:0/2278106948 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47001f070 con 0x7fc4800d0c50 2023-11-26T07:16:04.075 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.070+0000 7fc485992700 1 -- 172.21.15.2:0/2278106948 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4800b5c60 con 0x7fc4800d0c50 2023-11-26T07:16:04.075 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.070+0000 7fc467fff700 1 -- 172.21.15.2:0/2278106948 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc470003a20 con 0x7fc4800d0c50 2023-11-26T07:16:04.075 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.070+0000 7fc485992700 1 -- 172.21.15.2:0/2278106948 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4800ca670 con 0x7fc4800d0c50 2023-11-26T07:16:04.075 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.071+0000 7fc465ffb700 1 -- 172.21.15.2:0/2278106948 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4580052e0 con 0x7fc4800d0c50 2023-11-26T07:16:04.075 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.071+0000 7fc467fff700 1 -- 172.21.15.2:0/2278106948 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 14) v1 ==== 89945+0+0 (secure 0 0 0) 0x7fc470003b80 con 0x7fc4800d0c50 2023-11-26T07:16:04.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.072+0000 7fc467fff700 1 --2- 172.21.15.2:0/2278106948 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc46c06b6b0 0x7fc46c06db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:04.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.072+0000 7fc467fff700 1 -- 172.21.15.2:0/2278106948 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc470021070 con 0x7fc4800d0c50 2023-11-26T07:16:04.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.072+0000 7fc47effd700 1 --2- 172.21.15.2:0/2278106948 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc46c06b6b0 0x7fc46c06db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:04.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.073+0000 7fc47effd700 1 --2- 172.21.15.2:0/2278106948 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc46c06b6b0 0x7fc46c06db70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc474007b10 tx=0x7fc474007a60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:04.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.076+0000 7fc467fff700 1 -- 172.21.15.2:0/2278106948 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc470056330 con 0x7fc4800d0c50 2023-11-26T07:16:04.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.320+0000 7fc465ffb700 1 -- 172.21.15.2:0/2278106948 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone34300", "target": ["mon-mgr", ""]}) v1 -- 0x7fc458000bb0 con 0x7fc46c06b6b0 2023-11-26T07:16:04.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.930+0000 7fc467fff700 1 -- 172.21.15.2:0/2278106948 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+264 (secure 0 0 0) 0x7fc458000bb0 con 0x7fc46c06b6b0 2023-11-26T07:16:04.932 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-26T07:16:04.932 INFO:teuthology.orchestra.run.smithi002.stdout: "status": { 2023-11-26T07:16:04.932 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "canceled", 2023-11-26T07:16:04.932 INFO:teuthology.orchestra.run.smithi002.stdout: "source": { 2023-11-26T07:16:04.932 INFO:teuthology.orchestra.run.smithi002.stdout: "volume": "cephfs", 2023-11-26T07:16:04.932 INFO:teuthology.orchestra.run.smithi002.stdout: "subvolume": "subvol52070", 2023-11-26T07:16:04.932 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot": "subvol_snap97620" 2023-11-26T07:16:04.932 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:16:04.932 INFO:teuthology.orchestra.run.smithi002.stdout: "failure": { 2023-11-26T07:16:04.933 INFO:teuthology.orchestra.run.smithi002.stdout: "errno": "4", 2023-11-26T07:16:04.933 INFO:teuthology.orchestra.run.smithi002.stdout: "error_msg": "user interrupted clone operation" 2023-11-26T07:16:04.933 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:16:04.933 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:16:04.933 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-26T07:16:04.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.932+0000 7fc465ffb700 1 -- 172.21.15.2:0/2278106948 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc46c06b6b0 msgr2=0x7fc46c06db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:04.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.932+0000 7fc465ffb700 1 --2- 172.21.15.2:0/2278106948 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc46c06b6b0 0x7fc46c06db70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc474007b10 tx=0x7fc474007a60 comp rx=0 tx=0).stop 2023-11-26T07:16:04.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.932+0000 7fc465ffb700 1 -- 172.21.15.2:0/2278106948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4800d0c50 msgr2=0x7fc48006cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:04.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.932+0000 7fc465ffb700 1 --2- 172.21.15.2:0/2278106948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4800d0c50 0x7fc48006cd30 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fc4700090b0 tx=0x7fc470004750 comp rx=0 tx=0).stop 2023-11-26T07:16:04.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.932+0000 7fc465ffb700 1 -- 172.21.15.2:0/2278106948 shutdown_connections 2023-11-26T07:16:04.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.932+0000 7fc465ffb700 1 --2- 172.21.15.2:0/2278106948 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc46c06b6b0 0x7fc46c06db70 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:04.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.932+0000 7fc465ffb700 1 --2- 172.21.15.2:0/2278106948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc4800d49f0 0x7fc4800c97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:04.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.932+0000 7fc465ffb700 1 --2- 172.21.15.2:0/2278106948 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc4800d0870 0x7fc48006c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:04.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.932+0000 7fc465ffb700 1 --2- 172.21.15.2:0/2278106948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4800d0c50 0x7fc48006cd30 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:04.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.932+0000 7fc465ffb700 1 -- 172.21.15.2:0/2278106948 >> 172.21.15.2:0/2278106948 conn(0x7fc4800d3ed0 msgr2=0x7fc4800d2390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:04.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.933+0000 7fc465ffb700 1 -- 172.21.15.2:0/2278106948 shutdown_connections 2023-11-26T07:16:04.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:04.933+0000 7fc465ffb700 1 -- 172.21.15.2:0/2278106948 wait complete. 2023-11-26T07:16:04.949 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol_clone34300 --force 2023-11-26T07:16:05.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.083+0000 7f954ed04700 1 Processor -- start 2023-11-26T07:16:05.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.083+0000 7f954ed04700 1 -- start start 2023-11-26T07:16:05.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.084+0000 7f954ed04700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95481447a0 0x7f9548071b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:05.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.084+0000 7f954ed04700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f954806f070 0x7f95480720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:05.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.084+0000 7f954ed04700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f954806dbd0 con 0x7f9548072ab0 2023-11-26T07:16:05.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.084+0000 7f954ed04700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f954815b700 con 0x7f954806f070 2023-11-26T07:16:05.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.084+0000 7f954ed04700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f954815b9e0 con 0x7f95481447a0 2023-11-26T07:16:05.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.084+0000 7f9547fff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f9548072ab0 0x7f954815e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34688/0 (socket says 172.21.15.2:34688) 2023-11-26T07:16:05.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.084+0000 7f9547fff700 1 -- 172.21.15.2:0/4181840860 learned_addr learned my addr 172.21.15.2:0/4181840860 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:16:05.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.085+0000 7f954caa0700 1 --2- 172.21.15.2:0/4181840860 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95481447a0 0x7f9548071b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:05.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.085+0000 7f954d2a1700 1 --2- 172.21.15.2:0/4181840860 >> v2:172.21.15.192:3300/0 conn(0x7f954806f070 0x7f95480720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:05.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.085+0000 7f95477fe700 1 -- 172.21.15.2:0/4181840860 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 14397314 0 0) 0x7f954806dbd0 con 0x7f9548072ab0 2023-11-26T07:16:05.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.085+0000 7f95477fe700 1 -- 172.21.15.2:0/4181840860 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95380035b0 con 0x7f9548072ab0 2023-11-26T07:16:05.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.085+0000 7f95477fe700 1 -- 172.21.15.2:0/4181840860 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3735377252 0 0) 0x7f95380035b0 con 0x7f9548072ab0 2023-11-26T07:16:05.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.085+0000 7f95477fe700 1 -- 172.21.15.2:0/4181840860 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95481447a0 msgr2=0x7f9548071b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:05.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.085+0000 7f95477fe700 1 --2- 172.21.15.2:0/4181840860 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95481447a0 0x7f9548071b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:05.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.085+0000 7f95477fe700 1 -- 172.21.15.2:0/4181840860 >> v2:172.21.15.192:3300/0 conn(0x7f954806f070 msgr2=0x7f95480720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:05.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.085+0000 7f95477fe700 1 --2- 172.21.15.2:0/4181840860 >> v2:172.21.15.192:3300/0 conn(0x7f954806f070 0x7f95480720d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:05.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.085+0000 7f95477fe700 1 -- 172.21.15.2:0/4181840860 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f954815bcc0 con 0x7f9548072ab0 2023-11-26T07:16:05.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.085+0000 7f95477fe700 1 -- 172.21.15.2:0/4181840860 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f9534001670 con 0x7f9548072ab0 2023-11-26T07:16:05.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.085+0000 7f95477fe700 1 -- 172.21.15.2:0/4181840860 >> v1:172.21.15.2:6789/0 conn(0x7f9548072ab0 legacy=0x7f954815e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:05.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.085+0000 7f95477fe700 1 --2- 172.21.15.2:0/4181840860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9538003a00 0x7f9538003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:05.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.085+0000 7f95477fe700 1 --2- 172.21.15.2:0/4181840860 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95481447a0 0x7f9538004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:05.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.085+0000 7f95477fe700 1 --2- 172.21.15.2:0/4181840860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9538004d90 0x7f9538005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:05.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.085+0000 7f95477fe700 1 -- 172.21.15.2:0/4181840860 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954815b700 con 0x7f9538004d90 2023-11-26T07:16:05.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.085+0000 7f95477fe700 1 -- 172.21.15.2:0/4181840860 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954815b9e0 con 0x7f9538003a00 2023-11-26T07:16:05.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.085+0000 7f95477fe700 1 -- 172.21.15.2:0/4181840860 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f953800ba10 con 0x7f95481447a0 2023-11-26T07:16:05.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.085+0000 7f954d2a1700 1 --2- 172.21.15.2:0/4181840860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9538004d90 0x7f9538005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:05.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.085+0000 7f954caa0700 1 --2- 172.21.15.2:0/4181840860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9538003a00 0x7f9538003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:05.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.085+0000 7f9547fff700 1 --2- 172.21.15.2:0/4181840860 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95481447a0 0x7f9538004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:05.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.085+0000 7f954d2a1700 1 -- 172.21.15.2:0/4181840860 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95481447a0 msgr2=0x7f9538004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:05.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.085+0000 7f954d2a1700 1 --2- 172.21.15.2:0/4181840860 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95481447a0 0x7f9538004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:05.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.085+0000 7f954d2a1700 1 -- 172.21.15.2:0/4181840860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9538003a00 msgr2=0x7f9538003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:05.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.085+0000 7f954d2a1700 1 --2- 172.21.15.2:0/4181840860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9538003a00 0x7f9538003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:05.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.085+0000 7f954d2a1700 1 -- 172.21.15.2:0/4181840860 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95380035b0 con 0x7f9538004d90 2023-11-26T07:16:05.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.086+0000 7f954d2a1700 1 --2- 172.21.15.2:0/4181840860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9538004d90 0x7f9538005210 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f9540009bd0 tx=0x7f9538005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba679ad6663151e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:05.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.086+0000 7f95477fe700 1 -- 172.21.15.2:0/4181840860 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954000ebd0 con 0x7f9538004d90 2023-11-26T07:16:05.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.086+0000 7f95477fe700 1 -- 172.21.15.2:0/4181840860 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f954000f040 con 0x7f9538004d90 2023-11-26T07:16:05.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.086+0000 7f95477fe700 1 -- 172.21.15.2:0/4181840860 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9540012430 con 0x7f9538004d90 2023-11-26T07:16:05.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.086+0000 7f954ed04700 1 -- 172.21.15.2:0/4181840860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9538004d90 msgr2=0x7f9538005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:05.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.086+0000 7f954ed04700 1 --2- 172.21.15.2:0/4181840860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9538004d90 0x7f9538005210 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f9540009bd0 tx=0x7f9538005880 comp rx=0 tx=0).stop 2023-11-26T07:16:05.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.086+0000 7f954d2a1700 1 -- 172.21.15.2:0/4181840860 reap_dead start 2023-11-26T07:16:05.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.086+0000 7f954ed04700 1 -- 172.21.15.2:0/4181840860 shutdown_connections 2023-11-26T07:16:05.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.086+0000 7f954ed04700 1 -- 172.21.15.2:0/4181840860 >> 172.21.15.2:0/4181840860 conn(0x7f95480b2760 msgr2=0x7f95480b2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:05.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.086+0000 7f954ed04700 1 -- 172.21.15.2:0/4181840860 shutdown_connections 2023-11-26T07:16:05.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.086+0000 7f954ed04700 1 -- 172.21.15.2:0/4181840860 wait complete. 2023-11-26T07:16:05.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.088+0000 7f954ed04700 1 Processor -- start 2023-11-26T07:16:05.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.088+0000 7f954ed04700 1 -- start start 2023-11-26T07:16:05.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.089+0000 7f954ed04700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9538004d90 0x7f95481f4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:05.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.089+0000 7f954ed04700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95480a9d60 0x7f9548142b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:05.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.089+0000 7f954ed04700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95481430c0 0x7f95480cc510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:05.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.089+0000 7f954ed04700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9548143530 con 0x7f9538004d90 2023-11-26T07:16:05.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.089+0000 7f954ed04700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95480cc080 con 0x7f95480a9d60 2023-11-26T07:16:05.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.089+0000 7f954ed04700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95480cb330 con 0x7f95481430c0 2023-11-26T07:16:05.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.089+0000 7f954caa0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9538004d90 0x7f95481f4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:05.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.089+0000 7f954caa0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9538004d90 0x7f95481f4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43488/0 (socket says 172.21.15.2:43488) 2023-11-26T07:16:05.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.089+0000 7f954caa0700 1 -- 172.21.15.2:0/2312831944 learned_addr learned my addr 172.21.15.2:0/2312831944 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:05.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.090+0000 7f954d2a1700 1 --2- 172.21.15.2:0/2312831944 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95481430c0 0x7f95480cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:05.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.090+0000 7f9547fff700 1 --2- 172.21.15.2:0/2312831944 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95480a9d60 0x7f9548142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:05.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.090+0000 7f954caa0700 1 -- 172.21.15.2:0/2312831944 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95481430c0 msgr2=0x7f95480cc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:05.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.090+0000 7f954caa0700 1 --2- 172.21.15.2:0/2312831944 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95481430c0 0x7f95480cc510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:05.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.090+0000 7f954caa0700 1 -- 172.21.15.2:0/2312831944 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95480a9d60 msgr2=0x7f9548142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:05.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.090+0000 7f954caa0700 1 --2- 172.21.15.2:0/2312831944 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95480a9d60 0x7f9548142b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:05.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.090+0000 7f954caa0700 1 -- 172.21.15.2:0/2312831944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95480aa220 con 0x7f9538004d90 2023-11-26T07:16:05.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.090+0000 7f954d2a1700 1 --2- 172.21.15.2:0/2312831944 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95481430c0 0x7f95480cc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:16:05.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.090+0000 7f9547fff700 1 --2- 172.21.15.2:0/2312831944 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95480a9d60 0x7f9548142b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:16:05.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.090+0000 7f954caa0700 1 --2- 172.21.15.2:0/2312831944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9538004d90 0x7f95481f4e50 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f953c0119d0 tx=0x7f953c011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:05.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.090+0000 7f95457fa700 1 -- 172.21.15.2:0/2312831944 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953c00f940 con 0x7f9538004d90 2023-11-26T07:16:05.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.090+0000 7f95457fa700 1 -- 172.21.15.2:0/2312831944 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f953c00faa0 con 0x7f9538004d90 2023-11-26T07:16:05.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.090+0000 7f954ed04700 1 -- 172.21.15.2:0/2312831944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95480cba30 con 0x7f9538004d90 2023-11-26T07:16:05.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.090+0000 7f95457fa700 1 -- 172.21.15.2:0/2312831944 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953c00fe30 con 0x7f9538004d90 2023-11-26T07:16:05.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.090+0000 7f954ed04700 1 -- 172.21.15.2:0/2312831944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95480aa500 con 0x7f9538004d90 2023-11-26T07:16:05.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.091+0000 7f954ed04700 1 -- 172.21.15.2:0/2312831944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9548068670 con 0x7f9538004d90 2023-11-26T07:16:05.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.091+0000 7f95457fa700 1 -- 172.21.15.2:0/2312831944 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 14) v1 ==== 89945+0+0 (secure 0 0 0) 0x7f953c014440 con 0x7f9538004d90 2023-11-26T07:16:05.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.092+0000 7f95457fa700 1 --2- 172.21.15.2:0/2312831944 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f952c06b6b0 0x7f952c06db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:05.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.092+0000 7f95457fa700 1 -- 172.21.15.2:0/2312831944 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f953c0883b0 con 0x7f9538004d90 2023-11-26T07:16:05.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.092+0000 7f9547fff700 1 --2- 172.21.15.2:0/2312831944 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f952c06b6b0 0x7f952c06db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:05.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.093+0000 7f9547fff700 1 --2- 172.21.15.2:0/2312831944 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f952c06b6b0 0x7f952c06db70 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9534001050 tx=0x7f9534009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:05.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.097+0000 7f95457fa700 1 -- 172.21.15.2:0/2312831944 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f953c055060 con 0x7f9538004d90 2023-11-26T07:16:05.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.330+0000 7f954ed04700 1 -- 172.21.15.2:0/2312831944 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol_clone34300", "force": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f954815b130 con 0x7f952c06b6b0 2023-11-26T07:16:05.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.345+0000 7f95457fa700 1 -- 172.21.15.2:0/2312831944 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f9534007e30 con 0x7f952c06b6b0 2023-11-26T07:16:05.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.347+0000 7f954ed04700 1 -- 172.21.15.2:0/2312831944 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f952c06b6b0 msgr2=0x7f952c06db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:05.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.347+0000 7f954ed04700 1 --2- 172.21.15.2:0/2312831944 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f952c06b6b0 0x7f952c06db70 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9534001050 tx=0x7f9534009040 comp rx=0 tx=0).stop 2023-11-26T07:16:05.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.347+0000 7f954ed04700 1 -- 172.21.15.2:0/2312831944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9538004d90 msgr2=0x7f95481f4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:05.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.347+0000 7f954ed04700 1 --2- 172.21.15.2:0/2312831944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9538004d90 0x7f95481f4e50 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f953c0119d0 tx=0x7f953c011d90 comp rx=0 tx=0).stop 2023-11-26T07:16:05.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.347+0000 7f954ed04700 1 -- 172.21.15.2:0/2312831944 shutdown_connections 2023-11-26T07:16:05.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.347+0000 7f954ed04700 1 --2- 172.21.15.2:0/2312831944 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f952c06b6b0 0x7f952c06db70 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:05.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.347+0000 7f954ed04700 1 --2- 172.21.15.2:0/2312831944 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95481430c0 0x7f95480cc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:05.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.347+0000 7f954ed04700 1 --2- 172.21.15.2:0/2312831944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9538004d90 0x7f95481f4e50 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:05.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.347+0000 7f954ed04700 1 --2- 172.21.15.2:0/2312831944 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95480a9d60 0x7f9548142b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:05.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.347+0000 7f954ed04700 1 -- 172.21.15.2:0/2312831944 >> 172.21.15.2:0/2312831944 conn(0x7f95480b2760 msgr2=0x7f95480d0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:05.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.347+0000 7f954ed04700 1 -- 172.21.15.2:0/2312831944 shutdown_connections 2023-11-26T07:16:05.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.347+0000 7f954ed04700 1 -- 172.21.15.2:0/2312831944 wait complete. 2023-11-26T07:16:05.358 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:16:05.355+0000 7f8da82aa700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:16:05.358 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:16:05.355+0000 7f8da82aa700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:16:05.358 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:16:05.355+0000 7f8da82aa700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:16:05.358 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:16:05.355+0000 7f8da82aa700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:16:05.358 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:16:05.355+0000 7f8da82aa700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:16:05.362 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvol52070 subvol_snap97620 2023-11-26T07:16:05.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.491+0000 7fe1ffe31700 1 Processor -- start 2023-11-26T07:16:05.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.491+0000 7fe1ffe31700 1 -- start start 2023-11-26T07:16:05.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.492+0000 7fe1ffe31700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1f806afd0 0x7fe1f80b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:05.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.492+0000 7fe1ffe31700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1f8071ec0 con 0x7fe1f8072350 2023-11-26T07:16:05.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.492+0000 7fe1ffe31700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1f8071b90 con 0x7fe1f806b3b0 2023-11-26T07:16:05.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.492+0000 7fe1ffe31700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f815ed30 con 0x7fe1f806afd0 2023-11-26T07:16:05.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.492+0000 7fe1fe3ce700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe1f8072350 0x7fe1f806dbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34708/0 (socket says 172.21.15.2:34708) 2023-11-26T07:16:05.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.492+0000 7fe1fe3ce700 1 -- 172.21.15.2:0/313072622 learned_addr learned my addr 172.21.15.2:0/313072622 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:16:05.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.493+0000 7fe1fdbcd700 1 --2- 172.21.15.2:0/313072622 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1f806afd0 0x7fe1f80b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:05.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.493+0000 7fe1fcbcb700 1 -- 172.21.15.2:0/313072622 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 776836631 0 0) 0x7fe1f8071ec0 con 0x7fe1f8072350 2023-11-26T07:16:05.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.493+0000 7fe1fcbcb700 1 -- 172.21.15.2:0/313072622 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1e40035b0 con 0x7fe1f8072350 2023-11-26T07:16:05.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.493+0000 7fe1fcbcb700 1 -- 172.21.15.2:0/313072622 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 811474983 0 0) 0x7fe1f8071b90 con 0x7fe1f806b3b0 2023-11-26T07:16:05.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.493+0000 7fe1fcbcb700 1 -- 172.21.15.2:0/313072622 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1f8071ec0 con 0x7fe1f806b3b0 2023-11-26T07:16:05.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.493+0000 7fe1fcbcb700 1 -- 172.21.15.2:0/313072622 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4188105540 0 0) 0x7fe1e40035b0 con 0x7fe1f8072350 2023-11-26T07:16:05.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.493+0000 7fe1fcbcb700 1 -- 172.21.15.2:0/313072622 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1f806afd0 msgr2=0x7fe1f80b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:05.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.493+0000 7fe1fcbcb700 1 --2- 172.21.15.2:0/313072622 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1f806afd0 0x7fe1f80b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:05.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.493+0000 7fe1fcbcb700 1 -- 172.21.15.2:0/313072622 >> v1:172.21.15.192:6789/0 conn(0x7fe1f806b3b0 legacy=0x7fe1f815e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:05.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.493+0000 7fe1fcbcb700 1 -- 172.21.15.2:0/313072622 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f815f010 con 0x7fe1f8072350 2023-11-26T07:16:05.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.493+0000 7fe1fcbcb700 1 -- 172.21.15.2:0/313072622 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7fe1f00019f0 con 0x7fe1f8072350 2023-11-26T07:16:05.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.493+0000 7fe1fcbcb700 1 -- 172.21.15.2:0/313072622 >> v1:172.21.15.2:6789/0 conn(0x7fe1f8072350 legacy=0x7fe1f806dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:05.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.493+0000 7fe1fcbcb700 1 --2- 172.21.15.2:0/313072622 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1f806afd0 0x7fe1e4003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:05.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.493+0000 7fe1fcbcb700 1 --2- 172.21.15.2:0/313072622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1e4004120 0x7fe1e4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:05.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.493+0000 7fe1fcbcb700 1 --2- 172.21.15.2:0/313072622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1e4004d90 0x7fe1e4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:05.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.493+0000 7fe1fcbcb700 1 -- 172.21.15.2:0/313072622 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f815ed30 con 0x7fe1e4004120 2023-11-26T07:16:05.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.493+0000 7fe1fcbcb700 1 -- 172.21.15.2:0/313072622 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e400baf0 con 0x7fe1e4004d90 2023-11-26T07:16:05.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.493+0000 7fe1fcbcb700 1 -- 172.21.15.2:0/313072622 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e400bcb0 con 0x7fe1f806afd0 2023-11-26T07:16:05.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.493+0000 7fe1fd3cc700 1 --2- 172.21.15.2:0/313072622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1e4004120 0x7fe1e4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:05.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.493+0000 7fe1fdbcd700 1 --2- 172.21.15.2:0/313072622 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1f806afd0 0x7fe1e4003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:05.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.493+0000 7fe1fe3ce700 1 --2- 172.21.15.2:0/313072622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1e4004d90 0x7fe1e4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:05.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.494+0000 7fe1fd3cc700 1 -- 172.21.15.2:0/313072622 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1f806afd0 msgr2=0x7fe1e4003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:05.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.494+0000 7fe1fd3cc700 1 --2- 172.21.15.2:0/313072622 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1f806afd0 0x7fe1e4003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:05.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.494+0000 7fe1fd3cc700 1 -- 172.21.15.2:0/313072622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1e4004d90 msgr2=0x7fe1e4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:05.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.494+0000 7fe1fd3cc700 1 --2- 172.21.15.2:0/313072622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1e4004d90 0x7fe1e4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:05.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.494+0000 7fe1fd3cc700 1 -- 172.21.15.2:0/313072622 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e40035b0 con 0x7fe1e4004120 2023-11-26T07:16:05.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.494+0000 7fe1fe3ce700 1 --2- 172.21.15.2:0/313072622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1e4004d90 0x7fe1e4005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:16:05.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.494+0000 7fe1fd3cc700 1 --2- 172.21.15.2:0/313072622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1e4004120 0x7fe1e4004850 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4001980 tx=0x7fe1e4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac6509e18947460 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:05.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.494+0000 7fe1fcbcb700 1 -- 172.21.15.2:0/313072622 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4001470 con 0x7fe1e4004120 2023-11-26T07:16:05.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.494+0000 7fe1fcbcb700 1 -- 172.21.15.2:0/313072622 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f40052d0 con 0x7fe1e4004120 2023-11-26T07:16:05.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.494+0000 7fe1fcbcb700 1 -- 172.21.15.2:0/313072622 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4003680 con 0x7fe1e4004120 2023-11-26T07:16:05.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.494+0000 7fe1ffe31700 1 -- 172.21.15.2:0/313072622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1e4004120 msgr2=0x7fe1e4004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:05.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.494+0000 7fe1ffe31700 1 --2- 172.21.15.2:0/313072622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1e4004120 0x7fe1e4004850 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4001980 tx=0x7fe1e4005880 comp rx=0 tx=0).stop 2023-11-26T07:16:05.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.494+0000 7fe1fe3ce700 1 -- 172.21.15.2:0/313072622 reap_dead start 2023-11-26T07:16:05.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.494+0000 7fe1ffe31700 1 -- 172.21.15.2:0/313072622 shutdown_connections 2023-11-26T07:16:05.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.494+0000 7fe1ffe31700 1 -- 172.21.15.2:0/313072622 >> 172.21.15.2:0/313072622 conn(0x7fe1f80b2760 msgr2=0x7fe1f80b2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:05.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.495+0000 7fe1ffe31700 1 -- 172.21.15.2:0/313072622 shutdown_connections 2023-11-26T07:16:05.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.495+0000 7fe1ffe31700 1 -- 172.21.15.2:0/313072622 wait complete. 2023-11-26T07:16:05.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.496+0000 7fe1ffe31700 1 Processor -- start 2023-11-26T07:16:05.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.496+0000 7fe1ffe31700 1 -- start start 2023-11-26T07:16:05.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.497+0000 7fe1ffe31700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1e4004120 0x7fe1f815d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:05.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.497+0000 7fe1ffe31700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1f8143710 0x7fe1f81e8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:05.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.497+0000 7fe1ffe31700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1f80c5c90 0x7fe1f80ae9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:05.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.497+0000 7fe1ffe31700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f8130510 con 0x7fe1e4004120 2023-11-26T07:16:05.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.497+0000 7fe1ffe31700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f815dc80 con 0x7fe1f80c5c90 2023-11-26T07:16:05.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.497+0000 7fe1ffe31700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f8130760 con 0x7fe1f8143710 2023-11-26T07:16:05.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.497+0000 7fe1fdbcd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1e4004120 0x7fe1f815d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:05.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.497+0000 7fe1fdbcd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1e4004120 0x7fe1f815d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43506/0 (socket says 172.21.15.2:43506) 2023-11-26T07:16:05.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.497+0000 7fe1fdbcd700 1 -- 172.21.15.2:0/3519139947 learned_addr learned my addr 172.21.15.2:0/3519139947 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:05.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.497+0000 7fe1fd3cc700 1 --2- 172.21.15.2:0/3519139947 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1f8143710 0x7fe1f81e8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:05.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.497+0000 7fe1fe3ce700 1 --2- 172.21.15.2:0/3519139947 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1f80c5c90 0x7fe1f80ae9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:05.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.497+0000 7fe1fdbcd700 1 -- 172.21.15.2:0/3519139947 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1f8143710 msgr2=0x7fe1f81e8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:05.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.497+0000 7fe1fdbcd700 1 --2- 172.21.15.2:0/3519139947 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1f8143710 0x7fe1f81e8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:05.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.497+0000 7fe1fdbcd700 1 -- 172.21.15.2:0/3519139947 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1f80c5c90 msgr2=0x7fe1f80ae9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:05.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.497+0000 7fe1fdbcd700 1 --2- 172.21.15.2:0/3519139947 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1f80c5c90 0x7fe1f80ae9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:05.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.497+0000 7fe1fdbcd700 1 -- 172.21.15.2:0/3519139947 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f8130a40 con 0x7fe1e4004120 2023-11-26T07:16:05.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.497+0000 7fe1fdbcd700 1 --2- 172.21.15.2:0/3519139947 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1e4004120 0x7fe1f815d740 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8011aa0 tx=0x7fe1e8011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:05.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.497+0000 7fe1ee7fc700 1 -- 172.21.15.2:0/3519139947 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e8011ed0 con 0x7fe1e4004120 2023-11-26T07:16:05.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.497+0000 7fe1ee7fc700 1 -- 172.21.15.2:0/3519139947 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e800f940 con 0x7fe1e4004120 2023-11-26T07:16:05.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.497+0000 7fe1ffe31700 1 -- 172.21.15.2:0/3519139947 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1f8130d20 con 0x7fe1e4004120 2023-11-26T07:16:05.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.497+0000 7fe1ee7fc700 1 -- 172.21.15.2:0/3519139947 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e800fcf0 con 0x7fe1e4004120 2023-11-26T07:16:05.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.497+0000 7fe1ffe31700 1 -- 172.21.15.2:0/3519139947 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1f81312e0 con 0x7fe1e4004120 2023-11-26T07:16:05.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.498+0000 7fe1ffe31700 1 -- 172.21.15.2:0/3519139947 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1f8068670 con 0x7fe1e4004120 2023-11-26T07:16:05.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.499+0000 7fe1ee7fc700 1 -- 172.21.15.2:0/3519139947 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 14) v1 ==== 89945+0+0 (secure 0 0 0) 0x7fe1e8014440 con 0x7fe1e4004120 2023-11-26T07:16:05.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.499+0000 7fe1ee7fc700 1 --2- 172.21.15.2:0/3519139947 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe1dc06b6b0 0x7fe1dc06db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:05.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.499+0000 7fe1ee7fc700 1 -- 172.21.15.2:0/3519139947 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe1e8088250 con 0x7fe1e4004120 2023-11-26T07:16:05.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.500+0000 7fe1fd3cc700 1 --2- 172.21.15.2:0/3519139947 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe1dc06b6b0 0x7fe1dc06db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:05.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.500+0000 7fe1fd3cc700 1 --2- 172.21.15.2:0/3519139947 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe1dc06b6b0 0x7fe1dc06db70 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4005040 tx=0x7fe1f400a000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:05.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.504+0000 7fe1ee7fc700 1 -- 172.21.15.2:0/3519139947 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe1e8054fc0 con 0x7fe1e4004120 2023-11-26T07:16:05.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.744+0000 7fe1ffe31700 1 -- 172.21.15.2:0/3519139947 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvol52070", "snap_name": "subvol_snap97620", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1f806b830 con 0x7fe1dc06b6b0 2023-11-26T07:16:05.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.778+0000 7fe1ee7fc700 1 -- 172.21.15.2:0/3519139947 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe1f40050d0 con 0x7fe1dc06b6b0 2023-11-26T07:16:05.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.780+0000 7fe1ffe31700 1 -- 172.21.15.2:0/3519139947 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe1dc06b6b0 msgr2=0x7fe1dc06db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:05.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.780+0000 7fe1ffe31700 1 --2- 172.21.15.2:0/3519139947 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe1dc06b6b0 0x7fe1dc06db70 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4005040 tx=0x7fe1f400a000 comp rx=0 tx=0).stop 2023-11-26T07:16:05.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.780+0000 7fe1ffe31700 1 -- 172.21.15.2:0/3519139947 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1e4004120 msgr2=0x7fe1f815d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:05.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.780+0000 7fe1ffe31700 1 --2- 172.21.15.2:0/3519139947 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1e4004120 0x7fe1f815d740 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8011aa0 tx=0x7fe1e8011db0 comp rx=0 tx=0).stop 2023-11-26T07:16:05.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.780+0000 7fe1ffe31700 1 -- 172.21.15.2:0/3519139947 shutdown_connections 2023-11-26T07:16:05.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.780+0000 7fe1ffe31700 1 --2- 172.21.15.2:0/3519139947 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe1dc06b6b0 0x7fe1dc06db70 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:05.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.780+0000 7fe1ffe31700 1 --2- 172.21.15.2:0/3519139947 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1f80c5c90 0x7fe1f80ae9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:05.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.780+0000 7fe1ffe31700 1 --2- 172.21.15.2:0/3519139947 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1e4004120 0x7fe1f815d740 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:05.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.780+0000 7fe1ffe31700 1 --2- 172.21.15.2:0/3519139947 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1f8143710 0x7fe1f81e8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:05.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.780+0000 7fe1ffe31700 1 -- 172.21.15.2:0/3519139947 >> 172.21.15.2:0/3519139947 conn(0x7fe1f80b2760 msgr2=0x7fe1f806eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:05.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.780+0000 7fe1ffe31700 1 -- 172.21.15.2:0/3519139947 shutdown_connections 2023-11-26T07:16:05.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.780+0000 7fe1ffe31700 1 -- 172.21.15.2:0/3519139947 wait complete. 2023-11-26T07:16:05.794 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol52070 2023-11-26T07:16:05.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.920+0000 7fb53e543700 1 Processor -- start 2023-11-26T07:16:05.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.920+0000 7fb53e543700 1 -- start start 2023-11-26T07:16:05.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.921+0000 7fb53e543700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb53815e1c0 0x7fb53806eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:05.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.921+0000 7fb53e543700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb5380b0e90 0x7fb53806f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:05.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.921+0000 7fb53e543700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5380d1230 con 0x7fb53806fa80 2023-11-26T07:16:05.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.921+0000 7fb53e543700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb53806ff10 con 0x7fb53815e1c0 2023-11-26T07:16:05.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.921+0000 7fb53e543700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5380d0c70 con 0x7fb5380b0e90 2023-11-26T07:16:05.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.921+0000 7fb537fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb53815e1c0 0x7fb53806eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:05.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.921+0000 7fb53cae0700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb53806fa80 0x7fb538161d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34728/0 (socket says 172.21.15.2:34728) 2023-11-26T07:16:05.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.921+0000 7fb53cae0700 1 -- 172.21.15.2:0/3083001386 learned_addr learned my addr 172.21.15.2:0/3083001386 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:16:05.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.922+0000 7fb5377fe700 1 --2- 172.21.15.2:0/3083001386 >> v2:172.21.15.192:3300/0 conn(0x7fb5380b0e90 0x7fb53806f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:05.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.922+0000 7fb537fff700 1 -- 172.21.15.2:0/3083001386 >> v2:172.21.15.192:3300/0 conn(0x7fb5380b0e90 msgr2=0x7fb53806f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:05.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.922+0000 7fb537fff700 1 --2- 172.21.15.2:0/3083001386 >> v2:172.21.15.192:3300/0 conn(0x7fb5380b0e90 0x7fb53806f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:05.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.922+0000 7fb537fff700 1 -- 172.21.15.2:0/3083001386 >> v1:172.21.15.2:6789/0 conn(0x7fb53806fa80 legacy=0x7fb538161d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:05.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.922+0000 7fb537fff700 1 -- 172.21.15.2:0/3083001386 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5380d0f50 con 0x7fb53815e1c0 2023-11-26T07:16:05.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.922+0000 7fb536ffd700 1 -- 172.21.15.2:0/3083001386 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1783266489 0 0) 0x7fb5380d1230 con 0x7fb53806fa80 2023-11-26T07:16:05.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.922+0000 7fb537fff700 1 --2- 172.21.15.2:0/3083001386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb53815e1c0 0x7fb53806eef0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fb538071ba0 tx=0x7fb528009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f92fa249e7d49921 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:05.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.922+0000 7fb536ffd700 1 -- 172.21.15.2:0/3083001386 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb528011830 con 0x7fb53815e1c0 2023-11-26T07:16:05.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.922+0000 7fb536ffd700 1 -- 172.21.15.2:0/3083001386 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb528011990 con 0x7fb53815e1c0 2023-11-26T07:16:05.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.922+0000 7fb536ffd700 1 -- 172.21.15.2:0/3083001386 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb528011d20 con 0x7fb53815e1c0 2023-11-26T07:16:05.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.923+0000 7fb53e543700 1 -- 172.21.15.2:0/3083001386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb53815e1c0 msgr2=0x7fb53806eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:05.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.923+0000 7fb53e543700 1 --2- 172.21.15.2:0/3083001386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb53815e1c0 0x7fb53806eef0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fb538071ba0 tx=0x7fb528009b20 comp rx=0 tx=0).stop 2023-11-26T07:16:05.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.923+0000 7fb53e543700 1 -- 172.21.15.2:0/3083001386 shutdown_connections 2023-11-26T07:16:05.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.923+0000 7fb53e543700 1 --2- 172.21.15.2:0/3083001386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb53815e1c0 0x7fb53806eef0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:05.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.923+0000 7fb53e543700 1 --2- 172.21.15.2:0/3083001386 >> v2:172.21.15.192:3300/0 conn(0x7fb5380b0e90 0x7fb53806f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:05.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.923+0000 7fb53e543700 1 -- 172.21.15.2:0/3083001386 >> 172.21.15.2:0/3083001386 conn(0x7fb5380b3720 msgr2=0x7fb5380b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:05.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.923+0000 7fb53e543700 1 -- 172.21.15.2:0/3083001386 shutdown_connections 2023-11-26T07:16:05.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.923+0000 7fb53e543700 1 -- 172.21.15.2:0/3083001386 wait complete. 2023-11-26T07:16:05.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.924+0000 7fb53e543700 1 Processor -- start 2023-11-26T07:16:05.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.924+0000 7fb53e543700 1 -- start start 2023-11-26T07:16:05.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.925+0000 7fb53e543700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb53806fa80 0x7fb53814d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:05.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.925+0000 7fb53e543700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5380b0e90 0x7fb5380b62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:05.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.925+0000 7fb53e543700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb53815e1c0 0x7fb5380b67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:05.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.925+0000 7fb53e543700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53814e050 con 0x7fb53806fa80 2023-11-26T07:16:05.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.925+0000 7fb53e543700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5381f46f0 con 0x7fb5380b0e90 2023-11-26T07:16:05.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.925+0000 7fb53e543700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb53809c970 con 0x7fb53815e1c0 2023-11-26T07:16:05.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.925+0000 7fb537fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb53806fa80 0x7fb53814d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:05.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.925+0000 7fb537fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb53806fa80 0x7fb53814d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43520/0 (socket says 172.21.15.2:43520) 2023-11-26T07:16:05.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.925+0000 7fb537fff700 1 -- 172.21.15.2:0/1788495176 learned_addr learned my addr 172.21.15.2:0/1788495176 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:05.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.925+0000 7fb5377fe700 1 --2- 172.21.15.2:0/1788495176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5380b0e90 0x7fb5380b62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:05.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.925+0000 7fb537fff700 1 -- 172.21.15.2:0/1788495176 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb53815e1c0 msgr2=0x7fb5380b67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:05.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.925+0000 7fb537fff700 1 --2- 172.21.15.2:0/1788495176 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb53815e1c0 0x7fb5380b67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:05.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.925+0000 7fb537fff700 1 -- 172.21.15.2:0/1788495176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5380b0e90 msgr2=0x7fb5380b62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:05.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.925+0000 7fb537fff700 1 --2- 172.21.15.2:0/1788495176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5380b0e90 0x7fb5380b62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:05.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.925+0000 7fb537fff700 1 -- 172.21.15.2:0/1788495176 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5280094a0 con 0x7fb53806fa80 2023-11-26T07:16:05.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.925+0000 7fb537fff700 1 --2- 172.21.15.2:0/1788495176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb53806fa80 0x7fb53814d740 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fb528009b60 tx=0x7fb528004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:05.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.926+0000 7fb534ff9700 1 -- 172.21.15.2:0/1788495176 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5280038a0 con 0x7fb53806fa80 2023-11-26T07:16:05.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.926+0000 7fb534ff9700 1 -- 172.21.15.2:0/1788495176 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb52801e070 con 0x7fb53806fa80 2023-11-26T07:16:05.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.926+0000 7fb53e543700 1 -- 172.21.15.2:0/1788495176 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb53809bbb0 con 0x7fb53806fa80 2023-11-26T07:16:05.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.926+0000 7fb534ff9700 1 -- 172.21.15.2:0/1788495176 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb528003c20 con 0x7fb53806fa80 2023-11-26T07:16:05.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.926+0000 7fb53e543700 1 -- 172.21.15.2:0/1788495176 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb53809c170 con 0x7fb53806fa80 2023-11-26T07:16:05.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.927+0000 7fb53e543700 1 -- 172.21.15.2:0/1788495176 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb538075480 con 0x7fb53806fa80 2023-11-26T07:16:05.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.927+0000 7fb534ff9700 1 -- 172.21.15.2:0/1788495176 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 14) v1 ==== 89945+0+0 (secure 0 0 0) 0x7fb52802d450 con 0x7fb53806fa80 2023-11-26T07:16:05.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.927+0000 7fb534ff9700 1 --2- 172.21.15.2:0/1788495176 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb51806b6b0 0x7fb51806db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:05.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.927+0000 7fb534ff9700 1 -- 172.21.15.2:0/1788495176 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb528088cb0 con 0x7fb53806fa80 2023-11-26T07:16:05.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.928+0000 7fb5377fe700 1 --2- 172.21.15.2:0/1788495176 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb51806b6b0 0x7fb51806db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:05.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.928+0000 7fb5377fe700 1 --2- 172.21.15.2:0/1788495176 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb51806b6b0 0x7fb51806db70 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb520009950 tx=0x7fb520008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:05.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:05.932+0000 7fb534ff9700 1 -- 172.21.15.2:0/1788495176 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb528055960 con 0x7fb53806fa80 2023-11-26T07:16:06.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:06.167+0000 7fb53e543700 1 -- 172.21.15.2:0/1788495176 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol52070", "target": ["mon-mgr", ""]}) v1 -- 0x7fb5380d0920 con 0x7fb51806b6b0 2023-11-26T07:16:06.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:06.185+0000 7fb534ff9700 1 -- 172.21.15.2:0/1788495176 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fb5200095e0 con 0x7fb51806b6b0 2023-11-26T07:16:06.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:06.187+0000 7fb53e543700 1 -- 172.21.15.2:0/1788495176 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb51806b6b0 msgr2=0x7fb51806db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:06.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:06.187+0000 7fb53e543700 1 --2- 172.21.15.2:0/1788495176 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb51806b6b0 0x7fb51806db70 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb520009950 tx=0x7fb520008040 comp rx=0 tx=0).stop 2023-11-26T07:16:06.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:06.187+0000 7fb53e543700 1 -- 172.21.15.2:0/1788495176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb53806fa80 msgr2=0x7fb53814d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:06.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:06.187+0000 7fb53e543700 1 --2- 172.21.15.2:0/1788495176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb53806fa80 0x7fb53814d740 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fb528009b60 tx=0x7fb528004750 comp rx=0 tx=0).stop 2023-11-26T07:16:06.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:06.187+0000 7fb53e543700 1 -- 172.21.15.2:0/1788495176 shutdown_connections 2023-11-26T07:16:06.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:06.187+0000 7fb53e543700 1 --2- 172.21.15.2:0/1788495176 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb51806b6b0 0x7fb51806db70 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:06.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:06.187+0000 7fb53e543700 1 --2- 172.21.15.2:0/1788495176 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb53815e1c0 0x7fb5380b67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:06.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:06.187+0000 7fb53e543700 1 --2- 172.21.15.2:0/1788495176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb53806fa80 0x7fb53814d740 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:06.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:06.187+0000 7fb53e543700 1 --2- 172.21.15.2:0/1788495176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5380b0e90 0x7fb5380b62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:06.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:06.187+0000 7fb53e543700 1 -- 172.21.15.2:0/1788495176 >> 172.21.15.2:0/1788495176 conn(0x7fb5380b3720 msgr2=0x7fb53815d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:06.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:06.188+0000 7fb53e543700 1 -- 172.21.15.2:0/1788495176 shutdown_connections 2023-11-26T07:16:06.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:06.188+0000 7fb53e543700 1 -- 172.21.15.2:0/1788495176 wait complete. 2023-11-26T07:16:06.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:06.201 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-11-26T07:16:06.234 INFO:teuthology.orchestra.run.smithi002.stdout:3 2023-11-26T07:16:08.367 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:16:08.370 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:16:11.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:11.235 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-11-26T07:16:11.275 INFO:teuthology.orchestra.run.smithi002.stdout:2 2023-11-26T07:16:11.276 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-26T07:16:11.276 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:16:11.361 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:16:11.405 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-26T07:16:11.405 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:11.405 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:11.426 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:11.426 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:11.486 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:16:11.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.658+0000 7f6163d1e700 1 Processor -- start 2023-11-26T07:16:11.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.658+0000 7f6163d1e700 1 -- start start 2023-11-26T07:16:11.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.659+0000 7f6163d1e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f615c0affb0 0x7f615c0ae120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:11.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.659+0000 7f6163d1e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f615c0d1b40 con 0x7f615c06afd0 2023-11-26T07:16:11.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.659+0000 7f6163d1e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f615c070490 con 0x7f615c0d16e0 2023-11-26T07:16:11.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.659+0000 7f6163d1e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f615c0b0440 con 0x7f615c0affb0 2023-11-26T07:16:11.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.659+0000 7f6161aba700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f615c06afd0 0x7f615c06b3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34742/0 (socket says 172.21.15.2:34742) 2023-11-26T07:16:11.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.659+0000 7f6161aba700 1 -- 172.21.15.2:0/562503877 learned_addr learned my addr 172.21.15.2:0/562503877 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:16:11.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.659+0000 7f61622bb700 1 --2- 172.21.15.2:0/562503877 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f615c0affb0 0x7f615c0ae120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:11.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.659+0000 7f6160ab8700 1 -- 172.21.15.2:0/562503877 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3429048121 0 0) 0x7f615c0d1b40 con 0x7f615c06afd0 2023-11-26T07:16:11.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.659+0000 7f6160ab8700 1 -- 172.21.15.2:0/562503877 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61480035b0 con 0x7f615c06afd0 2023-11-26T07:16:11.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.659+0000 7f6160ab8700 1 -- 172.21.15.2:0/562503877 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 479452186 0 0) 0x7f615c070490 con 0x7f615c0d16e0 2023-11-26T07:16:11.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.659+0000 7f6160ab8700 1 -- 172.21.15.2:0/562503877 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f615c0d1b40 con 0x7f615c0d16e0 2023-11-26T07:16:11.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.659+0000 7f6160ab8700 1 -- 172.21.15.2:0/562503877 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4217058797 0 0) 0x7f61480035b0 con 0x7f615c06afd0 2023-11-26T07:16:11.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.659+0000 7f6160ab8700 1 -- 172.21.15.2:0/562503877 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f615c0affb0 msgr2=0x7f615c0ae120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:11.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.659+0000 7f6160ab8700 1 --2- 172.21.15.2:0/562503877 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f615c0affb0 0x7f615c0ae120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:11.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.659+0000 7f6160ab8700 1 -- 172.21.15.2:0/562503877 >> v1:172.21.15.192:6789/0 conn(0x7f615c0d16e0 legacy=0x7f615c0ada10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:11.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.659+0000 7f6160ab8700 1 -- 172.21.15.2:0/562503877 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f615c0af9f0 con 0x7f615c06afd0 2023-11-26T07:16:11.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.659+0000 7f6160ab8700 1 -- 172.21.15.2:0/562503877 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f61580015f0 con 0x7f615c06afd0 2023-11-26T07:16:11.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.659+0000 7f6160ab8700 1 -- 172.21.15.2:0/562503877 >> v1:172.21.15.2:6789/0 conn(0x7f615c06afd0 legacy=0x7f615c06b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:11.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.660+0000 7f6160ab8700 1 --2- 172.21.15.2:0/562503877 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f615c0affb0 0x7f6148003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:11.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.660+0000 7f6160ab8700 1 --2- 172.21.15.2:0/562503877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6148004170 0x7f6148004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:11.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.660+0000 7f6160ab8700 1 --2- 172.21.15.2:0/562503877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6148004d90 0x7f6148005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:11.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.660+0000 7f6160ab8700 1 -- 172.21.15.2:0/562503877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615c0b0440 con 0x7f6148004d90 2023-11-26T07:16:11.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.660+0000 7f6160ab8700 1 -- 172.21.15.2:0/562503877 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614800bb50 con 0x7f6148004170 2023-11-26T07:16:11.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.660+0000 7f6160ab8700 1 -- 172.21.15.2:0/562503877 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f614800bd10 con 0x7f615c0affb0 2023-11-26T07:16:11.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.660+0000 7f61622bb700 1 --2- 172.21.15.2:0/562503877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6148004d90 0x7f6148005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:11.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.660+0000 7f6161aba700 1 --2- 172.21.15.2:0/562503877 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f615c0affb0 0x7f6148003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:11.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.660+0000 7f61612b9700 1 --2- 172.21.15.2:0/562503877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6148004170 0x7f6148004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:11.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.660+0000 7f61622bb700 1 -- 172.21.15.2:0/562503877 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f615c0affb0 msgr2=0x7f6148003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:11.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.660+0000 7f61622bb700 1 --2- 172.21.15.2:0/562503877 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f615c0affb0 0x7f6148003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:11.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.660+0000 7f61622bb700 1 -- 172.21.15.2:0/562503877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6148004170 msgr2=0x7f6148004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:11.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.660+0000 7f61622bb700 1 --2- 172.21.15.2:0/562503877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6148004170 0x7f6148004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:11.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.660+0000 7f61622bb700 1 -- 172.21.15.2:0/562503877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61480035b0 con 0x7f6148004d90 2023-11-26T07:16:11.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.660+0000 7f61622bb700 1 --2- 172.21.15.2:0/562503877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6148004d90 0x7f6148005210 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f6154009fc0 tx=0x7f6148005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13f16719cb8a71a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:11.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.660+0000 7f6160ab8700 1 -- 172.21.15.2:0/562503877 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615400ec30 con 0x7f6148004d90 2023-11-26T07:16:11.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.660+0000 7f6160ab8700 1 -- 172.21.15.2:0/562503877 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615400f040 con 0x7f6148004d90 2023-11-26T07:16:11.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.660+0000 7f6160ab8700 1 -- 172.21.15.2:0/562503877 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6154014480 con 0x7f6148004d90 2023-11-26T07:16:11.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.661+0000 7f6163d1e700 1 -- 172.21.15.2:0/562503877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6148004d90 msgr2=0x7f6148005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:11.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.661+0000 7f6163d1e700 1 --2- 172.21.15.2:0/562503877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6148004d90 0x7f6148005210 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f6154009fc0 tx=0x7f6148005880 comp rx=0 tx=0).stop 2023-11-26T07:16:11.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.661+0000 7f61622bb700 1 -- 172.21.15.2:0/562503877 reap_dead start 2023-11-26T07:16:11.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.661+0000 7f6163d1e700 1 -- 172.21.15.2:0/562503877 shutdown_connections 2023-11-26T07:16:11.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.661+0000 7f6163d1e700 1 -- 172.21.15.2:0/562503877 >> 172.21.15.2:0/562503877 conn(0x7f615c0d0bc0 msgr2=0x7f615c0d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:11.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.661+0000 7f6163d1e700 1 -- 172.21.15.2:0/562503877 shutdown_connections 2023-11-26T07:16:11.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.661+0000 7f6163d1e700 1 -- 172.21.15.2:0/562503877 wait complete. 2023-11-26T07:16:11.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.662+0000 7f6163d1e700 1 Processor -- start 2023-11-26T07:16:11.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.662+0000 7f6163d1e700 1 -- start start 2023-11-26T07:16:11.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.663+0000 7f6163d1e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6148004d90 0x7f615c157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:11.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.663+0000 7f6163d1e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f615c15a430 0x7f615c1f3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:11.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.663+0000 7f6163d1e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f615c0b1a00 0x7f615c14d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:11.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.663+0000 7f6163d1e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615c0ce440 con 0x7f615c0b1a00 2023-11-26T07:16:11.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.663+0000 7f6163d1e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615c15a8b0 con 0x7f615c15a430 2023-11-26T07:16:11.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.663+0000 7f6163d1e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f615c1582a0 con 0x7f6148004d90 2023-11-26T07:16:11.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.663+0000 7f61622bb700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f615c0b1a00 0x7f615c14d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:11.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.663+0000 7f61622bb700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f615c0b1a00 0x7f615c14d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43548/0 (socket says 172.21.15.2:43548) 2023-11-26T07:16:11.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.663+0000 7f61622bb700 1 -- 172.21.15.2:0/1466534639 learned_addr learned my addr 172.21.15.2:0/1466534639 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:11.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.663+0000 7f61612b9700 1 --2- 172.21.15.2:0/1466534639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f615c15a430 0x7f615c1f3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:11.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.663+0000 7f6161aba700 1 --2- 172.21.15.2:0/1466534639 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6148004d90 0x7f615c157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:11.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.663+0000 7f61622bb700 1 -- 172.21.15.2:0/1466534639 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6148004d90 msgr2=0x7f615c157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:11.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.663+0000 7f61622bb700 1 --2- 172.21.15.2:0/1466534639 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6148004d90 0x7f615c157cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:11.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.663+0000 7f61622bb700 1 -- 172.21.15.2:0/1466534639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f615c15a430 msgr2=0x7f615c1f3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:11.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.663+0000 7f61622bb700 1 --2- 172.21.15.2:0/1466534639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f615c15a430 0x7f615c1f3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:11.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.663+0000 7f61622bb700 1 -- 172.21.15.2:0/1466534639 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f615c0ce690 con 0x7f615c0b1a00 2023-11-26T07:16:11.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.664+0000 7f61622bb700 1 --2- 172.21.15.2:0/1466534639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f615c0b1a00 0x7f615c14d400 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f6154009f60 tx=0x7f6154009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:11.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.664+0000 7f61527fc700 1 -- 172.21.15.2:0/1466534639 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6154004450 con 0x7f615c0b1a00 2023-11-26T07:16:11.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.664+0000 7f61527fc700 1 -- 172.21.15.2:0/1466534639 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61540045d0 con 0x7f615c0b1a00 2023-11-26T07:16:11.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.664+0000 7f6163d1e700 1 -- 172.21.15.2:0/1466534639 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f615c0ce970 con 0x7f615c0b1a00 2023-11-26T07:16:11.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.664+0000 7f61527fc700 1 -- 172.21.15.2:0/1466534639 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6154003e10 con 0x7f615c0b1a00 2023-11-26T07:16:11.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.664+0000 7f6163d1e700 1 -- 172.21.15.2:0/1466534639 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f615c1f4160 con 0x7f615c0b1a00 2023-11-26T07:16:11.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.665+0000 7f6163d1e700 1 -- 172.21.15.2:0/1466534639 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f615c068f50 con 0x7f615c0b1a00 2023-11-26T07:16:11.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.665+0000 7f61527fc700 1 -- 172.21.15.2:0/1466534639 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f6154024070 con 0x7f615c0b1a00 2023-11-26T07:16:11.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.666+0000 7f61527fc700 1 --2- 172.21.15.2:0/1466534639 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f614006b740 0x7f614006dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:11.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.666+0000 7f61527fc700 1 -- 172.21.15.2:0/1466534639 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f6154089a60 con 0x7f615c0b1a00 2023-11-26T07:16:11.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.666+0000 7f6161aba700 1 --2- 172.21.15.2:0/1466534639 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f614006b740 0x7f614006dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:11.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.666+0000 7f6161aba700 1 --2- 172.21.15.2:0/1466534639 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f614006b740 0x7f614006dc00 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6158001050 tx=0x7f6158009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:11.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.670+0000 7f61527fc700 1 -- 172.21.15.2:0/1466534639 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f61540565c0 con 0x7f615c0b1a00 2023-11-26T07:16:11.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.872+0000 7f6163d1e700 1 -- 172.21.15.2:0/1466534639 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f615c068670 con 0x7f615c0b1a00 2023-11-26T07:16:11.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.873+0000 7f61527fc700 1 -- 172.21.15.2:0/1466534639 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16625 (secure 0 0 0) 0x7f6154059be0 con 0x7f615c0b1a00 2023-11-26T07:16:11.875 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:16:11.875 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":61,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:16:09.414780+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:15:11.156119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-26T07:15:11.674003+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":61,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:16:11.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.875+0000 7f6163d1e700 1 -- 172.21.15.2:0/1466534639 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f614006b740 msgr2=0x7f614006dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:11.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.875+0000 7f6163d1e700 1 --2- 172.21.15.2:0/1466534639 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f614006b740 0x7f614006dc00 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6158001050 tx=0x7f6158009040 comp rx=0 tx=0).stop 2023-11-26T07:16:11.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.875+0000 7f6163d1e700 1 -- 172.21.15.2:0/1466534639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f615c0b1a00 msgr2=0x7f615c14d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:11.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.875+0000 7f6163d1e700 1 --2- 172.21.15.2:0/1466534639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f615c0b1a00 0x7f615c14d400 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f6154009f60 tx=0x7f6154009750 comp rx=0 tx=0).stop 2023-11-26T07:16:11.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.875+0000 7f6163d1e700 1 -- 172.21.15.2:0/1466534639 shutdown_connections 2023-11-26T07:16:11.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.875+0000 7f6163d1e700 1 --2- 172.21.15.2:0/1466534639 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f614006b740 0x7f614006dc00 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:11.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.875+0000 7f6163d1e700 1 --2- 172.21.15.2:0/1466534639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f615c0b1a00 0x7f615c14d400 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:11.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.875+0000 7f6163d1e700 1 --2- 172.21.15.2:0/1466534639 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6148004d90 0x7f615c157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:11.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.875+0000 7f6163d1e700 1 --2- 172.21.15.2:0/1466534639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f615c15a430 0x7f615c1f3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:11.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.875+0000 7f6163d1e700 1 -- 172.21.15.2:0/1466534639 >> 172.21.15.2:0/1466534639 conn(0x7f615c0d0bc0 msgr2=0x7f615c06b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:11.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.875+0000 7f6163d1e700 1 -- 172.21.15.2:0/1466534639 shutdown_connections 2023-11-26T07:16:11.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:11.875+0000 7f6163d1e700 1 -- 172.21.15.2:0/1466534639 wait complete. 2023-11-26T07:16:11.889 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:11:28.205739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:15:11.156119+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:15:11.674003+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 61, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:16:11.890 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:16:12.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.015+0000 7fc7afbdf700 1 Processor -- start 2023-11-26T07:16:12.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.016+0000 7fc7afbdf700 1 -- start start 2023-11-26T07:16:12.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.016+0000 7fc7afbdf700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc7a806b620 0x7fc7a80b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:12.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.016+0000 7fc7afbdf700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7a81629c0 con 0x7fc7a80b5ab0 2023-11-26T07:16:12.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.016+0000 7fc7afbdf700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7a8071f50 con 0x7fc7a806ee60 2023-11-26T07:16:12.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.016+0000 7fc7afbdf700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a8072230 con 0x7fc7a806b620 2023-11-26T07:16:12.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.017+0000 7fc7ad17a700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc7a80b5ab0 0x7fc7a8161ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34766/0 (socket says 172.21.15.2:34766) 2023-11-26T07:16:12.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.017+0000 7fc7ad17a700 1 -- 172.21.15.2:0/3607431364 learned_addr learned my addr 172.21.15.2:0/3607431364 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:16:12.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.017+0000 7fc7ad97b700 1 --2- 172.21.15.2:0/3607431364 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc7a806b620 0x7fc7a80b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:12.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.017+0000 7fc7ac979700 1 -- 172.21.15.2:0/3607431364 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3173330641 0 0) 0x7fc7a81629c0 con 0x7fc7a80b5ab0 2023-11-26T07:16:12.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.017+0000 7fc7ac979700 1 -- 172.21.15.2:0/3607431364 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7940035b0 con 0x7fc7a80b5ab0 2023-11-26T07:16:12.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.017+0000 7fc7ac979700 1 -- 172.21.15.2:0/3607431364 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3231345158 0 0) 0x7fc7940035b0 con 0x7fc7a80b5ab0 2023-11-26T07:16:12.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.017+0000 7fc7ad97b700 1 -- 172.21.15.2:0/3607431364 >> v1:172.21.15.192:6789/0 conn(0x7fc7a806ee60 legacy=0x7fc7a81622b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:12.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.017+0000 7fc7ad97b700 1 -- 172.21.15.2:0/3607431364 >> v1:172.21.15.2:6789/0 conn(0x7fc7a80b5ab0 legacy=0x7fc7a8161ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:12.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.017+0000 7fc7ad97b700 1 -- 172.21.15.2:0/3607431364 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a8072510 con 0x7fc7a806b620 2023-11-26T07:16:12.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.017+0000 7fc7ad97b700 1 --2- 172.21.15.2:0/3607431364 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc7a806b620 0x7fc7a80b3a40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4009870 tx=0x7fc7a4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=210469d64d6fbf06 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:12.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.018+0000 7fc7ac979700 1 -- 172.21.15.2:0/3607431364 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc798001670 con 0x7fc7a806b620 2023-11-26T07:16:12.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.018+0000 7fc7ac979700 1 -- 172.21.15.2:0/3607431364 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a4004030 con 0x7fc7a806b620 2023-11-26T07:16:12.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.018+0000 7fc7ac979700 1 -- 172.21.15.2:0/3607431364 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a40043c0 con 0x7fc7a806b620 2023-11-26T07:16:12.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.018+0000 7fc7afbdf700 1 -- 172.21.15.2:0/3607431364 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc7a806b620 msgr2=0x7fc7a80b3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:12.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.018+0000 7fc7afbdf700 1 --2- 172.21.15.2:0/3607431364 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc7a806b620 0x7fc7a80b3a40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4009870 tx=0x7fc7a4009b80 comp rx=0 tx=0).stop 2023-11-26T07:16:12.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.018+0000 7fc7afbdf700 1 -- 172.21.15.2:0/3607431364 shutdown_connections 2023-11-26T07:16:12.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.018+0000 7fc7afbdf700 1 --2- 172.21.15.2:0/3607431364 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc7a806b620 0x7fc7a80b3a40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:12.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.018+0000 7fc7afbdf700 1 -- 172.21.15.2:0/3607431364 >> 172.21.15.2:0/3607431364 conn(0x7fc7a80b2740 msgr2=0x7fc7a80b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:12.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.018+0000 7fc7afbdf700 1 -- 172.21.15.2:0/3607431364 shutdown_connections 2023-11-26T07:16:12.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.018+0000 7fc7afbdf700 1 -- 172.21.15.2:0/3607431364 wait complete. 2023-11-26T07:16:12.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.020+0000 7fc7afbdf700 1 Processor -- start 2023-11-26T07:16:12.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.020+0000 7fc7afbdf700 1 -- start start 2023-11-26T07:16:12.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.021+0000 7fc7afbdf700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc7a806b620 0x7fc7a813b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:12.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.021+0000 7fc7afbdf700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc7a806ee60 0x7fc7a813eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:12.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.021+0000 7fc7afbdf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7a80b5ab0 0x7fc7a80b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:12.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.021+0000 7fc7afbdf700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a813e7a0 con 0x7fc7a80b5ab0 2023-11-26T07:16:12.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.021+0000 7fc7afbdf700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a813ff00 con 0x7fc7a806b620 2023-11-26T07:16:12.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.021+0000 7fc7afbdf700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a81401e0 con 0x7fc7a806ee60 2023-11-26T07:16:12.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.021+0000 7fc7ae17c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7a80b5ab0 0x7fc7a80b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:12.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.021+0000 7fc7ae17c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7a80b5ab0 0x7fc7a80b0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43562/0 (socket says 172.21.15.2:43562) 2023-11-26T07:16:12.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.021+0000 7fc7ae17c700 1 -- 172.21.15.2:0/3345900342 learned_addr learned my addr 172.21.15.2:0/3345900342 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:12.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.021+0000 7fc7ad17a700 1 --2- 172.21.15.2:0/3345900342 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc7a806ee60 0x7fc7a813eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:12.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.021+0000 7fc7ad97b700 1 --2- 172.21.15.2:0/3345900342 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc7a806b620 0x7fc7a813b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:12.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.021+0000 7fc7ae17c700 1 -- 172.21.15.2:0/3345900342 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc7a806ee60 msgr2=0x7fc7a813eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:12.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.021+0000 7fc7ae17c700 1 --2- 172.21.15.2:0/3345900342 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc7a806ee60 0x7fc7a813eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:12.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.021+0000 7fc7ae17c700 1 -- 172.21.15.2:0/3345900342 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc7a806b620 msgr2=0x7fc7a813b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:12.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.021+0000 7fc7ae17c700 1 --2- 172.21.15.2:0/3345900342 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc7a806b620 0x7fc7a813b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:12.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.021+0000 7fc7ae17c700 1 -- 172.21.15.2:0/3345900342 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a40094a0 con 0x7fc7a80b5ab0 2023-11-26T07:16:12.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.021+0000 7fc7ae17c700 1 --2- 172.21.15.2:0/3345900342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7a80b5ab0 0x7fc7a80b0c00 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fc7a000c870 tx=0x7fc7a000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:12.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.022+0000 7fc79e7fc700 1 -- 172.21.15.2:0/3345900342 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a0003e30 con 0x7fc7a80b5ab0 2023-11-26T07:16:12.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.022+0000 7fc79e7fc700 1 -- 172.21.15.2:0/3345900342 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a000ce70 con 0x7fc7a80b5ab0 2023-11-26T07:16:12.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.022+0000 7fc79e7fc700 1 -- 172.21.15.2:0/3345900342 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a0005290 con 0x7fc7a80b5ab0 2023-11-26T07:16:12.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.022+0000 7fc7afbdf700 1 -- 172.21.15.2:0/3345900342 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7a81404c0 con 0x7fc7a80b5ab0 2023-11-26T07:16:12.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.022+0000 7fc7afbdf700 1 -- 172.21.15.2:0/3345900342 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7a813e390 con 0x7fc7a80b5ab0 2023-11-26T07:16:12.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.023+0000 7fc7afbdf700 1 -- 172.21.15.2:0/3345900342 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7a8140b10 con 0x7fc7a80b5ab0 2023-11-26T07:16:12.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.023+0000 7fc79e7fc700 1 -- 172.21.15.2:0/3345900342 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7fc7a00053f0 con 0x7fc7a80b5ab0 2023-11-26T07:16:12.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.024+0000 7fc79e7fc700 1 --2- 172.21.15.2:0/3345900342 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc78c06b740 0x7fc78c06dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:12.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.024+0000 7fc79e7fc700 1 -- 172.21.15.2:0/3345900342 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5765+0+0 (secure 0 0 0) 0x7fc7a008a650 con 0x7fc7a80b5ab0 2023-11-26T07:16:12.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.024+0000 7fc7ad97b700 1 --2- 172.21.15.2:0/3345900342 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc78c06b740 0x7fc78c06dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:12.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.024+0000 7fc7ad97b700 1 --2- 172.21.15.2:0/3345900342 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc78c06b740 0x7fc78c06dc00 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc7a40097c0 tx=0x7fc7a4008000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:12.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.028+0000 7fc79e7fc700 1 -- 172.21.15.2:0/3345900342 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc7a00547a0 con 0x7fc7a80b5ab0 2023-11-26T07:16:12.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.228+0000 7fc7afbdf700 1 -- 172.21.15.2:0/3345900342 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc7a8075480 con 0x7fc7a80b5ab0 2023-11-26T07:16:12.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.228+0000 7fc79e7fc700 1 -- 172.21.15.2:0/3345900342 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc7a0057dc0 con 0x7fc7a80b5ab0 2023-11-26T07:16:12.230 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-26T07:16:12.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.230+0000 7fc7afbdf700 1 -- 172.21.15.2:0/3345900342 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc78c06b740 msgr2=0x7fc78c06dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:12.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.230+0000 7fc7afbdf700 1 --2- 172.21.15.2:0/3345900342 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc78c06b740 0x7fc78c06dc00 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc7a40097c0 tx=0x7fc7a4008000 comp rx=0 tx=0).stop 2023-11-26T07:16:12.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.230+0000 7fc7afbdf700 1 -- 172.21.15.2:0/3345900342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7a80b5ab0 msgr2=0x7fc7a80b0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:12.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.230+0000 7fc7afbdf700 1 --2- 172.21.15.2:0/3345900342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7a80b5ab0 0x7fc7a80b0c00 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fc7a000c870 tx=0x7fc7a000cc30 comp rx=0 tx=0).stop 2023-11-26T07:16:12.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.230+0000 7fc7afbdf700 1 -- 172.21.15.2:0/3345900342 shutdown_connections 2023-11-26T07:16:12.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.230+0000 7fc7afbdf700 1 --2- 172.21.15.2:0/3345900342 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc78c06b740 0x7fc78c06dc00 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:12.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.230+0000 7fc7afbdf700 1 --2- 172.21.15.2:0/3345900342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7a80b5ab0 0x7fc7a80b0c00 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:12.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.230+0000 7fc7afbdf700 1 --2- 172.21.15.2:0/3345900342 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc7a806b620 0x7fc7a813b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:12.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.230+0000 7fc7afbdf700 1 --2- 172.21.15.2:0/3345900342 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc7a806ee60 0x7fc7a813eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:12.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.230+0000 7fc7afbdf700 1 -- 172.21.15.2:0/3345900342 >> 172.21.15.2:0/3345900342 conn(0x7fc7a80b2740 msgr2=0x7fc7a80cf770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:12.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.230+0000 7fc7afbdf700 1 -- 172.21.15.2:0/3345900342 shutdown_connections 2023-11-26T07:16:12.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.230+0000 7fc7afbdf700 1 -- 172.21.15.2:0/3345900342 wait complete. 2023-11-26T07:16:12.244 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:16:12.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.369+0000 7f5188af2700 1 Processor -- start 2023-11-26T07:16:12.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.369+0000 7f5188af2700 1 -- start start 2023-11-26T07:16:12.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.370+0000 7f5188af2700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f518406b620 0x7f51840b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:12.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.370+0000 7f5188af2700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51841629c0 con 0x7f51840b5ab0 2023-11-26T07:16:12.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.370+0000 7f5188af2700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5184071f50 con 0x7f518406ee60 2023-11-26T07:16:12.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.370+0000 7f5188af2700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5184072230 con 0x7f518406b620 2023-11-26T07:16:12.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.370+0000 7f5181d9b700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f51840b5ab0 0x7f5184161ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34776/0 (socket says 172.21.15.2:34776) 2023-11-26T07:16:12.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.370+0000 7f5181d9b700 1 -- 172.21.15.2:0/1380347187 learned_addr learned my addr 172.21.15.2:0/1380347187 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:16:12.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.370+0000 7f518259c700 1 --2- 172.21.15.2:0/1380347187 >> v2:172.21.15.192:3300/0 conn(0x7f518406b620 0x7f51840b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:12.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.370+0000 7f518159a700 1 -- 172.21.15.2:0/1380347187 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3946674997 0 0) 0x7f51841629c0 con 0x7f51840b5ab0 2023-11-26T07:16:12.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.370+0000 7f518159a700 1 -- 172.21.15.2:0/1380347187 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f516c0035b0 con 0x7f51840b5ab0 2023-11-26T07:16:12.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.371+0000 7f518159a700 1 -- 172.21.15.2:0/1380347187 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2507190003 0 0) 0x7f516c0035b0 con 0x7f51840b5ab0 2023-11-26T07:16:12.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.371+0000 7f518159a700 1 -- 172.21.15.2:0/1380347187 >> v2:172.21.15.192:3300/0 conn(0x7f518406b620 msgr2=0x7f51840b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:12.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.371+0000 7f518159a700 1 --2- 172.21.15.2:0/1380347187 >> v2:172.21.15.192:3300/0 conn(0x7f518406b620 0x7f51840b3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:12.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.371+0000 7f518159a700 1 -- 172.21.15.2:0/1380347187 >> v1:172.21.15.192:6789/0 conn(0x7f518406ee60 legacy=0x7f51841622b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:12.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.371+0000 7f518159a700 1 -- 172.21.15.2:0/1380347187 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5184072510 con 0x7f51840b5ab0 2023-11-26T07:16:12.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.371+0000 7f518159a700 1 -- 172.21.15.2:0/1380347187 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f5174001670 con 0x7f51840b5ab0 2023-11-26T07:16:12.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.371+0000 7f518159a700 1 -- 172.21.15.2:0/1380347187 >> v1:172.21.15.2:6789/0 conn(0x7f51840b5ab0 legacy=0x7f5184161ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:12.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.371+0000 7f518159a700 1 --2- 172.21.15.2:0/1380347187 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f516c003a00 0x7f516c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:12.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.371+0000 7f518159a700 1 --2- 172.21.15.2:0/1380347187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f516c004850 0x7f516c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:12.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.371+0000 7f518159a700 1 --2- 172.21.15.2:0/1380347187 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f516c005210 0x7f516c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:12.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.371+0000 7f518159a700 1 -- 172.21.15.2:0/1380347187 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5184072230 con 0x7f516c004850 2023-11-26T07:16:12.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.371+0000 7f518159a700 1 -- 172.21.15.2:0/1380347187 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f516c00c0b0 con 0x7f516c003a00 2023-11-26T07:16:12.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.371+0000 7f518159a700 1 -- 172.21.15.2:0/1380347187 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f516c00c270 con 0x7f516c005210 2023-11-26T07:16:12.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.371+0000 7f5181d9b700 1 --2- 172.21.15.2:0/1380347187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f516c004850 0x7f516c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:12.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.371+0000 7f518259c700 1 --2- 172.21.15.2:0/1380347187 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f516c003a00 0x7f516c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:12.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.371+0000 7f5182d9d700 1 --2- 172.21.15.2:0/1380347187 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f516c005210 0x7f516c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:12.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.371+0000 7f5181d9b700 1 -- 172.21.15.2:0/1380347187 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f516c005210 msgr2=0x7f516c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:12.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.371+0000 7f5181d9b700 1 --2- 172.21.15.2:0/1380347187 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f516c005210 0x7f516c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:12.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.371+0000 7f5181d9b700 1 -- 172.21.15.2:0/1380347187 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f516c003a00 msgr2=0x7f516c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:12.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.371+0000 7f5181d9b700 1 --2- 172.21.15.2:0/1380347187 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f516c003a00 0x7f516c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:12.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.371+0000 7f5181d9b700 1 -- 172.21.15.2:0/1380347187 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f516c0035b0 con 0x7f516c004850 2023-11-26T07:16:12.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.371+0000 7f5182d9d700 1 --2- 172.21.15.2:0/1380347187 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f516c005210 0x7f516c00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:16:12.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.371+0000 7f5182d9d700 1 -- 172.21.15.2:0/1380347187 reap_dead start 2023-11-26T07:16:12.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.371+0000 7f5181d9b700 1 --2- 172.21.15.2:0/1380347187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f516c004850 0x7f516c004cd0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f517400c270 tx=0x7f516c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e795371e4c5a085a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:12.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.372+0000 7f518159a700 1 -- 172.21.15.2:0/1380347187 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5174007c10 con 0x7f516c004850 2023-11-26T07:16:12.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.372+0000 7f518159a700 1 -- 172.21.15.2:0/1380347187 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517400cdb0 con 0x7f516c004850 2023-11-26T07:16:12.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.372+0000 7f518159a700 1 -- 172.21.15.2:0/1380347187 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5174005ba0 con 0x7f516c004850 2023-11-26T07:16:12.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.372+0000 7f5188af2700 1 -- 172.21.15.2:0/1380347187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f516c004850 msgr2=0x7f516c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:12.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.372+0000 7f5188af2700 1 --2- 172.21.15.2:0/1380347187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f516c004850 0x7f516c004cd0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f517400c270 tx=0x7f516c005880 comp rx=0 tx=0).stop 2023-11-26T07:16:12.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.372+0000 7f5188af2700 1 -- 172.21.15.2:0/1380347187 shutdown_connections 2023-11-26T07:16:12.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.372+0000 7f5188af2700 1 --2- 172.21.15.2:0/1380347187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f516c004850 0x7f516c004cd0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:12.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.372+0000 7f5188af2700 1 -- 172.21.15.2:0/1380347187 >> 172.21.15.2:0/1380347187 conn(0x7f51840b2740 msgr2=0x7f51840b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:12.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.372+0000 7f5188af2700 1 -- 172.21.15.2:0/1380347187 shutdown_connections 2023-11-26T07:16:12.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.372+0000 7f5188af2700 1 -- 172.21.15.2:0/1380347187 wait complete. 2023-11-26T07:16:12.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.374+0000 7f5188af2700 1 Processor -- start 2023-11-26T07:16:12.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.374+0000 7f5188af2700 1 -- start start 2023-11-26T07:16:12.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.374+0000 7f5188af2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f516c004850 0x7f518415dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:12.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.374+0000 7f5188af2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51840cf160 0x7f518413fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:12.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.374+0000 7f5188af2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5184145a60 0x7f5184145ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:12.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.374+0000 7f5188af2700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5184146420 con 0x7f5184145a60 2023-11-26T07:16:12.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.374+0000 7f5188af2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51841452a0 con 0x7f51840cf160 2023-11-26T07:16:12.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.374+0000 7f5188af2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5184144690 con 0x7f516c004850 2023-11-26T07:16:12.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.375+0000 7f5182d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5184145a60 0x7f5184145ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:12.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.375+0000 7f5182d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5184145a60 0x7f5184145ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43582/0 (socket says 172.21.15.2:43582) 2023-11-26T07:16:12.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.375+0000 7f5182d9d700 1 -- 172.21.15.2:0/2772499150 learned_addr learned my addr 172.21.15.2:0/2772499150 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:12.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.375+0000 7f518259c700 1 --2- 172.21.15.2:0/2772499150 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f516c004850 0x7f518415dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:12.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.375+0000 7f5181d9b700 1 --2- 172.21.15.2:0/2772499150 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51840cf160 0x7f518413fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:12.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.375+0000 7f5182d9d700 1 -- 172.21.15.2:0/2772499150 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f516c004850 msgr2=0x7f518415dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:12.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.375+0000 7f5182d9d700 1 --2- 172.21.15.2:0/2772499150 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f516c004850 0x7f518415dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:12.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.375+0000 7f5182d9d700 1 -- 172.21.15.2:0/2772499150 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51840cf160 msgr2=0x7f518413fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:12.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.375+0000 7f5182d9d700 1 --2- 172.21.15.2:0/2772499150 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51840cf160 0x7f518413fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:12.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.375+0000 7f5182d9d700 1 -- 172.21.15.2:0/2772499150 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5184144970 con 0x7f5184145a60 2023-11-26T07:16:12.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.375+0000 7f5182d9d700 1 --2- 172.21.15.2:0/2772499150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5184145a60 0x7f5184145ee0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f5184073020 tx=0x7f517c00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:12.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.375+0000 7f5172ffd700 1 -- 172.21.15.2:0/2772499150 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517c003c10 con 0x7f5184145a60 2023-11-26T07:16:12.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.375+0000 7f5172ffd700 1 -- 172.21.15.2:0/2772499150 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517c003d90 con 0x7f5184145a60 2023-11-26T07:16:12.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.375+0000 7f5188af2700 1 -- 172.21.15.2:0/2772499150 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5184144c50 con 0x7f5184145a60 2023-11-26T07:16:12.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.375+0000 7f5172ffd700 1 -- 172.21.15.2:0/2772499150 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517c005310 con 0x7f5184145a60 2023-11-26T07:16:12.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.375+0000 7f5188af2700 1 -- 172.21.15.2:0/2772499150 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51841401f0 con 0x7f5184145a60 2023-11-26T07:16:12.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.376+0000 7f5188af2700 1 -- 172.21.15.2:0/2772499150 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5184140380 con 0x7f5184145a60 2023-11-26T07:16:12.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.376+0000 7f5172ffd700 1 -- 172.21.15.2:0/2772499150 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f517c005470 con 0x7f5184145a60 2023-11-26T07:16:12.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.377+0000 7f5172ffd700 1 --2- 172.21.15.2:0/2772499150 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f516406b740 0x7f516406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:12.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.377+0000 7f5172ffd700 1 -- 172.21.15.2:0/2772499150 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f517c087f90 con 0x7f5184145a60 2023-11-26T07:16:12.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.377+0000 7f518259c700 1 --2- 172.21.15.2:0/2772499150 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f516406b740 0x7f516406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:12.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.378+0000 7f518259c700 1 --2- 172.21.15.2:0/2772499150 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f516406b740 0x7f516406dc00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5178009b20 tx=0x7f5178008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:12.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.381+0000 7f5172ffd700 1 -- 172.21.15.2:0/2772499150 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f517c054920 con 0x7f5184145a60 2023-11-26T07:16:12.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.581+0000 7f5188af2700 1 -- 172.21.15.2:0/2772499150 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5184145430 con 0x7f5184145a60 2023-11-26T07:16:12.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.581+0000 7f5172ffd700 1 -- 172.21.15.2:0/2772499150 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v61) v1 ==== 104+0+11 (secure 0 0 0) 0x7f517c088e60 con 0x7f5184145a60 2023-11-26T07:16:12.583 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-26T07:16:12.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.583+0000 7f5188af2700 1 -- 172.21.15.2:0/2772499150 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f516406b740 msgr2=0x7f516406dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:12.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.583+0000 7f5188af2700 1 --2- 172.21.15.2:0/2772499150 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f516406b740 0x7f516406dc00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5178009b20 tx=0x7f5178008040 comp rx=0 tx=0).stop 2023-11-26T07:16:12.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.583+0000 7f5188af2700 1 -- 172.21.15.2:0/2772499150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5184145a60 msgr2=0x7f5184145ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:12.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.583+0000 7f5188af2700 1 --2- 172.21.15.2:0/2772499150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5184145a60 0x7f5184145ee0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f5184073020 tx=0x7f517c00ee00 comp rx=0 tx=0).stop 2023-11-26T07:16:12.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.583+0000 7f5188af2700 1 -- 172.21.15.2:0/2772499150 shutdown_connections 2023-11-26T07:16:12.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.583+0000 7f5188af2700 1 --2- 172.21.15.2:0/2772499150 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f516406b740 0x7f516406dc00 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:12.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.583+0000 7f5188af2700 1 --2- 172.21.15.2:0/2772499150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5184145a60 0x7f5184145ee0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:12.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.583+0000 7f5188af2700 1 --2- 172.21.15.2:0/2772499150 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f516c004850 0x7f518415dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:12.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.583+0000 7f5188af2700 1 --2- 172.21.15.2:0/2772499150 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51840cf160 0x7f518413fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:12.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.583+0000 7f5188af2700 1 -- 172.21.15.2:0/2772499150 >> 172.21.15.2:0/2772499150 conn(0x7f51840b2740 msgr2=0x7f51841476b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:12.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.584+0000 7f5188af2700 1 -- 172.21.15.2:0/2772499150 shutdown_connections 2023-11-26T07:16:12.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.584+0000 7f5188af2700 1 -- 172.21.15.2:0/2772499150 wait complete. 2023-11-26T07:16:12.597 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:16:12.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.724+0000 7f3b10162700 1 Processor -- start 2023-11-26T07:16:12.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.724+0000 7f3b10162700 1 -- start start 2023-11-26T07:16:12.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.725+0000 7f3b10162700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3b0815e1c0 0x7f3b0806eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:12.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.725+0000 7f3b10162700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3b080b0e90 0x7f3b0806f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:12.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.725+0000 7f3b10162700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b080d1230 con 0x7f3b0806fa80 2023-11-26T07:16:12.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.725+0000 7f3b10162700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b0806ff10 con 0x7f3b0815e1c0 2023-11-26T07:16:12.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.725+0000 7f3b10162700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b080d0c70 con 0x7f3b080b0e90 2023-11-26T07:16:12.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.725+0000 7f3b0e6ff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f3b0806fa80 0x7f3b08161d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34800/0 (socket says 172.21.15.2:34800) 2023-11-26T07:16:12.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.725+0000 7f3b0e6ff700 1 -- 172.21.15.2:0/304825644 learned_addr learned my addr 172.21.15.2:0/304825644 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:16:12.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.725+0000 7f3b0d6fd700 1 --2- 172.21.15.2:0/304825644 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3b080b0e90 0x7f3b0806f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:12.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.725+0000 7f3b0defe700 1 --2- 172.21.15.2:0/304825644 >> v2:172.21.15.192:3300/0 conn(0x7f3b0815e1c0 0x7f3b0806eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:12.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.725+0000 7f3b0cefc700 1 -- 172.21.15.2:0/304825644 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2527265741 0 0) 0x7f3b080d1230 con 0x7f3b0806fa80 2023-11-26T07:16:12.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.726+0000 7f3b0cefc700 1 -- 172.21.15.2:0/304825644 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3af40035b0 con 0x7f3b0806fa80 2023-11-26T07:16:12.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.726+0000 7f3b0d6fd700 1 -- 172.21.15.2:0/304825644 >> v2:172.21.15.192:3300/0 conn(0x7f3b0815e1c0 msgr2=0x7f3b0806eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:12.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.726+0000 7f3b0d6fd700 1 --2- 172.21.15.2:0/304825644 >> v2:172.21.15.192:3300/0 conn(0x7f3b0815e1c0 0x7f3b0806eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:12.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.726+0000 7f3b0d6fd700 1 -- 172.21.15.2:0/304825644 >> v1:172.21.15.2:6789/0 conn(0x7f3b0806fa80 legacy=0x7f3b08161d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:12.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.726+0000 7f3b0cefc700 1 -- 172.21.15.2:0/304825644 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4249582990 0 0) 0x7f3af40035b0 con 0x7f3b0806fa80 2023-11-26T07:16:12.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.726+0000 7f3b0d6fd700 1 -- 172.21.15.2:0/304825644 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b080d0f50 con 0x7f3b080b0e90 2023-11-26T07:16:12.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.726+0000 7f3b0defe700 1 --2- 172.21.15.2:0/304825644 >> v2:172.21.15.192:3300/0 conn(0x7f3b0815e1c0 0x7f3b0806eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:16:12.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.726+0000 7f3b0d6fd700 1 --2- 172.21.15.2:0/304825644 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3b080b0e90 0x7f3b0806f540 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3b04009840 tx=0x7f3b04009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50dd6ba6ae18ab2c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:12.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.726+0000 7f3b0cefc700 1 -- 172.21.15.2:0/304825644 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b000019f0 con 0x7f3b080b0e90 2023-11-26T07:16:12.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.726+0000 7f3b0cefc700 1 -- 172.21.15.2:0/304825644 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b04004030 con 0x7f3b080b0e90 2023-11-26T07:16:12.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.726+0000 7f3b0cefc700 1 -- 172.21.15.2:0/304825644 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b040043a0 con 0x7f3b080b0e90 2023-11-26T07:16:12.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.727+0000 7f3b10162700 1 -- 172.21.15.2:0/304825644 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3b080b0e90 msgr2=0x7f3b0806f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:12.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.727+0000 7f3b10162700 1 --2- 172.21.15.2:0/304825644 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3b080b0e90 0x7f3b0806f540 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3b04009840 tx=0x7f3b04009b50 comp rx=0 tx=0).stop 2023-11-26T07:16:12.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.727+0000 7f3b10162700 1 -- 172.21.15.2:0/304825644 shutdown_connections 2023-11-26T07:16:12.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.727+0000 7f3b10162700 1 --2- 172.21.15.2:0/304825644 >> v2:172.21.15.192:3300/0 conn(0x7f3b0815e1c0 0x7f3b0806eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:12.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.727+0000 7f3b10162700 1 --2- 172.21.15.2:0/304825644 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3b080b0e90 0x7f3b0806f540 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:12.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.727+0000 7f3b10162700 1 -- 172.21.15.2:0/304825644 >> 172.21.15.2:0/304825644 conn(0x7f3b080b3720 msgr2=0x7f3b080b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:12.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.727+0000 7f3b10162700 1 -- 172.21.15.2:0/304825644 shutdown_connections 2023-11-26T07:16:12.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.727+0000 7f3b10162700 1 -- 172.21.15.2:0/304825644 wait complete. 2023-11-26T07:16:12.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.728+0000 7f3b10162700 1 Processor -- start 2023-11-26T07:16:12.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.728+0000 7f3b10162700 1 -- start start 2023-11-26T07:16:12.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.729+0000 7f3b10162700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b0806fa80 0x7f3b081f3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:12.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.729+0000 7f3b10162700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3b080b0e90 0x7f3b080b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:12.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.729+0000 7f3b10162700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b0815e1c0 0x7f3b080cb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:12.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.729+0000 7f3b10162700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b080b6400 con 0x7f3b0815e1c0 2023-11-26T07:16:12.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.729+0000 7f3b10162700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b080ca2f0 con 0x7f3b0806fa80 2023-11-26T07:16:12.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.729+0000 7f3b10162700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b081f3a70 con 0x7f3b080b0e90 2023-11-26T07:16:12.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.729+0000 7f3b0e6ff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b0815e1c0 0x7f3b080cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:12.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.729+0000 7f3b0e6ff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b0815e1c0 0x7f3b080cb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43596/0 (socket says 172.21.15.2:43596) 2023-11-26T07:16:12.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.729+0000 7f3b0e6ff700 1 -- 172.21.15.2:0/2989029398 learned_addr learned my addr 172.21.15.2:0/2989029398 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:12.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.729+0000 7f3b0d6fd700 1 --2- 172.21.15.2:0/2989029398 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3b080b0e90 0x7f3b080b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:12.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.729+0000 7f3b0defe700 1 --2- 172.21.15.2:0/2989029398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b0806fa80 0x7f3b081f3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:12.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.729+0000 7f3b0e6ff700 1 -- 172.21.15.2:0/2989029398 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3b080b0e90 msgr2=0x7f3b080b5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:12.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.729+0000 7f3b0e6ff700 1 --2- 172.21.15.2:0/2989029398 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3b080b0e90 0x7f3b080b5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:12.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.729+0000 7f3b0e6ff700 1 -- 172.21.15.2:0/2989029398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b0806fa80 msgr2=0x7f3b081f3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:12.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.729+0000 7f3b0e6ff700 1 --2- 172.21.15.2:0/2989029398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b0806fa80 0x7f3b081f3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:12.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.729+0000 7f3b0e6ff700 1 -- 172.21.15.2:0/2989029398 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af80094a0 con 0x7f3b0815e1c0 2023-11-26T07:16:12.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.729+0000 7f3b0e6ff700 1 --2- 172.21.15.2:0/2989029398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b0815e1c0 0x7f3b080cb300 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f3b00001ba0 tx=0x7f3b0000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:12.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.730+0000 7f3afe7fc700 1 -- 172.21.15.2:0/2989029398 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0000ac20 con 0x7f3b0815e1c0 2023-11-26T07:16:12.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.730+0000 7f3afe7fc700 1 -- 172.21.15.2:0/2989029398 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0000ad80 con 0x7f3b0815e1c0 2023-11-26T07:16:12.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.730+0000 7f3afe7fc700 1 -- 172.21.15.2:0/2989029398 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b00007310 con 0x7f3b0815e1c0 2023-11-26T07:16:12.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.730+0000 7f3b10162700 1 -- 172.21.15.2:0/2989029398 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b040094a0 con 0x7f3b0815e1c0 2023-11-26T07:16:12.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.730+0000 7f3b10162700 1 -- 172.21.15.2:0/2989029398 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b080ca820 con 0x7f3b0815e1c0 2023-11-26T07:16:12.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.731+0000 7f3b10162700 1 -- 172.21.15.2:0/2989029398 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b08075480 con 0x7f3b0815e1c0 2023-11-26T07:16:12.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.731+0000 7f3afe7fc700 1 -- 172.21.15.2:0/2989029398 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f3b00007470 con 0x7f3b0815e1c0 2023-11-26T07:16:12.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.731+0000 7f3afe7fc700 1 --2- 172.21.15.2:0/2989029398 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3aec06b740 0x7f3aec06dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:12.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.732+0000 7f3afe7fc700 1 -- 172.21.15.2:0/2989029398 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f3b00087ba0 con 0x7f3b0815e1c0 2023-11-26T07:16:12.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.732+0000 7f3b0defe700 1 --2- 172.21.15.2:0/2989029398 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3aec06b740 0x7f3aec06dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:12.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.732+0000 7f3b0defe700 1 --2- 172.21.15.2:0/2989029398 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3aec06b740 0x7f3aec06dc00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3af8009c60 tx=0x7f3af8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:12.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.736+0000 7f3afe7fc700 1 -- 172.21.15.2:0/2989029398 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3b00054530 con 0x7f3b0815e1c0 2023-11-26T07:16:12.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.936+0000 7f3b10162700 1 -- 172.21.15.2:0/2989029398 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3b080b4240 con 0x7f3b0815e1c0 2023-11-26T07:16:12.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.936+0000 7f3afe7fc700 1 -- 172.21.15.2:0/2989029398 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v61) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3b000180a0 con 0x7f3b0815e1c0 2023-11-26T07:16:12.938 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-26T07:16:12.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.938+0000 7f3b10162700 1 -- 172.21.15.2:0/2989029398 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3aec06b740 msgr2=0x7f3aec06dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:12.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.938+0000 7f3b10162700 1 --2- 172.21.15.2:0/2989029398 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3aec06b740 0x7f3aec06dc00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3af8009c60 tx=0x7f3af8008040 comp rx=0 tx=0).stop 2023-11-26T07:16:12.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.938+0000 7f3b10162700 1 -- 172.21.15.2:0/2989029398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b0815e1c0 msgr2=0x7f3b080cb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:12.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.938+0000 7f3b10162700 1 --2- 172.21.15.2:0/2989029398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b0815e1c0 0x7f3b080cb300 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f3b00001ba0 tx=0x7f3b0000a060 comp rx=0 tx=0).stop 2023-11-26T07:16:12.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.938+0000 7f3b10162700 1 -- 172.21.15.2:0/2989029398 shutdown_connections 2023-11-26T07:16:12.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.938+0000 7f3b10162700 1 --2- 172.21.15.2:0/2989029398 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3aec06b740 0x7f3aec06dc00 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:12.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.938+0000 7f3b10162700 1 --2- 172.21.15.2:0/2989029398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b0815e1c0 0x7f3b080cb300 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:12.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.938+0000 7f3b10162700 1 --2- 172.21.15.2:0/2989029398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b0806fa80 0x7f3b081f3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:12.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.938+0000 7f3b10162700 1 --2- 172.21.15.2:0/2989029398 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3b080b0e90 0x7f3b080b5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:12.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.938+0000 7f3b10162700 1 -- 172.21.15.2:0/2989029398 >> 172.21.15.2:0/2989029398 conn(0x7f3b080b3720 msgr2=0x7f3b080b3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:12.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.939+0000 7f3b10162700 1 -- 172.21.15.2:0/2989029398 shutdown_connections 2023-11-26T07:16:12.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:12.939+0000 7f3b10162700 1 -- 172.21.15.2:0/2989029398 wait complete. 2023-11-26T07:16:12.953 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-26T07:16:13.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.076+0000 7f0548000700 1 Processor -- start 2023-11-26T07:16:13.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.076+0000 7f0548000700 1 -- start start 2023-11-26T07:16:13.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.077+0000 7f0548000700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f05400cfc60 0x7f05400d0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:13.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.077+0000 7f0548000700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f054006f610 con 0x7f054015c010 2023-11-26T07:16:13.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.077+0000 7f0548000700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05400cdac0 con 0x7f05400d0650 2023-11-26T07:16:13.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.077+0000 7f0548000700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f054006ece0 con 0x7f05400cfc60 2023-11-26T07:16:13.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.077+0000 7f054559b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f05400cfc60 0x7f05400d0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:13.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.077+0000 7f0545d9c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f054015c010 0x7f05400cd2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34810/0 (socket says 172.21.15.2:34810) 2023-11-26T07:16:13.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.077+0000 7f0545d9c700 1 -- 172.21.15.2:0/4015197895 learned_addr learned my addr 172.21.15.2:0/4015197895 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:16:13.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.078+0000 7f054559b700 1 -- 172.21.15.2:0/4015197895 >> v1:172.21.15.192:6789/0 conn(0x7f05400d0650 legacy=0x7f054006faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:13.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.078+0000 7f054559b700 1 -- 172.21.15.2:0/4015197895 >> v1:172.21.15.2:6789/0 conn(0x7f054015c010 legacy=0x7f05400cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:13.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.078+0000 7f054559b700 1 -- 172.21.15.2:0/4015197895 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f054006efc0 con 0x7f05400cfc60 2023-11-26T07:16:13.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.078+0000 7f0544d9a700 1 -- 172.21.15.2:0/4015197895 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 128972096 0 0) 0x7f054006f610 con 0x7f054015c010 2023-11-26T07:16:13.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.078+0000 7f054559b700 1 --2- 172.21.15.2:0/4015197895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05400cfc60 0x7f05400d0110 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f053c009840 tx=0x7f053c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac9efc9ac13ad26a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:13.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.078+0000 7f0544d9a700 1 -- 172.21.15.2:0/4015197895 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c004230 con 0x7f05400cfc60 2023-11-26T07:16:13.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.078+0000 7f0544d9a700 1 -- 172.21.15.2:0/4015197895 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f053c004390 con 0x7f05400cfc60 2023-11-26T07:16:13.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.078+0000 7f0544d9a700 1 -- 172.21.15.2:0/4015197895 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c0036a0 con 0x7f05400cfc60 2023-11-26T07:16:13.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.078+0000 7f0548000700 1 -- 172.21.15.2:0/4015197895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05400cfc60 msgr2=0x7f05400d0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:13.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.078+0000 7f0548000700 1 --2- 172.21.15.2:0/4015197895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05400cfc60 0x7f05400d0110 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f053c009840 tx=0x7f053c009b50 comp rx=0 tx=0).stop 2023-11-26T07:16:13.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.078+0000 7f0548000700 1 -- 172.21.15.2:0/4015197895 shutdown_connections 2023-11-26T07:16:13.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.078+0000 7f0548000700 1 --2- 172.21.15.2:0/4015197895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05400cfc60 0x7f05400d0110 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:13.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.078+0000 7f0548000700 1 -- 172.21.15.2:0/4015197895 >> 172.21.15.2:0/4015197895 conn(0x7f05400b3790 msgr2=0x7f05400b3ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:13.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.079+0000 7f0548000700 1 -- 172.21.15.2:0/4015197895 shutdown_connections 2023-11-26T07:16:13.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.079+0000 7f0548000700 1 -- 172.21.15.2:0/4015197895 wait complete. 2023-11-26T07:16:13.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.080+0000 7f0548000700 1 Processor -- start 2023-11-26T07:16:13.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.080+0000 7f0548000700 1 -- start start 2023-11-26T07:16:13.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.081+0000 7f0548000700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05400cfc60 0x7f054015ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:13.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.081+0000 7f0548000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05400d0650 0x7f05401509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:13.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.081+0000 7f0548000700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f054015c010 0x7f0540159c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:13.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.081+0000 7f0548000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054015d990 con 0x7f05400d0650 2023-11-26T07:16:13.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.081+0000 7f0548000700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05401510b0 con 0x7f05400cfc60 2023-11-26T07:16:13.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.081+0000 7f0548000700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0540151390 con 0x7f054015c010 2023-11-26T07:16:13.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.081+0000 7f054559b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05400d0650 0x7f05401509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:13.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.081+0000 7f054559b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05400d0650 0x7f05401509b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43608/0 (socket says 172.21.15.2:43608) 2023-11-26T07:16:13.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.081+0000 7f054559b700 1 -- 172.21.15.2:0/4123531966 learned_addr learned my addr 172.21.15.2:0/4123531966 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:13.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.082+0000 7f054659d700 1 --2- 172.21.15.2:0/4123531966 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f054015c010 0x7f0540159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:13.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.082+0000 7f0545d9c700 1 --2- 172.21.15.2:0/4123531966 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05400cfc60 0x7f054015ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:13.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.082+0000 7f054559b700 1 -- 172.21.15.2:0/4123531966 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f054015c010 msgr2=0x7f0540159c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:13.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.082+0000 7f054559b700 1 --2- 172.21.15.2:0/4123531966 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f054015c010 0x7f0540159c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:13.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.082+0000 7f054559b700 1 -- 172.21.15.2:0/4123531966 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05400cfc60 msgr2=0x7f054015ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:13.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.082+0000 7f054559b700 1 --2- 172.21.15.2:0/4123531966 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05400cfc60 0x7f054015ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:13.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.082+0000 7f054559b700 1 -- 172.21.15.2:0/4123531966 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f053c0094a0 con 0x7f05400d0650 2023-11-26T07:16:13.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.082+0000 7f054659d700 1 --2- 172.21.15.2:0/4123531966 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f054015c010 0x7f0540159c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:16:13.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.082+0000 7f0545d9c700 1 --2- 172.21.15.2:0/4123531966 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05400cfc60 0x7f054015ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:16:13.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.082+0000 7f054559b700 1 --2- 172.21.15.2:0/4123531966 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05400d0650 0x7f05401509b0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f053c0090b0 tx=0x7f053c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:13.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.082+0000 7f05367fc700 1 -- 172.21.15.2:0/4123531966 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c011830 con 0x7f05400d0650 2023-11-26T07:16:13.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.082+0000 7f05367fc700 1 -- 172.21.15.2:0/4123531966 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f053c01e070 con 0x7f05400d0650 2023-11-26T07:16:13.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.082+0000 7f05367fc700 1 -- 172.21.15.2:0/4123531966 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c011bb0 con 0x7f05400d0650 2023-11-26T07:16:13.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.082+0000 7f0548000700 1 -- 172.21.15.2:0/4123531966 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0540151670 con 0x7f05400d0650 2023-11-26T07:16:13.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.082+0000 7f0548000700 1 -- 172.21.15.2:0/4123531966 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0540151c80 con 0x7f05400d0650 2023-11-26T07:16:13.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.083+0000 7f0548000700 1 -- 172.21.15.2:0/4123531966 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0540068670 con 0x7f05400d0650 2023-11-26T07:16:13.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.083+0000 7f05367fc700 1 -- 172.21.15.2:0/4123531966 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f053c011d10 con 0x7f05400d0650 2023-11-26T07:16:13.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.084+0000 7f05367fc700 1 --2- 172.21.15.2:0/4123531966 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f052406b740 0x7f052406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:13.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.084+0000 7f05367fc700 1 -- 172.21.15.2:0/4123531966 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f053c0893e0 con 0x7f05400d0650 2023-11-26T07:16:13.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.084+0000 7f0545d9c700 1 --2- 172.21.15.2:0/4123531966 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f052406b740 0x7f052406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:13.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.084+0000 7f0545d9c700 1 --2- 172.21.15.2:0/4123531966 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f052406b740 0x7f052406dc00 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0530000f60 tx=0x7f0530009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:13.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.088+0000 7f05367fc700 1 -- 172.21.15.2:0/4123531966 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f053c055d70 con 0x7f05400d0650 2023-11-26T07:16:13.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.306+0000 7f0548000700 1 -- 172.21.15.2:0/4123531966 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f054006b410 con 0x7f05400d0650 2023-11-26T07:16:13.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.306+0000 7f05367fc700 1 -- 172.21.15.2:0/4123531966 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v61) v1 ==== 80+0+0 (secure 0 0 0) 0x7f054006b410 con 0x7f05400d0650 2023-11-26T07:16:13.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.308+0000 7f0548000700 1 -- 172.21.15.2:0/4123531966 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f052406b740 msgr2=0x7f052406dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:13.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.308+0000 7f0548000700 1 --2- 172.21.15.2:0/4123531966 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f052406b740 0x7f052406dc00 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0530000f60 tx=0x7f0530009040 comp rx=0 tx=0).stop 2023-11-26T07:16:13.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.308+0000 7f0548000700 1 -- 172.21.15.2:0/4123531966 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05400d0650 msgr2=0x7f05401509b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:13.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.308+0000 7f0548000700 1 --2- 172.21.15.2:0/4123531966 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05400d0650 0x7f05401509b0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f053c0090b0 tx=0x7f053c004750 comp rx=0 tx=0).stop 2023-11-26T07:16:13.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.308+0000 7f0548000700 1 -- 172.21.15.2:0/4123531966 shutdown_connections 2023-11-26T07:16:13.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.308+0000 7f0548000700 1 --2- 172.21.15.2:0/4123531966 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f052406b740 0x7f052406dc00 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:13.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.308+0000 7f0548000700 1 --2- 172.21.15.2:0/4123531966 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f054015c010 0x7f0540159c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:13.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.308+0000 7f0548000700 1 --2- 172.21.15.2:0/4123531966 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05400cfc60 0x7f054015ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:13.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.308+0000 7f0548000700 1 --2- 172.21.15.2:0/4123531966 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05400d0650 0x7f05401509b0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:13.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.308+0000 7f0548000700 1 -- 172.21.15.2:0/4123531966 >> 172.21.15.2:0/4123531966 conn(0x7f05400b3790 msgr2=0x7f05400b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:13.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.308+0000 7f0548000700 1 -- 172.21.15.2:0/4123531966 shutdown_connections 2023-11-26T07:16:13.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.308+0000 7f0548000700 1 -- 172.21.15.2:0/4123531966 wait complete. 2023-11-26T07:16:13.314 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2023-11-26T07:16:13.324 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-26T07:16:13.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:13.324 DEBUG:teuthology.orchestra.run.smithi002:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-26T07:16:13.391 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2023-11-26T07:16:13.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:13.391 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-26T07:16:13.429 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:16:13.429 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:13.448 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:16:13.448 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:13.507 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:16:13.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.630+0000 7f542b19d700 1 Processor -- start 2023-11-26T07:16:13.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.631+0000 7f542b19d700 1 -- start start 2023-11-26T07:16:13.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.631+0000 7f542b19d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f542415f380 0x7f54240ced30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:13.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.631+0000 7f542b19d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54240b25f0 0x7f54240cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:13.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.631+0000 7f542b19d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f54240cfe30 0x7f54240b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:13.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.631+0000 7f542b19d700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54240ce8a0 con 0x7f54240cfe30 2023-11-26T07:16:13.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.631+0000 7f542b19d700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54240b44a0 con 0x7f542415f380 2023-11-26T07:16:13.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.631+0000 7f542b19d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54240b3210 con 0x7f54240b25f0 2023-11-26T07:16:13.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.632+0000 7f542a99c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f54240cfe30 0x7f54240b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:13.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.632+0000 7f542a99c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f54240cfe30 0x7f54240b48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43614/0 (socket says 172.21.15.2:43614) 2023-11-26T07:16:13.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.632+0000 7f542a99c700 1 -- 172.21.15.2:0/3038155810 learned_addr learned my addr 172.21.15.2:0/3038155810 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:13.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.632+0000 7f542999a700 1 --2- 172.21.15.2:0/3038155810 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54240b25f0 0x7f54240cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:13.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.632+0000 7f542a19b700 1 --2- 172.21.15.2:0/3038155810 >> v2:172.21.15.192:3300/0 conn(0x7f542415f380 0x7f54240ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:13.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.632+0000 7f542a99c700 1 -- 172.21.15.2:0/3038155810 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54240b25f0 msgr2=0x7f54240cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:13.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.632+0000 7f542a99c700 1 --2- 172.21.15.2:0/3038155810 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54240b25f0 0x7f54240cf8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:13.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.632+0000 7f542a99c700 1 -- 172.21.15.2:0/3038155810 >> v2:172.21.15.192:3300/0 conn(0x7f542415f380 msgr2=0x7f54240ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:13.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.632+0000 7f542a99c700 1 --2- 172.21.15.2:0/3038155810 >> v2:172.21.15.192:3300/0 conn(0x7f542415f380 0x7f54240ced30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:13.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.632+0000 7f542a99c700 1 -- 172.21.15.2:0/3038155810 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54240d0630 con 0x7f54240cfe30 2023-11-26T07:16:13.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.632+0000 7f542999a700 1 --2- 172.21.15.2:0/3038155810 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54240b25f0 0x7f54240cf8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:16:13.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.632+0000 7f542a19b700 1 --2- 172.21.15.2:0/3038155810 >> v2:172.21.15.192:3300/0 conn(0x7f542415f380 0x7f54240ced30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:16:13.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.632+0000 7f542a99c700 1 --2- 172.21.15.2:0/3038155810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54240cfe30 0x7f54240b48a0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f5424069350 tx=0x7f541c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63284a6947baeb4e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:13.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.632+0000 7f5429199700 1 -- 172.21.15.2:0/3038155810 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c00e070 con 0x7f54240cfe30 2023-11-26T07:16:13.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.632+0000 7f5429199700 1 -- 172.21.15.2:0/3038155810 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541c00b9c0 con 0x7f54240cfe30 2023-11-26T07:16:13.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.632+0000 7f5429199700 1 -- 172.21.15.2:0/3038155810 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c00bd70 con 0x7f54240cfe30 2023-11-26T07:16:13.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.633+0000 7f542b19d700 1 -- 172.21.15.2:0/3038155810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54240cfe30 msgr2=0x7f54240b48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:13.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.633+0000 7f542b19d700 1 --2- 172.21.15.2:0/3038155810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54240cfe30 0x7f54240b48a0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f5424069350 tx=0x7f541c00b330 comp rx=0 tx=0).stop 2023-11-26T07:16:13.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.633+0000 7f542b19d700 1 -- 172.21.15.2:0/3038155810 shutdown_connections 2023-11-26T07:16:13.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.633+0000 7f542b19d700 1 --2- 172.21.15.2:0/3038155810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54240cfe30 0x7f54240b48a0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:13.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.633+0000 7f542b19d700 1 --2- 172.21.15.2:0/3038155810 >> v2:172.21.15.192:3300/0 conn(0x7f542415f380 0x7f54240ced30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:13.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.633+0000 7f542b19d700 1 --2- 172.21.15.2:0/3038155810 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54240b25f0 0x7f54240cf8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:13.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.633+0000 7f542b19d700 1 -- 172.21.15.2:0/3038155810 >> 172.21.15.2:0/3038155810 conn(0x7f54240b35a0 msgr2=0x7f54240b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:13.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.633+0000 7f542b19d700 1 -- 172.21.15.2:0/3038155810 shutdown_connections 2023-11-26T07:16:13.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.633+0000 7f542b19d700 1 -- 172.21.15.2:0/3038155810 wait complete. 2023-11-26T07:16:13.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.634+0000 7f542b19d700 1 Processor -- start 2023-11-26T07:16:13.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.634+0000 7f542b19d700 1 -- start start 2023-11-26T07:16:13.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.635+0000 7f542b19d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54240b25f0 0x7f54240cd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:13.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.635+0000 7f542b19d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54240cfe30 0x7f54240cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:13.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.635+0000 7f542b19d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f542415f380 0x7f54241583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:13.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.635+0000 7f542b19d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54240c9290 con 0x7f542415f380 2023-11-26T07:16:13.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.635+0000 7f542b19d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5424159430 con 0x7f54240cfe30 2023-11-26T07:16:13.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.635+0000 7f542b19d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5424157e60 con 0x7f54240b25f0 2023-11-26T07:16:13.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.635+0000 7f542a99c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f542415f380 0x7f54241583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:13.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.635+0000 7f542a99c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f542415f380 0x7f54241583d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43620/0 (socket says 172.21.15.2:43620) 2023-11-26T07:16:13.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.635+0000 7f542a99c700 1 -- 172.21.15.2:0/2919895561 learned_addr learned my addr 172.21.15.2:0/2919895561 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:13.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.635+0000 7f542a19b700 1 --2- 172.21.15.2:0/2919895561 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54240b25f0 0x7f54240cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:13.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.635+0000 7f542999a700 1 --2- 172.21.15.2:0/2919895561 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54240cfe30 0x7f54240cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:13.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.635+0000 7f542a99c700 1 -- 172.21.15.2:0/2919895561 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54240b25f0 msgr2=0x7f54240cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:13.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.635+0000 7f542a99c700 1 --2- 172.21.15.2:0/2919895561 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54240b25f0 0x7f54240cd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:13.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.635+0000 7f542a99c700 1 -- 172.21.15.2:0/2919895561 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54240cfe30 msgr2=0x7f54240cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:13.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.635+0000 7f542a99c700 1 --2- 172.21.15.2:0/2919895561 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54240cfe30 0x7f54240cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:13.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.635+0000 7f542a99c700 1 -- 172.21.15.2:0/2919895561 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f541c009b30 con 0x7f542415f380 2023-11-26T07:16:13.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.635+0000 7f542a19b700 1 --2- 172.21.15.2:0/2919895561 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54240b25f0 0x7f54240cd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:16:13.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.635+0000 7f542999a700 1 --2- 172.21.15.2:0/2919895561 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54240cfe30 0x7f54240cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:16:13.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.635+0000 7f542a99c700 1 --2- 172.21.15.2:0/2919895561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f542415f380 0x7f54241583d0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f54240d2af0 tx=0x7f541c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:13.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.636+0000 7f541affd700 1 -- 172.21.15.2:0/2919895561 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c004310 con 0x7f542415f380 2023-11-26T07:16:13.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.636+0000 7f541affd700 1 -- 172.21.15.2:0/2919895561 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541c004470 con 0x7f542415f380 2023-11-26T07:16:13.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.636+0000 7f542b19d700 1 -- 172.21.15.2:0/2919895561 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f542415f8e0 con 0x7f542415f380 2023-11-26T07:16:13.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.636+0000 7f541affd700 1 -- 172.21.15.2:0/2919895561 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c004820 con 0x7f542415f380 2023-11-26T07:16:13.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.636+0000 7f542b19d700 1 -- 172.21.15.2:0/2919895561 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54240c8bd0 con 0x7f542415f380 2023-11-26T07:16:13.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.637+0000 7f542b19d700 1 -- 172.21.15.2:0/2919895561 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f542406ba80 con 0x7f542415f380 2023-11-26T07:16:13.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.637+0000 7f541affd700 1 -- 172.21.15.2:0/2919895561 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f541c01c440 con 0x7f542415f380 2023-11-26T07:16:13.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.638+0000 7f541affd700 1 --2- 172.21.15.2:0/2919895561 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f540806b740 0x7f540806dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:13.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.638+0000 7f541affd700 1 -- 172.21.15.2:0/2919895561 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f541c089490 con 0x7f542415f380 2023-11-26T07:16:13.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.638+0000 7f542a19b700 1 --2- 172.21.15.2:0/2919895561 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f540806b740 0x7f540806dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:13.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.638+0000 7f542a19b700 1 --2- 172.21.15.2:0/2919895561 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f540806b740 0x7f540806dc00 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5414006fd0 tx=0x7f5414008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:13.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.642+0000 7f541affd700 1 -- 172.21.15.2:0/2919895561 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f541c055f90 con 0x7f542415f380 2023-11-26T07:16:13.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.844+0000 7f542b19d700 1 -- 172.21.15.2:0/2919895561 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5424075300 con 0x7f542415f380 2023-11-26T07:16:13.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.845+0000 7f541affd700 1 -- 172.21.15.2:0/2919895561 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16625 (secure 0 0 0) 0x7f541c02a090 con 0x7f542415f380 2023-11-26T07:16:13.848 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:16:13.848 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":61,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:16:09.414780+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:15:11.156119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-26T07:15:11.674003+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":61,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:16:13.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.848+0000 7f542b19d700 1 -- 172.21.15.2:0/2919895561 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f540806b740 msgr2=0x7f540806dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:13.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.848+0000 7f542b19d700 1 --2- 172.21.15.2:0/2919895561 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f540806b740 0x7f540806dc00 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5414006fd0 tx=0x7f5414008040 comp rx=0 tx=0).stop 2023-11-26T07:16:13.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.848+0000 7f542b19d700 1 -- 172.21.15.2:0/2919895561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f542415f380 msgr2=0x7f54241583d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:13.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.848+0000 7f542b19d700 1 --2- 172.21.15.2:0/2919895561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f542415f380 0x7f54241583d0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f54240d2af0 tx=0x7f541c004ad0 comp rx=0 tx=0).stop 2023-11-26T07:16:13.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.848+0000 7f542b19d700 1 -- 172.21.15.2:0/2919895561 shutdown_connections 2023-11-26T07:16:13.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.848+0000 7f542b19d700 1 --2- 172.21.15.2:0/2919895561 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f540806b740 0x7f540806dc00 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:13.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.848+0000 7f542b19d700 1 --2- 172.21.15.2:0/2919895561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f542415f380 0x7f54241583d0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:13.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.848+0000 7f542b19d700 1 --2- 172.21.15.2:0/2919895561 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54240b25f0 0x7f54240cd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:13.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.848+0000 7f542b19d700 1 --2- 172.21.15.2:0/2919895561 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54240cfe30 0x7f54240cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:13.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.848+0000 7f542b19d700 1 -- 172.21.15.2:0/2919895561 >> 172.21.15.2:0/2919895561 conn(0x7f54240b35a0 msgr2=0x7f542415c990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:13.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.848+0000 7f542b19d700 1 -- 172.21.15.2:0/2919895561 shutdown_connections 2023-11-26T07:16:13.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.848+0000 7f542b19d700 1 -- 172.21.15.2:0/2919895561 wait complete. 2023-11-26T07:16:13.863 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:11:28.205739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:15:11.156119+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:15:11.674003+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 61, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:16:13.863 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:16:13.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.989+0000 7fa8d16d8700 1 Processor -- start 2023-11-26T07:16:13.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.989+0000 7fa8d16d8700 1 -- start start 2023-11-26T07:16:13.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.990+0000 7fa8d16d8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8cc0d0c50 0x7fa8cc0d26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:13.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.990+0000 7fa8d16d8700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa8cc0d49f0 0x7fa8cc0b6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:13.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.990+0000 7fa8d16d8700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8cc0b5370 con 0x7fa8cc0d0870 2023-11-26T07:16:13.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.990+0000 7fa8d16d8700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8cc0d2f80 con 0x7fa8cc0d49f0 2023-11-26T07:16:13.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.990+0000 7fa8d16d8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc0cff70 con 0x7fa8cc0d0c50 2023-11-26T07:16:13.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.990+0000 7fa8caffd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa8cc0d0870 0x7fa8cc0cf860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34834/0 (socket says 172.21.15.2:34834) 2023-11-26T07:16:13.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.990+0000 7fa8caffd700 1 -- 172.21.15.2:0/2424274885 learned_addr learned my addr 172.21.15.2:0/2424274885 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:16:13.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.990+0000 7fa8c9ffb700 1 -- 172.21.15.2:0/2424274885 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3950382978 0 0) 0x7fa8cc0b5370 con 0x7fa8cc0d0870 2023-11-26T07:16:13.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.990+0000 7fa8c9ffb700 1 -- 172.21.15.2:0/2424274885 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8b80035b0 con 0x7fa8cc0d0870 2023-11-26T07:16:13.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.990+0000 7fa8ca7fc700 1 --2- 172.21.15.2:0/2424274885 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8cc0d0c50 0x7fa8cc0d26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:13.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.990+0000 7fa8cb7fe700 1 --2- 172.21.15.2:0/2424274885 >> v2:172.21.15.192:3300/0 conn(0x7fa8cc0d49f0 0x7fa8cc0b6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:13.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.991+0000 7fa8c9ffb700 1 -- 172.21.15.2:0/2424274885 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3320012418 0 0) 0x7fa8b80035b0 con 0x7fa8cc0d0870 2023-11-26T07:16:13.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.991+0000 7fa8c9ffb700 1 -- 172.21.15.2:0/2424274885 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8cc0d0c50 msgr2=0x7fa8cc0d26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:13.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.991+0000 7fa8c9ffb700 1 --2- 172.21.15.2:0/2424274885 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8cc0d0c50 0x7fa8cc0d26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:13.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.991+0000 7fa8c9ffb700 1 -- 172.21.15.2:0/2424274885 >> v2:172.21.15.192:3300/0 conn(0x7fa8cc0d49f0 msgr2=0x7fa8cc0b6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:13.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.991+0000 7fa8c9ffb700 1 --2- 172.21.15.2:0/2424274885 >> v2:172.21.15.192:3300/0 conn(0x7fa8cc0d49f0 0x7fa8cc0b6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:13.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.991+0000 7fa8c9ffb700 1 -- 172.21.15.2:0/2424274885 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8cc0ceae0 con 0x7fa8cc0d0870 2023-11-26T07:16:13.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.991+0000 7fa8c9ffb700 1 -- 172.21.15.2:0/2424274885 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7fa8bc001670 con 0x7fa8cc0d0870 2023-11-26T07:16:13.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.991+0000 7fa8c9ffb700 1 -- 172.21.15.2:0/2424274885 >> v1:172.21.15.2:6789/0 conn(0x7fa8cc0d0870 legacy=0x7fa8cc0cf860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:13.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.991+0000 7fa8c9ffb700 1 --2- 172.21.15.2:0/2424274885 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8b8003a00 0x7fa8b8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:13.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.991+0000 7fa8c9ffb700 1 --2- 172.21.15.2:0/2424274885 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8cc0d0c50 0x7fa8b8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:13.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.991+0000 7fa8c9ffb700 1 --2- 172.21.15.2:0/2424274885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8b8004d90 0x7fa8b8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:13.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.991+0000 7fa8c9ffb700 1 -- 172.21.15.2:0/2424274885 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc0d2f80 con 0x7fa8b8004d90 2023-11-26T07:16:13.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.991+0000 7fa8c9ffb700 1 -- 172.21.15.2:0/2424274885 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc0cff70 con 0x7fa8b8003a00 2023-11-26T07:16:13.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.991+0000 7fa8c9ffb700 1 -- 172.21.15.2:0/2424274885 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b800ba10 con 0x7fa8cc0d0c50 2023-11-26T07:16:13.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.991+0000 7fa8cb7fe700 1 --2- 172.21.15.2:0/2424274885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8b8004d90 0x7fa8b8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:13.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.991+0000 7fa8ca7fc700 1 --2- 172.21.15.2:0/2424274885 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8cc0d0c50 0x7fa8b8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:13.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.991+0000 7fa8caffd700 1 --2- 172.21.15.2:0/2424274885 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8b8003a00 0x7fa8b8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:13.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.991+0000 7fa8cb7fe700 1 -- 172.21.15.2:0/2424274885 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8cc0d0c50 msgr2=0x7fa8b8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:13.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.991+0000 7fa8cb7fe700 1 --2- 172.21.15.2:0/2424274885 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8cc0d0c50 0x7fa8b8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:13.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.991+0000 7fa8cb7fe700 1 -- 172.21.15.2:0/2424274885 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8b8003a00 msgr2=0x7fa8b8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:13.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.991+0000 7fa8cb7fe700 1 --2- 172.21.15.2:0/2424274885 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8b8003a00 0x7fa8b8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:13.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.991+0000 7fa8cb7fe700 1 -- 172.21.15.2:0/2424274885 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b80035b0 con 0x7fa8b8004d90 2023-11-26T07:16:13.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.991+0000 7fa8cb7fe700 1 --2- 172.21.15.2:0/2424274885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8b8004d90 0x7fa8b8005210 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fa8c400e170 tx=0x7fa8b8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b42fdac292f042b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:13.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.992+0000 7fa8c9ffb700 1 -- 172.21.15.2:0/2424274885 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c400ec90 con 0x7fa8b8004d90 2023-11-26T07:16:13.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.992+0000 7fa8c9ffb700 1 -- 172.21.15.2:0/2424274885 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c400f040 con 0x7fa8b8004d90 2023-11-26T07:16:13.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.992+0000 7fa8c9ffb700 1 -- 172.21.15.2:0/2424274885 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4014480 con 0x7fa8b8004d90 2023-11-26T07:16:13.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.992+0000 7fa8d16d8700 1 -- 172.21.15.2:0/2424274885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8b8004d90 msgr2=0x7fa8b8005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:13.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.992+0000 7fa8d16d8700 1 --2- 172.21.15.2:0/2424274885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8b8004d90 0x7fa8b8005210 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fa8c400e170 tx=0x7fa8b8005880 comp rx=0 tx=0).stop 2023-11-26T07:16:13.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.992+0000 7fa8cb7fe700 1 -- 172.21.15.2:0/2424274885 reap_dead start 2023-11-26T07:16:13.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.992+0000 7fa8d16d8700 1 -- 172.21.15.2:0/2424274885 shutdown_connections 2023-11-26T07:16:13.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.992+0000 7fa8d16d8700 1 -- 172.21.15.2:0/2424274885 >> 172.21.15.2:0/2424274885 conn(0x7fa8cc0d3ed0 msgr2=0x7fa8cc0d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:13.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.992+0000 7fa8d16d8700 1 -- 172.21.15.2:0/2424274885 shutdown_connections 2023-11-26T07:16:13.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.992+0000 7fa8d16d8700 1 -- 172.21.15.2:0/2424274885 wait complete. 2023-11-26T07:16:14.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.993+0000 7fa8d16d8700 1 Processor -- start 2023-11-26T07:16:14.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.994+0000 7fa8d16d8700 1 -- start start 2023-11-26T07:16:14.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.994+0000 7fa8d16d8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8cc149550 0x7fa8cc14be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:14.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.994+0000 7fa8d16d8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8cc0c75e0 0x7fa8cc0b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:14.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.994+0000 7fa8d16d8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8cc14c370 0x7fa8cc0b2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:14.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.994+0000 7fa8d16d8700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc14c880 con 0x7fa8cc14c370 2023-11-26T07:16:14.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.994+0000 7fa8d16d8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc14cb60 con 0x7fa8cc149550 2023-11-26T07:16:14.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.994+0000 7fa8d16d8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc0c9500 con 0x7fa8cc0c75e0 2023-11-26T07:16:14.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.994+0000 7fa8cb7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8cc14c370 0x7fa8cc0b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:14.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.994+0000 7fa8cb7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8cc14c370 0x7fa8cc0b2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43640/0 (socket says 172.21.15.2:43640) 2023-11-26T07:16:14.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.994+0000 7fa8cb7fe700 1 -- 172.21.15.2:0/2701735404 learned_addr learned my addr 172.21.15.2:0/2701735404 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:14.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.995+0000 7fa8ca7fc700 1 --2- 172.21.15.2:0/2701735404 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8cc0c75e0 0x7fa8cc0b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:14.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.995+0000 7fa8caffd700 1 --2- 172.21.15.2:0/2701735404 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8cc149550 0x7fa8cc14be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:14.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.995+0000 7fa8cb7fe700 1 -- 172.21.15.2:0/2701735404 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8cc0c75e0 msgr2=0x7fa8cc0b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:14.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.995+0000 7fa8cb7fe700 1 --2- 172.21.15.2:0/2701735404 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8cc0c75e0 0x7fa8cc0b1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:14.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.995+0000 7fa8cb7fe700 1 -- 172.21.15.2:0/2701735404 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8cc149550 msgr2=0x7fa8cc14be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:14.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.995+0000 7fa8cb7fe700 1 --2- 172.21.15.2:0/2701735404 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8cc149550 0x7fa8cc14be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:14.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.995+0000 7fa8cb7fe700 1 -- 172.21.15.2:0/2701735404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8cc0c97e0 con 0x7fa8cc14c370 2023-11-26T07:16:14.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.995+0000 7fa8ca7fc700 1 --2- 172.21.15.2:0/2701735404 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8cc0c75e0 0x7fa8cc0b1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:16:14.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.995+0000 7fa8cb7fe700 1 --2- 172.21.15.2:0/2701735404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8cc14c370 0x7fa8cc0b2050 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4016000 tx=0x7fa8c4004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:14.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.995+0000 7fa8c37fe700 1 -- 172.21.15.2:0/2701735404 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4007000 con 0x7fa8cc14c370 2023-11-26T07:16:14.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.995+0000 7fa8c37fe700 1 -- 172.21.15.2:0/2701735404 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c400ee80 con 0x7fa8cc14c370 2023-11-26T07:16:14.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.995+0000 7fa8c37fe700 1 -- 172.21.15.2:0/2701735404 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4003a20 con 0x7fa8cc14c370 2023-11-26T07:16:14.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.995+0000 7fa8d16d8700 1 -- 172.21.15.2:0/2701735404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8cc150000 con 0x7fa8cc14c370 2023-11-26T07:16:14.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.995+0000 7fa8d16d8700 1 -- 172.21.15.2:0/2701735404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8cc149b10 con 0x7fa8cc14c370 2023-11-26T07:16:14.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.996+0000 7fa8d16d8700 1 -- 172.21.15.2:0/2701735404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8cc0b57c0 con 0x7fa8cc14c370 2023-11-26T07:16:14.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.997+0000 7fa8c37fe700 1 -- 172.21.15.2:0/2701735404 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7fa8c4003c00 con 0x7fa8cc14c370 2023-11-26T07:16:14.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.997+0000 7fa8c37fe700 1 --2- 172.21.15.2:0/2701735404 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa8ac06b740 0x7fa8ac06dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:14.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.997+0000 7fa8c37fe700 1 -- 172.21.15.2:0/2701735404 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5765+0+0 (secure 0 0 0) 0x7fa8c4088f50 con 0x7fa8cc14c370 2023-11-26T07:16:14.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.997+0000 7fa8caffd700 1 --2- 172.21.15.2:0/2701735404 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa8ac06b740 0x7fa8ac06dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:14.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:13.998+0000 7fa8caffd700 1 --2- 172.21.15.2:0/2701735404 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa8ac06b740 0x7fa8ac06dc00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc0048d0 tx=0x7fa8bc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:14.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.001+0000 7fa8c37fe700 1 -- 172.21.15.2:0/2701735404 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa8c4055ab0 con 0x7fa8cc14c370 2023-11-26T07:16:14.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.202+0000 7fa8d16d8700 1 -- 172.21.15.2:0/2701735404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa8cc0c9970 con 0x7fa8cc14c370 2023-11-26T07:16:14.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.202+0000 7fa8c37fe700 1 -- 172.21.15.2:0/2701735404 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa8c40590d0 con 0x7fa8cc14c370 2023-11-26T07:16:14.204 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-26T07:16:14.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.204+0000 7fa8d16d8700 1 -- 172.21.15.2:0/2701735404 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa8ac06b740 msgr2=0x7fa8ac06dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:14.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.204+0000 7fa8d16d8700 1 --2- 172.21.15.2:0/2701735404 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa8ac06b740 0x7fa8ac06dc00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc0048d0 tx=0x7fa8bc009040 comp rx=0 tx=0).stop 2023-11-26T07:16:14.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.204+0000 7fa8d16d8700 1 -- 172.21.15.2:0/2701735404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8cc14c370 msgr2=0x7fa8cc0b2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:14.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.204+0000 7fa8d16d8700 1 --2- 172.21.15.2:0/2701735404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8cc14c370 0x7fa8cc0b2050 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4016000 tx=0x7fa8c4004b40 comp rx=0 tx=0).stop 2023-11-26T07:16:14.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.204+0000 7fa8d16d8700 1 -- 172.21.15.2:0/2701735404 shutdown_connections 2023-11-26T07:16:14.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.204+0000 7fa8d16d8700 1 --2- 172.21.15.2:0/2701735404 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa8ac06b740 0x7fa8ac06dc00 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:14.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.204+0000 7fa8d16d8700 1 --2- 172.21.15.2:0/2701735404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8cc14c370 0x7fa8cc0b2050 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:14.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.204+0000 7fa8d16d8700 1 --2- 172.21.15.2:0/2701735404 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8cc149550 0x7fa8cc14be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:14.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.204+0000 7fa8d16d8700 1 --2- 172.21.15.2:0/2701735404 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8cc0c75e0 0x7fa8cc0b1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:14.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.204+0000 7fa8d16d8700 1 -- 172.21.15.2:0/2701735404 >> 172.21.15.2:0/2701735404 conn(0x7fa8cc0d3ed0 msgr2=0x7fa8cc0b8350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:14.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.204+0000 7fa8d16d8700 1 -- 172.21.15.2:0/2701735404 shutdown_connections 2023-11-26T07:16:14.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.204+0000 7fa8d16d8700 1 -- 172.21.15.2:0/2701735404 wait complete. 2023-11-26T07:16:14.218 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:16:14.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.344+0000 7f45ec349700 1 Processor -- start 2023-11-26T07:16:14.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.344+0000 7f45ec349700 1 -- start start 2023-11-26T07:16:14.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.345+0000 7f45ec349700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f45e40cecd0 0x7f45e415c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:14.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.345+0000 7f45ec349700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45e40d0a90 con 0x7f45e415bde0 2023-11-26T07:16:14.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.345+0000 7f45ec349700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45e406ee10 con 0x7f45e40cf2b0 2023-11-26T07:16:14.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.345+0000 7f45ec349700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45e406f0f0 con 0x7f45e40cecd0 2023-11-26T07:16:14.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.345+0000 7f45ea8e6700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f45e40cecd0 0x7f45e415c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:14.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.345+0000 7f45ea8e6700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f45e40cecd0 0x7f45e415c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43648/0 (socket says 172.21.15.2:43648) 2023-11-26T07:16:14.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.345+0000 7f45ea0e5700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f45e415bde0 0x7f45e40d01b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34854/0 (socket says 172.21.15.2:34854) 2023-11-26T07:16:14.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.345+0000 7f45ea8e6700 1 -- 172.21.15.2:0/2397758342 learned_addr learned my addr 172.21.15.2:0/2397758342 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:14.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.346+0000 7f45ea8e6700 1 -- 172.21.15.2:0/2397758342 >> v1:172.21.15.192:6789/0 conn(0x7f45e40cf2b0 legacy=0x7f45e40ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:14.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.346+0000 7f45ea8e6700 1 -- 172.21.15.2:0/2397758342 >> v1:172.21.15.2:6789/0 conn(0x7f45e415bde0 legacy=0x7f45e40d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:14.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.346+0000 7f45ea8e6700 1 -- 172.21.15.2:0/2397758342 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e406f3d0 con 0x7f45e40cecd0 2023-11-26T07:16:14.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.346+0000 7f45ea8e6700 1 --2- 172.21.15.2:0/2397758342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45e40cecd0 0x7f45e415c1c0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f45dc009e50 tx=0x7f45dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd98ac6e2e61d73c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:14.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.346+0000 7f45e90e3700 1 -- 172.21.15.2:0/2397758342 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc00e070 con 0x7f45e40cecd0 2023-11-26T07:16:14.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.346+0000 7f45e90e3700 1 -- 172.21.15.2:0/2397758342 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45dc00b9c0 con 0x7f45e40cecd0 2023-11-26T07:16:14.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.346+0000 7f45e90e3700 1 -- 172.21.15.2:0/2397758342 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc00bd70 con 0x7f45e40cecd0 2023-11-26T07:16:14.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.347+0000 7f45ec349700 1 -- 172.21.15.2:0/2397758342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45e40cecd0 msgr2=0x7f45e415c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:14.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.347+0000 7f45ec349700 1 --2- 172.21.15.2:0/2397758342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45e40cecd0 0x7f45e415c1c0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f45dc009e50 tx=0x7f45dc00b330 comp rx=0 tx=0).stop 2023-11-26T07:16:14.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.347+0000 7f45ec349700 1 -- 172.21.15.2:0/2397758342 shutdown_connections 2023-11-26T07:16:14.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.347+0000 7f45ec349700 1 --2- 172.21.15.2:0/2397758342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45e40cecd0 0x7f45e415c1c0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:14.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.347+0000 7f45ec349700 1 -- 172.21.15.2:0/2397758342 >> 172.21.15.2:0/2397758342 conn(0x7f45e40b3720 msgr2=0x7f45e40b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:14.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.347+0000 7f45ec349700 1 -- 172.21.15.2:0/2397758342 shutdown_connections 2023-11-26T07:16:14.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.347+0000 7f45ec349700 1 -- 172.21.15.2:0/2397758342 wait complete. 2023-11-26T07:16:14.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.348+0000 7f45ec349700 1 Processor -- start 2023-11-26T07:16:14.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.348+0000 7f45ec349700 1 -- start start 2023-11-26T07:16:14.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.349+0000 7f45ec349700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45e40cecd0 0x7f45e40b72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:14.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.349+0000 7f45ec349700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f45e40cf2b0 0x7f45e406caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:14.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.349+0000 7f45ec349700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45e415bde0 0x7f45e4166290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:14.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.349+0000 7f45ec349700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e4154240 con 0x7f45e415bde0 2023-11-26T07:16:14.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.349+0000 7f45ec349700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e406d030 con 0x7f45e40cecd0 2023-11-26T07:16:14.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.349+0000 7f45ec349700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e406d260 con 0x7f45e40cf2b0 2023-11-26T07:16:14.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.349+0000 7f45ea8e6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45e415bde0 0x7f45e4166290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:14.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.349+0000 7f45ea8e6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45e415bde0 0x7f45e4166290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43654/0 (socket says 172.21.15.2:43654) 2023-11-26T07:16:14.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.349+0000 7f45ea8e6700 1 -- 172.21.15.2:0/41031414 learned_addr learned my addr 172.21.15.2:0/41031414 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:14.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.349+0000 7f45ea0e5700 1 --2- 172.21.15.2:0/41031414 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45e40cecd0 0x7f45e40b72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:14.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.349+0000 7f45e98e4700 1 --2- 172.21.15.2:0/41031414 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f45e40cf2b0 0x7f45e406caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:14.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.349+0000 7f45ea8e6700 1 -- 172.21.15.2:0/41031414 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f45e40cf2b0 msgr2=0x7f45e406caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:14.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.349+0000 7f45ea8e6700 1 --2- 172.21.15.2:0/41031414 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f45e40cf2b0 0x7f45e406caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:14.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.349+0000 7f45ea8e6700 1 -- 172.21.15.2:0/41031414 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45e40cecd0 msgr2=0x7f45e40b72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:14.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.349+0000 7f45ea8e6700 1 --2- 172.21.15.2:0/41031414 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45e40cecd0 0x7f45e40b72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:14.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.349+0000 7f45ea8e6700 1 -- 172.21.15.2:0/41031414 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45dc009b30 con 0x7f45e415bde0 2023-11-26T07:16:14.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.349+0000 7f45ea0e5700 1 --2- 172.21.15.2:0/41031414 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45e40cecd0 0x7f45e40b72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:16:14.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.349+0000 7f45ea8e6700 1 --2- 172.21.15.2:0/41031414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45e415bde0 0x7f45e4166290 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f45e40cc2b0 tx=0x7f45dc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:14.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.349+0000 7f45daffd700 1 -- 172.21.15.2:0/41031414 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc004960 con 0x7f45e415bde0 2023-11-26T07:16:14.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.349+0000 7f45daffd700 1 -- 172.21.15.2:0/41031414 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45dc0099b0 con 0x7f45e415bde0 2023-11-26T07:16:14.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.349+0000 7f45ec349700 1 -- 172.21.15.2:0/41031414 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45e406d540 con 0x7f45e415bde0 2023-11-26T07:16:14.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.350+0000 7f45daffd700 1 -- 172.21.15.2:0/41031414 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc01b670 con 0x7f45e415bde0 2023-11-26T07:16:14.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.350+0000 7f45ec349700 1 -- 172.21.15.2:0/41031414 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e40b4990 con 0x7f45e415bde0 2023-11-26T07:16:14.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.350+0000 7f45ec349700 1 -- 172.21.15.2:0/41031414 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45e40b4b20 con 0x7f45e415bde0 2023-11-26T07:16:14.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.351+0000 7f45daffd700 1 -- 172.21.15.2:0/41031414 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f45dc01b7d0 con 0x7f45e415bde0 2023-11-26T07:16:14.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.351+0000 7f45daffd700 1 --2- 172.21.15.2:0/41031414 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f45c806b740 0x7f45c806dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:14.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.351+0000 7f45daffd700 1 -- 172.21.15.2:0/41031414 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f45dc089970 con 0x7f45e415bde0 2023-11-26T07:16:14.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.352+0000 7f45ea0e5700 1 --2- 172.21.15.2:0/41031414 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f45c806b740 0x7f45c806dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:14.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.352+0000 7f45ea0e5700 1 --2- 172.21.15.2:0/41031414 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f45c806b740 0x7f45c806dc00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f45d4000f60 tx=0x7f45d4007dd0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:14.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.356+0000 7f45daffd700 1 -- 172.21.15.2:0/41031414 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f45dc059ee0 con 0x7f45e415bde0 2023-11-26T07:16:14.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.555+0000 7f45ec349700 1 -- 172.21.15.2:0/41031414 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f45e40b4790 con 0x7f45e415bde0 2023-11-26T07:16:14.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.555+0000 7f45daffd700 1 -- 172.21.15.2:0/41031414 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v61) v1 ==== 104+0+11 (secure 0 0 0) 0x7f45dc059a70 con 0x7f45e415bde0 2023-11-26T07:16:14.557 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-26T07:16:14.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.557+0000 7f45ec349700 1 -- 172.21.15.2:0/41031414 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f45c806b740 msgr2=0x7f45c806dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:14.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.557+0000 7f45ec349700 1 --2- 172.21.15.2:0/41031414 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f45c806b740 0x7f45c806dc00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f45d4000f60 tx=0x7f45d4007dd0 comp rx=0 tx=0).stop 2023-11-26T07:16:14.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.557+0000 7f45ec349700 1 -- 172.21.15.2:0/41031414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45e415bde0 msgr2=0x7f45e4166290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:14.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.557+0000 7f45ec349700 1 --2- 172.21.15.2:0/41031414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45e415bde0 0x7f45e4166290 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f45e40cc2b0 tx=0x7f45dc004ad0 comp rx=0 tx=0).stop 2023-11-26T07:16:14.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.557+0000 7f45ec349700 1 -- 172.21.15.2:0/41031414 shutdown_connections 2023-11-26T07:16:14.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.557+0000 7f45ec349700 1 --2- 172.21.15.2:0/41031414 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f45c806b740 0x7f45c806dc00 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:14.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.557+0000 7f45ec349700 1 --2- 172.21.15.2:0/41031414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45e415bde0 0x7f45e4166290 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:14.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.557+0000 7f45ec349700 1 --2- 172.21.15.2:0/41031414 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45e40cecd0 0x7f45e40b72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:14.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.557+0000 7f45ec349700 1 --2- 172.21.15.2:0/41031414 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f45e40cf2b0 0x7f45e406caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:14.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.557+0000 7f45ec349700 1 -- 172.21.15.2:0/41031414 >> 172.21.15.2:0/41031414 conn(0x7f45e40b3720 msgr2=0x7f45e40d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:14.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.557+0000 7f45ec349700 1 -- 172.21.15.2:0/41031414 shutdown_connections 2023-11-26T07:16:14.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.557+0000 7f45ec349700 1 -- 172.21.15.2:0/41031414 wait complete. 2023-11-26T07:16:14.571 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:16:14.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.697+0000 7f913895b700 1 Processor -- start 2023-11-26T07:16:14.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.697+0000 7f913895b700 1 -- start start 2023-11-26T07:16:14.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.698+0000 7f913895b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91340722c0 0x7f91340b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:14.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.698+0000 7f913895b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f91341440f0 0x7f913406e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:14.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.698+0000 7f913895b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9134143ec0 con 0x7f9134143ae0 2023-11-26T07:16:14.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.698+0000 7f913895b700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91340b40a0 con 0x7f91341440f0 2023-11-26T07:16:14.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.698+0000 7f913895b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91340b3ae0 con 0x7f91340722c0 2023-11-26T07:16:14.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.698+0000 7f9131d9b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91340722c0 0x7f91340b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:14.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.698+0000 7f9132d9d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f91341440f0 0x7f913406e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:14.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.698+0000 7f9131d9b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91340722c0 0x7f91340b51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.2:41740/0 (socket says 172.21.15.2:41740) 2023-11-26T07:16:14.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.698+0000 7f913259c700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f9134143ae0 0x7f9134071bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.2:42238/0 (socket says 172.21.15.2:42238) 2023-11-26T07:16:14.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.698+0000 7f9131d9b700 1 -- 172.21.15.2:0/533366149 learned_addr learned my addr 172.21.15.2:0/533366149 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:14.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.698+0000 7f9131d9b700 1 -- 172.21.15.2:0/533366149 >> v2:172.21.15.192:3300/0 conn(0x7f91341440f0 msgr2=0x7f913406e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:14.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.698+0000 7f9131d9b700 1 --2- 172.21.15.2:0/533366149 >> v2:172.21.15.192:3300/0 conn(0x7f91341440f0 0x7f913406e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:14.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.698+0000 7f9131d9b700 1 -- 172.21.15.2:0/533366149 >> v1:172.21.15.192:6789/0 conn(0x7f9134143ae0 legacy=0x7f9134071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:14.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.698+0000 7f9131d9b700 1 -- 172.21.15.2:0/533366149 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91340b3dc0 con 0x7f91340722c0 2023-11-26T07:16:14.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.698+0000 7f9132d9d700 1 --2- 172.21.15.2:0/533366149 >> v2:172.21.15.192:3300/0 conn(0x7f91341440f0 0x7f913406e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:16:14.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.699+0000 7f9131d9b700 1 --2- 172.21.15.2:0/533366149 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91340722c0 0x7f91340b51b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f91240098f0 tx=0x7f9124009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99f055d07b64e937 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:14.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.699+0000 7f913159a700 1 -- 172.21.15.2:0/533366149 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9124011830 con 0x7f91340722c0 2023-11-26T07:16:14.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.699+0000 7f913159a700 1 -- 172.21.15.2:0/533366149 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9124011990 con 0x7f91340722c0 2023-11-26T07:16:14.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.699+0000 7f913159a700 1 -- 172.21.15.2:0/533366149 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9124011d20 con 0x7f91340722c0 2023-11-26T07:16:14.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.699+0000 7f913895b700 1 -- 172.21.15.2:0/533366149 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91340722c0 msgr2=0x7f91340b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:14.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.699+0000 7f913895b700 1 --2- 172.21.15.2:0/533366149 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91340722c0 0x7f91340b51b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f91240098f0 tx=0x7f9124009c00 comp rx=0 tx=0).stop 2023-11-26T07:16:14.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.699+0000 7f913895b700 1 -- 172.21.15.2:0/533366149 shutdown_connections 2023-11-26T07:16:14.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.699+0000 7f913895b700 1 --2- 172.21.15.2:0/533366149 >> v2:172.21.15.192:3300/0 conn(0x7f91341440f0 0x7f913406e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:14.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.699+0000 7f913895b700 1 --2- 172.21.15.2:0/533366149 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91340722c0 0x7f91340b51b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:14.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.699+0000 7f913895b700 1 -- 172.21.15.2:0/533366149 >> 172.21.15.2:0/533366149 conn(0x7f91340b2740 msgr2=0x7f91340b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:14.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.699+0000 7f913895b700 1 -- 172.21.15.2:0/533366149 shutdown_connections 2023-11-26T07:16:14.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.699+0000 7f913895b700 1 -- 172.21.15.2:0/533366149 wait complete. 2023-11-26T07:16:14.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.701+0000 7f913895b700 1 Processor -- start 2023-11-26T07:16:14.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.701+0000 7f913895b700 1 -- start start 2023-11-26T07:16:14.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.701+0000 7f913895b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91340722c0 0x7f9134157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:14.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.701+0000 7f913895b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9134143ae0 0x7f9134154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:14.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.701+0000 7f913895b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91341440f0 0x7f913412ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:14.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.701+0000 7f913895b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913413ae70 con 0x7f91341440f0 2023-11-26T07:16:14.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.701+0000 7f913895b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913413b150 con 0x7f91340722c0 2023-11-26T07:16:14.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.702+0000 7f913895b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f913413b430 con 0x7f9134143ae0 2023-11-26T07:16:14.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.702+0000 7f9132d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91341440f0 0x7f913412ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:14.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.702+0000 7f9132d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91341440f0 0x7f913412ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43666/0 (socket says 172.21.15.2:43666) 2023-11-26T07:16:14.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.702+0000 7f9132d9d700 1 -- 172.21.15.2:0/755610287 learned_addr learned my addr 172.21.15.2:0/755610287 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:14.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.702+0000 7f913259c700 1 --2- 172.21.15.2:0/755610287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91340722c0 0x7f9134157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:14.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.702+0000 7f9131d9b700 1 --2- 172.21.15.2:0/755610287 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9134143ae0 0x7f9134154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:14.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.702+0000 7f9132d9d700 1 -- 172.21.15.2:0/755610287 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9134143ae0 msgr2=0x7f9134154430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:14.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.702+0000 7f9132d9d700 1 --2- 172.21.15.2:0/755610287 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9134143ae0 0x7f9134154430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:14.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.702+0000 7f9132d9d700 1 -- 172.21.15.2:0/755610287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91340722c0 msgr2=0x7f9134157a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:14.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.702+0000 7f9132d9d700 1 --2- 172.21.15.2:0/755610287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91340722c0 0x7f9134157a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:14.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.702+0000 7f9132d9d700 1 -- 172.21.15.2:0/755610287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f912c009a70 con 0x7f91341440f0 2023-11-26T07:16:14.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.702+0000 7f9132d9d700 1 --2- 172.21.15.2:0/755610287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91341440f0 0x7f913412ebf0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f912c00efc0 tx=0x7f912c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:14.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.702+0000 7f9122ffd700 1 -- 172.21.15.2:0/755610287 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912c00ca90 con 0x7f91341440f0 2023-11-26T07:16:14.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.702+0000 7f913895b700 1 -- 172.21.15.2:0/755610287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9124009550 con 0x7f91341440f0 2023-11-26T07:16:14.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.702+0000 7f9122ffd700 1 -- 172.21.15.2:0/755610287 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f912c00f040 con 0x7f91341440f0 2023-11-26T07:16:14.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.702+0000 7f9122ffd700 1 -- 172.21.15.2:0/755610287 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912c00ce30 con 0x7f91341440f0 2023-11-26T07:16:14.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.703+0000 7f913895b700 1 -- 172.21.15.2:0/755610287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f913413b9f0 con 0x7f91341440f0 2023-11-26T07:16:14.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.703+0000 7f913895b700 1 -- 172.21.15.2:0/755610287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9134067a00 con 0x7f91341440f0 2023-11-26T07:16:14.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.704+0000 7f9122ffd700 1 -- 172.21.15.2:0/755610287 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f912c014480 con 0x7f91341440f0 2023-11-26T07:16:14.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.704+0000 7f9122ffd700 1 --2- 172.21.15.2:0/755610287 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f911406b740 0x7f911406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:14.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.704+0000 7f9122ffd700 1 -- 172.21.15.2:0/755610287 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f912c088590 con 0x7f91341440f0 2023-11-26T07:16:14.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.704+0000 7f913259c700 1 --2- 172.21.15.2:0/755610287 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f911406b740 0x7f911406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:14.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.705+0000 7f913259c700 1 --2- 172.21.15.2:0/755610287 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f911406b740 0x7f911406dc00 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9128000f60 tx=0x7f9128007ed0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:14.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.709+0000 7f9122ffd700 1 -- 172.21.15.2:0/755610287 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f912c055070 con 0x7f91341440f0 2023-11-26T07:16:14.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.912+0000 7f913895b700 1 -- 172.21.15.2:0/755610287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f91340cd230 con 0x7f91341440f0 2023-11-26T07:16:14.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.912+0000 7f9122ffd700 1 -- 172.21.15.2:0/755610287 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v61) v1 ==== 100+0+11 (secure 0 0 0) 0x7f912c009cd0 con 0x7f91341440f0 2023-11-26T07:16:14.914 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-26T07:16:14.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.914+0000 7f913895b700 1 -- 172.21.15.2:0/755610287 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f911406b740 msgr2=0x7f911406dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:14.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.914+0000 7f913895b700 1 --2- 172.21.15.2:0/755610287 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f911406b740 0x7f911406dc00 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9128000f60 tx=0x7f9128007ed0 comp rx=0 tx=0).stop 2023-11-26T07:16:14.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.914+0000 7f913895b700 1 -- 172.21.15.2:0/755610287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91341440f0 msgr2=0x7f913412ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:14.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.914+0000 7f913895b700 1 --2- 172.21.15.2:0/755610287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91341440f0 0x7f913412ebf0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f912c00efc0 tx=0x7f912c00c3a0 comp rx=0 tx=0).stop 2023-11-26T07:16:14.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.914+0000 7f913895b700 1 -- 172.21.15.2:0/755610287 shutdown_connections 2023-11-26T07:16:14.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.914+0000 7f913895b700 1 --2- 172.21.15.2:0/755610287 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f911406b740 0x7f911406dc00 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:14.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.914+0000 7f913895b700 1 --2- 172.21.15.2:0/755610287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91341440f0 0x7f913412ebf0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:14.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.914+0000 7f913895b700 1 --2- 172.21.15.2:0/755610287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91340722c0 0x7f9134157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:14.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.914+0000 7f913895b700 1 --2- 172.21.15.2:0/755610287 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9134143ae0 0x7f9134154430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:14.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.914+0000 7f913895b700 1 -- 172.21.15.2:0/755610287 >> 172.21.15.2:0/755610287 conn(0x7f91340b2740 msgr2=0x7f91340b41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:14.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.914+0000 7f913895b700 1 -- 172.21.15.2:0/755610287 shutdown_connections 2023-11-26T07:16:14.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:14.915+0000 7f913895b700 1 -- 172.21.15.2:0/755610287 wait complete. 2023-11-26T07:16:14.928 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-26T07:16:15.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.052+0000 7f8771cc8700 1 Processor -- start 2023-11-26T07:16:15.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.052+0000 7f8771cc8700 1 -- start start 2023-11-26T07:16:15.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.052+0000 7f8771cc8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f876c15e1c0 0x7f876c06eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:15.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.052+0000 7f8771cc8700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f876c0b0e90 0x7f876c06f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:15.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.052+0000 7f8771cc8700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f876c0d1230 con 0x7f876c06fa80 2023-11-26T07:16:15.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.052+0000 7f8771cc8700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f876c06ff10 con 0x7f876c0b0e90 2023-11-26T07:16:15.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.052+0000 7f8771cc8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f876c0d0c70 con 0x7f876c15e1c0 2023-11-26T07:16:15.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.053+0000 7f876affd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f876c0b0e90 0x7f876c06f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:15.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.053+0000 7f876affd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f876c0b0e90 0x7f876c06f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43674/0 (socket says 172.21.15.2:43674) 2023-11-26T07:16:15.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.053+0000 7f876affd700 1 -- 172.21.15.2:0/2884813858 learned_addr learned my addr 172.21.15.2:0/2884813858 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:15.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.053+0000 7f876b7fe700 1 --2- 172.21.15.2:0/2884813858 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f876c15e1c0 0x7f876c06eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:15.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.053+0000 7f876affd700 1 -- 172.21.15.2:0/2884813858 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f876c15e1c0 msgr2=0x7f876c06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:15.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.053+0000 7f876affd700 1 --2- 172.21.15.2:0/2884813858 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f876c15e1c0 0x7f876c06eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:15.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.053+0000 7f876affd700 1 -- 172.21.15.2:0/2884813858 >> v1:172.21.15.192:6789/0 conn(0x7f876c06fa80 legacy=0x7f876c161d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:15.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.053+0000 7f876a7fc700 1 -- 172.21.15.2:0/2884813858 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3678425669 0 0) 0x7f876c0d1230 con 0x7f876c06fa80 2023-11-26T07:16:15.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.053+0000 7f876affd700 1 -- 172.21.15.2:0/2884813858 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f876c0d0f50 con 0x7f876c0b0e90 2023-11-26T07:16:15.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.053+0000 7f876affd700 1 --2- 172.21.15.2:0/2884813858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f876c0b0e90 0x7f876c06f540 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f87600098f0 tx=0x7f8760009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=101ce4d871754243 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:15.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.053+0000 7f876a7fc700 1 -- 172.21.15.2:0/2884813858 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8760011830 con 0x7f876c0b0e90 2023-11-26T07:16:15.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.053+0000 7f876a7fc700 1 -- 172.21.15.2:0/2884813858 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8760011990 con 0x7f876c0b0e90 2023-11-26T07:16:15.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.053+0000 7f876a7fc700 1 -- 172.21.15.2:0/2884813858 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8760011d20 con 0x7f876c0b0e90 2023-11-26T07:16:15.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.054+0000 7f8771cc8700 1 -- 172.21.15.2:0/2884813858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f876c0b0e90 msgr2=0x7f876c06f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:15.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.054+0000 7f8771cc8700 1 --2- 172.21.15.2:0/2884813858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f876c0b0e90 0x7f876c06f540 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f87600098f0 tx=0x7f8760009c00 comp rx=0 tx=0).stop 2023-11-26T07:16:15.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.054+0000 7f8771cc8700 1 -- 172.21.15.2:0/2884813858 shutdown_connections 2023-11-26T07:16:15.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.054+0000 7f8771cc8700 1 --2- 172.21.15.2:0/2884813858 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f876c15e1c0 0x7f876c06eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:15.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.054+0000 7f8771cc8700 1 --2- 172.21.15.2:0/2884813858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f876c0b0e90 0x7f876c06f540 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:15.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.054+0000 7f8771cc8700 1 -- 172.21.15.2:0/2884813858 >> 172.21.15.2:0/2884813858 conn(0x7f876c0b3720 msgr2=0x7f876c0b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:15.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.054+0000 7f8771cc8700 1 -- 172.21.15.2:0/2884813858 shutdown_connections 2023-11-26T07:16:15.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.054+0000 7f8771cc8700 1 -- 172.21.15.2:0/2884813858 wait complete. 2023-11-26T07:16:15.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.055+0000 7f8771cc8700 1 Processor -- start 2023-11-26T07:16:15.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.055+0000 7f8771cc8700 1 -- start start 2023-11-26T07:16:15.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.056+0000 7f8771cc8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f876c06fa80 0x7f876c1584f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:15.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.056+0000 7f8771cc8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f876c0b0e90 0x7f876c1f7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:15.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.056+0000 7f8771cc8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f876c15e1c0 0x7f876c1f3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:15.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.056+0000 7f8771cc8700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876c1f4d40 con 0x7f876c0b0e90 2023-11-26T07:16:15.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.056+0000 7f8771cc8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876c1f4780 con 0x7f876c15e1c0 2023-11-26T07:16:15.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.056+0000 7f8771cc8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f876c1f4a60 con 0x7f876c06fa80 2023-11-26T07:16:15.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.056+0000 7f876affd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f876c0b0e90 0x7f876c1f7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:15.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.056+0000 7f876affd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f876c0b0e90 0x7f876c1f7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43680/0 (socket says 172.21.15.2:43680) 2023-11-26T07:16:15.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.056+0000 7f876affd700 1 -- 172.21.15.2:0/2915315519 learned_addr learned my addr 172.21.15.2:0/2915315519 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:15.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.057+0000 7f876bfff700 1 --2- 172.21.15.2:0/2915315519 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f876c15e1c0 0x7f876c1f3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:15.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.057+0000 7f876b7fe700 1 --2- 172.21.15.2:0/2915315519 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f876c06fa80 0x7f876c1584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:15.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.057+0000 7f876affd700 1 -- 172.21.15.2:0/2915315519 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f876c06fa80 msgr2=0x7f876c1584f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:15.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.057+0000 7f876affd700 1 --2- 172.21.15.2:0/2915315519 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f876c06fa80 0x7f876c1584f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:15.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.057+0000 7f876affd700 1 -- 172.21.15.2:0/2915315519 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f876c15e1c0 msgr2=0x7f876c1f3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:15.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.057+0000 7f876affd700 1 --2- 172.21.15.2:0/2915315519 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f876c15e1c0 0x7f876c1f3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:15.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.057+0000 7f876affd700 1 -- 172.21.15.2:0/2915315519 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8760009550 con 0x7f876c0b0e90 2023-11-26T07:16:15.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.057+0000 7f876affd700 1 --2- 172.21.15.2:0/2915315519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f876c0b0e90 0x7f876c1f7cc0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f8760009c40 tx=0x7f8760004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:15.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.057+0000 7f8753fff700 1 -- 172.21.15.2:0/2915315519 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8760004300 con 0x7f876c0b0e90 2023-11-26T07:16:15.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.057+0000 7f8753fff700 1 -- 172.21.15.2:0/2915315519 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f876001f070 con 0x7f876c0b0e90 2023-11-26T07:16:15.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.057+0000 7f8771cc8700 1 -- 172.21.15.2:0/2915315519 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f876c1f74c0 con 0x7f876c0b0e90 2023-11-26T07:16:15.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.057+0000 7f8753fff700 1 -- 172.21.15.2:0/2915315519 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87600036a0 con 0x7f876c0b0e90 2023-11-26T07:16:15.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.057+0000 7f8771cc8700 1 -- 172.21.15.2:0/2915315519 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f876c1f8200 con 0x7f876c0b0e90 2023-11-26T07:16:15.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.058+0000 7f8771cc8700 1 -- 172.21.15.2:0/2915315519 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f876c06e560 con 0x7f876c0b0e90 2023-11-26T07:16:15.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.058+0000 7f8753fff700 1 -- 172.21.15.2:0/2915315519 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f8760021030 con 0x7f876c0b0e90 2023-11-26T07:16:15.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.059+0000 7f8753fff700 1 --2- 172.21.15.2:0/2915315519 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f875806b740 0x7f875806dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:15.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.059+0000 7f8753fff700 1 -- 172.21.15.2:0/2915315519 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f8760089380 con 0x7f876c0b0e90 2023-11-26T07:16:15.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.059+0000 7f876b7fe700 1 --2- 172.21.15.2:0/2915315519 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f875806b740 0x7f875806dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:15.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.060+0000 7f876b7fe700 1 --2- 172.21.15.2:0/2915315519 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f875806b740 0x7f875806dc00 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f875c009ad0 tx=0x7f875c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:15.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.063+0000 7f8753fff700 1 -- 172.21.15.2:0/2915315519 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8760055e30 con 0x7f876c0b0e90 2023-11-26T07:16:15.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.283+0000 7f8771cc8700 1 -- 172.21.15.2:0/2915315519 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f876c072e70 con 0x7f876c0b0e90 2023-11-26T07:16:15.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.284+0000 7f8753fff700 1 -- 172.21.15.2:0/2915315519 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v61) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8760015020 con 0x7f876c0b0e90 2023-11-26T07:16:15.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.286+0000 7f8771cc8700 1 -- 172.21.15.2:0/2915315519 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f875806b740 msgr2=0x7f875806dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:15.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.286+0000 7f8771cc8700 1 --2- 172.21.15.2:0/2915315519 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f875806b740 0x7f875806dc00 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f875c009ad0 tx=0x7f875c008040 comp rx=0 tx=0).stop 2023-11-26T07:16:15.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.286+0000 7f8771cc8700 1 -- 172.21.15.2:0/2915315519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f876c0b0e90 msgr2=0x7f876c1f7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:15.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.286+0000 7f8771cc8700 1 --2- 172.21.15.2:0/2915315519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f876c0b0e90 0x7f876c1f7cc0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f8760009c40 tx=0x7f8760004750 comp rx=0 tx=0).stop 2023-11-26T07:16:15.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.286+0000 7f8771cc8700 1 -- 172.21.15.2:0/2915315519 shutdown_connections 2023-11-26T07:16:15.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.286+0000 7f8771cc8700 1 --2- 172.21.15.2:0/2915315519 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f875806b740 0x7f875806dc00 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:15.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.286+0000 7f8771cc8700 1 --2- 172.21.15.2:0/2915315519 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f876c15e1c0 0x7f876c1f3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:15.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.286+0000 7f8771cc8700 1 --2- 172.21.15.2:0/2915315519 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f876c06fa80 0x7f876c1584f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:15.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.286+0000 7f8771cc8700 1 --2- 172.21.15.2:0/2915315519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f876c0b0e90 0x7f876c1f7cc0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:15.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.286+0000 7f8771cc8700 1 -- 172.21.15.2:0/2915315519 >> 172.21.15.2:0/2915315519 conn(0x7f876c0b3720 msgr2=0x7f876c0b3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:15.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.286+0000 7f8771cc8700 1 -- 172.21.15.2:0/2915315519 shutdown_connections 2023-11-26T07:16:15.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.286+0000 7f8771cc8700 1 -- 172.21.15.2:0/2915315519 wait complete. 2023-11-26T07:16:15.289 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2023-11-26T07:16:15.300 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-26T07:16:15.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:15.300 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-26T07:16:15.345 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2023-11-26T07:16:15.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:15.345 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-26T07:16:15.364 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:15.364 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:15.381 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19704 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-26T07:16:15.382 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:16:15.382 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:15.423 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284224k,nr_inodes=4071056,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3837 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260544k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-26T07:16:15.423 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:16:15.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.546+0000 7fdb737a6700 1 Processor -- start 2023-11-26T07:16:15.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.546+0000 7fdb737a6700 1 -- start start 2023-11-26T07:16:15.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.547+0000 7fdb737a6700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdb6c142810 0x7fdb6c06afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:15.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.547+0000 7fdb737a6700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdb6c06e580 0x7fdb6c06b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:15.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.547+0000 7fdb737a6700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb6c0cf5f0 con 0x7fdb6c1459a0 2023-11-26T07:16:15.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.547+0000 7fdb737a6700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb6c06ea80 con 0x7fdb6c142810 2023-11-26T07:16:15.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.547+0000 7fdb737a6700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb6c06ed60 con 0x7fdb6c06e580 2023-11-26T07:16:15.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.547+0000 7fdb71542700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdb6c142810 0x7fdb6c06afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:15.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.547+0000 7fdb71542700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdb6c142810 0x7fdb6c06afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43686/0 (socket says 172.21.15.2:43686) 2023-11-26T07:16:15.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.547+0000 7fdb71542700 1 -- 172.21.15.2:0/3935198896 learned_addr learned my addr 172.21.15.2:0/3935198896 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:15.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.547+0000 7fdb71d43700 1 --2- 172.21.15.2:0/3935198896 >> v2:172.21.15.192:3300/0 conn(0x7fdb6c06e580 0x7fdb6c06b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:15.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.547+0000 7fdb71542700 1 -- 172.21.15.2:0/3935198896 >> v2:172.21.15.192:3300/0 conn(0x7fdb6c06e580 msgr2=0x7fdb6c06b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:15.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.547+0000 7fdb71542700 1 --2- 172.21.15.2:0/3935198896 >> v2:172.21.15.192:3300/0 conn(0x7fdb6c06e580 0x7fdb6c06b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:15.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.547+0000 7fdb71542700 1 -- 172.21.15.2:0/3935198896 >> v1:172.21.15.192:6789/0 conn(0x7fdb6c1459a0 legacy=0x7fdb6c071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:15.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.547+0000 7fdb71542700 1 -- 172.21.15.2:0/3935198896 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb6c06f040 con 0x7fdb6c142810 2023-11-26T07:16:15.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.547+0000 7fdb71542700 1 --2- 172.21.15.2:0/3935198896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb6c142810 0x7fdb6c06afd0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c0b0660 tx=0x7fdb68009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9af55b6bd8b71bb6 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:15.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.547+0000 7fdb63fff700 1 -- 172.21.15.2:0/3935198896 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb68004230 con 0x7fdb6c142810 2023-11-26T07:16:15.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.547+0000 7fdb63fff700 1 -- 172.21.15.2:0/3935198896 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb68004390 con 0x7fdb6c142810 2023-11-26T07:16:15.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.547+0000 7fdb63fff700 1 -- 172.21.15.2:0/3935198896 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb680036a0 con 0x7fdb6c142810 2023-11-26T07:16:15.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.548+0000 7fdb737a6700 1 -- 172.21.15.2:0/3935198896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb6c142810 msgr2=0x7fdb6c06afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:15.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.548+0000 7fdb737a6700 1 --2- 172.21.15.2:0/3935198896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb6c142810 0x7fdb6c06afd0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c0b0660 tx=0x7fdb68009bd0 comp rx=0 tx=0).stop 2023-11-26T07:16:15.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.548+0000 7fdb737a6700 1 -- 172.21.15.2:0/3935198896 shutdown_connections 2023-11-26T07:16:15.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.548+0000 7fdb737a6700 1 --2- 172.21.15.2:0/3935198896 >> v2:172.21.15.192:3300/0 conn(0x7fdb6c06e580 0x7fdb6c06b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:15.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.548+0000 7fdb737a6700 1 --2- 172.21.15.2:0/3935198896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb6c142810 0x7fdb6c06afd0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:15.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.548+0000 7fdb737a6700 1 -- 172.21.15.2:0/3935198896 >> 172.21.15.2:0/3935198896 conn(0x7fdb6c0b2740 msgr2=0x7fdb6c0b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:15.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.548+0000 7fdb737a6700 1 -- 172.21.15.2:0/3935198896 shutdown_connections 2023-11-26T07:16:15.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.548+0000 7fdb737a6700 1 -- 172.21.15.2:0/3935198896 wait complete. 2023-11-26T07:16:15.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.550+0000 7fdb737a6700 1 Processor -- start 2023-11-26T07:16:15.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.550+0000 7fdb737a6700 1 -- start start 2023-11-26T07:16:15.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.551+0000 7fdb737a6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb6c06e580 0x7fdb6c0afed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:15.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.551+0000 7fdb737a6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb6c142810 0x7fdb6c1f4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:15.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.551+0000 7fdb737a6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb6c1459a0 0x7fdb6c15f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:15.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.551+0000 7fdb737a6700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c1f51b0 con 0x7fdb6c1459a0 2023-11-26T07:16:15.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.551+0000 7fdb737a6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c1f53e0 con 0x7fdb6c06e580 2023-11-26T07:16:15.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.551+0000 7fdb737a6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c1f56c0 con 0x7fdb6c142810 2023-11-26T07:16:15.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.551+0000 7fdb71d43700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb6c1459a0 0x7fdb6c15f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:15.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.551+0000 7fdb71d43700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb6c1459a0 0x7fdb6c15f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43696/0 (socket says 172.21.15.2:43696) 2023-11-26T07:16:15.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.551+0000 7fdb71d43700 1 -- 172.21.15.2:0/959502330 learned_addr learned my addr 172.21.15.2:0/959502330 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:15.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.551+0000 7fdb71542700 1 --2- 172.21.15.2:0/959502330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb6c06e580 0x7fdb6c0afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:15.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.551+0000 7fdb70d41700 1 --2- 172.21.15.2:0/959502330 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb6c142810 0x7fdb6c1f4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:15.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.551+0000 7fdb71d43700 1 -- 172.21.15.2:0/959502330 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb6c142810 msgr2=0x7fdb6c1f4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:15.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.551+0000 7fdb71d43700 1 --2- 172.21.15.2:0/959502330 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb6c142810 0x7fdb6c1f4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:15.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.551+0000 7fdb71d43700 1 -- 172.21.15.2:0/959502330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb6c06e580 msgr2=0x7fdb6c0afed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:15.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.551+0000 7fdb71d43700 1 --2- 172.21.15.2:0/959502330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb6c06e580 0x7fdb6c0afed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:15.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.551+0000 7fdb71d43700 1 -- 172.21.15.2:0/959502330 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb68009550 con 0x7fdb6c1459a0 2023-11-26T07:16:15.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.551+0000 7fdb71542700 1 --2- 172.21.15.2:0/959502330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb6c06e580 0x7fdb6c0afed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:16:15.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.551+0000 7fdb71d43700 1 --2- 172.21.15.2:0/959502330 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb6c1459a0 0x7fdb6c15f0f0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fdb6400cd20 tx=0x7fdb6400a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:15.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.551+0000 7fdb61ffb700 1 -- 172.21.15.2:0/959502330 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb64003a20 con 0x7fdb6c1459a0 2023-11-26T07:16:15.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.551+0000 7fdb61ffb700 1 -- 172.21.15.2:0/959502330 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb64003b80 con 0x7fdb6c1459a0 2023-11-26T07:16:15.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.551+0000 7fdb737a6700 1 -- 172.21.15.2:0/959502330 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb6c1f59a0 con 0x7fdb6c1459a0 2023-11-26T07:16:15.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.551+0000 7fdb61ffb700 1 -- 172.21.15.2:0/959502330 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb64004020 con 0x7fdb6c1459a0 2023-11-26T07:16:15.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.552+0000 7fdb737a6700 1 -- 172.21.15.2:0/959502330 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb6c15f630 con 0x7fdb6c1459a0 2023-11-26T07:16:15.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.553+0000 7fdb737a6700 1 -- 172.21.15.2:0/959502330 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb6c1f5be0 con 0x7fdb6c1459a0 2023-11-26T07:16:15.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.553+0000 7fdb61ffb700 1 -- 172.21.15.2:0/959502330 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7fdb64004180 con 0x7fdb6c1459a0 2023-11-26T07:16:15.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.553+0000 7fdb61ffb700 1 --2- 172.21.15.2:0/959502330 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fdb5006b740 0x7fdb5006dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:15.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.554+0000 7fdb61ffb700 1 -- 172.21.15.2:0/959502330 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5765+0+0 (secure 0 0 0) 0x7fdb64012070 con 0x7fdb6c1459a0 2023-11-26T07:16:15.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.554+0000 7fdb71542700 1 --2- 172.21.15.2:0/959502330 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fdb5006b740 0x7fdb5006dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:15.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.554+0000 7fdb71542700 1 --2- 172.21.15.2:0/959502330 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fdb5006b740 0x7fdb5006dc00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fdb68009130 tx=0x7fdb68008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:15.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.558+0000 7fdb61ffb700 1 -- 172.21.15.2:0/959502330 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdb6c1f5be0 con 0x7fdb6c1459a0 2023-11-26T07:16:15.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.804+0000 7fdb737a6700 1 -- 172.21.15.2:0/959502330 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdb6c1351d0 con 0x7fdb6c1459a0 2023-11-26T07:16:15.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.805+0000 7fdb61ffb700 1 -- 172.21.15.2:0/959502330 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4913 (secure 0 0 0) 0x7fdb6c1351d0 con 0x7fdb6c1459a0 2023-11-26T07:16:15.807 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:16:15.807 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5384,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3283211322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3283211322},{"type":"v1","addr":"172.21.15.192:6837","nonce":3283211322}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":5833,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/4149545589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":4149545589},{"type":"v1","addr":"172.21.15.192:6836","nonce":4149545589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":6171,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/1422633843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1422633843},{"type":"v1","addr":"172.21.15.2:6834","nonce":1422633843}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:15:12.714394+0000","modified":"2023-11-26T07:15:15.725909+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6174},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6174":{"gid":6174,"name":"a","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6835/1251532899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":1251532899},{"type":"v1","addr":"172.21.15.2:6835","nonce":1251532899}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-26T07:16:15.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.807+0000 7fdb737a6700 1 -- 172.21.15.2:0/959502330 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fdb5006b740 msgr2=0x7fdb5006dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:15.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.807+0000 7fdb737a6700 1 --2- 172.21.15.2:0/959502330 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fdb5006b740 0x7fdb5006dc00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fdb68009130 tx=0x7fdb68008030 comp rx=0 tx=0).stop 2023-11-26T07:16:15.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.807+0000 7fdb737a6700 1 -- 172.21.15.2:0/959502330 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb6c1459a0 msgr2=0x7fdb6c15f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:15.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.807+0000 7fdb737a6700 1 --2- 172.21.15.2:0/959502330 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb6c1459a0 0x7fdb6c15f0f0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fdb6400cd20 tx=0x7fdb6400a570 comp rx=0 tx=0).stop 2023-11-26T07:16:15.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.807+0000 7fdb737a6700 1 -- 172.21.15.2:0/959502330 shutdown_connections 2023-11-26T07:16:15.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.807+0000 7fdb737a6700 1 --2- 172.21.15.2:0/959502330 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fdb5006b740 0x7fdb5006dc00 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:15.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.807+0000 7fdb737a6700 1 --2- 172.21.15.2:0/959502330 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb6c1459a0 0x7fdb6c15f0f0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:15.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.807+0000 7fdb737a6700 1 --2- 172.21.15.2:0/959502330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb6c06e580 0x7fdb6c0afed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:15.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.807+0000 7fdb737a6700 1 --2- 172.21.15.2:0/959502330 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb6c142810 0x7fdb6c1f4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:15.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.807+0000 7fdb737a6700 1 -- 172.21.15.2:0/959502330 >> 172.21.15.2:0/959502330 conn(0x7fdb6c0b2740 msgr2=0x7fdb6c15baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:15.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.807+0000 7fdb737a6700 1 -- 172.21.15.2:0/959502330 shutdown_connections 2023-11-26T07:16:15.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.807+0000 7fdb737a6700 1 -- 172.21.15.2:0/959502330 wait complete. 2023-11-26T07:16:15.811 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 37 2023-11-26T07:16:15.821 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:16:15.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.944+0000 7fe497923700 1 Processor -- start 2023-11-26T07:16:15.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.944+0000 7fe497923700 1 -- start start 2023-11-26T07:16:15.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.945+0000 7fe497923700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe4900b4150 0x7fe49006de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:15.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.945+0000 7fe497923700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe4900b5ab0 0x7fe49006e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:15.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.945+0000 7fe497923700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe490071f50 con 0x7fe49006b620 2023-11-26T07:16:15.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.945+0000 7fe497923700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe490072230 con 0x7fe4900b4150 2023-11-26T07:16:15.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.945+0000 7fe497923700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe490072510 con 0x7fe4900b5ab0 2023-11-26T07:16:15.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.945+0000 7fe494ebe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe4900b4150 0x7fe49006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:15.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.945+0000 7fe494ebe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe4900b4150 0x7fe49006de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43702/0 (socket says 172.21.15.2:43702) 2023-11-26T07:16:15.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.945+0000 7fe494ebe700 1 -- 172.21.15.2:0/345123017 learned_addr learned my addr 172.21.15.2:0/345123017 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:15.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.946+0000 7fe495ec0700 1 --2- 172.21.15.2:0/345123017 >> v2:172.21.15.192:3300/0 conn(0x7fe4900b5ab0 0x7fe49006e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:15.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.946+0000 7fe494ebe700 1 -- 172.21.15.2:0/345123017 >> v2:172.21.15.192:3300/0 conn(0x7fe4900b5ab0 msgr2=0x7fe49006e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:15.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.946+0000 7fe494ebe700 1 --2- 172.21.15.2:0/345123017 >> v2:172.21.15.192:3300/0 conn(0x7fe4900b5ab0 0x7fe49006e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:15.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.946+0000 7fe494ebe700 1 -- 172.21.15.2:0/345123017 >> v1:172.21.15.192:6789/0 conn(0x7fe49006b620 legacy=0x7fe4900b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:15.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.946+0000 7fe494ebe700 1 -- 172.21.15.2:0/345123017 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4900727f0 con 0x7fe4900b4150 2023-11-26T07:16:15.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.946+0000 7fe494ebe700 1 --2- 172.21.15.2:0/345123017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4900b4150 0x7fe49006de50 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fe4900694e0 tx=0x7fe480009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c00ba7a77a3fbe1 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:15.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.946+0000 7fe487fff700 1 -- 172.21.15.2:0/345123017 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe480011830 con 0x7fe4900b4150 2023-11-26T07:16:15.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.946+0000 7fe487fff700 1 -- 172.21.15.2:0/345123017 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe480011990 con 0x7fe4900b4150 2023-11-26T07:16:15.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.946+0000 7fe487fff700 1 -- 172.21.15.2:0/345123017 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe480011d20 con 0x7fe4900b4150 2023-11-26T07:16:15.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.947+0000 7fe497923700 1 -- 172.21.15.2:0/345123017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4900b4150 msgr2=0x7fe49006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:15.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.947+0000 7fe497923700 1 --2- 172.21.15.2:0/345123017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4900b4150 0x7fe49006de50 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fe4900694e0 tx=0x7fe480009bd0 comp rx=0 tx=0).stop 2023-11-26T07:16:15.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.947+0000 7fe497923700 1 -- 172.21.15.2:0/345123017 shutdown_connections 2023-11-26T07:16:15.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.947+0000 7fe497923700 1 --2- 172.21.15.2:0/345123017 >> v2:172.21.15.192:3300/0 conn(0x7fe4900b5ab0 0x7fe49006e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:15.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.947+0000 7fe497923700 1 --2- 172.21.15.2:0/345123017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4900b4150 0x7fe49006de50 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:15.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.947+0000 7fe497923700 1 -- 172.21.15.2:0/345123017 >> 172.21.15.2:0/345123017 conn(0x7fe4900b2740 msgr2=0x7fe4900b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:15.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.947+0000 7fe497923700 1 -- 172.21.15.2:0/345123017 shutdown_connections 2023-11-26T07:16:15.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.947+0000 7fe497923700 1 -- 172.21.15.2:0/345123017 wait complete. 2023-11-26T07:16:15.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.948+0000 7fe497923700 1 Processor -- start 2023-11-26T07:16:15.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.948+0000 7fe497923700 1 -- start start 2023-11-26T07:16:15.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.949+0000 7fe497923700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe49006b620 0x7fe490135840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:15.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.949+0000 7fe497923700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe4900b4150 0x7fe4900b1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:15.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.949+0000 7fe497923700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4900b5ab0 0x7fe4901f6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:15.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.949+0000 7fe497923700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe490135d80 con 0x7fe4900b5ab0 2023-11-26T07:16:15.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.949+0000 7fe497923700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe490134df0 con 0x7fe49006b620 2023-11-26T07:16:15.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.949+0000 7fe497923700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4901f7a80 con 0x7fe4900b4150 2023-11-26T07:16:15.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.949+0000 7fe495ec0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4900b5ab0 0x7fe4901f6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:15.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.949+0000 7fe495ec0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4900b5ab0 0x7fe4901f6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43710/0 (socket says 172.21.15.2:43710) 2023-11-26T07:16:15.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.949+0000 7fe495ec0700 1 -- 172.21.15.2:0/2031511567 learned_addr learned my addr 172.21.15.2:0/2031511567 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:15.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.949+0000 7fe4956bf700 1 --2- 172.21.15.2:0/2031511567 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe49006b620 0x7fe490135840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:15.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.949+0000 7fe494ebe700 1 --2- 172.21.15.2:0/2031511567 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe4900b4150 0x7fe4900b1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:15.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.949+0000 7fe495ec0700 1 -- 172.21.15.2:0/2031511567 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe4900b4150 msgr2=0x7fe4900b1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:15.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.949+0000 7fe495ec0700 1 --2- 172.21.15.2:0/2031511567 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe4900b4150 0x7fe4900b1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:15.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.949+0000 7fe495ec0700 1 -- 172.21.15.2:0/2031511567 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe49006b620 msgr2=0x7fe490135840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:15.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.949+0000 7fe495ec0700 1 --2- 172.21.15.2:0/2031511567 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe49006b620 0x7fe490135840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:15.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.949+0000 7fe495ec0700 1 -- 172.21.15.2:0/2031511567 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe480009550 con 0x7fe4900b5ab0 2023-11-26T07:16:15.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.949+0000 7fe4956bf700 1 --2- 172.21.15.2:0/2031511567 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe49006b620 0x7fe490135840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:16:15.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.949+0000 7fe494ebe700 1 --2- 172.21.15.2:0/2031511567 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe4900b4150 0x7fe4900b1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:16:15.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.949+0000 7fe495ec0700 1 --2- 172.21.15.2:0/2031511567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4900b5ab0 0x7fe4901f6fc0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fe48800efc0 tx=0x7fe48800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:15.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.950+0000 7fe485ffb700 1 -- 172.21.15.2:0/2031511567 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe488009ba0 con 0x7fe4900b5ab0 2023-11-26T07:16:15.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.950+0000 7fe485ffb700 1 -- 172.21.15.2:0/2031511567 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48800f040 con 0x7fe4900b5ab0 2023-11-26T07:16:15.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.950+0000 7fe485ffb700 1 -- 172.21.15.2:0/2031511567 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe488014480 con 0x7fe4900b5ab0 2023-11-26T07:16:15.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.950+0000 7fe497923700 1 -- 172.21.15.2:0/2031511567 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4901f7d60 con 0x7fe4900b5ab0 2023-11-26T07:16:15.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.950+0000 7fe497923700 1 -- 172.21.15.2:0/2031511567 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe490135320 con 0x7fe4900b5ab0 2023-11-26T07:16:15.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.951+0000 7fe497923700 1 -- 172.21.15.2:0/2031511567 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4900b54d0 con 0x7fe4900b5ab0 2023-11-26T07:16:15.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.951+0000 7fe485ffb700 1 -- 172.21.15.2:0/2031511567 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7fe4880145e0 con 0x7fe4900b5ab0 2023-11-26T07:16:15.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.952+0000 7fe485ffb700 1 --2- 172.21.15.2:0/2031511567 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe47406b740 0x7fe47406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:15.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.952+0000 7fe485ffb700 1 -- 172.21.15.2:0/2031511567 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5765+0+0 (secure 0 0 0) 0x7fe488088950 con 0x7fe4900b5ab0 2023-11-26T07:16:15.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.952+0000 7fe4956bf700 1 --2- 172.21.15.2:0/2031511567 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe47406b740 0x7fe47406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:15.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.952+0000 7fe4956bf700 1 --2- 172.21.15.2:0/2031511567 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe47406b740 0x7fe47406dc00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe48c000f60 tx=0x7fe48c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:15.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:15.956+0000 7fe485ffb700 1 -- 172.21.15.2:0/2031511567 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe4880554b0 con 0x7fe4900b5ab0 2023-11-26T07:16:16.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.155+0000 7fe497923700 1 -- 172.21.15.2:0/2031511567 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe490068670 con 0x7fe4900b5ab0 2023-11-26T07:16:16.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.157+0000 7fe485ffb700 1 -- 172.21.15.2:0/2031511567 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16625 (secure 0 0 0) 0x7fe488018090 con 0x7fe4900b5ab0 2023-11-26T07:16:16.159 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:16:16.159 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":61,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:16:09.414780+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:15:11.156119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-26T07:15:11.674003+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":61,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:16:16.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.159+0000 7fe497923700 1 -- 172.21.15.2:0/2031511567 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe47406b740 msgr2=0x7fe47406dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:16.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.159+0000 7fe497923700 1 --2- 172.21.15.2:0/2031511567 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe47406b740 0x7fe47406dc00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe48c000f60 tx=0x7fe48c009040 comp rx=0 tx=0).stop 2023-11-26T07:16:16.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.159+0000 7fe497923700 1 -- 172.21.15.2:0/2031511567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4900b5ab0 msgr2=0x7fe4901f6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:16.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.159+0000 7fe497923700 1 --2- 172.21.15.2:0/2031511567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4900b5ab0 0x7fe4901f6fc0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fe48800efc0 tx=0x7fe48800c3a0 comp rx=0 tx=0).stop 2023-11-26T07:16:16.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.159+0000 7fe497923700 1 -- 172.21.15.2:0/2031511567 shutdown_connections 2023-11-26T07:16:16.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.159+0000 7fe497923700 1 --2- 172.21.15.2:0/2031511567 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe47406b740 0x7fe47406dc00 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:16.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.159+0000 7fe497923700 1 --2- 172.21.15.2:0/2031511567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4900b5ab0 0x7fe4901f6fc0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:16.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.159+0000 7fe497923700 1 --2- 172.21.15.2:0/2031511567 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe49006b620 0x7fe490135840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:16.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.159+0000 7fe497923700 1 --2- 172.21.15.2:0/2031511567 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe4900b4150 0x7fe4900b1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:16.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.159+0000 7fe497923700 1 -- 172.21.15.2:0/2031511567 >> 172.21.15.2:0/2031511567 conn(0x7fe4900b2740 msgr2=0x7fe4900b2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:16.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.159+0000 7fe497923700 1 -- 172.21.15.2:0/2031511567 shutdown_connections 2023-11-26T07:16:16.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.159+0000 7fe497923700 1 -- 172.21.15.2:0/2031511567 wait complete. 2023-11-26T07:16:16.173 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:11:28.205739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:15:11.156119+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:15:11.674003+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 61, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:16:16.173 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:16:16.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.300+0000 7f9a8333e700 1 Processor -- start 2023-11-26T07:16:16.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.300+0000 7f9a8333e700 1 -- start start 2023-11-26T07:16:16.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.301+0000 7f9a8333e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9a7c1459c0 0x7f9a7c15c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:16.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.301+0000 7f9a8333e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a7c06daf0 con 0x7f9a7c0cd5d0 2023-11-26T07:16:16.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.301+0000 7f9a8333e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a7c0cfe60 con 0x7f9a7c06b6e0 2023-11-26T07:16:16.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.301+0000 7f9a8333e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a7c0d0140 con 0x7f9a7c1459c0 2023-11-26T07:16:16.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.301+0000 7f9a808d9700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f9a7c0cd5d0 0x7f9a7c06afd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34926/0 (socket says 172.21.15.2:34926) 2023-11-26T07:16:16.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.301+0000 7f9a808d9700 1 -- 172.21.15.2:0/1572032287 learned_addr learned my addr 172.21.15.2:0/1572032287 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:16:16.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.301+0000 7f9a810da700 1 --2- 172.21.15.2:0/1572032287 >> v2:172.21.15.192:3300/0 conn(0x7f9a7c1459c0 0x7f9a7c15c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:16.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.302+0000 7f9a73fff700 1 -- 172.21.15.2:0/1572032287 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 386989152 0 0) 0x7f9a7c06daf0 con 0x7f9a7c0cd5d0 2023-11-26T07:16:16.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.302+0000 7f9a73fff700 1 -- 172.21.15.2:0/1572032287 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a680035b0 con 0x7f9a7c0cd5d0 2023-11-26T07:16:16.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.302+0000 7f9a810da700 1 -- 172.21.15.2:0/1572032287 >> v1:172.21.15.192:6789/0 conn(0x7f9a7c06b6e0 legacy=0x7f9a7c06e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:16.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.302+0000 7f9a810da700 1 -- 172.21.15.2:0/1572032287 >> v1:172.21.15.2:6789/0 conn(0x7f9a7c0cd5d0 legacy=0x7f9a7c06afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:16.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.302+0000 7f9a810da700 1 -- 172.21.15.2:0/1572032287 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a7c0d0420 con 0x7f9a7c1459c0 2023-11-26T07:16:16.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.302+0000 7f9a810da700 1 --2- 172.21.15.2:0/1572032287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a7c1459c0 0x7f9a7c15c540 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9a78009840 tx=0x7f9a78009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1dd2a02466d5584b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:16.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.302+0000 7f9a73fff700 1 -- 172.21.15.2:0/1572032287 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a78011830 con 0x7f9a7c1459c0 2023-11-26T07:16:16.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.302+0000 7f9a73fff700 1 -- 172.21.15.2:0/1572032287 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a78011990 con 0x7f9a7c1459c0 2023-11-26T07:16:16.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.302+0000 7f9a73fff700 1 -- 172.21.15.2:0/1572032287 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a78011d20 con 0x7f9a7c1459c0 2023-11-26T07:16:16.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.303+0000 7f9a8333e700 1 -- 172.21.15.2:0/1572032287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a7c1459c0 msgr2=0x7f9a7c15c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:16.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.303+0000 7f9a8333e700 1 --2- 172.21.15.2:0/1572032287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a7c1459c0 0x7f9a7c15c540 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9a78009840 tx=0x7f9a78009b50 comp rx=0 tx=0).stop 2023-11-26T07:16:16.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.303+0000 7f9a8333e700 1 -- 172.21.15.2:0/1572032287 shutdown_connections 2023-11-26T07:16:16.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.303+0000 7f9a8333e700 1 --2- 172.21.15.2:0/1572032287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a7c1459c0 0x7f9a7c15c540 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:16.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.303+0000 7f9a8333e700 1 -- 172.21.15.2:0/1572032287 >> 172.21.15.2:0/1572032287 conn(0x7f9a7c0b27b0 msgr2=0x7f9a7c0b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:16.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.303+0000 7f9a8333e700 1 -- 172.21.15.2:0/1572032287 shutdown_connections 2023-11-26T07:16:16.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.303+0000 7f9a8333e700 1 -- 172.21.15.2:0/1572032287 wait complete. 2023-11-26T07:16:16.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.305+0000 7f9a8333e700 1 Processor -- start 2023-11-26T07:16:16.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.305+0000 7f9a8333e700 1 -- start start 2023-11-26T07:16:16.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.305+0000 7f9a8333e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a7c06b6e0 0x7f9a7c0ac5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:16.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.305+0000 7f9a8333e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a7c0cd5d0 0x7f9a7c0acb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:16.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.306+0000 7f9a8333e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a7c1459c0 0x7f9a7c0cb860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:16.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.306+0000 7f9a8333e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c15c0b0 con 0x7f9a7c06b6e0 2023-11-26T07:16:16.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.306+0000 7f9a8333e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c135000 con 0x7f9a7c0cd5d0 2023-11-26T07:16:16.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.306+0000 7f9a8333e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c0a9bd0 con 0x7f9a7c1459c0 2023-11-26T07:16:16.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.306+0000 7f9a810da700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a7c06b6e0 0x7f9a7c0ac5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:16.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.306+0000 7f9a810da700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a7c06b6e0 0x7f9a7c0ac5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43720/0 (socket says 172.21.15.2:43720) 2023-11-26T07:16:16.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.306+0000 7f9a810da700 1 -- 172.21.15.2:0/399427693 learned_addr learned my addr 172.21.15.2:0/399427693 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:16.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.306+0000 7f9a808d9700 1 --2- 172.21.15.2:0/399427693 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a7c0cd5d0 0x7f9a7c0acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:16.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.306+0000 7f9a818db700 1 --2- 172.21.15.2:0/399427693 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a7c1459c0 0x7f9a7c0cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:16.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.306+0000 7f9a810da700 1 -- 172.21.15.2:0/399427693 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a7c1459c0 msgr2=0x7f9a7c0cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:16.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.306+0000 7f9a810da700 1 --2- 172.21.15.2:0/399427693 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a7c1459c0 0x7f9a7c0cb860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:16.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.306+0000 7f9a810da700 1 -- 172.21.15.2:0/399427693 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a7c0cd5d0 msgr2=0x7f9a7c0acb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:16.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.306+0000 7f9a810da700 1 --2- 172.21.15.2:0/399427693 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a7c0cd5d0 0x7f9a7c0acb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:16.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.306+0000 7f9a810da700 1 -- 172.21.15.2:0/399427693 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a780094a0 con 0x7f9a7c06b6e0 2023-11-26T07:16:16.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.306+0000 7f9a810da700 1 --2- 172.21.15.2:0/399427693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a7c06b6e0 0x7f9a7c0ac5c0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f9a780090b0 tx=0x7f9a78004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:16.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.306+0000 7f9a71ffb700 1 -- 172.21.15.2:0/399427693 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a780036a0 con 0x7f9a7c06b6e0 2023-11-26T07:16:16.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.306+0000 7f9a71ffb700 1 -- 172.21.15.2:0/399427693 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a7801f070 con 0x7f9a7c06b6e0 2023-11-26T07:16:16.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.306+0000 7f9a8333e700 1 -- 172.21.15.2:0/399427693 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a7c0cc600 con 0x7f9a7c06b6e0 2023-11-26T07:16:16.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.306+0000 7f9a71ffb700 1 -- 172.21.15.2:0/399427693 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a78003a60 con 0x7f9a7c06b6e0 2023-11-26T07:16:16.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.307+0000 7f9a8333e700 1 -- 172.21.15.2:0/399427693 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a7c135530 con 0x7f9a7c06b6e0 2023-11-26T07:16:16.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.308+0000 7f9a8333e700 1 -- 172.21.15.2:0/399427693 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a7c067c70 con 0x7f9a7c06b6e0 2023-11-26T07:16:16.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.308+0000 7f9a71ffb700 1 -- 172.21.15.2:0/399427693 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f9a78003bc0 con 0x7f9a7c06b6e0 2023-11-26T07:16:16.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.308+0000 7f9a71ffb700 1 --2- 172.21.15.2:0/399427693 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9a6006b740 0x7f9a6006dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:16.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.308+0000 7f9a71ffb700 1 -- 172.21.15.2:0/399427693 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f9a78021070 con 0x7f9a7c06b6e0 2023-11-26T07:16:16.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.309+0000 7f9a808d9700 1 --2- 172.21.15.2:0/399427693 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9a6006b740 0x7f9a6006dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:16.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.309+0000 7f9a808d9700 1 --2- 172.21.15.2:0/399427693 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9a6006b740 0x7f9a6006dc00 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c0a9b00 tx=0x7f9a6c007dc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:16.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.313+0000 7f9a71ffb700 1 -- 172.21.15.2:0/399427693 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9a780561a0 con 0x7f9a7c06b6e0 2023-11-26T07:16:16.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.515+0000 7f9a8333e700 1 -- 172.21.15.2:0/399427693 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9a7c075480 con 0x7f9a7c06b6e0 2023-11-26T07:16:16.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.515+0000 7f9a71ffb700 1 -- 172.21.15.2:0/399427693 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v62) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9a780150a0 con 0x7f9a7c06b6e0 2023-11-26T07:16:16.517 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-26T07:16:16.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.517+0000 7f9a8333e700 1 -- 172.21.15.2:0/399427693 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9a6006b740 msgr2=0x7f9a6006dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:16.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.517+0000 7f9a8333e700 1 --2- 172.21.15.2:0/399427693 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9a6006b740 0x7f9a6006dc00 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c0a9b00 tx=0x7f9a6c007dc0 comp rx=0 tx=0).stop 2023-11-26T07:16:16.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.517+0000 7f9a8333e700 1 -- 172.21.15.2:0/399427693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a7c06b6e0 msgr2=0x7f9a7c0ac5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:16.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.517+0000 7f9a8333e700 1 --2- 172.21.15.2:0/399427693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a7c06b6e0 0x7f9a7c0ac5c0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f9a780090b0 tx=0x7f9a78004750 comp rx=0 tx=0).stop 2023-11-26T07:16:16.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.517+0000 7f9a8333e700 1 -- 172.21.15.2:0/399427693 shutdown_connections 2023-11-26T07:16:16.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.517+0000 7f9a8333e700 1 --2- 172.21.15.2:0/399427693 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9a6006b740 0x7f9a6006dc00 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:16.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.517+0000 7f9a8333e700 1 --2- 172.21.15.2:0/399427693 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a7c1459c0 0x7f9a7c0cb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:16.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.517+0000 7f9a8333e700 1 --2- 172.21.15.2:0/399427693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a7c06b6e0 0x7f9a7c0ac5c0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:16.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.517+0000 7f9a8333e700 1 --2- 172.21.15.2:0/399427693 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a7c0cd5d0 0x7f9a7c0acb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:16.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.517+0000 7f9a8333e700 1 -- 172.21.15.2:0/399427693 >> 172.21.15.2:0/399427693 conn(0x7f9a7c0b27b0 msgr2=0x7f9a7c15e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:16.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.517+0000 7f9a8333e700 1 -- 172.21.15.2:0/399427693 shutdown_connections 2023-11-26T07:16:16.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.517+0000 7f9a8333e700 1 -- 172.21.15.2:0/399427693 wait complete. 2023-11-26T07:16:16.531 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:16:16.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.657+0000 7fc63f723700 1 Processor -- start 2023-11-26T07:16:16.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.657+0000 7fc63f723700 1 -- start start 2023-11-26T07:16:16.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.658+0000 7fc63f723700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc63815e090 0x7fc63806afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:16.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.658+0000 7fc63f723700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc6381623d0 0x7fc6380cb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:16.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.658+0000 7fc63f723700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc63815e470 con 0x7fc63806b510 2023-11-26T07:16:16.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.658+0000 7fc63f723700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6380c6900 con 0x7fc6381623d0 2023-11-26T07:16:16.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.658+0000 7fc63f723700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc63806b990 con 0x7fc63815e090 2023-11-26T07:16:16.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.658+0000 7fc63dcc0700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc6381623d0 0x7fc6380cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:16.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.658+0000 7fc63dcc0700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc6381623d0 0x7fc6380cb160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43732/0 (socket says 172.21.15.2:43732) 2023-11-26T07:16:16.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.658+0000 7fc63ccbe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc63806b510 0x7fc638161cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34940/0 (socket says 172.21.15.2:34940) 2023-11-26T07:16:16.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.658+0000 7fc63dcc0700 1 -- 172.21.15.2:0/3041364382 learned_addr learned my addr 172.21.15.2:0/3041364382 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:16.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.658+0000 7fc63d4bf700 1 --2- 172.21.15.2:0/3041364382 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc63815e090 0x7fc63806afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:16.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.658+0000 7fc63dcc0700 1 -- 172.21.15.2:0/3041364382 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc63815e090 msgr2=0x7fc63806afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:16.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.658+0000 7fc63dcc0700 1 --2- 172.21.15.2:0/3041364382 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc63815e090 0x7fc63806afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:16.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.658+0000 7fc63dcc0700 1 -- 172.21.15.2:0/3041364382 >> v1:172.21.15.2:6789/0 conn(0x7fc63806b510 legacy=0x7fc638161cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:16.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.658+0000 7fc63dcc0700 1 -- 172.21.15.2:0/3041364382 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6381629f0 con 0x7fc6381623d0 2023-11-26T07:16:16.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.658+0000 7fc62ffff700 1 -- 172.21.15.2:0/3041364382 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 868829431 0 0) 0x7fc63815e470 con 0x7fc63806b510 2023-11-26T07:16:16.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.659+0000 7fc63dcc0700 1 --2- 172.21.15.2:0/3041364382 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6381623d0 0x7fc6380cb160 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fc630009e50 tx=0x7fc63000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d39c985e4d5288c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:16.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.659+0000 7fc62ffff700 1 -- 172.21.15.2:0/3041364382 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63000e070 con 0x7fc6381623d0 2023-11-26T07:16:16.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.659+0000 7fc62ffff700 1 -- 172.21.15.2:0/3041364382 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63000b9c0 con 0x7fc6381623d0 2023-11-26T07:16:16.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.659+0000 7fc62ffff700 1 -- 172.21.15.2:0/3041364382 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63000bd70 con 0x7fc6381623d0 2023-11-26T07:16:16.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.659+0000 7fc63f723700 1 -- 172.21.15.2:0/3041364382 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6381623d0 msgr2=0x7fc6380cb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:16.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.659+0000 7fc63f723700 1 --2- 172.21.15.2:0/3041364382 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6381623d0 0x7fc6380cb160 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fc630009e50 tx=0x7fc63000b330 comp rx=0 tx=0).stop 2023-11-26T07:16:16.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.659+0000 7fc63f723700 1 -- 172.21.15.2:0/3041364382 shutdown_connections 2023-11-26T07:16:16.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.659+0000 7fc63f723700 1 --2- 172.21.15.2:0/3041364382 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6381623d0 0x7fc6380cb160 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:16.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.659+0000 7fc63f723700 1 --2- 172.21.15.2:0/3041364382 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc63815e090 0x7fc63806afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:16.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.659+0000 7fc63f723700 1 -- 172.21.15.2:0/3041364382 >> 172.21.15.2:0/3041364382 conn(0x7fc6380d0b10 msgr2=0x7fc6380d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:16.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.660+0000 7fc63f723700 1 -- 172.21.15.2:0/3041364382 shutdown_connections 2023-11-26T07:16:16.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.660+0000 7fc63f723700 1 -- 172.21.15.2:0/3041364382 wait complete. 2023-11-26T07:16:16.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.661+0000 7fc63f723700 1 Processor -- start 2023-11-26T07:16:16.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.661+0000 7fc63f723700 1 -- start start 2023-11-26T07:16:16.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.661+0000 7fc63f723700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc63806b510 0x7fc6380b5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:16.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.661+0000 7fc63f723700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc63815e090 0x7fc6381f7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:16.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.662+0000 7fc63f723700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc6381623d0 0x7fc6380b3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:16.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.662+0000 7fc63f723700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6380b6b50 con 0x7fc63815e090 2023-11-26T07:16:16.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.662+0000 7fc63f723700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6380b5f40 con 0x7fc63806b510 2023-11-26T07:16:16.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.662+0000 7fc63f723700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6380b6220 con 0x7fc6381623d0 2023-11-26T07:16:16.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.662+0000 7fc63ccbe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc63815e090 0x7fc6381f7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:16.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.662+0000 7fc63ccbe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc63815e090 0x7fc6381f7d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43736/0 (socket says 172.21.15.2:43736) 2023-11-26T07:16:16.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.662+0000 7fc63ccbe700 1 -- 172.21.15.2:0/992029155 learned_addr learned my addr 172.21.15.2:0/992029155 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:16.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.662+0000 7fc63d4bf700 1 --2- 172.21.15.2:0/992029155 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc63806b510 0x7fc6380b5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:16.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.662+0000 7fc63dcc0700 1 --2- 172.21.15.2:0/992029155 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc6381623d0 0x7fc6380b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:16.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.662+0000 7fc63ccbe700 1 -- 172.21.15.2:0/992029155 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc6381623d0 msgr2=0x7fc6380b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:16.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.662+0000 7fc63ccbe700 1 --2- 172.21.15.2:0/992029155 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc6381623d0 0x7fc6380b3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:16.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.662+0000 7fc63ccbe700 1 -- 172.21.15.2:0/992029155 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc63806b510 msgr2=0x7fc6380b5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:16.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.662+0000 7fc63ccbe700 1 --2- 172.21.15.2:0/992029155 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc63806b510 0x7fc6380b5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:16.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.662+0000 7fc63ccbe700 1 -- 172.21.15.2:0/992029155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc630009b30 con 0x7fc63815e090 2023-11-26T07:16:16.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.662+0000 7fc63ccbe700 1 --2- 172.21.15.2:0/992029155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc63815e090 0x7fc6381f7d60 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fc6280011e0 tx=0x7fc62800ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:16.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.662+0000 7fc62dffb700 1 -- 172.21.15.2:0/992029155 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc628004c80 con 0x7fc63815e090 2023-11-26T07:16:16.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.662+0000 7fc62dffb700 1 -- 172.21.15.2:0/992029155 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc628004e00 con 0x7fc63815e090 2023-11-26T07:16:16.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.662+0000 7fc63f723700 1 -- 172.21.15.2:0/992029155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6380b6500 con 0x7fc63815e090 2023-11-26T07:16:16.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.662+0000 7fc62dffb700 1 -- 172.21.15.2:0/992029155 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc628007310 con 0x7fc63815e090 2023-11-26T07:16:16.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.663+0000 7fc63f723700 1 -- 172.21.15.2:0/992029155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6381f82a0 con 0x7fc63815e090 2023-11-26T07:16:16.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.663+0000 7fc63f723700 1 -- 172.21.15.2:0/992029155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc638159a70 con 0x7fc63815e090 2023-11-26T07:16:16.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.664+0000 7fc62dffb700 1 -- 172.21.15.2:0/992029155 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7fc628007470 con 0x7fc63815e090 2023-11-26T07:16:16.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.664+0000 7fc62dffb700 1 --2- 172.21.15.2:0/992029155 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc61c06b740 0x7fc61c06dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:16.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.665+0000 7fc62dffb700 1 -- 172.21.15.2:0/992029155 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fc628087c30 con 0x7fc63815e090 2023-11-26T07:16:16.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.665+0000 7fc63d4bf700 1 --2- 172.21.15.2:0/992029155 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc61c06b740 0x7fc61c06dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:16.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.665+0000 7fc63d4bf700 1 --2- 172.21.15.2:0/992029155 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc61c06b740 0x7fc61c06dc00 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc634006b20 tx=0x7fc634008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:16.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.669+0000 7fc62dffb700 1 -- 172.21.15.2:0/992029155 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc638159a70 con 0x7fc63815e090 2023-11-26T07:16:16.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.873+0000 7fc63f723700 1 -- 172.21.15.2:0/992029155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc6380ae2d0 con 0x7fc63815e090 2023-11-26T07:16:16.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.874+0000 7fc62dffb700 1 -- 172.21.15.2:0/992029155 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v62) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc6280545c0 con 0x7fc63815e090 2023-11-26T07:16:16.876 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-26T07:16:16.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.876+0000 7fc63f723700 1 -- 172.21.15.2:0/992029155 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc61c06b740 msgr2=0x7fc61c06dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:16.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.876+0000 7fc63f723700 1 --2- 172.21.15.2:0/992029155 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc61c06b740 0x7fc61c06dc00 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc634006b20 tx=0x7fc634008040 comp rx=0 tx=0).stop 2023-11-26T07:16:16.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.876+0000 7fc63f723700 1 -- 172.21.15.2:0/992029155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc63815e090 msgr2=0x7fc6381f7d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:16.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.876+0000 7fc63f723700 1 --2- 172.21.15.2:0/992029155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc63815e090 0x7fc6381f7d60 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fc6280011e0 tx=0x7fc62800ca30 comp rx=0 tx=0).stop 2023-11-26T07:16:16.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.876+0000 7fc63f723700 1 -- 172.21.15.2:0/992029155 shutdown_connections 2023-11-26T07:16:16.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.876+0000 7fc63f723700 1 --2- 172.21.15.2:0/992029155 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc61c06b740 0x7fc61c06dc00 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:16.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.876+0000 7fc63f723700 1 --2- 172.21.15.2:0/992029155 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc6381623d0 0x7fc6380b3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:16.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.876+0000 7fc63f723700 1 --2- 172.21.15.2:0/992029155 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc63806b510 0x7fc6380b5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:16.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.876+0000 7fc63f723700 1 --2- 172.21.15.2:0/992029155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc63815e090 0x7fc6381f7d60 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:16.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.876+0000 7fc63f723700 1 -- 172.21.15.2:0/992029155 >> 172.21.15.2:0/992029155 conn(0x7fc6380d0b10 msgr2=0x7fc638161b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:16.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.876+0000 7fc63f723700 1 -- 172.21.15.2:0/992029155 shutdown_connections 2023-11-26T07:16:16.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:16.876+0000 7fc63f723700 1 -- 172.21.15.2:0/992029155 wait complete. 2023-11-26T07:16:16.890 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:16:17.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.017+0000 7fe490bfd700 1 Processor -- start 2023-11-26T07:16:17.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.017+0000 7fe490bfd700 1 -- start start 2023-11-26T07:16:17.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.018+0000 7fe490bfd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe48c0b3e00 0x7fe48c06b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:17.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.018+0000 7fe490bfd700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe48c0ad260 con 0x7fe48c0afdc0 2023-11-26T07:16:17.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.018+0000 7fe490bfd700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe48c06bf20 con 0x7fe48c15a440 2023-11-26T07:16:17.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.018+0000 7fe490bfd700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe48c0673f0 con 0x7fe48c0b3e00 2023-11-26T07:16:17.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.018+0000 7fe48ad9d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe48c0afdc0 0x7fe48c165180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34956/0 (socket says 172.21.15.2:34956) 2023-11-26T07:16:17.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.018+0000 7fe48ad9d700 1 -- 172.21.15.2:0/1236610990 learned_addr learned my addr 172.21.15.2:0/1236610990 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:16:17.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.018+0000 7fe48a59c700 1 --2- 172.21.15.2:0/1236610990 >> v2:172.21.15.192:3300/0 conn(0x7fe48c0b3e00 0x7fe48c06b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:17.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.018+0000 7fe48959a700 1 -- 172.21.15.2:0/1236610990 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2597942343 0 0) 0x7fe48c0ad260 con 0x7fe48c0afdc0 2023-11-26T07:16:17.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.018+0000 7fe48959a700 1 -- 172.21.15.2:0/1236610990 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4780035b0 con 0x7fe48c0afdc0 2023-11-26T07:16:17.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.019+0000 7fe48959a700 1 -- 172.21.15.2:0/1236610990 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3054415919 0 0) 0x7fe4780035b0 con 0x7fe48c0afdc0 2023-11-26T07:16:17.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.019+0000 7fe48959a700 1 -- 172.21.15.2:0/1236610990 >> v2:172.21.15.192:3300/0 conn(0x7fe48c0b3e00 msgr2=0x7fe48c06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:17.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.019+0000 7fe48959a700 1 --2- 172.21.15.2:0/1236610990 >> v2:172.21.15.192:3300/0 conn(0x7fe48c0b3e00 0x7fe48c06b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:17.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.019+0000 7fe48959a700 1 -- 172.21.15.2:0/1236610990 >> v1:172.21.15.192:6789/0 conn(0x7fe48c15a440 legacy=0x7fe48c066ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:17.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.019+0000 7fe48959a700 1 -- 172.21.15.2:0/1236610990 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe48c0ad4b0 con 0x7fe48c0afdc0 2023-11-26T07:16:17.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.019+0000 7fe48959a700 1 -- 172.21.15.2:0/1236610990 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7fe4840019f0 con 0x7fe48c0afdc0 2023-11-26T07:16:17.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.019+0000 7fe48959a700 1 -- 172.21.15.2:0/1236610990 >> v1:172.21.15.2:6789/0 conn(0x7fe48c0afdc0 legacy=0x7fe48c165180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:17.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.019+0000 7fe48959a700 1 --2- 172.21.15.2:0/1236610990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe478003a00 0x7fe478003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:17.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.019+0000 7fe48959a700 1 --2- 172.21.15.2:0/1236610990 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe478004850 0x7fe478004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:17.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.019+0000 7fe48959a700 1 --2- 172.21.15.2:0/1236610990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe478005330 0x7fe47800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:17.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.019+0000 7fe48959a700 1 -- 172.21.15.2:0/1236610990 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c0673f0 con 0x7fe478005330 2023-11-26T07:16:17.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.019+0000 7fe48959a700 1 -- 172.21.15.2:0/1236610990 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47800c200 con 0x7fe478003a00 2023-11-26T07:16:17.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.019+0000 7fe48959a700 1 -- 172.21.15.2:0/1236610990 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe47800c3c0 con 0x7fe478004850 2023-11-26T07:16:17.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.019+0000 7fe48ad9d700 1 --2- 172.21.15.2:0/1236610990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe478005330 0x7fe47800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:17.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.019+0000 7fe48a59c700 1 --2- 172.21.15.2:0/1236610990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe478003a00 0x7fe478003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:17.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.019+0000 7fe489d9b700 1 --2- 172.21.15.2:0/1236610990 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe478004850 0x7fe478004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:17.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.019+0000 7fe48ad9d700 1 -- 172.21.15.2:0/1236610990 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe478004850 msgr2=0x7fe478004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:17.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.019+0000 7fe48ad9d700 1 --2- 172.21.15.2:0/1236610990 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe478004850 0x7fe478004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:17.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.019+0000 7fe48ad9d700 1 -- 172.21.15.2:0/1236610990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe478003a00 msgr2=0x7fe478003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:17.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.019+0000 7fe48ad9d700 1 --2- 172.21.15.2:0/1236610990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe478003a00 0x7fe478003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:17.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.019+0000 7fe48ad9d700 1 -- 172.21.15.2:0/1236610990 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4780035b0 con 0x7fe478005330 2023-11-26T07:16:17.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.019+0000 7fe48a59c700 1 --2- 172.21.15.2:0/1236610990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe478003a00 0x7fe478003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:16:17.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.019+0000 7fe48ad9d700 1 -- 172.21.15.2:0/1236610990 reap_dead start 2023-11-26T07:16:17.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.019+0000 7fe48ad9d700 1 --2- 172.21.15.2:0/1236610990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe478005330 0x7fe47800ba10 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fe48400a7f0 tx=0x7fe478005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddab350f2fa7b8d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:17.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.019+0000 7fe48959a700 1 -- 172.21.15.2:0/1236610990 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48400a2f0 con 0x7fe478005330 2023-11-26T07:16:17.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.019+0000 7fe48959a700 1 -- 172.21.15.2:0/1236610990 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe484012620 con 0x7fe478005330 2023-11-26T07:16:17.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.019+0000 7fe48959a700 1 -- 172.21.15.2:0/1236610990 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4840129d0 con 0x7fe478005330 2023-11-26T07:16:17.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.020+0000 7fe490bfd700 1 -- 172.21.15.2:0/1236610990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe478005330 msgr2=0x7fe47800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:17.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.020+0000 7fe490bfd700 1 --2- 172.21.15.2:0/1236610990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe478005330 0x7fe47800ba10 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fe48400a7f0 tx=0x7fe478005880 comp rx=0 tx=0).stop 2023-11-26T07:16:17.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.020+0000 7fe490bfd700 1 -- 172.21.15.2:0/1236610990 shutdown_connections 2023-11-26T07:16:17.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.020+0000 7fe490bfd700 1 --2- 172.21.15.2:0/1236610990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe478005330 0x7fe47800ba10 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:17.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.020+0000 7fe490bfd700 1 -- 172.21.15.2:0/1236610990 >> 172.21.15.2:0/1236610990 conn(0x7fe48c0717f0 msgr2=0x7fe48c0b50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:17.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.020+0000 7fe490bfd700 1 -- 172.21.15.2:0/1236610990 shutdown_connections 2023-11-26T07:16:17.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.020+0000 7fe490bfd700 1 -- 172.21.15.2:0/1236610990 wait complete. 2023-11-26T07:16:17.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.021+0000 7fe490bfd700 1 Processor -- start 2023-11-26T07:16:17.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.021+0000 7fe490bfd700 1 -- start start 2023-11-26T07:16:17.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.022+0000 7fe490bfd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe478005330 0x7fe48c147980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:17.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.022+0000 7fe490bfd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe48c1557e0 0x7fe48c155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:17.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.022+0000 7fe490bfd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe48c09c8c0 0x7fe48c09cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:17.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.022+0000 7fe490bfd700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c1561a0 con 0x7fe478005330 2023-11-26T07:16:17.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.022+0000 7fe490bfd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c1481d0 con 0x7fe48c1557e0 2023-11-26T07:16:17.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.022+0000 7fe490bfd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c1f3c70 con 0x7fe48c09c8c0 2023-11-26T07:16:17.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.022+0000 7fe48a59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe478005330 0x7fe48c147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:17.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.022+0000 7fe48a59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe478005330 0x7fe48c147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43754/0 (socket says 172.21.15.2:43754) 2023-11-26T07:16:17.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.022+0000 7fe48a59c700 1 -- 172.21.15.2:0/466455934 learned_addr learned my addr 172.21.15.2:0/466455934 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:17.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.023+0000 7fe48ad9d700 1 --2- 172.21.15.2:0/466455934 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe48c09c8c0 0x7fe48c09cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:17.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.023+0000 7fe489d9b700 1 --2- 172.21.15.2:0/466455934 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe48c1557e0 0x7fe48c155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:17.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.023+0000 7fe48a59c700 1 -- 172.21.15.2:0/466455934 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe48c09c8c0 msgr2=0x7fe48c09cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:17.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.023+0000 7fe48a59c700 1 --2- 172.21.15.2:0/466455934 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe48c09c8c0 0x7fe48c09cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:17.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.023+0000 7fe48a59c700 1 -- 172.21.15.2:0/466455934 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe48c1557e0 msgr2=0x7fe48c155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:17.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.023+0000 7fe48a59c700 1 --2- 172.21.15.2:0/466455934 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe48c1557e0 0x7fe48c155c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:17.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.023+0000 7fe48a59c700 1 -- 172.21.15.2:0/466455934 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe48c147ec0 con 0x7fe478005330 2023-11-26T07:16:17.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.023+0000 7fe48a59c700 1 --2- 172.21.15.2:0/466455934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe478005330 0x7fe48c147980 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fe474010880 tx=0x7fe474010c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:17.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.023+0000 7fe482ffd700 1 -- 172.21.15.2:0/466455934 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe474010e80 con 0x7fe478005330 2023-11-26T07:16:17.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.023+0000 7fe482ffd700 1 -- 172.21.15.2:0/466455934 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe474004020 con 0x7fe478005330 2023-11-26T07:16:17.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.023+0000 7fe490bfd700 1 -- 172.21.15.2:0/466455934 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe48c1f3f10 con 0x7fe478005330 2023-11-26T07:16:17.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.023+0000 7fe482ffd700 1 -- 172.21.15.2:0/466455934 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4740043b0 con 0x7fe478005330 2023-11-26T07:16:17.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.023+0000 7fe490bfd700 1 -- 172.21.15.2:0/466455934 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe48c1f44d0 con 0x7fe478005330 2023-11-26T07:16:17.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.024+0000 7fe490bfd700 1 -- 172.21.15.2:0/466455934 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe48c075480 con 0x7fe478005330 2023-11-26T07:16:17.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.024+0000 7fe482ffd700 1 -- 172.21.15.2:0/466455934 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7fe47400e8d0 con 0x7fe478005330 2023-11-26T07:16:17.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.025+0000 7fe482ffd700 1 --2- 172.21.15.2:0/466455934 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe46c06b740 0x7fe46c06dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:17.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.025+0000 7fe482ffd700 1 -- 172.21.15.2:0/466455934 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fe474088390 con 0x7fe478005330 2023-11-26T07:16:17.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.025+0000 7fe489d9b700 1 --2- 172.21.15.2:0/466455934 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe46c06b740 0x7fe46c06dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:17.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.026+0000 7fe489d9b700 1 --2- 172.21.15.2:0/466455934 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe46c06b740 0x7fe46c06dc00 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe48c0af670 tx=0x7fe47c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:17.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.029+0000 7fe482ffd700 1 -- 172.21.15.2:0/466455934 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe474054d20 con 0x7fe478005330 2023-11-26T07:16:17.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.234+0000 7fe490bfd700 1 -- 172.21.15.2:0/466455934 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe48c09a640 con 0x7fe478005330 2023-11-26T07:16:17.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.234+0000 7fe482ffd700 1 -- 172.21.15.2:0/466455934 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v62) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe474058340 con 0x7fe478005330 2023-11-26T07:16:17.236 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-26T07:16:17.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.236+0000 7fe490bfd700 1 -- 172.21.15.2:0/466455934 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe46c06b740 msgr2=0x7fe46c06dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:17.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.236+0000 7fe490bfd700 1 --2- 172.21.15.2:0/466455934 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe46c06b740 0x7fe46c06dc00 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe48c0af670 tx=0x7fe47c009040 comp rx=0 tx=0).stop 2023-11-26T07:16:17.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.236+0000 7fe490bfd700 1 -- 172.21.15.2:0/466455934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe478005330 msgr2=0x7fe48c147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:17.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.236+0000 7fe490bfd700 1 --2- 172.21.15.2:0/466455934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe478005330 0x7fe48c147980 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fe474010880 tx=0x7fe474010c40 comp rx=0 tx=0).stop 2023-11-26T07:16:17.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.236+0000 7fe490bfd700 1 -- 172.21.15.2:0/466455934 shutdown_connections 2023-11-26T07:16:17.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.236+0000 7fe490bfd700 1 --2- 172.21.15.2:0/466455934 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe46c06b740 0x7fe46c06dc00 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:17.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.236+0000 7fe490bfd700 1 --2- 172.21.15.2:0/466455934 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe48c09c8c0 0x7fe48c09cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:17.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.236+0000 7fe490bfd700 1 --2- 172.21.15.2:0/466455934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe478005330 0x7fe48c147980 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:17.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.236+0000 7fe490bfd700 1 --2- 172.21.15.2:0/466455934 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe48c1557e0 0x7fe48c155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:17.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.236+0000 7fe490bfd700 1 -- 172.21.15.2:0/466455934 >> 172.21.15.2:0/466455934 conn(0x7fe48c0717f0 msgr2=0x7fe48c06d420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:17.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.236+0000 7fe490bfd700 1 -- 172.21.15.2:0/466455934 shutdown_connections 2023-11-26T07:16:17.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.236+0000 7fe490bfd700 1 -- 172.21.15.2:0/466455934 wait complete. 2023-11-26T07:16:17.251 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:16:17.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.376+0000 7f59cee8b700 1 Processor -- start 2023-11-26T07:16:17.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.376+0000 7f59cee8b700 1 -- start start 2023-11-26T07:16:17.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.377+0000 7f59cee8b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f59c8145830 0x7f59c80cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:17.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.377+0000 7f59cee8b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f59c806afd0 0x7f59c806b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:17.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.377+0000 7f59cee8b700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c806db10 con 0x7f59c806b990 2023-11-26T07:16:17.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.377+0000 7f59cee8b700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c8145c10 con 0x7f59c8145830 2023-11-26T07:16:17.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.377+0000 7f59cee8b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c806be20 con 0x7f59c806afd0 2023-11-26T07:16:17.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.377+0000 7f59ccc27700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f59c8145830 0x7f59c80cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:17.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.377+0000 7f59cd428700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f59c806b990 0x7f59c815fa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34972/0 (socket says 172.21.15.2:34972) 2023-11-26T07:16:17.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.377+0000 7f59cd428700 1 -- 172.21.15.2:0/2284481828 learned_addr learned my addr 172.21.15.2:0/2284481828 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:16:17.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.377+0000 7f59c7fff700 1 --2- 172.21.15.2:0/2284481828 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f59c806afd0 0x7f59c806b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:17.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.378+0000 7f59ccc27700 1 -- 172.21.15.2:0/2284481828 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f59c806afd0 msgr2=0x7f59c806b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:17.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.378+0000 7f59ccc27700 1 --2- 172.21.15.2:0/2284481828 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f59c806afd0 0x7f59c806b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:17.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.378+0000 7f59ccc27700 1 -- 172.21.15.2:0/2284481828 >> v1:172.21.15.2:6789/0 conn(0x7f59c806b990 legacy=0x7f59c815fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:17.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.378+0000 7f59c77fe700 1 -- 172.21.15.2:0/2284481828 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 646754629 0 0) 0x7f59c806db10 con 0x7f59c806b990 2023-11-26T07:16:17.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.378+0000 7f59ccc27700 1 -- 172.21.15.2:0/2284481828 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c80cddb0 con 0x7f59c8145830 2023-11-26T07:16:17.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.378+0000 7f59c7fff700 1 --2- 172.21.15.2:0/2284481828 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f59c806afd0 0x7f59c806b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:16:17.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.378+0000 7f59ccc27700 1 --2- 172.21.15.2:0/2284481828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59c8145830 0x7f59c80cd5d0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f59bc009840 tx=0x7f59bc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae487075727f626d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:17.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.378+0000 7f59c77fe700 1 -- 172.21.15.2:0/2284481828 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc011830 con 0x7f59c8145830 2023-11-26T07:16:17.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.378+0000 7f59c77fe700 1 -- 172.21.15.2:0/2284481828 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59bc011990 con 0x7f59c8145830 2023-11-26T07:16:17.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.378+0000 7f59c77fe700 1 -- 172.21.15.2:0/2284481828 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc011d20 con 0x7f59c8145830 2023-11-26T07:16:17.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.378+0000 7f59cee8b700 1 -- 172.21.15.2:0/2284481828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59c8145830 msgr2=0x7f59c80cd5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:17.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.378+0000 7f59cee8b700 1 --2- 172.21.15.2:0/2284481828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59c8145830 0x7f59c80cd5d0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f59bc009840 tx=0x7f59bc009b50 comp rx=0 tx=0).stop 2023-11-26T07:16:17.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.378+0000 7f59cee8b700 1 -- 172.21.15.2:0/2284481828 shutdown_connections 2023-11-26T07:16:17.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.378+0000 7f59cee8b700 1 --2- 172.21.15.2:0/2284481828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59c8145830 0x7f59c80cd5d0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:17.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.378+0000 7f59cee8b700 1 --2- 172.21.15.2:0/2284481828 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f59c806afd0 0x7f59c806b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:17.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.378+0000 7f59cee8b700 1 -- 172.21.15.2:0/2284481828 >> 172.21.15.2:0/2284481828 conn(0x7f59c80d0bc0 msgr2=0x7f59c80d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:17.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.379+0000 7f59cee8b700 1 -- 172.21.15.2:0/2284481828 shutdown_connections 2023-11-26T07:16:17.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.379+0000 7f59cee8b700 1 -- 172.21.15.2:0/2284481828 wait complete. 2023-11-26T07:16:17.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.380+0000 7f59cee8b700 1 Processor -- start 2023-11-26T07:16:17.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.380+0000 7f59cee8b700 1 -- start start 2023-11-26T07:16:17.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.381+0000 7f59cee8b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f59c806afd0 0x7f59c80b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:17.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.381+0000 7f59cee8b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59c806b990 0x7f59c80c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:17.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.381+0000 7f59cee8b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59c8145830 0x7f59c80cb840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:17.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.381+0000 7f59cee8b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c80ca290 con 0x7f59c8145830 2023-11-26T07:16:17.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.381+0000 7f59cee8b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c80c9680 con 0x7f59c806b990 2023-11-26T07:16:17.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.381+0000 7f59cee8b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c80c9960 con 0x7f59c806afd0 2023-11-26T07:16:17.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.381+0000 7f59cd428700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59c8145830 0x7f59c80cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:17.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.381+0000 7f59cd428700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59c8145830 0x7f59c80cb840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43770/0 (socket says 172.21.15.2:43770) 2023-11-26T07:16:17.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.381+0000 7f59cd428700 1 -- 172.21.15.2:0/3018076153 learned_addr learned my addr 172.21.15.2:0/3018076153 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:17.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.382+0000 7f59c7fff700 1 --2- 172.21.15.2:0/3018076153 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59c806b990 0x7f59c80c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:17.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.382+0000 7f59ccc27700 1 --2- 172.21.15.2:0/3018076153 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f59c806afd0 0x7f59c80b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:17.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.382+0000 7f59cd428700 1 -- 172.21.15.2:0/3018076153 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f59c806afd0 msgr2=0x7f59c80b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:17.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.382+0000 7f59cd428700 1 --2- 172.21.15.2:0/3018076153 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f59c806afd0 0x7f59c80b1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:17.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.382+0000 7f59cd428700 1 -- 172.21.15.2:0/3018076153 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59c806b990 msgr2=0x7f59c80c8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:17.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.382+0000 7f59cd428700 1 --2- 172.21.15.2:0/3018076153 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59c806b990 0x7f59c80c8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:17.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.382+0000 7f59cd428700 1 -- 172.21.15.2:0/3018076153 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59bc0094a0 con 0x7f59c8145830 2023-11-26T07:16:17.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.382+0000 7f59cd428700 1 --2- 172.21.15.2:0/3018076153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59c8145830 0x7f59c80cb840 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f59c0002230 tx=0x7f59c000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:17.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.382+0000 7f59c57fa700 1 -- 172.21.15.2:0/3018076153 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c000ac20 con 0x7f59c8145830 2023-11-26T07:16:17.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.382+0000 7f59c57fa700 1 -- 172.21.15.2:0/3018076153 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c000ada0 con 0x7f59c8145830 2023-11-26T07:16:17.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.382+0000 7f59cee8b700 1 -- 172.21.15.2:0/3018076153 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59c80c9c40 con 0x7f59c8145830 2023-11-26T07:16:17.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.382+0000 7f59c57fa700 1 -- 172.21.15.2:0/3018076153 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c0007310 con 0x7f59c8145830 2023-11-26T07:16:17.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.382+0000 7f59cee8b700 1 -- 172.21.15.2:0/3018076153 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c80b21a0 con 0x7f59c8145830 2023-11-26T07:16:17.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.383+0000 7f59cee8b700 1 -- 172.21.15.2:0/3018076153 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c8068670 con 0x7f59c8145830 2023-11-26T07:16:17.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.383+0000 7f59c57fa700 1 -- 172.21.15.2:0/3018076153 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f59c0007470 con 0x7f59c8145830 2023-11-26T07:16:17.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.384+0000 7f59c57fa700 1 --2- 172.21.15.2:0/3018076153 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f59ac06b740 0x7f59ac06dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:17.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.384+0000 7f59c57fa700 1 -- 172.21.15.2:0/3018076153 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f59c0087b30 con 0x7f59c8145830 2023-11-26T07:16:17.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.384+0000 7f59ccc27700 1 --2- 172.21.15.2:0/3018076153 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f59ac06b740 0x7f59ac06dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:17.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.385+0000 7f59ccc27700 1 --2- 172.21.15.2:0/3018076153 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f59ac06b740 0x7f59ac06dc00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f59bc0090b0 tx=0x7f59bc01c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:17.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.388+0000 7f59c57fa700 1 -- 172.21.15.2:0/3018076153 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f59c00544c0 con 0x7f59c8145830 2023-11-26T07:16:17.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.634+0000 7f59cee8b700 1 -- 172.21.15.2:0/3018076153 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f59c80ca3d0 con 0x7f59c8145830 2023-11-26T07:16:17.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.634+0000 7f59c57fa700 1 -- 172.21.15.2:0/3018076153 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f59c80ca3d0 con 0x7f59c8145830 2023-11-26T07:16:17.636 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:16:17.636 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5384,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3283211322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3283211322},{"type":"v1","addr":"172.21.15.192:6837","nonce":3283211322}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":5833,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/4149545589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":4149545589},{"type":"v1","addr":"172.21.15.192:6836","nonce":4149545589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":6171,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/1422633843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1422633843},{"type":"v1","addr":"172.21.15.2:6834","nonce":1422633843}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:15:12.714394+0000","modified":"2023-11-26T07:15:15.725909+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6174},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6174":{"gid":6174,"name":"a","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6835/1251532899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":1251532899},{"type":"v1","addr":"172.21.15.2:6835","nonce":1251532899}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-26T07:16:17.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.636+0000 7f59cee8b700 1 -- 172.21.15.2:0/3018076153 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f59ac06b740 msgr2=0x7f59ac06dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:17.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.636+0000 7f59cee8b700 1 --2- 172.21.15.2:0/3018076153 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f59ac06b740 0x7f59ac06dc00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f59bc0090b0 tx=0x7f59bc01c040 comp rx=0 tx=0).stop 2023-11-26T07:16:17.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.636+0000 7f59cee8b700 1 -- 172.21.15.2:0/3018076153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59c8145830 msgr2=0x7f59c80cb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:17.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.636+0000 7f59cee8b700 1 --2- 172.21.15.2:0/3018076153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59c8145830 0x7f59c80cb840 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f59c0002230 tx=0x7f59c000a060 comp rx=0 tx=0).stop 2023-11-26T07:16:17.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.636+0000 7f59cee8b700 1 -- 172.21.15.2:0/3018076153 shutdown_connections 2023-11-26T07:16:17.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.637+0000 7f59cee8b700 1 --2- 172.21.15.2:0/3018076153 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f59ac06b740 0x7f59ac06dc00 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:17.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.637+0000 7f59cee8b700 1 --2- 172.21.15.2:0/3018076153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59c8145830 0x7f59c80cb840 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:17.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.637+0000 7f59cee8b700 1 --2- 172.21.15.2:0/3018076153 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f59c806afd0 0x7f59c80b1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:17.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.637+0000 7f59cee8b700 1 --2- 172.21.15.2:0/3018076153 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59c806b990 0x7f59c80c8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:17.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.637+0000 7f59cee8b700 1 -- 172.21.15.2:0/3018076153 >> 172.21.15.2:0/3018076153 conn(0x7f59c80d0bc0 msgr2=0x7f59c806f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:17.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.637+0000 7f59cee8b700 1 -- 172.21.15.2:0/3018076153 shutdown_connections 2023-11-26T07:16:17.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.637+0000 7f59cee8b700 1 -- 172.21.15.2:0/3018076153 wait complete. 2023-11-26T07:16:17.640 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 37 2023-11-26T07:16:17.651 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:16:17.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.773+0000 7fd3820f7700 1 Processor -- start 2023-11-26T07:16:17.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.773+0000 7fd3820f7700 1 -- start start 2023-11-26T07:16:17.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.774+0000 7fd3820f7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd37c0722c0 0x7fd37c0b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:17.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.774+0000 7fd3820f7700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd37c1440f0 0x7fd37c06e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:17.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.774+0000 7fd3820f7700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd37c143ec0 con 0x7fd37c143ae0 2023-11-26T07:16:17.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.774+0000 7fd3820f7700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd37c0b40a0 con 0x7fd37c1440f0 2023-11-26T07:16:17.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.774+0000 7fd3820f7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c0b3ae0 con 0x7fd37c0722c0 2023-11-26T07:16:17.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.775+0000 7fd37bfff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd37c1440f0 0x7fd37c06e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:17.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.775+0000 7fd37affd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd37c0722c0 0x7fd37c0b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:17.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.775+0000 7fd37b7fe700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fd37c143ae0 0x7fd37c071bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.2:42354/0 (socket says 172.21.15.2:42354) 2023-11-26T07:16:17.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.775+0000 7fd37b7fe700 1 -- 172.21.15.2:0/3782010217 learned_addr learned my addr 172.21.15.2:0/3782010217 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:16:17.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.775+0000 7fd37a7fc700 1 -- 172.21.15.2:0/3782010217 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3280592019 0 0) 0x7fd37c143ec0 con 0x7fd37c143ae0 2023-11-26T07:16:17.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.775+0000 7fd37a7fc700 1 -- 172.21.15.2:0/3782010217 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3640035b0 con 0x7fd37c143ae0 2023-11-26T07:16:17.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.775+0000 7fd37affd700 1 -- 172.21.15.2:0/3782010217 >> v2:172.21.15.192:3300/0 conn(0x7fd37c1440f0 msgr2=0x7fd37c06e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:17.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.775+0000 7fd37affd700 1 --2- 172.21.15.2:0/3782010217 >> v2:172.21.15.192:3300/0 conn(0x7fd37c1440f0 0x7fd37c06e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:17.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.775+0000 7fd37affd700 1 -- 172.21.15.2:0/3782010217 >> v1:172.21.15.192:6789/0 conn(0x7fd37c143ae0 legacy=0x7fd37c071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:17.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.775+0000 7fd37affd700 1 -- 172.21.15.2:0/3782010217 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd37c0b3dc0 con 0x7fd37c0722c0 2023-11-26T07:16:17.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.775+0000 7fd37bfff700 1 --2- 172.21.15.2:0/3782010217 >> v2:172.21.15.192:3300/0 conn(0x7fd37c1440f0 0x7fd37c06e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:16:17.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.775+0000 7fd37affd700 1 --2- 172.21.15.2:0/3782010217 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd37c0722c0 0x7fd37c0b51b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd370009840 tx=0x7fd370009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7300d3452a5b1f27 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:17.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.775+0000 7fd37a7fc700 1 -- 172.21.15.2:0/3782010217 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd370011830 con 0x7fd37c0722c0 2023-11-26T07:16:17.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.775+0000 7fd37a7fc700 1 -- 172.21.15.2:0/3782010217 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd370011990 con 0x7fd37c0722c0 2023-11-26T07:16:17.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.775+0000 7fd37a7fc700 1 -- 172.21.15.2:0/3782010217 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd370011d00 con 0x7fd37c0722c0 2023-11-26T07:16:17.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.776+0000 7fd3820f7700 1 -- 172.21.15.2:0/3782010217 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd37c0722c0 msgr2=0x7fd37c0b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:17.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.776+0000 7fd3820f7700 1 --2- 172.21.15.2:0/3782010217 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd37c0722c0 0x7fd37c0b51b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd370009840 tx=0x7fd370009b50 comp rx=0 tx=0).stop 2023-11-26T07:16:17.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.776+0000 7fd3820f7700 1 -- 172.21.15.2:0/3782010217 shutdown_connections 2023-11-26T07:16:17.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.776+0000 7fd3820f7700 1 --2- 172.21.15.2:0/3782010217 >> v2:172.21.15.192:3300/0 conn(0x7fd37c1440f0 0x7fd37c06e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:17.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.776+0000 7fd3820f7700 1 --2- 172.21.15.2:0/3782010217 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd37c0722c0 0x7fd37c0b51b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:17.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.776+0000 7fd3820f7700 1 -- 172.21.15.2:0/3782010217 >> 172.21.15.2:0/3782010217 conn(0x7fd37c0b2740 msgr2=0x7fd37c0b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:17.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.776+0000 7fd3820f7700 1 -- 172.21.15.2:0/3782010217 shutdown_connections 2023-11-26T07:16:17.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.776+0000 7fd3820f7700 1 -- 172.21.15.2:0/3782010217 wait complete. 2023-11-26T07:16:17.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.777+0000 7fd3820f7700 1 Processor -- start 2023-11-26T07:16:17.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.778+0000 7fd3820f7700 1 -- start start 2023-11-26T07:16:17.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.778+0000 7fd3820f7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd37c0722c0 0x7fd37c0c59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:17.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.778+0000 7fd3820f7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd37c143ae0 0x7fd37c15bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:17.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.778+0000 7fd3820f7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd37c1440f0 0x7fd37c141800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:17.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.778+0000 7fd3820f7700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c156ec0 con 0x7fd37c1440f0 2023-11-26T07:16:17.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.778+0000 7fd3820f7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c15c2d0 con 0x7fd37c143ae0 2023-11-26T07:16:17.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.778+0000 7fd3820f7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c15c570 con 0x7fd37c0722c0 2023-11-26T07:16:17.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.778+0000 7fd37bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd37c1440f0 0x7fd37c141800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:17.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.778+0000 7fd37bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd37c1440f0 0x7fd37c141800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43784/0 (socket says 172.21.15.2:43784) 2023-11-26T07:16:17.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.778+0000 7fd37b7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd37c0722c0 0x7fd37c0c59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:17.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.778+0000 7fd37bfff700 1 -- 172.21.15.2:0/2779652522 learned_addr learned my addr 172.21.15.2:0/2779652522 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:17.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.778+0000 7fd37affd700 1 --2- 172.21.15.2:0/2779652522 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd37c143ae0 0x7fd37c15bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:17.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.779+0000 7fd37bfff700 1 -- 172.21.15.2:0/2779652522 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd37c0722c0 msgr2=0x7fd37c0c59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:17.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.779+0000 7fd37bfff700 1 --2- 172.21.15.2:0/2779652522 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd37c0722c0 0x7fd37c0c59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:17.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.779+0000 7fd37bfff700 1 -- 172.21.15.2:0/2779652522 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd37c143ae0 msgr2=0x7fd37c15bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:17.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.779+0000 7fd37bfff700 1 --2- 172.21.15.2:0/2779652522 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd37c143ae0 0x7fd37c15bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:17.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.779+0000 7fd37bfff700 1 -- 172.21.15.2:0/2779652522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd374009a70 con 0x7fd37c1440f0 2023-11-26T07:16:17.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.779+0000 7fd37bfff700 1 --2- 172.21.15.2:0/2779652522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd37c1440f0 0x7fd37c141800 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fd37400e580 tx=0x7fd37400e890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:17.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.779+0000 7fd363fff700 1 -- 172.21.15.2:0/2779652522 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd374003c20 con 0x7fd37c1440f0 2023-11-26T07:16:17.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.779+0000 7fd363fff700 1 -- 172.21.15.2:0/2779652522 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd374003d80 con 0x7fd37c1440f0 2023-11-26T07:16:17.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.779+0000 7fd363fff700 1 -- 172.21.15.2:0/2779652522 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd374004260 con 0x7fd37c1440f0 2023-11-26T07:16:17.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.779+0000 7fd3820f7700 1 -- 172.21.15.2:0/2779652522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3700094a0 con 0x7fd37c1440f0 2023-11-26T07:16:17.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.779+0000 7fd3820f7700 1 -- 172.21.15.2:0/2779652522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd37c15cb30 con 0x7fd37c1440f0 2023-11-26T07:16:17.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.780+0000 7fd3820f7700 1 -- 172.21.15.2:0/2779652522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd37c15d180 con 0x7fd37c1440f0 2023-11-26T07:16:17.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.781+0000 7fd363fff700 1 -- 172.21.15.2:0/2779652522 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7fd3740043c0 con 0x7fd37c1440f0 2023-11-26T07:16:17.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.781+0000 7fd363fff700 1 --2- 172.21.15.2:0/2779652522 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd36806b740 0x7fd36806dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:17.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.781+0000 7fd363fff700 1 -- 172.21.15.2:0/2779652522 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fd374016070 con 0x7fd37c1440f0 2023-11-26T07:16:17.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.781+0000 7fd37b7fe700 1 --2- 172.21.15.2:0/2779652522 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd36806b740 0x7fd36806dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:17.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.782+0000 7fd37b7fe700 1 --2- 172.21.15.2:0/2779652522 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd36806b740 0x7fd36806dc00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd36c007fd0 tx=0x7fd36c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:17.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.786+0000 7fd363fff700 1 -- 172.21.15.2:0/2779652522 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd3740574b0 con 0x7fd37c1440f0 2023-11-26T07:16:17.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.987+0000 7fd3820f7700 1 -- 172.21.15.2:0/2779652522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd37c068670 con 0x7fd37c1440f0 2023-11-26T07:16:17.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.988+0000 7fd363fff700 1 -- 172.21.15.2:0/2779652522 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+16582 (secure 0 0 0) 0x7fd37405aad0 con 0x7fd37c1440f0 2023-11-26T07:16:17.990 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:16:17.990 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":62,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:16:16.254986+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:15:11.156119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-26T07:15:11.674003+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":61,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:16:17.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.990+0000 7fd3820f7700 1 -- 172.21.15.2:0/2779652522 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd36806b740 msgr2=0x7fd36806dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:17.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.990+0000 7fd3820f7700 1 --2- 172.21.15.2:0/2779652522 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd36806b740 0x7fd36806dc00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd36c007fd0 tx=0x7fd36c009040 comp rx=0 tx=0).stop 2023-11-26T07:16:17.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.990+0000 7fd3820f7700 1 -- 172.21.15.2:0/2779652522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd37c1440f0 msgr2=0x7fd37c141800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:17.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.990+0000 7fd3820f7700 1 --2- 172.21.15.2:0/2779652522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd37c1440f0 0x7fd37c141800 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fd37400e580 tx=0x7fd37400e890 comp rx=0 tx=0).stop 2023-11-26T07:16:17.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.990+0000 7fd3820f7700 1 -- 172.21.15.2:0/2779652522 shutdown_connections 2023-11-26T07:16:17.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.990+0000 7fd3820f7700 1 --2- 172.21.15.2:0/2779652522 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd36806b740 0x7fd36806dc00 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:17.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.990+0000 7fd3820f7700 1 --2- 172.21.15.2:0/2779652522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd37c1440f0 0x7fd37c141800 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:17.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.990+0000 7fd3820f7700 1 --2- 172.21.15.2:0/2779652522 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd37c0722c0 0x7fd37c0c59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:17.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.990+0000 7fd3820f7700 1 --2- 172.21.15.2:0/2779652522 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd37c143ae0 0x7fd37c15bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:17.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.990+0000 7fd3820f7700 1 -- 172.21.15.2:0/2779652522 >> 172.21.15.2:0/2779652522 conn(0x7fd37c0b2740 msgr2=0x7fd37c0b4430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:17.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.990+0000 7fd3820f7700 1 -- 172.21.15.2:0/2779652522 shutdown_connections 2023-11-26T07:16:17.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:17.990+0000 7fd3820f7700 1 -- 172.21.15.2:0/2779652522 wait complete. 2023-11-26T07:16:18.005 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-26T07:16:18.005 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:16:18.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.129+0000 7f8cbe0b7700 1 Processor -- start 2023-11-26T07:16:18.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.129+0000 7f8cbe0b7700 1 -- start start 2023-11-26T07:16:18.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.130+0000 7f8cbe0b7700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8cb80d0080 0x7f8cb80b5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:18.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.130+0000 7f8cbe0b7700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8cb8071bb0 0x7f8cb806afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:18.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.130+0000 7f8cbe0b7700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb8147bb0 con 0x7f8cb806b510 2023-11-26T07:16:18.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.130+0000 7f8cbe0b7700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb8072cd0 con 0x7f8cb8071bb0 2023-11-26T07:16:18.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.130+0000 7f8cbe0b7700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb806b980 con 0x7f8cb80d0080 2023-11-26T07:16:18.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.130+0000 7f8cb6ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8cb8071bb0 0x7f8cb806afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:18.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.130+0000 7f8cb6ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8cb8071bb0 0x7f8cb806afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43790/0 (socket says 172.21.15.2:43790) 2023-11-26T07:16:18.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.130+0000 7f8cb6ffd700 1 -- 172.21.15.2:0/517255851 learned_addr learned my addr 172.21.15.2:0/517255851 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:18.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.130+0000 7f8cb77fe700 1 --2- 172.21.15.2:0/517255851 >> v2:172.21.15.192:3300/0 conn(0x7f8cb80d0080 0x7f8cb80b5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:18.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.130+0000 7f8cb6ffd700 1 -- 172.21.15.2:0/517255851 >> v2:172.21.15.192:3300/0 conn(0x7f8cb80d0080 msgr2=0x7f8cb80b5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:18.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.130+0000 7f8cb6ffd700 1 --2- 172.21.15.2:0/517255851 >> v2:172.21.15.192:3300/0 conn(0x7f8cb80d0080 0x7f8cb80b5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:18.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.130+0000 7f8cb6ffd700 1 -- 172.21.15.2:0/517255851 >> v1:172.21.15.192:6789/0 conn(0x7f8cb806b510 legacy=0x7f8cb8161b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:18.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.130+0000 7f8cb6ffd700 1 -- 172.21.15.2:0/517255851 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb80b5dd0 con 0x7f8cb8071bb0 2023-11-26T07:16:18.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.130+0000 7f8cb6ffd700 1 --2- 172.21.15.2:0/517255851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb8071bb0 0x7f8cb806afd0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f8cb8062d30 tx=0x7f8cac009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed12c71c2354a768 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:18.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.130+0000 7f8cb67fc700 1 -- 172.21.15.2:0/517255851 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cac004230 con 0x7f8cb8071bb0 2023-11-26T07:16:18.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.130+0000 7f8cb67fc700 1 -- 172.21.15.2:0/517255851 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cac004390 con 0x7f8cb8071bb0 2023-11-26T07:16:18.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.130+0000 7f8cb67fc700 1 -- 172.21.15.2:0/517255851 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cac0036a0 con 0x7f8cb8071bb0 2023-11-26T07:16:18.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.131+0000 7f8cbe0b7700 1 -- 172.21.15.2:0/517255851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb8071bb0 msgr2=0x7f8cb806afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:18.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.131+0000 7f8cbe0b7700 1 --2- 172.21.15.2:0/517255851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb8071bb0 0x7f8cb806afd0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f8cb8062d30 tx=0x7f8cac009bd0 comp rx=0 tx=0).stop 2023-11-26T07:16:18.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.131+0000 7f8cbe0b7700 1 -- 172.21.15.2:0/517255851 shutdown_connections 2023-11-26T07:16:18.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.131+0000 7f8cbe0b7700 1 --2- 172.21.15.2:0/517255851 >> v2:172.21.15.192:3300/0 conn(0x7f8cb80d0080 0x7f8cb80b5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:18.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.131+0000 7f8cbe0b7700 1 --2- 172.21.15.2:0/517255851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb8071bb0 0x7f8cb806afd0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:18.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.131+0000 7f8cbe0b7700 1 -- 172.21.15.2:0/517255851 >> 172.21.15.2:0/517255851 conn(0x7f8cb80b27d0 msgr2=0x7f8cb80b2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:18.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.131+0000 7f8cbe0b7700 1 -- 172.21.15.2:0/517255851 shutdown_connections 2023-11-26T07:16:18.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.131+0000 7f8cbe0b7700 1 -- 172.21.15.2:0/517255851 wait complete. 2023-11-26T07:16:18.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.132+0000 7f8cbe0b7700 1 Processor -- start 2023-11-26T07:16:18.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.132+0000 7f8cbe0b7700 1 -- start start 2023-11-26T07:16:18.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.133+0000 7f8cbe0b7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8cb806b510 0x7f8cb8140b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:18.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.133+0000 7f8cbe0b7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8cb8071bb0 0x7f8cb81e7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:18.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.133+0000 7f8cbe0b7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb80d0080 0x7f8cb81e7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:18.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.133+0000 7f8cbe0b7700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb81f4b80 con 0x7f8cb80d0080 2023-11-26T07:16:18.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.133+0000 7f8cbe0b7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb81f4e60 con 0x7f8cb806b510 2023-11-26T07:16:18.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.133+0000 7f8cbe0b7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb81f5140 con 0x7f8cb8071bb0 2023-11-26T07:16:18.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.133+0000 7f8cb7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb80d0080 0x7f8cb81e7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:18.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.133+0000 7f8cb7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb80d0080 0x7f8cb81e7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43798/0 (socket says 172.21.15.2:43798) 2023-11-26T07:16:18.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.133+0000 7f8cb7fff700 1 -- 172.21.15.2:0/1818009284 learned_addr learned my addr 172.21.15.2:0/1818009284 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:18.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.133+0000 7f8cb77fe700 1 --2- 172.21.15.2:0/1818009284 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8cb806b510 0x7f8cb8140b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:18.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.133+0000 7f8cb6ffd700 1 --2- 172.21.15.2:0/1818009284 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8cb8071bb0 0x7f8cb81e7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:18.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.134+0000 7f8cb7fff700 1 -- 172.21.15.2:0/1818009284 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8cb8071bb0 msgr2=0x7f8cb81e7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:18.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.134+0000 7f8cb7fff700 1 --2- 172.21.15.2:0/1818009284 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8cb8071bb0 0x7f8cb81e7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:18.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.134+0000 7f8cb7fff700 1 -- 172.21.15.2:0/1818009284 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8cb806b510 msgr2=0x7f8cb8140b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:18.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.134+0000 7f8cb7fff700 1 --2- 172.21.15.2:0/1818009284 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8cb806b510 0x7f8cb8140b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:18.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.134+0000 7f8cb7fff700 1 -- 172.21.15.2:0/1818009284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cac009550 con 0x7f8cb80d0080 2023-11-26T07:16:18.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.134+0000 7f8cb6ffd700 1 --2- 172.21.15.2:0/1818009284 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8cb8071bb0 0x7f8cb81e7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:16:18.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.134+0000 7f8cb7fff700 1 --2- 172.21.15.2:0/1818009284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb80d0080 0x7f8cb81e7c40 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f8cb000c7a0 tx=0x7f8cb000cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:18.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.134+0000 7f8c9ffff700 1 -- 172.21.15.2:0/1818009284 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb0003e10 con 0x7f8cb80d0080 2023-11-26T07:16:18.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.134+0000 7f8c9ffff700 1 -- 172.21.15.2:0/1818009284 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb0005070 con 0x7f8cb80d0080 2023-11-26T07:16:18.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.134+0000 7f8cbe0b7700 1 -- 172.21.15.2:0/1818009284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb81f5420 con 0x7f8cb80d0080 2023-11-26T07:16:18.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.134+0000 7f8c9ffff700 1 -- 172.21.15.2:0/1818009284 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb0005420 con 0x7f8cb80d0080 2023-11-26T07:16:18.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.134+0000 7f8cbe0b7700 1 -- 172.21.15.2:0/1818009284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb8141040 con 0x7f8cb80d0080 2023-11-26T07:16:18.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.135+0000 7f8cbe0b7700 1 -- 172.21.15.2:0/1818009284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cb81f5a70 con 0x7f8cb80d0080 2023-11-26T07:16:18.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.135+0000 7f8c9ffff700 1 -- 172.21.15.2:0/1818009284 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f8cb0005580 con 0x7f8cb80d0080 2023-11-26T07:16:18.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.136+0000 7f8c9ffff700 1 --2- 172.21.15.2:0/1818009284 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8ca406b740 0x7f8ca406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:18.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.136+0000 7f8c9ffff700 1 -- 172.21.15.2:0/1818009284 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f8cb0087720 con 0x7f8cb80d0080 2023-11-26T07:16:18.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.136+0000 7f8cb77fe700 1 --2- 172.21.15.2:0/1818009284 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8ca406b740 0x7f8ca406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:18.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.136+0000 7f8cb77fe700 1 --2- 172.21.15.2:0/1818009284 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8ca406b740 0x7f8ca406dc00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8cb80b5c60 tx=0x7f8ca8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:18.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.140+0000 7f8c9ffff700 1 -- 172.21.15.2:0/1818009284 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8cb00540b0 con 0x7f8cb80d0080 2023-11-26T07:16:18.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.385+0000 7f8cbe0b7700 1 -- 172.21.15.2:0/1818009284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8cb80b37f0 con 0x7f8cb80d0080 2023-11-26T07:16:18.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.386+0000 7f8c9ffff700 1 -- 172.21.15.2:0/1818009284 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f8cb0017090 con 0x7f8cb80d0080 2023-11-26T07:16:18.388 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:16:18.388 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5384,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3283211322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3283211322},{"type":"v1","addr":"172.21.15.192:6837","nonce":3283211322}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":5833,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/4149545589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":4149545589},{"type":"v1","addr":"172.21.15.192:6836","nonce":4149545589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":6171,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/1422633843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1422633843},{"type":"v1","addr":"172.21.15.2:6834","nonce":1422633843}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:15:12.714394+0000","modified":"2023-11-26T07:15:15.725909+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6174},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6174":{"gid":6174,"name":"a","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6835/1251532899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":1251532899},{"type":"v1","addr":"172.21.15.2:6835","nonce":1251532899}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-26T07:16:18.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.388+0000 7f8cbe0b7700 1 -- 172.21.15.2:0/1818009284 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8ca406b740 msgr2=0x7f8ca406dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:18.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.388+0000 7f8cbe0b7700 1 --2- 172.21.15.2:0/1818009284 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8ca406b740 0x7f8ca406dc00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8cb80b5c60 tx=0x7f8ca8008040 comp rx=0 tx=0).stop 2023-11-26T07:16:18.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.388+0000 7f8cbe0b7700 1 -- 172.21.15.2:0/1818009284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb80d0080 msgr2=0x7f8cb81e7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:18.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.388+0000 7f8cbe0b7700 1 --2- 172.21.15.2:0/1818009284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb80d0080 0x7f8cb81e7c40 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f8cb000c7a0 tx=0x7f8cb000cb60 comp rx=0 tx=0).stop 2023-11-26T07:16:18.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.388+0000 7f8cbe0b7700 1 -- 172.21.15.2:0/1818009284 shutdown_connections 2023-11-26T07:16:18.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.388+0000 7f8cbe0b7700 1 --2- 172.21.15.2:0/1818009284 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8ca406b740 0x7f8ca406dc00 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:18.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.388+0000 7f8cbe0b7700 1 --2- 172.21.15.2:0/1818009284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb80d0080 0x7f8cb81e7c40 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:18.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.388+0000 7f8cbe0b7700 1 --2- 172.21.15.2:0/1818009284 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8cb806b510 0x7f8cb8140b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:18.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.388+0000 7f8cbe0b7700 1 --2- 172.21.15.2:0/1818009284 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8cb8071bb0 0x7f8cb81e7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:18.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.388+0000 7f8cbe0b7700 1 -- 172.21.15.2:0/1818009284 >> 172.21.15.2:0/1818009284 conn(0x7f8cb80b27d0 msgr2=0x7f8cb80b0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:18.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.388+0000 7f8cbe0b7700 1 -- 172.21.15.2:0/1818009284 shutdown_connections 2023-11-26T07:16:18.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.388+0000 7f8cbe0b7700 1 -- 172.21.15.2:0/1818009284 wait complete. 2023-11-26T07:16:18.392 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 37 2023-11-26T07:16:18.402 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:16:18.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.527+0000 7f28748fe700 1 Processor -- start 2023-11-26T07:16:18.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.527+0000 7f28748fe700 1 -- start start 2023-11-26T07:16:18.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.528+0000 7f28748fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f28700d49d0 0x7f28700d2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:18.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.528+0000 7f28748fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28700d29d0 0x7f28700b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:18.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.528+0000 7f28748fe700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28700d4e50 con 0x7f287015e460 2023-11-26T07:16:18.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.528+0000 7f28748fe700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28700d2e60 con 0x7f28700d49d0 2023-11-26T07:16:18.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.528+0000 7f28748fe700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28700b3370 con 0x7f28700d29d0 2023-11-26T07:16:18.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.528+0000 7f286dd9b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f28700d49d0 0x7f28700d2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:18.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.528+0000 7f286ed9d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28700d29d0 0x7f28700b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:18.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.529+0000 7f286ed9d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28700d29d0 0x7f28700b40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.2:41886/0 (socket says 172.21.15.2:41886) 2023-11-26T07:16:18.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.529+0000 7f286dd9b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f28700d49d0 0x7f28700d2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.2:52390/0 (socket says 172.21.15.2:52390) 2023-11-26T07:16:18.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.529+0000 7f286ed9d700 1 -- 172.21.15.2:0/4047348375 learned_addr learned my addr 172.21.15.2:0/4047348375 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:18.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.529+0000 7f286e59c700 1 --1- 172.21.15.2:0/4047348375 >> v1:172.21.15.192:6789/0 conn(0x7f287015e460 0x7f28700cf480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.2:42382/0 (socket says 172.21.15.2:42382) 2023-11-26T07:16:18.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.529+0000 7f286ed9d700 1 -- 172.21.15.2:0/4047348375 >> v2:172.21.15.192:3300/0 conn(0x7f28700d49d0 msgr2=0x7f28700d2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:18.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.529+0000 7f286ed9d700 1 --2- 172.21.15.2:0/4047348375 >> v2:172.21.15.192:3300/0 conn(0x7f28700d49d0 0x7f28700d2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:18.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.529+0000 7f286ed9d700 1 -- 172.21.15.2:0/4047348375 >> v1:172.21.15.192:6789/0 conn(0x7f287015e460 legacy=0x7f28700cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:18.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.529+0000 7f286ed9d700 1 -- 172.21.15.2:0/4047348375 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28700cfc40 con 0x7f28700d29d0 2023-11-26T07:16:18.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.529+0000 7f286d59a700 1 -- 172.21.15.2:0/4047348375 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3779723451 0 0) 0x7f28700d4e50 con 0x7f287015e460 2023-11-26T07:16:18.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.529+0000 7f286dd9b700 1 --2- 172.21.15.2:0/4047348375 >> v2:172.21.15.192:3300/0 conn(0x7f28700d49d0 0x7f28700d2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:16:18.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.529+0000 7f286ed9d700 1 --2- 172.21.15.2:0/4047348375 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28700d29d0 0x7f28700b40a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f28600098f0 tx=0x7f2860009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db8f8b036ba46b37 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:18.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.529+0000 7f286d59a700 1 -- 172.21.15.2:0/4047348375 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2860011830 con 0x7f28700d29d0 2023-11-26T07:16:18.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.529+0000 7f286d59a700 1 -- 172.21.15.2:0/4047348375 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2860011990 con 0x7f28700d29d0 2023-11-26T07:16:18.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.529+0000 7f286d59a700 1 -- 172.21.15.2:0/4047348375 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2860011d20 con 0x7f28700d29d0 2023-11-26T07:16:18.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.530+0000 7f28748fe700 1 -- 172.21.15.2:0/4047348375 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28700d29d0 msgr2=0x7f28700b40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:18.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.530+0000 7f28748fe700 1 --2- 172.21.15.2:0/4047348375 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28700d29d0 0x7f28700b40a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f28600098f0 tx=0x7f2860009c00 comp rx=0 tx=0).stop 2023-11-26T07:16:18.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.530+0000 7f28748fe700 1 -- 172.21.15.2:0/4047348375 shutdown_connections 2023-11-26T07:16:18.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.530+0000 7f28748fe700 1 --2- 172.21.15.2:0/4047348375 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28700d29d0 0x7f28700b40a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:18.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.530+0000 7f28748fe700 1 --2- 172.21.15.2:0/4047348375 >> v2:172.21.15.192:3300/0 conn(0x7f28700d49d0 0x7f28700d2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:18.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.530+0000 7f28748fe700 1 -- 172.21.15.2:0/4047348375 >> 172.21.15.2:0/4047348375 conn(0x7f28700d3eb0 msgr2=0x7f28700d42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:18.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.530+0000 7f28748fe700 1 -- 172.21.15.2:0/4047348375 shutdown_connections 2023-11-26T07:16:18.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.530+0000 7f28748fe700 1 -- 172.21.15.2:0/4047348375 wait complete. 2023-11-26T07:16:18.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.531+0000 7f28748fe700 1 Processor -- start 2023-11-26T07:16:18.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.531+0000 7f28748fe700 1 -- start start 2023-11-26T07:16:18.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.532+0000 7f28748fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28700d29d0 0x7f28700b8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:18.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.532+0000 7f28748fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28700d49d0 0x7f28700b1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:18.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.532+0000 7f28748fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f287015e460 0x7f28700cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:18.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.532+0000 7f28748fe700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28700b7a30 con 0x7f28700d29d0 2023-11-26T07:16:18.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.532+0000 7f28748fe700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28700b6db0 con 0x7f28700d49d0 2023-11-26T07:16:18.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.532+0000 7f28748fe700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28700b7090 con 0x7f287015e460 2023-11-26T07:16:18.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.532+0000 7f286e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28700d29d0 0x7f28700b8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:18.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.532+0000 7f286e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28700d29d0 0x7f28700b8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43808/0 (socket says 172.21.15.2:43808) 2023-11-26T07:16:18.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.532+0000 7f286e59c700 1 -- 172.21.15.2:0/3566118217 learned_addr learned my addr 172.21.15.2:0/3566118217 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:18.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.532+0000 7f286ed9d700 1 --2- 172.21.15.2:0/3566118217 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f287015e460 0x7f28700cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:18.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.532+0000 7f286dd9b700 1 --2- 172.21.15.2:0/3566118217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28700d49d0 0x7f28700b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:18.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.533+0000 7f286e59c700 1 -- 172.21.15.2:0/3566118217 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f287015e460 msgr2=0x7f28700cd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:18.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.533+0000 7f286e59c700 1 --2- 172.21.15.2:0/3566118217 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f287015e460 0x7f28700cd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:18.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.533+0000 7f286e59c700 1 -- 172.21.15.2:0/3566118217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28700d49d0 msgr2=0x7f28700b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:18.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.533+0000 7f286e59c700 1 --2- 172.21.15.2:0/3566118217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28700d49d0 0x7f28700b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:18.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.533+0000 7f286e59c700 1 -- 172.21.15.2:0/3566118217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28580094a0 con 0x7f28700d29d0 2023-11-26T07:16:18.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.533+0000 7f286ed9d700 1 --2- 172.21.15.2:0/3566118217 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f287015e460 0x7f28700cd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:16:18.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.533+0000 7f286dd9b700 1 --2- 172.21.15.2:0/3566118217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28700d49d0 0x7f28700b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:16:18.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.533+0000 7f286e59c700 1 --2- 172.21.15.2:0/3566118217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28700d29d0 0x7f28700b8e70 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f286800cc20 tx=0x7f286800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:18.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.533+0000 7f2866ffd700 1 -- 172.21.15.2:0/3566118217 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286800ac20 con 0x7f28700d29d0 2023-11-26T07:16:18.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.533+0000 7f2866ffd700 1 -- 172.21.15.2:0/3566118217 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286800ad80 con 0x7f28700d29d0 2023-11-26T07:16:18.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.533+0000 7f28748fe700 1 -- 172.21.15.2:0/3566118217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2860009550 con 0x7f28700d29d0 2023-11-26T07:16:18.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.533+0000 7f2866ffd700 1 -- 172.21.15.2:0/3566118217 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2868007310 con 0x7f28700d29d0 2023-11-26T07:16:18.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.533+0000 7f28748fe700 1 -- 172.21.15.2:0/3566118217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28700b7650 con 0x7f28700d29d0 2023-11-26T07:16:18.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.534+0000 7f28748fe700 1 -- 172.21.15.2:0/3566118217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2870067f60 con 0x7f28700d29d0 2023-11-26T07:16:18.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.534+0000 7f2866ffd700 1 -- 172.21.15.2:0/3566118217 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f2868007470 con 0x7f28700d29d0 2023-11-26T07:16:18.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.535+0000 7f2866ffd700 1 --2- 172.21.15.2:0/3566118217 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f285006b740 0x7f285006dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:18.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.535+0000 7f2866ffd700 1 -- 172.21.15.2:0/3566118217 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f2868087bd0 con 0x7f28700d29d0 2023-11-26T07:16:18.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.535+0000 7f286dd9b700 1 --2- 172.21.15.2:0/3566118217 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f285006b740 0x7f285006dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:18.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.536+0000 7f286dd9b700 1 --2- 172.21.15.2:0/3566118217 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f285006b740 0x7f285006dc00 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f28701f6e10 tx=0x7f2858008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:18.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.539+0000 7f2866ffd700 1 -- 172.21.15.2:0/3566118217 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2868054500 con 0x7f28700d29d0 2023-11-26T07:16:18.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.791+0000 7f28748fe700 1 -- 172.21.15.2:0/3566118217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28700d2270 con 0x7f28700d29d0 2023-11-26T07:16:18.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.792+0000 7f2866ffd700 1 -- 172.21.15.2:0/3566118217 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f2868018090 con 0x7f28700d29d0 2023-11-26T07:16:18.794 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:16:18.794 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5384,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3283211322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3283211322},{"type":"v1","addr":"172.21.15.192:6837","nonce":3283211322}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":5833,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/4149545589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":4149545589},{"type":"v1","addr":"172.21.15.192:6836","nonce":4149545589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":6171,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/1422633843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1422633843},{"type":"v1","addr":"172.21.15.2:6834","nonce":1422633843}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:15:12.714394+0000","modified":"2023-11-26T07:15:15.725909+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6174},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6174":{"gid":6174,"name":"a","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6835/1251532899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":1251532899},{"type":"v1","addr":"172.21.15.2:6835","nonce":1251532899}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-26T07:16:18.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.794+0000 7f28748fe700 1 -- 172.21.15.2:0/3566118217 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f285006b740 msgr2=0x7f285006dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:18.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.794+0000 7f28748fe700 1 --2- 172.21.15.2:0/3566118217 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f285006b740 0x7f285006dc00 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f28701f6e10 tx=0x7f2858008040 comp rx=0 tx=0).stop 2023-11-26T07:16:18.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.794+0000 7f28748fe700 1 -- 172.21.15.2:0/3566118217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28700d29d0 msgr2=0x7f28700b8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:18.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.794+0000 7f28748fe700 1 --2- 172.21.15.2:0/3566118217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28700d29d0 0x7f28700b8e70 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f286800cc20 tx=0x7f286800a060 comp rx=0 tx=0).stop 2023-11-26T07:16:18.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.794+0000 7f28748fe700 1 -- 172.21.15.2:0/3566118217 shutdown_connections 2023-11-26T07:16:18.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.794+0000 7f28748fe700 1 --2- 172.21.15.2:0/3566118217 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f285006b740 0x7f285006dc00 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:18.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.794+0000 7f28748fe700 1 --2- 172.21.15.2:0/3566118217 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f287015e460 0x7f28700cd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:18.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.794+0000 7f28748fe700 1 --2- 172.21.15.2:0/3566118217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28700d29d0 0x7f28700b8e70 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:18.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.794+0000 7f28748fe700 1 --2- 172.21.15.2:0/3566118217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28700d49d0 0x7f28700b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:18.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.794+0000 7f28748fe700 1 -- 172.21.15.2:0/3566118217 >> 172.21.15.2:0/3566118217 conn(0x7f28700d3eb0 msgr2=0x7f28700ce880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:18.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.794+0000 7f28748fe700 1 -- 172.21.15.2:0/3566118217 shutdown_connections 2023-11-26T07:16:18.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.794+0000 7f28748fe700 1 -- 172.21.15.2:0/3566118217 wait complete. 2023-11-26T07:16:18.798 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 37 2023-11-26T07:16:18.809 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:16:18.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.931+0000 7f0a9cb02700 1 Processor -- start 2023-11-26T07:16:18.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.931+0000 7f0a9cb02700 1 -- start start 2023-11-26T07:16:18.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.932+0000 7f0a9cb02700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0a9806afd0 0x7f0a980b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:18.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.932+0000 7f0a9cb02700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a9806edc0 0x7f0a9806b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:18.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.932+0000 7f0a9cb02700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0a9806dba0 0x7f0a9806e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:18.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.932+0000 7f0a9cb02700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a9806f830 con 0x7f0a9806afd0 2023-11-26T07:16:18.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.932+0000 7f0a9cb02700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a980ad860 con 0x7f0a9806dba0 2023-11-26T07:16:18.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.932+0000 7f0a9cb02700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a980d0a20 con 0x7f0a9806edc0 2023-11-26T07:16:18.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.932+0000 7f0a9659c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0a9806afd0 0x7f0a980b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:18.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.932+0000 7f0a9659c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0a9806afd0 0x7f0a980b5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43816/0 (socket says 172.21.15.2:43816) 2023-11-26T07:16:18.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.932+0000 7f0a9659c700 1 -- 172.21.15.2:0/1846882352 learned_addr learned my addr 172.21.15.2:0/1846882352 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:18.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.932+0000 7f0a96d9d700 1 --2- 172.21.15.2:0/1846882352 >> v2:172.21.15.192:3300/0 conn(0x7f0a9806dba0 0x7f0a9806e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:18.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.932+0000 7f0a95d9b700 1 --2- 172.21.15.2:0/1846882352 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a9806edc0 0x7f0a9806b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:18.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.932+0000 7f0a9659c700 1 -- 172.21.15.2:0/1846882352 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a9806edc0 msgr2=0x7f0a9806b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:18.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.932+0000 7f0a9659c700 1 --2- 172.21.15.2:0/1846882352 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a9806edc0 0x7f0a9806b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:18.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.932+0000 7f0a9659c700 1 -- 172.21.15.2:0/1846882352 >> v2:172.21.15.192:3300/0 conn(0x7f0a9806dba0 msgr2=0x7f0a9806e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:18.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.933+0000 7f0a9659c700 1 --2- 172.21.15.2:0/1846882352 >> v2:172.21.15.192:3300/0 conn(0x7f0a9806dba0 0x7f0a9806e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:18.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.933+0000 7f0a9659c700 1 -- 172.21.15.2:0/1846882352 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a98162a70 con 0x7f0a9806afd0 2023-11-26T07:16:18.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.933+0000 7f0a9659c700 1 --2- 172.21.15.2:0/1846882352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a9806afd0 0x7f0a980b5a70 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f0a98071ad0 tx=0x7f0a8c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=238cdba35b1e9b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:18.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.933+0000 7f0a9559a700 1 -- 172.21.15.2:0/1846882352 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c00b870 con 0x7f0a9806afd0 2023-11-26T07:16:18.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.933+0000 7f0a9559a700 1 -- 172.21.15.2:0/1846882352 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8c00b9d0 con 0x7f0a9806afd0 2023-11-26T07:16:18.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.933+0000 7f0a9559a700 1 -- 172.21.15.2:0/1846882352 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c00bd60 con 0x7f0a9806afd0 2023-11-26T07:16:18.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.933+0000 7f0a9cb02700 1 -- 172.21.15.2:0/1846882352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a9806afd0 msgr2=0x7f0a980b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:18.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.933+0000 7f0a9cb02700 1 --2- 172.21.15.2:0/1846882352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a9806afd0 0x7f0a980b5a70 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f0a98071ad0 tx=0x7f0a8c009bd0 comp rx=0 tx=0).stop 2023-11-26T07:16:18.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.933+0000 7f0a9cb02700 1 -- 172.21.15.2:0/1846882352 shutdown_connections 2023-11-26T07:16:18.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.933+0000 7f0a9cb02700 1 --2- 172.21.15.2:0/1846882352 >> v2:172.21.15.192:3300/0 conn(0x7f0a9806dba0 0x7f0a9806e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:18.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.933+0000 7f0a9cb02700 1 --2- 172.21.15.2:0/1846882352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a9806afd0 0x7f0a980b5a70 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:18.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.933+0000 7f0a9cb02700 1 --2- 172.21.15.2:0/1846882352 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a9806edc0 0x7f0a9806b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:18.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.933+0000 7f0a9cb02700 1 -- 172.21.15.2:0/1846882352 >> 172.21.15.2:0/1846882352 conn(0x7f0a980b2840 msgr2=0x7f0a980b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:18.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.934+0000 7f0a9cb02700 1 -- 172.21.15.2:0/1846882352 shutdown_connections 2023-11-26T07:16:18.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.934+0000 7f0a9cb02700 1 -- 172.21.15.2:0/1846882352 wait complete. 2023-11-26T07:16:18.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.935+0000 7f0a9cb02700 1 Processor -- start 2023-11-26T07:16:18.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.935+0000 7f0a9cb02700 1 -- start start 2023-11-26T07:16:18.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.936+0000 7f0a9cb02700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a9806afd0 0x7f0a980b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:18.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.936+0000 7f0a9cb02700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a9806dba0 0x7f0a981e9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:18.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.936+0000 7f0a9cb02700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a9806edc0 0x7f0a98143210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:18.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.936+0000 7f0a9cb02700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a980b2660 con 0x7f0a9806dba0 2023-11-26T07:16:18.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.936+0000 7f0a9cb02700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9815e640 con 0x7f0a9806afd0 2023-11-26T07:16:18.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.936+0000 7f0a9cb02700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9815e920 con 0x7f0a9806edc0 2023-11-26T07:16:18.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.936+0000 7f0a95d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a9806dba0 0x7f0a981e9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:18.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.936+0000 7f0a95d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a9806dba0 0x7f0a981e9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43824/0 (socket says 172.21.15.2:43824) 2023-11-26T07:16:18.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.936+0000 7f0a95d9b700 1 -- 172.21.15.2:0/751712732 learned_addr learned my addr 172.21.15.2:0/751712732 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:18.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.936+0000 7f0a9659c700 1 --2- 172.21.15.2:0/751712732 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a9806afd0 0x7f0a980b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:18.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.936+0000 7f0a96d9d700 1 --2- 172.21.15.2:0/751712732 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a9806edc0 0x7f0a98143210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:18.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.936+0000 7f0a95d9b700 1 -- 172.21.15.2:0/751712732 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a9806edc0 msgr2=0x7f0a98143210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:18.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.936+0000 7f0a95d9b700 1 --2- 172.21.15.2:0/751712732 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a9806edc0 0x7f0a98143210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:18.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.936+0000 7f0a95d9b700 1 -- 172.21.15.2:0/751712732 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a9806afd0 msgr2=0x7f0a980b2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:18.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.936+0000 7f0a95d9b700 1 --2- 172.21.15.2:0/751712732 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a9806afd0 0x7f0a980b2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:18.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.936+0000 7f0a95d9b700 1 -- 172.21.15.2:0/751712732 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a8c009550 con 0x7f0a9806dba0 2023-11-26T07:16:18.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.936+0000 7f0a95d9b700 1 --2- 172.21.15.2:0/751712732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a9806dba0 0x7f0a981e9d90 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f0a8800c7f0 tx=0x7f0a8800cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:18.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.936+0000 7f0a86ffd700 1 -- 172.21.15.2:0/751712732 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a88004220 con 0x7f0a9806dba0 2023-11-26T07:16:18.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.937+0000 7f0a86ffd700 1 -- 172.21.15.2:0/751712732 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a88004380 con 0x7f0a9806dba0 2023-11-26T07:16:18.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.937+0000 7f0a9cb02700 1 -- 172.21.15.2:0/751712732 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a9815ec00 con 0x7f0a9806dba0 2023-11-26T07:16:18.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.937+0000 7f0a86ffd700 1 -- 172.21.15.2:0/751712732 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a880036a0 con 0x7f0a9806dba0 2023-11-26T07:16:18.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.937+0000 7f0a9cb02700 1 -- 172.21.15.2:0/751712732 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a9815f1c0 con 0x7f0a9806dba0 2023-11-26T07:16:18.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.937+0000 7f0a9cb02700 1 -- 172.21.15.2:0/751712732 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a98068670 con 0x7f0a9806dba0 2023-11-26T07:16:18.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.938+0000 7f0a86ffd700 1 -- 172.21.15.2:0/751712732 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f0a88003800 con 0x7f0a9806dba0 2023-11-26T07:16:18.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.938+0000 7f0a86ffd700 1 --2- 172.21.15.2:0/751712732 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0a7806b740 0x7f0a7806dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:18.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.939+0000 7f0a86ffd700 1 -- 172.21.15.2:0/751712732 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f0a88087ad0 con 0x7f0a9806dba0 2023-11-26T07:16:18.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.939+0000 7f0a9659c700 1 --2- 172.21.15.2:0/751712732 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0a7806b740 0x7f0a7806dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:18.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.939+0000 7f0a9659c700 1 --2- 172.21.15.2:0/751712732 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0a7806b740 0x7f0a7806dc00 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c000c00 tx=0x7f0a8c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:18.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:18.943+0000 7f0a86ffd700 1 -- 172.21.15.2:0/751712732 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0a88054400 con 0x7f0a9806dba0 2023-11-26T07:16:19.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.143+0000 7f0a9cb02700 1 -- 172.21.15.2:0/751712732 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a9815f3e0 con 0x7f0a9806dba0 2023-11-26T07:16:19.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.145+0000 7f0a86ffd700 1 -- 172.21.15.2:0/751712732 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+16582 (secure 0 0 0) 0x7f0a88088e60 con 0x7f0a9806dba0 2023-11-26T07:16:19.147 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:16:19.147 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":62,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:16:16.254986+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:15:11.156119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-26T07:15:11.674003+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":61,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:16:19.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.147+0000 7f0a9cb02700 1 -- 172.21.15.2:0/751712732 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0a7806b740 msgr2=0x7f0a7806dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:19.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.147+0000 7f0a9cb02700 1 --2- 172.21.15.2:0/751712732 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0a7806b740 0x7f0a7806dc00 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c000c00 tx=0x7f0a8c008030 comp rx=0 tx=0).stop 2023-11-26T07:16:19.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.147+0000 7f0a9cb02700 1 -- 172.21.15.2:0/751712732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a9806dba0 msgr2=0x7f0a981e9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:19.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.147+0000 7f0a9cb02700 1 --2- 172.21.15.2:0/751712732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a9806dba0 0x7f0a981e9d90 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f0a8800c7f0 tx=0x7f0a8800cb00 comp rx=0 tx=0).stop 2023-11-26T07:16:19.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.147+0000 7f0a9cb02700 1 -- 172.21.15.2:0/751712732 shutdown_connections 2023-11-26T07:16:19.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.147+0000 7f0a9cb02700 1 --2- 172.21.15.2:0/751712732 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0a7806b740 0x7f0a7806dc00 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:19.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.147+0000 7f0a9cb02700 1 --2- 172.21.15.2:0/751712732 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a9806edc0 0x7f0a98143210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:19.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.147+0000 7f0a9cb02700 1 --2- 172.21.15.2:0/751712732 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a9806afd0 0x7f0a980b2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:19.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.147+0000 7f0a9cb02700 1 --2- 172.21.15.2:0/751712732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a9806dba0 0x7f0a981e9d90 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:19.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.147+0000 7f0a9cb02700 1 -- 172.21.15.2:0/751712732 >> 172.21.15.2:0/751712732 conn(0x7f0a980b2840 msgr2=0x7f0a980b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:19.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.147+0000 7f0a9cb02700 1 -- 172.21.15.2:0/751712732 shutdown_connections 2023-11-26T07:16:19.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.147+0000 7f0a9cb02700 1 -- 172.21.15.2:0/751712732 wait complete. 2023-11-26T07:16:19.161 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-26T07:16:19.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.285+0000 7f8b3dad8700 1 Processor -- start 2023-11-26T07:16:19.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.285+0000 7f8b3dad8700 1 -- start start 2023-11-26T07:16:19.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.286+0000 7f8b3dad8700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8b38144ff0 0x7f8b3806afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:19.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.286+0000 7f8b3dad8700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8b3806b510 0x7f8b380cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:19.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.286+0000 7f8b3dad8700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b380727b0 con 0x7f8b3815bcf0 2023-11-26T07:16:19.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.286+0000 7f8b3dad8700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b3806b9c0 con 0x7f8b38144ff0 2023-11-26T07:16:19.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.286+0000 7f8b3dad8700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b38071be0 con 0x7f8b3806b510 2023-11-26T07:16:19.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.286+0000 7f8b36ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8b38144ff0 0x7f8b3806afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:19.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.286+0000 7f8b36ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8b38144ff0 0x7f8b3806afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43832/0 (socket says 172.21.15.2:43832) 2023-11-26T07:16:19.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.286+0000 7f8b36ffd700 1 -- 172.21.15.2:0/2170290963 learned_addr learned my addr 172.21.15.2:0/2170290963 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:19.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.287+0000 7f8b37fff700 1 --2- 172.21.15.2:0/2170290963 >> v2:172.21.15.192:3300/0 conn(0x7f8b3806b510 0x7f8b380cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:19.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.287+0000 7f8b36ffd700 1 -- 172.21.15.2:0/2170290963 >> v2:172.21.15.192:3300/0 conn(0x7f8b3806b510 msgr2=0x7f8b380cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:19.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.287+0000 7f8b36ffd700 1 --2- 172.21.15.2:0/2170290963 >> v2:172.21.15.192:3300/0 conn(0x7f8b3806b510 0x7f8b380cf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:19.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.287+0000 7f8b36ffd700 1 -- 172.21.15.2:0/2170290963 >> v1:172.21.15.192:6789/0 conn(0x7f8b3815bcf0 legacy=0x7f8b381602a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:19.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.287+0000 7f8b36ffd700 1 -- 172.21.15.2:0/2170290963 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b38071e80 con 0x7f8b38144ff0 2023-11-26T07:16:19.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.287+0000 7f8b36ffd700 1 --2- 172.21.15.2:0/2170290963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b38144ff0 0x7f8b3806afd0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f8b38071ad0 tx=0x7f8b20009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9c0f2200dafbcb0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:19.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.287+0000 7f8b367fc700 1 -- 172.21.15.2:0/2170290963 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2000b870 con 0x7f8b38144ff0 2023-11-26T07:16:19.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.287+0000 7f8b367fc700 1 -- 172.21.15.2:0/2170290963 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b2000b9d0 con 0x7f8b38144ff0 2023-11-26T07:16:19.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.287+0000 7f8b367fc700 1 -- 172.21.15.2:0/2170290963 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2000bd60 con 0x7f8b38144ff0 2023-11-26T07:16:19.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.288+0000 7f8b3dad8700 1 -- 172.21.15.2:0/2170290963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b38144ff0 msgr2=0x7f8b3806afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:19.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.288+0000 7f8b3dad8700 1 --2- 172.21.15.2:0/2170290963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b38144ff0 0x7f8b3806afd0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f8b38071ad0 tx=0x7f8b20009bd0 comp rx=0 tx=0).stop 2023-11-26T07:16:19.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.288+0000 7f8b3dad8700 1 -- 172.21.15.2:0/2170290963 shutdown_connections 2023-11-26T07:16:19.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.288+0000 7f8b3dad8700 1 --2- 172.21.15.2:0/2170290963 >> v2:172.21.15.192:3300/0 conn(0x7f8b3806b510 0x7f8b380cf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:19.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.288+0000 7f8b3dad8700 1 --2- 172.21.15.2:0/2170290963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b38144ff0 0x7f8b3806afd0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:19.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.288+0000 7f8b3dad8700 1 -- 172.21.15.2:0/2170290963 >> 172.21.15.2:0/2170290963 conn(0x7f8b380b2840 msgr2=0x7f8b380b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:19.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.288+0000 7f8b3dad8700 1 -- 172.21.15.2:0/2170290963 shutdown_connections 2023-11-26T07:16:19.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.288+0000 7f8b3dad8700 1 -- 172.21.15.2:0/2170290963 wait complete. 2023-11-26T07:16:19.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.289+0000 7f8b3dad8700 1 Processor -- start 2023-11-26T07:16:19.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.289+0000 7f8b3dad8700 1 -- start start 2023-11-26T07:16:19.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.290+0000 7f8b3dad8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8b3806b510 0x7f8b38137780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:19.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.290+0000 7f8b3dad8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b38144ff0 0x7f8b381388b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:19.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.290+0000 7f8b3dad8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b3815bcf0 0x7f8b381407c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:19.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.290+0000 7f8b3dad8700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b38140330 con 0x7f8b3815bcf0 2023-11-26T07:16:19.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.290+0000 7f8b3dad8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b38137cc0 con 0x7f8b38144ff0 2023-11-26T07:16:19.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.290+0000 7f8b3dad8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3813f440 con 0x7f8b3806b510 2023-11-26T07:16:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.290+0000 7f8b37fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b3815bcf0 0x7f8b381407c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.290+0000 7f8b37fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b3815bcf0 0x7f8b381407c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43840/0 (socket says 172.21.15.2:43840) 2023-11-26T07:16:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.290+0000 7f8b37fff700 1 -- 172.21.15.2:0/2335963938 learned_addr learned my addr 172.21.15.2:0/2335963938 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.290+0000 7f8b377fe700 1 --2- 172.21.15.2:0/2335963938 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8b3806b510 0x7f8b38137780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.290+0000 7f8b36ffd700 1 --2- 172.21.15.2:0/2335963938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b38144ff0 0x7f8b381388b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.290+0000 7f8b37fff700 1 -- 172.21.15.2:0/2335963938 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8b3806b510 msgr2=0x7f8b38137780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.290+0000 7f8b37fff700 1 --2- 172.21.15.2:0/2335963938 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8b3806b510 0x7f8b38137780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.290+0000 7f8b37fff700 1 -- 172.21.15.2:0/2335963938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b38144ff0 msgr2=0x7f8b381388b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.290+0000 7f8b37fff700 1 --2- 172.21.15.2:0/2335963938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b38144ff0 0x7f8b381388b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.290+0000 7f8b37fff700 1 -- 172.21.15.2:0/2335963938 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b20009550 con 0x7f8b3815bcf0 2023-11-26T07:16:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.290+0000 7f8b36ffd700 1 --2- 172.21.15.2:0/2335963938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b38144ff0 0x7f8b381388b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:16:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.290+0000 7f8b37fff700 1 --2- 172.21.15.2:0/2335963938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b3815bcf0 0x7f8b381407c0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f8b30007e40 tx=0x7f8b3000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:19.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.290+0000 7f8b2ffff700 1 -- 172.21.15.2:0/2335963938 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3000eea0 con 0x7f8b3815bcf0 2023-11-26T07:16:19.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.290+0000 7f8b2ffff700 1 -- 172.21.15.2:0/2335963938 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b30014420 con 0x7f8b3815bcf0 2023-11-26T07:16:19.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.291+0000 7f8b3dad8700 1 -- 172.21.15.2:0/2335963938 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b3813f720 con 0x7f8b3815bcf0 2023-11-26T07:16:19.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.291+0000 7f8b2ffff700 1 -- 172.21.15.2:0/2335963938 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b300147b0 con 0x7f8b3815bcf0 2023-11-26T07:16:19.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.291+0000 7f8b3dad8700 1 -- 172.21.15.2:0/2335963938 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b3813fce0 con 0x7f8b3815bcf0 2023-11-26T07:16:19.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.291+0000 7f8b3dad8700 1 -- 172.21.15.2:0/2335963938 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b381404a0 con 0x7f8b3815bcf0 2023-11-26T07:16:19.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.292+0000 7f8b2ffff700 1 -- 172.21.15.2:0/2335963938 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f8b30014910 con 0x7f8b3815bcf0 2023-11-26T07:16:19.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.292+0000 7f8b2ffff700 1 --2- 172.21.15.2:0/2335963938 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8b1806b740 0x7f8b1806dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:19.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.292+0000 7f8b2ffff700 1 -- 172.21.15.2:0/2335963938 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f8b300886d0 con 0x7f8b3815bcf0 2023-11-26T07:16:19.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.293+0000 7f8b377fe700 1 --2- 172.21.15.2:0/2335963938 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8b1806b740 0x7f8b1806dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:19.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.293+0000 7f8b377fe700 1 --2- 172.21.15.2:0/2335963938 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8b1806b740 0x7f8b1806dc00 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f8b28000f60 tx=0x7f8b28009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:19.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.297+0000 7f8b2ffff700 1 -- 172.21.15.2:0/2335963938 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8b3008e030 con 0x7f8b3815bcf0 2023-11-26T07:16:19.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.544+0000 7f8b3dad8700 1 -- 172.21.15.2:0/2335963938 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8b38068670 con 0x7f8b3815bcf0 2023-11-26T07:16:19.547 INFO:tasks.ceph.mon.a.smithi002.stderr:2023-11-26T07:16:19.545+0000 7f35cd3c3700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-26T07:16:19.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.546+0000 7f8b2ffff700 1 -- 172.21.15.2:0/2335963938 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v38) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8b300551d0 con 0x7f8b3815bcf0 2023-11-26T07:16:19.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.548+0000 7f8b3dad8700 1 -- 172.21.15.2:0/2335963938 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8b1806b740 msgr2=0x7f8b1806dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:19.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.548+0000 7f8b3dad8700 1 --2- 172.21.15.2:0/2335963938 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8b1806b740 0x7f8b1806dc00 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f8b28000f60 tx=0x7f8b28009040 comp rx=0 tx=0).stop 2023-11-26T07:16:19.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.548+0000 7f8b3dad8700 1 -- 172.21.15.2:0/2335963938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b3815bcf0 msgr2=0x7f8b381407c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:19.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.548+0000 7f8b3dad8700 1 --2- 172.21.15.2:0/2335963938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b3815bcf0 0x7f8b381407c0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f8b30007e40 tx=0x7f8b3000e3c0 comp rx=0 tx=0).stop 2023-11-26T07:16:19.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.548+0000 7f8b3dad8700 1 -- 172.21.15.2:0/2335963938 shutdown_connections 2023-11-26T07:16:19.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.548+0000 7f8b3dad8700 1 --2- 172.21.15.2:0/2335963938 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8b1806b740 0x7f8b1806dc00 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:19.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.549+0000 7f8b3dad8700 1 --2- 172.21.15.2:0/2335963938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b3815bcf0 0x7f8b381407c0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:19.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.549+0000 7f8b3dad8700 1 --2- 172.21.15.2:0/2335963938 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8b3806b510 0x7f8b38137780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:19.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.549+0000 7f8b3dad8700 1 --2- 172.21.15.2:0/2335963938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b38144ff0 0x7f8b381388b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:19.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.549+0000 7f8b3dad8700 1 -- 172.21.15.2:0/2335963938 >> 172.21.15.2:0/2335963938 conn(0x7f8b380b2840 msgr2=0x7f8b381426c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:19.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.549+0000 7f8b3dad8700 1 -- 172.21.15.2:0/2335963938 shutdown_connections 2023-11-26T07:16:19.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.549+0000 7f8b3dad8700 1 -- 172.21.15.2:0/2335963938 wait complete. 2023-11-26T07:16:19.552 INFO:teuthology.orchestra.run.smithi002.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-26T07:16:19.564 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-26T07:16:19.592 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2023-11-26T07:16:19.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.693+0000 7fbb26f79700 1 Processor -- start 2023-11-26T07:16:19.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.694+0000 7fbb26f79700 1 -- start start 2023-11-26T07:16:19.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.694+0000 7fbb26f79700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbb200d1100 0x7fbb2015e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:19.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.694+0000 7fbb26f79700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb2006f700 0x7fbb2015ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:19.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.694+0000 7fbb26f79700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb2006e9d0 con 0x7fbb20144610 2023-11-26T07:16:19.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.694+0000 7fbb26f79700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb2006f270 con 0x7fbb200d1100 2023-11-26T07:16:19.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.694+0000 7fbb26f79700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb201449f0 con 0x7fbb2006f700 2023-11-26T07:16:19.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.695+0000 7fbb1ffff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbb200d1100 0x7fbb2015e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:19.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.695+0000 7fbb1ffff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbb200d1100 0x7fbb2015e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43858/0 (socket says 172.21.15.2:43858) 2023-11-26T07:16:19.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.695+0000 7fbb1ffff700 1 -- 172.21.15.2:0/3446635074 learned_addr learned my addr 172.21.15.2:0/3446635074 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:19.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.695+0000 7fbb25516700 1 --2- 172.21.15.2:0/3446635074 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb2006f700 0x7fbb2015ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:19.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.695+0000 7fbb1ffff700 1 -- 172.21.15.2:0/3446635074 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb2006f700 msgr2=0x7fbb2015ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:19.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.695+0000 7fbb1ffff700 1 --2- 172.21.15.2:0/3446635074 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb2006f700 0x7fbb2015ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:19.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.695+0000 7fbb1ffff700 1 -- 172.21.15.2:0/3446635074 >> v1:172.21.15.192:6789/0 conn(0x7fbb20144610 legacy=0x7fbb200d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:19.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.695+0000 7fbb1ffff700 1 -- 172.21.15.2:0/3446635074 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2015f530 con 0x7fbb200d1100 2023-11-26T07:16:19.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.695+0000 7fbb1ffff700 1 --2- 172.21.15.2:0/3446635074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb200d1100 0x7fbb2015e7c0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c00bb90 tx=0x7fbb0c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b5f4d380e114e19 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:19.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.695+0000 7fbb1f7fe700 1 -- 172.21.15.2:0/3446635074 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c00dd30 con 0x7fbb200d1100 2023-11-26T07:16:19.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.695+0000 7fbb1f7fe700 1 -- 172.21.15.2:0/3446635074 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb0c00de90 con 0x7fbb200d1100 2023-11-26T07:16:19.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.695+0000 7fbb1f7fe700 1 -- 172.21.15.2:0/3446635074 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c010690 con 0x7fbb200d1100 2023-11-26T07:16:19.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.696+0000 7fbb26f79700 1 -- 172.21.15.2:0/3446635074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb200d1100 msgr2=0x7fbb2015e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:19.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.696+0000 7fbb26f79700 1 --2- 172.21.15.2:0/3446635074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb200d1100 0x7fbb2015e7c0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c00bb90 tx=0x7fbb0c00bea0 comp rx=0 tx=0).stop 2023-11-26T07:16:19.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.696+0000 7fbb26f79700 1 -- 172.21.15.2:0/3446635074 shutdown_connections 2023-11-26T07:16:19.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.696+0000 7fbb26f79700 1 --2- 172.21.15.2:0/3446635074 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb2006f700 0x7fbb2015ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:19.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.696+0000 7fbb26f79700 1 --2- 172.21.15.2:0/3446635074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb200d1100 0x7fbb2015e7c0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:19.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.696+0000 7fbb26f79700 1 -- 172.21.15.2:0/3446635074 >> 172.21.15.2:0/3446635074 conn(0x7fbb200b2740 msgr2=0x7fbb200b2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:19.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.696+0000 7fbb26f79700 1 -- 172.21.15.2:0/3446635074 shutdown_connections 2023-11-26T07:16:19.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.696+0000 7fbb26f79700 1 -- 172.21.15.2:0/3446635074 wait complete. 2023-11-26T07:16:19.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.697+0000 7fbb26f79700 1 Processor -- start 2023-11-26T07:16:19.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.697+0000 7fbb26f79700 1 -- start start 2023-11-26T07:16:19.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.698+0000 7fbb26f79700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb2006f700 0x7fbb2015b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:19.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.698+0000 7fbb26f79700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb200d1100 0x7fbb2013ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:19.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.698+0000 7fbb26f79700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb20144610 0x7fbb2015d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:19.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.698+0000 7fbb26f79700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2015da80 con 0x7fbb2006f700 2023-11-26T07:16:19.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.698+0000 7fbb26f79700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2015dd60 con 0x7fbb200d1100 2023-11-26T07:16:19.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.698+0000 7fbb26f79700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2015e040 con 0x7fbb20144610 2023-11-26T07:16:19.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.698+0000 7fbb24d15700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb2006f700 0x7fbb2015b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:19.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.698+0000 7fbb24d15700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb2006f700 0x7fbb2015b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43862/0 (socket says 172.21.15.2:43862) 2023-11-26T07:16:19.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.698+0000 7fbb24d15700 1 -- 172.21.15.2:0/96293727 learned_addr learned my addr 172.21.15.2:0/96293727 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:19.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.698+0000 7fbb25516700 1 --2- 172.21.15.2:0/96293727 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb20144610 0x7fbb2015d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:19.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.698+0000 7fbb1ffff700 1 --2- 172.21.15.2:0/96293727 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb200d1100 0x7fbb2013ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:19.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.698+0000 7fbb24d15700 1 -- 172.21.15.2:0/96293727 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb20144610 msgr2=0x7fbb2015d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:19.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.698+0000 7fbb24d15700 1 --2- 172.21.15.2:0/96293727 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb20144610 0x7fbb2015d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:19.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.698+0000 7fbb24d15700 1 -- 172.21.15.2:0/96293727 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb200d1100 msgr2=0x7fbb2013ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:19.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.698+0000 7fbb24d15700 1 --2- 172.21.15.2:0/96293727 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb200d1100 0x7fbb2013ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:19.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.698+0000 7fbb24d15700 1 -- 172.21.15.2:0/96293727 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0c00b7f0 con 0x7fbb2006f700 2023-11-26T07:16:19.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.699+0000 7fbb24d15700 1 --2- 172.21.15.2:0/96293727 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb2006f700 0x7fbb2015b940 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fbb1400c450 tx=0x7fbb1400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:19.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.699+0000 7fbb1d7fa700 1 -- 172.21.15.2:0/96293727 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb140052d0 con 0x7fbb2006f700 2023-11-26T07:16:19.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.699+0000 7fbb1d7fa700 1 -- 172.21.15.2:0/96293727 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb14005430 con 0x7fbb2006f700 2023-11-26T07:16:19.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.699+0000 7fbb1d7fa700 1 -- 172.21.15.2:0/96293727 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb140038c0 con 0x7fbb2006f700 2023-11-26T07:16:19.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.699+0000 7fbb26f79700 1 -- 172.21.15.2:0/96293727 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb2015e320 con 0x7fbb2006f700 2023-11-26T07:16:19.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.699+0000 7fbb26f79700 1 -- 172.21.15.2:0/96293727 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb2013f280 con 0x7fbb2006f700 2023-11-26T07:16:19.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.700+0000 7fbb26f79700 1 -- 172.21.15.2:0/96293727 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb20075480 con 0x7fbb2006f700 2023-11-26T07:16:19.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.700+0000 7fbb1d7fa700 1 -- 172.21.15.2:0/96293727 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7fbb14003a20 con 0x7fbb2006f700 2023-11-26T07:16:19.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.701+0000 7fbb1d7fa700 1 --2- 172.21.15.2:0/96293727 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fbb0406b740 0x7fbb0406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:19.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.701+0000 7fbb1d7fa700 1 -- 172.21.15.2:0/96293727 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fbb14087310 con 0x7fbb2006f700 2023-11-26T07:16:19.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.701+0000 7fbb1ffff700 1 --2- 172.21.15.2:0/96293727 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fbb0406b740 0x7fbb0406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:19.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.701+0000 7fbb1ffff700 1 --2- 172.21.15.2:0/96293727 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fbb0406b740 0x7fbb0406dc00 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c00bee0 tx=0x7fbb0c013000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:19.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.705+0000 7fbb1d7fa700 1 -- 172.21.15.2:0/96293727 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbb14053ca0 con 0x7fbb2006f700 2023-11-26T07:16:19.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:19.955+0000 7fbb26f79700 1 -- 172.21.15.2:0/96293727 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fbb2006e2a0 con 0x7fbb2006f700 2023-11-26T07:16:20.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.550+0000 7fbb1d7fa700 1 -- 172.21.15.2:0/96293727 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v39) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbb1400ce60 con 0x7fbb2006f700 2023-11-26T07:16:20.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.553+0000 7fbb26f79700 1 -- 172.21.15.2:0/96293727 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fbb0406b740 msgr2=0x7fbb0406dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:20.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.553+0000 7fbb26f79700 1 --2- 172.21.15.2:0/96293727 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fbb0406b740 0x7fbb0406dc00 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c00bee0 tx=0x7fbb0c013000 comp rx=0 tx=0).stop 2023-11-26T07:16:20.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.553+0000 7fbb26f79700 1 -- 172.21.15.2:0/96293727 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb2006f700 msgr2=0x7fbb2015b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:20.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.553+0000 7fbb26f79700 1 --2- 172.21.15.2:0/96293727 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb2006f700 0x7fbb2015b940 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fbb1400c450 tx=0x7fbb1400c760 comp rx=0 tx=0).stop 2023-11-26T07:16:20.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.553+0000 7fbb26f79700 1 -- 172.21.15.2:0/96293727 shutdown_connections 2023-11-26T07:16:20.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.553+0000 7fbb26f79700 1 --2- 172.21.15.2:0/96293727 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fbb0406b740 0x7fbb0406dc00 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:20.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.553+0000 7fbb26f79700 1 --2- 172.21.15.2:0/96293727 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb20144610 0x7fbb2015d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:20.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.553+0000 7fbb26f79700 1 --2- 172.21.15.2:0/96293727 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb2006f700 0x7fbb2015b940 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:20.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.553+0000 7fbb26f79700 1 --2- 172.21.15.2:0/96293727 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb200d1100 0x7fbb2013ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:20.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.553+0000 7fbb26f79700 1 -- 172.21.15.2:0/96293727 >> 172.21.15.2:0/96293727 conn(0x7fbb200b2740 msgr2=0x7fbb20143860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:20.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.553+0000 7fbb26f79700 1 -- 172.21.15.2:0/96293727 shutdown_connections 2023-11-26T07:16:20.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.553+0000 7fbb26f79700 1 -- 172.21.15.2:0/96293727 wait complete. 2023-11-26T07:16:20.570 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-26T07:16:20.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.744+0000 7f2fa2b7e700 1 Processor -- start 2023-11-26T07:16:20.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.744+0000 7f2fa2b7e700 1 -- start start 2023-11-26T07:16:20.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.744+0000 7f2fa2b7e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f9c158700 0x7f2f9c071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:20.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.744+0000 7f2fa2b7e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2f9c06f6b0 0x7f2f9c0720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:20.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.745+0000 7f2fa2b7e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f9c0b45f0 con 0x7f2f9c0b4a80 2023-11-26T07:16:20.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.745+0000 7f2fa2b7e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f9c06fcd0 con 0x7f2f9c06f6b0 2023-11-26T07:16:20.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.745+0000 7f2fa2b7e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9c158ae0 con 0x7f2f9c158700 2023-11-26T07:16:20.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.745+0000 7f2f9bfff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2f9c0b4a80 0x7f2f9c06efa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35084/0 (socket says 172.21.15.2:35084) 2023-11-26T07:16:20.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.745+0000 7f2f9bfff700 1 -- 172.21.15.2:0/1269153571 learned_addr learned my addr 172.21.15.2:0/1269153571 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:16:20.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.745+0000 7f2fa091a700 1 --2- 172.21.15.2:0/1269153571 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f9c158700 0x7f2f9c071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:20.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.745+0000 7f2fa111b700 1 --2- 172.21.15.2:0/1269153571 >> v2:172.21.15.192:3300/0 conn(0x7f2f9c06f6b0 0x7f2f9c0720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:20.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.745+0000 7f2f9b7fe700 1 -- 172.21.15.2:0/1269153571 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 658701425 0 0) 0x7f2f9c0b45f0 con 0x7f2f9c0b4a80 2023-11-26T07:16:20.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.745+0000 7f2f9b7fe700 1 -- 172.21.15.2:0/1269153571 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f8c0035b0 con 0x7f2f9c0b4a80 2023-11-26T07:16:20.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.745+0000 7f2f9b7fe700 1 -- 172.21.15.2:0/1269153571 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2391765765 0 0) 0x7f2f8c0035b0 con 0x7f2f9c0b4a80 2023-11-26T07:16:20.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.745+0000 7f2f9b7fe700 1 -- 172.21.15.2:0/1269153571 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f9c158700 msgr2=0x7f2f9c071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:20.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.745+0000 7f2f9b7fe700 1 --2- 172.21.15.2:0/1269153571 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f9c158700 0x7f2f9c071bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:20.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.745+0000 7f2f9b7fe700 1 -- 172.21.15.2:0/1269153571 >> v2:172.21.15.192:3300/0 conn(0x7f2f9c06f6b0 msgr2=0x7f2f9c0720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:20.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.745+0000 7f2f9b7fe700 1 --2- 172.21.15.2:0/1269153571 >> v2:172.21.15.192:3300/0 conn(0x7f2f9c06f6b0 0x7f2f9c0720f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:20.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.745+0000 7f2f9b7fe700 1 -- 172.21.15.2:0/1269153571 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9c0b3cc0 con 0x7f2f9c0b4a80 2023-11-26T07:16:20.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.745+0000 7f2f9b7fe700 1 -- 172.21.15.2:0/1269153571 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f2f88001670 con 0x7f2f9c0b4a80 2023-11-26T07:16:20.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.745+0000 7f2f9b7fe700 1 -- 172.21.15.2:0/1269153571 >> v1:172.21.15.2:6789/0 conn(0x7f2f9c0b4a80 legacy=0x7f2f9c06efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:20.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.745+0000 7f2f9b7fe700 1 --2- 172.21.15.2:0/1269153571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f8c003a00 0x7f2f8c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:20.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.745+0000 7f2f9b7fe700 1 --2- 172.21.15.2:0/1269153571 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f8c004850 0x7f2f8c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:20.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.745+0000 7f2f9b7fe700 1 --2- 172.21.15.2:0/1269153571 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f9c158700 0x7f2f8c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:20.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.745+0000 7f2f9b7fe700 1 -- 172.21.15.2:0/1269153571 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9c06fcd0 con 0x7f2f8c003a00 2023-11-26T07:16:20.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.745+0000 7f2f9b7fe700 1 -- 172.21.15.2:0/1269153571 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9c158ae0 con 0x7f2f8c004850 2023-11-26T07:16:20.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.745+0000 7f2f9b7fe700 1 -- 172.21.15.2:0/1269153571 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c00ba10 con 0x7f2f9c158700 2023-11-26T07:16:20.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.745+0000 7f2fa091a700 1 --2- 172.21.15.2:0/1269153571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f8c003a00 0x7f2f8c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:20.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.746+0000 7f2f9bfff700 1 --2- 172.21.15.2:0/1269153571 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f8c004850 0x7f2f8c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:20.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.746+0000 7f2fa111b700 1 --2- 172.21.15.2:0/1269153571 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f9c158700 0x7f2f8c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:20.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.746+0000 7f2fa091a700 1 -- 172.21.15.2:0/1269153571 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f9c158700 msgr2=0x7f2f8c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:20.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.746+0000 7f2fa091a700 1 --2- 172.21.15.2:0/1269153571 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f9c158700 0x7f2f8c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:20.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.746+0000 7f2fa091a700 1 -- 172.21.15.2:0/1269153571 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f8c004850 msgr2=0x7f2f8c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:20.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.746+0000 7f2fa091a700 1 --2- 172.21.15.2:0/1269153571 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f8c004850 0x7f2f8c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:20.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.746+0000 7f2fa091a700 1 -- 172.21.15.2:0/1269153571 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8c0035b0 con 0x7f2f8c003a00 2023-11-26T07:16:20.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.746+0000 7f2fa091a700 1 --2- 172.21.15.2:0/1269153571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f8c003a00 0x7f2f8c003e20 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f2f90009b60 tx=0x7f2f8c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3c22dc2b38e76e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:20.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.746+0000 7f2f9b7fe700 1 -- 172.21.15.2:0/1269153571 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9000e6c0 con 0x7f2f8c003a00 2023-11-26T07:16:20.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.746+0000 7f2f9b7fe700 1 -- 172.21.15.2:0/1269153571 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f9000e820 con 0x7f2f8c003a00 2023-11-26T07:16:20.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.746+0000 7f2f9b7fe700 1 -- 172.21.15.2:0/1269153571 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9000eb90 con 0x7f2f8c003a00 2023-11-26T07:16:20.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.747+0000 7f2fa2b7e700 1 -- 172.21.15.2:0/1269153571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f8c003a00 msgr2=0x7f2f8c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:20.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.747+0000 7f2fa2b7e700 1 --2- 172.21.15.2:0/1269153571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f8c003a00 0x7f2f8c003e20 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f2f90009b60 tx=0x7f2f8c005880 comp rx=0 tx=0).stop 2023-11-26T07:16:20.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.747+0000 7f2fa111b700 1 -- 172.21.15.2:0/1269153571 reap_dead start 2023-11-26T07:16:20.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.747+0000 7f2fa2b7e700 1 -- 172.21.15.2:0/1269153571 shutdown_connections 2023-11-26T07:16:20.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.747+0000 7f2fa2b7e700 1 -- 172.21.15.2:0/1269153571 >> 172.21.15.2:0/1269153571 conn(0x7f2f9c0b2840 msgr2=0x7f2f9c0b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:20.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.747+0000 7f2fa2b7e700 1 -- 172.21.15.2:0/1269153571 shutdown_connections 2023-11-26T07:16:20.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.747+0000 7f2fa2b7e700 1 -- 172.21.15.2:0/1269153571 wait complete. 2023-11-26T07:16:20.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.748+0000 7f2fa2b7e700 1 Processor -- start 2023-11-26T07:16:20.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.748+0000 7f2fa2b7e700 1 -- start start 2023-11-26T07:16:20.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.749+0000 7f2fa2b7e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f8c003a00 0x7f2f9c150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:20.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.749+0000 7f2fa2b7e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f9c0ce940 0x7f2f9c0cff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:20.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.749+0000 7f2fa2b7e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f9c156d20 0x7f2f9c154cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:20.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.749+0000 7f2fa2b7e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9c0cfac0 con 0x7f2f9c156d20 2023-11-26T07:16:20.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.749+0000 7f2fa2b7e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9c0ceeb0 con 0x7f2f9c0ce940 2023-11-26T07:16:20.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.749+0000 7f2fa2b7e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9c0cf190 con 0x7f2f8c003a00 2023-11-26T07:16:20.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.749+0000 7f2fa111b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f9c156d20 0x7f2f9c154cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:20.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.749+0000 7f2fa111b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f9c156d20 0x7f2f9c154cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43888/0 (socket says 172.21.15.2:43888) 2023-11-26T07:16:20.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.749+0000 7f2fa111b700 1 -- 172.21.15.2:0/1556607610 learned_addr learned my addr 172.21.15.2:0/1556607610 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:20.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.749+0000 7f2fa091a700 1 --2- 172.21.15.2:0/1556607610 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f8c003a00 0x7f2f9c150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:20.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.749+0000 7f2f9bfff700 1 --2- 172.21.15.2:0/1556607610 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f9c0ce940 0x7f2f9c0cff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:20.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.749+0000 7f2fa111b700 1 -- 172.21.15.2:0/1556607610 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f8c003a00 msgr2=0x7f2f9c150f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:20.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.749+0000 7f2fa111b700 1 --2- 172.21.15.2:0/1556607610 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f8c003a00 0x7f2f9c150f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:20.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.749+0000 7f2fa111b700 1 -- 172.21.15.2:0/1556607610 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f9c0ce940 msgr2=0x7f2f9c0cff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:20.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.749+0000 7f2fa111b700 1 --2- 172.21.15.2:0/1556607610 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f9c0ce940 0x7f2f9c0cff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:20.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.749+0000 7f2fa111b700 1 -- 172.21.15.2:0/1556607610 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9c0cf470 con 0x7f2f9c156d20 2023-11-26T07:16:20.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.749+0000 7f2f9bfff700 1 --2- 172.21.15.2:0/1556607610 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f9c0ce940 0x7f2f9c0cff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:16:20.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.750+0000 7f2fa111b700 1 --2- 172.21.15.2:0/1556607610 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f9c156d20 0x7f2f9c154cf0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c06af30 tx=0x7f2f94011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:20.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.750+0000 7f2f997fa700 1 -- 172.21.15.2:0/1556607610 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9400e040 con 0x7f2f9c156d20 2023-11-26T07:16:20.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.750+0000 7f2f997fa700 1 -- 172.21.15.2:0/1556607610 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f9400f040 con 0x7f2f9c156d20 2023-11-26T07:16:20.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.750+0000 7f2fa2b7e700 1 -- 172.21.15.2:0/1556607610 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f9c0cf750 con 0x7f2f9c156d20 2023-11-26T07:16:20.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.750+0000 7f2f997fa700 1 -- 172.21.15.2:0/1556607610 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f94015430 con 0x7f2f9c156d20 2023-11-26T07:16:20.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.750+0000 7f2fa2b7e700 1 -- 172.21.15.2:0/1556607610 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f9c1571a0 con 0x7f2f9c156d20 2023-11-26T07:16:20.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.751+0000 7f2fa2b7e700 1 -- 172.21.15.2:0/1556607610 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f9c0cf8e0 con 0x7f2f9c156d20 2023-11-26T07:16:20.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.751+0000 7f2f997fa700 1 -- 172.21.15.2:0/1556607610 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f2f94015590 con 0x7f2f9c156d20 2023-11-26T07:16:20.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.752+0000 7f2f997fa700 1 --2- 172.21.15.2:0/1556607610 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f2f8006b730 0x7f2f8006dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:20.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.752+0000 7f2f997fa700 1 -- 172.21.15.2:0/1556607610 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f2f94088660 con 0x7f2f9c156d20 2023-11-26T07:16:20.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.752+0000 7f2fa091a700 1 --2- 172.21.15.2:0/1556607610 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f2f8006b730 0x7f2f8006dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:20.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.753+0000 7f2fa091a700 1 --2- 172.21.15.2:0/1556607610 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f2f8006b730 0x7f2f8006dbf0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2f900090b0 tx=0x7f2f90008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:20.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.756+0000 7f2f997fa700 1 -- 172.21.15.2:0/1556607610 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2f940551c0 con 0x7f2f9c156d20 2023-11-26T07:16:20.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:20.958+0000 7f2fa2b7e700 1 -- 172.21.15.2:0/1556607610 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2f9c0b5ef0 con 0x7f2f9c156d20 2023-11-26T07:16:21.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.552+0000 7f2f997fa700 1 -- 172.21.15.2:0/1556607610 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v64) v1 ==== 181+0+0 (secure 0 0 0) 0x7f2f940587e0 con 0x7f2f9c156d20 2023-11-26T07:16:21.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.555+0000 7f2fa2b7e700 1 -- 172.21.15.2:0/1556607610 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f2f8006b730 msgr2=0x7f2f8006dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:21.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.555+0000 7f2fa2b7e700 1 --2- 172.21.15.2:0/1556607610 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f2f8006b730 0x7f2f8006dbf0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2f900090b0 tx=0x7f2f90008030 comp rx=0 tx=0).stop 2023-11-26T07:16:21.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.555+0000 7f2fa2b7e700 1 -- 172.21.15.2:0/1556607610 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f9c156d20 msgr2=0x7f2f9c154cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:21.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.555+0000 7f2fa2b7e700 1 --2- 172.21.15.2:0/1556607610 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f9c156d20 0x7f2f9c154cf0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c06af30 tx=0x7f2f94011f60 comp rx=0 tx=0).stop 2023-11-26T07:16:21.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.556+0000 7f2fa2b7e700 1 -- 172.21.15.2:0/1556607610 shutdown_connections 2023-11-26T07:16:21.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.556+0000 7f2fa2b7e700 1 --2- 172.21.15.2:0/1556607610 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f2f8006b730 0x7f2f8006dbf0 secure :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2f900090b0 tx=0x7f2f90008030 comp rx=0 tx=0).stop 2023-11-26T07:16:21.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.556+0000 7f2fa2b7e700 1 --2- 172.21.15.2:0/1556607610 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f9c156d20 0x7f2f9c154cf0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:21.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.556+0000 7f2fa2b7e700 1 --2- 172.21.15.2:0/1556607610 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f8c003a00 0x7f2f9c150f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:21.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.556+0000 7f2fa2b7e700 1 --2- 172.21.15.2:0/1556607610 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f9c0ce940 0x7f2f9c0cff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:21.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.556+0000 7f2fa2b7e700 1 -- 172.21.15.2:0/1556607610 >> 172.21.15.2:0/1556607610 conn(0x7f2f9c0b2840 msgr2=0x7f2f9c15a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:21.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.556+0000 7f2fa2b7e700 1 -- 172.21.15.2:0/1556607610 shutdown_connections 2023-11-26T07:16:21.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.556+0000 7f2fa2b7e700 1 -- 172.21.15.2:0/1556607610 wait complete. 2023-11-26T07:16:21.561 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' removed 2023-11-26T07:16:21.574 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-26T07:16:21.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.713+0000 7f4d49509700 1 Processor -- start 2023-11-26T07:16:21.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.713+0000 7f4d49509700 1 -- start start 2023-11-26T07:16:21.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.714+0000 7f4d49509700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4d440b59d0 0x7f4d4415e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:21.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.714+0000 7f4d49509700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d44072350 0x7f4d440727c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:21.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.714+0000 7f4d49509700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d44071ec0 con 0x7f4d4406afd0 2023-11-26T07:16:21.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.714+0000 7f4d49509700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d44071b90 con 0x7f4d440b59d0 2023-11-26T07:16:21.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.714+0000 7f4d49509700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4415ed30 con 0x7f4d44072350 2023-11-26T07:16:21.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.714+0000 7f4d427fc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4d440b59d0 0x7f4d4415e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:21.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.714+0000 7f4d427fc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4d440b59d0 0x7f4d4415e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43894/0 (socket says 172.21.15.2:43894) 2023-11-26T07:16:21.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.714+0000 7f4d427fc700 1 -- 172.21.15.2:0/2185999237 learned_addr learned my addr 172.21.15.2:0/2185999237 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:21.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.715+0000 7f4d427fc700 1 -- 172.21.15.2:0/2185999237 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d44072350 msgr2=0x7f4d440727c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:21.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.715+0000 7f4d427fc700 1 --2- 172.21.15.2:0/2185999237 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d44072350 0x7f4d440727c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:21.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.715+0000 7f4d427fc700 1 -- 172.21.15.2:0/2185999237 >> v1:172.21.15.192:6789/0 conn(0x7f4d4406afd0 legacy=0x7f4d4406b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:21.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.715+0000 7f4d427fc700 1 -- 172.21.15.2:0/2185999237 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d4415f010 con 0x7f4d440b59d0 2023-11-26T07:16:21.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.715+0000 7f4d427fc700 1 --2- 172.21.15.2:0/2185999237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d440b59d0 0x7f4d4415e470 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f4d340098f0 tx=0x7f4d34009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9787a4d4b6910b8c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:21.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.715+0000 7f4d41ffb700 1 -- 172.21.15.2:0/2185999237 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d34004230 con 0x7f4d440b59d0 2023-11-26T07:16:21.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.715+0000 7f4d41ffb700 1 -- 172.21.15.2:0/2185999237 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d34004390 con 0x7f4d440b59d0 2023-11-26T07:16:21.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.715+0000 7f4d41ffb700 1 -- 172.21.15.2:0/2185999237 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d340036a0 con 0x7f4d440b59d0 2023-11-26T07:16:21.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.715+0000 7f4d49509700 1 -- 172.21.15.2:0/2185999237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d440b59d0 msgr2=0x7f4d4415e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:21.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.715+0000 7f4d49509700 1 --2- 172.21.15.2:0/2185999237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d440b59d0 0x7f4d4415e470 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f4d340098f0 tx=0x7f4d34009c00 comp rx=0 tx=0).stop 2023-11-26T07:16:21.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.715+0000 7f4d49509700 1 -- 172.21.15.2:0/2185999237 shutdown_connections 2023-11-26T07:16:21.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.715+0000 7f4d49509700 1 --2- 172.21.15.2:0/2185999237 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d44072350 0x7f4d440727c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:21.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.715+0000 7f4d49509700 1 --2- 172.21.15.2:0/2185999237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d440b59d0 0x7f4d4415e470 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:21.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.715+0000 7f4d49509700 1 -- 172.21.15.2:0/2185999237 >> 172.21.15.2:0/2185999237 conn(0x7f4d440b2760 msgr2=0x7f4d440b2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:21.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.715+0000 7f4d49509700 1 -- 172.21.15.2:0/2185999237 shutdown_connections 2023-11-26T07:16:21.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.716+0000 7f4d49509700 1 -- 172.21.15.2:0/2185999237 wait complete. 2023-11-26T07:16:21.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.717+0000 7f4d49509700 1 Processor -- start 2023-11-26T07:16:21.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.717+0000 7f4d49509700 1 -- start start 2023-11-26T07:16:21.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.718+0000 7f4d49509700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d4406afd0 0x7f4d440af690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:21.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.718+0000 7f4d49509700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d44072350 0x7f4d440c59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:21.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.718+0000 7f4d49509700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d440b59d0 0x7f4d44142f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:21.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.718+0000 7f4d49509700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d440c6220 con 0x7f4d4406afd0 2023-11-26T07:16:21.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.718+0000 7f4d49509700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d440c6500 con 0x7f4d440b59d0 2023-11-26T07:16:21.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.718+0000 7f4d49509700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d440c67e0 con 0x7f4d44072350 2023-11-26T07:16:21.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.718+0000 7f4d42ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d4406afd0 0x7f4d440af690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:21.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.718+0000 7f4d42ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d4406afd0 0x7f4d440af690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43898/0 (socket says 172.21.15.2:43898) 2023-11-26T07:16:21.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.718+0000 7f4d42ffd700 1 -- 172.21.15.2:0/1126711303 learned_addr learned my addr 172.21.15.2:0/1126711303 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:21.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.718+0000 7f4d427fc700 1 --2- 172.21.15.2:0/1126711303 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d44072350 0x7f4d440c59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:21.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.718+0000 7f4d437fe700 1 --2- 172.21.15.2:0/1126711303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d440b59d0 0x7f4d44142f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:21.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.718+0000 7f4d42ffd700 1 -- 172.21.15.2:0/1126711303 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d44072350 msgr2=0x7f4d440c59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:21.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.718+0000 7f4d42ffd700 1 --2- 172.21.15.2:0/1126711303 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d44072350 0x7f4d440c59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:21.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.718+0000 7f4d42ffd700 1 -- 172.21.15.2:0/1126711303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d440b59d0 msgr2=0x7f4d44142f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:21.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.718+0000 7f4d42ffd700 1 --2- 172.21.15.2:0/1126711303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d440b59d0 0x7f4d44142f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:21.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.718+0000 7f4d42ffd700 1 -- 172.21.15.2:0/1126711303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d34009550 con 0x7f4d4406afd0 2023-11-26T07:16:21.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.718+0000 7f4d437fe700 1 --2- 172.21.15.2:0/1126711303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d440b59d0 0x7f4d44142f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:16:21.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.718+0000 7f4d42ffd700 1 --2- 172.21.15.2:0/1126711303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d4406afd0 0x7f4d440af690 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f4d3800c4a0 tx=0x7f4d3800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:21.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.718+0000 7f4d2b7fe700 1 -- 172.21.15.2:0/1126711303 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d380054e0 con 0x7f4d4406afd0 2023-11-26T07:16:21.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.718+0000 7f4d2b7fe700 1 -- 172.21.15.2:0/1126711303 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d38003680 con 0x7f4d4406afd0 2023-11-26T07:16:21.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.718+0000 7f4d2b7fe700 1 -- 172.21.15.2:0/1126711303 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d38003a30 con 0x7f4d4406afd0 2023-11-26T07:16:21.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.718+0000 7f4d49509700 1 -- 172.21.15.2:0/1126711303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d440c6ac0 con 0x7f4d4406afd0 2023-11-26T07:16:21.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.718+0000 7f4d49509700 1 -- 172.21.15.2:0/1126711303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d441f41e0 con 0x7f4d4406afd0 2023-11-26T07:16:21.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.719+0000 7f4d49509700 1 -- 172.21.15.2:0/1126711303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d441f4430 con 0x7f4d4406afd0 2023-11-26T07:16:21.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.720+0000 7f4d2b7fe700 1 -- 172.21.15.2:0/1126711303 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f4d38003b90 con 0x7f4d4406afd0 2023-11-26T07:16:21.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.720+0000 7f4d2b7fe700 1 --2- 172.21.15.2:0/1126711303 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4d3006b740 0x7f4d3006dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:21.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.720+0000 7f4d2b7fe700 1 -- 172.21.15.2:0/1126711303 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f4d38087060 con 0x7f4d4406afd0 2023-11-26T07:16:21.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.720+0000 7f4d427fc700 1 --2- 172.21.15.2:0/1126711303 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4d3006b740 0x7f4d3006dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:21.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.721+0000 7f4d427fc700 1 --2- 172.21.15.2:0/1126711303 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4d3006b740 0x7f4d3006dc00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4d34009130 tx=0x7f4d34008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:21.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.725+0000 7f4d2b7fe700 1 -- 172.21.15.2:0/1126711303 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4d380539f0 con 0x7f4d4406afd0 2023-11-26T07:16:21.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:21.927+0000 7f4d49509700 1 -- 172.21.15.2:0/1126711303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4d441f45c0 con 0x7f4d4406afd0 2023-11-26T07:16:22.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.556+0000 7f4d2b7fe700 1 -- 172.21.15.2:0/1126711303 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v65) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4d38057010 con 0x7f4d4406afd0 2023-11-26T07:16:22.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.559+0000 7f4d49509700 1 -- 172.21.15.2:0/1126711303 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4d3006b740 msgr2=0x7f4d3006dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:22.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.559+0000 7f4d49509700 1 --2- 172.21.15.2:0/1126711303 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4d3006b740 0x7f4d3006dc00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4d34009130 tx=0x7f4d34008030 comp rx=0 tx=0).stop 2023-11-26T07:16:22.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.559+0000 7f4d49509700 1 -- 172.21.15.2:0/1126711303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d4406afd0 msgr2=0x7f4d440af690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:22.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.559+0000 7f4d49509700 1 --2- 172.21.15.2:0/1126711303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d4406afd0 0x7f4d440af690 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f4d3800c4a0 tx=0x7f4d3800c7b0 comp rx=0 tx=0).stop 2023-11-26T07:16:22.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.559+0000 7f4d49509700 1 -- 172.21.15.2:0/1126711303 shutdown_connections 2023-11-26T07:16:22.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.559+0000 7f4d49509700 1 --2- 172.21.15.2:0/1126711303 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4d3006b740 0x7f4d3006dc00 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:22.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.559+0000 7f4d49509700 1 --2- 172.21.15.2:0/1126711303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d440b59d0 0x7f4d44142f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:22.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.559+0000 7f4d49509700 1 --2- 172.21.15.2:0/1126711303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d4406afd0 0x7f4d440af690 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:22.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.559+0000 7f4d49509700 1 --2- 172.21.15.2:0/1126711303 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d44072350 0x7f4d440c59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:22.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.559+0000 7f4d49509700 1 -- 172.21.15.2:0/1126711303 >> 172.21.15.2:0/1126711303 conn(0x7f4d440b2760 msgr2=0x7f4d4406b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:22.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.559+0000 7f4d49509700 1 -- 172.21.15.2:0/1126711303 shutdown_connections 2023-11-26T07:16:22.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.559+0000 7f4d49509700 1 -- 172.21.15.2:0/1126711303 wait complete. 2023-11-26T07:16:22.563 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' removed 2023-11-26T07:16:22.576 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/volumes/snapshot_clone_delay 2023-11-26T07:16:22.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.710+0000 7f36d9ed7700 1 Processor -- start 2023-11-26T07:16:22.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.710+0000 7f36d9ed7700 1 -- start start 2023-11-26T07:16:22.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.710+0000 7f36d9ed7700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f36d415bde0 0x7f36d415c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:22.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.710+0000 7f36d9ed7700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f36d40cf2b0 0x7f36d40d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:22.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.710+0000 7f36d9ed7700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36d40d0a90 con 0x7f36d40ce5c0 2023-11-26T07:16:22.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.710+0000 7f36d9ed7700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36d406ee10 con 0x7f36d415bde0 2023-11-26T07:16:22.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.710+0000 7f36d9ed7700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36d406f0f0 con 0x7f36d40cf2b0 2023-11-26T07:16:22.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.711+0000 7f36d37fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f36d415bde0 0x7f36d415c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:22.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.711+0000 7f36d3fff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f36d40ce5c0 0x7f36d40cc670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35118/0 (socket says 172.21.15.2:35118) 2023-11-26T07:16:22.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.711+0000 7f36d37fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f36d415bde0 0x7f36d415c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43906/0 (socket says 172.21.15.2:43906) 2023-11-26T07:16:22.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.711+0000 7f36d3fff700 1 -- 172.21.15.2:0/3363979970 learned_addr learned my addr 172.21.15.2:0/3363979970 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:16:22.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.711+0000 7f36d37fe700 1 -- 172.21.15.2:0/3363979970 >> v2:172.21.15.192:3300/0 conn(0x7f36d40cf2b0 msgr2=0x7f36d40d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:22.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.711+0000 7f36d2ffd700 1 --2- 172.21.15.2:0/3363979970 >> v2:172.21.15.192:3300/0 conn(0x7f36d40cf2b0 0x7f36d40d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:22.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.711+0000 7f36d37fe700 1 --2- 172.21.15.2:0/3363979970 >> v2:172.21.15.192:3300/0 conn(0x7f36d40cf2b0 0x7f36d40d01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:22.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.711+0000 7f36d37fe700 1 -- 172.21.15.2:0/3363979970 >> v1:172.21.15.2:6789/0 conn(0x7f36d40ce5c0 legacy=0x7f36d40cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:22.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.711+0000 7f36d27fc700 1 -- 172.21.15.2:0/3363979970 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1947926069 0 0) 0x7f36d40d0a90 con 0x7f36d40ce5c0 2023-11-26T07:16:22.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.711+0000 7f36d37fe700 1 -- 172.21.15.2:0/3363979970 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d406f3d0 con 0x7f36d415bde0 2023-11-26T07:16:22.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.711+0000 7f36d37fe700 1 --2- 172.21.15.2:0/3363979970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36d415bde0 0x7f36d415c1c0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f36d406e780 tx=0x7f36c4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f15a6fba0b544378 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:22.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.711+0000 7f36d27fc700 1 -- 172.21.15.2:0/3363979970 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c4011830 con 0x7f36d415bde0 2023-11-26T07:16:22.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.711+0000 7f36d27fc700 1 -- 172.21.15.2:0/3363979970 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c4011990 con 0x7f36d415bde0 2023-11-26T07:16:22.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.711+0000 7f36d27fc700 1 -- 172.21.15.2:0/3363979970 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c4011d20 con 0x7f36d415bde0 2023-11-26T07:16:22.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.712+0000 7f36d9ed7700 1 -- 172.21.15.2:0/3363979970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36d415bde0 msgr2=0x7f36d415c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:22.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.712+0000 7f36d9ed7700 1 --2- 172.21.15.2:0/3363979970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36d415bde0 0x7f36d415c1c0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f36d406e780 tx=0x7f36c4009b20 comp rx=0 tx=0).stop 2023-11-26T07:16:22.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.712+0000 7f36d9ed7700 1 -- 172.21.15.2:0/3363979970 shutdown_connections 2023-11-26T07:16:22.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.712+0000 7f36d9ed7700 1 --2- 172.21.15.2:0/3363979970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36d415bde0 0x7f36d415c1c0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:22.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.712+0000 7f36d9ed7700 1 --2- 172.21.15.2:0/3363979970 >> v2:172.21.15.192:3300/0 conn(0x7f36d40cf2b0 0x7f36d40d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:22.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.712+0000 7f36d9ed7700 1 -- 172.21.15.2:0/3363979970 >> 172.21.15.2:0/3363979970 conn(0x7f36d40b3720 msgr2=0x7f36d40b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:22.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.712+0000 7f36d9ed7700 1 -- 172.21.15.2:0/3363979970 shutdown_connections 2023-11-26T07:16:22.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.712+0000 7f36d9ed7700 1 -- 172.21.15.2:0/3363979970 wait complete. 2023-11-26T07:16:22.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.713+0000 7f36d9ed7700 1 Processor -- start 2023-11-26T07:16:22.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.714+0000 7f36d9ed7700 1 -- start start 2023-11-26T07:16:22.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.715+0000 7f36d9ed7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36d40ce5c0 0x7f36d40cb170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:22.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.715+0000 7f36d9ed7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36d40cf2b0 0x7f36d41f4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:22.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.715+0000 7f36d9ed7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36d415bde0 0x7f36d40b64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:22.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.715+0000 7f36d9ed7700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d41f52d0 con 0x7f36d415bde0 2023-11-26T07:16:22.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.715+0000 7f36d9ed7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d41f55b0 con 0x7f36d40ce5c0 2023-11-26T07:16:22.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.715+0000 7f36d9ed7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d41f5890 con 0x7f36d40cf2b0 2023-11-26T07:16:22.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.715+0000 7f36d3fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36d415bde0 0x7f36d40b64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:22.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.715+0000 7f36d3fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36d415bde0 0x7f36d40b64f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43914/0 (socket says 172.21.15.2:43914) 2023-11-26T07:16:22.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.715+0000 7f36d3fff700 1 -- 172.21.15.2:0/2147060721 learned_addr learned my addr 172.21.15.2:0/2147060721 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:22.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.715+0000 7f36d2ffd700 1 --2- 172.21.15.2:0/2147060721 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36d40cf2b0 0x7f36d41f4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:22.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.715+0000 7f36d37fe700 1 --2- 172.21.15.2:0/2147060721 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36d40ce5c0 0x7f36d40cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:22.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.715+0000 7f36d3fff700 1 -- 172.21.15.2:0/2147060721 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36d40cf2b0 msgr2=0x7f36d41f4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:22.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.715+0000 7f36d3fff700 1 --2- 172.21.15.2:0/2147060721 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36d40cf2b0 0x7f36d41f4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:22.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.715+0000 7f36d3fff700 1 -- 172.21.15.2:0/2147060721 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36d40ce5c0 msgr2=0x7f36d40cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:22.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.715+0000 7f36d3fff700 1 --2- 172.21.15.2:0/2147060721 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36d40ce5c0 0x7f36d40cb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:22.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.715+0000 7f36d3fff700 1 -- 172.21.15.2:0/2147060721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c40094a0 con 0x7f36d415bde0 2023-11-26T07:16:22.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.715+0000 7f36d37fe700 1 --2- 172.21.15.2:0/2147060721 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36d40ce5c0 0x7f36d40cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:16:22.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.715+0000 7f36d2ffd700 1 --2- 172.21.15.2:0/2147060721 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36d40cf2b0 0x7f36d41f4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:16:22.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.715+0000 7f36d3fff700 1 --2- 172.21.15.2:0/2147060721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36d415bde0 0x7f36d40b64f0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f36cc002230 tx=0x7f36cc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:22.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.715+0000 7f36bbfff700 1 -- 172.21.15.2:0/2147060721 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36cc00ac20 con 0x7f36d415bde0 2023-11-26T07:16:22.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.715+0000 7f36bbfff700 1 -- 172.21.15.2:0/2147060721 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36cc00ada0 con 0x7f36d415bde0 2023-11-26T07:16:22.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.715+0000 7f36d9ed7700 1 -- 172.21.15.2:0/2147060721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36d41f17a0 con 0x7f36d415bde0 2023-11-26T07:16:22.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.715+0000 7f36bbfff700 1 -- 172.21.15.2:0/2147060721 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36cc007310 con 0x7f36d415bde0 2023-11-26T07:16:22.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.716+0000 7f36d9ed7700 1 -- 172.21.15.2:0/2147060721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36d41f4fc0 con 0x7f36d415bde0 2023-11-26T07:16:22.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.716+0000 7f36d9ed7700 1 -- 172.21.15.2:0/2147060721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36d4075480 con 0x7f36d415bde0 2023-11-26T07:16:22.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.717+0000 7f36bbfff700 1 -- 172.21.15.2:0/2147060721 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f36cc007470 con 0x7f36d415bde0 2023-11-26T07:16:22.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.717+0000 7f36bbfff700 1 --2- 172.21.15.2:0/2147060721 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f36c006b740 0x7f36c006dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:22.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.718+0000 7f36bbfff700 1 -- 172.21.15.2:0/2147060721 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f36cc087ef0 con 0x7f36d415bde0 2023-11-26T07:16:22.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.718+0000 7f36d37fe700 1 --2- 172.21.15.2:0/2147060721 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f36c006b740 0x7f36c006dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:22.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.718+0000 7f36d37fe700 1 --2- 172.21.15.2:0/2147060721 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f36c006b740 0x7f36c006dc00 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f36c40090b0 tx=0x7f36c401c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:22.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.722+0000 7f36bbfff700 1 -- 172.21.15.2:0/2147060721 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f36cc054880 con 0x7f36d415bde0 2023-11-26T07:16:22.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.927+0000 7f36d9ed7700 1 -- 172.21.15.2:0/2147060721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_delay"} v 0) v1 -- 0x7f36d41e49b0 con 0x7f36d415bde0 2023-11-26T07:16:22.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.931+0000 7f36bbfff700 1 -- 172.21.15.2:0/2147060721 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_delay"}]=0 v20) v1 ==== 115+0+0 (secure 0 0 0) 0x7f36cc0180b0 con 0x7f36d415bde0 2023-11-26T07:16:22.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.933+0000 7f36d9ed7700 1 -- 172.21.15.2:0/2147060721 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f36c006b740 msgr2=0x7f36c006dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:22.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.933+0000 7f36d9ed7700 1 --2- 172.21.15.2:0/2147060721 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f36c006b740 0x7f36c006dc00 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f36c40090b0 tx=0x7f36c401c040 comp rx=0 tx=0).stop 2023-11-26T07:16:22.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.933+0000 7f36d9ed7700 1 -- 172.21.15.2:0/2147060721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36d415bde0 msgr2=0x7f36d40b64f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:22.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.933+0000 7f36d9ed7700 1 --2- 172.21.15.2:0/2147060721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36d415bde0 0x7f36d40b64f0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f36cc002230 tx=0x7f36cc00a060 comp rx=0 tx=0).stop 2023-11-26T07:16:22.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.933+0000 7f36d9ed7700 1 -- 172.21.15.2:0/2147060721 shutdown_connections 2023-11-26T07:16:22.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.933+0000 7f36d9ed7700 1 --2- 172.21.15.2:0/2147060721 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f36c006b740 0x7f36c006dc00 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:22.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.933+0000 7f36d9ed7700 1 --2- 172.21.15.2:0/2147060721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36d415bde0 0x7f36d40b64f0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:22.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.933+0000 7f36d9ed7700 1 --2- 172.21.15.2:0/2147060721 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36d40ce5c0 0x7f36d40cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:22.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.933+0000 7f36d9ed7700 1 --2- 172.21.15.2:0/2147060721 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36d40cf2b0 0x7f36d41f4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:22.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.933+0000 7f36d9ed7700 1 -- 172.21.15.2:0/2147060721 >> 172.21.15.2:0/2147060721 conn(0x7f36d40b3720 msgr2=0x7f36d40b0570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:22.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.933+0000 7f36d9ed7700 1 -- 172.21.15.2:0/2147060721 shutdown_connections 2023-11-26T07:16:22.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:22.933+0000 7f36d9ed7700 1 -- 172.21.15.2:0/2147060721 wait complete. 2023-11-26T07:16:22.947 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-26T07:16:23.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.083+0000 7fc2a639d700 1 Processor -- start 2023-11-26T07:16:23.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.083+0000 7fc2a639d700 1 -- start start 2023-11-26T07:16:23.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.084+0000 7fc2a639d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc2a015add0 0x7fc2a00b4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:23.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.084+0000 7fc2a639d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc2a00b3ab0 0x7fc2a006ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:23.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.084+0000 7fc2a639d700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2a00ce5b0 con 0x7fc2a006f370 2023-11-26T07:16:23.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.084+0000 7fc2a639d700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a006f800 con 0x7fc2a00b3ab0 2023-11-26T07:16:23.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.084+0000 7fc2a639d700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a0072d70 con 0x7fc2a015add0 2023-11-26T07:16:23.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.084+0000 7fc29f7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc2a00b3ab0 0x7fc2a006ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:23.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.084+0000 7fc29f7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc2a00b3ab0 0x7fc2a006ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43922/0 (socket says 172.21.15.2:43922) 2023-11-26T07:16:23.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.084+0000 7fc29f7fe700 1 -- 172.21.15.2:0/217766955 learned_addr learned my addr 172.21.15.2:0/217766955 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:23.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.084+0000 7fc29ffff700 1 --2- 172.21.15.2:0/217766955 >> v2:172.21.15.192:3300/0 conn(0x7fc2a015add0 0x7fc2a00b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:23.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.084+0000 7fc29f7fe700 1 -- 172.21.15.2:0/217766955 >> v2:172.21.15.192:3300/0 conn(0x7fc2a015add0 msgr2=0x7fc2a00b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:23.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.084+0000 7fc29f7fe700 1 --2- 172.21.15.2:0/217766955 >> v2:172.21.15.192:3300/0 conn(0x7fc2a015add0 0x7fc2a00b4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:23.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.084+0000 7fc29f7fe700 1 -- 172.21.15.2:0/217766955 >> v1:172.21.15.192:6789/0 conn(0x7fc2a006f370 legacy=0x7fc2a006daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:23.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.084+0000 7fc29f7fe700 1 -- 172.21.15.2:0/217766955 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a00b4f10 con 0x7fc2a00b3ab0 2023-11-26T07:16:23.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.084+0000 7fc29ffff700 1 --2- 172.21.15.2:0/217766955 >> v2:172.21.15.192:3300/0 conn(0x7fc2a015add0 0x7fc2a00b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:16:23.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.085+0000 7fc29f7fe700 1 --2- 172.21.15.2:0/217766955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2a00b3ab0 0x7fc2a006ee30 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fc2a006da40 tx=0x7fc288009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cf03ec6cd9259dc server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:23.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.085+0000 7fc29effd700 1 -- 172.21.15.2:0/217766955 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc288004230 con 0x7fc2a00b3ab0 2023-11-26T07:16:23.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.085+0000 7fc29effd700 1 -- 172.21.15.2:0/217766955 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc288004390 con 0x7fc2a00b3ab0 2023-11-26T07:16:23.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.085+0000 7fc29effd700 1 -- 172.21.15.2:0/217766955 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2880036a0 con 0x7fc2a00b3ab0 2023-11-26T07:16:23.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.085+0000 7fc2a639d700 1 -- 172.21.15.2:0/217766955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2a00b3ab0 msgr2=0x7fc2a006ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:23.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.085+0000 7fc2a639d700 1 --2- 172.21.15.2:0/217766955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2a00b3ab0 0x7fc2a006ee30 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fc2a006da40 tx=0x7fc288009bd0 comp rx=0 tx=0).stop 2023-11-26T07:16:23.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.085+0000 7fc2a639d700 1 -- 172.21.15.2:0/217766955 shutdown_connections 2023-11-26T07:16:23.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.085+0000 7fc2a639d700 1 --2- 172.21.15.2:0/217766955 >> v2:172.21.15.192:3300/0 conn(0x7fc2a015add0 0x7fc2a00b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:23.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.085+0000 7fc2a639d700 1 --2- 172.21.15.2:0/217766955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2a00b3ab0 0x7fc2a006ee30 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:23.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.085+0000 7fc2a639d700 1 -- 172.21.15.2:0/217766955 >> 172.21.15.2:0/217766955 conn(0x7fc2a00b27b0 msgr2=0x7fc2a00b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:23.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.085+0000 7fc2a639d700 1 -- 172.21.15.2:0/217766955 shutdown_connections 2023-11-26T07:16:23.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.085+0000 7fc2a639d700 1 -- 172.21.15.2:0/217766955 wait complete. 2023-11-26T07:16:23.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.087+0000 7fc2a639d700 1 Processor -- start 2023-11-26T07:16:23.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.087+0000 7fc2a639d700 1 -- start start 2023-11-26T07:16:23.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.088+0000 7fc2a639d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc2a006f370 0x7fc2a01f15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:23.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.088+0000 7fc2a639d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2a00b3ab0 0x7fc2a00aba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:23.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.088+0000 7fc2a639d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2a015add0 0x7fc2a00abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:23.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.088+0000 7fc2a639d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a0154fd0 con 0x7fc2a00b3ab0 2023-11-26T07:16:23.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.088+0000 7fc2a639d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a00a9490 con 0x7fc2a015add0 2023-11-26T07:16:23.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.088+0000 7fc2a639d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a00a9730 con 0x7fc2a006f370 2023-11-26T07:16:23.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.088+0000 7fc29f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2a00b3ab0 0x7fc2a00aba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:23.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.088+0000 7fc29f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2a00b3ab0 0x7fc2a00aba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43926/0 (socket says 172.21.15.2:43926) 2023-11-26T07:16:23.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.088+0000 7fc29f7fe700 1 -- 172.21.15.2:0/1422867635 learned_addr learned my addr 172.21.15.2:0/1422867635 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:23.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.088+0000 7fc2a493a700 1 --2- 172.21.15.2:0/1422867635 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2a015add0 0x7fc2a00abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:23.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.088+0000 7fc29ffff700 1 --2- 172.21.15.2:0/1422867635 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc2a006f370 0x7fc2a01f15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:23.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.088+0000 7fc29f7fe700 1 -- 172.21.15.2:0/1422867635 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc2a006f370 msgr2=0x7fc2a01f15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:23.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.088+0000 7fc29f7fe700 1 --2- 172.21.15.2:0/1422867635 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc2a006f370 0x7fc2a01f15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:23.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.088+0000 7fc29f7fe700 1 -- 172.21.15.2:0/1422867635 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2a015add0 msgr2=0x7fc2a00abfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:23.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.088+0000 7fc29f7fe700 1 --2- 172.21.15.2:0/1422867635 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2a015add0 0x7fc2a00abfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:23.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.088+0000 7fc29f7fe700 1 -- 172.21.15.2:0/1422867635 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc288009550 con 0x7fc2a00b3ab0 2023-11-26T07:16:23.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.089+0000 7fc29f7fe700 1 --2- 172.21.15.2:0/1422867635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2a00b3ab0 0x7fc2a00aba90 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fc288009130 tx=0x7fc288004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:23.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.089+0000 7fc29cff9700 1 -- 172.21.15.2:0/1422867635 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28801f070 con 0x7fc2a00b3ab0 2023-11-26T07:16:23.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.089+0000 7fc29cff9700 1 -- 172.21.15.2:0/1422867635 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc288003d50 con 0x7fc2a00b3ab0 2023-11-26T07:16:23.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.089+0000 7fc2a639d700 1 -- 172.21.15.2:0/1422867635 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2a00a9a10 con 0x7fc2a00b3ab0 2023-11-26T07:16:23.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.089+0000 7fc29cff9700 1 -- 172.21.15.2:0/1422867635 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc288011850 con 0x7fc2a00b3ab0 2023-11-26T07:16:23.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.089+0000 7fc2a639d700 1 -- 172.21.15.2:0/1422867635 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a00a9fd0 con 0x7fc2a00b3ab0 2023-11-26T07:16:23.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.090+0000 7fc2a639d700 1 -- 172.21.15.2:0/1422867635 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2a0075480 con 0x7fc2a00b3ab0 2023-11-26T07:16:23.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.090+0000 7fc29cff9700 1 -- 172.21.15.2:0/1422867635 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7fc2880119b0 con 0x7fc2a00b3ab0 2023-11-26T07:16:23.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.091+0000 7fc29cff9700 1 --2- 172.21.15.2:0/1422867635 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc28006b740 0x7fc28006dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:23.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.091+0000 7fc29cff9700 1 -- 172.21.15.2:0/1422867635 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc28808b460 con 0x7fc2a00b3ab0 2023-11-26T07:16:23.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.091+0000 7fc29ffff700 1 --2- 172.21.15.2:0/1422867635 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc28006b740 0x7fc28006dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:23.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.091+0000 7fc29ffff700 1 --2- 172.21.15.2:0/1422867635 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc28006b740 0x7fc28006dc00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc290006fd0 tx=0x7fc290008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:23.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.095+0000 7fc29cff9700 1 -- 172.21.15.2:0/1422867635 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc288057e30 con 0x7fc2a00b3ab0 2023-11-26T07:16:23.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.297+0000 7fc2a639d700 1 -- 172.21.15.2:0/1422867635 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc2a00b2fd0 con 0x7fc2a00b3ab0 2023-11-26T07:16:23.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.300+0000 7fc29cff9700 1 -- 172.21.15.2:0/1422867635 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc2880233d0 con 0x7fc2a00b3ab0 2023-11-26T07:16:23.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.302+0000 7fc2a639d700 1 -- 172.21.15.2:0/1422867635 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc28006b740 msgr2=0x7fc28006dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:23.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.302+0000 7fc2a639d700 1 --2- 172.21.15.2:0/1422867635 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc28006b740 0x7fc28006dc00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc290006fd0 tx=0x7fc290008040 comp rx=0 tx=0).stop 2023-11-26T07:16:23.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.302+0000 7fc2a639d700 1 -- 172.21.15.2:0/1422867635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2a00b3ab0 msgr2=0x7fc2a00aba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:23.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.302+0000 7fc2a639d700 1 --2- 172.21.15.2:0/1422867635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2a00b3ab0 0x7fc2a00aba90 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fc288009130 tx=0x7fc288004750 comp rx=0 tx=0).stop 2023-11-26T07:16:23.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.303+0000 7fc2a639d700 1 -- 172.21.15.2:0/1422867635 shutdown_connections 2023-11-26T07:16:23.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.303+0000 7fc2a639d700 1 --2- 172.21.15.2:0/1422867635 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc28006b740 0x7fc28006dc00 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:23.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.303+0000 7fc2a639d700 1 --2- 172.21.15.2:0/1422867635 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2a015add0 0x7fc2a00abfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:23.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.303+0000 7fc2a639d700 1 --2- 172.21.15.2:0/1422867635 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc2a006f370 0x7fc2a01f15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:23.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.303+0000 7fc2a639d700 1 --2- 172.21.15.2:0/1422867635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2a00b3ab0 0x7fc2a00aba90 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:23.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.303+0000 7fc2a639d700 1 -- 172.21.15.2:0/1422867635 >> 172.21.15.2:0/1422867635 conn(0x7fc2a00b27b0 msgr2=0x7fc2a006daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:23.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.303+0000 7fc2a639d700 1 -- 172.21.15.2:0/1422867635 shutdown_connections 2023-11-26T07:16:23.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.303+0000 7fc2a639d700 1 -- 172.21.15.2:0/1422867635 wait complete. 2023-11-26T07:16:23.341 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_cancelled' 2023-11-26T07:16:23.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.465+0000 7feca7b9f700 1 Processor -- start 2023-11-26T07:16:23.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.465+0000 7feca7b9f700 1 -- start start 2023-11-26T07:16:23.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.466+0000 7feca7b9f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7feca00b4150 0x7feca006de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:23.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.466+0000 7feca7b9f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7feca00b5ab0 0x7feca006e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:23.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.466+0000 7feca7b9f700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feca0071f50 con 0x7feca006b620 2023-11-26T07:16:23.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.466+0000 7feca7b9f700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feca0072230 con 0x7feca00b5ab0 2023-11-26T07:16:23.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.466+0000 7feca7b9f700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feca0072510 con 0x7feca00b4150 2023-11-26T07:16:23.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.466+0000 7feca593b700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7feca006b620 0x7feca00b3a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35142/0 (socket says 172.21.15.2:35142) 2023-11-26T07:16:23.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.466+0000 7feca593b700 1 -- 172.21.15.2:0/3049480111 learned_addr learned my addr 172.21.15.2:0/3049480111 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:16:23.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.466+0000 7feca613c700 1 --2- 172.21.15.2:0/3049480111 >> v2:172.21.15.2:3300/0 conn(0x7feca00b5ab0 0x7feca006e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:23.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.466+0000 7feca513a700 1 --2- 172.21.15.2:0/3049480111 >> v2:172.21.15.192:3300/0 conn(0x7feca00b4150 0x7feca006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:23.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.466+0000 7feca4939700 1 -- 172.21.15.2:0/3049480111 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1381336934 0 0) 0x7feca0071f50 con 0x7feca006b620 2023-11-26T07:16:23.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.466+0000 7feca4939700 1 -- 172.21.15.2:0/3049480111 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec8c0035b0 con 0x7feca006b620 2023-11-26T07:16:23.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.466+0000 7feca613c700 1 -- 172.21.15.2:0/3049480111 >> v2:172.21.15.192:3300/0 conn(0x7feca00b4150 msgr2=0x7feca006de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:23.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.466+0000 7feca613c700 1 --2- 172.21.15.2:0/3049480111 >> v2:172.21.15.192:3300/0 conn(0x7feca00b4150 0x7feca006de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:23.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.466+0000 7feca613c700 1 -- 172.21.15.2:0/3049480111 >> v1:172.21.15.2:6789/0 conn(0x7feca006b620 legacy=0x7feca00b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:23.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.466+0000 7feca613c700 1 -- 172.21.15.2:0/3049480111 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca00727f0 con 0x7feca00b5ab0 2023-11-26T07:16:23.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.466+0000 7feca513a700 1 --2- 172.21.15.2:0/3049480111 >> v2:172.21.15.192:3300/0 conn(0x7feca00b4150 0x7feca006de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:16:23.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.466+0000 7feca613c700 1 --2- 172.21.15.2:0/3049480111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feca00b5ab0 0x7feca006e390 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7feca006d6f0 tx=0x7fec9800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d812e54222fa07 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:23.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.467+0000 7feca4939700 1 -- 172.21.15.2:0/3049480111 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9800e070 con 0x7feca00b5ab0 2023-11-26T07:16:23.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.467+0000 7feca4939700 1 -- 172.21.15.2:0/3049480111 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9800bb20 con 0x7feca00b5ab0 2023-11-26T07:16:23.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.467+0000 7feca4939700 1 -- 172.21.15.2:0/3049480111 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec98012430 con 0x7feca00b5ab0 2023-11-26T07:16:23.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.467+0000 7feca7b9f700 1 -- 172.21.15.2:0/3049480111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feca00b5ab0 msgr2=0x7feca006e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:23.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.467+0000 7feca7b9f700 1 --2- 172.21.15.2:0/3049480111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feca00b5ab0 0x7feca006e390 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7feca006d6f0 tx=0x7fec9800b330 comp rx=0 tx=0).stop 2023-11-26T07:16:23.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.467+0000 7feca7b9f700 1 -- 172.21.15.2:0/3049480111 shutdown_connections 2023-11-26T07:16:23.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.467+0000 7feca7b9f700 1 --2- 172.21.15.2:0/3049480111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feca00b5ab0 0x7feca006e390 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:23.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.467+0000 7feca7b9f700 1 --2- 172.21.15.2:0/3049480111 >> v2:172.21.15.192:3300/0 conn(0x7feca00b4150 0x7feca006de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:23.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.467+0000 7feca7b9f700 1 -- 172.21.15.2:0/3049480111 >> 172.21.15.2:0/3049480111 conn(0x7feca00b2740 msgr2=0x7feca00b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:23.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.467+0000 7feca7b9f700 1 -- 172.21.15.2:0/3049480111 shutdown_connections 2023-11-26T07:16:23.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.467+0000 7feca7b9f700 1 -- 172.21.15.2:0/3049480111 wait complete. 2023-11-26T07:16:23.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.468+0000 7feca7b9f700 1 Processor -- start 2023-11-26T07:16:23.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.468+0000 7feca7b9f700 1 -- start start 2023-11-26T07:16:23.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.469+0000 7feca7b9f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feca006b620 0x7feca006eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:23.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.469+0000 7feca7b9f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feca00b4150 0x7feca006f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:23.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.469+0000 7feca7b9f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feca00b5ab0 0x7feca01f74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:23.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.469+0000 7feca7b9f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca0135220 con 0x7feca00b5ab0 2023-11-26T07:16:23.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.469+0000 7feca7b9f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca0135500 con 0x7feca006b620 2023-11-26T07:16:23.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.469+0000 7feca7b9f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca01357e0 con 0x7feca00b4150 2023-11-26T07:16:23.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.469+0000 7feca613c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feca00b5ab0 0x7feca01f74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:23.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.469+0000 7feca613c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feca00b5ab0 0x7feca01f74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43942/0 (socket says 172.21.15.2:43942) 2023-11-26T07:16:23.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.469+0000 7feca613c700 1 -- 172.21.15.2:0/3768099615 learned_addr learned my addr 172.21.15.2:0/3768099615 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:23.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.470+0000 7feca513a700 1 --2- 172.21.15.2:0/3768099615 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feca00b4150 0x7feca006f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:23.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.470+0000 7feca593b700 1 --2- 172.21.15.2:0/3768099615 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feca006b620 0x7feca006eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:23.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.470+0000 7feca613c700 1 -- 172.21.15.2:0/3768099615 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feca00b4150 msgr2=0x7feca006f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:23.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.470+0000 7feca613c700 1 --2- 172.21.15.2:0/3768099615 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feca00b4150 0x7feca006f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:23.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.470+0000 7feca613c700 1 -- 172.21.15.2:0/3768099615 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feca006b620 msgr2=0x7feca006eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:23.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.470+0000 7feca613c700 1 --2- 172.21.15.2:0/3768099615 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feca006b620 0x7feca006eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:23.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.470+0000 7feca613c700 1 -- 172.21.15.2:0/3768099615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec98009a70 con 0x7feca00b5ab0 2023-11-26T07:16:23.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.470+0000 7feca613c700 1 --2- 172.21.15.2:0/3768099615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feca00b5ab0 0x7feca01f74d0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fec98014040 tx=0x7fec98004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:23.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.470+0000 7fec967fc700 1 -- 172.21.15.2:0/3768099615 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec98012430 con 0x7feca00b5ab0 2023-11-26T07:16:23.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.470+0000 7fec967fc700 1 -- 172.21.15.2:0/3768099615 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec98020070 con 0x7feca00b5ab0 2023-11-26T07:16:23.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.470+0000 7feca7b9f700 1 -- 172.21.15.2:0/3768099615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feca0135ac0 con 0x7feca00b5ab0 2023-11-26T07:16:23.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.470+0000 7fec967fc700 1 -- 172.21.15.2:0/3768099615 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec98004280 con 0x7feca00b5ab0 2023-11-26T07:16:23.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.470+0000 7feca7b9f700 1 -- 172.21.15.2:0/3768099615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feca01e5500 con 0x7feca00b5ab0 2023-11-26T07:16:23.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.471+0000 7feca7b9f700 1 -- 172.21.15.2:0/3768099615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feca00b54d0 con 0x7feca00b5ab0 2023-11-26T07:16:23.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.471+0000 7fec967fc700 1 -- 172.21.15.2:0/3768099615 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7fec980043e0 con 0x7feca00b5ab0 2023-11-26T07:16:23.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.472+0000 7fec967fc700 1 --2- 172.21.15.2:0/3768099615 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fec8406b740 0x7fec8406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:23.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.472+0000 7fec967fc700 1 -- 172.21.15.2:0/3768099615 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fec98022070 con 0x7feca00b5ab0 2023-11-26T07:16:23.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.472+0000 7feca593b700 1 --2- 172.21.15.2:0/3768099615 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fec8406b740 0x7fec8406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:23.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.473+0000 7feca593b700 1 --2- 172.21.15.2:0/3768099615 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fec8406b740 0x7fec8406dc00 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fec9c000f60 tx=0x7fec9c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:23.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.476+0000 7fec967fc700 1 -- 172.21.15.2:0/3768099615 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fec980566d0 con 0x7feca00b5ab0 2023-11-26T07:16:23.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:23.760+0000 7feca7b9f700 1 -- 172.21.15.2:0/3768099615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_cancelled"]} v 0) v1 -- 0x7feca0135360 con 0x7feca00b5ab0 2023-11-26T07:16:24.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.563+0000 7fec967fc700 1 -- 172.21.15.2:0/3768099615 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_cancelled"]}]=0 v249) v1 ==== 176+0+0 (secure 0 0 0) 0x7feca0135360 con 0x7feca00b5ab0 2023-11-26T07:16:24.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.566+0000 7feca7b9f700 1 -- 172.21.15.2:0/3768099615 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fec8406b740 msgr2=0x7fec8406dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:24.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.566+0000 7feca7b9f700 1 --2- 172.21.15.2:0/3768099615 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fec8406b740 0x7fec8406dc00 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fec9c000f60 tx=0x7fec9c009040 comp rx=0 tx=0).stop 2023-11-26T07:16:24.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.566+0000 7feca7b9f700 1 -- 172.21.15.2:0/3768099615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feca00b5ab0 msgr2=0x7feca01f74d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:24.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.566+0000 7feca7b9f700 1 --2- 172.21.15.2:0/3768099615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feca00b5ab0 0x7feca01f74d0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fec98014040 tx=0x7fec98004ad0 comp rx=0 tx=0).stop 2023-11-26T07:16:24.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.566+0000 7feca7b9f700 1 -- 172.21.15.2:0/3768099615 shutdown_connections 2023-11-26T07:16:24.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.566+0000 7feca7b9f700 1 --2- 172.21.15.2:0/3768099615 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fec8406b740 0x7fec8406dc00 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:24.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.566+0000 7feca7b9f700 1 --2- 172.21.15.2:0/3768099615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feca00b5ab0 0x7feca01f74d0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:24.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.566+0000 7feca7b9f700 1 --2- 172.21.15.2:0/3768099615 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feca006b620 0x7feca006eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:24.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.566+0000 7feca7b9f700 1 --2- 172.21.15.2:0/3768099615 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feca00b4150 0x7feca006f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:24.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.566+0000 7feca7b9f700 1 -- 172.21.15.2:0/3768099615 >> 172.21.15.2:0/3768099615 conn(0x7feca00b2740 msgr2=0x7feca00af0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:24.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.566+0000 7feca7b9f700 1 -- 172.21.15.2:0/3768099615 shutdown_connections 2023-11-26T07:16:24.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.566+0000 7feca7b9f700 1 -- 172.21.15.2:0/3768099615 wait complete. 2023-11-26T07:16:24.583 INFO:tasks.cephfs_test_runner:ensure failure status is shown when clone is cancelled during pending state and validate the reason ... ok 2023-11-26T07:16:24.583 INFO:tasks.cephfs_test_runner:Starting test: test_clone_failure_status_pending_in_progress_complete (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) ensure failure status is not shown when clone is not in failed/cancelled state 2023-11-26T07:16:24.583 INFO:tasks.cephfs_test_runner:test_clone_failure_status_pending_in_progress_complete (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2023-11-26T07:16:24.584 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:16:24.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.714+0000 7fbeffe2e700 1 Processor -- start 2023-11-26T07:16:24.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.715+0000 7fbeffe2e700 1 -- start start 2023-11-26T07:16:24.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.715+0000 7fbeffe2e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbef8143ae0 0x7fbef80b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:24.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.715+0000 7fbeffe2e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbef80722c0 0x7fbef806e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:24.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.715+0000 7fbeffe2e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbef8143ec0 con 0x7fbef81440f0 2023-11-26T07:16:24.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.715+0000 7fbeffe2e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbef80b40a0 con 0x7fbef8143ae0 2023-11-26T07:16:24.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.715+0000 7fbeffe2e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbef80b3ae0 con 0x7fbef80722c0 2023-11-26T07:16:24.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.715+0000 7fbefdbca700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbef8143ae0 0x7fbef80b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:24.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.716+0000 7fbefdbca700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbef8143ae0 0x7fbef80b51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43946/0 (socket says 172.21.15.2:43946) 2023-11-26T07:16:24.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.716+0000 7fbefdbca700 1 -- 172.21.15.2:0/3662785643 learned_addr learned my addr 172.21.15.2:0/3662785643 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:24.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.716+0000 7fbefe3cb700 1 --2- 172.21.15.2:0/3662785643 >> v2:172.21.15.192:3300/0 conn(0x7fbef80722c0 0x7fbef806e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:24.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.716+0000 7fbefdbca700 1 -- 172.21.15.2:0/3662785643 >> v2:172.21.15.192:3300/0 conn(0x7fbef80722c0 msgr2=0x7fbef806e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:24.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.716+0000 7fbefdbca700 1 --2- 172.21.15.2:0/3662785643 >> v2:172.21.15.192:3300/0 conn(0x7fbef80722c0 0x7fbef806e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:24.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.716+0000 7fbefdbca700 1 -- 172.21.15.2:0/3662785643 >> v1:172.21.15.192:6789/0 conn(0x7fbef81440f0 legacy=0x7fbef8071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:24.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.716+0000 7fbefdbca700 1 -- 172.21.15.2:0/3662785643 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef80b3dc0 con 0x7fbef8143ae0 2023-11-26T07:16:24.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.716+0000 7fbefdbca700 1 --2- 172.21.15.2:0/3662785643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbef8143ae0 0x7fbef80b51b0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fbef80747c0 tx=0x7fbef4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec79c1caa96068bc server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:24.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.716+0000 7fbefcbc8700 1 -- 172.21.15.2:0/3662785643 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef4004230 con 0x7fbef8143ae0 2023-11-26T07:16:24.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.716+0000 7fbefcbc8700 1 -- 172.21.15.2:0/3662785643 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef4004390 con 0x7fbef8143ae0 2023-11-26T07:16:24.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.716+0000 7fbefcbc8700 1 -- 172.21.15.2:0/3662785643 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef40036a0 con 0x7fbef8143ae0 2023-11-26T07:16:24.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.717+0000 7fbeffe2e700 1 -- 172.21.15.2:0/3662785643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbef8143ae0 msgr2=0x7fbef80b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:24.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.717+0000 7fbeffe2e700 1 --2- 172.21.15.2:0/3662785643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbef8143ae0 0x7fbef80b51b0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fbef80747c0 tx=0x7fbef4009bd0 comp rx=0 tx=0).stop 2023-11-26T07:16:24.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.717+0000 7fbeffe2e700 1 -- 172.21.15.2:0/3662785643 shutdown_connections 2023-11-26T07:16:24.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.717+0000 7fbeffe2e700 1 --2- 172.21.15.2:0/3662785643 >> v2:172.21.15.192:3300/0 conn(0x7fbef80722c0 0x7fbef806e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:24.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.717+0000 7fbeffe2e700 1 --2- 172.21.15.2:0/3662785643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbef8143ae0 0x7fbef80b51b0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:24.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.717+0000 7fbeffe2e700 1 -- 172.21.15.2:0/3662785643 >> 172.21.15.2:0/3662785643 conn(0x7fbef80b2740 msgr2=0x7fbef80b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:24.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.717+0000 7fbeffe2e700 1 -- 172.21.15.2:0/3662785643 shutdown_connections 2023-11-26T07:16:24.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.717+0000 7fbeffe2e700 1 -- 172.21.15.2:0/3662785643 wait complete. 2023-11-26T07:16:24.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.718+0000 7fbeffe2e700 1 Processor -- start 2023-11-26T07:16:24.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.718+0000 7fbeffe2e700 1 -- start start 2023-11-26T07:16:24.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.719+0000 7fbeffe2e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbef80722c0 0x7fbef8153e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:24.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.719+0000 7fbeffe2e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbef8143ae0 0x7fbef81528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:24.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.719+0000 7fbeffe2e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbef81440f0 0x7fbef8152df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:24.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.719+0000 7fbeffe2e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef815b620 con 0x7fbef80722c0 2023-11-26T07:16:24.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.719+0000 7fbeffe2e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef812c040 con 0x7fbef81440f0 2023-11-26T07:16:24.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.719+0000 7fbeffe2e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef812c320 con 0x7fbef8143ae0 2023-11-26T07:16:24.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.719+0000 7fbefdbca700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbef80722c0 0x7fbef8153e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:24.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.719+0000 7fbefdbca700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbef80722c0 0x7fbef8153e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43952/0 (socket says 172.21.15.2:43952) 2023-11-26T07:16:24.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.719+0000 7fbefdbca700 1 -- 172.21.15.2:0/1906827315 learned_addr learned my addr 172.21.15.2:0/1906827315 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:24.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.719+0000 7fbefe3cb700 1 --2- 172.21.15.2:0/1906827315 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbef81440f0 0x7fbef8152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:24.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.719+0000 7fbefd3c9700 1 --2- 172.21.15.2:0/1906827315 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbef8143ae0 0x7fbef81528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:24.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.719+0000 7fbefdbca700 1 -- 172.21.15.2:0/1906827315 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbef8143ae0 msgr2=0x7fbef81528b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:24.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.719+0000 7fbefdbca700 1 --2- 172.21.15.2:0/1906827315 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbef8143ae0 0x7fbef81528b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:24.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.719+0000 7fbefdbca700 1 -- 172.21.15.2:0/1906827315 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbef81440f0 msgr2=0x7fbef8152df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:24.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.719+0000 7fbefdbca700 1 --2- 172.21.15.2:0/1906827315 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbef81440f0 0x7fbef8152df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:24.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.719+0000 7fbefdbca700 1 -- 172.21.15.2:0/1906827315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef4009550 con 0x7fbef80722c0 2023-11-26T07:16:24.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.719+0000 7fbefdbca700 1 --2- 172.21.15.2:0/1906827315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbef80722c0 0x7fbef8153e60 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fbef4009130 tx=0x7fbef4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:24.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.720+0000 7fbeea7fc700 1 -- 172.21.15.2:0/1906827315 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef4003d40 con 0x7fbef80722c0 2023-11-26T07:16:24.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.720+0000 7fbeea7fc700 1 -- 172.21.15.2:0/1906827315 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef401f070 con 0x7fbef80722c0 2023-11-26T07:16:24.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.720+0000 7fbeffe2e700 1 -- 172.21.15.2:0/1906827315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbef812c600 con 0x7fbef80722c0 2023-11-26T07:16:24.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.720+0000 7fbeea7fc700 1 -- 172.21.15.2:0/1906827315 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef4011870 con 0x7fbef80722c0 2023-11-26T07:16:24.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.720+0000 7fbeffe2e700 1 -- 172.21.15.2:0/1906827315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbef815b2f0 con 0x7fbef80722c0 2023-11-26T07:16:24.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.721+0000 7fbeffe2e700 1 -- 172.21.15.2:0/1906827315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbef8068670 con 0x7fbef80722c0 2023-11-26T07:16:24.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.721+0000 7fbeea7fc700 1 -- 172.21.15.2:0/1906827315 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7fbef4021030 con 0x7fbef80722c0 2023-11-26T07:16:24.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.721+0000 7fbeea7fc700 1 --2- 172.21.15.2:0/1906827315 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fbedc06b740 0x7fbedc06dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:24.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.722+0000 7fbeea7fc700 1 -- 172.21.15.2:0/1906827315 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbef40895f0 con 0x7fbef80722c0 2023-11-26T07:16:24.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.722+0000 7fbefd3c9700 1 --2- 172.21.15.2:0/1906827315 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fbedc06b740 0x7fbedc06dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:24.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.722+0000 7fbefd3c9700 1 --2- 172.21.15.2:0/1906827315 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fbedc06b740 0x7fbedc06dc00 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fbef81f5040 tx=0x7fbeec008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:24.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.726+0000 7fbeea7fc700 1 -- 172.21.15.2:0/1906827315 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbef4055f80 con 0x7fbef80722c0 2023-11-26T07:16:24.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.930+0000 7fbeffe2e700 1 -- 172.21.15.2:0/1906827315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbef8144830 con 0x7fbef80722c0 2023-11-26T07:16:24.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.930+0000 7fbeea7fc700 1 -- 172.21.15.2:0/1906827315 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+12936 (secure 0 0 0) 0x7fbef40595a0 con 0x7fbef80722c0 2023-11-26T07:16:24.933 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:16:24.933 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":65,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:16:22.553072+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6835/1251532899":"2023-11-27T07:16:19.546041+0000","172.21.15.2:6833/1251532899":"2023-11-27T07:16:19.546041+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:16:24.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.933+0000 7fbeffe2e700 1 -- 172.21.15.2:0/1906827315 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fbedc06b740 msgr2=0x7fbedc06dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:24.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.933+0000 7fbeffe2e700 1 --2- 172.21.15.2:0/1906827315 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fbedc06b740 0x7fbedc06dc00 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fbef81f5040 tx=0x7fbeec008040 comp rx=0 tx=0).stop 2023-11-26T07:16:24.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.933+0000 7fbeffe2e700 1 -- 172.21.15.2:0/1906827315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbef80722c0 msgr2=0x7fbef8153e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:24.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.933+0000 7fbeffe2e700 1 --2- 172.21.15.2:0/1906827315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbef80722c0 0x7fbef8153e60 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fbef4009130 tx=0x7fbef4004750 comp rx=0 tx=0).stop 2023-11-26T07:16:24.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.933+0000 7fbeffe2e700 1 -- 172.21.15.2:0/1906827315 shutdown_connections 2023-11-26T07:16:24.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.933+0000 7fbeffe2e700 1 --2- 172.21.15.2:0/1906827315 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fbedc06b740 0x7fbedc06dc00 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:24.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.933+0000 7fbeffe2e700 1 --2- 172.21.15.2:0/1906827315 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbef81440f0 0x7fbef8152df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:24.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.933+0000 7fbeffe2e700 1 --2- 172.21.15.2:0/1906827315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbef80722c0 0x7fbef8153e60 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:24.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.933+0000 7fbeffe2e700 1 --2- 172.21.15.2:0/1906827315 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbef8143ae0 0x7fbef81528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:24.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.933+0000 7fbeffe2e700 1 -- 172.21.15.2:0/1906827315 >> 172.21.15.2:0/1906827315 conn(0x7fbef80b2740 msgr2=0x7fbef81420e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:24.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.933+0000 7fbeffe2e700 1 -- 172.21.15.2:0/1906827315 shutdown_connections 2023-11-26T07:16:24.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:24.933+0000 7fbeffe2e700 1 -- 172.21.15.2:0/1906827315 wait complete. 2023-11-26T07:16:24.947 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:11:28.205739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:16:24.948 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:16:25.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.074+0000 7f6d5e83e700 1 Processor -- start 2023-11-26T07:16:25.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.074+0000 7f6d5e83e700 1 -- start start 2023-11-26T07:16:25.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.075+0000 7f6d5e83e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6d580b3ab0 0x7f6d580b4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:25.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.075+0000 7f6d5e83e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d580ce5b0 con 0x7f6d5806f540 2023-11-26T07:16:25.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.075+0000 7f6d5e83e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d58072d70 con 0x7f6d5815add0 2023-11-26T07:16:25.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.075+0000 7f6d5e83e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d580b4f10 con 0x7f6d580b3ab0 2023-11-26T07:16:25.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.075+0000 7f6d5cddb700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6d580b3ab0 0x7f6d580b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:25.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.075+0000 7f6d577fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f6d5806f540 0x7f6d580cea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35172/0 (socket says 172.21.15.2:35172) 2023-11-26T07:16:25.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.075+0000 7f6d5cddb700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6d580b3ab0 0x7f6d580b4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43964/0 (socket says 172.21.15.2:43964) 2023-11-26T07:16:25.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.075+0000 7f6d577fe700 1 -- 172.21.15.2:0/3781615493 learned_addr learned my addr 172.21.15.2:0/3781615493 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:16:25.079 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.076+0000 7f6d5cddb700 1 -- 172.21.15.2:0/3781615493 >> v1:172.21.15.192:6789/0 conn(0x7f6d5815add0 legacy=0x7f6d5806ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:25.079 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.076+0000 7f6d5cddb700 1 -- 172.21.15.2:0/3781615493 >> v1:172.21.15.2:6789/0 conn(0x7f6d5806f540 legacy=0x7f6d580cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:25.079 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.076+0000 7f6d5cddb700 1 -- 172.21.15.2:0/3781615493 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d580b51f0 con 0x7f6d580b3ab0 2023-11-26T07:16:25.079 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.076+0000 7f6d56ffd700 1 -- 172.21.15.2:0/3781615493 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3097135668 0 0) 0x7f6d580ce5b0 con 0x7f6d5806f540 2023-11-26T07:16:25.079 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.076+0000 7f6d5cddb700 1 --2- 172.21.15.2:0/3781615493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d580b3ab0 0x7f6d580b4880 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f6d50009d90 tx=0x7f6d5000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c668663ac680d86a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:25.079 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.076+0000 7f6d56ffd700 1 -- 172.21.15.2:0/3781615493 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5000e070 con 0x7f6d580b3ab0 2023-11-26T07:16:25.079 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.076+0000 7f6d56ffd700 1 -- 172.21.15.2:0/3781615493 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d5000bb90 con 0x7f6d580b3ab0 2023-11-26T07:16:25.079 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.076+0000 7f6d56ffd700 1 -- 172.21.15.2:0/3781615493 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d50003a20 con 0x7f6d580b3ab0 2023-11-26T07:16:25.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.076+0000 7f6d5e83e700 1 -- 172.21.15.2:0/3781615493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d580b3ab0 msgr2=0x7f6d580b4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:25.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.076+0000 7f6d5e83e700 1 --2- 172.21.15.2:0/3781615493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d580b3ab0 0x7f6d580b4880 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f6d50009d90 tx=0x7f6d5000b330 comp rx=0 tx=0).stop 2023-11-26T07:16:25.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.077+0000 7f6d5e83e700 1 -- 172.21.15.2:0/3781615493 shutdown_connections 2023-11-26T07:16:25.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.077+0000 7f6d5e83e700 1 --2- 172.21.15.2:0/3781615493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d580b3ab0 0x7f6d580b4880 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:25.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.077+0000 7f6d5e83e700 1 -- 172.21.15.2:0/3781615493 >> 172.21.15.2:0/3781615493 conn(0x7f6d580b27b0 msgr2=0x7f6d580b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:25.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.077+0000 7f6d5e83e700 1 -- 172.21.15.2:0/3781615493 shutdown_connections 2023-11-26T07:16:25.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.077+0000 7f6d5e83e700 1 -- 172.21.15.2:0/3781615493 wait complete. 2023-11-26T07:16:25.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.078+0000 7f6d5e83e700 1 Processor -- start 2023-11-26T07:16:25.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.079+0000 7f6d5e83e700 1 -- start start 2023-11-26T07:16:25.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.079+0000 7f6d5e83e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d5806f540 0x7f6d581f20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:25.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.079+0000 7f6d5e83e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d580b3ab0 0x7f6d58152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:25.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.079+0000 7f6d5e83e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d5815add0 0x7f6d581f4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:25.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.079+0000 7f6d5e83e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d581f5630 con 0x7f6d5815add0 2023-11-26T07:16:25.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.079+0000 7f6d5e83e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d581f15e0 con 0x7f6d5806f540 2023-11-26T07:16:25.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.079+0000 7f6d5e83e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d581f18c0 con 0x7f6d580b3ab0 2023-11-26T07:16:25.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.080+0000 7f6d5cddb700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d5815add0 0x7f6d581f4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:25.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.080+0000 7f6d5cddb700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d5815add0 0x7f6d581f4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43970/0 (socket says 172.21.15.2:43970) 2023-11-26T07:16:25.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.080+0000 7f6d5cddb700 1 -- 172.21.15.2:0/4259690872 learned_addr learned my addr 172.21.15.2:0/4259690872 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:25.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.080+0000 7f6d577fe700 1 --2- 172.21.15.2:0/4259690872 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d580b3ab0 0x7f6d58152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:25.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.080+0000 7f6d57fff700 1 --2- 172.21.15.2:0/4259690872 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d5806f540 0x7f6d581f20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:25.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.080+0000 7f6d5cddb700 1 -- 172.21.15.2:0/4259690872 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d580b3ab0 msgr2=0x7f6d58152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:25.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.080+0000 7f6d5cddb700 1 --2- 172.21.15.2:0/4259690872 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d580b3ab0 0x7f6d58152990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:25.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.080+0000 7f6d5cddb700 1 -- 172.21.15.2:0/4259690872 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d5806f540 msgr2=0x7f6d581f20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:25.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.080+0000 7f6d5cddb700 1 --2- 172.21.15.2:0/4259690872 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d5806f540 0x7f6d581f20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:25.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.080+0000 7f6d5cddb700 1 -- 172.21.15.2:0/4259690872 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d50009a70 con 0x7f6d5815add0 2023-11-26T07:16:25.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.080+0000 7f6d5cddb700 1 --2- 172.21.15.2:0/4259690872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d5815add0 0x7f6d581f4ac0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f6d58070640 tx=0x7f6d50004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:25.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.080+0000 7f6d54ff9700 1 -- 172.21.15.2:0/4259690872 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d50012630 con 0x7f6d5815add0 2023-11-26T07:16:25.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.080+0000 7f6d54ff9700 1 -- 172.21.15.2:0/4259690872 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d500127b0 con 0x7f6d5815add0 2023-11-26T07:16:25.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.080+0000 7f6d5e83e700 1 -- 172.21.15.2:0/4259690872 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d581f1ba0 con 0x7f6d5815add0 2023-11-26T07:16:25.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.080+0000 7f6d54ff9700 1 -- 172.21.15.2:0/4259690872 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d50012b60 con 0x7f6d5815add0 2023-11-26T07:16:25.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.080+0000 7f6d5e83e700 1 -- 172.21.15.2:0/4259690872 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d580c6900 con 0x7f6d5815add0 2023-11-26T07:16:25.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.081+0000 7f6d5e83e700 1 -- 172.21.15.2:0/4259690872 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d58075480 con 0x7f6d5815add0 2023-11-26T07:16:25.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.082+0000 7f6d54ff9700 1 -- 172.21.15.2:0/4259690872 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f6d50012cc0 con 0x7f6d5815add0 2023-11-26T07:16:25.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.082+0000 7f6d54ff9700 1 --2- 172.21.15.2:0/4259690872 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6d4406b740 0x7f6d4406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:25.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.082+0000 7f6d54ff9700 1 -- 172.21.15.2:0/4259690872 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6d5008a580 con 0x7f6d5815add0 2023-11-26T07:16:25.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.083+0000 7f6d57fff700 1 --2- 172.21.15.2:0/4259690872 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6d4406b740 0x7f6d4406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:25.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.083+0000 7f6d57fff700 1 --2- 172.21.15.2:0/4259690872 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6d4406b740 0x7f6d4406dc00 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6d48004f30 tx=0x7f6d48009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:25.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.087+0000 7f6d54ff9700 1 -- 172.21.15.2:0/4259690872 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6d5005ab70 con 0x7f6d5815add0 2023-11-26T07:16:25.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.288+0000 7f6d5e83e700 1 -- 172.21.15.2:0/4259690872 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6d581f1d80 con 0x7f6d5815add0 2023-11-26T07:16:25.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.288+0000 7f6d54ff9700 1 -- 172.21.15.2:0/4259690872 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v65) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6d5005a700 con 0x7f6d5815add0 2023-11-26T07:16:25.290 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-26T07:16:25.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.290+0000 7f6d5e83e700 1 -- 172.21.15.2:0/4259690872 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6d4406b740 msgr2=0x7f6d4406dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:25.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.290+0000 7f6d5e83e700 1 --2- 172.21.15.2:0/4259690872 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6d4406b740 0x7f6d4406dc00 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6d48004f30 tx=0x7f6d48009040 comp rx=0 tx=0).stop 2023-11-26T07:16:25.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.290+0000 7f6d5e83e700 1 -- 172.21.15.2:0/4259690872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d5815add0 msgr2=0x7f6d581f4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:25.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.290+0000 7f6d5e83e700 1 --2- 172.21.15.2:0/4259690872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d5815add0 0x7f6d581f4ac0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f6d58070640 tx=0x7f6d50004ad0 comp rx=0 tx=0).stop 2023-11-26T07:16:25.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.290+0000 7f6d5e83e700 1 -- 172.21.15.2:0/4259690872 shutdown_connections 2023-11-26T07:16:25.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.290+0000 7f6d5e83e700 1 --2- 172.21.15.2:0/4259690872 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6d4406b740 0x7f6d4406dc00 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:25.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.290+0000 7f6d5e83e700 1 --2- 172.21.15.2:0/4259690872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d5815add0 0x7f6d581f4ac0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:25.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.290+0000 7f6d5e83e700 1 --2- 172.21.15.2:0/4259690872 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d5806f540 0x7f6d581f20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:25.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.290+0000 7f6d5e83e700 1 --2- 172.21.15.2:0/4259690872 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d580b3ab0 0x7f6d58152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:25.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.290+0000 7f6d5e83e700 1 -- 172.21.15.2:0/4259690872 >> 172.21.15.2:0/4259690872 conn(0x7f6d580b27b0 msgr2=0x7f6d580b1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:25.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.290+0000 7f6d5e83e700 1 -- 172.21.15.2:0/4259690872 shutdown_connections 2023-11-26T07:16:25.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.290+0000 7f6d5e83e700 1 -- 172.21.15.2:0/4259690872 wait complete. 2023-11-26T07:16:25.305 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_in_progress_complete' 2023-11-26T07:16:25.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.428+0000 7ff20ab0a700 1 Processor -- start 2023-11-26T07:16:25.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.428+0000 7ff20ab0a700 1 -- start start 2023-11-26T07:16:25.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.429+0000 7ff20ab0a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff2040722c0 0x7ff2040b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:25.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.429+0000 7ff20ab0a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff2041440f0 0x7ff20406e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:25.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.429+0000 7ff20ab0a700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff204143ec0 con 0x7ff204143ae0 2023-11-26T07:16:25.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.429+0000 7ff20ab0a700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2040b40a0 con 0x7ff2041440f0 2023-11-26T07:16:25.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.429+0000 7ff20ab0a700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2040b3ae0 con 0x7ff2040722c0 2023-11-26T07:16:25.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.429+0000 7ff2090a7700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff2041440f0 0x7ff20406e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:25.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.429+0000 7ff2090a7700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff2041440f0 0x7ff20406e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43978/0 (socket says 172.21.15.2:43978) 2023-11-26T07:16:25.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.429+0000 7ff2090a7700 1 -- 172.21.15.2:0/1139831119 learned_addr learned my addr 172.21.15.2:0/1139831119 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:25.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.429+0000 7ff2088a6700 1 --1- 172.21.15.2:0/1139831119 >> v1:172.21.15.2:6789/0 conn(0x7ff204143ae0 0x7ff204071bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35184/0 (socket says 172.21.15.2:35184) 2023-11-26T07:16:25.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.430+0000 7ff203fff700 1 --2- 172.21.15.2:0/1139831119 >> v2:172.21.15.192:3300/0 conn(0x7ff2040722c0 0x7ff2040b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:25.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.430+0000 7ff2090a7700 1 -- 172.21.15.2:0/1139831119 >> v2:172.21.15.192:3300/0 conn(0x7ff2040722c0 msgr2=0x7ff2040b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:25.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.430+0000 7ff2090a7700 1 --2- 172.21.15.2:0/1139831119 >> v2:172.21.15.192:3300/0 conn(0x7ff2040722c0 0x7ff2040b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:25.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.430+0000 7ff2090a7700 1 -- 172.21.15.2:0/1139831119 >> v1:172.21.15.2:6789/0 conn(0x7ff204143ae0 legacy=0x7ff204071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:25.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.430+0000 7ff2090a7700 1 -- 172.21.15.2:0/1139831119 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2040b3dc0 con 0x7ff2041440f0 2023-11-26T07:16:25.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.430+0000 7ff2037fe700 1 -- 172.21.15.2:0/1139831119 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 98621541 0 0) 0x7ff204143ec0 con 0x7ff204143ae0 2023-11-26T07:16:25.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.430+0000 7ff2090a7700 1 --2- 172.21.15.2:0/1139831119 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2041440f0 0x7ff20406e510 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7ff2040d1b00 tx=0x7ff1fc00d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bad0080ef444ce26 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:25.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.430+0000 7ff2037fe700 1 -- 172.21.15.2:0/1139831119 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc010070 con 0x7ff2041440f0 2023-11-26T07:16:25.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.430+0000 7ff2037fe700 1 -- 172.21.15.2:0/1139831119 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1fc00dd90 con 0x7ff2041440f0 2023-11-26T07:16:25.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.430+0000 7ff2037fe700 1 -- 172.21.15.2:0/1139831119 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc00b310 con 0x7ff2041440f0 2023-11-26T07:16:25.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.431+0000 7ff20ab0a700 1 -- 172.21.15.2:0/1139831119 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2041440f0 msgr2=0x7ff20406e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:25.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.431+0000 7ff20ab0a700 1 --2- 172.21.15.2:0/1139831119 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2041440f0 0x7ff20406e510 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7ff2040d1b00 tx=0x7ff1fc00d430 comp rx=0 tx=0).stop 2023-11-26T07:16:25.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.431+0000 7ff20ab0a700 1 -- 172.21.15.2:0/1139831119 shutdown_connections 2023-11-26T07:16:25.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.431+0000 7ff20ab0a700 1 --2- 172.21.15.2:0/1139831119 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2041440f0 0x7ff20406e510 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:25.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.431+0000 7ff20ab0a700 1 --2- 172.21.15.2:0/1139831119 >> v2:172.21.15.192:3300/0 conn(0x7ff2040722c0 0x7ff2040b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:25.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.431+0000 7ff20ab0a700 1 -- 172.21.15.2:0/1139831119 >> 172.21.15.2:0/1139831119 conn(0x7ff2040b2740 msgr2=0x7ff2040b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:25.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.431+0000 7ff20ab0a700 1 -- 172.21.15.2:0/1139831119 shutdown_connections 2023-11-26T07:16:25.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.431+0000 7ff20ab0a700 1 -- 172.21.15.2:0/1139831119 wait complete. 2023-11-26T07:16:25.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.432+0000 7ff20ab0a700 1 Processor -- start 2023-11-26T07:16:25.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.432+0000 7ff20ab0a700 1 -- start start 2023-11-26T07:16:25.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.433+0000 7ff20ab0a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2040722c0 0x7ff20414c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:25.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.433+0000 7ff20ab0a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff204143ae0 0x7ff20415c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:25.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.433+0000 7ff20ab0a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2041440f0 0x7ff2041410d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:25.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.433+0000 7ff20ab0a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2040cf4e0 con 0x7ff2041440f0 2023-11-26T07:16:25.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.433+0000 7ff20ab0a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2040cf7c0 con 0x7ff2040722c0 2023-11-26T07:16:25.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.433+0000 7ff20ab0a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2040cfaa0 con 0x7ff204143ae0 2023-11-26T07:16:25.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.433+0000 7ff2090a7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2041440f0 0x7ff2041410d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:25.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.433+0000 7ff2090a7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2041440f0 0x7ff2041410d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43984/0 (socket says 172.21.15.2:43984) 2023-11-26T07:16:25.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.433+0000 7ff2090a7700 1 -- 172.21.15.2:0/2880732815 learned_addr learned my addr 172.21.15.2:0/2880732815 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:25.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.433+0000 7ff203fff700 1 --2- 172.21.15.2:0/2880732815 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff204143ae0 0x7ff20415c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:25.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.433+0000 7ff2088a6700 1 --2- 172.21.15.2:0/2880732815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2040722c0 0x7ff20414c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:25.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.433+0000 7ff2090a7700 1 -- 172.21.15.2:0/2880732815 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff204143ae0 msgr2=0x7ff20415c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:25.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.433+0000 7ff2090a7700 1 --2- 172.21.15.2:0/2880732815 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff204143ae0 0x7ff20415c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:25.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.433+0000 7ff2090a7700 1 -- 172.21.15.2:0/2880732815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2040722c0 msgr2=0x7ff20414c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:25.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.433+0000 7ff2090a7700 1 --2- 172.21.15.2:0/2880732815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2040722c0 0x7ff20414c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:25.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.433+0000 7ff2090a7700 1 -- 172.21.15.2:0/2880732815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1fc00bd40 con 0x7ff2041440f0 2023-11-26T07:16:25.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.433+0000 7ff2088a6700 1 --2- 172.21.15.2:0/2880732815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2040722c0 0x7ff20414c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:16:25.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.433+0000 7ff2090a7700 1 --2- 172.21.15.2:0/2880732815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2041440f0 0x7ff2041410d0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc00d830 tx=0x7ff1fc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:25.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.434+0000 7ff2017fa700 1 -- 172.21.15.2:0/2880732815 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc00b4c0 con 0x7ff2041440f0 2023-11-26T07:16:25.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.434+0000 7ff2017fa700 1 -- 172.21.15.2:0/2880732815 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1fc00acf0 con 0x7ff2041440f0 2023-11-26T07:16:25.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.434+0000 7ff20ab0a700 1 -- 172.21.15.2:0/2880732815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2040cfd80 con 0x7ff2041440f0 2023-11-26T07:16:25.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.434+0000 7ff2017fa700 1 -- 172.21.15.2:0/2880732815 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc004280 con 0x7ff2041440f0 2023-11-26T07:16:25.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.434+0000 7ff20ab0a700 1 -- 172.21.15.2:0/2880732815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2040cf170 con 0x7ff2041440f0 2023-11-26T07:16:25.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.435+0000 7ff20ab0a700 1 -- 172.21.15.2:0/2880732815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff204068670 con 0x7ff2041440f0 2023-11-26T07:16:25.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.435+0000 7ff2017fa700 1 -- 172.21.15.2:0/2880732815 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7ff1fc0043e0 con 0x7ff2041440f0 2023-11-26T07:16:25.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.435+0000 7ff2017fa700 1 --2- 172.21.15.2:0/2880732815 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff1e806b770 0x7ff1e806dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:25.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.436+0000 7ff2017fa700 1 -- 172.21.15.2:0/2880732815 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff1fc08b350 con 0x7ff2041440f0 2023-11-26T07:16:25.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.436+0000 7ff2088a6700 1 --2- 172.21.15.2:0/2880732815 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff1e806b770 0x7ff1e806dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:25.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.436+0000 7ff2088a6700 1 --2- 172.21.15.2:0/2880732815 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff1e806b770 0x7ff1e806dc30 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff1f8000f60 tx=0x7ff1f8007ca0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:25.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.440+0000 7ff2017fa700 1 -- 172.21.15.2:0/2880732815 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff1fc057e50 con 0x7ff2041440f0 2023-11-26T07:16:25.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:25.726+0000 7ff20ab0a700 1 -- 172.21.15.2:0/2880732815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_in_progress_complete"]} v 0) v1 -- 0x7ff2040b5d20 con 0x7ff2041440f0 2023-11-26T07:16:26.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.569+0000 7ff2017fa700 1 -- 172.21.15.2:0/2880732815 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_in_progress_complete"]}]=0 v251) v1 ==== 190+0+0 (secure 0 0 0) 0x7ff1fc00ae60 con 0x7ff2041440f0 2023-11-26T07:16:26.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.571+0000 7ff20ab0a700 1 -- 172.21.15.2:0/2880732815 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff1e806b770 msgr2=0x7ff1e806dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:26.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.571+0000 7ff20ab0a700 1 --2- 172.21.15.2:0/2880732815 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff1e806b770 0x7ff1e806dc30 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff1f8000f60 tx=0x7ff1f8007ca0 comp rx=0 tx=0).stop 2023-11-26T07:16:26.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.571+0000 7ff20ab0a700 1 -- 172.21.15.2:0/2880732815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2041440f0 msgr2=0x7ff2041410d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:26.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.571+0000 7ff20ab0a700 1 --2- 172.21.15.2:0/2880732815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2041440f0 0x7ff2041410d0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc00d830 tx=0x7ff1fc004ad0 comp rx=0 tx=0).stop 2023-11-26T07:16:26.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.572+0000 7ff20ab0a700 1 -- 172.21.15.2:0/2880732815 shutdown_connections 2023-11-26T07:16:26.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.572+0000 7ff20ab0a700 1 --2- 172.21.15.2:0/2880732815 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff1e806b770 0x7ff1e806dc30 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:26.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.572+0000 7ff20ab0a700 1 --2- 172.21.15.2:0/2880732815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2041440f0 0x7ff2041410d0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:26.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.572+0000 7ff20ab0a700 1 --2- 172.21.15.2:0/2880732815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2040722c0 0x7ff20414c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:26.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.572+0000 7ff20ab0a700 1 --2- 172.21.15.2:0/2880732815 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff204143ae0 0x7ff20415c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:26.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.572+0000 7ff20ab0a700 1 -- 172.21.15.2:0/2880732815 >> 172.21.15.2:0/2880732815 conn(0x7ff2040b2740 msgr2=0x7ff204071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:26.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.572+0000 7ff20ab0a700 1 -- 172.21.15.2:0/2880732815 shutdown_connections 2023-11-26T07:16:26.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.572+0000 7ff20ab0a700 1 -- 172.21.15.2:0/2880732815 wait complete. 2023-11-26T07:16:26.588 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-26T07:16:26.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.721+0000 7f626cad6700 1 Processor -- start 2023-11-26T07:16:26.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.721+0000 7f626cad6700 1 -- start start 2023-11-26T07:16:26.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.722+0000 7f626cad6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f626815bf10 0x7f6268066ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:26.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.722+0000 7f626cad6700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f626806b7c0 0x7f626806bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:26.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.722+0000 7f626cad6700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62680b10c0 con 0x7f62680af980 2023-11-26T07:16:26.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.722+0000 7f626cad6700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f626806c190 con 0x7f626806b7c0 2023-11-26T07:16:26.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.722+0000 7f626cad6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62680af730 con 0x7f626815bf10 2023-11-26T07:16:26.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.722+0000 7f6266d9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f626806b7c0 0x7f626806bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:26.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.722+0000 7f6265d9b700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f62680af980 0x7f62680b1550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35202/0 (socket says 172.21.15.2:35202) 2023-11-26T07:16:26.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.722+0000 7f6265d9b700 1 -- 172.21.15.2:0/1881847552 learned_addr learned my addr 172.21.15.2:0/1881847552 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:16:26.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.722+0000 7f626659c700 1 --2- 172.21.15.2:0/1881847552 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f626815bf10 0x7f6268066ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:26.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.722+0000 7f6266d9d700 1 -- 172.21.15.2:0/1881847552 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f626815bf10 msgr2=0x7f6268066ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:26.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.722+0000 7f6266d9d700 1 --2- 172.21.15.2:0/1881847552 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f626815bf10 0x7f6268066ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:26.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.722+0000 7f6266d9d700 1 -- 172.21.15.2:0/1881847552 >> v1:172.21.15.2:6789/0 conn(0x7f62680af980 legacy=0x7f62680b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:26.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.722+0000 7f6266d9d700 1 -- 172.21.15.2:0/1881847552 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62680b1c60 con 0x7f626806b7c0 2023-11-26T07:16:26.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.722+0000 7f626559a700 1 -- 172.21.15.2:0/1881847552 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1016596711 0 0) 0x7f62680b10c0 con 0x7f62680af980 2023-11-26T07:16:26.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.722+0000 7f6266d9d700 1 --2- 172.21.15.2:0/1881847552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f626806b7c0 0x7f626806bc50 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f6260009d90 tx=0x7f626000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd25349c76b0be11 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:26.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.723+0000 7f626559a700 1 -- 172.21.15.2:0/1881847552 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626000e070 con 0x7f626806b7c0 2023-11-26T07:16:26.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.723+0000 7f626559a700 1 -- 172.21.15.2:0/1881847552 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626000bbd0 con 0x7f626806b7c0 2023-11-26T07:16:26.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.723+0000 7f626559a700 1 -- 172.21.15.2:0/1881847552 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6260012430 con 0x7f626806b7c0 2023-11-26T07:16:26.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.723+0000 7f626cad6700 1 -- 172.21.15.2:0/1881847552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f626806b7c0 msgr2=0x7f626806bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:26.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.723+0000 7f626cad6700 1 --2- 172.21.15.2:0/1881847552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f626806b7c0 0x7f626806bc50 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f6260009d90 tx=0x7f626000b330 comp rx=0 tx=0).stop 2023-11-26T07:16:26.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.723+0000 7f626cad6700 1 -- 172.21.15.2:0/1881847552 shutdown_connections 2023-11-26T07:16:26.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.723+0000 7f626cad6700 1 --2- 172.21.15.2:0/1881847552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f626806b7c0 0x7f626806bc50 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:26.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.723+0000 7f626cad6700 1 --2- 172.21.15.2:0/1881847552 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f626815bf10 0x7f6268066ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:26.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.723+0000 7f626cad6700 1 -- 172.21.15.2:0/1881847552 >> 172.21.15.2:0/1881847552 conn(0x7f62680b5070 msgr2=0x7f62680b5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:26.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.723+0000 7f626cad6700 1 -- 172.21.15.2:0/1881847552 shutdown_connections 2023-11-26T07:16:26.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.723+0000 7f626cad6700 1 -- 172.21.15.2:0/1881847552 wait complete. 2023-11-26T07:16:26.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.725+0000 7f626cad6700 1 Processor -- start 2023-11-26T07:16:26.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.725+0000 7f626cad6700 1 -- start start 2023-11-26T07:16:26.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.725+0000 7f626cad6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f626806b7c0 0x7f6268155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:26.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.725+0000 7f626cad6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f62680af980 0x7f6268152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:26.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.725+0000 7f626cad6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f626815bf10 0x7f626814b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:26.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.725+0000 7f626cad6700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6268156240 con 0x7f626806b7c0 2023-11-26T07:16:26.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.725+0000 7f626cad6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62681f70f0 con 0x7f626815bf10 2023-11-26T07:16:26.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.725+0000 7f626cad6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62681f73d0 con 0x7f62680af980 2023-11-26T07:16:26.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.725+0000 7f626659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f626806b7c0 0x7f6268155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:26.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.725+0000 7f626659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f626806b7c0 0x7f6268155c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43994/0 (socket says 172.21.15.2:43994) 2023-11-26T07:16:26.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.725+0000 7f626659c700 1 -- 172.21.15.2:0/2732501220 learned_addr learned my addr 172.21.15.2:0/2732501220 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:26.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.726+0000 7f6265d9b700 1 --2- 172.21.15.2:0/2732501220 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f62680af980 0x7f6268152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:26.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.726+0000 7f6266d9d700 1 --2- 172.21.15.2:0/2732501220 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f626815bf10 0x7f626814b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:26.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.726+0000 7f626659c700 1 -- 172.21.15.2:0/2732501220 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f62680af980 msgr2=0x7f6268152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:26.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.726+0000 7f626659c700 1 --2- 172.21.15.2:0/2732501220 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f62680af980 0x7f6268152580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:26.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.726+0000 7f626659c700 1 -- 172.21.15.2:0/2732501220 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f626815bf10 msgr2=0x7f626814b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:26.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.726+0000 7f626659c700 1 --2- 172.21.15.2:0/2732501220 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f626815bf10 0x7f626814b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:26.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.726+0000 7f626659c700 1 -- 172.21.15.2:0/2732501220 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6260009a70 con 0x7f626806b7c0 2023-11-26T07:16:26.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.726+0000 7f6266d9d700 1 --2- 172.21.15.2:0/2732501220 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f626815bf10 0x7f626814b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:16:26.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.726+0000 7f626659c700 1 --2- 172.21.15.2:0/2732501220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f626806b7c0 0x7f6268155c60 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f625800e810 tx=0x7f625800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:26.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.726+0000 7f6256ffd700 1 -- 172.21.15.2:0/2732501220 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6258013610 con 0x7f626806b7c0 2023-11-26T07:16:26.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.726+0000 7f6256ffd700 1 -- 172.21.15.2:0/2732501220 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6258013770 con 0x7f626806b7c0 2023-11-26T07:16:26.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.726+0000 7f6256ffd700 1 -- 172.21.15.2:0/2732501220 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6258013b20 con 0x7f626806b7c0 2023-11-26T07:16:26.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.726+0000 7f626cad6700 1 -- 172.21.15.2:0/2732501220 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62681f76b0 con 0x7f626806b7c0 2023-11-26T07:16:26.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.726+0000 7f626cad6700 1 -- 172.21.15.2:0/2732501220 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62681f7eb0 con 0x7f626806b7c0 2023-11-26T07:16:26.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.727+0000 7f626cad6700 1 -- 172.21.15.2:0/2732501220 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62680672b0 con 0x7f626806b7c0 2023-11-26T07:16:26.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.728+0000 7f6256ffd700 1 -- 172.21.15.2:0/2732501220 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f6258013c80 con 0x7f626806b7c0 2023-11-26T07:16:26.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.728+0000 7f6256ffd700 1 --2- 172.21.15.2:0/2732501220 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f624806b740 0x7f624806dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:26.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.728+0000 7f6256ffd700 1 -- 172.21.15.2:0/2732501220 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6258087c90 con 0x7f626806b7c0 2023-11-26T07:16:26.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.728+0000 7f6265d9b700 1 --2- 172.21.15.2:0/2732501220 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f624806b740 0x7f624806dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:26.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.729+0000 7f6265d9b700 1 --2- 172.21.15.2:0/2732501220 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f624806b740 0x7f624806dc00 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f625c007fd0 tx=0x7f625c007de0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:26.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.733+0000 7f6256ffd700 1 -- 172.21.15.2:0/2732501220 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f62580545a0 con 0x7f626806b7c0 2023-11-26T07:16:26.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.938+0000 7f626cad6700 1 -- 172.21.15.2:0/2732501220 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6268075480 con 0x7f626806b7c0 2023-11-26T07:16:26.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.941+0000 7f6256ffd700 1 -- 172.21.15.2:0/2732501220 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6258057bc0 con 0x7f626806b7c0 2023-11-26T07:16:26.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.943+0000 7f626cad6700 1 -- 172.21.15.2:0/2732501220 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f624806b740 msgr2=0x7f624806dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:26.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.943+0000 7f626cad6700 1 --2- 172.21.15.2:0/2732501220 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f624806b740 0x7f624806dc00 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f625c007fd0 tx=0x7f625c007de0 comp rx=0 tx=0).stop 2023-11-26T07:16:26.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.943+0000 7f626cad6700 1 -- 172.21.15.2:0/2732501220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f626806b7c0 msgr2=0x7f6268155c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:26.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.943+0000 7f626cad6700 1 --2- 172.21.15.2:0/2732501220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f626806b7c0 0x7f6268155c60 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f625800e810 tx=0x7f625800eb20 comp rx=0 tx=0).stop 2023-11-26T07:16:26.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.943+0000 7f626cad6700 1 -- 172.21.15.2:0/2732501220 shutdown_connections 2023-11-26T07:16:26.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.943+0000 7f626cad6700 1 --2- 172.21.15.2:0/2732501220 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f624806b740 0x7f624806dc00 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:26.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.943+0000 7f626cad6700 1 --2- 172.21.15.2:0/2732501220 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f626815bf10 0x7f626814b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:26.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.943+0000 7f626cad6700 1 --2- 172.21.15.2:0/2732501220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f626806b7c0 0x7f6268155c60 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:26.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.943+0000 7f626cad6700 1 --2- 172.21.15.2:0/2732501220 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f62680af980 0x7f6268152580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:26.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.943+0000 7f626cad6700 1 -- 172.21.15.2:0/2732501220 >> 172.21.15.2:0/2732501220 conn(0x7f62680b5070 msgr2=0x7f626815ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:26.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.943+0000 7f626cad6700 1 -- 172.21.15.2:0/2732501220 shutdown_connections 2023-11-26T07:16:26.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:26.943+0000 7f626cad6700 1 -- 172.21.15.2:0/2732501220 wait complete. 2023-11-26T07:16:26.957 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-26T07:16:26.957 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:16:27.004 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:16:27.055 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-26T07:16:27.055 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:27.055 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:27.072 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19704 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-26T07:16:27.073 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:16:27.073 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:27.092 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284224k,nr_inodes=4071056,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3837 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260544k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-26T07:16:27.093 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:27.093 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:27.129 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19704 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-26T07:16:27.129 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:16:27.129 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:27.151 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284224k,nr_inodes=4071056,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3837 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260544k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-26T07:16:27.151 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-26T07:16:27.152 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:16:27.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.293+0000 7fcdb0811700 1 Processor -- start 2023-11-26T07:16:27.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.293+0000 7fcdb0811700 1 -- start start 2023-11-26T07:16:27.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.294+0000 7fcdb0811700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fcdac0cf2b0 0x7fcdac15c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:27.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.294+0000 7fcdb0811700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdac0ce5c0 0x7fcdac0cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:27.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.294+0000 7fcdb0811700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdac0d0a90 con 0x7fcdac15bde0 2023-11-26T07:16:27.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.294+0000 7fcdb0811700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdac0cefb0 con 0x7fcdac0cf2b0 2023-11-26T07:16:27.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.294+0000 7fcdb0811700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac06ee10 con 0x7fcdac0ce5c0 2023-11-26T07:16:27.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.294+0000 7fcdaad9d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdac0ce5c0 0x7fcdac0cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:27.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.294+0000 7fcda9d9b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fcdac0cf2b0 0x7fcdac15c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:27.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.294+0000 7fcdaad9d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdac0ce5c0 0x7fcdac0cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.2:42086/0 (socket says 172.21.15.2:42086) 2023-11-26T07:16:27.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.294+0000 7fcdaad9d700 1 -- 172.21.15.2:0/2530088834 learned_addr learned my addr 172.21.15.2:0/2530088834 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:27.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.294+0000 7fcda9d9b700 1 -- 172.21.15.2:0/2530088834 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdac0ce5c0 msgr2=0x7fcdac0cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:27.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.294+0000 7fcda9d9b700 1 --2- 172.21.15.2:0/2530088834 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdac0ce5c0 0x7fcdac0cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:27.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.294+0000 7fcda9d9b700 1 -- 172.21.15.2:0/2530088834 >> v1:172.21.15.192:6789/0 conn(0x7fcdac15bde0 legacy=0x7fcdac0d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:27.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.294+0000 7fcda959a700 1 -- 172.21.15.2:0/2530088834 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2928475639 0 0) 0x7fcdac0d0a90 con 0x7fcdac15bde0 2023-11-26T07:16:27.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.294+0000 7fcda9d9b700 1 -- 172.21.15.2:0/2530088834 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdac06f0f0 con 0x7fcdac0cf2b0 2023-11-26T07:16:27.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.294+0000 7fcdaad9d700 1 --2- 172.21.15.2:0/2530088834 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdac0ce5c0 0x7fcdac0cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:16:27.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.295+0000 7fcda9d9b700 1 --2- 172.21.15.2:0/2530088834 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdac0cf2b0 0x7fcdac15c1c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fcda0009840 tx=0x7fcda0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1557ca4217e366d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:27.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.295+0000 7fcda959a700 1 -- 172.21.15.2:0/2530088834 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda0011830 con 0x7fcdac0cf2b0 2023-11-26T07:16:27.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.295+0000 7fcda959a700 1 -- 172.21.15.2:0/2530088834 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda0011990 con 0x7fcdac0cf2b0 2023-11-26T07:16:27.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.295+0000 7fcda959a700 1 -- 172.21.15.2:0/2530088834 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda0011d20 con 0x7fcdac0cf2b0 2023-11-26T07:16:27.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.295+0000 7fcdb0811700 1 -- 172.21.15.2:0/2530088834 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdac0cf2b0 msgr2=0x7fcdac15c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:27.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.295+0000 7fcdb0811700 1 --2- 172.21.15.2:0/2530088834 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdac0cf2b0 0x7fcdac15c1c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fcda0009840 tx=0x7fcda0009b50 comp rx=0 tx=0).stop 2023-11-26T07:16:27.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.295+0000 7fcdb0811700 1 -- 172.21.15.2:0/2530088834 shutdown_connections 2023-11-26T07:16:27.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.295+0000 7fcdb0811700 1 --2- 172.21.15.2:0/2530088834 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdac0ce5c0 0x7fcdac0cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:27.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.295+0000 7fcdb0811700 1 --2- 172.21.15.2:0/2530088834 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdac0cf2b0 0x7fcdac15c1c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:27.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.295+0000 7fcdb0811700 1 -- 172.21.15.2:0/2530088834 >> 172.21.15.2:0/2530088834 conn(0x7fcdac0b3720 msgr2=0x7fcdac0b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:27.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.295+0000 7fcdb0811700 1 -- 172.21.15.2:0/2530088834 shutdown_connections 2023-11-26T07:16:27.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.295+0000 7fcdb0811700 1 -- 172.21.15.2:0/2530088834 wait complete. 2023-11-26T07:16:27.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.297+0000 7fcdb0811700 1 Processor -- start 2023-11-26T07:16:27.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.297+0000 7fcdb0811700 1 -- start start 2023-11-26T07:16:27.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.298+0000 7fcdb0811700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdac0ce5c0 0x7fcdac0b5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:27.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.298+0000 7fcdb0811700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdac0cf2b0 0x7fcdac1f2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:27.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.298+0000 7fcdb0811700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdac15bde0 0x7fcdac0b7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:27.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.298+0000 7fcdb0811700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac0c7ef0 con 0x7fcdac15bde0 2023-11-26T07:16:27.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.298+0000 7fcdb0811700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac1f2c80 con 0x7fcdac0cf2b0 2023-11-26T07:16:27.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.298+0000 7fcdb0811700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac0c87d0 con 0x7fcdac0ce5c0 2023-11-26T07:16:27.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.298+0000 7fcdaad9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdac15bde0 0x7fcdac0b7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:27.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.298+0000 7fcdaad9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdac15bde0 0x7fcdac0b7050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44012/0 (socket says 172.21.15.2:44012) 2023-11-26T07:16:27.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.298+0000 7fcdaad9d700 1 -- 172.21.15.2:0/2759446480 learned_addr learned my addr 172.21.15.2:0/2759446480 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:27.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.298+0000 7fcdaa59c700 1 --2- 172.21.15.2:0/2759446480 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdac0ce5c0 0x7fcdac0b5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:27.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.298+0000 7fcda9d9b700 1 --2- 172.21.15.2:0/2759446480 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdac0cf2b0 0x7fcdac1f2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:27.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.298+0000 7fcdaad9d700 1 -- 172.21.15.2:0/2759446480 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdac0ce5c0 msgr2=0x7fcdac0b5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:27.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.298+0000 7fcdaad9d700 1 --2- 172.21.15.2:0/2759446480 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdac0ce5c0 0x7fcdac0b5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:27.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.298+0000 7fcdaad9d700 1 -- 172.21.15.2:0/2759446480 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdac0cf2b0 msgr2=0x7fcdac1f2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:27.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.298+0000 7fcdaad9d700 1 --2- 172.21.15.2:0/2759446480 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdac0cf2b0 0x7fcdac1f2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:27.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.298+0000 7fcdaad9d700 1 -- 172.21.15.2:0/2759446480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda4009b30 con 0x7fcdac15bde0 2023-11-26T07:16:27.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.298+0000 7fcdaad9d700 1 --2- 172.21.15.2:0/2759446480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdac15bde0 0x7fcdac0b7050 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fcda400efc0 tx=0x7fcda400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:27.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.298+0000 7fcd9affd700 1 -- 172.21.15.2:0/2759446480 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda4018070 con 0x7fcdac15bde0 2023-11-26T07:16:27.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.298+0000 7fcd9affd700 1 -- 172.21.15.2:0/2759446480 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda400f040 con 0x7fcdac15bde0 2023-11-26T07:16:27.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.298+0000 7fcdb0811700 1 -- 172.21.15.2:0/2759446480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcda00094a0 con 0x7fcdac15bde0 2023-11-26T07:16:27.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.298+0000 7fcd9affd700 1 -- 172.21.15.2:0/2759446480 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda4003c20 con 0x7fcdac15bde0 2023-11-26T07:16:27.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.299+0000 7fcdb0811700 1 -- 172.21.15.2:0/2759446480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdac15d670 con 0x7fcdac15bde0 2023-11-26T07:16:27.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.300+0000 7fcdb0811700 1 -- 172.21.15.2:0/2759446480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdac068670 con 0x7fcdac15bde0 2023-11-26T07:16:27.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.300+0000 7fcd9affd700 1 -- 172.21.15.2:0/2759446480 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7fcda400c880 con 0x7fcdac15bde0 2023-11-26T07:16:27.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.300+0000 7fcd9affd700 1 --2- 172.21.15.2:0/2759446480 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fcd8c06b740 0x7fcd8c06dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:27.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.300+0000 7fcd9affd700 1 -- 172.21.15.2:0/2759446480 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fcda4087fa0 con 0x7fcdac15bde0 2023-11-26T07:16:27.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.301+0000 7fcdaa59c700 1 --2- 172.21.15.2:0/2759446480 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fcd8c06b740 0x7fcd8c06dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:27.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.301+0000 7fcdaa59c700 1 --2- 172.21.15.2:0/2759446480 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fcd8c06b740 0x7fcd8c06dc00 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c000f60 tx=0x7fcd9c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:27.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.305+0000 7fcd9affd700 1 -- 172.21.15.2:0/2759446480 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcda4054b00 con 0x7fcdac15bde0 2023-11-26T07:16:27.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.551+0000 7fcdb0811700 1 -- 172.21.15.2:0/2759446480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcdac067a50 con 0x7fcdac15bde0 2023-11-26T07:16:27.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.551+0000 7fcd9affd700 1 -- 172.21.15.2:0/2759446480 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+3699 (secure 0 0 0) 0x7fcda4058120 con 0x7fcdac15bde0 2023-11-26T07:16:27.553 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:16:27.553 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":39,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5384,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3283211322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3283211322},{"type":"v1","addr":"172.21.15.192:6837","nonce":3283211322}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":5833,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/4149545589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":4149545589},{"type":"v1","addr":"172.21.15.192:6836","nonce":4149545589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":6171,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/1422633843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1422633843},{"type":"v1","addr":"172.21.15.2:6834","nonce":1422633843}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":6621,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/4293180348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":4293180348},{"type":"v1","addr":"172.21.15.2:6835","nonce":4293180348}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39}],"filesystems":[]} 2023-11-26T07:16:27.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.553+0000 7fcdb0811700 1 -- 172.21.15.2:0/2759446480 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fcd8c06b740 msgr2=0x7fcd8c06dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:27.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.553+0000 7fcdb0811700 1 --2- 172.21.15.2:0/2759446480 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fcd8c06b740 0x7fcd8c06dc00 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c000f60 tx=0x7fcd9c009040 comp rx=0 tx=0).stop 2023-11-26T07:16:27.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.553+0000 7fcdb0811700 1 -- 172.21.15.2:0/2759446480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdac15bde0 msgr2=0x7fcdac0b7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:27.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.553+0000 7fcdb0811700 1 --2- 172.21.15.2:0/2759446480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdac15bde0 0x7fcdac0b7050 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fcda400efc0 tx=0x7fcda400c3a0 comp rx=0 tx=0).stop 2023-11-26T07:16:27.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.553+0000 7fcdb0811700 1 -- 172.21.15.2:0/2759446480 shutdown_connections 2023-11-26T07:16:27.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.553+0000 7fcdb0811700 1 --2- 172.21.15.2:0/2759446480 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fcd8c06b740 0x7fcd8c06dc00 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:27.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.553+0000 7fcdb0811700 1 --2- 172.21.15.2:0/2759446480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdac15bde0 0x7fcdac0b7050 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:27.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.553+0000 7fcdb0811700 1 --2- 172.21.15.2:0/2759446480 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdac0ce5c0 0x7fcdac0b5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:27.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.553+0000 7fcdb0811700 1 --2- 172.21.15.2:0/2759446480 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdac0cf2b0 0x7fcdac1f2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:27.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.554+0000 7fcdb0811700 1 -- 172.21.15.2:0/2759446480 >> 172.21.15.2:0/2759446480 conn(0x7fcdac0b3720 msgr2=0x7fcdac0aed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:27.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.554+0000 7fcdb0811700 1 -- 172.21.15.2:0/2759446480 shutdown_connections 2023-11-26T07:16:27.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.554+0000 7fcdb0811700 1 -- 172.21.15.2:0/2759446480 wait complete. 2023-11-26T07:16:27.557 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 39 2023-11-26T07:16:27.568 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-26T07:16:27.568 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-26T07:16:27.568 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-26T07:16:27.568 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:16:27.568 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-26T07:16:27.568 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-26T07:16:27.569 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-26T07:16:27.569 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:16:27.569 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-26T07:16:27.569 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-26T07:16:27.569 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-26T07:16:27.569 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:16:27.570 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-26T07:16:27.570 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-26T07:16:27.570 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-26T07:16:27.570 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:16:27.577 INFO:tasks.ceph.mds.a:Stopped 2023-11-26T07:16:27.577 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-26T07:16:27.578 INFO:tasks.ceph.mds.c:Stopped 2023-11-26T07:16:27.578 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-26T07:16:27.582 INFO:tasks.ceph.mds.b:Stopped 2023-11-26T07:16:27.582 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-26T07:16:27.583 INFO:tasks.ceph.mds.d:Stopped 2023-11-26T07:16:27.583 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-26T07:16:27.620 INFO:tasks.ceph.mds.a:Started 2023-11-26T07:16:27.620 DEBUG:teuthology.parallel:result is None 2023-11-26T07:16:27.621 INFO:tasks.ceph.mds.c:Started 2023-11-26T07:16:27.621 DEBUG:teuthology.parallel:result is None 2023-11-26T07:16:27.625 INFO:tasks.ceph.mds.b:Started 2023-11-26T07:16:27.625 DEBUG:teuthology.parallel:result is None 2023-11-26T07:16:27.625 INFO:tasks.ceph.mds.d:Started 2023-11-26T07:16:27.626 DEBUG:teuthology.parallel:result is None 2023-11-26T07:16:27.626 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-26T07:16:27.703 INFO:tasks.ceph.mds.c.smithi002.stdout:starting mds.c at 2023-11-26T07:16:27.703 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2023-11-26T07:16:27.716 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2023-11-26T07:16:27.720 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2023-11-26T07:16:27.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.755+0000 7f1496d69700 1 Processor -- start 2023-11-26T07:16:27.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.755+0000 7f1496d69700 1 -- start start 2023-11-26T07:16:27.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.756+0000 7f1496d69700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f149015bfd0 0x7f14900d2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:27.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.756+0000 7f1496d69700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14900b1590 con 0x7f14900d0920 2023-11-26T07:16:27.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.757+0000 7f1496d69700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14900b1870 con 0x7f14900cfa10 2023-11-26T07:16:27.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.757+0000 7f1496d69700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14900cd3f0 con 0x7f149015bfd0 2023-11-26T07:16:27.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.757+0000 7f1494b05700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f149015bfd0 0x7f14900d2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:27.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.757+0000 7f1495306700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f14900d0920 0x7f14900b1d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35254/0 (socket says 172.21.15.2:35254) 2023-11-26T07:16:27.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.757+0000 7f1495306700 1 -- 172.21.15.2:0/1559439336 learned_addr learned my addr 172.21.15.2:0/1559439336 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:16:27.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.757+0000 7f1494b05700 1 -- 172.21.15.2:0/1559439336 >> v1:172.21.15.192:6789/0 conn(0x7f14900cfa10 legacy=0x7f14900d0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:27.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.757+0000 7f1494b05700 1 -- 172.21.15.2:0/1559439336 >> v1:172.21.15.2:6789/0 conn(0x7f14900d0920 legacy=0x7f14900b1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:27.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.757+0000 7f1494b05700 1 -- 172.21.15.2:0/1559439336 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14900cd690 con 0x7f149015bfd0 2023-11-26T07:16:27.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.757+0000 7f1494b05700 1 --2- 172.21.15.2:0/1559439336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f149015bfd0 0x7f14900d2750 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f1488009d90 tx=0x7f148800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c76e462d93cceeb5 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:27.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.758+0000 7f148f7fe700 1 -- 172.21.15.2:0/1559439336 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148800e070 con 0x7f149015bfd0 2023-11-26T07:16:27.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.758+0000 7f148f7fe700 1 -- 172.21.15.2:0/1559439336 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148800bbd0 con 0x7f149015bfd0 2023-11-26T07:16:27.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.758+0000 7f148f7fe700 1 -- 172.21.15.2:0/1559439336 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1488012430 con 0x7f149015bfd0 2023-11-26T07:16:27.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.758+0000 7f1496d69700 1 -- 172.21.15.2:0/1559439336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f149015bfd0 msgr2=0x7f14900d2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:27.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.758+0000 7f1496d69700 1 --2- 172.21.15.2:0/1559439336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f149015bfd0 0x7f14900d2750 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f1488009d90 tx=0x7f148800b330 comp rx=0 tx=0).stop 2023-11-26T07:16:27.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.758+0000 7f1496d69700 1 -- 172.21.15.2:0/1559439336 shutdown_connections 2023-11-26T07:16:27.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.758+0000 7f1496d69700 1 --2- 172.21.15.2:0/1559439336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f149015bfd0 0x7f14900d2750 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:27.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.758+0000 7f1496d69700 1 -- 172.21.15.2:0/1559439336 >> 172.21.15.2:0/1559439336 conn(0x7f14900d1c30 msgr2=0x7f14900d2040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:27.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.758+0000 7f1496d69700 1 -- 172.21.15.2:0/1559439336 shutdown_connections 2023-11-26T07:16:27.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.758+0000 7f1496d69700 1 -- 172.21.15.2:0/1559439336 wait complete. 2023-11-26T07:16:27.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.759+0000 7f1496d69700 1 Processor -- start 2023-11-26T07:16:27.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.759+0000 7f1496d69700 1 -- start start 2023-11-26T07:16:27.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.760+0000 7f1496d69700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14900cfa10 0x7f14900b4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:27.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.760+0000 7f1496d69700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14900d0920 0x7f149006fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:27.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.760+0000 7f1496d69700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f149015bfd0 0x7f14900b6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:27.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.760+0000 7f1496d69700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14901f4af0 con 0x7f149015bfd0 2023-11-26T07:16:27.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.760+0000 7f1496d69700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14901f3f70 con 0x7f14900cfa10 2023-11-26T07:16:27.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.760+0000 7f1496d69700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14901f4250 con 0x7f14900d0920 2023-11-26T07:16:27.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.760+0000 7f1495306700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f149015bfd0 0x7f14900b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:27.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.760+0000 7f1495306700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f149015bfd0 0x7f14900b6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44050/0 (socket says 172.21.15.2:44050) 2023-11-26T07:16:27.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.760+0000 7f1495306700 1 -- 172.21.15.2:0/2981258660 learned_addr learned my addr 172.21.15.2:0/2981258660 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:27.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.761+0000 7f1494b05700 1 --2- 172.21.15.2:0/2981258660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14900cfa10 0x7f14900b4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:27.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.761+0000 7f148ffff700 1 --2- 172.21.15.2:0/2981258660 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14900d0920 0x7f149006fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:27.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.761+0000 7f1495306700 1 -- 172.21.15.2:0/2981258660 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14900d0920 msgr2=0x7f149006fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:27.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.761+0000 7f1495306700 1 --2- 172.21.15.2:0/2981258660 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14900d0920 0x7f149006fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:27.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.761+0000 7f1495306700 1 -- 172.21.15.2:0/2981258660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14900cfa10 msgr2=0x7f14900b4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:27.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.761+0000 7f1495306700 1 --2- 172.21.15.2:0/2981258660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14900cfa10 0x7f14900b4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:27.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.761+0000 7f1495306700 1 -- 172.21.15.2:0/2981258660 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1488009a70 con 0x7f149015bfd0 2023-11-26T07:16:27.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.761+0000 7f1495306700 1 --2- 172.21.15.2:0/2981258660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f149015bfd0 0x7f14900b6960 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f148000c500 tx=0x7f148000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:27.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.761+0000 7f148d7fa700 1 -- 172.21.15.2:0/2981258660 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1480005d70 con 0x7f149015bfd0 2023-11-26T07:16:27.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.761+0000 7f148d7fa700 1 -- 172.21.15.2:0/2981258660 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14800070d0 con 0x7f149015bfd0 2023-11-26T07:16:27.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.761+0000 7f1496d69700 1 -- 172.21.15.2:0/2981258660 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14901f4530 con 0x7f149015bfd0 2023-11-26T07:16:27.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.761+0000 7f148d7fa700 1 -- 172.21.15.2:0/2981258660 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1480007440 con 0x7f149015bfd0 2023-11-26T07:16:27.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.761+0000 7f1496d69700 1 -- 172.21.15.2:0/2981258660 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1490070530 con 0x7f149015bfd0 2023-11-26T07:16:27.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.762+0000 7f1496d69700 1 -- 172.21.15.2:0/2981258660 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f149006c280 con 0x7f149015bfd0 2023-11-26T07:16:27.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.763+0000 7f148d7fa700 1 -- 172.21.15.2:0/2981258660 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f14800075a0 con 0x7f149015bfd0 2023-11-26T07:16:27.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.763+0000 7f148d7fa700 1 --2- 172.21.15.2:0/2981258660 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f147006b740 0x7f147006dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:27.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.763+0000 7f148d7fa700 1 -- 172.21.15.2:0/2981258660 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1480087200 con 0x7f149015bfd0 2023-11-26T07:16:27.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.763+0000 7f1494b05700 1 --2- 172.21.15.2:0/2981258660 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f147006b740 0x7f147006dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:27.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.764+0000 7f1494b05700 1 --2- 172.21.15.2:0/2981258660 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f147006b740 0x7f147006dc00 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1488014040 tx=0x7f1488011000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:27.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.767+0000 7f148d7fa700 1 -- 172.21.15.2:0/2981258660 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1480053c40 con 0x7f149015bfd0 2023-11-26T07:16:27.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:27.985+0000 7f1496d69700 1 -- 172.21.15.2:0/2981258660 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f1490067f60 con 0x7f149015bfd0 2023-11-26T07:16:28.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.580+0000 7f148d7fa700 1 -- 172.21.15.2:0/2981258660 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v67) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1480057260 con 0x7f149015bfd0 2023-11-26T07:16:28.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.584+0000 7f1496d69700 1 -- 172.21.15.2:0/2981258660 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f147006b740 msgr2=0x7f147006dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:28.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.584+0000 7f1496d69700 1 --2- 172.21.15.2:0/2981258660 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f147006b740 0x7f147006dc00 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1488014040 tx=0x7f1488011000 comp rx=0 tx=0).stop 2023-11-26T07:16:28.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.584+0000 7f1496d69700 1 -- 172.21.15.2:0/2981258660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f149015bfd0 msgr2=0x7f14900b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:28.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.584+0000 7f1496d69700 1 --2- 172.21.15.2:0/2981258660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f149015bfd0 0x7f14900b6960 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f148000c500 tx=0x7f148000c810 comp rx=0 tx=0).stop 2023-11-26T07:16:28.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.584+0000 7f1496d69700 1 -- 172.21.15.2:0/2981258660 shutdown_connections 2023-11-26T07:16:28.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.584+0000 7f1496d69700 1 --2- 172.21.15.2:0/2981258660 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f147006b740 0x7f147006dc00 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:28.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.584+0000 7f1496d69700 1 --2- 172.21.15.2:0/2981258660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f149015bfd0 0x7f14900b6960 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:28.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.584+0000 7f1496d69700 1 --2- 172.21.15.2:0/2981258660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14900cfa10 0x7f14900b4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:28.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.584+0000 7f1496d69700 1 --2- 172.21.15.2:0/2981258660 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14900d0920 0x7f149006fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:28.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.584+0000 7f1496d69700 1 -- 172.21.15.2:0/2981258660 >> 172.21.15.2:0/2981258660 conn(0x7f14900d1c30 msgr2=0x7f14900b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:28.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.584+0000 7f1496d69700 1 -- 172.21.15.2:0/2981258660 shutdown_connections 2023-11-26T07:16:28.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.584+0000 7f1496d69700 1 -- 172.21.15.2:0/2981258660 wait complete. 2023-11-26T07:16:28.587 INFO:teuthology.orchestra.run.smithi002.stderr: removed all blocklist entries 2023-11-26T07:16:28.602 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-26T07:16:28.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.731+0000 7facab0e0700 1 Processor -- start 2023-11-26T07:16:28.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.732+0000 7facab0e0700 1 -- start start 2023-11-26T07:16:28.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.733+0000 7facab0e0700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7faca4145830 0x7faca40cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:28.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.733+0000 7facab0e0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faca406afd0 0x7faca406b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:28.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.733+0000 7facab0e0700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faca406db10 con 0x7faca406b990 2023-11-26T07:16:28.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.733+0000 7facab0e0700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faca4145c10 con 0x7faca4145830 2023-11-26T07:16:28.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.733+0000 7facab0e0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faca406be20 con 0x7faca406afd0 2023-11-26T07:16:28.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.733+0000 7faca967d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7faca406b990 0x7faca415fa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35268/0 (socket says 172.21.15.2:35268) 2023-11-26T07:16:28.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.733+0000 7faca967d700 1 -- 172.21.15.2:0/700392780 learned_addr learned my addr 172.21.15.2:0/700392780 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:16:28.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.733+0000 7faca37fe700 1 -- 172.21.15.2:0/700392780 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1000026492 0 0) 0x7faca406db10 con 0x7faca406b990 2023-11-26T07:16:28.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.733+0000 7faca8e7c700 1 --2- 172.21.15.2:0/700392780 >> v2:172.21.15.192:3300/0 conn(0x7faca4145830 0x7faca40cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:28.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.733+0000 7faca3fff700 1 --2- 172.21.15.2:0/700392780 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faca406afd0 0x7faca406b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:28.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.733+0000 7faca37fe700 1 -- 172.21.15.2:0/700392780 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac900035b0 con 0x7faca406b990 2023-11-26T07:16:28.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.733+0000 7faca37fe700 1 -- 172.21.15.2:0/700392780 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 118528123 0 0) 0x7fac900035b0 con 0x7faca406b990 2023-11-26T07:16:28.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.733+0000 7faca37fe700 1 -- 172.21.15.2:0/700392780 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faca406afd0 msgr2=0x7faca406b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:28.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.733+0000 7faca37fe700 1 --2- 172.21.15.2:0/700392780 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faca406afd0 0x7faca406b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:28.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.734+0000 7faca37fe700 1 -- 172.21.15.2:0/700392780 >> v2:172.21.15.192:3300/0 conn(0x7faca4145830 msgr2=0x7faca40cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:28.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.734+0000 7faca37fe700 1 --2- 172.21.15.2:0/700392780 >> v2:172.21.15.192:3300/0 conn(0x7faca4145830 0x7faca40cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:28.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.734+0000 7faca37fe700 1 -- 172.21.15.2:0/700392780 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca40cddb0 con 0x7faca406b990 2023-11-26T07:16:28.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.734+0000 7faca37fe700 1 -- 172.21.15.2:0/700392780 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7fac94001670 con 0x7faca406b990 2023-11-26T07:16:28.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.734+0000 7faca37fe700 1 -- 172.21.15.2:0/700392780 >> v1:172.21.15.2:6789/0 conn(0x7faca406b990 legacy=0x7faca415fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:28.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.734+0000 7faca37fe700 1 --2- 172.21.15.2:0/700392780 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac90003a00 0x7fac90003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:28.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.734+0000 7faca37fe700 1 --2- 172.21.15.2:0/700392780 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac90004850 0x7fac90004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:28.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.734+0000 7faca37fe700 1 --2- 172.21.15.2:0/700392780 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faca406afd0 0x7fac90005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:28.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.734+0000 7faca37fe700 1 -- 172.21.15.2:0/700392780 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca4145c10 con 0x7fac90003a00 2023-11-26T07:16:28.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.734+0000 7faca37fe700 1 -- 172.21.15.2:0/700392780 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca406be20 con 0x7fac90004850 2023-11-26T07:16:28.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.734+0000 7faca37fe700 1 -- 172.21.15.2:0/700392780 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac9000ba10 con 0x7faca406afd0 2023-11-26T07:16:28.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.734+0000 7faca8e7c700 1 --2- 172.21.15.2:0/700392780 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac90003a00 0x7fac90003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:28.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.734+0000 7faca3fff700 1 --2- 172.21.15.2:0/700392780 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac90004850 0x7fac90004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:28.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.734+0000 7faca967d700 1 --2- 172.21.15.2:0/700392780 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faca406afd0 0x7fac90005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:28.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.734+0000 7faca8e7c700 1 -- 172.21.15.2:0/700392780 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faca406afd0 msgr2=0x7fac90005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:28.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.734+0000 7faca8e7c700 1 --2- 172.21.15.2:0/700392780 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faca406afd0 0x7fac90005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:28.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.734+0000 7faca8e7c700 1 -- 172.21.15.2:0/700392780 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac90004850 msgr2=0x7fac90004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:28.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.734+0000 7faca8e7c700 1 --2- 172.21.15.2:0/700392780 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac90004850 0x7fac90004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:28.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.734+0000 7faca8e7c700 1 -- 172.21.15.2:0/700392780 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac900035b0 con 0x7fac90003a00 2023-11-26T07:16:28.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.734+0000 7faca8e7c700 1 --2- 172.21.15.2:0/700392780 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac90003a00 0x7fac90003e20 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fac9c009fc0 tx=0x7fac90005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20033151e3299a31 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:28.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.734+0000 7faca37fe700 1 -- 172.21.15.2:0/700392780 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9c00ec30 con 0x7fac90003a00 2023-11-26T07:16:28.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.734+0000 7faca37fe700 1 -- 172.21.15.2:0/700392780 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9c00f040 con 0x7fac90003a00 2023-11-26T07:16:28.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.734+0000 7faca37fe700 1 -- 172.21.15.2:0/700392780 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9c014480 con 0x7fac90003a00 2023-11-26T07:16:28.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.735+0000 7facab0e0700 1 -- 172.21.15.2:0/700392780 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac90003a00 msgr2=0x7fac90003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:28.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.735+0000 7facab0e0700 1 --2- 172.21.15.2:0/700392780 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac90003a00 0x7fac90003e20 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fac9c009fc0 tx=0x7fac90005880 comp rx=0 tx=0).stop 2023-11-26T07:16:28.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.735+0000 7faca967d700 1 -- 172.21.15.2:0/700392780 reap_dead start 2023-11-26T07:16:28.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.735+0000 7facab0e0700 1 -- 172.21.15.2:0/700392780 shutdown_connections 2023-11-26T07:16:28.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.735+0000 7facab0e0700 1 -- 172.21.15.2:0/700392780 >> 172.21.15.2:0/700392780 conn(0x7faca40d0bc0 msgr2=0x7faca40d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:28.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.735+0000 7facab0e0700 1 -- 172.21.15.2:0/700392780 shutdown_connections 2023-11-26T07:16:28.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.735+0000 7facab0e0700 1 -- 172.21.15.2:0/700392780 wait complete. 2023-11-26T07:16:28.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.736+0000 7facab0e0700 1 Processor -- start 2023-11-26T07:16:28.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.736+0000 7facab0e0700 1 -- start start 2023-11-26T07:16:28.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.737+0000 7facab0e0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac90003a00 0x7faca41f76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:28.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.737+0000 7facab0e0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faca406ea90 0x7faca415a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:28.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.737+0000 7facab0e0700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faca406ef10 0x7faca415aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:28.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.737+0000 7facab0e0700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca41f3f10 con 0x7fac90003a00 2023-11-26T07:16:28.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.737+0000 7facab0e0700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca415b430 con 0x7faca406ef10 2023-11-26T07:16:28.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.737+0000 7facab0e0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faca41f7c00 con 0x7faca406ea90 2023-11-26T07:16:28.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.737+0000 7faca8e7c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac90003a00 0x7faca41f76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:28.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.737+0000 7faca8e7c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac90003a00 0x7faca41f76c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44068/0 (socket says 172.21.15.2:44068) 2023-11-26T07:16:28.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.737+0000 7faca8e7c700 1 -- 172.21.15.2:0/799091206 learned_addr learned my addr 172.21.15.2:0/799091206 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:28.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.737+0000 7faca3fff700 1 --2- 172.21.15.2:0/799091206 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faca406ea90 0x7faca415a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:28.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.737+0000 7faca967d700 1 --2- 172.21.15.2:0/799091206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faca406ef10 0x7faca415aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:28.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.738+0000 7faca8e7c700 1 -- 172.21.15.2:0/799091206 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faca406ea90 msgr2=0x7faca415a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:28.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.738+0000 7faca8e7c700 1 --2- 172.21.15.2:0/799091206 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faca406ea90 0x7faca415a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:28.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.738+0000 7faca8e7c700 1 -- 172.21.15.2:0/799091206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faca406ef10 msgr2=0x7faca415aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:28.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.738+0000 7faca8e7c700 1 --2- 172.21.15.2:0/799091206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faca406ef10 0x7faca415aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:28.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.738+0000 7faca8e7c700 1 -- 172.21.15.2:0/799091206 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca40b5ba0 con 0x7fac90003a00 2023-11-26T07:16:28.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.738+0000 7faca8e7c700 1 --2- 172.21.15.2:0/799091206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac90003a00 0x7faca41f76c0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fac9c00ef30 tx=0x7fac9c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:28.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.738+0000 7faca17fa700 1 -- 172.21.15.2:0/799091206 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9c004450 con 0x7fac90003a00 2023-11-26T07:16:28.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.738+0000 7faca17fa700 1 -- 172.21.15.2:0/799091206 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9c003e90 con 0x7fac90003a00 2023-11-26T07:16:28.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.738+0000 7facab0e0700 1 -- 172.21.15.2:0/799091206 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faca40b58c0 con 0x7fac90003a00 2023-11-26T07:16:28.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.738+0000 7faca17fa700 1 -- 172.21.15.2:0/799091206 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9c004810 con 0x7fac90003a00 2023-11-26T07:16:28.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.738+0000 7facab0e0700 1 -- 172.21.15.2:0/799091206 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faca41f3b30 con 0x7fac90003a00 2023-11-26T07:16:28.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.739+0000 7facab0e0700 1 -- 172.21.15.2:0/799091206 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faca4068670 con 0x7fac90003a00 2023-11-26T07:16:28.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.739+0000 7faca17fa700 1 -- 172.21.15.2:0/799091206 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7fac9c014480 con 0x7fac90003a00 2023-11-26T07:16:28.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.740+0000 7faca17fa700 1 --2- 172.21.15.2:0/799091206 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fac8406b740 0x7fac8406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:28.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.740+0000 7faca17fa700 1 -- 172.21.15.2:0/799091206 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fac9c089870 con 0x7fac90003a00 2023-11-26T07:16:28.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.740+0000 7faca3fff700 1 --2- 172.21.15.2:0/799091206 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fac8406b740 0x7fac8406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:28.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.741+0000 7faca3fff700 1 --2- 172.21.15.2:0/799091206 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fac8406b740 0x7fac8406dc00 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7faca406f4b0 tx=0x7fac8c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:28.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:28.745+0000 7faca17fa700 1 -- 172.21.15.2:0/799091206 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fac9c056370 con 0x7fac90003a00 2023-11-26T07:16:29.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.031+0000 7facab0e0700 1 -- 172.21.15.2:0/799091206 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7faca40b2000 con 0x7fac90003a00 2023-11-26T07:16:29.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.031+0000 7faca17fa700 1 -- 172.21.15.2:0/799091206 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fac9c059990 con 0x7fac90003a00 2023-11-26T07:16:29.033 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:16:29.033 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-26T07:16:29.033 INFO:teuthology.orchestra.run.smithi002.stdout: "auth_dump": [ 2023-11-26T07:16:29.033 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:16:29.033 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.a", 2023-11-26T07:16:29.034 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBv72JlhmTiEhAA/g3oblyy8oWp0Ha83rXvJw==", 2023-11-26T07:16:29.034 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:16:29.034 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-26T07:16:29.034 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-26T07:16:29.034 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-26T07:16:29.034 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:16:29.034 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:16:29.034 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:16:29.034 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:16:29.034 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.b", 2023-11-26T07:16:29.034 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBv72Jlq7BeHxAAOcHBt+2M+s3xqG9k14Oong==", 2023-11-26T07:16:29.035 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:16:29.035 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-26T07:16:29.035 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-26T07:16:29.035 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-26T07:16:29.035 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:16:29.035 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:16:29.035 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:16:29.035 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:16:29.035 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.c", 2023-11-26T07:16:29.035 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBv72Jl5jJFGhAAni1U32wc8K7h2w2Uri/P1Q==", 2023-11-26T07:16:29.035 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:16:29.035 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-26T07:16:29.036 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-26T07:16:29.036 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-26T07:16:29.036 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:16:29.036 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:16:29.036 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:16:29.036 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:16:29.036 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.d", 2023-11-26T07:16:29.036 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBv72JlhpKzJhAAp75J2TEPTop+Zj8ziajW1w==", 2023-11-26T07:16:29.036 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:16:29.036 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-26T07:16:29.036 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-26T07:16:29.036 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-26T07:16:29.037 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:16:29.037 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:16:29.037 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:16:29.037 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:16:29.037 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.0", 2023-11-26T07:16:29.037 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBx72JlnIatFhAAQQkaBQT0iVGJLFeE3ITlAQ==", 2023-11-26T07:16:29.037 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:16:29.037 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-26T07:16:29.037 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-26T07:16:29.037 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:16:29.037 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:16:29.037 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:16:29.038 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:16:29.038 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.1", 2023-11-26T07:16:29.038 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQB072JlXBpBFhAAAEeTzgDMWrtz6OM1Xt6AQg==", 2023-11-26T07:16:29.038 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:16:29.038 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-26T07:16:29.038 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-26T07:16:29.038 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:16:29.038 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:16:29.038 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:16:29.038 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:16:29.038 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.2", 2023-11-26T07:16:29.039 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQB372Jl4nopFhAAYua4b0EX2F1ldmd/00FcUA==", 2023-11-26T07:16:29.039 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:16:29.039 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-26T07:16:29.039 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-26T07:16:29.039 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:16:29.039 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:16:29.039 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:16:29.039 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:16:29.039 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.3", 2023-11-26T07:16:29.039 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQB672Jl73zLFRAATTzBUJUAS8/WHwoQZWQX1w==", 2023-11-26T07:16:29.039 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:16:29.039 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-26T07:16:29.040 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-26T07:16:29.040 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:16:29.040 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:16:29.040 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:16:29.040 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:16:29.040 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.4", 2023-11-26T07:16:29.040 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQCA72JlEqEZGhAAp//g7ZC8YUXoQhoKZKtcDA==", 2023-11-26T07:16:29.040 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:16:29.040 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-26T07:16:29.040 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-26T07:16:29.040 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:16:29.040 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:16:29.041 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:16:29.041 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:16:29.041 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.5", 2023-11-26T07:16:29.041 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQCD72JlGuu/GRAAQb5WygMoPJ7mjB2fR8N3+g==", 2023-11-26T07:16:29.041 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:16:29.041 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-26T07:16:29.041 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-26T07:16:29.041 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:16:29.041 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:16:29.041 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:16:29.041 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:16:29.041 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.6", 2023-11-26T07:16:29.041 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQCG72JlLHYCGRAAEDOtGcsGAVuKMSaXdJdgXg==", 2023-11-26T07:16:29.042 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:16:29.042 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-26T07:16:29.042 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-26T07:16:29.042 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:16:29.042 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:16:29.042 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:16:29.042 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:16:29.042 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.7", 2023-11-26T07:16:29.042 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQCJ72JlKmUJGRAAG7LL7Ath8gv2/HwbKsXYbg==", 2023-11-26T07:16:29.042 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:16:29.042 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-26T07:16:29.043 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-26T07:16:29.043 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:16:29.043 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:16:29.043 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:16:29.043 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:16:29.043 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.0", 2023-11-26T07:16:29.043 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBv72JlaEgQKxAA4cVx4nUFgqn0HvVBJdVHVg==", 2023-11-26T07:16:29.043 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:16:29.043 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-26T07:16:29.043 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow r", 2023-11-26T07:16:29.043 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-26T07:16:29.043 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:16:29.044 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:16:29.044 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:16:29.044 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.1", 2023-11-26T07:16:29.044 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBv72Jl/WHJMRAAcXuo1XInXpAErMaGOhvpBA==", 2023-11-26T07:16:29.044 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:16:29.044 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-26T07:16:29.044 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2023-11-26T07:16:29.044 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2023-11-26T07:16:29.044 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2023-11-26T07:16:29.044 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:16:29.044 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:16:29.044 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:16:29.044 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.2", 2023-11-26T07:16:29.045 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBv72Jl859vLhAAX9K4SuB6kAi/thy6EVKwWA==", 2023-11-26T07:16:29.045 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:16:29.045 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-26T07:16:29.045 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2023-11-26T07:16:29.045 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2023-11-26T07:16:29.045 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2023-11-26T07:16:29.045 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:16:29.045 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:16:29.045 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:16:29.045 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.3", 2023-11-26T07:16:29.045 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBv72JlRDh9NxAAgWUYNNwgFOantC7zH0fC8g==", 2023-11-26T07:16:29.045 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:16:29.046 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-26T07:16:29.046 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2023-11-26T07:16:29.046 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2023-11-26T07:16:29.046 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2023-11-26T07:16:29.046 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:16:29.046 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:16:29.046 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:16:29.046 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.admin", 2023-11-26T07:16:29.046 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBu72JlGFz7MBAA3accSSm2BS7VSUwOhEVnRQ==", 2023-11-26T07:16:29.046 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:16:29.046 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2023-11-26T07:16:29.046 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-26T07:16:29.047 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-26T07:16:29.047 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:16:29.047 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:16:29.047 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:16:29.047 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:16:29.047 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.x", 2023-11-26T07:16:29.047 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBv72Jlq5FrDxAAoovK02XkZdaKmOAgVyJKWw==", 2023-11-26T07:16:29.047 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:16:29.047 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2023-11-26T07:16:29.047 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2023-11-26T07:16:29.047 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:16:29.047 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:16:29.048 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-26T07:16:29.048 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:16:29.048 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.y", 2023-11-26T07:16:29.048 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBv72Jl5jZZCxAANtm1EyG6Goa1xfuH6Mcy2g==", 2023-11-26T07:16:29.048 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-26T07:16:29.048 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2023-11-26T07:16:29.048 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2023-11-26T07:16:29.048 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-26T07:16:29.048 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:16:29.048 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:16:29.048 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2023-11-26T07:16:29.048 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-26T07:16:29.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.033+0000 7facab0e0700 1 -- 172.21.15.2:0/799091206 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fac8406b740 msgr2=0x7fac8406dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:29.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.033+0000 7facab0e0700 1 --2- 172.21.15.2:0/799091206 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fac8406b740 0x7fac8406dc00 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7faca406f4b0 tx=0x7fac8c008040 comp rx=0 tx=0).stop 2023-11-26T07:16:29.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.033+0000 7facab0e0700 1 -- 172.21.15.2:0/799091206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac90003a00 msgr2=0x7faca41f76c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:29.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.033+0000 7facab0e0700 1 --2- 172.21.15.2:0/799091206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac90003a00 0x7faca41f76c0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fac9c00ef30 tx=0x7fac9c009750 comp rx=0 tx=0).stop 2023-11-26T07:16:29.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.033+0000 7facab0e0700 1 -- 172.21.15.2:0/799091206 shutdown_connections 2023-11-26T07:16:29.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.033+0000 7facab0e0700 1 --2- 172.21.15.2:0/799091206 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fac8406b740 0x7fac8406dc00 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:29.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.033+0000 7facab0e0700 1 --2- 172.21.15.2:0/799091206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faca406ef10 0x7faca415aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:29.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.033+0000 7facab0e0700 1 --2- 172.21.15.2:0/799091206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac90003a00 0x7faca41f76c0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:29.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.033+0000 7facab0e0700 1 --2- 172.21.15.2:0/799091206 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faca406ea90 0x7faca415a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:29.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.033+0000 7facab0e0700 1 -- 172.21.15.2:0/799091206 >> 172.21.15.2:0/799091206 conn(0x7faca40d0bc0 msgr2=0x7faca41435d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:29.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.033+0000 7facab0e0700 1 -- 172.21.15.2:0/799091206 shutdown_connections 2023-11-26T07:16:29.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.033+0000 7facab0e0700 1 -- 172.21.15.2:0/799091206 wait complete. 2023-11-26T07:16:29.051 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:16:29.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.174+0000 7ff6eeb21700 1 Processor -- start 2023-11-26T07:16:29.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.174+0000 7ff6eeb21700 1 -- start start 2023-11-26T07:16:29.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.175+0000 7ff6eeb21700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff6e81617a0 0x7ff6e80d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:29.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.175+0000 7ff6eeb21700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6e80d2d40 con 0x7ff6e80ce9b0 2023-11-26T07:16:29.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.175+0000 7ff6eeb21700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6e8162b40 con 0x7ff6e80d2930 2023-11-26T07:16:29.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.175+0000 7ff6eeb21700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6e80d4930 con 0x7ff6e81617a0 2023-11-26T07:16:29.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.175+0000 7ff6ec8bd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff6e81617a0 0x7ff6e80d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:29.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.175+0000 7ff6e7fff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff6e80ce9b0 0x7ff6e8161d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35284/0 (socket says 172.21.15.2:35284) 2023-11-26T07:16:29.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.175+0000 7ff6ec8bd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff6e81617a0 0x7ff6e80d23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44074/0 (socket says 172.21.15.2:44074) 2023-11-26T07:16:29.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.175+0000 7ff6e7fff700 1 -- 172.21.15.2:0/2921627543 learned_addr learned my addr 172.21.15.2:0/2921627543 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:16:29.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.175+0000 7ff6ec8bd700 1 -- 172.21.15.2:0/2921627543 >> v1:172.21.15.192:6789/0 conn(0x7ff6e80d2930 legacy=0x7ff6e8162430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:29.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.175+0000 7ff6ec8bd700 1 -- 172.21.15.2:0/2921627543 >> v1:172.21.15.2:6789/0 conn(0x7ff6e80ce9b0 legacy=0x7ff6e8161d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:29.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.175+0000 7ff6ec8bd700 1 -- 172.21.15.2:0/2921627543 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e80d4c10 con 0x7ff6e81617a0 2023-11-26T07:16:29.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.175+0000 7ff6e77fe700 1 -- 172.21.15.2:0/2921627543 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3913625411 0 0) 0x7ff6e80d2d40 con 0x7ff6e80ce9b0 2023-11-26T07:16:29.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.176+0000 7ff6ec8bd700 1 --2- 172.21.15.2:0/2921627543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6e81617a0 0x7ff6e80d23f0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7ff6e0009d90 tx=0x7ff6e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e97154727901e33 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:29.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.176+0000 7ff6e77fe700 1 -- 172.21.15.2:0/2921627543 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e000e070 con 0x7ff6e81617a0 2023-11-26T07:16:29.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.176+0000 7ff6e77fe700 1 -- 172.21.15.2:0/2921627543 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e000bb90 con 0x7ff6e81617a0 2023-11-26T07:16:29.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.176+0000 7ff6e77fe700 1 -- 172.21.15.2:0/2921627543 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e0003a20 con 0x7ff6e81617a0 2023-11-26T07:16:29.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.176+0000 7ff6eeb21700 1 -- 172.21.15.2:0/2921627543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6e81617a0 msgr2=0x7ff6e80d23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:29.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.176+0000 7ff6eeb21700 1 --2- 172.21.15.2:0/2921627543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6e81617a0 0x7ff6e80d23f0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7ff6e0009d90 tx=0x7ff6e000b330 comp rx=0 tx=0).stop 2023-11-26T07:16:29.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.176+0000 7ff6eeb21700 1 -- 172.21.15.2:0/2921627543 shutdown_connections 2023-11-26T07:16:29.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.176+0000 7ff6eeb21700 1 --2- 172.21.15.2:0/2921627543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6e81617a0 0x7ff6e80d23f0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:29.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.176+0000 7ff6eeb21700 1 -- 172.21.15.2:0/2921627543 >> 172.21.15.2:0/2921627543 conn(0x7ff6e80d3e10 msgr2=0x7ff6e80d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:29.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.176+0000 7ff6eeb21700 1 -- 172.21.15.2:0/2921627543 shutdown_connections 2023-11-26T07:16:29.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.176+0000 7ff6eeb21700 1 -- 172.21.15.2:0/2921627543 wait complete. 2023-11-26T07:16:29.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.178+0000 7ff6eeb21700 1 Processor -- start 2023-11-26T07:16:29.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.178+0000 7ff6eeb21700 1 -- start start 2023-11-26T07:16:29.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.178+0000 7ff6eeb21700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6e80ce9b0 0x7ff6e81f87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:29.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.178+0000 7ff6eeb21700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff6e80d2930 0x7ff6e80cb000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:29.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.178+0000 7ff6eeb21700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6e81617a0 0x7ff6e80cb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:29.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.178+0000 7ff6eeb21700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e80cdc60 con 0x7ff6e81617a0 2023-11-26T07:16:29.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.178+0000 7ff6eeb21700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e80cd090 con 0x7ff6e80ce9b0 2023-11-26T07:16:29.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.178+0000 7ff6eeb21700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e80cd2c0 con 0x7ff6e80d2930 2023-11-26T07:16:29.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.179+0000 7ff6ed0be700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6e81617a0 0x7ff6e80cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:29.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.179+0000 7ff6ed0be700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6e81617a0 0x7ff6e80cb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44084/0 (socket says 172.21.15.2:44084) 2023-11-26T07:16:29.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.179+0000 7ff6ed0be700 1 -- 172.21.15.2:0/2085150851 learned_addr learned my addr 172.21.15.2:0/2085150851 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:29.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.179+0000 7ff6ec8bd700 1 --2- 172.21.15.2:0/2085150851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6e80ce9b0 0x7ff6e81f87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:29.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.179+0000 7ff6e7fff700 1 --2- 172.21.15.2:0/2085150851 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff6e80d2930 0x7ff6e80cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:29.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.179+0000 7ff6ed0be700 1 -- 172.21.15.2:0/2085150851 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff6e80d2930 msgr2=0x7ff6e80cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:29.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.179+0000 7ff6ed0be700 1 --2- 172.21.15.2:0/2085150851 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff6e80d2930 0x7ff6e80cb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:29.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.179+0000 7ff6ed0be700 1 -- 172.21.15.2:0/2085150851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6e80ce9b0 msgr2=0x7ff6e81f87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:29.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.179+0000 7ff6ed0be700 1 --2- 172.21.15.2:0/2085150851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6e80ce9b0 0x7ff6e81f87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:29.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.179+0000 7ff6ed0be700 1 -- 172.21.15.2:0/2085150851 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e0009a70 con 0x7ff6e81617a0 2023-11-26T07:16:29.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.179+0000 7ff6ed0be700 1 --2- 172.21.15.2:0/2085150851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6e81617a0 0x7ff6e80cb540 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7ff6d800b3e0 tx=0x7ff6d800b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:29.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.179+0000 7ff6e57fa700 1 -- 172.21.15.2:0/2085150851 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d8011830 con 0x7ff6e81617a0 2023-11-26T07:16:29.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.179+0000 7ff6e57fa700 1 -- 172.21.15.2:0/2085150851 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d80119b0 con 0x7ff6e81617a0 2023-11-26T07:16:29.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.179+0000 7ff6eeb21700 1 -- 172.21.15.2:0/2085150851 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6e80cd5a0 con 0x7ff6e81617a0 2023-11-26T07:16:29.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.179+0000 7ff6e57fa700 1 -- 172.21.15.2:0/2085150851 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d8011d60 con 0x7ff6e81617a0 2023-11-26T07:16:29.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.179+0000 7ff6eeb21700 1 -- 172.21.15.2:0/2085150851 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6e80cbbc0 con 0x7ff6e81617a0 2023-11-26T07:16:29.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.180+0000 7ff6eeb21700 1 -- 172.21.15.2:0/2085150851 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6e80cdda0 con 0x7ff6e81617a0 2023-11-26T07:16:29.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.181+0000 7ff6e57fa700 1 -- 172.21.15.2:0/2085150851 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7ff6d801a400 con 0x7ff6e81617a0 2023-11-26T07:16:29.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.182+0000 7ff6e57fa700 1 --2- 172.21.15.2:0/2085150851 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff6c806b740 0x7ff6c806dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:29.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.182+0000 7ff6e57fa700 1 -- 172.21.15.2:0/2085150851 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff6d8088470 con 0x7ff6e81617a0 2023-11-26T07:16:29.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.182+0000 7ff6ec8bd700 1 --2- 172.21.15.2:0/2085150851 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff6c806b740 0x7ff6c806dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:29.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.182+0000 7ff6ec8bd700 1 --2- 172.21.15.2:0/2085150851 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff6c806b740 0x7ff6c806dc00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff6e000b370 tx=0x7ff6e0011000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:29.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.185+0000 7ff6e57fa700 1 -- 172.21.15.2:0/2085150851 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff6d8054e90 con 0x7ff6e81617a0 2023-11-26T07:16:29.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.389+0000 7ff6eeb21700 1 -- 172.21.15.2:0/2085150851 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6e80cdda0 con 0x7ff6e81617a0 2023-11-26T07:16:29.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.390+0000 7ff6e57fa700 1 -- 172.21.15.2:0/2085150851 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+12809 (secure 0 0 0) 0x7ff6e80cdda0 con 0x7ff6e81617a0 2023-11-26T07:16:29.392 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:16:29.392 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":69,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:16:28.587406+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:16:29.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.393+0000 7ff6eeb21700 1 -- 172.21.15.2:0/2085150851 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff6c806b740 msgr2=0x7ff6c806dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:29.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.393+0000 7ff6eeb21700 1 --2- 172.21.15.2:0/2085150851 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff6c806b740 0x7ff6c806dc00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff6e000b370 tx=0x7ff6e0011000 comp rx=0 tx=0).stop 2023-11-26T07:16:29.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.393+0000 7ff6eeb21700 1 -- 172.21.15.2:0/2085150851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6e81617a0 msgr2=0x7ff6e80cb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:29.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.393+0000 7ff6eeb21700 1 --2- 172.21.15.2:0/2085150851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6e81617a0 0x7ff6e80cb540 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7ff6d800b3e0 tx=0x7ff6d800b7a0 comp rx=0 tx=0).stop 2023-11-26T07:16:29.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.393+0000 7ff6eeb21700 1 -- 172.21.15.2:0/2085150851 shutdown_connections 2023-11-26T07:16:29.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.393+0000 7ff6eeb21700 1 --2- 172.21.15.2:0/2085150851 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff6c806b740 0x7ff6c806dc00 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:29.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.393+0000 7ff6eeb21700 1 --2- 172.21.15.2:0/2085150851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6e81617a0 0x7ff6e80cb540 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:29.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.393+0000 7ff6eeb21700 1 --2- 172.21.15.2:0/2085150851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6e80ce9b0 0x7ff6e81f87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:29.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.393+0000 7ff6eeb21700 1 --2- 172.21.15.2:0/2085150851 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff6e80d2930 0x7ff6e80cb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:29.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.393+0000 7ff6eeb21700 1 -- 172.21.15.2:0/2085150851 >> 172.21.15.2:0/2085150851 conn(0x7ff6e80d3e10 msgr2=0x7ff6e80d01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:29.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.393+0000 7ff6eeb21700 1 -- 172.21.15.2:0/2085150851 shutdown_connections 2023-11-26T07:16:29.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.393+0000 7ff6eeb21700 1 -- 172.21.15.2:0/2085150851 wait complete. 2023-11-26T07:16:29.407 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:11:28.205739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:16:29.407 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:16:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.534+0000 7f6d9b6d6700 1 Processor -- start 2023-11-26T07:16:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.534+0000 7f6d9b6d6700 1 -- start start 2023-11-26T07:16:29.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.535+0000 7f6d9b6d6700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6d94143ae0 0x7f6d940b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:29.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.535+0000 7f6d9b6d6700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6d940722c0 0x7f6d9406e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:29.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.535+0000 7f6d9b6d6700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d94143ec0 con 0x7f6d941440f0 2023-11-26T07:16:29.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.535+0000 7f6d9b6d6700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d940b40a0 con 0x7f6d940722c0 2023-11-26T07:16:29.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.535+0000 7f6d9b6d6700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d940b3ae0 con 0x7f6d94143ae0 2023-11-26T07:16:29.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.535+0000 7f6d99c73700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6d940722c0 0x7f6d9406e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:29.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.535+0000 7f6d99c73700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6d940722c0 0x7f6d9406e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44092/0 (socket says 172.21.15.2:44092) 2023-11-26T07:16:29.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.535+0000 7f6d99c73700 1 -- 172.21.15.2:0/259358997 learned_addr learned my addr 172.21.15.2:0/259358997 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:29.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.535+0000 7f6d99472700 1 --2- 172.21.15.2:0/259358997 >> v2:172.21.15.192:3300/0 conn(0x7f6d94143ae0 0x7f6d940b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:29.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.536+0000 7f6d99c73700 1 -- 172.21.15.2:0/259358997 >> v2:172.21.15.192:3300/0 conn(0x7f6d94143ae0 msgr2=0x7f6d940b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:29.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.536+0000 7f6d99c73700 1 --2- 172.21.15.2:0/259358997 >> v2:172.21.15.192:3300/0 conn(0x7f6d94143ae0 0x7f6d940b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:29.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.536+0000 7f6d99c73700 1 -- 172.21.15.2:0/259358997 >> v1:172.21.15.192:6789/0 conn(0x7f6d941440f0 legacy=0x7f6d94071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:29.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.536+0000 7f6d99c73700 1 -- 172.21.15.2:0/259358997 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d940b3dc0 con 0x7f6d940722c0 2023-11-26T07:16:29.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.536+0000 7f6d99c73700 1 --2- 172.21.15.2:0/259358997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d940722c0 0x7f6d9406e510 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f6d9406d2e0 tx=0x7f6d8c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adc1a09a4f2a3b95 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:29.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.536+0000 7f6d8bfff700 1 -- 172.21.15.2:0/259358997 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c00e070 con 0x7f6d940722c0 2023-11-26T07:16:29.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.536+0000 7f6d8bfff700 1 -- 172.21.15.2:0/259358997 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8c003a20 con 0x7f6d940722c0 2023-11-26T07:16:29.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.536+0000 7f6d8bfff700 1 -- 172.21.15.2:0/259358997 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c003dd0 con 0x7f6d940722c0 2023-11-26T07:16:29.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.536+0000 7f6d9b6d6700 1 -- 172.21.15.2:0/259358997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d940722c0 msgr2=0x7f6d9406e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:29.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.536+0000 7f6d9b6d6700 1 --2- 172.21.15.2:0/259358997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d940722c0 0x7f6d9406e510 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f6d9406d2e0 tx=0x7f6d8c00b330 comp rx=0 tx=0).stop 2023-11-26T07:16:29.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.536+0000 7f6d9b6d6700 1 -- 172.21.15.2:0/259358997 shutdown_connections 2023-11-26T07:16:29.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.536+0000 7f6d9b6d6700 1 --2- 172.21.15.2:0/259358997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d940722c0 0x7f6d9406e510 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:29.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.536+0000 7f6d9b6d6700 1 --2- 172.21.15.2:0/259358997 >> v2:172.21.15.192:3300/0 conn(0x7f6d94143ae0 0x7f6d940b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:29.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.536+0000 7f6d9b6d6700 1 -- 172.21.15.2:0/259358997 >> 172.21.15.2:0/259358997 conn(0x7f6d940b2740 msgr2=0x7f6d940b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:29.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.536+0000 7f6d9b6d6700 1 -- 172.21.15.2:0/259358997 shutdown_connections 2023-11-26T07:16:29.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.537+0000 7f6d9b6d6700 1 -- 172.21.15.2:0/259358997 wait complete. 2023-11-26T07:16:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.538+0000 7f6d9b6d6700 1 Processor -- start 2023-11-26T07:16:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.538+0000 7f6d9b6d6700 1 -- start start 2023-11-26T07:16:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.538+0000 7f6d9b6d6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d940722c0 0x7f6d9413c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.538+0000 7f6d9b6d6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d94143ae0 0x7f6d94159b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.538+0000 7f6d9b6d6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d941440f0 0x7f6d9415a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.538+0000 7f6d9b6d6700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d94156890 con 0x7f6d941440f0 2023-11-26T07:16:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.538+0000 7f6d9b6d6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9413ce10 con 0x7f6d94143ae0 2023-11-26T07:16:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.538+0000 7f6d9b6d6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d94153c80 con 0x7f6d940722c0 2023-11-26T07:16:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.539+0000 7f6d99c73700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d941440f0 0x7f6d9415a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.539+0000 7f6d99c73700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d941440f0 0x7f6d9415a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44098/0 (socket says 172.21.15.2:44098) 2023-11-26T07:16:29.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.539+0000 7f6d99c73700 1 -- 172.21.15.2:0/3633365720 learned_addr learned my addr 172.21.15.2:0/3633365720 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:29.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.539+0000 7f6d98c71700 1 --2- 172.21.15.2:0/3633365720 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d94143ae0 0x7f6d94159b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:29.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.539+0000 7f6d99472700 1 --2- 172.21.15.2:0/3633365720 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d940722c0 0x7f6d9413c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:29.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.539+0000 7f6d99c73700 1 -- 172.21.15.2:0/3633365720 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d940722c0 msgr2=0x7f6d9413c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:29.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.539+0000 7f6d99c73700 1 --2- 172.21.15.2:0/3633365720 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d940722c0 0x7f6d9413c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:29.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.539+0000 7f6d99c73700 1 -- 172.21.15.2:0/3633365720 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d94143ae0 msgr2=0x7f6d94159b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:29.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.539+0000 7f6d99c73700 1 --2- 172.21.15.2:0/3633365720 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d94143ae0 0x7f6d94159b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:29.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.539+0000 7f6d99c73700 1 -- 172.21.15.2:0/3633365720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8c009b30 con 0x7f6d941440f0 2023-11-26T07:16:29.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.539+0000 7f6d99c73700 1 --2- 172.21.15.2:0/3633365720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d941440f0 0x7f6d9415a0a0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c00b370 tx=0x7f6d8c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:29.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.539+0000 7f6d89ffb700 1 -- 172.21.15.2:0/3633365720 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c004440 con 0x7f6d941440f0 2023-11-26T07:16:29.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.539+0000 7f6d89ffb700 1 -- 172.21.15.2:0/3633365720 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8c0045a0 con 0x7f6d941440f0 2023-11-26T07:16:29.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.539+0000 7f6d89ffb700 1 -- 172.21.15.2:0/3633365720 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c004950 con 0x7f6d941440f0 2023-11-26T07:16:29.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.539+0000 7f6d9b6d6700 1 -- 172.21.15.2:0/3633365720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d941f09c0 con 0x7f6d941440f0 2023-11-26T07:16:29.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.539+0000 7f6d9b6d6700 1 -- 172.21.15.2:0/3633365720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d941f0f60 con 0x7f6d941440f0 2023-11-26T07:16:29.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.540+0000 7f6d9b6d6700 1 -- 172.21.15.2:0/3633365720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d94159400 con 0x7f6d941440f0 2023-11-26T07:16:29.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.541+0000 7f6d89ffb700 1 -- 172.21.15.2:0/3633365720 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f6d8c012430 con 0x7f6d941440f0 2023-11-26T07:16:29.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.541+0000 7f6d89ffb700 1 --2- 172.21.15.2:0/3633365720 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6d7806b740 0x7f6d7806dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:29.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.541+0000 7f6d89ffb700 1 -- 172.21.15.2:0/3633365720 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6d8c0892a0 con 0x7f6d941440f0 2023-11-26T07:16:29.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.542+0000 7f6d99472700 1 --2- 172.21.15.2:0/3633365720 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6d7806b740 0x7f6d7806dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:29.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.542+0000 7f6d99472700 1 --2- 172.21.15.2:0/3633365720 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6d7806b740 0x7f6d7806dc00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6d940b2710 tx=0x7f6d90008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:29.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.546+0000 7f6d89ffb700 1 -- 172.21.15.2:0/3633365720 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6d8c055da0 con 0x7f6d941440f0 2023-11-26T07:16:29.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.747+0000 7f6d9b6d6700 1 -- 172.21.15.2:0/3633365720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6d94067a00 con 0x7f6d941440f0 2023-11-26T07:16:29.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.747+0000 7f6d89ffb700 1 -- 172.21.15.2:0/3633365720 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6d8c017020 con 0x7f6d941440f0 2023-11-26T07:16:29.749 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-26T07:16:29.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.749+0000 7f6d9b6d6700 1 -- 172.21.15.2:0/3633365720 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6d7806b740 msgr2=0x7f6d7806dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:29.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.749+0000 7f6d9b6d6700 1 --2- 172.21.15.2:0/3633365720 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6d7806b740 0x7f6d7806dc00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6d940b2710 tx=0x7f6d90008040 comp rx=0 tx=0).stop 2023-11-26T07:16:29.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.749+0000 7f6d9b6d6700 1 -- 172.21.15.2:0/3633365720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d941440f0 msgr2=0x7f6d9415a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:29.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.749+0000 7f6d9b6d6700 1 --2- 172.21.15.2:0/3633365720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d941440f0 0x7f6d9415a0a0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c00b370 tx=0x7f6d8c004ad0 comp rx=0 tx=0).stop 2023-11-26T07:16:29.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.749+0000 7f6d9b6d6700 1 -- 172.21.15.2:0/3633365720 shutdown_connections 2023-11-26T07:16:29.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.749+0000 7f6d9b6d6700 1 --2- 172.21.15.2:0/3633365720 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6d7806b740 0x7f6d7806dc00 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:29.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.749+0000 7f6d9b6d6700 1 --2- 172.21.15.2:0/3633365720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d941440f0 0x7f6d9415a0a0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:29.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.749+0000 7f6d9b6d6700 1 --2- 172.21.15.2:0/3633365720 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d940722c0 0x7f6d9413c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:29.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.749+0000 7f6d9b6d6700 1 --2- 172.21.15.2:0/3633365720 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d94143ae0 0x7f6d94159b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:29.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.749+0000 7f6d9b6d6700 1 -- 172.21.15.2:0/3633365720 >> 172.21.15.2:0/3633365720 conn(0x7f6d940b2740 msgr2=0x7f6d94142920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:29.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.750+0000 7f6d9b6d6700 1 -- 172.21.15.2:0/3633365720 shutdown_connections 2023-11-26T07:16:29.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.750+0000 7f6d9b6d6700 1 -- 172.21.15.2:0/3633365720 wait complete. 2023-11-26T07:16:29.764 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-26T07:16:29.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.887+0000 7fc335796700 1 Processor -- start 2023-11-26T07:16:29.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.887+0000 7fc335796700 1 -- start start 2023-11-26T07:16:29.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.888+0000 7fc335796700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc33015e460 0x7fc3300d49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:29.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.888+0000 7fc335796700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3300b3370 con 0x7fc3300d2ba0 2023-11-26T07:16:29.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.888+0000 7fc335796700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3300cfc40 con 0x7fc3300cf480 2023-11-26T07:16:29.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.888+0000 7fc335796700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3300b35c0 con 0x7fc33015e460 2023-11-26T07:16:29.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.888+0000 7fc32f7fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc3300d2ba0 0x7fc3300b40a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35318/0 (socket says 172.21.15.2:35318) 2023-11-26T07:16:29.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.888+0000 7fc32f7fe700 1 -- 172.21.15.2:0/2447930040 learned_addr learned my addr 172.21.15.2:0/2447930040 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:16:29.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.888+0000 7fc32dffb700 1 -- 172.21.15.2:0/2447930040 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3628795235 0 0) 0x7fc3300b3370 con 0x7fc3300d2ba0 2023-11-26T07:16:29.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.888+0000 7fc32dffb700 1 -- 172.21.15.2:0/2447930040 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3180035b0 con 0x7fc3300d2ba0 2023-11-26T07:16:29.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.888+0000 7fc32effd700 1 --2- 172.21.15.2:0/2447930040 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc33015e460 0x7fc3300d49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:29.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.889+0000 7fc32dffb700 1 -- 172.21.15.2:0/2447930040 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 101831554 0 0) 0x7fc3180035b0 con 0x7fc3300d2ba0 2023-11-26T07:16:29.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.889+0000 7fc32dffb700 1 -- 172.21.15.2:0/2447930040 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc33015e460 msgr2=0x7fc3300d49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:29.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.889+0000 7fc32dffb700 1 --2- 172.21.15.2:0/2447930040 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc33015e460 0x7fc3300d49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:29.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.889+0000 7fc32dffb700 1 -- 172.21.15.2:0/2447930040 >> v1:172.21.15.192:6789/0 conn(0x7fc3300cf480 legacy=0x7fc3300d2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:29.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.889+0000 7fc32dffb700 1 -- 172.21.15.2:0/2447930040 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3300b38a0 con 0x7fc3300d2ba0 2023-11-26T07:16:29.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.889+0000 7fc32dffb700 1 -- 172.21.15.2:0/2447930040 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7fc3280019f0 con 0x7fc3300d2ba0 2023-11-26T07:16:29.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.889+0000 7fc32dffb700 1 -- 172.21.15.2:0/2447930040 >> v1:172.21.15.2:6789/0 conn(0x7fc3300d2ba0 legacy=0x7fc3300b40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:29.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.889+0000 7fc32dffb700 1 --2- 172.21.15.2:0/2447930040 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc318003a30 0x7fc318003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:29.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.889+0000 7fc32dffb700 1 --2- 172.21.15.2:0/2447930040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc318004850 0x7fc318004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:29.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.889+0000 7fc32dffb700 1 --2- 172.21.15.2:0/2447930040 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc33015e460 0x7fc318005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:29.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.889+0000 7fc32dffb700 1 -- 172.21.15.2:0/2447930040 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3300b35c0 con 0x7fc318004850 2023-11-26T07:16:29.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.889+0000 7fc32dffb700 1 -- 172.21.15.2:0/2447930040 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31800bb50 con 0x7fc318003a30 2023-11-26T07:16:29.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.889+0000 7fc32dffb700 1 -- 172.21.15.2:0/2447930040 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc31800bd10 con 0x7fc33015e460 2023-11-26T07:16:29.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.889+0000 7fc32e7fc700 1 --2- 172.21.15.2:0/2447930040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc318004850 0x7fc318004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:29.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.889+0000 7fc32f7fe700 1 --2- 172.21.15.2:0/2447930040 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc33015e460 0x7fc318005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:29.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.889+0000 7fc32effd700 1 --2- 172.21.15.2:0/2447930040 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc318003a30 0x7fc318003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:29.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.889+0000 7fc32e7fc700 1 -- 172.21.15.2:0/2447930040 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc33015e460 msgr2=0x7fc318005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:29.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.889+0000 7fc32e7fc700 1 --2- 172.21.15.2:0/2447930040 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc33015e460 0x7fc318005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:29.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.889+0000 7fc32e7fc700 1 -- 172.21.15.2:0/2447930040 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc318003a30 msgr2=0x7fc318003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:29.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.889+0000 7fc32e7fc700 1 --2- 172.21.15.2:0/2447930040 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc318003a30 0x7fc318003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:29.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.889+0000 7fc32e7fc700 1 -- 172.21.15.2:0/2447930040 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3180035b0 con 0x7fc318004850 2023-11-26T07:16:29.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.889+0000 7fc32effd700 1 --2- 172.21.15.2:0/2447930040 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc318003a30 0x7fc318003e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:16:29.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.889+0000 7fc32e7fc700 1 --2- 172.21.15.2:0/2447930040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc318004850 0x7fc318004cd0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fc320007fd0 tx=0x7fc318005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba3bb7fde46cf5a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:29.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.889+0000 7fc32dffb700 1 -- 172.21.15.2:0/2447930040 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3200052d0 con 0x7fc318004850 2023-11-26T07:16:29.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.889+0000 7fc32dffb700 1 -- 172.21.15.2:0/2447930040 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc320005470 con 0x7fc318004850 2023-11-26T07:16:29.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.889+0000 7fc32dffb700 1 -- 172.21.15.2:0/2447930040 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3200038c0 con 0x7fc318004850 2023-11-26T07:16:29.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.890+0000 7fc335796700 1 -- 172.21.15.2:0/2447930040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc318004850 msgr2=0x7fc318004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:29.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.890+0000 7fc335796700 1 --2- 172.21.15.2:0/2447930040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc318004850 0x7fc318004cd0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fc320007fd0 tx=0x7fc318005880 comp rx=0 tx=0).stop 2023-11-26T07:16:29.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.890+0000 7fc32f7fe700 1 -- 172.21.15.2:0/2447930040 reap_dead start 2023-11-26T07:16:29.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.890+0000 7fc335796700 1 -- 172.21.15.2:0/2447930040 shutdown_connections 2023-11-26T07:16:29.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.890+0000 7fc335796700 1 -- 172.21.15.2:0/2447930040 >> 172.21.15.2:0/2447930040 conn(0x7fc3300d3eb0 msgr2=0x7fc3300d42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:29.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.890+0000 7fc335796700 1 -- 172.21.15.2:0/2447930040 shutdown_connections 2023-11-26T07:16:29.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.890+0000 7fc335796700 1 -- 172.21.15.2:0/2447930040 wait complete. 2023-11-26T07:16:29.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.891+0000 7fc335796700 1 Processor -- start 2023-11-26T07:16:29.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.891+0000 7fc335796700 1 -- start start 2023-11-26T07:16:29.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.892+0000 7fc335796700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc318004850 0x7fc330153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:29.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.892+0000 7fc335796700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3300cc9e0 0x7fc3300cce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:29.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.892+0000 7fc335796700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3300b6c70 0x7fc3300b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:29.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.892+0000 7fc335796700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3300cd3a0 con 0x7fc3300b6c70 2023-11-26T07:16:29.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.892+0000 7fc335796700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3300b8540 con 0x7fc318004850 2023-11-26T07:16:29.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.892+0000 7fc335796700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3300c8330 con 0x7fc3300cc9e0 2023-11-26T07:16:29.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.892+0000 7fc32f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3300b6c70 0x7fc3300b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:29.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.892+0000 7fc32f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3300b6c70 0x7fc3300b70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44120/0 (socket says 172.21.15.2:44120) 2023-11-26T07:16:29.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.892+0000 7fc32f7fe700 1 -- 172.21.15.2:0/539062946 learned_addr learned my addr 172.21.15.2:0/539062946 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:29.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.892+0000 7fc32effd700 1 --2- 172.21.15.2:0/539062946 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc318004850 0x7fc330153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:29.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.892+0000 7fc32e7fc700 1 --2- 172.21.15.2:0/539062946 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3300cc9e0 0x7fc3300cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:29.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.893+0000 7fc32f7fe700 1 -- 172.21.15.2:0/539062946 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3300cc9e0 msgr2=0x7fc3300cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:29.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.893+0000 7fc32f7fe700 1 --2- 172.21.15.2:0/539062946 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3300cc9e0 0x7fc3300cce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:29.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.893+0000 7fc32f7fe700 1 -- 172.21.15.2:0/539062946 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc318004850 msgr2=0x7fc330153210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:29.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.893+0000 7fc32f7fe700 1 --2- 172.21.15.2:0/539062946 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc318004850 0x7fc330153210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:29.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.893+0000 7fc32f7fe700 1 -- 172.21.15.2:0/539062946 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3300b79c0 con 0x7fc3300b6c70 2023-11-26T07:16:29.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.893+0000 7fc32effd700 1 --2- 172.21.15.2:0/539062946 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc318004850 0x7fc330153210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:16:29.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.893+0000 7fc32f7fe700 1 --2- 172.21.15.2:0/539062946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3300b6c70 0x7fc3300b70f0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fc330067bd0 tx=0x7fc32800e4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:29.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.893+0000 7fc3177fe700 1 -- 172.21.15.2:0/539062946 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc328017070 con 0x7fc3300b6c70 2023-11-26T07:16:29.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.893+0000 7fc3177fe700 1 -- 172.21.15.2:0/539062946 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32800eda0 con 0x7fc3300b6c70 2023-11-26T07:16:29.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.893+0000 7fc335796700 1 -- 172.21.15.2:0/539062946 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3300b7ca0 con 0x7fc3300b6c70 2023-11-26T07:16:29.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.893+0000 7fc3177fe700 1 -- 172.21.15.2:0/539062946 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc328013420 con 0x7fc3300b6c70 2023-11-26T07:16:29.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.893+0000 7fc335796700 1 -- 172.21.15.2:0/539062946 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3300b8260 con 0x7fc3300b6c70 2023-11-26T07:16:29.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.894+0000 7fc335796700 1 -- 172.21.15.2:0/539062946 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc330067f60 con 0x7fc3300b6c70 2023-11-26T07:16:29.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.894+0000 7fc3177fe700 1 -- 172.21.15.2:0/539062946 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7fc328013580 con 0x7fc3300b6c70 2023-11-26T07:16:29.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.895+0000 7fc3177fe700 1 --2- 172.21.15.2:0/539062946 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc31c06b740 0x7fc31c06dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:29.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.895+0000 7fc3177fe700 1 -- 172.21.15.2:0/539062946 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc328087d90 con 0x7fc3300b6c70 2023-11-26T07:16:29.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.895+0000 7fc32effd700 1 --2- 172.21.15.2:0/539062946 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc31c06b740 0x7fc31c06dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:29.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.896+0000 7fc32effd700 1 --2- 172.21.15.2:0/539062946 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc31c06b740 0x7fc31c06dc00 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc324009bf0 tx=0x7fc324008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:29.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:29.900+0000 7fc3177fe700 1 -- 172.21.15.2:0/539062946 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc328054720 con 0x7fc3300b6c70 2023-11-26T07:16:30.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.101+0000 7fc335796700 1 -- 172.21.15.2:0/539062946 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc3300c84f0 con 0x7fc3300b6c70 2023-11-26T07:16:30.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.102+0000 7fc3177fe700 1 -- 172.21.15.2:0/539062946 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v69) v1 ==== 84+0+65 (secure 0 0 0) 0x7fc328057d40 con 0x7fc3300b6c70 2023-11-26T07:16:30.104 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:16:30.104 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2023-11-26T07:16:30.104 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:16:30.104 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 1, 2023-11-26T07:16:30.104 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": ".mgr" 2023-11-26T07:16:30.104 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:16:30.104 INFO:teuthology.orchestra.run.smithi002.stdout:] 2023-11-26T07:16:30.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.104+0000 7fc335796700 1 -- 172.21.15.2:0/539062946 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc31c06b740 msgr2=0x7fc31c06dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:30.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.104+0000 7fc335796700 1 --2- 172.21.15.2:0/539062946 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc31c06b740 0x7fc31c06dc00 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc324009bf0 tx=0x7fc324008040 comp rx=0 tx=0).stop 2023-11-26T07:16:30.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.104+0000 7fc335796700 1 -- 172.21.15.2:0/539062946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3300b6c70 msgr2=0x7fc3300b70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:30.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.104+0000 7fc335796700 1 --2- 172.21.15.2:0/539062946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3300b6c70 0x7fc3300b70f0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fc330067bd0 tx=0x7fc32800e4f0 comp rx=0 tx=0).stop 2023-11-26T07:16:30.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.104+0000 7fc335796700 1 -- 172.21.15.2:0/539062946 shutdown_connections 2023-11-26T07:16:30.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.104+0000 7fc335796700 1 --2- 172.21.15.2:0/539062946 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc31c06b740 0x7fc31c06dc00 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:30.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.104+0000 7fc335796700 1 --2- 172.21.15.2:0/539062946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3300b6c70 0x7fc3300b70f0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:30.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.104+0000 7fc335796700 1 --2- 172.21.15.2:0/539062946 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc318004850 0x7fc330153210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:30.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.104+0000 7fc335796700 1 --2- 172.21.15.2:0/539062946 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3300cc9e0 0x7fc3300cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:30.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.104+0000 7fc335796700 1 -- 172.21.15.2:0/539062946 >> 172.21.15.2:0/539062946 conn(0x7fc3300d3eb0 msgr2=0x7fc3300cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:30.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.104+0000 7fc335796700 1 -- 172.21.15.2:0/539062946 shutdown_connections 2023-11-26T07:16:30.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.104+0000 7fc335796700 1 -- 172.21.15.2:0/539062946 wait complete. 2023-11-26T07:16:30.118 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-26T07:16:30.119 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-26T07:16:30.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.246+0000 7f9ffae2a700 1 Processor -- start 2023-11-26T07:16:30.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.246+0000 7f9ffae2a700 1 -- start start 2023-11-26T07:16:30.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.247+0000 7f9ffae2a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9ff406b6e0 0x7f9ff415e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:30.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.247+0000 7f9ffae2a700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff40d0da0 con 0x7f9ff415e4c0 2023-11-26T07:16:30.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.247+0000 7f9ffae2a700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff415efb0 con 0x7f9ff40b4330 2023-11-26T07:16:30.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.247+0000 7f9ffae2a700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ff40d1940 con 0x7f9ff406b6e0 2023-11-26T07:16:30.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.247+0000 7f9ff3fff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f9ff415e4c0 0x7f9ff406afd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35336/0 (socket says 172.21.15.2:35336) 2023-11-26T07:16:30.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.247+0000 7f9ff3fff700 1 -- 172.21.15.2:0/3977453287 learned_addr learned my addr 172.21.15.2:0/3977453287 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:16:30.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.247+0000 7f9ff93c7700 1 --2- 172.21.15.2:0/3977453287 >> v2:172.21.15.192:3300/0 conn(0x7f9ff406b6e0 0x7f9ff415e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:30.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.247+0000 7f9ff37fe700 1 -- 172.21.15.2:0/3977453287 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2591800100 0 0) 0x7f9ff40d0da0 con 0x7f9ff415e4c0 2023-11-26T07:16:30.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.247+0000 7f9ff37fe700 1 -- 172.21.15.2:0/3977453287 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fe40035b0 con 0x7f9ff415e4c0 2023-11-26T07:16:30.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.247+0000 7f9ff37fe700 1 -- 172.21.15.2:0/3977453287 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2425992455 0 0) 0x7f9fe40035b0 con 0x7f9ff415e4c0 2023-11-26T07:16:30.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.247+0000 7f9ff37fe700 1 -- 172.21.15.2:0/3977453287 >> v2:172.21.15.192:3300/0 conn(0x7f9ff406b6e0 msgr2=0x7f9ff415e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:30.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.247+0000 7f9ff37fe700 1 --2- 172.21.15.2:0/3977453287 >> v2:172.21.15.192:3300/0 conn(0x7f9ff406b6e0 0x7f9ff415e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:30.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.247+0000 7f9ff37fe700 1 -- 172.21.15.2:0/3977453287 >> v1:172.21.15.192:6789/0 conn(0x7f9ff40b4330 legacy=0x7f9ff40d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:30.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.247+0000 7f9ff37fe700 1 -- 172.21.15.2:0/3977453287 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff415f290 con 0x7f9ff415e4c0 2023-11-26T07:16:30.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.247+0000 7f9ff37fe700 1 -- 172.21.15.2:0/3977453287 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f9fe0001670 con 0x7f9ff415e4c0 2023-11-26T07:16:30.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.247+0000 7f9ff37fe700 1 -- 172.21.15.2:0/3977453287 >> v1:172.21.15.2:6789/0 conn(0x7f9ff415e4c0 legacy=0x7f9ff406afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:30.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.247+0000 7f9ff37fe700 1 --2- 172.21.15.2:0/3977453287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fe4003a00 0x7f9fe4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:30.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.247+0000 7f9ff37fe700 1 --2- 172.21.15.2:0/3977453287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9fe4004850 0x7f9fe4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:30.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.248+0000 7f9ff37fe700 1 --2- 172.21.15.2:0/3977453287 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9fe4005210 0x7f9fe400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:30.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.248+0000 7f9ff37fe700 1 -- 172.21.15.2:0/3977453287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff40d1940 con 0x7f9fe4003a00 2023-11-26T07:16:30.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.248+0000 7f9ff37fe700 1 -- 172.21.15.2:0/3977453287 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe400c0b0 con 0x7f9fe4004850 2023-11-26T07:16:30.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.248+0000 7f9ff37fe700 1 -- 172.21.15.2:0/3977453287 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe400c270 con 0x7f9fe4005210 2023-11-26T07:16:30.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.248+0000 7f9ff93c7700 1 --2- 172.21.15.2:0/3977453287 >> v2:172.21.15.192:3300/0 conn(0x7f9ff406b6e0 0x7f9ff415e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:16:30.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.248+0000 7f9ff8bc6700 1 --2- 172.21.15.2:0/3977453287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fe4003a00 0x7f9fe4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:30.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.248+0000 7f9ff3fff700 1 --2- 172.21.15.2:0/3977453287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9fe4004850 0x7f9fe4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:30.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.248+0000 7f9ff93c7700 1 --2- 172.21.15.2:0/3977453287 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9fe4005210 0x7f9fe400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:30.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.248+0000 7f9ff8bc6700 1 -- 172.21.15.2:0/3977453287 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9fe4005210 msgr2=0x7f9fe400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:30.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.248+0000 7f9ff8bc6700 1 --2- 172.21.15.2:0/3977453287 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9fe4005210 0x7f9fe400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:30.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.248+0000 7f9ff8bc6700 1 -- 172.21.15.2:0/3977453287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9fe4004850 msgr2=0x7f9fe4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:30.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.248+0000 7f9ff8bc6700 1 --2- 172.21.15.2:0/3977453287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9fe4004850 0x7f9fe4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:30.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.248+0000 7f9ff8bc6700 1 -- 172.21.15.2:0/3977453287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe40035b0 con 0x7f9fe4003a00 2023-11-26T07:16:30.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.248+0000 7f9ff3fff700 1 --2- 172.21.15.2:0/3977453287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9fe4004850 0x7f9fe4004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:16:30.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.248+0000 7f9ff93c7700 1 --2- 172.21.15.2:0/3977453287 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9fe4005210 0x7f9fe400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:16:30.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.248+0000 7f9ff93c7700 1 -- 172.21.15.2:0/3977453287 reap_dead start 2023-11-26T07:16:30.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.248+0000 7f9ff8bc6700 1 --2- 172.21.15.2:0/3977453287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fe4003a00 0x7f9fe4003e20 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f9fe80017c0 tx=0x7f9fe4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea1d9bd7d3521512 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:30.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.248+0000 7f9ff37fe700 1 -- 172.21.15.2:0/3977453287 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe80052d0 con 0x7f9fe4003a00 2023-11-26T07:16:30.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.248+0000 7f9ff37fe700 1 -- 172.21.15.2:0/3977453287 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe8005430 con 0x7f9fe4003a00 2023-11-26T07:16:30.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.248+0000 7f9ff37fe700 1 -- 172.21.15.2:0/3977453287 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe80038c0 con 0x7f9fe4003a00 2023-11-26T07:16:30.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.249+0000 7f9ffae2a700 1 -- 172.21.15.2:0/3977453287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fe4003a00 msgr2=0x7f9fe4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:30.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.249+0000 7f9ffae2a700 1 --2- 172.21.15.2:0/3977453287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fe4003a00 0x7f9fe4003e20 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f9fe80017c0 tx=0x7f9fe4005880 comp rx=0 tx=0).stop 2023-11-26T07:16:30.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.249+0000 7f9ffae2a700 1 -- 172.21.15.2:0/3977453287 shutdown_connections 2023-11-26T07:16:30.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.249+0000 7f9ffae2a700 1 --2- 172.21.15.2:0/3977453287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fe4003a00 0x7f9fe4003e20 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:30.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.249+0000 7f9ffae2a700 1 -- 172.21.15.2:0/3977453287 >> 172.21.15.2:0/3977453287 conn(0x7f9ff40b2740 msgr2=0x7f9ff40b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:30.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.249+0000 7f9ffae2a700 1 -- 172.21.15.2:0/3977453287 shutdown_connections 2023-11-26T07:16:30.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.249+0000 7f9ffae2a700 1 -- 172.21.15.2:0/3977453287 wait complete. 2023-11-26T07:16:30.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.250+0000 7f9ffae2a700 1 Processor -- start 2023-11-26T07:16:30.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.250+0000 7f9ffae2a700 1 -- start start 2023-11-26T07:16:30.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.251+0000 7f9ffae2a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9fe4003a00 0x7f9ff4152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:30.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.251+0000 7f9ffae2a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ff4151540 0x7f9ff4142700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:30.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.251+0000 7f9ffae2a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ff4142c40 0x7f9ff4143770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:30.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.251+0000 7f9ffae2a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff4141470 con 0x7f9ff4142c40 2023-11-26T07:16:30.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.251+0000 7f9ffae2a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff41528c0 con 0x7f9ff4151540 2023-11-26T07:16:30.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.251+0000 7f9ffae2a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff4141680 con 0x7f9fe4003a00 2023-11-26T07:16:30.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.251+0000 7f9ff93c7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ff4142c40 0x7f9ff4143770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:30.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.251+0000 7f9ff93c7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ff4142c40 0x7f9ff4143770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44140/0 (socket says 172.21.15.2:44140) 2023-11-26T07:16:30.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.251+0000 7f9ff93c7700 1 -- 172.21.15.2:0/3042786074 learned_addr learned my addr 172.21.15.2:0/3042786074 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:30.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.251+0000 7f9ff3fff700 1 --2- 172.21.15.2:0/3042786074 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ff4151540 0x7f9ff4142700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:30.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.251+0000 7f9ff8bc6700 1 --2- 172.21.15.2:0/3042786074 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9fe4003a00 0x7f9ff4152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:30.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.251+0000 7f9ff93c7700 1 -- 172.21.15.2:0/3042786074 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9fe4003a00 msgr2=0x7f9ff4152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:30.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.251+0000 7f9ff93c7700 1 --2- 172.21.15.2:0/3042786074 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9fe4003a00 0x7f9ff4152380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:30.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.251+0000 7f9ff93c7700 1 -- 172.21.15.2:0/3042786074 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ff4151540 msgr2=0x7f9ff4142700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:30.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.251+0000 7f9ff93c7700 1 --2- 172.21.15.2:0/3042786074 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ff4151540 0x7f9ff4142700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:30.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.251+0000 7f9ff93c7700 1 -- 172.21.15.2:0/3042786074 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff4141960 con 0x7f9ff4142c40 2023-11-26T07:16:30.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.251+0000 7f9ff93c7700 1 --2- 172.21.15.2:0/3042786074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ff4142c40 0x7f9ff4143770 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f9ff406bcb0 tx=0x7f9fec00f430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:30.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.252+0000 7f9ff17fa700 1 -- 172.21.15.2:0/3042786074 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fec00fe60 con 0x7f9ff4142c40 2023-11-26T07:16:30.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.252+0000 7f9ff17fa700 1 -- 172.21.15.2:0/3042786074 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fec016420 con 0x7f9ff4142c40 2023-11-26T07:16:30.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.252+0000 7f9ff17fa700 1 -- 172.21.15.2:0/3042786074 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fec0167d0 con 0x7f9ff4142c40 2023-11-26T07:16:30.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.252+0000 7f9ffae2a700 1 -- 172.21.15.2:0/3042786074 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ff4141c40 con 0x7f9ff4142c40 2023-11-26T07:16:30.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.252+0000 7f9ffae2a700 1 -- 172.21.15.2:0/3042786074 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ff4142200 con 0x7f9ff4142c40 2023-11-26T07:16:30.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.253+0000 7f9ffae2a700 1 -- 172.21.15.2:0/3042786074 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ff4142390 con 0x7f9ff4142c40 2023-11-26T07:16:30.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.253+0000 7f9ff17fa700 1 -- 172.21.15.2:0/3042786074 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f9fec016930 con 0x7f9ff4142c40 2023-11-26T07:16:30.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.253+0000 7f9ff17fa700 1 --2- 172.21.15.2:0/3042786074 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9fd806b770 0x7f9fd806dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:30.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.254+0000 7f9ff17fa700 1 -- 172.21.15.2:0/3042786074 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9fec0888e0 con 0x7f9ff4142c40 2023-11-26T07:16:30.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.254+0000 7f9ff8bc6700 1 --2- 172.21.15.2:0/3042786074 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9fd806b770 0x7f9fd806dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:30.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.254+0000 7f9ff8bc6700 1 --2- 172.21.15.2:0/3042786074 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9fd806b770 0x7f9fd806dc30 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8015040 tx=0x7f9fe8009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:30.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.258+0000 7f9ff17fa700 1 -- 172.21.15.2:0/3042786074 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9fec0553b0 con 0x7f9ff4142c40 2023-11-26T07:16:30.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.456+0000 7f9ffae2a700 1 -- 172.21.15.2:0/3042786074 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f9ff4067f60 con 0x7f9ff4142c40 2023-11-26T07:16:30.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.583+0000 7f9ff17fa700 1 -- 172.21.15.2:0/3042786074 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v70) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9fec0589d0 con 0x7f9ff4142c40 2023-11-26T07:16:30.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.586+0000 7f9ffae2a700 1 -- 172.21.15.2:0/3042786074 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9fd806b770 msgr2=0x7f9fd806dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:30.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.586+0000 7f9ffae2a700 1 --2- 172.21.15.2:0/3042786074 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9fd806b770 0x7f9fd806dc30 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8015040 tx=0x7f9fe8009030 comp rx=0 tx=0).stop 2023-11-26T07:16:30.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.586+0000 7f9ffae2a700 1 -- 172.21.15.2:0/3042786074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ff4142c40 msgr2=0x7f9ff4143770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:30.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.586+0000 7f9ffae2a700 1 --2- 172.21.15.2:0/3042786074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ff4142c40 0x7f9ff4143770 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f9ff406bcb0 tx=0x7f9fec00f430 comp rx=0 tx=0).stop 2023-11-26T07:16:30.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.586+0000 7f9ffae2a700 1 -- 172.21.15.2:0/3042786074 shutdown_connections 2023-11-26T07:16:30.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.586+0000 7f9ffae2a700 1 --2- 172.21.15.2:0/3042786074 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9fd806b770 0x7f9fd806dc30 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:30.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.586+0000 7f9ffae2a700 1 --2- 172.21.15.2:0/3042786074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ff4142c40 0x7f9ff4143770 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:30.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.586+0000 7f9ffae2a700 1 --2- 172.21.15.2:0/3042786074 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9fe4003a00 0x7f9ff4152380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:30.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.586+0000 7f9ffae2a700 1 --2- 172.21.15.2:0/3042786074 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ff4151540 0x7f9ff4142700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:30.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.586+0000 7f9ffae2a700 1 -- 172.21.15.2:0/3042786074 >> 172.21.15.2:0/3042786074 conn(0x7f9ff40b2740 msgr2=0x7f9ff40d1230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:30.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.586+0000 7f9ffae2a700 1 -- 172.21.15.2:0/3042786074 shutdown_connections 2023-11-26T07:16:30.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.586+0000 7f9ffae2a700 1 -- 172.21.15.2:0/3042786074 wait complete. 2023-11-26T07:16:30.590 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' created 2023-11-26T07:16:30.603 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-26T07:16:30.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.734+0000 7f19b6519700 1 Processor -- start 2023-11-26T07:16:30.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.734+0000 7f19b6519700 1 -- start start 2023-11-26T07:16:30.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.735+0000 7f19b6519700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19b0144610 0x7f19b00d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:30.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.735+0000 7f19b6519700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f19b015eed0 0x7f19b00d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:30.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.735+0000 7f19b6519700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19b006e9d0 con 0x7f19b006f700 2023-11-26T07:16:30.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.735+0000 7f19b6519700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19b006f270 con 0x7f19b015eed0 2023-11-26T07:16:30.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.735+0000 7f19b6519700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b01449f0 con 0x7f19b0144610 2023-11-26T07:16:30.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.735+0000 7f19affff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19b0144610 0x7f19b00d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:30.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.735+0000 7f19b4ab6700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f19b015eed0 0x7f19b00d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:30.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.735+0000 7f19affff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19b0144610 0x7f19b00d09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.2:42224/0 (socket says 172.21.15.2:42224) 2023-11-26T07:16:30.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.735+0000 7f19af7fe700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f19b006f700 0x7f19b015e7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.2:42724/0 (socket says 172.21.15.2:42724) 2023-11-26T07:16:30.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.735+0000 7f19affff700 1 -- 172.21.15.2:0/2468828379 learned_addr learned my addr 172.21.15.2:0/2468828379 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:30.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.735+0000 7f19b4ab6700 1 --2- 172.21.15.2:0/2468828379 >> v2:172.21.15.192:3300/0 conn(0x7f19b015eed0 0x7f19b00d0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.2:52734/0 (socket says 172.21.15.2:52734) 2023-11-26T07:16:30.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.736+0000 7f19aeffd700 1 -- 172.21.15.2:0/2468828379 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1126757966 0 0) 0x7f19b006e9d0 con 0x7f19b006f700 2023-11-26T07:16:30.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.736+0000 7f19aeffd700 1 -- 172.21.15.2:0/2468828379 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f199c0035b0 con 0x7f19b006f700 2023-11-26T07:16:30.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.736+0000 7f19b4ab6700 1 -- 172.21.15.2:0/2468828379 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19b0144610 msgr2=0x7f19b00d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:30.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.736+0000 7f19b4ab6700 1 --2- 172.21.15.2:0/2468828379 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19b0144610 0x7f19b00d09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:30.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.736+0000 7f19b4ab6700 1 -- 172.21.15.2:0/2468828379 >> v1:172.21.15.192:6789/0 conn(0x7f19b006f700 legacy=0x7f19b015e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:30.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.736+0000 7f19b4ab6700 1 -- 172.21.15.2:0/2468828379 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b015f530 con 0x7f19b015eed0 2023-11-26T07:16:30.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.736+0000 7f19affff700 1 --2- 172.21.15.2:0/2468828379 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19b0144610 0x7f19b00d09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:16:30.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.736+0000 7f19b4ab6700 1 --2- 172.21.15.2:0/2468828379 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19b015eed0 0x7f19b00d0f30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f19a8009dc0 tx=0x7f19a800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7105a62a8fe471f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:30.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.736+0000 7f19aeffd700 1 -- 172.21.15.2:0/2468828379 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a800e070 con 0x7f19b015eed0 2023-11-26T07:16:30.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.736+0000 7f19aeffd700 1 -- 172.21.15.2:0/2468828379 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a800bae0 con 0x7f19b015eed0 2023-11-26T07:16:30.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.736+0000 7f19aeffd700 1 -- 172.21.15.2:0/2468828379 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a800be90 con 0x7f19b015eed0 2023-11-26T07:16:30.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.737+0000 7f19b6519700 1 -- 172.21.15.2:0/2468828379 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19b015eed0 msgr2=0x7f19b00d0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:30.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.737+0000 7f19b6519700 1 --2- 172.21.15.2:0/2468828379 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19b015eed0 0x7f19b00d0f30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f19a8009dc0 tx=0x7f19a800b330 comp rx=0 tx=0).stop 2023-11-26T07:16:30.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.737+0000 7f19b6519700 1 -- 172.21.15.2:0/2468828379 shutdown_connections 2023-11-26T07:16:30.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.737+0000 7f19b6519700 1 --2- 172.21.15.2:0/2468828379 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19b015eed0 0x7f19b00d0f30 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:30.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.737+0000 7f19b6519700 1 --2- 172.21.15.2:0/2468828379 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19b0144610 0x7f19b00d09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:30.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.737+0000 7f19b6519700 1 -- 172.21.15.2:0/2468828379 >> 172.21.15.2:0/2468828379 conn(0x7f19b00b2740 msgr2=0x7f19b00b2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:30.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.737+0000 7f19b6519700 1 -- 172.21.15.2:0/2468828379 shutdown_connections 2023-11-26T07:16:30.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.737+0000 7f19b6519700 1 -- 172.21.15.2:0/2468828379 wait complete. 2023-11-26T07:16:30.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.738+0000 7f19b6519700 1 Processor -- start 2023-11-26T07:16:30.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.738+0000 7f19b6519700 1 -- start start 2023-11-26T07:16:30.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.739+0000 7f19b6519700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19b006f700 0x7f19b01436d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:30.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.739+0000 7f19b6519700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19b0144610 0x7f19b01566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:30.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.739+0000 7f19b6519700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19b015eed0 0x7f19b0156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:30.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.739+0000 7f19b6519700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b00ae920 con 0x7f19b0144610 2023-11-26T07:16:30.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.739+0000 7f19b6519700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b015b0b0 con 0x7f19b006f700 2023-11-26T07:16:30.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.739+0000 7f19b6519700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b00ae640 con 0x7f19b015eed0 2023-11-26T07:16:30.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.739+0000 7f19af7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19b0144610 0x7f19b01566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:30.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.739+0000 7f19af7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19b0144610 0x7f19b01566b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44152/0 (socket says 172.21.15.2:44152) 2023-11-26T07:16:30.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.739+0000 7f19af7fe700 1 -- 172.21.15.2:0/911513977 learned_addr learned my addr 172.21.15.2:0/911513977 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:30.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.739+0000 7f19affff700 1 --2- 172.21.15.2:0/911513977 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19b006f700 0x7f19b01436d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:30.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.739+0000 7f19b4ab6700 1 --2- 172.21.15.2:0/911513977 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19b015eed0 0x7f19b0156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:30.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.740+0000 7f19af7fe700 1 -- 172.21.15.2:0/911513977 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19b015eed0 msgr2=0x7f19b0156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:30.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.740+0000 7f19af7fe700 1 --2- 172.21.15.2:0/911513977 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19b015eed0 0x7f19b0156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:30.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.740+0000 7f19af7fe700 1 -- 172.21.15.2:0/911513977 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19b006f700 msgr2=0x7f19b01436d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:30.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.740+0000 7f19af7fe700 1 --2- 172.21.15.2:0/911513977 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19b006f700 0x7f19b01436d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:30.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.740+0000 7f19af7fe700 1 -- 172.21.15.2:0/911513977 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a000b7f0 con 0x7f19b0144610 2023-11-26T07:16:30.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.740+0000 7f19af7fe700 1 --2- 172.21.15.2:0/911513977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19b0144610 0x7f19b01566b0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f199800c700 tx=0x7f199800cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:30.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.740+0000 7f19acff9700 1 -- 172.21.15.2:0/911513977 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1998005cb0 con 0x7f19b0144610 2023-11-26T07:16:30.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.740+0000 7f19acff9700 1 -- 172.21.15.2:0/911513977 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1998005e10 con 0x7f19b0144610 2023-11-26T07:16:30.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.740+0000 7f19b6519700 1 -- 172.21.15.2:0/911513977 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19a8009a70 con 0x7f19b0144610 2023-11-26T07:16:30.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.740+0000 7f19acff9700 1 -- 172.21.15.2:0/911513977 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19980072d0 con 0x7f19b0144610 2023-11-26T07:16:30.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.740+0000 7f19b6519700 1 -- 172.21.15.2:0/911513977 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b015b630 con 0x7f19b0144610 2023-11-26T07:16:30.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.741+0000 7f19b6519700 1 -- 172.21.15.2:0/911513977 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19b015b9a0 con 0x7f19b0144610 2023-11-26T07:16:30.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.742+0000 7f19acff9700 1 -- 172.21.15.2:0/911513977 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f1998007430 con 0x7f19b0144610 2023-11-26T07:16:30.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.742+0000 7f19acff9700 1 --2- 172.21.15.2:0/911513977 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f199006b740 0x7f199006dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:30.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.742+0000 7f19acff9700 1 -- 172.21.15.2:0/911513977 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f19980879b0 con 0x7f19b0144610 2023-11-26T07:16:30.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.742+0000 7f19affff700 1 --2- 172.21.15.2:0/911513977 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f199006b740 0x7f199006dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:30.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.743+0000 7f19affff700 1 --2- 172.21.15.2:0/911513977 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f199006b740 0x7f199006dc00 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f19a000be70 tx=0x7f19a000b4d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:30.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.746+0000 7f19acff9700 1 -- 172.21.15.2:0/911513977 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f19980543f0 con 0x7f19b0144610 2023-11-26T07:16:30.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:30.950+0000 7f19b6519700 1 -- 172.21.15.2:0/911513977 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f19b015af10 con 0x7f19b0144610 2023-11-26T07:16:31.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.586+0000 7f19acff9700 1 -- 172.21.15.2:0/911513977 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v71) v1 ==== 170+0+0 (secure 0 0 0) 0x7f19b015af10 con 0x7f19b0144610 2023-11-26T07:16:31.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.589+0000 7f19b6519700 1 -- 172.21.15.2:0/911513977 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f199006b740 msgr2=0x7f199006dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:31.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.589+0000 7f19b6519700 1 --2- 172.21.15.2:0/911513977 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f199006b740 0x7f199006dc00 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f19a000be70 tx=0x7f19a000b4d0 comp rx=0 tx=0).stop 2023-11-26T07:16:31.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.589+0000 7f19b6519700 1 -- 172.21.15.2:0/911513977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19b0144610 msgr2=0x7f19b01566b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:31.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.589+0000 7f19b6519700 1 --2- 172.21.15.2:0/911513977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19b0144610 0x7f19b01566b0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f199800c700 tx=0x7f199800cac0 comp rx=0 tx=0).stop 2023-11-26T07:16:31.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.590+0000 7f19b6519700 1 -- 172.21.15.2:0/911513977 shutdown_connections 2023-11-26T07:16:31.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.590+0000 7f19b6519700 1 --2- 172.21.15.2:0/911513977 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f199006b740 0x7f199006dc00 secure :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f19a000be70 tx=0x7f19a000b4d0 comp rx=0 tx=0).stop 2023-11-26T07:16:31.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.590+0000 7f19b6519700 1 --2- 172.21.15.2:0/911513977 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19b015eed0 0x7f19b0156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:31.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.590+0000 7f19b6519700 1 --2- 172.21.15.2:0/911513977 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19b006f700 0x7f19b01436d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:31.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.590+0000 7f19b6519700 1 --2- 172.21.15.2:0/911513977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19b0144610 0x7f19b01566b0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:31.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.590+0000 7f19b6519700 1 -- 172.21.15.2:0/911513977 >> 172.21.15.2:0/911513977 conn(0x7f19b00b2740 msgr2=0x7f19b0140610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:31.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.590+0000 7f19b6519700 1 -- 172.21.15.2:0/911513977 shutdown_connections 2023-11-26T07:16:31.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.590+0000 7f19b6519700 1 -- 172.21.15.2:0/911513977 wait complete. 2023-11-26T07:16:31.595 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' created 2023-11-26T07:16:31.619 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-26T07:16:31.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.750+0000 7f89be721700 1 Processor -- start 2023-11-26T07:16:31.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.751+0000 7f89be721700 1 -- start start 2023-11-26T07:16:31.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.751+0000 7f89be721700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f89b815f5e0 0x7f89b80cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:31.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.751+0000 7f89be721700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f89b80b4320 0x7f89b80d0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:31.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.751+0000 7f89be721700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89b80d0c70 con 0x7f89b80d0750 2023-11-26T07:16:31.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.751+0000 7f89be721700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89b815f9c0 con 0x7f89b80b4320 2023-11-26T07:16:31.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.751+0000 7f89be721700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89b80cd250 con 0x7f89b815f5e0 2023-11-26T07:16:31.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.752+0000 7f89b77fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f89b80b4320 0x7f89b80d0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:31.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.752+0000 7f89b77fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f89b80b4320 0x7f89b80d0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44160/0 (socket says 172.21.15.2:44160) 2023-11-26T07:16:31.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.752+0000 7f89b77fe700 1 -- 172.21.15.2:0/3764879026 learned_addr learned my addr 172.21.15.2:0/3764879026 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:31.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.752+0000 7f89b7fff700 1 --2- 172.21.15.2:0/3764879026 >> v2:172.21.15.192:3300/0 conn(0x7f89b815f5e0 0x7f89b80cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:31.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.752+0000 7f89b77fe700 1 -- 172.21.15.2:0/3764879026 >> v2:172.21.15.192:3300/0 conn(0x7f89b815f5e0 msgr2=0x7f89b80cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:31.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.752+0000 7f89b77fe700 1 --2- 172.21.15.2:0/3764879026 >> v2:172.21.15.192:3300/0 conn(0x7f89b815f5e0 0x7f89b80cfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:31.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.752+0000 7f89b77fe700 1 -- 172.21.15.2:0/3764879026 >> v1:172.21.15.192:6789/0 conn(0x7f89b80d0750 legacy=0x7f89b80ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:31.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.752+0000 7f89b77fe700 1 -- 172.21.15.2:0/3764879026 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b80c5860 con 0x7f89b80b4320 2023-11-26T07:16:31.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.752+0000 7f89b77fe700 1 --2- 172.21.15.2:0/3764879026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89b80b4320 0x7f89b80d0210 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f89b8072f70 tx=0x7f89ac009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dacea249fcca3852 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:31.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.752+0000 7f89b6ffd700 1 -- 172.21.15.2:0/3764879026 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ac004230 con 0x7f89b80b4320 2023-11-26T07:16:31.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.752+0000 7f89b6ffd700 1 -- 172.21.15.2:0/3764879026 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89ac004390 con 0x7f89b80b4320 2023-11-26T07:16:31.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.752+0000 7f89b6ffd700 1 -- 172.21.15.2:0/3764879026 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ac0036a0 con 0x7f89b80b4320 2023-11-26T07:16:31.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.753+0000 7f89be721700 1 -- 172.21.15.2:0/3764879026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89b80b4320 msgr2=0x7f89b80d0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:31.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.753+0000 7f89be721700 1 --2- 172.21.15.2:0/3764879026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89b80b4320 0x7f89b80d0210 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f89b8072f70 tx=0x7f89ac009bd0 comp rx=0 tx=0).stop 2023-11-26T07:16:31.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.753+0000 7f89be721700 1 -- 172.21.15.2:0/3764879026 shutdown_connections 2023-11-26T07:16:31.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.753+0000 7f89be721700 1 --2- 172.21.15.2:0/3764879026 >> v2:172.21.15.192:3300/0 conn(0x7f89b815f5e0 0x7f89b80cfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:31.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.753+0000 7f89be721700 1 --2- 172.21.15.2:0/3764879026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89b80b4320 0x7f89b80d0210 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:31.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.753+0000 7f89be721700 1 -- 172.21.15.2:0/3764879026 >> 172.21.15.2:0/3764879026 conn(0x7f89b80b3800 msgr2=0x7f89b80b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:31.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.753+0000 7f89be721700 1 -- 172.21.15.2:0/3764879026 shutdown_connections 2023-11-26T07:16:31.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.753+0000 7f89be721700 1 -- 172.21.15.2:0/3764879026 wait complete. 2023-11-26T07:16:31.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.754+0000 7f89be721700 1 Processor -- start 2023-11-26T07:16:31.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.754+0000 7f89be721700 1 -- start start 2023-11-26T07:16:31.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.755+0000 7f89be721700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f89b80b4320 0x7f89b80c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:31.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.755+0000 7f89be721700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89b80d0750 0x7f89b80c73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:31.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.755+0000 7f89be721700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89b815f5e0 0x7f89b806c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:31.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.755+0000 7f89be721700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b80b4f20 con 0x7f89b815f5e0 2023-11-26T07:16:31.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.755+0000 7f89be721700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b80b48f0 con 0x7f89b80b4320 2023-11-26T07:16:31.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.755+0000 7f89be721700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b806e0b0 con 0x7f89b80d0750 2023-11-26T07:16:31.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.755+0000 7f89bccbe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89b815f5e0 0x7f89b806c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:31.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.755+0000 7f89bccbe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89b815f5e0 0x7f89b806c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44168/0 (socket says 172.21.15.2:44168) 2023-11-26T07:16:31.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.755+0000 7f89bccbe700 1 -- 172.21.15.2:0/3003876544 learned_addr learned my addr 172.21.15.2:0/3003876544 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:31.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.755+0000 7f89b7fff700 1 --2- 172.21.15.2:0/3003876544 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f89b80b4320 0x7f89b80c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:31.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.755+0000 7f89b77fe700 1 --2- 172.21.15.2:0/3003876544 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89b80d0750 0x7f89b80c73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:31.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.755+0000 7f89bccbe700 1 -- 172.21.15.2:0/3003876544 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89b80d0750 msgr2=0x7f89b80c73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:31.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.755+0000 7f89bccbe700 1 --2- 172.21.15.2:0/3003876544 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89b80d0750 0x7f89b80c73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:31.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.755+0000 7f89bccbe700 1 -- 172.21.15.2:0/3003876544 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f89b80b4320 msgr2=0x7f89b80c9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:31.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.755+0000 7f89bccbe700 1 --2- 172.21.15.2:0/3003876544 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f89b80b4320 0x7f89b80c9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:31.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.755+0000 7f89bccbe700 1 -- 172.21.15.2:0/3003876544 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ac009550 con 0x7f89b815f5e0 2023-11-26T07:16:31.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.755+0000 7f89b77fe700 1 --2- 172.21.15.2:0/3003876544 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89b80d0750 0x7f89b80c73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:16:31.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.756+0000 7f89bccbe700 1 --2- 172.21.15.2:0/3003876544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89b815f5e0 0x7f89b806c0e0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f89b000cc10 tx=0x7f89b000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:31.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.756+0000 7f89b4ff9700 1 -- 172.21.15.2:0/3003876544 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b000abb0 con 0x7f89b815f5e0 2023-11-26T07:16:31.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.756+0000 7f89b4ff9700 1 -- 172.21.15.2:0/3003876544 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b000ad10 con 0x7f89b815f5e0 2023-11-26T07:16:31.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.756+0000 7f89be721700 1 -- 172.21.15.2:0/3003876544 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89b806cc10 con 0x7f89b815f5e0 2023-11-26T07:16:31.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.756+0000 7f89b4ff9700 1 -- 172.21.15.2:0/3003876544 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b0012660 con 0x7f89b815f5e0 2023-11-26T07:16:31.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.756+0000 7f89be721700 1 -- 172.21.15.2:0/3003876544 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b80b4b40 con 0x7f89b815f5e0 2023-11-26T07:16:31.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.757+0000 7f89be721700 1 -- 172.21.15.2:0/3003876544 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89b80b5060 con 0x7f89b815f5e0 2023-11-26T07:16:31.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.758+0000 7f89b4ff9700 1 -- 172.21.15.2:0/3003876544 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f89b00127c0 con 0x7f89b815f5e0 2023-11-26T07:16:31.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.758+0000 7f89b4ff9700 1 --2- 172.21.15.2:0/3003876544 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f89a406b740 0x7f89a406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:31.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.758+0000 7f89b4ff9700 1 -- 172.21.15.2:0/3003876544 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f89b00887f0 con 0x7f89b815f5e0 2023-11-26T07:16:31.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.758+0000 7f89b7fff700 1 --2- 172.21.15.2:0/3003876544 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f89a406b740 0x7f89a406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:31.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.759+0000 7f89b7fff700 1 --2- 172.21.15.2:0/3003876544 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f89a406b740 0x7f89a406dc00 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f89b806d8e0 tx=0x7f89a8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:31.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:31.763+0000 7f89b4ff9700 1 -- 172.21.15.2:0/3003876544 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f89b80b5060 con 0x7f89b815f5e0 2023-11-26T07:16:32.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.013+0000 7f89be721700 1 -- 172.21.15.2:0/3003876544 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f89b80b5060 con 0x7f89b815f5e0 2023-11-26T07:16:32.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.612+0000 7f89b4ff9700 1 -- 172.21.15.2:0/3003876544 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v42) v1 ==== 174+0+0 (secure 0 0 0) 0x7f89b80b5060 con 0x7f89b815f5e0 2023-11-26T07:16:32.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.617+0000 7f89be721700 1 -- 172.21.15.2:0/3003876544 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f89a406b740 msgr2=0x7f89a406dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:32.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.617+0000 7f89be721700 1 --2- 172.21.15.2:0/3003876544 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f89a406b740 0x7f89a406dc00 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f89b806d8e0 tx=0x7f89a8008040 comp rx=0 tx=0).stop 2023-11-26T07:16:32.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.617+0000 7f89be721700 1 -- 172.21.15.2:0/3003876544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89b815f5e0 msgr2=0x7f89b806c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:32.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.617+0000 7f89be721700 1 --2- 172.21.15.2:0/3003876544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89b815f5e0 0x7f89b806c0e0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f89b000cc10 tx=0x7f89b000a060 comp rx=0 tx=0).stop 2023-11-26T07:16:32.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.618+0000 7f89be721700 1 -- 172.21.15.2:0/3003876544 shutdown_connections 2023-11-26T07:16:32.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.618+0000 7f89be721700 1 --2- 172.21.15.2:0/3003876544 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f89a406b740 0x7f89a406dc00 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:32.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.618+0000 7f89be721700 1 --2- 172.21.15.2:0/3003876544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89b815f5e0 0x7f89b806c0e0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:32.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.618+0000 7f89be721700 1 --2- 172.21.15.2:0/3003876544 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f89b80b4320 0x7f89b80c9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:32.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.618+0000 7f89be721700 1 --2- 172.21.15.2:0/3003876544 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89b80d0750 0x7f89b80c73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:32.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.618+0000 7f89be721700 1 -- 172.21.15.2:0/3003876544 >> 172.21.15.2:0/3003876544 conn(0x7f89b80b3800 msgr2=0x7f89b80ce1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:32.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.618+0000 7f89be721700 1 -- 172.21.15.2:0/3003876544 shutdown_connections 2023-11-26T07:16:32.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.618+0000 7f89be721700 1 -- 172.21.15.2:0/3003876544 wait complete. 2023-11-26T07:16:32.627 INFO:teuthology.orchestra.run.smithi002.stderr:new fs with metadata pool 10 and data pool 11 2023-11-26T07:16:32.640 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:16:32.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.765+0000 7f9317446700 1 Processor -- start 2023-11-26T07:16:32.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.765+0000 7f9317446700 1 -- start start 2023-11-26T07:16:32.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.766+0000 7f9317446700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93100b4150 0x7f931006de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:32.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.766+0000 7f9317446700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f93100b5ab0 0x7f931006e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:32.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.766+0000 7f9317446700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9310071f50 con 0x7f931006b620 2023-11-26T07:16:32.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.766+0000 7f9317446700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9310072230 con 0x7f93100b5ab0 2023-11-26T07:16:32.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.766+0000 7f9317446700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9310072510 con 0x7f93100b4150 2023-11-26T07:16:32.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.766+0000 7f93151e2700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f931006b620 0x7f93100b3a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35394/0 (socket says 172.21.15.2:35394) 2023-11-26T07:16:32.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.766+0000 7f93151e2700 1 -- 172.21.15.2:0/3953211796 learned_addr learned my addr 172.21.15.2:0/3953211796 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:16:32.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.766+0000 7f93159e3700 1 --2- 172.21.15.2:0/3953211796 >> v2:172.21.15.192:3300/0 conn(0x7f93100b5ab0 0x7f931006e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:32.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.766+0000 7f93149e1700 1 --2- 172.21.15.2:0/3953211796 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93100b4150 0x7f931006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:32.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.766+0000 7f9307fff700 1 -- 172.21.15.2:0/3953211796 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 552658003 0 0) 0x7f9310071f50 con 0x7f931006b620 2023-11-26T07:16:32.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.766+0000 7f9307fff700 1 -- 172.21.15.2:0/3953211796 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92fc0035b0 con 0x7f931006b620 2023-11-26T07:16:32.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.767+0000 7f9307fff700 1 -- 172.21.15.2:0/3953211796 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2539755454 0 0) 0x7f92fc0035b0 con 0x7f931006b620 2023-11-26T07:16:32.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.767+0000 7f9307fff700 1 -- 172.21.15.2:0/3953211796 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93100b4150 msgr2=0x7f931006de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:32.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.767+0000 7f9307fff700 1 --2- 172.21.15.2:0/3953211796 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93100b4150 0x7f931006de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:32.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.767+0000 7f9307fff700 1 -- 172.21.15.2:0/3953211796 >> v2:172.21.15.192:3300/0 conn(0x7f93100b5ab0 msgr2=0x7f931006e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:32.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.767+0000 7f9307fff700 1 --2- 172.21.15.2:0/3953211796 >> v2:172.21.15.192:3300/0 conn(0x7f93100b5ab0 0x7f931006e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:32.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.767+0000 7f9307fff700 1 -- 172.21.15.2:0/3953211796 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93100727f0 con 0x7f931006b620 2023-11-26T07:16:32.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.767+0000 7f9307fff700 1 -- 172.21.15.2:0/3953211796 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f9300001670 con 0x7f931006b620 2023-11-26T07:16:32.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.767+0000 7f9307fff700 1 -- 172.21.15.2:0/3953211796 >> v1:172.21.15.2:6789/0 conn(0x7f931006b620 legacy=0x7f93100b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:32.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.767+0000 7f9307fff700 1 --2- 172.21.15.2:0/3953211796 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92fc003a00 0x7f92fc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:32.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.767+0000 7f9307fff700 1 --2- 172.21.15.2:0/3953211796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92fc004850 0x7f92fc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:32.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.767+0000 7f9307fff700 1 --2- 172.21.15.2:0/3953211796 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93100b4150 0x7f92fc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:32.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.767+0000 7f9307fff700 1 -- 172.21.15.2:0/3953211796 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9310072230 con 0x7f92fc004850 2023-11-26T07:16:32.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.767+0000 7f9307fff700 1 -- 172.21.15.2:0/3953211796 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9310072510 con 0x7f92fc003a00 2023-11-26T07:16:32.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.767+0000 7f9307fff700 1 -- 172.21.15.2:0/3953211796 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc00ba10 con 0x7f93100b4150 2023-11-26T07:16:32.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.767+0000 7f93149e1700 1 --2- 172.21.15.2:0/3953211796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92fc004850 0x7f92fc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:32.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.767+0000 7f93151e2700 1 --2- 172.21.15.2:0/3953211796 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92fc003a00 0x7f92fc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:32.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.767+0000 7f93159e3700 1 --2- 172.21.15.2:0/3953211796 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93100b4150 0x7f92fc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:32.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.767+0000 7f93149e1700 1 -- 172.21.15.2:0/3953211796 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93100b4150 msgr2=0x7f92fc005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:32.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.767+0000 7f93149e1700 1 --2- 172.21.15.2:0/3953211796 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93100b4150 0x7f92fc005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:32.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.767+0000 7f93149e1700 1 -- 172.21.15.2:0/3953211796 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92fc003a00 msgr2=0x7f92fc003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:32.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.767+0000 7f93149e1700 1 --2- 172.21.15.2:0/3953211796 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92fc003a00 0x7f92fc003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:32.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.767+0000 7f93149e1700 1 -- 172.21.15.2:0/3953211796 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92fc0035b0 con 0x7f92fc004850 2023-11-26T07:16:32.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.767+0000 7f93149e1700 1 --2- 172.21.15.2:0/3953211796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92fc004850 0x7f92fc004cd0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f930c009b60 tx=0x7f92fc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c096eb8c662c1081 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:32.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.767+0000 7f9307fff700 1 -- 172.21.15.2:0/3953211796 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930c00e6c0 con 0x7f92fc004850 2023-11-26T07:16:32.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.767+0000 7f9307fff700 1 -- 172.21.15.2:0/3953211796 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f930c00e820 con 0x7f92fc004850 2023-11-26T07:16:32.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.767+0000 7f9307fff700 1 -- 172.21.15.2:0/3953211796 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930c00eb90 con 0x7f92fc004850 2023-11-26T07:16:32.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.768+0000 7f9317446700 1 -- 172.21.15.2:0/3953211796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92fc004850 msgr2=0x7f92fc004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:32.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.768+0000 7f9317446700 1 --2- 172.21.15.2:0/3953211796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92fc004850 0x7f92fc004cd0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f930c009b60 tx=0x7f92fc005880 comp rx=0 tx=0).stop 2023-11-26T07:16:32.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.768+0000 7f93159e3700 1 -- 172.21.15.2:0/3953211796 reap_dead start 2023-11-26T07:16:32.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.768+0000 7f9317446700 1 -- 172.21.15.2:0/3953211796 shutdown_connections 2023-11-26T07:16:32.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.768+0000 7f9317446700 1 -- 172.21.15.2:0/3953211796 >> 172.21.15.2:0/3953211796 conn(0x7f93100b2740 msgr2=0x7f93100b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:32.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.768+0000 7f9317446700 1 -- 172.21.15.2:0/3953211796 shutdown_connections 2023-11-26T07:16:32.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.768+0000 7f9317446700 1 -- 172.21.15.2:0/3953211796 wait complete. 2023-11-26T07:16:32.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.769+0000 7f9317446700 1 Processor -- start 2023-11-26T07:16:32.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.769+0000 7f9317446700 1 -- start start 2023-11-26T07:16:32.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.770+0000 7f9317446700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f92fc004850 0x7f9310143360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:32.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.770+0000 7f9317446700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93100c59b0 0x7f9310144e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:32.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.770+0000 7f9317446700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93100c5e30 0x7f93101453b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:32.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.770+0000 7f9317446700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93101438a0 con 0x7f93100c5e30 2023-11-26T07:16:32.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.770+0000 7f9317446700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93100c6390 con 0x7f93100c59b0 2023-11-26T07:16:32.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.770+0000 7f9317446700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93100c6670 con 0x7f92fc004850 2023-11-26T07:16:32.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.770+0000 7f93159e3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93100c5e30 0x7f93101453b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:32.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.770+0000 7f93159e3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93100c5e30 0x7f93101453b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44200/0 (socket says 172.21.15.2:44200) 2023-11-26T07:16:32.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.770+0000 7f93159e3700 1 -- 172.21.15.2:0/1191789001 learned_addr learned my addr 172.21.15.2:0/1191789001 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:32.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.771+0000 7f93151e2700 1 --2- 172.21.15.2:0/1191789001 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f92fc004850 0x7f9310143360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:32.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.771+0000 7f93149e1700 1 --2- 172.21.15.2:0/1191789001 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93100c59b0 0x7f9310144e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:32.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.771+0000 7f93159e3700 1 -- 172.21.15.2:0/1191789001 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f92fc004850 msgr2=0x7f9310143360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:32.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.771+0000 7f93159e3700 1 --2- 172.21.15.2:0/1191789001 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f92fc004850 0x7f9310143360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:32.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.771+0000 7f93159e3700 1 -- 172.21.15.2:0/1191789001 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93100c59b0 msgr2=0x7f9310144e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:32.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.771+0000 7f93159e3700 1 --2- 172.21.15.2:0/1191789001 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93100c59b0 0x7f9310144e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:32.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.771+0000 7f93159e3700 1 -- 172.21.15.2:0/1191789001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93100c6950 con 0x7f93100c5e30 2023-11-26T07:16:32.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.771+0000 7f93149e1700 1 --2- 172.21.15.2:0/1191789001 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93100c59b0 0x7f9310144e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:16:32.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.771+0000 7f93159e3700 1 --2- 172.21.15.2:0/1191789001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93100c5e30 0x7f93101453b0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f93100706e0 tx=0x7f9308011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:32.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.771+0000 7f9305ffb700 1 -- 172.21.15.2:0/1191789001 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930800e040 con 0x7f93100c5e30 2023-11-26T07:16:32.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.771+0000 7f9305ffb700 1 -- 172.21.15.2:0/1191789001 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f930800f040 con 0x7f93100c5e30 2023-11-26T07:16:32.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.771+0000 7f9317446700 1 -- 172.21.15.2:0/1191789001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93100c6c30 con 0x7f93100c5e30 2023-11-26T07:16:32.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.771+0000 7f9305ffb700 1 -- 172.21.15.2:0/1191789001 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930800fa00 con 0x7f93100c5e30 2023-11-26T07:16:32.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.771+0000 7f9317446700 1 -- 172.21.15.2:0/1191789001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93100cf310 con 0x7f93100c5e30 2023-11-26T07:16:32.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.772+0000 7f9317446700 1 -- 172.21.15.2:0/1191789001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f931006df80 con 0x7f93100c5e30 2023-11-26T07:16:32.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.772+0000 7f9305ffb700 1 -- 172.21.15.2:0/1191789001 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f930800fb60 con 0x7f93100c5e30 2023-11-26T07:16:32.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.773+0000 7f9305ffb700 1 --2- 172.21.15.2:0/1191789001 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f92f406b740 0x7f92f406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:32.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.773+0000 7f9305ffb700 1 -- 172.21.15.2:0/1191789001 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9308088490 con 0x7f93100c5e30 2023-11-26T07:16:32.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.773+0000 7f93151e2700 1 --2- 172.21.15.2:0/1191789001 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f92f406b740 0x7f92f406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:32.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.774+0000 7f93151e2700 1 --2- 172.21.15.2:0/1191789001 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f92f406b740 0x7f92f406dc00 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9300000fb0 tx=0x7f9300009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:32.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.777+0000 7f9305ffb700 1 -- 172.21.15.2:0/1191789001 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9308054ff0 con 0x7f93100c5e30 2023-11-26T07:16:32.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.980+0000 7f9317446700 1 -- 172.21.15.2:0/1191789001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9310068670 con 0x7f93100c5e30 2023-11-26T07:16:32.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.982+0000 7f9305ffb700 1 -- 172.21.15.2:0/1191789001 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+16533 (secure 0 0 0) 0x7f9308058610 con 0x7f93100c5e30 2023-11-26T07:16:32.985 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:16:32.985 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":72,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:16:32.014346+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:16:30.488040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-26T07:16:30.981722+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:16:32.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.984+0000 7f9317446700 1 -- 172.21.15.2:0/1191789001 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f92f406b740 msgr2=0x7f92f406dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:32.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.984+0000 7f9317446700 1 --2- 172.21.15.2:0/1191789001 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f92f406b740 0x7f92f406dc00 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9300000fb0 tx=0x7f9300009040 comp rx=0 tx=0).stop 2023-11-26T07:16:32.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.984+0000 7f9317446700 1 -- 172.21.15.2:0/1191789001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93100c5e30 msgr2=0x7f93101453b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:32.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.984+0000 7f9317446700 1 --2- 172.21.15.2:0/1191789001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93100c5e30 0x7f93101453b0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f93100706e0 tx=0x7f9308011f80 comp rx=0 tx=0).stop 2023-11-26T07:16:32.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.984+0000 7f9317446700 1 -- 172.21.15.2:0/1191789001 shutdown_connections 2023-11-26T07:16:32.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.984+0000 7f9317446700 1 --2- 172.21.15.2:0/1191789001 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f92f406b740 0x7f92f406dc00 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:32.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.984+0000 7f9317446700 1 --2- 172.21.15.2:0/1191789001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93100c5e30 0x7f93101453b0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:32.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.984+0000 7f9317446700 1 --2- 172.21.15.2:0/1191789001 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f92fc004850 0x7f9310143360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:32.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.984+0000 7f9317446700 1 --2- 172.21.15.2:0/1191789001 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93100c59b0 0x7f9310144e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:32.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.984+0000 7f9317446700 1 -- 172.21.15.2:0/1191789001 >> 172.21.15.2:0/1191789001 conn(0x7f93100b2740 msgr2=0x7f93100aee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:32.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.984+0000 7f9317446700 1 -- 172.21.15.2:0/1191789001 shutdown_connections 2023-11-26T07:16:32.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:32.984+0000 7f9317446700 1 -- 172.21.15.2:0/1191789001 wait complete. 2023-11-26T07:16:32.999 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:16:33.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.121+0000 7f96962ff700 1 Processor -- start 2023-11-26T07:16:33.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.121+0000 7f96962ff700 1 -- start start 2023-11-26T07:16:33.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.122+0000 7f96962ff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96900d0820 0x7f9690166c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:33.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.122+0000 7f96962ff700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f969006f610 con 0x7f969015c010 2023-11-26T07:16:33.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.122+0000 7f96962ff700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96900cdac0 con 0x7f96900cfc60 2023-11-26T07:16:33.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.122+0000 7f96962ff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f969006ece0 con 0x7f96900d0820 2023-11-26T07:16:33.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.122+0000 7f968ffff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f969015c010 0x7f96900cd2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35414/0 (socket says 172.21.15.2:35414) 2023-11-26T07:16:33.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.122+0000 7f968ffff700 1 -- 172.21.15.2:0/3263437115 learned_addr learned my addr 172.21.15.2:0/3263437115 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:16:33.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.122+0000 7f969489c700 1 --2- 172.21.15.2:0/3263437115 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96900d0820 0x7f9690166c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:33.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.122+0000 7f968effd700 1 -- 172.21.15.2:0/3263437115 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2349955381 0 0) 0x7f969006f610 con 0x7f969015c010 2023-11-26T07:16:33.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.122+0000 7f968effd700 1 -- 172.21.15.2:0/3263437115 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f967c0035b0 con 0x7f969015c010 2023-11-26T07:16:33.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.123+0000 7f968effd700 1 -- 172.21.15.2:0/3263437115 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2186709439 0 0) 0x7f96900cdac0 con 0x7f96900cfc60 2023-11-26T07:16:33.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.123+0000 7f968effd700 1 -- 172.21.15.2:0/3263437115 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f969006f610 con 0x7f96900cfc60 2023-11-26T07:16:33.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.123+0000 7f968effd700 1 -- 172.21.15.2:0/3263437115 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3514317401 0 0) 0x7f967c0035b0 con 0x7f969015c010 2023-11-26T07:16:33.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.123+0000 7f969489c700 1 -- 172.21.15.2:0/3263437115 >> v1:172.21.15.192:6789/0 conn(0x7f96900cfc60 legacy=0x7f96900d0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:33.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.123+0000 7f969489c700 1 -- 172.21.15.2:0/3263437115 >> v1:172.21.15.2:6789/0 conn(0x7f969015c010 legacy=0x7f96900cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:33.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.123+0000 7f969489c700 1 -- 172.21.15.2:0/3263437115 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f969006efc0 con 0x7f96900d0820 2023-11-26T07:16:33.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.123+0000 7f969489c700 1 --2- 172.21.15.2:0/3263437115 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96900d0820 0x7f9690166c00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9688009dc0 tx=0x7f968800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=268b498eeae81b2c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:33.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.123+0000 7f968effd700 1 -- 172.21.15.2:0/3263437115 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968800e070 con 0x7f96900d0820 2023-11-26T07:16:33.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.123+0000 7f968effd700 1 -- 172.21.15.2:0/3263437115 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9688003a20 con 0x7f96900d0820 2023-11-26T07:16:33.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.123+0000 7f968effd700 1 -- 172.21.15.2:0/3263437115 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9678001670 con 0x7f96900d0820 2023-11-26T07:16:33.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.123+0000 7f96962ff700 1 -- 172.21.15.2:0/3263437115 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96900d0820 msgr2=0x7f9690166c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:33.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.123+0000 7f96962ff700 1 --2- 172.21.15.2:0/3263437115 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96900d0820 0x7f9690166c00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9688009dc0 tx=0x7f968800b330 comp rx=0 tx=0).stop 2023-11-26T07:16:33.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.124+0000 7f96962ff700 1 -- 172.21.15.2:0/3263437115 shutdown_connections 2023-11-26T07:16:33.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.124+0000 7f96962ff700 1 --2- 172.21.15.2:0/3263437115 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96900d0820 0x7f9690166c00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:33.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.124+0000 7f96962ff700 1 -- 172.21.15.2:0/3263437115 >> 172.21.15.2:0/3263437115 conn(0x7f96900b3790 msgr2=0x7f96900b3ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:33.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.124+0000 7f96962ff700 1 -- 172.21.15.2:0/3263437115 shutdown_connections 2023-11-26T07:16:33.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.124+0000 7f96962ff700 1 -- 172.21.15.2:0/3263437115 wait complete. 2023-11-26T07:16:33.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.125+0000 7f96962ff700 1 Processor -- start 2023-11-26T07:16:33.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.125+0000 7f96962ff700 1 -- start start 2023-11-26T07:16:33.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.126+0000 7f96962ff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96900cfc60 0x7f96901edcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:33.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.126+0000 7f96962ff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96900d0820 0x7f96901f3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:33.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.126+0000 7f96962ff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f969015c010 0x7f96901f41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:33.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.126+0000 7f96962ff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96901ee210 con 0x7f969015c010 2023-11-26T07:16:33.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.126+0000 7f96962ff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969015dbe0 con 0x7f96900cfc60 2023-11-26T07:16:33.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.126+0000 7f96962ff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f969015d890 con 0x7f96900d0820 2023-11-26T07:16:33.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.126+0000 7f969489c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f969015c010 0x7f96901f41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:33.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.126+0000 7f969489c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f969015c010 0x7f96901f41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44214/0 (socket says 172.21.15.2:44214) 2023-11-26T07:16:33.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.126+0000 7f969489c700 1 -- 172.21.15.2:0/352896400 learned_addr learned my addr 172.21.15.2:0/352896400 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:33.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.126+0000 7f968ffff700 1 --2- 172.21.15.2:0/352896400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96900cfc60 0x7f96901edcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:33.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.126+0000 7f968f7fe700 1 --2- 172.21.15.2:0/352896400 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96900d0820 0x7f96901f3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:33.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.126+0000 7f969489c700 1 -- 172.21.15.2:0/352896400 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96900d0820 msgr2=0x7f96901f3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:33.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.126+0000 7f969489c700 1 --2- 172.21.15.2:0/352896400 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96900d0820 0x7f96901f3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:33.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.126+0000 7f969489c700 1 -- 172.21.15.2:0/352896400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96900cfc60 msgr2=0x7f96901edcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:33.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.126+0000 7f969489c700 1 --2- 172.21.15.2:0/352896400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96900cfc60 0x7f96901edcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:33.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.126+0000 7f969489c700 1 -- 172.21.15.2:0/352896400 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9688009a70 con 0x7f969015c010 2023-11-26T07:16:33.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.126+0000 7f969489c700 1 --2- 172.21.15.2:0/352896400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f969015c010 0x7f96901f41a0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f9688004000 tx=0x7f9688004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:33.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.126+0000 7f968cff9700 1 -- 172.21.15.2:0/352896400 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96880044b0 con 0x7f969015c010 2023-11-26T07:16:33.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.126+0000 7f968cff9700 1 -- 172.21.15.2:0/352896400 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9688004650 con 0x7f969015c010 2023-11-26T07:16:33.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.127+0000 7f96962ff700 1 -- 172.21.15.2:0/352896400 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96901f4780 con 0x7f969015c010 2023-11-26T07:16:33.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.127+0000 7f968cff9700 1 -- 172.21.15.2:0/352896400 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968801c460 con 0x7f969015c010 2023-11-26T07:16:33.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.127+0000 7f96962ff700 1 -- 172.21.15.2:0/352896400 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f969006c3d0 con 0x7f969015c010 2023-11-26T07:16:33.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.128+0000 7f96962ff700 1 -- 172.21.15.2:0/352896400 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9690068670 con 0x7f969015c010 2023-11-26T07:16:33.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.128+0000 7f968cff9700 1 -- 172.21.15.2:0/352896400 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f968801c5c0 con 0x7f969015c010 2023-11-26T07:16:33.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.128+0000 7f968cff9700 1 --2- 172.21.15.2:0/352896400 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f967006b740 0x7f967006dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:33.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.129+0000 7f968cff9700 1 -- 172.21.15.2:0/352896400 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9688089600 con 0x7f969015c010 2023-11-26T07:16:33.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.129+0000 7f968ffff700 1 --2- 172.21.15.2:0/352896400 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f967006b740 0x7f967006dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:33.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.129+0000 7f968ffff700 1 --2- 172.21.15.2:0/352896400 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f967006b740 0x7f967006dc00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9678007fd0 tx=0x7f9678007a00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:33.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.133+0000 7f968cff9700 1 -- 172.21.15.2:0/352896400 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9688056160 con 0x7f969015c010 2023-11-26T07:16:33.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.336+0000 7f96962ff700 1 -- 172.21.15.2:0/352896400 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96901f4c40 con 0x7f969015c010 2023-11-26T07:16:33.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.337+0000 7f968cff9700 1 -- 172.21.15.2:0/352896400 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+16533 (secure 0 0 0) 0x7f9688059780 con 0x7f969015c010 2023-11-26T07:16:33.340 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:16:33.340 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":72,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:16:32.014346+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:16:30.488040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-26T07:16:30.981722+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:16:33.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.339+0000 7f96962ff700 1 -- 172.21.15.2:0/352896400 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f967006b740 msgr2=0x7f967006dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:33.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.339+0000 7f96962ff700 1 --2- 172.21.15.2:0/352896400 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f967006b740 0x7f967006dc00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9678007fd0 tx=0x7f9678007a00 comp rx=0 tx=0).stop 2023-11-26T07:16:33.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.339+0000 7f96962ff700 1 -- 172.21.15.2:0/352896400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f969015c010 msgr2=0x7f96901f41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:33.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.339+0000 7f96962ff700 1 --2- 172.21.15.2:0/352896400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f969015c010 0x7f96901f41a0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f9688004000 tx=0x7f9688004ad0 comp rx=0 tx=0).stop 2023-11-26T07:16:33.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.339+0000 7f96962ff700 1 -- 172.21.15.2:0/352896400 shutdown_connections 2023-11-26T07:16:33.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.339+0000 7f96962ff700 1 --2- 172.21.15.2:0/352896400 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f967006b740 0x7f967006dc00 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:33.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.340+0000 7f96962ff700 1 --2- 172.21.15.2:0/352896400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f969015c010 0x7f96901f41a0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:33.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.340+0000 7f96962ff700 1 --2- 172.21.15.2:0/352896400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96900cfc60 0x7f96901edcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:33.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.340+0000 7f96962ff700 1 --2- 172.21.15.2:0/352896400 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96900d0820 0x7f96901f3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:33.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.340+0000 7f96962ff700 1 -- 172.21.15.2:0/352896400 >> 172.21.15.2:0/352896400 conn(0x7f96900b3790 msgr2=0x7f969015b150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:33.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.340+0000 7f96962ff700 1 -- 172.21.15.2:0/352896400 shutdown_connections 2023-11-26T07:16:33.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.340+0000 7f96962ff700 1 -- 172.21.15.2:0/352896400 wait complete. 2023-11-26T07:16:33.355 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-26T07:16:33.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.480+0000 7fe974fc2700 1 Processor -- start 2023-11-26T07:16:33.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.480+0000 7fe974fc2700 1 -- start start 2023-11-26T07:16:33.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.481+0000 7fe974fc2700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe97006b620 0x7fe9700b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:33.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.481+0000 7fe974fc2700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9701629c0 con 0x7fe97006ee60 2023-11-26T07:16:33.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.481+0000 7fe974fc2700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe970071f50 con 0x7fe9700b5ab0 2023-11-26T07:16:33.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.481+0000 7fe974fc2700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe970072230 con 0x7fe97006b620 2023-11-26T07:16:33.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.481+0000 7fe96e59c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe97006b620 0x7fe9700b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:33.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.481+0000 7fe96e59c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe97006b620 0x7fe9700b3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44218/0 (socket says 172.21.15.2:44218) 2023-11-26T07:16:33.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.481+0000 7fe96e59c700 1 -- 172.21.15.2:0/2601798644 learned_addr learned my addr 172.21.15.2:0/2601798644 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:33.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.481+0000 7fe96ed9d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe97006ee60 0x7fe9701622b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35432/0 (socket says 172.21.15.2:35432) 2023-11-26T07:16:33.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.482+0000 7fe96e59c700 1 -- 172.21.15.2:0/2601798644 >> v1:172.21.15.192:6789/0 conn(0x7fe9700b5ab0 legacy=0x7fe970161ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:33.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.482+0000 7fe96e59c700 1 -- 172.21.15.2:0/2601798644 >> v1:172.21.15.2:6789/0 conn(0x7fe97006ee60 legacy=0x7fe9701622b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:33.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.482+0000 7fe96d59a700 1 -- 172.21.15.2:0/2601798644 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3582056276 0 0) 0x7fe9701629c0 con 0x7fe97006ee60 2023-11-26T07:16:33.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.482+0000 7fe96e59c700 1 -- 172.21.15.2:0/2601798644 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe970072510 con 0x7fe97006b620 2023-11-26T07:16:33.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.482+0000 7fe96e59c700 1 --2- 172.21.15.2:0/2601798644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe97006b620 0x7fe9700b3a40 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fe9640098f0 tx=0x7fe964009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=330d34b603cb1646 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:33.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.482+0000 7fe96d59a700 1 -- 172.21.15.2:0/2601798644 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96400b8a0 con 0x7fe97006b620 2023-11-26T07:16:33.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.482+0000 7fe96d59a700 1 -- 172.21.15.2:0/2601798644 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe96400ba00 con 0x7fe97006b620 2023-11-26T07:16:33.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.482+0000 7fe96d59a700 1 -- 172.21.15.2:0/2601798644 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96400bd90 con 0x7fe97006b620 2023-11-26T07:16:33.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.482+0000 7fe974fc2700 1 -- 172.21.15.2:0/2601798644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe97006b620 msgr2=0x7fe9700b3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:33.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.482+0000 7fe974fc2700 1 --2- 172.21.15.2:0/2601798644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe97006b620 0x7fe9700b3a40 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fe9640098f0 tx=0x7fe964009c00 comp rx=0 tx=0).stop 2023-11-26T07:16:33.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.483+0000 7fe974fc2700 1 -- 172.21.15.2:0/2601798644 shutdown_connections 2023-11-26T07:16:33.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.483+0000 7fe974fc2700 1 --2- 172.21.15.2:0/2601798644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe97006b620 0x7fe9700b3a40 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:33.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.483+0000 7fe974fc2700 1 -- 172.21.15.2:0/2601798644 >> 172.21.15.2:0/2601798644 conn(0x7fe9700b2740 msgr2=0x7fe9700b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:33.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.483+0000 7fe974fc2700 1 -- 172.21.15.2:0/2601798644 shutdown_connections 2023-11-26T07:16:33.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.483+0000 7fe974fc2700 1 -- 172.21.15.2:0/2601798644 wait complete. 2023-11-26T07:16:33.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.484+0000 7fe974fc2700 1 Processor -- start 2023-11-26T07:16:33.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.484+0000 7fe974fc2700 1 -- start start 2023-11-26T07:16:33.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.485+0000 7fe974fc2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe97006b620 0x7fe970137ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:33.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.485+0000 7fe974fc2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe97006ee60 0x7fe970144240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:33.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.485+0000 7fe974fc2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9700b5ab0 0x7fe970144780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:33.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.485+0000 7fe974fc2700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9700c7560 con 0x7fe9700b5ab0 2023-11-26T07:16:33.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.485+0000 7fe974fc2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe970137ff0 con 0x7fe97006ee60 2023-11-26T07:16:33.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.485+0000 7fe974fc2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9700c68e0 con 0x7fe97006b620 2023-11-26T07:16:33.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.485+0000 7fe96ed9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9700b5ab0 0x7fe970144780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:33.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.485+0000 7fe96ed9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9700b5ab0 0x7fe970144780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44228/0 (socket says 172.21.15.2:44228) 2023-11-26T07:16:33.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.485+0000 7fe96ed9d700 1 -- 172.21.15.2:0/3048148143 learned_addr learned my addr 172.21.15.2:0/3048148143 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:33.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.485+0000 7fe96e59c700 1 --2- 172.21.15.2:0/3048148143 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe97006b620 0x7fe970137ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:33.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.485+0000 7fe96dd9b700 1 --2- 172.21.15.2:0/3048148143 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe97006ee60 0x7fe970144240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:33.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.485+0000 7fe96ed9d700 1 -- 172.21.15.2:0/3048148143 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe97006b620 msgr2=0x7fe970137ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:33.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.485+0000 7fe96ed9d700 1 --2- 172.21.15.2:0/3048148143 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe97006b620 0x7fe970137ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:33.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.485+0000 7fe96ed9d700 1 -- 172.21.15.2:0/3048148143 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe97006ee60 msgr2=0x7fe970144240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:33.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.485+0000 7fe96ed9d700 1 --2- 172.21.15.2:0/3048148143 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe97006ee60 0x7fe970144240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:33.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.485+0000 7fe96ed9d700 1 -- 172.21.15.2:0/3048148143 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe964009550 con 0x7fe9700b5ab0 2023-11-26T07:16:33.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.485+0000 7fe96dd9b700 1 --2- 172.21.15.2:0/3048148143 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe97006ee60 0x7fe970144240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:16:33.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.485+0000 7fe96ed9d700 1 --2- 172.21.15.2:0/3048148143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9700b5ab0 0x7fe970144780 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fe968002230 tx=0x7fe96800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:33.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.486+0000 7fe95effd700 1 -- 172.21.15.2:0/3048148143 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96800ab70 con 0x7fe9700b5ab0 2023-11-26T07:16:33.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.486+0000 7fe95effd700 1 -- 172.21.15.2:0/3048148143 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe96800acf0 con 0x7fe9700b5ab0 2023-11-26T07:16:33.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.486+0000 7fe974fc2700 1 -- 172.21.15.2:0/3048148143 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9700c6bc0 con 0x7fe9700b5ab0 2023-11-26T07:16:33.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.486+0000 7fe95effd700 1 -- 172.21.15.2:0/3048148143 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe968007310 con 0x7fe9700b5ab0 2023-11-26T07:16:33.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.486+0000 7fe974fc2700 1 -- 172.21.15.2:0/3048148143 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9700c7180 con 0x7fe9700b5ab0 2023-11-26T07:16:33.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.487+0000 7fe974fc2700 1 -- 172.21.15.2:0/3048148143 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9700c76a0 con 0x7fe9700b5ab0 2023-11-26T07:16:33.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.487+0000 7fe95effd700 1 -- 172.21.15.2:0/3048148143 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7fe968007470 con 0x7fe9700b5ab0 2023-11-26T07:16:33.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.487+0000 7fe95effd700 1 --2- 172.21.15.2:0/3048148143 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe95006b740 0x7fe95006dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:33.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.488+0000 7fe95effd700 1 -- 172.21.15.2:0/3048148143 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe968087e30 con 0x7fe9700b5ab0 2023-11-26T07:16:33.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.488+0000 7fe96e59c700 1 --2- 172.21.15.2:0/3048148143 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe95006b740 0x7fe95006dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:33.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.488+0000 7fe96e59c700 1 --2- 172.21.15.2:0/3048148143 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe95006b740 0x7fe95006dc00 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe964014040 tx=0x7fe96401c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:33.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.492+0000 7fe95effd700 1 -- 172.21.15.2:0/3048148143 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe9700c76a0 con 0x7fe9700b5ab0 2023-11-26T07:16:33.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:33.743+0000 7fe974fc2700 1 -- 172.21.15.2:0/3048148143 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe9700c76a0 con 0x7fe9700b5ab0 2023-11-26T07:16:34.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.626+0000 7fe95effd700 1 -- 172.21.15.2:0/3048148143 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v45) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe9700c76a0 con 0x7fe9700b5ab0 2023-11-26T07:16:34.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.629+0000 7fe974fc2700 1 -- 172.21.15.2:0/3048148143 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe95006b740 msgr2=0x7fe95006dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:34.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.629+0000 7fe974fc2700 1 --2- 172.21.15.2:0/3048148143 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe95006b740 0x7fe95006dc00 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe964014040 tx=0x7fe96401c040 comp rx=0 tx=0).stop 2023-11-26T07:16:34.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.629+0000 7fe974fc2700 1 -- 172.21.15.2:0/3048148143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9700b5ab0 msgr2=0x7fe970144780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:34.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.629+0000 7fe974fc2700 1 --2- 172.21.15.2:0/3048148143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9700b5ab0 0x7fe970144780 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fe968002230 tx=0x7fe96800cf50 comp rx=0 tx=0).stop 2023-11-26T07:16:34.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.629+0000 7fe974fc2700 1 -- 172.21.15.2:0/3048148143 shutdown_connections 2023-11-26T07:16:34.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.629+0000 7fe974fc2700 1 --2- 172.21.15.2:0/3048148143 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe95006b740 0x7fe95006dc00 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:34.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.629+0000 7fe974fc2700 1 --2- 172.21.15.2:0/3048148143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9700b5ab0 0x7fe970144780 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:34.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.629+0000 7fe974fc2700 1 --2- 172.21.15.2:0/3048148143 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe97006b620 0x7fe970137ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:34.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.629+0000 7fe974fc2700 1 --2- 172.21.15.2:0/3048148143 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe97006ee60 0x7fe970144240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:34.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.629+0000 7fe974fc2700 1 -- 172.21.15.2:0/3048148143 >> 172.21.15.2:0/3048148143 conn(0x7fe9700b2740 msgr2=0x7fe9700b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:34.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.630+0000 7fe974fc2700 1 -- 172.21.15.2:0/3048148143 shutdown_connections 2023-11-26T07:16:34.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.630+0000 7fe974fc2700 1 -- 172.21.15.2:0/3048148143 wait complete. 2023-11-26T07:16:34.647 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-26T07:16:34.648 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-26T07:16:34.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.781+0000 7f1863f0b700 1 Processor -- start 2023-11-26T07:16:34.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.782+0000 7f1863f0b700 1 -- start start 2023-11-26T07:16:34.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.782+0000 7f1863f0b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f185c15f610 0x7f185c0b2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:34.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.782+0000 7f1863f0b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f185c0d01f0 0x7f185c0cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:34.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.782+0000 7f1863f0b700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f185c0d0c70 con 0x7f185c0cf0e0 2023-11-26T07:16:34.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.782+0000 7f1863f0b700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f185c0b3570 con 0x7f185c0d01f0 2023-11-26T07:16:34.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.782+0000 7f1863f0b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185c0d06b0 con 0x7f185c15f610 2023-11-26T07:16:34.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.783+0000 7f18614a6700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f185c0cf0e0 0x7f185c0cfae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35442/0 (socket says 172.21.15.2:35442) 2023-11-26T07:16:34.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.783+0000 7f18614a6700 1 -- 172.21.15.2:0/3504023676 learned_addr learned my addr 172.21.15.2:0/3504023676 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:16:34.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.783+0000 7f18624a8700 1 --2- 172.21.15.2:0/3504023676 >> v2:172.21.15.2:3300/0 conn(0x7f185c0d01f0 0x7f185c0cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:34.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.783+0000 7f1861ca7700 1 --2- 172.21.15.2:0/3504023676 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f185c15f610 0x7f185c0b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:34.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.783+0000 7f1860ca5700 1 -- 172.21.15.2:0/3504023676 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2200359852 0 0) 0x7f185c0d0c70 con 0x7f185c0cf0e0 2023-11-26T07:16:34.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.783+0000 7f1860ca5700 1 -- 172.21.15.2:0/3504023676 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18480035b0 con 0x7f185c0cf0e0 2023-11-26T07:16:34.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.783+0000 7f18624a8700 1 -- 172.21.15.2:0/3504023676 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f185c15f610 msgr2=0x7f185c0b2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:34.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.783+0000 7f18624a8700 1 --2- 172.21.15.2:0/3504023676 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f185c15f610 0x7f185c0b2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:34.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.783+0000 7f18624a8700 1 -- 172.21.15.2:0/3504023676 >> v1:172.21.15.2:6789/0 conn(0x7f185c0cf0e0 legacy=0x7f185c0cfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:34.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.783+0000 7f18624a8700 1 -- 172.21.15.2:0/3504023676 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f185c0d0990 con 0x7f185c0d01f0 2023-11-26T07:16:34.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.783+0000 7f18624a8700 1 --2- 172.21.15.2:0/3504023676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f185c0d01f0 0x7f185c0cd8b0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f1854009d90 tx=0x7f185400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79486f0d1fc5c70e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:34.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.783+0000 7f1860ca5700 1 -- 172.21.15.2:0/3504023676 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185400e070 con 0x7f185c0d01f0 2023-11-26T07:16:34.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.783+0000 7f1860ca5700 1 -- 172.21.15.2:0/3504023676 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185400bb20 con 0x7f185c0d01f0 2023-11-26T07:16:34.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.783+0000 7f1860ca5700 1 -- 172.21.15.2:0/3504023676 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1854012430 con 0x7f185c0d01f0 2023-11-26T07:16:34.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.784+0000 7f1863f0b700 1 -- 172.21.15.2:0/3504023676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f185c0d01f0 msgr2=0x7f185c0cd8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:34.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.784+0000 7f1863f0b700 1 --2- 172.21.15.2:0/3504023676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f185c0d01f0 0x7f185c0cd8b0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f1854009d90 tx=0x7f185400b330 comp rx=0 tx=0).stop 2023-11-26T07:16:34.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.784+0000 7f1863f0b700 1 -- 172.21.15.2:0/3504023676 shutdown_connections 2023-11-26T07:16:34.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.784+0000 7f1863f0b700 1 --2- 172.21.15.2:0/3504023676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f185c0d01f0 0x7f185c0cd8b0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:34.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.784+0000 7f1863f0b700 1 --2- 172.21.15.2:0/3504023676 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f185c15f610 0x7f185c0b2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:34.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.784+0000 7f1863f0b700 1 -- 172.21.15.2:0/3504023676 >> 172.21.15.2:0/3504023676 conn(0x7f185c0b3790 msgr2=0x7f185c0b3ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:34.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.784+0000 7f1863f0b700 1 -- 172.21.15.2:0/3504023676 shutdown_connections 2023-11-26T07:16:34.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.784+0000 7f1863f0b700 1 -- 172.21.15.2:0/3504023676 wait complete. 2023-11-26T07:16:34.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.785+0000 7f1863f0b700 1 Processor -- start 2023-11-26T07:16:34.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.785+0000 7f1863f0b700 1 -- start start 2023-11-26T07:16:34.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.786+0000 7f1863f0b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f185c0cf0e0 0x7f185c06d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:34.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.786+0000 7f1863f0b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f185c0d01f0 0x7f185c0c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:34.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.786+0000 7f1863f0b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f185c15f610 0x7f185c0c6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:34.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.786+0000 7f1863f0b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185c06dee0 con 0x7f185c0d01f0 2023-11-26T07:16:34.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.786+0000 7f1863f0b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185c06d960 con 0x7f185c0cf0e0 2023-11-26T07:16:34.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.786+0000 7f1863f0b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185c06cf90 con 0x7f185c15f610 2023-11-26T07:16:34.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.786+0000 7f18614a6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f185c0d01f0 0x7f185c0c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:34.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.786+0000 7f18614a6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f185c0d01f0 0x7f185c0c96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44240/0 (socket says 172.21.15.2:44240) 2023-11-26T07:16:34.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.786+0000 7f18614a6700 1 -- 172.21.15.2:0/3041242188 learned_addr learned my addr 172.21.15.2:0/3041242188 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:34.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.786+0000 7f18624a8700 1 --2- 172.21.15.2:0/3041242188 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f185c15f610 0x7f185c0c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:34.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.786+0000 7f1861ca7700 1 --2- 172.21.15.2:0/3041242188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f185c0cf0e0 0x7f185c06d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:34.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.786+0000 7f18614a6700 1 -- 172.21.15.2:0/3041242188 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f185c15f610 msgr2=0x7f185c0c6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:34.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.786+0000 7f18614a6700 1 --2- 172.21.15.2:0/3041242188 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f185c15f610 0x7f185c0c6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:34.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.786+0000 7f18614a6700 1 -- 172.21.15.2:0/3041242188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f185c0cf0e0 msgr2=0x7f185c06d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:34.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.786+0000 7f18614a6700 1 --2- 172.21.15.2:0/3041242188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f185c0cf0e0 0x7f185c06d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:34.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.786+0000 7f18614a6700 1 -- 172.21.15.2:0/3041242188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1854009a70 con 0x7f185c0d01f0 2023-11-26T07:16:34.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.786+0000 7f1861ca7700 1 --2- 172.21.15.2:0/3041242188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f185c0cf0e0 0x7f185c06d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:16:34.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.786+0000 7f18614a6700 1 --2- 172.21.15.2:0/3041242188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f185c0d01f0 0x7f185c0c96c0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f185800c4d0 tx=0x7f185800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:34.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.787+0000 7f18527fc700 1 -- 172.21.15.2:0/3041242188 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1858005d70 con 0x7f185c0d01f0 2023-11-26T07:16:34.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.787+0000 7f18527fc700 1 -- 172.21.15.2:0/3041242188 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18580070d0 con 0x7f185c0d01f0 2023-11-26T07:16:34.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.787+0000 7f1863f0b700 1 -- 172.21.15.2:0/3041242188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f185c15b760 con 0x7f185c0d01f0 2023-11-26T07:16:34.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.787+0000 7f18527fc700 1 -- 172.21.15.2:0/3041242188 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1858007460 con 0x7f185c0d01f0 2023-11-26T07:16:34.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.787+0000 7f1863f0b700 1 -- 172.21.15.2:0/3041242188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f185c06c130 con 0x7f185c0d01f0 2023-11-26T07:16:34.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.788+0000 7f1863f0b700 1 -- 172.21.15.2:0/3041242188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f185c0694b0 con 0x7f185c0d01f0 2023-11-26T07:16:34.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.788+0000 7f18527fc700 1 -- 172.21.15.2:0/3041242188 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f18580075c0 con 0x7f185c0d01f0 2023-11-26T07:16:34.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.788+0000 7f18527fc700 1 --2- 172.21.15.2:0/3041242188 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f184006b740 0x7f184006dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:34.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.789+0000 7f18527fc700 1 -- 172.21.15.2:0/3041242188 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1858087420 con 0x7f185c0d01f0 2023-11-26T07:16:34.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.789+0000 7f1861ca7700 1 --2- 172.21.15.2:0/3041242188 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f184006b740 0x7f184006dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:34.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.789+0000 7f1861ca7700 1 --2- 172.21.15.2:0/3041242188 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f184006b740 0x7f184006dc00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f184c0099f0 tx=0x7f184c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:34.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:34.793+0000 7f18527fc700 1 -- 172.21.15.2:0/3041242188 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1858053db0 con 0x7f185c0d01f0 2023-11-26T07:16:35.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.043+0000 7f1863f0b700 1 -- 172.21.15.2:0/3041242188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f185c075480 con 0x7f185c0d01f0 2023-11-26T07:16:35.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.628+0000 7f18527fc700 1 -- 172.21.15.2:0/3041242188 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v46) v1 ==== 122+0+0 (secure 0 0 0) 0x7f18580170c0 con 0x7f185c0d01f0 2023-11-26T07:16:35.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.630+0000 7f1863f0b700 1 -- 172.21.15.2:0/3041242188 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f184006b740 msgr2=0x7f184006dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:35.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.630+0000 7f1863f0b700 1 --2- 172.21.15.2:0/3041242188 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f184006b740 0x7f184006dc00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f184c0099f0 tx=0x7f184c008040 comp rx=0 tx=0).stop 2023-11-26T07:16:35.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.630+0000 7f1863f0b700 1 -- 172.21.15.2:0/3041242188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f185c0d01f0 msgr2=0x7f185c0c96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:35.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.630+0000 7f1863f0b700 1 --2- 172.21.15.2:0/3041242188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f185c0d01f0 0x7f185c0c96c0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f185800c4d0 tx=0x7f185800c7e0 comp rx=0 tx=0).stop 2023-11-26T07:16:35.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.631+0000 7f1863f0b700 1 -- 172.21.15.2:0/3041242188 shutdown_connections 2023-11-26T07:16:35.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.631+0000 7f1863f0b700 1 --2- 172.21.15.2:0/3041242188 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f184006b740 0x7f184006dc00 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:35.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.631+0000 7f1863f0b700 1 --2- 172.21.15.2:0/3041242188 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f185c15f610 0x7f185c0c6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:35.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.631+0000 7f1863f0b700 1 --2- 172.21.15.2:0/3041242188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f185c0cf0e0 0x7f185c06d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:35.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.631+0000 7f1863f0b700 1 --2- 172.21.15.2:0/3041242188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f185c0d01f0 0x7f185c0c96c0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:35.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.631+0000 7f1863f0b700 1 -- 172.21.15.2:0/3041242188 >> 172.21.15.2:0/3041242188 conn(0x7f185c0b3790 msgr2=0x7f185c15cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:35.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.631+0000 7f1863f0b700 1 -- 172.21.15.2:0/3041242188 shutdown_connections 2023-11-26T07:16:35.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.631+0000 7f1863f0b700 1 -- 172.21.15.2:0/3041242188 wait complete. 2023-11-26T07:16:35.647 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-26T07:16:35.647 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:16:35.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.773+0000 7fc5717d7700 1 Processor -- start 2023-11-26T07:16:35.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.773+0000 7fc5717d7700 1 -- start start 2023-11-26T07:16:35.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.773+0000 7fc5717d7700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc56c0d49d0 0x7fc56c0d2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:35.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.773+0000 7fc5717d7700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc56c0d29d0 0x7fc56c0b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:35.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.773+0000 7fc5717d7700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc56c0d4e50 con 0x7fc56c15e460 2023-11-26T07:16:35.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.773+0000 7fc5717d7700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc56c0d2e40 con 0x7fc56c0d49d0 2023-11-26T07:16:35.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.773+0000 7fc5717d7700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc56c0b3370 con 0x7fc56c0d29d0 2023-11-26T07:16:35.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.774+0000 7fc56a7fc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc56c0d49d0 0x7fc56c0d2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:35.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.774+0000 7fc56affd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc56c15e460 0x7fc56c0cf480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35456/0 (socket says 172.21.15.2:35456) 2023-11-26T07:16:35.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.774+0000 7fc56affd700 1 -- 172.21.15.2:0/2809373174 learned_addr learned my addr 172.21.15.2:0/2809373174 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:16:35.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.774+0000 7fc56b7fe700 1 --2- 172.21.15.2:0/2809373174 >> v2:172.21.15.192:3300/0 conn(0x7fc56c0d29d0 0x7fc56c0b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:35.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.774+0000 7fc56a7fc700 1 -- 172.21.15.2:0/2809373174 >> v2:172.21.15.192:3300/0 conn(0x7fc56c0d29d0 msgr2=0x7fc56c0b40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:35.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.774+0000 7fc56a7fc700 1 --2- 172.21.15.2:0/2809373174 >> v2:172.21.15.192:3300/0 conn(0x7fc56c0d29d0 0x7fc56c0b40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:35.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.774+0000 7fc56a7fc700 1 -- 172.21.15.2:0/2809373174 >> v1:172.21.15.2:6789/0 conn(0x7fc56c15e460 legacy=0x7fc56c0cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:35.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.774+0000 7fc56a7fc700 1 -- 172.21.15.2:0/2809373174 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc56c0cfc40 con 0x7fc56c0d49d0 2023-11-26T07:16:35.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.774+0000 7fc56b7fe700 1 --2- 172.21.15.2:0/2809373174 >> v2:172.21.15.192:3300/0 conn(0x7fc56c0d29d0 0x7fc56c0b40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:16:35.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.774+0000 7fc569ffb700 1 -- 172.21.15.2:0/2809373174 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2353807920 0 0) 0x7fc56c0d4e50 con 0x7fc56c15e460 2023-11-26T07:16:35.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.774+0000 7fc56a7fc700 1 --2- 172.21.15.2:0/2809373174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc56c0d49d0 0x7fc56c0d2490 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fc56c08d240 tx=0x7fc55c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7692aa51d38ef393 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:35.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.774+0000 7fc569ffb700 1 -- 172.21.15.2:0/2809373174 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55c011830 con 0x7fc56c0d49d0 2023-11-26T07:16:35.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.774+0000 7fc569ffb700 1 -- 172.21.15.2:0/2809373174 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc55c011990 con 0x7fc56c0d49d0 2023-11-26T07:16:35.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.774+0000 7fc569ffb700 1 -- 172.21.15.2:0/2809373174 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55c011d20 con 0x7fc56c0d49d0 2023-11-26T07:16:35.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.775+0000 7fc5717d7700 1 -- 172.21.15.2:0/2809373174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc56c0d49d0 msgr2=0x7fc56c0d2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:35.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.775+0000 7fc5717d7700 1 --2- 172.21.15.2:0/2809373174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc56c0d49d0 0x7fc56c0d2490 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fc56c08d240 tx=0x7fc55c009b20 comp rx=0 tx=0).stop 2023-11-26T07:16:35.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.775+0000 7fc5717d7700 1 -- 172.21.15.2:0/2809373174 shutdown_connections 2023-11-26T07:16:35.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.775+0000 7fc5717d7700 1 --2- 172.21.15.2:0/2809373174 >> v2:172.21.15.192:3300/0 conn(0x7fc56c0d29d0 0x7fc56c0b40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:35.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.775+0000 7fc5717d7700 1 --2- 172.21.15.2:0/2809373174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc56c0d49d0 0x7fc56c0d2490 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:35.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.775+0000 7fc5717d7700 1 -- 172.21.15.2:0/2809373174 >> 172.21.15.2:0/2809373174 conn(0x7fc56c0d3eb0 msgr2=0x7fc56c0d42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:35.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.775+0000 7fc5717d7700 1 -- 172.21.15.2:0/2809373174 shutdown_connections 2023-11-26T07:16:35.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.775+0000 7fc5717d7700 1 -- 172.21.15.2:0/2809373174 wait complete. 2023-11-26T07:16:35.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.776+0000 7fc5717d7700 1 Processor -- start 2023-11-26T07:16:35.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.776+0000 7fc5717d7700 1 -- start start 2023-11-26T07:16:35.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.777+0000 7fc5717d7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc56c0d29d0 0x7fc56c0c9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:35.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.777+0000 7fc5717d7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc56c0d49d0 0x7fc56c15f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:35.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.777+0000 7fc5717d7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc56c15e460 0x7fc56c15f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:35.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.777+0000 7fc5717d7700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56c0b6ab0 con 0x7fc56c0d49d0 2023-11-26T07:16:35.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.777+0000 7fc5717d7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56c0c9460 con 0x7fc56c15e460 2023-11-26T07:16:35.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.777+0000 7fc5717d7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc56c0c9180 con 0x7fc56c0d29d0 2023-11-26T07:16:35.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.777+0000 7fc56a7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc56c0d49d0 0x7fc56c15f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:35.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.777+0000 7fc56a7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc56c0d49d0 0x7fc56c15f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44254/0 (socket says 172.21.15.2:44254) 2023-11-26T07:16:35.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.777+0000 7fc56a7fc700 1 -- 172.21.15.2:0/3758740476 learned_addr learned my addr 172.21.15.2:0/3758740476 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:35.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.777+0000 7fc56affd700 1 --2- 172.21.15.2:0/3758740476 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc56c0d29d0 0x7fc56c0c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:35.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.777+0000 7fc56b7fe700 1 --2- 172.21.15.2:0/3758740476 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc56c15e460 0x7fc56c15f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:35.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.777+0000 7fc56a7fc700 1 -- 172.21.15.2:0/3758740476 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc56c0d29d0 msgr2=0x7fc56c0c9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:35.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.777+0000 7fc56a7fc700 1 --2- 172.21.15.2:0/3758740476 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc56c0d29d0 0x7fc56c0c9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:35.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.777+0000 7fc56a7fc700 1 -- 172.21.15.2:0/3758740476 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc56c15e460 msgr2=0x7fc56c15f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:35.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.777+0000 7fc56a7fc700 1 --2- 172.21.15.2:0/3758740476 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc56c15e460 0x7fc56c15f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:35.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.777+0000 7fc56a7fc700 1 -- 172.21.15.2:0/3758740476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc55c0094a0 con 0x7fc56c0d49d0 2023-11-26T07:16:35.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.777+0000 7fc56affd700 1 --2- 172.21.15.2:0/3758740476 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc56c0d29d0 0x7fc56c0c9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:16:35.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.777+0000 7fc56b7fe700 1 --2- 172.21.15.2:0/3758740476 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc56c15e460 0x7fc56c15f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:16:35.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.778+0000 7fc56a7fc700 1 --2- 172.21.15.2:0/3758740476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc56c0d49d0 0x7fc56c15f450 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fc55c000c00 tx=0x7fc55c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:35.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.778+0000 7fc5537fe700 1 -- 172.21.15.2:0/3758740476 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55c0038a0 con 0x7fc56c0d49d0 2023-11-26T07:16:35.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.778+0000 7fc5537fe700 1 -- 172.21.15.2:0/3758740476 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc55c01f070 con 0x7fc56c0d49d0 2023-11-26T07:16:35.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.778+0000 7fc5717d7700 1 -- 172.21.15.2:0/3758740476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc56c15e970 con 0x7fc56c0d49d0 2023-11-26T07:16:35.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.778+0000 7fc5537fe700 1 -- 172.21.15.2:0/3758740476 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55c003c60 con 0x7fc56c0d49d0 2023-11-26T07:16:35.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.778+0000 7fc5717d7700 1 -- 172.21.15.2:0/3758740476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc56c15ef30 con 0x7fc56c0d49d0 2023-11-26T07:16:35.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.779+0000 7fc5717d7700 1 -- 172.21.15.2:0/3758740476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc56c15f0f0 con 0x7fc56c0d49d0 2023-11-26T07:16:35.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.779+0000 7fc5537fe700 1 -- 172.21.15.2:0/3758740476 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7fc55c01a430 con 0x7fc56c0d49d0 2023-11-26T07:16:35.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.780+0000 7fc5537fe700 1 --2- 172.21.15.2:0/3758740476 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc55806b740 0x7fc55806dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:35.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.780+0000 7fc5537fe700 1 -- 172.21.15.2:0/3758740476 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc55c021070 con 0x7fc56c0d49d0 2023-11-26T07:16:35.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.780+0000 7fc56affd700 1 --2- 172.21.15.2:0/3758740476 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc55806b740 0x7fc55806dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:35.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.781+0000 7fc56affd700 1 --2- 172.21.15.2:0/3758740476 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc55806b740 0x7fc55806dc00 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc560000f60 tx=0x7fc560007d30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:35.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:35.784+0000 7fc5537fe700 1 -- 172.21.15.2:0/3758740476 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc55c056430 con 0x7fc56c0d49d0 2023-11-26T07:16:36.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.029+0000 7fc5717d7700 1 -- 172.21.15.2:0/3758740476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc56c15f2a0 con 0x7fc56c0d49d0 2023-11-26T07:16:36.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.030+0000 7fc5537fe700 1 -- 172.21.15.2:0/3758740476 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4912 (secure 0 0 0) 0x7fc55c015020 con 0x7fc56c0d49d0 2023-11-26T07:16:36.033 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:16:36.033 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":46,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5678,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3437634953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3437634953},{"type":"v1","addr":"172.21.15.192:6835","nonce":3437634953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":5684,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2624944008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2624944008},{"type":"v1","addr":"172.21.15.192:6837","nonce":2624944008}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6711,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/1847794001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1847794001},{"type":"v1","addr":"172.21.15.2:6834","nonce":1847794001}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:16:32.014651+0000","modified":"2023-11-26T07:16:35.045399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6714},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6714":{"gid":6714,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6835/177641343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":177641343},{"type":"v1","addr":"172.21.15.2:6835","nonce":177641343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-26T07:16:36.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.032+0000 7fc5717d7700 1 -- 172.21.15.2:0/3758740476 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc55806b740 msgr2=0x7fc55806dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:36.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.032+0000 7fc5717d7700 1 --2- 172.21.15.2:0/3758740476 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc55806b740 0x7fc55806dc00 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc560000f60 tx=0x7fc560007d30 comp rx=0 tx=0).stop 2023-11-26T07:16:36.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.032+0000 7fc5717d7700 1 -- 172.21.15.2:0/3758740476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc56c0d49d0 msgr2=0x7fc56c15f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:36.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.032+0000 7fc5717d7700 1 --2- 172.21.15.2:0/3758740476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc56c0d49d0 0x7fc56c15f450 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fc55c000c00 tx=0x7fc55c004750 comp rx=0 tx=0).stop 2023-11-26T07:16:36.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.032+0000 7fc5717d7700 1 -- 172.21.15.2:0/3758740476 shutdown_connections 2023-11-26T07:16:36.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.032+0000 7fc5717d7700 1 --2- 172.21.15.2:0/3758740476 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc55806b740 0x7fc55806dc00 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:36.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.032+0000 7fc5717d7700 1 --2- 172.21.15.2:0/3758740476 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc56c15e460 0x7fc56c15f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:36.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.032+0000 7fc5717d7700 1 --2- 172.21.15.2:0/3758740476 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc56c0d29d0 0x7fc56c0c9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:36.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.032+0000 7fc5717d7700 1 --2- 172.21.15.2:0/3758740476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc56c0d49d0 0x7fc56c15f450 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:36.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.032+0000 7fc5717d7700 1 -- 172.21.15.2:0/3758740476 >> 172.21.15.2:0/3758740476 conn(0x7fc56c0d3eb0 msgr2=0x7fc56c06ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:36.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.032+0000 7fc5717d7700 1 -- 172.21.15.2:0/3758740476 shutdown_connections 2023-11-26T07:16:36.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.032+0000 7fc5717d7700 1 -- 172.21.15.2:0/3758740476 wait complete. 2023-11-26T07:16:36.036 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 46 2023-11-26T07:16:36.047 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:16:36.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.169+0000 7f9a131d3700 1 Processor -- start 2023-11-26T07:16:36.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.169+0000 7f9a131d3700 1 -- start start 2023-11-26T07:16:36.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.170+0000 7f9a131d3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a0c0cf2b0 0x7f9a0c15c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:36.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.170+0000 7f9a131d3700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9a0c0ce5c0 0x7f9a0c0cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:36.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.170+0000 7f9a131d3700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a0c0d0a90 con 0x7f9a0c15bde0 2023-11-26T07:16:36.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.170+0000 7f9a131d3700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a0c0cefb0 con 0x7f9a0c0ce5c0 2023-11-26T07:16:36.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.170+0000 7f9a131d3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c06ee10 con 0x7f9a0c0cf2b0 2023-11-26T07:16:36.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.170+0000 7f9a11770700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9a0c0ce5c0 0x7f9a0c0cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:36.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.170+0000 7f9a11770700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9a0c0ce5c0 0x7f9a0c0cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44262/0 (socket says 172.21.15.2:44262) 2023-11-26T07:16:36.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.170+0000 7f9a11770700 1 -- 172.21.15.2:0/232909563 learned_addr learned my addr 172.21.15.2:0/232909563 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:36.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.170+0000 7f9a0bfff700 1 --2- 172.21.15.2:0/232909563 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a0c0cf2b0 0x7f9a0c15c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:36.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.170+0000 7f9a11770700 1 -- 172.21.15.2:0/232909563 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a0c0cf2b0 msgr2=0x7f9a0c15c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:36.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.170+0000 7f9a11770700 1 --2- 172.21.15.2:0/232909563 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a0c0cf2b0 0x7f9a0c15c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:36.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.170+0000 7f9a11770700 1 -- 172.21.15.2:0/232909563 >> v1:172.21.15.192:6789/0 conn(0x7f9a0c15bde0 legacy=0x7f9a0c0d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:36.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.170+0000 7f9a11770700 1 -- 172.21.15.2:0/232909563 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a0c06f0f0 con 0x7f9a0c0ce5c0 2023-11-26T07:16:36.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.170+0000 7f9a11770700 1 --2- 172.21.15.2:0/232909563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a0c0ce5c0 0x7f9a0c0cea70 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f9a04009e50 tx=0x7f9a0400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da42e305d185221b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:36.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.170+0000 7f9a0b7fe700 1 -- 172.21.15.2:0/232909563 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0400e070 con 0x7f9a0c0ce5c0 2023-11-26T07:16:36.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.171+0000 7f9a0b7fe700 1 -- 172.21.15.2:0/232909563 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0400b9c0 con 0x7f9a0c0ce5c0 2023-11-26T07:16:36.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.171+0000 7f9a0b7fe700 1 -- 172.21.15.2:0/232909563 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0400bd70 con 0x7f9a0c0ce5c0 2023-11-26T07:16:36.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.171+0000 7f9a131d3700 1 -- 172.21.15.2:0/232909563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a0c0ce5c0 msgr2=0x7f9a0c0cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:36.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.171+0000 7f9a131d3700 1 --2- 172.21.15.2:0/232909563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a0c0ce5c0 0x7f9a0c0cea70 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f9a04009e50 tx=0x7f9a0400b330 comp rx=0 tx=0).stop 2023-11-26T07:16:36.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.171+0000 7f9a131d3700 1 -- 172.21.15.2:0/232909563 shutdown_connections 2023-11-26T07:16:36.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.171+0000 7f9a131d3700 1 --2- 172.21.15.2:0/232909563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a0c0ce5c0 0x7f9a0c0cea70 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:36.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.171+0000 7f9a131d3700 1 --2- 172.21.15.2:0/232909563 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a0c0cf2b0 0x7f9a0c15c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:36.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.171+0000 7f9a131d3700 1 -- 172.21.15.2:0/232909563 >> 172.21.15.2:0/232909563 conn(0x7f9a0c0b3720 msgr2=0x7f9a0c0b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:36.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.171+0000 7f9a131d3700 1 -- 172.21.15.2:0/232909563 shutdown_connections 2023-11-26T07:16:36.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.171+0000 7f9a131d3700 1 -- 172.21.15.2:0/232909563 wait complete. 2023-11-26T07:16:36.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.173+0000 7f9a131d3700 1 Processor -- start 2023-11-26T07:16:36.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.173+0000 7f9a131d3700 1 -- start start 2023-11-26T07:16:36.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.174+0000 7f9a131d3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a0c0ce5c0 0x7f9a0c15a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:36.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.174+0000 7f9a131d3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a0c0cf2b0 0x7f9a0c0b6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:36.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.174+0000 7f9a131d3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a0c15bde0 0x7f9a0c0b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:36.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.174+0000 7f9a131d3700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c15f340 con 0x7f9a0c15bde0 2023-11-26T07:16:36.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.174+0000 7f9a131d3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c15abf0 con 0x7f9a0c0cf2b0 2023-11-26T07:16:36.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.174+0000 7f9a131d3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c15eeb0 con 0x7f9a0c0ce5c0 2023-11-26T07:16:36.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.174+0000 7f9a11770700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a0c15bde0 0x7f9a0c0b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:36.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.174+0000 7f9a11770700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a0c15bde0 0x7f9a0c0b6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44268/0 (socket says 172.21.15.2:44268) 2023-11-26T07:16:36.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.174+0000 7f9a11770700 1 -- 172.21.15.2:0/3516105189 learned_addr learned my addr 172.21.15.2:0/3516105189 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:36.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.174+0000 7f9a10f6f700 1 --2- 172.21.15.2:0/3516105189 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a0c0ce5c0 0x7f9a0c15a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:36.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.174+0000 7f9a0bfff700 1 --2- 172.21.15.2:0/3516105189 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a0c0cf2b0 0x7f9a0c0b6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:36.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.174+0000 7f9a11770700 1 -- 172.21.15.2:0/3516105189 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a0c0ce5c0 msgr2=0x7f9a0c15a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:36.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.174+0000 7f9a11770700 1 --2- 172.21.15.2:0/3516105189 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a0c0ce5c0 0x7f9a0c15a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:36.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.174+0000 7f9a11770700 1 -- 172.21.15.2:0/3516105189 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a0c0cf2b0 msgr2=0x7f9a0c0b6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:36.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.174+0000 7f9a11770700 1 --2- 172.21.15.2:0/3516105189 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a0c0cf2b0 0x7f9a0c0b6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:36.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.174+0000 7f9a11770700 1 -- 172.21.15.2:0/3516105189 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a04009b30 con 0x7f9a0c15bde0 2023-11-26T07:16:36.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.174+0000 7f9a11770700 1 --2- 172.21.15.2:0/3516105189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a0c15bde0 0x7f9a0c0b6d60 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c072340 tx=0x7f9a04004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:36.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.175+0000 7f9a097fa700 1 -- 172.21.15.2:0/3516105189 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a040047c0 con 0x7f9a0c15bde0 2023-11-26T07:16:36.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.175+0000 7f9a097fa700 1 -- 172.21.15.2:0/3516105189 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a040099b0 con 0x7f9a0c15bde0 2023-11-26T07:16:36.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.175+0000 7f9a131d3700 1 -- 172.21.15.2:0/3516105189 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a0c15e2a0 con 0x7f9a0c15bde0 2023-11-26T07:16:36.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.175+0000 7f9a097fa700 1 -- 172.21.15.2:0/3516105189 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0401c680 con 0x7f9a0c15bde0 2023-11-26T07:16:36.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.175+0000 7f9a131d3700 1 -- 172.21.15.2:0/3516105189 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a0c15e860 con 0x7f9a0c15bde0 2023-11-26T07:16:36.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.176+0000 7f9a131d3700 1 -- 172.21.15.2:0/3516105189 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a0c15f020 con 0x7f9a0c15bde0 2023-11-26T07:16:36.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.176+0000 7f9a097fa700 1 -- 172.21.15.2:0/3516105189 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f9a0401c7e0 con 0x7f9a0c15bde0 2023-11-26T07:16:36.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.176+0000 7f9a097fa700 1 --2- 172.21.15.2:0/3516105189 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f99f006b740 0x7f99f006dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:36.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.177+0000 7f9a097fa700 1 -- 172.21.15.2:0/3516105189 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9a04089a60 con 0x7f9a0c15bde0 2023-11-26T07:16:36.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.177+0000 7f9a10f6f700 1 --2- 172.21.15.2:0/3516105189 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f99f006b740 0x7f99f006dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:36.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.177+0000 7f9a10f6f700 1 --2- 172.21.15.2:0/3516105189 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f99f006b740 0x7f99f006dc00 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9a00007fd0 tx=0x7f9a00009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:36.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.181+0000 7f9a097fa700 1 -- 172.21.15.2:0/3516105189 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9a040565c0 con 0x7f9a0c15bde0 2023-11-26T07:16:36.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.385+0000 7f9a131d3700 1 -- 172.21.15.2:0/3516105189 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a0c068670 con 0x7f9a0c15bde0 2023-11-26T07:16:36.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.386+0000 7f9a097fa700 1 -- 172.21.15.2:0/3516105189 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+16520 (secure 0 0 0) 0x7f9a04059be0 con 0x7f9a0c15bde0 2023-11-26T07:16:36.389 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:16:36.389 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":73,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:16:33.597109+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:16:30.488040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-26T07:16:30.981722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:16:36.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.388+0000 7f9a131d3700 1 -- 172.21.15.2:0/3516105189 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f99f006b740 msgr2=0x7f99f006dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:36.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.388+0000 7f9a131d3700 1 --2- 172.21.15.2:0/3516105189 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f99f006b740 0x7f99f006dc00 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9a00007fd0 tx=0x7f9a00009040 comp rx=0 tx=0).stop 2023-11-26T07:16:36.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.388+0000 7f9a131d3700 1 -- 172.21.15.2:0/3516105189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a0c15bde0 msgr2=0x7f9a0c0b6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:36.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.388+0000 7f9a131d3700 1 --2- 172.21.15.2:0/3516105189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a0c15bde0 0x7f9a0c0b6d60 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c072340 tx=0x7f9a04004ad0 comp rx=0 tx=0).stop 2023-11-26T07:16:36.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.388+0000 7f9a131d3700 1 -- 172.21.15.2:0/3516105189 shutdown_connections 2023-11-26T07:16:36.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.388+0000 7f9a131d3700 1 --2- 172.21.15.2:0/3516105189 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f99f006b740 0x7f99f006dc00 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:36.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.388+0000 7f9a131d3700 1 --2- 172.21.15.2:0/3516105189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a0c15bde0 0x7f9a0c0b6d60 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:36.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.388+0000 7f9a131d3700 1 --2- 172.21.15.2:0/3516105189 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a0c0ce5c0 0x7f9a0c15a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:36.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.388+0000 7f9a131d3700 1 --2- 172.21.15.2:0/3516105189 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a0c0cf2b0 0x7f9a0c0b6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:36.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.388+0000 7f9a131d3700 1 -- 172.21.15.2:0/3516105189 >> 172.21.15.2:0/3516105189 conn(0x7f9a0c0b3720 msgr2=0x7f9a0c0cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:36.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.388+0000 7f9a131d3700 1 -- 172.21.15.2:0/3516105189 shutdown_connections 2023-11-26T07:16:36.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.388+0000 7f9a131d3700 1 -- 172.21.15.2:0/3516105189 wait complete. 2023-11-26T07:16:36.404 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-26T07:16:36.404 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:16:36.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.525+0000 7fc166b2a700 1 Processor -- start 2023-11-26T07:16:36.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.525+0000 7fc166b2a700 1 -- start start 2023-11-26T07:16:36.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.526+0000 7fc166b2a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc16015abb0 0x7fc1600b4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:36.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.526+0000 7fc166b2a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc1600724a0 0x7fc1600cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:36.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.526+0000 7fc166b2a700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc16006e550 con 0x7fc1600b4d50 2023-11-26T07:16:36.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.526+0000 7fc166b2a700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1600b51d0 con 0x7fc16015abb0 2023-11-26T07:16:36.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.526+0000 7fc166b2a700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc16006f3b0 con 0x7fc1600724a0 2023-11-26T07:16:36.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.526+0000 7fc1648c6700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc16015abb0 0x7fc1600b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:36.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.526+0000 7fc1648c6700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc16015abb0 0x7fc1600b4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44272/0 (socket says 172.21.15.2:44272) 2023-11-26T07:16:36.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.526+0000 7fc1648c6700 1 -- 172.21.15.2:0/2478954098 learned_addr learned my addr 172.21.15.2:0/2478954098 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:36.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.527+0000 7fc1650c7700 1 --2- 172.21.15.2:0/2478954098 >> v2:172.21.15.192:3300/0 conn(0x7fc1600724a0 0x7fc1600cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:36.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.527+0000 7fc1648c6700 1 -- 172.21.15.2:0/2478954098 >> v2:172.21.15.192:3300/0 conn(0x7fc1600724a0 msgr2=0x7fc1600cdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:36.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.527+0000 7fc1648c6700 1 --2- 172.21.15.2:0/2478954098 >> v2:172.21.15.192:3300/0 conn(0x7fc1600724a0 0x7fc1600cdee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:36.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.527+0000 7fc1648c6700 1 -- 172.21.15.2:0/2478954098 >> v1:172.21.15.192:6789/0 conn(0x7fc1600b4d50 legacy=0x7fc160071d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:36.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.527+0000 7fc1648c6700 1 -- 172.21.15.2:0/2478954098 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc16006e7a0 con 0x7fc16015abb0 2023-11-26T07:16:36.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.527+0000 7fc1648c6700 1 --2- 172.21.15.2:0/2478954098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc16015abb0 0x7fc1600b4810 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fc1600d0990 tx=0x7fc15400be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4474df7a18255415 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:36.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.527+0000 7fc15f7fe700 1 -- 172.21.15.2:0/2478954098 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15400dd30 con 0x7fc16015abb0 2023-11-26T07:16:36.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.527+0000 7fc15f7fe700 1 -- 172.21.15.2:0/2478954098 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc15400de90 con 0x7fc16015abb0 2023-11-26T07:16:36.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.527+0000 7fc15f7fe700 1 -- 172.21.15.2:0/2478954098 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc154010690 con 0x7fc16015abb0 2023-11-26T07:16:36.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.528+0000 7fc166b2a700 1 -- 172.21.15.2:0/2478954098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc16015abb0 msgr2=0x7fc1600b4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:36.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.528+0000 7fc166b2a700 1 --2- 172.21.15.2:0/2478954098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc16015abb0 0x7fc1600b4810 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fc1600d0990 tx=0x7fc15400be70 comp rx=0 tx=0).stop 2023-11-26T07:16:36.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.528+0000 7fc166b2a700 1 -- 172.21.15.2:0/2478954098 shutdown_connections 2023-11-26T07:16:36.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.528+0000 7fc166b2a700 1 --2- 172.21.15.2:0/2478954098 >> v2:172.21.15.192:3300/0 conn(0x7fc1600724a0 0x7fc1600cdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:36.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.528+0000 7fc166b2a700 1 --2- 172.21.15.2:0/2478954098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc16015abb0 0x7fc1600b4810 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:36.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.528+0000 7fc166b2a700 1 -- 172.21.15.2:0/2478954098 >> 172.21.15.2:0/2478954098 conn(0x7fc1600d0aa0 msgr2=0x7fc1600d0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:36.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.528+0000 7fc166b2a700 1 -- 172.21.15.2:0/2478954098 shutdown_connections 2023-11-26T07:16:36.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.528+0000 7fc166b2a700 1 -- 172.21.15.2:0/2478954098 wait complete. 2023-11-26T07:16:36.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.529+0000 7fc166b2a700 1 Processor -- start 2023-11-26T07:16:36.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.529+0000 7fc166b2a700 1 -- start start 2023-11-26T07:16:36.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.530+0000 7fc166b2a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1600724a0 0x7fc16014d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:36.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.530+0000 7fc166b2a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc1600b4d50 0x7fc1600cf160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:36.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.530+0000 7fc166b2a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc16015abb0 0x7fc16015d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:36.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.530+0000 7fc166b2a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16015b9d0 con 0x7fc1600724a0 2023-11-26T07:16:36.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.530+0000 7fc166b2a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16014cc20 con 0x7fc16015abb0 2023-11-26T07:16:36.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.530+0000 7fc166b2a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc16015bf00 con 0x7fc1600b4d50 2023-11-26T07:16:36.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.530+0000 7fc1648c6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1600724a0 0x7fc16014d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:36.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.530+0000 7fc1648c6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1600724a0 0x7fc16014d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44278/0 (socket says 172.21.15.2:44278) 2023-11-26T07:16:36.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.530+0000 7fc1648c6700 1 -- 172.21.15.2:0/3614840909 learned_addr learned my addr 172.21.15.2:0/3614840909 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:36.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.530+0000 7fc15ffff700 1 --2- 172.21.15.2:0/3614840909 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc1600b4d50 0x7fc1600cf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:36.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.530+0000 7fc1650c7700 1 --2- 172.21.15.2:0/3614840909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc16015abb0 0x7fc16015d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:36.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.530+0000 7fc1648c6700 1 -- 172.21.15.2:0/3614840909 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc1600b4d50 msgr2=0x7fc1600cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:36.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.530+0000 7fc1648c6700 1 --2- 172.21.15.2:0/3614840909 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc1600b4d50 0x7fc1600cf160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:36.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.530+0000 7fc1648c6700 1 -- 172.21.15.2:0/3614840909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc16015abb0 msgr2=0x7fc16015d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:36.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.530+0000 7fc1648c6700 1 --2- 172.21.15.2:0/3614840909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc16015abb0 0x7fc16015d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:36.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.530+0000 7fc1648c6700 1 -- 172.21.15.2:0/3614840909 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc15400b7f0 con 0x7fc1600724a0 2023-11-26T07:16:36.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.530+0000 7fc1648c6700 1 --2- 172.21.15.2:0/3614840909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1600724a0 0x7fc16014d670 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fc154000c00 tx=0x7fc154004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:36.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.530+0000 7fc15d7fa700 1 -- 172.21.15.2:0/3614840909 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15401f070 con 0x7fc1600724a0 2023-11-26T07:16:36.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.531+0000 7fc15d7fa700 1 -- 172.21.15.2:0/3614840909 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc154003ba0 con 0x7fc1600724a0 2023-11-26T07:16:36.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.531+0000 7fc166b2a700 1 -- 172.21.15.2:0/3614840909 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc16015c1e0 con 0x7fc1600724a0 2023-11-26T07:16:36.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.531+0000 7fc15d7fa700 1 -- 172.21.15.2:0/3614840909 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc154010470 con 0x7fc1600724a0 2023-11-26T07:16:36.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.531+0000 7fc166b2a700 1 -- 172.21.15.2:0/3614840909 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc16014d150 con 0x7fc1600724a0 2023-11-26T07:16:36.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.532+0000 7fc166b2a700 1 -- 172.21.15.2:0/3614840909 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc16014d340 con 0x7fc1600724a0 2023-11-26T07:16:36.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.532+0000 7fc15d7fa700 1 -- 172.21.15.2:0/3614840909 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7fc154019400 con 0x7fc1600724a0 2023-11-26T07:16:36.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.532+0000 7fc15d7fa700 1 --2- 172.21.15.2:0/3614840909 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc14406b740 0x7fc14406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:36.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.533+0000 7fc15d7fa700 1 -- 172.21.15.2:0/3614840909 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc15408b2c0 con 0x7fc1600724a0 2023-11-26T07:16:36.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.533+0000 7fc15ffff700 1 --2- 172.21.15.2:0/3614840909 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc14406b740 0x7fc14406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:36.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.533+0000 7fc15ffff700 1 --2- 172.21.15.2:0/3614840909 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc14406b740 0x7fc14406dc00 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc16015b320 tx=0x7fc14c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:36.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.537+0000 7fc15d7fa700 1 -- 172.21.15.2:0/3614840909 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc154057c50 con 0x7fc1600724a0 2023-11-26T07:16:36.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.735+0000 7fc166b2a700 1 -- 172.21.15.2:0/3614840909 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc16006f040 con 0x7fc14406b740 2023-11-26T07:16:36.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.744+0000 7fc15d7fa700 1 -- 172.21.15.2:0/3614840909 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283909 (secure 0 0 0) 0x7fc14c001490 con 0x7fc14406b740 2023-11-26T07:16:36.750 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:16:36.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.747+0000 7fc166b2a700 1 -- 172.21.15.2:0/3614840909 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc14406b740 msgr2=0x7fc14406dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:36.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.747+0000 7fc166b2a700 1 --2- 172.21.15.2:0/3614840909 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc14406b740 0x7fc14406dc00 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc16015b320 tx=0x7fc14c009040 comp rx=0 tx=0).stop 2023-11-26T07:16:36.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.747+0000 7fc166b2a700 1 -- 172.21.15.2:0/3614840909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1600724a0 msgr2=0x7fc16014d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:36.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.747+0000 7fc166b2a700 1 --2- 172.21.15.2:0/3614840909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1600724a0 0x7fc16014d670 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fc154000c00 tx=0x7fc154004750 comp rx=0 tx=0).stop 2023-11-26T07:16:36.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.747+0000 7fc166b2a700 1 -- 172.21.15.2:0/3614840909 shutdown_connections 2023-11-26T07:16:36.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.747+0000 7fc166b2a700 1 --2- 172.21.15.2:0/3614840909 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fc14406b740 0x7fc14406dc00 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:36.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.747+0000 7fc166b2a700 1 --2- 172.21.15.2:0/3614840909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc16015abb0 0x7fc16015d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:36.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.747+0000 7fc166b2a700 1 --2- 172.21.15.2:0/3614840909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1600724a0 0x7fc16014d670 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:36.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.747+0000 7fc166b2a700 1 --2- 172.21.15.2:0/3614840909 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc1600b4d50 0x7fc1600cf160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:36.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.747+0000 7fc166b2a700 1 -- 172.21.15.2:0/3614840909 >> 172.21.15.2:0/3614840909 conn(0x7fc1600d0aa0 msgr2=0x7fc1600b0540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:36.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.747+0000 7fc166b2a700 1 -- 172.21.15.2:0/3614840909 shutdown_connections 2023-11-26T07:16:36.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.747+0000 7fc166b2a700 1 -- 172.21.15.2:0/3614840909 wait complete. 2023-11-26T07:16:36.753 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-26T07:16:36.762 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":221,"stamp":"2023-11-26T07:16:36.230125+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257384,"kb_used_data":7900,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754717336,"statfs":{"total":773094113280,"available":772830552064,"internally_reserved":0,"allocated":8089600,"data_stored":4091285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.644691"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.599254+0000","last_change":"2023-11-26T07:16:31.599254+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.599254+0000","last_undegraded":"2023-11-26T07:16:31.599254+0000","last_fullsized":"2023-11-26T07:16:31.599254+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.598744+0000","last_change":"2023-11-26T07:16:31.598744+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.598744+0000","last_undegraded":"2023-11-26T07:16:31.598744+0000","last_fullsized":"2023-11-26T07:16:31.598744+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.596490+0000","last_change":"2023-11-26T07:16:31.596490+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.596490+0000","last_undegraded":"2023-11-26T07:16:31.596490+0000","last_fullsized":"2023-11-26T07:16:31.596490+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.594577+0000","last_change":"2023-11-26T07:16:31.594577+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.594577+0000","last_undegraded":"2023-11-26T07:16:31.594577+0000","last_fullsized":"2023-11-26T07:16:31.594577+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.601432+0000","last_change":"2023-11-26T07:16:31.601432+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.601432+0000","last_undegraded":"2023-11-26T07:16:31.601432+0000","last_fullsized":"2023-11-26T07:16:31.601432+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.598968+0000","last_change":"2023-11-26T07:16:31.598968+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.598968+0000","last_undegraded":"2023-11-26T07:16:31.598968+0000","last_fullsized":"2023-11-26T07:16:31.598968+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.594942+0000","last_change":"2023-11-26T07:16:31.594942+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.594942+0000","last_undegraded":"2023-11-26T07:16:31.594942+0000","last_fullsized":"2023-11-26T07:16:31.594942+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.598612+0000","last_change":"2023-11-26T07:16:31.598612+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.598612+0000","last_undegraded":"2023-11-26T07:16:31.598612+0000","last_fullsized":"2023-11-26T07:16:31.598612+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.600548+0000","last_change":"2023-11-26T07:16:31.600548+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.600548+0000","last_undegraded":"2023-11-26T07:16:31.600548+0000","last_fullsized":"2023-11-26T07:16:31.600548+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.591825+0000","last_change":"2023-11-26T07:16:31.591825+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.591825+0000","last_undegraded":"2023-11-26T07:16:31.591825+0000","last_fullsized":"2023-11-26T07:16:31.591825+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.597271+0000","last_change":"2023-11-26T07:16:31.597271+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.597271+0000","last_undegraded":"2023-11-26T07:16:31.597271+0000","last_fullsized":"2023-11-26T07:16:31.597271+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.594135+0000","last_change":"2023-11-26T07:16:31.594135+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.594135+0000","last_undegraded":"2023-11-26T07:16:31.594135+0000","last_fullsized":"2023-11-26T07:16:31.594135+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.595814+0000","last_change":"2023-11-26T07:16:31.595814+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.595814+0000","last_undegraded":"2023-11-26T07:16:31.595814+0000","last_fullsized":"2023-11-26T07:16:31.595814+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.601303+0000","last_change":"2023-11-26T07:16:31.601303+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.601303+0000","last_undegraded":"2023-11-26T07:16:31.601303+0000","last_fullsized":"2023-11-26T07:16:31.601303+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.595322+0000","last_change":"2023-11-26T07:16:31.595322+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.595322+0000","last_undegraded":"2023-11-26T07:16:31.595322+0000","last_fullsized":"2023-11-26T07:16:31.595322+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.591146+0000","last_change":"2023-11-26T07:16:31.591146+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.591146+0000","last_undegraded":"2023-11-26T07:16:31.591146+0000","last_fullsized":"2023-11-26T07:16:31.591146+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.600103+0000","last_change":"2023-11-26T07:16:31.600103+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.600103+0000","last_undegraded":"2023-11-26T07:16:31.600103+0000","last_fullsized":"2023-11-26T07:16:31.600103+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.593527+0000","last_change":"2023-11-26T07:16:31.593527+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.593527+0000","last_undegraded":"2023-11-26T07:16:31.593527+0000","last_fullsized":"2023-11-26T07:16:31.593527+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.598419+0000","last_change":"2023-11-26T07:16:31.598419+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.598419+0000","last_undegraded":"2023-11-26T07:16:31.598419+0000","last_fullsized":"2023-11-26T07:16:31.598419+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.593750+0000","last_change":"2023-11-26T07:16:31.593750+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.593750+0000","last_undegraded":"2023-11-26T07:16:31.593750+0000","last_fullsized":"2023-11-26T07:16:31.593750+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.591574+0000","last_change":"2023-11-26T07:16:31.591574+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.591574+0000","last_undegraded":"2023-11-26T07:16:31.591574+0000","last_fullsized":"2023-11-26T07:16:31.591574+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.591270+0000","last_change":"2023-11-26T07:16:31.591270+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.591270+0000","last_undegraded":"2023-11-26T07:16:31.591270+0000","last_fullsized":"2023-11-26T07:16:31.591270+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.598084+0000","last_change":"2023-11-26T07:16:31.598084+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.598084+0000","last_undegraded":"2023-11-26T07:16:31.598084+0000","last_fullsized":"2023-11-26T07:16:31.598084+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.595800+0000","last_change":"2023-11-26T07:16:31.595800+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.595800+0000","last_undegraded":"2023-11-26T07:16:31.595800+0000","last_fullsized":"2023-11-26T07:16:31.595800+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.591671+0000","last_change":"2023-11-26T07:16:31.591671+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.591671+0000","last_undegraded":"2023-11-26T07:16:31.591671+0000","last_fullsized":"2023-11-26T07:16:31.591671+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.594660+0000","last_change":"2023-11-26T07:16:31.594660+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.594660+0000","last_undegraded":"2023-11-26T07:16:31.594660+0000","last_fullsized":"2023-11-26T07:16:31.594660+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.595823+0000","last_change":"2023-11-26T07:16:31.595823+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.595823+0000","last_undegraded":"2023-11-26T07:16:31.595823+0000","last_fullsized":"2023-11-26T07:16:31.595823+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.590424+0000","last_change":"2023-11-26T07:16:31.590424+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.590424+0000","last_undegraded":"2023-11-26T07:16:31.590424+0000","last_fullsized":"2023-11-26T07:16:31.590424+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.595869+0000","last_change":"2023-11-26T07:16:31.595869+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.595869+0000","last_undegraded":"2023-11-26T07:16:31.595869+0000","last_fullsized":"2023-11-26T07:16:31.595869+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.594757+0000","last_change":"2023-11-26T07:16:31.594757+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.594757+0000","last_undegraded":"2023-11-26T07:16:31.594757+0000","last_fullsized":"2023-11-26T07:16:31.594757+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.594164+0000","last_change":"2023-11-26T07:16:31.594164+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.594164+0000","last_undegraded":"2023-11-26T07:16:31.594164+0000","last_fullsized":"2023-11-26T07:16:31.594164+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.594946+0000","last_change":"2023-11-26T07:16:31.594946+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.594946+0000","last_undegraded":"2023-11-26T07:16:31.594946+0000","last_fullsized":"2023-11-26T07:16:31.594946+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.595892+0000","last_change":"2023-11-26T07:16:31.595892+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.595892+0000","last_undegraded":"2023-11-26T07:16:31.595892+0000","last_fullsized":"2023-11-26T07:16:31.595892+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.609808+0000","last_change":"2023-11-26T07:16:31.609063+0000","last_active":"2023-11-26T07:16:31.609808+0000","last_peered":"2023-11-26T07:16:31.609808+0000","last_clean":"2023-11-26T07:16:31.609808+0000","last_became_active":"2023-11-26T07:16:31.608791+0000","last_became_peered":"2023-11-26T07:16:31.608791+0000","last_unstale":"2023-11-26T07:16:31.609808+0000","last_undegraded":"2023-11-26T07:16:31.609808+0000","last_fullsized":"2023-11-26T07:16:31.609808+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:18:47.861543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.599410+0000","last_change":"2023-11-26T07:16:31.599410+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.599410+0000","last_undegraded":"2023-11-26T07:16:31.599410+0000","last_fullsized":"2023-11-26T07:16:31.599410+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.607180+0000","last_change":"2023-11-26T07:16:31.604650+0000","last_active":"2023-11-26T07:16:31.607180+0000","last_peered":"2023-11-26T07:16:31.607180+0000","last_clean":"2023-11-26T07:16:31.607180+0000","last_became_active":"2023-11-26T07:16:31.603826+0000","last_became_peered":"2023-11-26T07:16:31.603826+0000","last_unstale":"2023-11-26T07:16:31.607180+0000","last_undegraded":"2023-11-26T07:16:31.607180+0000","last_fullsized":"2023-11-26T07:16:31.607180+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:47:37.657536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.595949+0000","last_change":"2023-11-26T07:16:31.595949+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.595949+0000","last_undegraded":"2023-11-26T07:16:31.595949+0000","last_fullsized":"2023-11-26T07:16:31.595949+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.609847+0000","last_change":"2023-11-26T07:16:31.606982+0000","last_active":"2023-11-26T07:16:31.609847+0000","last_peered":"2023-11-26T07:16:31.609847+0000","last_clean":"2023-11-26T07:16:31.609847+0000","last_became_active":"2023-11-26T07:16:31.606668+0000","last_became_peered":"2023-11-26T07:16:31.606668+0000","last_unstale":"2023-11-26T07:16:31.609847+0000","last_undegraded":"2023-11-26T07:16:31.609847+0000","last_fullsized":"2023-11-26T07:16:31.609847+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:49:13.892037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.596841+0000","last_change":"2023-11-26T07:16:31.596841+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.596841+0000","last_undegraded":"2023-11-26T07:16:31.596841+0000","last_fullsized":"2023-11-26T07:16:31.596841+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.608125+0000","last_change":"2023-11-26T07:16:31.606756+0000","last_active":"2023-11-26T07:16:31.608125+0000","last_peered":"2023-11-26T07:16:31.608125+0000","last_clean":"2023-11-26T07:16:31.608125+0000","last_became_active":"2023-11-26T07:16:31.606493+0000","last_became_peered":"2023-11-26T07:16:31.606493+0000","last_unstale":"2023-11-26T07:16:31.608125+0000","last_undegraded":"2023-11-26T07:16:31.608125+0000","last_fullsized":"2023-11-26T07:16:31.608125+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:06:48.106371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.593690+0000","last_change":"2023-11-26T07:16:31.593690+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.593690+0000","last_undegraded":"2023-11-26T07:16:31.593690+0000","last_fullsized":"2023-11-26T07:16:31.593690+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.601859+0000","last_change":"2023-11-26T07:16:31.598926+0000","last_active":"2023-11-26T07:16:31.601859+0000","last_peered":"2023-11-26T07:16:31.601859+0000","last_clean":"2023-11-26T07:16:31.601859+0000","last_became_active":"2023-11-26T07:16:31.598622+0000","last_became_peered":"2023-11-26T07:16:31.598622+0000","last_unstale":"2023-11-26T07:16:31.601859+0000","last_undegraded":"2023-11-26T07:16:31.601859+0000","last_fullsized":"2023-11-26T07:16:31.601859+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:04:22.685813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.590394+0000","last_change":"2023-11-26T07:16:31.590394+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.590394+0000","last_undegraded":"2023-11-26T07:16:31.590394+0000","last_fullsized":"2023-11-26T07:16:31.590394+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.610370+0000","last_change":"2023-11-26T07:16:31.608252+0000","last_active":"2023-11-26T07:16:31.610370+0000","last_peered":"2023-11-26T07:16:31.610370+0000","last_clean":"2023-11-26T07:16:31.610370+0000","last_became_active":"2023-11-26T07:16:31.607942+0000","last_became_peered":"2023-11-26T07:16:31.607942+0000","last_unstale":"2023-11-26T07:16:31.610370+0000","last_undegraded":"2023-11-26T07:16:31.610370+0000","last_fullsized":"2023-11-26T07:16:31.610370+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:55:42.677020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.599635+0000","last_change":"2023-11-26T07:16:31.599635+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.599635+0000","last_undegraded":"2023-11-26T07:16:31.599635+0000","last_fullsized":"2023-11-26T07:16:31.599635+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.602579+0000","last_change":"2023-11-26T07:16:31.597056+0000","last_active":"2023-11-26T07:16:31.602579+0000","last_peered":"2023-11-26T07:16:31.602579+0000","last_clean":"2023-11-26T07:16:31.602579+0000","last_became_active":"2023-11-26T07:16:31.596785+0000","last_became_peered":"2023-11-26T07:16:31.596785+0000","last_unstale":"2023-11-26T07:16:31.602579+0000","last_undegraded":"2023-11-26T07:16:31.602579+0000","last_fullsized":"2023-11-26T07:16:31.602579+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:00:37.336785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.593030+0000","last_change":"2023-11-26T07:16:31.593030+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.593030+0000","last_undegraded":"2023-11-26T07:16:31.593030+0000","last_fullsized":"2023-11-26T07:16:31.593030+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.610454+0000","last_change":"2023-11-26T07:16:31.608983+0000","last_active":"2023-11-26T07:16:31.610454+0000","last_peered":"2023-11-26T07:16:31.610454+0000","last_clean":"2023-11-26T07:16:31.610454+0000","last_became_active":"2023-11-26T07:16:31.608647+0000","last_became_peered":"2023-11-26T07:16:31.608647+0000","last_unstale":"2023-11-26T07:16:31.610454+0000","last_undegraded":"2023-11-26T07:16:31.610454+0000","last_fullsized":"2023-11-26T07:16:31.610454+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:31:11.200541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.594201+0000","last_change":"2023-11-26T07:16:31.594201+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.594201+0000","last_undegraded":"2023-11-26T07:16:31.594201+0000","last_fullsized":"2023-11-26T07:16:31.594201+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.604578+0000","last_change":"2023-11-26T07:16:31.597710+0000","last_active":"2023-11-26T07:16:31.604578+0000","last_peered":"2023-11-26T07:16:31.604578+0000","last_clean":"2023-11-26T07:16:31.604578+0000","last_became_active":"2023-11-26T07:16:31.597421+0000","last_became_peered":"2023-11-26T07:16:31.597421+0000","last_unstale":"2023-11-26T07:16:31.604578+0000","last_undegraded":"2023-11-26T07:16:31.604578+0000","last_fullsized":"2023-11-26T07:16:31.604578+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:21:29.309253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.598876+0000","last_change":"2023-11-26T07:16:31.598876+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.598876+0000","last_undegraded":"2023-11-26T07:16:31.598876+0000","last_fullsized":"2023-11-26T07:16:31.598876+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.608688+0000","last_change":"2023-11-26T07:16:31.607372+0000","last_active":"2023-11-26T07:16:31.608688+0000","last_peered":"2023-11-26T07:16:31.608688+0000","last_clean":"2023-11-26T07:16:31.608688+0000","last_became_active":"2023-11-26T07:16:31.607094+0000","last_became_peered":"2023-11-26T07:16:31.607094+0000","last_unstale":"2023-11-26T07:16:31.608688+0000","last_undegraded":"2023-11-26T07:16:31.608688+0000","last_fullsized":"2023-11-26T07:16:31.608688+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:35:30.163394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.595583+0000","last_change":"2023-11-26T07:16:31.595583+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.595583+0000","last_undegraded":"2023-11-26T07:16:31.595583+0000","last_fullsized":"2023-11-26T07:16:31.595583+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.601820+0000","last_change":"2023-11-26T07:16:31.598168+0000","last_active":"2023-11-26T07:16:31.601820+0000","last_peered":"2023-11-26T07:16:31.601820+0000","last_clean":"2023-11-26T07:16:31.601820+0000","last_became_active":"2023-11-26T07:16:31.597799+0000","last_became_peered":"2023-11-26T07:16:31.597799+0000","last_unstale":"2023-11-26T07:16:31.601820+0000","last_undegraded":"2023-11-26T07:16:31.601820+0000","last_fullsized":"2023-11-26T07:16:31.601820+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:25:16.232940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.599913+0000","last_change":"2023-11-26T07:16:31.599913+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.599913+0000","last_undegraded":"2023-11-26T07:16:31.599913+0000","last_fullsized":"2023-11-26T07:16:31.599913+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.608573+0000","last_change":"2023-11-26T07:16:31.605820+0000","last_active":"2023-11-26T07:16:31.608573+0000","last_peered":"2023-11-26T07:16:31.608573+0000","last_clean":"2023-11-26T07:16:31.608573+0000","last_became_active":"2023-11-26T07:16:31.604337+0000","last_became_peered":"2023-11-26T07:16:31.604337+0000","last_unstale":"2023-11-26T07:16:31.608573+0000","last_undegraded":"2023-11-26T07:16:31.608573+0000","last_fullsized":"2023-11-26T07:16:31.608573+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:57:09.945561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.595895+0000","last_change":"2023-11-26T07:16:31.595895+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.595895+0000","last_undegraded":"2023-11-26T07:16:31.595895+0000","last_fullsized":"2023-11-26T07:16:31.595895+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.609626+0000","last_change":"2023-11-26T07:16:31.607105+0000","last_active":"2023-11-26T07:16:31.609626+0000","last_peered":"2023-11-26T07:16:31.609626+0000","last_clean":"2023-11-26T07:16:31.609626+0000","last_became_active":"2023-11-26T07:16:31.606832+0000","last_became_peered":"2023-11-26T07:16:31.606832+0000","last_unstale":"2023-11-26T07:16:31.609626+0000","last_undegraded":"2023-11-26T07:16:31.609626+0000","last_fullsized":"2023-11-26T07:16:31.609626+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:47:30.148611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.593693+0000","last_change":"2023-11-26T07:16:31.593693+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.593693+0000","last_undegraded":"2023-11-26T07:16:31.593693+0000","last_fullsized":"2023-11-26T07:16:31.593693+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.608705+0000","last_change":"2023-11-26T07:16:31.607550+0000","last_active":"2023-11-26T07:16:31.608705+0000","last_peered":"2023-11-26T07:16:31.608705+0000","last_clean":"2023-11-26T07:16:31.608705+0000","last_became_active":"2023-11-26T07:16:31.607266+0000","last_became_peered":"2023-11-26T07:16:31.607266+0000","last_unstale":"2023-11-26T07:16:31.608705+0000","last_undegraded":"2023-11-26T07:16:31.608705+0000","last_fullsized":"2023-11-26T07:16:31.608705+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:15:53.033981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.594576+0000","last_change":"2023-11-26T07:16:31.594576+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.594576+0000","last_undegraded":"2023-11-26T07:16:31.594576+0000","last_fullsized":"2023-11-26T07:16:31.594576+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.604518+0000","last_change":"2023-11-26T07:16:31.598844+0000","last_active":"2023-11-26T07:16:31.604518+0000","last_peered":"2023-11-26T07:16:31.604518+0000","last_clean":"2023-11-26T07:16:31.604518+0000","last_became_active":"2023-11-26T07:16:31.598510+0000","last_became_peered":"2023-11-26T07:16:31.598510+0000","last_unstale":"2023-11-26T07:16:31.604518+0000","last_undegraded":"2023-11-26T07:16:31.604518+0000","last_fullsized":"2023-11-26T07:16:31.604518+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:41:16.384671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.600076+0000","last_change":"2023-11-26T07:16:31.600076+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.600076+0000","last_undegraded":"2023-11-26T07:16:31.600076+0000","last_fullsized":"2023-11-26T07:16:31.600076+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.610337+0000","last_change":"2023-11-26T07:16:31.609252+0000","last_active":"2023-11-26T07:16:31.610337+0000","last_peered":"2023-11-26T07:16:31.610337+0000","last_clean":"2023-11-26T07:16:31.610337+0000","last_became_active":"2023-11-26T07:16:31.608944+0000","last_became_peered":"2023-11-26T07:16:31.608944+0000","last_unstale":"2023-11-26T07:16:31.610337+0000","last_undegraded":"2023-11-26T07:16:31.610337+0000","last_fullsized":"2023-11-26T07:16:31.610337+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:27:23.533262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.591339+0000","last_change":"2023-11-26T07:16:31.591339+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.591339+0000","last_undegraded":"2023-11-26T07:16:31.591339+0000","last_fullsized":"2023-11-26T07:16:31.591339+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.610712+0000","last_change":"2023-11-26T07:16:31.608619+0000","last_active":"2023-11-26T07:16:31.610712+0000","last_peered":"2023-11-26T07:16:31.610712+0000","last_clean":"2023-11-26T07:16:31.610712+0000","last_became_active":"2023-11-26T07:16:31.608154+0000","last_became_peered":"2023-11-26T07:16:31.608154+0000","last_unstale":"2023-11-26T07:16:31.610712+0000","last_undegraded":"2023-11-26T07:16:31.610712+0000","last_fullsized":"2023-11-26T07:16:31.610712+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:49:38.418150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.598410+0000","last_change":"2023-11-26T07:16:31.598410+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.598410+0000","last_undegraded":"2023-11-26T07:16:31.598410+0000","last_fullsized":"2023-11-26T07:16:31.598410+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.609872+0000","last_change":"2023-11-26T07:16:31.608166+0000","last_active":"2023-11-26T07:16:31.609872+0000","last_peered":"2023-11-26T07:16:31.609872+0000","last_clean":"2023-11-26T07:16:31.609872+0000","last_became_active":"2023-11-26T07:16:31.607443+0000","last_became_peered":"2023-11-26T07:16:31.607443+0000","last_unstale":"2023-11-26T07:16:31.609872+0000","last_undegraded":"2023-11-26T07:16:31.609872+0000","last_fullsized":"2023-11-26T07:16:31.609872+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:08:07.953306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.593458+0000","last_change":"2023-11-26T07:16:31.593458+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.593458+0000","last_undegraded":"2023-11-26T07:16:31.593458+0000","last_fullsized":"2023-11-26T07:16:31.593458+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.607301+0000","last_change":"2023-11-26T07:16:31.602892+0000","last_active":"2023-11-26T07:16:31.607301+0000","last_peered":"2023-11-26T07:16:31.607301+0000","last_clean":"2023-11-26T07:16:31.607301+0000","last_became_active":"2023-11-26T07:16:31.602626+0000","last_became_peered":"2023-11-26T07:16:31.602626+0000","last_unstale":"2023-11-26T07:16:31.607301+0000","last_undegraded":"2023-11-26T07:16:31.607301+0000","last_fullsized":"2023-11-26T07:16:31.607301+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:31:17.102746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.599311+0000","last_change":"2023-11-26T07:16:31.599311+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.599311+0000","last_undegraded":"2023-11-26T07:16:31.599311+0000","last_fullsized":"2023-11-26T07:16:31.599311+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.608799+0000","last_change":"2023-11-26T07:16:31.606767+0000","last_active":"2023-11-26T07:16:31.608799+0000","last_peered":"2023-11-26T07:16:31.608799+0000","last_clean":"2023-11-26T07:16:31.608799+0000","last_became_active":"2023-11-26T07:16:31.606477+0000","last_became_peered":"2023-11-26T07:16:31.606477+0000","last_unstale":"2023-11-26T07:16:31.608799+0000","last_undegraded":"2023-11-26T07:16:31.608799+0000","last_fullsized":"2023-11-26T07:16:31.608799+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:53:36.321574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.594972+0000","last_change":"2023-11-26T07:16:31.594972+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.594972+0000","last_undegraded":"2023-11-26T07:16:31.594972+0000","last_fullsized":"2023-11-26T07:16:31.594972+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.608685+0000","last_change":"2023-11-26T07:16:31.607018+0000","last_active":"2023-11-26T07:16:31.608685+0000","last_peered":"2023-11-26T07:16:31.608685+0000","last_clean":"2023-11-26T07:16:31.608685+0000","last_became_active":"2023-11-26T07:16:31.606736+0000","last_became_peered":"2023-11-26T07:16:31.606736+0000","last_unstale":"2023-11-26T07:16:31.608685+0000","last_undegraded":"2023-11-26T07:16:31.608685+0000","last_fullsized":"2023-11-26T07:16:31.608685+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:51:01.983190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.592923+0000","last_change":"2023-11-26T07:16:31.592923+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.592923+0000","last_undegraded":"2023-11-26T07:16:31.592923+0000","last_fullsized":"2023-11-26T07:16:31.592923+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.606079+0000","last_change":"2023-11-26T07:16:31.604168+0000","last_active":"2023-11-26T07:16:31.606079+0000","last_peered":"2023-11-26T07:16:31.606079+0000","last_clean":"2023-11-26T07:16:31.606079+0000","last_became_active":"2023-11-26T07:16:31.603852+0000","last_became_peered":"2023-11-26T07:16:31.603852+0000","last_unstale":"2023-11-26T07:16:31.606079+0000","last_undegraded":"2023-11-26T07:16:31.606079+0000","last_fullsized":"2023-11-26T07:16:31.606079+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:04:43.215372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.593451+0000","last_change":"2023-11-26T07:16:31.593451+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.593451+0000","last_undegraded":"2023-11-26T07:16:31.593451+0000","last_fullsized":"2023-11-26T07:16:31.593451+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.607360+0000","last_change":"2023-11-26T07:16:31.603291+0000","last_active":"2023-11-26T07:16:31.607360+0000","last_peered":"2023-11-26T07:16:31.607360+0000","last_clean":"2023-11-26T07:16:31.607360+0000","last_became_active":"2023-11-26T07:16:31.603030+0000","last_became_peered":"2023-11-26T07:16:31.603030+0000","last_unstale":"2023-11-26T07:16:31.607360+0000","last_undegraded":"2023-11-26T07:16:31.607360+0000","last_fullsized":"2023-11-26T07:16:31.607360+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:18:47.861543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.596145+0000","last_change":"2023-11-26T07:16:31.596145+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.596145+0000","last_undegraded":"2023-11-26T07:16:31.596145+0000","last_fullsized":"2023-11-26T07:16:31.596145+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.610351+0000","last_change":"2023-11-26T07:16:31.608037+0000","last_active":"2023-11-26T07:16:31.610351+0000","last_peered":"2023-11-26T07:16:31.610351+0000","last_clean":"2023-11-26T07:16:31.610351+0000","last_became_active":"2023-11-26T07:16:31.607653+0000","last_became_peered":"2023-11-26T07:16:31.607653+0000","last_unstale":"2023-11-26T07:16:31.610351+0000","last_undegraded":"2023-11-26T07:16:31.610351+0000","last_fullsized":"2023-11-26T07:16:31.610351+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:21:40.442201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.593759+0000","last_change":"2023-11-26T07:16:31.593759+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.593759+0000","last_undegraded":"2023-11-26T07:16:31.593759+0000","last_fullsized":"2023-11-26T07:16:31.593759+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.605881+0000","last_change":"2023-11-26T07:16:31.601496+0000","last_active":"2023-11-26T07:16:31.605881+0000","last_peered":"2023-11-26T07:16:31.605881+0000","last_clean":"2023-11-26T07:16:31.605881+0000","last_became_active":"2023-11-26T07:16:31.600854+0000","last_became_peered":"2023-11-26T07:16:31.600854+0000","last_unstale":"2023-11-26T07:16:31.605881+0000","last_undegraded":"2023-11-26T07:16:31.605881+0000","last_fullsized":"2023-11-26T07:16:31.605881+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:00:32.449928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.596521+0000","last_change":"2023-11-26T07:16:31.596521+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.596521+0000","last_undegraded":"2023-11-26T07:16:31.596521+0000","last_fullsized":"2023-11-26T07:16:31.596521+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.611821+0000","last_change":"2023-11-26T07:16:31.611255+0000","last_active":"2023-11-26T07:16:31.611821+0000","last_peered":"2023-11-26T07:16:31.611821+0000","last_clean":"2023-11-26T07:16:31.611821+0000","last_became_active":"2023-11-26T07:16:31.610936+0000","last_became_peered":"2023-11-26T07:16:31.610936+0000","last_unstale":"2023-11-26T07:16:31.611821+0000","last_undegraded":"2023-11-26T07:16:31.611821+0000","last_fullsized":"2023-11-26T07:16:31.611821+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:59:20.890903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.596395+0000","last_change":"2023-11-26T07:16:31.596395+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.596395+0000","last_undegraded":"2023-11-26T07:16:31.596395+0000","last_fullsized":"2023-11-26T07:16:31.596395+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.607426+0000","last_change":"2023-11-26T07:16:31.604687+0000","last_active":"2023-11-26T07:16:31.607426+0000","last_peered":"2023-11-26T07:16:31.607426+0000","last_clean":"2023-11-26T07:16:31.607426+0000","last_became_active":"2023-11-26T07:16:31.604369+0000","last_became_peered":"2023-11-26T07:16:31.604369+0000","last_unstale":"2023-11-26T07:16:31.607426+0000","last_undegraded":"2023-11-26T07:16:31.607426+0000","last_fullsized":"2023-11-26T07:16:31.607426+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:40:49.206751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.599473+0000","last_change":"2023-11-26T07:16:31.599473+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.599473+0000","last_undegraded":"2023-11-26T07:16:31.599473+0000","last_fullsized":"2023-11-26T07:16:31.599473+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.609569+0000","last_change":"2023-11-26T07:16:31.606737+0000","last_active":"2023-11-26T07:16:31.609569+0000","last_peered":"2023-11-26T07:16:31.609569+0000","last_clean":"2023-11-26T07:16:31.609569+0000","last_became_active":"2023-11-26T07:16:31.606477+0000","last_became_peered":"2023-11-26T07:16:31.606477+0000","last_unstale":"2023-11-26T07:16:31.609569+0000","last_undegraded":"2023-11-26T07:16:31.609569+0000","last_fullsized":"2023-11-26T07:16:31.609569+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:20:43.639773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.594896+0000","last_change":"2023-11-26T07:16:31.594896+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.594896+0000","last_undegraded":"2023-11-26T07:16:31.594896+0000","last_fullsized":"2023-11-26T07:16:31.594896+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.602628+0000","last_change":"2023-11-26T07:16:31.597623+0000","last_active":"2023-11-26T07:16:31.602628+0000","last_peered":"2023-11-26T07:16:31.602628+0000","last_clean":"2023-11-26T07:16:31.602628+0000","last_became_active":"2023-11-26T07:16:31.597356+0000","last_became_peered":"2023-11-26T07:16:31.597356+0000","last_unstale":"2023-11-26T07:16:31.602628+0000","last_undegraded":"2023-11-26T07:16:31.602628+0000","last_fullsized":"2023-11-26T07:16:31.602628+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:33:18.957245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.593371+0000","last_change":"2023-11-26T07:16:31.593371+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.593371+0000","last_undegraded":"2023-11-26T07:16:31.593371+0000","last_fullsized":"2023-11-26T07:16:31.593371+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.609547+0000","last_change":"2023-11-26T07:16:31.605393+0000","last_active":"2023-11-26T07:16:31.609547+0000","last_peered":"2023-11-26T07:16:31.609547+0000","last_clean":"2023-11-26T07:16:31.609547+0000","last_became_active":"2023-11-26T07:16:31.605134+0000","last_became_peered":"2023-11-26T07:16:31.605134+0000","last_unstale":"2023-11-26T07:16:31.609547+0000","last_undegraded":"2023-11-26T07:16:31.609547+0000","last_fullsized":"2023-11-26T07:16:31.609547+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:00:14.422829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.595169+0000","last_change":"2023-11-26T07:16:31.595169+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.595169+0000","last_undegraded":"2023-11-26T07:16:31.595169+0000","last_fullsized":"2023-11-26T07:16:31.595169+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.607688+0000","last_change":"2023-11-26T07:16:31.605773+0000","last_active":"2023-11-26T07:16:31.607688+0000","last_peered":"2023-11-26T07:16:31.607688+0000","last_clean":"2023-11-26T07:16:31.607688+0000","last_became_active":"2023-11-26T07:16:31.605493+0000","last_became_peered":"2023-11-26T07:16:31.605493+0000","last_unstale":"2023-11-26T07:16:31.607688+0000","last_undegraded":"2023-11-26T07:16:31.607688+0000","last_fullsized":"2023-11-26T07:16:31.607688+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:06:59.820803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.593887+0000","last_change":"2023-11-26T07:16:31.593887+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.593887+0000","last_undegraded":"2023-11-26T07:16:31.593887+0000","last_fullsized":"2023-11-26T07:16:31.593887+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.607002+0000","last_change":"2023-11-26T07:16:31.603942+0000","last_active":"2023-11-26T07:16:31.607002+0000","last_peered":"2023-11-26T07:16:31.607002+0000","last_clean":"2023-11-26T07:16:31.607002+0000","last_became_active":"2023-11-26T07:16:31.603643+0000","last_became_peered":"2023-11-26T07:16:31.603643+0000","last_unstale":"2023-11-26T07:16:31.607002+0000","last_undegraded":"2023-11-26T07:16:31.607002+0000","last_fullsized":"2023-11-26T07:16:31.607002+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:38:12.974493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":209,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-26T07:16:30.591121+0000","last_change":"2023-11-26T07:11:29.855919+0000","last_active":"2023-11-26T07:16:30.591121+0000","last_peered":"2023-11-26T07:16:30.591121+0000","last_clean":"2023-11-26T07:16:30.591121+0000","last_became_active":"2023-11-26T07:11:29.854903+0000","last_became_peered":"2023-11-26T07:11:29.854903+0000","last_unstale":"2023-11-26T07:16:30.591121+0000","last_undegraded":"2023-11-26T07:16:30.591121+0000","last_fullsized":"2023-11-26T07:16:30.591121+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:28.594252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:28.594252+0000","last_clean_scrub_stamp":"2023-11-26T07:11:28.594252+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:33:34.642696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574914,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32612,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339228,"statfs":{"total":96636764160,"available":96603369472,"internally_reserved":0,"allocated":1458176,"data_stored":954971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:15:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34000000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.66600000000000004,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.51100000000000001,"15min":0.505},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.64400000000000002,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.63300000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:15:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.74299999999999999,"15min":0.94499999999999995},"min":{"1min":0.38600000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72199999999999998,"5min":9.5600000000000005,"15min":9.5600000000000005},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56100000000000005,"15min":0.57699999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.69599999999999995,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.59799999999999998}]},{"osd":2,"last update":"Sun Nov 26 07:15:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.58699999999999997,"15min":0.59899999999999998},"min":{"1min":0.42999999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.65700000000000003,"5min":1.569,"15min":1.569},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.623,"15min":0.64400000000000002},"min":{"1min":0.36899999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.71199999999999997,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.61699999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:15:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.57699999999999996,"15min":0.59799999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.63700000000000001,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.505},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.57699999999999996,"15min":0.56599999999999995},"min":{"1min":0.434,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69199999999999995,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.64700000000000002}]},{"osd":4,"last update":"Sun Nov 26 07:15:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.51800000000000002,"15min":0.52100000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.71099999999999997,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.52900000000000003,"15min":0.51300000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.67800000000000005,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.42099999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:15:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55100000000000005,"15min":0.53300000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.751,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.621,"15min":0.63},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.75900000000000001,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.44}]},{"osd":6,"last update":"Sun Nov 26 07:15:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.433,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72999999999999998,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.59599999999999997,"15min":0.59099999999999997},"min":{"1min":0.40500000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.69199999999999995,"5min":1.552,"15min":1.552},"last":0.46899999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574914,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":851968,"data_stored":358328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:15:30 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.50700000000000001,"15min":0.48499999999999999},"min":{"1min":0.33200000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.70899999999999996,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.51600000000000001,"15min":0.47999999999999998},"min":{"1min":0.35299999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.80800000000000005,"5min":0.871,"15min":0.871},"last":0.54500000000000004}]},{"osd":1,"last update":"Sun Nov 26 07:15:30 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.52100000000000002,"15min":0.51100000000000001},"min":{"1min":0.39000000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.65500000000000003,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.629},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.39600000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.82999999999999996,"5min":1.198,"15min":1.198},"last":0.51800000000000002}]},{"osd":2,"last update":"Sun Nov 26 07:15:30 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.51800000000000002,"15min":0.496},"min":{"1min":0.36199999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.68600000000000005,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.55300000000000005,"15min":0.52500000000000002},"min":{"1min":0.38500000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.79600000000000004,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.59699999999999998}]},{"osd":3,"last update":"Sun Nov 26 07:15:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58599999999999997,"15min":0.55500000000000005},"min":{"1min":0.44500000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.85999999999999999,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60699999999999998,"15min":0.58499999999999996},"min":{"1min":0.40699999999999997,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.67000000000000004}]},{"osd":4,"last update":"Sun Nov 26 07:15:30 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.51500000000000001,"15min":0.52800000000000002},"min":{"1min":0.35399999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.67900000000000005,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.34000000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.41199999999999998}]},{"osd":5,"last update":"Sun Nov 26 07:15:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56599999999999995,"15min":0.56100000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.70199999999999996,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.77700000000000002,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.443}]},{"osd":7,"last update":"Sun Nov 26 07:15:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59399999999999997,"15min":0.59199999999999997},"min":{"1min":0.38300000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79300000000000004,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.629,"15min":0.626},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80200000000000005,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.495}]}]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":864256,"data_stored":364603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.36299999999999999},"min":{"1min":0.223,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.57999999999999996,"15min":0.79900000000000004},"min":{"1min":0.29299999999999998,"5min":0.214,"15min":0.214},"max":{"1min":0.55700000000000005,"5min":11.922000000000001,"15min":11.922000000000001},"last":0.56200000000000006}]},{"osd":2,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35799999999999998,"15min":0.372},"min":{"1min":0.26000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.59599999999999997,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.40300000000000002,"15min":0.40799999999999997},"min":{"1min":0.307,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.56999999999999995,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.50600000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.45000000000000001,"15min":0.45800000000000002},"min":{"1min":0.35599999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.61299999999999999,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.42999999999999999,"15min":0.44},"min":{"1min":0.32500000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.51100000000000001,"5min":1.101,"15min":1.101},"last":0.40999999999999998}]},{"osd":4,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.74099999999999999,"15min":0.86499999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82199999999999995,"5min":6.8979999999999997,"15min":6.8979999999999997},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.65600000000000003,"15min":0.66400000000000003},"min":{"1min":0.48799999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83999999999999997,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.66200000000000003}]},{"osd":5,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.621,"15min":0.627},"min":{"1min":0.41599999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.89100000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":1.2090000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.745,"15min":0.871},"min":{"1min":0.442,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85199999999999998,"5min":6.9480000000000004,"15min":6.9480000000000004},"last":0.45100000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.64700000000000002,"15min":0.66100000000000003},"min":{"1min":0.46200000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.87,"5min":1.194,"15min":1.194},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.75800000000000001,"15min":0.89500000000000002},"min":{"1min":0.435,"5min":0.372,"15min":0.372},"max":{"1min":0.90500000000000003,"5min":6.9800000000000004,"15min":6.9800000000000004},"last":1.222}]},{"osd":7,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65800000000000003,"15min":0.66000000000000003},"min":{"1min":0.48399999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.92400000000000004,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":3.5649999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.68300000000000005},"min":{"1min":0.44700000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.93300000000000005,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":3.548}]}]},{"osd":0,"up_from":13,"seq":55834574912,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32612,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339228,"statfs":{"total":96636764160,"available":96603369472,"internally_reserved":0,"allocated":1458176,"data_stored":954971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.34100000000000003,"15min":0.36799999999999999},"min":{"1min":0.24199999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.52600000000000002,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.374},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.58599999999999997,"15min":0.82099999999999995},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.54500000000000004,"5min":11.987,"15min":11.987},"last":0.26900000000000002}]},{"osd":2,"last update":"Sun Nov 26 07:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.39400000000000002,"15min":0.43099999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57099999999999995,"5min":1.607,"15min":1.607},"last":0.317},{"interface":"front","average":{"1min":0.375,"5min":0.39300000000000002,"15min":0.41099999999999998},"min":{"1min":0.27500000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.64900000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.34499999999999997}]},{"osd":3,"last update":"Sun Nov 26 07:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.375,"15min":0.38700000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.58899999999999997,"5min":0.752,"15min":0.752},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.44,"15min":0.46999999999999997},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71699999999999997,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.40000000000000002}]},{"osd":4,"last update":"Sun Nov 26 07:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.61799999999999999,"15min":0.65000000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71999999999999997,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.73799999999999999,"15min":0.88},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77300000000000002,"5min":6.5279999999999996,"15min":6.5279999999999996},"last":0.499}]},{"osd":5,"last update":"Sun Nov 26 07:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.622,"15min":0.64700000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77400000000000002,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.65900000000000003,"15min":0.69199999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.80500000000000005,"5min":1.508,"15min":1.508},"last":0.61099999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.76900000000000002,"15min":0.91600000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85299999999999998,"5min":6.5419999999999998,"15min":6.5419999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.64000000000000001,"15min":0.67300000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.79200000000000004,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.46700000000000003}]},{"osd":7,"last update":"Sun Nov 26 07:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.66200000000000003,"15min":0.69599999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.83799999999999997,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.64100000000000001,"15min":0.66200000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82899999999999996,"5min":1.155,"15min":1.155},"last":0.47699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574913,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":864256,"data_stored":364603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:15:38 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34000000000000002,"15min":0.34599999999999997},"min":{"1min":0.22500000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39400000000000002,"15min":0.39800000000000002},"min":{"1min":0.28100000000000003,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.53500000000000003,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.34399999999999997}]},{"osd":1,"last update":"Sun Nov 26 07:15:38 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34399999999999997,"15min":0.34799999999999998},"min":{"1min":0.224,"5min":0.222,"15min":0.222},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.375,"15min":0.377},"min":{"1min":0.24399999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.58199999999999996,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.39800000000000002}]},{"osd":3,"last update":"Sun Nov 26 07:15:38 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39700000000000002,"15min":0.41099999999999998},"min":{"1min":0.28100000000000003,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.59699999999999998,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.376,"5min":0.374,"15min":0.38200000000000001},"min":{"1min":0.27600000000000002,"5min":0.224,"15min":0.224},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.47899999999999998}]},{"osd":4,"last update":"Sun Nov 26 07:15:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.42699999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.497},{"interface":"front","average":{"1min":0.623,"5min":0.58399999999999996,"15min":0.58099999999999996},"min":{"1min":0.438,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.44800000000000001}]},{"osd":5,"last update":"Sun Nov 26 07:15:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.58099999999999996,"15min":0.57699999999999996},"min":{"1min":0.47199999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.435},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60999999999999999,"15min":0.63},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84299999999999997,"5min":1.002,"15min":1.002},"last":0.56100000000000005}]},{"osd":6,"last update":"Sun Nov 26 07:15:38 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.60899999999999999,"15min":0.61099999999999999},"min":{"1min":0.40999999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.629,"15min":0.63500000000000001},"min":{"1min":0.44700000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.53800000000000003}]},{"osd":7,"last update":"Sun Nov 26 07:15:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.62,"15min":0.629},"min":{"1min":0.499,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86299999999999999,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.625,"15min":0.625},"min":{"1min":0.47199999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.51300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574913,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":864256,"data_stored":364603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.34100000000000003,"15min":0.36499999999999999},"min":{"1min":0.22,"5min":0.219,"15min":0.219},"max":{"1min":0.46600000000000003,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.39300000000000002,"15min":0.41899999999999998},"min":{"1min":0.24199999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.61299999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.32400000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.375,"15min":0.40300000000000002},"min":{"1min":0.25800000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.58799999999999997,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.252},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.439,"15min":0.5},"min":{"1min":0.26300000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.56899999999999995,"5min":2.903,"15min":2.903},"last":0.35099999999999998}]},{"osd":2,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39300000000000002,"15min":0.40400000000000003},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.55200000000000005,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.40500000000000003,"15min":0.41799999999999998},"min":{"1min":0.309,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.63700000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.374}]},{"osd":4,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.65400000000000003,"15min":0.70699999999999996},"min":{"1min":0.376,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.96799999999999997,"5min":2.9609999999999999,"15min":2.9609999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.625,"15min":0.64100000000000001},"min":{"1min":0.437,"5min":0.373,"15min":0.373},"max":{"1min":1.1499999999999999,"5min":1.163,"15min":1.163},"last":0.64500000000000002}]},{"osd":5,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.65100000000000002,"15min":0.67300000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.98199999999999998,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.64000000000000001,"15min":0.66400000000000003},"min":{"1min":0.436,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93999999999999995,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.63}]},{"osd":6,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64500000000000002,"15min":0.67100000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.083,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.65600000000000003,"15min":0.68000000000000005},"min":{"1min":0.44900000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94499999999999995,"5min":1.258,"15min":1.258},"last":0.55000000000000004}]},{"osd":7,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.65200000000000002,"15min":0.68200000000000005},"min":{"1min":0.46700000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.014,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.69799999999999995,"15min":0.752},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.94899999999999995,"5min":2.9969999999999999,"15min":2.9969999999999999},"last":0.59799999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574912,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":864256,"data_stored":364603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.73599999999999999,"15min":0.91200000000000003},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.80800000000000005,"5min":8.7539999999999996,"15min":8.7539999999999996},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.76000000000000001,"15min":0.93100000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.74299999999999999,"5min":8.7390000000000008,"15min":8.7390000000000008},"last":0.57499999999999996}]},{"osd":1,"last update":"Sun Nov 26 07:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.76600000000000001,"15min":0.96199999999999997},"min":{"1min":0.34799999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.76400000000000001,"5min":9.7720000000000002,"15min":9.7720000000000002},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56200000000000006,"15min":0.56799999999999995},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.74399999999999999,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.54200000000000004}]},{"osd":2,"last update":"Sun Nov 26 07:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.73499999999999999,"15min":0.91600000000000004},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.748,"5min":9.8119999999999994,"15min":9.8119999999999994},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.70699999999999996,"15min":0.82299999999999995},"min":{"1min":0.35699999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76000000000000001,"5min":3.645,"15min":3.645},"last":0.56100000000000005}]},{"osd":3,"last update":"Sun Nov 26 07:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.78200000000000003,"15min":0.95999999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.81299999999999994,"5min":8.8089999999999993,"15min":8.8089999999999993},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.77400000000000002,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.49299999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52300000000000002,"15min":0.505},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.55500000000000005,"15min":0.55200000000000005},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72699999999999998,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.33600000000000002}]},{"osd":6,"last update":"Sun Nov 26 07:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.35199999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56200000000000006,"15min":0.57199999999999995},"min":{"1min":0.36099999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79600000000000004,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.39200000000000002}]},{"osd":7,"last update":"Sun Nov 26 07:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.32600000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.79100000000000004,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.60599999999999998,"15min":0.60399999999999998},"min":{"1min":0.40200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.91000000000000003,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.433}]}]},{"osd":5,"up_from":13,"seq":55834574914,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":864256,"data_stored":364603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58099999999999996,"15min":0.53800000000000003},"min":{"1min":0.40400000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.80200000000000005,"5min":7.1500000000000004,"15min":7.1500000000000004},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.60099999999999998,"15min":0.57299999999999995},"min":{"1min":0.42599999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.747,"5min":6.8470000000000004,"15min":6.8470000000000004},"last":0.45900000000000002}]},{"osd":1,"last update":"Sun Nov 26 07:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.59099999999999997,"15min":0.55700000000000005},"min":{"1min":0.442,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.746,"5min":7.1269999999999998,"15min":7.1269999999999998},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56499999999999995,"15min":0.55900000000000005},"min":{"1min":0.39900000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.70499999999999996,"5min":1.514,"15min":1.514},"last":0.61899999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.63700000000000001,"15min":0.59599999999999997},"min":{"1min":0.377,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81899999999999995,"5min":7.2000000000000002,"15min":7.2000000000000002},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66100000000000003,"15min":0.62},"min":{"1min":0.51800000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.71999999999999997,"5min":7.8259999999999996,"15min":7.8259999999999996},"last":0.70899999999999996}]},{"osd":3,"last update":"Sun Nov 26 07:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.58899999999999997,"15min":0.56799999999999995},"min":{"1min":0.52200000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.77600000000000002,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.64900000000000002,"15min":0.60699999999999998},"min":{"1min":0.42099999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84699999999999998,"5min":6.9240000000000004,"15min":6.9240000000000004},"last":0.73899999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.56000000000000005,"15min":0.51200000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72299999999999998,"5min":7.2830000000000004,"15min":7.2830000000000004},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57599999999999996,"15min":0.57399999999999995},"min":{"1min":0.40500000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73299999999999998,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.76600000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.624,"15min":0.57299999999999995},"min":{"1min":0.438,"5min":0.308,"15min":0.308},"max":{"1min":0.749,"5min":6.8890000000000002,"15min":6.8890000000000002},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.63700000000000001,"15min":0.59099999999999997},"min":{"1min":0.39600000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.74399999999999999,"5min":7.2430000000000003,"15min":7.2430000000000003},"last":0.82999999999999996}]},{"osd":7,"last update":"Sun Nov 26 07:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65900000000000003,"15min":0.60899999999999999},"min":{"1min":0.376,"5min":0.371,"15min":0.371},"max":{"1min":0.80600000000000005,"5min":6.9880000000000004,"15min":6.9880000000000004},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.73399999999999999,"15min":0.65900000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.80100000000000005,"5min":11.874000000000001,"15min":11.874000000000001},"last":0.84299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:16:36.767 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:16:36.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.924+0000 7f9398df7700 1 Processor -- start 2023-11-26T07:16:36.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.924+0000 7f9398df7700 1 -- start start 2023-11-26T07:16:36.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.925+0000 7f9398df7700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9394143ae0 0x7f93940b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:36.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.925+0000 7f9398df7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93941440f0 0x7f9394071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:36.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.925+0000 7f9398df7700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9394143ec0 con 0x7f93940720f0 2023-11-26T07:16:36.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.925+0000 7f9398df7700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93940b40a0 con 0x7f9394143ae0 2023-11-26T07:16:36.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.925+0000 7f9398df7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9394072580 con 0x7f93941440f0 2023-11-26T07:16:36.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.925+0000 7f939259c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9394143ae0 0x7f93940b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:36.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.925+0000 7f939259c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9394143ae0 0x7f93940b51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44286/0 (socket says 172.21.15.2:44286) 2023-11-26T07:16:36.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.925+0000 7f939259c700 1 -- 172.21.15.2:0/630249407 learned_addr learned my addr 172.21.15.2:0/630249407 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:36.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.925+0000 7f939259c700 1 -- 172.21.15.2:0/630249407 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93941440f0 msgr2=0x7f9394071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:36.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.925+0000 7f939259c700 1 --2- 172.21.15.2:0/630249407 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93941440f0 0x7f9394071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:36.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.925+0000 7f939259c700 1 -- 172.21.15.2:0/630249407 >> v1:172.21.15.192:6789/0 conn(0x7f93940720f0 legacy=0x7f939415e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:36.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.925+0000 7f939259c700 1 -- 172.21.15.2:0/630249407 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93940b3ae0 con 0x7f9394143ae0 2023-11-26T07:16:36.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.926+0000 7f939259c700 1 --2- 172.21.15.2:0/630249407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9394143ae0 0x7f93940b51b0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f938800bb90 tx=0x7f938800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=127394337a3f85f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:36.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.926+0000 7f939159a700 1 -- 172.21.15.2:0/630249407 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938800dd10 con 0x7f9394143ae0 2023-11-26T07:16:36.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.926+0000 7f939159a700 1 -- 172.21.15.2:0/630249407 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f938800de70 con 0x7f9394143ae0 2023-11-26T07:16:36.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.926+0000 7f939159a700 1 -- 172.21.15.2:0/630249407 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9388004230 con 0x7f9394143ae0 2023-11-26T07:16:36.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.926+0000 7f9398df7700 1 -- 172.21.15.2:0/630249407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9394143ae0 msgr2=0x7f93940b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:36.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.926+0000 7f9398df7700 1 --2- 172.21.15.2:0/630249407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9394143ae0 0x7f93940b51b0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f938800bb90 tx=0x7f938800bea0 comp rx=0 tx=0).stop 2023-11-26T07:16:36.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.926+0000 7f9398df7700 1 -- 172.21.15.2:0/630249407 shutdown_connections 2023-11-26T07:16:36.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.926+0000 7f9398df7700 1 --2- 172.21.15.2:0/630249407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9394143ae0 0x7f93940b51b0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:36.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.926+0000 7f9398df7700 1 --2- 172.21.15.2:0/630249407 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93941440f0 0x7f9394071bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:36.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.926+0000 7f9398df7700 1 -- 172.21.15.2:0/630249407 >> 172.21.15.2:0/630249407 conn(0x7f93940b2740 msgr2=0x7f93940b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:36.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.926+0000 7f9398df7700 1 -- 172.21.15.2:0/630249407 shutdown_connections 2023-11-26T07:16:36.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.927+0000 7f9398df7700 1 -- 172.21.15.2:0/630249407 wait complete. 2023-11-26T07:16:36.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.928+0000 7f9398df7700 1 Processor -- start 2023-11-26T07:16:36.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.928+0000 7f9398df7700 1 -- start start 2023-11-26T07:16:36.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.929+0000 7f9398df7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93940720f0 0x7f9394154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:36.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.929+0000 7f9398df7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9394143ae0 0x7f939413a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:36.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.929+0000 7f9398df7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93941440f0 0x7f9394139c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:36.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.929+0000 7f9398df7700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9394138ec0 con 0x7f93941440f0 2023-11-26T07:16:36.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.929+0000 7f9398df7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93941391a0 con 0x7f9394143ae0 2023-11-26T07:16:36.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.929+0000 7f9398df7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9394139480 con 0x7f93940720f0 2023-11-26T07:16:36.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.929+0000 7f9392d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93941440f0 0x7f9394139c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:36.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.929+0000 7f9392d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93941440f0 0x7f9394139c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44296/0 (socket says 172.21.15.2:44296) 2023-11-26T07:16:36.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.929+0000 7f9392d9d700 1 -- 172.21.15.2:0/1824815974 learned_addr learned my addr 172.21.15.2:0/1824815974 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:36.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.929+0000 7f9391d9b700 1 --2- 172.21.15.2:0/1824815974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9394143ae0 0x7f939413a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:36.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.929+0000 7f939259c700 1 --2- 172.21.15.2:0/1824815974 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93940720f0 0x7f9394154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:36.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.929+0000 7f9392d9d700 1 -- 172.21.15.2:0/1824815974 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93940720f0 msgr2=0x7f9394154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:36.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.929+0000 7f9392d9d700 1 --2- 172.21.15.2:0/1824815974 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93940720f0 0x7f9394154600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:36.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.929+0000 7f9392d9d700 1 -- 172.21.15.2:0/1824815974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9394143ae0 msgr2=0x7f939413a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:36.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.929+0000 7f9392d9d700 1 --2- 172.21.15.2:0/1824815974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9394143ae0 0x7f939413a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:36.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.929+0000 7f9392d9d700 1 -- 172.21.15.2:0/1824815974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f938800b7f0 con 0x7f93941440f0 2023-11-26T07:16:36.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.929+0000 7f939259c700 1 --2- 172.21.15.2:0/1824815974 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93940720f0 0x7f9394154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:16:36.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.929+0000 7f9392d9d700 1 --2- 172.21.15.2:0/1824815974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93941440f0 0x7f9394139c80 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f938c00b970 tx=0x7f938c00bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:36.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.929+0000 7f9382ffd700 1 -- 172.21.15.2:0/1824815974 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938c00c9b0 con 0x7f93941440f0 2023-11-26T07:16:36.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.929+0000 7f9382ffd700 1 -- 172.21.15.2:0/1824815974 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f938c00cb10 con 0x7f93941440f0 2023-11-26T07:16:36.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.929+0000 7f9382ffd700 1 -- 172.21.15.2:0/1824815974 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938c014440 con 0x7f93941440f0 2023-11-26T07:16:36.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.929+0000 7f9398df7700 1 -- 172.21.15.2:0/1824815974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9394139760 con 0x7f93941440f0 2023-11-26T07:16:36.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.929+0000 7f9398df7700 1 -- 172.21.15.2:0/1824815974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f939413aef0 con 0x7f93941440f0 2023-11-26T07:16:36.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.930+0000 7f9398df7700 1 -- 172.21.15.2:0/1824815974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9394067a00 con 0x7f93941440f0 2023-11-26T07:16:36.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.931+0000 7f9382ffd700 1 -- 172.21.15.2:0/1824815974 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f938c01d3b0 con 0x7f93941440f0 2023-11-26T07:16:36.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.931+0000 7f9382ffd700 1 --2- 172.21.15.2:0/1824815974 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f937406b740 0x7f937406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:36.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.931+0000 7f9382ffd700 1 -- 172.21.15.2:0/1824815974 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f938c087cb0 con 0x7f93941440f0 2023-11-26T07:16:36.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.932+0000 7f939259c700 1 --2- 172.21.15.2:0/1824815974 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f937406b740 0x7f937406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:36.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.932+0000 7f939259c700 1 --2- 172.21.15.2:0/1824815974 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f937406b740 0x7f937406dc00 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9388000c00 tx=0x7f9388013000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:36.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:36.936+0000 7f9382ffd700 1 -- 172.21.15.2:0/1824815974 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f938c0545e0 con 0x7f93941440f0 2023-11-26T07:16:37.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.133+0000 7f9398df7700 1 -- 172.21.15.2:0/1824815974 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f939406dff0 con 0x7f937406b740 2023-11-26T07:16:37.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.142+0000 7f9382ffd700 1 -- 172.21.15.2:0/1824815974 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283909 (secure 0 0 0) 0x7f9388004130 con 0x7f937406b740 2023-11-26T07:16:37.148 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:16:37.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.145+0000 7f9398df7700 1 -- 172.21.15.2:0/1824815974 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f937406b740 msgr2=0x7f937406dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:37.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.145+0000 7f9398df7700 1 --2- 172.21.15.2:0/1824815974 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f937406b740 0x7f937406dc00 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9388000c00 tx=0x7f9388013000 comp rx=0 tx=0).stop 2023-11-26T07:16:37.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.145+0000 7f9398df7700 1 -- 172.21.15.2:0/1824815974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93941440f0 msgr2=0x7f9394139c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:37.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.145+0000 7f9398df7700 1 --2- 172.21.15.2:0/1824815974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93941440f0 0x7f9394139c80 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f938c00b970 tx=0x7f938c00bd30 comp rx=0 tx=0).stop 2023-11-26T07:16:37.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.145+0000 7f9398df7700 1 -- 172.21.15.2:0/1824815974 shutdown_connections 2023-11-26T07:16:37.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.145+0000 7f9398df7700 1 --2- 172.21.15.2:0/1824815974 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f937406b740 0x7f937406dc00 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:37.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.145+0000 7f9398df7700 1 --2- 172.21.15.2:0/1824815974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93941440f0 0x7f9394139c80 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:37.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.145+0000 7f9398df7700 1 --2- 172.21.15.2:0/1824815974 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93940720f0 0x7f9394154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:37.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.145+0000 7f9398df7700 1 --2- 172.21.15.2:0/1824815974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9394143ae0 0x7f939413a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:37.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.145+0000 7f9398df7700 1 -- 172.21.15.2:0/1824815974 >> 172.21.15.2:0/1824815974 conn(0x7f93940b2740 msgr2=0x7f939406ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:37.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.145+0000 7f9398df7700 1 -- 172.21.15.2:0/1824815974 shutdown_connections 2023-11-26T07:16:37.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.145+0000 7f9398df7700 1 -- 172.21.15.2:0/1824815974 wait complete. 2023-11-26T07:16:37.151 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-26T07:16:37.160 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":221,"stamp":"2023-11-26T07:16:36.230125+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257384,"kb_used_data":7900,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754717336,"statfs":{"total":773094113280,"available":772830552064,"internally_reserved":0,"allocated":8089600,"data_stored":4091285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.644691"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.599254+0000","last_change":"2023-11-26T07:16:31.599254+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.599254+0000","last_undegraded":"2023-11-26T07:16:31.599254+0000","last_fullsized":"2023-11-26T07:16:31.599254+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.598744+0000","last_change":"2023-11-26T07:16:31.598744+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.598744+0000","last_undegraded":"2023-11-26T07:16:31.598744+0000","last_fullsized":"2023-11-26T07:16:31.598744+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.596490+0000","last_change":"2023-11-26T07:16:31.596490+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.596490+0000","last_undegraded":"2023-11-26T07:16:31.596490+0000","last_fullsized":"2023-11-26T07:16:31.596490+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.594577+0000","last_change":"2023-11-26T07:16:31.594577+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.594577+0000","last_undegraded":"2023-11-26T07:16:31.594577+0000","last_fullsized":"2023-11-26T07:16:31.594577+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.601432+0000","last_change":"2023-11-26T07:16:31.601432+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.601432+0000","last_undegraded":"2023-11-26T07:16:31.601432+0000","last_fullsized":"2023-11-26T07:16:31.601432+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.598968+0000","last_change":"2023-11-26T07:16:31.598968+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.598968+0000","last_undegraded":"2023-11-26T07:16:31.598968+0000","last_fullsized":"2023-11-26T07:16:31.598968+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.594942+0000","last_change":"2023-11-26T07:16:31.594942+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.594942+0000","last_undegraded":"2023-11-26T07:16:31.594942+0000","last_fullsized":"2023-11-26T07:16:31.594942+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.598612+0000","last_change":"2023-11-26T07:16:31.598612+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.598612+0000","last_undegraded":"2023-11-26T07:16:31.598612+0000","last_fullsized":"2023-11-26T07:16:31.598612+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.600548+0000","last_change":"2023-11-26T07:16:31.600548+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.600548+0000","last_undegraded":"2023-11-26T07:16:31.600548+0000","last_fullsized":"2023-11-26T07:16:31.600548+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.591825+0000","last_change":"2023-11-26T07:16:31.591825+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.591825+0000","last_undegraded":"2023-11-26T07:16:31.591825+0000","last_fullsized":"2023-11-26T07:16:31.591825+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.597271+0000","last_change":"2023-11-26T07:16:31.597271+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.597271+0000","last_undegraded":"2023-11-26T07:16:31.597271+0000","last_fullsized":"2023-11-26T07:16:31.597271+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.594135+0000","last_change":"2023-11-26T07:16:31.594135+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.594135+0000","last_undegraded":"2023-11-26T07:16:31.594135+0000","last_fullsized":"2023-11-26T07:16:31.594135+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.595814+0000","last_change":"2023-11-26T07:16:31.595814+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.595814+0000","last_undegraded":"2023-11-26T07:16:31.595814+0000","last_fullsized":"2023-11-26T07:16:31.595814+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.601303+0000","last_change":"2023-11-26T07:16:31.601303+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.601303+0000","last_undegraded":"2023-11-26T07:16:31.601303+0000","last_fullsized":"2023-11-26T07:16:31.601303+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.595322+0000","last_change":"2023-11-26T07:16:31.595322+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.595322+0000","last_undegraded":"2023-11-26T07:16:31.595322+0000","last_fullsized":"2023-11-26T07:16:31.595322+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.591146+0000","last_change":"2023-11-26T07:16:31.591146+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.591146+0000","last_undegraded":"2023-11-26T07:16:31.591146+0000","last_fullsized":"2023-11-26T07:16:31.591146+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.600103+0000","last_change":"2023-11-26T07:16:31.600103+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.600103+0000","last_undegraded":"2023-11-26T07:16:31.600103+0000","last_fullsized":"2023-11-26T07:16:31.600103+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.593527+0000","last_change":"2023-11-26T07:16:31.593527+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.593527+0000","last_undegraded":"2023-11-26T07:16:31.593527+0000","last_fullsized":"2023-11-26T07:16:31.593527+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.598419+0000","last_change":"2023-11-26T07:16:31.598419+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.598419+0000","last_undegraded":"2023-11-26T07:16:31.598419+0000","last_fullsized":"2023-11-26T07:16:31.598419+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.593750+0000","last_change":"2023-11-26T07:16:31.593750+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.593750+0000","last_undegraded":"2023-11-26T07:16:31.593750+0000","last_fullsized":"2023-11-26T07:16:31.593750+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.591574+0000","last_change":"2023-11-26T07:16:31.591574+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.591574+0000","last_undegraded":"2023-11-26T07:16:31.591574+0000","last_fullsized":"2023-11-26T07:16:31.591574+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.591270+0000","last_change":"2023-11-26T07:16:31.591270+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.591270+0000","last_undegraded":"2023-11-26T07:16:31.591270+0000","last_fullsized":"2023-11-26T07:16:31.591270+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.598084+0000","last_change":"2023-11-26T07:16:31.598084+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.598084+0000","last_undegraded":"2023-11-26T07:16:31.598084+0000","last_fullsized":"2023-11-26T07:16:31.598084+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.595800+0000","last_change":"2023-11-26T07:16:31.595800+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.595800+0000","last_undegraded":"2023-11-26T07:16:31.595800+0000","last_fullsized":"2023-11-26T07:16:31.595800+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.591671+0000","last_change":"2023-11-26T07:16:31.591671+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.591671+0000","last_undegraded":"2023-11-26T07:16:31.591671+0000","last_fullsized":"2023-11-26T07:16:31.591671+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.594660+0000","last_change":"2023-11-26T07:16:31.594660+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.594660+0000","last_undegraded":"2023-11-26T07:16:31.594660+0000","last_fullsized":"2023-11-26T07:16:31.594660+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.595823+0000","last_change":"2023-11-26T07:16:31.595823+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.595823+0000","last_undegraded":"2023-11-26T07:16:31.595823+0000","last_fullsized":"2023-11-26T07:16:31.595823+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.590424+0000","last_change":"2023-11-26T07:16:31.590424+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.590424+0000","last_undegraded":"2023-11-26T07:16:31.590424+0000","last_fullsized":"2023-11-26T07:16:31.590424+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.595869+0000","last_change":"2023-11-26T07:16:31.595869+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.595869+0000","last_undegraded":"2023-11-26T07:16:31.595869+0000","last_fullsized":"2023-11-26T07:16:31.595869+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.594757+0000","last_change":"2023-11-26T07:16:31.594757+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.594757+0000","last_undegraded":"2023-11-26T07:16:31.594757+0000","last_fullsized":"2023-11-26T07:16:31.594757+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.594164+0000","last_change":"2023-11-26T07:16:31.594164+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.594164+0000","last_undegraded":"2023-11-26T07:16:31.594164+0000","last_fullsized":"2023-11-26T07:16:31.594164+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.594946+0000","last_change":"2023-11-26T07:16:31.594946+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.594946+0000","last_undegraded":"2023-11-26T07:16:31.594946+0000","last_fullsized":"2023-11-26T07:16:31.594946+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.595892+0000","last_change":"2023-11-26T07:16:31.595892+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.595892+0000","last_undegraded":"2023-11-26T07:16:31.595892+0000","last_fullsized":"2023-11-26T07:16:31.595892+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.609808+0000","last_change":"2023-11-26T07:16:31.609063+0000","last_active":"2023-11-26T07:16:31.609808+0000","last_peered":"2023-11-26T07:16:31.609808+0000","last_clean":"2023-11-26T07:16:31.609808+0000","last_became_active":"2023-11-26T07:16:31.608791+0000","last_became_peered":"2023-11-26T07:16:31.608791+0000","last_unstale":"2023-11-26T07:16:31.609808+0000","last_undegraded":"2023-11-26T07:16:31.609808+0000","last_fullsized":"2023-11-26T07:16:31.609808+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:18:47.861543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.599410+0000","last_change":"2023-11-26T07:16:31.599410+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.599410+0000","last_undegraded":"2023-11-26T07:16:31.599410+0000","last_fullsized":"2023-11-26T07:16:31.599410+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.607180+0000","last_change":"2023-11-26T07:16:31.604650+0000","last_active":"2023-11-26T07:16:31.607180+0000","last_peered":"2023-11-26T07:16:31.607180+0000","last_clean":"2023-11-26T07:16:31.607180+0000","last_became_active":"2023-11-26T07:16:31.603826+0000","last_became_peered":"2023-11-26T07:16:31.603826+0000","last_unstale":"2023-11-26T07:16:31.607180+0000","last_undegraded":"2023-11-26T07:16:31.607180+0000","last_fullsized":"2023-11-26T07:16:31.607180+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:47:37.657536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.595949+0000","last_change":"2023-11-26T07:16:31.595949+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.595949+0000","last_undegraded":"2023-11-26T07:16:31.595949+0000","last_fullsized":"2023-11-26T07:16:31.595949+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.609847+0000","last_change":"2023-11-26T07:16:31.606982+0000","last_active":"2023-11-26T07:16:31.609847+0000","last_peered":"2023-11-26T07:16:31.609847+0000","last_clean":"2023-11-26T07:16:31.609847+0000","last_became_active":"2023-11-26T07:16:31.606668+0000","last_became_peered":"2023-11-26T07:16:31.606668+0000","last_unstale":"2023-11-26T07:16:31.609847+0000","last_undegraded":"2023-11-26T07:16:31.609847+0000","last_fullsized":"2023-11-26T07:16:31.609847+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:49:13.892037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.596841+0000","last_change":"2023-11-26T07:16:31.596841+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.596841+0000","last_undegraded":"2023-11-26T07:16:31.596841+0000","last_fullsized":"2023-11-26T07:16:31.596841+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.608125+0000","last_change":"2023-11-26T07:16:31.606756+0000","last_active":"2023-11-26T07:16:31.608125+0000","last_peered":"2023-11-26T07:16:31.608125+0000","last_clean":"2023-11-26T07:16:31.608125+0000","last_became_active":"2023-11-26T07:16:31.606493+0000","last_became_peered":"2023-11-26T07:16:31.606493+0000","last_unstale":"2023-11-26T07:16:31.608125+0000","last_undegraded":"2023-11-26T07:16:31.608125+0000","last_fullsized":"2023-11-26T07:16:31.608125+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:06:48.106371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.593690+0000","last_change":"2023-11-26T07:16:31.593690+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.593690+0000","last_undegraded":"2023-11-26T07:16:31.593690+0000","last_fullsized":"2023-11-26T07:16:31.593690+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.601859+0000","last_change":"2023-11-26T07:16:31.598926+0000","last_active":"2023-11-26T07:16:31.601859+0000","last_peered":"2023-11-26T07:16:31.601859+0000","last_clean":"2023-11-26T07:16:31.601859+0000","last_became_active":"2023-11-26T07:16:31.598622+0000","last_became_peered":"2023-11-26T07:16:31.598622+0000","last_unstale":"2023-11-26T07:16:31.601859+0000","last_undegraded":"2023-11-26T07:16:31.601859+0000","last_fullsized":"2023-11-26T07:16:31.601859+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:04:22.685813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.590394+0000","last_change":"2023-11-26T07:16:31.590394+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.590394+0000","last_undegraded":"2023-11-26T07:16:31.590394+0000","last_fullsized":"2023-11-26T07:16:31.590394+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.610370+0000","last_change":"2023-11-26T07:16:31.608252+0000","last_active":"2023-11-26T07:16:31.610370+0000","last_peered":"2023-11-26T07:16:31.610370+0000","last_clean":"2023-11-26T07:16:31.610370+0000","last_became_active":"2023-11-26T07:16:31.607942+0000","last_became_peered":"2023-11-26T07:16:31.607942+0000","last_unstale":"2023-11-26T07:16:31.610370+0000","last_undegraded":"2023-11-26T07:16:31.610370+0000","last_fullsized":"2023-11-26T07:16:31.610370+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:55:42.677020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.599635+0000","last_change":"2023-11-26T07:16:31.599635+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.599635+0000","last_undegraded":"2023-11-26T07:16:31.599635+0000","last_fullsized":"2023-11-26T07:16:31.599635+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.602579+0000","last_change":"2023-11-26T07:16:31.597056+0000","last_active":"2023-11-26T07:16:31.602579+0000","last_peered":"2023-11-26T07:16:31.602579+0000","last_clean":"2023-11-26T07:16:31.602579+0000","last_became_active":"2023-11-26T07:16:31.596785+0000","last_became_peered":"2023-11-26T07:16:31.596785+0000","last_unstale":"2023-11-26T07:16:31.602579+0000","last_undegraded":"2023-11-26T07:16:31.602579+0000","last_fullsized":"2023-11-26T07:16:31.602579+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:00:37.336785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.593030+0000","last_change":"2023-11-26T07:16:31.593030+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.593030+0000","last_undegraded":"2023-11-26T07:16:31.593030+0000","last_fullsized":"2023-11-26T07:16:31.593030+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.610454+0000","last_change":"2023-11-26T07:16:31.608983+0000","last_active":"2023-11-26T07:16:31.610454+0000","last_peered":"2023-11-26T07:16:31.610454+0000","last_clean":"2023-11-26T07:16:31.610454+0000","last_became_active":"2023-11-26T07:16:31.608647+0000","last_became_peered":"2023-11-26T07:16:31.608647+0000","last_unstale":"2023-11-26T07:16:31.610454+0000","last_undegraded":"2023-11-26T07:16:31.610454+0000","last_fullsized":"2023-11-26T07:16:31.610454+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:31:11.200541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.594201+0000","last_change":"2023-11-26T07:16:31.594201+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.594201+0000","last_undegraded":"2023-11-26T07:16:31.594201+0000","last_fullsized":"2023-11-26T07:16:31.594201+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.604578+0000","last_change":"2023-11-26T07:16:31.597710+0000","last_active":"2023-11-26T07:16:31.604578+0000","last_peered":"2023-11-26T07:16:31.604578+0000","last_clean":"2023-11-26T07:16:31.604578+0000","last_became_active":"2023-11-26T07:16:31.597421+0000","last_became_peered":"2023-11-26T07:16:31.597421+0000","last_unstale":"2023-11-26T07:16:31.604578+0000","last_undegraded":"2023-11-26T07:16:31.604578+0000","last_fullsized":"2023-11-26T07:16:31.604578+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:21:29.309253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.598876+0000","last_change":"2023-11-26T07:16:31.598876+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.598876+0000","last_undegraded":"2023-11-26T07:16:31.598876+0000","last_fullsized":"2023-11-26T07:16:31.598876+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.608688+0000","last_change":"2023-11-26T07:16:31.607372+0000","last_active":"2023-11-26T07:16:31.608688+0000","last_peered":"2023-11-26T07:16:31.608688+0000","last_clean":"2023-11-26T07:16:31.608688+0000","last_became_active":"2023-11-26T07:16:31.607094+0000","last_became_peered":"2023-11-26T07:16:31.607094+0000","last_unstale":"2023-11-26T07:16:31.608688+0000","last_undegraded":"2023-11-26T07:16:31.608688+0000","last_fullsized":"2023-11-26T07:16:31.608688+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:35:30.163394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.595583+0000","last_change":"2023-11-26T07:16:31.595583+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.595583+0000","last_undegraded":"2023-11-26T07:16:31.595583+0000","last_fullsized":"2023-11-26T07:16:31.595583+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.601820+0000","last_change":"2023-11-26T07:16:31.598168+0000","last_active":"2023-11-26T07:16:31.601820+0000","last_peered":"2023-11-26T07:16:31.601820+0000","last_clean":"2023-11-26T07:16:31.601820+0000","last_became_active":"2023-11-26T07:16:31.597799+0000","last_became_peered":"2023-11-26T07:16:31.597799+0000","last_unstale":"2023-11-26T07:16:31.601820+0000","last_undegraded":"2023-11-26T07:16:31.601820+0000","last_fullsized":"2023-11-26T07:16:31.601820+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:25:16.232940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.599913+0000","last_change":"2023-11-26T07:16:31.599913+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.599913+0000","last_undegraded":"2023-11-26T07:16:31.599913+0000","last_fullsized":"2023-11-26T07:16:31.599913+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.608573+0000","last_change":"2023-11-26T07:16:31.605820+0000","last_active":"2023-11-26T07:16:31.608573+0000","last_peered":"2023-11-26T07:16:31.608573+0000","last_clean":"2023-11-26T07:16:31.608573+0000","last_became_active":"2023-11-26T07:16:31.604337+0000","last_became_peered":"2023-11-26T07:16:31.604337+0000","last_unstale":"2023-11-26T07:16:31.608573+0000","last_undegraded":"2023-11-26T07:16:31.608573+0000","last_fullsized":"2023-11-26T07:16:31.608573+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:57:09.945561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.595895+0000","last_change":"2023-11-26T07:16:31.595895+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.595895+0000","last_undegraded":"2023-11-26T07:16:31.595895+0000","last_fullsized":"2023-11-26T07:16:31.595895+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.609626+0000","last_change":"2023-11-26T07:16:31.607105+0000","last_active":"2023-11-26T07:16:31.609626+0000","last_peered":"2023-11-26T07:16:31.609626+0000","last_clean":"2023-11-26T07:16:31.609626+0000","last_became_active":"2023-11-26T07:16:31.606832+0000","last_became_peered":"2023-11-26T07:16:31.606832+0000","last_unstale":"2023-11-26T07:16:31.609626+0000","last_undegraded":"2023-11-26T07:16:31.609626+0000","last_fullsized":"2023-11-26T07:16:31.609626+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:47:30.148611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.593693+0000","last_change":"2023-11-26T07:16:31.593693+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.593693+0000","last_undegraded":"2023-11-26T07:16:31.593693+0000","last_fullsized":"2023-11-26T07:16:31.593693+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.608705+0000","last_change":"2023-11-26T07:16:31.607550+0000","last_active":"2023-11-26T07:16:31.608705+0000","last_peered":"2023-11-26T07:16:31.608705+0000","last_clean":"2023-11-26T07:16:31.608705+0000","last_became_active":"2023-11-26T07:16:31.607266+0000","last_became_peered":"2023-11-26T07:16:31.607266+0000","last_unstale":"2023-11-26T07:16:31.608705+0000","last_undegraded":"2023-11-26T07:16:31.608705+0000","last_fullsized":"2023-11-26T07:16:31.608705+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:15:53.033981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.594576+0000","last_change":"2023-11-26T07:16:31.594576+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.594576+0000","last_undegraded":"2023-11-26T07:16:31.594576+0000","last_fullsized":"2023-11-26T07:16:31.594576+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.604518+0000","last_change":"2023-11-26T07:16:31.598844+0000","last_active":"2023-11-26T07:16:31.604518+0000","last_peered":"2023-11-26T07:16:31.604518+0000","last_clean":"2023-11-26T07:16:31.604518+0000","last_became_active":"2023-11-26T07:16:31.598510+0000","last_became_peered":"2023-11-26T07:16:31.598510+0000","last_unstale":"2023-11-26T07:16:31.604518+0000","last_undegraded":"2023-11-26T07:16:31.604518+0000","last_fullsized":"2023-11-26T07:16:31.604518+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:41:16.384671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.600076+0000","last_change":"2023-11-26T07:16:31.600076+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.600076+0000","last_undegraded":"2023-11-26T07:16:31.600076+0000","last_fullsized":"2023-11-26T07:16:31.600076+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.610337+0000","last_change":"2023-11-26T07:16:31.609252+0000","last_active":"2023-11-26T07:16:31.610337+0000","last_peered":"2023-11-26T07:16:31.610337+0000","last_clean":"2023-11-26T07:16:31.610337+0000","last_became_active":"2023-11-26T07:16:31.608944+0000","last_became_peered":"2023-11-26T07:16:31.608944+0000","last_unstale":"2023-11-26T07:16:31.610337+0000","last_undegraded":"2023-11-26T07:16:31.610337+0000","last_fullsized":"2023-11-26T07:16:31.610337+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:27:23.533262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.591339+0000","last_change":"2023-11-26T07:16:31.591339+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.591339+0000","last_undegraded":"2023-11-26T07:16:31.591339+0000","last_fullsized":"2023-11-26T07:16:31.591339+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.610712+0000","last_change":"2023-11-26T07:16:31.608619+0000","last_active":"2023-11-26T07:16:31.610712+0000","last_peered":"2023-11-26T07:16:31.610712+0000","last_clean":"2023-11-26T07:16:31.610712+0000","last_became_active":"2023-11-26T07:16:31.608154+0000","last_became_peered":"2023-11-26T07:16:31.608154+0000","last_unstale":"2023-11-26T07:16:31.610712+0000","last_undegraded":"2023-11-26T07:16:31.610712+0000","last_fullsized":"2023-11-26T07:16:31.610712+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:49:38.418150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.598410+0000","last_change":"2023-11-26T07:16:31.598410+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.598410+0000","last_undegraded":"2023-11-26T07:16:31.598410+0000","last_fullsized":"2023-11-26T07:16:31.598410+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.609872+0000","last_change":"2023-11-26T07:16:31.608166+0000","last_active":"2023-11-26T07:16:31.609872+0000","last_peered":"2023-11-26T07:16:31.609872+0000","last_clean":"2023-11-26T07:16:31.609872+0000","last_became_active":"2023-11-26T07:16:31.607443+0000","last_became_peered":"2023-11-26T07:16:31.607443+0000","last_unstale":"2023-11-26T07:16:31.609872+0000","last_undegraded":"2023-11-26T07:16:31.609872+0000","last_fullsized":"2023-11-26T07:16:31.609872+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:08:07.953306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.593458+0000","last_change":"2023-11-26T07:16:31.593458+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.593458+0000","last_undegraded":"2023-11-26T07:16:31.593458+0000","last_fullsized":"2023-11-26T07:16:31.593458+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.607301+0000","last_change":"2023-11-26T07:16:31.602892+0000","last_active":"2023-11-26T07:16:31.607301+0000","last_peered":"2023-11-26T07:16:31.607301+0000","last_clean":"2023-11-26T07:16:31.607301+0000","last_became_active":"2023-11-26T07:16:31.602626+0000","last_became_peered":"2023-11-26T07:16:31.602626+0000","last_unstale":"2023-11-26T07:16:31.607301+0000","last_undegraded":"2023-11-26T07:16:31.607301+0000","last_fullsized":"2023-11-26T07:16:31.607301+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:31:17.102746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.599311+0000","last_change":"2023-11-26T07:16:31.599311+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.599311+0000","last_undegraded":"2023-11-26T07:16:31.599311+0000","last_fullsized":"2023-11-26T07:16:31.599311+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.608799+0000","last_change":"2023-11-26T07:16:31.606767+0000","last_active":"2023-11-26T07:16:31.608799+0000","last_peered":"2023-11-26T07:16:31.608799+0000","last_clean":"2023-11-26T07:16:31.608799+0000","last_became_active":"2023-11-26T07:16:31.606477+0000","last_became_peered":"2023-11-26T07:16:31.606477+0000","last_unstale":"2023-11-26T07:16:31.608799+0000","last_undegraded":"2023-11-26T07:16:31.608799+0000","last_fullsized":"2023-11-26T07:16:31.608799+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:53:36.321574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.594972+0000","last_change":"2023-11-26T07:16:31.594972+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.594972+0000","last_undegraded":"2023-11-26T07:16:31.594972+0000","last_fullsized":"2023-11-26T07:16:31.594972+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.608685+0000","last_change":"2023-11-26T07:16:31.607018+0000","last_active":"2023-11-26T07:16:31.608685+0000","last_peered":"2023-11-26T07:16:31.608685+0000","last_clean":"2023-11-26T07:16:31.608685+0000","last_became_active":"2023-11-26T07:16:31.606736+0000","last_became_peered":"2023-11-26T07:16:31.606736+0000","last_unstale":"2023-11-26T07:16:31.608685+0000","last_undegraded":"2023-11-26T07:16:31.608685+0000","last_fullsized":"2023-11-26T07:16:31.608685+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:51:01.983190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.592923+0000","last_change":"2023-11-26T07:16:31.592923+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.592923+0000","last_undegraded":"2023-11-26T07:16:31.592923+0000","last_fullsized":"2023-11-26T07:16:31.592923+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.606079+0000","last_change":"2023-11-26T07:16:31.604168+0000","last_active":"2023-11-26T07:16:31.606079+0000","last_peered":"2023-11-26T07:16:31.606079+0000","last_clean":"2023-11-26T07:16:31.606079+0000","last_became_active":"2023-11-26T07:16:31.603852+0000","last_became_peered":"2023-11-26T07:16:31.603852+0000","last_unstale":"2023-11-26T07:16:31.606079+0000","last_undegraded":"2023-11-26T07:16:31.606079+0000","last_fullsized":"2023-11-26T07:16:31.606079+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:04:43.215372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.593451+0000","last_change":"2023-11-26T07:16:31.593451+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.593451+0000","last_undegraded":"2023-11-26T07:16:31.593451+0000","last_fullsized":"2023-11-26T07:16:31.593451+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.607360+0000","last_change":"2023-11-26T07:16:31.603291+0000","last_active":"2023-11-26T07:16:31.607360+0000","last_peered":"2023-11-26T07:16:31.607360+0000","last_clean":"2023-11-26T07:16:31.607360+0000","last_became_active":"2023-11-26T07:16:31.603030+0000","last_became_peered":"2023-11-26T07:16:31.603030+0000","last_unstale":"2023-11-26T07:16:31.607360+0000","last_undegraded":"2023-11-26T07:16:31.607360+0000","last_fullsized":"2023-11-26T07:16:31.607360+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:18:47.861543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.596145+0000","last_change":"2023-11-26T07:16:31.596145+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.596145+0000","last_undegraded":"2023-11-26T07:16:31.596145+0000","last_fullsized":"2023-11-26T07:16:31.596145+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.610351+0000","last_change":"2023-11-26T07:16:31.608037+0000","last_active":"2023-11-26T07:16:31.610351+0000","last_peered":"2023-11-26T07:16:31.610351+0000","last_clean":"2023-11-26T07:16:31.610351+0000","last_became_active":"2023-11-26T07:16:31.607653+0000","last_became_peered":"2023-11-26T07:16:31.607653+0000","last_unstale":"2023-11-26T07:16:31.610351+0000","last_undegraded":"2023-11-26T07:16:31.610351+0000","last_fullsized":"2023-11-26T07:16:31.610351+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:21:40.442201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.593759+0000","last_change":"2023-11-26T07:16:31.593759+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.593759+0000","last_undegraded":"2023-11-26T07:16:31.593759+0000","last_fullsized":"2023-11-26T07:16:31.593759+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.605881+0000","last_change":"2023-11-26T07:16:31.601496+0000","last_active":"2023-11-26T07:16:31.605881+0000","last_peered":"2023-11-26T07:16:31.605881+0000","last_clean":"2023-11-26T07:16:31.605881+0000","last_became_active":"2023-11-26T07:16:31.600854+0000","last_became_peered":"2023-11-26T07:16:31.600854+0000","last_unstale":"2023-11-26T07:16:31.605881+0000","last_undegraded":"2023-11-26T07:16:31.605881+0000","last_fullsized":"2023-11-26T07:16:31.605881+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:00:32.449928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.596521+0000","last_change":"2023-11-26T07:16:31.596521+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.596521+0000","last_undegraded":"2023-11-26T07:16:31.596521+0000","last_fullsized":"2023-11-26T07:16:31.596521+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.611821+0000","last_change":"2023-11-26T07:16:31.611255+0000","last_active":"2023-11-26T07:16:31.611821+0000","last_peered":"2023-11-26T07:16:31.611821+0000","last_clean":"2023-11-26T07:16:31.611821+0000","last_became_active":"2023-11-26T07:16:31.610936+0000","last_became_peered":"2023-11-26T07:16:31.610936+0000","last_unstale":"2023-11-26T07:16:31.611821+0000","last_undegraded":"2023-11-26T07:16:31.611821+0000","last_fullsized":"2023-11-26T07:16:31.611821+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:59:20.890903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.596395+0000","last_change":"2023-11-26T07:16:31.596395+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.596395+0000","last_undegraded":"2023-11-26T07:16:31.596395+0000","last_fullsized":"2023-11-26T07:16:31.596395+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.607426+0000","last_change":"2023-11-26T07:16:31.604687+0000","last_active":"2023-11-26T07:16:31.607426+0000","last_peered":"2023-11-26T07:16:31.607426+0000","last_clean":"2023-11-26T07:16:31.607426+0000","last_became_active":"2023-11-26T07:16:31.604369+0000","last_became_peered":"2023-11-26T07:16:31.604369+0000","last_unstale":"2023-11-26T07:16:31.607426+0000","last_undegraded":"2023-11-26T07:16:31.607426+0000","last_fullsized":"2023-11-26T07:16:31.607426+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:40:49.206751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.599473+0000","last_change":"2023-11-26T07:16:31.599473+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.599473+0000","last_undegraded":"2023-11-26T07:16:31.599473+0000","last_fullsized":"2023-11-26T07:16:31.599473+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.609569+0000","last_change":"2023-11-26T07:16:31.606737+0000","last_active":"2023-11-26T07:16:31.609569+0000","last_peered":"2023-11-26T07:16:31.609569+0000","last_clean":"2023-11-26T07:16:31.609569+0000","last_became_active":"2023-11-26T07:16:31.606477+0000","last_became_peered":"2023-11-26T07:16:31.606477+0000","last_unstale":"2023-11-26T07:16:31.609569+0000","last_undegraded":"2023-11-26T07:16:31.609569+0000","last_fullsized":"2023-11-26T07:16:31.609569+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:20:43.639773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.594896+0000","last_change":"2023-11-26T07:16:31.594896+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.594896+0000","last_undegraded":"2023-11-26T07:16:31.594896+0000","last_fullsized":"2023-11-26T07:16:31.594896+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.602628+0000","last_change":"2023-11-26T07:16:31.597623+0000","last_active":"2023-11-26T07:16:31.602628+0000","last_peered":"2023-11-26T07:16:31.602628+0000","last_clean":"2023-11-26T07:16:31.602628+0000","last_became_active":"2023-11-26T07:16:31.597356+0000","last_became_peered":"2023-11-26T07:16:31.597356+0000","last_unstale":"2023-11-26T07:16:31.602628+0000","last_undegraded":"2023-11-26T07:16:31.602628+0000","last_fullsized":"2023-11-26T07:16:31.602628+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:33:18.957245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.593371+0000","last_change":"2023-11-26T07:16:31.593371+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.593371+0000","last_undegraded":"2023-11-26T07:16:31.593371+0000","last_fullsized":"2023-11-26T07:16:31.593371+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.609547+0000","last_change":"2023-11-26T07:16:31.605393+0000","last_active":"2023-11-26T07:16:31.609547+0000","last_peered":"2023-11-26T07:16:31.609547+0000","last_clean":"2023-11-26T07:16:31.609547+0000","last_became_active":"2023-11-26T07:16:31.605134+0000","last_became_peered":"2023-11-26T07:16:31.605134+0000","last_unstale":"2023-11-26T07:16:31.609547+0000","last_undegraded":"2023-11-26T07:16:31.609547+0000","last_fullsized":"2023-11-26T07:16:31.609547+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:00:14.422829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.595169+0000","last_change":"2023-11-26T07:16:31.595169+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.595169+0000","last_undegraded":"2023-11-26T07:16:31.595169+0000","last_fullsized":"2023-11-26T07:16:31.595169+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.607688+0000","last_change":"2023-11-26T07:16:31.605773+0000","last_active":"2023-11-26T07:16:31.607688+0000","last_peered":"2023-11-26T07:16:31.607688+0000","last_clean":"2023-11-26T07:16:31.607688+0000","last_became_active":"2023-11-26T07:16:31.605493+0000","last_became_peered":"2023-11-26T07:16:31.605493+0000","last_unstale":"2023-11-26T07:16:31.607688+0000","last_undegraded":"2023-11-26T07:16:31.607688+0000","last_fullsized":"2023-11-26T07:16:31.607688+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:06:59.820803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.593887+0000","last_change":"2023-11-26T07:16:31.593887+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.593887+0000","last_undegraded":"2023-11-26T07:16:31.593887+0000","last_fullsized":"2023-11-26T07:16:31.593887+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.607002+0000","last_change":"2023-11-26T07:16:31.603942+0000","last_active":"2023-11-26T07:16:31.607002+0000","last_peered":"2023-11-26T07:16:31.607002+0000","last_clean":"2023-11-26T07:16:31.607002+0000","last_became_active":"2023-11-26T07:16:31.603643+0000","last_became_peered":"2023-11-26T07:16:31.603643+0000","last_unstale":"2023-11-26T07:16:31.607002+0000","last_undegraded":"2023-11-26T07:16:31.607002+0000","last_fullsized":"2023-11-26T07:16:31.607002+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:38:12.974493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":209,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-26T07:16:30.591121+0000","last_change":"2023-11-26T07:11:29.855919+0000","last_active":"2023-11-26T07:16:30.591121+0000","last_peered":"2023-11-26T07:16:30.591121+0000","last_clean":"2023-11-26T07:16:30.591121+0000","last_became_active":"2023-11-26T07:11:29.854903+0000","last_became_peered":"2023-11-26T07:11:29.854903+0000","last_unstale":"2023-11-26T07:16:30.591121+0000","last_undegraded":"2023-11-26T07:16:30.591121+0000","last_fullsized":"2023-11-26T07:16:30.591121+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:28.594252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:28.594252+0000","last_clean_scrub_stamp":"2023-11-26T07:11:28.594252+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:33:34.642696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574914,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32612,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339228,"statfs":{"total":96636764160,"available":96603369472,"internally_reserved":0,"allocated":1458176,"data_stored":954971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:15:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34000000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.66600000000000004,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.51100000000000001,"15min":0.505},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.64400000000000002,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.63300000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:15:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.74299999999999999,"15min":0.94499999999999995},"min":{"1min":0.38600000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72199999999999998,"5min":9.5600000000000005,"15min":9.5600000000000005},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56100000000000005,"15min":0.57699999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.69599999999999995,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.59799999999999998}]},{"osd":2,"last update":"Sun Nov 26 07:15:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.58699999999999997,"15min":0.59899999999999998},"min":{"1min":0.42999999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.65700000000000003,"5min":1.569,"15min":1.569},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.623,"15min":0.64400000000000002},"min":{"1min":0.36899999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.71199999999999997,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.61699999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:15:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.57699999999999996,"15min":0.59799999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.63700000000000001,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.505},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.57699999999999996,"15min":0.56599999999999995},"min":{"1min":0.434,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69199999999999995,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.64700000000000002}]},{"osd":4,"last update":"Sun Nov 26 07:15:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.51800000000000002,"15min":0.52100000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.71099999999999997,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.52900000000000003,"15min":0.51300000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.67800000000000005,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.42099999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:15:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55100000000000005,"15min":0.53300000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.751,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.621,"15min":0.63},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.75900000000000001,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.44}]},{"osd":6,"last update":"Sun Nov 26 07:15:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.433,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72999999999999998,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.59599999999999997,"15min":0.59099999999999997},"min":{"1min":0.40500000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.69199999999999995,"5min":1.552,"15min":1.552},"last":0.46899999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574914,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":851968,"data_stored":358328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:15:30 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.50700000000000001,"15min":0.48499999999999999},"min":{"1min":0.33200000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.70899999999999996,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.51600000000000001,"15min":0.47999999999999998},"min":{"1min":0.35299999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.80800000000000005,"5min":0.871,"15min":0.871},"last":0.54500000000000004}]},{"osd":1,"last update":"Sun Nov 26 07:15:30 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.52100000000000002,"15min":0.51100000000000001},"min":{"1min":0.39000000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.65500000000000003,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.629},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.39600000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.82999999999999996,"5min":1.198,"15min":1.198},"last":0.51800000000000002}]},{"osd":2,"last update":"Sun Nov 26 07:15:30 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.51800000000000002,"15min":0.496},"min":{"1min":0.36199999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.68600000000000005,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.55300000000000005,"15min":0.52500000000000002},"min":{"1min":0.38500000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.79600000000000004,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.59699999999999998}]},{"osd":3,"last update":"Sun Nov 26 07:15:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58599999999999997,"15min":0.55500000000000005},"min":{"1min":0.44500000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.85999999999999999,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60699999999999998,"15min":0.58499999999999996},"min":{"1min":0.40699999999999997,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.67000000000000004}]},{"osd":4,"last update":"Sun Nov 26 07:15:30 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.51500000000000001,"15min":0.52800000000000002},"min":{"1min":0.35399999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.67900000000000005,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.34000000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.41199999999999998}]},{"osd":5,"last update":"Sun Nov 26 07:15:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56599999999999995,"15min":0.56100000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.70199999999999996,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.77700000000000002,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.443}]},{"osd":7,"last update":"Sun Nov 26 07:15:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59399999999999997,"15min":0.59199999999999997},"min":{"1min":0.38300000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79300000000000004,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.629,"15min":0.626},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80200000000000005,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.495}]}]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":864256,"data_stored":364603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.36299999999999999},"min":{"1min":0.223,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.57999999999999996,"15min":0.79900000000000004},"min":{"1min":0.29299999999999998,"5min":0.214,"15min":0.214},"max":{"1min":0.55700000000000005,"5min":11.922000000000001,"15min":11.922000000000001},"last":0.56200000000000006}]},{"osd":2,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35799999999999998,"15min":0.372},"min":{"1min":0.26000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.59599999999999997,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.40300000000000002,"15min":0.40799999999999997},"min":{"1min":0.307,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.56999999999999995,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.50600000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.45000000000000001,"15min":0.45800000000000002},"min":{"1min":0.35599999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.61299999999999999,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.42999999999999999,"15min":0.44},"min":{"1min":0.32500000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.51100000000000001,"5min":1.101,"15min":1.101},"last":0.40999999999999998}]},{"osd":4,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.74099999999999999,"15min":0.86499999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82199999999999995,"5min":6.8979999999999997,"15min":6.8979999999999997},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.65600000000000003,"15min":0.66400000000000003},"min":{"1min":0.48799999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83999999999999997,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.66200000000000003}]},{"osd":5,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.621,"15min":0.627},"min":{"1min":0.41599999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.89100000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":1.2090000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.745,"15min":0.871},"min":{"1min":0.442,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85199999999999998,"5min":6.9480000000000004,"15min":6.9480000000000004},"last":0.45100000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.64700000000000002,"15min":0.66100000000000003},"min":{"1min":0.46200000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.87,"5min":1.194,"15min":1.194},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.75800000000000001,"15min":0.89500000000000002},"min":{"1min":0.435,"5min":0.372,"15min":0.372},"max":{"1min":0.90500000000000003,"5min":6.9800000000000004,"15min":6.9800000000000004},"last":1.222}]},{"osd":7,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65800000000000003,"15min":0.66000000000000003},"min":{"1min":0.48399999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.92400000000000004,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":3.5649999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.68300000000000005},"min":{"1min":0.44700000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.93300000000000005,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":3.548}]}]},{"osd":0,"up_from":13,"seq":55834574912,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32612,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339228,"statfs":{"total":96636764160,"available":96603369472,"internally_reserved":0,"allocated":1458176,"data_stored":954971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.34100000000000003,"15min":0.36799999999999999},"min":{"1min":0.24199999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.52600000000000002,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.374},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.58599999999999997,"15min":0.82099999999999995},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.54500000000000004,"5min":11.987,"15min":11.987},"last":0.26900000000000002}]},{"osd":2,"last update":"Sun Nov 26 07:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.39400000000000002,"15min":0.43099999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57099999999999995,"5min":1.607,"15min":1.607},"last":0.317},{"interface":"front","average":{"1min":0.375,"5min":0.39300000000000002,"15min":0.41099999999999998},"min":{"1min":0.27500000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.64900000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.34499999999999997}]},{"osd":3,"last update":"Sun Nov 26 07:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.375,"15min":0.38700000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.58899999999999997,"5min":0.752,"15min":0.752},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.44,"15min":0.46999999999999997},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71699999999999997,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.40000000000000002}]},{"osd":4,"last update":"Sun Nov 26 07:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.61799999999999999,"15min":0.65000000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71999999999999997,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.73799999999999999,"15min":0.88},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77300000000000002,"5min":6.5279999999999996,"15min":6.5279999999999996},"last":0.499}]},{"osd":5,"last update":"Sun Nov 26 07:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.622,"15min":0.64700000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77400000000000002,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.65900000000000003,"15min":0.69199999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.80500000000000005,"5min":1.508,"15min":1.508},"last":0.61099999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.76900000000000002,"15min":0.91600000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85299999999999998,"5min":6.5419999999999998,"15min":6.5419999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.64000000000000001,"15min":0.67300000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.79200000000000004,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.46700000000000003}]},{"osd":7,"last update":"Sun Nov 26 07:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.66200000000000003,"15min":0.69599999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.83799999999999997,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.64100000000000001,"15min":0.66200000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82899999999999996,"5min":1.155,"15min":1.155},"last":0.47699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574913,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":864256,"data_stored":364603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:15:38 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34000000000000002,"15min":0.34599999999999997},"min":{"1min":0.22500000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39400000000000002,"15min":0.39800000000000002},"min":{"1min":0.28100000000000003,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.53500000000000003,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.34399999999999997}]},{"osd":1,"last update":"Sun Nov 26 07:15:38 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34399999999999997,"15min":0.34799999999999998},"min":{"1min":0.224,"5min":0.222,"15min":0.222},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.375,"15min":0.377},"min":{"1min":0.24399999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.58199999999999996,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.39800000000000002}]},{"osd":3,"last update":"Sun Nov 26 07:15:38 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39700000000000002,"15min":0.41099999999999998},"min":{"1min":0.28100000000000003,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.59699999999999998,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.376,"5min":0.374,"15min":0.38200000000000001},"min":{"1min":0.27600000000000002,"5min":0.224,"15min":0.224},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.47899999999999998}]},{"osd":4,"last update":"Sun Nov 26 07:15:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.42699999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.497},{"interface":"front","average":{"1min":0.623,"5min":0.58399999999999996,"15min":0.58099999999999996},"min":{"1min":0.438,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.44800000000000001}]},{"osd":5,"last update":"Sun Nov 26 07:15:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.58099999999999996,"15min":0.57699999999999996},"min":{"1min":0.47199999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.435},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60999999999999999,"15min":0.63},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84299999999999997,"5min":1.002,"15min":1.002},"last":0.56100000000000005}]},{"osd":6,"last update":"Sun Nov 26 07:15:38 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.60899999999999999,"15min":0.61099999999999999},"min":{"1min":0.40999999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.629,"15min":0.63500000000000001},"min":{"1min":0.44700000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.53800000000000003}]},{"osd":7,"last update":"Sun Nov 26 07:15:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.62,"15min":0.629},"min":{"1min":0.499,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86299999999999999,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.625,"15min":0.625},"min":{"1min":0.47199999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.51300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574913,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":864256,"data_stored":364603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.34100000000000003,"15min":0.36499999999999999},"min":{"1min":0.22,"5min":0.219,"15min":0.219},"max":{"1min":0.46600000000000003,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.39300000000000002,"15min":0.41899999999999998},"min":{"1min":0.24199999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.61299999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.32400000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.375,"15min":0.40300000000000002},"min":{"1min":0.25800000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.58799999999999997,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.252},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.439,"15min":0.5},"min":{"1min":0.26300000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.56899999999999995,"5min":2.903,"15min":2.903},"last":0.35099999999999998}]},{"osd":2,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39300000000000002,"15min":0.40400000000000003},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.55200000000000005,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.40500000000000003,"15min":0.41799999999999998},"min":{"1min":0.309,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.63700000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.374}]},{"osd":4,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.65400000000000003,"15min":0.70699999999999996},"min":{"1min":0.376,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.96799999999999997,"5min":2.9609999999999999,"15min":2.9609999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.625,"15min":0.64100000000000001},"min":{"1min":0.437,"5min":0.373,"15min":0.373},"max":{"1min":1.1499999999999999,"5min":1.163,"15min":1.163},"last":0.64500000000000002}]},{"osd":5,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.65100000000000002,"15min":0.67300000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.98199999999999998,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.64000000000000001,"15min":0.66400000000000003},"min":{"1min":0.436,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93999999999999995,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.63}]},{"osd":6,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64500000000000002,"15min":0.67100000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.083,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.65600000000000003,"15min":0.68000000000000005},"min":{"1min":0.44900000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94499999999999995,"5min":1.258,"15min":1.258},"last":0.55000000000000004}]},{"osd":7,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.65200000000000002,"15min":0.68200000000000005},"min":{"1min":0.46700000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.014,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.69799999999999995,"15min":0.752},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.94899999999999995,"5min":2.9969999999999999,"15min":2.9969999999999999},"last":0.59799999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574912,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":864256,"data_stored":364603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.73599999999999999,"15min":0.91200000000000003},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.80800000000000005,"5min":8.7539999999999996,"15min":8.7539999999999996},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.76000000000000001,"15min":0.93100000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.74299999999999999,"5min":8.7390000000000008,"15min":8.7390000000000008},"last":0.57499999999999996}]},{"osd":1,"last update":"Sun Nov 26 07:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.76600000000000001,"15min":0.96199999999999997},"min":{"1min":0.34799999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.76400000000000001,"5min":9.7720000000000002,"15min":9.7720000000000002},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56200000000000006,"15min":0.56799999999999995},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.74399999999999999,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.54200000000000004}]},{"osd":2,"last update":"Sun Nov 26 07:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.73499999999999999,"15min":0.91600000000000004},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.748,"5min":9.8119999999999994,"15min":9.8119999999999994},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.70699999999999996,"15min":0.82299999999999995},"min":{"1min":0.35699999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76000000000000001,"5min":3.645,"15min":3.645},"last":0.56100000000000005}]},{"osd":3,"last update":"Sun Nov 26 07:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.78200000000000003,"15min":0.95999999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.81299999999999994,"5min":8.8089999999999993,"15min":8.8089999999999993},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.77400000000000002,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.49299999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52300000000000002,"15min":0.505},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.55500000000000005,"15min":0.55200000000000005},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72699999999999998,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.33600000000000002}]},{"osd":6,"last update":"Sun Nov 26 07:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.35199999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56200000000000006,"15min":0.57199999999999995},"min":{"1min":0.36099999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79600000000000004,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.39200000000000002}]},{"osd":7,"last update":"Sun Nov 26 07:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.32600000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.79100000000000004,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.60599999999999998,"15min":0.60399999999999998},"min":{"1min":0.40200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.91000000000000003,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.433}]}]},{"osd":5,"up_from":13,"seq":55834574914,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":864256,"data_stored":364603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58099999999999996,"15min":0.53800000000000003},"min":{"1min":0.40400000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.80200000000000005,"5min":7.1500000000000004,"15min":7.1500000000000004},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.60099999999999998,"15min":0.57299999999999995},"min":{"1min":0.42599999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.747,"5min":6.8470000000000004,"15min":6.8470000000000004},"last":0.45900000000000002}]},{"osd":1,"last update":"Sun Nov 26 07:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.59099999999999997,"15min":0.55700000000000005},"min":{"1min":0.442,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.746,"5min":7.1269999999999998,"15min":7.1269999999999998},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56499999999999995,"15min":0.55900000000000005},"min":{"1min":0.39900000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.70499999999999996,"5min":1.514,"15min":1.514},"last":0.61899999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.63700000000000001,"15min":0.59599999999999997},"min":{"1min":0.377,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81899999999999995,"5min":7.2000000000000002,"15min":7.2000000000000002},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66100000000000003,"15min":0.62},"min":{"1min":0.51800000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.71999999999999997,"5min":7.8259999999999996,"15min":7.8259999999999996},"last":0.70899999999999996}]},{"osd":3,"last update":"Sun Nov 26 07:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.58899999999999997,"15min":0.56799999999999995},"min":{"1min":0.52200000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.77600000000000002,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.64900000000000002,"15min":0.60699999999999998},"min":{"1min":0.42099999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84699999999999998,"5min":6.9240000000000004,"15min":6.9240000000000004},"last":0.73899999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.56000000000000005,"15min":0.51200000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72299999999999998,"5min":7.2830000000000004,"15min":7.2830000000000004},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57599999999999996,"15min":0.57399999999999995},"min":{"1min":0.40500000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73299999999999998,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.76600000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.624,"15min":0.57299999999999995},"min":{"1min":0.438,"5min":0.308,"15min":0.308},"max":{"1min":0.749,"5min":6.8890000000000002,"15min":6.8890000000000002},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.63700000000000001,"15min":0.59099999999999997},"min":{"1min":0.39600000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.74399999999999999,"5min":7.2430000000000003,"15min":7.2430000000000003},"last":0.82999999999999996}]},{"osd":7,"last update":"Sun Nov 26 07:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65900000000000003,"15min":0.60899999999999999},"min":{"1min":0.376,"5min":0.371,"15min":0.371},"max":{"1min":0.80600000000000005,"5min":6.9880000000000004,"15min":6.9880000000000004},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.73399999999999999,"15min":0.65900000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.80100000000000005,"5min":11.874000000000001,"15min":11.874000000000001},"last":0.84299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:16:37.165 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:16:37.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.323+0000 7f73ef61b700 1 Processor -- start 2023-11-26T07:16:37.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.323+0000 7f73ef61b700 1 -- start start 2023-11-26T07:16:37.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.324+0000 7f73ef61b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f73e80b3b40 0x7f73e80b5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:37.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.324+0000 7f73ef61b700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e806ef90 con 0x7f73e806f420 2023-11-26T07:16:37.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.324+0000 7f73ef61b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e80b5560 con 0x7f73e80b4c40 2023-11-26T07:16:37.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.324+0000 7f73ef61b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e806e380 con 0x7f73e80b3b40 2023-11-26T07:16:37.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.324+0000 7f73edbb8700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f73e806f420 0x7f73e80ce1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35514/0 (socket says 172.21.15.2:35514) 2023-11-26T07:16:37.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.324+0000 7f73edbb8700 1 -- 172.21.15.2:0/8760367 learned_addr learned my addr 172.21.15.2:0/8760367 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:16:37.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.324+0000 7f73dffff700 1 -- 172.21.15.2:0/8760367 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4200396461 0 0) 0x7f73e806ef90 con 0x7f73e806f420 2023-11-26T07:16:37.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.325+0000 7f73dffff700 1 -- 172.21.15.2:0/8760367 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73d40035b0 con 0x7f73e806f420 2023-11-26T07:16:37.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.325+0000 7f73ecbb6700 1 --2- 172.21.15.2:0/8760367 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f73e80b3b40 0x7f73e80b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:37.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.325+0000 7f73dffff700 1 -- 172.21.15.2:0/8760367 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1399764582 0 0) 0x7f73d40035b0 con 0x7f73e806f420 2023-11-26T07:16:37.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.325+0000 7f73dffff700 1 -- 172.21.15.2:0/8760367 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f73e80b3b40 msgr2=0x7f73e80b5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:37.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.325+0000 7f73dffff700 1 --2- 172.21.15.2:0/8760367 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f73e80b3b40 0x7f73e80b5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:37.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.325+0000 7f73dffff700 1 -- 172.21.15.2:0/8760367 >> v1:172.21.15.192:6789/0 conn(0x7f73e80b4c40 legacy=0x7f73e806dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:37.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.325+0000 7f73dffff700 1 -- 172.21.15.2:0/8760367 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e806e660 con 0x7f73e806f420 2023-11-26T07:16:37.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.325+0000 7f73dffff700 1 -- 172.21.15.2:0/8760367 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f73e00019f0 con 0x7f73e806f420 2023-11-26T07:16:37.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.325+0000 7f73dffff700 1 -- 172.21.15.2:0/8760367 >> v1:172.21.15.2:6789/0 conn(0x7f73e806f420 legacy=0x7f73e80ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:37.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.325+0000 7f73dffff700 1 --2- 172.21.15.2:0/8760367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73d4003a30 0x7f73d4003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:37.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.325+0000 7f73dffff700 1 --2- 172.21.15.2:0/8760367 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f73e80b3b40 0x7f73d4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:37.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.325+0000 7f73dffff700 1 --2- 172.21.15.2:0/8760367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73d4004d90 0x7f73d4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:37.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.325+0000 7f73dffff700 1 -- 172.21.15.2:0/8760367 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e806e380 con 0x7f73d4004d90 2023-11-26T07:16:37.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.325+0000 7f73dffff700 1 -- 172.21.15.2:0/8760367 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d400bac0 con 0x7f73d4003a30 2023-11-26T07:16:37.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.325+0000 7f73dffff700 1 -- 172.21.15.2:0/8760367 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d400bc80 con 0x7f73e80b3b40 2023-11-26T07:16:37.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.325+0000 7f73edbb8700 1 --2- 172.21.15.2:0/8760367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73d4004d90 0x7f73d4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:37.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.325+0000 7f73ed3b7700 1 --2- 172.21.15.2:0/8760367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73d4003a30 0x7f73d4003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:37.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.325+0000 7f73ecbb6700 1 --2- 172.21.15.2:0/8760367 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f73e80b3b40 0x7f73d4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:37.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.325+0000 7f73edbb8700 1 -- 172.21.15.2:0/8760367 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f73e80b3b40 msgr2=0x7f73d4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:37.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.325+0000 7f73edbb8700 1 --2- 172.21.15.2:0/8760367 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f73e80b3b40 0x7f73d4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:37.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.325+0000 7f73edbb8700 1 -- 172.21.15.2:0/8760367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73d4003a30 msgr2=0x7f73d4003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:37.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.325+0000 7f73edbb8700 1 --2- 172.21.15.2:0/8760367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73d4003a30 0x7f73d4003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:37.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.325+0000 7f73edbb8700 1 -- 172.21.15.2:0/8760367 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d40035b0 con 0x7f73d4004d90 2023-11-26T07:16:37.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.325+0000 7f73ed3b7700 1 --2- 172.21.15.2:0/8760367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73d4003a30 0x7f73d4003e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:16:37.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.325+0000 7f73ecbb6700 1 --2- 172.21.15.2:0/8760367 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f73e80b3b40 0x7f73d4004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:16:37.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.325+0000 7f73edbb8700 1 --2- 172.21.15.2:0/8760367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73d4004d90 0x7f73d4005210 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f73e000a800 tx=0x7f73d4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb93175f7d7d6db3 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:37.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.326+0000 7f73dffff700 1 -- 172.21.15.2:0/8760367 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e000a2f0 con 0x7f73d4004d90 2023-11-26T07:16:37.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.326+0000 7f73dffff700 1 -- 172.21.15.2:0/8760367 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e0012600 con 0x7f73d4004d90 2023-11-26T07:16:37.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.326+0000 7f73dffff700 1 -- 172.21.15.2:0/8760367 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e00129b0 con 0x7f73d4004d90 2023-11-26T07:16:37.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.326+0000 7f73ef61b700 1 -- 172.21.15.2:0/8760367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73d4004d90 msgr2=0x7f73d4005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:37.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.326+0000 7f73ef61b700 1 --2- 172.21.15.2:0/8760367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73d4004d90 0x7f73d4005210 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f73e000a800 tx=0x7f73d4005880 comp rx=0 tx=0).stop 2023-11-26T07:16:37.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.326+0000 7f73edbb8700 1 -- 172.21.15.2:0/8760367 reap_dead start 2023-11-26T07:16:37.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.326+0000 7f73ef61b700 1 -- 172.21.15.2:0/8760367 shutdown_connections 2023-11-26T07:16:37.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.326+0000 7f73ef61b700 1 -- 172.21.15.2:0/8760367 >> 172.21.15.2:0/8760367 conn(0x7f73e80b2840 msgr2=0x7f73e80b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:37.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.326+0000 7f73ef61b700 1 -- 172.21.15.2:0/8760367 shutdown_connections 2023-11-26T07:16:37.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.326+0000 7f73ef61b700 1 -- 172.21.15.2:0/8760367 wait complete. 2023-11-26T07:16:37.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.327+0000 7f73ef61b700 1 Processor -- start 2023-11-26T07:16:37.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.328+0000 7f73ef61b700 1 -- start start 2023-11-26T07:16:37.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.328+0000 7f73ef61b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73e8153720 0x7f73e81423b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:37.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.328+0000 7f73ef61b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f73e80afce0 0x7f73e815b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:37.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.328+0000 7f73ef61b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73e80b0160 0x7f73e815b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:37.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.328+0000 7f73ef61b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e8141310 con 0x7f73e8153720 2023-11-26T07:16:37.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.328+0000 7f73ef61b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e81415f0 con 0x7f73e80b0160 2023-11-26T07:16:37.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.328+0000 7f73ef61b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e81418d0 con 0x7f73e80afce0 2023-11-26T07:16:37.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.328+0000 7f73ed3b7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73e8153720 0x7f73e81423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:37.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.328+0000 7f73ed3b7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73e8153720 0x7f73e81423b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44312/0 (socket says 172.21.15.2:44312) 2023-11-26T07:16:37.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.328+0000 7f73ed3b7700 1 -- 172.21.15.2:0/753997028 learned_addr learned my addr 172.21.15.2:0/753997028 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:37.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.329+0000 7f73edbb8700 1 --2- 172.21.15.2:0/753997028 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73e80b0160 0x7f73e815b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:37.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.329+0000 7f73ecbb6700 1 --2- 172.21.15.2:0/753997028 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f73e80afce0 0x7f73e815b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:37.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.329+0000 7f73ed3b7700 1 -- 172.21.15.2:0/753997028 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f73e80afce0 msgr2=0x7f73e815b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:37.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.329+0000 7f73ed3b7700 1 --2- 172.21.15.2:0/753997028 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f73e80afce0 0x7f73e815b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:37.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.329+0000 7f73ed3b7700 1 -- 172.21.15.2:0/753997028 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73e80b0160 msgr2=0x7f73e815b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:37.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.329+0000 7f73ed3b7700 1 --2- 172.21.15.2:0/753997028 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73e80b0160 0x7f73e815b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:37.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.329+0000 7f73ed3b7700 1 -- 172.21.15.2:0/753997028 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e8141bb0 con 0x7f73e8153720 2023-11-26T07:16:37.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.329+0000 7f73edbb8700 1 --2- 172.21.15.2:0/753997028 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73e80b0160 0x7f73e815b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:16:37.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.329+0000 7f73ecbb6700 1 --2- 172.21.15.2:0/753997028 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f73e80afce0 0x7f73e815b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:16:37.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.329+0000 7f73ed3b7700 1 --2- 172.21.15.2:0/753997028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73e8153720 0x7f73e81423b0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f73d800e5a0 tx=0x7f73d800e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:37.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.329+0000 7f73ddffb700 1 -- 172.21.15.2:0/753997028 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d80052e0 con 0x7f73e8153720 2023-11-26T07:16:37.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.329+0000 7f73ddffb700 1 -- 172.21.15.2:0/753997028 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d8005440 con 0x7f73e8153720 2023-11-26T07:16:37.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.329+0000 7f73ef61b700 1 -- 172.21.15.2:0/753997028 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e8141e90 con 0x7f73e8153720 2023-11-26T07:16:37.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.329+0000 7f73ddffb700 1 -- 172.21.15.2:0/753997028 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d80038a0 con 0x7f73e8153720 2023-11-26T07:16:37.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.329+0000 7f73ef61b700 1 -- 172.21.15.2:0/753997028 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e8153b00 con 0x7f73e8153720 2023-11-26T07:16:37.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.330+0000 7f73ef61b700 1 -- 172.21.15.2:0/753997028 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73e8153d20 con 0x7f73e8153720 2023-11-26T07:16:37.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.330+0000 7f73ddffb700 1 -- 172.21.15.2:0/753997028 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f73d8003a00 con 0x7f73e8153720 2023-11-26T07:16:37.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.331+0000 7f73ddffb700 1 --2- 172.21.15.2:0/753997028 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f73cc06b6d0 0x7f73cc06db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:37.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.331+0000 7f73ddffb700 1 -- 172.21.15.2:0/753997028 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f73d8087880 con 0x7f73e8153720 2023-11-26T07:16:37.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.331+0000 7f73ecbb6700 1 --2- 172.21.15.2:0/753997028 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f73cc06b6d0 0x7f73cc06db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:37.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.331+0000 7f73ecbb6700 1 --2- 172.21.15.2:0/753997028 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f73cc06b6d0 0x7f73cc06db90 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f73e8140b20 tx=0x7f73e4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:37.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.335+0000 7f73ddffb700 1 -- 172.21.15.2:0/753997028 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f73d8090080 con 0x7f73e8153720 2023-11-26T07:16:37.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.530+0000 7f73ef61b700 1 -- 172.21.15.2:0/753997028 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f73e806ec20 con 0x7f73cc06b6d0 2023-11-26T07:16:37.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.539+0000 7f73ddffb700 1 -- 172.21.15.2:0/753997028 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283909 (secure 0 0 0) 0x7f73e4012770 con 0x7f73cc06b6d0 2023-11-26T07:16:37.545 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:16:37.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.542+0000 7f73ef61b700 1 -- 172.21.15.2:0/753997028 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f73cc06b6d0 msgr2=0x7f73cc06db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:37.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.542+0000 7f73ef61b700 1 --2- 172.21.15.2:0/753997028 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f73cc06b6d0 0x7f73cc06db90 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f73e8140b20 tx=0x7f73e4008040 comp rx=0 tx=0).stop 2023-11-26T07:16:37.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.542+0000 7f73ef61b700 1 -- 172.21.15.2:0/753997028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73e8153720 msgr2=0x7f73e81423b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:37.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.542+0000 7f73ef61b700 1 --2- 172.21.15.2:0/753997028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73e8153720 0x7f73e81423b0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f73d800e5a0 tx=0x7f73d800e960 comp rx=0 tx=0).stop 2023-11-26T07:16:37.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.542+0000 7f73ef61b700 1 -- 172.21.15.2:0/753997028 shutdown_connections 2023-11-26T07:16:37.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.542+0000 7f73ef61b700 1 --2- 172.21.15.2:0/753997028 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f73cc06b6d0 0x7f73cc06db90 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:37.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.542+0000 7f73ef61b700 1 --2- 172.21.15.2:0/753997028 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73e80b0160 0x7f73e815b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:37.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.542+0000 7f73ef61b700 1 --2- 172.21.15.2:0/753997028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73e8153720 0x7f73e81423b0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:37.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.542+0000 7f73ef61b700 1 --2- 172.21.15.2:0/753997028 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f73e80afce0 0x7f73e815b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:37.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.542+0000 7f73ef61b700 1 -- 172.21.15.2:0/753997028 >> 172.21.15.2:0/753997028 conn(0x7f73e80b2840 msgr2=0x7f73e815e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:37.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.542+0000 7f73ef61b700 1 -- 172.21.15.2:0/753997028 shutdown_connections 2023-11-26T07:16:37.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.542+0000 7f73ef61b700 1 -- 172.21.15.2:0/753997028 wait complete. 2023-11-26T07:16:37.548 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-26T07:16:37.557 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":221,"stamp":"2023-11-26T07:16:36.230125+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257384,"kb_used_data":7900,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754717336,"statfs":{"total":773094113280,"available":772830552064,"internally_reserved":0,"allocated":8089600,"data_stored":4091285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.644691"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.599254+0000","last_change":"2023-11-26T07:16:31.599254+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.599254+0000","last_undegraded":"2023-11-26T07:16:31.599254+0000","last_fullsized":"2023-11-26T07:16:31.599254+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.598744+0000","last_change":"2023-11-26T07:16:31.598744+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.598744+0000","last_undegraded":"2023-11-26T07:16:31.598744+0000","last_fullsized":"2023-11-26T07:16:31.598744+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.596490+0000","last_change":"2023-11-26T07:16:31.596490+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.596490+0000","last_undegraded":"2023-11-26T07:16:31.596490+0000","last_fullsized":"2023-11-26T07:16:31.596490+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.594577+0000","last_change":"2023-11-26T07:16:31.594577+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.594577+0000","last_undegraded":"2023-11-26T07:16:31.594577+0000","last_fullsized":"2023-11-26T07:16:31.594577+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.601432+0000","last_change":"2023-11-26T07:16:31.601432+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.601432+0000","last_undegraded":"2023-11-26T07:16:31.601432+0000","last_fullsized":"2023-11-26T07:16:31.601432+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.598968+0000","last_change":"2023-11-26T07:16:31.598968+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.598968+0000","last_undegraded":"2023-11-26T07:16:31.598968+0000","last_fullsized":"2023-11-26T07:16:31.598968+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.594942+0000","last_change":"2023-11-26T07:16:31.594942+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.594942+0000","last_undegraded":"2023-11-26T07:16:31.594942+0000","last_fullsized":"2023-11-26T07:16:31.594942+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.598612+0000","last_change":"2023-11-26T07:16:31.598612+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.598612+0000","last_undegraded":"2023-11-26T07:16:31.598612+0000","last_fullsized":"2023-11-26T07:16:31.598612+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.600548+0000","last_change":"2023-11-26T07:16:31.600548+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.600548+0000","last_undegraded":"2023-11-26T07:16:31.600548+0000","last_fullsized":"2023-11-26T07:16:31.600548+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.591825+0000","last_change":"2023-11-26T07:16:31.591825+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.591825+0000","last_undegraded":"2023-11-26T07:16:31.591825+0000","last_fullsized":"2023-11-26T07:16:31.591825+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.597271+0000","last_change":"2023-11-26T07:16:31.597271+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.597271+0000","last_undegraded":"2023-11-26T07:16:31.597271+0000","last_fullsized":"2023-11-26T07:16:31.597271+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.594135+0000","last_change":"2023-11-26T07:16:31.594135+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.594135+0000","last_undegraded":"2023-11-26T07:16:31.594135+0000","last_fullsized":"2023-11-26T07:16:31.594135+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.595814+0000","last_change":"2023-11-26T07:16:31.595814+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.595814+0000","last_undegraded":"2023-11-26T07:16:31.595814+0000","last_fullsized":"2023-11-26T07:16:31.595814+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.601303+0000","last_change":"2023-11-26T07:16:31.601303+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.601303+0000","last_undegraded":"2023-11-26T07:16:31.601303+0000","last_fullsized":"2023-11-26T07:16:31.601303+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.595322+0000","last_change":"2023-11-26T07:16:31.595322+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.595322+0000","last_undegraded":"2023-11-26T07:16:31.595322+0000","last_fullsized":"2023-11-26T07:16:31.595322+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.591146+0000","last_change":"2023-11-26T07:16:31.591146+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.591146+0000","last_undegraded":"2023-11-26T07:16:31.591146+0000","last_fullsized":"2023-11-26T07:16:31.591146+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.600103+0000","last_change":"2023-11-26T07:16:31.600103+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.600103+0000","last_undegraded":"2023-11-26T07:16:31.600103+0000","last_fullsized":"2023-11-26T07:16:31.600103+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.593527+0000","last_change":"2023-11-26T07:16:31.593527+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.593527+0000","last_undegraded":"2023-11-26T07:16:31.593527+0000","last_fullsized":"2023-11-26T07:16:31.593527+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.598419+0000","last_change":"2023-11-26T07:16:31.598419+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.598419+0000","last_undegraded":"2023-11-26T07:16:31.598419+0000","last_fullsized":"2023-11-26T07:16:31.598419+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.593750+0000","last_change":"2023-11-26T07:16:31.593750+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.593750+0000","last_undegraded":"2023-11-26T07:16:31.593750+0000","last_fullsized":"2023-11-26T07:16:31.593750+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.591574+0000","last_change":"2023-11-26T07:16:31.591574+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.591574+0000","last_undegraded":"2023-11-26T07:16:31.591574+0000","last_fullsized":"2023-11-26T07:16:31.591574+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.591270+0000","last_change":"2023-11-26T07:16:31.591270+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.591270+0000","last_undegraded":"2023-11-26T07:16:31.591270+0000","last_fullsized":"2023-11-26T07:16:31.591270+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.598084+0000","last_change":"2023-11-26T07:16:31.598084+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.598084+0000","last_undegraded":"2023-11-26T07:16:31.598084+0000","last_fullsized":"2023-11-26T07:16:31.598084+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.595800+0000","last_change":"2023-11-26T07:16:31.595800+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.595800+0000","last_undegraded":"2023-11-26T07:16:31.595800+0000","last_fullsized":"2023-11-26T07:16:31.595800+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.591671+0000","last_change":"2023-11-26T07:16:31.591671+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.591671+0000","last_undegraded":"2023-11-26T07:16:31.591671+0000","last_fullsized":"2023-11-26T07:16:31.591671+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.594660+0000","last_change":"2023-11-26T07:16:31.594660+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.594660+0000","last_undegraded":"2023-11-26T07:16:31.594660+0000","last_fullsized":"2023-11-26T07:16:31.594660+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.595823+0000","last_change":"2023-11-26T07:16:31.595823+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.595823+0000","last_undegraded":"2023-11-26T07:16:31.595823+0000","last_fullsized":"2023-11-26T07:16:31.595823+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.590424+0000","last_change":"2023-11-26T07:16:31.590424+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.590424+0000","last_undegraded":"2023-11-26T07:16:31.590424+0000","last_fullsized":"2023-11-26T07:16:31.590424+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.595869+0000","last_change":"2023-11-26T07:16:31.595869+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.595869+0000","last_undegraded":"2023-11-26T07:16:31.595869+0000","last_fullsized":"2023-11-26T07:16:31.595869+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.594757+0000","last_change":"2023-11-26T07:16:31.594757+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.594757+0000","last_undegraded":"2023-11-26T07:16:31.594757+0000","last_fullsized":"2023-11-26T07:16:31.594757+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.594164+0000","last_change":"2023-11-26T07:16:31.594164+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.594164+0000","last_undegraded":"2023-11-26T07:16:31.594164+0000","last_fullsized":"2023-11-26T07:16:31.594164+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.594946+0000","last_change":"2023-11-26T07:16:31.594946+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.594946+0000","last_undegraded":"2023-11-26T07:16:31.594946+0000","last_fullsized":"2023-11-26T07:16:31.594946+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.595892+0000","last_change":"2023-11-26T07:16:31.595892+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.595892+0000","last_undegraded":"2023-11-26T07:16:31.595892+0000","last_fullsized":"2023-11-26T07:16:31.595892+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.609808+0000","last_change":"2023-11-26T07:16:31.609063+0000","last_active":"2023-11-26T07:16:31.609808+0000","last_peered":"2023-11-26T07:16:31.609808+0000","last_clean":"2023-11-26T07:16:31.609808+0000","last_became_active":"2023-11-26T07:16:31.608791+0000","last_became_peered":"2023-11-26T07:16:31.608791+0000","last_unstale":"2023-11-26T07:16:31.609808+0000","last_undegraded":"2023-11-26T07:16:31.609808+0000","last_fullsized":"2023-11-26T07:16:31.609808+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:18:47.861543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.599410+0000","last_change":"2023-11-26T07:16:31.599410+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.599410+0000","last_undegraded":"2023-11-26T07:16:31.599410+0000","last_fullsized":"2023-11-26T07:16:31.599410+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.607180+0000","last_change":"2023-11-26T07:16:31.604650+0000","last_active":"2023-11-26T07:16:31.607180+0000","last_peered":"2023-11-26T07:16:31.607180+0000","last_clean":"2023-11-26T07:16:31.607180+0000","last_became_active":"2023-11-26T07:16:31.603826+0000","last_became_peered":"2023-11-26T07:16:31.603826+0000","last_unstale":"2023-11-26T07:16:31.607180+0000","last_undegraded":"2023-11-26T07:16:31.607180+0000","last_fullsized":"2023-11-26T07:16:31.607180+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:47:37.657536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.595949+0000","last_change":"2023-11-26T07:16:31.595949+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.595949+0000","last_undegraded":"2023-11-26T07:16:31.595949+0000","last_fullsized":"2023-11-26T07:16:31.595949+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.609847+0000","last_change":"2023-11-26T07:16:31.606982+0000","last_active":"2023-11-26T07:16:31.609847+0000","last_peered":"2023-11-26T07:16:31.609847+0000","last_clean":"2023-11-26T07:16:31.609847+0000","last_became_active":"2023-11-26T07:16:31.606668+0000","last_became_peered":"2023-11-26T07:16:31.606668+0000","last_unstale":"2023-11-26T07:16:31.609847+0000","last_undegraded":"2023-11-26T07:16:31.609847+0000","last_fullsized":"2023-11-26T07:16:31.609847+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:49:13.892037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.596841+0000","last_change":"2023-11-26T07:16:31.596841+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.596841+0000","last_undegraded":"2023-11-26T07:16:31.596841+0000","last_fullsized":"2023-11-26T07:16:31.596841+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.608125+0000","last_change":"2023-11-26T07:16:31.606756+0000","last_active":"2023-11-26T07:16:31.608125+0000","last_peered":"2023-11-26T07:16:31.608125+0000","last_clean":"2023-11-26T07:16:31.608125+0000","last_became_active":"2023-11-26T07:16:31.606493+0000","last_became_peered":"2023-11-26T07:16:31.606493+0000","last_unstale":"2023-11-26T07:16:31.608125+0000","last_undegraded":"2023-11-26T07:16:31.608125+0000","last_fullsized":"2023-11-26T07:16:31.608125+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:06:48.106371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.593690+0000","last_change":"2023-11-26T07:16:31.593690+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.593690+0000","last_undegraded":"2023-11-26T07:16:31.593690+0000","last_fullsized":"2023-11-26T07:16:31.593690+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.601859+0000","last_change":"2023-11-26T07:16:31.598926+0000","last_active":"2023-11-26T07:16:31.601859+0000","last_peered":"2023-11-26T07:16:31.601859+0000","last_clean":"2023-11-26T07:16:31.601859+0000","last_became_active":"2023-11-26T07:16:31.598622+0000","last_became_peered":"2023-11-26T07:16:31.598622+0000","last_unstale":"2023-11-26T07:16:31.601859+0000","last_undegraded":"2023-11-26T07:16:31.601859+0000","last_fullsized":"2023-11-26T07:16:31.601859+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:04:22.685813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.590394+0000","last_change":"2023-11-26T07:16:31.590394+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.590394+0000","last_undegraded":"2023-11-26T07:16:31.590394+0000","last_fullsized":"2023-11-26T07:16:31.590394+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.610370+0000","last_change":"2023-11-26T07:16:31.608252+0000","last_active":"2023-11-26T07:16:31.610370+0000","last_peered":"2023-11-26T07:16:31.610370+0000","last_clean":"2023-11-26T07:16:31.610370+0000","last_became_active":"2023-11-26T07:16:31.607942+0000","last_became_peered":"2023-11-26T07:16:31.607942+0000","last_unstale":"2023-11-26T07:16:31.610370+0000","last_undegraded":"2023-11-26T07:16:31.610370+0000","last_fullsized":"2023-11-26T07:16:31.610370+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:55:42.677020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.599635+0000","last_change":"2023-11-26T07:16:31.599635+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.599635+0000","last_undegraded":"2023-11-26T07:16:31.599635+0000","last_fullsized":"2023-11-26T07:16:31.599635+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.602579+0000","last_change":"2023-11-26T07:16:31.597056+0000","last_active":"2023-11-26T07:16:31.602579+0000","last_peered":"2023-11-26T07:16:31.602579+0000","last_clean":"2023-11-26T07:16:31.602579+0000","last_became_active":"2023-11-26T07:16:31.596785+0000","last_became_peered":"2023-11-26T07:16:31.596785+0000","last_unstale":"2023-11-26T07:16:31.602579+0000","last_undegraded":"2023-11-26T07:16:31.602579+0000","last_fullsized":"2023-11-26T07:16:31.602579+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:00:37.336785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.593030+0000","last_change":"2023-11-26T07:16:31.593030+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.593030+0000","last_undegraded":"2023-11-26T07:16:31.593030+0000","last_fullsized":"2023-11-26T07:16:31.593030+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.610454+0000","last_change":"2023-11-26T07:16:31.608983+0000","last_active":"2023-11-26T07:16:31.610454+0000","last_peered":"2023-11-26T07:16:31.610454+0000","last_clean":"2023-11-26T07:16:31.610454+0000","last_became_active":"2023-11-26T07:16:31.608647+0000","last_became_peered":"2023-11-26T07:16:31.608647+0000","last_unstale":"2023-11-26T07:16:31.610454+0000","last_undegraded":"2023-11-26T07:16:31.610454+0000","last_fullsized":"2023-11-26T07:16:31.610454+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:31:11.200541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.594201+0000","last_change":"2023-11-26T07:16:31.594201+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.594201+0000","last_undegraded":"2023-11-26T07:16:31.594201+0000","last_fullsized":"2023-11-26T07:16:31.594201+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.604578+0000","last_change":"2023-11-26T07:16:31.597710+0000","last_active":"2023-11-26T07:16:31.604578+0000","last_peered":"2023-11-26T07:16:31.604578+0000","last_clean":"2023-11-26T07:16:31.604578+0000","last_became_active":"2023-11-26T07:16:31.597421+0000","last_became_peered":"2023-11-26T07:16:31.597421+0000","last_unstale":"2023-11-26T07:16:31.604578+0000","last_undegraded":"2023-11-26T07:16:31.604578+0000","last_fullsized":"2023-11-26T07:16:31.604578+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:21:29.309253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.598876+0000","last_change":"2023-11-26T07:16:31.598876+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.598876+0000","last_undegraded":"2023-11-26T07:16:31.598876+0000","last_fullsized":"2023-11-26T07:16:31.598876+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.608688+0000","last_change":"2023-11-26T07:16:31.607372+0000","last_active":"2023-11-26T07:16:31.608688+0000","last_peered":"2023-11-26T07:16:31.608688+0000","last_clean":"2023-11-26T07:16:31.608688+0000","last_became_active":"2023-11-26T07:16:31.607094+0000","last_became_peered":"2023-11-26T07:16:31.607094+0000","last_unstale":"2023-11-26T07:16:31.608688+0000","last_undegraded":"2023-11-26T07:16:31.608688+0000","last_fullsized":"2023-11-26T07:16:31.608688+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:35:30.163394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.595583+0000","last_change":"2023-11-26T07:16:31.595583+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.595583+0000","last_undegraded":"2023-11-26T07:16:31.595583+0000","last_fullsized":"2023-11-26T07:16:31.595583+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.601820+0000","last_change":"2023-11-26T07:16:31.598168+0000","last_active":"2023-11-26T07:16:31.601820+0000","last_peered":"2023-11-26T07:16:31.601820+0000","last_clean":"2023-11-26T07:16:31.601820+0000","last_became_active":"2023-11-26T07:16:31.597799+0000","last_became_peered":"2023-11-26T07:16:31.597799+0000","last_unstale":"2023-11-26T07:16:31.601820+0000","last_undegraded":"2023-11-26T07:16:31.601820+0000","last_fullsized":"2023-11-26T07:16:31.601820+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:25:16.232940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.599913+0000","last_change":"2023-11-26T07:16:31.599913+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.599913+0000","last_undegraded":"2023-11-26T07:16:31.599913+0000","last_fullsized":"2023-11-26T07:16:31.599913+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.608573+0000","last_change":"2023-11-26T07:16:31.605820+0000","last_active":"2023-11-26T07:16:31.608573+0000","last_peered":"2023-11-26T07:16:31.608573+0000","last_clean":"2023-11-26T07:16:31.608573+0000","last_became_active":"2023-11-26T07:16:31.604337+0000","last_became_peered":"2023-11-26T07:16:31.604337+0000","last_unstale":"2023-11-26T07:16:31.608573+0000","last_undegraded":"2023-11-26T07:16:31.608573+0000","last_fullsized":"2023-11-26T07:16:31.608573+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:57:09.945561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.595895+0000","last_change":"2023-11-26T07:16:31.595895+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.595895+0000","last_undegraded":"2023-11-26T07:16:31.595895+0000","last_fullsized":"2023-11-26T07:16:31.595895+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.609626+0000","last_change":"2023-11-26T07:16:31.607105+0000","last_active":"2023-11-26T07:16:31.609626+0000","last_peered":"2023-11-26T07:16:31.609626+0000","last_clean":"2023-11-26T07:16:31.609626+0000","last_became_active":"2023-11-26T07:16:31.606832+0000","last_became_peered":"2023-11-26T07:16:31.606832+0000","last_unstale":"2023-11-26T07:16:31.609626+0000","last_undegraded":"2023-11-26T07:16:31.609626+0000","last_fullsized":"2023-11-26T07:16:31.609626+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:47:30.148611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.593693+0000","last_change":"2023-11-26T07:16:31.593693+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.593693+0000","last_undegraded":"2023-11-26T07:16:31.593693+0000","last_fullsized":"2023-11-26T07:16:31.593693+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.608705+0000","last_change":"2023-11-26T07:16:31.607550+0000","last_active":"2023-11-26T07:16:31.608705+0000","last_peered":"2023-11-26T07:16:31.608705+0000","last_clean":"2023-11-26T07:16:31.608705+0000","last_became_active":"2023-11-26T07:16:31.607266+0000","last_became_peered":"2023-11-26T07:16:31.607266+0000","last_unstale":"2023-11-26T07:16:31.608705+0000","last_undegraded":"2023-11-26T07:16:31.608705+0000","last_fullsized":"2023-11-26T07:16:31.608705+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:15:53.033981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.594576+0000","last_change":"2023-11-26T07:16:31.594576+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.594576+0000","last_undegraded":"2023-11-26T07:16:31.594576+0000","last_fullsized":"2023-11-26T07:16:31.594576+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.604518+0000","last_change":"2023-11-26T07:16:31.598844+0000","last_active":"2023-11-26T07:16:31.604518+0000","last_peered":"2023-11-26T07:16:31.604518+0000","last_clean":"2023-11-26T07:16:31.604518+0000","last_became_active":"2023-11-26T07:16:31.598510+0000","last_became_peered":"2023-11-26T07:16:31.598510+0000","last_unstale":"2023-11-26T07:16:31.604518+0000","last_undegraded":"2023-11-26T07:16:31.604518+0000","last_fullsized":"2023-11-26T07:16:31.604518+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:41:16.384671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.600076+0000","last_change":"2023-11-26T07:16:31.600076+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.600076+0000","last_undegraded":"2023-11-26T07:16:31.600076+0000","last_fullsized":"2023-11-26T07:16:31.600076+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.610337+0000","last_change":"2023-11-26T07:16:31.609252+0000","last_active":"2023-11-26T07:16:31.610337+0000","last_peered":"2023-11-26T07:16:31.610337+0000","last_clean":"2023-11-26T07:16:31.610337+0000","last_became_active":"2023-11-26T07:16:31.608944+0000","last_became_peered":"2023-11-26T07:16:31.608944+0000","last_unstale":"2023-11-26T07:16:31.610337+0000","last_undegraded":"2023-11-26T07:16:31.610337+0000","last_fullsized":"2023-11-26T07:16:31.610337+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:27:23.533262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.591339+0000","last_change":"2023-11-26T07:16:31.591339+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.591339+0000","last_undegraded":"2023-11-26T07:16:31.591339+0000","last_fullsized":"2023-11-26T07:16:31.591339+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.610712+0000","last_change":"2023-11-26T07:16:31.608619+0000","last_active":"2023-11-26T07:16:31.610712+0000","last_peered":"2023-11-26T07:16:31.610712+0000","last_clean":"2023-11-26T07:16:31.610712+0000","last_became_active":"2023-11-26T07:16:31.608154+0000","last_became_peered":"2023-11-26T07:16:31.608154+0000","last_unstale":"2023-11-26T07:16:31.610712+0000","last_undegraded":"2023-11-26T07:16:31.610712+0000","last_fullsized":"2023-11-26T07:16:31.610712+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:49:38.418150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.598410+0000","last_change":"2023-11-26T07:16:31.598410+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.598410+0000","last_undegraded":"2023-11-26T07:16:31.598410+0000","last_fullsized":"2023-11-26T07:16:31.598410+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.609872+0000","last_change":"2023-11-26T07:16:31.608166+0000","last_active":"2023-11-26T07:16:31.609872+0000","last_peered":"2023-11-26T07:16:31.609872+0000","last_clean":"2023-11-26T07:16:31.609872+0000","last_became_active":"2023-11-26T07:16:31.607443+0000","last_became_peered":"2023-11-26T07:16:31.607443+0000","last_unstale":"2023-11-26T07:16:31.609872+0000","last_undegraded":"2023-11-26T07:16:31.609872+0000","last_fullsized":"2023-11-26T07:16:31.609872+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:08:07.953306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.593458+0000","last_change":"2023-11-26T07:16:31.593458+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.593458+0000","last_undegraded":"2023-11-26T07:16:31.593458+0000","last_fullsized":"2023-11-26T07:16:31.593458+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.607301+0000","last_change":"2023-11-26T07:16:31.602892+0000","last_active":"2023-11-26T07:16:31.607301+0000","last_peered":"2023-11-26T07:16:31.607301+0000","last_clean":"2023-11-26T07:16:31.607301+0000","last_became_active":"2023-11-26T07:16:31.602626+0000","last_became_peered":"2023-11-26T07:16:31.602626+0000","last_unstale":"2023-11-26T07:16:31.607301+0000","last_undegraded":"2023-11-26T07:16:31.607301+0000","last_fullsized":"2023-11-26T07:16:31.607301+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:31:17.102746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.599311+0000","last_change":"2023-11-26T07:16:31.599311+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.599311+0000","last_undegraded":"2023-11-26T07:16:31.599311+0000","last_fullsized":"2023-11-26T07:16:31.599311+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.608799+0000","last_change":"2023-11-26T07:16:31.606767+0000","last_active":"2023-11-26T07:16:31.608799+0000","last_peered":"2023-11-26T07:16:31.608799+0000","last_clean":"2023-11-26T07:16:31.608799+0000","last_became_active":"2023-11-26T07:16:31.606477+0000","last_became_peered":"2023-11-26T07:16:31.606477+0000","last_unstale":"2023-11-26T07:16:31.608799+0000","last_undegraded":"2023-11-26T07:16:31.608799+0000","last_fullsized":"2023-11-26T07:16:31.608799+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:53:36.321574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.594972+0000","last_change":"2023-11-26T07:16:31.594972+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.594972+0000","last_undegraded":"2023-11-26T07:16:31.594972+0000","last_fullsized":"2023-11-26T07:16:31.594972+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.608685+0000","last_change":"2023-11-26T07:16:31.607018+0000","last_active":"2023-11-26T07:16:31.608685+0000","last_peered":"2023-11-26T07:16:31.608685+0000","last_clean":"2023-11-26T07:16:31.608685+0000","last_became_active":"2023-11-26T07:16:31.606736+0000","last_became_peered":"2023-11-26T07:16:31.606736+0000","last_unstale":"2023-11-26T07:16:31.608685+0000","last_undegraded":"2023-11-26T07:16:31.608685+0000","last_fullsized":"2023-11-26T07:16:31.608685+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:51:01.983190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.592923+0000","last_change":"2023-11-26T07:16:31.592923+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.592923+0000","last_undegraded":"2023-11-26T07:16:31.592923+0000","last_fullsized":"2023-11-26T07:16:31.592923+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.606079+0000","last_change":"2023-11-26T07:16:31.604168+0000","last_active":"2023-11-26T07:16:31.606079+0000","last_peered":"2023-11-26T07:16:31.606079+0000","last_clean":"2023-11-26T07:16:31.606079+0000","last_became_active":"2023-11-26T07:16:31.603852+0000","last_became_peered":"2023-11-26T07:16:31.603852+0000","last_unstale":"2023-11-26T07:16:31.606079+0000","last_undegraded":"2023-11-26T07:16:31.606079+0000","last_fullsized":"2023-11-26T07:16:31.606079+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:04:43.215372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.593451+0000","last_change":"2023-11-26T07:16:31.593451+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.593451+0000","last_undegraded":"2023-11-26T07:16:31.593451+0000","last_fullsized":"2023-11-26T07:16:31.593451+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.607360+0000","last_change":"2023-11-26T07:16:31.603291+0000","last_active":"2023-11-26T07:16:31.607360+0000","last_peered":"2023-11-26T07:16:31.607360+0000","last_clean":"2023-11-26T07:16:31.607360+0000","last_became_active":"2023-11-26T07:16:31.603030+0000","last_became_peered":"2023-11-26T07:16:31.603030+0000","last_unstale":"2023-11-26T07:16:31.607360+0000","last_undegraded":"2023-11-26T07:16:31.607360+0000","last_fullsized":"2023-11-26T07:16:31.607360+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:18:47.861543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.596145+0000","last_change":"2023-11-26T07:16:31.596145+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.596145+0000","last_undegraded":"2023-11-26T07:16:31.596145+0000","last_fullsized":"2023-11-26T07:16:31.596145+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.610351+0000","last_change":"2023-11-26T07:16:31.608037+0000","last_active":"2023-11-26T07:16:31.610351+0000","last_peered":"2023-11-26T07:16:31.610351+0000","last_clean":"2023-11-26T07:16:31.610351+0000","last_became_active":"2023-11-26T07:16:31.607653+0000","last_became_peered":"2023-11-26T07:16:31.607653+0000","last_unstale":"2023-11-26T07:16:31.610351+0000","last_undegraded":"2023-11-26T07:16:31.610351+0000","last_fullsized":"2023-11-26T07:16:31.610351+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:21:40.442201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.593759+0000","last_change":"2023-11-26T07:16:31.593759+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.593759+0000","last_undegraded":"2023-11-26T07:16:31.593759+0000","last_fullsized":"2023-11-26T07:16:31.593759+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.605881+0000","last_change":"2023-11-26T07:16:31.601496+0000","last_active":"2023-11-26T07:16:31.605881+0000","last_peered":"2023-11-26T07:16:31.605881+0000","last_clean":"2023-11-26T07:16:31.605881+0000","last_became_active":"2023-11-26T07:16:31.600854+0000","last_became_peered":"2023-11-26T07:16:31.600854+0000","last_unstale":"2023-11-26T07:16:31.605881+0000","last_undegraded":"2023-11-26T07:16:31.605881+0000","last_fullsized":"2023-11-26T07:16:31.605881+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:00:32.449928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.596521+0000","last_change":"2023-11-26T07:16:31.596521+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.596521+0000","last_undegraded":"2023-11-26T07:16:31.596521+0000","last_fullsized":"2023-11-26T07:16:31.596521+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.611821+0000","last_change":"2023-11-26T07:16:31.611255+0000","last_active":"2023-11-26T07:16:31.611821+0000","last_peered":"2023-11-26T07:16:31.611821+0000","last_clean":"2023-11-26T07:16:31.611821+0000","last_became_active":"2023-11-26T07:16:31.610936+0000","last_became_peered":"2023-11-26T07:16:31.610936+0000","last_unstale":"2023-11-26T07:16:31.611821+0000","last_undegraded":"2023-11-26T07:16:31.611821+0000","last_fullsized":"2023-11-26T07:16:31.611821+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:59:20.890903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.596395+0000","last_change":"2023-11-26T07:16:31.596395+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.596395+0000","last_undegraded":"2023-11-26T07:16:31.596395+0000","last_fullsized":"2023-11-26T07:16:31.596395+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.607426+0000","last_change":"2023-11-26T07:16:31.604687+0000","last_active":"2023-11-26T07:16:31.607426+0000","last_peered":"2023-11-26T07:16:31.607426+0000","last_clean":"2023-11-26T07:16:31.607426+0000","last_became_active":"2023-11-26T07:16:31.604369+0000","last_became_peered":"2023-11-26T07:16:31.604369+0000","last_unstale":"2023-11-26T07:16:31.607426+0000","last_undegraded":"2023-11-26T07:16:31.607426+0000","last_fullsized":"2023-11-26T07:16:31.607426+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:40:49.206751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.599473+0000","last_change":"2023-11-26T07:16:31.599473+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.599473+0000","last_undegraded":"2023-11-26T07:16:31.599473+0000","last_fullsized":"2023-11-26T07:16:31.599473+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.609569+0000","last_change":"2023-11-26T07:16:31.606737+0000","last_active":"2023-11-26T07:16:31.609569+0000","last_peered":"2023-11-26T07:16:31.609569+0000","last_clean":"2023-11-26T07:16:31.609569+0000","last_became_active":"2023-11-26T07:16:31.606477+0000","last_became_peered":"2023-11-26T07:16:31.606477+0000","last_unstale":"2023-11-26T07:16:31.609569+0000","last_undegraded":"2023-11-26T07:16:31.609569+0000","last_fullsized":"2023-11-26T07:16:31.609569+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:20:43.639773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.594896+0000","last_change":"2023-11-26T07:16:31.594896+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.594896+0000","last_undegraded":"2023-11-26T07:16:31.594896+0000","last_fullsized":"2023-11-26T07:16:31.594896+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.602628+0000","last_change":"2023-11-26T07:16:31.597623+0000","last_active":"2023-11-26T07:16:31.602628+0000","last_peered":"2023-11-26T07:16:31.602628+0000","last_clean":"2023-11-26T07:16:31.602628+0000","last_became_active":"2023-11-26T07:16:31.597356+0000","last_became_peered":"2023-11-26T07:16:31.597356+0000","last_unstale":"2023-11-26T07:16:31.602628+0000","last_undegraded":"2023-11-26T07:16:31.602628+0000","last_fullsized":"2023-11-26T07:16:31.602628+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:33:18.957245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.593371+0000","last_change":"2023-11-26T07:16:31.593371+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.593371+0000","last_undegraded":"2023-11-26T07:16:31.593371+0000","last_fullsized":"2023-11-26T07:16:31.593371+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.609547+0000","last_change":"2023-11-26T07:16:31.605393+0000","last_active":"2023-11-26T07:16:31.609547+0000","last_peered":"2023-11-26T07:16:31.609547+0000","last_clean":"2023-11-26T07:16:31.609547+0000","last_became_active":"2023-11-26T07:16:31.605134+0000","last_became_peered":"2023-11-26T07:16:31.605134+0000","last_unstale":"2023-11-26T07:16:31.609547+0000","last_undegraded":"2023-11-26T07:16:31.609547+0000","last_fullsized":"2023-11-26T07:16:31.609547+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:00:14.422829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.595169+0000","last_change":"2023-11-26T07:16:31.595169+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.595169+0000","last_undegraded":"2023-11-26T07:16:31.595169+0000","last_fullsized":"2023-11-26T07:16:31.595169+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.607688+0000","last_change":"2023-11-26T07:16:31.605773+0000","last_active":"2023-11-26T07:16:31.607688+0000","last_peered":"2023-11-26T07:16:31.607688+0000","last_clean":"2023-11-26T07:16:31.607688+0000","last_became_active":"2023-11-26T07:16:31.605493+0000","last_became_peered":"2023-11-26T07:16:31.605493+0000","last_unstale":"2023-11-26T07:16:31.607688+0000","last_undegraded":"2023-11-26T07:16:31.607688+0000","last_fullsized":"2023-11-26T07:16:31.607688+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:06:59.820803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":71,"state":"creating+peering","last_fresh":"2023-11-26T07:16:31.593887+0000","last_change":"2023-11-26T07:16:31.593887+0000","last_active":"2023-11-26T07:16:31.584625+0000","last_peered":"2023-11-26T07:16:31.584625+0000","last_clean":"2023-11-26T07:16:31.584625+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-26T07:16:31.593887+0000","last_undegraded":"2023-11-26T07:16:31.593887+0000","last_fullsized":"2023-11-26T07:16:31.593887+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-11-26T07:16:31.607002+0000","last_change":"2023-11-26T07:16:31.603942+0000","last_active":"2023-11-26T07:16:31.607002+0000","last_peered":"2023-11-26T07:16:31.607002+0000","last_clean":"2023-11-26T07:16:31.607002+0000","last_became_active":"2023-11-26T07:16:31.603643+0000","last_became_peered":"2023-11-26T07:16:31.603643+0000","last_unstale":"2023-11-26T07:16:31.607002+0000","last_undegraded":"2023-11-26T07:16:31.607002+0000","last_fullsized":"2023-11-26T07:16:31.607002+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:38:12.974493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":209,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-11-26T07:16:30.591121+0000","last_change":"2023-11-26T07:11:29.855919+0000","last_active":"2023-11-26T07:16:30.591121+0000","last_peered":"2023-11-26T07:16:30.591121+0000","last_clean":"2023-11-26T07:16:30.591121+0000","last_became_active":"2023-11-26T07:11:29.854903+0000","last_became_peered":"2023-11-26T07:11:29.854903+0000","last_unstale":"2023-11-26T07:16:30.591121+0000","last_undegraded":"2023-11-26T07:16:30.591121+0000","last_fullsized":"2023-11-26T07:16:30.591121+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:28.594252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:28.594252+0000","last_clean_scrub_stamp":"2023-11-26T07:11:28.594252+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:33:34.642696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574914,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32612,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339228,"statfs":{"total":96636764160,"available":96603369472,"internally_reserved":0,"allocated":1458176,"data_stored":954971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:15:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34000000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.66600000000000004,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.51100000000000001,"15min":0.505},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.64400000000000002,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.63300000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:15:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.74299999999999999,"15min":0.94499999999999995},"min":{"1min":0.38600000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72199999999999998,"5min":9.5600000000000005,"15min":9.5600000000000005},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56100000000000005,"15min":0.57699999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.69599999999999995,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.59799999999999998}]},{"osd":2,"last update":"Sun Nov 26 07:15:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.58699999999999997,"15min":0.59899999999999998},"min":{"1min":0.42999999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.65700000000000003,"5min":1.569,"15min":1.569},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.623,"15min":0.64400000000000002},"min":{"1min":0.36899999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.71199999999999997,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.61699999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:15:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.57699999999999996,"15min":0.59799999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.63700000000000001,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.505},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.57699999999999996,"15min":0.56599999999999995},"min":{"1min":0.434,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69199999999999995,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.64700000000000002}]},{"osd":4,"last update":"Sun Nov 26 07:15:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.51800000000000002,"15min":0.52100000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.71099999999999997,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.52900000000000003,"15min":0.51300000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.67800000000000005,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.42099999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:15:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55100000000000005,"15min":0.53300000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.751,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.621,"15min":0.63},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.75900000000000001,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.44}]},{"osd":6,"last update":"Sun Nov 26 07:15:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.433,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72999999999999998,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.59599999999999997,"15min":0.59099999999999997},"min":{"1min":0.40500000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.69199999999999995,"5min":1.552,"15min":1.552},"last":0.46899999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574914,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":851968,"data_stored":358328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:15:30 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.50700000000000001,"15min":0.48499999999999999},"min":{"1min":0.33200000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.70899999999999996,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.51600000000000001,"15min":0.47999999999999998},"min":{"1min":0.35299999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.80800000000000005,"5min":0.871,"15min":0.871},"last":0.54500000000000004}]},{"osd":1,"last update":"Sun Nov 26 07:15:30 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.52100000000000002,"15min":0.51100000000000001},"min":{"1min":0.39000000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.65500000000000003,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.629},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.39600000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.82999999999999996,"5min":1.198,"15min":1.198},"last":0.51800000000000002}]},{"osd":2,"last update":"Sun Nov 26 07:15:30 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.51800000000000002,"15min":0.496},"min":{"1min":0.36199999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.68600000000000005,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.55300000000000005,"15min":0.52500000000000002},"min":{"1min":0.38500000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.79600000000000004,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.59699999999999998}]},{"osd":3,"last update":"Sun Nov 26 07:15:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58599999999999997,"15min":0.55500000000000005},"min":{"1min":0.44500000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.85999999999999999,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60699999999999998,"15min":0.58499999999999996},"min":{"1min":0.40699999999999997,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.67000000000000004}]},{"osd":4,"last update":"Sun Nov 26 07:15:30 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.51500000000000001,"15min":0.52800000000000002},"min":{"1min":0.35399999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.67900000000000005,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.34000000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.41199999999999998}]},{"osd":5,"last update":"Sun Nov 26 07:15:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56599999999999995,"15min":0.56100000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.70199999999999996,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.77700000000000002,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.443}]},{"osd":7,"last update":"Sun Nov 26 07:15:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59399999999999997,"15min":0.59199999999999997},"min":{"1min":0.38300000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79300000000000004,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.629,"15min":0.626},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80200000000000005,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.495}]}]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":864256,"data_stored":364603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.36299999999999999},"min":{"1min":0.223,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.57999999999999996,"15min":0.79900000000000004},"min":{"1min":0.29299999999999998,"5min":0.214,"15min":0.214},"max":{"1min":0.55700000000000005,"5min":11.922000000000001,"15min":11.922000000000001},"last":0.56200000000000006}]},{"osd":2,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35799999999999998,"15min":0.372},"min":{"1min":0.26000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.59599999999999997,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.40300000000000002,"15min":0.40799999999999997},"min":{"1min":0.307,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.56999999999999995,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.50600000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.45000000000000001,"15min":0.45800000000000002},"min":{"1min":0.35599999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.61299999999999999,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.42999999999999999,"15min":0.44},"min":{"1min":0.32500000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.51100000000000001,"5min":1.101,"15min":1.101},"last":0.40999999999999998}]},{"osd":4,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.74099999999999999,"15min":0.86499999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82199999999999995,"5min":6.8979999999999997,"15min":6.8979999999999997},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.65600000000000003,"15min":0.66400000000000003},"min":{"1min":0.48799999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83999999999999997,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.66200000000000003}]},{"osd":5,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.621,"15min":0.627},"min":{"1min":0.41599999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.89100000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":1.2090000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.745,"15min":0.871},"min":{"1min":0.442,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85199999999999998,"5min":6.9480000000000004,"15min":6.9480000000000004},"last":0.45100000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.64700000000000002,"15min":0.66100000000000003},"min":{"1min":0.46200000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.87,"5min":1.194,"15min":1.194},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.75800000000000001,"15min":0.89500000000000002},"min":{"1min":0.435,"5min":0.372,"15min":0.372},"max":{"1min":0.90500000000000003,"5min":6.9800000000000004,"15min":6.9800000000000004},"last":1.222}]},{"osd":7,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65800000000000003,"15min":0.66000000000000003},"min":{"1min":0.48399999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.92400000000000004,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":3.5649999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.68300000000000005},"min":{"1min":0.44700000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.93300000000000005,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":3.548}]}]},{"osd":0,"up_from":13,"seq":55834574912,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32612,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339228,"statfs":{"total":96636764160,"available":96603369472,"internally_reserved":0,"allocated":1458176,"data_stored":954971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.34100000000000003,"15min":0.36799999999999999},"min":{"1min":0.24199999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.52600000000000002,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.374},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.58599999999999997,"15min":0.82099999999999995},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.54500000000000004,"5min":11.987,"15min":11.987},"last":0.26900000000000002}]},{"osd":2,"last update":"Sun Nov 26 07:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.39400000000000002,"15min":0.43099999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57099999999999995,"5min":1.607,"15min":1.607},"last":0.317},{"interface":"front","average":{"1min":0.375,"5min":0.39300000000000002,"15min":0.41099999999999998},"min":{"1min":0.27500000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.64900000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.34499999999999997}]},{"osd":3,"last update":"Sun Nov 26 07:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.375,"15min":0.38700000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.58899999999999997,"5min":0.752,"15min":0.752},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.44,"15min":0.46999999999999997},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71699999999999997,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.40000000000000002}]},{"osd":4,"last update":"Sun Nov 26 07:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.61799999999999999,"15min":0.65000000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71999999999999997,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.73799999999999999,"15min":0.88},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77300000000000002,"5min":6.5279999999999996,"15min":6.5279999999999996},"last":0.499}]},{"osd":5,"last update":"Sun Nov 26 07:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.622,"15min":0.64700000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77400000000000002,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.65900000000000003,"15min":0.69199999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.80500000000000005,"5min":1.508,"15min":1.508},"last":0.61099999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.76900000000000002,"15min":0.91600000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85299999999999998,"5min":6.5419999999999998,"15min":6.5419999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.64000000000000001,"15min":0.67300000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.79200000000000004,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.46700000000000003}]},{"osd":7,"last update":"Sun Nov 26 07:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.66200000000000003,"15min":0.69599999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.83799999999999997,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.64100000000000001,"15min":0.66200000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82899999999999996,"5min":1.155,"15min":1.155},"last":0.47699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574913,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":864256,"data_stored":364603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:15:38 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34000000000000002,"15min":0.34599999999999997},"min":{"1min":0.22500000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39400000000000002,"15min":0.39800000000000002},"min":{"1min":0.28100000000000003,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.53500000000000003,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.34399999999999997}]},{"osd":1,"last update":"Sun Nov 26 07:15:38 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34399999999999997,"15min":0.34799999999999998},"min":{"1min":0.224,"5min":0.222,"15min":0.222},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.375,"15min":0.377},"min":{"1min":0.24399999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.58199999999999996,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.39800000000000002}]},{"osd":3,"last update":"Sun Nov 26 07:15:38 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39700000000000002,"15min":0.41099999999999998},"min":{"1min":0.28100000000000003,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.59699999999999998,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.376,"5min":0.374,"15min":0.38200000000000001},"min":{"1min":0.27600000000000002,"5min":0.224,"15min":0.224},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.47899999999999998}]},{"osd":4,"last update":"Sun Nov 26 07:15:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.42699999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.497},{"interface":"front","average":{"1min":0.623,"5min":0.58399999999999996,"15min":0.58099999999999996},"min":{"1min":0.438,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.44800000000000001}]},{"osd":5,"last update":"Sun Nov 26 07:15:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.58099999999999996,"15min":0.57699999999999996},"min":{"1min":0.47199999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.435},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60999999999999999,"15min":0.63},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84299999999999997,"5min":1.002,"15min":1.002},"last":0.56100000000000005}]},{"osd":6,"last update":"Sun Nov 26 07:15:38 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.60899999999999999,"15min":0.61099999999999999},"min":{"1min":0.40999999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.629,"15min":0.63500000000000001},"min":{"1min":0.44700000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.53800000000000003}]},{"osd":7,"last update":"Sun Nov 26 07:15:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.62,"15min":0.629},"min":{"1min":0.499,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86299999999999999,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.625,"15min":0.625},"min":{"1min":0.47199999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.51300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574913,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":864256,"data_stored":364603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.34100000000000003,"15min":0.36499999999999999},"min":{"1min":0.22,"5min":0.219,"15min":0.219},"max":{"1min":0.46600000000000003,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.39300000000000002,"15min":0.41899999999999998},"min":{"1min":0.24199999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.61299999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.32400000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.375,"15min":0.40300000000000002},"min":{"1min":0.25800000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.58799999999999997,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.252},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.439,"15min":0.5},"min":{"1min":0.26300000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.56899999999999995,"5min":2.903,"15min":2.903},"last":0.35099999999999998}]},{"osd":2,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39300000000000002,"15min":0.40400000000000003},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.55200000000000005,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.40500000000000003,"15min":0.41799999999999998},"min":{"1min":0.309,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.63700000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.374}]},{"osd":4,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.65400000000000003,"15min":0.70699999999999996},"min":{"1min":0.376,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.96799999999999997,"5min":2.9609999999999999,"15min":2.9609999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.625,"15min":0.64100000000000001},"min":{"1min":0.437,"5min":0.373,"15min":0.373},"max":{"1min":1.1499999999999999,"5min":1.163,"15min":1.163},"last":0.64500000000000002}]},{"osd":5,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.65100000000000002,"15min":0.67300000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.98199999999999998,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.64000000000000001,"15min":0.66400000000000003},"min":{"1min":0.436,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93999999999999995,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.63}]},{"osd":6,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64500000000000002,"15min":0.67100000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.083,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.65600000000000003,"15min":0.68000000000000005},"min":{"1min":0.44900000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94499999999999995,"5min":1.258,"15min":1.258},"last":0.55000000000000004}]},{"osd":7,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.65200000000000002,"15min":0.68200000000000005},"min":{"1min":0.46700000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.014,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.69799999999999995,"15min":0.752},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.94899999999999995,"5min":2.9969999999999999,"15min":2.9969999999999999},"last":0.59799999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574912,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":864256,"data_stored":364603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.73599999999999999,"15min":0.91200000000000003},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.80800000000000005,"5min":8.7539999999999996,"15min":8.7539999999999996},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.76000000000000001,"15min":0.93100000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.74299999999999999,"5min":8.7390000000000008,"15min":8.7390000000000008},"last":0.57499999999999996}]},{"osd":1,"last update":"Sun Nov 26 07:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.76600000000000001,"15min":0.96199999999999997},"min":{"1min":0.34799999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.76400000000000001,"5min":9.7720000000000002,"15min":9.7720000000000002},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56200000000000006,"15min":0.56799999999999995},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.74399999999999999,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.54200000000000004}]},{"osd":2,"last update":"Sun Nov 26 07:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.73499999999999999,"15min":0.91600000000000004},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.748,"5min":9.8119999999999994,"15min":9.8119999999999994},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.70699999999999996,"15min":0.82299999999999995},"min":{"1min":0.35699999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76000000000000001,"5min":3.645,"15min":3.645},"last":0.56100000000000005}]},{"osd":3,"last update":"Sun Nov 26 07:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.78200000000000003,"15min":0.95999999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.81299999999999994,"5min":8.8089999999999993,"15min":8.8089999999999993},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.77400000000000002,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.49299999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52300000000000002,"15min":0.505},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.55500000000000005,"15min":0.55200000000000005},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72699999999999998,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.33600000000000002}]},{"osd":6,"last update":"Sun Nov 26 07:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.35199999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56200000000000006,"15min":0.57199999999999995},"min":{"1min":0.36099999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79600000000000004,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.39200000000000002}]},{"osd":7,"last update":"Sun Nov 26 07:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.32600000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.79100000000000004,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.60599999999999998,"15min":0.60399999999999998},"min":{"1min":0.40200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.91000000000000003,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.433}]}]},{"osd":5,"up_from":13,"seq":55834574914,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":864256,"data_stored":364603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58099999999999996,"15min":0.53800000000000003},"min":{"1min":0.40400000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.80200000000000005,"5min":7.1500000000000004,"15min":7.1500000000000004},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.60099999999999998,"15min":0.57299999999999995},"min":{"1min":0.42599999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.747,"5min":6.8470000000000004,"15min":6.8470000000000004},"last":0.45900000000000002}]},{"osd":1,"last update":"Sun Nov 26 07:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.59099999999999997,"15min":0.55700000000000005},"min":{"1min":0.442,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.746,"5min":7.1269999999999998,"15min":7.1269999999999998},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56499999999999995,"15min":0.55900000000000005},"min":{"1min":0.39900000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.70499999999999996,"5min":1.514,"15min":1.514},"last":0.61899999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.63700000000000001,"15min":0.59599999999999997},"min":{"1min":0.377,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81899999999999995,"5min":7.2000000000000002,"15min":7.2000000000000002},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66100000000000003,"15min":0.62},"min":{"1min":0.51800000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.71999999999999997,"5min":7.8259999999999996,"15min":7.8259999999999996},"last":0.70899999999999996}]},{"osd":3,"last update":"Sun Nov 26 07:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.58899999999999997,"15min":0.56799999999999995},"min":{"1min":0.52200000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.77600000000000002,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.64900000000000002,"15min":0.60699999999999998},"min":{"1min":0.42099999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84699999999999998,"5min":6.9240000000000004,"15min":6.9240000000000004},"last":0.73899999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.56000000000000005,"15min":0.51200000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72299999999999998,"5min":7.2830000000000004,"15min":7.2830000000000004},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57599999999999996,"15min":0.57399999999999995},"min":{"1min":0.40500000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73299999999999998,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.76600000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.624,"15min":0.57299999999999995},"min":{"1min":0.438,"5min":0.308,"15min":0.308},"max":{"1min":0.749,"5min":6.8890000000000002,"15min":6.8890000000000002},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.63700000000000001,"15min":0.59099999999999997},"min":{"1min":0.39600000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.74399999999999999,"5min":7.2430000000000003,"15min":7.2430000000000003},"last":0.82999999999999996}]},{"osd":7,"last update":"Sun Nov 26 07:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65900000000000003,"15min":0.60899999999999999},"min":{"1min":0.376,"5min":0.371,"15min":0.371},"max":{"1min":0.80600000000000005,"5min":6.9880000000000004,"15min":6.9880000000000004},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.73399999999999999,"15min":0.65900000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.80100000000000005,"5min":11.874000000000001,"15min":11.874000000000001},"last":0.84299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:16:37.562 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3f is not active+clean 2023-11-26T07:16:37.562 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.599254+0000', 'last_change': '2023-11-26T07:16:31.599254+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.599254+0000', 'last_undegraded': '2023-11-26T07:16:31.599254+0000', 'last_fullsized': '2023-11-26T07:16:31.599254+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-26T07:16:37.562 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3e is not active+clean 2023-11-26T07:16:37.562 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.598744+0000', 'last_change': '2023-11-26T07:16:31.598744+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.598744+0000', 'last_undegraded': '2023-11-26T07:16:31.598744+0000', 'last_fullsized': '2023-11-26T07:16:31.598744+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-26T07:16:37.562 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3d is not active+clean 2023-11-26T07:16:37.562 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.596490+0000', 'last_change': '2023-11-26T07:16:31.596490+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.596490+0000', 'last_undegraded': '2023-11-26T07:16:31.596490+0000', 'last_fullsized': '2023-11-26T07:16:31.596490+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-26T07:16:37.562 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3c is not active+clean 2023-11-26T07:16:37.562 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.594577+0000', 'last_change': '2023-11-26T07:16:31.594577+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.594577+0000', 'last_undegraded': '2023-11-26T07:16:31.594577+0000', 'last_fullsized': '2023-11-26T07:16:31.594577+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-26T07:16:37.563 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3b is not active+clean 2023-11-26T07:16:37.563 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.601432+0000', 'last_change': '2023-11-26T07:16:31.601432+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.601432+0000', 'last_undegraded': '2023-11-26T07:16:31.601432+0000', 'last_fullsized': '2023-11-26T07:16:31.601432+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-26T07:16:37.563 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3a is not active+clean 2023-11-26T07:16:37.563 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.598968+0000', 'last_change': '2023-11-26T07:16:31.598968+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.598968+0000', 'last_undegraded': '2023-11-26T07:16:31.598968+0000', 'last_fullsized': '2023-11-26T07:16:31.598968+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-26T07:16:37.563 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.39 is not active+clean 2023-11-26T07:16:37.563 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.594942+0000', 'last_change': '2023-11-26T07:16:31.594942+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.594942+0000', 'last_undegraded': '2023-11-26T07:16:31.594942+0000', 'last_fullsized': '2023-11-26T07:16:31.594942+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-26T07:16:37.563 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.38 is not active+clean 2023-11-26T07:16:37.563 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.598612+0000', 'last_change': '2023-11-26T07:16:31.598612+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.598612+0000', 'last_undegraded': '2023-11-26T07:16:31.598612+0000', 'last_fullsized': '2023-11-26T07:16:31.598612+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-26T07:16:37.563 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.37 is not active+clean 2023-11-26T07:16:37.563 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.600548+0000', 'last_change': '2023-11-26T07:16:31.600548+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.600548+0000', 'last_undegraded': '2023-11-26T07:16:31.600548+0000', 'last_fullsized': '2023-11-26T07:16:31.600548+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-26T07:16:37.564 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.36 is not active+clean 2023-11-26T07:16:37.564 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.591825+0000', 'last_change': '2023-11-26T07:16:31.591825+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.591825+0000', 'last_undegraded': '2023-11-26T07:16:31.591825+0000', 'last_fullsized': '2023-11-26T07:16:31.591825+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-26T07:16:37.564 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.35 is not active+clean 2023-11-26T07:16:37.564 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.597271+0000', 'last_change': '2023-11-26T07:16:31.597271+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.597271+0000', 'last_undegraded': '2023-11-26T07:16:31.597271+0000', 'last_fullsized': '2023-11-26T07:16:31.597271+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-26T07:16:37.564 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.34 is not active+clean 2023-11-26T07:16:37.564 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.594135+0000', 'last_change': '2023-11-26T07:16:31.594135+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.594135+0000', 'last_undegraded': '2023-11-26T07:16:31.594135+0000', 'last_fullsized': '2023-11-26T07:16:31.594135+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-26T07:16:37.564 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.33 is not active+clean 2023-11-26T07:16:37.564 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.595814+0000', 'last_change': '2023-11-26T07:16:31.595814+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.595814+0000', 'last_undegraded': '2023-11-26T07:16:31.595814+0000', 'last_fullsized': '2023-11-26T07:16:31.595814+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-26T07:16:37.564 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.32 is not active+clean 2023-11-26T07:16:37.564 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.601303+0000', 'last_change': '2023-11-26T07:16:31.601303+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.601303+0000', 'last_undegraded': '2023-11-26T07:16:31.601303+0000', 'last_fullsized': '2023-11-26T07:16:31.601303+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-26T07:16:37.565 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.31 is not active+clean 2023-11-26T07:16:37.565 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.595322+0000', 'last_change': '2023-11-26T07:16:31.595322+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.595322+0000', 'last_undegraded': '2023-11-26T07:16:31.595322+0000', 'last_fullsized': '2023-11-26T07:16:31.595322+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-26T07:16:37.565 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.30 is not active+clean 2023-11-26T07:16:37.565 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.591146+0000', 'last_change': '2023-11-26T07:16:31.591146+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.591146+0000', 'last_undegraded': '2023-11-26T07:16:31.591146+0000', 'last_fullsized': '2023-11-26T07:16:31.591146+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-26T07:16:37.565 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2f is not active+clean 2023-11-26T07:16:37.565 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.600103+0000', 'last_change': '2023-11-26T07:16:31.600103+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.600103+0000', 'last_undegraded': '2023-11-26T07:16:31.600103+0000', 'last_fullsized': '2023-11-26T07:16:31.600103+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-26T07:16:37.565 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2e is not active+clean 2023-11-26T07:16:37.565 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.593527+0000', 'last_change': '2023-11-26T07:16:31.593527+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.593527+0000', 'last_undegraded': '2023-11-26T07:16:31.593527+0000', 'last_fullsized': '2023-11-26T07:16:31.593527+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-26T07:16:37.565 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2d is not active+clean 2023-11-26T07:16:37.565 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.598419+0000', 'last_change': '2023-11-26T07:16:31.598419+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.598419+0000', 'last_undegraded': '2023-11-26T07:16:31.598419+0000', 'last_fullsized': '2023-11-26T07:16:31.598419+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-26T07:16:37.565 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2c is not active+clean 2023-11-26T07:16:37.566 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.593750+0000', 'last_change': '2023-11-26T07:16:31.593750+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.593750+0000', 'last_undegraded': '2023-11-26T07:16:31.593750+0000', 'last_fullsized': '2023-11-26T07:16:31.593750+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-26T07:16:37.566 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2b is not active+clean 2023-11-26T07:16:37.566 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.591574+0000', 'last_change': '2023-11-26T07:16:31.591574+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.591574+0000', 'last_undegraded': '2023-11-26T07:16:31.591574+0000', 'last_fullsized': '2023-11-26T07:16:31.591574+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-26T07:16:37.566 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2a is not active+clean 2023-11-26T07:16:37.566 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.591270+0000', 'last_change': '2023-11-26T07:16:31.591270+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.591270+0000', 'last_undegraded': '2023-11-26T07:16:31.591270+0000', 'last_fullsized': '2023-11-26T07:16:31.591270+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-26T07:16:37.566 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.29 is not active+clean 2023-11-26T07:16:37.566 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.598084+0000', 'last_change': '2023-11-26T07:16:31.598084+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.598084+0000', 'last_undegraded': '2023-11-26T07:16:31.598084+0000', 'last_fullsized': '2023-11-26T07:16:31.598084+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-26T07:16:37.566 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.28 is not active+clean 2023-11-26T07:16:37.566 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.595800+0000', 'last_change': '2023-11-26T07:16:31.595800+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.595800+0000', 'last_undegraded': '2023-11-26T07:16:31.595800+0000', 'last_fullsized': '2023-11-26T07:16:31.595800+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-26T07:16:37.566 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.27 is not active+clean 2023-11-26T07:16:37.567 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.591671+0000', 'last_change': '2023-11-26T07:16:31.591671+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.591671+0000', 'last_undegraded': '2023-11-26T07:16:31.591671+0000', 'last_fullsized': '2023-11-26T07:16:31.591671+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-26T07:16:37.567 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.26 is not active+clean 2023-11-26T07:16:37.567 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.594660+0000', 'last_change': '2023-11-26T07:16:31.594660+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.594660+0000', 'last_undegraded': '2023-11-26T07:16:31.594660+0000', 'last_fullsized': '2023-11-26T07:16:31.594660+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-26T07:16:37.567 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.25 is not active+clean 2023-11-26T07:16:37.567 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.595823+0000', 'last_change': '2023-11-26T07:16:31.595823+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.595823+0000', 'last_undegraded': '2023-11-26T07:16:31.595823+0000', 'last_fullsized': '2023-11-26T07:16:31.595823+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-26T07:16:37.567 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.24 is not active+clean 2023-11-26T07:16:37.567 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.590424+0000', 'last_change': '2023-11-26T07:16:31.590424+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.590424+0000', 'last_undegraded': '2023-11-26T07:16:31.590424+0000', 'last_fullsized': '2023-11-26T07:16:31.590424+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-26T07:16:37.567 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.23 is not active+clean 2023-11-26T07:16:37.567 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.595869+0000', 'last_change': '2023-11-26T07:16:31.595869+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.595869+0000', 'last_undegraded': '2023-11-26T07:16:31.595869+0000', 'last_fullsized': '2023-11-26T07:16:31.595869+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-26T07:16:37.567 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.22 is not active+clean 2023-11-26T07:16:37.568 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.594757+0000', 'last_change': '2023-11-26T07:16:31.594757+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.594757+0000', 'last_undegraded': '2023-11-26T07:16:31.594757+0000', 'last_fullsized': '2023-11-26T07:16:31.594757+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-26T07:16:37.568 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.21 is not active+clean 2023-11-26T07:16:37.568 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.594164+0000', 'last_change': '2023-11-26T07:16:31.594164+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.594164+0000', 'last_undegraded': '2023-11-26T07:16:31.594164+0000', 'last_fullsized': '2023-11-26T07:16:31.594164+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-26T07:16:37.568 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.20 is not active+clean 2023-11-26T07:16:37.568 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.594946+0000', 'last_change': '2023-11-26T07:16:31.594946+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.594946+0000', 'last_undegraded': '2023-11-26T07:16:31.594946+0000', 'last_fullsized': '2023-11-26T07:16:31.594946+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-26T07:16:37.568 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1e is not active+clean 2023-11-26T07:16:37.568 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.595892+0000', 'last_change': '2023-11-26T07:16:31.595892+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.595892+0000', 'last_undegraded': '2023-11-26T07:16:31.595892+0000', 'last_fullsized': '2023-11-26T07:16:31.595892+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-26T07:16:37.568 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1f is not active+clean 2023-11-26T07:16:37.568 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.599410+0000', 'last_change': '2023-11-26T07:16:31.599410+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.599410+0000', 'last_undegraded': '2023-11-26T07:16:31.599410+0000', 'last_fullsized': '2023-11-26T07:16:31.599410+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-26T07:16:37.568 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1c is not active+clean 2023-11-26T07:16:37.568 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.595949+0000', 'last_change': '2023-11-26T07:16:31.595949+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.595949+0000', 'last_undegraded': '2023-11-26T07:16:31.595949+0000', 'last_fullsized': '2023-11-26T07:16:31.595949+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-26T07:16:37.569 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1d is not active+clean 2023-11-26T07:16:37.569 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.596841+0000', 'last_change': '2023-11-26T07:16:31.596841+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.596841+0000', 'last_undegraded': '2023-11-26T07:16:31.596841+0000', 'last_fullsized': '2023-11-26T07:16:31.596841+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-26T07:16:37.569 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1a is not active+clean 2023-11-26T07:16:37.569 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.593690+0000', 'last_change': '2023-11-26T07:16:31.593690+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.593690+0000', 'last_undegraded': '2023-11-26T07:16:31.593690+0000', 'last_fullsized': '2023-11-26T07:16:31.593690+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-26T07:16:37.569 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1b is not active+clean 2023-11-26T07:16:37.569 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.590394+0000', 'last_change': '2023-11-26T07:16:31.590394+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.590394+0000', 'last_undegraded': '2023-11-26T07:16:31.590394+0000', 'last_fullsized': '2023-11-26T07:16:31.590394+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-26T07:16:37.569 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.18 is not active+clean 2023-11-26T07:16:37.569 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.599635+0000', 'last_change': '2023-11-26T07:16:31.599635+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.599635+0000', 'last_undegraded': '2023-11-26T07:16:31.599635+0000', 'last_fullsized': '2023-11-26T07:16:31.599635+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-26T07:16:37.569 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.19 is not active+clean 2023-11-26T07:16:37.570 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.593030+0000', 'last_change': '2023-11-26T07:16:31.593030+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.593030+0000', 'last_undegraded': '2023-11-26T07:16:31.593030+0000', 'last_fullsized': '2023-11-26T07:16:31.593030+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-26T07:16:37.570 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.16 is not active+clean 2023-11-26T07:16:37.570 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.594201+0000', 'last_change': '2023-11-26T07:16:31.594201+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.594201+0000', 'last_undegraded': '2023-11-26T07:16:31.594201+0000', 'last_fullsized': '2023-11-26T07:16:31.594201+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-26T07:16:37.570 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.17 is not active+clean 2023-11-26T07:16:37.570 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.598876+0000', 'last_change': '2023-11-26T07:16:31.598876+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.598876+0000', 'last_undegraded': '2023-11-26T07:16:31.598876+0000', 'last_fullsized': '2023-11-26T07:16:31.598876+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-26T07:16:37.570 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.14 is not active+clean 2023-11-26T07:16:37.570 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.595583+0000', 'last_change': '2023-11-26T07:16:31.595583+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.595583+0000', 'last_undegraded': '2023-11-26T07:16:31.595583+0000', 'last_fullsized': '2023-11-26T07:16:31.595583+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-26T07:16:37.570 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.15 is not active+clean 2023-11-26T07:16:37.570 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.599913+0000', 'last_change': '2023-11-26T07:16:31.599913+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.599913+0000', 'last_undegraded': '2023-11-26T07:16:31.599913+0000', 'last_fullsized': '2023-11-26T07:16:31.599913+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-26T07:16:37.570 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.12 is not active+clean 2023-11-26T07:16:37.571 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.595895+0000', 'last_change': '2023-11-26T07:16:31.595895+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.595895+0000', 'last_undegraded': '2023-11-26T07:16:31.595895+0000', 'last_fullsized': '2023-11-26T07:16:31.595895+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-26T07:16:37.571 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.13 is not active+clean 2023-11-26T07:16:37.571 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.593693+0000', 'last_change': '2023-11-26T07:16:31.593693+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.593693+0000', 'last_undegraded': '2023-11-26T07:16:31.593693+0000', 'last_fullsized': '2023-11-26T07:16:31.593693+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-26T07:16:37.571 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.10 is not active+clean 2023-11-26T07:16:37.571 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.594576+0000', 'last_change': '2023-11-26T07:16:31.594576+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.594576+0000', 'last_undegraded': '2023-11-26T07:16:31.594576+0000', 'last_fullsized': '2023-11-26T07:16:31.594576+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-26T07:16:37.571 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.11 is not active+clean 2023-11-26T07:16:37.571 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.600076+0000', 'last_change': '2023-11-26T07:16:31.600076+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.600076+0000', 'last_undegraded': '2023-11-26T07:16:31.600076+0000', 'last_fullsized': '2023-11-26T07:16:31.600076+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-26T07:16:37.571 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.e is not active+clean 2023-11-26T07:16:37.571 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.591339+0000', 'last_change': '2023-11-26T07:16:31.591339+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.591339+0000', 'last_undegraded': '2023-11-26T07:16:31.591339+0000', 'last_fullsized': '2023-11-26T07:16:31.591339+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-26T07:16:37.571 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.f is not active+clean 2023-11-26T07:16:37.572 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.598410+0000', 'last_change': '2023-11-26T07:16:31.598410+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.598410+0000', 'last_undegraded': '2023-11-26T07:16:31.598410+0000', 'last_fullsized': '2023-11-26T07:16:31.598410+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-26T07:16:37.572 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.c is not active+clean 2023-11-26T07:16:37.572 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.593458+0000', 'last_change': '2023-11-26T07:16:31.593458+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.593458+0000', 'last_undegraded': '2023-11-26T07:16:31.593458+0000', 'last_fullsized': '2023-11-26T07:16:31.593458+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-26T07:16:37.572 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.d is not active+clean 2023-11-26T07:16:37.572 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.599311+0000', 'last_change': '2023-11-26T07:16:31.599311+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.599311+0000', 'last_undegraded': '2023-11-26T07:16:31.599311+0000', 'last_fullsized': '2023-11-26T07:16:31.599311+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-26T07:16:37.572 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.b is not active+clean 2023-11-26T07:16:37.572 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.594972+0000', 'last_change': '2023-11-26T07:16:31.594972+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.594972+0000', 'last_undegraded': '2023-11-26T07:16:31.594972+0000', 'last_fullsized': '2023-11-26T07:16:31.594972+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-26T07:16:37.572 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.8 is not active+clean 2023-11-26T07:16:37.572 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.592923+0000', 'last_change': '2023-11-26T07:16:31.592923+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.592923+0000', 'last_undegraded': '2023-11-26T07:16:31.592923+0000', 'last_fullsized': '2023-11-26T07:16:31.592923+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-26T07:16:37.572 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.9 is not active+clean 2023-11-26T07:16:37.573 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.593451+0000', 'last_change': '2023-11-26T07:16:31.593451+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.593451+0000', 'last_undegraded': '2023-11-26T07:16:31.593451+0000', 'last_fullsized': '2023-11-26T07:16:31.593451+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-26T07:16:37.573 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.6 is not active+clean 2023-11-26T07:16:37.573 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.596145+0000', 'last_change': '2023-11-26T07:16:31.596145+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.596145+0000', 'last_undegraded': '2023-11-26T07:16:31.596145+0000', 'last_fullsized': '2023-11-26T07:16:31.596145+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-26T07:16:37.573 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.7 is not active+clean 2023-11-26T07:16:37.573 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.593759+0000', 'last_change': '2023-11-26T07:16:31.593759+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.593759+0000', 'last_undegraded': '2023-11-26T07:16:31.593759+0000', 'last_fullsized': '2023-11-26T07:16:31.593759+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-26T07:16:37.573 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.4 is not active+clean 2023-11-26T07:16:37.573 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.596521+0000', 'last_change': '2023-11-26T07:16:31.596521+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.596521+0000', 'last_undegraded': '2023-11-26T07:16:31.596521+0000', 'last_fullsized': '2023-11-26T07:16:31.596521+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-26T07:16:37.573 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.5 is not active+clean 2023-11-26T07:16:37.573 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.596395+0000', 'last_change': '2023-11-26T07:16:31.596395+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.596395+0000', 'last_undegraded': '2023-11-26T07:16:31.596395+0000', 'last_fullsized': '2023-11-26T07:16:31.596395+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-26T07:16:37.573 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2 is not active+clean 2023-11-26T07:16:37.574 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.599473+0000', 'last_change': '2023-11-26T07:16:31.599473+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.599473+0000', 'last_undegraded': '2023-11-26T07:16:31.599473+0000', 'last_fullsized': '2023-11-26T07:16:31.599473+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-26T07:16:37.574 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3 is not active+clean 2023-11-26T07:16:37.574 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.594896+0000', 'last_change': '2023-11-26T07:16:31.594896+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.594896+0000', 'last_undegraded': '2023-11-26T07:16:31.594896+0000', 'last_fullsized': '2023-11-26T07:16:31.594896+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-26T07:16:37.574 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.0 is not active+clean 2023-11-26T07:16:37.574 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.593371+0000', 'last_change': '2023-11-26T07:16:31.593371+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.593371+0000', 'last_undegraded': '2023-11-26T07:16:31.593371+0000', 'last_fullsized': '2023-11-26T07:16:31.593371+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-26T07:16:37.574 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1 is not active+clean 2023-11-26T07:16:37.574 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.595169+0000', 'last_change': '2023-11-26T07:16:31.595169+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.595169+0000', 'last_undegraded': '2023-11-26T07:16:31.595169+0000', 'last_fullsized': '2023-11-26T07:16:31.595169+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-26T07:16:37.574 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.a is not active+clean 2023-11-26T07:16:37.574 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 71, 'state': 'creating+peering', 'last_fresh': '2023-11-26T07:16:31.593887+0000', 'last_change': '2023-11-26T07:16:31.593887+0000', 'last_active': '2023-11-26T07:16:31.584625+0000', 'last_peered': '2023-11-26T07:16:31.584625+0000', 'last_clean': '2023-11-26T07:16:31.584625+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-26T07:16:31.593887+0000', 'last_undegraded': '2023-11-26T07:16:31.593887+0000', 'last_fullsized': '2023-11-26T07:16:31.593887+0000', 'mapping_epoch': 71, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'last_clean_scrub_stamp': '2023-11-26T07:16:31.584625+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-26T07:16:37.575 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-26T07:16:37.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.719+0000 7f1a4ad1c700 1 Processor -- start 2023-11-26T07:16:37.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.719+0000 7f1a4ad1c700 1 -- start start 2023-11-26T07:16:37.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.720+0000 7f1a4ad1c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1a4406b620 0x7f1a440b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:37.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.720+0000 7f1a4ad1c700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a441629c0 con 0x7f1a440b5ab0 2023-11-26T07:16:37.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.720+0000 7f1a4ad1c700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a44071f50 con 0x7f1a4406ee60 2023-11-26T07:16:37.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.720+0000 7f1a4ad1c700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a44072230 con 0x7f1a4406b620 2023-11-26T07:16:37.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.720+0000 7f1a48ab8700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1a4406b620 0x7f1a440b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:37.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.720+0000 7f1a43fff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f1a440b5ab0 0x7f1a44161ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35532/0 (socket says 172.21.15.2:35532) 2023-11-26T07:16:37.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.720+0000 7f1a43fff700 1 -- 172.21.15.2:0/2631765087 learned_addr learned my addr 172.21.15.2:0/2631765087 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:16:37.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.720+0000 7f1a48ab8700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1a4406b620 0x7f1a440b3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44322/0 (socket says 172.21.15.2:44322) 2023-11-26T07:16:37.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.721+0000 7f1a48ab8700 1 -- 172.21.15.2:0/2631765087 >> v1:172.21.15.192:6789/0 conn(0x7f1a4406ee60 legacy=0x7f1a441622b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:37.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.721+0000 7f1a48ab8700 1 -- 172.21.15.2:0/2631765087 >> v1:172.21.15.2:6789/0 conn(0x7f1a440b5ab0 legacy=0x7f1a44161ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:37.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.721+0000 7f1a48ab8700 1 -- 172.21.15.2:0/2631765087 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a44072510 con 0x7f1a4406b620 2023-11-26T07:16:37.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.721+0000 7f1a437fe700 1 -- 172.21.15.2:0/2631765087 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3786428827 0 0) 0x7f1a441629c0 con 0x7f1a440b5ab0 2023-11-26T07:16:37.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.721+0000 7f1a48ab8700 1 --2- 172.21.15.2:0/2631765087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a4406b620 0x7f1a440b3a40 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f1a38009840 tx=0x7f1a38009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=267f44b2c0f1dde2 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:37.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.721+0000 7f1a437fe700 1 -- 172.21.15.2:0/2631765087 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a38004230 con 0x7f1a4406b620 2023-11-26T07:16:37.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.721+0000 7f1a437fe700 1 -- 172.21.15.2:0/2631765087 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a38004390 con 0x7f1a4406b620 2023-11-26T07:16:37.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.721+0000 7f1a437fe700 1 -- 172.21.15.2:0/2631765087 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a380036a0 con 0x7f1a4406b620 2023-11-26T07:16:37.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.722+0000 7f1a4ad1c700 1 -- 172.21.15.2:0/2631765087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a4406b620 msgr2=0x7f1a440b3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:37.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.722+0000 7f1a4ad1c700 1 --2- 172.21.15.2:0/2631765087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a4406b620 0x7f1a440b3a40 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f1a38009840 tx=0x7f1a38009b50 comp rx=0 tx=0).stop 2023-11-26T07:16:37.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.722+0000 7f1a4ad1c700 1 -- 172.21.15.2:0/2631765087 shutdown_connections 2023-11-26T07:16:37.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.722+0000 7f1a4ad1c700 1 --2- 172.21.15.2:0/2631765087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a4406b620 0x7f1a440b3a40 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:37.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.722+0000 7f1a4ad1c700 1 -- 172.21.15.2:0/2631765087 >> 172.21.15.2:0/2631765087 conn(0x7f1a440b2740 msgr2=0x7f1a440b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:37.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.722+0000 7f1a4ad1c700 1 -- 172.21.15.2:0/2631765087 shutdown_connections 2023-11-26T07:16:37.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.722+0000 7f1a4ad1c700 1 -- 172.21.15.2:0/2631765087 wait complete. 2023-11-26T07:16:37.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.723+0000 7f1a4ad1c700 1 Processor -- start 2023-11-26T07:16:37.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.723+0000 7f1a4ad1c700 1 -- start start 2023-11-26T07:16:37.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.724+0000 7f1a4ad1c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a4406b620 0x7f1a441587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:37.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.724+0000 7f1a4ad1c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a4406ee60 0x7f1a440c8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:37.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.724+0000 7f1a4ad1c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a440b5ab0 0x7f1a440ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:37.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.724+0000 7f1a4ad1c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a440ca810 con 0x7f1a4406b620 2023-11-26T07:16:37.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.724+0000 7f1a4ad1c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a440c89b0 con 0x7f1a4406ee60 2023-11-26T07:16:37.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.724+0000 7f1a4ad1c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a440c8c90 con 0x7f1a440b5ab0 2023-11-26T07:16:37.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.724+0000 7f1a48ab8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a4406b620 0x7f1a441587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:37.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.724+0000 7f1a48ab8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a4406b620 0x7f1a441587f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44326/0 (socket says 172.21.15.2:44326) 2023-11-26T07:16:37.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.724+0000 7f1a48ab8700 1 -- 172.21.15.2:0/4280072380 learned_addr learned my addr 172.21.15.2:0/4280072380 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:37.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.725+0000 7f1a43fff700 1 --2- 172.21.15.2:0/4280072380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a4406ee60 0x7f1a440c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:37.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.725+0000 7f1a492b9700 1 --2- 172.21.15.2:0/4280072380 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a440b5ab0 0x7f1a440ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:37.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.725+0000 7f1a48ab8700 1 -- 172.21.15.2:0/4280072380 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a440b5ab0 msgr2=0x7f1a440ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:37.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.725+0000 7f1a48ab8700 1 --2- 172.21.15.2:0/4280072380 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a440b5ab0 0x7f1a440ccc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:37.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.725+0000 7f1a48ab8700 1 -- 172.21.15.2:0/4280072380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a4406ee60 msgr2=0x7f1a440c8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:37.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.725+0000 7f1a48ab8700 1 --2- 172.21.15.2:0/4280072380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a4406ee60 0x7f1a440c8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:37.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.725+0000 7f1a48ab8700 1 -- 172.21.15.2:0/4280072380 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a380094a0 con 0x7f1a4406b620 2023-11-26T07:16:37.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.725+0000 7f1a43fff700 1 --2- 172.21.15.2:0/4280072380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a4406ee60 0x7f1a440c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:16:37.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.725+0000 7f1a492b9700 1 --2- 172.21.15.2:0/4280072380 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a440b5ab0 0x7f1a440ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:16:37.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.725+0000 7f1a48ab8700 1 --2- 172.21.15.2:0/4280072380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a4406b620 0x7f1a441587f0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f1a38000c00 tx=0x7f1a38004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:37.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.725+0000 7f1a417fa700 1 -- 172.21.15.2:0/4280072380 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a38011630 con 0x7f1a4406b620 2023-11-26T07:16:37.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.725+0000 7f1a417fa700 1 -- 172.21.15.2:0/4280072380 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3801e070 con 0x7f1a4406b620 2023-11-26T07:16:37.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.725+0000 7f1a417fa700 1 -- 172.21.15.2:0/4280072380 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a380119f0 con 0x7f1a4406b620 2023-11-26T07:16:37.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.725+0000 7f1a4ad1c700 1 -- 172.21.15.2:0/4280072380 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a440c8f70 con 0x7f1a4406b620 2023-11-26T07:16:37.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.725+0000 7f1a4ad1c700 1 -- 172.21.15.2:0/4280072380 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a440c8550 con 0x7f1a4406b620 2023-11-26T07:16:37.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.726+0000 7f1a4ad1c700 1 -- 172.21.15.2:0/4280072380 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a44068670 con 0x7f1a4406b620 2023-11-26T07:16:37.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.727+0000 7f1a417fa700 1 -- 172.21.15.2:0/4280072380 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f1a38011b50 con 0x7f1a4406b620 2023-11-26T07:16:37.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.727+0000 7f1a417fa700 1 --2- 172.21.15.2:0/4280072380 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f1a2806b740 0x7f1a2806dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:37.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.727+0000 7f1a417fa700 1 -- 172.21.15.2:0/4280072380 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1a38089a00 con 0x7f1a4406b620 2023-11-26T07:16:37.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.728+0000 7f1a43fff700 1 --2- 172.21.15.2:0/4280072380 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f1a2806b740 0x7f1a2806dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:37.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.728+0000 7f1a43fff700 1 --2- 172.21.15.2:0/4280072380 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f1a2806b740 0x7f1a2806dc00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1a440cc8d0 tx=0x7f1a30009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:37.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:37.731+0000 7f1a417fa700 1 -- 172.21.15.2:0/4280072380 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1a38056330 con 0x7f1a4406b620 2023-11-26T07:16:38.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.020+0000 7f1a4ad1c700 1 -- 172.21.15.2:0/4280072380 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f1a4406bd40 con 0x7f1a4406b620 2023-11-26T07:16:38.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.020+0000 7f1a417fa700 1 -- 172.21.15.2:0/4280072380 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1034 (secure 0 0 0) 0x7f1a38020080 con 0x7f1a4406b620 2023-11-26T07:16:38.024 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:16:38.024 INFO:teuthology.orchestra.run.smithi002.stdout:{"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":321,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":73,"num_osds":8,"num_up_osds":8,"osd_up_since":1700982686,"num_in_osds":8,"osd_in_since":1700982678,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":263561216,"bytes_avail":772830552064,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":46,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"a","status":"up:active","gid":6714}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":10,"modified":"2023-11-26T07:16:20.226663+0000","services":{}},"progress_events":{}} 2023-11-26T07:16:38.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.022+0000 7f1a4ad1c700 1 -- 172.21.15.2:0/4280072380 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f1a2806b740 msgr2=0x7f1a2806dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:38.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.022+0000 7f1a4ad1c700 1 --2- 172.21.15.2:0/4280072380 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f1a2806b740 0x7f1a2806dc00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1a440cc8d0 tx=0x7f1a30009040 comp rx=0 tx=0).stop 2023-11-26T07:16:38.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.022+0000 7f1a4ad1c700 1 -- 172.21.15.2:0/4280072380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a4406b620 msgr2=0x7f1a441587f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:38.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.022+0000 7f1a4ad1c700 1 --2- 172.21.15.2:0/4280072380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a4406b620 0x7f1a441587f0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f1a38000c00 tx=0x7f1a38004750 comp rx=0 tx=0).stop 2023-11-26T07:16:38.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.022+0000 7f1a4ad1c700 1 -- 172.21.15.2:0/4280072380 shutdown_connections 2023-11-26T07:16:38.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.022+0000 7f1a4ad1c700 1 --2- 172.21.15.2:0/4280072380 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f1a2806b740 0x7f1a2806dc00 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:38.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.022+0000 7f1a4ad1c700 1 --2- 172.21.15.2:0/4280072380 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a440b5ab0 0x7f1a440ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:38.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.022+0000 7f1a4ad1c700 1 --2- 172.21.15.2:0/4280072380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a4406b620 0x7f1a441587f0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:38.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.022+0000 7f1a4ad1c700 1 --2- 172.21.15.2:0/4280072380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a4406ee60 0x7f1a440c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:38.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.022+0000 7f1a4ad1c700 1 -- 172.21.15.2:0/4280072380 >> 172.21.15.2:0/4280072380 conn(0x7f1a440b2740 msgr2=0x7f1a44146de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:38.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.023+0000 7f1a4ad1c700 1 -- 172.21.15.2:0/4280072380 shutdown_connections 2023-11-26T07:16:38.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.023+0000 7f1a4ad1c700 1 -- 172.21.15.2:0/4280072380 wait complete. 2023-11-26T07:16:38.037 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-26T07:16:38.038 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:16:38.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.159+0000 7f175537a700 1 Processor -- start 2023-11-26T07:16:38.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.159+0000 7f175537a700 1 -- start start 2023-11-26T07:16:38.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.160+0000 7f175537a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f17500cec10 0x7f17500b4390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:38.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.160+0000 7f175537a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f175006caf0 0x7f17500cce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:38.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.160+0000 7f175537a700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f175015e5c0 con 0x7f175015e1e0 2023-11-26T07:16:38.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.160+0000 7f175537a700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f175006d0b0 con 0x7f17500cec10 2023-11-26T07:16:38.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.160+0000 7f175537a700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17500cc370 con 0x7f175006caf0 2023-11-26T07:16:38.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.160+0000 7f174e7fc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f17500cec10 0x7f17500b4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:38.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.160+0000 7f174e7fc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f17500cec10 0x7f17500b4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44336/0 (socket says 172.21.15.2:44336) 2023-11-26T07:16:38.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.160+0000 7f174e7fc700 1 -- 172.21.15.2:0/371665367 learned_addr learned my addr 172.21.15.2:0/371665367 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:38.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.160+0000 7f174f7fe700 1 --2- 172.21.15.2:0/371665367 >> v2:172.21.15.192:3300/0 conn(0x7f175006caf0 0x7f17500cce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:38.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.160+0000 7f174e7fc700 1 -- 172.21.15.2:0/371665367 >> v2:172.21.15.192:3300/0 conn(0x7f175006caf0 msgr2=0x7f17500cce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:38.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.160+0000 7f174e7fc700 1 --2- 172.21.15.2:0/371665367 >> v2:172.21.15.192:3300/0 conn(0x7f175006caf0 0x7f17500cce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:38.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.160+0000 7f174e7fc700 1 -- 172.21.15.2:0/371665367 >> v1:172.21.15.192:6789/0 conn(0x7f175015e1e0 legacy=0x7f17500ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:38.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.160+0000 7f174e7fc700 1 -- 172.21.15.2:0/371665367 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17500cc650 con 0x7f17500cec10 2023-11-26T07:16:38.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.160+0000 7f174e7fc700 1 --2- 172.21.15.2:0/371665367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17500cec10 0x7f17500b4390 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f175006e5b0 tx=0x7f1738009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b602d3d20f3ea03 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:38.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.161+0000 7f174dffb700 1 -- 172.21.15.2:0/371665367 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1738004230 con 0x7f17500cec10 2023-11-26T07:16:38.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.161+0000 7f174dffb700 1 -- 172.21.15.2:0/371665367 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1738004390 con 0x7f17500cec10 2023-11-26T07:16:38.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.161+0000 7f174dffb700 1 -- 172.21.15.2:0/371665367 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17380036a0 con 0x7f17500cec10 2023-11-26T07:16:38.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.161+0000 7f175537a700 1 -- 172.21.15.2:0/371665367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17500cec10 msgr2=0x7f17500b4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:38.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.161+0000 7f175537a700 1 --2- 172.21.15.2:0/371665367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17500cec10 0x7f17500b4390 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f175006e5b0 tx=0x7f1738009bd0 comp rx=0 tx=0).stop 2023-11-26T07:16:38.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.161+0000 7f175537a700 1 -- 172.21.15.2:0/371665367 shutdown_connections 2023-11-26T07:16:38.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.161+0000 7f175537a700 1 --2- 172.21.15.2:0/371665367 >> v2:172.21.15.192:3300/0 conn(0x7f175006caf0 0x7f17500cce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:38.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.161+0000 7f175537a700 1 --2- 172.21.15.2:0/371665367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17500cec10 0x7f17500b4390 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:38.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.161+0000 7f175537a700 1 -- 172.21.15.2:0/371665367 >> 172.21.15.2:0/371665367 conn(0x7f17500b3870 msgr2=0x7f17500b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:38.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.161+0000 7f175537a700 1 -- 172.21.15.2:0/371665367 shutdown_connections 2023-11-26T07:16:38.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.161+0000 7f175537a700 1 -- 172.21.15.2:0/371665367 wait complete. 2023-11-26T07:16:38.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.163+0000 7f175537a700 1 Processor -- start 2023-11-26T07:16:38.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.163+0000 7f175537a700 1 -- start start 2023-11-26T07:16:38.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.163+0000 7f175537a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f175006caf0 0x7f175009f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:38.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.163+0000 7f175537a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17500cec10 0x7f17500cb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:38.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.163+0000 7f175537a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f175015e1e0 0x7f175009df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:38.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.163+0000 7f175537a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17501f40b0 con 0x7f17500cec10 2023-11-26T07:16:38.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.163+0000 7f175537a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175009e680 con 0x7f175006caf0 2023-11-26T07:16:38.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.163+0000 7f175537a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f175009e960 con 0x7f175015e1e0 2023-11-26T07:16:38.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.164+0000 7f174e7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17500cec10 0x7f17500cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:38.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.164+0000 7f174e7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17500cec10 0x7f17500cb530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44342/0 (socket says 172.21.15.2:44342) 2023-11-26T07:16:38.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.164+0000 7f174e7fc700 1 -- 172.21.15.2:0/3918550036 learned_addr learned my addr 172.21.15.2:0/3918550036 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:38.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.164+0000 7f174f7fe700 1 --2- 172.21.15.2:0/3918550036 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f175015e1e0 0x7f175009df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:38.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.164+0000 7f174effd700 1 --2- 172.21.15.2:0/3918550036 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f175006caf0 0x7f175009f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:38.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.164+0000 7f174e7fc700 1 -- 172.21.15.2:0/3918550036 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f175015e1e0 msgr2=0x7f175009df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:38.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.164+0000 7f174e7fc700 1 --2- 172.21.15.2:0/3918550036 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f175015e1e0 0x7f175009df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:38.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.164+0000 7f174e7fc700 1 -- 172.21.15.2:0/3918550036 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f175006caf0 msgr2=0x7f175009f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:38.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.164+0000 7f174e7fc700 1 --2- 172.21.15.2:0/3918550036 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f175006caf0 0x7f175009f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:38.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.164+0000 7f174e7fc700 1 -- 172.21.15.2:0/3918550036 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1738009550 con 0x7f17500cec10 2023-11-26T07:16:38.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.164+0000 7f174e7fc700 1 --2- 172.21.15.2:0/3918550036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17500cec10 0x7f17500cb530 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f1738009130 tx=0x7f1738004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:38.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.164+0000 7f17477fe700 1 -- 172.21.15.2:0/3918550036 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1738003b90 con 0x7f17500cec10 2023-11-26T07:16:38.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.164+0000 7f17477fe700 1 -- 172.21.15.2:0/3918550036 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f173801f070 con 0x7f17500cec10 2023-11-26T07:16:38.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.164+0000 7f175537a700 1 -- 172.21.15.2:0/3918550036 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f175009ec40 con 0x7f17500cec10 2023-11-26T07:16:38.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.164+0000 7f17477fe700 1 -- 172.21.15.2:0/3918550036 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1738011630 con 0x7f17500cec10 2023-11-26T07:16:38.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.164+0000 7f175537a700 1 -- 172.21.15.2:0/3918550036 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f175009f200 con 0x7f17500cec10 2023-11-26T07:16:38.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.165+0000 7f175537a700 1 -- 172.21.15.2:0/3918550036 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1750067f60 con 0x7f17500cec10 2023-11-26T07:16:38.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.166+0000 7f17477fe700 1 -- 172.21.15.2:0/3918550036 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f1738021030 con 0x7f17500cec10 2023-11-26T07:16:38.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.166+0000 7f17477fe700 1 --2- 172.21.15.2:0/3918550036 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f173006b740 0x7f173006dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:38.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.166+0000 7f17477fe700 1 -- 172.21.15.2:0/3918550036 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1738089300 con 0x7f17500cec10 2023-11-26T07:16:38.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.167+0000 7f174effd700 1 --2- 172.21.15.2:0/3918550036 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f173006b740 0x7f173006dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:38.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.167+0000 7f174effd700 1 --2- 172.21.15.2:0/3918550036 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f173006b740 0x7f173006dc00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1740009960 tx=0x7f17400090e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:38.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.171+0000 7f17477fe700 1 -- 172.21.15.2:0/3918550036 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1738055c10 con 0x7f17500cec10 2023-11-26T07:16:38.368 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.365+0000 7f175537a700 1 -- 172.21.15.2:0/3918550036 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f175006d390 con 0x7f173006b740 2023-11-26T07:16:38.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.374+0000 7f17477fe700 1 -- 172.21.15.2:0/3918550036 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289329 (secure 0 0 0) 0x7f1740009e30 con 0x7f173006b740 2023-11-26T07:16:38.380 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:16:38.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.377+0000 7f175537a700 1 -- 172.21.15.2:0/3918550036 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f173006b740 msgr2=0x7f173006dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:38.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.377+0000 7f175537a700 1 --2- 172.21.15.2:0/3918550036 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f173006b740 0x7f173006dc00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1740009960 tx=0x7f17400090e0 comp rx=0 tx=0).stop 2023-11-26T07:16:38.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.377+0000 7f175537a700 1 -- 172.21.15.2:0/3918550036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17500cec10 msgr2=0x7f17500cb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:38.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.377+0000 7f175537a700 1 --2- 172.21.15.2:0/3918550036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17500cec10 0x7f17500cb530 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f1738009130 tx=0x7f1738004750 comp rx=0 tx=0).stop 2023-11-26T07:16:38.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.377+0000 7f175537a700 1 -- 172.21.15.2:0/3918550036 shutdown_connections 2023-11-26T07:16:38.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.377+0000 7f175537a700 1 --2- 172.21.15.2:0/3918550036 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f173006b740 0x7f173006dc00 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:38.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.377+0000 7f175537a700 1 --2- 172.21.15.2:0/3918550036 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f175015e1e0 0x7f175009df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:38.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.377+0000 7f175537a700 1 --2- 172.21.15.2:0/3918550036 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f175006caf0 0x7f175009f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:38.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.377+0000 7f175537a700 1 --2- 172.21.15.2:0/3918550036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17500cec10 0x7f17500cb530 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:38.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.377+0000 7f175537a700 1 -- 172.21.15.2:0/3918550036 >> 172.21.15.2:0/3918550036 conn(0x7f17500b3870 msgr2=0x7f1750160870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:38.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.377+0000 7f175537a700 1 -- 172.21.15.2:0/3918550036 shutdown_connections 2023-11-26T07:16:38.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:38.377+0000 7f175537a700 1 -- 172.21.15.2:0/3918550036 wait complete. 2023-11-26T07:16:38.384 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-26T07:16:38.392 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2023-11-26T07:16:38.230546+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257628,"kb_used_data":8168,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754717092,"statfs":{"total":773094113280,"available":772830302208,"internally_reserved":0,"allocated":8364032,"data_stored":4206980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.642243"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684459+0000","last_change":"2023-11-26T07:16:32.618840+0000","last_active":"2023-11-26T07:16:34.684459+0000","last_peered":"2023-11-26T07:16:34.684459+0000","last_clean":"2023-11-26T07:16:34.684459+0000","last_became_active":"2023-11-26T07:16:32.618551+0000","last_became_peered":"2023-11-26T07:16:32.618551+0000","last_unstale":"2023-11-26T07:16:34.684459+0000","last_undegraded":"2023-11-26T07:16:34.684459+0000","last_fullsized":"2023-11-26T07:16:34.684459+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:04:23.691314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684424+0000","last_change":"2023-11-26T07:16:32.615672+0000","last_active":"2023-11-26T07:16:34.684424+0000","last_peered":"2023-11-26T07:16:34.684424+0000","last_clean":"2023-11-26T07:16:34.684424+0000","last_became_active":"2023-11-26T07:16:32.614838+0000","last_became_peered":"2023-11-26T07:16:32.614838+0000","last_unstale":"2023-11-26T07:16:34.684424+0000","last_undegraded":"2023-11-26T07:16:34.684424+0000","last_fullsized":"2023-11-26T07:16:34.684424+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:44:25.487995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684036+0000","last_change":"2023-11-26T07:16:32.609479+0000","last_active":"2023-11-26T07:16:34.684036+0000","last_peered":"2023-11-26T07:16:34.684036+0000","last_clean":"2023-11-26T07:16:34.684036+0000","last_became_active":"2023-11-26T07:16:32.609149+0000","last_became_peered":"2023-11-26T07:16:32.609149+0000","last_unstale":"2023-11-26T07:16:34.684036+0000","last_undegraded":"2023-11-26T07:16:34.684036+0000","last_fullsized":"2023-11-26T07:16:34.684036+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:00:08.804498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684264+0000","last_change":"2023-11-26T07:16:32.619624+0000","last_active":"2023-11-26T07:16:34.684264+0000","last_peered":"2023-11-26T07:16:34.684264+0000","last_clean":"2023-11-26T07:16:34.684264+0000","last_became_active":"2023-11-26T07:16:32.619349+0000","last_became_peered":"2023-11-26T07:16:32.619349+0000","last_unstale":"2023-11-26T07:16:34.684264+0000","last_undegraded":"2023-11-26T07:16:34.684264+0000","last_fullsized":"2023-11-26T07:16:34.684264+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:50:54.963674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.685034+0000","last_change":"2023-11-26T07:16:32.616416+0000","last_active":"2023-11-26T07:16:34.685034+0000","last_peered":"2023-11-26T07:16:34.685034+0000","last_clean":"2023-11-26T07:16:34.685034+0000","last_became_active":"2023-11-26T07:16:32.616077+0000","last_became_peered":"2023-11-26T07:16:32.616077+0000","last_unstale":"2023-11-26T07:16:34.685034+0000","last_undegraded":"2023-11-26T07:16:34.685034+0000","last_fullsized":"2023-11-26T07:16:34.685034+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:53:00.254090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684068+0000","last_change":"2023-11-26T07:16:32.614368+0000","last_active":"2023-11-26T07:16:34.684068+0000","last_peered":"2023-11-26T07:16:34.684068+0000","last_clean":"2023-11-26T07:16:34.684068+0000","last_became_active":"2023-11-26T07:16:32.614042+0000","last_became_peered":"2023-11-26T07:16:32.614042+0000","last_unstale":"2023-11-26T07:16:34.684068+0000","last_undegraded":"2023-11-26T07:16:34.684068+0000","last_fullsized":"2023-11-26T07:16:34.684068+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:09:54.083950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:33.602893+0000","last_change":"2023-11-26T07:16:32.618039+0000","last_active":"2023-11-26T07:16:33.602893+0000","last_peered":"2023-11-26T07:16:33.602893+0000","last_clean":"2023-11-26T07:16:33.602893+0000","last_became_active":"2023-11-26T07:16:32.617771+0000","last_became_peered":"2023-11-26T07:16:32.617771+0000","last_unstale":"2023-11-26T07:16:33.602893+0000","last_undegraded":"2023-11-26T07:16:33.602893+0000","last_fullsized":"2023-11-26T07:16:33.602893+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:28:34.870976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.683570+0000","last_change":"2023-11-26T07:16:32.617923+0000","last_active":"2023-11-26T07:16:34.683570+0000","last_peered":"2023-11-26T07:16:34.683570+0000","last_clean":"2023-11-26T07:16:34.683570+0000","last_became_active":"2023-11-26T07:16:32.617588+0000","last_became_peered":"2023-11-26T07:16:32.617588+0000","last_unstale":"2023-11-26T07:16:34.683570+0000","last_undegraded":"2023-11-26T07:16:34.683570+0000","last_fullsized":"2023-11-26T07:16:34.683570+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:50:59.862905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.685457+0000","last_change":"2023-11-26T07:16:32.617657+0000","last_active":"2023-11-26T07:16:34.685457+0000","last_peered":"2023-11-26T07:16:34.685457+0000","last_clean":"2023-11-26T07:16:34.685457+0000","last_became_active":"2023-11-26T07:16:32.617390+0000","last_became_peered":"2023-11-26T07:16:32.617390+0000","last_unstale":"2023-11-26T07:16:34.685457+0000","last_undegraded":"2023-11-26T07:16:34.685457+0000","last_fullsized":"2023-11-26T07:16:34.685457+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:57:10.951062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:33.602782+0000","last_change":"2023-11-26T07:16:32.613923+0000","last_active":"2023-11-26T07:16:33.602782+0000","last_peered":"2023-11-26T07:16:33.602782+0000","last_clean":"2023-11-26T07:16:33.602782+0000","last_became_active":"2023-11-26T07:16:32.613202+0000","last_became_peered":"2023-11-26T07:16:32.613202+0000","last_unstale":"2023-11-26T07:16:33.602782+0000","last_undegraded":"2023-11-26T07:16:33.602782+0000","last_fullsized":"2023-11-26T07:16:33.602782+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:44:25.487995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684035+0000","last_change":"2023-11-26T07:16:32.613713+0000","last_active":"2023-11-26T07:16:34.684035+0000","last_peered":"2023-11-26T07:16:34.684035+0000","last_clean":"2023-11-26T07:16:34.684035+0000","last_became_active":"2023-11-26T07:16:32.613428+0000","last_became_peered":"2023-11-26T07:16:32.613428+0000","last_unstale":"2023-11-26T07:16:34.684035+0000","last_undegraded":"2023-11-26T07:16:34.684035+0000","last_fullsized":"2023-11-26T07:16:34.684035+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:29:55.413054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684414+0000","last_change":"2023-11-26T07:16:32.611550+0000","last_active":"2023-11-26T07:16:34.684414+0000","last_peered":"2023-11-26T07:16:34.684414+0000","last_clean":"2023-11-26T07:16:34.684414+0000","last_became_active":"2023-11-26T07:16:32.611059+0000","last_became_peered":"2023-11-26T07:16:32.611059+0000","last_unstale":"2023-11-26T07:16:34.684414+0000","last_undegraded":"2023-11-26T07:16:34.684414+0000","last_fullsized":"2023-11-26T07:16:34.684414+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:10:32.920608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684710+0000","last_change":"2023-11-26T07:16:32.611303+0000","last_active":"2023-11-26T07:16:34.684710+0000","last_peered":"2023-11-26T07:16:34.684710+0000","last_clean":"2023-11-26T07:16:34.684710+0000","last_became_active":"2023-11-26T07:16:32.610959+0000","last_became_peered":"2023-11-26T07:16:32.610959+0000","last_unstale":"2023-11-26T07:16:34.684710+0000","last_undegraded":"2023-11-26T07:16:34.684710+0000","last_fullsized":"2023-11-26T07:16:34.684710+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:56:01.891239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.685072+0000","last_change":"2023-11-26T07:16:32.620986+0000","last_active":"2023-11-26T07:16:34.685072+0000","last_peered":"2023-11-26T07:16:34.685072+0000","last_clean":"2023-11-26T07:16:34.685072+0000","last_became_active":"2023-11-26T07:16:32.620672+0000","last_became_peered":"2023-11-26T07:16:32.620672+0000","last_unstale":"2023-11-26T07:16:34.685072+0000","last_undegraded":"2023-11-26T07:16:34.685072+0000","last_fullsized":"2023-11-26T07:16:34.685072+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:34:17.755737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684438+0000","last_change":"2023-11-26T07:16:32.618382+0000","last_active":"2023-11-26T07:16:34.684438+0000","last_peered":"2023-11-26T07:16:34.684438+0000","last_clean":"2023-11-26T07:16:34.684438+0000","last_became_active":"2023-11-26T07:16:32.618104+0000","last_became_peered":"2023-11-26T07:16:32.618104+0000","last_unstale":"2023-11-26T07:16:34.684438+0000","last_undegraded":"2023-11-26T07:16:34.684438+0000","last_fullsized":"2023-11-26T07:16:34.684438+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:57:46.113545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:33.602703+0000","last_change":"2023-11-26T07:16:32.622360+0000","last_active":"2023-11-26T07:16:33.602703+0000","last_peered":"2023-11-26T07:16:33.602703+0000","last_clean":"2023-11-26T07:16:33.602703+0000","last_became_active":"2023-11-26T07:16:32.622061+0000","last_became_peered":"2023-11-26T07:16:32.622061+0000","last_unstale":"2023-11-26T07:16:33.602703+0000","last_undegraded":"2023-11-26T07:16:33.602703+0000","last_fullsized":"2023-11-26T07:16:33.602703+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:19:33.039679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.685597+0000","last_change":"2023-11-26T07:16:32.616582+0000","last_active":"2023-11-26T07:16:34.685597+0000","last_peered":"2023-11-26T07:16:34.685597+0000","last_clean":"2023-11-26T07:16:34.685597+0000","last_became_active":"2023-11-26T07:16:32.616193+0000","last_became_peered":"2023-11-26T07:16:32.616193+0000","last_unstale":"2023-11-26T07:16:34.685597+0000","last_undegraded":"2023-11-26T07:16:34.685597+0000","last_fullsized":"2023-11-26T07:16:34.685597+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:47:31.154113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684364+0000","last_change":"2023-11-26T07:16:32.618976+0000","last_active":"2023-11-26T07:16:34.684364+0000","last_peered":"2023-11-26T07:16:34.684364+0000","last_clean":"2023-11-26T07:16:34.684364+0000","last_became_active":"2023-11-26T07:16:32.618280+0000","last_became_peered":"2023-11-26T07:16:32.618280+0000","last_unstale":"2023-11-26T07:16:34.684364+0000","last_undegraded":"2023-11-26T07:16:34.684364+0000","last_fullsized":"2023-11-26T07:16:34.684364+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:38:26.302320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684140+0000","last_change":"2023-11-26T07:16:32.616866+0000","last_active":"2023-11-26T07:16:34.684140+0000","last_peered":"2023-11-26T07:16:34.684140+0000","last_clean":"2023-11-26T07:16:34.684140+0000","last_became_active":"2023-11-26T07:16:32.614722+0000","last_became_peered":"2023-11-26T07:16:32.614722+0000","last_unstale":"2023-11-26T07:16:34.684140+0000","last_undegraded":"2023-11-26T07:16:34.684140+0000","last_fullsized":"2023-11-26T07:16:34.684140+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:14:25.229178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684612+0000","last_change":"2023-11-26T07:16:32.615877+0000","last_active":"2023-11-26T07:16:34.684612+0000","last_peered":"2023-11-26T07:16:34.684612+0000","last_clean":"2023-11-26T07:16:34.684612+0000","last_became_active":"2023-11-26T07:16:32.615574+0000","last_became_peered":"2023-11-26T07:16:32.615574+0000","last_unstale":"2023-11-26T07:16:34.684612+0000","last_undegraded":"2023-11-26T07:16:34.684612+0000","last_fullsized":"2023-11-26T07:16:34.684612+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:34:37.499588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:33.603053+0000","last_change":"2023-11-26T07:16:32.613513+0000","last_active":"2023-11-26T07:16:33.603053+0000","last_peered":"2023-11-26T07:16:33.603053+0000","last_clean":"2023-11-26T07:16:33.603053+0000","last_became_active":"2023-11-26T07:16:32.612504+0000","last_became_peered":"2023-11-26T07:16:32.612504+0000","last_unstale":"2023-11-26T07:16:33.603053+0000","last_undegraded":"2023-11-26T07:16:33.603053+0000","last_fullsized":"2023-11-26T07:16:33.603053+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:40:50.212252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:33.602743+0000","last_change":"2023-11-26T07:16:32.617086+0000","last_active":"2023-11-26T07:16:33.602743+0000","last_peered":"2023-11-26T07:16:33.602743+0000","last_clean":"2023-11-26T07:16:33.602743+0000","last_became_active":"2023-11-26T07:16:32.616743+0000","last_became_peered":"2023-11-26T07:16:32.616743+0000","last_unstale":"2023-11-26T07:16:33.602743+0000","last_undegraded":"2023-11-26T07:16:33.602743+0000","last_fullsized":"2023-11-26T07:16:33.602743+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:14:25.229178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.683443+0000","last_change":"2023-11-26T07:16:32.615803+0000","last_active":"2023-11-26T07:16:34.683443+0000","last_peered":"2023-11-26T07:16:34.683443+0000","last_clean":"2023-11-26T07:16:34.683443+0000","last_became_active":"2023-11-26T07:16:32.615511+0000","last_became_peered":"2023-11-26T07:16:32.615511+0000","last_unstale":"2023-11-26T07:16:34.683443+0000","last_undegraded":"2023-11-26T07:16:34.683443+0000","last_fullsized":"2023-11-26T07:16:34.683443+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:34:37.499588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.683204+0000","last_change":"2023-11-26T07:16:32.615006+0000","last_active":"2023-11-26T07:16:34.683204+0000","last_peered":"2023-11-26T07:16:34.683204+0000","last_clean":"2023-11-26T07:16:34.683204+0000","last_became_active":"2023-11-26T07:16:32.614731+0000","last_became_peered":"2023-11-26T07:16:32.614731+0000","last_unstale":"2023-11-26T07:16:34.683204+0000","last_undegraded":"2023-11-26T07:16:34.683204+0000","last_fullsized":"2023-11-26T07:16:34.683204+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:57:46.113545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:33.602887+0000","last_change":"2023-11-26T07:16:32.613001+0000","last_active":"2023-11-26T07:16:33.602887+0000","last_peered":"2023-11-26T07:16:33.602887+0000","last_clean":"2023-11-26T07:16:33.602887+0000","last_became_active":"2023-11-26T07:16:32.612112+0000","last_became_peered":"2023-11-26T07:16:32.612112+0000","last_unstale":"2023-11-26T07:16:33.602887+0000","last_undegraded":"2023-11-26T07:16:33.602887+0000","last_fullsized":"2023-11-26T07:16:33.602887+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:18:55.494557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:33.603585+0000","last_change":"2023-11-26T07:16:32.619615+0000","last_active":"2023-11-26T07:16:33.603585+0000","last_peered":"2023-11-26T07:16:33.603585+0000","last_clean":"2023-11-26T07:16:33.603585+0000","last_became_active":"2023-11-26T07:16:32.619330+0000","last_became_peered":"2023-11-26T07:16:32.619330+0000","last_unstale":"2023-11-26T07:16:33.603585+0000","last_undegraded":"2023-11-26T07:16:33.603585+0000","last_fullsized":"2023-11-26T07:16:33.603585+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:20:12.245158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684165+0000","last_change":"2023-11-26T07:16:32.615271+0000","last_active":"2023-11-26T07:16:34.684165+0000","last_peered":"2023-11-26T07:16:34.684165+0000","last_clean":"2023-11-26T07:16:34.684165+0000","last_became_active":"2023-11-26T07:16:32.614922+0000","last_became_peered":"2023-11-26T07:16:32.614922+0000","last_unstale":"2023-11-26T07:16:34.684165+0000","last_undegraded":"2023-11-26T07:16:34.684165+0000","last_fullsized":"2023-11-26T07:16:34.684165+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:58:34.678599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:33.603035+0000","last_change":"2023-11-26T07:16:32.613939+0000","last_active":"2023-11-26T07:16:33.603035+0000","last_peered":"2023-11-26T07:16:33.603035+0000","last_clean":"2023-11-26T07:16:33.603035+0000","last_became_active":"2023-11-26T07:16:32.613081+0000","last_became_peered":"2023-11-26T07:16:32.613081+0000","last_unstale":"2023-11-26T07:16:33.603035+0000","last_undegraded":"2023-11-26T07:16:33.603035+0000","last_fullsized":"2023-11-26T07:16:33.603035+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:18:48.867045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.683769+0000","last_change":"2023-11-26T07:16:32.618257+0000","last_active":"2023-11-26T07:16:34.683769+0000","last_peered":"2023-11-26T07:16:34.683769+0000","last_clean":"2023-11-26T07:16:34.683769+0000","last_became_active":"2023-11-26T07:16:32.617930+0000","last_became_peered":"2023-11-26T07:16:32.617930+0000","last_unstale":"2023-11-26T07:16:34.683769+0000","last_undegraded":"2023-11-26T07:16:34.683769+0000","last_fullsized":"2023-11-26T07:16:34.683769+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:22:46.782114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:33.602506+0000","last_change":"2023-11-26T07:16:32.619839+0000","last_active":"2023-11-26T07:16:33.602506+0000","last_peered":"2023-11-26T07:16:33.602506+0000","last_clean":"2023-11-26T07:16:33.602506+0000","last_became_active":"2023-11-26T07:16:32.619492+0000","last_became_peered":"2023-11-26T07:16:32.619492+0000","last_unstale":"2023-11-26T07:16:33.602506+0000","last_undegraded":"2023-11-26T07:16:33.602506+0000","last_fullsized":"2023-11-26T07:16:33.602506+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:38:36.670909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:33.603028+0000","last_change":"2023-11-26T07:16:32.620483+0000","last_active":"2023-11-26T07:16:33.603028+0000","last_peered":"2023-11-26T07:16:33.603028+0000","last_clean":"2023-11-26T07:16:33.603028+0000","last_became_active":"2023-11-26T07:16:32.620253+0000","last_became_peered":"2023-11-26T07:16:32.620253+0000","last_unstale":"2023-11-26T07:16:33.603028+0000","last_undegraded":"2023-11-26T07:16:33.603028+0000","last_fullsized":"2023-11-26T07:16:33.603028+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:11:19.983822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.683471+0000","last_change":"2023-11-26T07:16:32.613465+0000","last_active":"2023-11-26T07:16:34.683471+0000","last_peered":"2023-11-26T07:16:34.683471+0000","last_clean":"2023-11-26T07:16:34.683471+0000","last_became_active":"2023-11-26T07:16:32.613040+0000","last_became_peered":"2023-11-26T07:16:32.613040+0000","last_unstale":"2023-11-26T07:16:34.683471+0000","last_undegraded":"2023-11-26T07:16:34.683471+0000","last_fullsized":"2023-11-26T07:16:34.683471+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:45:46.931807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684727+0000","last_change":"2023-11-26T07:16:32.619825+0000","last_active":"2023-11-26T07:16:34.684727+0000","last_peered":"2023-11-26T07:16:34.684727+0000","last_clean":"2023-11-26T07:16:34.684727+0000","last_became_active":"2023-11-26T07:16:32.619568+0000","last_became_peered":"2023-11-26T07:16:32.619568+0000","last_unstale":"2023-11-26T07:16:34.684727+0000","last_undegraded":"2023-11-26T07:16:34.684727+0000","last_fullsized":"2023-11-26T07:16:34.684727+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:29:09.496861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"72'4","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.632843+0000","last_change":"2023-11-26T07:16:31.609063+0000","last_active":"2023-11-26T07:16:32.632843+0000","last_peered":"2023-11-26T07:16:32.632843+0000","last_clean":"2023-11-26T07:16:32.632843+0000","last_became_active":"2023-11-26T07:16:31.608791+0000","last_became_peered":"2023-11-26T07:16:31.608791+0000","last_unstale":"2023-11-26T07:16:32.632843+0000","last_undegraded":"2023-11-26T07:16:32.632843+0000","last_fullsized":"2023-11-26T07:16:32.632843+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:17:32.465955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.685729+0000","last_change":"2023-11-26T07:16:32.616574+0000","last_active":"2023-11-26T07:16:34.685729+0000","last_peered":"2023-11-26T07:16:34.685729+0000","last_clean":"2023-11-26T07:16:34.685729+0000","last_became_active":"2023-11-26T07:16:32.616323+0000","last_became_peered":"2023-11-26T07:16:32.616323+0000","last_unstale":"2023-11-26T07:16:34.685729+0000","last_undegraded":"2023-11-26T07:16:34.685729+0000","last_fullsized":"2023-11-26T07:16:34.685729+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:38:13.979994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"72'1","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.628853+0000","last_change":"2023-11-26T07:16:31.604650+0000","last_active":"2023-11-26T07:16:32.628853+0000","last_peered":"2023-11-26T07:16:32.628853+0000","last_clean":"2023-11-26T07:16:32.628853+0000","last_became_active":"2023-11-26T07:16:31.603826+0000","last_became_peered":"2023-11-26T07:16:31.603826+0000","last_unstale":"2023-11-26T07:16:32.628853+0000","last_undegraded":"2023-11-26T07:16:32.628853+0000","last_fullsized":"2023-11-26T07:16:32.628853+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:16:17.708450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684060+0000","last_change":"2023-11-26T07:16:32.610518+0000","last_active":"2023-11-26T07:16:34.684060+0000","last_peered":"2023-11-26T07:16:34.684060+0000","last_clean":"2023-11-26T07:16:34.684060+0000","last_became_active":"2023-11-26T07:16:32.610152+0000","last_became_peered":"2023-11-26T07:16:32.610152+0000","last_unstale":"2023-11-26T07:16:34.684060+0000","last_undegraded":"2023-11-26T07:16:34.684060+0000","last_fullsized":"2023-11-26T07:16:34.684060+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:41:17.390172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"72'2","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.630580+0000","last_change":"2023-11-26T07:16:31.606982+0000","last_active":"2023-11-26T07:16:32.630580+0000","last_peered":"2023-11-26T07:16:32.630580+0000","last_clean":"2023-11-26T07:16:32.630580+0000","last_became_active":"2023-11-26T07:16:31.606668+0000","last_became_peered":"2023-11-26T07:16:31.606668+0000","last_unstale":"2023-11-26T07:16:32.630580+0000","last_undegraded":"2023-11-26T07:16:32.630580+0000","last_fullsized":"2023-11-26T07:16:32.630580+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:00:32.449928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684185+0000","last_change":"2023-11-26T07:16:32.613348+0000","last_active":"2023-11-26T07:16:34.684185+0000","last_peered":"2023-11-26T07:16:34.684185+0000","last_clean":"2023-11-26T07:16:34.684185+0000","last_became_active":"2023-11-26T07:16:32.612758+0000","last_became_peered":"2023-11-26T07:16:32.612758+0000","last_unstale":"2023-11-26T07:16:34.684185+0000","last_undegraded":"2023-11-26T07:16:34.684185+0000","last_fullsized":"2023-11-26T07:16:34.684185+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:32:20.894157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"72'2","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.629649+0000","last_change":"2023-11-26T07:16:31.606756+0000","last_active":"2023-11-26T07:16:32.629649+0000","last_peered":"2023-11-26T07:16:32.629649+0000","last_clean":"2023-11-26T07:16:32.629649+0000","last_became_active":"2023-11-26T07:16:31.606493+0000","last_became_peered":"2023-11-26T07:16:31.606493+0000","last_unstale":"2023-11-26T07:16:32.629649+0000","last_undegraded":"2023-11-26T07:16:32.629649+0000","last_fullsized":"2023-11-26T07:16:32.629649+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:57:57.978717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:33.602539+0000","last_change":"2023-11-26T07:16:32.619508+0000","last_active":"2023-11-26T07:16:33.602539+0000","last_peered":"2023-11-26T07:16:33.602539+0000","last_clean":"2023-11-26T07:16:33.602539+0000","last_became_active":"2023-11-26T07:16:32.619183+0000","last_became_peered":"2023-11-26T07:16:32.619183+0000","last_unstale":"2023-11-26T07:16:33.602539+0000","last_undegraded":"2023-11-26T07:16:33.602539+0000","last_fullsized":"2023-11-26T07:16:33.602539+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:53:53.607029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"72'1","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.628123+0000","last_change":"2023-11-26T07:16:31.598926+0000","last_active":"2023-11-26T07:16:32.628123+0000","last_peered":"2023-11-26T07:16:32.628123+0000","last_clean":"2023-11-26T07:16:32.628123+0000","last_became_active":"2023-11-26T07:16:31.598622+0000","last_became_peered":"2023-11-26T07:16:31.598622+0000","last_unstale":"2023-11-26T07:16:32.628123+0000","last_undegraded":"2023-11-26T07:16:32.628123+0000","last_fullsized":"2023-11-26T07:16:32.628123+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:27:02.135913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:33.603118+0000","last_change":"2023-11-26T07:16:32.617082+0000","last_active":"2023-11-26T07:16:33.603118+0000","last_peered":"2023-11-26T07:16:33.603118+0000","last_clean":"2023-11-26T07:16:33.603118+0000","last_became_active":"2023-11-26T07:16:32.616776+0000","last_became_peered":"2023-11-26T07:16:32.616776+0000","last_unstale":"2023-11-26T07:16:33.603118+0000","last_undegraded":"2023-11-26T07:16:33.603118+0000","last_fullsized":"2023-11-26T07:16:33.603118+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:47:38.663037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"72'1","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.629496+0000","last_change":"2023-11-26T07:16:31.608252+0000","last_active":"2023-11-26T07:16:32.629496+0000","last_peered":"2023-11-26T07:16:32.629496+0000","last_clean":"2023-11-26T07:16:32.629496+0000","last_became_active":"2023-11-26T07:16:31.607942+0000","last_became_peered":"2023-11-26T07:16:31.607942+0000","last_unstale":"2023-11-26T07:16:32.629496+0000","last_undegraded":"2023-11-26T07:16:32.629496+0000","last_fullsized":"2023-11-26T07:16:32.629496+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:08:07.953306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684255+0000","last_change":"2023-11-26T07:16:32.615693+0000","last_active":"2023-11-26T07:16:34.684255+0000","last_peered":"2023-11-26T07:16:34.684255+0000","last_clean":"2023-11-26T07:16:34.684255+0000","last_became_active":"2023-11-26T07:16:32.615387+0000","last_became_peered":"2023-11-26T07:16:32.615387+0000","last_unstale":"2023-11-26T07:16:34.684255+0000","last_undegraded":"2023-11-26T07:16:34.684255+0000","last_fullsized":"2023-11-26T07:16:34.684255+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:22:15.436742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.599229+0000","last_change":"2023-11-26T07:16:31.597056+0000","last_active":"2023-11-26T07:16:32.599229+0000","last_peered":"2023-11-26T07:16:32.599229+0000","last_clean":"2023-11-26T07:16:32.599229+0000","last_became_active":"2023-11-26T07:16:31.596785+0000","last_became_peered":"2023-11-26T07:16:31.596785+0000","last_unstale":"2023-11-26T07:16:32.599229+0000","last_undegraded":"2023-11-26T07:16:32.599229+0000","last_fullsized":"2023-11-26T07:16:32.599229+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:31:17.102746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684504+0000","last_change":"2023-11-26T07:16:32.612269+0000","last_active":"2023-11-26T07:16:34.684504+0000","last_peered":"2023-11-26T07:16:34.684504+0000","last_clean":"2023-11-26T07:16:34.684504+0000","last_became_active":"2023-11-26T07:16:32.611995+0000","last_became_peered":"2023-11-26T07:16:32.611995+0000","last_unstale":"2023-11-26T07:16:34.684504+0000","last_undegraded":"2023-11-26T07:16:34.684504+0000","last_fullsized":"2023-11-26T07:16:34.684504+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:17:09.530143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.604759+0000","last_change":"2023-11-26T07:16:31.608983+0000","last_active":"2023-11-26T07:16:32.604759+0000","last_peered":"2023-11-26T07:16:32.604759+0000","last_clean":"2023-11-26T07:16:32.604759+0000","last_became_active":"2023-11-26T07:16:31.608647+0000","last_became_peered":"2023-11-26T07:16:31.608647+0000","last_unstale":"2023-11-26T07:16:32.604759+0000","last_undegraded":"2023-11-26T07:16:32.604759+0000","last_fullsized":"2023-11-26T07:16:32.604759+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:58:15.884166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:33.603607+0000","last_change":"2023-11-26T07:16:32.618385+0000","last_active":"2023-11-26T07:16:33.603607+0000","last_peered":"2023-11-26T07:16:33.603607+0000","last_clean":"2023-11-26T07:16:33.603607+0000","last_became_active":"2023-11-26T07:16:32.617766+0000","last_became_peered":"2023-11-26T07:16:32.617766+0000","last_unstale":"2023-11-26T07:16:33.603607+0000","last_undegraded":"2023-11-26T07:16:33.603607+0000","last_fullsized":"2023-11-26T07:16:33.603607+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:16:18.713951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.613259+0000","last_change":"2023-11-26T07:16:31.597710+0000","last_active":"2023-11-26T07:16:32.613259+0000","last_peered":"2023-11-26T07:16:32.613259+0000","last_clean":"2023-11-26T07:16:32.613259+0000","last_became_active":"2023-11-26T07:16:31.597421+0000","last_became_peered":"2023-11-26T07:16:31.597421+0000","last_unstale":"2023-11-26T07:16:32.613259+0000","last_undegraded":"2023-11-26T07:16:32.613259+0000","last_fullsized":"2023-11-26T07:16:32.613259+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:09:53.078448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684501+0000","last_change":"2023-11-26T07:16:32.613841+0000","last_active":"2023-11-26T07:16:34.684501+0000","last_peered":"2023-11-26T07:16:34.684501+0000","last_clean":"2023-11-26T07:16:34.684501+0000","last_became_active":"2023-11-26T07:16:32.611722+0000","last_became_peered":"2023-11-26T07:16:32.611722+0000","last_unstale":"2023-11-26T07:16:34.684501+0000","last_undegraded":"2023-11-26T07:16:34.684501+0000","last_fullsized":"2023-11-26T07:16:34.684501+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:20:33.530404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.602407+0000","last_change":"2023-11-26T07:16:31.607372+0000","last_active":"2023-11-26T07:16:32.602407+0000","last_peered":"2023-11-26T07:16:32.602407+0000","last_clean":"2023-11-26T07:16:32.602407+0000","last_became_active":"2023-11-26T07:16:31.607094+0000","last_became_peered":"2023-11-26T07:16:31.607094+0000","last_unstale":"2023-11-26T07:16:32.602407+0000","last_undegraded":"2023-11-26T07:16:32.602407+0000","last_fullsized":"2023-11-26T07:16:32.602407+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:33:34.607255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684115+0000","last_change":"2023-11-26T07:16:32.617526+0000","last_active":"2023-11-26T07:16:34.684115+0000","last_peered":"2023-11-26T07:16:34.684115+0000","last_clean":"2023-11-26T07:16:34.684115+0000","last_became_active":"2023-11-26T07:16:32.617221+0000","last_became_peered":"2023-11-26T07:16:32.617221+0000","last_unstale":"2023-11-26T07:16:34.684115+0000","last_undegraded":"2023-11-26T07:16:34.684115+0000","last_fullsized":"2023-11-26T07:16:34.684115+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:19:33.039679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"72'3","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.630749+0000","last_change":"2023-11-26T07:16:31.598168+0000","last_active":"2023-11-26T07:16:32.630749+0000","last_peered":"2023-11-26T07:16:32.630749+0000","last_clean":"2023-11-26T07:16:32.630749+0000","last_became_active":"2023-11-26T07:16:31.597799+0000","last_became_peered":"2023-11-26T07:16:31.597799+0000","last_unstale":"2023-11-26T07:16:32.630749+0000","last_undegraded":"2023-11-26T07:16:32.630749+0000","last_fullsized":"2023-11-26T07:16:32.630749+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:04:07.878362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.685178+0000","last_change":"2023-11-26T07:16:32.610873+0000","last_active":"2023-11-26T07:16:34.685178+0000","last_peered":"2023-11-26T07:16:34.685178+0000","last_clean":"2023-11-26T07:16:34.685178+0000","last_became_active":"2023-11-26T07:16:32.610543+0000","last_became_peered":"2023-11-26T07:16:32.610543+0000","last_unstale":"2023-11-26T07:16:34.685178+0000","last_undegraded":"2023-11-26T07:16:34.685178+0000","last_fullsized":"2023-11-26T07:16:34.685178+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:33:19.962746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"72'6","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.630814+0000","last_change":"2023-11-26T07:16:31.605820+0000","last_active":"2023-11-26T07:16:32.630814+0000","last_peered":"2023-11-26T07:16:32.630814+0000","last_clean":"2023-11-26T07:16:32.630814+0000","last_became_active":"2023-11-26T07:16:31.604337+0000","last_became_peered":"2023-11-26T07:16:31.604337+0000","last_unstale":"2023-11-26T07:16:32.630814+0000","last_undegraded":"2023-11-26T07:16:32.630814+0000","last_fullsized":"2023-11-26T07:16:32.630814+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:51:01.983190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.683385+0000","last_change":"2023-11-26T07:16:32.617621+0000","last_active":"2023-11-26T07:16:34.683385+0000","last_peered":"2023-11-26T07:16:34.683385+0000","last_clean":"2023-11-26T07:16:34.683385+0000","last_became_active":"2023-11-26T07:16:32.617351+0000","last_became_peered":"2023-11-26T07:16:32.617351+0000","last_unstale":"2023-11-26T07:16:34.683385+0000","last_undegraded":"2023-11-26T07:16:34.683385+0000","last_fullsized":"2023-11-26T07:16:34.683385+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:17:09.530143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"72'2","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.633174+0000","last_change":"2023-11-26T07:16:31.607105+0000","last_active":"2023-11-26T07:16:32.633174+0000","last_peered":"2023-11-26T07:16:32.633174+0000","last_clean":"2023-11-26T07:16:32.633174+0000","last_became_active":"2023-11-26T07:16:31.606832+0000","last_became_peered":"2023-11-26T07:16:31.606832+0000","last_unstale":"2023-11-26T07:16:32.633174+0000","last_undegraded":"2023-11-26T07:16:32.633174+0000","last_fullsized":"2023-11-26T07:16:32.633174+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:06:59.820803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:33.603558+0000","last_change":"2023-11-26T07:16:32.615375+0000","last_active":"2023-11-26T07:16:33.603558+0000","last_peered":"2023-11-26T07:16:33.603558+0000","last_clean":"2023-11-26T07:16:33.603558+0000","last_became_active":"2023-11-26T07:16:32.614958+0000","last_became_peered":"2023-11-26T07:16:32.614958+0000","last_unstale":"2023-11-26T07:16:33.603558+0000","last_undegraded":"2023-11-26T07:16:33.603558+0000","last_fullsized":"2023-11-26T07:16:33.603558+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:37:37.450735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.602059+0000","last_change":"2023-11-26T07:16:31.607550+0000","last_active":"2023-11-26T07:16:32.602059+0000","last_peered":"2023-11-26T07:16:32.602059+0000","last_clean":"2023-11-26T07:16:32.602059+0000","last_became_active":"2023-11-26T07:16:31.607266+0000","last_became_peered":"2023-11-26T07:16:31.607266+0000","last_unstale":"2023-11-26T07:16:32.602059+0000","last_undegraded":"2023-11-26T07:16:32.602059+0000","last_fullsized":"2023-11-26T07:16:32.602059+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:21:29.309253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.683219+0000","last_change":"2023-11-26T07:16:32.614041+0000","last_active":"2023-11-26T07:16:34.683219+0000","last_peered":"2023-11-26T07:16:34.683219+0000","last_clean":"2023-11-26T07:16:34.683219+0000","last_became_active":"2023-11-26T07:16:32.613666+0000","last_became_peered":"2023-11-26T07:16:32.613666+0000","last_unstale":"2023-11-26T07:16:34.683219+0000","last_undegraded":"2023-11-26T07:16:34.683219+0000","last_fullsized":"2023-11-26T07:16:34.683219+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:17:33.471457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.610711+0000","last_change":"2023-11-26T07:16:31.598844+0000","last_active":"2023-11-26T07:16:32.610711+0000","last_peered":"2023-11-26T07:16:32.610711+0000","last_clean":"2023-11-26T07:16:32.610711+0000","last_became_active":"2023-11-26T07:16:31.598510+0000","last_became_peered":"2023-11-26T07:16:31.598510+0000","last_unstale":"2023-11-26T07:16:32.610711+0000","last_undegraded":"2023-11-26T07:16:32.610711+0000","last_fullsized":"2023-11-26T07:16:32.610711+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:18:47.861543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.683601+0000","last_change":"2023-11-26T07:16:32.611301+0000","last_active":"2023-11-26T07:16:34.683601+0000","last_peered":"2023-11-26T07:16:34.683601+0000","last_clean":"2023-11-26T07:16:34.683601+0000","last_became_active":"2023-11-26T07:16:32.610472+0000","last_became_peered":"2023-11-26T07:16:32.610472+0000","last_unstale":"2023-11-26T07:16:34.683601+0000","last_undegraded":"2023-11-26T07:16:34.683601+0000","last_fullsized":"2023-11-26T07:16:34.683601+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:43:40.695058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"72'8","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.635419+0000","last_change":"2023-11-26T07:16:31.609252+0000","last_active":"2023-11-26T07:16:32.635419+0000","last_peered":"2023-11-26T07:16:32.635419+0000","last_clean":"2023-11-26T07:16:32.635419+0000","last_became_active":"2023-11-26T07:16:31.608944+0000","last_became_peered":"2023-11-26T07:16:31.608944+0000","last_unstale":"2023-11-26T07:16:32.635419+0000","last_undegraded":"2023-11-26T07:16:32.635419+0000","last_fullsized":"2023-11-26T07:16:32.635419+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:50:58.857404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:33.602978+0000","last_change":"2023-11-26T07:16:32.614041+0000","last_active":"2023-11-26T07:16:33.602978+0000","last_peered":"2023-11-26T07:16:33.602978+0000","last_clean":"2023-11-26T07:16:33.602978+0000","last_became_active":"2023-11-26T07:16:32.612690+0000","last_became_peered":"2023-11-26T07:16:32.612690+0000","last_unstale":"2023-11-26T07:16:33.602978+0000","last_undegraded":"2023-11-26T07:16:33.602978+0000","last_fullsized":"2023-11-26T07:16:33.602978+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:53:37.327075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"72'1","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.629788+0000","last_change":"2023-11-26T07:16:31.608619+0000","last_active":"2023-11-26T07:16:32.629788+0000","last_peered":"2023-11-26T07:16:32.629788+0000","last_clean":"2023-11-26T07:16:32.629788+0000","last_became_active":"2023-11-26T07:16:31.608154+0000","last_became_peered":"2023-11-26T07:16:31.608154+0000","last_unstale":"2023-11-26T07:16:32.629788+0000","last_undegraded":"2023-11-26T07:16:32.629788+0000","last_fullsized":"2023-11-26T07:16:32.629788+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:45:09.704394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684609+0000","last_change":"2023-11-26T07:16:32.612346+0000","last_active":"2023-11-26T07:16:34.684609+0000","last_peered":"2023-11-26T07:16:34.684609+0000","last_clean":"2023-11-26T07:16:34.684609+0000","last_became_active":"2023-11-26T07:16:32.612085+0000","last_became_peered":"2023-11-26T07:16:32.612085+0000","last_unstale":"2023-11-26T07:16:34.684609+0000","last_undegraded":"2023-11-26T07:16:34.684609+0000","last_fullsized":"2023-11-26T07:16:34.684609+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:09:19.109225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"72'2","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.630473+0000","last_change":"2023-11-26T07:16:31.608166+0000","last_active":"2023-11-26T07:16:32.630473+0000","last_peered":"2023-11-26T07:16:32.630473+0000","last_clean":"2023-11-26T07:16:32.630473+0000","last_became_active":"2023-11-26T07:16:31.607443+0000","last_became_peered":"2023-11-26T07:16:31.607443+0000","last_unstale":"2023-11-26T07:16:32.630473+0000","last_undegraded":"2023-11-26T07:16:32.630473+0000","last_fullsized":"2023-11-26T07:16:32.630473+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:41:16.384671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684550+0000","last_change":"2023-11-26T07:16:32.611054+0000","last_active":"2023-11-26T07:16:34.684550+0000","last_peered":"2023-11-26T07:16:34.684550+0000","last_clean":"2023-11-26T07:16:34.684550+0000","last_became_active":"2023-11-26T07:16:32.610739+0000","last_became_peered":"2023-11-26T07:16:32.610739+0000","last_unstale":"2023-11-26T07:16:34.684550+0000","last_undegraded":"2023-11-26T07:16:34.684550+0000","last_fullsized":"2023-11-26T07:16:34.684550+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:59:41.247469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"72'1","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.630575+0000","last_change":"2023-11-26T07:16:31.602892+0000","last_active":"2023-11-26T07:16:32.630575+0000","last_peered":"2023-11-26T07:16:32.630575+0000","last_clean":"2023-11-26T07:16:32.630575+0000","last_became_active":"2023-11-26T07:16:31.602626+0000","last_became_peered":"2023-11-26T07:16:31.602626+0000","last_unstale":"2023-11-26T07:16:32.630575+0000","last_undegraded":"2023-11-26T07:16:32.630575+0000","last_fullsized":"2023-11-26T07:16:32.630575+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:29:16.462035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.685337+0000","last_change":"2023-11-26T07:16:32.614550+0000","last_active":"2023-11-26T07:16:34.685337+0000","last_peered":"2023-11-26T07:16:34.685337+0000","last_clean":"2023-11-26T07:16:34.685337+0000","last_became_active":"2023-11-26T07:16:32.614213+0000","last_became_peered":"2023-11-26T07:16:32.614213+0000","last_unstale":"2023-11-26T07:16:34.685337+0000","last_undegraded":"2023-11-26T07:16:34.685337+0000","last_fullsized":"2023-11-26T07:16:34.685337+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:00:38.342286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.606570+0000","last_change":"2023-11-26T07:16:31.606767+0000","last_active":"2023-11-26T07:16:32.606570+0000","last_peered":"2023-11-26T07:16:32.606570+0000","last_clean":"2023-11-26T07:16:32.606570+0000","last_became_active":"2023-11-26T07:16:31.606477+0000","last_became_peered":"2023-11-26T07:16:31.606477+0000","last_unstale":"2023-11-26T07:16:32.606570+0000","last_undegraded":"2023-11-26T07:16:32.606570+0000","last_fullsized":"2023-11-26T07:16:32.606570+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:28:33.865475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.683882+0000","last_change":"2023-11-26T07:16:32.609910+0000","last_active":"2023-11-26T07:16:34.683882+0000","last_peered":"2023-11-26T07:16:34.683882+0000","last_clean":"2023-11-26T07:16:34.683882+0000","last_became_active":"2023-11-26T07:16:32.609596+0000","last_became_peered":"2023-11-26T07:16:32.609596+0000","last_unstale":"2023-11-26T07:16:34.683882+0000","last_undegraded":"2023-11-26T07:16:34.683882+0000","last_fullsized":"2023-11-26T07:16:34.683882+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:57:21.048560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.602152+0000","last_change":"2023-11-26T07:16:31.607018+0000","last_active":"2023-11-26T07:16:32.602152+0000","last_peered":"2023-11-26T07:16:32.602152+0000","last_clean":"2023-11-26T07:16:32.602152+0000","last_became_active":"2023-11-26T07:16:31.606736+0000","last_became_peered":"2023-11-26T07:16:31.606736+0000","last_unstale":"2023-11-26T07:16:32.602152+0000","last_undegraded":"2023-11-26T07:16:32.602152+0000","last_fullsized":"2023-11-26T07:16:32.602152+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:27:23.533262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.683393+0000","last_change":"2023-11-26T07:16:32.619922+0000","last_active":"2023-11-26T07:16:34.683393+0000","last_peered":"2023-11-26T07:16:34.683393+0000","last_clean":"2023-11-26T07:16:34.683393+0000","last_became_active":"2023-11-26T07:16:32.614974+0000","last_became_peered":"2023-11-26T07:16:32.614974+0000","last_unstale":"2023-11-26T07:16:34.683393+0000","last_undegraded":"2023-11-26T07:16:34.683393+0000","last_fullsized":"2023-11-26T07:16:34.683393+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:39:03.101817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.610858+0000","last_change":"2023-11-26T07:16:31.604168+0000","last_active":"2023-11-26T07:16:32.610858+0000","last_peered":"2023-11-26T07:16:32.610858+0000","last_clean":"2023-11-26T07:16:32.610858+0000","last_became_active":"2023-11-26T07:16:31.603852+0000","last_became_peered":"2023-11-26T07:16:31.603852+0000","last_unstale":"2023-11-26T07:16:32.610858+0000","last_undegraded":"2023-11-26T07:16:32.610858+0000","last_fullsized":"2023-11-26T07:16:32.610858+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:40:49.206751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.683564+0000","last_change":"2023-11-26T07:16:32.613314+0000","last_active":"2023-11-26T07:16:34.683564+0000","last_peered":"2023-11-26T07:16:34.683564+0000","last_clean":"2023-11-26T07:16:34.683564+0000","last_became_active":"2023-11-26T07:16:32.612725+0000","last_became_peered":"2023-11-26T07:16:32.612725+0000","last_unstale":"2023-11-26T07:16:34.683564+0000","last_undegraded":"2023-11-26T07:16:34.683564+0000","last_fullsized":"2023-11-26T07:16:34.683564+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:35:15.962276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.607597+0000","last_change":"2023-11-26T07:16:31.603291+0000","last_active":"2023-11-26T07:16:32.607597+0000","last_peered":"2023-11-26T07:16:32.607597+0000","last_clean":"2023-11-26T07:16:32.607597+0000","last_became_active":"2023-11-26T07:16:31.603030+0000","last_became_peered":"2023-11-26T07:16:31.603030+0000","last_unstale":"2023-11-26T07:16:32.607597+0000","last_undegraded":"2023-11-26T07:16:32.607597+0000","last_fullsized":"2023-11-26T07:16:32.607597+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:20:11.239657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684760+0000","last_change":"2023-11-26T07:16:32.617970+0000","last_active":"2023-11-26T07:16:34.684760+0000","last_peered":"2023-11-26T07:16:34.684760+0000","last_clean":"2023-11-26T07:16:34.684760+0000","last_became_active":"2023-11-26T07:16:32.617511+0000","last_became_peered":"2023-11-26T07:16:32.617511+0000","last_unstale":"2023-11-26T07:16:34.684760+0000","last_undegraded":"2023-11-26T07:16:34.684760+0000","last_fullsized":"2023-11-26T07:16:34.684760+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:29:55.413054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"72'2","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.629684+0000","last_change":"2023-11-26T07:16:31.608037+0000","last_active":"2023-11-26T07:16:32.629684+0000","last_peered":"2023-11-26T07:16:32.629684+0000","last_clean":"2023-11-26T07:16:32.629684+0000","last_became_active":"2023-11-26T07:16:31.607653+0000","last_became_peered":"2023-11-26T07:16:31.607653+0000","last_unstale":"2023-11-26T07:16:32.629684+0000","last_undegraded":"2023-11-26T07:16:32.629684+0000","last_fullsized":"2023-11-26T07:16:32.629684+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:14:46.356838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:33.603609+0000","last_change":"2023-11-26T07:16:32.618893+0000","last_active":"2023-11-26T07:16:33.603609+0000","last_peered":"2023-11-26T07:16:33.603609+0000","last_clean":"2023-11-26T07:16:33.603609+0000","last_became_active":"2023-11-26T07:16:32.618423+0000","last_became_peered":"2023-11-26T07:16:32.618423+0000","last_unstale":"2023-11-26T07:16:33.603609+0000","last_undegraded":"2023-11-26T07:16:33.603609+0000","last_fullsized":"2023-11-26T07:16:33.603609+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:48:30.404873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.611654+0000","last_change":"2023-11-26T07:16:31.601496+0000","last_active":"2023-11-26T07:16:32.611654+0000","last_peered":"2023-11-26T07:16:32.611654+0000","last_clean":"2023-11-26T07:16:32.611654+0000","last_became_active":"2023-11-26T07:16:31.600854+0000","last_became_peered":"2023-11-26T07:16:31.600854+0000","last_unstale":"2023-11-26T07:16:32.611654+0000","last_undegraded":"2023-11-26T07:16:32.611654+0000","last_fullsized":"2023-11-26T07:16:32.611654+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:55:10.145719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.683876+0000","last_change":"2023-11-26T07:16:32.615796+0000","last_active":"2023-11-26T07:16:34.683876+0000","last_peered":"2023-11-26T07:16:34.683876+0000","last_clean":"2023-11-26T07:16:34.683876+0000","last_became_active":"2023-11-26T07:16:32.615443+0000","last_became_peered":"2023-11-26T07:16:32.615443+0000","last_unstale":"2023-11-26T07:16:34.683876+0000","last_undegraded":"2023-11-26T07:16:34.683876+0000","last_fullsized":"2023-11-26T07:16:34.683876+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:56:01.891239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.605836+0000","last_change":"2023-11-26T07:16:31.611255+0000","last_active":"2023-11-26T07:16:32.605836+0000","last_peered":"2023-11-26T07:16:32.605836+0000","last_clean":"2023-11-26T07:16:32.605836+0000","last_became_active":"2023-11-26T07:16:31.610936+0000","last_became_peered":"2023-11-26T07:16:31.610936+0000","last_unstale":"2023-11-26T07:16:32.605836+0000","last_undegraded":"2023-11-26T07:16:32.605836+0000","last_fullsized":"2023-11-26T07:16:32.605836+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:03:32.957406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684337+0000","last_change":"2023-11-26T07:16:32.618954+0000","last_active":"2023-11-26T07:16:34.684337+0000","last_peered":"2023-11-26T07:16:34.684337+0000","last_clean":"2023-11-26T07:16:34.684337+0000","last_became_active":"2023-11-26T07:16:32.618687+0000","last_became_peered":"2023-11-26T07:16:32.618687+0000","last_unstale":"2023-11-26T07:16:34.684337+0000","last_undegraded":"2023-11-26T07:16:34.684337+0000","last_fullsized":"2023-11-26T07:16:34.684337+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:25:17.238441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.603680+0000","last_change":"2023-11-26T07:16:31.604687+0000","last_active":"2023-11-26T07:16:32.603680+0000","last_peered":"2023-11-26T07:16:32.603680+0000","last_clean":"2023-11-26T07:16:32.603680+0000","last_became_active":"2023-11-26T07:16:31.604369+0000","last_became_peered":"2023-11-26T07:16:31.604369+0000","last_unstale":"2023-11-26T07:16:32.603680+0000","last_undegraded":"2023-11-26T07:16:32.603680+0000","last_fullsized":"2023-11-26T07:16:32.603680+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:53:52.601528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.685108+0000","last_change":"2023-11-26T07:16:32.614667+0000","last_active":"2023-11-26T07:16:34.685108+0000","last_peered":"2023-11-26T07:16:34.685108+0000","last_clean":"2023-11-26T07:16:34.685108+0000","last_became_active":"2023-11-26T07:16:32.614343+0000","last_became_peered":"2023-11-26T07:16:32.614343+0000","last_unstale":"2023-11-26T07:16:34.685108+0000","last_undegraded":"2023-11-26T07:16:34.685108+0000","last_fullsized":"2023-11-26T07:16:34.685108+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:36:14.386458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.605760+0000","last_change":"2023-11-26T07:16:31.606737+0000","last_active":"2023-11-26T07:16:32.605760+0000","last_peered":"2023-11-26T07:16:32.605760+0000","last_clean":"2023-11-26T07:16:32.605760+0000","last_became_active":"2023-11-26T07:16:31.606477+0000","last_became_peered":"2023-11-26T07:16:31.606477+0000","last_unstale":"2023-11-26T07:16:32.605760+0000","last_undegraded":"2023-11-26T07:16:32.605760+0000","last_fullsized":"2023-11-26T07:16:32.605760+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:01:31.967021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.683892+0000","last_change":"2023-11-26T07:16:32.610076+0000","last_active":"2023-11-26T07:16:34.683892+0000","last_peered":"2023-11-26T07:16:34.683892+0000","last_clean":"2023-11-26T07:16:34.683892+0000","last_became_active":"2023-11-26T07:16:32.609769+0000","last_became_peered":"2023-11-26T07:16:32.609769+0000","last_unstale":"2023-11-26T07:16:34.683892+0000","last_undegraded":"2023-11-26T07:16:34.683892+0000","last_fullsized":"2023-11-26T07:16:34.683892+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:00:33.455429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.599130+0000","last_change":"2023-11-26T07:16:31.597623+0000","last_active":"2023-11-26T07:16:32.599130+0000","last_peered":"2023-11-26T07:16:32.599130+0000","last_clean":"2023-11-26T07:16:32.599130+0000","last_became_active":"2023-11-26T07:16:31.597356+0000","last_became_peered":"2023-11-26T07:16:31.597356+0000","last_unstale":"2023-11-26T07:16:32.599130+0000","last_undegraded":"2023-11-26T07:16:32.599130+0000","last_fullsized":"2023-11-26T07:16:32.599130+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:38:12.974493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684450+0000","last_change":"2023-11-26T07:16:32.605868+0000","last_active":"2023-11-26T07:16:34.684450+0000","last_peered":"2023-11-26T07:16:34.684450+0000","last_clean":"2023-11-26T07:16:34.684450+0000","last_became_active":"2023-11-26T07:16:32.605532+0000","last_became_peered":"2023-11-26T07:16:32.605532+0000","last_unstale":"2023-11-26T07:16:34.684450+0000","last_undegraded":"2023-11-26T07:16:34.684450+0000","last_fullsized":"2023-11-26T07:16:34.684450+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:52:53.868801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.612506+0000","last_change":"2023-11-26T07:16:31.605393+0000","last_active":"2023-11-26T07:16:32.612506+0000","last_peered":"2023-11-26T07:16:32.612506+0000","last_clean":"2023-11-26T07:16:32.612506+0000","last_became_active":"2023-11-26T07:16:31.605134+0000","last_became_peered":"2023-11-26T07:16:31.605134+0000","last_unstale":"2023-11-26T07:16:32.612506+0000","last_undegraded":"2023-11-26T07:16:32.612506+0000","last_fullsized":"2023-11-26T07:16:32.612506+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:04:43.215372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.683636+0000","last_change":"2023-11-26T07:16:32.611231+0000","last_active":"2023-11-26T07:16:34.683636+0000","last_peered":"2023-11-26T07:16:34.683636+0000","last_clean":"2023-11-26T07:16:34.683636+0000","last_became_active":"2023-11-26T07:16:32.610935+0000","last_became_peered":"2023-11-26T07:16:32.610935+0000","last_unstale":"2023-11-26T07:16:34.683636+0000","last_undegraded":"2023-11-26T07:16:34.683636+0000","last_fullsized":"2023-11-26T07:16:34.683636+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:04:44.220873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.601963+0000","last_change":"2023-11-26T07:16:31.605773+0000","last_active":"2023-11-26T07:16:32.601963+0000","last_peered":"2023-11-26T07:16:32.601963+0000","last_clean":"2023-11-26T07:16:32.601963+0000","last_became_active":"2023-11-26T07:16:31.605493+0000","last_became_peered":"2023-11-26T07:16:31.605493+0000","last_unstale":"2023-11-26T07:16:32.601963+0000","last_undegraded":"2023-11-26T07:16:32.601963+0000","last_fullsized":"2023-11-26T07:16:32.601963+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:00:14.422829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.683771+0000","last_change":"2023-11-26T07:16:32.613816+0000","last_active":"2023-11-26T07:16:34.683771+0000","last_peered":"2023-11-26T07:16:34.683771+0000","last_clean":"2023-11-26T07:16:34.683771+0000","last_became_active":"2023-11-26T07:16:32.613166+0000","last_became_peered":"2023-11-26T07:16:32.613166+0000","last_unstale":"2023-11-26T07:16:34.683771+0000","last_undegraded":"2023-11-26T07:16:34.683771+0000","last_fullsized":"2023-11-26T07:16:34.683771+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:46:31.392268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"72'2","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.629566+0000","last_change":"2023-11-26T07:16:31.603942+0000","last_active":"2023-11-26T07:16:32.629566+0000","last_peered":"2023-11-26T07:16:32.629566+0000","last_clean":"2023-11-26T07:16:32.629566+0000","last_became_active":"2023-11-26T07:16:31.603643+0000","last_became_peered":"2023-11-26T07:16:31.603643+0000","last_unstale":"2023-11-26T07:16:32.629566+0000","last_undegraded":"2023-11-26T07:16:32.629566+0000","last_fullsized":"2023-11-26T07:16:32.629566+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:13:51.805422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":211,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.605104+0000","last_change":"2023-11-26T07:11:29.855919+0000","last_active":"2023-11-26T07:16:32.605104+0000","last_peered":"2023-11-26T07:16:32.605104+0000","last_clean":"2023-11-26T07:16:32.605104+0000","last_became_active":"2023-11-26T07:11:29.854903+0000","last_became_peered":"2023-11-26T07:11:29.854903+0000","last_unstale":"2023-11-26T07:16:32.605104+0000","last_undegraded":"2023-11-26T07:16:32.605104+0000","last_fullsized":"2023-11-26T07:16:32.605104+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:28.594252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:28.594252+0000","last_clean_scrub_stamp":"2023-11-26T07:11:28.594252+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:33:34.642696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574915,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32640,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339200,"statfs":{"total":96636764160,"available":96603340800,"internally_reserved":0,"allocated":1490944,"data_stored":968662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:15:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34000000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.66600000000000004,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.51100000000000001,"15min":0.505},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.64400000000000002,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.39700000000000002}]},{"osd":1,"last update":"Sun Nov 26 07:15:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.74299999999999999,"15min":0.94499999999999995},"min":{"1min":0.38600000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72199999999999998,"5min":9.5600000000000005,"15min":9.5600000000000005},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56100000000000005,"15min":0.57699999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.69599999999999995,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.51700000000000002}]},{"osd":2,"last update":"Sun Nov 26 07:15:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.58699999999999997,"15min":0.59899999999999998},"min":{"1min":0.42999999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.65700000000000003,"5min":1.569,"15min":1.569},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.623,"15min":0.64400000000000002},"min":{"1min":0.36899999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.71199999999999997,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.59999999999999998}]},{"osd":3,"last update":"Sun Nov 26 07:15:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.57699999999999996,"15min":0.59799999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.63700000000000001,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.57699999999999996,"15min":0.56599999999999995},"min":{"1min":0.434,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69199999999999995,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.57699999999999996}]},{"osd":4,"last update":"Sun Nov 26 07:15:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.51800000000000002,"15min":0.52100000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.71099999999999997,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.52900000000000003,"15min":0.51300000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.67800000000000005,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.432}]},{"osd":5,"last update":"Sun Nov 26 07:15:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55100000000000005,"15min":0.53300000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.751,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.621,"15min":0.63},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.75900000000000001,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.63100000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:15:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.433,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72999999999999998,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.59599999999999997,"15min":0.59099999999999997},"min":{"1min":0.40500000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.69199999999999995,"5min":1.552,"15min":1.552},"last":0.65600000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574915,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339780,"statfs":{"total":96636764160,"available":96603934720,"internally_reserved":0,"allocated":897024,"data_stored":377770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:16:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51700000000000002,"15min":0.48899999999999999},"min":{"1min":0.33200000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.70199999999999996,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53800000000000003,"15min":0.48799999999999999},"min":{"1min":0.36399999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.752,"5min":0.871,"15min":0.871},"last":0.56599999999999995}]},{"osd":1,"last update":"Sun Nov 26 07:16:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.53200000000000003,"15min":0.51400000000000001},"min":{"1min":0.38900000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.76200000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54800000000000004,"15min":0.54400000000000004},"min":{"1min":0.38100000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67300000000000004,"5min":1.198,"15min":1.198},"last":0.46100000000000002}]},{"osd":2,"last update":"Sun Nov 26 07:16:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.53700000000000003,"15min":0.502},"min":{"1min":0.35699999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.74199999999999999,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.375},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56799999999999995,"15min":0.53000000000000003},"min":{"1min":0.38800000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.76300000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.53700000000000003}]},{"osd":3,"last update":"Sun Nov 26 07:16:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59899999999999998,"15min":0.55900000000000005},"min":{"1min":0.40999999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.74199999999999999,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.62,"15min":0.58999999999999997},"min":{"1min":0.434,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79100000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.60399999999999998}]},{"osd":4,"last update":"Sun Nov 26 07:16:33 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.502,"15min":0.52400000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.62,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.55600000000000005,"15min":0.56599999999999995},"min":{"1min":0.33200000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.68300000000000005,"5min":0.87,"15min":0.87},"last":0.49399999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:16:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.66500000000000004,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.57099999999999995,"15min":0.58299999999999996},"min":{"1min":0.34699999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.69999999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.64000000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:16:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.37,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.755,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.629},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.621,"15min":0.623},"min":{"1min":0.43099999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.81299999999999994,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.70799999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574914,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":909312,"data_stored":379906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.36299999999999999},"min":{"1min":0.223,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.57999999999999996,"15min":0.79900000000000004},"min":{"1min":0.29299999999999998,"5min":0.214,"15min":0.214},"max":{"1min":0.55700000000000005,"5min":11.922000000000001,"15min":11.922000000000001},"last":0.41299999999999998}]},{"osd":2,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35799999999999998,"15min":0.372},"min":{"1min":0.26000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.59599999999999997,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.40300000000000002,"15min":0.40799999999999997},"min":{"1min":0.307,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.56999999999999995,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.32600000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.45000000000000001,"15min":0.45800000000000002},"min":{"1min":0.35599999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.61299999999999999,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.42999999999999999,"15min":0.44},"min":{"1min":0.32500000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.51100000000000001,"5min":1.101,"15min":1.101},"last":0.377}]},{"osd":4,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.74099999999999999,"15min":0.86499999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82199999999999995,"5min":6.8979999999999997,"15min":6.8979999999999997},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.65600000000000003,"15min":0.66400000000000003},"min":{"1min":0.48799999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83999999999999997,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.57299999999999995}]},{"osd":5,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.621,"15min":0.627},"min":{"1min":0.41599999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.89100000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.621,"5min":0.745,"15min":0.871},"min":{"1min":0.442,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85199999999999998,"5min":6.9480000000000004,"15min":6.9480000000000004},"last":0.51200000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.64700000000000002,"15min":0.66100000000000003},"min":{"1min":0.46200000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.87,"5min":1.194,"15min":1.194},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.75800000000000001,"15min":0.89500000000000002},"min":{"1min":0.435,"5min":0.372,"15min":0.372},"max":{"1min":0.90500000000000003,"5min":6.9800000000000004,"15min":6.9800000000000004},"last":0.54000000000000004}]},{"osd":7,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65800000000000003,"15min":0.66000000000000003},"min":{"1min":0.48399999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.92400000000000004,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.68300000000000005},"min":{"1min":0.44700000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.93300000000000005,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.628}]}]},{"osd":0,"up_from":13,"seq":55834574913,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32632,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339208,"statfs":{"total":96636764160,"available":96603348992,"internally_reserved":0,"allocated":1482752,"data_stored":968046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33100000000000002,"15min":0.36499999999999999},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.44500000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.214},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.46800000000000003,"15min":0.78200000000000003},"min":{"1min":0.25,"5min":0.216,"15min":0.216},"max":{"1min":0.48299999999999998,"5min":11.987,"15min":11.987},"last":0.25}]},{"osd":2,"last update":"Sun Nov 26 07:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.378,"15min":0.42599999999999999},"min":{"1min":0.26900000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.503,"5min":1.607,"15min":1.607},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.38900000000000001,"15min":0.40999999999999998},"min":{"1min":0.307,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.54700000000000004,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.32000000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.36799999999999999,"15min":0.38400000000000001},"min":{"1min":0.27300000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.50900000000000001,"5min":0.752,"15min":0.752},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.42599999999999999,"15min":0.46500000000000002},"min":{"1min":0.30099999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.55200000000000005,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.307}]},{"osd":4,"last update":"Sun Nov 26 07:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.60099999999999998,"15min":0.64500000000000002},"min":{"1min":0.42399999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.72899999999999998,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.66700000000000004,"15min":0.85599999999999998},"min":{"1min":0.41699999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.79600000000000004,"5min":6.5279999999999996,"15min":6.5279999999999996},"last":0.68000000000000005}]},{"osd":5,"last update":"Sun Nov 26 07:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60799999999999998,"15min":0.64200000000000002},"min":{"1min":0.45000000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.878,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.63900000000000001,"15min":0.68500000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.78600000000000003,"5min":1.508,"15min":1.508},"last":0.52700000000000002}]},{"osd":6,"last update":"Sun Nov 26 07:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.69599999999999995,"15min":0.89200000000000002},"min":{"1min":0.435,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.76100000000000001,"5min":6.5419999999999998,"15min":6.5419999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.627,"15min":0.66900000000000004},"min":{"1min":0.45600000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.84099999999999997,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.66300000000000003}]},{"osd":7,"last update":"Sun Nov 26 07:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64800000000000002,"15min":0.69199999999999995},"min":{"1min":0.46400000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.78400000000000003,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.624,"15min":0.65600000000000003},"min":{"1min":0.42699999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77000000000000002,"5min":1.155,"15min":1.155},"last":0.56499999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574914,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32060,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339780,"statfs":{"total":96636764160,"available":96603934720,"internally_reserved":0,"allocated":901120,"data_stored":379290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:15:38 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34000000000000002,"15min":0.34599999999999997},"min":{"1min":0.22500000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39400000000000002,"15min":0.39800000000000002},"min":{"1min":0.28100000000000003,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.53500000000000003,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.314}]},{"osd":1,"last update":"Sun Nov 26 07:15:38 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34399999999999997,"15min":0.34799999999999998},"min":{"1min":0.224,"5min":0.222,"15min":0.222},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.375,"15min":0.377},"min":{"1min":0.24399999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.58199999999999996,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.40400000000000003}]},{"osd":3,"last update":"Sun Nov 26 07:15:38 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39700000000000002,"15min":0.41099999999999998},"min":{"1min":0.28100000000000003,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.59699999999999998,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.376,"5min":0.374,"15min":0.38200000000000001},"min":{"1min":0.27600000000000002,"5min":0.224,"15min":0.224},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.42799999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:15:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.42699999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.58399999999999996,"15min":0.58099999999999996},"min":{"1min":0.438,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.65300000000000002}]},{"osd":5,"last update":"Sun Nov 26 07:15:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.58099999999999996,"15min":0.57699999999999996},"min":{"1min":0.47199999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60999999999999999,"15min":0.63},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84299999999999997,"5min":1.002,"15min":1.002},"last":0.52200000000000002}]},{"osd":6,"last update":"Sun Nov 26 07:15:38 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.60899999999999999,"15min":0.61099999999999999},"min":{"1min":0.40999999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.623},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.629,"15min":0.63500000000000001},"min":{"1min":0.44700000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.54300000000000004}]},{"osd":7,"last update":"Sun Nov 26 07:15:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.62,"15min":0.629},"min":{"1min":0.499,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86299999999999999,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.625,"15min":0.625},"min":{"1min":0.47199999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.67400000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574914,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339780,"statfs":{"total":96636764160,"available":96603934720,"internally_reserved":0,"allocated":897024,"data_stored":377790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.34100000000000003,"15min":0.36499999999999999},"min":{"1min":0.22,"5min":0.219,"15min":0.219},"max":{"1min":0.46600000000000003,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.39300000000000002,"15min":0.41899999999999998},"min":{"1min":0.24199999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.61299999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.33300000000000002}]},{"osd":1,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.375,"15min":0.40300000000000002},"min":{"1min":0.25800000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.58799999999999997,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.246},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.439,"15min":0.5},"min":{"1min":0.26300000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.56899999999999995,"5min":2.903,"15min":2.903},"last":0.34799999999999998}]},{"osd":2,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39300000000000002,"15min":0.40400000000000003},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.55200000000000005,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.40500000000000003,"15min":0.41799999999999998},"min":{"1min":0.309,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.63700000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.38300000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.65400000000000003,"15min":0.70699999999999996},"min":{"1min":0.376,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.96799999999999997,"5min":2.9609999999999999,"15min":2.9609999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.625,"15min":0.64100000000000001},"min":{"1min":0.437,"5min":0.373,"15min":0.373},"max":{"1min":1.1499999999999999,"5min":1.163,"15min":1.163},"last":0.45800000000000002}]},{"osd":5,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.65100000000000002,"15min":0.67300000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.98199999999999998,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.64000000000000001,"15min":0.66400000000000003},"min":{"1min":0.436,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93999999999999995,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.58199999999999996}]},{"osd":6,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64500000000000002,"15min":0.67100000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.083,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.65600000000000003,"15min":0.68000000000000005},"min":{"1min":0.44900000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94499999999999995,"5min":1.258,"15min":1.258},"last":0.55300000000000005}]},{"osd":7,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.65200000000000002,"15min":0.68200000000000005},"min":{"1min":0.46700000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.014,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.69799999999999995,"15min":0.752},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.94899999999999995,"5min":2.9969999999999999,"15min":2.9969999999999999},"last":0.56599999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574913,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32052,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339788,"statfs":{"total":96636764160,"available":96603942912,"internally_reserved":0,"allocated":892928,"data_stored":377748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.65100000000000002,"15min":0.88400000000000001},"min":{"1min":0.41899999999999998,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.748,"5min":8.7539999999999996,"15min":8.7539999999999996},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.67400000000000004,"15min":0.90200000000000002},"min":{"1min":0.41499999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.81899999999999995,"5min":8.7390000000000008,"15min":8.7390000000000008},"last":0.63300000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.67100000000000004,"15min":0.93000000000000005},"min":{"1min":0.42899999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.76000000000000001,"5min":9.7720000000000002,"15min":9.7720000000000002},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56000000000000005,"15min":0.56699999999999995},"min":{"1min":0.38700000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.75600000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.57199999999999995}]},{"osd":2,"last update":"Sun Nov 26 07:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.63600000000000001,"15min":0.88300000000000001},"min":{"1min":0.36499999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.66400000000000003,"5min":9.8119999999999994,"15min":9.8119999999999994},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.65000000000000002,"15min":0.80400000000000005},"min":{"1min":0.48999999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80200000000000005,"5min":3.645,"15min":3.645},"last":0.67700000000000005}]},{"osd":3,"last update":"Sun Nov 26 07:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.69099999999999995,"15min":0.92900000000000005},"min":{"1min":0.41599999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.79300000000000004,"5min":8.8089999999999993,"15min":8.8089999999999993},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.49299999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78600000000000003,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.65800000000000003}]},{"osd":5,"last update":"Sun Nov 26 07:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.54200000000000004,"15min":0.51200000000000001},"min":{"1min":0.35499999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.82299999999999995,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55500000000000005,"15min":0.55200000000000005},"min":{"1min":0.33600000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.82099999999999995,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.45300000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.59499999999999997,"15min":0.58299999999999996},"min":{"1min":0.42299999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84999999999999998,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56699999999999995,"15min":0.57299999999999995},"min":{"1min":0.39200000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.77100000000000002,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.74099999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60199999999999998,"15min":0.59599999999999997},"min":{"1min":0.41899999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.78300000000000003,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.61499999999999999,"15min":0.60699999999999998},"min":{"1min":0.42899999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.88700000000000001,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.70799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574915,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":892928,"data_stored":377768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.58799999999999997,"15min":0.54000000000000004},"min":{"1min":0.35199999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76300000000000001,"5min":7.1500000000000004,"15min":7.1500000000000004},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.59699999999999998,"15min":0.57199999999999995},"min":{"1min":0.372,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72999999999999998,"5min":6.8470000000000004,"15min":6.8470000000000004},"last":0.69999999999999996}]},{"osd":1,"last update":"Sun Nov 26 07:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.59099999999999997,"15min":0.55700000000000005},"min":{"1min":0.33500000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.73899999999999999,"5min":7.1269999999999998,"15min":7.1269999999999998},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56399999999999995,"15min":0.55900000000000005},"min":{"1min":0.33800000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.74099999999999999,"5min":1.514,"15min":1.514},"last":0.44700000000000001}]},{"osd":2,"last update":"Sun Nov 26 07:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.64100000000000001,"15min":0.59699999999999998},"min":{"1min":0.40500000000000003,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.75700000000000001,"5min":7.2000000000000002,"15min":7.2000000000000002},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.66200000000000003,"15min":0.62},"min":{"1min":0.40799999999999997,"5min":0.379,"15min":0.379},"max":{"1min":0.749,"5min":7.8259999999999996,"15min":7.8259999999999996},"last":0.66100000000000003}]},{"osd":3,"last update":"Sun Nov 26 07:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.59999999999999998,"15min":0.57199999999999995},"min":{"1min":0.47799999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.77800000000000002,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.65300000000000002,"15min":0.60899999999999999},"min":{"1min":0.44500000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.73899999999999999,"5min":6.9240000000000004,"15min":6.9240000000000004},"last":0.64000000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.56699999999999995,"15min":0.51400000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78800000000000003,"5min":7.2830000000000004,"15min":7.2830000000000004},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.77000000000000002,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.77000000000000002}]},{"osd":6,"last update":"Sun Nov 26 07:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.622,"15min":0.57199999999999995},"min":{"1min":0.377,"5min":0.308,"15min":0.308},"max":{"1min":0.80400000000000005,"5min":6.8890000000000002,"15min":6.8890000000000002},"last":0.752},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.63800000000000001,"15min":0.59199999999999997},"min":{"1min":0.40500000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.82999999999999996,"5min":7.2430000000000003,"15min":7.2430000000000003},"last":0.72499999999999998}]},{"osd":7,"last update":"Sun Nov 26 07:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.66300000000000003,"15min":0.61099999999999999},"min":{"1min":0.40300000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.83999999999999997,"5min":6.9880000000000004,"15min":6.9880000000000004},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.624,"5min":0.73399999999999999,"15min":0.65900000000000003},"min":{"1min":0.434,"5min":0.38,"15min":0.38},"max":{"1min":0.84299999999999997,"5min":11.874000000000001,"15min":11.874000000000001},"last":0.79000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:16:38.432 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:16:38.435 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:16:38.585 INFO:tasks.ceph.mds.a.smithi002.stderr:2023-11-26T07:16:38.583+0000 7f1cd1a3b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-26T07:16:41.398 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:16:41.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.534+0000 7fda9dcb4700 1 Processor -- start 2023-11-26T07:16:41.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.534+0000 7fda9dcb4700 1 -- start start 2023-11-26T07:16:41.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.535+0000 7fda9dcb4700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fda980cecd0 0x7fda9815c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:41.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.535+0000 7fda9dcb4700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda980d0a90 con 0x7fda980cf2b0 2023-11-26T07:16:41.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.535+0000 7fda9dcb4700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda9806ee10 con 0x7fda9815bde0 2023-11-26T07:16:41.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.535+0000 7fda9dcb4700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda9806f0f0 con 0x7fda980cecd0 2023-11-26T07:16:41.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.535+0000 7fda96ffd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fda980cf2b0 0x7fda980ce5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35558/0 (socket says 172.21.15.2:35558) 2023-11-26T07:16:41.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.535+0000 7fda96ffd700 1 -- 172.21.15.2:0/2237701642 learned_addr learned my addr 172.21.15.2:0/2237701642 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:16:41.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.536+0000 7fda967fc700 1 -- 172.21.15.2:0/2237701642 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3551915333 0 0) 0x7fda980d0a90 con 0x7fda980cf2b0 2023-11-26T07:16:41.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.536+0000 7fda967fc700 1 -- 172.21.15.2:0/2237701642 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda840035b0 con 0x7fda980cf2b0 2023-11-26T07:16:41.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.536+0000 7fda97fff700 1 --2- 172.21.15.2:0/2237701642 >> v2:172.21.15.192:3300/0 conn(0x7fda980cecd0 0x7fda9815c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:41.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.536+0000 7fda967fc700 1 -- 172.21.15.2:0/2237701642 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2439947279 0 0) 0x7fda840035b0 con 0x7fda980cf2b0 2023-11-26T07:16:41.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.536+0000 7fda967fc700 1 -- 172.21.15.2:0/2237701642 >> v2:172.21.15.192:3300/0 conn(0x7fda980cecd0 msgr2=0x7fda9815c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:41.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.536+0000 7fda967fc700 1 --2- 172.21.15.2:0/2237701642 >> v2:172.21.15.192:3300/0 conn(0x7fda980cecd0 0x7fda9815c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:41.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.536+0000 7fda967fc700 1 -- 172.21.15.2:0/2237701642 >> v1:172.21.15.192:6789/0 conn(0x7fda9815bde0 legacy=0x7fda980d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:41.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.536+0000 7fda967fc700 1 -- 172.21.15.2:0/2237701642 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9806f3d0 con 0x7fda980cf2b0 2023-11-26T07:16:41.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.536+0000 7fda967fc700 1 -- 172.21.15.2:0/2237701642 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7fda80001670 con 0x7fda980cf2b0 2023-11-26T07:16:41.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.536+0000 7fda967fc700 1 -- 172.21.15.2:0/2237701642 >> v1:172.21.15.2:6789/0 conn(0x7fda980cf2b0 legacy=0x7fda980ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:41.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.536+0000 7fda967fc700 1 --2- 172.21.15.2:0/2237701642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda84003a00 0x7fda84003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:41.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.536+0000 7fda967fc700 1 --2- 172.21.15.2:0/2237701642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda84004850 0x7fda84004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:41.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.536+0000 7fda967fc700 1 --2- 172.21.15.2:0/2237701642 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda84005330 0x7fda8400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:41.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.536+0000 7fda967fc700 1 -- 172.21.15.2:0/2237701642 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9806f0f0 con 0x7fda84003a00 2023-11-26T07:16:41.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.536+0000 7fda967fc700 1 -- 172.21.15.2:0/2237701642 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8400c280 con 0x7fda84004850 2023-11-26T07:16:41.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.536+0000 7fda967fc700 1 -- 172.21.15.2:0/2237701642 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda8400c440 con 0x7fda84005330 2023-11-26T07:16:41.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.536+0000 7fda977fe700 1 --2- 172.21.15.2:0/2237701642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda84003a00 0x7fda84003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:41.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.536+0000 7fda96ffd700 1 --2- 172.21.15.2:0/2237701642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda84004850 0x7fda84004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:41.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.536+0000 7fda97fff700 1 --2- 172.21.15.2:0/2237701642 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda84005330 0x7fda8400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:41.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.536+0000 7fda977fe700 1 -- 172.21.15.2:0/2237701642 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda84005330 msgr2=0x7fda8400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:41.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.536+0000 7fda977fe700 1 --2- 172.21.15.2:0/2237701642 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda84005330 0x7fda8400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:41.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.536+0000 7fda977fe700 1 -- 172.21.15.2:0/2237701642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda84004850 msgr2=0x7fda84004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:41.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.536+0000 7fda977fe700 1 --2- 172.21.15.2:0/2237701642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda84004850 0x7fda84004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:41.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.536+0000 7fda977fe700 1 -- 172.21.15.2:0/2237701642 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda840035b0 con 0x7fda84003a00 2023-11-26T07:16:41.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.536+0000 7fda97fff700 1 -- 172.21.15.2:0/2237701642 reap_dead start 2023-11-26T07:16:41.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.537+0000 7fda977fe700 1 --2- 172.21.15.2:0/2237701642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda84003a00 0x7fda84003e00 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fda88007fd0 tx=0x7fda84005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b228db9fe8352030 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:41.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.537+0000 7fda967fc700 1 -- 172.21.15.2:0/2237701642 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda88016070 con 0x7fda84003a00 2023-11-26T07:16:41.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.537+0000 7fda967fc700 1 -- 172.21.15.2:0/2237701642 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda88006860 con 0x7fda84003a00 2023-11-26T07:16:41.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.537+0000 7fda967fc700 1 -- 172.21.15.2:0/2237701642 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda88003950 con 0x7fda84003a00 2023-11-26T07:16:41.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.537+0000 7fda9dcb4700 1 -- 172.21.15.2:0/2237701642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda84003a00 msgr2=0x7fda84003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:41.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.537+0000 7fda9dcb4700 1 --2- 172.21.15.2:0/2237701642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda84003a00 0x7fda84003e00 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fda88007fd0 tx=0x7fda84005880 comp rx=0 tx=0).stop 2023-11-26T07:16:41.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.537+0000 7fda9dcb4700 1 -- 172.21.15.2:0/2237701642 shutdown_connections 2023-11-26T07:16:41.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.537+0000 7fda9dcb4700 1 --2- 172.21.15.2:0/2237701642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda84003a00 0x7fda84003e00 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:41.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.537+0000 7fda9dcb4700 1 -- 172.21.15.2:0/2237701642 >> 172.21.15.2:0/2237701642 conn(0x7fda980b3720 msgr2=0x7fda980b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:41.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.537+0000 7fda9dcb4700 1 -- 172.21.15.2:0/2237701642 shutdown_connections 2023-11-26T07:16:41.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.537+0000 7fda9dcb4700 1 -- 172.21.15.2:0/2237701642 wait complete. 2023-11-26T07:16:41.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.539+0000 7fda9dcb4700 1 Processor -- start 2023-11-26T07:16:41.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.539+0000 7fda9dcb4700 1 -- start start 2023-11-26T07:16:41.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.540+0000 7fda9dcb4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda84003a00 0x7fda9806dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:41.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.540+0000 7fda9dcb4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda981e5b20 0x7fda980c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:41.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.540+0000 7fda9dcb4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda980b2540 0x7fda980b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:41.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.540+0000 7fda9dcb4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda980b2f00 con 0x7fda981e5b20 2023-11-26T07:16:41.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.540+0000 7fda9dcb4700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda980b0b00 con 0x7fda980b2540 2023-11-26T07:16:41.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.540+0000 7fda9dcb4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda980c8ca0 con 0x7fda84003a00 2023-11-26T07:16:41.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.540+0000 7fda96ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda981e5b20 0x7fda980c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:41.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.540+0000 7fda96ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda981e5b20 0x7fda980c7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44362/0 (socket says 172.21.15.2:44362) 2023-11-26T07:16:41.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.540+0000 7fda96ffd700 1 -- 172.21.15.2:0/2485376474 learned_addr learned my addr 172.21.15.2:0/2485376474 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:41.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.540+0000 7fda977fe700 1 --2- 172.21.15.2:0/2485376474 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda84003a00 0x7fda9806dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:41.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.540+0000 7fda97fff700 1 --2- 172.21.15.2:0/2485376474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda980b2540 0x7fda980b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:41.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.540+0000 7fda96ffd700 1 -- 172.21.15.2:0/2485376474 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda84003a00 msgr2=0x7fda9806dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:41.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.540+0000 7fda96ffd700 1 --2- 172.21.15.2:0/2485376474 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda84003a00 0x7fda9806dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:41.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.540+0000 7fda96ffd700 1 -- 172.21.15.2:0/2485376474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda980b2540 msgr2=0x7fda980b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:41.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.540+0000 7fda96ffd700 1 --2- 172.21.15.2:0/2485376474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda980b2540 0x7fda980b29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:41.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.540+0000 7fda96ffd700 1 -- 172.21.15.2:0/2485376474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9815c880 con 0x7fda981e5b20 2023-11-26T07:16:41.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.540+0000 7fda97fff700 1 --2- 172.21.15.2:0/2485376474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda980b2540 0x7fda980b29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:16:41.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.540+0000 7fda96ffd700 1 --2- 172.21.15.2:0/2485376474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda981e5b20 0x7fda980c7b90 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fda80000fb0 tx=0x7fda80007340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:41.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.540+0000 7fda8ffff700 1 -- 172.21.15.2:0/2485376474 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda80011580 con 0x7fda981e5b20 2023-11-26T07:16:41.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.540+0000 7fda8ffff700 1 -- 172.21.15.2:0/2485376474 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda800116e0 con 0x7fda981e5b20 2023-11-26T07:16:41.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.541+0000 7fda9dcb4700 1 -- 172.21.15.2:0/2485376474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda980afef0 con 0x7fda981e5b20 2023-11-26T07:16:41.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.541+0000 7fda8ffff700 1 -- 172.21.15.2:0/2485376474 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda80011a70 con 0x7fda981e5b20 2023-11-26T07:16:41.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.541+0000 7fda9dcb4700 1 -- 172.21.15.2:0/2485376474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda980b04b0 con 0x7fda981e5b20 2023-11-26T07:16:41.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.542+0000 7fda9dcb4700 1 -- 172.21.15.2:0/2485376474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda98068670 con 0x7fda981e5b20 2023-11-26T07:16:41.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.542+0000 7fda8ffff700 1 -- 172.21.15.2:0/2485376474 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7fda80011bd0 con 0x7fda981e5b20 2023-11-26T07:16:41.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.542+0000 7fda8ffff700 1 --2- 172.21.15.2:0/2485376474 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fda7806b740 0x7fda7806dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:41.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.543+0000 7fda8ffff700 1 -- 172.21.15.2:0/2485376474 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fda80088070 con 0x7fda981e5b20 2023-11-26T07:16:41.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.543+0000 7fda977fe700 1 --2- 172.21.15.2:0/2485376474 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fda7806b740 0x7fda7806dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:41.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.543+0000 7fda977fe700 1 --2- 172.21.15.2:0/2485376474 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fda7806b740 0x7fda7806dc00 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fda88014040 tx=0x7fda88009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:41.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.547+0000 7fda8ffff700 1 -- 172.21.15.2:0/2485376474 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fda80054980 con 0x7fda981e5b20 2023-11-26T07:16:41.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.743+0000 7fda9dcb4700 1 -- 172.21.15.2:0/2485376474 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fda9815f940 con 0x7fda7806b740 2023-11-26T07:16:41.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.752+0000 7fda8ffff700 1 -- 172.21.15.2:0/2485376474 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289329 (secure 0 0 0) 0x7fda9815f940 con 0x7fda7806b740 2023-11-26T07:16:41.758 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:16:41.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.755+0000 7fda9dcb4700 1 -- 172.21.15.2:0/2485376474 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fda7806b740 msgr2=0x7fda7806dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:41.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.755+0000 7fda9dcb4700 1 --2- 172.21.15.2:0/2485376474 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fda7806b740 0x7fda7806dc00 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fda88014040 tx=0x7fda88009030 comp rx=0 tx=0).stop 2023-11-26T07:16:41.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.755+0000 7fda9dcb4700 1 -- 172.21.15.2:0/2485376474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda981e5b20 msgr2=0x7fda980c7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:41.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.755+0000 7fda9dcb4700 1 --2- 172.21.15.2:0/2485376474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda981e5b20 0x7fda980c7b90 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fda80000fb0 tx=0x7fda80007340 comp rx=0 tx=0).stop 2023-11-26T07:16:41.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.755+0000 7fda9dcb4700 1 -- 172.21.15.2:0/2485376474 shutdown_connections 2023-11-26T07:16:41.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.755+0000 7fda9dcb4700 1 --2- 172.21.15.2:0/2485376474 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fda7806b740 0x7fda7806dc00 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:41.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.755+0000 7fda9dcb4700 1 --2- 172.21.15.2:0/2485376474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda980b2540 0x7fda980b29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:41.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.755+0000 7fda9dcb4700 1 --2- 172.21.15.2:0/2485376474 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda84003a00 0x7fda9806dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:41.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.755+0000 7fda9dcb4700 1 --2- 172.21.15.2:0/2485376474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda981e5b20 0x7fda980c7b90 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:41.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.755+0000 7fda9dcb4700 1 -- 172.21.15.2:0/2485376474 >> 172.21.15.2:0/2485376474 conn(0x7fda980b3720 msgr2=0x7fda9815afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:41.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.756+0000 7fda9dcb4700 1 -- 172.21.15.2:0/2485376474 shutdown_connections 2023-11-26T07:16:41.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.756+0000 7fda9dcb4700 1 -- 172.21.15.2:0/2485376474 wait complete. 2023-11-26T07:16:41.761 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-26T07:16:41.771 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":223,"stamp":"2023-11-26T07:16:40.231359+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257628,"kb_used_data":8168,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754717092,"statfs":{"total":773094113280,"available":772830302208,"internally_reserved":0,"allocated":8364032,"data_stored":4206980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002247"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684459+0000","last_change":"2023-11-26T07:16:32.618840+0000","last_active":"2023-11-26T07:16:34.684459+0000","last_peered":"2023-11-26T07:16:34.684459+0000","last_clean":"2023-11-26T07:16:34.684459+0000","last_became_active":"2023-11-26T07:16:32.618551+0000","last_became_peered":"2023-11-26T07:16:32.618551+0000","last_unstale":"2023-11-26T07:16:34.684459+0000","last_undegraded":"2023-11-26T07:16:34.684459+0000","last_fullsized":"2023-11-26T07:16:34.684459+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:04:23.691314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684424+0000","last_change":"2023-11-26T07:16:32.615672+0000","last_active":"2023-11-26T07:16:34.684424+0000","last_peered":"2023-11-26T07:16:34.684424+0000","last_clean":"2023-11-26T07:16:34.684424+0000","last_became_active":"2023-11-26T07:16:32.614838+0000","last_became_peered":"2023-11-26T07:16:32.614838+0000","last_unstale":"2023-11-26T07:16:34.684424+0000","last_undegraded":"2023-11-26T07:16:34.684424+0000","last_fullsized":"2023-11-26T07:16:34.684424+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:44:25.487995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684036+0000","last_change":"2023-11-26T07:16:32.609479+0000","last_active":"2023-11-26T07:16:34.684036+0000","last_peered":"2023-11-26T07:16:34.684036+0000","last_clean":"2023-11-26T07:16:34.684036+0000","last_became_active":"2023-11-26T07:16:32.609149+0000","last_became_peered":"2023-11-26T07:16:32.609149+0000","last_unstale":"2023-11-26T07:16:34.684036+0000","last_undegraded":"2023-11-26T07:16:34.684036+0000","last_fullsized":"2023-11-26T07:16:34.684036+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:00:08.804498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684264+0000","last_change":"2023-11-26T07:16:32.619624+0000","last_active":"2023-11-26T07:16:34.684264+0000","last_peered":"2023-11-26T07:16:34.684264+0000","last_clean":"2023-11-26T07:16:34.684264+0000","last_became_active":"2023-11-26T07:16:32.619349+0000","last_became_peered":"2023-11-26T07:16:32.619349+0000","last_unstale":"2023-11-26T07:16:34.684264+0000","last_undegraded":"2023-11-26T07:16:34.684264+0000","last_fullsized":"2023-11-26T07:16:34.684264+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:50:54.963674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.685034+0000","last_change":"2023-11-26T07:16:32.616416+0000","last_active":"2023-11-26T07:16:34.685034+0000","last_peered":"2023-11-26T07:16:34.685034+0000","last_clean":"2023-11-26T07:16:34.685034+0000","last_became_active":"2023-11-26T07:16:32.616077+0000","last_became_peered":"2023-11-26T07:16:32.616077+0000","last_unstale":"2023-11-26T07:16:34.685034+0000","last_undegraded":"2023-11-26T07:16:34.685034+0000","last_fullsized":"2023-11-26T07:16:34.685034+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:53:00.254090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684068+0000","last_change":"2023-11-26T07:16:32.614368+0000","last_active":"2023-11-26T07:16:34.684068+0000","last_peered":"2023-11-26T07:16:34.684068+0000","last_clean":"2023-11-26T07:16:34.684068+0000","last_became_active":"2023-11-26T07:16:32.614042+0000","last_became_peered":"2023-11-26T07:16:32.614042+0000","last_unstale":"2023-11-26T07:16:34.684068+0000","last_undegraded":"2023-11-26T07:16:34.684068+0000","last_fullsized":"2023-11-26T07:16:34.684068+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:09:54.083950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:33.602893+0000","last_change":"2023-11-26T07:16:32.618039+0000","last_active":"2023-11-26T07:16:33.602893+0000","last_peered":"2023-11-26T07:16:33.602893+0000","last_clean":"2023-11-26T07:16:33.602893+0000","last_became_active":"2023-11-26T07:16:32.617771+0000","last_became_peered":"2023-11-26T07:16:32.617771+0000","last_unstale":"2023-11-26T07:16:33.602893+0000","last_undegraded":"2023-11-26T07:16:33.602893+0000","last_fullsized":"2023-11-26T07:16:33.602893+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:28:34.870976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.683570+0000","last_change":"2023-11-26T07:16:32.617923+0000","last_active":"2023-11-26T07:16:34.683570+0000","last_peered":"2023-11-26T07:16:34.683570+0000","last_clean":"2023-11-26T07:16:34.683570+0000","last_became_active":"2023-11-26T07:16:32.617588+0000","last_became_peered":"2023-11-26T07:16:32.617588+0000","last_unstale":"2023-11-26T07:16:34.683570+0000","last_undegraded":"2023-11-26T07:16:34.683570+0000","last_fullsized":"2023-11-26T07:16:34.683570+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:50:59.862905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.685457+0000","last_change":"2023-11-26T07:16:32.617657+0000","last_active":"2023-11-26T07:16:34.685457+0000","last_peered":"2023-11-26T07:16:34.685457+0000","last_clean":"2023-11-26T07:16:34.685457+0000","last_became_active":"2023-11-26T07:16:32.617390+0000","last_became_peered":"2023-11-26T07:16:32.617390+0000","last_unstale":"2023-11-26T07:16:34.685457+0000","last_undegraded":"2023-11-26T07:16:34.685457+0000","last_fullsized":"2023-11-26T07:16:34.685457+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:57:10.951062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:33.602782+0000","last_change":"2023-11-26T07:16:32.613923+0000","last_active":"2023-11-26T07:16:33.602782+0000","last_peered":"2023-11-26T07:16:33.602782+0000","last_clean":"2023-11-26T07:16:33.602782+0000","last_became_active":"2023-11-26T07:16:32.613202+0000","last_became_peered":"2023-11-26T07:16:32.613202+0000","last_unstale":"2023-11-26T07:16:33.602782+0000","last_undegraded":"2023-11-26T07:16:33.602782+0000","last_fullsized":"2023-11-26T07:16:33.602782+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:44:25.487995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684035+0000","last_change":"2023-11-26T07:16:32.613713+0000","last_active":"2023-11-26T07:16:34.684035+0000","last_peered":"2023-11-26T07:16:34.684035+0000","last_clean":"2023-11-26T07:16:34.684035+0000","last_became_active":"2023-11-26T07:16:32.613428+0000","last_became_peered":"2023-11-26T07:16:32.613428+0000","last_unstale":"2023-11-26T07:16:34.684035+0000","last_undegraded":"2023-11-26T07:16:34.684035+0000","last_fullsized":"2023-11-26T07:16:34.684035+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:29:55.413054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684414+0000","last_change":"2023-11-26T07:16:32.611550+0000","last_active":"2023-11-26T07:16:34.684414+0000","last_peered":"2023-11-26T07:16:34.684414+0000","last_clean":"2023-11-26T07:16:34.684414+0000","last_became_active":"2023-11-26T07:16:32.611059+0000","last_became_peered":"2023-11-26T07:16:32.611059+0000","last_unstale":"2023-11-26T07:16:34.684414+0000","last_undegraded":"2023-11-26T07:16:34.684414+0000","last_fullsized":"2023-11-26T07:16:34.684414+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:10:32.920608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684710+0000","last_change":"2023-11-26T07:16:32.611303+0000","last_active":"2023-11-26T07:16:34.684710+0000","last_peered":"2023-11-26T07:16:34.684710+0000","last_clean":"2023-11-26T07:16:34.684710+0000","last_became_active":"2023-11-26T07:16:32.610959+0000","last_became_peered":"2023-11-26T07:16:32.610959+0000","last_unstale":"2023-11-26T07:16:34.684710+0000","last_undegraded":"2023-11-26T07:16:34.684710+0000","last_fullsized":"2023-11-26T07:16:34.684710+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:56:01.891239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.685072+0000","last_change":"2023-11-26T07:16:32.620986+0000","last_active":"2023-11-26T07:16:34.685072+0000","last_peered":"2023-11-26T07:16:34.685072+0000","last_clean":"2023-11-26T07:16:34.685072+0000","last_became_active":"2023-11-26T07:16:32.620672+0000","last_became_peered":"2023-11-26T07:16:32.620672+0000","last_unstale":"2023-11-26T07:16:34.685072+0000","last_undegraded":"2023-11-26T07:16:34.685072+0000","last_fullsized":"2023-11-26T07:16:34.685072+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:34:17.755737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684438+0000","last_change":"2023-11-26T07:16:32.618382+0000","last_active":"2023-11-26T07:16:34.684438+0000","last_peered":"2023-11-26T07:16:34.684438+0000","last_clean":"2023-11-26T07:16:34.684438+0000","last_became_active":"2023-11-26T07:16:32.618104+0000","last_became_peered":"2023-11-26T07:16:32.618104+0000","last_unstale":"2023-11-26T07:16:34.684438+0000","last_undegraded":"2023-11-26T07:16:34.684438+0000","last_fullsized":"2023-11-26T07:16:34.684438+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:57:46.113545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:33.602703+0000","last_change":"2023-11-26T07:16:32.622360+0000","last_active":"2023-11-26T07:16:33.602703+0000","last_peered":"2023-11-26T07:16:33.602703+0000","last_clean":"2023-11-26T07:16:33.602703+0000","last_became_active":"2023-11-26T07:16:32.622061+0000","last_became_peered":"2023-11-26T07:16:32.622061+0000","last_unstale":"2023-11-26T07:16:33.602703+0000","last_undegraded":"2023-11-26T07:16:33.602703+0000","last_fullsized":"2023-11-26T07:16:33.602703+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:19:33.039679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.685597+0000","last_change":"2023-11-26T07:16:32.616582+0000","last_active":"2023-11-26T07:16:34.685597+0000","last_peered":"2023-11-26T07:16:34.685597+0000","last_clean":"2023-11-26T07:16:34.685597+0000","last_became_active":"2023-11-26T07:16:32.616193+0000","last_became_peered":"2023-11-26T07:16:32.616193+0000","last_unstale":"2023-11-26T07:16:34.685597+0000","last_undegraded":"2023-11-26T07:16:34.685597+0000","last_fullsized":"2023-11-26T07:16:34.685597+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:47:31.154113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684364+0000","last_change":"2023-11-26T07:16:32.618976+0000","last_active":"2023-11-26T07:16:34.684364+0000","last_peered":"2023-11-26T07:16:34.684364+0000","last_clean":"2023-11-26T07:16:34.684364+0000","last_became_active":"2023-11-26T07:16:32.618280+0000","last_became_peered":"2023-11-26T07:16:32.618280+0000","last_unstale":"2023-11-26T07:16:34.684364+0000","last_undegraded":"2023-11-26T07:16:34.684364+0000","last_fullsized":"2023-11-26T07:16:34.684364+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:38:26.302320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684140+0000","last_change":"2023-11-26T07:16:32.616866+0000","last_active":"2023-11-26T07:16:34.684140+0000","last_peered":"2023-11-26T07:16:34.684140+0000","last_clean":"2023-11-26T07:16:34.684140+0000","last_became_active":"2023-11-26T07:16:32.614722+0000","last_became_peered":"2023-11-26T07:16:32.614722+0000","last_unstale":"2023-11-26T07:16:34.684140+0000","last_undegraded":"2023-11-26T07:16:34.684140+0000","last_fullsized":"2023-11-26T07:16:34.684140+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:14:25.229178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684612+0000","last_change":"2023-11-26T07:16:32.615877+0000","last_active":"2023-11-26T07:16:34.684612+0000","last_peered":"2023-11-26T07:16:34.684612+0000","last_clean":"2023-11-26T07:16:34.684612+0000","last_became_active":"2023-11-26T07:16:32.615574+0000","last_became_peered":"2023-11-26T07:16:32.615574+0000","last_unstale":"2023-11-26T07:16:34.684612+0000","last_undegraded":"2023-11-26T07:16:34.684612+0000","last_fullsized":"2023-11-26T07:16:34.684612+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:34:37.499588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:33.603053+0000","last_change":"2023-11-26T07:16:32.613513+0000","last_active":"2023-11-26T07:16:33.603053+0000","last_peered":"2023-11-26T07:16:33.603053+0000","last_clean":"2023-11-26T07:16:33.603053+0000","last_became_active":"2023-11-26T07:16:32.612504+0000","last_became_peered":"2023-11-26T07:16:32.612504+0000","last_unstale":"2023-11-26T07:16:33.603053+0000","last_undegraded":"2023-11-26T07:16:33.603053+0000","last_fullsized":"2023-11-26T07:16:33.603053+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:40:50.212252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:33.602743+0000","last_change":"2023-11-26T07:16:32.617086+0000","last_active":"2023-11-26T07:16:33.602743+0000","last_peered":"2023-11-26T07:16:33.602743+0000","last_clean":"2023-11-26T07:16:33.602743+0000","last_became_active":"2023-11-26T07:16:32.616743+0000","last_became_peered":"2023-11-26T07:16:32.616743+0000","last_unstale":"2023-11-26T07:16:33.602743+0000","last_undegraded":"2023-11-26T07:16:33.602743+0000","last_fullsized":"2023-11-26T07:16:33.602743+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:14:25.229178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.683443+0000","last_change":"2023-11-26T07:16:32.615803+0000","last_active":"2023-11-26T07:16:34.683443+0000","last_peered":"2023-11-26T07:16:34.683443+0000","last_clean":"2023-11-26T07:16:34.683443+0000","last_became_active":"2023-11-26T07:16:32.615511+0000","last_became_peered":"2023-11-26T07:16:32.615511+0000","last_unstale":"2023-11-26T07:16:34.683443+0000","last_undegraded":"2023-11-26T07:16:34.683443+0000","last_fullsized":"2023-11-26T07:16:34.683443+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:34:37.499588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.683204+0000","last_change":"2023-11-26T07:16:32.615006+0000","last_active":"2023-11-26T07:16:34.683204+0000","last_peered":"2023-11-26T07:16:34.683204+0000","last_clean":"2023-11-26T07:16:34.683204+0000","last_became_active":"2023-11-26T07:16:32.614731+0000","last_became_peered":"2023-11-26T07:16:32.614731+0000","last_unstale":"2023-11-26T07:16:34.683204+0000","last_undegraded":"2023-11-26T07:16:34.683204+0000","last_fullsized":"2023-11-26T07:16:34.683204+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:57:46.113545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:33.602887+0000","last_change":"2023-11-26T07:16:32.613001+0000","last_active":"2023-11-26T07:16:33.602887+0000","last_peered":"2023-11-26T07:16:33.602887+0000","last_clean":"2023-11-26T07:16:33.602887+0000","last_became_active":"2023-11-26T07:16:32.612112+0000","last_became_peered":"2023-11-26T07:16:32.612112+0000","last_unstale":"2023-11-26T07:16:33.602887+0000","last_undegraded":"2023-11-26T07:16:33.602887+0000","last_fullsized":"2023-11-26T07:16:33.602887+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:18:55.494557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:33.603585+0000","last_change":"2023-11-26T07:16:32.619615+0000","last_active":"2023-11-26T07:16:33.603585+0000","last_peered":"2023-11-26T07:16:33.603585+0000","last_clean":"2023-11-26T07:16:33.603585+0000","last_became_active":"2023-11-26T07:16:32.619330+0000","last_became_peered":"2023-11-26T07:16:32.619330+0000","last_unstale":"2023-11-26T07:16:33.603585+0000","last_undegraded":"2023-11-26T07:16:33.603585+0000","last_fullsized":"2023-11-26T07:16:33.603585+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:20:12.245158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684165+0000","last_change":"2023-11-26T07:16:32.615271+0000","last_active":"2023-11-26T07:16:34.684165+0000","last_peered":"2023-11-26T07:16:34.684165+0000","last_clean":"2023-11-26T07:16:34.684165+0000","last_became_active":"2023-11-26T07:16:32.614922+0000","last_became_peered":"2023-11-26T07:16:32.614922+0000","last_unstale":"2023-11-26T07:16:34.684165+0000","last_undegraded":"2023-11-26T07:16:34.684165+0000","last_fullsized":"2023-11-26T07:16:34.684165+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:58:34.678599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:33.603035+0000","last_change":"2023-11-26T07:16:32.613939+0000","last_active":"2023-11-26T07:16:33.603035+0000","last_peered":"2023-11-26T07:16:33.603035+0000","last_clean":"2023-11-26T07:16:33.603035+0000","last_became_active":"2023-11-26T07:16:32.613081+0000","last_became_peered":"2023-11-26T07:16:32.613081+0000","last_unstale":"2023-11-26T07:16:33.603035+0000","last_undegraded":"2023-11-26T07:16:33.603035+0000","last_fullsized":"2023-11-26T07:16:33.603035+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:18:48.867045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.683769+0000","last_change":"2023-11-26T07:16:32.618257+0000","last_active":"2023-11-26T07:16:34.683769+0000","last_peered":"2023-11-26T07:16:34.683769+0000","last_clean":"2023-11-26T07:16:34.683769+0000","last_became_active":"2023-11-26T07:16:32.617930+0000","last_became_peered":"2023-11-26T07:16:32.617930+0000","last_unstale":"2023-11-26T07:16:34.683769+0000","last_undegraded":"2023-11-26T07:16:34.683769+0000","last_fullsized":"2023-11-26T07:16:34.683769+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:22:46.782114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:33.602506+0000","last_change":"2023-11-26T07:16:32.619839+0000","last_active":"2023-11-26T07:16:33.602506+0000","last_peered":"2023-11-26T07:16:33.602506+0000","last_clean":"2023-11-26T07:16:33.602506+0000","last_became_active":"2023-11-26T07:16:32.619492+0000","last_became_peered":"2023-11-26T07:16:32.619492+0000","last_unstale":"2023-11-26T07:16:33.602506+0000","last_undegraded":"2023-11-26T07:16:33.602506+0000","last_fullsized":"2023-11-26T07:16:33.602506+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:38:36.670909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:33.603028+0000","last_change":"2023-11-26T07:16:32.620483+0000","last_active":"2023-11-26T07:16:33.603028+0000","last_peered":"2023-11-26T07:16:33.603028+0000","last_clean":"2023-11-26T07:16:33.603028+0000","last_became_active":"2023-11-26T07:16:32.620253+0000","last_became_peered":"2023-11-26T07:16:32.620253+0000","last_unstale":"2023-11-26T07:16:33.603028+0000","last_undegraded":"2023-11-26T07:16:33.603028+0000","last_fullsized":"2023-11-26T07:16:33.603028+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:11:19.983822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.683471+0000","last_change":"2023-11-26T07:16:32.613465+0000","last_active":"2023-11-26T07:16:34.683471+0000","last_peered":"2023-11-26T07:16:34.683471+0000","last_clean":"2023-11-26T07:16:34.683471+0000","last_became_active":"2023-11-26T07:16:32.613040+0000","last_became_peered":"2023-11-26T07:16:32.613040+0000","last_unstale":"2023-11-26T07:16:34.683471+0000","last_undegraded":"2023-11-26T07:16:34.683471+0000","last_fullsized":"2023-11-26T07:16:34.683471+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:45:46.931807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684727+0000","last_change":"2023-11-26T07:16:32.619825+0000","last_active":"2023-11-26T07:16:34.684727+0000","last_peered":"2023-11-26T07:16:34.684727+0000","last_clean":"2023-11-26T07:16:34.684727+0000","last_became_active":"2023-11-26T07:16:32.619568+0000","last_became_peered":"2023-11-26T07:16:32.619568+0000","last_unstale":"2023-11-26T07:16:34.684727+0000","last_undegraded":"2023-11-26T07:16:34.684727+0000","last_fullsized":"2023-11-26T07:16:34.684727+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:29:09.496861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"72'4","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.632843+0000","last_change":"2023-11-26T07:16:31.609063+0000","last_active":"2023-11-26T07:16:32.632843+0000","last_peered":"2023-11-26T07:16:32.632843+0000","last_clean":"2023-11-26T07:16:32.632843+0000","last_became_active":"2023-11-26T07:16:31.608791+0000","last_became_peered":"2023-11-26T07:16:31.608791+0000","last_unstale":"2023-11-26T07:16:32.632843+0000","last_undegraded":"2023-11-26T07:16:32.632843+0000","last_fullsized":"2023-11-26T07:16:32.632843+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:17:32.465955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.685729+0000","last_change":"2023-11-26T07:16:32.616574+0000","last_active":"2023-11-26T07:16:34.685729+0000","last_peered":"2023-11-26T07:16:34.685729+0000","last_clean":"2023-11-26T07:16:34.685729+0000","last_became_active":"2023-11-26T07:16:32.616323+0000","last_became_peered":"2023-11-26T07:16:32.616323+0000","last_unstale":"2023-11-26T07:16:34.685729+0000","last_undegraded":"2023-11-26T07:16:34.685729+0000","last_fullsized":"2023-11-26T07:16:34.685729+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:38:13.979994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"72'1","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.628853+0000","last_change":"2023-11-26T07:16:31.604650+0000","last_active":"2023-11-26T07:16:32.628853+0000","last_peered":"2023-11-26T07:16:32.628853+0000","last_clean":"2023-11-26T07:16:32.628853+0000","last_became_active":"2023-11-26T07:16:31.603826+0000","last_became_peered":"2023-11-26T07:16:31.603826+0000","last_unstale":"2023-11-26T07:16:32.628853+0000","last_undegraded":"2023-11-26T07:16:32.628853+0000","last_fullsized":"2023-11-26T07:16:32.628853+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:16:17.708450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684060+0000","last_change":"2023-11-26T07:16:32.610518+0000","last_active":"2023-11-26T07:16:34.684060+0000","last_peered":"2023-11-26T07:16:34.684060+0000","last_clean":"2023-11-26T07:16:34.684060+0000","last_became_active":"2023-11-26T07:16:32.610152+0000","last_became_peered":"2023-11-26T07:16:32.610152+0000","last_unstale":"2023-11-26T07:16:34.684060+0000","last_undegraded":"2023-11-26T07:16:34.684060+0000","last_fullsized":"2023-11-26T07:16:34.684060+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:41:17.390172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"72'2","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.630580+0000","last_change":"2023-11-26T07:16:31.606982+0000","last_active":"2023-11-26T07:16:32.630580+0000","last_peered":"2023-11-26T07:16:32.630580+0000","last_clean":"2023-11-26T07:16:32.630580+0000","last_became_active":"2023-11-26T07:16:31.606668+0000","last_became_peered":"2023-11-26T07:16:31.606668+0000","last_unstale":"2023-11-26T07:16:32.630580+0000","last_undegraded":"2023-11-26T07:16:32.630580+0000","last_fullsized":"2023-11-26T07:16:32.630580+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:00:32.449928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684185+0000","last_change":"2023-11-26T07:16:32.613348+0000","last_active":"2023-11-26T07:16:34.684185+0000","last_peered":"2023-11-26T07:16:34.684185+0000","last_clean":"2023-11-26T07:16:34.684185+0000","last_became_active":"2023-11-26T07:16:32.612758+0000","last_became_peered":"2023-11-26T07:16:32.612758+0000","last_unstale":"2023-11-26T07:16:34.684185+0000","last_undegraded":"2023-11-26T07:16:34.684185+0000","last_fullsized":"2023-11-26T07:16:34.684185+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:32:20.894157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"72'2","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.629649+0000","last_change":"2023-11-26T07:16:31.606756+0000","last_active":"2023-11-26T07:16:32.629649+0000","last_peered":"2023-11-26T07:16:32.629649+0000","last_clean":"2023-11-26T07:16:32.629649+0000","last_became_active":"2023-11-26T07:16:31.606493+0000","last_became_peered":"2023-11-26T07:16:31.606493+0000","last_unstale":"2023-11-26T07:16:32.629649+0000","last_undegraded":"2023-11-26T07:16:32.629649+0000","last_fullsized":"2023-11-26T07:16:32.629649+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:57:57.978717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:33.602539+0000","last_change":"2023-11-26T07:16:32.619508+0000","last_active":"2023-11-26T07:16:33.602539+0000","last_peered":"2023-11-26T07:16:33.602539+0000","last_clean":"2023-11-26T07:16:33.602539+0000","last_became_active":"2023-11-26T07:16:32.619183+0000","last_became_peered":"2023-11-26T07:16:32.619183+0000","last_unstale":"2023-11-26T07:16:33.602539+0000","last_undegraded":"2023-11-26T07:16:33.602539+0000","last_fullsized":"2023-11-26T07:16:33.602539+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:53:53.607029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"72'1","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.628123+0000","last_change":"2023-11-26T07:16:31.598926+0000","last_active":"2023-11-26T07:16:32.628123+0000","last_peered":"2023-11-26T07:16:32.628123+0000","last_clean":"2023-11-26T07:16:32.628123+0000","last_became_active":"2023-11-26T07:16:31.598622+0000","last_became_peered":"2023-11-26T07:16:31.598622+0000","last_unstale":"2023-11-26T07:16:32.628123+0000","last_undegraded":"2023-11-26T07:16:32.628123+0000","last_fullsized":"2023-11-26T07:16:32.628123+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:27:02.135913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:33.603118+0000","last_change":"2023-11-26T07:16:32.617082+0000","last_active":"2023-11-26T07:16:33.603118+0000","last_peered":"2023-11-26T07:16:33.603118+0000","last_clean":"2023-11-26T07:16:33.603118+0000","last_became_active":"2023-11-26T07:16:32.616776+0000","last_became_peered":"2023-11-26T07:16:32.616776+0000","last_unstale":"2023-11-26T07:16:33.603118+0000","last_undegraded":"2023-11-26T07:16:33.603118+0000","last_fullsized":"2023-11-26T07:16:33.603118+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:47:38.663037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"72'1","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.629496+0000","last_change":"2023-11-26T07:16:31.608252+0000","last_active":"2023-11-26T07:16:32.629496+0000","last_peered":"2023-11-26T07:16:32.629496+0000","last_clean":"2023-11-26T07:16:32.629496+0000","last_became_active":"2023-11-26T07:16:31.607942+0000","last_became_peered":"2023-11-26T07:16:31.607942+0000","last_unstale":"2023-11-26T07:16:32.629496+0000","last_undegraded":"2023-11-26T07:16:32.629496+0000","last_fullsized":"2023-11-26T07:16:32.629496+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:08:07.953306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684255+0000","last_change":"2023-11-26T07:16:32.615693+0000","last_active":"2023-11-26T07:16:34.684255+0000","last_peered":"2023-11-26T07:16:34.684255+0000","last_clean":"2023-11-26T07:16:34.684255+0000","last_became_active":"2023-11-26T07:16:32.615387+0000","last_became_peered":"2023-11-26T07:16:32.615387+0000","last_unstale":"2023-11-26T07:16:34.684255+0000","last_undegraded":"2023-11-26T07:16:34.684255+0000","last_fullsized":"2023-11-26T07:16:34.684255+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:22:15.436742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.599229+0000","last_change":"2023-11-26T07:16:31.597056+0000","last_active":"2023-11-26T07:16:32.599229+0000","last_peered":"2023-11-26T07:16:32.599229+0000","last_clean":"2023-11-26T07:16:32.599229+0000","last_became_active":"2023-11-26T07:16:31.596785+0000","last_became_peered":"2023-11-26T07:16:31.596785+0000","last_unstale":"2023-11-26T07:16:32.599229+0000","last_undegraded":"2023-11-26T07:16:32.599229+0000","last_fullsized":"2023-11-26T07:16:32.599229+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:31:17.102746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684504+0000","last_change":"2023-11-26T07:16:32.612269+0000","last_active":"2023-11-26T07:16:34.684504+0000","last_peered":"2023-11-26T07:16:34.684504+0000","last_clean":"2023-11-26T07:16:34.684504+0000","last_became_active":"2023-11-26T07:16:32.611995+0000","last_became_peered":"2023-11-26T07:16:32.611995+0000","last_unstale":"2023-11-26T07:16:34.684504+0000","last_undegraded":"2023-11-26T07:16:34.684504+0000","last_fullsized":"2023-11-26T07:16:34.684504+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:17:09.530143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.604759+0000","last_change":"2023-11-26T07:16:31.608983+0000","last_active":"2023-11-26T07:16:32.604759+0000","last_peered":"2023-11-26T07:16:32.604759+0000","last_clean":"2023-11-26T07:16:32.604759+0000","last_became_active":"2023-11-26T07:16:31.608647+0000","last_became_peered":"2023-11-26T07:16:31.608647+0000","last_unstale":"2023-11-26T07:16:32.604759+0000","last_undegraded":"2023-11-26T07:16:32.604759+0000","last_fullsized":"2023-11-26T07:16:32.604759+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:58:15.884166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:33.603607+0000","last_change":"2023-11-26T07:16:32.618385+0000","last_active":"2023-11-26T07:16:33.603607+0000","last_peered":"2023-11-26T07:16:33.603607+0000","last_clean":"2023-11-26T07:16:33.603607+0000","last_became_active":"2023-11-26T07:16:32.617766+0000","last_became_peered":"2023-11-26T07:16:32.617766+0000","last_unstale":"2023-11-26T07:16:33.603607+0000","last_undegraded":"2023-11-26T07:16:33.603607+0000","last_fullsized":"2023-11-26T07:16:33.603607+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:16:18.713951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.613259+0000","last_change":"2023-11-26T07:16:31.597710+0000","last_active":"2023-11-26T07:16:32.613259+0000","last_peered":"2023-11-26T07:16:32.613259+0000","last_clean":"2023-11-26T07:16:32.613259+0000","last_became_active":"2023-11-26T07:16:31.597421+0000","last_became_peered":"2023-11-26T07:16:31.597421+0000","last_unstale":"2023-11-26T07:16:32.613259+0000","last_undegraded":"2023-11-26T07:16:32.613259+0000","last_fullsized":"2023-11-26T07:16:32.613259+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:09:53.078448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684501+0000","last_change":"2023-11-26T07:16:32.613841+0000","last_active":"2023-11-26T07:16:34.684501+0000","last_peered":"2023-11-26T07:16:34.684501+0000","last_clean":"2023-11-26T07:16:34.684501+0000","last_became_active":"2023-11-26T07:16:32.611722+0000","last_became_peered":"2023-11-26T07:16:32.611722+0000","last_unstale":"2023-11-26T07:16:34.684501+0000","last_undegraded":"2023-11-26T07:16:34.684501+0000","last_fullsized":"2023-11-26T07:16:34.684501+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:20:33.530404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.602407+0000","last_change":"2023-11-26T07:16:31.607372+0000","last_active":"2023-11-26T07:16:32.602407+0000","last_peered":"2023-11-26T07:16:32.602407+0000","last_clean":"2023-11-26T07:16:32.602407+0000","last_became_active":"2023-11-26T07:16:31.607094+0000","last_became_peered":"2023-11-26T07:16:31.607094+0000","last_unstale":"2023-11-26T07:16:32.602407+0000","last_undegraded":"2023-11-26T07:16:32.602407+0000","last_fullsized":"2023-11-26T07:16:32.602407+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:33:34.607255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684115+0000","last_change":"2023-11-26T07:16:32.617526+0000","last_active":"2023-11-26T07:16:34.684115+0000","last_peered":"2023-11-26T07:16:34.684115+0000","last_clean":"2023-11-26T07:16:34.684115+0000","last_became_active":"2023-11-26T07:16:32.617221+0000","last_became_peered":"2023-11-26T07:16:32.617221+0000","last_unstale":"2023-11-26T07:16:34.684115+0000","last_undegraded":"2023-11-26T07:16:34.684115+0000","last_fullsized":"2023-11-26T07:16:34.684115+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:19:33.039679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"72'3","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.630749+0000","last_change":"2023-11-26T07:16:31.598168+0000","last_active":"2023-11-26T07:16:32.630749+0000","last_peered":"2023-11-26T07:16:32.630749+0000","last_clean":"2023-11-26T07:16:32.630749+0000","last_became_active":"2023-11-26T07:16:31.597799+0000","last_became_peered":"2023-11-26T07:16:31.597799+0000","last_unstale":"2023-11-26T07:16:32.630749+0000","last_undegraded":"2023-11-26T07:16:32.630749+0000","last_fullsized":"2023-11-26T07:16:32.630749+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:04:07.878362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.685178+0000","last_change":"2023-11-26T07:16:32.610873+0000","last_active":"2023-11-26T07:16:34.685178+0000","last_peered":"2023-11-26T07:16:34.685178+0000","last_clean":"2023-11-26T07:16:34.685178+0000","last_became_active":"2023-11-26T07:16:32.610543+0000","last_became_peered":"2023-11-26T07:16:32.610543+0000","last_unstale":"2023-11-26T07:16:34.685178+0000","last_undegraded":"2023-11-26T07:16:34.685178+0000","last_fullsized":"2023-11-26T07:16:34.685178+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:33:19.962746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"72'6","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.630814+0000","last_change":"2023-11-26T07:16:31.605820+0000","last_active":"2023-11-26T07:16:32.630814+0000","last_peered":"2023-11-26T07:16:32.630814+0000","last_clean":"2023-11-26T07:16:32.630814+0000","last_became_active":"2023-11-26T07:16:31.604337+0000","last_became_peered":"2023-11-26T07:16:31.604337+0000","last_unstale":"2023-11-26T07:16:32.630814+0000","last_undegraded":"2023-11-26T07:16:32.630814+0000","last_fullsized":"2023-11-26T07:16:32.630814+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:51:01.983190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.683385+0000","last_change":"2023-11-26T07:16:32.617621+0000","last_active":"2023-11-26T07:16:34.683385+0000","last_peered":"2023-11-26T07:16:34.683385+0000","last_clean":"2023-11-26T07:16:34.683385+0000","last_became_active":"2023-11-26T07:16:32.617351+0000","last_became_peered":"2023-11-26T07:16:32.617351+0000","last_unstale":"2023-11-26T07:16:34.683385+0000","last_undegraded":"2023-11-26T07:16:34.683385+0000","last_fullsized":"2023-11-26T07:16:34.683385+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:17:09.530143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"72'2","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.633174+0000","last_change":"2023-11-26T07:16:31.607105+0000","last_active":"2023-11-26T07:16:32.633174+0000","last_peered":"2023-11-26T07:16:32.633174+0000","last_clean":"2023-11-26T07:16:32.633174+0000","last_became_active":"2023-11-26T07:16:31.606832+0000","last_became_peered":"2023-11-26T07:16:31.606832+0000","last_unstale":"2023-11-26T07:16:32.633174+0000","last_undegraded":"2023-11-26T07:16:32.633174+0000","last_fullsized":"2023-11-26T07:16:32.633174+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:06:59.820803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:33.603558+0000","last_change":"2023-11-26T07:16:32.615375+0000","last_active":"2023-11-26T07:16:33.603558+0000","last_peered":"2023-11-26T07:16:33.603558+0000","last_clean":"2023-11-26T07:16:33.603558+0000","last_became_active":"2023-11-26T07:16:32.614958+0000","last_became_peered":"2023-11-26T07:16:32.614958+0000","last_unstale":"2023-11-26T07:16:33.603558+0000","last_undegraded":"2023-11-26T07:16:33.603558+0000","last_fullsized":"2023-11-26T07:16:33.603558+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:37:37.450735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.602059+0000","last_change":"2023-11-26T07:16:31.607550+0000","last_active":"2023-11-26T07:16:32.602059+0000","last_peered":"2023-11-26T07:16:32.602059+0000","last_clean":"2023-11-26T07:16:32.602059+0000","last_became_active":"2023-11-26T07:16:31.607266+0000","last_became_peered":"2023-11-26T07:16:31.607266+0000","last_unstale":"2023-11-26T07:16:32.602059+0000","last_undegraded":"2023-11-26T07:16:32.602059+0000","last_fullsized":"2023-11-26T07:16:32.602059+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:21:29.309253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.683219+0000","last_change":"2023-11-26T07:16:32.614041+0000","last_active":"2023-11-26T07:16:34.683219+0000","last_peered":"2023-11-26T07:16:34.683219+0000","last_clean":"2023-11-26T07:16:34.683219+0000","last_became_active":"2023-11-26T07:16:32.613666+0000","last_became_peered":"2023-11-26T07:16:32.613666+0000","last_unstale":"2023-11-26T07:16:34.683219+0000","last_undegraded":"2023-11-26T07:16:34.683219+0000","last_fullsized":"2023-11-26T07:16:34.683219+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:17:33.471457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.610711+0000","last_change":"2023-11-26T07:16:31.598844+0000","last_active":"2023-11-26T07:16:32.610711+0000","last_peered":"2023-11-26T07:16:32.610711+0000","last_clean":"2023-11-26T07:16:32.610711+0000","last_became_active":"2023-11-26T07:16:31.598510+0000","last_became_peered":"2023-11-26T07:16:31.598510+0000","last_unstale":"2023-11-26T07:16:32.610711+0000","last_undegraded":"2023-11-26T07:16:32.610711+0000","last_fullsized":"2023-11-26T07:16:32.610711+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:18:47.861543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.683601+0000","last_change":"2023-11-26T07:16:32.611301+0000","last_active":"2023-11-26T07:16:34.683601+0000","last_peered":"2023-11-26T07:16:34.683601+0000","last_clean":"2023-11-26T07:16:34.683601+0000","last_became_active":"2023-11-26T07:16:32.610472+0000","last_became_peered":"2023-11-26T07:16:32.610472+0000","last_unstale":"2023-11-26T07:16:34.683601+0000","last_undegraded":"2023-11-26T07:16:34.683601+0000","last_fullsized":"2023-11-26T07:16:34.683601+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:43:40.695058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"72'8","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.635419+0000","last_change":"2023-11-26T07:16:31.609252+0000","last_active":"2023-11-26T07:16:32.635419+0000","last_peered":"2023-11-26T07:16:32.635419+0000","last_clean":"2023-11-26T07:16:32.635419+0000","last_became_active":"2023-11-26T07:16:31.608944+0000","last_became_peered":"2023-11-26T07:16:31.608944+0000","last_unstale":"2023-11-26T07:16:32.635419+0000","last_undegraded":"2023-11-26T07:16:32.635419+0000","last_fullsized":"2023-11-26T07:16:32.635419+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:50:58.857404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:33.602978+0000","last_change":"2023-11-26T07:16:32.614041+0000","last_active":"2023-11-26T07:16:33.602978+0000","last_peered":"2023-11-26T07:16:33.602978+0000","last_clean":"2023-11-26T07:16:33.602978+0000","last_became_active":"2023-11-26T07:16:32.612690+0000","last_became_peered":"2023-11-26T07:16:32.612690+0000","last_unstale":"2023-11-26T07:16:33.602978+0000","last_undegraded":"2023-11-26T07:16:33.602978+0000","last_fullsized":"2023-11-26T07:16:33.602978+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:53:37.327075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"72'1","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.629788+0000","last_change":"2023-11-26T07:16:31.608619+0000","last_active":"2023-11-26T07:16:32.629788+0000","last_peered":"2023-11-26T07:16:32.629788+0000","last_clean":"2023-11-26T07:16:32.629788+0000","last_became_active":"2023-11-26T07:16:31.608154+0000","last_became_peered":"2023-11-26T07:16:31.608154+0000","last_unstale":"2023-11-26T07:16:32.629788+0000","last_undegraded":"2023-11-26T07:16:32.629788+0000","last_fullsized":"2023-11-26T07:16:32.629788+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:45:09.704394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684609+0000","last_change":"2023-11-26T07:16:32.612346+0000","last_active":"2023-11-26T07:16:34.684609+0000","last_peered":"2023-11-26T07:16:34.684609+0000","last_clean":"2023-11-26T07:16:34.684609+0000","last_became_active":"2023-11-26T07:16:32.612085+0000","last_became_peered":"2023-11-26T07:16:32.612085+0000","last_unstale":"2023-11-26T07:16:34.684609+0000","last_undegraded":"2023-11-26T07:16:34.684609+0000","last_fullsized":"2023-11-26T07:16:34.684609+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:09:19.109225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"72'2","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.630473+0000","last_change":"2023-11-26T07:16:31.608166+0000","last_active":"2023-11-26T07:16:32.630473+0000","last_peered":"2023-11-26T07:16:32.630473+0000","last_clean":"2023-11-26T07:16:32.630473+0000","last_became_active":"2023-11-26T07:16:31.607443+0000","last_became_peered":"2023-11-26T07:16:31.607443+0000","last_unstale":"2023-11-26T07:16:32.630473+0000","last_undegraded":"2023-11-26T07:16:32.630473+0000","last_fullsized":"2023-11-26T07:16:32.630473+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:41:16.384671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684550+0000","last_change":"2023-11-26T07:16:32.611054+0000","last_active":"2023-11-26T07:16:34.684550+0000","last_peered":"2023-11-26T07:16:34.684550+0000","last_clean":"2023-11-26T07:16:34.684550+0000","last_became_active":"2023-11-26T07:16:32.610739+0000","last_became_peered":"2023-11-26T07:16:32.610739+0000","last_unstale":"2023-11-26T07:16:34.684550+0000","last_undegraded":"2023-11-26T07:16:34.684550+0000","last_fullsized":"2023-11-26T07:16:34.684550+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:59:41.247469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"72'1","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.630575+0000","last_change":"2023-11-26T07:16:31.602892+0000","last_active":"2023-11-26T07:16:32.630575+0000","last_peered":"2023-11-26T07:16:32.630575+0000","last_clean":"2023-11-26T07:16:32.630575+0000","last_became_active":"2023-11-26T07:16:31.602626+0000","last_became_peered":"2023-11-26T07:16:31.602626+0000","last_unstale":"2023-11-26T07:16:32.630575+0000","last_undegraded":"2023-11-26T07:16:32.630575+0000","last_fullsized":"2023-11-26T07:16:32.630575+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:29:16.462035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.685337+0000","last_change":"2023-11-26T07:16:32.614550+0000","last_active":"2023-11-26T07:16:34.685337+0000","last_peered":"2023-11-26T07:16:34.685337+0000","last_clean":"2023-11-26T07:16:34.685337+0000","last_became_active":"2023-11-26T07:16:32.614213+0000","last_became_peered":"2023-11-26T07:16:32.614213+0000","last_unstale":"2023-11-26T07:16:34.685337+0000","last_undegraded":"2023-11-26T07:16:34.685337+0000","last_fullsized":"2023-11-26T07:16:34.685337+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:00:38.342286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.606570+0000","last_change":"2023-11-26T07:16:31.606767+0000","last_active":"2023-11-26T07:16:32.606570+0000","last_peered":"2023-11-26T07:16:32.606570+0000","last_clean":"2023-11-26T07:16:32.606570+0000","last_became_active":"2023-11-26T07:16:31.606477+0000","last_became_peered":"2023-11-26T07:16:31.606477+0000","last_unstale":"2023-11-26T07:16:32.606570+0000","last_undegraded":"2023-11-26T07:16:32.606570+0000","last_fullsized":"2023-11-26T07:16:32.606570+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:28:33.865475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.683882+0000","last_change":"2023-11-26T07:16:32.609910+0000","last_active":"2023-11-26T07:16:34.683882+0000","last_peered":"2023-11-26T07:16:34.683882+0000","last_clean":"2023-11-26T07:16:34.683882+0000","last_became_active":"2023-11-26T07:16:32.609596+0000","last_became_peered":"2023-11-26T07:16:32.609596+0000","last_unstale":"2023-11-26T07:16:34.683882+0000","last_undegraded":"2023-11-26T07:16:34.683882+0000","last_fullsized":"2023-11-26T07:16:34.683882+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:57:21.048560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.602152+0000","last_change":"2023-11-26T07:16:31.607018+0000","last_active":"2023-11-26T07:16:32.602152+0000","last_peered":"2023-11-26T07:16:32.602152+0000","last_clean":"2023-11-26T07:16:32.602152+0000","last_became_active":"2023-11-26T07:16:31.606736+0000","last_became_peered":"2023-11-26T07:16:31.606736+0000","last_unstale":"2023-11-26T07:16:32.602152+0000","last_undegraded":"2023-11-26T07:16:32.602152+0000","last_fullsized":"2023-11-26T07:16:32.602152+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:27:23.533262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.683393+0000","last_change":"2023-11-26T07:16:32.619922+0000","last_active":"2023-11-26T07:16:34.683393+0000","last_peered":"2023-11-26T07:16:34.683393+0000","last_clean":"2023-11-26T07:16:34.683393+0000","last_became_active":"2023-11-26T07:16:32.614974+0000","last_became_peered":"2023-11-26T07:16:32.614974+0000","last_unstale":"2023-11-26T07:16:34.683393+0000","last_undegraded":"2023-11-26T07:16:34.683393+0000","last_fullsized":"2023-11-26T07:16:34.683393+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:39:03.101817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.610858+0000","last_change":"2023-11-26T07:16:31.604168+0000","last_active":"2023-11-26T07:16:32.610858+0000","last_peered":"2023-11-26T07:16:32.610858+0000","last_clean":"2023-11-26T07:16:32.610858+0000","last_became_active":"2023-11-26T07:16:31.603852+0000","last_became_peered":"2023-11-26T07:16:31.603852+0000","last_unstale":"2023-11-26T07:16:32.610858+0000","last_undegraded":"2023-11-26T07:16:32.610858+0000","last_fullsized":"2023-11-26T07:16:32.610858+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:40:49.206751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.683564+0000","last_change":"2023-11-26T07:16:32.613314+0000","last_active":"2023-11-26T07:16:34.683564+0000","last_peered":"2023-11-26T07:16:34.683564+0000","last_clean":"2023-11-26T07:16:34.683564+0000","last_became_active":"2023-11-26T07:16:32.612725+0000","last_became_peered":"2023-11-26T07:16:32.612725+0000","last_unstale":"2023-11-26T07:16:34.683564+0000","last_undegraded":"2023-11-26T07:16:34.683564+0000","last_fullsized":"2023-11-26T07:16:34.683564+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:35:15.962276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.607597+0000","last_change":"2023-11-26T07:16:31.603291+0000","last_active":"2023-11-26T07:16:32.607597+0000","last_peered":"2023-11-26T07:16:32.607597+0000","last_clean":"2023-11-26T07:16:32.607597+0000","last_became_active":"2023-11-26T07:16:31.603030+0000","last_became_peered":"2023-11-26T07:16:31.603030+0000","last_unstale":"2023-11-26T07:16:32.607597+0000","last_undegraded":"2023-11-26T07:16:32.607597+0000","last_fullsized":"2023-11-26T07:16:32.607597+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:20:11.239657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684760+0000","last_change":"2023-11-26T07:16:32.617970+0000","last_active":"2023-11-26T07:16:34.684760+0000","last_peered":"2023-11-26T07:16:34.684760+0000","last_clean":"2023-11-26T07:16:34.684760+0000","last_became_active":"2023-11-26T07:16:32.617511+0000","last_became_peered":"2023-11-26T07:16:32.617511+0000","last_unstale":"2023-11-26T07:16:34.684760+0000","last_undegraded":"2023-11-26T07:16:34.684760+0000","last_fullsized":"2023-11-26T07:16:34.684760+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:29:55.413054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"72'2","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.629684+0000","last_change":"2023-11-26T07:16:31.608037+0000","last_active":"2023-11-26T07:16:32.629684+0000","last_peered":"2023-11-26T07:16:32.629684+0000","last_clean":"2023-11-26T07:16:32.629684+0000","last_became_active":"2023-11-26T07:16:31.607653+0000","last_became_peered":"2023-11-26T07:16:31.607653+0000","last_unstale":"2023-11-26T07:16:32.629684+0000","last_undegraded":"2023-11-26T07:16:32.629684+0000","last_fullsized":"2023-11-26T07:16:32.629684+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:14:46.356838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:33.603609+0000","last_change":"2023-11-26T07:16:32.618893+0000","last_active":"2023-11-26T07:16:33.603609+0000","last_peered":"2023-11-26T07:16:33.603609+0000","last_clean":"2023-11-26T07:16:33.603609+0000","last_became_active":"2023-11-26T07:16:32.618423+0000","last_became_peered":"2023-11-26T07:16:32.618423+0000","last_unstale":"2023-11-26T07:16:33.603609+0000","last_undegraded":"2023-11-26T07:16:33.603609+0000","last_fullsized":"2023-11-26T07:16:33.603609+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:48:30.404873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.611654+0000","last_change":"2023-11-26T07:16:31.601496+0000","last_active":"2023-11-26T07:16:32.611654+0000","last_peered":"2023-11-26T07:16:32.611654+0000","last_clean":"2023-11-26T07:16:32.611654+0000","last_became_active":"2023-11-26T07:16:31.600854+0000","last_became_peered":"2023-11-26T07:16:31.600854+0000","last_unstale":"2023-11-26T07:16:32.611654+0000","last_undegraded":"2023-11-26T07:16:32.611654+0000","last_fullsized":"2023-11-26T07:16:32.611654+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:55:10.145719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.683876+0000","last_change":"2023-11-26T07:16:32.615796+0000","last_active":"2023-11-26T07:16:34.683876+0000","last_peered":"2023-11-26T07:16:34.683876+0000","last_clean":"2023-11-26T07:16:34.683876+0000","last_became_active":"2023-11-26T07:16:32.615443+0000","last_became_peered":"2023-11-26T07:16:32.615443+0000","last_unstale":"2023-11-26T07:16:34.683876+0000","last_undegraded":"2023-11-26T07:16:34.683876+0000","last_fullsized":"2023-11-26T07:16:34.683876+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:56:01.891239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.605836+0000","last_change":"2023-11-26T07:16:31.611255+0000","last_active":"2023-11-26T07:16:32.605836+0000","last_peered":"2023-11-26T07:16:32.605836+0000","last_clean":"2023-11-26T07:16:32.605836+0000","last_became_active":"2023-11-26T07:16:31.610936+0000","last_became_peered":"2023-11-26T07:16:31.610936+0000","last_unstale":"2023-11-26T07:16:32.605836+0000","last_undegraded":"2023-11-26T07:16:32.605836+0000","last_fullsized":"2023-11-26T07:16:32.605836+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:03:32.957406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684337+0000","last_change":"2023-11-26T07:16:32.618954+0000","last_active":"2023-11-26T07:16:34.684337+0000","last_peered":"2023-11-26T07:16:34.684337+0000","last_clean":"2023-11-26T07:16:34.684337+0000","last_became_active":"2023-11-26T07:16:32.618687+0000","last_became_peered":"2023-11-26T07:16:32.618687+0000","last_unstale":"2023-11-26T07:16:34.684337+0000","last_undegraded":"2023-11-26T07:16:34.684337+0000","last_fullsized":"2023-11-26T07:16:34.684337+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:25:17.238441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.603680+0000","last_change":"2023-11-26T07:16:31.604687+0000","last_active":"2023-11-26T07:16:32.603680+0000","last_peered":"2023-11-26T07:16:32.603680+0000","last_clean":"2023-11-26T07:16:32.603680+0000","last_became_active":"2023-11-26T07:16:31.604369+0000","last_became_peered":"2023-11-26T07:16:31.604369+0000","last_unstale":"2023-11-26T07:16:32.603680+0000","last_undegraded":"2023-11-26T07:16:32.603680+0000","last_fullsized":"2023-11-26T07:16:32.603680+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:53:52.601528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.685108+0000","last_change":"2023-11-26T07:16:32.614667+0000","last_active":"2023-11-26T07:16:34.685108+0000","last_peered":"2023-11-26T07:16:34.685108+0000","last_clean":"2023-11-26T07:16:34.685108+0000","last_became_active":"2023-11-26T07:16:32.614343+0000","last_became_peered":"2023-11-26T07:16:32.614343+0000","last_unstale":"2023-11-26T07:16:34.685108+0000","last_undegraded":"2023-11-26T07:16:34.685108+0000","last_fullsized":"2023-11-26T07:16:34.685108+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:36:14.386458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.605760+0000","last_change":"2023-11-26T07:16:31.606737+0000","last_active":"2023-11-26T07:16:32.605760+0000","last_peered":"2023-11-26T07:16:32.605760+0000","last_clean":"2023-11-26T07:16:32.605760+0000","last_became_active":"2023-11-26T07:16:31.606477+0000","last_became_peered":"2023-11-26T07:16:31.606477+0000","last_unstale":"2023-11-26T07:16:32.605760+0000","last_undegraded":"2023-11-26T07:16:32.605760+0000","last_fullsized":"2023-11-26T07:16:32.605760+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:01:31.967021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.683892+0000","last_change":"2023-11-26T07:16:32.610076+0000","last_active":"2023-11-26T07:16:34.683892+0000","last_peered":"2023-11-26T07:16:34.683892+0000","last_clean":"2023-11-26T07:16:34.683892+0000","last_became_active":"2023-11-26T07:16:32.609769+0000","last_became_peered":"2023-11-26T07:16:32.609769+0000","last_unstale":"2023-11-26T07:16:34.683892+0000","last_undegraded":"2023-11-26T07:16:34.683892+0000","last_fullsized":"2023-11-26T07:16:34.683892+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:00:33.455429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.599130+0000","last_change":"2023-11-26T07:16:31.597623+0000","last_active":"2023-11-26T07:16:32.599130+0000","last_peered":"2023-11-26T07:16:32.599130+0000","last_clean":"2023-11-26T07:16:32.599130+0000","last_became_active":"2023-11-26T07:16:31.597356+0000","last_became_peered":"2023-11-26T07:16:31.597356+0000","last_unstale":"2023-11-26T07:16:32.599130+0000","last_undegraded":"2023-11-26T07:16:32.599130+0000","last_fullsized":"2023-11-26T07:16:32.599130+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:38:12.974493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.684450+0000","last_change":"2023-11-26T07:16:32.605868+0000","last_active":"2023-11-26T07:16:34.684450+0000","last_peered":"2023-11-26T07:16:34.684450+0000","last_clean":"2023-11-26T07:16:34.684450+0000","last_became_active":"2023-11-26T07:16:32.605532+0000","last_became_peered":"2023-11-26T07:16:32.605532+0000","last_unstale":"2023-11-26T07:16:34.684450+0000","last_undegraded":"2023-11-26T07:16:34.684450+0000","last_fullsized":"2023-11-26T07:16:34.684450+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:52:53.868801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.612506+0000","last_change":"2023-11-26T07:16:31.605393+0000","last_active":"2023-11-26T07:16:32.612506+0000","last_peered":"2023-11-26T07:16:32.612506+0000","last_clean":"2023-11-26T07:16:32.612506+0000","last_became_active":"2023-11-26T07:16:31.605134+0000","last_became_peered":"2023-11-26T07:16:31.605134+0000","last_unstale":"2023-11-26T07:16:32.612506+0000","last_undegraded":"2023-11-26T07:16:32.612506+0000","last_fullsized":"2023-11-26T07:16:32.612506+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:04:43.215372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.683636+0000","last_change":"2023-11-26T07:16:32.611231+0000","last_active":"2023-11-26T07:16:34.683636+0000","last_peered":"2023-11-26T07:16:34.683636+0000","last_clean":"2023-11-26T07:16:34.683636+0000","last_became_active":"2023-11-26T07:16:32.610935+0000","last_became_peered":"2023-11-26T07:16:32.610935+0000","last_unstale":"2023-11-26T07:16:34.683636+0000","last_undegraded":"2023-11-26T07:16:34.683636+0000","last_fullsized":"2023-11-26T07:16:34.683636+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:04:44.220873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.601963+0000","last_change":"2023-11-26T07:16:31.605773+0000","last_active":"2023-11-26T07:16:32.601963+0000","last_peered":"2023-11-26T07:16:32.601963+0000","last_clean":"2023-11-26T07:16:32.601963+0000","last_became_active":"2023-11-26T07:16:31.605493+0000","last_became_peered":"2023-11-26T07:16:31.605493+0000","last_unstale":"2023-11-26T07:16:32.601963+0000","last_undegraded":"2023-11-26T07:16:32.601963+0000","last_fullsized":"2023-11-26T07:16:32.601963+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:00:14.422829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-11-26T07:16:34.683771+0000","last_change":"2023-11-26T07:16:32.613816+0000","last_active":"2023-11-26T07:16:34.683771+0000","last_peered":"2023-11-26T07:16:34.683771+0000","last_clean":"2023-11-26T07:16:34.683771+0000","last_became_active":"2023-11-26T07:16:32.613166+0000","last_became_peered":"2023-11-26T07:16:32.613166+0000","last_unstale":"2023-11-26T07:16:34.683771+0000","last_undegraded":"2023-11-26T07:16:34.683771+0000","last_fullsized":"2023-11-26T07:16:34.683771+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:31.584625+0000","last_clean_scrub_stamp":"2023-11-26T07:16:31.584625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:46:31.392268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"72'2","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.629566+0000","last_change":"2023-11-26T07:16:31.603942+0000","last_active":"2023-11-26T07:16:32.629566+0000","last_peered":"2023-11-26T07:16:32.629566+0000","last_clean":"2023-11-26T07:16:32.629566+0000","last_became_active":"2023-11-26T07:16:31.603643+0000","last_became_peered":"2023-11-26T07:16:31.603643+0000","last_unstale":"2023-11-26T07:16:32.629566+0000","last_undegraded":"2023-11-26T07:16:32.629566+0000","last_fullsized":"2023-11-26T07:16:32.629566+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:16:30.579124+0000","last_clean_scrub_stamp":"2023-11-26T07:16:30.579124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:13:51.805422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":211,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-11-26T07:16:32.605104+0000","last_change":"2023-11-26T07:11:29.855919+0000","last_active":"2023-11-26T07:16:32.605104+0000","last_peered":"2023-11-26T07:16:32.605104+0000","last_clean":"2023-11-26T07:16:32.605104+0000","last_became_active":"2023-11-26T07:11:29.854903+0000","last_became_peered":"2023-11-26T07:11:29.854903+0000","last_unstale":"2023-11-26T07:16:32.605104+0000","last_undegraded":"2023-11-26T07:16:32.605104+0000","last_fullsized":"2023-11-26T07:16:32.605104+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:28.594252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:28.594252+0000","last_clean_scrub_stamp":"2023-11-26T07:11:28.594252+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:33:34.642696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574915,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32640,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339200,"statfs":{"total":96636764160,"available":96603340800,"internally_reserved":0,"allocated":1490944,"data_stored":968662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:15:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34000000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.66600000000000004,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.51100000000000001,"15min":0.505},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.64400000000000002,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.39700000000000002}]},{"osd":1,"last update":"Sun Nov 26 07:15:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.74299999999999999,"15min":0.94499999999999995},"min":{"1min":0.38600000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72199999999999998,"5min":9.5600000000000005,"15min":9.5600000000000005},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56100000000000005,"15min":0.57699999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.69599999999999995,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.51700000000000002}]},{"osd":2,"last update":"Sun Nov 26 07:15:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.58699999999999997,"15min":0.59899999999999998},"min":{"1min":0.42999999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.65700000000000003,"5min":1.569,"15min":1.569},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.623,"15min":0.64400000000000002},"min":{"1min":0.36899999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.71199999999999997,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.59999999999999998}]},{"osd":3,"last update":"Sun Nov 26 07:15:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.57699999999999996,"15min":0.59799999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.63700000000000001,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.57699999999999996,"15min":0.56599999999999995},"min":{"1min":0.434,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69199999999999995,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.57699999999999996}]},{"osd":4,"last update":"Sun Nov 26 07:15:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.51800000000000002,"15min":0.52100000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.71099999999999997,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.52900000000000003,"15min":0.51300000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.67800000000000005,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.432}]},{"osd":5,"last update":"Sun Nov 26 07:15:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55100000000000005,"15min":0.53300000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.751,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.621,"15min":0.63},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.75900000000000001,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.63100000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:15:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.433,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72999999999999998,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.59599999999999997,"15min":0.59099999999999997},"min":{"1min":0.40500000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.69199999999999995,"5min":1.552,"15min":1.552},"last":0.65600000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574915,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339780,"statfs":{"total":96636764160,"available":96603934720,"internally_reserved":0,"allocated":897024,"data_stored":377770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:16:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51700000000000002,"15min":0.48899999999999999},"min":{"1min":0.33200000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.70199999999999996,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53800000000000003,"15min":0.48799999999999999},"min":{"1min":0.36399999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.752,"5min":0.871,"15min":0.871},"last":0.56599999999999995}]},{"osd":1,"last update":"Sun Nov 26 07:16:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.53200000000000003,"15min":0.51400000000000001},"min":{"1min":0.38900000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.76200000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54800000000000004,"15min":0.54400000000000004},"min":{"1min":0.38100000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67300000000000004,"5min":1.198,"15min":1.198},"last":0.46100000000000002}]},{"osd":2,"last update":"Sun Nov 26 07:16:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.53700000000000003,"15min":0.502},"min":{"1min":0.35699999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.74199999999999999,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.375},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56799999999999995,"15min":0.53000000000000003},"min":{"1min":0.38800000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.76300000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.53700000000000003}]},{"osd":3,"last update":"Sun Nov 26 07:16:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59899999999999998,"15min":0.55900000000000005},"min":{"1min":0.40999999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.74199999999999999,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.62,"15min":0.58999999999999997},"min":{"1min":0.434,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79100000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.60399999999999998}]},{"osd":4,"last update":"Sun Nov 26 07:16:33 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.502,"15min":0.52400000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.62,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.55600000000000005,"15min":0.56599999999999995},"min":{"1min":0.33200000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.68300000000000005,"5min":0.87,"15min":0.87},"last":0.49399999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:16:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.66500000000000004,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.57099999999999995,"15min":0.58299999999999996},"min":{"1min":0.34699999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.69999999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.64000000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:16:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.37,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.755,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.629},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.621,"15min":0.623},"min":{"1min":0.43099999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.81299999999999994,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.70799999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574914,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":909312,"data_stored":379906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.36299999999999999},"min":{"1min":0.223,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.57999999999999996,"15min":0.79900000000000004},"min":{"1min":0.29299999999999998,"5min":0.214,"15min":0.214},"max":{"1min":0.55700000000000005,"5min":11.922000000000001,"15min":11.922000000000001},"last":0.41299999999999998}]},{"osd":2,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35799999999999998,"15min":0.372},"min":{"1min":0.26000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.59599999999999997,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.40300000000000002,"15min":0.40799999999999997},"min":{"1min":0.307,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.56999999999999995,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.32600000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.45000000000000001,"15min":0.45800000000000002},"min":{"1min":0.35599999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.61299999999999999,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.42999999999999999,"15min":0.44},"min":{"1min":0.32500000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.51100000000000001,"5min":1.101,"15min":1.101},"last":0.377}]},{"osd":4,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.74099999999999999,"15min":0.86499999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82199999999999995,"5min":6.8979999999999997,"15min":6.8979999999999997},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.65600000000000003,"15min":0.66400000000000003},"min":{"1min":0.48799999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83999999999999997,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.57299999999999995}]},{"osd":5,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.621,"15min":0.627},"min":{"1min":0.41599999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.89100000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.621,"5min":0.745,"15min":0.871},"min":{"1min":0.442,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85199999999999998,"5min":6.9480000000000004,"15min":6.9480000000000004},"last":0.51200000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.64700000000000002,"15min":0.66100000000000003},"min":{"1min":0.46200000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.87,"5min":1.194,"15min":1.194},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.75800000000000001,"15min":0.89500000000000002},"min":{"1min":0.435,"5min":0.372,"15min":0.372},"max":{"1min":0.90500000000000003,"5min":6.9800000000000004,"15min":6.9800000000000004},"last":0.54000000000000004}]},{"osd":7,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65800000000000003,"15min":0.66000000000000003},"min":{"1min":0.48399999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.92400000000000004,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.68300000000000005},"min":{"1min":0.44700000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.93300000000000005,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.628}]}]},{"osd":0,"up_from":13,"seq":55834574913,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32632,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339208,"statfs":{"total":96636764160,"available":96603348992,"internally_reserved":0,"allocated":1482752,"data_stored":968046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33100000000000002,"15min":0.36499999999999999},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.44500000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.214},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.46800000000000003,"15min":0.78200000000000003},"min":{"1min":0.25,"5min":0.216,"15min":0.216},"max":{"1min":0.48299999999999998,"5min":11.987,"15min":11.987},"last":0.25}]},{"osd":2,"last update":"Sun Nov 26 07:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.378,"15min":0.42599999999999999},"min":{"1min":0.26900000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.503,"5min":1.607,"15min":1.607},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.38900000000000001,"15min":0.40999999999999998},"min":{"1min":0.307,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.54700000000000004,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.32000000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.36799999999999999,"15min":0.38400000000000001},"min":{"1min":0.27300000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.50900000000000001,"5min":0.752,"15min":0.752},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.42599999999999999,"15min":0.46500000000000002},"min":{"1min":0.30099999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.55200000000000005,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.307}]},{"osd":4,"last update":"Sun Nov 26 07:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.60099999999999998,"15min":0.64500000000000002},"min":{"1min":0.42399999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.72899999999999998,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.66700000000000004,"15min":0.85599999999999998},"min":{"1min":0.41699999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.79600000000000004,"5min":6.5279999999999996,"15min":6.5279999999999996},"last":0.68000000000000005}]},{"osd":5,"last update":"Sun Nov 26 07:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60799999999999998,"15min":0.64200000000000002},"min":{"1min":0.45000000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.878,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.63900000000000001,"15min":0.68500000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.78600000000000003,"5min":1.508,"15min":1.508},"last":0.52700000000000002}]},{"osd":6,"last update":"Sun Nov 26 07:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.69599999999999995,"15min":0.89200000000000002},"min":{"1min":0.435,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.76100000000000001,"5min":6.5419999999999998,"15min":6.5419999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.627,"15min":0.66900000000000004},"min":{"1min":0.45600000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.84099999999999997,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.66300000000000003}]},{"osd":7,"last update":"Sun Nov 26 07:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64800000000000002,"15min":0.69199999999999995},"min":{"1min":0.46400000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.78400000000000003,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.624,"15min":0.65600000000000003},"min":{"1min":0.42699999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77000000000000002,"5min":1.155,"15min":1.155},"last":0.56499999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574914,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32060,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339780,"statfs":{"total":96636764160,"available":96603934720,"internally_reserved":0,"allocated":901120,"data_stored":379290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:15:38 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34000000000000002,"15min":0.34599999999999997},"min":{"1min":0.22500000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39400000000000002,"15min":0.39800000000000002},"min":{"1min":0.28100000000000003,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.53500000000000003,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.314}]},{"osd":1,"last update":"Sun Nov 26 07:15:38 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34399999999999997,"15min":0.34799999999999998},"min":{"1min":0.224,"5min":0.222,"15min":0.222},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.375,"15min":0.377},"min":{"1min":0.24399999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.58199999999999996,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.40400000000000003}]},{"osd":3,"last update":"Sun Nov 26 07:15:38 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39700000000000002,"15min":0.41099999999999998},"min":{"1min":0.28100000000000003,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.59699999999999998,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.376,"5min":0.374,"15min":0.38200000000000001},"min":{"1min":0.27600000000000002,"5min":0.224,"15min":0.224},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.42799999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:15:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.42699999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.58399999999999996,"15min":0.58099999999999996},"min":{"1min":0.438,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.65300000000000002}]},{"osd":5,"last update":"Sun Nov 26 07:15:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.58099999999999996,"15min":0.57699999999999996},"min":{"1min":0.47199999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60999999999999999,"15min":0.63},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84299999999999997,"5min":1.002,"15min":1.002},"last":0.52200000000000002}]},{"osd":6,"last update":"Sun Nov 26 07:15:38 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.60899999999999999,"15min":0.61099999999999999},"min":{"1min":0.40999999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.623},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.629,"15min":0.63500000000000001},"min":{"1min":0.44700000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.54300000000000004}]},{"osd":7,"last update":"Sun Nov 26 07:15:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.62,"15min":0.629},"min":{"1min":0.499,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86299999999999999,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.625,"15min":0.625},"min":{"1min":0.47199999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.67400000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574914,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339780,"statfs":{"total":96636764160,"available":96603934720,"internally_reserved":0,"allocated":897024,"data_stored":377790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.34100000000000003,"15min":0.36499999999999999},"min":{"1min":0.22,"5min":0.219,"15min":0.219},"max":{"1min":0.46600000000000003,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.39300000000000002,"15min":0.41899999999999998},"min":{"1min":0.24199999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.61299999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.33300000000000002}]},{"osd":1,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.375,"15min":0.40300000000000002},"min":{"1min":0.25800000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.58799999999999997,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.246},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.439,"15min":0.5},"min":{"1min":0.26300000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.56899999999999995,"5min":2.903,"15min":2.903},"last":0.34799999999999998}]},{"osd":2,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39300000000000002,"15min":0.40400000000000003},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.55200000000000005,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.40500000000000003,"15min":0.41799999999999998},"min":{"1min":0.309,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.63700000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.38300000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.65400000000000003,"15min":0.70699999999999996},"min":{"1min":0.376,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.96799999999999997,"5min":2.9609999999999999,"15min":2.9609999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.625,"15min":0.64100000000000001},"min":{"1min":0.437,"5min":0.373,"15min":0.373},"max":{"1min":1.1499999999999999,"5min":1.163,"15min":1.163},"last":0.45800000000000002}]},{"osd":5,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.65100000000000002,"15min":0.67300000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.98199999999999998,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.64000000000000001,"15min":0.66400000000000003},"min":{"1min":0.436,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93999999999999995,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.58199999999999996}]},{"osd":6,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64500000000000002,"15min":0.67100000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.083,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.65600000000000003,"15min":0.68000000000000005},"min":{"1min":0.44900000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94499999999999995,"5min":1.258,"15min":1.258},"last":0.55300000000000005}]},{"osd":7,"last update":"Sun Nov 26 07:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.65200000000000002,"15min":0.68200000000000005},"min":{"1min":0.46700000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.014,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.69799999999999995,"15min":0.752},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.94899999999999995,"5min":2.9969999999999999,"15min":2.9969999999999999},"last":0.56599999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574913,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32052,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339788,"statfs":{"total":96636764160,"available":96603942912,"internally_reserved":0,"allocated":892928,"data_stored":377748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.65100000000000002,"15min":0.88400000000000001},"min":{"1min":0.41899999999999998,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.748,"5min":8.7539999999999996,"15min":8.7539999999999996},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.67400000000000004,"15min":0.90200000000000002},"min":{"1min":0.41499999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.81899999999999995,"5min":8.7390000000000008,"15min":8.7390000000000008},"last":0.63300000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.67100000000000004,"15min":0.93000000000000005},"min":{"1min":0.42899999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.76000000000000001,"5min":9.7720000000000002,"15min":9.7720000000000002},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56000000000000005,"15min":0.56699999999999995},"min":{"1min":0.38700000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.75600000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.57199999999999995}]},{"osd":2,"last update":"Sun Nov 26 07:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.63600000000000001,"15min":0.88300000000000001},"min":{"1min":0.36499999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.66400000000000003,"5min":9.8119999999999994,"15min":9.8119999999999994},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.65000000000000002,"15min":0.80400000000000005},"min":{"1min":0.48999999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80200000000000005,"5min":3.645,"15min":3.645},"last":0.67700000000000005}]},{"osd":3,"last update":"Sun Nov 26 07:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.69099999999999995,"15min":0.92900000000000005},"min":{"1min":0.41599999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.79300000000000004,"5min":8.8089999999999993,"15min":8.8089999999999993},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.49299999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78600000000000003,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.65800000000000003}]},{"osd":5,"last update":"Sun Nov 26 07:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.54200000000000004,"15min":0.51200000000000001},"min":{"1min":0.35499999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.82299999999999995,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55500000000000005,"15min":0.55200000000000005},"min":{"1min":0.33600000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.82099999999999995,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.45300000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.59499999999999997,"15min":0.58299999999999996},"min":{"1min":0.42299999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84999999999999998,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56699999999999995,"15min":0.57299999999999995},"min":{"1min":0.39200000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.77100000000000002,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.74099999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60199999999999998,"15min":0.59599999999999997},"min":{"1min":0.41899999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.78300000000000003,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.61499999999999999,"15min":0.60699999999999998},"min":{"1min":0.42899999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.88700000000000001,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.70799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574915,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":892928,"data_stored":377768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.58799999999999997,"15min":0.54000000000000004},"min":{"1min":0.35199999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76300000000000001,"5min":7.1500000000000004,"15min":7.1500000000000004},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.59699999999999998,"15min":0.57199999999999995},"min":{"1min":0.372,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72999999999999998,"5min":6.8470000000000004,"15min":6.8470000000000004},"last":0.69999999999999996}]},{"osd":1,"last update":"Sun Nov 26 07:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.59099999999999997,"15min":0.55700000000000005},"min":{"1min":0.33500000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.73899999999999999,"5min":7.1269999999999998,"15min":7.1269999999999998},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56399999999999995,"15min":0.55900000000000005},"min":{"1min":0.33800000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.74099999999999999,"5min":1.514,"15min":1.514},"last":0.44700000000000001}]},{"osd":2,"last update":"Sun Nov 26 07:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.64100000000000001,"15min":0.59699999999999998},"min":{"1min":0.40500000000000003,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.75700000000000001,"5min":7.2000000000000002,"15min":7.2000000000000002},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.66200000000000003,"15min":0.62},"min":{"1min":0.40799999999999997,"5min":0.379,"15min":0.379},"max":{"1min":0.749,"5min":7.8259999999999996,"15min":7.8259999999999996},"last":0.66100000000000003}]},{"osd":3,"last update":"Sun Nov 26 07:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.59999999999999998,"15min":0.57199999999999995},"min":{"1min":0.47799999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.77800000000000002,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.65300000000000002,"15min":0.60899999999999999},"min":{"1min":0.44500000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.73899999999999999,"5min":6.9240000000000004,"15min":6.9240000000000004},"last":0.64000000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.56699999999999995,"15min":0.51400000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78800000000000003,"5min":7.2830000000000004,"15min":7.2830000000000004},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.77000000000000002,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.77000000000000002}]},{"osd":6,"last update":"Sun Nov 26 07:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.622,"15min":0.57199999999999995},"min":{"1min":0.377,"5min":0.308,"15min":0.308},"max":{"1min":0.80400000000000005,"5min":6.8890000000000002,"15min":6.8890000000000002},"last":0.752},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.63800000000000001,"15min":0.59199999999999997},"min":{"1min":0.40500000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.82999999999999996,"5min":7.2430000000000003,"15min":7.2430000000000003},"last":0.72499999999999998}]},{"osd":7,"last update":"Sun Nov 26 07:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.66300000000000003,"15min":0.61099999999999999},"min":{"1min":0.40300000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.83999999999999997,"5min":6.9880000000000004,"15min":6.9880000000000004},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.624,"5min":0.73399999999999999,"15min":0.65900000000000003},"min":{"1min":0.434,"5min":0.38,"15min":0.38},"max":{"1min":0.84299999999999997,"5min":11.874000000000001,"15min":11.874000000000001},"last":0.79000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:16:41.775 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-26T07:16:41.776 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-26T07:16:41.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.941+0000 7f81dcb3c700 1 Processor -- start 2023-11-26T07:16:41.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.941+0000 7f81dcb3c700 1 -- start start 2023-11-26T07:16:41.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.942+0000 7f81dcb3c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f81d815f410 0x7f81d80b4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:41.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.942+0000 7f81dcb3c700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81d80b14c0 con 0x7f81d81607e0 2023-11-26T07:16:41.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.942+0000 7f81dcb3c700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81d80b3270 con 0x7f81d815fc20 2023-11-26T07:16:41.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.942+0000 7f81dcb3c700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81d80b3070 con 0x7f81d815f410 2023-11-26T07:16:41.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.942+0000 7f81d659c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f81d815f410 0x7f81d80b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:41.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.942+0000 7f81d6d9d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f81d81607e0 0x7f81d80ce140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35582/0 (socket says 172.21.15.2:35582) 2023-11-26T07:16:41.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.942+0000 7f81d6d9d700 1 -- 172.21.15.2:0/3723441040 learned_addr learned my addr 172.21.15.2:0/3723441040 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:16:41.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.942+0000 7f81d659c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f81d815f410 0x7f81d80b4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44368/0 (socket says 172.21.15.2:44368) 2023-11-26T07:16:41.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.942+0000 7f81d659c700 1 -- 172.21.15.2:0/3723441040 >> v1:172.21.15.192:6789/0 conn(0x7f81d815fc20 legacy=0x7f81d81600d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:41.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.942+0000 7f81d659c700 1 -- 172.21.15.2:0/3723441040 >> v1:172.21.15.2:6789/0 conn(0x7f81d81607e0 legacy=0x7f81d80ce140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:41.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.942+0000 7f81d659c700 1 -- 172.21.15.2:0/3723441040 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d80b3510 con 0x7f81d815f410 2023-11-26T07:16:41.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.942+0000 7f81d659c700 1 --2- 172.21.15.2:0/3723441040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81d815f410 0x7f81d80b4240 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f81c8009840 tx=0x7f81c8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67c2b48020a75fad server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:41.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.942+0000 7f81d559a700 1 -- 172.21.15.2:0/3723441040 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c8004230 con 0x7f81d815f410 2023-11-26T07:16:41.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.943+0000 7f81d559a700 1 -- 172.21.15.2:0/3723441040 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c8004390 con 0x7f81d815f410 2023-11-26T07:16:41.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.943+0000 7f81d559a700 1 -- 172.21.15.2:0/3723441040 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c80036a0 con 0x7f81d815f410 2023-11-26T07:16:41.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.943+0000 7f81dcb3c700 1 -- 172.21.15.2:0/3723441040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81d815f410 msgr2=0x7f81d80b4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:41.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.943+0000 7f81dcb3c700 1 --2- 172.21.15.2:0/3723441040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81d815f410 0x7f81d80b4240 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f81c8009840 tx=0x7f81c8009b50 comp rx=0 tx=0).stop 2023-11-26T07:16:41.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.943+0000 7f81dcb3c700 1 -- 172.21.15.2:0/3723441040 shutdown_connections 2023-11-26T07:16:41.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.943+0000 7f81dcb3c700 1 --2- 172.21.15.2:0/3723441040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81d815f410 0x7f81d80b4240 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:41.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.943+0000 7f81dcb3c700 1 -- 172.21.15.2:0/3723441040 >> 172.21.15.2:0/3723441040 conn(0x7f81d80b3720 msgr2=0x7f81d80b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:41.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.943+0000 7f81dcb3c700 1 -- 172.21.15.2:0/3723441040 shutdown_connections 2023-11-26T07:16:41.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.943+0000 7f81dcb3c700 1 -- 172.21.15.2:0/3723441040 wait complete. 2023-11-26T07:16:41.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.944+0000 7f81dcb3c700 1 Processor -- start 2023-11-26T07:16:41.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.945+0000 7f81dcb3c700 1 -- start start 2023-11-26T07:16:41.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.945+0000 7f81dcb3c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f81d815f410 0x7f81d81f1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:41.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.945+0000 7f81dcb3c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81d815fc20 0x7f81d80d1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:41.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.945+0000 7f81dcb3c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81d81607e0 0x7f81d80d22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:41.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.945+0000 7f81dcb3c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d8152b90 con 0x7f81d815fc20 2023-11-26T07:16:41.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.945+0000 7f81dcb3c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d80b5780 con 0x7f81d81607e0 2023-11-26T07:16:41.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.945+0000 7f81dcb3c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81d80b4b70 con 0x7f81d815f410 2023-11-26T07:16:41.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.945+0000 7f81d5d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81d815fc20 0x7f81d80d1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:41.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.945+0000 7f81d5d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81d815fc20 0x7f81d80d1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44376/0 (socket says 172.21.15.2:44376) 2023-11-26T07:16:41.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.945+0000 7f81d5d9b700 1 -- 172.21.15.2:0/1462411269 learned_addr learned my addr 172.21.15.2:0/1462411269 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:41.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.946+0000 7f81d6d9d700 1 --2- 172.21.15.2:0/1462411269 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81d81607e0 0x7f81d80d22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:41.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.946+0000 7f81d659c700 1 --2- 172.21.15.2:0/1462411269 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f81d815f410 0x7f81d81f1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:41.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.946+0000 7f81d5d9b700 1 -- 172.21.15.2:0/1462411269 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f81d815f410 msgr2=0x7f81d81f1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:41.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.946+0000 7f81d5d9b700 1 --2- 172.21.15.2:0/1462411269 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f81d815f410 0x7f81d81f1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:41.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.946+0000 7f81d5d9b700 1 -- 172.21.15.2:0/1462411269 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81d81607e0 msgr2=0x7f81d80d22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:41.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.946+0000 7f81d5d9b700 1 --2- 172.21.15.2:0/1462411269 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81d81607e0 0x7f81d80d22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:41.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.946+0000 7f81d5d9b700 1 -- 172.21.15.2:0/1462411269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c80094a0 con 0x7f81d815fc20 2023-11-26T07:16:41.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.946+0000 7f81d5d9b700 1 --2- 172.21.15.2:0/1462411269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81d815fc20 0x7f81d80d1d80 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f81cc00c4d0 tx=0x7f81cc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:41.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.946+0000 7f81c6ffd700 1 -- 172.21.15.2:0/1462411269 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81cc011790 con 0x7f81d815fc20 2023-11-26T07:16:41.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.946+0000 7f81c6ffd700 1 -- 172.21.15.2:0/1462411269 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81cc0118f0 con 0x7f81d815fc20 2023-11-26T07:16:41.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.946+0000 7f81dcb3c700 1 -- 172.21.15.2:0/1462411269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81d80b4e50 con 0x7f81d815fc20 2023-11-26T07:16:41.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.946+0000 7f81c6ffd700 1 -- 172.21.15.2:0/1462411269 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81cc011ca0 con 0x7f81d815fc20 2023-11-26T07:16:41.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.946+0000 7f81dcb3c700 1 -- 172.21.15.2:0/1462411269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81d80b5410 con 0x7f81d815fc20 2023-11-26T07:16:41.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.947+0000 7f81dcb3c700 1 -- 172.21.15.2:0/1462411269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81d80ce000 con 0x7f81d815fc20 2023-11-26T07:16:41.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.947+0000 7f81c6ffd700 1 -- 172.21.15.2:0/1462411269 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f81cc01c460 con 0x7f81d815fc20 2023-11-26T07:16:41.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.948+0000 7f81c6ffd700 1 --2- 172.21.15.2:0/1462411269 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f81b806b740 0x7f81b806dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:41.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.948+0000 7f81c6ffd700 1 -- 172.21.15.2:0/1462411269 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f81cc087ed0 con 0x7f81d815fc20 2023-11-26T07:16:41.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.948+0000 7f81d659c700 1 --2- 172.21.15.2:0/1462411269 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f81b806b740 0x7f81b806dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:41.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.948+0000 7f81d659c700 1 --2- 172.21.15.2:0/1462411269 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f81b806b740 0x7f81b806dc00 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f81c8000c00 tx=0x7f81c801c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:41.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:41.952+0000 7f81c6ffd700 1 -- 172.21.15.2:0/1462411269 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f81cc054860 con 0x7f81d815fc20 2023-11-26T07:16:42.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.243+0000 7f81dcb3c700 1 -- 172.21.15.2:0/1462411269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f81d8075480 con 0x7f81d815fc20 2023-11-26T07:16:42.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.244+0000 7f81c6ffd700 1 -- 172.21.15.2:0/1462411269 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+147 (secure 0 0 0) 0x7f81cc057e80 con 0x7f81d815fc20 2023-11-26T07:16:42.247 INFO:teuthology.orchestra.run.smithi002.stdout:[client.0] 2023-11-26T07:16:42.248 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBv72JlaEgQKxAA4cVx4nUFgqn0HvVBJdVHVg== 2023-11-26T07:16:42.248 INFO:teuthology.orchestra.run.smithi002.stdout: caps mds = "allow" 2023-11-26T07:16:42.248 INFO:teuthology.orchestra.run.smithi002.stdout: caps mon = "allow r" 2023-11-26T07:16:42.248 INFO:teuthology.orchestra.run.smithi002.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-26T07:16:42.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.247+0000 7f81dcb3c700 1 -- 172.21.15.2:0/1462411269 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f81b806b740 msgr2=0x7f81b806dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:42.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.247+0000 7f81dcb3c700 1 --2- 172.21.15.2:0/1462411269 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f81b806b740 0x7f81b806dc00 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f81c8000c00 tx=0x7f81c801c040 comp rx=0 tx=0).stop 2023-11-26T07:16:42.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.247+0000 7f81dcb3c700 1 -- 172.21.15.2:0/1462411269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81d815fc20 msgr2=0x7f81d80d1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:42.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.247+0000 7f81dcb3c700 1 --2- 172.21.15.2:0/1462411269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81d815fc20 0x7f81d80d1d80 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f81cc00c4d0 tx=0x7f81cc00c890 comp rx=0 tx=0).stop 2023-11-26T07:16:42.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.247+0000 7f81dcb3c700 1 -- 172.21.15.2:0/1462411269 shutdown_connections 2023-11-26T07:16:42.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.247+0000 7f81dcb3c700 1 --2- 172.21.15.2:0/1462411269 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f81b806b740 0x7f81b806dc00 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:42.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.247+0000 7f81dcb3c700 1 --2- 172.21.15.2:0/1462411269 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81d81607e0 0x7f81d80d22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:42.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.247+0000 7f81dcb3c700 1 --2- 172.21.15.2:0/1462411269 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f81d815f410 0x7f81d81f1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:42.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.247+0000 7f81dcb3c700 1 --2- 172.21.15.2:0/1462411269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81d815fc20 0x7f81d80d1d80 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:42.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.247+0000 7f81dcb3c700 1 -- 172.21.15.2:0/1462411269 >> 172.21.15.2:0/1462411269 conn(0x7f81d80b3720 msgr2=0x7f81d80ceef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:42.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.247+0000 7f81dcb3c700 1 -- 172.21.15.2:0/1462411269 shutdown_connections 2023-11-26T07:16:42.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.247+0000 7f81dcb3c700 1 -- 172.21.15.2:0/1462411269 wait complete. 2023-11-26T07:16:42.252 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.0 2023-11-26T07:16:42.263 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:16:42.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.385+0000 7f22675ce700 1 Processor -- start 2023-11-26T07:16:42.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.385+0000 7f22675ce700 1 -- start start 2023-11-26T07:16:42.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.386+0000 7f22675ce700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f22601440f0 0x7f22600b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:42.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.386+0000 7f22675ce700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2260143ec0 con 0x7f2260143ae0 2023-11-26T07:16:42.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.386+0000 7f22675ce700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22600b3ae0 con 0x7f22600722c0 2023-11-26T07:16:42.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.386+0000 7f22675ce700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22600b40a0 con 0x7f22601440f0 2023-11-26T07:16:42.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.386+0000 7f226536a700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2260143ae0 0x7f2260071bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35592/0 (socket says 172.21.15.2:35592) 2023-11-26T07:16:42.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.386+0000 7f226536a700 1 -- 172.21.15.2:0/4074949174 learned_addr learned my addr 172.21.15.2:0/4074949174 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:16:42.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.386+0000 7f2257fff700 1 -- 172.21.15.2:0/4074949174 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2876456728 0 0) 0x7f2260143ec0 con 0x7f2260143ae0 2023-11-26T07:16:42.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.386+0000 7f2265b6b700 1 --2- 172.21.15.2:0/4074949174 >> v2:172.21.15.192:3300/0 conn(0x7f22601440f0 0x7f22600b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:42.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.386+0000 7f2257fff700 1 -- 172.21.15.2:0/4074949174 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f224c0035b0 con 0x7f2260143ae0 2023-11-26T07:16:42.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.386+0000 7f2257fff700 1 -- 172.21.15.2:0/4074949174 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3309015079 0 0) 0x7f224c0035b0 con 0x7f2260143ae0 2023-11-26T07:16:42.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.386+0000 7f2257fff700 1 -- 172.21.15.2:0/4074949174 >> v2:172.21.15.192:3300/0 conn(0x7f22601440f0 msgr2=0x7f22600b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:42.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.386+0000 7f2257fff700 1 --2- 172.21.15.2:0/4074949174 >> v2:172.21.15.192:3300/0 conn(0x7f22601440f0 0x7f22600b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:42.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.386+0000 7f2257fff700 1 -- 172.21.15.2:0/4074949174 >> v1:172.21.15.192:6789/0 conn(0x7f22600722c0 legacy=0x7f226006e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:42.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.386+0000 7f2257fff700 1 -- 172.21.15.2:0/4074949174 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22600b3dc0 con 0x7f2260143ae0 2023-11-26T07:16:42.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.387+0000 7f2257fff700 1 -- 172.21.15.2:0/4074949174 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f225c001670 con 0x7f2260143ae0 2023-11-26T07:16:42.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.387+0000 7f2265b6b700 1 --2- 172.21.15.2:0/4074949174 >> v2:172.21.15.192:3300/0 conn(0x7f22601440f0 0x7f22600b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:16:42.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.387+0000 7f2257fff700 1 -- 172.21.15.2:0/4074949174 >> v1:172.21.15.2:6789/0 conn(0x7f2260143ae0 legacy=0x7f2260071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:42.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.387+0000 7f2257fff700 1 --2- 172.21.15.2:0/4074949174 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f224c003a00 0x7f224c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:42.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.387+0000 7f2257fff700 1 --2- 172.21.15.2:0/4074949174 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f224c004850 0x7f224c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:42.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.387+0000 7f2257fff700 1 --2- 172.21.15.2:0/4074949174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f224c005210 0x7f224c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:42.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.387+0000 7f2257fff700 1 -- 172.21.15.2:0/4074949174 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22600b40a0 con 0x7f224c005210 2023-11-26T07:16:42.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.387+0000 7f2257fff700 1 -- 172.21.15.2:0/4074949174 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224c00c140 con 0x7f224c003a00 2023-11-26T07:16:42.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.387+0000 7f2257fff700 1 -- 172.21.15.2:0/4074949174 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f224c00e510 con 0x7f224c004850 2023-11-26T07:16:42.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.387+0000 7f2265b6b700 1 --2- 172.21.15.2:0/4074949174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f224c005210 0x7f224c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:42.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.387+0000 7f226536a700 1 --2- 172.21.15.2:0/4074949174 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f224c003a00 0x7f224c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:42.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.387+0000 7f2264b69700 1 --2- 172.21.15.2:0/4074949174 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f224c004850 0x7f224c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:42.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.387+0000 7f2265b6b700 1 -- 172.21.15.2:0/4074949174 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f224c004850 msgr2=0x7f224c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:42.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.387+0000 7f2265b6b700 1 --2- 172.21.15.2:0/4074949174 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f224c004850 0x7f224c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:42.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.387+0000 7f2265b6b700 1 -- 172.21.15.2:0/4074949174 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f224c003a00 msgr2=0x7f224c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:42.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.387+0000 7f2265b6b700 1 --2- 172.21.15.2:0/4074949174 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f224c003a00 0x7f224c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:42.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.387+0000 7f2265b6b700 1 -- 172.21.15.2:0/4074949174 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f224c0035b0 con 0x7f224c005210 2023-11-26T07:16:42.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.387+0000 7f2265b6b700 1 -- 172.21.15.2:0/4074949174 reap_dead start 2023-11-26T07:16:42.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.387+0000 7f2265b6b700 1 --2- 172.21.15.2:0/4074949174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f224c005210 0x7f224c00ba10 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f22580073b0 tx=0x7f224c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdbaa6bcdb4ac008 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:42.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.387+0000 7f2257fff700 1 -- 172.21.15.2:0/4074949174 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2258009490 con 0x7f224c005210 2023-11-26T07:16:42.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.387+0000 7f2257fff700 1 -- 172.21.15.2:0/4074949174 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2258014400 con 0x7f224c005210 2023-11-26T07:16:42.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.387+0000 7f2257fff700 1 -- 172.21.15.2:0/4074949174 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2258014770 con 0x7f224c005210 2023-11-26T07:16:42.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.388+0000 7f22675ce700 1 -- 172.21.15.2:0/4074949174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f224c005210 msgr2=0x7f224c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:42.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.388+0000 7f22675ce700 1 --2- 172.21.15.2:0/4074949174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f224c005210 0x7f224c00ba10 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f22580073b0 tx=0x7f224c005880 comp rx=0 tx=0).stop 2023-11-26T07:16:42.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.388+0000 7f22675ce700 1 -- 172.21.15.2:0/4074949174 shutdown_connections 2023-11-26T07:16:42.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.388+0000 7f22675ce700 1 --2- 172.21.15.2:0/4074949174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f224c005210 0x7f224c00ba10 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:42.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.388+0000 7f22675ce700 1 -- 172.21.15.2:0/4074949174 >> 172.21.15.2:0/4074949174 conn(0x7f22600b2740 msgr2=0x7f22600b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:42.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.388+0000 7f22675ce700 1 -- 172.21.15.2:0/4074949174 shutdown_connections 2023-11-26T07:16:42.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.388+0000 7f22675ce700 1 -- 172.21.15.2:0/4074949174 wait complete. 2023-11-26T07:16:42.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.390+0000 7f22675ce700 1 Processor -- start 2023-11-26T07:16:42.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.390+0000 7f22675ce700 1 -- start start 2023-11-26T07:16:42.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.391+0000 7f22675ce700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f224c005210 0x7f226013ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:42.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.391+0000 7f22675ce700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f226006e410 0x7f226006e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:42.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.391+0000 7f22675ce700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f226015caf0 0x7f226015cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:42.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.391+0000 7f22675ce700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226015bc00 con 0x7f224c005210 2023-11-26T07:16:42.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.391+0000 7f22675ce700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226015d4c0 con 0x7f226015caf0 2023-11-26T07:16:42.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.391+0000 7f22675ce700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f226006edb0 con 0x7f226006e410 2023-11-26T07:16:42.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.391+0000 7f226536a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f224c005210 0x7f226013ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:42.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.391+0000 7f226536a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f224c005210 0x7f226013ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44394/0 (socket says 172.21.15.2:44394) 2023-11-26T07:16:42.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.391+0000 7f226536a700 1 -- 172.21.15.2:0/2656428632 learned_addr learned my addr 172.21.15.2:0/2656428632 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:42.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.391+0000 7f2264b69700 1 --2- 172.21.15.2:0/2656428632 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f226006e410 0x7f226006e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:42.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.391+0000 7f226536a700 1 -- 172.21.15.2:0/2656428632 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f226006e410 msgr2=0x7f226006e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:42.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.391+0000 7f226536a700 1 --2- 172.21.15.2:0/2656428632 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f226006e410 0x7f226006e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:42.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.391+0000 7f226536a700 1 -- 172.21.15.2:0/2656428632 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f226015caf0 msgr2=0x7f226015cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:42.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.391+0000 7f226536a700 1 --2- 172.21.15.2:0/2656428632 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f226015caf0 0x7f226015cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:42.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.391+0000 7f226536a700 1 -- 172.21.15.2:0/2656428632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226015b2f0 con 0x7f224c005210 2023-11-26T07:16:42.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.391+0000 7f226536a700 1 --2- 172.21.15.2:0/2656428632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f224c005210 0x7f226013ed40 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f225c0017a0 tx=0x7f225c007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:42.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.391+0000 7f2255ffb700 1 -- 172.21.15.2:0/2656428632 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225c007800 con 0x7f224c005210 2023-11-26T07:16:42.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.391+0000 7f2255ffb700 1 -- 172.21.15.2:0/2656428632 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225c00f8d0 con 0x7f224c005210 2023-11-26T07:16:42.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.391+0000 7f22675ce700 1 -- 172.21.15.2:0/2656428632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f226013f900 con 0x7f224c005210 2023-11-26T07:16:42.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.391+0000 7f2255ffb700 1 -- 172.21.15.2:0/2656428632 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225c00fc40 con 0x7f224c005210 2023-11-26T07:16:42.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.392+0000 7f22675ce700 1 -- 172.21.15.2:0/2656428632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f226015b540 con 0x7f224c005210 2023-11-26T07:16:42.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.393+0000 7f22675ce700 1 -- 172.21.15.2:0/2656428632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22600cd8d0 con 0x7f224c005210 2023-11-26T07:16:42.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.393+0000 7f2255ffb700 1 -- 172.21.15.2:0/2656428632 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f225c01d460 con 0x7f224c005210 2023-11-26T07:16:42.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.393+0000 7f2255ffb700 1 --2- 172.21.15.2:0/2656428632 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f224406b740 0x7f224406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:42.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.393+0000 7f2255ffb700 1 -- 172.21.15.2:0/2656428632 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f225c0880b0 con 0x7f224c005210 2023-11-26T07:16:42.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.394+0000 7f2264b69700 1 --2- 172.21.15.2:0/2656428632 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f224406b740 0x7f224406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:42.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.394+0000 7f2264b69700 1 --2- 172.21.15.2:0/2656428632 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f224406b740 0x7f224406dc00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2250007fd0 tx=0x7f2250009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:42.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.398+0000 7f2255ffb700 1 -- 172.21.15.2:0/2656428632 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f225c054a40 con 0x7f224c005210 2023-11-26T07:16:42.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.647+0000 7f22675ce700 1 -- 172.21.15.2:0/2656428632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2260068670 con 0x7f224c005210 2023-11-26T07:16:42.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.647+0000 7f2255ffb700 1 -- 172.21.15.2:0/2656428632 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4912 (secure 0 0 0) 0x7f225c058060 con 0x7f224c005210 2023-11-26T07:16:42.650 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:16:42.650 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":46,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5678,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3437634953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3437634953},{"type":"v1","addr":"172.21.15.192:6835","nonce":3437634953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":5684,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2624944008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2624944008},{"type":"v1","addr":"172.21.15.192:6837","nonce":2624944008}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6711,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/1847794001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1847794001},{"type":"v1","addr":"172.21.15.2:6834","nonce":1847794001}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:16:32.014651+0000","modified":"2023-11-26T07:16:35.045399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6714},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6714":{"gid":6714,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6835/177641343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":177641343},{"type":"v1","addr":"172.21.15.2:6835","nonce":177641343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-26T07:16:42.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.650+0000 7f22675ce700 1 -- 172.21.15.2:0/2656428632 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f224406b740 msgr2=0x7f224406dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:42.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.650+0000 7f22675ce700 1 --2- 172.21.15.2:0/2656428632 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f224406b740 0x7f224406dc00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2250007fd0 tx=0x7f2250009040 comp rx=0 tx=0).stop 2023-11-26T07:16:42.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.650+0000 7f22675ce700 1 -- 172.21.15.2:0/2656428632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f224c005210 msgr2=0x7f226013ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:42.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.650+0000 7f22675ce700 1 --2- 172.21.15.2:0/2656428632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f224c005210 0x7f226013ed40 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f225c0017a0 tx=0x7f225c007620 comp rx=0 tx=0).stop 2023-11-26T07:16:42.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.650+0000 7f22675ce700 1 -- 172.21.15.2:0/2656428632 shutdown_connections 2023-11-26T07:16:42.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.650+0000 7f22675ce700 1 --2- 172.21.15.2:0/2656428632 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f224406b740 0x7f224406dc00 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:42.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.650+0000 7f22675ce700 1 --2- 172.21.15.2:0/2656428632 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f226015caf0 0x7f226015cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:42.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.650+0000 7f22675ce700 1 --2- 172.21.15.2:0/2656428632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f224c005210 0x7f226013ed40 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:42.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.650+0000 7f22675ce700 1 --2- 172.21.15.2:0/2656428632 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f226006e410 0x7f226006e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:42.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.650+0000 7f22675ce700 1 -- 172.21.15.2:0/2656428632 >> 172.21.15.2:0/2656428632 conn(0x7f22600b2740 msgr2=0x7f226015a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:42.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.650+0000 7f22675ce700 1 -- 172.21.15.2:0/2656428632 shutdown_connections 2023-11-26T07:16:42.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:42.650+0000 7f22675ce700 1 -- 172.21.15.2:0/2656428632 wait complete. 2023-11-26T07:16:42.654 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 46 2023-11-26T07:16:43.067 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 46, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-26T07:16:32.014651+0000', 'modified': '2023-11-26T07:16:35.045399+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6714}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6714': {'gid': 6714, 'name': 'a', 'rank': 0, 'incarnation': 42, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6835/177641343', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6833', 'nonce': 177641343}, {'type': 'v1', 'addr': '172.21.15.2:6835', 'nonce': 177641343}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-26T07:16:43.067 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-26T07:16:43.067 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-26T07:16:43.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.195+0000 7f074e76d700 1 Processor -- start 2023-11-26T07:16:43.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.195+0000 7f074e76d700 1 -- start start 2023-11-26T07:16:43.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.196+0000 7f074e76d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07481447b0 0x7f074815b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:43.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.196+0000 7f074e76d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f07480b3c80 0x7f07480b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:43.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.196+0000 7f074e76d700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f074815bbf0 con 0x7f07480b4f50 2023-11-26T07:16:43.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.196+0000 7f074e76d700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07480b53e0 con 0x7f07480b3c80 2023-11-26T07:16:43.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.196+0000 7f074e76d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074815bed0 con 0x7f07481447b0 2023-11-26T07:16:43.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.196+0000 7f0747fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07481447b0 0x7f074815b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:43.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.196+0000 7f0747fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07481447b0 0x7f074815b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.2:42482/0 (socket says 172.21.15.2:42482) 2023-11-26T07:16:43.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.196+0000 7f07477fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f07480b3c80 0x7f07480b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:43.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.196+0000 7f0747fff700 1 -- 172.21.15.2:0/2462691165 learned_addr learned my addr 172.21.15.2:0/2462691165 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:43.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.196+0000 7f074cd0a700 1 --1- 172.21.15.2:0/2462691165 >> v1:172.21.15.192:6789/0 conn(0x7f07480b4f50 0x7f074815e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.2:42986/0 (socket says 172.21.15.2:42986) 2023-11-26T07:16:43.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.197+0000 7f0747fff700 1 -- 172.21.15.2:0/2462691165 >> v2:172.21.15.192:3300/0 conn(0x7f07480b3c80 msgr2=0x7f07480b4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:43.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.197+0000 7f0747fff700 1 --2- 172.21.15.2:0/2462691165 >> v2:172.21.15.192:3300/0 conn(0x7f07480b3c80 0x7f07480b4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:43.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.197+0000 7f0747fff700 1 -- 172.21.15.2:0/2462691165 >> v1:172.21.15.192:6789/0 conn(0x7f07480b4f50 legacy=0x7f074815e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:43.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.197+0000 7f0747fff700 1 -- 172.21.15.2:0/2462691165 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074815c1b0 con 0x7f07481447b0 2023-11-26T07:16:43.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.197+0000 7f07477fe700 1 --2- 172.21.15.2:0/2462691165 >> v2:172.21.15.192:3300/0 conn(0x7f07480b3c80 0x7f07480b4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:16:43.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.197+0000 7f0747fff700 1 --2- 172.21.15.2:0/2462691165 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07481447b0 0x7f074815b350 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f07300098f0 tx=0x7f0730009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e96542a8486d748 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:43.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.197+0000 7f0746ffd700 1 -- 172.21.15.2:0/2462691165 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0730011830 con 0x7f07481447b0 2023-11-26T07:16:43.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.197+0000 7f0746ffd700 1 -- 172.21.15.2:0/2462691165 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0730011990 con 0x7f07481447b0 2023-11-26T07:16:43.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.197+0000 7f0746ffd700 1 -- 172.21.15.2:0/2462691165 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0730011d20 con 0x7f07481447b0 2023-11-26T07:16:43.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.197+0000 7f074e76d700 1 -- 172.21.15.2:0/2462691165 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07481447b0 msgr2=0x7f074815b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:43.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.197+0000 7f074e76d700 1 --2- 172.21.15.2:0/2462691165 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07481447b0 0x7f074815b350 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f07300098f0 tx=0x7f0730009c00 comp rx=0 tx=0).stop 2023-11-26T07:16:43.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.198+0000 7f074e76d700 1 -- 172.21.15.2:0/2462691165 shutdown_connections 2023-11-26T07:16:43.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.198+0000 7f074e76d700 1 --2- 172.21.15.2:0/2462691165 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07481447b0 0x7f074815b350 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:43.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.198+0000 7f074e76d700 1 --2- 172.21.15.2:0/2462691165 >> v2:172.21.15.192:3300/0 conn(0x7f07480b3c80 0x7f07480b4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:43.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.198+0000 7f074e76d700 1 -- 172.21.15.2:0/2462691165 >> 172.21.15.2:0/2462691165 conn(0x7f07480b27d0 msgr2=0x7f07480b2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:43.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.198+0000 7f074e76d700 1 -- 172.21.15.2:0/2462691165 shutdown_connections 2023-11-26T07:16:43.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.198+0000 7f074e76d700 1 -- 172.21.15.2:0/2462691165 wait complete. 2023-11-26T07:16:43.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.199+0000 7f074e76d700 1 Processor -- start 2023-11-26T07:16:43.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.199+0000 7f074e76d700 1 -- start start 2023-11-26T07:16:43.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.200+0000 7f074e76d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07480b3c80 0x7f0748159170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:43.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.200+0000 7f074e76d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07480b4f50 0x7f074815cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:43.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.200+0000 7f074e76d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07481447b0 0x7f074813f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:43.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.200+0000 7f074e76d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074813df00 con 0x7f07480b3c80 2023-11-26T07:16:43.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.200+0000 7f074e76d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074813e1e0 con 0x7f07481447b0 2023-11-26T07:16:43.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.200+0000 7f074e76d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074813e4c0 con 0x7f07480b4f50 2023-11-26T07:16:43.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.200+0000 7f0747fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07480b3c80 0x7f0748159170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:43.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.200+0000 7f0747fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07480b3c80 0x7f0748159170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44408/0 (socket says 172.21.15.2:44408) 2023-11-26T07:16:43.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.200+0000 7f0747fff700 1 -- 172.21.15.2:0/1423899359 learned_addr learned my addr 172.21.15.2:0/1423899359 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:43.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.201+0000 7f07477fe700 1 --2- 172.21.15.2:0/1423899359 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07480b4f50 0x7f074815cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:43.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.201+0000 7f074cd0a700 1 --2- 172.21.15.2:0/1423899359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07481447b0 0x7f074813f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:43.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.201+0000 7f0747fff700 1 -- 172.21.15.2:0/1423899359 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07480b4f50 msgr2=0x7f074815cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:43.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.201+0000 7f0747fff700 1 --2- 172.21.15.2:0/1423899359 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07480b4f50 0x7f074815cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:43.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.201+0000 7f0747fff700 1 -- 172.21.15.2:0/1423899359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07481447b0 msgr2=0x7f074813f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:43.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.201+0000 7f0747fff700 1 --2- 172.21.15.2:0/1423899359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07481447b0 0x7f074813f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:43.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.201+0000 7f0747fff700 1 -- 172.21.15.2:0/1423899359 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07380094a0 con 0x7f07480b3c80 2023-11-26T07:16:43.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.201+0000 7f074cd0a700 1 --2- 172.21.15.2:0/1423899359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07481447b0 0x7f074813f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:16:43.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.201+0000 7f0747fff700 1 --2- 172.21.15.2:0/1423899359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07480b3c80 0x7f0748159170 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f0730009c40 tx=0x7f0730004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:43.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.201+0000 7f0744ff9700 1 -- 172.21.15.2:0/1423899359 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0730004590 con 0x7f07480b3c80 2023-11-26T07:16:43.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.201+0000 7f0744ff9700 1 -- 172.21.15.2:0/1423899359 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f073001e070 con 0x7f07480b3c80 2023-11-26T07:16:43.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.201+0000 7f074e76d700 1 -- 172.21.15.2:0/1423899359 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0730009550 con 0x7f07480b3c80 2023-11-26T07:16:43.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.201+0000 7f0744ff9700 1 -- 172.21.15.2:0/1423899359 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07300038e0 con 0x7f07480b3c80 2023-11-26T07:16:43.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.201+0000 7f074e76d700 1 -- 172.21.15.2:0/1423899359 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f074813ea80 con 0x7f07480b3c80 2023-11-26T07:16:43.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.203+0000 7f0744ff9700 1 -- 172.21.15.2:0/1423899359 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f0730003a40 con 0x7f07480b3c80 2023-11-26T07:16:43.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.203+0000 7f0744ff9700 1 --2- 172.21.15.2:0/1423899359 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f072806b740 0x7f072806dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:43.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.204+0000 7f0744ff9700 1 -- 172.21.15.2:0/1423899359 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0730088ee0 con 0x7f07480b3c80 2023-11-26T07:16:43.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.204+0000 7f07477fe700 1 --2- 172.21.15.2:0/1423899359 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f072806b740 0x7f072806dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:43.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.204+0000 7f07477fe700 1 --2- 172.21.15.2:0/1423899359 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f072806b740 0x7f072806dc00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f0738009d70 tx=0x7f0738009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:43.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.205+0000 7f075a966b80 1 Processor -- start 2023-11-26T07:16:43.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.205+0000 7f075a966b80 1 -- start start 2023-11-26T07:16:43.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.206+0000 7f075a966b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b64f0a080 0x561b64f50840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:43.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.206+0000 7f075a966b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561b64f1fed0 0x561b64f50d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:43.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.206+0000 7f075a966b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561b64f07490 0x561b64f33e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:43.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.206+0000 7f075a966b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b64e7d770 con 0x561b64f0a080 2023-11-26T07:16:43.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.206+0000 7f075a966b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b64e64750 con 0x561b64f07490 2023-11-26T07:16:43.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.206+0000 7f075a966b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x561b64e62070 con 0x561b64f1fed0 2023-11-26T07:16:43.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.206+0000 7f0747fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b64f0a080 0x561b64f50840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:43.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.206+0000 7f0747fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b64f0a080 0x561b64f50840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44416/0 (socket says 172.21.15.2:44416) 2023-11-26T07:16:43.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.206+0000 7f0747fff700 1 -- 172.21.15.2:0/2267781287 learned_addr learned my addr 172.21.15.2:0/2267781287 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:43.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.206+0000 7f074cd0a700 1 --2- 172.21.15.2:0/2267781287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561b64f07490 0x561b64f33e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:43.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.206+0000 7f07477fe700 1 --2- 172.21.15.2:0/2267781287 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561b64f1fed0 0x561b64f50d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:43.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.206+0000 7f0747fff700 1 -- 172.21.15.2:0/2267781287 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561b64f1fed0 msgr2=0x561b64f50d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:43.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.206+0000 7f0747fff700 1 --2- 172.21.15.2:0/2267781287 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561b64f1fed0 0x561b64f50d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:43.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.206+0000 7f0747fff700 1 -- 172.21.15.2:0/2267781287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561b64f07490 msgr2=0x561b64f33e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:43.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.206+0000 7f0747fff700 1 --2- 172.21.15.2:0/2267781287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561b64f07490 0x561b64f33e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:43.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.206+0000 7f0747fff700 1 -- 172.21.15.2:0/2267781287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b64cda5e0 con 0x561b64f0a080 2023-11-26T07:16:43.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.207+0000 7f0747fff700 1 --2- 172.21.15.2:0/2267781287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b64f0a080 0x561b64f50840 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f0730061300 tx=0x7f0730059410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1279667f768b33f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:43.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.207+0000 7f073dffb700 1 -- 172.21.15.2:0/2267781287 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073008b050 con 0x561b64f0a080 2023-11-26T07:16:43.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.207+0000 7f073dffb700 1 -- 172.21.15.2:0/2267781287 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f073005d680 con 0x561b64f0a080 2023-11-26T07:16:43.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.207+0000 7f073dffb700 1 -- 172.21.15.2:0/2267781287 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0730061830 con 0x561b64f0a080 2023-11-26T07:16:43.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.207+0000 7f075a966b80 1 -- 172.21.15.2:0/2267781287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b64f0a080 msgr2=0x561b64f50840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:43.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.207+0000 7f075a966b80 1 --2- 172.21.15.2:0/2267781287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b64f0a080 0x561b64f50840 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f0730061300 tx=0x7f0730059410 comp rx=0 tx=0).stop 2023-11-26T07:16:43.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.207+0000 7f075a966b80 1 -- 172.21.15.2:0/2267781287 shutdown_connections 2023-11-26T07:16:43.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.207+0000 7f075a966b80 1 --2- 172.21.15.2:0/2267781287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561b64f07490 0x561b64f33e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:43.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.207+0000 7f075a966b80 1 --2- 172.21.15.2:0/2267781287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b64f0a080 0x561b64f50840 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:43.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.207+0000 7f075a966b80 1 --2- 172.21.15.2:0/2267781287 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561b64f1fed0 0x561b64f50d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:43.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.207+0000 7f075a966b80 1 -- 172.21.15.2:0/2267781287 >> 172.21.15.2:0/2267781287 conn(0x561b64e38310 msgr2=0x561b64f4ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:43.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.207+0000 7f075a966b80 1 -- 172.21.15.2:0/2267781287 shutdown_connections 2023-11-26T07:16:43.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.207+0000 7f075a966b80 1 -- 172.21.15.2:0/2267781287 wait complete. 2023-11-26T07:16:43.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.208+0000 7f075a966b80 1 -- start start 2023-11-26T07:16:43.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.208+0000 7f075a966b80 1 Processor -- start 2023-11-26T07:16:43.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.209+0000 7f075a966b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561b64f07490 0x561b64f34020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:43.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.209+0000 7f075a966b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b64f0a080 0x561b64efe330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:43.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.209+0000 7f075a966b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561b64f1fed0 0x561b64efe870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:43.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.209+0000 7f075a966b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b64e5d960 con 0x561b64f0a080 2023-11-26T07:16:43.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.209+0000 7f075a966b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b64e17510 con 0x561b64f07490 2023-11-26T07:16:43.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.209+0000 7f075a966b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x561b64e171b0 con 0x561b64f1fed0 2023-11-26T07:16:43.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.209+0000 7f075a966b80 10 client.0 _ll_register_callbacks cb 0x561b64d42a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-26T07:16:43.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.209+0000 7f07477fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b64f0a080 0x561b64efe330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:43.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.209+0000 7f07477fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b64f0a080 0x561b64efe330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44424/0 (socket says 172.21.15.2:44424) 2023-11-26T07:16:43.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.209+0000 7f07477fe700 1 -- 172.21.15.2:0/3789634665 learned_addr learned my addr 172.21.15.2:0/3789634665 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:43.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.209+0000 7f074cd0a700 1 --2- 172.21.15.2:0/3789634665 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561b64f1fed0 0x561b64efe870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:43.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.209+0000 7f0747fff700 1 --2- 172.21.15.2:0/3789634665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561b64f07490 0x561b64f34020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:43.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.209+0000 7f07477fe700 1 -- 172.21.15.2:0/3789634665 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561b64f1fed0 msgr2=0x561b64efe870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:43.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.209+0000 7f07477fe700 1 --2- 172.21.15.2:0/3789634665 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561b64f1fed0 0x561b64efe870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:43.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.209+0000 7f07477fe700 1 -- 172.21.15.2:0/3789634665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561b64f07490 msgr2=0x561b64f34020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:43.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.209+0000 7f07477fe700 1 --2- 172.21.15.2:0/3789634665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561b64f07490 0x561b64f34020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:43.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.209+0000 7f07477fe700 1 -- 172.21.15.2:0/3789634665 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f074813ea80 con 0x561b64f0a080 2023-11-26T07:16:43.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.209+0000 7f0747fff700 1 --2- 172.21.15.2:0/3789634665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561b64f07490 0x561b64f34020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:16:43.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.209+0000 7f07477fe700 1 --2- 172.21.15.2:0/3789634665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b64f0a080 0x561b64efe330 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f0738014940 tx=0x7f0738004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ef7f1c25464d854 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:43.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.210+0000 7f0726ffd700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-26T07:16:43.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.210+0000 7f0726ffd700 1 -- 172.21.15.2:0/3789634665 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0738013730 con 0x561b64f0a080 2023-11-26T07:16:43.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.210+0000 7f0726ffd700 1 -- 172.21.15.2:0/3789634665 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0738013890 con 0x561b64f0a080 2023-11-26T07:16:43.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.210+0000 7f075a966b80 1 -- 172.21.15.2:0/3789634665 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561b64efca40 con 0x561b64f0a080 2023-11-26T07:16:43.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.210+0000 7f0726ffd700 1 -- 172.21.15.2:0/3789634665 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0738013a50 con 0x561b64f0a080 2023-11-26T07:16:43.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.210+0000 7f075a966b80 10 client.6885 fetch_fsmap learned FSMap version 46 2023-11-26T07:16:43.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.210+0000 7f075a966b80 1 -- 172.21.15.2:0/3789634665 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x561b64c86d90 con 0x561b64f0a080 2023-11-26T07:16:43.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.210+0000 7f0726ffd700 1 -- 172.21.15.2:0/3789634665 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561b64efca40 con 0x561b64f0a080 2023-11-26T07:16:43.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.210+0000 7f0726ffd700 1 -- 172.21.15.2:0/3789634665 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 46) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0738013bb0 con 0x561b64f0a080 2023-11-26T07:16:43.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.210+0000 7f075a966b80 10 client.6885 fetch_fsmap finished waiting for FSMap version 46 2023-11-26T07:16:43.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.210+0000 7f075a966b80 10 client.6885 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-26T07:16:43.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.210+0000 7f075a966b80 20 client.6885 populate_metadata read hostname 'smithi002' 2023-11-26T07:16:43.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.210+0000 7f075a966b80 1 --2- 172.21.15.2:0/3789634665 >> [v2:172.21.15.2:6833/177641343,v1:172.21.15.2:6835/177641343] conn(0x561b64f103e0 0x561b64f37b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:43.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.210+0000 7f075a966b80 4 client.6885 mds_command: new command op to 6714 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-26T07:16:43.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.210+0000 7f075a966b80 1 -- 172.21.15.2:0/3789634665 --> [v2:172.21.15.2:6833/177641343,v1:172.21.15.2:6835/177641343] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561b64ed8840 con 0x561b64f103e0 2023-11-26T07:16:43.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.210+0000 7f0747fff700 1 --2- 172.21.15.2:0/3789634665 >> [v2:172.21.15.2:6833/177641343,v1:172.21.15.2:6835/177641343] conn(0x561b64f103e0 0x561b64f37b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:43.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.211+0000 7f0747fff700 1 --2- 172.21.15.2:0/3789634665 >> [v2:172.21.15.2:6833/177641343,v1:172.21.15.2:6835/177641343] conn(0x561b64f103e0 0x561b64f37b90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d3b71e0be762236 server_cookie=59185a4f37422b78 in_seq=0 out_seq=0 2023-11-26T07:16:43.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.211+0000 7f0726ffd700 10 client.6885 ms_handle_connect on v2:172.21.15.2:6833/177641343 2023-11-26T07:16:43.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.211+0000 7f0726ffd700 1 -- 172.21.15.2:0/3789634665 <== mds.0 v2:172.21.15.2:6833/177641343 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561b64ed8840 con 0x561b64f103e0 2023-11-26T07:16:43.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.211+0000 7f0726ffd700 10 client.6885 handle_command_reply: tid=0 2023-11-26T07:16:43.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.211+0000 7f075a966b80 1 client.6885 shutdown 2023-11-26T07:16:43.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.211+0000 7f075a966b80 1 -- 172.21.15.2:0/3789634665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b64f0a080 msgr2=0x561b64efe330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:43.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.211+0000 7f075a966b80 1 --2- 172.21.15.2:0/3789634665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b64f0a080 0x561b64efe330 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f0738014940 tx=0x7f0738004750 comp rx=0 tx=0).stop 2023-11-26T07:16:43.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.211+0000 7f075a966b80 1 -- 172.21.15.2:0/3789634665 shutdown_connections 2023-11-26T07:16:43.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.211+0000 7f075a966b80 1 --2- 172.21.15.2:0/3789634665 >> [v2:172.21.15.2:6833/177641343,v1:172.21.15.2:6835/177641343] conn(0x561b64f103e0 0x561b64f37b90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:43.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.211+0000 7f075a966b80 1 --2- 172.21.15.2:0/3789634665 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561b64f1fed0 0x561b64efe870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:43.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.211+0000 7f075a966b80 1 --2- 172.21.15.2:0/3789634665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561b64f07490 0x561b64f34020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:43.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.211+0000 7f075a966b80 1 --2- 172.21.15.2:0/3789634665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b64f0a080 0x561b64efe330 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:43.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.211+0000 7f0726ffd700 0 client.6885 ms_handle_reset on v2:172.21.15.2:6833/177641343 2023-11-26T07:16:43.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.211+0000 7f075a966b80 1 -- 172.21.15.2:0/3789634665 >> 172.21.15.2:0/3789634665 conn(0x561b64e38310 msgr2=0x561b64f52c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:43.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.212+0000 7f075a966b80 1 -- 172.21.15.2:0/3789634665 shutdown_connections 2023-11-26T07:16:43.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.212+0000 7f075a966b80 1 -- 172.21.15.2:0/3789634665 wait complete. 2023-11-26T07:16:43.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.212+0000 7f075a966b80 20 client.6885 trim_cache size 0 max 16384 2023-11-26T07:16:43.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.230+0000 7f075a966b80 1 Processor -- start 2023-11-26T07:16:43.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.230+0000 7f075a966b80 1 -- start start 2023-11-26T07:16:43.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.230+0000 7f075a966b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b64f07490 0x561b64f04230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:43.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.230+0000 7f075a966b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561b64f0a080 0x561b64f04770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:43.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.230+0000 7f075a966b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561b64f1fed0 0x561b64f30f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:43.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.230+0000 7f075a966b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b64cdc8d0 con 0x561b64f07490 2023-11-26T07:16:43.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.230+0000 7f075a966b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b64edf250 con 0x561b64f1fed0 2023-11-26T07:16:43.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.230+0000 7f075a966b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x561b64f4c4d0 con 0x561b64f0a080 2023-11-26T07:16:43.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.230+0000 7f0747fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b64f07490 0x561b64f04230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:43.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.230+0000 7f0747fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b64f07490 0x561b64f04230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44430/0 (socket says 172.21.15.2:44430) 2023-11-26T07:16:43.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.230+0000 7f0747fff700 1 -- 172.21.15.2:0/3682315942 learned_addr learned my addr 172.21.15.2:0/3682315942 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:43.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.231+0000 7f074cd0a700 1 --2- 172.21.15.2:0/3682315942 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561b64f1fed0 0x561b64f30f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:43.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.231+0000 7f07477fe700 1 --2- 172.21.15.2:0/3682315942 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561b64f0a080 0x561b64f04770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:43.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.231+0000 7f0747fff700 1 -- 172.21.15.2:0/3682315942 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561b64f0a080 msgr2=0x561b64f04770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:43.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.231+0000 7f0747fff700 1 --2- 172.21.15.2:0/3682315942 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561b64f0a080 0x561b64f04770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:43.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.231+0000 7f0747fff700 1 -- 172.21.15.2:0/3682315942 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561b64f1fed0 msgr2=0x561b64f30f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:43.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.231+0000 7f0747fff700 1 --2- 172.21.15.2:0/3682315942 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561b64f1fed0 0x561b64f30f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:43.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.231+0000 7f0747fff700 1 -- 172.21.15.2:0/3682315942 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b64c6fc10 con 0x561b64f07490 2023-11-26T07:16:43.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.231+0000 7f0747fff700 1 --2- 172.21.15.2:0/3682315942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b64f07490 0x561b64f04230 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f0730003fd0 tx=0x7f073001c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77a3fda58034c54e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:43.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.231+0000 7f073e7fc700 1 -- 172.21.15.2:0/3682315942 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073008b040 con 0x561b64f07490 2023-11-26T07:16:43.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.231+0000 7f073e7fc700 1 -- 172.21.15.2:0/3682315942 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0730076040 con 0x561b64f07490 2023-11-26T07:16:43.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.231+0000 7f073e7fc700 1 -- 172.21.15.2:0/3682315942 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0730055c40 con 0x561b64f07490 2023-11-26T07:16:43.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.231+0000 7f075a966b80 1 -- 172.21.15.2:0/3682315942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b64f07490 msgr2=0x561b64f04230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:43.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.231+0000 7f075a966b80 1 --2- 172.21.15.2:0/3682315942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b64f07490 0x561b64f04230 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f0730003fd0 tx=0x7f073001c070 comp rx=0 tx=0).stop 2023-11-26T07:16:43.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.231+0000 7f075a966b80 1 -- 172.21.15.2:0/3682315942 shutdown_connections 2023-11-26T07:16:43.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.231+0000 7f075a966b80 1 --2- 172.21.15.2:0/3682315942 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561b64f1fed0 0x561b64f30f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:43.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.231+0000 7f075a966b80 1 --2- 172.21.15.2:0/3682315942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b64f07490 0x561b64f04230 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:43.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.231+0000 7f075a966b80 1 --2- 172.21.15.2:0/3682315942 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561b64f0a080 0x561b64f04770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:43.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.231+0000 7f075a966b80 1 -- 172.21.15.2:0/3682315942 >> 172.21.15.2:0/3682315942 conn(0x561b64e38310 msgr2=0x561b64f05590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:43.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.232+0000 7f075a966b80 1 -- 172.21.15.2:0/3682315942 shutdown_connections 2023-11-26T07:16:43.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.232+0000 7f075a966b80 1 -- 172.21.15.2:0/3682315942 wait complete. 2023-11-26T07:16:43.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.232+0000 7f075a966b80 1 -- start start 2023-11-26T07:16:43.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.232+0000 7f075a966b80 1 Processor -- start 2023-11-26T07:16:43.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.233+0000 7f075a966b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561b64f07490 0x561b64f675e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:43.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.233+0000 7f075a966b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561b64f0a080 0x561b64fb7870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:43.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.233+0000 7f075a966b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b64f1fed0 0x561b64f2a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:43.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.233+0000 7f075a966b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b64f50c70 con 0x561b64f1fed0 2023-11-26T07:16:43.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.233+0000 7f075a966b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b64f67b20 con 0x561b64f07490 2023-11-26T07:16:43.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.233+0000 7f075a966b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x561b64fb7db0 con 0x561b64f0a080 2023-11-26T07:16:43.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.233+0000 7f075a966b80 10 client.0 _ll_register_callbacks cb 0x561b64d42a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-26T07:16:43.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.233+0000 7f074cd0a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b64f1fed0 0x561b64f2a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:43.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.233+0000 7f074cd0a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b64f1fed0 0x561b64f2a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44440/0 (socket says 172.21.15.2:44440) 2023-11-26T07:16:43.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.233+0000 7f074cd0a700 1 -- 172.21.15.2:0/3102550070 learned_addr learned my addr 172.21.15.2:0/3102550070 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:43.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.233+0000 7f07477fe700 1 --2- 172.21.15.2:0/3102550070 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561b64f0a080 0x561b64fb7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:43.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.233+0000 7f0747fff700 1 --2- 172.21.15.2:0/3102550070 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561b64f07490 0x561b64f675e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:43.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.233+0000 7f074cd0a700 1 -- 172.21.15.2:0/3102550070 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561b64f0a080 msgr2=0x561b64fb7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:43.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.233+0000 7f074cd0a700 1 --2- 172.21.15.2:0/3102550070 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561b64f0a080 0x561b64fb7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:43.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.233+0000 7f074cd0a700 1 -- 172.21.15.2:0/3102550070 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561b64f07490 msgr2=0x561b64f675e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:43.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.233+0000 7f074cd0a700 1 --2- 172.21.15.2:0/3102550070 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561b64f07490 0x561b64f675e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:43.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.233+0000 7f074cd0a700 1 -- 172.21.15.2:0/3102550070 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0730086040 con 0x561b64f1fed0 2023-11-26T07:16:43.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.234+0000 7f074cd0a700 1 --2- 172.21.15.2:0/3102550070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b64f1fed0 0x561b64f2a790 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f07400072b0 tx=0x7f07400075c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40a2fb2e15a66e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:43.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.234+0000 7f0726ffd700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-26T07:16:43.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.234+0000 7f0726ffd700 1 -- 172.21.15.2:0/3102550070 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0740017870 con 0x561b64f1fed0 2023-11-26T07:16:43.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.234+0000 7f0726ffd700 1 -- 172.21.15.2:0/3102550070 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f07400179d0 con 0x561b64f1fed0 2023-11-26T07:16:43.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.234+0000 7f075a966b80 1 -- 172.21.15.2:0/3102550070 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f073005d680 con 0x561b64f1fed0 2023-11-26T07:16:43.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.234+0000 7f0726ffd700 1 -- 172.21.15.2:0/3102550070 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0740017b90 con 0x561b64f1fed0 2023-11-26T07:16:43.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.234+0000 7f075a966b80 10 client.6891 fetch_fsmap learned FSMap version 46 2023-11-26T07:16:43.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.234+0000 7f075a966b80 1 -- 172.21.15.2:0/3102550070 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x561b64cad200 con 0x561b64f1fed0 2023-11-26T07:16:43.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.234+0000 7f0726ffd700 1 -- 172.21.15.2:0/3102550070 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f073005d680 con 0x561b64f1fed0 2023-11-26T07:16:43.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.234+0000 7f0726ffd700 1 -- 172.21.15.2:0/3102550070 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 46) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0740017cf0 con 0x561b64f1fed0 2023-11-26T07:16:43.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.234+0000 7f075a966b80 10 client.6891 fetch_fsmap finished waiting for FSMap version 46 2023-11-26T07:16:43.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.234+0000 7f075a966b80 10 client.6891 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-26T07:16:43.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.234+0000 7f075a966b80 20 client.6891 populate_metadata read hostname 'smithi002' 2023-11-26T07:16:43.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.234+0000 7f075a966b80 1 --2- 172.21.15.2:0/3102550070 >> [v2:172.21.15.2:6833/177641343,v1:172.21.15.2:6835/177641343] conn(0x561b64f484e0 0x561b64f1ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:43.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.234+0000 7f075a966b80 4 client.6891 mds_command: new command op to 6714 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-26T07:16:43.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.234+0000 7f075a966b80 1 -- 172.21.15.2:0/3102550070 --> [v2:172.21.15.2:6833/177641343,v1:172.21.15.2:6835/177641343] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561b64e23f80 con 0x561b64f484e0 2023-11-26T07:16:43.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.234+0000 7f0747fff700 1 --2- 172.21.15.2:0/3102550070 >> [v2:172.21.15.2:6833/177641343,v1:172.21.15.2:6835/177641343] conn(0x561b64f484e0 0x561b64f1ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:43.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.235+0000 7f0726ffd700 10 client.6891 ms_handle_connect on v2:172.21.15.2:6833/177641343 2023-11-26T07:16:43.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.235+0000 7f0747fff700 1 --2- 172.21.15.2:0/3102550070 >> [v2:172.21.15.2:6833/177641343,v1:172.21.15.2:6835/177641343] conn(0x561b64f484e0 0x561b64f1ed70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca4182e47cee2381 server_cookie=5e7edf3e3ceaa98 in_seq=0 out_seq=0 2023-11-26T07:16:43.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.235+0000 7f0726ffd700 1 -- 172.21.15.2:0/3102550070 <== mds.0 v2:172.21.15.2:6833/177641343 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x561b64e23f80 con 0x561b64f484e0 2023-11-26T07:16:43.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.235+0000 7f0726ffd700 10 client.6891 handle_command_reply: tid=0 2023-11-26T07:16:43.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.235+0000 7f075a966b80 1 client.6891 shutdown 2023-11-26T07:16:43.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.235+0000 7f075a966b80 1 -- 172.21.15.2:0/3102550070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b64f1fed0 msgr2=0x561b64f2a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:43.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.235+0000 7f075a966b80 1 --2- 172.21.15.2:0/3102550070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b64f1fed0 0x561b64f2a790 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f07400072b0 tx=0x7f07400075c0 comp rx=0 tx=0).stop 2023-11-26T07:16:43.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.235+0000 7f075a966b80 1 -- 172.21.15.2:0/3102550070 shutdown_connections 2023-11-26T07:16:43.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.235+0000 7f075a966b80 1 --2- 172.21.15.2:0/3102550070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b64f1fed0 0x561b64f2a790 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:43.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.235+0000 7f075a966b80 1 --2- 172.21.15.2:0/3102550070 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561b64f07490 0x561b64f675e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:43.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.235+0000 7f075a966b80 1 --2- 172.21.15.2:0/3102550070 >> [v2:172.21.15.2:6833/177641343,v1:172.21.15.2:6835/177641343] conn(0x561b64f484e0 0x561b64f1ed70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:43.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.235+0000 7f075a966b80 1 --2- 172.21.15.2:0/3102550070 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561b64f0a080 0x561b64fb7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:43.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.235+0000 7f0726ffd700 0 client.6891 ms_handle_reset on v2:172.21.15.2:6833/177641343 2023-11-26T07:16:43.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.235+0000 7f075a966b80 1 -- 172.21.15.2:0/3102550070 >> 172.21.15.2:0/3102550070 conn(0x561b64e38310 msgr2=0x561b64f32fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:43.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.235+0000 7f075a966b80 1 -- 172.21.15.2:0/3102550070 shutdown_connections 2023-11-26T07:16:43.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.235+0000 7f075a966b80 1 -- 172.21.15.2:0/3102550070 wait complete. 2023-11-26T07:16:43.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.235+0000 7f075a966b80 20 client.6891 trim_cache size 0 max 16384 2023-11-26T07:16:43.245 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-26T07:16:43.245 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "cb9817c7-f1ed-4745-9395-2760a3bb9712", 2023-11-26T07:16:43.245 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2023-11-26T07:16:43.245 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 6714, 2023-11-26T07:16:43.245 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2023-11-26T07:16:43.245 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2023-11-26T07:16:43.245 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2023-11-26T07:16:43.245 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 10.624534042000001, 2023-11-26T07:16:43.245 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 46, 2023-11-26T07:16:43.245 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 73, 2023-11-26T07:16:43.245 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 73, 2023-11-26T07:16:43.246 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 15.532249029999999 2023-11-26T07:16:43.246 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-26T07:16:43.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.236+0000 7f074e76d700 1 -- 172.21.15.2:0/1423899359 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f072806b740 msgr2=0x7f072806dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:43.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.236+0000 7f074e76d700 1 --2- 172.21.15.2:0/1423899359 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f072806b740 0x7f072806dc00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f0738009d70 tx=0x7f0738009210 comp rx=0 tx=0).stop 2023-11-26T07:16:43.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.236+0000 7f074e76d700 1 -- 172.21.15.2:0/1423899359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07480b3c80 msgr2=0x7f0748159170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:43.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.236+0000 7f074e76d700 1 --2- 172.21.15.2:0/1423899359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07480b3c80 0x7f0748159170 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f0730009c40 tx=0x7f0730004750 comp rx=0 tx=0).stop 2023-11-26T07:16:43.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.236+0000 7f074e76d700 1 -- 172.21.15.2:0/1423899359 shutdown_connections 2023-11-26T07:16:43.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.236+0000 7f074e76d700 1 --2- 172.21.15.2:0/1423899359 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f072806b740 0x7f072806dc00 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:43.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.236+0000 7f074e76d700 1 --2- 172.21.15.2:0/1423899359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07481447b0 0x7f074813f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:43.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.236+0000 7f074e76d700 1 --2- 172.21.15.2:0/1423899359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07480b3c80 0x7f0748159170 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:43.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.236+0000 7f074e76d700 1 --2- 172.21.15.2:0/1423899359 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07480b4f50 0x7f074815cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:43.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.236+0000 7f074e76d700 1 -- 172.21.15.2:0/1423899359 >> 172.21.15.2:0/1423899359 conn(0x7f07480b27d0 msgr2=0x7f074806afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:43.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.236+0000 7f074e76d700 1 -- 172.21.15.2:0/1423899359 shutdown_connections 2023-11-26T07:16:43.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.236+0000 7f074e76d700 1 -- 172.21.15.2:0/1423899359 wait complete. 2023-11-26T07:16:43.250 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-26T07:16:43.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.373+0000 7f2ef71c2700 1 Processor -- start 2023-11-26T07:16:43.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.373+0000 7f2ef71c2700 1 -- start start 2023-11-26T07:16:43.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.374+0000 7f2ef71c2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ef006b620 0x7f2ef00b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:43.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.374+0000 7f2ef71c2700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2ef00b5ab0 0x7f2ef00b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:43.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.374+0000 7f2ef71c2700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2ef01478c0 0x7f2ef0161ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:43.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.374+0000 7f2ef71c2700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef0071f50 con 0x7f2ef00b5ab0 2023-11-26T07:16:43.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.374+0000 7f2ef71c2700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef0072230 con 0x7f2ef01478c0 2023-11-26T07:16:43.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.374+0000 7f2ef71c2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef0072510 con 0x7f2ef006b620 2023-11-26T07:16:43.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.374+0000 7f2eeffff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2ef00b5ab0 0x7f2ef00b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:43.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.374+0000 7f2eeffff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2ef00b5ab0 0x7f2ef00b3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44444/0 (socket says 172.21.15.2:44444) 2023-11-26T07:16:43.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.374+0000 7f2eeffff700 1 -- 172.21.15.2:0/2096121280 learned_addr learned my addr 172.21.15.2:0/2096121280 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:43.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.374+0000 7f2ef4f5e700 1 --2- 172.21.15.2:0/2096121280 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ef006b620 0x7f2ef00b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:43.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.374+0000 7f2eeffff700 1 -- 172.21.15.2:0/2096121280 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ef006b620 msgr2=0x7f2ef00b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:43.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.374+0000 7f2eeffff700 1 --2- 172.21.15.2:0/2096121280 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ef006b620 0x7f2ef00b3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:43.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.374+0000 7f2eeffff700 1 -- 172.21.15.2:0/2096121280 >> v2:172.21.15.192:3300/0 conn(0x7f2ef01478c0 msgr2=0x7f2ef0161ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:43.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.374+0000 7f2ef575f700 1 --2- 172.21.15.2:0/2096121280 >> v2:172.21.15.192:3300/0 conn(0x7f2ef01478c0 0x7f2ef0161ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:43.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.374+0000 7f2eeffff700 1 --2- 172.21.15.2:0/2096121280 >> v2:172.21.15.192:3300/0 conn(0x7f2ef01478c0 0x7f2ef0161ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:43.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.374+0000 7f2eeffff700 1 -- 172.21.15.2:0/2096121280 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef00727f0 con 0x7f2ef00b5ab0 2023-11-26T07:16:43.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.374+0000 7f2ef4f5e700 1 --2- 172.21.15.2:0/2096121280 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ef006b620 0x7f2ef00b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:16:43.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.375+0000 7f2ef575f700 1 --2- 172.21.15.2:0/2096121280 >> v2:172.21.15.192:3300/0 conn(0x7f2ef01478c0 0x7f2ef0161ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:16:43.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.375+0000 7f2eeffff700 1 --2- 172.21.15.2:0/2096121280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ef00b5ab0 0x7f2ef00b3f80 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f2ef00747c0 tx=0x7f2edc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0246ae22d3c644 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:43.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.375+0000 7f2eef7fe700 1 -- 172.21.15.2:0/2096121280 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2edc00b870 con 0x7f2ef00b5ab0 2023-11-26T07:16:43.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.375+0000 7f2eef7fe700 1 -- 172.21.15.2:0/2096121280 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2edc00b9d0 con 0x7f2ef00b5ab0 2023-11-26T07:16:43.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.375+0000 7f2eef7fe700 1 -- 172.21.15.2:0/2096121280 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2edc00bd60 con 0x7f2ef00b5ab0 2023-11-26T07:16:43.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.375+0000 7f2ef71c2700 1 -- 172.21.15.2:0/2096121280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ef00b5ab0 msgr2=0x7f2ef00b3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:43.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.375+0000 7f2ef71c2700 1 --2- 172.21.15.2:0/2096121280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ef00b5ab0 0x7f2ef00b3f80 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f2ef00747c0 tx=0x7f2edc009bd0 comp rx=0 tx=0).stop 2023-11-26T07:16:43.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.375+0000 7f2ef71c2700 1 -- 172.21.15.2:0/2096121280 shutdown_connections 2023-11-26T07:16:43.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.375+0000 7f2ef71c2700 1 --2- 172.21.15.2:0/2096121280 >> v2:172.21.15.192:3300/0 conn(0x7f2ef01478c0 0x7f2ef0161ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:43.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.375+0000 7f2ef71c2700 1 --2- 172.21.15.2:0/2096121280 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ef006b620 0x7f2ef00b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:43.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.375+0000 7f2ef71c2700 1 --2- 172.21.15.2:0/2096121280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ef00b5ab0 0x7f2ef00b3f80 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:43.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.375+0000 7f2ef71c2700 1 -- 172.21.15.2:0/2096121280 >> 172.21.15.2:0/2096121280 conn(0x7f2ef00b2740 msgr2=0x7f2ef00b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:43.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.375+0000 7f2ef71c2700 1 -- 172.21.15.2:0/2096121280 shutdown_connections 2023-11-26T07:16:43.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.375+0000 7f2ef71c2700 1 -- 172.21.15.2:0/2096121280 wait complete. 2023-11-26T07:16:43.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.377+0000 7f2ef71c2700 1 Processor -- start 2023-11-26T07:16:43.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.377+0000 7f2ef71c2700 1 -- start start 2023-11-26T07:16:43.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.378+0000 7f2ef71c2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ef006b620 0x7f2ef01e4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:43.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.378+0000 7f2ef71c2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ef00b5ab0 0x7f2ef00ae910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:43.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.378+0000 7f2ef71c2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ef01478c0 0x7f2ef00aee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:43.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.378+0000 7f2ef71c2700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef01f4730 con 0x7f2ef01478c0 2023-11-26T07:16:43.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.378+0000 7f2ef71c2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef01e4b70 con 0x7f2ef00b5ab0 2023-11-26T07:16:43.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.378+0000 7f2ef71c2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef01f3b20 con 0x7f2ef006b620 2023-11-26T07:16:43.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.378+0000 7f2ef575f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ef01478c0 0x7f2ef00aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:43.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.378+0000 7f2ef575f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ef01478c0 0x7f2ef00aee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44454/0 (socket says 172.21.15.2:44454) 2023-11-26T07:16:43.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.378+0000 7f2ef4f5e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ef006b620 0x7f2ef01e4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:43.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.378+0000 7f2ef575f700 1 -- 172.21.15.2:0/3485483677 learned_addr learned my addr 172.21.15.2:0/3485483677 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:43.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.378+0000 7f2eeffff700 1 --2- 172.21.15.2:0/3485483677 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ef00b5ab0 0x7f2ef00ae910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:43.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.378+0000 7f2ef575f700 1 -- 172.21.15.2:0/3485483677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ef006b620 msgr2=0x7f2ef01e4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:43.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.378+0000 7f2ef575f700 1 --2- 172.21.15.2:0/3485483677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ef006b620 0x7f2ef01e4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:43.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.378+0000 7f2ef575f700 1 -- 172.21.15.2:0/3485483677 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ef00b5ab0 msgr2=0x7f2ef00ae910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:43.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.378+0000 7f2ef575f700 1 --2- 172.21.15.2:0/3485483677 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ef00b5ab0 0x7f2ef00ae910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:43.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.378+0000 7f2ef575f700 1 -- 172.21.15.2:0/3485483677 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2edc009550 con 0x7f2ef01478c0 2023-11-26T07:16:43.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.378+0000 7f2ef575f700 1 --2- 172.21.15.2:0/3485483677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ef01478c0 0x7f2ef00aee50 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f2ee800cd50 tx=0x7f2ee800a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:43.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.378+0000 7f2eed7fa700 1 -- 172.21.15.2:0/3485483677 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee800cea0 con 0x7f2ef01478c0 2023-11-26T07:16:43.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.378+0000 7f2eed7fa700 1 -- 172.21.15.2:0/3485483677 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee800f480 con 0x7f2ef01478c0 2023-11-26T07:16:43.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.378+0000 7f2ef71c2700 1 -- 172.21.15.2:0/3485483677 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef01f3e00 con 0x7f2ef01478c0 2023-11-26T07:16:43.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.378+0000 7f2eed7fa700 1 -- 172.21.15.2:0/3485483677 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee800f830 con 0x7f2ef01478c0 2023-11-26T07:16:43.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.378+0000 7f2ef71c2700 1 -- 172.21.15.2:0/3485483677 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ef01f43c0 con 0x7f2ef01478c0 2023-11-26T07:16:43.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.379+0000 7f2ef71c2700 1 -- 172.21.15.2:0/3485483677 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ef0068670 con 0x7f2ef01478c0 2023-11-26T07:16:43.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.380+0000 7f2eed7fa700 1 -- 172.21.15.2:0/3485483677 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f2ee800b040 con 0x7f2ef01478c0 2023-11-26T07:16:43.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.380+0000 7f2eed7fa700 1 --2- 172.21.15.2:0/3485483677 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f2ed406b740 0x7f2ed406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:43.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.381+0000 7f2eed7fa700 1 -- 172.21.15.2:0/3485483677 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ee8088590 con 0x7f2ef01478c0 2023-11-26T07:16:43.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.381+0000 7f2ef4f5e700 1 --2- 172.21.15.2:0/3485483677 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f2ed406b740 0x7f2ed406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:43.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.381+0000 7f2ef4f5e700 1 --2- 172.21.15.2:0/3485483677 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f2ed406b740 0x7f2ed406dc00 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0145f60 tx=0x7f2ee4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:43.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.385+0000 7f2eed7fa700 1 -- 172.21.15.2:0/3485483677 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2ee8055090 con 0x7f2ef01478c0 2023-11-26T07:16:43.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.631+0000 7f2ef71c2700 1 -- 172.21.15.2:0/3485483677 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2ef01f4870 con 0x7f2ef01478c0 2023-11-26T07:16:43.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.631+0000 7f2eed7fa700 1 -- 172.21.15.2:0/3485483677 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v46) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2ee80586b0 con 0x7f2ef01478c0 2023-11-26T07:16:43.633 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-26T07:16:43.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.633+0000 7f2ef71c2700 1 -- 172.21.15.2:0/3485483677 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f2ed406b740 msgr2=0x7f2ed406dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:43.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.633+0000 7f2ef71c2700 1 --2- 172.21.15.2:0/3485483677 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f2ed406b740 0x7f2ed406dc00 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0145f60 tx=0x7f2ee4008040 comp rx=0 tx=0).stop 2023-11-26T07:16:43.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.633+0000 7f2ef71c2700 1 -- 172.21.15.2:0/3485483677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ef01478c0 msgr2=0x7f2ef00aee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:43.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.633+0000 7f2ef71c2700 1 --2- 172.21.15.2:0/3485483677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ef01478c0 0x7f2ef00aee50 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f2ee800cd50 tx=0x7f2ee800a560 comp rx=0 tx=0).stop 2023-11-26T07:16:43.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.633+0000 7f2ef71c2700 1 -- 172.21.15.2:0/3485483677 shutdown_connections 2023-11-26T07:16:43.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.633+0000 7f2ef71c2700 1 --2- 172.21.15.2:0/3485483677 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f2ed406b740 0x7f2ed406dc00 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:43.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.633+0000 7f2ef71c2700 1 --2- 172.21.15.2:0/3485483677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ef01478c0 0x7f2ef00aee50 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:43.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.633+0000 7f2ef71c2700 1 --2- 172.21.15.2:0/3485483677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ef006b620 0x7f2ef01e4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:43.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.633+0000 7f2ef71c2700 1 --2- 172.21.15.2:0/3485483677 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ef00b5ab0 0x7f2ef00ae910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:43.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.633+0000 7f2ef71c2700 1 -- 172.21.15.2:0/3485483677 >> 172.21.15.2:0/3485483677 conn(0x7f2ef00b2740 msgr2=0x7f2ef00b3a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:43.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.634+0000 7f2ef71c2700 1 -- 172.21.15.2:0/3485483677 shutdown_connections 2023-11-26T07:16:43.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:43.634+0000 7f2ef71c2700 1 -- 172.21.15.2:0/3485483677 wait complete. 2023-11-26T07:16:43.647 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-26T07:16:43.647 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-26T07:16:43.648 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2023-11-26T07:16:43.648 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-26T07:16:43.648 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-26T07:16:43.648 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-26T07:16:43.648 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-26T07:16:43.648 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-26T07:16:43.648 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-26T07:16:43.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:43.648 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2023-11-26T07:16:43.665 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:16:43.665 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:16:43.666 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:16:43.666 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:16:43.666 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2023-11-26T07:16:43.666 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:16:43.666 INFO:teuthology.orchestra.run.smithi002.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:16:43.666 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:16:43.666 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:16:43.666 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:16:43.666 INFO:teuthology.orchestra.run.smithi002.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-26T07:16:43.666 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:16:43.667 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-26T07:16:43.667 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 42020sec preferred_lft 42020sec 2023-11-26T07:16:43.667 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link 2023-11-26T07:16:43.667 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:16:43.667 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:16:43.667 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:16:43.667 INFO:teuthology.orchestra.run.smithi002.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-26T07:16:43.667 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0a:57:c2:51:2c:98 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:16:43.667 INFO:teuthology.orchestra.run.smithi002.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-26T07:16:43.667 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:16:43.667 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::60ae:c7ff:fe6a:97cb/64 scope link 2023-11-26T07:16:43.667 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:16:43.668 INFO:teuthology.orchestra.run.smithi002.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:16:43.668 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0a:57:c2:51:2c:98 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:16:43.668 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::857:c2ff:fe51:2c98/64 scope link 2023-11-26T07:16:43.668 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:16:43.668 INFO:teuthology.orchestra.run.smithi002.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:16:43.668 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether a2:e0:b8:ef:39:07 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-26T07:16:43.668 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::a0e0:b8ff:feef:3907/64 scope link 2023-11-26T07:16:43.668 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:16:43.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:43.668 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-26T07:16:43.731 INFO:teuthology.orchestra.run.smithi002.stdout:1 2023-11-26T07:16:43.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:43.732 DEBUG:teuthology.orchestra.run.smithi002:> route 2023-11-26T07:16:43.791 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2023-11-26T07:16:43.791 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-26T07:16:43.791 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-26T07:16:43.791 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-26T07:16:43.791 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-26T07:16:43.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:43.792 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-11-26T07:16:43.792 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-11-26T07:16:43.792 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-26T07:16:43.792 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-26T07:16:43.792 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-26T07:16:43.792 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-11-26T07:16:43.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:43.899 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2023-11-26T07:16:43.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-26T07:16:43.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-26T07:16:43.915 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-26T07:16:43.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:43.916 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 up 2023-11-26T07:16:43.983 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:16:43.983 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-26T07:16:44.039 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-26T07:16:44.040 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:16:44.040 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-26T07:16:44.096 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-26T07:16:44.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:44.096 DEBUG:teuthology.orchestra.run.smithi002:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-26T07:16:44.183 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-26T07:16:44.183 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-26T07:16:44.183 INFO:teuthology.orchestra.run.smithi002.stdout:invalid new device string format 2023-11-26T07:16:44.192 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-26T07:16:44.192 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-26T07:16:44.192 INFO:teuthology.orchestra.run.smithi002.stdout:invalid new device string format 2023-11-26T07:16:44.192 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-11-26T07:16:44.192 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:16:44.265 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-26T07:16:44.265 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-26T07:16:44.265 INFO:teuthology.orchestra.run.smithi002.stdout:invalid new device string format 2023-11-26T07:16:44.265 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-11-26T07:16:44.265 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:16:44.265 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: resolved to: "172.21.15.2:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-11-26T07:16:44.265 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.2:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-11-26T07:16:44.265 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=cb9817c7-f1ed-4745-9395-2760a3bb9712" will pass to kernel 2023-11-26T07:16:44.267 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-26T07:16:44.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:44.268 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-26T07:16:44.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:44.295 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-26T07:16:44.378 INFO:teuthology.orchestra.run.smithi002.stdout:client6346 2023-11-26T07:16:44.378 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:44.378 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:44.435 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-26T07:16:44.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.598+0000 7f7cbe739700 1 Processor -- start 2023-11-26T07:16:44.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.599+0000 7f7cbe739700 1 -- start start 2023-11-26T07:16:44.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.599+0000 7f7cbe739700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7cb806afd0 0x7f7cb80b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:44.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.599+0000 7f7cbe739700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7cb806edc0 0x7f7cb806b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:44.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.599+0000 7f7cbe739700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb80ad860 con 0x7f7cb806dba0 2023-11-26T07:16:44.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.599+0000 7f7cbe739700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cb806f830 con 0x7f7cb806edc0 2023-11-26T07:16:44.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.599+0000 7f7cbe739700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb80d0a20 con 0x7f7cb806afd0 2023-11-26T07:16:44.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.600+0000 7f7cbccd6700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7cb806dba0 0x7f7cb806e050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35676/0 (socket says 172.21.15.2:35676) 2023-11-26T07:16:44.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.600+0000 7f7cbccd6700 1 -- 172.21.15.2:0/2293873825 learned_addr learned my addr 172.21.15.2:0/2293873825 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:16:44.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.600+0000 7f7cb77fe700 1 --2- 172.21.15.2:0/2293873825 >> v2:172.21.15.192:3300/0 conn(0x7f7cb806edc0 0x7f7cb806b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:44.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.600+0000 7f7cb7fff700 1 --2- 172.21.15.2:0/2293873825 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7cb806afd0 0x7f7cb80b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:44.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.600+0000 7f7cb6ffd700 1 -- 172.21.15.2:0/2293873825 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3713550019 0 0) 0x7f7cb80ad860 con 0x7f7cb806dba0 2023-11-26T07:16:44.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.600+0000 7f7cb6ffd700 1 -- 172.21.15.2:0/2293873825 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ca00035b0 con 0x7f7cb806dba0 2023-11-26T07:16:44.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.600+0000 7f7cb6ffd700 1 -- 172.21.15.2:0/2293873825 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3566992191 0 0) 0x7f7ca00035b0 con 0x7f7cb806dba0 2023-11-26T07:16:44.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.600+0000 7f7cb6ffd700 1 -- 172.21.15.2:0/2293873825 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7cb806afd0 msgr2=0x7f7cb80b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:44.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.600+0000 7f7cb6ffd700 1 --2- 172.21.15.2:0/2293873825 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7cb806afd0 0x7f7cb80b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:44.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.600+0000 7f7cb6ffd700 1 -- 172.21.15.2:0/2293873825 >> v2:172.21.15.192:3300/0 conn(0x7f7cb806edc0 msgr2=0x7f7cb806b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:44.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.600+0000 7f7cb6ffd700 1 --2- 172.21.15.2:0/2293873825 >> v2:172.21.15.192:3300/0 conn(0x7f7cb806edc0 0x7f7cb806b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:44.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.600+0000 7f7cb6ffd700 1 -- 172.21.15.2:0/2293873825 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb8072b50 con 0x7f7cb806dba0 2023-11-26T07:16:44.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.600+0000 7f7cb6ffd700 1 -- 172.21.15.2:0/2293873825 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f7cb00019f0 con 0x7f7cb806dba0 2023-11-26T07:16:44.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.600+0000 7f7cb6ffd700 1 -- 172.21.15.2:0/2293873825 >> v1:172.21.15.2:6789/0 conn(0x7f7cb806dba0 legacy=0x7f7cb806e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:44.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.600+0000 7f7cb6ffd700 1 --2- 172.21.15.2:0/2293873825 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ca0003a00 0x7f7ca0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:44.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.600+0000 7f7cb6ffd700 1 --2- 172.21.15.2:0/2293873825 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7cb806afd0 0x7f7ca0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:44.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.600+0000 7f7cb6ffd700 1 --2- 172.21.15.2:0/2293873825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ca0004d90 0x7f7ca0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:44.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.600+0000 7f7cb6ffd700 1 -- 172.21.15.2:0/2293873825 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb806f830 con 0x7f7ca0004d90 2023-11-26T07:16:44.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.600+0000 7f7cb6ffd700 1 -- 172.21.15.2:0/2293873825 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb80d0a20 con 0x7f7ca0003a00 2023-11-26T07:16:44.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.600+0000 7f7cb6ffd700 1 -- 172.21.15.2:0/2293873825 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca000ba10 con 0x7f7cb806afd0 2023-11-26T07:16:44.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.600+0000 7f7cbccd6700 1 --2- 172.21.15.2:0/2293873825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ca0004d90 0x7f7ca0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:44.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.600+0000 7f7cb7fff700 1 --2- 172.21.15.2:0/2293873825 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ca0003a00 0x7f7ca0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:44.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.600+0000 7f7cb77fe700 1 --2- 172.21.15.2:0/2293873825 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7cb806afd0 0x7f7ca0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:44.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.601+0000 7f7cbccd6700 1 -- 172.21.15.2:0/2293873825 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7cb806afd0 msgr2=0x7f7ca0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:44.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.601+0000 7f7cbccd6700 1 --2- 172.21.15.2:0/2293873825 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7cb806afd0 0x7f7ca0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:44.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.601+0000 7f7cbccd6700 1 -- 172.21.15.2:0/2293873825 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ca0003a00 msgr2=0x7f7ca0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:44.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.601+0000 7f7cbccd6700 1 --2- 172.21.15.2:0/2293873825 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ca0003a00 0x7f7ca0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:44.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.601+0000 7f7cbccd6700 1 -- 172.21.15.2:0/2293873825 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca00035b0 con 0x7f7ca0004d90 2023-11-26T07:16:44.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.601+0000 7f7cbccd6700 1 --2- 172.21.15.2:0/2293873825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ca0004d90 0x7f7ca0005210 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f7cb000a8d0 tx=0x7f7ca0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab40bb13a094dfb server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:44.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.601+0000 7f7cb6ffd700 1 -- 172.21.15.2:0/2293873825 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb000a340 con 0x7f7ca0004d90 2023-11-26T07:16:44.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.601+0000 7f7cb6ffd700 1 -- 172.21.15.2:0/2293873825 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb0012600 con 0x7f7ca0004d90 2023-11-26T07:16:44.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.601+0000 7f7cb6ffd700 1 -- 172.21.15.2:0/2293873825 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb00129b0 con 0x7f7ca0004d90 2023-11-26T07:16:44.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.601+0000 7f7cbe739700 1 -- 172.21.15.2:0/2293873825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ca0004d90 msgr2=0x7f7ca0005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:44.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.601+0000 7f7cbe739700 1 --2- 172.21.15.2:0/2293873825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ca0004d90 0x7f7ca0005210 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f7cb000a8d0 tx=0x7f7ca0005880 comp rx=0 tx=0).stop 2023-11-26T07:16:44.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.601+0000 7f7cbccd6700 1 -- 172.21.15.2:0/2293873825 reap_dead start 2023-11-26T07:16:44.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.602+0000 7f7cbe739700 1 -- 172.21.15.2:0/2293873825 shutdown_connections 2023-11-26T07:16:44.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.602+0000 7f7cbe739700 1 -- 172.21.15.2:0/2293873825 >> 172.21.15.2:0/2293873825 conn(0x7f7cb80b2840 msgr2=0x7f7cb80b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:44.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.602+0000 7f7cbe739700 1 -- 172.21.15.2:0/2293873825 shutdown_connections 2023-11-26T07:16:44.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.602+0000 7f7cbe739700 1 -- 172.21.15.2:0/2293873825 wait complete. 2023-11-26T07:16:44.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.603+0000 7f7cbe739700 1 Processor -- start 2023-11-26T07:16:44.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.603+0000 7f7cbe739700 1 -- start start 2023-11-26T07:16:44.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.604+0000 7f7cbe739700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7cb8146870 0x7f7cb815fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:44.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.604+0000 7f7cbe739700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cb8160270 0x7f7cb815a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:44.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.604+0000 7f7cbe739700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cb815a7a0 0x7f7cb815c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:44.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.604+0000 7f7cbe739700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb815ac20 con 0x7f7cb815a7a0 2023-11-26T07:16:44.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.604+0000 7f7cbe739700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb8146c50 con 0x7f7cb8160270 2023-11-26T07:16:44.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.604+0000 7f7cbe739700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb815d680 con 0x7f7cb8146870 2023-11-26T07:16:44.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.604+0000 7f7cbccd6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cb815a7a0 0x7f7cb815c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:44.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.604+0000 7f7cbccd6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cb815a7a0 0x7f7cb815c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44478/0 (socket says 172.21.15.2:44478) 2023-11-26T07:16:44.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.604+0000 7f7cbccd6700 1 -- 172.21.15.2:0/2892794271 learned_addr learned my addr 172.21.15.2:0/2892794271 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:44.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.604+0000 7f7cb77fe700 1 --2- 172.21.15.2:0/2892794271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cb8160270 0x7f7cb815a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:44.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.604+0000 7f7cb7fff700 1 --2- 172.21.15.2:0/2892794271 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7cb8146870 0x7f7cb815fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:44.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.604+0000 7f7cbccd6700 1 -- 172.21.15.2:0/2892794271 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7cb8146870 msgr2=0x7f7cb815fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:44.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.604+0000 7f7cbccd6700 1 --2- 172.21.15.2:0/2892794271 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7cb8146870 0x7f7cb815fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:44.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.604+0000 7f7cbccd6700 1 -- 172.21.15.2:0/2892794271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cb8160270 msgr2=0x7f7cb815a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:44.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.604+0000 7f7cbccd6700 1 --2- 172.21.15.2:0/2892794271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cb8160270 0x7f7cb815a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:44.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.604+0000 7f7cbccd6700 1 -- 172.21.15.2:0/2892794271 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb81608a0 con 0x7f7cb815a7a0 2023-11-26T07:16:44.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.604+0000 7f7cb77fe700 1 --2- 172.21.15.2:0/2892794271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cb8160270 0x7f7cb815a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:16:44.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.604+0000 7f7cbccd6700 1 --2- 172.21.15.2:0/2892794271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cb815a7a0 0x7f7cb815c2c0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0015040 tx=0x7f7cb0001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:44.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.604+0000 7f7cb4ff9700 1 -- 172.21.15.2:0/2892794271 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb000a340 con 0x7f7cb815a7a0 2023-11-26T07:16:44.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.604+0000 7f7cb4ff9700 1 -- 172.21.15.2:0/2892794271 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb00019c0 con 0x7f7cb815a7a0 2023-11-26T07:16:44.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.604+0000 7f7cbe739700 1 -- 172.21.15.2:0/2892794271 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb8160b80 con 0x7f7cb815a7a0 2023-11-26T07:16:44.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.604+0000 7f7cb4ff9700 1 -- 172.21.15.2:0/2892794271 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb0027410 con 0x7f7cb815a7a0 2023-11-26T07:16:44.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.605+0000 7f7cbe739700 1 -- 172.21.15.2:0/2892794271 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb8154f80 con 0x7f7cb815a7a0 2023-11-26T07:16:44.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.605+0000 7f7cbe739700 1 -- 172.21.15.2:0/2892794271 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cb81555d0 con 0x7f7cb815a7a0 2023-11-26T07:16:44.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.606+0000 7f7cb4ff9700 1 -- 172.21.15.2:0/2892794271 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f7cb0019070 con 0x7f7cb815a7a0 2023-11-26T07:16:44.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.606+0000 7f7cb4ff9700 1 --2- 172.21.15.2:0/2892794271 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7ca406b740 0x7f7ca406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:44.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.606+0000 7f7cb4ff9700 1 -- 172.21.15.2:0/2892794271 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7cb00894d0 con 0x7f7cb815a7a0 2023-11-26T07:16:44.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.607+0000 7f7cb7fff700 1 --2- 172.21.15.2:0/2892794271 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7ca406b740 0x7f7ca406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:44.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.607+0000 7f7cb7fff700 1 --2- 172.21.15.2:0/2892794271 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7ca406b740 0x7f7ca406dc00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8009a20 tx=0x7f7ca8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:44.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.611+0000 7f7cb4ff9700 1 -- 172.21.15.2:0/2892794271 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7cb0055e60 con 0x7f7cb815a7a0 2023-11-26T07:16:44.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.857+0000 7f7cbe739700 1 -- 172.21.15.2:0/2892794271 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7cb8068670 con 0x7f7cb815a7a0 2023-11-26T07:16:44.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.857+0000 7f7cb4ff9700 1 -- 172.21.15.2:0/2892794271 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v46) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7cb0059480 con 0x7f7cb815a7a0 2023-11-26T07:16:44.859 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-26T07:16:44.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.859+0000 7f7cbe739700 1 -- 172.21.15.2:0/2892794271 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7ca406b740 msgr2=0x7f7ca406dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:44.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.859+0000 7f7cbe739700 1 --2- 172.21.15.2:0/2892794271 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7ca406b740 0x7f7ca406dc00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8009a20 tx=0x7f7ca8008040 comp rx=0 tx=0).stop 2023-11-26T07:16:44.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.859+0000 7f7cbe739700 1 -- 172.21.15.2:0/2892794271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cb815a7a0 msgr2=0x7f7cb815c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:44.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.859+0000 7f7cbe739700 1 --2- 172.21.15.2:0/2892794271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cb815a7a0 0x7f7cb815c2c0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0015040 tx=0x7f7cb0001360 comp rx=0 tx=0).stop 2023-11-26T07:16:44.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.859+0000 7f7cbe739700 1 -- 172.21.15.2:0/2892794271 shutdown_connections 2023-11-26T07:16:44.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.859+0000 7f7cbe739700 1 --2- 172.21.15.2:0/2892794271 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7ca406b740 0x7f7ca406dc00 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:44.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.859+0000 7f7cbe739700 1 --2- 172.21.15.2:0/2892794271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cb815a7a0 0x7f7cb815c2c0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:44.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.859+0000 7f7cbe739700 1 --2- 172.21.15.2:0/2892794271 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7cb8146870 0x7f7cb815fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:44.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.859+0000 7f7cbe739700 1 --2- 172.21.15.2:0/2892794271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cb8160270 0x7f7cb815a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:44.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.859+0000 7f7cbe739700 1 -- 172.21.15.2:0/2892794271 >> 172.21.15.2:0/2892794271 conn(0x7f7cb80b2840 msgr2=0x7f7cb80b4190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:44.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.859+0000 7f7cbe739700 1 -- 172.21.15.2:0/2892794271 shutdown_connections 2023-11-26T07:16:44.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:44.859+0000 7f7cbe739700 1 -- 172.21.15.2:0/2892794271 wait complete. 2023-11-26T07:16:44.873 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-26T07:16:44.873 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-26T07:16:44.873 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2023-11-26T07:16:44.873 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-26T07:16:44.873 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-26T07:16:44.874 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-26T07:16:44.874 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-26T07:16:44.874 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-26T07:16:44.874 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-26T07:16:44.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:44.874 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2023-11-26T07:16:44.895 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:16:44.895 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:16:44.895 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:16:44.895 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:16:44.895 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2023-11-26T07:16:44.895 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:16:44.895 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:16:44.896 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2023-11-26T07:16:44.896 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:16:44.896 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2023-11-26T07:16:44.896 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-26T07:16:44.896 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:16:44.896 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-26T07:16:44.896 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:16:44.896 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-26T07:16:44.896 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42096sec preferred_lft 42096sec 2023-11-26T07:16:44.896 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::4774:e26a:42bc:5f29/64 scope link noprefixroute 2023-11-26T07:16:44.896 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:16:44.896 INFO:teuthology.orchestra.run.smithi192.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-26T07:16:44.897 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 8a:29:a0:eb:3c:15 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:16:44.897 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-26T07:16:44.897 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:16:44.897 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::548b:6dff:fe7a:f7ca/64 scope link 2023-11-26T07:16:44.897 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:16:44.897 INFO:teuthology.orchestra.run.smithi192.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:16:44.897 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether a2:92:2e:43:f5:72 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:16:44.897 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::a092:2eff:fe43:f572/64 scope link 2023-11-26T07:16:44.897 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:16:44.897 INFO:teuthology.orchestra.run.smithi192.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:16:44.897 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 8a:29:a0:eb:3c:15 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-26T07:16:44.897 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::8829:a0ff:feeb:3c15/64 scope link 2023-11-26T07:16:44.898 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:16:44.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:44.898 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-26T07:16:44.965 INFO:teuthology.orchestra.run.smithi192.stdout:1 2023-11-26T07:16:44.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:44.967 DEBUG:teuthology.orchestra.run.smithi192:> route 2023-11-26T07:16:45.026 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2023-11-26T07:16:45.026 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-26T07:16:45.027 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-26T07:16:45.027 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-26T07:16:45.027 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-26T07:16:45.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:45.027 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-11-26T07:16:45.027 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-11-26T07:16:45.027 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-26T07:16:45.027 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-26T07:16:45.028 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-26T07:16:45.028 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-11-26T07:16:45.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:45.135 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2023-11-26T07:16:45.152 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-26T07:16:45.152 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-26T07:16:45.153 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-26T07:16:45.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:45.153 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2023-11-26T07:16:45.218 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:16:45.219 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-26T07:16:45.275 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-26T07:16:45.275 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:16:45.275 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-26T07:16:45.332 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-26T07:16:45.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:45.332 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-26T07:16:45.417 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-26T07:16:45.417 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-26T07:16:45.417 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2023-11-26T07:16:45.426 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-26T07:16:45.426 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-26T07:16:45.426 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2023-11-26T07:16:45.426 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-11-26T07:16:45.426 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:16:45.453 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-26T07:16:45.453 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-26T07:16:45.453 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2023-11-26T07:16:45.453 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-11-26T07:16:45.453 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-26T07:16:45.453 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.2:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-11-26T07:16:45.453 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.2:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-11-26T07:16:45.454 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=cb9817c7-f1ed-4745-9395-2760a3bb9712" will pass to kernel 2023-11-26T07:16:45.457 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-26T07:16:45.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:45.457 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-26T07:16:45.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:45.490 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-26T07:16:45.562 INFO:teuthology.orchestra.run.smithi192.stdout:client5780 2023-11-26T07:16:45.563 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:16:45.563 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:45.619 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-11-26T07:16:45.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.758+0000 7fec69a69700 1 Processor -- start 2023-11-26T07:16:45.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.758+0000 7fec69a69700 1 -- start start 2023-11-26T07:16:45.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.759+0000 7fec69a69700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fec6406d1f0 0x7fec640cfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:45.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.759+0000 7fec69a69700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec640ce5b0 0x7fec640ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:45.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.759+0000 7fec69a69700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec6406f110 con 0x7fec640b11d0 2023-11-26T07:16:45.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.759+0000 7fec69a69700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec64161a10 con 0x7fec6406d1f0 2023-11-26T07:16:45.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.759+0000 7fec69a69700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec640d1010 con 0x7fec640ce5b0 2023-11-26T07:16:45.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.759+0000 7fec637fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fec640b11d0 0x7fec6406fcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35692/0 (socket says 172.21.15.2:35692) 2023-11-26T07:16:45.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.759+0000 7fec637fe700 1 -- 172.21.15.2:0/528474313 learned_addr learned my addr 172.21.15.2:0/528474313 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:16:45.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.760+0000 7fec627fc700 1 -- 172.21.15.2:0/528474313 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3834078707 0 0) 0x7fec6406f110 con 0x7fec640b11d0 2023-11-26T07:16:45.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.760+0000 7fec627fc700 1 -- 172.21.15.2:0/528474313 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec500035b0 con 0x7fec640b11d0 2023-11-26T07:16:45.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.760+0000 7fec62ffd700 1 --2- 172.21.15.2:0/528474313 >> v2:172.21.15.192:3300/0 conn(0x7fec6406d1f0 0x7fec640cfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:45.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.760+0000 7fec63fff700 1 --2- 172.21.15.2:0/528474313 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec640ce5b0 0x7fec640ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:45.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.760+0000 7fec627fc700 1 -- 172.21.15.2:0/528474313 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3291165609 0 0) 0x7fec500035b0 con 0x7fec640b11d0 2023-11-26T07:16:45.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.760+0000 7fec627fc700 1 -- 172.21.15.2:0/528474313 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec640ce5b0 msgr2=0x7fec640ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:45.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.760+0000 7fec627fc700 1 --2- 172.21.15.2:0/528474313 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec640ce5b0 0x7fec640ce9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:45.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.760+0000 7fec627fc700 1 -- 172.21.15.2:0/528474313 >> v2:172.21.15.192:3300/0 conn(0x7fec6406d1f0 msgr2=0x7fec640cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:45.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.760+0000 7fec627fc700 1 --2- 172.21.15.2:0/528474313 >> v2:172.21.15.192:3300/0 conn(0x7fec6406d1f0 0x7fec640cfd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:45.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.760+0000 7fec627fc700 1 -- 172.21.15.2:0/528474313 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec640cef10 con 0x7fec640b11d0 2023-11-26T07:16:45.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.760+0000 7fec627fc700 1 -- 172.21.15.2:0/528474313 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7fec54001670 con 0x7fec640b11d0 2023-11-26T07:16:45.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.760+0000 7fec627fc700 1 -- 172.21.15.2:0/528474313 >> v1:172.21.15.2:6789/0 conn(0x7fec640b11d0 legacy=0x7fec6406fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:45.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.760+0000 7fec627fc700 1 --2- 172.21.15.2:0/528474313 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec640ce5b0 0x7fec50003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:45.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.760+0000 7fec627fc700 1 --2- 172.21.15.2:0/528474313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec50003f80 0x7fec50004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:45.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.760+0000 7fec627fc700 1 --2- 172.21.15.2:0/528474313 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec50004d90 0x7fec50005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:45.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.760+0000 7fec627fc700 1 -- 172.21.15.2:0/528474313 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec64161a10 con 0x7fec50003f80 2023-11-26T07:16:45.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.760+0000 7fec627fc700 1 -- 172.21.15.2:0/528474313 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec640d1010 con 0x7fec50004d90 2023-11-26T07:16:45.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.760+0000 7fec627fc700 1 -- 172.21.15.2:0/528474313 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5000ba10 con 0x7fec640ce5b0 2023-11-26T07:16:45.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.760+0000 7fec62ffd700 1 --2- 172.21.15.2:0/528474313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec50003f80 0x7fec50004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:45.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.760+0000 7fec637fe700 1 --2- 172.21.15.2:0/528474313 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec640ce5b0 0x7fec50003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:45.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.760+0000 7fec63fff700 1 --2- 172.21.15.2:0/528474313 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec50004d90 0x7fec50005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:45.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.761+0000 7fec62ffd700 1 -- 172.21.15.2:0/528474313 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec640ce5b0 msgr2=0x7fec50003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:45.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.761+0000 7fec62ffd700 1 --2- 172.21.15.2:0/528474313 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec640ce5b0 0x7fec50003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:45.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.761+0000 7fec62ffd700 1 -- 172.21.15.2:0/528474313 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec50004d90 msgr2=0x7fec50005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:45.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.761+0000 7fec62ffd700 1 --2- 172.21.15.2:0/528474313 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec50004d90 0x7fec50005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:45.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.761+0000 7fec62ffd700 1 -- 172.21.15.2:0/528474313 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec500035b0 con 0x7fec50003f80 2023-11-26T07:16:45.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.761+0000 7fec62ffd700 1 --2- 172.21.15.2:0/528474313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec50003f80 0x7fec50004850 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fec4c009b30 tx=0x7fec50005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a909a3034b366272 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:45.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.761+0000 7fec627fc700 1 -- 172.21.15.2:0/528474313 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4c00e660 con 0x7fec50003f80 2023-11-26T07:16:45.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.761+0000 7fec627fc700 1 -- 172.21.15.2:0/528474313 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec4c00e7c0 con 0x7fec50003f80 2023-11-26T07:16:45.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.761+0000 7fec627fc700 1 -- 172.21.15.2:0/528474313 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4c00eb30 con 0x7fec50003f80 2023-11-26T07:16:45.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.761+0000 7fec69a69700 1 -- 172.21.15.2:0/528474313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec50003f80 msgr2=0x7fec50004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:45.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.761+0000 7fec69a69700 1 --2- 172.21.15.2:0/528474313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec50003f80 0x7fec50004850 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fec4c009b30 tx=0x7fec50005880 comp rx=0 tx=0).stop 2023-11-26T07:16:45.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.761+0000 7fec63fff700 1 -- 172.21.15.2:0/528474313 reap_dead start 2023-11-26T07:16:45.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.761+0000 7fec69a69700 1 -- 172.21.15.2:0/528474313 shutdown_connections 2023-11-26T07:16:45.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.761+0000 7fec69a69700 1 -- 172.21.15.2:0/528474313 >> 172.21.15.2:0/528474313 conn(0x7fec640b3700 msgr2=0x7fec640b3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:45.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.761+0000 7fec69a69700 1 -- 172.21.15.2:0/528474313 shutdown_connections 2023-11-26T07:16:45.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.761+0000 7fec69a69700 1 -- 172.21.15.2:0/528474313 wait complete. 2023-11-26T07:16:45.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.763+0000 7fec69a69700 1 Processor -- start 2023-11-26T07:16:45.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.763+0000 7fec69a69700 1 -- start start 2023-11-26T07:16:45.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.764+0000 7fec69a69700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec50003f80 0x7fec6415f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:45.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.764+0000 7fec69a69700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec6409c500 0x7fec6409dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:45.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.764+0000 7fec69a69700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec640c96c0 0x7fec640c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:45.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.764+0000 7fec69a69700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec640ca0b0 con 0x7fec640c96c0 2023-11-26T07:16:45.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.764+0000 7fec69a69700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec640cb780 con 0x7fec50003f80 2023-11-26T07:16:45.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.764+0000 7fec69a69700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec6409d560 con 0x7fec6409c500 2023-11-26T07:16:45.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.764+0000 7fec63fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec640c96c0 0x7fec640c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:45.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.764+0000 7fec63fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec640c96c0 0x7fec640c9b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44498/0 (socket says 172.21.15.2:44498) 2023-11-26T07:16:45.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.764+0000 7fec63fff700 1 -- 172.21.15.2:0/2679064861 learned_addr learned my addr 172.21.15.2:0/2679064861 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:45.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.764+0000 7fec637fe700 1 --2- 172.21.15.2:0/2679064861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec50003f80 0x7fec6415f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:45.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.764+0000 7fec62ffd700 1 --2- 172.21.15.2:0/2679064861 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec6409c500 0x7fec6409dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:45.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.764+0000 7fec63fff700 1 -- 172.21.15.2:0/2679064861 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec6409c500 msgr2=0x7fec6409dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:45.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.764+0000 7fec63fff700 1 --2- 172.21.15.2:0/2679064861 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec6409c500 0x7fec6409dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:45.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.764+0000 7fec63fff700 1 -- 172.21.15.2:0/2679064861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec50003f80 msgr2=0x7fec6415f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:45.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.764+0000 7fec63fff700 1 --2- 172.21.15.2:0/2679064861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec50003f80 0x7fec6415f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:45.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.764+0000 7fec63fff700 1 -- 172.21.15.2:0/2679064861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec6415fd60 con 0x7fec640c96c0 2023-11-26T07:16:45.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.764+0000 7fec63fff700 1 --2- 172.21.15.2:0/2679064861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec640c96c0 0x7fec640c9b70 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fec64071dc0 tx=0x7fec5c011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:45.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.764+0000 7fec5bfff700 1 -- 172.21.15.2:0/2679064861 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c00e040 con 0x7fec640c96c0 2023-11-26T07:16:45.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.764+0000 7fec5bfff700 1 -- 172.21.15.2:0/2679064861 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5c00f040 con 0x7fec640c96c0 2023-11-26T07:16:45.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.764+0000 7fec69a69700 1 -- 172.21.15.2:0/2679064861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec6409c9e0 con 0x7fec640c96c0 2023-11-26T07:16:45.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.764+0000 7fec5bfff700 1 -- 172.21.15.2:0/2679064861 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c00fde0 con 0x7fec640c96c0 2023-11-26T07:16:45.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.764+0000 7fec69a69700 1 -- 172.21.15.2:0/2679064861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec6409cfa0 con 0x7fec640c96c0 2023-11-26T07:16:45.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.765+0000 7fec69a69700 1 -- 172.21.15.2:0/2679064861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec6406bc40 con 0x7fec640c96c0 2023-11-26T07:16:45.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.767+0000 7fec5bfff700 1 -- 172.21.15.2:0/2679064861 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7fec5c022460 con 0x7fec640c96c0 2023-11-26T07:16:45.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.767+0000 7fec5bfff700 1 --2- 172.21.15.2:0/2679064861 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fec4406b770 0x7fec4406dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:45.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.768+0000 7fec5bfff700 1 -- 172.21.15.2:0/2679064861 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec5c0890a0 con 0x7fec640c96c0 2023-11-26T07:16:45.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.768+0000 7fec637fe700 1 --2- 172.21.15.2:0/2679064861 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fec4406b770 0x7fec4406dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:45.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.768+0000 7fec637fe700 1 --2- 172.21.15.2:0/2679064861 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fec4406b770 0x7fec4406dc30 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fec54000c00 tx=0x7fec54009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:45.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:45.771+0000 7fec5bfff700 1 -- 172.21.15.2:0/2679064861 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fec5c055ba0 con 0x7fec640c96c0 2023-11-26T07:16:46.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.022+0000 7fec69a69700 1 -- 172.21.15.2:0/2679064861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fec64068670 con 0x7fec640c96c0 2023-11-26T07:16:46.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.299+0000 7fec5bfff700 1 -- 172.21.15.2:0/2679064861 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v47) v1 ==== 136+0+0 (secure 0 0 0) 0x7fec5c0591c0 con 0x7fec640c96c0 2023-11-26T07:16:46.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.301+0000 7fec69a69700 1 -- 172.21.15.2:0/2679064861 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fec4406b770 msgr2=0x7fec4406dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:46.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.301+0000 7fec69a69700 1 --2- 172.21.15.2:0/2679064861 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fec4406b770 0x7fec4406dc30 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fec54000c00 tx=0x7fec54009040 comp rx=0 tx=0).stop 2023-11-26T07:16:46.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.301+0000 7fec69a69700 1 -- 172.21.15.2:0/2679064861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec640c96c0 msgr2=0x7fec640c9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:46.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.301+0000 7fec69a69700 1 --2- 172.21.15.2:0/2679064861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec640c96c0 0x7fec640c9b70 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fec64071dc0 tx=0x7fec5c011f80 comp rx=0 tx=0).stop 2023-11-26T07:16:46.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.302+0000 7fec69a69700 1 -- 172.21.15.2:0/2679064861 shutdown_connections 2023-11-26T07:16:46.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.302+0000 7fec69a69700 1 --2- 172.21.15.2:0/2679064861 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fec4406b770 0x7fec4406dc30 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:46.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.302+0000 7fec69a69700 1 --2- 172.21.15.2:0/2679064861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec640c96c0 0x7fec640c9b70 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:46.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.302+0000 7fec69a69700 1 --2- 172.21.15.2:0/2679064861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec50003f80 0x7fec6415f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:46.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.302+0000 7fec69a69700 1 --2- 172.21.15.2:0/2679064861 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec6409c500 0x7fec6409dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:46.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.302+0000 7fec69a69700 1 -- 172.21.15.2:0/2679064861 >> 172.21.15.2:0/2679064861 conn(0x7fec640b3700 msgr2=0x7fec640d13c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:46.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.302+0000 7fec69a69700 1 -- 172.21.15.2:0/2679064861 shutdown_connections 2023-11-26T07:16:46.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.302+0000 7fec69a69700 1 -- 172.21.15.2:0/2679064861 wait complete. 2023-11-26T07:16:46.316 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-26T07:16:46.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.441+0000 7f457dc3d700 1 Processor -- start 2023-11-26T07:16:46.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.441+0000 7f457dc3d700 1 -- start start 2023-11-26T07:16:46.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.442+0000 7f457dc3d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f45780d2b00 0x7f45780b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:46.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.442+0000 7f457dc3d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f45780ce9b0 0x7f45780b4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:46.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.442+0000 7f457dc3d700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45780d4930 con 0x7f45781617a0 2023-11-26T07:16:46.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.442+0000 7f457dc3d700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45780d4c10 con 0x7f45780ce9b0 2023-11-26T07:16:46.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.442+0000 7f457dc3d700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45780d19e0 con 0x7f45780d2b00 2023-11-26T07:16:46.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.442+0000 7f4577fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f45780ce9b0 0x7f45780b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:46.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.442+0000 7f4577fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f45780ce9b0 0x7f45780b4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44506/0 (socket says 172.21.15.2:44506) 2023-11-26T07:16:46.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.442+0000 7f4577fff700 1 -- 172.21.15.2:0/3760453441 learned_addr learned my addr 172.21.15.2:0/3760453441 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:46.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.442+0000 7f456ffff700 1 --2- 172.21.15.2:0/3760453441 >> v2:172.21.15.192:3300/0 conn(0x7f45780d2b00 0x7f45780b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:46.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.442+0000 7f4577fff700 1 -- 172.21.15.2:0/3760453441 >> v2:172.21.15.192:3300/0 conn(0x7f45780d2b00 msgr2=0x7f45780b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:46.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.442+0000 7f4577fff700 1 --2- 172.21.15.2:0/3760453441 >> v2:172.21.15.192:3300/0 conn(0x7f45780d2b00 0x7f45780b3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:46.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.442+0000 7f4577fff700 1 -- 172.21.15.2:0/3760453441 >> v1:172.21.15.192:6789/0 conn(0x7f45781617a0 legacy=0x7f45780d23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:46.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.442+0000 7f4577fff700 1 -- 172.21.15.2:0/3760453441 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45780d1cc0 con 0x7f45780ce9b0 2023-11-26T07:16:46.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.442+0000 7f4577fff700 1 --2- 172.21.15.2:0/3760453441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45780ce9b0 0x7f45780b4090 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f45780b3680 tx=0x7f457000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60a8c857cf505b2f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:46.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.442+0000 7f4576ffd700 1 -- 172.21.15.2:0/3760453441 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457000e070 con 0x7f45780ce9b0 2023-11-26T07:16:46.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.442+0000 7f4576ffd700 1 -- 172.21.15.2:0/3760453441 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457000b9c0 con 0x7f45780ce9b0 2023-11-26T07:16:46.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.442+0000 7f4576ffd700 1 -- 172.21.15.2:0/3760453441 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457000bd70 con 0x7f45780ce9b0 2023-11-26T07:16:46.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.443+0000 7f457dc3d700 1 -- 172.21.15.2:0/3760453441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45780ce9b0 msgr2=0x7f45780b4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:46.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.443+0000 7f457dc3d700 1 --2- 172.21.15.2:0/3760453441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45780ce9b0 0x7f45780b4090 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f45780b3680 tx=0x7f457000b330 comp rx=0 tx=0).stop 2023-11-26T07:16:46.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.443+0000 7f457dc3d700 1 -- 172.21.15.2:0/3760453441 shutdown_connections 2023-11-26T07:16:46.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.443+0000 7f457dc3d700 1 --2- 172.21.15.2:0/3760453441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45780ce9b0 0x7f45780b4090 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:46.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.443+0000 7f457dc3d700 1 --2- 172.21.15.2:0/3760453441 >> v2:172.21.15.192:3300/0 conn(0x7f45780d2b00 0x7f45780b3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:46.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.443+0000 7f457dc3d700 1 -- 172.21.15.2:0/3760453441 >> 172.21.15.2:0/3760453441 conn(0x7f45780d3e10 msgr2=0x7f45780d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:46.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.443+0000 7f457dc3d700 1 -- 172.21.15.2:0/3760453441 shutdown_connections 2023-11-26T07:16:46.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.443+0000 7f457dc3d700 1 -- 172.21.15.2:0/3760453441 wait complete. 2023-11-26T07:16:46.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.444+0000 7f457dc3d700 1 Processor -- start 2023-11-26T07:16:46.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.444+0000 7f457dc3d700 1 -- start start 2023-11-26T07:16:46.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.445+0000 7f457dc3d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f45780ce9b0 0x7f45781f7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:46.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.445+0000 7f457dc3d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45780d2b00 0x7f457815f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:46.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.445+0000 7f457dc3d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45781617a0 0x7f457806c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:46.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.445+0000 7f457dc3d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45781f43e0 con 0x7f45781617a0 2023-11-26T07:16:46.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.445+0000 7f457dc3d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f457815fe20 con 0x7f45780d2b00 2023-11-26T07:16:46.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.445+0000 7f457dc3d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45781f3d20 con 0x7f45780ce9b0 2023-11-26T07:16:46.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.445+0000 7f4577fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45781617a0 0x7f457806c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:46.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.445+0000 7f4577fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45781617a0 0x7f457806c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44510/0 (socket says 172.21.15.2:44510) 2023-11-26T07:16:46.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.445+0000 7f4577fff700 1 -- 172.21.15.2:0/3906192252 learned_addr learned my addr 172.21.15.2:0/3906192252 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:46.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.446+0000 7f456ffff700 1 --2- 172.21.15.2:0/3906192252 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45780d2b00 0x7f457815f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:46.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.446+0000 7f45777fe700 1 --2- 172.21.15.2:0/3906192252 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f45780ce9b0 0x7f45781f7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:46.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.446+0000 7f4577fff700 1 -- 172.21.15.2:0/3906192252 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f45780ce9b0 msgr2=0x7f45781f7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:46.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.446+0000 7f4577fff700 1 --2- 172.21.15.2:0/3906192252 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f45780ce9b0 0x7f45781f7690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:46.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.446+0000 7f4577fff700 1 -- 172.21.15.2:0/3906192252 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45780d2b00 msgr2=0x7f457815f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:46.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.446+0000 7f4577fff700 1 --2- 172.21.15.2:0/3906192252 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45780d2b00 0x7f457815f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:46.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.446+0000 7f4577fff700 1 -- 172.21.15.2:0/3906192252 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4570009b30 con 0x7f45781617a0 2023-11-26T07:16:46.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.446+0000 7f456ffff700 1 --2- 172.21.15.2:0/3906192252 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45780d2b00 0x7f457815f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:16:46.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.446+0000 7f4577fff700 1 --2- 172.21.15.2:0/3906192252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45781617a0 0x7f457806c640 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f457808ca90 tx=0x7f4570004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:46.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.446+0000 7f4574ff9700 1 -- 172.21.15.2:0/3906192252 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45700099b0 con 0x7f45781617a0 2023-11-26T07:16:46.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.446+0000 7f4574ff9700 1 -- 172.21.15.2:0/3906192252 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45700092e0 con 0x7f45781617a0 2023-11-26T07:16:46.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.446+0000 7f457dc3d700 1 -- 172.21.15.2:0/3906192252 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45781f4000 con 0x7f45781617a0 2023-11-26T07:16:46.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.446+0000 7f4574ff9700 1 -- 172.21.15.2:0/3906192252 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457001b630 con 0x7f45781617a0 2023-11-26T07:16:46.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.446+0000 7f457dc3d700 1 -- 172.21.15.2:0/3906192252 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45781f4800 con 0x7f45781617a0 2023-11-26T07:16:46.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.447+0000 7f457dc3d700 1 -- 172.21.15.2:0/3906192252 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45781f49c0 con 0x7f45781617a0 2023-11-26T07:16:46.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.447+0000 7f4574ff9700 1 -- 172.21.15.2:0/3906192252 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f457001b790 con 0x7f45781617a0 2023-11-26T07:16:46.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.448+0000 7f4574ff9700 1 --2- 172.21.15.2:0/3906192252 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f455806b740 0x7f455806dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:46.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.448+0000 7f4574ff9700 1 -- 172.21.15.2:0/3906192252 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4570089790 con 0x7f45781617a0 2023-11-26T07:16:46.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.448+0000 7f45777fe700 1 --2- 172.21.15.2:0/3906192252 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f455806b740 0x7f455806dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:46.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.449+0000 7f45777fe700 1 --2- 172.21.15.2:0/3906192252 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f455806b740 0x7f455806dc00 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f4568007fd0 tx=0x7f4568009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:46.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.453+0000 7f4574ff9700 1 -- 172.21.15.2:0/3906192252 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f45700bee90 con 0x7f45781617a0 2023-11-26T07:16:46.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.680+0000 7f457dc3d700 1 -- 172.21.15.2:0/3906192252 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f45780678e0 con 0x7f455806b740 2023-11-26T07:16:46.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.682+0000 7f4574ff9700 1 -- 172.21.15.2:0/3906192252 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f45780678e0 con 0x7f455806b740 2023-11-26T07:16:46.684 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2023-11-26T07:16:46.684 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-26T07:16:46.684 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephfs" 2023-11-26T07:16:46.684 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:16:46.684 INFO:teuthology.orchestra.run.smithi002.stdout:] 2023-11-26T07:16:46.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.684+0000 7f457dc3d700 1 -- 172.21.15.2:0/3906192252 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f455806b740 msgr2=0x7f455806dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:46.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.684+0000 7f457dc3d700 1 --2- 172.21.15.2:0/3906192252 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f455806b740 0x7f455806dc00 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f4568007fd0 tx=0x7f4568009040 comp rx=0 tx=0).stop 2023-11-26T07:16:46.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.684+0000 7f457dc3d700 1 -- 172.21.15.2:0/3906192252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45781617a0 msgr2=0x7f457806c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:46.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.684+0000 7f457dc3d700 1 --2- 172.21.15.2:0/3906192252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45781617a0 0x7f457806c640 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f457808ca90 tx=0x7f4570004ad0 comp rx=0 tx=0).stop 2023-11-26T07:16:46.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.684+0000 7f457dc3d700 1 -- 172.21.15.2:0/3906192252 shutdown_connections 2023-11-26T07:16:46.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.684+0000 7f457dc3d700 1 --2- 172.21.15.2:0/3906192252 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f455806b740 0x7f455806dc00 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:46.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.684+0000 7f457dc3d700 1 --2- 172.21.15.2:0/3906192252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45781617a0 0x7f457806c640 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:46.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.684+0000 7f457dc3d700 1 --2- 172.21.15.2:0/3906192252 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f45780ce9b0 0x7f45781f7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:46.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.684+0000 7f457dc3d700 1 --2- 172.21.15.2:0/3906192252 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45780d2b00 0x7f457815f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:46.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.684+0000 7f457dc3d700 1 -- 172.21.15.2:0/3906192252 >> 172.21.15.2:0/3906192252 conn(0x7f45780d3e10 msgr2=0x7f45780d0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:46.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.684+0000 7f457dc3d700 1 -- 172.21.15.2:0/3906192252 shutdown_connections 2023-11-26T07:16:46.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.684+0000 7f457dc3d700 1 -- 172.21.15.2:0/3906192252 wait complete. 2023-11-26T07:16:46.698 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-26T07:16:46.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.823+0000 7fb03537a700 1 Processor -- start 2023-11-26T07:16:46.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.824+0000 7fb03537a700 1 -- start start 2023-11-26T07:16:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.824+0000 7fb03537a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0300d0870 0x7fb0300d26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.824+0000 7fb03537a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb0300d49f0 0x7fb0300b6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.824+0000 7fb03537a700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0300b5370 con 0x7fb0300d0c50 2023-11-26T07:16:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.824+0000 7fb03537a700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0300d2f80 con 0x7fb0300d49f0 2023-11-26T07:16:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.824+0000 7fb03537a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0300cff70 con 0x7fb0300d0870 2023-11-26T07:16:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.825+0000 7fb02f7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb0300d49f0 0x7fb0300b6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.825+0000 7fb02f7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb0300d49f0 0x7fb0300b6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44520/0 (socket says 172.21.15.2:44520) 2023-11-26T07:16:46.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.825+0000 7fb02f7fe700 1 -- 172.21.15.2:0/378121275 learned_addr learned my addr 172.21.15.2:0/378121275 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:46.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.825+0000 7fb02effd700 1 --2- 172.21.15.2:0/378121275 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0300d0870 0x7fb0300d26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:46.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.825+0000 7fb02f7fe700 1 -- 172.21.15.2:0/378121275 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0300d0870 msgr2=0x7fb0300d26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:46.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.825+0000 7fb02f7fe700 1 --2- 172.21.15.2:0/378121275 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0300d0870 0x7fb0300d26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:46.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.825+0000 7fb02f7fe700 1 -- 172.21.15.2:0/378121275 >> v1:172.21.15.192:6789/0 conn(0x7fb0300d0c50 legacy=0x7fb0300cf860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:46.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.825+0000 7fb02f7fe700 1 -- 172.21.15.2:0/378121275 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0300ceae0 con 0x7fb0300d49f0 2023-11-26T07:16:46.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.825+0000 7fb02effd700 1 --2- 172.21.15.2:0/378121275 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0300d0870 0x7fb0300d26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:16:46.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.825+0000 7fb02f7fe700 1 --2- 172.21.15.2:0/378121275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0300d49f0 0x7fb0300b6d20 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fb028009e50 tx=0x7fb02800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a7899881d6f00d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:46.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.825+0000 7fb02dffb700 1 -- 172.21.15.2:0/378121275 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02800e070 con 0x7fb0300d49f0 2023-11-26T07:16:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.825+0000 7fb02dffb700 1 -- 172.21.15.2:0/378121275 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb02800b9c0 con 0x7fb0300d49f0 2023-11-26T07:16:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.825+0000 7fb02dffb700 1 -- 172.21.15.2:0/378121275 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02800bd70 con 0x7fb0300d49f0 2023-11-26T07:16:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.826+0000 7fb03537a700 1 -- 172.21.15.2:0/378121275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0300d49f0 msgr2=0x7fb0300b6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.826+0000 7fb03537a700 1 --2- 172.21.15.2:0/378121275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0300d49f0 0x7fb0300b6d20 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fb028009e50 tx=0x7fb02800b330 comp rx=0 tx=0).stop 2023-11-26T07:16:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.826+0000 7fb03537a700 1 -- 172.21.15.2:0/378121275 shutdown_connections 2023-11-26T07:16:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.826+0000 7fb03537a700 1 --2- 172.21.15.2:0/378121275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0300d49f0 0x7fb0300b6d20 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.826+0000 7fb03537a700 1 --2- 172.21.15.2:0/378121275 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0300d0870 0x7fb0300d26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.826+0000 7fb03537a700 1 -- 172.21.15.2:0/378121275 >> 172.21.15.2:0/378121275 conn(0x7fb0300d3ed0 msgr2=0x7fb0300d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.826+0000 7fb03537a700 1 -- 172.21.15.2:0/378121275 shutdown_connections 2023-11-26T07:16:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.826+0000 7fb03537a700 1 -- 172.21.15.2:0/378121275 wait complete. 2023-11-26T07:16:46.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.827+0000 7fb03537a700 1 Processor -- start 2023-11-26T07:16:46.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.827+0000 7fb03537a700 1 -- start start 2023-11-26T07:16:46.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.828+0000 7fb03537a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0300d0870 0x7fb03015a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:46.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.828+0000 7fb03537a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0300d0c50 0x7fb0300b8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:46.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.828+0000 7fb03537a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0300d49f0 0x7fb0300b93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:46.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.828+0000 7fb03537a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0300b3550 con 0x7fb0300d49f0 2023-11-26T07:16:46.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.828+0000 7fb03537a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03015adf0 con 0x7fb0300d0870 2023-11-26T07:16:46.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.828+0000 7fb03537a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0300b28d0 con 0x7fb0300d0c50 2023-11-26T07:16:46.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.828+0000 7fb02f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0300d49f0 0x7fb0300b93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:46.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.828+0000 7fb02f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0300d49f0 0x7fb0300b93d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44526/0 (socket says 172.21.15.2:44526) 2023-11-26T07:16:46.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.828+0000 7fb02f7fe700 1 -- 172.21.15.2:0/2200577745 learned_addr learned my addr 172.21.15.2:0/2200577745 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:46.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.828+0000 7fb02effd700 1 --2- 172.21.15.2:0/2200577745 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0300d0870 0x7fb03015a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:46.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.828+0000 7fb02e7fc700 1 --2- 172.21.15.2:0/2200577745 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0300d0c50 0x7fb0300b8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:46.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.828+0000 7fb02f7fe700 1 -- 172.21.15.2:0/2200577745 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0300d0c50 msgr2=0x7fb0300b8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:46.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.828+0000 7fb02f7fe700 1 --2- 172.21.15.2:0/2200577745 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0300d0c50 0x7fb0300b8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:46.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.828+0000 7fb02f7fe700 1 -- 172.21.15.2:0/2200577745 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0300d0870 msgr2=0x7fb03015a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:46.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.828+0000 7fb02f7fe700 1 --2- 172.21.15.2:0/2200577745 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0300d0870 0x7fb03015a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:46.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.828+0000 7fb02f7fe700 1 -- 172.21.15.2:0/2200577745 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb028009b30 con 0x7fb0300d49f0 2023-11-26T07:16:46.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.828+0000 7fb02e7fc700 1 --2- 172.21.15.2:0/2200577745 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0300d0c50 0x7fb0300b8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:16:46.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.829+0000 7fb02f7fe700 1 --2- 172.21.15.2:0/2200577745 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0300d49f0 0x7fb0300b93d0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fb03008c300 tx=0x7fb028004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:46.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.829+0000 7fb0177fe700 1 -- 172.21.15.2:0/2200577745 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0280048b0 con 0x7fb0300d49f0 2023-11-26T07:16:46.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.829+0000 7fb0177fe700 1 -- 172.21.15.2:0/2200577745 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0280099b0 con 0x7fb0300d49f0 2023-11-26T07:16:46.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.829+0000 7fb0177fe700 1 -- 172.21.15.2:0/2200577745 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02801b670 con 0x7fb0300d49f0 2023-11-26T07:16:46.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.829+0000 7fb03537a700 1 -- 172.21.15.2:0/2200577745 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0300b2bb0 con 0x7fb0300d49f0 2023-11-26T07:16:46.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.829+0000 7fb03537a700 1 -- 172.21.15.2:0/2200577745 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0300b3170 con 0x7fb0300d49f0 2023-11-26T07:16:46.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.830+0000 7fb03537a700 1 -- 172.21.15.2:0/2200577745 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb030067a20 con 0x7fb0300d49f0 2023-11-26T07:16:46.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.830+0000 7fb0177fe700 1 -- 172.21.15.2:0/2200577745 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7fb02801b7d0 con 0x7fb0300d49f0 2023-11-26T07:16:46.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.831+0000 7fb0177fe700 1 --2- 172.21.15.2:0/2200577745 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb01c06b740 0x7fb01c06dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:46.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.831+0000 7fb0177fe700 1 -- 172.21.15.2:0/2200577745 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb028089700 con 0x7fb0300d49f0 2023-11-26T07:16:46.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.831+0000 7fb02effd700 1 --2- 172.21.15.2:0/2200577745 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb01c06b740 0x7fb01c06dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:46.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.831+0000 7fb02effd700 1 --2- 172.21.15.2:0/2200577745 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb01c06b740 0x7fb01c06dc00 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb0240099d0 tx=0x7fb024008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:46.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:46.835+0000 7fb0177fe700 1 -- 172.21.15.2:0/2200577745 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb028056260 con 0x7fb0300d49f0 2023-11-26T07:16:47.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.035+0000 7fb03537a700 1 -- 172.21.15.2:0/2200577745 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fb030075480 con 0x7fb0300d49f0 2023-11-26T07:16:47.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.036+0000 7fb0177fe700 1 -- 172.21.15.2:0/2200577745 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb028059880 con 0x7fb0300d49f0 2023-11-26T07:16:47.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.038+0000 7fb03537a700 1 -- 172.21.15.2:0/2200577745 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb01c06b740 msgr2=0x7fb01c06dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:47.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.038+0000 7fb03537a700 1 --2- 172.21.15.2:0/2200577745 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb01c06b740 0x7fb01c06dc00 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb0240099d0 tx=0x7fb024008040 comp rx=0 tx=0).stop 2023-11-26T07:16:47.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.038+0000 7fb03537a700 1 -- 172.21.15.2:0/2200577745 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0300d49f0 msgr2=0x7fb0300b93d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:47.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.038+0000 7fb03537a700 1 --2- 172.21.15.2:0/2200577745 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0300d49f0 0x7fb0300b93d0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fb03008c300 tx=0x7fb028004ad0 comp rx=0 tx=0).stop 2023-11-26T07:16:47.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.038+0000 7fb03537a700 1 -- 172.21.15.2:0/2200577745 shutdown_connections 2023-11-26T07:16:47.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.038+0000 7fb03537a700 1 --2- 172.21.15.2:0/2200577745 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb01c06b740 0x7fb01c06dc00 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:47.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.038+0000 7fb03537a700 1 --2- 172.21.15.2:0/2200577745 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0300d49f0 0x7fb0300b93d0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:47.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.038+0000 7fb03537a700 1 --2- 172.21.15.2:0/2200577745 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0300d0870 0x7fb03015a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:47.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.038+0000 7fb03537a700 1 --2- 172.21.15.2:0/2200577745 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0300d0c50 0x7fb0300b8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:47.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.038+0000 7fb03537a700 1 -- 172.21.15.2:0/2200577745 >> 172.21.15.2:0/2200577745 conn(0x7fb0300d3ed0 msgr2=0x7fb03015bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:47.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.038+0000 7fb03537a700 1 -- 172.21.15.2:0/2200577745 shutdown_connections 2023-11-26T07:16:47.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.038+0000 7fb03537a700 1 -- 172.21.15.2:0/2200577745 wait complete. 2023-11-26T07:16:47.052 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol83060 --mode=777 2023-11-26T07:16:47.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.178+0000 7fa932602700 1 Processor -- start 2023-11-26T07:16:47.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.178+0000 7fa932602700 1 -- start start 2023-11-26T07:16:47.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.179+0000 7fa932602700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa92c0cd150 0x7fa92c0ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:47.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.179+0000 7fa932602700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa92c06f940 0x7fa92c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:47.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.179+0000 7fa932602700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa92c06f4b0 con 0x7fa92c15bfe0 2023-11-26T07:16:47.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.179+0000 7fa932602700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa92c15c3c0 con 0x7fa92c06f940 2023-11-26T07:16:47.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.179+0000 7fa932602700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa92c0cd760 con 0x7fa92c0cd150 2023-11-26T07:16:47.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.179+0000 7fa930b9f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa92c06f940 0x7fa92c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:47.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.179+0000 7fa930b9f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa92c06f940 0x7fa92c06fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44534/0 (socket says 172.21.15.2:44534) 2023-11-26T07:16:47.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.179+0000 7fa930b9f700 1 -- 172.21.15.2:0/1435217272 learned_addr learned my addr 172.21.15.2:0/1435217272 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:47.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.179+0000 7fa92b7fe700 1 --2- 172.21.15.2:0/1435217272 >> v2:172.21.15.192:3300/0 conn(0x7fa92c0cd150 0x7fa92c0ceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:47.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.180+0000 7fa930b9f700 1 -- 172.21.15.2:0/1435217272 >> v2:172.21.15.192:3300/0 conn(0x7fa92c0cd150 msgr2=0x7fa92c0ceb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:47.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.180+0000 7fa930b9f700 1 --2- 172.21.15.2:0/1435217272 >> v2:172.21.15.192:3300/0 conn(0x7fa92c0cd150 0x7fa92c0ceb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:47.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.180+0000 7fa930b9f700 1 -- 172.21.15.2:0/1435217272 >> v1:172.21.15.192:6789/0 conn(0x7fa92c15bfe0 legacy=0x7fa92c0ce430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:47.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.180+0000 7fa930b9f700 1 -- 172.21.15.2:0/1435217272 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa92c06ee60 con 0x7fa92c06f940 2023-11-26T07:16:47.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.180+0000 7fa92b7fe700 1 --2- 172.21.15.2:0/1435217272 >> v2:172.21.15.192:3300/0 conn(0x7fa92c0cd150 0x7fa92c0ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:16:47.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.180+0000 7fa930b9f700 1 --2- 172.21.15.2:0/1435217272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa92c06f940 0x7fa92c06fd50 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fa92c0725d0 tx=0x7fa92400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f21f21a0eb38e608 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:47.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.180+0000 7fa92affd700 1 -- 172.21.15.2:0/1435217272 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92400e070 con 0x7fa92c06f940 2023-11-26T07:16:47.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.180+0000 7fa92affd700 1 -- 172.21.15.2:0/1435217272 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa92400b9c0 con 0x7fa92c06f940 2023-11-26T07:16:47.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.180+0000 7fa92affd700 1 -- 172.21.15.2:0/1435217272 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92400bd70 con 0x7fa92c06f940 2023-11-26T07:16:47.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.180+0000 7fa932602700 1 -- 172.21.15.2:0/1435217272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa92c06f940 msgr2=0x7fa92c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:47.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.180+0000 7fa932602700 1 --2- 172.21.15.2:0/1435217272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa92c06f940 0x7fa92c06fd50 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fa92c0725d0 tx=0x7fa92400b330 comp rx=0 tx=0).stop 2023-11-26T07:16:47.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.181+0000 7fa932602700 1 -- 172.21.15.2:0/1435217272 shutdown_connections 2023-11-26T07:16:47.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.181+0000 7fa932602700 1 --2- 172.21.15.2:0/1435217272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa92c06f940 0x7fa92c06fd50 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:47.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.181+0000 7fa932602700 1 --2- 172.21.15.2:0/1435217272 >> v2:172.21.15.192:3300/0 conn(0x7fa92c0cd150 0x7fa92c0ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:47.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.181+0000 7fa932602700 1 -- 172.21.15.2:0/1435217272 >> 172.21.15.2:0/1435217272 conn(0x7fa92c0b3700 msgr2=0x7fa92c0b3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:47.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.181+0000 7fa932602700 1 -- 172.21.15.2:0/1435217272 shutdown_connections 2023-11-26T07:16:47.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.181+0000 7fa932602700 1 -- 172.21.15.2:0/1435217272 wait complete. 2023-11-26T07:16:47.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.182+0000 7fa932602700 1 Processor -- start 2023-11-26T07:16:47.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.182+0000 7fa932602700 1 -- start start 2023-11-26T07:16:47.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.183+0000 7fa932602700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa92c06f940 0x7fa92c1f0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:47.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.183+0000 7fa932602700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa92c0cd150 0x7fa92c0cae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:47.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.183+0000 7fa932602700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa92c15bfe0 0x7fa92c0cb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:47.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.183+0000 7fa932602700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92c0c77b0 con 0x7fa92c06f940 2023-11-26T07:16:47.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.183+0000 7fa932602700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92c0c7a50 con 0x7fa92c0cd150 2023-11-26T07:16:47.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.183+0000 7fa932602700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa92c0c7d30 con 0x7fa92c15bfe0 2023-11-26T07:16:47.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.183+0000 7fa92bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa92c06f940 0x7fa92c1f0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:47.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.183+0000 7fa92bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa92c06f940 0x7fa92c1f0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44536/0 (socket says 172.21.15.2:44536) 2023-11-26T07:16:47.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.184+0000 7fa92bfff700 1 -- 172.21.15.2:0/3593563541 learned_addr learned my addr 172.21.15.2:0/3593563541 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:47.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.184+0000 7fa92b7fe700 1 --2- 172.21.15.2:0/3593563541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa92c0cd150 0x7fa92c0cae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:47.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.184+0000 7fa930b9f700 1 --2- 172.21.15.2:0/3593563541 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa92c15bfe0 0x7fa92c0cb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:47.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.184+0000 7fa92bfff700 1 -- 172.21.15.2:0/3593563541 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa92c15bfe0 msgr2=0x7fa92c0cb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:47.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.184+0000 7fa92bfff700 1 --2- 172.21.15.2:0/3593563541 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa92c15bfe0 0x7fa92c0cb3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:47.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.184+0000 7fa92bfff700 1 -- 172.21.15.2:0/3593563541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa92c0cd150 msgr2=0x7fa92c0cae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:47.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.184+0000 7fa92bfff700 1 --2- 172.21.15.2:0/3593563541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa92c0cd150 0x7fa92c0cae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:47.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.184+0000 7fa92bfff700 1 -- 172.21.15.2:0/3593563541 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa924009b30 con 0x7fa92c06f940 2023-11-26T07:16:47.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.184+0000 7fa92bfff700 1 --2- 172.21.15.2:0/3593563541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa92c06f940 0x7fa92c1f0f10 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fa91c00c450 tx=0x7fa91c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:47.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.184+0000 7fa928ff9700 1 -- 172.21.15.2:0/3593563541 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c0052d0 con 0x7fa92c06f940 2023-11-26T07:16:47.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.184+0000 7fa928ff9700 1 -- 172.21.15.2:0/3593563541 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa91c005430 con 0x7fa92c06f940 2023-11-26T07:16:47.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.184+0000 7fa932602700 1 -- 172.21.15.2:0/3593563541 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa92c0c8010 con 0x7fa92c06f940 2023-11-26T07:16:47.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.184+0000 7fa928ff9700 1 -- 172.21.15.2:0/3593563541 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c0038c0 con 0x7fa92c06f940 2023-11-26T07:16:47.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.184+0000 7fa932602700 1 -- 172.21.15.2:0/3593563541 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa92c15de90 con 0x7fa92c06f940 2023-11-26T07:16:47.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.185+0000 7fa932602700 1 -- 172.21.15.2:0/3593563541 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa92c06bc40 con 0x7fa92c06f940 2023-11-26T07:16:47.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.186+0000 7fa928ff9700 1 -- 172.21.15.2:0/3593563541 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7fa91c003a20 con 0x7fa92c06f940 2023-11-26T07:16:47.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.186+0000 7fa928ff9700 1 --2- 172.21.15.2:0/3593563541 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa91806b740 0x7fa91806dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:47.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.186+0000 7fa928ff9700 1 -- 172.21.15.2:0/3593563541 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa91c0874f0 con 0x7fa92c06f940 2023-11-26T07:16:47.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.186+0000 7fa92b7fe700 1 --2- 172.21.15.2:0/3593563541 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa91806b740 0x7fa91806dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:47.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.187+0000 7fa92b7fe700 1 --2- 172.21.15.2:0/3593563541 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa91806b740 0x7fa91806dc00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa92c159770 tx=0x7fa920008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:47.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.190+0000 7fa928ff9700 1 -- 172.21.15.2:0/3593563541 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa91c053e00 con 0x7fa92c06f940 2023-11-26T07:16:47.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.424+0000 7fa932602700 1 -- 172.21.15.2:0/3593563541 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol83060", "mode": "777", "target": ["mon-mgr", ""]}) v1 -- 0x7fa92c0cda40 con 0x7fa91806b740 2023-11-26T07:16:47.433 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:16:47.430+0000 7f8da6aa7700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:16:47.433 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:16:47.430+0000 7f8da6aa7700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:16:47.433 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:16:47.430+0000 7f8da6aa7700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:16:47.433 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:16:47.430+0000 7f8da6aa7700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:16:47.433 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:16:47.430+0000 7f8da6aa7700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:16:47.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.462+0000 7fa928ff9700 1 -- 172.21.15.2:0/3593563541 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fa92000c050 con 0x7fa91806b740 2023-11-26T07:16:47.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.465+0000 7fa932602700 1 -- 172.21.15.2:0/3593563541 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa91806b740 msgr2=0x7fa91806dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:47.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.465+0000 7fa932602700 1 --2- 172.21.15.2:0/3593563541 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa91806b740 0x7fa91806dc00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa92c159770 tx=0x7fa920008040 comp rx=0 tx=0).stop 2023-11-26T07:16:47.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.465+0000 7fa932602700 1 -- 172.21.15.2:0/3593563541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa92c06f940 msgr2=0x7fa92c1f0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:47.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.465+0000 7fa932602700 1 --2- 172.21.15.2:0/3593563541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa92c06f940 0x7fa92c1f0f10 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fa91c00c450 tx=0x7fa91c00c810 comp rx=0 tx=0).stop 2023-11-26T07:16:47.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.465+0000 7fa932602700 1 -- 172.21.15.2:0/3593563541 shutdown_connections 2023-11-26T07:16:47.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.465+0000 7fa932602700 1 --2- 172.21.15.2:0/3593563541 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa91806b740 0x7fa91806dc00 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:47.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.465+0000 7fa932602700 1 --2- 172.21.15.2:0/3593563541 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa92c15bfe0 0x7fa92c0cb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:47.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.465+0000 7fa932602700 1 --2- 172.21.15.2:0/3593563541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa92c06f940 0x7fa92c1f0f10 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:47.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.465+0000 7fa932602700 1 --2- 172.21.15.2:0/3593563541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa92c0cd150 0x7fa92c0cae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:47.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.465+0000 7fa932602700 1 -- 172.21.15.2:0/3593563541 >> 172.21.15.2:0/3593563541 conn(0x7fa92c0b3700 msgr2=0x7fa92c0b1670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:47.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.465+0000 7fa932602700 1 -- 172.21.15.2:0/3593563541 shutdown_connections 2023-11-26T07:16:47.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.465+0000 7fa932602700 1 -- 172.21.15.2:0/3593563541 wait complete. 2023-11-26T07:16:47.479 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol83060 2023-11-26T07:16:47.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.605+0000 7f27a1844700 1 Processor -- start 2023-11-26T07:16:47.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.605+0000 7f27a1844700 1 -- start start 2023-11-26T07:16:47.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.606+0000 7f27a1844700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f279c144610 0x7f279c0d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:47.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.606+0000 7f27a1844700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f279c06f700 0x7f279c0d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:47.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.606+0000 7f27a1844700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f279c15e7c0 0x7f279c15ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:47.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.606+0000 7f27a1844700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f279c06e9d0 con 0x7f279c144610 2023-11-26T07:16:47.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.606+0000 7f27a1844700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f279c06f270 con 0x7f279c06f700 2023-11-26T07:16:47.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.606+0000 7f27a1844700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f279c1449f0 con 0x7f279c15e7c0 2023-11-26T07:16:47.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.606+0000 7f279affd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f279c144610 0x7f279c0d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:47.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.606+0000 7f279affd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f279c144610 0x7f279c0d09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44544/0 (socket says 172.21.15.2:44544) 2023-11-26T07:16:47.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.607+0000 7f279affd700 1 -- 172.21.15.2:0/2378252198 learned_addr learned my addr 172.21.15.2:0/2378252198 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:47.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.607+0000 7f279a7fc700 1 --2- 172.21.15.2:0/2378252198 >> v2:172.21.15.192:3300/0 conn(0x7f279c06f700 0x7f279c0d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:47.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.607+0000 7f279b7fe700 1 --2- 172.21.15.2:0/2378252198 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f279c15e7c0 0x7f279c15ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:47.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.607+0000 7f279affd700 1 -- 172.21.15.2:0/2378252198 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f279c15e7c0 msgr2=0x7f279c15ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:47.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.607+0000 7f279affd700 1 --2- 172.21.15.2:0/2378252198 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f279c15e7c0 0x7f279c15ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:47.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.607+0000 7f279affd700 1 -- 172.21.15.2:0/2378252198 >> v2:172.21.15.192:3300/0 conn(0x7f279c06f700 msgr2=0x7f279c0d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:16:47.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.607+0000 7f279affd700 1 --2- 172.21.15.2:0/2378252198 >> v2:172.21.15.192:3300/0 conn(0x7f279c06f700 0x7f279c0d0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:47.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.607+0000 7f279affd700 1 -- 172.21.15.2:0/2378252198 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f279c15f530 con 0x7f279c144610 2023-11-26T07:16:47.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.607+0000 7f279affd700 1 --2- 172.21.15.2:0/2378252198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f279c144610 0x7f279c0d09f0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f279c0b5ca0 tx=0x7f278c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7fa7a639b0bb94a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:47.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.607+0000 7f2799ffb700 1 -- 172.21.15.2:0/2378252198 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278c011830 con 0x7f279c144610 2023-11-26T07:16:47.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.607+0000 7f2799ffb700 1 -- 172.21.15.2:0/2378252198 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f278c011990 con 0x7f279c144610 2023-11-26T07:16:47.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.607+0000 7f2799ffb700 1 -- 172.21.15.2:0/2378252198 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278c011d20 con 0x7f279c144610 2023-11-26T07:16:47.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.608+0000 7f27a1844700 1 -- 172.21.15.2:0/2378252198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f279c144610 msgr2=0x7f279c0d09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:47.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.608+0000 7f27a1844700 1 --2- 172.21.15.2:0/2378252198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f279c144610 0x7f279c0d09f0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f279c0b5ca0 tx=0x7f278c009bd0 comp rx=0 tx=0).stop 2023-11-26T07:16:47.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.608+0000 7f27a1844700 1 -- 172.21.15.2:0/2378252198 shutdown_connections 2023-11-26T07:16:47.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.608+0000 7f27a1844700 1 --2- 172.21.15.2:0/2378252198 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f279c15e7c0 0x7f279c15ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:47.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.608+0000 7f27a1844700 1 --2- 172.21.15.2:0/2378252198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f279c144610 0x7f279c0d09f0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:47.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.608+0000 7f27a1844700 1 --2- 172.21.15.2:0/2378252198 >> v2:172.21.15.192:3300/0 conn(0x7f279c06f700 0x7f279c0d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:47.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.608+0000 7f27a1844700 1 -- 172.21.15.2:0/2378252198 >> 172.21.15.2:0/2378252198 conn(0x7f279c0b2740 msgr2=0x7f279c0b2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:47.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.608+0000 7f27a1844700 1 -- 172.21.15.2:0/2378252198 shutdown_connections 2023-11-26T07:16:47.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.608+0000 7f27a1844700 1 -- 172.21.15.2:0/2378252198 wait complete. 2023-11-26T07:16:47.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.609+0000 7f27a1844700 1 Processor -- start 2023-11-26T07:16:47.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.609+0000 7f27a1844700 1 -- start start 2023-11-26T07:16:47.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.610+0000 7f27a1844700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f279c06f700 0x7f279c156f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:47.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.610+0000 7f27a1844700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f279c144610 0x7f279c138380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:47.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.610+0000 7f27a1844700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f279c15e7c0 0x7f279c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:47.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.610+0000 7f27a1844700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279c1388c0 con 0x7f279c144610 2023-11-26T07:16:47.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.610+0000 7f27a1844700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279c15ada0 con 0x7f279c15e7c0 2023-11-26T07:16:47.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.610+0000 7f27a1844700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f279c132950 con 0x7f279c06f700 2023-11-26T07:16:47.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.610+0000 7f279a7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f279c144610 0x7f279c138380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:47.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.610+0000 7f279a7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f279c144610 0x7f279c138380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44550/0 (socket says 172.21.15.2:44550) 2023-11-26T07:16:47.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.610+0000 7f279a7fc700 1 -- 172.21.15.2:0/137481889 learned_addr learned my addr 172.21.15.2:0/137481889 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:16:47.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.610+0000 7f279affd700 1 --2- 172.21.15.2:0/137481889 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f279c06f700 0x7f279c156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:47.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.611+0000 7f279b7fe700 1 --2- 172.21.15.2:0/137481889 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f279c15e7c0 0x7f279c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:47.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.611+0000 7f279a7fc700 1 -- 172.21.15.2:0/137481889 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f279c06f700 msgr2=0x7f279c156f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:47.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.611+0000 7f279a7fc700 1 --2- 172.21.15.2:0/137481889 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f279c06f700 0x7f279c156f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:47.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.611+0000 7f279a7fc700 1 -- 172.21.15.2:0/137481889 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f279c15e7c0 msgr2=0x7f279c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:47.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.611+0000 7f279a7fc700 1 --2- 172.21.15.2:0/137481889 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f279c15e7c0 0x7f279c1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:47.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.611+0000 7f279a7fc700 1 -- 172.21.15.2:0/137481889 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f278c009550 con 0x7f279c144610 2023-11-26T07:16:47.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.611+0000 7f279a7fc700 1 --2- 172.21.15.2:0/137481889 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f279c144610 0x7f279c138380 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f279000e870 tx=0x7f279000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:47.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.611+0000 7f2783fff700 1 -- 172.21.15.2:0/137481889 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2790013680 con 0x7f279c144610 2023-11-26T07:16:47.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.611+0000 7f2783fff700 1 -- 172.21.15.2:0/137481889 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27900137e0 con 0x7f279c144610 2023-11-26T07:16:47.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.611+0000 7f27a1844700 1 -- 172.21.15.2:0/137481889 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f279c132c30 con 0x7f279c144610 2023-11-26T07:16:47.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.611+0000 7f2783fff700 1 -- 172.21.15.2:0/137481889 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2790013b90 con 0x7f279c144610 2023-11-26T07:16:47.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.611+0000 7f27a1844700 1 -- 172.21.15.2:0/137481889 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f279c1331f0 con 0x7f279c144610 2023-11-26T07:16:47.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.612+0000 7f27a1844700 1 -- 172.21.15.2:0/137481889 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f279c075480 con 0x7f279c144610 2023-11-26T07:16:47.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.613+0000 7f2783fff700 1 -- 172.21.15.2:0/137481889 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 89996+0+0 (secure 0 0 0) 0x7f2790013cf0 con 0x7f279c144610 2023-11-26T07:16:47.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.613+0000 7f2783fff700 1 --2- 172.21.15.2:0/137481889 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f278806b740 0x7f278806dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:16:47.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.613+0000 7f2783fff700 1 -- 172.21.15.2:0/137481889 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f279008a660 con 0x7f279c144610 2023-11-26T07:16:47.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.613+0000 7f279affd700 1 --2- 172.21.15.2:0/137481889 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f278806b740 0x7f278806dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:16:47.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.614+0000 7f279affd700 1 --2- 172.21.15.2:0/137481889 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f278806b740 0x7f278806dc00 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f278c009c10 tx=0x7f278c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:16:47.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.617+0000 7f2783fff700 1 -- 172.21.15.2:0/137481889 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2790054760 con 0x7f279c144610 2023-11-26T07:16:47.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.856+0000 7f27a1844700 1 -- 172.21.15.2:0/137481889 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol83060", "target": ["mon-mgr", ""]}) v1 -- 0x7f279c06ef00 con 0x7f278806b740 2023-11-26T07:16:47.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.862+0000 7f2783fff700 1 -- 172.21.15.2:0/137481889 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+67 (secure 0 0 0) 0x7f278c011b00 con 0x7f278806b740 2023-11-26T07:16:47.864 INFO:teuthology.orchestra.run.smithi002.stdout:/volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be 2023-11-26T07:16:47.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.864+0000 7f27a1844700 1 -- 172.21.15.2:0/137481889 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f278806b740 msgr2=0x7f278806dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:47.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.864+0000 7f27a1844700 1 --2- 172.21.15.2:0/137481889 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f278806b740 0x7f278806dc00 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f278c009c10 tx=0x7f278c008030 comp rx=0 tx=0).stop 2023-11-26T07:16:47.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.864+0000 7f27a1844700 1 -- 172.21.15.2:0/137481889 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f279c144610 msgr2=0x7f279c138380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:16:47.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.864+0000 7f27a1844700 1 --2- 172.21.15.2:0/137481889 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f279c144610 0x7f279c138380 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f279000e870 tx=0x7f279000eb80 comp rx=0 tx=0).stop 2023-11-26T07:16:47.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.864+0000 7f27a1844700 1 -- 172.21.15.2:0/137481889 shutdown_connections 2023-11-26T07:16:47.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.864+0000 7f27a1844700 1 --2- 172.21.15.2:0/137481889 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f278806b740 0x7f278806dc00 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:47.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.864+0000 7f27a1844700 1 --2- 172.21.15.2:0/137481889 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f279c15e7c0 0x7f279c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:47.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.864+0000 7f27a1844700 1 --2- 172.21.15.2:0/137481889 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f279c06f700 0x7f279c156f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:47.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.864+0000 7f27a1844700 1 --2- 172.21.15.2:0/137481889 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f279c144610 0x7f279c138380 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:16:47.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.864+0000 7f27a1844700 1 -- 172.21.15.2:0/137481889 >> 172.21.15.2:0/137481889 conn(0x7f279c0b2740 msgr2=0x7f279c0b0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:16:47.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.864+0000 7f27a1844700 1 -- 172.21.15.2:0/137481889 shutdown_connections 2023-11-26T07:16:47.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:16:47.864+0000 7f27a1844700 1 -- 172.21.15.2:0/137481889 wait complete. 2023-11-26T07:16:47.878 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvol83060 with 200 files each 1MB size under directory volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be 2023-11-26T07:16:47.878 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:47.878 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:47.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:47.896 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:47.968 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:47.968 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:47.968 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100362 s, 104 MB/s 2023-11-26T07:16:47.969 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:47.969 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:48.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:48.027 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:48.098 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:48.098 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:48.098 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129745 s, 80.8 MB/s 2023-11-26T07:16:48.099 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:48.099 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:48.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:48.156 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:48.223 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:48.223 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:48.223 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0099277 s, 106 MB/s 2023-11-26T07:16:48.224 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:48.224 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:48.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:48.282 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:48.350 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:48.350 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:48.350 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106152 s, 98.8 MB/s 2023-11-26T07:16:48.351 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:48.351 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:48.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:48.409 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:48.474 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:48.475 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:48.475 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0081624 s, 128 MB/s 2023-11-26T07:16:48.475 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:48.476 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:48.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:48.533 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:48.604 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:48.604 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:48.604 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013428 s, 78.1 MB/s 2023-11-26T07:16:48.604 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:48.604 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:48.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:48.661 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:48.728 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:48.728 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:48.728 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00907396 s, 116 MB/s 2023-11-26T07:16:48.729 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:48.729 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:48.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:48.786 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:48.853 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:48.853 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:48.853 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00850269 s, 123 MB/s 2023-11-26T07:16:48.853 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:48.853 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:48.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:48.912 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:48.980 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:48.980 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:48.980 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103026 s, 102 MB/s 2023-11-26T07:16:48.980 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:48.980 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:49.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:49.038 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:49.106 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:49.106 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:49.106 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100679 s, 104 MB/s 2023-11-26T07:16:49.107 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:49.107 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:49.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:49.165 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.10 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:49.232 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:49.232 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:49.232 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00896635 s, 117 MB/s 2023-11-26T07:16:49.232 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:49.232 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:49.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:49.291 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.11 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:49.357 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:49.357 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:49.357 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00835939 s, 125 MB/s 2023-11-26T07:16:49.357 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:49.358 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:49.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:49.415 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.12 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:49.484 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:49.484 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:49.484 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00985064 s, 106 MB/s 2023-11-26T07:16:49.485 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:49.485 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:49.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:49.542 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.13 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:49.611 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:49.611 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:49.611 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103568 s, 101 MB/s 2023-11-26T07:16:49.611 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:49.611 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:49.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:49.668 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.14 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:49.733 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:49.733 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:49.733 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00809832 s, 129 MB/s 2023-11-26T07:16:49.734 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:49.734 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:49.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:49.791 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.15 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:49.861 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:49.861 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:49.862 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114209 s, 91.8 MB/s 2023-11-26T07:16:49.862 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:49.862 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:49.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:49.919 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.16 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:49.987 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:49.987 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:49.987 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00984752 s, 106 MB/s 2023-11-26T07:16:49.988 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:49.988 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:50.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:50.046 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.17 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:50.113 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:50.113 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:50.113 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103412 s, 101 MB/s 2023-11-26T07:16:50.114 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:50.114 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:50.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:50.172 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.18 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:50.240 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:50.240 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:50.240 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102243 s, 103 MB/s 2023-11-26T07:16:50.241 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:50.241 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:50.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:50.300 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.19 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:50.367 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:50.367 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:50.367 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100609 s, 104 MB/s 2023-11-26T07:16:50.368 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:50.368 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:50.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:50.425 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.20 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:50.492 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:50.492 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:50.492 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00917738 s, 114 MB/s 2023-11-26T07:16:50.493 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:50.493 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:50.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:50.551 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.21 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:50.617 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:50.618 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:50.618 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00914314 s, 115 MB/s 2023-11-26T07:16:50.619 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:50.619 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:50.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:50.678 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.22 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:50.743 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:50.743 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:50.743 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00827145 s, 127 MB/s 2023-11-26T07:16:50.744 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:50.744 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:50.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:50.801 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.23 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:50.867 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:50.868 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:50.868 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00905849 s, 116 MB/s 2023-11-26T07:16:50.868 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:50.869 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:50.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:50.927 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.24 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:50.997 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:50.997 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:50.997 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127995 s, 81.9 MB/s 2023-11-26T07:16:50.998 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:50.998 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:51.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:51.055 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.25 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:51.123 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:51.123 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:51.123 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0095008 s, 110 MB/s 2023-11-26T07:16:51.123 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:51.123 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:51.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:51.180 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.26 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:51.247 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:51.247 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:51.247 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00926531 s, 113 MB/s 2023-11-26T07:16:51.248 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:51.248 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:51.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:51.306 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.27 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:51.374 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:51.374 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:51.374 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00974829 s, 108 MB/s 2023-11-26T07:16:51.374 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:51.374 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:51.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:51.432 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.28 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:51.503 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:51.503 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:51.503 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012218 s, 85.8 MB/s 2023-11-26T07:16:51.503 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:51.503 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:51.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:51.560 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.29 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:51.629 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:51.629 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:51.629 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01155 s, 90.8 MB/s 2023-11-26T07:16:51.630 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:51.630 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:51.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:51.688 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.30 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:51.755 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:51.755 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:51.755 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0095749 s, 110 MB/s 2023-11-26T07:16:51.756 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:51.757 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:51.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:51.814 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.31 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:51.880 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:51.880 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:51.880 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00829568 s, 126 MB/s 2023-11-26T07:16:51.881 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:51.881 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:51.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:51.939 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.32 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:52.007 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:52.007 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:52.007 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0094556 s, 111 MB/s 2023-11-26T07:16:52.007 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:52.007 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:52.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:52.064 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.33 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:52.130 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:52.130 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:52.131 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00932399 s, 112 MB/s 2023-11-26T07:16:52.131 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:52.131 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:52.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:52.190 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.34 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:52.256 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:52.256 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:52.256 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00847116 s, 124 MB/s 2023-11-26T07:16:52.257 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:52.257 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:52.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:52.315 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.35 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:52.381 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:52.381 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:52.381 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00859953 s, 122 MB/s 2023-11-26T07:16:52.382 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:52.382 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:52.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:52.440 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.36 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:52.507 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:52.507 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:52.508 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00958466 s, 109 MB/s 2023-11-26T07:16:52.508 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:52.508 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:52.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:52.566 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.37 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:52.634 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:52.634 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:52.634 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010842 s, 96.7 MB/s 2023-11-26T07:16:52.635 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:52.635 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:52.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:52.694 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.38 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:52.761 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:52.761 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:52.761 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103187 s, 102 MB/s 2023-11-26T07:16:52.762 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:52.762 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:52.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:52.820 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.39 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:52.887 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:52.888 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:52.888 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00981369 s, 107 MB/s 2023-11-26T07:16:52.888 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:52.889 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:52.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:52.946 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.40 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:53.013 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:53.013 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:53.013 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00979491 s, 107 MB/s 2023-11-26T07:16:53.014 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:53.014 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:53.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:53.072 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.41 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:53.138 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:53.138 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:53.138 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00876133 s, 120 MB/s 2023-11-26T07:16:53.139 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:53.139 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:53.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:53.197 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.42 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:53.264 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:53.264 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:53.265 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00995504 s, 105 MB/s 2023-11-26T07:16:53.265 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:53.266 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:53.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:53.324 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.43 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:53.390 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:53.391 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:53.391 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100136 s, 105 MB/s 2023-11-26T07:16:53.391 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:53.392 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:53.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:53.450 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.44 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:53.518 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:53.518 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:53.518 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119102 s, 88.0 MB/s 2023-11-26T07:16:53.519 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:53.519 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:53.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:53.577 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.45 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:53.644 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:53.644 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:53.644 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100712 s, 104 MB/s 2023-11-26T07:16:53.645 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:53.645 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:53.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:53.702 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.46 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:53.768 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:53.768 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:53.768 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00912058 s, 115 MB/s 2023-11-26T07:16:53.769 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:53.769 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:53.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:53.827 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.47 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:53.892 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:53.892 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:53.892 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00850579 s, 123 MB/s 2023-11-26T07:16:53.893 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:53.893 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:53.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:53.951 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.48 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:54.018 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:54.118 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:54.118 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00963206 s, 109 MB/s 2023-11-26T07:16:54.119 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:54.119 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:54.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:54.177 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.49 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:54.245 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:54.245 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:54.245 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101159 s, 104 MB/s 2023-11-26T07:16:54.246 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:54.246 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:54.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:54.304 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.50 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:54.371 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:54.371 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:54.371 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00946737 s, 111 MB/s 2023-11-26T07:16:54.372 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:54.372 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:54.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:54.430 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.51 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:54.498 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:54.498 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:54.498 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00994942 s, 105 MB/s 2023-11-26T07:16:54.499 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:54.499 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:54.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:54.556 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.52 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:54.625 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:54.625 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:54.625 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115031 s, 91.2 MB/s 2023-11-26T07:16:54.626 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:54.626 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:54.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:54.683 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.53 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:54.750 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:54.750 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:54.750 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100222 s, 105 MB/s 2023-11-26T07:16:54.751 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:54.751 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:54.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:54.810 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.54 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:54.876 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:54.876 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:54.877 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00992934 s, 106 MB/s 2023-11-26T07:16:54.877 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:54.877 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:54.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:54.935 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.55 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:55.004 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:55.004 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:55.004 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011521 s, 91.0 MB/s 2023-11-26T07:16:55.005 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:55.005 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:55.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:55.063 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.56 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:55.131 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:55.131 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:55.131 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100157 s, 105 MB/s 2023-11-26T07:16:55.131 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:55.131 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:55.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:55.189 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.57 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:55.259 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:55.259 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:55.259 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113553 s, 92.3 MB/s 2023-11-26T07:16:55.259 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:55.259 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:55.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:55.317 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.58 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:55.383 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:55.383 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:55.384 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00979947 s, 107 MB/s 2023-11-26T07:16:55.384 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:55.385 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:55.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:55.442 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.59 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:55.510 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:55.510 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:55.511 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010478 s, 100 MB/s 2023-11-26T07:16:55.511 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:55.512 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:55.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:55.569 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.60 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:55.637 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:55.637 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:55.637 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108145 s, 97.0 MB/s 2023-11-26T07:16:55.638 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:55.638 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:55.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:55.696 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.61 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:55.762 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:55.762 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:55.762 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00829733 s, 126 MB/s 2023-11-26T07:16:55.763 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:55.763 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:55.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:55.821 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.62 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:55.888 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:55.888 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:55.888 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00990381 s, 106 MB/s 2023-11-26T07:16:55.889 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:55.889 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:55.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:55.947 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.63 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:56.017 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:56.017 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:56.017 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118252 s, 88.7 MB/s 2023-11-26T07:16:56.017 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:56.017 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:56.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:56.076 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.64 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:56.143 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:56.143 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:56.143 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00961445 s, 109 MB/s 2023-11-26T07:16:56.143 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:56.143 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:56.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:56.201 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.65 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:56.268 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:56.268 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:56.268 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00974313 s, 108 MB/s 2023-11-26T07:16:56.269 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:56.269 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:56.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:56.327 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.66 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:56.395 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:56.395 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:56.395 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00949706 s, 110 MB/s 2023-11-26T07:16:56.395 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:56.395 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:56.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:56.452 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.67 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:56.522 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:56.523 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:56.523 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121412 s, 86.4 MB/s 2023-11-26T07:16:56.523 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:56.523 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:56.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:56.580 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.68 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:56.648 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:56.648 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:56.648 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00992519 s, 106 MB/s 2023-11-26T07:16:56.648 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:56.648 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:56.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:56.706 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.69 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:56.773 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:56.773 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:56.773 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104619 s, 100 MB/s 2023-11-26T07:16:56.774 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:56.774 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:56.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:56.832 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.70 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:56.899 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:56.899 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:56.899 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00948964 s, 110 MB/s 2023-11-26T07:16:56.900 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:56.900 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:56.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:56.958 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.71 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:57.025 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:57.025 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:57.025 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00948499 s, 111 MB/s 2023-11-26T07:16:57.026 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:57.026 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:57.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:57.084 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.72 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:57.152 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:57.152 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:57.152 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102322 s, 102 MB/s 2023-11-26T07:16:57.153 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:57.153 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:57.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:57.210 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.73 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:57.279 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:57.279 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:57.279 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114313 s, 91.7 MB/s 2023-11-26T07:16:57.280 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:57.280 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:57.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:57.338 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.74 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:57.406 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:57.407 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:57.407 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106351 s, 98.6 MB/s 2023-11-26T07:16:57.407 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:57.407 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:57.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:57.464 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.75 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:57.531 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:57.531 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:57.531 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00886633 s, 118 MB/s 2023-11-26T07:16:57.532 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:57.532 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:57.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:57.590 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.76 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:57.657 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:57.657 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:57.657 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00956015 s, 110 MB/s 2023-11-26T07:16:57.658 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:57.658 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:57.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:57.717 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.77 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:57.784 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:57.784 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:57.784 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00993584 s, 106 MB/s 2023-11-26T07:16:57.785 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:57.785 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:57.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:57.843 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.78 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:57.909 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:57.909 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:57.909 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00914201 s, 115 MB/s 2023-11-26T07:16:57.909 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:57.909 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:57.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:57.967 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.79 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:58.032 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:58.032 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:58.032 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00856693 s, 122 MB/s 2023-11-26T07:16:58.033 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:58.033 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:58.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:58.091 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.80 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:58.157 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:58.157 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:58.157 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00847125 s, 124 MB/s 2023-11-26T07:16:58.158 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:58.158 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:58.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:58.216 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.81 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:58.281 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:58.281 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:58.281 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00781831 s, 134 MB/s 2023-11-26T07:16:58.281 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:58.281 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:58.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:58.340 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.82 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:58.407 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:58.407 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:58.407 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102022 s, 103 MB/s 2023-11-26T07:16:58.408 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:58.408 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:58.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:58.465 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.83 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:58.533 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:58.533 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:58.533 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102034 s, 103 MB/s 2023-11-26T07:16:58.534 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:58.534 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:58.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:58.592 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.84 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:58.660 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:58.660 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:58.660 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.009961 s, 105 MB/s 2023-11-26T07:16:58.660 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:58.660 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:58.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:58.718 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.85 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:58.785 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:58.785 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:58.785 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00904257 s, 116 MB/s 2023-11-26T07:16:58.786 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:58.786 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:58.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:58.844 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.86 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:58.912 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:58.913 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:58.913 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101821 s, 103 MB/s 2023-11-26T07:16:58.913 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:58.914 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:58.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:58.972 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.87 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:59.041 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:59.041 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:59.042 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122255 s, 85.8 MB/s 2023-11-26T07:16:59.042 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:59.042 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:59.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:59.100 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.88 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:59.169 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:59.169 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:59.169 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118176 s, 88.7 MB/s 2023-11-26T07:16:59.169 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:59.170 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:59.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:59.227 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.89 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:59.293 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:59.293 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:59.294 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.008535 s, 123 MB/s 2023-11-26T07:16:59.294 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:59.294 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:59.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:59.351 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.90 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:59.417 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:59.417 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:59.417 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00883229 s, 119 MB/s 2023-11-26T07:16:59.418 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:59.419 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:59.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:59.476 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.91 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:59.542 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:59.542 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:59.542 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00803472 s, 131 MB/s 2023-11-26T07:16:59.543 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:59.543 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:59.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:59.601 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.92 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:59.667 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:59.667 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:59.668 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00810168 s, 129 MB/s 2023-11-26T07:16:59.668 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:59.668 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:59.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:59.725 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.93 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:59.794 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:59.794 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:59.794 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107316 s, 97.7 MB/s 2023-11-26T07:16:59.795 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:59.795 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:59.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:59.854 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.94 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:16:59.920 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:16:59.920 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:16:59.921 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00960389 s, 109 MB/s 2023-11-26T07:16:59.922 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:16:59.922 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:16:59.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:16:59.981 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.95 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:00.048 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:00.048 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:00.048 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103209 s, 102 MB/s 2023-11-26T07:17:00.049 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:00.049 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:00.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:00.108 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.96 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:00.174 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:00.174 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:00.174 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00823498 s, 127 MB/s 2023-11-26T07:17:00.175 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:00.175 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:00.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:00.232 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.97 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:00.300 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:00.300 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:00.300 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103302 s, 102 MB/s 2023-11-26T07:17:00.301 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:00.301 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:00.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:00.360 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.98 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:00.427 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:00.427 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:00.427 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00992102 s, 106 MB/s 2023-11-26T07:17:00.428 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:00.428 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:00.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:00.486 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.99 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:00.553 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:00.553 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:00.553 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00840954 s, 125 MB/s 2023-11-26T07:17:00.554 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:00.555 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:00.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:00.614 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.100 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:00.680 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:00.680 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:00.680 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00933399 s, 112 MB/s 2023-11-26T07:17:00.681 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:00.681 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:00.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:00.740 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.101 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:00.807 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:00.807 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:00.807 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00947946 s, 111 MB/s 2023-11-26T07:17:00.808 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:00.808 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:00.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:00.865 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.102 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:00.931 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:00.931 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:00.931 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00833755 s, 126 MB/s 2023-11-26T07:17:00.932 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:00.932 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:00.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:00.990 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.103 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:01.058 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:01.059 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:01.059 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105418 s, 99.5 MB/s 2023-11-26T07:17:01.059 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:01.060 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:01.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:01.117 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.104 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:01.184 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:01.184 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:01.184 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00918555 s, 114 MB/s 2023-11-26T07:17:01.185 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:01.185 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:01.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:01.243 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.105 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:01.311 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:01.311 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:01.312 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01016 s, 103 MB/s 2023-11-26T07:17:01.312 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:01.312 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:01.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:01.370 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.106 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:01.440 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:01.440 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:01.440 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119705 s, 87.6 MB/s 2023-11-26T07:17:01.441 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:01.441 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:01.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:01.499 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.107 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:01.568 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:01.568 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:01.568 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00985804 s, 106 MB/s 2023-11-26T07:17:01.569 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:01.569 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:01.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:01.627 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.108 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:01.693 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:01.693 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:01.693 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0083082 s, 126 MB/s 2023-11-26T07:17:01.694 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:01.694 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:01.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:01.752 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.109 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:01.820 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:01.821 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:01.821 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00980208 s, 107 MB/s 2023-11-26T07:17:01.821 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:01.821 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:01.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:01.878 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.110 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:01.946 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:01.946 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:01.946 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100048 s, 105 MB/s 2023-11-26T07:17:01.947 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:01.947 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:02.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:02.005 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.111 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:02.073 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:02.073 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:02.073 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00987382 s, 106 MB/s 2023-11-26T07:17:02.074 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:02.074 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:02.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:02.131 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.112 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:02.199 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:02.199 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:02.199 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00938769 s, 112 MB/s 2023-11-26T07:17:02.199 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:02.199 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:02.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:02.257 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.113 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:02.322 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:02.323 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:02.323 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00839554 s, 125 MB/s 2023-11-26T07:17:02.323 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:02.324 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:02.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:02.381 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.114 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:02.450 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:02.450 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:02.450 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110748 s, 94.7 MB/s 2023-11-26T07:17:02.450 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:02.451 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:02.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:02.508 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.115 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:02.576 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:02.576 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:02.576 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00928092 s, 113 MB/s 2023-11-26T07:17:02.577 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:02.577 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:02.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:02.634 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.116 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:02.701 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:02.701 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:02.701 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00867942 s, 121 MB/s 2023-11-26T07:17:02.701 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:02.701 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:02.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:02.759 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.117 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:02.826 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:02.826 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:02.826 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00984702 s, 106 MB/s 2023-11-26T07:17:02.827 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:02.827 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:02.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:02.885 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.118 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:02.951 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:02.951 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:02.951 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00832022 s, 126 MB/s 2023-11-26T07:17:02.952 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:02.952 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:03.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:03.010 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.119 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:03.076 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:03.076 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:03.076 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00919769 s, 114 MB/s 2023-11-26T07:17:03.076 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:03.077 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:03.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:03.134 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.120 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:03.204 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:03.204 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:03.205 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122607 s, 85.5 MB/s 2023-11-26T07:17:03.205 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:03.205 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:03.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:03.262 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.121 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:03.329 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:03.329 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:03.329 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00994543 s, 105 MB/s 2023-11-26T07:17:03.330 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:03.330 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:03.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:03.388 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.122 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:03.454 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:03.454 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:03.454 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00854609 s, 123 MB/s 2023-11-26T07:17:03.455 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:03.455 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:03.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:03.514 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.123 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:03.582 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:03.582 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:03.582 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108955 s, 96.2 MB/s 2023-11-26T07:17:03.583 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:03.583 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:03.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:03.640 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.124 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:03.707 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:03.707 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:03.707 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00938429 s, 112 MB/s 2023-11-26T07:17:03.708 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:03.708 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:03.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:03.766 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.125 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:03.832 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:03.832 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:03.832 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00886897 s, 118 MB/s 2023-11-26T07:17:03.833 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:03.833 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:03.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:03.891 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.126 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:03.958 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:03.958 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:03.958 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00931126 s, 113 MB/s 2023-11-26T07:17:03.959 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:03.959 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:04.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:04.017 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.127 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:04.085 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:04.085 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:04.085 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100056 s, 105 MB/s 2023-11-26T07:17:04.086 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:04.086 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:04.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:04.144 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.128 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:04.209 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:04.210 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:04.210 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00803445 s, 131 MB/s 2023-11-26T07:17:04.211 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:04.211 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:04.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:04.268 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.129 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:04.336 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:04.336 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:04.336 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00978041 s, 107 MB/s 2023-11-26T07:17:04.336 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:04.337 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:04.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:04.394 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.130 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:04.464 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:04.464 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:04.464 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116576 s, 89.9 MB/s 2023-11-26T07:17:04.464 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:04.465 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:04.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:04.523 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.131 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:04.590 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:04.590 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:04.590 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00923918 s, 113 MB/s 2023-11-26T07:17:04.590 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:04.590 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:04.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:04.647 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.132 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:04.714 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:04.714 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:04.714 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00906512 s, 116 MB/s 2023-11-26T07:17:04.715 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:04.715 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:04.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:04.772 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.133 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:04.838 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:04.838 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:04.839 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00906362 s, 116 MB/s 2023-11-26T07:17:04.839 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:04.840 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:04.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:04.898 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.134 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:04.964 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:04.964 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:04.964 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00887966 s, 118 MB/s 2023-11-26T07:17:04.965 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:04.965 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:05.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:05.022 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.135 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:05.091 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:05.091 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:05.091 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114434 s, 91.6 MB/s 2023-11-26T07:17:05.092 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:05.092 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:05.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:05.150 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.136 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:05.218 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:05.218 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:05.218 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102856 s, 102 MB/s 2023-11-26T07:17:05.219 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:05.219 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:05.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:05.276 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.137 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:05.342 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:05.343 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:05.343 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00911342 s, 115 MB/s 2023-11-26T07:17:05.344 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:05.344 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:05.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:05.401 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.138 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:05.466 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:05.466 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:05.467 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00789435 s, 133 MB/s 2023-11-26T07:17:05.467 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:05.467 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:05.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:05.526 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.139 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:05.593 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:05.594 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:05.594 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00964859 s, 109 MB/s 2023-11-26T07:17:05.594 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:05.595 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:05.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:05.652 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.140 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:05.719 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:05.720 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:05.720 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010008 s, 105 MB/s 2023-11-26T07:17:05.721 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:05.721 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:05.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:05.778 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.141 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:05.846 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:05.847 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:05.847 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102122 s, 103 MB/s 2023-11-26T07:17:05.847 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:05.847 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:05.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:05.905 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.142 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:05.971 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:05.971 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:05.972 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00964756 s, 109 MB/s 2023-11-26T07:17:05.972 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:05.972 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:06.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:06.030 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.143 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:06.099 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:06.099 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:06.099 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116878 s, 89.7 MB/s 2023-11-26T07:17:06.100 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:06.100 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:06.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:06.157 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.144 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:06.224 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:06.224 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:06.224 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00990961 s, 106 MB/s 2023-11-26T07:17:06.225 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:06.225 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:06.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:06.282 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.145 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:06.349 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:06.350 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:06.350 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954196 s, 110 MB/s 2023-11-26T07:17:06.351 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:06.351 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:06.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:06.408 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.146 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:06.475 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:06.475 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:06.475 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00945833 s, 111 MB/s 2023-11-26T07:17:06.475 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:06.475 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:06.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:06.532 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.147 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:06.600 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:06.600 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:06.600 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106434 s, 98.5 MB/s 2023-11-26T07:17:06.601 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:06.601 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:06.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:06.658 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.148 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:06.723 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:06.723 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:06.723 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00787618 s, 133 MB/s 2023-11-26T07:17:06.724 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:06.724 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:06.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:06.782 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.149 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:06.850 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:06.851 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:06.851 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00996695 s, 105 MB/s 2023-11-26T07:17:06.852 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:06.852 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:06.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:06.909 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.150 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:06.977 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:06.977 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:06.977 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00965184 s, 109 MB/s 2023-11-26T07:17:06.977 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:06.978 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:07.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:07.036 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.151 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:07.101 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:07.102 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:07.102 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00853931 s, 123 MB/s 2023-11-26T07:17:07.103 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:07.103 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:07.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:07.161 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.152 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:07.226 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:07.226 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:07.226 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00843479 s, 124 MB/s 2023-11-26T07:17:07.227 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:07.227 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:07.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:07.285 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.153 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:07.354 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:07.354 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:07.354 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110403 s, 95.0 MB/s 2023-11-26T07:17:07.354 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:07.354 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:07.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:07.412 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.154 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:07.478 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:07.478 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:07.478 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00881159 s, 119 MB/s 2023-11-26T07:17:07.479 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:07.479 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:07.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:07.537 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.155 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:07.603 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:07.603 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:07.604 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00817728 s, 128 MB/s 2023-11-26T07:17:07.604 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:07.605 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:07.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:07.662 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.156 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:07.731 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:07.731 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:07.731 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109157 s, 96.1 MB/s 2023-11-26T07:17:07.731 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:07.731 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:07.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:07.789 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.157 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:07.855 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:07.855 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:07.855 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0082125 s, 128 MB/s 2023-11-26T07:17:07.856 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:07.856 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:07.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:07.913 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.158 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:07.980 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:07.980 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:07.980 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00941656 s, 111 MB/s 2023-11-26T07:17:07.981 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:07.981 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:08.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:08.039 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.159 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:08.111 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:08.111 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:08.111 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133805 s, 78.4 MB/s 2023-11-26T07:17:08.111 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:08.111 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:08.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:08.168 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.160 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:08.236 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:08.236 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:08.236 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102573 s, 102 MB/s 2023-11-26T07:17:08.237 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:08.237 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:08.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:08.296 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.161 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:08.362 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:08.362 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:08.362 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00948447 s, 111 MB/s 2023-11-26T07:17:08.363 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:08.363 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:08.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:08.422 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.162 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:08.488 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:08.489 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:08.489 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00988607 s, 106 MB/s 2023-11-26T07:17:08.489 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:08.490 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:08.512 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:17:08.532 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:17:08.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:08.547 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.163 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:08.652 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:08.652 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:08.652 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00847826 s, 124 MB/s 2023-11-26T07:17:08.652 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:08.652 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:08.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:08.711 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.164 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:08.777 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:08.777 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:08.778 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00953946 s, 110 MB/s 2023-11-26T07:17:08.778 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:08.778 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:08.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:08.836 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.165 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:08.904 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:08.904 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:08.904 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00947947 s, 111 MB/s 2023-11-26T07:17:08.904 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:08.904 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:08.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:08.962 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.166 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:09.030 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:09.030 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:09.030 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0099906 s, 105 MB/s 2023-11-26T07:17:09.031 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:09.031 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:09.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:09.089 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.167 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:09.157 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:09.157 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:09.157 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102532 s, 102 MB/s 2023-11-26T07:17:09.158 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:09.158 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:09.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:09.216 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.168 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:09.283 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:09.283 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:09.283 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00903845 s, 116 MB/s 2023-11-26T07:17:09.284 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:09.284 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:09.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:09.341 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.169 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:09.408 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:09.408 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:09.408 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00877278 s, 120 MB/s 2023-11-26T07:17:09.409 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:09.409 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:09.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:09.466 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.170 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:09.533 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:09.533 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:09.533 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00944224 s, 111 MB/s 2023-11-26T07:17:09.534 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:09.534 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:09.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:09.591 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.171 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:09.659 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:09.659 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:09.659 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00918066 s, 114 MB/s 2023-11-26T07:17:09.659 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:09.659 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:09.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:09.717 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.172 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:09.785 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:09.785 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:09.785 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00985116 s, 106 MB/s 2023-11-26T07:17:09.786 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:09.786 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:09.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:09.843 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.173 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:09.911 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:09.911 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:09.911 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102798 s, 102 MB/s 2023-11-26T07:17:09.912 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:09.912 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:09.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:09.970 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.174 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:10.037 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:10.038 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:10.038 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00975776 s, 107 MB/s 2023-11-26T07:17:10.039 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:10.039 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:10.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:10.096 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.175 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:10.163 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:10.163 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:10.163 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00921852 s, 114 MB/s 2023-11-26T07:17:10.164 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:10.164 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:10.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:10.221 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.176 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:10.289 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:10.289 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:10.289 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.009792 s, 107 MB/s 2023-11-26T07:17:10.289 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:10.289 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:10.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:10.348 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.177 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:10.415 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:10.415 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:10.415 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00985709 s, 106 MB/s 2023-11-26T07:17:10.416 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:10.416 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:10.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:10.473 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.178 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:10.542 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:10.542 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:10.542 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116421 s, 90.1 MB/s 2023-11-26T07:17:10.543 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:10.543 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:10.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:10.601 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.179 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:10.669 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:10.670 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:10.670 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102068 s, 103 MB/s 2023-11-26T07:17:10.670 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:10.671 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:10.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:10.728 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.180 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:10.795 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:10.795 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:10.795 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00910594 s, 115 MB/s 2023-11-26T07:17:10.796 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:10.796 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:10.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:10.855 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.181 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:10.921 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:10.921 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:10.922 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00953391 s, 110 MB/s 2023-11-26T07:17:10.922 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:10.923 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:10.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:10.980 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.182 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:11.047 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:11.047 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:11.047 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0086327 s, 121 MB/s 2023-11-26T07:17:11.047 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:11.047 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:11.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:11.104 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.183 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:11.170 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:11.170 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:11.171 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00897461 s, 117 MB/s 2023-11-26T07:17:11.171 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:11.171 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:11.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:11.229 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.184 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:11.296 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:11.296 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:11.296 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00797837 s, 131 MB/s 2023-11-26T07:17:11.297 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:11.297 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:11.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:11.355 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.185 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:11.422 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:11.423 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:11.423 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00950657 s, 110 MB/s 2023-11-26T07:17:11.423 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:11.423 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:11.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:11.480 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.186 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:11.546 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:11.546 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:11.546 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00983899 s, 107 MB/s 2023-11-26T07:17:11.547 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:11.547 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:11.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:11.605 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.187 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:11.672 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:11.672 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:11.673 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0095341 s, 110 MB/s 2023-11-26T07:17:11.673 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:11.673 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:11.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:11.731 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.188 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:11.799 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:11.799 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:11.799 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00956473 s, 110 MB/s 2023-11-26T07:17:11.799 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:11.799 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:11.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:11.857 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.189 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:11.924 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:11.924 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:11.924 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00928924 s, 113 MB/s 2023-11-26T07:17:11.925 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:11.925 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:11.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:11.983 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.190 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:12.048 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:12.049 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:12.049 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00873268 s, 120 MB/s 2023-11-26T07:17:12.049 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:12.050 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:12.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:12.107 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.191 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:12.174 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:12.174 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:12.174 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00966317 s, 109 MB/s 2023-11-26T07:17:12.175 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:12.176 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:12.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:12.233 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.192 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:12.300 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:12.300 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:12.300 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00851115 s, 123 MB/s 2023-11-26T07:17:12.300 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:12.300 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:12.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:12.357 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.193 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:12.426 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:12.426 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:12.426 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115942 s, 90.4 MB/s 2023-11-26T07:17:12.427 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:12.427 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:12.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:12.485 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.194 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:12.551 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:12.551 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:12.552 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00904285 s, 116 MB/s 2023-11-26T07:17:12.552 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:12.552 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:12.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:12.610 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.195 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:12.678 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:12.679 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:12.679 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100899 s, 104 MB/s 2023-11-26T07:17:12.679 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:12.680 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:12.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:12.737 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.196 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:12.804 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:12.804 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:12.804 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00985345 s, 106 MB/s 2023-11-26T07:17:12.805 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:12.805 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:12.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:12.863 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.197 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:12.930 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:12.930 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:12.931 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00983787 s, 107 MB/s 2023-11-26T07:17:12.931 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:12.932 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:12.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:12.989 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.198 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:13.057 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:13.057 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:13.057 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00955886 s, 110 MB/s 2023-11-26T07:17:13.057 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:13.057 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:13.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:13.114 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol83060/d29ee5c8-3b2b-4462-859f-114a61ae17be/subvolume_file.199 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:17:13.182 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-26T07:17:13.182 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-26T07:17:13.182 INFO:teuthology.orchestra.run.smithi002.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110507 s, 94.9 MB/s 2023-11-26T07:17:13.183 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs subvol83060 subvol_snap31270 2023-11-26T07:17:13.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.351+0000 7f778807c700 1 Processor -- start 2023-11-26T07:17:13.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.351+0000 7f778807c700 1 -- start start 2023-11-26T07:17:13.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.352+0000 7f778807c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77800722a0 0x7f778006e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:13.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.352+0000 7f778807c700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f778006dbd0 con 0x7f7780072ab0 2023-11-26T07:17:13.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.352+0000 7f778807c700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f778015b700 con 0x7f77801447a0 2023-11-26T07:17:13.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.352+0000 7f778807c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f778015b9e0 con 0x7f77800722a0 2023-11-26T07:17:13.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.352+0000 7f7786619700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7780072ab0 0x7f778006e5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35786/0 (socket says 172.21.15.2:35786) 2023-11-26T07:17:13.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.352+0000 7f7786619700 1 -- 172.21.15.2:0/802442601 learned_addr learned my addr 172.21.15.2:0/802442601 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:13.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.352+0000 7f7785617700 1 --2- 172.21.15.2:0/802442601 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77800722a0 0x7f778006e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:13.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.352+0000 7f7784e16700 1 -- 172.21.15.2:0/802442601 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 875018708 0 0) 0x7f778006dbd0 con 0x7f7780072ab0 2023-11-26T07:17:13.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.352+0000 7f7784e16700 1 -- 172.21.15.2:0/802442601 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f776c0035b0 con 0x7f7780072ab0 2023-11-26T07:17:13.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.353+0000 7f7784e16700 1 -- 172.21.15.2:0/802442601 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1717802777 0 0) 0x7f776c0035b0 con 0x7f7780072ab0 2023-11-26T07:17:13.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.353+0000 7f7784e16700 1 -- 172.21.15.2:0/802442601 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77800722a0 msgr2=0x7f778006e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:13.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.353+0000 7f7784e16700 1 --2- 172.21.15.2:0/802442601 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77800722a0 0x7f778006e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.353+0000 7f7784e16700 1 -- 172.21.15.2:0/802442601 >> v1:172.21.15.192:6789/0 conn(0x7f77801447a0 legacy=0x7f7780071b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:13.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.353+0000 7f7784e16700 1 -- 172.21.15.2:0/802442601 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f778015bcc0 con 0x7f7780072ab0 2023-11-26T07:17:13.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.353+0000 7f7784e16700 1 -- 172.21.15.2:0/802442601 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f77780019f0 con 0x7f7780072ab0 2023-11-26T07:17:13.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.353+0000 7f7784e16700 1 -- 172.21.15.2:0/802442601 >> v1:172.21.15.2:6789/0 conn(0x7f7780072ab0 legacy=0x7f778006e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:13.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.353+0000 7f7784e16700 1 --2- 172.21.15.2:0/802442601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f776c003a30 0x7f776c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:13.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.353+0000 7f7784e16700 1 --2- 172.21.15.2:0/802442601 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f776c004850 0x7f776c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:13.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.353+0000 7f7784e16700 1 --2- 172.21.15.2:0/802442601 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77800722a0 0x7f776c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:13.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.353+0000 7f7784e16700 1 -- 172.21.15.2:0/802442601 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778015b9e0 con 0x7f776c003a30 2023-11-26T07:17:13.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.353+0000 7f7784e16700 1 -- 172.21.15.2:0/802442601 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f776c00bac0 con 0x7f776c004850 2023-11-26T07:17:13.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.353+0000 7f7784e16700 1 -- 172.21.15.2:0/802442601 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f776c00bc80 con 0x7f77800722a0 2023-11-26T07:17:13.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.353+0000 7f7785e18700 1 --2- 172.21.15.2:0/802442601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f776c003a30 0x7f776c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:13.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.353+0000 7f7785617700 1 --2- 172.21.15.2:0/802442601 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f776c004850 0x7f776c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:13.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.353+0000 7f7786619700 1 --2- 172.21.15.2:0/802442601 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77800722a0 0x7f776c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:13.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.353+0000 7f7785e18700 1 -- 172.21.15.2:0/802442601 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77800722a0 msgr2=0x7f776c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:13.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.353+0000 7f7785e18700 1 --2- 172.21.15.2:0/802442601 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77800722a0 0x7f776c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.353+0000 7f7785e18700 1 -- 172.21.15.2:0/802442601 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f776c004850 msgr2=0x7f776c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:13.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.353+0000 7f7785e18700 1 --2- 172.21.15.2:0/802442601 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f776c004850 0x7f776c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.353+0000 7f7785e18700 1 -- 172.21.15.2:0/802442601 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f776c0035b0 con 0x7f776c003a30 2023-11-26T07:17:13.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.353+0000 7f7785e18700 1 --2- 172.21.15.2:0/802442601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f776c003a30 0x7f776c003e50 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f7770007fd0 tx=0x7f776c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ff7f87ea1d94158 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:13.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.353+0000 7f7784e16700 1 -- 172.21.15.2:0/802442601 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77700052d0 con 0x7f776c003a30 2023-11-26T07:17:13.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.353+0000 7f7784e16700 1 -- 172.21.15.2:0/802442601 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7770005470 con 0x7f776c003a30 2023-11-26T07:17:13.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.353+0000 7f7784e16700 1 -- 172.21.15.2:0/802442601 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77700038c0 con 0x7f776c003a30 2023-11-26T07:17:13.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.354+0000 7f778807c700 1 -- 172.21.15.2:0/802442601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f776c003a30 msgr2=0x7f776c003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:13.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.354+0000 7f778807c700 1 --2- 172.21.15.2:0/802442601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f776c003a30 0x7f776c003e50 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f7770007fd0 tx=0x7f776c005880 comp rx=0 tx=0).stop 2023-11-26T07:17:13.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.354+0000 7f7786619700 1 -- 172.21.15.2:0/802442601 reap_dead start 2023-11-26T07:17:13.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.354+0000 7f778807c700 1 -- 172.21.15.2:0/802442601 shutdown_connections 2023-11-26T07:17:13.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.354+0000 7f778807c700 1 -- 172.21.15.2:0/802442601 >> 172.21.15.2:0/802442601 conn(0x7f77800b2760 msgr2=0x7f77800b2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:13.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.354+0000 7f778807c700 1 -- 172.21.15.2:0/802442601 shutdown_connections 2023-11-26T07:17:13.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.354+0000 7f778807c700 1 -- 172.21.15.2:0/802442601 wait complete. 2023-11-26T07:17:13.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.355+0000 7f778807c700 1 Processor -- start 2023-11-26T07:17:13.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.355+0000 7f778807c700 1 -- start start 2023-11-26T07:17:13.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.356+0000 7f778807c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f776c003a30 0x7f7780143340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:13.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.356+0000 7f778807c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7780143880 0x7f778014b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:13.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.356+0000 7f778807c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f778014b9e0 0x7f778014be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:13.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.356+0000 7f778807c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77800b03f0 con 0x7f7780143880 2023-11-26T07:17:13.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.356+0000 7f778807c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7780143d00 con 0x7f776c003a30 2023-11-26T07:17:13.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.356+0000 7f778807c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7780149de0 con 0x7f778014b9e0 2023-11-26T07:17:13.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.356+0000 7f7785617700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7780143880 0x7f778014b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:13.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.356+0000 7f7785617700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7780143880 0x7f778014b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44586/0 (socket says 172.21.15.2:44586) 2023-11-26T07:17:13.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.356+0000 7f7785617700 1 -- 172.21.15.2:0/3206517330 learned_addr learned my addr 172.21.15.2:0/3206517330 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:13.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.356+0000 7f7786619700 1 --2- 172.21.15.2:0/3206517330 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f778014b9e0 0x7f778014be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:13.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.356+0000 7f7785e18700 1 --2- 172.21.15.2:0/3206517330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f776c003a30 0x7f7780143340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:13.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.356+0000 7f7785617700 1 -- 172.21.15.2:0/3206517330 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f778014b9e0 msgr2=0x7f778014be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:13.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.356+0000 7f7785617700 1 --2- 172.21.15.2:0/3206517330 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f778014b9e0 0x7f778014be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.356+0000 7f7785617700 1 -- 172.21.15.2:0/3206517330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f776c003a30 msgr2=0x7f7780143340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:13.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.356+0000 7f7785617700 1 --2- 172.21.15.2:0/3206517330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f776c003a30 0x7f7780143340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.356+0000 7f7785617700 1 -- 172.21.15.2:0/3206517330 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f778015eca0 con 0x7f7780143880 2023-11-26T07:17:13.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.356+0000 7f7785e18700 1 --2- 172.21.15.2:0/3206517330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f776c003a30 0x7f7780143340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:13.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.357+0000 7f7785617700 1 --2- 172.21.15.2:0/3206517330 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7780143880 0x7f778014b4a0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f777c011de0 tx=0x7f777c010720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:13.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.357+0000 7f77767fc700 1 -- 172.21.15.2:0/3206517330 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777c016070 con 0x7f7780143880 2023-11-26T07:17:13.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.357+0000 7f77767fc700 1 -- 172.21.15.2:0/3206517330 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f777c01a410 con 0x7f7780143880 2023-11-26T07:17:13.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.357+0000 7f778807c700 1 -- 172.21.15.2:0/3206517330 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77801494b0 con 0x7f7780143880 2023-11-26T07:17:13.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.357+0000 7f77767fc700 1 -- 172.21.15.2:0/3206517330 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777c01a7a0 con 0x7f7780143880 2023-11-26T07:17:13.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.357+0000 7f778807c700 1 -- 172.21.15.2:0/3206517330 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7780149a70 con 0x7f7780143880 2023-11-26T07:17:13.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.358+0000 7f778807c700 1 -- 172.21.15.2:0/3206517330 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7780068670 con 0x7f7780143880 2023-11-26T07:17:13.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.358+0000 7f77767fc700 1 -- 172.21.15.2:0/3206517330 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) v1 ==== 90047+0+0 (secure 0 0 0) 0x7f777c01a900 con 0x7f7780143880 2023-11-26T07:17:13.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.359+0000 7f77767fc700 1 --2- 172.21.15.2:0/3206517330 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f776406b7d0 0x7f776406dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:13.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.359+0000 7f77767fc700 1 -- 172.21.15.2:0/3206517330 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f777c08aa50 con 0x7f7780143880 2023-11-26T07:17:13.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.359+0000 7f7785e18700 1 --2- 172.21.15.2:0/3206517330 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f776406b7d0 0x7f776406dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:13.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.359+0000 7f7785e18700 1 --2- 172.21.15.2:0/3206517330 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f776406b7d0 0x7f776406dc90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f7770007fd0 tx=0x7f7770009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:13.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.363+0000 7f77767fc700 1 -- 172.21.15.2:0/3206517330 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f777c057410 con 0x7f7780143880 2023-11-26T07:17:13.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.602+0000 7f778807c700 1 -- 172.21.15.2:0/3206517330 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "subvol83060", "snap_name": "subvol_snap31270", "target": ["mon-mgr", ""]}) v1 -- 0x7f778015b130 con 0x7f776406b7d0 2023-11-26T07:17:13.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.622+0000 7f77767fc700 1 -- 172.21.15.2:0/3206517330 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f7770005250 con 0x7f776406b7d0 2023-11-26T07:17:13.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.625+0000 7f778807c700 1 -- 172.21.15.2:0/3206517330 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f776406b7d0 msgr2=0x7f776406dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:13.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.625+0000 7f778807c700 1 --2- 172.21.15.2:0/3206517330 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f776406b7d0 0x7f776406dc90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f7770007fd0 tx=0x7f7770009030 comp rx=0 tx=0).stop 2023-11-26T07:17:13.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.625+0000 7f778807c700 1 -- 172.21.15.2:0/3206517330 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7780143880 msgr2=0x7f778014b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:13.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.625+0000 7f778807c700 1 --2- 172.21.15.2:0/3206517330 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7780143880 0x7f778014b4a0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f777c011de0 tx=0x7f777c010720 comp rx=0 tx=0).stop 2023-11-26T07:17:13.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.625+0000 7f778807c700 1 -- 172.21.15.2:0/3206517330 shutdown_connections 2023-11-26T07:17:13.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.625+0000 7f778807c700 1 --2- 172.21.15.2:0/3206517330 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f776406b7d0 0x7f776406dc90 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.625+0000 7f778807c700 1 --2- 172.21.15.2:0/3206517330 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f778014b9e0 0x7f778014be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.625+0000 7f778807c700 1 --2- 172.21.15.2:0/3206517330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f776c003a30 0x7f7780143340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.625+0000 7f778807c700 1 --2- 172.21.15.2:0/3206517330 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7780143880 0x7f778014b4a0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.625+0000 7f778807c700 1 -- 172.21.15.2:0/3206517330 >> 172.21.15.2:0/3206517330 conn(0x7f77800b2760 msgr2=0x7f77800b16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:13.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.625+0000 7f778807c700 1 -- 172.21.15.2:0/3206517330 shutdown_connections 2023-11-26T07:17:13.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.625+0000 7f778807c700 1 -- 172.21.15.2:0/3206517330 wait complete. 2023-11-26T07:17:13.643 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/snapshot_clone_delay 5 2023-11-26T07:17:13.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.771+0000 7fb1f4546700 1 Processor -- start 2023-11-26T07:17:13.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.771+0000 7fb1f4546700 1 -- start start 2023-11-26T07:17:13.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.772+0000 7fb1f4546700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb1ec0cecd0 0x7fb1ec15c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:13.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.772+0000 7fb1f4546700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ec0d0a90 con 0x7fb1ec0cf2b0 2023-11-26T07:17:13.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.772+0000 7fb1f4546700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ec06ee10 con 0x7fb1ec15bde0 2023-11-26T07:17:13.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.772+0000 7fb1f4546700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1ec06f0f0 con 0x7fb1ec0cecd0 2023-11-26T07:17:13.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.772+0000 7fb1f2ae3700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb1ec0cecd0 0x7fb1ec15c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:13.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.772+0000 7fb1f1ae1700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb1ec0cf2b0 0x7fb1ec0ce5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35802/0 (socket says 172.21.15.2:35802) 2023-11-26T07:17:13.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.772+0000 7fb1f1ae1700 1 -- 172.21.15.2:0/558285956 learned_addr learned my addr 172.21.15.2:0/558285956 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:13.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.773+0000 7fb1f2ae3700 1 -- 172.21.15.2:0/558285956 >> v1:172.21.15.192:6789/0 conn(0x7fb1ec15bde0 legacy=0x7fb1ec0d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:13.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.773+0000 7fb1f2ae3700 1 -- 172.21.15.2:0/558285956 >> v1:172.21.15.2:6789/0 conn(0x7fb1ec0cf2b0 legacy=0x7fb1ec0ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:13.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.773+0000 7fb1f2ae3700 1 -- 172.21.15.2:0/558285956 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1ec06f3d0 con 0x7fb1ec0cecd0 2023-11-26T07:17:13.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.773+0000 7fb1f12e0700 1 -- 172.21.15.2:0/558285956 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 463393573 0 0) 0x7fb1ec0d0a90 con 0x7fb1ec0cf2b0 2023-11-26T07:17:13.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.773+0000 7fb1f2ae3700 1 --2- 172.21.15.2:0/558285956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1ec0cecd0 0x7fb1ec15c1c0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8009840 tx=0x7fb1e8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf8480b6aa2dab8a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:13.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.773+0000 7fb1f12e0700 1 -- 172.21.15.2:0/558285956 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e8004230 con 0x7fb1ec0cecd0 2023-11-26T07:17:13.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.773+0000 7fb1f12e0700 1 -- 172.21.15.2:0/558285956 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e8004390 con 0x7fb1ec0cecd0 2023-11-26T07:17:13.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.773+0000 7fb1f12e0700 1 -- 172.21.15.2:0/558285956 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e80036a0 con 0x7fb1ec0cecd0 2023-11-26T07:17:13.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.773+0000 7fb1f4546700 1 -- 172.21.15.2:0/558285956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1ec0cecd0 msgr2=0x7fb1ec15c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:13.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.773+0000 7fb1f4546700 1 --2- 172.21.15.2:0/558285956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1ec0cecd0 0x7fb1ec15c1c0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8009840 tx=0x7fb1e8009b50 comp rx=0 tx=0).stop 2023-11-26T07:17:13.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.774+0000 7fb1f4546700 1 -- 172.21.15.2:0/558285956 shutdown_connections 2023-11-26T07:17:13.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.774+0000 7fb1f4546700 1 --2- 172.21.15.2:0/558285956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1ec0cecd0 0x7fb1ec15c1c0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.774+0000 7fb1f4546700 1 -- 172.21.15.2:0/558285956 >> 172.21.15.2:0/558285956 conn(0x7fb1ec0b3720 msgr2=0x7fb1ec0b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:13.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.774+0000 7fb1f4546700 1 -- 172.21.15.2:0/558285956 shutdown_connections 2023-11-26T07:17:13.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.774+0000 7fb1f4546700 1 -- 172.21.15.2:0/558285956 wait complete. 2023-11-26T07:17:13.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.775+0000 7fb1f4546700 1 Processor -- start 2023-11-26T07:17:13.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.775+0000 7fb1f4546700 1 -- start start 2023-11-26T07:17:13.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.776+0000 7fb1f4546700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1ec0cecd0 0x7fb1ec0afb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:13.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.776+0000 7fb1f4546700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1ec0cf2b0 0x7fb1ec0b58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:13.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.776+0000 7fb1f4546700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1ec15bde0 0x7fb1ec152d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:13.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.776+0000 7fb1f4546700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ec0c5a40 con 0x7fb1ec0cecd0 2023-11-26T07:17:13.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.776+0000 7fb1f4546700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ec0c7b30 con 0x7fb1ec15bde0 2023-11-26T07:17:13.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.776+0000 7fb1f4546700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ec0c7e10 con 0x7fb1ec0cf2b0 2023-11-26T07:17:13.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.776+0000 7fb1f22e2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1ec0cecd0 0x7fb1ec0afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:13.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.776+0000 7fb1f22e2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1ec0cecd0 0x7fb1ec0afb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44598/0 (socket says 172.21.15.2:44598) 2023-11-26T07:17:13.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.776+0000 7fb1f22e2700 1 -- 172.21.15.2:0/1846608830 learned_addr learned my addr 172.21.15.2:0/1846608830 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:13.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.776+0000 7fb1f2ae3700 1 --2- 172.21.15.2:0/1846608830 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1ec15bde0 0x7fb1ec152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:13.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.776+0000 7fb1f1ae1700 1 --2- 172.21.15.2:0/1846608830 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1ec0cf2b0 0x7fb1ec0b58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:13.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.776+0000 7fb1f22e2700 1 -- 172.21.15.2:0/1846608830 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1ec0cf2b0 msgr2=0x7fb1ec0b58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:13.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.776+0000 7fb1f22e2700 1 --2- 172.21.15.2:0/1846608830 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1ec0cf2b0 0x7fb1ec0b58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.776+0000 7fb1f22e2700 1 -- 172.21.15.2:0/1846608830 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1ec15bde0 msgr2=0x7fb1ec152d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:13.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.776+0000 7fb1f22e2700 1 --2- 172.21.15.2:0/1846608830 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1ec15bde0 0x7fb1ec152d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.776+0000 7fb1f22e2700 1 -- 172.21.15.2:0/1846608830 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e80094a0 con 0x7fb1ec0cecd0 2023-11-26T07:17:13.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.776+0000 7fb1f2ae3700 1 --2- 172.21.15.2:0/1846608830 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1ec15bde0 0x7fb1ec152d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:13.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.776+0000 7fb1f22e2700 1 --2- 172.21.15.2:0/1846608830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1ec0cecd0 0x7fb1ec0afb90 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fb1e400ba50 tx=0x7fb1e400be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:13.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.776+0000 7fb1e2ffd700 1 -- 172.21.15.2:0/1846608830 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e400cae0 con 0x7fb1ec0cecd0 2023-11-26T07:17:13.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.776+0000 7fb1e2ffd700 1 -- 172.21.15.2:0/1846608830 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e400cc40 con 0x7fb1ec0cecd0 2023-11-26T07:17:13.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.776+0000 7fb1f4546700 1 -- 172.21.15.2:0/1846608830 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1ec0c5660 con 0x7fb1ec0cecd0 2023-11-26T07:17:13.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.776+0000 7fb1e2ffd700 1 -- 172.21.15.2:0/1846608830 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e4014440 con 0x7fb1ec0cecd0 2023-11-26T07:17:13.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.777+0000 7fb1f4546700 1 -- 172.21.15.2:0/1846608830 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1ec0c7760 con 0x7fb1ec0cecd0 2023-11-26T07:17:13.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.777+0000 7fb1f4546700 1 -- 172.21.15.2:0/1846608830 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1ec0c5cb0 con 0x7fb1ec0cecd0 2023-11-26T07:17:13.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.778+0000 7fb1e2ffd700 1 -- 172.21.15.2:0/1846608830 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) v1 ==== 90047+0+0 (secure 0 0 0) 0x7fb1e4006d50 con 0x7fb1ec0cecd0 2023-11-26T07:17:13.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.778+0000 7fb1e2ffd700 1 --2- 172.21.15.2:0/1846608830 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb1d006b7d0 0x7fb1d006dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:13.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.778+0000 7fb1e2ffd700 1 -- 172.21.15.2:0/1846608830 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb1e4087c30 con 0x7fb1ec0cecd0 2023-11-26T07:17:13.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.779+0000 7fb1f1ae1700 1 --2- 172.21.15.2:0/1846608830 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb1d006b7d0 0x7fb1d006dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:13.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.779+0000 7fb1f1ae1700 1 --2- 172.21.15.2:0/1846608830 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb1d006b7d0 0x7fb1d006dc90 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec15f700 tx=0x7fb1dc007be0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:13.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.783+0000 7fb1e2ffd700 1 -- 172.21.15.2:0/1846608830 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb1e40545a0 con 0x7fb1ec0cecd0 2023-11-26T07:17:13.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.986+0000 7fb1f4546700 1 -- 172.21.15.2:0/1846608830 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}] v 0) v1 -- 0x7fb1ec068480 con 0x7fb1ec0cecd0 2023-11-26T07:17:13.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.989+0000 7fb1e2ffd700 1 -- 172.21.15.2:0/1846608830 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}]=0 v23)=0 v23) v1 ==== 130+0+0 (secure 0 0 0) 0x7fb1e4057bc0 con 0x7fb1ec0cecd0 2023-11-26T07:17:13.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.992+0000 7fb1f4546700 1 -- 172.21.15.2:0/1846608830 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb1d006b7d0 msgr2=0x7fb1d006dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:13.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.992+0000 7fb1f4546700 1 --2- 172.21.15.2:0/1846608830 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb1d006b7d0 0x7fb1d006dc90 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec15f700 tx=0x7fb1dc007be0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.992+0000 7fb1f4546700 1 -- 172.21.15.2:0/1846608830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1ec0cecd0 msgr2=0x7fb1ec0afb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:13.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.992+0000 7fb1f4546700 1 --2- 172.21.15.2:0/1846608830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1ec0cecd0 0x7fb1ec0afb90 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fb1e400ba50 tx=0x7fb1e400be10 comp rx=0 tx=0).stop 2023-11-26T07:17:13.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.992+0000 7fb1f4546700 1 -- 172.21.15.2:0/1846608830 shutdown_connections 2023-11-26T07:17:13.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.992+0000 7fb1f4546700 1 --2- 172.21.15.2:0/1846608830 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb1d006b7d0 0x7fb1d006dc90 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.992+0000 7fb1f4546700 1 --2- 172.21.15.2:0/1846608830 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1ec15bde0 0x7fb1ec152d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.992+0000 7fb1f4546700 1 --2- 172.21.15.2:0/1846608830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1ec0cecd0 0x7fb1ec0afb90 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.992+0000 7fb1f4546700 1 --2- 172.21.15.2:0/1846608830 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1ec0cf2b0 0x7fb1ec0b58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:13.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.992+0000 7fb1f4546700 1 -- 172.21.15.2:0/1846608830 >> 172.21.15.2:0/1846608830 conn(0x7fb1ec0b3720 msgr2=0x7fb1ec0cdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:13.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.992+0000 7fb1f4546700 1 -- 172.21.15.2:0/1846608830 shutdown_connections 2023-11-26T07:17:13.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:13.992+0000 7fb1f4546700 1 -- 172.21.15.2:0/1846608830 wait complete. 2023-11-26T07:17:14.005 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:17:14.003+0000 7f8da9aad700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:17:14.005 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:17:14.003+0000 7f8da9aad700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:17:14.005 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:17:14.003+0000 7f8da9aad700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:17:14.006 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:17:14.003+0000 7f8da9aad700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:17:14.006 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:17:14.003+0000 7f8da9aad700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:17:14.006 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs subvol83060 subvol_snap31270 subvol_clone33480 2023-11-26T07:17:14.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.135+0000 7fbe1ec7f700 1 Processor -- start 2023-11-26T07:17:14.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.136+0000 7fbe1ec7f700 1 -- start start 2023-11-26T07:17:14.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.136+0000 7fbe1ec7f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbe180722c0 0x7fbe180b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:14.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.136+0000 7fbe1ec7f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe181440f0 0x7fbe1806e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:14.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.136+0000 7fbe1ec7f700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe18143ec0 con 0x7fbe18143ae0 2023-11-26T07:17:14.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.136+0000 7fbe1ec7f700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe180b40a0 con 0x7fbe180722c0 2023-11-26T07:17:14.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.136+0000 7fbe1ec7f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe180b3ae0 con 0x7fbe181440f0 2023-11-26T07:17:14.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.136+0000 7fbe17fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbe180722c0 0x7fbe180b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:14.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.136+0000 7fbe1ca1b700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fbe18143ae0 0x7fbe18071bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35816/0 (socket says 172.21.15.2:35816) 2023-11-26T07:17:14.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.136+0000 7fbe1ca1b700 1 -- 172.21.15.2:0/143734594 learned_addr learned my addr 172.21.15.2:0/143734594 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:14.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.137+0000 7fbe1d21c700 1 --2- 172.21.15.2:0/143734594 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe181440f0 0x7fbe1806e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:14.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.137+0000 7fbe177fe700 1 -- 172.21.15.2:0/143734594 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2988585661 0 0) 0x7fbe18143ec0 con 0x7fbe18143ae0 2023-11-26T07:17:14.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.137+0000 7fbe177fe700 1 -- 172.21.15.2:0/143734594 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe080035b0 con 0x7fbe18143ae0 2023-11-26T07:17:14.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.137+0000 7fbe17fff700 1 -- 172.21.15.2:0/143734594 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe181440f0 msgr2=0x7fbe1806e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:14.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.137+0000 7fbe17fff700 1 --2- 172.21.15.2:0/143734594 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe181440f0 0x7fbe1806e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:14.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.137+0000 7fbe17fff700 1 -- 172.21.15.2:0/143734594 >> v1:172.21.15.2:6789/0 conn(0x7fbe18143ae0 legacy=0x7fbe18071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:14.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.137+0000 7fbe17fff700 1 -- 172.21.15.2:0/143734594 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe180b3dc0 con 0x7fbe180722c0 2023-11-26T07:17:14.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.137+0000 7fbe17fff700 1 --2- 172.21.15.2:0/143734594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe180722c0 0x7fbe180b51b0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fbe04009840 tx=0x7fbe04009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3763455bcf69cab server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:14.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.137+0000 7fbe177fe700 1 -- 172.21.15.2:0/143734594 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe04011830 con 0x7fbe180722c0 2023-11-26T07:17:14.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.137+0000 7fbe177fe700 1 -- 172.21.15.2:0/143734594 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe04011990 con 0x7fbe180722c0 2023-11-26T07:17:14.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.137+0000 7fbe177fe700 1 -- 172.21.15.2:0/143734594 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe04011d20 con 0x7fbe180722c0 2023-11-26T07:17:14.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.138+0000 7fbe1ec7f700 1 -- 172.21.15.2:0/143734594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe180722c0 msgr2=0x7fbe180b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:14.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.138+0000 7fbe1ec7f700 1 --2- 172.21.15.2:0/143734594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe180722c0 0x7fbe180b51b0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fbe04009840 tx=0x7fbe04009b50 comp rx=0 tx=0).stop 2023-11-26T07:17:14.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.138+0000 7fbe1ec7f700 1 -- 172.21.15.2:0/143734594 shutdown_connections 2023-11-26T07:17:14.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.138+0000 7fbe1ec7f700 1 --2- 172.21.15.2:0/143734594 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe181440f0 0x7fbe1806e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:14.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.138+0000 7fbe1ec7f700 1 --2- 172.21.15.2:0/143734594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe180722c0 0x7fbe180b51b0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:14.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.138+0000 7fbe1ec7f700 1 -- 172.21.15.2:0/143734594 >> 172.21.15.2:0/143734594 conn(0x7fbe180b2740 msgr2=0x7fbe180b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:14.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.138+0000 7fbe1ec7f700 1 -- 172.21.15.2:0/143734594 shutdown_connections 2023-11-26T07:17:14.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.138+0000 7fbe1ec7f700 1 -- 172.21.15.2:0/143734594 wait complete. 2023-11-26T07:17:14.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.139+0000 7fbe1ec7f700 1 Processor -- start 2023-11-26T07:17:14.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.139+0000 7fbe1ec7f700 1 -- start start 2023-11-26T07:17:14.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.140+0000 7fbe1ec7f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe180722c0 0x7fbe18153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:14.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.140+0000 7fbe1ec7f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe18143ae0 0x7fbe1815b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:14.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.140+0000 7fbe1ec7f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe181440f0 0x7fbe180cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:14.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.140+0000 7fbe1ec7f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe18154210 con 0x7fbe180722c0 2023-11-26T07:17:14.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.140+0000 7fbe1ec7f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe180cdf90 con 0x7fbe181440f0 2023-11-26T07:17:14.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.140+0000 7fbe1ec7f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe180ceb10 con 0x7fbe18143ae0 2023-11-26T07:17:14.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.140+0000 7fbe1ca1b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe180722c0 0x7fbe18153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:14.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.140+0000 7fbe1ca1b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe180722c0 0x7fbe18153cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44612/0 (socket says 172.21.15.2:44612) 2023-11-26T07:17:14.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.140+0000 7fbe1ca1b700 1 -- 172.21.15.2:0/3503550380 learned_addr learned my addr 172.21.15.2:0/3503550380 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:14.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.140+0000 7fbe17fff700 1 --2- 172.21.15.2:0/3503550380 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe18143ae0 0x7fbe1815b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:14.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.140+0000 7fbe1ca1b700 1 -- 172.21.15.2:0/3503550380 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe18143ae0 msgr2=0x7fbe1815b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:14.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.140+0000 7fbe1ca1b700 1 --2- 172.21.15.2:0/3503550380 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe18143ae0 0x7fbe1815b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:14.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.140+0000 7fbe1ca1b700 1 -- 172.21.15.2:0/3503550380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe181440f0 msgr2=0x7fbe180cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:14.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.140+0000 7fbe1ca1b700 1 --2- 172.21.15.2:0/3503550380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe181440f0 0x7fbe180cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:14.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.140+0000 7fbe1ca1b700 1 -- 172.21.15.2:0/3503550380 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe040094a0 con 0x7fbe180722c0 2023-11-26T07:17:14.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.141+0000 7fbe1ca1b700 1 --2- 172.21.15.2:0/3503550380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe180722c0 0x7fbe18153cd0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c00c700 tx=0x7fbe0c00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:14.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.141+0000 7fbe157fa700 1 -- 172.21.15.2:0/3503550380 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c005d70 con 0x7fbe180722c0 2023-11-26T07:17:14.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.141+0000 7fbe157fa700 1 -- 172.21.15.2:0/3503550380 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe0c0070d0 con 0x7fbe180722c0 2023-11-26T07:17:14.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.141+0000 7fbe1ec7f700 1 -- 172.21.15.2:0/3503550380 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe1813f070 con 0x7fbe180722c0 2023-11-26T07:17:14.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.141+0000 7fbe157fa700 1 -- 172.21.15.2:0/3503550380 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c007460 con 0x7fbe180722c0 2023-11-26T07:17:14.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.141+0000 7fbe1ec7f700 1 -- 172.21.15.2:0/3503550380 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe180ce1e0 con 0x7fbe180722c0 2023-11-26T07:17:14.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.142+0000 7fbe1ec7f700 1 -- 172.21.15.2:0/3503550380 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe180b6d30 con 0x7fbe180722c0 2023-11-26T07:17:14.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.142+0000 7fbe157fa700 1 -- 172.21.15.2:0/3503550380 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) v1 ==== 90047+0+0 (secure 0 0 0) 0x7fbe0c0075c0 con 0x7fbe180722c0 2023-11-26T07:17:14.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.143+0000 7fbe157fa700 1 --2- 172.21.15.2:0/3503550380 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fbdfc06b7d0 0x7fbdfc06dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:14.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.143+0000 7fbe157fa700 1 -- 172.21.15.2:0/3503550380 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe0c0874c0 con 0x7fbe180722c0 2023-11-26T07:17:14.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.143+0000 7fbe17fff700 1 --2- 172.21.15.2:0/3503550380 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fbdfc06b7d0 0x7fbdfc06dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:14.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.144+0000 7fbe17fff700 1 --2- 172.21.15.2:0/3503550380 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fbdfc06b7d0 0x7fbdfc06dc90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fbe1813fc60 tx=0x7fbe04008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:14.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.148+0000 7fbe157fa700 1 -- 172.21.15.2:0/3503550380 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbe0c053fa0 con 0x7fbe180722c0 2023-11-26T07:17:14.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.392+0000 7fbe1ec7f700 1 -- 172.21.15.2:0/3503550380 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "subvol83060", "snap_name": "subvol_snap31270", "target_sub_name": "subvol_clone33480", "target": ["mon-mgr", ""]}) v1 -- 0x7fbe18144860 con 0x7fbdfc06b7d0 2023-11-26T07:17:14.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.463+0000 7fbe157fa700 1 -- 172.21.15.2:0/3503550380 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fbe04011b00 con 0x7fbdfc06b7d0 2023-11-26T07:17:14.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.465+0000 7fbe1ec7f700 1 -- 172.21.15.2:0/3503550380 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fbdfc06b7d0 msgr2=0x7fbdfc06dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:14.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.465+0000 7fbe1ec7f700 1 --2- 172.21.15.2:0/3503550380 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fbdfc06b7d0 0x7fbdfc06dc90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fbe1813fc60 tx=0x7fbe04008030 comp rx=0 tx=0).stop 2023-11-26T07:17:14.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.465+0000 7fbe1ec7f700 1 -- 172.21.15.2:0/3503550380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe180722c0 msgr2=0x7fbe18153cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:14.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.465+0000 7fbe1ec7f700 1 --2- 172.21.15.2:0/3503550380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe180722c0 0x7fbe18153cd0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c00c700 tx=0x7fbe0c00cac0 comp rx=0 tx=0).stop 2023-11-26T07:17:14.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.465+0000 7fbe1ec7f700 1 -- 172.21.15.2:0/3503550380 shutdown_connections 2023-11-26T07:17:14.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.465+0000 7fbe1ec7f700 1 --2- 172.21.15.2:0/3503550380 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fbdfc06b7d0 0x7fbdfc06dc90 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:14.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.465+0000 7fbe1ec7f700 1 --2- 172.21.15.2:0/3503550380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe181440f0 0x7fbe180cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:14.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.465+0000 7fbe1ec7f700 1 --2- 172.21.15.2:0/3503550380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe180722c0 0x7fbe18153cd0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:14.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.465+0000 7fbe1ec7f700 1 --2- 172.21.15.2:0/3503550380 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe18143ae0 0x7fbe1815b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:14.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.466+0000 7fbe1ec7f700 1 -- 172.21.15.2:0/3503550380 >> 172.21.15.2:0/3503550380 conn(0x7fbe180b2740 msgr2=0x7fbe18071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:14.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.466+0000 7fbe1ec7f700 1 -- 172.21.15.2:0/3503550380 shutdown_connections 2023-11-26T07:17:14.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.466+0000 7fbe1ec7f700 1 -- 172.21.15.2:0/3503550380 wait complete. 2023-11-26T07:17:14.470 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:17:14.469+0000 7f8dacab3700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:17:14.470 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:17:14.469+0000 7f8dacab3700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:17:14.471 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:17:14.469+0000 7f8dacab3700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:17:14.471 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:17:14.469+0000 7f8dacab3700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:17:14.471 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:17:14.469+0000 7f8dacab3700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:17:14.480 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone33480 2023-11-26T07:17:14.486 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:17:14.484+0000 7f8dab2b0700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:17:14.486 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:17:14.484+0000 7f8dab2b0700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:17:14.486 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:17:14.484+0000 7f8dab2b0700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:17:14.486 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:17:14.484+0000 7f8dab2b0700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:17:14.486 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:17:14.484+0000 7f8dab2b0700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:17:14.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.606+0000 7f4072098700 1 Processor -- start 2023-11-26T07:17:14.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.606+0000 7f4072098700 1 -- start start 2023-11-26T07:17:14.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.607+0000 7f4072098700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f406c0b5ab0 0x7f406c06e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:14.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.607+0000 7f4072098700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f406c071f50 con 0x7f406c0b4150 2023-11-26T07:17:14.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.607+0000 7f4072098700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f406c072230 con 0x7f406c06b620 2023-11-26T07:17:14.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.607+0000 7f4072098700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f406c072510 con 0x7f406c0b5ab0 2023-11-26T07:17:14.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.607+0000 7f406affd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f406c0b4150 0x7f406c06de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35832/0 (socket says 172.21.15.2:35832) 2023-11-26T07:17:14.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.607+0000 7f406affd700 1 -- 172.21.15.2:0/597784148 learned_addr learned my addr 172.21.15.2:0/597784148 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:14.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.607+0000 7f406bfff700 1 --2- 172.21.15.2:0/597784148 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f406c0b5ab0 0x7f406c06e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:14.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.607+0000 7f406a7fc700 1 -- 172.21.15.2:0/597784148 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4286883210 0 0) 0x7f406c071f50 con 0x7f406c0b4150 2023-11-26T07:17:14.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.608+0000 7f406a7fc700 1 -- 172.21.15.2:0/597784148 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40580035b0 con 0x7f406c0b4150 2023-11-26T07:17:14.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.608+0000 7f406a7fc700 1 -- 172.21.15.2:0/597784148 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3559654415 0 0) 0x7f406c072230 con 0x7f406c06b620 2023-11-26T07:17:14.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.608+0000 7f406a7fc700 1 -- 172.21.15.2:0/597784148 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f406c071f50 con 0x7f406c06b620 2023-11-26T07:17:14.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.608+0000 7f406bfff700 1 -- 172.21.15.2:0/597784148 >> v1:172.21.15.192:6789/0 conn(0x7f406c06b620 legacy=0x7f406c0b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:14.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.608+0000 7f406a7fc700 1 -- 172.21.15.2:0/597784148 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2301539121 0 0) 0x7f40580035b0 con 0x7f406c0b4150 2023-11-26T07:17:14.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.608+0000 7f406bfff700 1 -- 172.21.15.2:0/597784148 >> v1:172.21.15.2:6789/0 conn(0x7f406c0b4150 legacy=0x7f406c06de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:14.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.608+0000 7f406bfff700 1 -- 172.21.15.2:0/597784148 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f406c0727f0 con 0x7f406c0b5ab0 2023-11-26T07:17:14.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.608+0000 7f406bfff700 1 --2- 172.21.15.2:0/597784148 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f406c0b5ab0 0x7f406c06e560 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4064009dc0 tx=0x7f406400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9fdfea19cbc0156 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:14.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.608+0000 7f406a7fc700 1 -- 172.21.15.2:0/597784148 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406400e070 con 0x7f406c0b5ab0 2023-11-26T07:17:14.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.608+0000 7f406a7fc700 1 -- 172.21.15.2:0/597784148 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4064003a20 con 0x7f406c0b5ab0 2023-11-26T07:17:14.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.608+0000 7f406a7fc700 1 -- 172.21.15.2:0/597784148 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405c001670 con 0x7f406c0b5ab0 2023-11-26T07:17:14.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.609+0000 7f4072098700 1 -- 172.21.15.2:0/597784148 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f406c0b5ab0 msgr2=0x7f406c06e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:14.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.609+0000 7f4072098700 1 --2- 172.21.15.2:0/597784148 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f406c0b5ab0 0x7f406c06e560 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4064009dc0 tx=0x7f406400b330 comp rx=0 tx=0).stop 2023-11-26T07:17:14.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.609+0000 7f4072098700 1 -- 172.21.15.2:0/597784148 shutdown_connections 2023-11-26T07:17:14.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.609+0000 7f4072098700 1 --2- 172.21.15.2:0/597784148 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f406c0b5ab0 0x7f406c06e560 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:14.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.609+0000 7f4072098700 1 -- 172.21.15.2:0/597784148 >> 172.21.15.2:0/597784148 conn(0x7f406c0b2740 msgr2=0x7f406c0b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:14.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.609+0000 7f4072098700 1 -- 172.21.15.2:0/597784148 shutdown_connections 2023-11-26T07:17:14.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.609+0000 7f4072098700 1 -- 172.21.15.2:0/597784148 wait complete. 2023-11-26T07:17:14.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.610+0000 7f4072098700 1 Processor -- start 2023-11-26T07:17:14.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.610+0000 7f4072098700 1 -- start start 2023-11-26T07:17:14.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.611+0000 7f4072098700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f406c06b620 0x7f406c1f7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:14.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.611+0000 7f4072098700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f406c0b4150 0x7f406c1e7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:14.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.611+0000 7f4072098700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f406c0b5ab0 0x7f406c1e8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:14.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.611+0000 7f4072098700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406c06e100 con 0x7f406c0b4150 2023-11-26T07:17:14.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.611+0000 7f4072098700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406c1e8750 con 0x7f406c0b5ab0 2023-11-26T07:17:14.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.611+0000 7f4072098700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f406c1f7da0 con 0x7f406c06b620 2023-11-26T07:17:14.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.611+0000 7f406affd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f406c0b4150 0x7f406c1e7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:14.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.611+0000 7f406affd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f406c0b4150 0x7f406c1e7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44628/0 (socket says 172.21.15.2:44628) 2023-11-26T07:17:14.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.611+0000 7f406affd700 1 -- 172.21.15.2:0/3803354458 learned_addr learned my addr 172.21.15.2:0/3803354458 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:14.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.611+0000 7f406b7fe700 1 --2- 172.21.15.2:0/3803354458 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f406c06b620 0x7f406c1f7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:14.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.611+0000 7f406bfff700 1 --2- 172.21.15.2:0/3803354458 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f406c0b5ab0 0x7f406c1e8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:14.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.611+0000 7f406affd700 1 -- 172.21.15.2:0/3803354458 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f406c06b620 msgr2=0x7f406c1f7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:14.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.611+0000 7f406affd700 1 --2- 172.21.15.2:0/3803354458 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f406c06b620 0x7f406c1f7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:14.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.611+0000 7f406affd700 1 -- 172.21.15.2:0/3803354458 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f406c0b5ab0 msgr2=0x7f406c1e8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:14.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.611+0000 7f406affd700 1 --2- 172.21.15.2:0/3803354458 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f406c0b5ab0 0x7f406c1e8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:14.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.611+0000 7f406affd700 1 -- 172.21.15.2:0/3803354458 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4064009a70 con 0x7f406c0b4150 2023-11-26T07:17:14.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.611+0000 7f406bfff700 1 --2- 172.21.15.2:0/3803354458 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f406c0b5ab0 0x7f406c1e8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:14.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.611+0000 7f406affd700 1 --2- 172.21.15.2:0/3803354458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f406c0b4150 0x7f406c1e7cd0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f405c00c750 tx=0x7f405c00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:14.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.612+0000 7f4063fff700 1 -- 172.21.15.2:0/3803354458 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405c007560 con 0x7f406c0b4150 2023-11-26T07:17:14.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.612+0000 7f4063fff700 1 -- 172.21.15.2:0/3803354458 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f405c0076c0 con 0x7f406c0b4150 2023-11-26T07:17:14.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.612+0000 7f4072098700 1 -- 172.21.15.2:0/3803354458 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f406c0c9d20 con 0x7f406c0b4150 2023-11-26T07:17:14.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.612+0000 7f4063fff700 1 -- 172.21.15.2:0/3803354458 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405c004ab0 con 0x7f406c0b4150 2023-11-26T07:17:14.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.612+0000 7f4072098700 1 -- 172.21.15.2:0/3803354458 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f406c0c9a40 con 0x7f406c0b4150 2023-11-26T07:17:14.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.613+0000 7f4072098700 1 -- 172.21.15.2:0/3803354458 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f406c144c10 con 0x7f406c0b4150 2023-11-26T07:17:14.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.613+0000 7f4063fff700 1 -- 172.21.15.2:0/3803354458 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) v1 ==== 90047+0+0 (secure 0 0 0) 0x7f405c004c10 con 0x7f406c0b4150 2023-11-26T07:17:14.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.614+0000 7f4063fff700 1 --2- 172.21.15.2:0/3803354458 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f404c06b7d0 0x7f404c06dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:14.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.614+0000 7f4063fff700 1 -- 172.21.15.2:0/3803354458 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f405c087cc0 con 0x7f406c0b4150 2023-11-26T07:17:14.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.614+0000 7f406b7fe700 1 --2- 172.21.15.2:0/3803354458 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f404c06b7d0 0x7f404c06dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:14.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.614+0000 7f406b7fe700 1 --2- 172.21.15.2:0/3803354458 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f404c06b7d0 0x7f404c06dc90 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f40540011e0 tx=0x7f4054009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:14.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.618+0000 7f4063fff700 1 -- 172.21.15.2:0/3803354458 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f405c0547a0 con 0x7f406c0b4150 2023-11-26T07:17:14.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.865+0000 7f4072098700 1 -- 172.21.15.2:0/3803354458 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone33480", "target": ["mon-mgr", ""]}) v1 -- 0x7f406c06ba00 con 0x7f404c06b7d0 2023-11-26T07:17:14.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.873+0000 7f4063fff700 1 -- 172.21.15.2:0/3803354458 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+165 (secure 0 0 0) 0x7f40540013f0 con 0x7f404c06b7d0 2023-11-26T07:17:14.875 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-26T07:17:14.875 INFO:teuthology.orchestra.run.smithi002.stdout: "status": { 2023-11-26T07:17:14.875 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "pending", 2023-11-26T07:17:14.875 INFO:teuthology.orchestra.run.smithi002.stdout: "source": { 2023-11-26T07:17:14.875 INFO:teuthology.orchestra.run.smithi002.stdout: "volume": "cephfs", 2023-11-26T07:17:14.875 INFO:teuthology.orchestra.run.smithi002.stdout: "subvolume": "subvol83060", 2023-11-26T07:17:14.875 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot": "subvol_snap31270" 2023-11-26T07:17:14.875 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:17:14.875 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:17:14.875 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-26T07:17:14.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.875+0000 7f4072098700 1 -- 172.21.15.2:0/3803354458 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f404c06b7d0 msgr2=0x7f404c06dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:14.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.875+0000 7f4072098700 1 --2- 172.21.15.2:0/3803354458 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f404c06b7d0 0x7f404c06dc90 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f40540011e0 tx=0x7f4054009040 comp rx=0 tx=0).stop 2023-11-26T07:17:14.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.875+0000 7f4072098700 1 -- 172.21.15.2:0/3803354458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f406c0b4150 msgr2=0x7f406c1e7cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:14.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.875+0000 7f4072098700 1 --2- 172.21.15.2:0/3803354458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f406c0b4150 0x7f406c1e7cd0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f405c00c750 tx=0x7f405c00cb10 comp rx=0 tx=0).stop 2023-11-26T07:17:14.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.875+0000 7f4072098700 1 -- 172.21.15.2:0/3803354458 shutdown_connections 2023-11-26T07:17:14.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.875+0000 7f4072098700 1 --2- 172.21.15.2:0/3803354458 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f404c06b7d0 0x7f404c06dc90 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:14.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.875+0000 7f4072098700 1 --2- 172.21.15.2:0/3803354458 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f406c0b5ab0 0x7f406c1e8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:14.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.875+0000 7f4072098700 1 --2- 172.21.15.2:0/3803354458 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f406c06b620 0x7f406c1f7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:14.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.875+0000 7f4072098700 1 --2- 172.21.15.2:0/3803354458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f406c0b4150 0x7f406c1e7cd0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:14.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.875+0000 7f4072098700 1 -- 172.21.15.2:0/3803354458 >> 172.21.15.2:0/3803354458 conn(0x7f406c0b2740 msgr2=0x7f406c0b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:14.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.875+0000 7f4072098700 1 -- 172.21.15.2:0/3803354458 shutdown_connections 2023-11-26T07:17:14.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:14.875+0000 7f4072098700 1 -- 172.21.15.2:0/3803354458 wait complete. 2023-11-26T07:17:14.889 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone33480 2023-11-26T07:17:15.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.017+0000 7f8a99d98700 1 Processor -- start 2023-11-26T07:17:15.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.017+0000 7f8a99d98700 1 -- start start 2023-11-26T07:17:15.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.017+0000 7f8a99d98700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8a940d0220 0x7f8a940cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:15.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.017+0000 7f8a99d98700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8a940b56d0 0x7f8a940b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:15.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.017+0000 7f8a99d98700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a940d06d0 con 0x7f8a9415f570 2023-11-26T07:17:15.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.017+0000 7f8a99d98700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a940b4c30 con 0x7f8a940b56d0 2023-11-26T07:17:15.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.017+0000 7f8a99d98700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a940cdbc0 con 0x7f8a940d0220 2023-11-26T07:17:15.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.018+0000 7f8a93fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8a940b56d0 0x7f8a940b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:15.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.018+0000 7f8a93fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8a940b56d0 0x7f8a940b5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44638/0 (socket says 172.21.15.2:44638) 2023-11-26T07:17:15.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.018+0000 7f8a93fff700 1 -- 172.21.15.2:0/3637533010 learned_addr learned my addr 172.21.15.2:0/3637533010 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:15.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.018+0000 7f8a92ffd700 1 --2- 172.21.15.2:0/3637533010 >> v2:172.21.15.192:3300/0 conn(0x7f8a940d0220 0x7f8a940cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:15.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.018+0000 7f8a93fff700 1 -- 172.21.15.2:0/3637533010 >> v2:172.21.15.192:3300/0 conn(0x7f8a940d0220 msgr2=0x7f8a940cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:15.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.018+0000 7f8a93fff700 1 --2- 172.21.15.2:0/3637533010 >> v2:172.21.15.192:3300/0 conn(0x7f8a940d0220 0x7f8a940cebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:15.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.018+0000 7f8a93fff700 1 -- 172.21.15.2:0/3637533010 >> v1:172.21.15.192:6789/0 conn(0x7f8a9415f570 legacy=0x7f8a940ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:15.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.018+0000 7f8a93fff700 1 -- 172.21.15.2:0/3637533010 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a940d0950 con 0x7f8a940b56d0 2023-11-26T07:17:15.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.018+0000 7f8a92ffd700 1 --2- 172.21.15.2:0/3637533010 >> v2:172.21.15.192:3300/0 conn(0x7f8a940d0220 0x7f8a940cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:15.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.018+0000 7f8a93fff700 1 --2- 172.21.15.2:0/3637533010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a940b56d0 0x7f8a940b5ae0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f8a94071ec0 tx=0x7f8a8c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5c39a9ca2ac94f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:15.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.018+0000 7f8a927fc700 1 -- 172.21.15.2:0/3637533010 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c00e070 con 0x7f8a940b56d0 2023-11-26T07:17:15.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.018+0000 7f8a927fc700 1 -- 172.21.15.2:0/3637533010 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a8c00b9c0 con 0x7f8a940b56d0 2023-11-26T07:17:15.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.018+0000 7f8a927fc700 1 -- 172.21.15.2:0/3637533010 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c00bd70 con 0x7f8a940b56d0 2023-11-26T07:17:15.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.019+0000 7f8a99d98700 1 -- 172.21.15.2:0/3637533010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a940b56d0 msgr2=0x7f8a940b5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:15.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.019+0000 7f8a99d98700 1 --2- 172.21.15.2:0/3637533010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a940b56d0 0x7f8a940b5ae0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f8a94071ec0 tx=0x7f8a8c00b330 comp rx=0 tx=0).stop 2023-11-26T07:17:15.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.019+0000 7f8a99d98700 1 -- 172.21.15.2:0/3637533010 shutdown_connections 2023-11-26T07:17:15.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.019+0000 7f8a99d98700 1 --2- 172.21.15.2:0/3637533010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a940b56d0 0x7f8a940b5ae0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:15.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.019+0000 7f8a99d98700 1 --2- 172.21.15.2:0/3637533010 >> v2:172.21.15.192:3300/0 conn(0x7f8a940d0220 0x7f8a940cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:15.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.019+0000 7f8a99d98700 1 -- 172.21.15.2:0/3637533010 >> 172.21.15.2:0/3637533010 conn(0x7f8a940b3800 msgr2=0x7f8a940b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:15.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.019+0000 7f8a99d98700 1 -- 172.21.15.2:0/3637533010 shutdown_connections 2023-11-26T07:17:15.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.019+0000 7f8a99d98700 1 -- 172.21.15.2:0/3637533010 wait complete. 2023-11-26T07:17:15.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.020+0000 7f8a99d98700 1 Processor -- start 2023-11-26T07:17:15.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.020+0000 7f8a99d98700 1 -- start start 2023-11-26T07:17:15.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.021+0000 7f8a99d98700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a940b56d0 0x7f8a941f2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:15.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.021+0000 7f8a99d98700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a940d0220 0x7f8a940c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:15.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.021+0000 7f8a99d98700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a9415f570 0x7f8a940c9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:15.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.021+0000 7f8a99d98700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a940c5da0 con 0x7f8a940d0220 2023-11-26T07:17:15.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.021+0000 7f8a99d98700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a941f2840 con 0x7f8a9415f570 2023-11-26T07:17:15.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.021+0000 7f8a99d98700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a940cb0d0 con 0x7f8a940b56d0 2023-11-26T07:17:15.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.021+0000 7f8a92ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a940d0220 0x7f8a940c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:15.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.021+0000 7f8a92ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a940d0220 0x7f8a940c8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44642/0 (socket says 172.21.15.2:44642) 2023-11-26T07:17:15.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.021+0000 7f8a92ffd700 1 -- 172.21.15.2:0/1560966722 learned_addr learned my addr 172.21.15.2:0/1560966722 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:15.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.021+0000 7f8a937fe700 1 --2- 172.21.15.2:0/1560966722 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a940b56d0 0x7f8a941f2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:15.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.021+0000 7f8a93fff700 1 --2- 172.21.15.2:0/1560966722 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a9415f570 0x7f8a940c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:15.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.021+0000 7f8a92ffd700 1 -- 172.21.15.2:0/1560966722 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a940b56d0 msgr2=0x7f8a941f2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:15.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.021+0000 7f8a92ffd700 1 --2- 172.21.15.2:0/1560966722 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a940b56d0 0x7f8a941f2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:15.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.021+0000 7f8a92ffd700 1 -- 172.21.15.2:0/1560966722 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a9415f570 msgr2=0x7f8a940c9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:15.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.021+0000 7f8a92ffd700 1 --2- 172.21.15.2:0/1560966722 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a9415f570 0x7f8a940c9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:15.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.021+0000 7f8a92ffd700 1 -- 172.21.15.2:0/1560966722 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a8c009b30 con 0x7f8a940d0220 2023-11-26T07:17:15.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.022+0000 7f8a92ffd700 1 --2- 172.21.15.2:0/1560966722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a940d0220 0x7f8a940c8d40 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f8a8800e810 tx=0x7f8a8800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:15.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.022+0000 7f8a7bfff700 1 -- 172.21.15.2:0/1560966722 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8800c070 con 0x7f8a940d0220 2023-11-26T07:17:15.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.022+0000 7f8a7bfff700 1 -- 172.21.15.2:0/1560966722 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a88004230 con 0x7f8a940d0220 2023-11-26T07:17:15.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.022+0000 7f8a7bfff700 1 -- 172.21.15.2:0/1560966722 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a880036a0 con 0x7f8a940d0220 2023-11-26T07:17:15.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.022+0000 7f8a99d98700 1 -- 172.21.15.2:0/1560966722 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a940cab50 con 0x7f8a940d0220 2023-11-26T07:17:15.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.022+0000 7f8a99d98700 1 -- 172.21.15.2:0/1560966722 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a940cadf0 con 0x7f8a940d0220 2023-11-26T07:17:15.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.023+0000 7f8a99d98700 1 -- 172.21.15.2:0/1560966722 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a94075480 con 0x7f8a940d0220 2023-11-26T07:17:15.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.023+0000 7f8a7bfff700 1 -- 172.21.15.2:0/1560966722 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) v1 ==== 90098+0+0 (secure 0 0 0) 0x7f8a88003800 con 0x7f8a940d0220 2023-11-26T07:17:15.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.024+0000 7f8a7bfff700 1 --2- 172.21.15.2:0/1560966722 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8a8006b860 0x7f8a8006dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:15.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.024+0000 7f8a7bfff700 1 -- 172.21.15.2:0/1560966722 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a88087d10 con 0x7f8a940d0220 2023-11-26T07:17:15.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.024+0000 7f8a937fe700 1 --2- 172.21.15.2:0/1560966722 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8a8006b860 0x7f8a8006dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:15.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.024+0000 7f8a937fe700 1 --2- 172.21.15.2:0/1560966722 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8a8006b860 0x7f8a8006dd20 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8a940cbde0 tx=0x7f8a84009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:15.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.028+0000 7f8a7bfff700 1 -- 172.21.15.2:0/1560966722 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8a88054670 con 0x7f8a940d0220 2023-11-26T07:17:15.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.271+0000 7f8a99d98700 1 -- 172.21.15.2:0/1560966722 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone33480", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a940d0c30 con 0x7f8a8006b860 2023-11-26T07:17:15.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.280+0000 7f8a7bfff700 1 -- 172.21.15.2:0/1560966722 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+165 (secure 0 0 0) 0x7f8a840014e0 con 0x7f8a8006b860 2023-11-26T07:17:15.282 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-26T07:17:15.282 INFO:teuthology.orchestra.run.smithi002.stdout: "status": { 2023-11-26T07:17:15.282 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "pending", 2023-11-26T07:17:15.282 INFO:teuthology.orchestra.run.smithi002.stdout: "source": { 2023-11-26T07:17:15.282 INFO:teuthology.orchestra.run.smithi002.stdout: "volume": "cephfs", 2023-11-26T07:17:15.282 INFO:teuthology.orchestra.run.smithi002.stdout: "subvolume": "subvol83060", 2023-11-26T07:17:15.282 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot": "subvol_snap31270" 2023-11-26T07:17:15.282 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:17:15.282 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:17:15.282 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-26T07:17:15.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.281+0000 7f8a99d98700 1 -- 172.21.15.2:0/1560966722 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8a8006b860 msgr2=0x7f8a8006dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:15.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.281+0000 7f8a99d98700 1 --2- 172.21.15.2:0/1560966722 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8a8006b860 0x7f8a8006dd20 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8a940cbde0 tx=0x7f8a84009040 comp rx=0 tx=0).stop 2023-11-26T07:17:15.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.281+0000 7f8a99d98700 1 -- 172.21.15.2:0/1560966722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a940d0220 msgr2=0x7f8a940c8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:15.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.281+0000 7f8a99d98700 1 --2- 172.21.15.2:0/1560966722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a940d0220 0x7f8a940c8d40 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f8a8800e810 tx=0x7f8a8800eb20 comp rx=0 tx=0).stop 2023-11-26T07:17:15.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.282+0000 7f8a99d98700 1 -- 172.21.15.2:0/1560966722 shutdown_connections 2023-11-26T07:17:15.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.282+0000 7f8a99d98700 1 --2- 172.21.15.2:0/1560966722 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8a8006b860 0x7f8a8006dd20 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:15.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.282+0000 7f8a99d98700 1 --2- 172.21.15.2:0/1560966722 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a9415f570 0x7f8a940c9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:15.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.282+0000 7f8a99d98700 1 --2- 172.21.15.2:0/1560966722 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a940b56d0 0x7f8a941f2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:15.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.282+0000 7f8a99d98700 1 --2- 172.21.15.2:0/1560966722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a940d0220 0x7f8a940c8d40 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:15.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.282+0000 7f8a99d98700 1 -- 172.21.15.2:0/1560966722 >> 172.21.15.2:0/1560966722 conn(0x7f8a940b3800 msgr2=0x7f8a940705b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:15.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.282+0000 7f8a99d98700 1 -- 172.21.15.2:0/1560966722 shutdown_connections 2023-11-26T07:17:15.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:15.282+0000 7f8a99d98700 1 -- 172.21.15.2:0/1560966722 wait complete. 2023-11-26T07:17:16.297 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone33480 2023-11-26T07:17:16.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.436+0000 7fd30d168700 1 Processor -- start 2023-11-26T07:17:16.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.436+0000 7fd30d168700 1 -- start start 2023-11-26T07:17:16.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.437+0000 7fd30d168700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd30815e1c0 0x7fd30806eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:16.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.437+0000 7fd30d168700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd30806fc50 0x7fd30806ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:16.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.437+0000 7fd30d168700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3080d1230 con 0x7fd3080b0e90 2023-11-26T07:17:16.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.437+0000 7fd30d168700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3080d0c70 con 0x7fd30806fc50 2023-11-26T07:17:16.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.437+0000 7fd30d168700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3080d0f50 con 0x7fd30815e1c0 2023-11-26T07:17:16.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.437+0000 7fd30759e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd30806fc50 0x7fd30806ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:16.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.437+0000 7fd30659c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd3080b0e90 0x7fd30806f540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35858/0 (socket says 172.21.15.2:35858) 2023-11-26T07:17:16.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.437+0000 7fd30659c700 1 -- 172.21.15.2:0/2847548701 learned_addr learned my addr 172.21.15.2:0/2847548701 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:16.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.437+0000 7fd306d9d700 1 --2- 172.21.15.2:0/2847548701 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd30815e1c0 0x7fd30806eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:16.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.437+0000 7fd30759e700 1 -- 172.21.15.2:0/2847548701 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd30815e1c0 msgr2=0x7fd30806eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:16.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.437+0000 7fd30759e700 1 --2- 172.21.15.2:0/2847548701 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd30815e1c0 0x7fd30806eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:16.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.437+0000 7fd305d9b700 1 -- 172.21.15.2:0/2847548701 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 875564683 0 0) 0x7fd3080d1230 con 0x7fd3080b0e90 2023-11-26T07:17:16.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.437+0000 7fd30759e700 1 -- 172.21.15.2:0/2847548701 >> v1:172.21.15.2:6789/0 conn(0x7fd3080b0e90 legacy=0x7fd30806f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:16.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.437+0000 7fd30759e700 1 -- 172.21.15.2:0/2847548701 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd30806c210 con 0x7fd30806fc50 2023-11-26T07:17:16.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.437+0000 7fd306d9d700 1 --2- 172.21.15.2:0/2847548701 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd30815e1c0 0x7fd30806eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:16.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.438+0000 7fd30759e700 1 --2- 172.21.15.2:0/2847548701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd30806fc50 0x7fd30806ca10 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fd300009d90 tx=0x7fd30000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f9f840f84b12130 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:16.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.438+0000 7fd305d9b700 1 -- 172.21.15.2:0/2847548701 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30000e070 con 0x7fd30806fc50 2023-11-26T07:17:16.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.438+0000 7fd305d9b700 1 -- 172.21.15.2:0/2847548701 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30000bbd0 con 0x7fd30806fc50 2023-11-26T07:17:16.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.438+0000 7fd305d9b700 1 -- 172.21.15.2:0/2847548701 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd300012430 con 0x7fd30806fc50 2023-11-26T07:17:16.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.438+0000 7fd30d168700 1 -- 172.21.15.2:0/2847548701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd30806fc50 msgr2=0x7fd30806ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:16.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.438+0000 7fd30d168700 1 --2- 172.21.15.2:0/2847548701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd30806fc50 0x7fd30806ca10 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fd300009d90 tx=0x7fd30000b330 comp rx=0 tx=0).stop 2023-11-26T07:17:16.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.438+0000 7fd30d168700 1 -- 172.21.15.2:0/2847548701 shutdown_connections 2023-11-26T07:17:16.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.438+0000 7fd30d168700 1 --2- 172.21.15.2:0/2847548701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd30806fc50 0x7fd30806ca10 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:16.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.438+0000 7fd30d168700 1 --2- 172.21.15.2:0/2847548701 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd30815e1c0 0x7fd30806eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:16.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.438+0000 7fd30d168700 1 -- 172.21.15.2:0/2847548701 >> 172.21.15.2:0/2847548701 conn(0x7fd3080b3720 msgr2=0x7fd3080b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:16.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.438+0000 7fd30d168700 1 -- 172.21.15.2:0/2847548701 shutdown_connections 2023-11-26T07:17:16.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.438+0000 7fd30d168700 1 -- 172.21.15.2:0/2847548701 wait complete. 2023-11-26T07:17:16.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.440+0000 7fd30d168700 1 Processor -- start 2023-11-26T07:17:16.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.440+0000 7fd30d168700 1 -- start start 2023-11-26T07:17:16.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.441+0000 7fd30d168700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd30806fc50 0x7fd30809cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:16.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.441+0000 7fd30d168700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3080b0e90 0x7fd308156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:16.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.441+0000 7fd30d168700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd30815e1c0 0x7fd3080cff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:16.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.441+0000 7fd30d168700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3080d04a0 con 0x7fd3080b0e90 2023-11-26T07:17:16.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.441+0000 7fd30d168700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd30815eae0 con 0x7fd30815e1c0 2023-11-26T07:17:16.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.441+0000 7fd30d168700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd30815edc0 con 0x7fd30806fc50 2023-11-26T07:17:16.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.441+0000 7fd30659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3080b0e90 0x7fd308156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:16.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.441+0000 7fd30659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3080b0e90 0x7fd308156a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44656/0 (socket says 172.21.15.2:44656) 2023-11-26T07:17:16.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.441+0000 7fd30659c700 1 -- 172.21.15.2:0/2376574691 learned_addr learned my addr 172.21.15.2:0/2376574691 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:16.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.441+0000 7fd306d9d700 1 --2- 172.21.15.2:0/2376574691 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd30806fc50 0x7fd30809cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:16.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.441+0000 7fd30759e700 1 --2- 172.21.15.2:0/2376574691 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd30815e1c0 0x7fd3080cff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:16.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.441+0000 7fd30659c700 1 -- 172.21.15.2:0/2376574691 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd30806fc50 msgr2=0x7fd30809cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:16.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.441+0000 7fd30659c700 1 --2- 172.21.15.2:0/2376574691 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd30806fc50 0x7fd30809cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:16.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.441+0000 7fd30659c700 1 -- 172.21.15.2:0/2376574691 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd30815e1c0 msgr2=0x7fd3080cff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:16.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.441+0000 7fd30659c700 1 --2- 172.21.15.2:0/2376574691 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd30815e1c0 0x7fd3080cff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:16.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.441+0000 7fd30659c700 1 -- 172.21.15.2:0/2376574691 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd300009a70 con 0x7fd3080b0e90 2023-11-26T07:17:16.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.441+0000 7fd30659c700 1 --2- 172.21.15.2:0/2376574691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3080b0e90 0x7fd308156a40 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fd2f80011e0 tx=0x7fd2f800cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:16.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.441+0000 7fd2ef7fe700 1 -- 172.21.15.2:0/2376574691 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f8004c80 con 0x7fd3080b0e90 2023-11-26T07:17:16.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.442+0000 7fd2ef7fe700 1 -- 172.21.15.2:0/2376574691 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f8004e00 con 0x7fd3080b0e90 2023-11-26T07:17:16.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.442+0000 7fd2ef7fe700 1 -- 172.21.15.2:0/2376574691 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f8007310 con 0x7fd3080b0e90 2023-11-26T07:17:16.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.442+0000 7fd30d168700 1 -- 172.21.15.2:0/2376574691 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd30815f0a0 con 0x7fd3080b0e90 2023-11-26T07:17:16.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.442+0000 7fd30d168700 1 -- 172.21.15.2:0/2376574691 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd30815f660 con 0x7fd3080b0e90 2023-11-26T07:17:16.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.443+0000 7fd30d168700 1 -- 172.21.15.2:0/2376574691 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd30815f9d0 con 0x7fd3080b0e90 2023-11-26T07:17:16.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.443+0000 7fd2ef7fe700 1 -- 172.21.15.2:0/2376574691 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) v1 ==== 90098+0+0 (secure 0 0 0) 0x7fd2f8007470 con 0x7fd3080b0e90 2023-11-26T07:17:16.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.443+0000 7fd2ef7fe700 1 --2- 172.21.15.2:0/2376574691 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd2f406b860 0x7fd2f406dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:16.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.444+0000 7fd2ef7fe700 1 -- 172.21.15.2:0/2376574691 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd2f8087ed0 con 0x7fd3080b0e90 2023-11-26T07:17:16.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.444+0000 7fd306d9d700 1 --2- 172.21.15.2:0/2376574691 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd2f406b860 0x7fd2f406dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:16.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.444+0000 7fd306d9d700 1 --2- 172.21.15.2:0/2376574691 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd2f406b860 0x7fd2f406dd20 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc006fd0 tx=0x7fd2fc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:16.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.448+0000 7fd2ef7fe700 1 -- 172.21.15.2:0/2376574691 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd2f8054830 con 0x7fd3080b0e90 2023-11-26T07:17:16.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.694+0000 7fd30d168700 1 -- 172.21.15.2:0/2376574691 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone33480", "target": ["mon-mgr", ""]}) v1 -- 0x7fd30815ef30 con 0x7fd2f406b860 2023-11-26T07:17:16.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.703+0000 7fd2ef7fe700 1 -- 172.21.15.2:0/2376574691 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+165 (secure 0 0 0) 0x7fd30815ef30 con 0x7fd2f406b860 2023-11-26T07:17:16.706 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-26T07:17:16.706 INFO:teuthology.orchestra.run.smithi002.stdout: "status": { 2023-11-26T07:17:16.706 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "pending", 2023-11-26T07:17:16.706 INFO:teuthology.orchestra.run.smithi002.stdout: "source": { 2023-11-26T07:17:16.706 INFO:teuthology.orchestra.run.smithi002.stdout: "volume": "cephfs", 2023-11-26T07:17:16.706 INFO:teuthology.orchestra.run.smithi002.stdout: "subvolume": "subvol83060", 2023-11-26T07:17:16.706 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot": "subvol_snap31270" 2023-11-26T07:17:16.706 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:17:16.706 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:17:16.706 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-26T07:17:16.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.705+0000 7fd30d168700 1 -- 172.21.15.2:0/2376574691 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd2f406b860 msgr2=0x7fd2f406dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:16.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.705+0000 7fd30d168700 1 --2- 172.21.15.2:0/2376574691 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd2f406b860 0x7fd2f406dd20 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc006fd0 tx=0x7fd2fc008040 comp rx=0 tx=0).stop 2023-11-26T07:17:16.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.705+0000 7fd30d168700 1 -- 172.21.15.2:0/2376574691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3080b0e90 msgr2=0x7fd308156a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:16.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.705+0000 7fd30d168700 1 --2- 172.21.15.2:0/2376574691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3080b0e90 0x7fd308156a40 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fd2f80011e0 tx=0x7fd2f800cae0 comp rx=0 tx=0).stop 2023-11-26T07:17:16.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.705+0000 7fd30d168700 1 -- 172.21.15.2:0/2376574691 shutdown_connections 2023-11-26T07:17:16.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.705+0000 7fd30d168700 1 --2- 172.21.15.2:0/2376574691 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd2f406b860 0x7fd2f406dd20 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:16.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.705+0000 7fd30d168700 1 --2- 172.21.15.2:0/2376574691 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd30815e1c0 0x7fd3080cff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:16.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.705+0000 7fd30d168700 1 --2- 172.21.15.2:0/2376574691 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd30806fc50 0x7fd30809cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:16.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.705+0000 7fd30d168700 1 --2- 172.21.15.2:0/2376574691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3080b0e90 0x7fd308156a40 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:16.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.705+0000 7fd30d168700 1 -- 172.21.15.2:0/2376574691 >> 172.21.15.2:0/2376574691 conn(0x7fd3080b3720 msgr2=0x7fd30815d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:16.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.705+0000 7fd30d168700 1 -- 172.21.15.2:0/2376574691 shutdown_connections 2023-11-26T07:17:16.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:16.705+0000 7fd30d168700 1 -- 172.21.15.2:0/2376574691 wait complete. 2023-11-26T07:17:17.721 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone33480 2023-11-26T07:17:17.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.859+0000 7f7b78be6700 1 Processor -- start 2023-11-26T07:17:17.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.859+0000 7f7b78be6700 1 -- start start 2023-11-26T07:17:17.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.860+0000 7f7b78be6700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7b740b21d0 0x7f7b740b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:17.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.860+0000 7f7b78be6700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b7406caf0 con 0x7f7b740b28a0 2023-11-26T07:17:17.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.860+0000 7f7b78be6700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b740cf250 con 0x7f7b740d0ff0 2023-11-26T07:17:17.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.860+0000 7f7b78be6700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b7406cdb0 con 0x7f7b740b21d0 2023-11-26T07:17:17.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.860+0000 7f7b7259c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7b740b21d0 0x7f7b740b2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:17.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.860+0000 7f7b71d9b700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7b740b28a0 0x7f7b740ce4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35874/0 (socket says 172.21.15.2:35874) 2023-11-26T07:17:17.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.861+0000 7f7b71d9b700 1 -- 172.21.15.2:0/2260937930 learned_addr learned my addr 172.21.15.2:0/2260937930 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:17.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.861+0000 7f7b7159a700 1 -- 172.21.15.2:0/2260937930 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 445421947 0 0) 0x7f7b7406caf0 con 0x7f7b740b28a0 2023-11-26T07:17:17.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.861+0000 7f7b7159a700 1 -- 172.21.15.2:0/2260937930 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b5c0035b0 con 0x7f7b740b28a0 2023-11-26T07:17:17.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.861+0000 7f7b7259c700 1 -- 172.21.15.2:0/2260937930 >> v1:172.21.15.192:6789/0 conn(0x7f7b740d0ff0 legacy=0x7f7b740cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:17.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.861+0000 7f7b7259c700 1 -- 172.21.15.2:0/2260937930 >> v1:172.21.15.2:6789/0 conn(0x7f7b740b28a0 legacy=0x7f7b740ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:17.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.861+0000 7f7b7259c700 1 -- 172.21.15.2:0/2260937930 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b7406d090 con 0x7f7b740b21d0 2023-11-26T07:17:17.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.861+0000 7f7b7259c700 1 --2- 172.21.15.2:0/2260937930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b740b21d0 0x7f7b740b2dd0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f7b68009840 tx=0x7f7b68009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d6989f2621b5432 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:17.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.861+0000 7f7b7159a700 1 -- 172.21.15.2:0/2260937930 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b68011830 con 0x7f7b740b21d0 2023-11-26T07:17:17.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.861+0000 7f7b7159a700 1 -- 172.21.15.2:0/2260937930 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b68011990 con 0x7f7b740b21d0 2023-11-26T07:17:17.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.861+0000 7f7b7159a700 1 -- 172.21.15.2:0/2260937930 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b68011d20 con 0x7f7b740b21d0 2023-11-26T07:17:17.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.862+0000 7f7b78be6700 1 -- 172.21.15.2:0/2260937930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b740b21d0 msgr2=0x7f7b740b2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:17.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.862+0000 7f7b78be6700 1 --2- 172.21.15.2:0/2260937930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b740b21d0 0x7f7b740b2dd0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f7b68009840 tx=0x7f7b68009b50 comp rx=0 tx=0).stop 2023-11-26T07:17:17.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.862+0000 7f7b78be6700 1 -- 172.21.15.2:0/2260937930 shutdown_connections 2023-11-26T07:17:17.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.862+0000 7f7b78be6700 1 --2- 172.21.15.2:0/2260937930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b740b21d0 0x7f7b740b2dd0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:17.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.862+0000 7f7b78be6700 1 -- 172.21.15.2:0/2260937930 >> 172.21.15.2:0/2260937930 conn(0x7f7b740b3800 msgr2=0x7f7b740b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:17.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.862+0000 7f7b78be6700 1 -- 172.21.15.2:0/2260937930 shutdown_connections 2023-11-26T07:17:17.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.862+0000 7f7b78be6700 1 -- 172.21.15.2:0/2260937930 wait complete. 2023-11-26T07:17:17.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.863+0000 7f7b78be6700 1 Processor -- start 2023-11-26T07:17:17.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.863+0000 7f7b78be6700 1 -- start start 2023-11-26T07:17:17.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.864+0000 7f7b78be6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b740b21d0 0x7f7b740b5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:17.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.864+0000 7f7b78be6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b740d0ff0 0x7f7b74151a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:17.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.864+0000 7f7b78be6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b740b7080 0x7f7b740cd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:17.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.864+0000 7f7b78be6700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b74151f80 con 0x7f7b740d0ff0 2023-11-26T07:17:17.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.864+0000 7f7b78be6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b740b5fe0 con 0x7f7b740b21d0 2023-11-26T07:17:17.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.864+0000 7f7b78be6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b740b62c0 con 0x7f7b740b7080 2023-11-26T07:17:17.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.864+0000 7f7b71d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b740d0ff0 0x7f7b74151a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:17.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.864+0000 7f7b71d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b740d0ff0 0x7f7b74151a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44670/0 (socket says 172.21.15.2:44670) 2023-11-26T07:17:17.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.864+0000 7f7b71d9b700 1 -- 172.21.15.2:0/3182886395 learned_addr learned my addr 172.21.15.2:0/3182886395 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:17.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.864+0000 7f7b7259c700 1 --2- 172.21.15.2:0/3182886395 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b740b21d0 0x7f7b740b5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:17.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.864+0000 7f7b72d9d700 1 --2- 172.21.15.2:0/3182886395 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b740b7080 0x7f7b740cd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:17.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.864+0000 7f7b71d9b700 1 -- 172.21.15.2:0/3182886395 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b740b7080 msgr2=0x7f7b740cd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:17.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.864+0000 7f7b71d9b700 1 --2- 172.21.15.2:0/3182886395 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b740b7080 0x7f7b740cd1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:17.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.864+0000 7f7b71d9b700 1 -- 172.21.15.2:0/3182886395 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b740b21d0 msgr2=0x7f7b740b5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:17.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.864+0000 7f7b71d9b700 1 --2- 172.21.15.2:0/3182886395 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b740b21d0 0x7f7b740b5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:17.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.864+0000 7f7b71d9b700 1 -- 172.21.15.2:0/3182886395 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b680094a0 con 0x7f7b740d0ff0 2023-11-26T07:17:17.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.865+0000 7f7b71d9b700 1 --2- 172.21.15.2:0/3182886395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b740d0ff0 0x7f7b74151a40 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f7b6400c700 tx=0x7f7b6400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:17.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.865+0000 7f7b62ffd700 1 -- 172.21.15.2:0/3182886395 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b64005d70 con 0x7f7b740d0ff0 2023-11-26T07:17:17.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.865+0000 7f7b62ffd700 1 -- 172.21.15.2:0/3182886395 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b640070d0 con 0x7f7b740d0ff0 2023-11-26T07:17:17.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.865+0000 7f7b78be6700 1 -- 172.21.15.2:0/3182886395 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b740b65a0 con 0x7f7b740d0ff0 2023-11-26T07:17:17.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.865+0000 7f7b62ffd700 1 -- 172.21.15.2:0/3182886395 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b64007460 con 0x7f7b740d0ff0 2023-11-26T07:17:17.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.865+0000 7f7b78be6700 1 -- 172.21.15.2:0/3182886395 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b740b6b60 con 0x7f7b740d0ff0 2023-11-26T07:17:17.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.866+0000 7f7b78be6700 1 -- 172.21.15.2:0/3182886395 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b740b6cf0 con 0x7f7b740d0ff0 2023-11-26T07:17:17.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.866+0000 7f7b62ffd700 1 -- 172.21.15.2:0/3182886395 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f7b640075c0 con 0x7f7b740d0ff0 2023-11-26T07:17:17.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.867+0000 7f7b62ffd700 1 --2- 172.21.15.2:0/3182886395 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7b5406b980 0x7f7b5406de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:17.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.867+0000 7f7b62ffd700 1 -- 172.21.15.2:0/3182886395 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b64087790 con 0x7f7b740d0ff0 2023-11-26T07:17:17.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.867+0000 7f7b7259c700 1 --2- 172.21.15.2:0/3182886395 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7b5406b980 0x7f7b5406de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:17.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.867+0000 7f7b7259c700 1 --2- 172.21.15.2:0/3182886395 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7b5406b980 0x7f7b5406de40 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f7b680090b0 tx=0x7f7b68008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:17.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:17.871+0000 7f7b62ffd700 1 -- 172.21.15.2:0/3182886395 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7b64054040 con 0x7f7b740d0ff0 2023-11-26T07:17:18.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:18.116+0000 7f7b78be6700 1 -- 172.21.15.2:0/3182886395 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone33480", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b74075480 con 0x7f7b5406b980 2023-11-26T07:17:18.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:18.126+0000 7f7b62ffd700 1 -- 172.21.15.2:0/3182886395 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+165 (secure 0 0 0) 0x7f7b74075480 con 0x7f7b5406b980 2023-11-26T07:17:18.129 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-26T07:17:18.129 INFO:teuthology.orchestra.run.smithi002.stdout: "status": { 2023-11-26T07:17:18.129 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "pending", 2023-11-26T07:17:18.129 INFO:teuthology.orchestra.run.smithi002.stdout: "source": { 2023-11-26T07:17:18.129 INFO:teuthology.orchestra.run.smithi002.stdout: "volume": "cephfs", 2023-11-26T07:17:18.129 INFO:teuthology.orchestra.run.smithi002.stdout: "subvolume": "subvol83060", 2023-11-26T07:17:18.129 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot": "subvol_snap31270" 2023-11-26T07:17:18.129 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:17:18.129 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:17:18.129 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-26T07:17:18.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:18.128+0000 7f7b78be6700 1 -- 172.21.15.2:0/3182886395 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7b5406b980 msgr2=0x7f7b5406de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:18.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:18.128+0000 7f7b78be6700 1 --2- 172.21.15.2:0/3182886395 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7b5406b980 0x7f7b5406de40 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f7b680090b0 tx=0x7f7b68008030 comp rx=0 tx=0).stop 2023-11-26T07:17:18.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:18.128+0000 7f7b78be6700 1 -- 172.21.15.2:0/3182886395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b740d0ff0 msgr2=0x7f7b74151a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:18.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:18.128+0000 7f7b78be6700 1 --2- 172.21.15.2:0/3182886395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b740d0ff0 0x7f7b74151a40 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f7b6400c700 tx=0x7f7b6400cac0 comp rx=0 tx=0).stop 2023-11-26T07:17:18.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:18.128+0000 7f7b78be6700 1 -- 172.21.15.2:0/3182886395 shutdown_connections 2023-11-26T07:17:18.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:18.128+0000 7f7b78be6700 1 --2- 172.21.15.2:0/3182886395 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7b5406b980 0x7f7b5406de40 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:18.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:18.128+0000 7f7b78be6700 1 --2- 172.21.15.2:0/3182886395 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b740b7080 0x7f7b740cd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:18.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:18.128+0000 7f7b78be6700 1 --2- 172.21.15.2:0/3182886395 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b740b21d0 0x7f7b740b5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:18.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:18.128+0000 7f7b78be6700 1 --2- 172.21.15.2:0/3182886395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b740d0ff0 0x7f7b74151a40 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:18.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:18.128+0000 7f7b78be6700 1 -- 172.21.15.2:0/3182886395 >> 172.21.15.2:0/3182886395 conn(0x7f7b740b3800 msgr2=0x7f7b740b13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:18.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:18.128+0000 7f7b78be6700 1 -- 172.21.15.2:0/3182886395 shutdown_connections 2023-11-26T07:17:18.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:18.128+0000 7f7b78be6700 1 -- 172.21.15.2:0/3182886395 wait complete. 2023-11-26T07:17:19.144 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone33480 2023-11-26T07:17:19.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.284+0000 7f7c99e6d700 1 Processor -- start 2023-11-26T07:17:19.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.284+0000 7f7c99e6d700 1 -- start start 2023-11-26T07:17:19.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.285+0000 7f7c99e6d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7c940b5e40 0x7f7c9406b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:19.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.285+0000 7f7c99e6d700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c94158d80 con 0x7f7c94072e20 2023-11-26T07:17:19.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.285+0000 7f7c99e6d700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c9415c120 con 0x7f7c941589a0 2023-11-26T07:17:19.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.285+0000 7f7c99e6d700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c9415b300 con 0x7f7c940b5e40 2023-11-26T07:17:19.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.285+0000 7f7c92ffd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7c94072e20 0x7f7c9406b0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35888/0 (socket says 172.21.15.2:35888) 2023-11-26T07:17:19.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.285+0000 7f7c92ffd700 1 -- 172.21.15.2:0/930700645 learned_addr learned my addr 172.21.15.2:0/930700645 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:19.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.286+0000 7f7c927fc700 1 -- 172.21.15.2:0/930700645 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2942197611 0 0) 0x7f7c7c001110 con 0x7f7c94072e20 2023-11-26T07:17:19.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.286+0000 7f7c927fc700 1 -- 172.21.15.2:0/930700645 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c800035b0 con 0x7f7c94072e20 2023-11-26T07:17:19.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.286+0000 7f7c93fff700 1 --2- 172.21.15.2:0/930700645 >> v2:172.21.15.192:3300/0 conn(0x7f7c940b5e40 0x7f7c9406b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:19.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.286+0000 7f7c927fc700 1 -- 172.21.15.2:0/930700645 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 512167034 0 0) 0x7f7c800035b0 con 0x7f7c94072e20 2023-11-26T07:17:19.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.286+0000 7f7c927fc700 1 -- 172.21.15.2:0/930700645 >> v2:172.21.15.192:3300/0 conn(0x7f7c940b5e40 msgr2=0x7f7c9406b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:19.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.286+0000 7f7c927fc700 1 --2- 172.21.15.2:0/930700645 >> v2:172.21.15.192:3300/0 conn(0x7f7c940b5e40 0x7f7c9406b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:19.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.286+0000 7f7c927fc700 1 -- 172.21.15.2:0/930700645 >> v1:172.21.15.192:6789/0 conn(0x7f7c941589a0 legacy=0x7f7c94072710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:19.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.286+0000 7f7c927fc700 1 -- 172.21.15.2:0/930700645 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c9415b510 con 0x7f7c94072e20 2023-11-26T07:17:19.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.286+0000 7f7c927fc700 1 -- 172.21.15.2:0/930700645 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f7c7c001800 con 0x7f7c94072e20 2023-11-26T07:17:19.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.286+0000 7f7c927fc700 1 -- 172.21.15.2:0/930700645 >> v1:172.21.15.2:6789/0 conn(0x7f7c94072e20 legacy=0x7f7c9406b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:19.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.286+0000 7f7c927fc700 1 --2- 172.21.15.2:0/930700645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c80003a00 0x7f7c80003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:19.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.286+0000 7f7c927fc700 1 --2- 172.21.15.2:0/930700645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c80004400 0x7f7c800048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:19.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.286+0000 7f7c927fc700 1 --2- 172.21.15.2:0/930700645 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c80005170 0x7f7c8000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:19.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.286+0000 7f7c927fc700 1 -- 172.21.15.2:0/930700645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9415b300 con 0x7f7c80003a00 2023-11-26T07:17:19.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.286+0000 7f7c927fc700 1 -- 172.21.15.2:0/930700645 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8000c0b0 con 0x7f7c80004400 2023-11-26T07:17:19.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.286+0000 7f7c927fc700 1 -- 172.21.15.2:0/930700645 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8000c270 con 0x7f7c80005170 2023-11-26T07:17:19.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.286+0000 7f7c937fe700 1 --2- 172.21.15.2:0/930700645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c80003a00 0x7f7c80003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:19.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.286+0000 7f7c92ffd700 1 --2- 172.21.15.2:0/930700645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c80004400 0x7f7c800048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:19.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.286+0000 7f7c93fff700 1 --2- 172.21.15.2:0/930700645 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c80005170 0x7f7c8000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:19.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.286+0000 7f7c937fe700 1 -- 172.21.15.2:0/930700645 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c80005170 msgr2=0x7f7c8000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:19.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.286+0000 7f7c937fe700 1 --2- 172.21.15.2:0/930700645 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c80005170 0x7f7c8000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:19.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.287+0000 7f7c937fe700 1 -- 172.21.15.2:0/930700645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c80004400 msgr2=0x7f7c800048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:19.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.287+0000 7f7c937fe700 1 --2- 172.21.15.2:0/930700645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c80004400 0x7f7c800048d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:19.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.287+0000 7f7c937fe700 1 -- 172.21.15.2:0/930700645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c800035b0 con 0x7f7c80003a00 2023-11-26T07:17:19.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.287+0000 7f7c93fff700 1 --2- 172.21.15.2:0/930700645 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c80005170 0x7f7c8000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:19.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.287+0000 7f7c93fff700 1 -- 172.21.15.2:0/930700645 reap_dead start 2023-11-26T07:17:19.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.287+0000 7f7c937fe700 1 --2- 172.21.15.2:0/930700645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c80003a00 0x7f7c80003de0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f7c840018d0 tx=0x7f7c80005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1513683f05f4b67b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:19.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.287+0000 7f7c927fc700 1 -- 172.21.15.2:0/930700645 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c840052d0 con 0x7f7c80003a00 2023-11-26T07:17:19.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.287+0000 7f7c927fc700 1 -- 172.21.15.2:0/930700645 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c84005430 con 0x7f7c80003a00 2023-11-26T07:17:19.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.287+0000 7f7c927fc700 1 -- 172.21.15.2:0/930700645 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c840038c0 con 0x7f7c80003a00 2023-11-26T07:17:19.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.287+0000 7f7c99e6d700 1 -- 172.21.15.2:0/930700645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c80003a00 msgr2=0x7f7c80003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:19.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.287+0000 7f7c99e6d700 1 --2- 172.21.15.2:0/930700645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c80003a00 0x7f7c80003de0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f7c840018d0 tx=0x7f7c80005880 comp rx=0 tx=0).stop 2023-11-26T07:17:19.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.287+0000 7f7c99e6d700 1 -- 172.21.15.2:0/930700645 shutdown_connections 2023-11-26T07:17:19.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.287+0000 7f7c99e6d700 1 --2- 172.21.15.2:0/930700645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c80003a00 0x7f7c80003de0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:19.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.287+0000 7f7c99e6d700 1 -- 172.21.15.2:0/930700645 >> 172.21.15.2:0/930700645 conn(0x7f7c940b5070 msgr2=0x7f7c940b5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:19.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.287+0000 7f7c99e6d700 1 -- 172.21.15.2:0/930700645 shutdown_connections 2023-11-26T07:17:19.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.287+0000 7f7c99e6d700 1 -- 172.21.15.2:0/930700645 wait complete. 2023-11-26T07:17:19.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.289+0000 7f7c99e6d700 1 Processor -- start 2023-11-26T07:17:19.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.289+0000 7f7c99e6d700 1 -- start start 2023-11-26T07:17:19.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.290+0000 7f7c99e6d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c80003a00 0x7f7c941f14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:19.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.290+0000 7f7c99e6d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c941f1a20 0x7f7c94150a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:19.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.290+0000 7f7c99e6d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c94150f50 0x7f7c94154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:19.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.290+0000 7f7c99e6d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c940b0d40 con 0x7f7c941f1a20 2023-11-26T07:17:19.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.290+0000 7f7c99e6d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c941513e0 con 0x7f7c80003a00 2023-11-26T07:17:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.290+0000 7f7c99e6d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c940b00c0 con 0x7f7c94150f50 2023-11-26T07:17:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.290+0000 7f7c92ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c941f1a20 0x7f7c94150a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.290+0000 7f7c92ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c941f1a20 0x7f7c94150a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44690/0 (socket says 172.21.15.2:44690) 2023-11-26T07:17:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.290+0000 7f7c92ffd700 1 -- 172.21.15.2:0/999727242 learned_addr learned my addr 172.21.15.2:0/999727242 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.291+0000 7f7c937fe700 1 --2- 172.21.15.2:0/999727242 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c80003a00 0x7f7c941f14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.291+0000 7f7c93fff700 1 --2- 172.21.15.2:0/999727242 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c94150f50 0x7f7c94154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.291+0000 7f7c92ffd700 1 -- 172.21.15.2:0/999727242 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c94150f50 msgr2=0x7f7c94154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.291+0000 7f7c92ffd700 1 --2- 172.21.15.2:0/999727242 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c94150f50 0x7f7c94154590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.291+0000 7f7c92ffd700 1 -- 172.21.15.2:0/999727242 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c80003a00 msgr2=0x7f7c941f14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.291+0000 7f7c92ffd700 1 --2- 172.21.15.2:0/999727242 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c80003a00 0x7f7c941f14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.291+0000 7f7c92ffd700 1 -- 172.21.15.2:0/999727242 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c940b03a0 con 0x7f7c941f1a20 2023-11-26T07:17:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.291+0000 7f7c937fe700 1 --2- 172.21.15.2:0/999727242 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c80003a00 0x7f7c941f14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:19.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.291+0000 7f7c92ffd700 1 --2- 172.21.15.2:0/999727242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c941f1a20 0x7f7c94150a10 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c0072c0 tx=0x7f7c7c0075d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:19.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.291+0000 7f7c8bfff700 1 -- 172.21.15.2:0/999727242 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c00f6c0 con 0x7f7c941f1a20 2023-11-26T07:17:19.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.291+0000 7f7c8bfff700 1 -- 172.21.15.2:0/999727242 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7c00f860 con 0x7f7c941f1a20 2023-11-26T07:17:19.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.291+0000 7f7c8bfff700 1 -- 172.21.15.2:0/999727242 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c00fc10 con 0x7f7c941f1a20 2023-11-26T07:17:19.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.291+0000 7f7c99e6d700 1 -- 172.21.15.2:0/999727242 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c940b0680 con 0x7f7c941f1a20 2023-11-26T07:17:19.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.291+0000 7f7c99e6d700 1 -- 172.21.15.2:0/999727242 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c94154ad0 con 0x7f7c941f1a20 2023-11-26T07:17:19.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.292+0000 7f7c99e6d700 1 -- 172.21.15.2:0/999727242 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c94075480 con 0x7f7c941f1a20 2023-11-26T07:17:19.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.293+0000 7f7c8bfff700 1 -- 172.21.15.2:0/999727242 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f7c7c00fd70 con 0x7f7c941f1a20 2023-11-26T07:17:19.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.293+0000 7f7c8bfff700 1 --2- 172.21.15.2:0/999727242 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7c7406b980 0x7f7c7406de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:19.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.293+0000 7f7c8bfff700 1 -- 172.21.15.2:0/999727242 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c7c087ce0 con 0x7f7c941f1a20 2023-11-26T07:17:19.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.293+0000 7f7c937fe700 1 --2- 172.21.15.2:0/999727242 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7c7406b980 0x7f7c7406de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:19.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.294+0000 7f7c937fe700 1 --2- 172.21.15.2:0/999727242 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7c7406b980 0x7f7c7406de40 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f7c84000c00 tx=0x7f7c84005000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:19.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.298+0000 7f7c8bfff700 1 -- 172.21.15.2:0/999727242 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7c7c054840 con 0x7f7c941f1a20 2023-11-26T07:17:19.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:19.545+0000 7f7c99e6d700 1 -- 172.21.15.2:0/999727242 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone33480", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c9415bdb0 con 0x7f7c7406b980 2023-11-26T07:17:22.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.720+0000 7f7c8bfff700 1 -- 172.21.15.2:0/999727242 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+169 (secure 0 0 0) 0x7f7c840050d0 con 0x7f7c7406b980 2023-11-26T07:17:22.723 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-26T07:17:22.723 INFO:teuthology.orchestra.run.smithi002.stdout: "status": { 2023-11-26T07:17:22.723 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "in-progress", 2023-11-26T07:17:22.723 INFO:teuthology.orchestra.run.smithi002.stdout: "source": { 2023-11-26T07:17:22.723 INFO:teuthology.orchestra.run.smithi002.stdout: "volume": "cephfs", 2023-11-26T07:17:22.723 INFO:teuthology.orchestra.run.smithi002.stdout: "subvolume": "subvol83060", 2023-11-26T07:17:22.723 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot": "subvol_snap31270" 2023-11-26T07:17:22.723 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:17:22.724 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:17:22.724 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-26T07:17:22.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.723+0000 7f7c99e6d700 1 -- 172.21.15.2:0/999727242 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7c7406b980 msgr2=0x7f7c7406de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:22.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.723+0000 7f7c99e6d700 1 --2- 172.21.15.2:0/999727242 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7c7406b980 0x7f7c7406de40 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f7c84000c00 tx=0x7f7c84005000 comp rx=0 tx=0).stop 2023-11-26T07:17:22.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.723+0000 7f7c99e6d700 1 -- 172.21.15.2:0/999727242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c941f1a20 msgr2=0x7f7c94150a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:22.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.723+0000 7f7c99e6d700 1 --2- 172.21.15.2:0/999727242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c941f1a20 0x7f7c94150a10 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c0072c0 tx=0x7f7c7c0075d0 comp rx=0 tx=0).stop 2023-11-26T07:17:22.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.723+0000 7f7c99e6d700 1 -- 172.21.15.2:0/999727242 shutdown_connections 2023-11-26T07:17:22.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.723+0000 7f7c99e6d700 1 --2- 172.21.15.2:0/999727242 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7c7406b980 0x7f7c7406de40 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:22.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.723+0000 7f7c99e6d700 1 --2- 172.21.15.2:0/999727242 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c94150f50 0x7f7c94154590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:22.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.723+0000 7f7c99e6d700 1 --2- 172.21.15.2:0/999727242 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c80003a00 0x7f7c941f14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:22.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.723+0000 7f7c99e6d700 1 --2- 172.21.15.2:0/999727242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c941f1a20 0x7f7c94150a10 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:22.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.723+0000 7f7c99e6d700 1 -- 172.21.15.2:0/999727242 >> 172.21.15.2:0/999727242 conn(0x7f7c940b5070 msgr2=0x7f7c9406c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:22.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.723+0000 7f7c99e6d700 1 -- 172.21.15.2:0/999727242 shutdown_connections 2023-11-26T07:17:22.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.723+0000 7f7c99e6d700 1 -- 172.21.15.2:0/999727242 wait complete. 2023-11-26T07:17:22.741 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone33480 2023-11-26T07:17:22.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.891+0000 7f938ba80700 1 Processor -- start 2023-11-26T07:17:22.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.891+0000 7f938ba80700 1 -- start start 2023-11-26T07:17:22.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.892+0000 7f938ba80700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f938415f380 0x7f9384066ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:22.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.892+0000 7f938ba80700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f938415f760 con 0x7f938406c670 2023-11-26T07:17:22.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.892+0000 7f938ba80700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f938406b2f0 con 0x7f93840b5eb0 2023-11-26T07:17:22.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.892+0000 7f938ba80700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f938406b5b0 con 0x7f938415f380 2023-11-26T07:17:22.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.892+0000 7f938981c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f938415f380 0x7f9384066ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:22.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.892+0000 7f938a01d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f938406c670 0x7f93840aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35910/0 (socket says 172.21.15.2:35910) 2023-11-26T07:17:22.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.893+0000 7f938a01d700 1 -- 172.21.15.2:0/3147011921 learned_addr learned my addr 172.21.15.2:0/3147011921 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:22.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.893+0000 7f938981c700 1 -- 172.21.15.2:0/3147011921 >> v1:172.21.15.192:6789/0 conn(0x7f93840b5eb0 legacy=0x7f938406bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:22.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.893+0000 7f938981c700 1 -- 172.21.15.2:0/3147011921 >> v1:172.21.15.2:6789/0 conn(0x7f938406c670 legacy=0x7f93840aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:22.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.893+0000 7f938881a700 1 -- 172.21.15.2:0/3147011921 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2663388870 0 0) 0x7f938415f760 con 0x7f938406c670 2023-11-26T07:17:22.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.893+0000 7f938981c700 1 -- 172.21.15.2:0/3147011921 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f938406b890 con 0x7f938415f380 2023-11-26T07:17:22.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.893+0000 7f938981c700 1 --2- 172.21.15.2:0/3147011921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f938415f380 0x7f9384066ce0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f9380009840 tx=0x7f9380009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d447e857a8b15a07 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:22.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.893+0000 7f938881a700 1 -- 172.21.15.2:0/3147011921 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9380004230 con 0x7f938415f380 2023-11-26T07:17:22.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.893+0000 7f938881a700 1 -- 172.21.15.2:0/3147011921 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9380004390 con 0x7f938415f380 2023-11-26T07:17:22.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.893+0000 7f938881a700 1 -- 172.21.15.2:0/3147011921 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93800036a0 con 0x7f938415f380 2023-11-26T07:17:22.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.894+0000 7f938ba80700 1 -- 172.21.15.2:0/3147011921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f938415f380 msgr2=0x7f9384066ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:22.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.894+0000 7f938ba80700 1 --2- 172.21.15.2:0/3147011921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f938415f380 0x7f9384066ce0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f9380009840 tx=0x7f9380009b50 comp rx=0 tx=0).stop 2023-11-26T07:17:22.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.894+0000 7f938ba80700 1 -- 172.21.15.2:0/3147011921 shutdown_connections 2023-11-26T07:17:22.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.894+0000 7f938ba80700 1 --2- 172.21.15.2:0/3147011921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f938415f380 0x7f9384066ce0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:22.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.894+0000 7f938ba80700 1 -- 172.21.15.2:0/3147011921 >> 172.21.15.2:0/3147011921 conn(0x7f93840b5070 msgr2=0x7f93840b5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:22.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.894+0000 7f938ba80700 1 -- 172.21.15.2:0/3147011921 shutdown_connections 2023-11-26T07:17:22.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.894+0000 7f938ba80700 1 -- 172.21.15.2:0/3147011921 wait complete. 2023-11-26T07:17:22.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.895+0000 7f938ba80700 1 Processor -- start 2023-11-26T07:17:22.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.895+0000 7f938ba80700 1 -- start start 2023-11-26T07:17:22.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.896+0000 7f938ba80700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f938406c670 0x7f9384155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:22.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.896+0000 7f938ba80700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93840b5eb0 0x7f93841f3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:22.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.896+0000 7f938ba80700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f938415f380 0x7f9384154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:22.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.896+0000 7f938ba80700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93840cc0d0 con 0x7f93840b5eb0 2023-11-26T07:17:22.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.896+0000 7f938ba80700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9384153f70 con 0x7f938406c670 2023-11-26T07:17:22.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.896+0000 7f938ba80700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9384153c70 con 0x7f938415f380 2023-11-26T07:17:22.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.896+0000 7f938901b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93840b5eb0 0x7f93841f3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:22.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.896+0000 7f938901b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93840b5eb0 0x7f93841f3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44704/0 (socket says 172.21.15.2:44704) 2023-11-26T07:17:22.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.896+0000 7f938901b700 1 -- 172.21.15.2:0/1127349612 learned_addr learned my addr 172.21.15.2:0/1127349612 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:22.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.896+0000 7f938981c700 1 --2- 172.21.15.2:0/1127349612 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f938406c670 0x7f9384155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:22.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.896+0000 7f938a01d700 1 --2- 172.21.15.2:0/1127349612 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f938415f380 0x7f9384154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:22.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.897+0000 7f938901b700 1 -- 172.21.15.2:0/1127349612 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f938415f380 msgr2=0x7f9384154400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:22.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.897+0000 7f938901b700 1 --2- 172.21.15.2:0/1127349612 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f938415f380 0x7f9384154400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:22.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.897+0000 7f938901b700 1 -- 172.21.15.2:0/1127349612 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f938406c670 msgr2=0x7f9384155440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:22.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.897+0000 7f938901b700 1 --2- 172.21.15.2:0/1127349612 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f938406c670 0x7f9384155440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:22.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.897+0000 7f938901b700 1 -- 172.21.15.2:0/1127349612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93800094a0 con 0x7f93840b5eb0 2023-11-26T07:17:22.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.897+0000 7f938901b700 1 --2- 172.21.15.2:0/1127349612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93840b5eb0 0x7f93841f3a00 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f937400c530 tx=0x7f937400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:22.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.897+0000 7f937a7fc700 1 -- 172.21.15.2:0/1127349612 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9374011790 con 0x7f93840b5eb0 2023-11-26T07:17:22.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.897+0000 7f937a7fc700 1 -- 172.21.15.2:0/1127349612 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93740118f0 con 0x7f93840b5eb0 2023-11-26T07:17:22.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.897+0000 7f938ba80700 1 -- 172.21.15.2:0/1127349612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9384155980 con 0x7f93840b5eb0 2023-11-26T07:17:22.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.897+0000 7f937a7fc700 1 -- 172.21.15.2:0/1127349612 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9374011ca0 con 0x7f93840b5eb0 2023-11-26T07:17:22.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.897+0000 7f938ba80700 1 -- 172.21.15.2:0/1127349612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93840c9d80 con 0x7f93840b5eb0 2023-11-26T07:17:22.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.898+0000 7f938ba80700 1 -- 172.21.15.2:0/1127349612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9384075480 con 0x7f93840b5eb0 2023-11-26T07:17:22.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.899+0000 7f937a7fc700 1 -- 172.21.15.2:0/1127349612 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f937401c460 con 0x7f93840b5eb0 2023-11-26T07:17:22.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.899+0000 7f937a7fc700 1 --2- 172.21.15.2:0/1127349612 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f936806b980 0x7f936806de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:22.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.899+0000 7f937a7fc700 1 -- 172.21.15.2:0/1127349612 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9374087c30 con 0x7f93840b5eb0 2023-11-26T07:17:22.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.899+0000 7f938981c700 1 --2- 172.21.15.2:0/1127349612 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f936806b980 0x7f936806de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:22.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.900+0000 7f938981c700 1 --2- 172.21.15.2:0/1127349612 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f936806b980 0x7f936806de40 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f93800090b0 tx=0x7f9380008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:22.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:22.904+0000 7f937a7fc700 1 -- 172.21.15.2:0/1127349612 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9374054710 con 0x7f93840b5eb0 2023-11-26T07:17:23.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.188+0000 7f938ba80700 1 -- 172.21.15.2:0/1127349612 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone33480", "target": ["mon-mgr", ""]}) v1 -- 0x7f9384067220 con 0x7f936806b980 2023-11-26T07:17:23.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.194+0000 7f937a7fc700 1 -- 172.21.15.2:0/1127349612 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+169 (secure 0 0 0) 0x7f9380003850 con 0x7f936806b980 2023-11-26T07:17:23.197 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-26T07:17:23.197 INFO:teuthology.orchestra.run.smithi002.stdout: "status": { 2023-11-26T07:17:23.198 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "in-progress", 2023-11-26T07:17:23.198 INFO:teuthology.orchestra.run.smithi002.stdout: "source": { 2023-11-26T07:17:23.198 INFO:teuthology.orchestra.run.smithi002.stdout: "volume": "cephfs", 2023-11-26T07:17:23.198 INFO:teuthology.orchestra.run.smithi002.stdout: "subvolume": "subvol83060", 2023-11-26T07:17:23.198 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot": "subvol_snap31270" 2023-11-26T07:17:23.198 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:17:23.198 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:17:23.198 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-26T07:17:23.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.197+0000 7f938ba80700 1 -- 172.21.15.2:0/1127349612 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f936806b980 msgr2=0x7f936806de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:23.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.197+0000 7f938ba80700 1 --2- 172.21.15.2:0/1127349612 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f936806b980 0x7f936806de40 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f93800090b0 tx=0x7f9380008030 comp rx=0 tx=0).stop 2023-11-26T07:17:23.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.197+0000 7f938ba80700 1 -- 172.21.15.2:0/1127349612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93840b5eb0 msgr2=0x7f93841f3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:23.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.197+0000 7f938ba80700 1 --2- 172.21.15.2:0/1127349612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93840b5eb0 0x7f93841f3a00 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f937400c530 tx=0x7f937400c840 comp rx=0 tx=0).stop 2023-11-26T07:17:23.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.197+0000 7f938ba80700 1 -- 172.21.15.2:0/1127349612 shutdown_connections 2023-11-26T07:17:23.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.197+0000 7f938ba80700 1 --2- 172.21.15.2:0/1127349612 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f936806b980 0x7f936806de40 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:23.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.197+0000 7f938ba80700 1 --2- 172.21.15.2:0/1127349612 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f938415f380 0x7f9384154400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:23.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.197+0000 7f938ba80700 1 --2- 172.21.15.2:0/1127349612 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f938406c670 0x7f9384155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:23.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.197+0000 7f938ba80700 1 --2- 172.21.15.2:0/1127349612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93840b5eb0 0x7f93841f3a00 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:23.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.197+0000 7f938ba80700 1 -- 172.21.15.2:0/1127349612 >> 172.21.15.2:0/1127349612 conn(0x7f93840b5070 msgr2=0x7f93840cf600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:23.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.197+0000 7f938ba80700 1 -- 172.21.15.2:0/1127349612 shutdown_connections 2023-11-26T07:17:23.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.197+0000 7f938ba80700 1 -- 172.21.15.2:0/1127349612 wait complete. 2023-11-26T07:17:23.214 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone33480 2023-11-26T07:17:23.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.356+0000 7f19bdd9e700 1 Processor -- start 2023-11-26T07:17:23.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.357+0000 7f19bdd9e700 1 -- start start 2023-11-26T07:17:23.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.357+0000 7f19bdd9e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f19b806b8f0 0x7f19b80719e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:23.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.357+0000 7f19bdd9e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19b815e4e0 con 0x7f19b8071f20 2023-11-26T07:17:23.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.357+0000 7f19bdd9e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19b815e7c0 con 0x7f19b815ddc0 2023-11-26T07:17:23.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.357+0000 7f19bdd9e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19b815f160 con 0x7f19b806b8f0 2023-11-26T07:17:23.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.358+0000 7f19bd59d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f19b8071f20 0x7f19b80cf000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35924/0 (socket says 172.21.15.2:35924) 2023-11-26T07:17:23.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.358+0000 7f19bd59d700 1 -- 172.21.15.2:0/1783516076 learned_addr learned my addr 172.21.15.2:0/1783516076 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:23.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.358+0000 7f19b7fff700 1 --2- 172.21.15.2:0/1783516076 >> v2:172.21.15.192:3300/0 conn(0x7f19b806b8f0 0x7f19b80719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:23.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.358+0000 7f19b77fe700 1 -- 172.21.15.2:0/1783516076 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 127695404 0 0) 0x7f19b815e4e0 con 0x7f19b8071f20 2023-11-26T07:17:23.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.358+0000 7f19b77fe700 1 -- 172.21.15.2:0/1783516076 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19a80035b0 con 0x7f19b8071f20 2023-11-26T07:17:23.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.358+0000 7f19b77fe700 1 -- 172.21.15.2:0/1783516076 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3825651440 0 0) 0x7f19b815e7c0 con 0x7f19b815ddc0 2023-11-26T07:17:23.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.358+0000 7f19b77fe700 1 -- 172.21.15.2:0/1783516076 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19b815e4e0 con 0x7f19b815ddc0 2023-11-26T07:17:23.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.358+0000 7f19b7fff700 1 -- 172.21.15.2:0/1783516076 >> v1:172.21.15.192:6789/0 conn(0x7f19b815ddc0 legacy=0x7f19b806b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:23.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.358+0000 7f19b7fff700 1 -- 172.21.15.2:0/1783516076 >> v1:172.21.15.2:6789/0 conn(0x7f19b8071f20 legacy=0x7f19b80cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:23.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.358+0000 7f19b7fff700 1 -- 172.21.15.2:0/1783516076 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b815eaa0 con 0x7f19b806b8f0 2023-11-26T07:17:23.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.358+0000 7f19b7fff700 1 --2- 172.21.15.2:0/1783516076 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19b806b8f0 0x7f19b80719e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f19a4009840 tx=0x7f19a4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=695816ac871287aa server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:23.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.358+0000 7f19b77fe700 1 -- 172.21.15.2:0/1783516076 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a4011830 con 0x7f19b806b8f0 2023-11-26T07:17:23.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.358+0000 7f19b77fe700 1 -- 172.21.15.2:0/1783516076 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a4011990 con 0x7f19b806b8f0 2023-11-26T07:17:23.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.358+0000 7f19b77fe700 1 -- 172.21.15.2:0/1783516076 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a4011d20 con 0x7f19b806b8f0 2023-11-26T07:17:23.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.359+0000 7f19bdd9e700 1 -- 172.21.15.2:0/1783516076 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19b806b8f0 msgr2=0x7f19b80719e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:23.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.359+0000 7f19bdd9e700 1 --2- 172.21.15.2:0/1783516076 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19b806b8f0 0x7f19b80719e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f19a4009840 tx=0x7f19a4009b50 comp rx=0 tx=0).stop 2023-11-26T07:17:23.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.359+0000 7f19bdd9e700 1 -- 172.21.15.2:0/1783516076 shutdown_connections 2023-11-26T07:17:23.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.359+0000 7f19bdd9e700 1 --2- 172.21.15.2:0/1783516076 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19b806b8f0 0x7f19b80719e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:23.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.359+0000 7f19bdd9e700 1 -- 172.21.15.2:0/1783516076 >> 172.21.15.2:0/1783516076 conn(0x7f19b80cd490 msgr2=0x7f19b80cd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:23.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.359+0000 7f19bdd9e700 1 -- 172.21.15.2:0/1783516076 shutdown_connections 2023-11-26T07:17:23.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.359+0000 7f19bdd9e700 1 -- 172.21.15.2:0/1783516076 wait complete. 2023-11-26T07:17:23.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.361+0000 7f19bdd9e700 1 Processor -- start 2023-11-26T07:17:23.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.361+0000 7f19bdd9e700 1 -- start start 2023-11-26T07:17:23.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.362+0000 7f19bdd9e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19b806b8f0 0x7f19b8152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:23.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.362+0000 7f19bdd9e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19b8071f20 0x7f19b81520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:23.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.362+0000 7f19bdd9e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19b815ddc0 0x7f19b80b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:23.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.362+0000 7f19bdd9e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b8152b60 con 0x7f19b806b8f0 2023-11-26T07:17:23.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.362+0000 7f19bdd9e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b81533e0 con 0x7f19b815ddc0 2023-11-26T07:17:23.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.362+0000 7f19bdd9e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b81536c0 con 0x7f19b8071f20 2023-11-26T07:17:23.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.362+0000 7f19bcd9c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19b806b8f0 0x7f19b8152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:23.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.362+0000 7f19b7fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19b8071f20 0x7f19b81520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:23.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.362+0000 7f19bcd9c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19b806b8f0 0x7f19b8152ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44716/0 (socket says 172.21.15.2:44716) 2023-11-26T07:17:23.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.362+0000 7f19bcd9c700 1 -- 172.21.15.2:0/2006485938 learned_addr learned my addr 172.21.15.2:0/2006485938 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:23.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.362+0000 7f19bd59d700 1 --2- 172.21.15.2:0/2006485938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19b815ddc0 0x7f19b80b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:23.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.363+0000 7f19bcd9c700 1 -- 172.21.15.2:0/2006485938 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19b8071f20 msgr2=0x7f19b81520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:23.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.363+0000 7f19bcd9c700 1 --2- 172.21.15.2:0/2006485938 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19b8071f20 0x7f19b81520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:23.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.363+0000 7f19bcd9c700 1 -- 172.21.15.2:0/2006485938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19b815ddc0 msgr2=0x7f19b80b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:23.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.363+0000 7f19bcd9c700 1 --2- 172.21.15.2:0/2006485938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19b815ddc0 0x7f19b80b4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:23.368 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.363+0000 7f19bcd9c700 1 -- 172.21.15.2:0/2006485938 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a40094a0 con 0x7f19b806b8f0 2023-11-26T07:17:23.368 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.363+0000 7f19bcd9c700 1 --2- 172.21.15.2:0/2006485938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19b806b8f0 0x7f19b8152ce0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f19ac00c500 tx=0x7f19ac00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:23.368 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.363+0000 7f19b57fa700 1 -- 172.21.15.2:0/2006485938 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac0052d0 con 0x7f19b806b8f0 2023-11-26T07:17:23.368 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.363+0000 7f19b57fa700 1 -- 172.21.15.2:0/2006485938 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19ac005450 con 0x7f19b806b8f0 2023-11-26T07:17:23.368 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.363+0000 7f19bdd9e700 1 -- 172.21.15.2:0/2006485938 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b81539a0 con 0x7f19b806b8f0 2023-11-26T07:17:23.368 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.363+0000 7f19b57fa700 1 -- 172.21.15.2:0/2006485938 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac0038c0 con 0x7f19b806b8f0 2023-11-26T07:17:23.368 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.363+0000 7f19bdd9e700 1 -- 172.21.15.2:0/2006485938 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b8153f60 con 0x7f19b806b8f0 2023-11-26T07:17:23.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.364+0000 7f19bdd9e700 1 -- 172.21.15.2:0/2006485938 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19b8154120 con 0x7f19b806b8f0 2023-11-26T07:17:23.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.365+0000 7f19b57fa700 1 -- 172.21.15.2:0/2006485938 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f19ac003a20 con 0x7f19b806b8f0 2023-11-26T07:17:23.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.365+0000 7f19b57fa700 1 --2- 172.21.15.2:0/2006485938 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f199c06b980 0x7f199c06de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:23.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.365+0000 7f19b57fa700 1 -- 172.21.15.2:0/2006485938 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f19ac087510 con 0x7f19b806b8f0 2023-11-26T07:17:23.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.365+0000 7f19b7fff700 1 --2- 172.21.15.2:0/2006485938 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f199c06b980 0x7f199c06de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:23.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.366+0000 7f19b7fff700 1 --2- 172.21.15.2:0/2006485938 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f199c06b980 0x7f199c06de40 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f19b806bd00 tx=0x7f19a401c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:23.372 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.369+0000 7f19b57fa700 1 -- 172.21.15.2:0/2006485938 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f19ac053dc0 con 0x7f19b806b8f0 2023-11-26T07:17:23.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.618+0000 7f19bdd9e700 1 -- 172.21.15.2:0/2006485938 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone33480", "target": ["mon-mgr", ""]}) v1 -- 0x7f19b815e1a0 con 0x7f199c06b980 2023-11-26T07:17:23.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.626+0000 7f19b57fa700 1 -- 172.21.15.2:0/2006485938 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+169 (secure 0 0 0) 0x7f19a4011b00 con 0x7f199c06b980 2023-11-26T07:17:23.629 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-26T07:17:23.629 INFO:teuthology.orchestra.run.smithi002.stdout: "status": { 2023-11-26T07:17:23.629 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "in-progress", 2023-11-26T07:17:23.629 INFO:teuthology.orchestra.run.smithi002.stdout: "source": { 2023-11-26T07:17:23.629 INFO:teuthology.orchestra.run.smithi002.stdout: "volume": "cephfs", 2023-11-26T07:17:23.629 INFO:teuthology.orchestra.run.smithi002.stdout: "subvolume": "subvol83060", 2023-11-26T07:17:23.629 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot": "subvol_snap31270" 2023-11-26T07:17:23.629 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:17:23.629 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:17:23.629 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-26T07:17:23.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.628+0000 7f19bdd9e700 1 -- 172.21.15.2:0/2006485938 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f199c06b980 msgr2=0x7f199c06de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:23.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.628+0000 7f19bdd9e700 1 --2- 172.21.15.2:0/2006485938 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f199c06b980 0x7f199c06de40 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f19b806bd00 tx=0x7f19a401c040 comp rx=0 tx=0).stop 2023-11-26T07:17:23.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.628+0000 7f19bdd9e700 1 -- 172.21.15.2:0/2006485938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19b806b8f0 msgr2=0x7f19b8152ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:23.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.628+0000 7f19bdd9e700 1 --2- 172.21.15.2:0/2006485938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19b806b8f0 0x7f19b8152ce0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f19ac00c500 tx=0x7f19ac00c810 comp rx=0 tx=0).stop 2023-11-26T07:17:23.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.628+0000 7f19bdd9e700 1 -- 172.21.15.2:0/2006485938 shutdown_connections 2023-11-26T07:17:23.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.628+0000 7f19bdd9e700 1 --2- 172.21.15.2:0/2006485938 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f199c06b980 0x7f199c06de40 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:23.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.628+0000 7f19bdd9e700 1 --2- 172.21.15.2:0/2006485938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19b815ddc0 0x7f19b80b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:23.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.628+0000 7f19bdd9e700 1 --2- 172.21.15.2:0/2006485938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19b806b8f0 0x7f19b8152ce0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:23.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.628+0000 7f19bdd9e700 1 --2- 172.21.15.2:0/2006485938 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19b8071f20 0x7f19b81520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:23.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.628+0000 7f19bdd9e700 1 -- 172.21.15.2:0/2006485938 >> 172.21.15.2:0/2006485938 conn(0x7f19b80cd490 msgr2=0x7f19b80cf850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:23.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.628+0000 7f19bdd9e700 1 -- 172.21.15.2:0/2006485938 shutdown_connections 2023-11-26T07:17:23.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:23.628+0000 7f19bdd9e700 1 -- 172.21.15.2:0/2006485938 wait complete. 2023-11-26T07:17:24.644 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone33480 2023-11-26T07:17:24.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.783+0000 7f9ea1db9700 1 Processor -- start 2023-11-26T07:17:24.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.783+0000 7f9ea1db9700 1 -- start start 2023-11-26T07:17:24.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.784+0000 7f9ea1db9700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9e9c0b0e90 0x7f9e9c06eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:24.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.784+0000 7f9ea1db9700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e9c0d1230 con 0x7f9e9c15e1c0 2023-11-26T07:17:24.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.784+0000 7f9ea1db9700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e9c0d0c70 con 0x7f9e9c06fc50 2023-11-26T07:17:24.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.784+0000 7f9ea1db9700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e9c0d0f50 con 0x7f9e9c0b0e90 2023-11-26T07:17:24.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.785+0000 7f9e9b7fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f9e9c15e1c0 0x7f9e9c06f540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35934/0 (socket says 172.21.15.2:35934) 2023-11-26T07:17:24.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.785+0000 7f9e9b7fe700 1 -- 172.21.15.2:0/1433357298 learned_addr learned my addr 172.21.15.2:0/1433357298 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:24.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.785+0000 7f9e9bfff700 1 --2- 172.21.15.2:0/1433357298 >> v2:172.21.15.2:3300/0 conn(0x7f9e9c0b0e90 0x7f9e9c06eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:24.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.785+0000 7f9e9a7fc700 1 -- 172.21.15.2:0/1433357298 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3852353864 0 0) 0x7f9e9c0d1230 con 0x7f9e9c15e1c0 2023-11-26T07:17:24.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.785+0000 7f9e9a7fc700 1 -- 172.21.15.2:0/1433357298 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e840035b0 con 0x7f9e9c15e1c0 2023-11-26T07:17:24.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.785+0000 7f9e9bfff700 1 -- 172.21.15.2:0/1433357298 >> v1:172.21.15.192:6789/0 conn(0x7f9e9c06fc50 legacy=0x7f9e9c06ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:24.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.785+0000 7f9e9bfff700 1 -- 172.21.15.2:0/1433357298 >> v1:172.21.15.2:6789/0 conn(0x7f9e9c15e1c0 legacy=0x7f9e9c06f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:24.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.785+0000 7f9e9bfff700 1 -- 172.21.15.2:0/1433357298 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e9c06c210 con 0x7f9e9c0b0e90 2023-11-26T07:17:24.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.785+0000 7f9e9bfff700 1 --2- 172.21.15.2:0/1433357298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e9c0b0e90 0x7f9e9c06eef0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f9e94009840 tx=0x7f9e94009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e1c57b9b517f77e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:24.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.785+0000 7f9e9a7fc700 1 -- 172.21.15.2:0/1433357298 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e94011830 con 0x7f9e9c0b0e90 2023-11-26T07:17:24.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.786+0000 7f9e9a7fc700 1 -- 172.21.15.2:0/1433357298 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e94011990 con 0x7f9e9c0b0e90 2023-11-26T07:17:24.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.786+0000 7f9e9a7fc700 1 -- 172.21.15.2:0/1433357298 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e94011d20 con 0x7f9e9c0b0e90 2023-11-26T07:17:24.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.786+0000 7f9ea1db9700 1 -- 172.21.15.2:0/1433357298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e9c0b0e90 msgr2=0x7f9e9c06eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:24.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.786+0000 7f9ea1db9700 1 --2- 172.21.15.2:0/1433357298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e9c0b0e90 0x7f9e9c06eef0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f9e94009840 tx=0x7f9e94009b50 comp rx=0 tx=0).stop 2023-11-26T07:17:24.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.786+0000 7f9ea1db9700 1 -- 172.21.15.2:0/1433357298 shutdown_connections 2023-11-26T07:17:24.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.786+0000 7f9ea1db9700 1 --2- 172.21.15.2:0/1433357298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e9c0b0e90 0x7f9e9c06eef0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:24.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.786+0000 7f9ea1db9700 1 -- 172.21.15.2:0/1433357298 >> 172.21.15.2:0/1433357298 conn(0x7f9e9c0b3720 msgr2=0x7f9e9c0b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:24.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.786+0000 7f9ea1db9700 1 -- 172.21.15.2:0/1433357298 shutdown_connections 2023-11-26T07:17:24.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.786+0000 7f9ea1db9700 1 -- 172.21.15.2:0/1433357298 wait complete. 2023-11-26T07:17:24.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.788+0000 7f9ea1db9700 1 Processor -- start 2023-11-26T07:17:24.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.788+0000 7f9ea1db9700 1 -- start start 2023-11-26T07:17:24.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.789+0000 7f9ea1db9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e9c06fc50 0x7f9e9c15fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:24.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.789+0000 7f9ea1db9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e9c0b0e90 0x7f9e9c0b2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:24.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.789+0000 7f9ea1db9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e9c15e1c0 0x7f9e9c0b2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:24.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.789+0000 7f9ea1db9700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c09bc20 con 0x7f9e9c0b0e90 2023-11-26T07:17:24.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.789+0000 7f9ea1db9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c160680 con 0x7f9e9c15e1c0 2023-11-26T07:17:24.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.789+0000 7f9ea1db9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c160960 con 0x7f9e9c06fc50 2023-11-26T07:17:24.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.789+0000 7f9e9affd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e9c0b0e90 0x7f9e9c0b2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:24.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.789+0000 7f9e9affd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e9c0b0e90 0x7f9e9c0b2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44732/0 (socket says 172.21.15.2:44732) 2023-11-26T07:17:24.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.789+0000 7f9e9bfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e9c15e1c0 0x7f9e9c0b2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:24.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.789+0000 7f9e9affd700 1 -- 172.21.15.2:0/3622064035 learned_addr learned my addr 172.21.15.2:0/3622064035 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:24.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.789+0000 7f9e9b7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e9c06fc50 0x7f9e9c15fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:24.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.790+0000 7f9e9b7fe700 1 -- 172.21.15.2:0/3622064035 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e9c15e1c0 msgr2=0x7f9e9c0b2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:24.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.790+0000 7f9e9b7fe700 1 --2- 172.21.15.2:0/3622064035 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e9c15e1c0 0x7f9e9c0b2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:24.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.790+0000 7f9e9b7fe700 1 -- 172.21.15.2:0/3622064035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e9c0b0e90 msgr2=0x7f9e9c0b2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:24.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.790+0000 7f9e9b7fe700 1 --2- 172.21.15.2:0/3622064035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e9c0b0e90 0x7f9e9c0b2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:24.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.790+0000 7f9e9b7fe700 1 -- 172.21.15.2:0/3622064035 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e940094a0 con 0x7f9e9c06fc50 2023-11-26T07:17:24.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.790+0000 7f9e9affd700 1 --2- 172.21.15.2:0/3622064035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e9c0b0e90 0x7f9e9c0b2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:17:24.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.790+0000 7f9e9bfff700 1 --2- 172.21.15.2:0/3622064035 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e9c15e1c0 0x7f9e9c0b2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:17:24.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.790+0000 7f9e9b7fe700 1 --2- 172.21.15.2:0/3622064035 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e9c06fc50 0x7f9e9c15fe50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c00caa0 tx=0x7f9e8c00cdb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:24.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.790+0000 7f9e83fff700 1 -- 172.21.15.2:0/3622064035 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c00a9a0 con 0x7f9e9c06fc50 2023-11-26T07:17:24.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.790+0000 7f9e83fff700 1 -- 172.21.15.2:0/3622064035 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e8c00ab00 con 0x7f9e9c06fc50 2023-11-26T07:17:24.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.790+0000 7f9ea1db9700 1 -- 172.21.15.2:0/3622064035 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e9c160c40 con 0x7f9e9c06fc50 2023-11-26T07:17:24.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.790+0000 7f9e83fff700 1 -- 172.21.15.2:0/3622064035 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c00ae70 con 0x7f9e9c06fc50 2023-11-26T07:17:24.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.790+0000 7f9ea1db9700 1 -- 172.21.15.2:0/3622064035 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e9c161200 con 0x7f9e9c06fc50 2023-11-26T07:17:24.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.791+0000 7f9ea1db9700 1 -- 172.21.15.2:0/3622064035 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e9c161570 con 0x7f9e9c06fc50 2023-11-26T07:17:24.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.791+0000 7f9e83fff700 1 -- 172.21.15.2:0/3622064035 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f9e8c01b3b0 con 0x7f9e9c06fc50 2023-11-26T07:17:24.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.792+0000 7f9e83fff700 1 --2- 172.21.15.2:0/3622064035 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9e8806b980 0x7f9e8806de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:24.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.792+0000 7f9e83fff700 1 -- 172.21.15.2:0/3622064035 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f9e8c087b60 con 0x7f9e9c06fc50 2023-11-26T07:17:24.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.792+0000 7f9e9affd700 1 --2- 172.21.15.2:0/3622064035 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9e8806b980 0x7f9e8806de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:24.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.793+0000 7f9e9affd700 1 --2- 172.21.15.2:0/3622064035 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9e8806b980 0x7f9e8806de40 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c0cf560 tx=0x7f9e90009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:24.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:24.797+0000 7f9e83fff700 1 -- 172.21.15.2:0/3622064035 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9e8c054540 con 0x7f9e9c06fc50 2023-11-26T07:17:25.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:25.068+0000 7f9ea1db9700 1 -- 172.21.15.2:0/3622064035 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone33480", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e9c15e5a0 con 0x7f9e8806b980 2023-11-26T07:17:25.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:25.075+0000 7f9e83fff700 1 -- 172.21.15.2:0/3622064035 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+169 (secure 0 0 0) 0x7f9e90001960 con 0x7f9e8806b980 2023-11-26T07:17:25.078 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-26T07:17:25.079 INFO:teuthology.orchestra.run.smithi002.stdout: "status": { 2023-11-26T07:17:25.079 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "in-progress", 2023-11-26T07:17:25.079 INFO:teuthology.orchestra.run.smithi002.stdout: "source": { 2023-11-26T07:17:25.079 INFO:teuthology.orchestra.run.smithi002.stdout: "volume": "cephfs", 2023-11-26T07:17:25.079 INFO:teuthology.orchestra.run.smithi002.stdout: "subvolume": "subvol83060", 2023-11-26T07:17:25.079 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot": "subvol_snap31270" 2023-11-26T07:17:25.080 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:17:25.080 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:17:25.080 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-26T07:17:25.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:25.078+0000 7f9ea1db9700 1 -- 172.21.15.2:0/3622064035 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9e8806b980 msgr2=0x7f9e8806de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:25.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:25.078+0000 7f9ea1db9700 1 --2- 172.21.15.2:0/3622064035 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9e8806b980 0x7f9e8806de40 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c0cf560 tx=0x7f9e90009040 comp rx=0 tx=0).stop 2023-11-26T07:17:25.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:25.078+0000 7f9ea1db9700 1 -- 172.21.15.2:0/3622064035 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e9c06fc50 msgr2=0x7f9e9c15fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:25.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:25.078+0000 7f9ea1db9700 1 --2- 172.21.15.2:0/3622064035 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e9c06fc50 0x7f9e9c15fe50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c00caa0 tx=0x7f9e8c00cdb0 comp rx=0 tx=0).stop 2023-11-26T07:17:25.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:25.078+0000 7f9ea1db9700 1 -- 172.21.15.2:0/3622064035 shutdown_connections 2023-11-26T07:17:25.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:25.078+0000 7f9ea1db9700 1 --2- 172.21.15.2:0/3622064035 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9e8806b980 0x7f9e8806de40 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:25.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:25.078+0000 7f9ea1db9700 1 --2- 172.21.15.2:0/3622064035 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e9c15e1c0 0x7f9e9c0b2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:25.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:25.078+0000 7f9ea1db9700 1 --2- 172.21.15.2:0/3622064035 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e9c06fc50 0x7f9e9c15fe50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:25.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:25.078+0000 7f9ea1db9700 1 --2- 172.21.15.2:0/3622064035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e9c0b0e90 0x7f9e9c0b2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:25.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:25.078+0000 7f9ea1db9700 1 -- 172.21.15.2:0/3622064035 >> 172.21.15.2:0/3622064035 conn(0x7f9e9c0b3720 msgr2=0x7f9e9c15b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:25.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:25.078+0000 7f9ea1db9700 1 -- 172.21.15.2:0/3622064035 shutdown_connections 2023-11-26T07:17:25.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:25.078+0000 7f9ea1db9700 1 -- 172.21.15.2:0/3622064035 wait complete. 2023-11-26T07:17:26.096 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone33480 2023-11-26T07:17:26.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.240+0000 7fd4cc244700 1 Processor -- start 2023-11-26T07:17:26.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.240+0000 7fd4cc244700 1 -- start start 2023-11-26T07:17:26.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.241+0000 7fd4cc244700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd4c406b620 0x7fd4c40b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:26.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.241+0000 7fd4cc244700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4c406ee60 0x7fd4c40b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:26.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.241+0000 7fd4cc244700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4c4071f50 con 0x7fd4c40b5ab0 2023-11-26T07:17:26.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.241+0000 7fd4cc244700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4c4072230 con 0x7fd4c406b620 2023-11-26T07:17:26.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.241+0000 7fd4cc244700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c4072510 con 0x7fd4c406ee60 2023-11-26T07:17:26.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.241+0000 7fd4c97df700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd4c40b5ab0 0x7fd4c4161ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35952/0 (socket says 172.21.15.2:35952) 2023-11-26T07:17:26.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.241+0000 7fd4c97df700 1 -- 172.21.15.2:0/2296455592 learned_addr learned my addr 172.21.15.2:0/2296455592 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:26.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.241+0000 7fd4ca7e1700 1 --2- 172.21.15.2:0/2296455592 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4c406ee60 0x7fd4c40b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:26.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.241+0000 7fd4c9fe0700 1 --2- 172.21.15.2:0/2296455592 >> v2:172.21.15.192:3300/0 conn(0x7fd4c406b620 0x7fd4c40b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:26.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.241+0000 7fd4c8fde700 1 -- 172.21.15.2:0/2296455592 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3125963776 0 0) 0x7fd4c4071f50 con 0x7fd4c40b5ab0 2023-11-26T07:17:26.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.241+0000 7fd4c8fde700 1 -- 172.21.15.2:0/2296455592 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4b00035b0 con 0x7fd4c40b5ab0 2023-11-26T07:17:26.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.242+0000 7fd4ca7e1700 1 -- 172.21.15.2:0/2296455592 >> v2:172.21.15.192:3300/0 conn(0x7fd4c406b620 msgr2=0x7fd4c40b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:26.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.242+0000 7fd4ca7e1700 1 --2- 172.21.15.2:0/2296455592 >> v2:172.21.15.192:3300/0 conn(0x7fd4c406b620 0x7fd4c40b3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:26.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.242+0000 7fd4ca7e1700 1 -- 172.21.15.2:0/2296455592 >> v1:172.21.15.2:6789/0 conn(0x7fd4c40b5ab0 legacy=0x7fd4c4161ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:26.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.242+0000 7fd4ca7e1700 1 -- 172.21.15.2:0/2296455592 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c40727f0 con 0x7fd4c406ee60 2023-11-26T07:17:26.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.242+0000 7fd4ca7e1700 1 --2- 172.21.15.2:0/2296455592 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4c406ee60 0x7fd4c40b3f80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc009d90 tx=0x7fd4bc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a59cb5db905e9b04 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:26.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.242+0000 7fd4c8fde700 1 -- 172.21.15.2:0/2296455592 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc00e070 con 0x7fd4c406ee60 2023-11-26T07:17:26.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.242+0000 7fd4c8fde700 1 -- 172.21.15.2:0/2296455592 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4bc00bb20 con 0x7fd4c406ee60 2023-11-26T07:17:26.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.242+0000 7fd4c8fde700 1 -- 172.21.15.2:0/2296455592 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc012430 con 0x7fd4c406ee60 2023-11-26T07:17:26.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.243+0000 7fd4cc244700 1 -- 172.21.15.2:0/2296455592 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4c406ee60 msgr2=0x7fd4c40b3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:26.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.243+0000 7fd4cc244700 1 --2- 172.21.15.2:0/2296455592 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4c406ee60 0x7fd4c40b3f80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc009d90 tx=0x7fd4bc00b330 comp rx=0 tx=0).stop 2023-11-26T07:17:26.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.243+0000 7fd4cc244700 1 -- 172.21.15.2:0/2296455592 shutdown_connections 2023-11-26T07:17:26.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.243+0000 7fd4cc244700 1 --2- 172.21.15.2:0/2296455592 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4c406ee60 0x7fd4c40b3f80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:26.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.243+0000 7fd4cc244700 1 --2- 172.21.15.2:0/2296455592 >> v2:172.21.15.192:3300/0 conn(0x7fd4c406b620 0x7fd4c40b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:26.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.243+0000 7fd4cc244700 1 -- 172.21.15.2:0/2296455592 >> 172.21.15.2:0/2296455592 conn(0x7fd4c40b2740 msgr2=0x7fd4c40b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:26.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.243+0000 7fd4cc244700 1 -- 172.21.15.2:0/2296455592 shutdown_connections 2023-11-26T07:17:26.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.243+0000 7fd4cc244700 1 -- 172.21.15.2:0/2296455592 wait complete. 2023-11-26T07:17:26.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.245+0000 7fd4cc244700 1 Processor -- start 2023-11-26T07:17:26.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.245+0000 7fd4cc244700 1 -- start start 2023-11-26T07:17:26.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.246+0000 7fd4cc244700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4c406b620 0x7fd4c413ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:26.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.246+0000 7fd4cc244700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4c406ee60 0x7fd4c413b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:26.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.246+0000 7fd4cc244700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c40b5ab0 0x7fd4c40ae260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:26.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.246+0000 7fd4cc244700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c413bf50 con 0x7fd4c40b5ab0 2023-11-26T07:17:26.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.246+0000 7fd4cc244700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c413c230 con 0x7fd4c406ee60 2023-11-26T07:17:26.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.246+0000 7fd4cc244700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c413c510 con 0x7fd4c406b620 2023-11-26T07:17:26.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.246+0000 7fd4ca7e1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c40b5ab0 0x7fd4c40ae260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:26.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.246+0000 7fd4ca7e1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c40b5ab0 0x7fd4c40ae260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44748/0 (socket says 172.21.15.2:44748) 2023-11-26T07:17:26.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.246+0000 7fd4ca7e1700 1 -- 172.21.15.2:0/1978414972 learned_addr learned my addr 172.21.15.2:0/1978414972 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:26.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.246+0000 7fd4c9fe0700 1 --2- 172.21.15.2:0/1978414972 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4c406b620 0x7fd4c413ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:26.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.246+0000 7fd4c97df700 1 --2- 172.21.15.2:0/1978414972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4c406ee60 0x7fd4c413b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:26.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.246+0000 7fd4ca7e1700 1 -- 172.21.15.2:0/1978414972 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4c406b620 msgr2=0x7fd4c413ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:26.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.246+0000 7fd4ca7e1700 1 --2- 172.21.15.2:0/1978414972 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4c406b620 0x7fd4c413ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:26.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.246+0000 7fd4ca7e1700 1 -- 172.21.15.2:0/1978414972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4c406ee60 msgr2=0x7fd4c413b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:26.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.246+0000 7fd4ca7e1700 1 --2- 172.21.15.2:0/1978414972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4c406ee60 0x7fd4c413b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:26.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.246+0000 7fd4ca7e1700 1 -- 172.21.15.2:0/1978414972 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4bc009a70 con 0x7fd4c40b5ab0 2023-11-26T07:17:26.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.246+0000 7fd4c9fe0700 1 --2- 172.21.15.2:0/1978414972 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4c406b620 0x7fd4c413ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:26.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.247+0000 7fd4ca7e1700 1 --2- 172.21.15.2:0/1978414972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c40b5ab0 0x7fd4c40ae260 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc014040 tx=0x7fd4bc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:26.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.247+0000 7fd4ba7fc700 1 -- 172.21.15.2:0/1978414972 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc0129f0 con 0x7fd4c40b5ab0 2023-11-26T07:17:26.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.247+0000 7fd4ba7fc700 1 -- 172.21.15.2:0/1978414972 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4bc020070 con 0x7fd4c40b5ab0 2023-11-26T07:17:26.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.247+0000 7fd4cc244700 1 -- 172.21.15.2:0/1978414972 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4c413c7f0 con 0x7fd4c40b5ab0 2023-11-26T07:17:26.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.247+0000 7fd4ba7fc700 1 -- 172.21.15.2:0/1978414972 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc012db0 con 0x7fd4c40b5ab0 2023-11-26T07:17:26.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.247+0000 7fd4cc244700 1 -- 172.21.15.2:0/1978414972 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4c413b320 con 0x7fd4c40b5ab0 2023-11-26T07:17:26.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.248+0000 7fd4cc244700 1 -- 172.21.15.2:0/1978414972 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4c4075480 con 0x7fd4c40b5ab0 2023-11-26T07:17:26.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.248+0000 7fd4ba7fc700 1 -- 172.21.15.2:0/1978414972 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7fd4bc004040 con 0x7fd4c40b5ab0 2023-11-26T07:17:26.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.249+0000 7fd4ba7fc700 1 --2- 172.21.15.2:0/1978414972 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd4a806b980 0x7fd4a806de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:26.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.249+0000 7fd4ba7fc700 1 -- 172.21.15.2:0/1978414972 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd4bc022070 con 0x7fd4c40b5ab0 2023-11-26T07:17:26.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.249+0000 7fd4c9fe0700 1 --2- 172.21.15.2:0/1978414972 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd4a806b980 0x7fd4a806de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:26.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.249+0000 7fd4c9fe0700 1 --2- 172.21.15.2:0/1978414972 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd4a806b980 0x7fd4a806de40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0009c30 tx=0x7fd4c0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:26.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.254+0000 7fd4ba7fc700 1 -- 172.21.15.2:0/1978414972 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd4bc05a5a0 con 0x7fd4c40b5ab0 2023-11-26T07:17:26.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.529+0000 7fd4cc244700 1 -- 172.21.15.2:0/1978414972 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone33480", "target": ["mon-mgr", ""]}) v1 -- 0x7fd4c406ba00 con 0x7fd4a806b980 2023-11-26T07:17:26.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.536+0000 7fd4ba7fc700 1 -- 172.21.15.2:0/1978414972 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+169 (secure 0 0 0) 0x7fd4c0009960 con 0x7fd4a806b980 2023-11-26T07:17:26.538 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-26T07:17:26.538 INFO:teuthology.orchestra.run.smithi002.stdout: "status": { 2023-11-26T07:17:26.538 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "in-progress", 2023-11-26T07:17:26.539 INFO:teuthology.orchestra.run.smithi002.stdout: "source": { 2023-11-26T07:17:26.539 INFO:teuthology.orchestra.run.smithi002.stdout: "volume": "cephfs", 2023-11-26T07:17:26.539 INFO:teuthology.orchestra.run.smithi002.stdout: "subvolume": "subvol83060", 2023-11-26T07:17:26.539 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot": "subvol_snap31270" 2023-11-26T07:17:26.539 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:17:26.539 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:17:26.539 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-26T07:17:26.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.539+0000 7fd4cc244700 1 -- 172.21.15.2:0/1978414972 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd4a806b980 msgr2=0x7fd4a806de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:26.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.539+0000 7fd4cc244700 1 --2- 172.21.15.2:0/1978414972 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd4a806b980 0x7fd4a806de40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0009c30 tx=0x7fd4c0008040 comp rx=0 tx=0).stop 2023-11-26T07:17:26.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.539+0000 7fd4cc244700 1 -- 172.21.15.2:0/1978414972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c40b5ab0 msgr2=0x7fd4c40ae260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:26.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.539+0000 7fd4cc244700 1 --2- 172.21.15.2:0/1978414972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c40b5ab0 0x7fd4c40ae260 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc014040 tx=0x7fd4bc004ad0 comp rx=0 tx=0).stop 2023-11-26T07:17:26.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.539+0000 7fd4cc244700 1 -- 172.21.15.2:0/1978414972 shutdown_connections 2023-11-26T07:17:26.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.539+0000 7fd4cc244700 1 --2- 172.21.15.2:0/1978414972 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd4a806b980 0x7fd4a806de40 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:26.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.539+0000 7fd4cc244700 1 --2- 172.21.15.2:0/1978414972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c40b5ab0 0x7fd4c40ae260 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:26.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.539+0000 7fd4cc244700 1 --2- 172.21.15.2:0/1978414972 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4c406b620 0x7fd4c413ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:26.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.539+0000 7fd4cc244700 1 --2- 172.21.15.2:0/1978414972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4c406ee60 0x7fd4c413b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:26.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.539+0000 7fd4cc244700 1 -- 172.21.15.2:0/1978414972 >> 172.21.15.2:0/1978414972 conn(0x7fd4c40b2740 msgr2=0x7fd4c4146c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:26.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.539+0000 7fd4cc244700 1 -- 172.21.15.2:0/1978414972 shutdown_connections 2023-11-26T07:17:26.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:26.539+0000 7fd4cc244700 1 -- 172.21.15.2:0/1978414972 wait complete. 2023-11-26T07:17:27.555 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone33480 2023-11-26T07:17:27.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.690+0000 7f7c16dd3700 1 Processor -- start 2023-11-26T07:17:27.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.690+0000 7f7c16dd3700 1 -- start start 2023-11-26T07:17:27.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.690+0000 7f7c16dd3700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7c1015bde0 0x7f7c1015c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:27.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.690+0000 7f7c16dd3700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c100d0a90 con 0x7f7c100cf2b0 2023-11-26T07:17:27.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.690+0000 7f7c16dd3700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c1006ee10 con 0x7f7c100ce5c0 2023-11-26T07:17:27.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.690+0000 7f7c16dd3700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c1006f0f0 con 0x7f7c1015bde0 2023-11-26T07:17:27.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.691+0000 7f7c14b6f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7c1015bde0 0x7f7c1015c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:27.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.691+0000 7f7c0ffff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7c100cf2b0 0x7f7c100d01b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35962/0 (socket says 172.21.15.2:35962) 2023-11-26T07:17:27.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.691+0000 7f7c0ffff700 1 -- 172.21.15.2:0/2576660788 learned_addr learned my addr 172.21.15.2:0/2576660788 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:27.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.691+0000 7f7c14b6f700 1 -- 172.21.15.2:0/2576660788 >> v1:172.21.15.192:6789/0 conn(0x7f7c100ce5c0 legacy=0x7f7c1006fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:27.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.691+0000 7f7c14b6f700 1 -- 172.21.15.2:0/2576660788 >> v1:172.21.15.2:6789/0 conn(0x7f7c100cf2b0 legacy=0x7f7c100d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:27.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.691+0000 7f7c0f7fe700 1 -- 172.21.15.2:0/2576660788 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2843616898 0 0) 0x7f7c100d0a90 con 0x7f7c100cf2b0 2023-11-26T07:17:27.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.691+0000 7f7c14b6f700 1 -- 172.21.15.2:0/2576660788 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c1006f3d0 con 0x7f7c1015bde0 2023-11-26T07:17:27.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.691+0000 7f7c14b6f700 1 --2- 172.21.15.2:0/2576660788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c1015bde0 0x7f7c1015c1c0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f7c04009840 tx=0x7f7c04009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b47a8820df1702db server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:27.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.691+0000 7f7c0f7fe700 1 -- 172.21.15.2:0/2576660788 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c04011830 con 0x7f7c1015bde0 2023-11-26T07:17:27.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.691+0000 7f7c0f7fe700 1 -- 172.21.15.2:0/2576660788 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c04011990 con 0x7f7c1015bde0 2023-11-26T07:17:27.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.691+0000 7f7c0f7fe700 1 -- 172.21.15.2:0/2576660788 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c04011d20 con 0x7f7c1015bde0 2023-11-26T07:17:27.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.692+0000 7f7c16dd3700 1 -- 172.21.15.2:0/2576660788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c1015bde0 msgr2=0x7f7c1015c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:27.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.692+0000 7f7c16dd3700 1 --2- 172.21.15.2:0/2576660788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c1015bde0 0x7f7c1015c1c0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f7c04009840 tx=0x7f7c04009b50 comp rx=0 tx=0).stop 2023-11-26T07:17:27.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.692+0000 7f7c16dd3700 1 -- 172.21.15.2:0/2576660788 shutdown_connections 2023-11-26T07:17:27.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.692+0000 7f7c16dd3700 1 --2- 172.21.15.2:0/2576660788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c1015bde0 0x7f7c1015c1c0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:27.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.692+0000 7f7c16dd3700 1 -- 172.21.15.2:0/2576660788 >> 172.21.15.2:0/2576660788 conn(0x7f7c100b3720 msgr2=0x7f7c100b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:27.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.692+0000 7f7c16dd3700 1 -- 172.21.15.2:0/2576660788 shutdown_connections 2023-11-26T07:17:27.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.692+0000 7f7c16dd3700 1 -- 172.21.15.2:0/2576660788 wait complete. 2023-11-26T07:17:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.693+0000 7f7c16dd3700 1 Processor -- start 2023-11-26T07:17:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.693+0000 7f7c16dd3700 1 -- start start 2023-11-26T07:17:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.694+0000 7f7c16dd3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c100ce5c0 0x7f7c100ca830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.694+0000 7f7c16dd3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c100cf2b0 0x7f7c101f57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.694+0000 7f7c16dd3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c1015bde0 0x7f7c10158e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.694+0000 7f7c16dd3700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c100b4e30 con 0x7f7c100ce5c0 2023-11-26T07:17:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.694+0000 7f7c16dd3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c100cad70 con 0x7f7c1015bde0 2023-11-26T07:17:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.694+0000 7f7c16dd3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c101f5d30 con 0x7f7c100cf2b0 2023-11-26T07:17:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.694+0000 7f7c14b6f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c100ce5c0 0x7f7c100ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.694+0000 7f7c14b6f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c100ce5c0 0x7f7c100ca830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44758/0 (socket says 172.21.15.2:44758) 2023-11-26T07:17:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.694+0000 7f7c14b6f700 1 -- 172.21.15.2:0/4040763036 learned_addr learned my addr 172.21.15.2:0/4040763036 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:27.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.694+0000 7f7c15370700 1 --2- 172.21.15.2:0/4040763036 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c1015bde0 0x7f7c10158e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:27.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.694+0000 7f7c14b6f700 1 -- 172.21.15.2:0/4040763036 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c100cf2b0 msgr2=0x7f7c101f57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:27.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.694+0000 7f7c14b6f700 1 --2- 172.21.15.2:0/4040763036 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c100cf2b0 0x7f7c101f57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:27.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.695+0000 7f7c14b6f700 1 -- 172.21.15.2:0/4040763036 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c1015bde0 msgr2=0x7f7c10158e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:27.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.695+0000 7f7c14b6f700 1 --2- 172.21.15.2:0/4040763036 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c1015bde0 0x7f7c10158e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:27.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.695+0000 7f7c14b6f700 1 -- 172.21.15.2:0/4040763036 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c040094a0 con 0x7f7c100ce5c0 2023-11-26T07:17:27.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.695+0000 7f7c15370700 1 --2- 172.21.15.2:0/4040763036 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c1015bde0 0x7f7c10158e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:27.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.695+0000 7f7c14b6f700 1 --2- 172.21.15.2:0/4040763036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c100ce5c0 0x7f7c100ca830 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f7c04014040 tx=0x7f7c04004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:27.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.695+0000 7f7c0d7fa700 1 -- 172.21.15.2:0/4040763036 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0401a980 con 0x7f7c100ce5c0 2023-11-26T07:17:27.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.695+0000 7f7c0d7fa700 1 -- 172.21.15.2:0/4040763036 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0401ab00 con 0x7f7c100ce5c0 2023-11-26T07:17:27.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.695+0000 7f7c16dd3700 1 -- 172.21.15.2:0/4040763036 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c100c8d40 con 0x7f7c100ce5c0 2023-11-26T07:17:27.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.695+0000 7f7c0d7fa700 1 -- 172.21.15.2:0/4040763036 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c04024420 con 0x7f7c100ce5c0 2023-11-26T07:17:27.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.695+0000 7f7c16dd3700 1 -- 172.21.15.2:0/4040763036 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c100c8fe0 con 0x7f7c100ce5c0 2023-11-26T07:17:27.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.696+0000 7f7c16dd3700 1 -- 172.21.15.2:0/4040763036 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c100c9350 con 0x7f7c100ce5c0 2023-11-26T07:17:27.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.696+0000 7f7c0d7fa700 1 -- 172.21.15.2:0/4040763036 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f7c04022070 con 0x7f7c100ce5c0 2023-11-26T07:17:27.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.697+0000 7f7c0d7fa700 1 --2- 172.21.15.2:0/4040763036 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7bf406b980 0x7f7bf406de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:27.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.697+0000 7f7c0d7fa700 1 -- 172.21.15.2:0/4040763036 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f7c04089450 con 0x7f7c100ce5c0 2023-11-26T07:17:27.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.697+0000 7f7c0ffff700 1 --2- 172.21.15.2:0/4040763036 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7bf406b980 0x7f7bf406de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:27.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.697+0000 7f7c0ffff700 1 --2- 172.21.15.2:0/4040763036 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7bf406b980 0x7f7bf406de40 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc000c00 tx=0x7f7bfc007990 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:27.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.701+0000 7f7c0d7fa700 1 -- 172.21.15.2:0/4040763036 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7c04055d80 con 0x7f7c100ce5c0 2023-11-26T07:17:27.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.947+0000 7f7c16dd3700 1 -- 172.21.15.2:0/4040763036 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone33480", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c100cfe90 con 0x7f7bf406b980 2023-11-26T07:17:27.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.960+0000 7f7c0d7fa700 1 -- 172.21.15.2:0/4040763036 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+46 (secure 0 0 0) 0x7f7c100cfe90 con 0x7f7bf406b980 2023-11-26T07:17:27.962 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-26T07:17:27.962 INFO:teuthology.orchestra.run.smithi002.stdout: "status": { 2023-11-26T07:17:27.962 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "complete" 2023-11-26T07:17:27.962 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:17:27.962 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-26T07:17:27.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.962+0000 7f7c16dd3700 1 -- 172.21.15.2:0/4040763036 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7bf406b980 msgr2=0x7f7bf406de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:27.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.962+0000 7f7c16dd3700 1 --2- 172.21.15.2:0/4040763036 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7bf406b980 0x7f7bf406de40 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc000c00 tx=0x7f7bfc007990 comp rx=0 tx=0).stop 2023-11-26T07:17:27.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.962+0000 7f7c16dd3700 1 -- 172.21.15.2:0/4040763036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c100ce5c0 msgr2=0x7f7c100ca830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:27.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.962+0000 7f7c16dd3700 1 --2- 172.21.15.2:0/4040763036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c100ce5c0 0x7f7c100ca830 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f7c04014040 tx=0x7f7c04004750 comp rx=0 tx=0).stop 2023-11-26T07:17:27.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.962+0000 7f7c16dd3700 1 -- 172.21.15.2:0/4040763036 shutdown_connections 2023-11-26T07:17:27.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.962+0000 7f7c16dd3700 1 --2- 172.21.15.2:0/4040763036 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f7bf406b980 0x7f7bf406de40 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:27.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.962+0000 7f7c16dd3700 1 --2- 172.21.15.2:0/4040763036 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c1015bde0 0x7f7c10158e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:27.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.962+0000 7f7c16dd3700 1 --2- 172.21.15.2:0/4040763036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c100ce5c0 0x7f7c100ca830 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:27.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.962+0000 7f7c16dd3700 1 --2- 172.21.15.2:0/4040763036 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c100cf2b0 0x7f7c101f57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:27.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.962+0000 7f7c16dd3700 1 -- 172.21.15.2:0/4040763036 >> 172.21.15.2:0/4040763036 conn(0x7f7c100b3720 msgr2=0x7f7c100b3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:27.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.963+0000 7f7c16dd3700 1 -- 172.21.15.2:0/4040763036 shutdown_connections 2023-11-26T07:17:27.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:27.963+0000 7f7c16dd3700 1 -- 172.21.15.2:0/4040763036 wait complete. 2023-11-26T07:17:27.979 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone33480 2023-11-26T07:17:28.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.105+0000 7f34c002c700 1 Processor -- start 2023-11-26T07:17:28.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.105+0000 7f34c002c700 1 -- start start 2023-11-26T07:17:28.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.106+0000 7f34c002c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f34b8142810 0x7f34b806afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:28.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.106+0000 7f34c002c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f34b81459a0 0x7f34b806b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:28.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.106+0000 7f34c002c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f34b806e580 0x7f34b8071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:28.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.106+0000 7f34c002c700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34b80cf5f0 con 0x7f34b81459a0 2023-11-26T07:17:28.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.106+0000 7f34c002c700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34b806ea80 con 0x7f34b806e580 2023-11-26T07:17:28.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.106+0000 7f34c002c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b806ed60 con 0x7f34b8142810 2023-11-26T07:17:28.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.106+0000 7f34bd5c7700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f34b81459a0 0x7f34b806b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:28.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.106+0000 7f34bd5c7700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f34b81459a0 0x7f34b806b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44768/0 (socket says 172.21.15.2:44768) 2023-11-26T07:17:28.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.106+0000 7f34bd5c7700 1 -- 172.21.15.2:0/2627234340 learned_addr learned my addr 172.21.15.2:0/2627234340 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:28.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.106+0000 7f34bd5c7700 1 -- 172.21.15.2:0/2627234340 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f34b8142810 msgr2=0x7f34b806afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:28.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.106+0000 7f34bd5c7700 1 --2- 172.21.15.2:0/2627234340 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f34b8142810 0x7f34b806afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:28.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.106+0000 7f34bd5c7700 1 -- 172.21.15.2:0/2627234340 >> v2:172.21.15.192:3300/0 conn(0x7f34b806e580 msgr2=0x7f34b8071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:28.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.106+0000 7f34bd5c7700 1 --2- 172.21.15.2:0/2627234340 >> v2:172.21.15.192:3300/0 conn(0x7f34b806e580 0x7f34b8071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:28.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.106+0000 7f34bd5c7700 1 -- 172.21.15.2:0/2627234340 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b806f040 con 0x7f34b81459a0 2023-11-26T07:17:28.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.106+0000 7f34bd5c7700 1 --2- 172.21.15.2:0/2627234340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34b81459a0 0x7f34b806b510 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f34b80679e0 tx=0x7f34a8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34b864e498eed0ed server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:28.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.107+0000 7f34bcdc6700 1 -- 172.21.15.2:0/2627234340 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a800b870 con 0x7f34b81459a0 2023-11-26T07:17:28.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.107+0000 7f34bcdc6700 1 -- 172.21.15.2:0/2627234340 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a800b9d0 con 0x7f34b81459a0 2023-11-26T07:17:28.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.107+0000 7f34bcdc6700 1 -- 172.21.15.2:0/2627234340 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a800bd60 con 0x7f34b81459a0 2023-11-26T07:17:28.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.107+0000 7f34c002c700 1 -- 172.21.15.2:0/2627234340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34b81459a0 msgr2=0x7f34b806b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:28.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.107+0000 7f34c002c700 1 --2- 172.21.15.2:0/2627234340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34b81459a0 0x7f34b806b510 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f34b80679e0 tx=0x7f34a8009bd0 comp rx=0 tx=0).stop 2023-11-26T07:17:28.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.107+0000 7f34c002c700 1 -- 172.21.15.2:0/2627234340 shutdown_connections 2023-11-26T07:17:28.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.107+0000 7f34c002c700 1 --2- 172.21.15.2:0/2627234340 >> v2:172.21.15.192:3300/0 conn(0x7f34b806e580 0x7f34b8071bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:28.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.107+0000 7f34c002c700 1 --2- 172.21.15.2:0/2627234340 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f34b8142810 0x7f34b806afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:28.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.107+0000 7f34c002c700 1 --2- 172.21.15.2:0/2627234340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34b81459a0 0x7f34b806b510 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:28.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.107+0000 7f34c002c700 1 -- 172.21.15.2:0/2627234340 >> 172.21.15.2:0/2627234340 conn(0x7f34b80b2740 msgr2=0x7f34b80b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:28.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.107+0000 7f34c002c700 1 -- 172.21.15.2:0/2627234340 shutdown_connections 2023-11-26T07:17:28.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.107+0000 7f34c002c700 1 -- 172.21.15.2:0/2627234340 wait complete. 2023-11-26T07:17:28.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.108+0000 7f34c002c700 1 Processor -- start 2023-11-26T07:17:28.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.108+0000 7f34c002c700 1 -- start start 2023-11-26T07:17:28.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.109+0000 7f34c002c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34b806e580 0x7f34b80a96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:28.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.109+0000 7f34c002c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34b8142810 0x7f34b81f0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.109+0000 7f34c002c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f34b81459a0 0x7f34b81f0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.109+0000 7f34c002c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b81f1520 con 0x7f34b806e580 2023-11-26T07:17:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.109+0000 7f34c002c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b813f1d0 con 0x7f34b8142810 2023-11-26T07:17:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.109+0000 7f34c002c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b813f4b0 con 0x7f34b81459a0 2023-11-26T07:17:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.109+0000 7f34bddc8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34b806e580 0x7f34b80a96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.109+0000 7f34bddc8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34b806e580 0x7f34b80a96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44772/0 (socket says 172.21.15.2:44772) 2023-11-26T07:17:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.109+0000 7f34bddc8700 1 -- 172.21.15.2:0/2630913925 learned_addr learned my addr 172.21.15.2:0/2630913925 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.110+0000 7f34bddc8700 1 -- 172.21.15.2:0/2630913925 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f34b81459a0 msgr2=0x7f34b81f0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.110+0000 7f34bd5c7700 1 --2- 172.21.15.2:0/2630913925 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34b8142810 0x7f34b81f0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.110+0000 7f34be5c9700 1 --2- 172.21.15.2:0/2630913925 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f34b81459a0 0x7f34b81f0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.110+0000 7f34bddc8700 1 --2- 172.21.15.2:0/2630913925 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f34b81459a0 0x7f34b81f0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.110+0000 7f34bddc8700 1 -- 172.21.15.2:0/2630913925 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34b8142810 msgr2=0x7f34b81f0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:28.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.110+0000 7f34bddc8700 1 --2- 172.21.15.2:0/2630913925 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34b8142810 0x7f34b81f0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:28.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.110+0000 7f34bddc8700 1 -- 172.21.15.2:0/2630913925 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a8009550 con 0x7f34b806e580 2023-11-26T07:17:28.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.110+0000 7f34bd5c7700 1 --2- 172.21.15.2:0/2630913925 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34b8142810 0x7f34b81f0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:28.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.110+0000 7f34be5c9700 1 --2- 172.21.15.2:0/2630913925 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f34b81459a0 0x7f34b81f0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:28.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.110+0000 7f34bddc8700 1 --2- 172.21.15.2:0/2630913925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34b806e580 0x7f34b80a96c0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f34b400b530 tx=0x7f34b400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:28.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.110+0000 7f34ae7fc700 1 -- 172.21.15.2:0/2630913925 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b4011830 con 0x7f34b806e580 2023-11-26T07:17:28.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.110+0000 7f34ae7fc700 1 -- 172.21.15.2:0/2630913925 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b40119b0 con 0x7f34b806e580 2023-11-26T07:17:28.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.110+0000 7f34c002c700 1 -- 172.21.15.2:0/2630913925 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34b80cfa80 con 0x7f34b806e580 2023-11-26T07:17:28.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.110+0000 7f34ae7fc700 1 -- 172.21.15.2:0/2630913925 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b4011d60 con 0x7f34b806e580 2023-11-26T07:17:28.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.110+0000 7f34c002c700 1 -- 172.21.15.2:0/2630913925 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34b80d0040 con 0x7f34b806e580 2023-11-26T07:17:28.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.111+0000 7f34c002c700 1 -- 172.21.15.2:0/2630913925 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34b8075480 con 0x7f34b806e580 2023-11-26T07:17:28.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.111+0000 7f34ae7fc700 1 -- 172.21.15.2:0/2630913925 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f34b401a400 con 0x7f34b806e580 2023-11-26T07:17:28.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.112+0000 7f34ae7fc700 1 --2- 172.21.15.2:0/2630913925 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f349c06b980 0x7f349c06de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:28.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.112+0000 7f34ae7fc700 1 -- 172.21.15.2:0/2630913925 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f34b4087fc0 con 0x7f34b806e580 2023-11-26T07:17:28.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.112+0000 7f34bd5c7700 1 --2- 172.21.15.2:0/2630913925 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f349c06b980 0x7f349c06de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:28.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.113+0000 7f34bd5c7700 1 --2- 172.21.15.2:0/2630913925 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f349c06b980 0x7f349c06de40 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f34b813dd40 tx=0x7f34a8008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:28.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.117+0000 7f34ae7fc700 1 -- 172.21.15.2:0/2630913925 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f34b4054b20 con 0x7f34b806e580 2023-11-26T07:17:28.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.362+0000 7f34c002c700 1 -- 172.21.15.2:0/2630913925 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone33480", "target": ["mon-mgr", ""]}) v1 -- 0x7f34b8141fc0 con 0x7f349c06b980 2023-11-26T07:17:28.372 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.370+0000 7f34ae7fc700 1 -- 172.21.15.2:0/2630913925 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+46 (secure 0 0 0) 0x7f34b8141fc0 con 0x7f349c06b980 2023-11-26T07:17:28.372 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-26T07:17:28.372 INFO:teuthology.orchestra.run.smithi002.stdout: "status": { 2023-11-26T07:17:28.372 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "complete" 2023-11-26T07:17:28.372 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-26T07:17:28.372 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-26T07:17:28.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.372+0000 7f34c002c700 1 -- 172.21.15.2:0/2630913925 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f349c06b980 msgr2=0x7f349c06de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:28.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.372+0000 7f34c002c700 1 --2- 172.21.15.2:0/2630913925 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f349c06b980 0x7f349c06de40 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f34b813dd40 tx=0x7f34a8008030 comp rx=0 tx=0).stop 2023-11-26T07:17:28.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.372+0000 7f34c002c700 1 -- 172.21.15.2:0/2630913925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34b806e580 msgr2=0x7f34b80a96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:28.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.372+0000 7f34c002c700 1 --2- 172.21.15.2:0/2630913925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34b806e580 0x7f34b80a96c0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f34b400b530 tx=0x7f34b400b8f0 comp rx=0 tx=0).stop 2023-11-26T07:17:28.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.372+0000 7f34c002c700 1 -- 172.21.15.2:0/2630913925 shutdown_connections 2023-11-26T07:17:28.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.372+0000 7f34c002c700 1 --2- 172.21.15.2:0/2630913925 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f349c06b980 0x7f349c06de40 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:28.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.372+0000 7f34c002c700 1 --2- 172.21.15.2:0/2630913925 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f34b81459a0 0x7f34b81f0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:28.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.372+0000 7f34c002c700 1 --2- 172.21.15.2:0/2630913925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34b806e580 0x7f34b80a96c0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:28.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.372+0000 7f34c002c700 1 --2- 172.21.15.2:0/2630913925 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34b8142810 0x7f34b81f0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:28.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.372+0000 7f34c002c700 1 -- 172.21.15.2:0/2630913925 >> 172.21.15.2:0/2630913925 conn(0x7f34b80b2740 msgr2=0x7f34b80b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:28.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.372+0000 7f34c002c700 1 -- 172.21.15.2:0/2630913925 shutdown_connections 2023-11-26T07:17:28.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.372+0000 7f34c002c700 1 -- 172.21.15.2:0/2630913925 wait complete. 2023-11-26T07:17:28.389 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvol83060 subvol_snap31270 2023-11-26T07:17:28.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.517+0000 7fd593a87700 1 Processor -- start 2023-11-26T07:17:28.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.517+0000 7fd593a87700 1 -- start start 2023-11-26T07:17:28.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.518+0000 7fd593a87700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd58c15bf20 0x7fd58c066ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:28.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.518+0000 7fd593a87700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd58c0d0980 0x7fd58c06b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:28.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.518+0000 7fd593a87700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd58c06afd0 con 0x7fd58c0b5e40 2023-11-26T07:17:28.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.518+0000 7fd593a87700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd58c0ad400 con 0x7fd58c15bf20 2023-11-26T07:17:28.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.518+0000 7fd593a87700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd58c0af560 con 0x7fd58c0d0980 2023-11-26T07:17:28.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.518+0000 7fd591823700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd58c15bf20 0x7fd58c066ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:28.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.518+0000 7fd591022700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd58c0b5e40 0x7fd58c0d0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35992/0 (socket says 172.21.15.2:35992) 2023-11-26T07:17:28.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.518+0000 7fd591022700 1 -- 172.21.15.2:0/3495301644 learned_addr learned my addr 172.21.15.2:0/3495301644 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:28.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.519+0000 7fd591823700 1 -- 172.21.15.2:0/3495301644 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd58c0d0980 msgr2=0x7fd58c06b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:28.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.519+0000 7fd592024700 1 --2- 172.21.15.2:0/3495301644 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd58c0d0980 0x7fd58c06b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:28.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.519+0000 7fd591823700 1 --2- 172.21.15.2:0/3495301644 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd58c0d0980 0x7fd58c06b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:28.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.519+0000 7fd590821700 1 -- 172.21.15.2:0/3495301644 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3948763972 0 0) 0x7fd58c06afd0 con 0x7fd58c0b5e40 2023-11-26T07:17:28.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.519+0000 7fd591823700 1 -- 172.21.15.2:0/3495301644 >> v1:172.21.15.2:6789/0 conn(0x7fd58c0b5e40 legacy=0x7fd58c0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:28.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.519+0000 7fd591823700 1 -- 172.21.15.2:0/3495301644 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd58c067220 con 0x7fd58c15bf20 2023-11-26T07:17:28.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.519+0000 7fd591823700 1 --2- 172.21.15.2:0/3495301644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd58c15bf20 0x7fd58c066ce0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fd57c009840 tx=0x7fd57c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=793e9e3d9714fae3 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:28.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.519+0000 7fd590821700 1 -- 172.21.15.2:0/3495301644 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57c011830 con 0x7fd58c15bf20 2023-11-26T07:17:28.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.519+0000 7fd590821700 1 -- 172.21.15.2:0/3495301644 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57c011990 con 0x7fd58c15bf20 2023-11-26T07:17:28.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.519+0000 7fd590821700 1 -- 172.21.15.2:0/3495301644 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57c011d20 con 0x7fd58c15bf20 2023-11-26T07:17:28.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.520+0000 7fd593a87700 1 -- 172.21.15.2:0/3495301644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd58c15bf20 msgr2=0x7fd58c066ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:28.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.520+0000 7fd593a87700 1 --2- 172.21.15.2:0/3495301644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd58c15bf20 0x7fd58c066ce0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fd57c009840 tx=0x7fd57c009b50 comp rx=0 tx=0).stop 2023-11-26T07:17:28.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.520+0000 7fd593a87700 1 -- 172.21.15.2:0/3495301644 shutdown_connections 2023-11-26T07:17:28.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.520+0000 7fd593a87700 1 --2- 172.21.15.2:0/3495301644 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd58c0d0980 0x7fd58c06b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:28.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.520+0000 7fd593a87700 1 --2- 172.21.15.2:0/3495301644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd58c15bf20 0x7fd58c066ce0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:28.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.520+0000 7fd593a87700 1 -- 172.21.15.2:0/3495301644 >> 172.21.15.2:0/3495301644 conn(0x7fd58c0b5070 msgr2=0x7fd58c0b5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:28.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.520+0000 7fd593a87700 1 -- 172.21.15.2:0/3495301644 shutdown_connections 2023-11-26T07:17:28.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.520+0000 7fd593a87700 1 -- 172.21.15.2:0/3495301644 wait complete. 2023-11-26T07:17:28.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.521+0000 7fd593a87700 1 Processor -- start 2023-11-26T07:17:28.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.521+0000 7fd593a87700 1 -- start start 2023-11-26T07:17:28.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.522+0000 7fd593a87700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd58c0b5e40 0x7fd58c156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:28.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.522+0000 7fd593a87700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd58c0d0980 0x7fd58c157f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:28.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.522+0000 7fd593a87700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd58c15bf20 0x7fd58c1e1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:28.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.522+0000 7fd593a87700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58c09cd90 con 0x7fd58c15bf20 2023-11-26T07:17:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.522+0000 7fd593a87700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58c09cf80 con 0x7fd58c0d0980 2023-11-26T07:17:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.522+0000 7fd593a87700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd58c09d260 con 0x7fd58c0b5e40 2023-11-26T07:17:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.522+0000 7fd592024700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd58c15bf20 0x7fd58c1e1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.522+0000 7fd592024700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd58c15bf20 0x7fd58c1e1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44790/0 (socket says 172.21.15.2:44790) 2023-11-26T07:17:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.522+0000 7fd592024700 1 -- 172.21.15.2:0/3294144326 learned_addr learned my addr 172.21.15.2:0/3294144326 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.522+0000 7fd591823700 1 --2- 172.21.15.2:0/3294144326 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd58c0b5e40 0x7fd58c156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.522+0000 7fd592024700 1 -- 172.21.15.2:0/3294144326 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd58c0b5e40 msgr2=0x7fd58c156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.522+0000 7fd591022700 1 --2- 172.21.15.2:0/3294144326 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd58c0d0980 0x7fd58c157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.522+0000 7fd592024700 1 --2- 172.21.15.2:0/3294144326 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd58c0b5e40 0x7fd58c156950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.522+0000 7fd592024700 1 -- 172.21.15.2:0/3294144326 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd58c0d0980 msgr2=0x7fd58c157f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.522+0000 7fd592024700 1 --2- 172.21.15.2:0/3294144326 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd58c0d0980 0x7fd58c157f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.522+0000 7fd592024700 1 -- 172.21.15.2:0/3294144326 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd57c0094a0 con 0x7fd58c15bf20 2023-11-26T07:17:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.522+0000 7fd592024700 1 --2- 172.21.15.2:0/3294144326 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd58c15bf20 0x7fd58c1e1780 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fd58400cd40 tx=0x7fd58400a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:28.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.522+0000 7fd5827fc700 1 -- 172.21.15.2:0/3294144326 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd584003a20 con 0x7fd58c15bf20 2023-11-26T07:17:28.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.523+0000 7fd5827fc700 1 -- 172.21.15.2:0/3294144326 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd584003b80 con 0x7fd58c15bf20 2023-11-26T07:17:28.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.523+0000 7fd593a87700 1 -- 172.21.15.2:0/3294144326 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd58c09d540 con 0x7fd58c15bf20 2023-11-26T07:17:28.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.523+0000 7fd5827fc700 1 -- 172.21.15.2:0/3294144326 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd584004020 con 0x7fd58c15bf20 2023-11-26T07:17:28.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.523+0000 7fd593a87700 1 -- 172.21.15.2:0/3294144326 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd58c09db00 con 0x7fd58c15bf20 2023-11-26T07:17:28.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.523+0000 7fd593a87700 1 -- 172.21.15.2:0/3294144326 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd58c09dc90 con 0x7fd58c15bf20 2023-11-26T07:17:28.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.524+0000 7fd5827fc700 1 -- 172.21.15.2:0/3294144326 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7fd584004180 con 0x7fd58c15bf20 2023-11-26T07:17:28.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.524+0000 7fd5827fc700 1 --2- 172.21.15.2:0/3294144326 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd57006b980 0x7fd57006de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:28.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.524+0000 7fd5827fc700 1 -- 172.21.15.2:0/3294144326 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd584012070 con 0x7fd58c15bf20 2023-11-26T07:17:28.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.525+0000 7fd591823700 1 --2- 172.21.15.2:0/3294144326 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd57006b980 0x7fd57006de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:28.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.525+0000 7fd591823700 1 --2- 172.21.15.2:0/3294144326 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fd57006b980 0x7fd57006de40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd57c000c00 tx=0x7fd57c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:28.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.529+0000 7fd5827fc700 1 -- 172.21.15.2:0/3294144326 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd5840552d0 con 0x7fd58c15bf20 2023-11-26T07:17:28.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.776+0000 7fd593a87700 1 -- 172.21.15.2:0/3294144326 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvol83060", "snap_name": "subvol_snap31270", "target": ["mon-mgr", ""]}) v1 -- 0x7fd58c06c5f0 con 0x7fd57006b980 2023-11-26T07:17:28.788 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-11-26T07:17:28.786+0000 7f8da6aa7700 -1 mgr.server reply reply (11) Resource temporarily unavailable snapshot 'subvol_snap31270' has pending clones 2023-11-26T07:17:28.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:28.786+0000 7fd5827fc700 1 -- 172.21.15.2:0/3294144326 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: -11 snapshot 'subvol_snap31270' has pending clones) v1 ==== 54+0+0 (secure 0 0 0) 0x7fd58c06c5f0 con 0x7fd57006b980 2023-11-26T07:17:28.790 INFO:teuthology.orchestra.run.smithi002.stderr:Error EAGAIN: snapshot 'subvol_snap31270' has pending clones 2023-11-26T07:17:28.793 DEBUG:teuthology.orchestra.run:got remote process result: 11 2023-11-26T07:17:28.794 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-26T07:17:28.795 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:17:28.846 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:17:28.897 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-26T07:17:28.897 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:28.897 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:28.915 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:28.915 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:28.973 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:17:29.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.137+0000 7fef15f86700 1 Processor -- start 2023-11-26T07:17:29.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.137+0000 7fef15f86700 1 -- start start 2023-11-26T07:17:29.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.138+0000 7fef15f86700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fef1015a820 0x7fef1006b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:29.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.138+0000 7fef15f86700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef100d06b0 0x7fef1006b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:29.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.138+0000 7fef15f86700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef100b05f0 con 0x7fef1015a440 2023-11-26T07:17:29.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.138+0000 7fef15f86700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef1015f080 con 0x7fef1015a820 2023-11-26T07:17:29.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.138+0000 7fef15f86700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef100afd50 con 0x7fef100d06b0 2023-11-26T07:17:29.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.138+0000 7fef0ffff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef100d06b0 0x7fef1006b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:29.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.138+0000 7fef0effd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fef1015a820 0x7fef1006b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:29.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.138+0000 7fef0f7fe700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fef1015a440 0x7fef100cffa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.2:43374/0 (socket says 172.21.15.2:43374) 2023-11-26T07:17:29.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.138+0000 7fef0f7fe700 1 -- 172.21.15.2:0/1975419753 learned_addr learned my addr 172.21.15.2:0/1975419753 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:29.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.139+0000 7fef0e7fc700 1 -- 172.21.15.2:0/1975419753 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1683762457 0 0) 0x7fef100b05f0 con 0x7fef1015a440 2023-11-26T07:17:29.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.139+0000 7fef0e7fc700 1 -- 172.21.15.2:0/1975419753 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feef80035b0 con 0x7fef1015a440 2023-11-26T07:17:29.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.139+0000 7fef0ffff700 1 -- 172.21.15.2:0/1975419753 >> v2:172.21.15.192:3300/0 conn(0x7fef1015a820 msgr2=0x7fef1006b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:29.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.139+0000 7fef0ffff700 1 --2- 172.21.15.2:0/1975419753 >> v2:172.21.15.192:3300/0 conn(0x7fef1015a820 0x7fef1006b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:29.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.139+0000 7fef0ffff700 1 -- 172.21.15.2:0/1975419753 >> v1:172.21.15.192:6789/0 conn(0x7fef1015a440 legacy=0x7fef100cffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:29.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.139+0000 7fef0ffff700 1 -- 172.21.15.2:0/1975419753 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef100b0030 con 0x7fef100d06b0 2023-11-26T07:17:29.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.139+0000 7fef0effd700 1 --2- 172.21.15.2:0/1975419753 >> v2:172.21.15.192:3300/0 conn(0x7fef1015a820 0x7fef1006b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:17:29.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.139+0000 7fef0ffff700 1 --2- 172.21.15.2:0/1975419753 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef100d06b0 0x7fef1006b880 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fef08009d90 tx=0x7fef0800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7cf9d3b8f790a6ea server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:29.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.139+0000 7fef0e7fc700 1 -- 172.21.15.2:0/1975419753 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0800e070 con 0x7fef100d06b0 2023-11-26T07:17:29.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.139+0000 7fef0e7fc700 1 -- 172.21.15.2:0/1975419753 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef0800bb20 con 0x7fef100d06b0 2023-11-26T07:17:29.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.139+0000 7fef0e7fc700 1 -- 172.21.15.2:0/1975419753 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0800be90 con 0x7fef100d06b0 2023-11-26T07:17:29.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.140+0000 7fef15f86700 1 -- 172.21.15.2:0/1975419753 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef100d06b0 msgr2=0x7fef1006b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:29.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.140+0000 7fef15f86700 1 --2- 172.21.15.2:0/1975419753 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef100d06b0 0x7fef1006b880 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fef08009d90 tx=0x7fef0800b330 comp rx=0 tx=0).stop 2023-11-26T07:17:29.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.140+0000 7fef15f86700 1 -- 172.21.15.2:0/1975419753 shutdown_connections 2023-11-26T07:17:29.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.140+0000 7fef15f86700 1 --2- 172.21.15.2:0/1975419753 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef100d06b0 0x7fef1006b880 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:29.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.140+0000 7fef15f86700 1 --2- 172.21.15.2:0/1975419753 >> v2:172.21.15.192:3300/0 conn(0x7fef1015a820 0x7fef1006b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:29.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.140+0000 7fef15f86700 1 -- 172.21.15.2:0/1975419753 >> 172.21.15.2:0/1975419753 conn(0x7fef100b5070 msgr2=0x7fef100b5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:29.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.140+0000 7fef15f86700 1 -- 172.21.15.2:0/1975419753 shutdown_connections 2023-11-26T07:17:29.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.140+0000 7fef15f86700 1 -- 172.21.15.2:0/1975419753 wait complete. 2023-11-26T07:17:29.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.141+0000 7fef15f86700 1 Processor -- start 2023-11-26T07:17:29.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.141+0000 7fef15f86700 1 -- start start 2023-11-26T07:17:29.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.142+0000 7fef15f86700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef100d06b0 0x7fef1009a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:29.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.142+0000 7fef15f86700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef1015a440 0x7fef101506f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:29.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.142+0000 7fef15f86700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef1009e0d0 0x7fef10159350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:29.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.142+0000 7fef15f86700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1009ab30 con 0x7fef1009e0d0 2023-11-26T07:17:29.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.142+0000 7fef15f86700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1009ae10 con 0x7fef1015a440 2023-11-26T07:17:29.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.142+0000 7fef15f86700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef100cccf0 con 0x7fef100d06b0 2023-11-26T07:17:29.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.142+0000 7fef0ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef1009e0d0 0x7fef10159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:29.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.142+0000 7fef0ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef1009e0d0 0x7fef10159350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44804/0 (socket says 172.21.15.2:44804) 2023-11-26T07:17:29.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.142+0000 7fef0ffff700 1 -- 172.21.15.2:0/815925117 learned_addr learned my addr 172.21.15.2:0/815925117 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:29.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.142+0000 7fef0effd700 1 --2- 172.21.15.2:0/815925117 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef1015a440 0x7fef101506f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:29.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.142+0000 7fef0f7fe700 1 --2- 172.21.15.2:0/815925117 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef100d06b0 0x7fef1009a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:29.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.142+0000 7fef0ffff700 1 -- 172.21.15.2:0/815925117 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef100d06b0 msgr2=0x7fef1009a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:29.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.142+0000 7fef0ffff700 1 --2- 172.21.15.2:0/815925117 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef100d06b0 0x7fef1009a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:29.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.142+0000 7fef0ffff700 1 -- 172.21.15.2:0/815925117 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef1015a440 msgr2=0x7fef101506f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:29.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.142+0000 7fef0ffff700 1 --2- 172.21.15.2:0/815925117 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef1015a440 0x7fef101506f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:29.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.142+0000 7fef0ffff700 1 -- 172.21.15.2:0/815925117 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef0000a640 con 0x7fef1009e0d0 2023-11-26T07:17:29.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.143+0000 7fef0ffff700 1 --2- 172.21.15.2:0/815925117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef1009e0d0 0x7fef10159350 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fef0800b370 tx=0x7fef08004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:29.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.143+0000 7feef7fff700 1 -- 172.21.15.2:0/815925117 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef08004880 con 0x7fef1009e0d0 2023-11-26T07:17:29.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.143+0000 7feef7fff700 1 -- 172.21.15.2:0/815925117 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef08020070 con 0x7fef1009e0d0 2023-11-26T07:17:29.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.143+0000 7fef15f86700 1 -- 172.21.15.2:0/815925117 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef08009a70 con 0x7fef1009e0d0 2023-11-26T07:17:29.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.143+0000 7feef7fff700 1 -- 172.21.15.2:0/815925117 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef080276c0 con 0x7fef1009e0d0 2023-11-26T07:17:29.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.143+0000 7fef15f86700 1 -- 172.21.15.2:0/815925117 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef100cd2b0 con 0x7fef1009e0d0 2023-11-26T07:17:29.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.144+0000 7fef15f86700 1 -- 172.21.15.2:0/815925117 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef100cd620 con 0x7fef1009e0d0 2023-11-26T07:17:29.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.144+0000 7feef7fff700 1 -- 172.21.15.2:0/815925117 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7fef08012430 con 0x7fef1009e0d0 2023-11-26T07:17:29.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.145+0000 7feef7fff700 1 --2- 172.21.15.2:0/815925117 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7feefc06b980 0x7feefc06de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:29.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.145+0000 7feef7fff700 1 -- 172.21.15.2:0/815925117 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fef08022070 con 0x7fef1009e0d0 2023-11-26T07:17:29.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.145+0000 7fef0f7fe700 1 --2- 172.21.15.2:0/815925117 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7feefc06b980 0x7feefc06de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:29.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.145+0000 7fef0f7fe700 1 --2- 172.21.15.2:0/815925117 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7feefc06b980 0x7feefc06de40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fef04007fd0 tx=0x7fef04009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:29.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.149+0000 7feef7fff700 1 -- 172.21.15.2:0/815925117 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fef080566c0 con 0x7fef1009e0d0 2023-11-26T07:17:29.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.351+0000 7fef15f86700 1 -- 172.21.15.2:0/815925117 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef1009ac70 con 0x7fef1009e0d0 2023-11-26T07:17:29.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.352+0000 7feef7fff700 1 -- 172.21.15.2:0/815925117 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+16617 (secure 0 0 0) 0x7fef1009ac70 con 0x7fef1009e0d0 2023-11-26T07:17:29.355 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:17:29.355 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":75,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:17:24.287171+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:16:30.488040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-26T07:16:30.981722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.4","mappings":[{"from":6,"to":0}]},{"pgid":"11.38","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:17:29.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.354+0000 7fef15f86700 1 -- 172.21.15.2:0/815925117 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7feefc06b980 msgr2=0x7feefc06de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:29.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.354+0000 7fef15f86700 1 --2- 172.21.15.2:0/815925117 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7feefc06b980 0x7feefc06de40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fef04007fd0 tx=0x7fef04009040 comp rx=0 tx=0).stop 2023-11-26T07:17:29.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.354+0000 7fef15f86700 1 -- 172.21.15.2:0/815925117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef1009e0d0 msgr2=0x7fef10159350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:29.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.354+0000 7fef15f86700 1 --2- 172.21.15.2:0/815925117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef1009e0d0 0x7fef10159350 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fef0800b370 tx=0x7fef08004ad0 comp rx=0 tx=0).stop 2023-11-26T07:17:29.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.354+0000 7fef15f86700 1 -- 172.21.15.2:0/815925117 shutdown_connections 2023-11-26T07:17:29.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.354+0000 7fef15f86700 1 --2- 172.21.15.2:0/815925117 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7feefc06b980 0x7feefc06de40 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:29.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.354+0000 7fef15f86700 1 --2- 172.21.15.2:0/815925117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef1009e0d0 0x7fef10159350 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:29.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.354+0000 7fef15f86700 1 --2- 172.21.15.2:0/815925117 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef100d06b0 0x7fef1009a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:29.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.354+0000 7fef15f86700 1 --2- 172.21.15.2:0/815925117 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef1015a440 0x7fef101506f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:29.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.354+0000 7fef15f86700 1 -- 172.21.15.2:0/815925117 >> 172.21.15.2:0/815925117 conn(0x7fef100b5070 msgr2=0x7fef1006bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:29.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.354+0000 7fef15f86700 1 -- 172.21.15.2:0/815925117 shutdown_connections 2023-11-26T07:17:29.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.355+0000 7fef15f86700 1 -- 172.21.15.2:0/815925117 wait complete. 2023-11-26T07:17:29.368 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:11:28.205739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:16:30.488040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:16:30.981722+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:17:29.369 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:17:29.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.494+0000 7f007be87700 1 Processor -- start 2023-11-26T07:17:29.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.495+0000 7f007be87700 1 -- start start 2023-11-26T07:17:29.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.495+0000 7f007be87700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f007406d1f0 0x7f00740cfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:29.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.495+0000 7f007be87700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f00740ce5b0 0x7f00740ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:29.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.495+0000 7f007be87700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f007406f110 con 0x7f00740b11d0 2023-11-26T07:17:29.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.495+0000 7f007be87700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0074161a10 con 0x7f00740ce5b0 2023-11-26T07:17:29.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.495+0000 7f007be87700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00740d1010 con 0x7f007406d1f0 2023-11-26T07:17:29.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.495+0000 7f007a424700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f00740ce5b0 0x7f00740ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:29.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.495+0000 7f0079c23700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f00740b11d0 0x7f007406fcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36018/0 (socket says 172.21.15.2:36018) 2023-11-26T07:17:29.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.495+0000 7f0079c23700 1 -- 172.21.15.2:0/1360744343 learned_addr learned my addr 172.21.15.2:0/1360744343 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:29.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.496+0000 7f0079422700 1 --2- 172.21.15.2:0/1360744343 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f007406d1f0 0x7f00740cfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:29.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.496+0000 7f0078c21700 1 -- 172.21.15.2:0/1360744343 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1556448718 0 0) 0x7f007406f110 con 0x7f00740b11d0 2023-11-26T07:17:29.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.496+0000 7f0078c21700 1 -- 172.21.15.2:0/1360744343 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00600035b0 con 0x7f00740b11d0 2023-11-26T07:17:29.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.496+0000 7f007a424700 1 -- 172.21.15.2:0/1360744343 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f007406d1f0 msgr2=0x7f00740cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:29.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.496+0000 7f007a424700 1 --2- 172.21.15.2:0/1360744343 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f007406d1f0 0x7f00740cfd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:29.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.496+0000 7f007a424700 1 -- 172.21.15.2:0/1360744343 >> v1:172.21.15.2:6789/0 conn(0x7f00740b11d0 legacy=0x7f007406fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:29.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.496+0000 7f007a424700 1 -- 172.21.15.2:0/1360744343 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00740cef00 con 0x7f00740ce5b0 2023-11-26T07:17:29.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.496+0000 7f007a424700 1 --2- 172.21.15.2:0/1360744343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00740ce5b0 0x7f00740ce9c0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f006c009d90 tx=0x7f006c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7570797d80b0177c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:29.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.496+0000 7f0078c21700 1 -- 172.21.15.2:0/1360744343 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c00e070 con 0x7f00740ce5b0 2023-11-26T07:17:29.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.496+0000 7f0078c21700 1 -- 172.21.15.2:0/1360744343 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006c00bb20 con 0x7f00740ce5b0 2023-11-26T07:17:29.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.496+0000 7f0078c21700 1 -- 172.21.15.2:0/1360744343 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c00be90 con 0x7f00740ce5b0 2023-11-26T07:17:29.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.497+0000 7f007be87700 1 -- 172.21.15.2:0/1360744343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00740ce5b0 msgr2=0x7f00740ce9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:29.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.497+0000 7f007be87700 1 --2- 172.21.15.2:0/1360744343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00740ce5b0 0x7f00740ce9c0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f006c009d90 tx=0x7f006c00b330 comp rx=0 tx=0).stop 2023-11-26T07:17:29.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.497+0000 7f007be87700 1 -- 172.21.15.2:0/1360744343 shutdown_connections 2023-11-26T07:17:29.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.497+0000 7f007be87700 1 --2- 172.21.15.2:0/1360744343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00740ce5b0 0x7f00740ce9c0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:29.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.497+0000 7f007be87700 1 --2- 172.21.15.2:0/1360744343 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f007406d1f0 0x7f00740cfd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:29.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.497+0000 7f007be87700 1 -- 172.21.15.2:0/1360744343 >> 172.21.15.2:0/1360744343 conn(0x7f00740b3700 msgr2=0x7f00740b3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:29.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.497+0000 7f007be87700 1 -- 172.21.15.2:0/1360744343 shutdown_connections 2023-11-26T07:17:29.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.497+0000 7f007be87700 1 -- 172.21.15.2:0/1360744343 wait complete. 2023-11-26T07:17:29.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.498+0000 7f007be87700 1 Processor -- start 2023-11-26T07:17:29.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.498+0000 7f007be87700 1 -- start start 2023-11-26T07:17:29.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.499+0000 7f007be87700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f007406d1f0 0x7f00740cb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:29.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.499+0000 7f007be87700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00740b11d0 0x7f007415e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:29.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.499+0000 7f007be87700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00740ce5b0 0x7f0074155f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:29.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.499+0000 7f007be87700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007415f0f0 con 0x7f00740ce5b0 2023-11-26T07:17:29.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.499+0000 7f007be87700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007415e5c0 con 0x7f007406d1f0 2023-11-26T07:17:29.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.499+0000 7f007be87700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f007415e850 con 0x7f00740b11d0 2023-11-26T07:17:29.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.500+0000 7f007a424700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00740ce5b0 0x7f0074155f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:29.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.500+0000 7f007a424700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00740ce5b0 0x7f0074155f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44818/0 (socket says 172.21.15.2:44818) 2023-11-26T07:17:29.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.500+0000 7f007a424700 1 -- 172.21.15.2:0/2494367947 learned_addr learned my addr 172.21.15.2:0/2494367947 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:29.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.500+0000 7f0079422700 1 --2- 172.21.15.2:0/2494367947 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00740b11d0 0x7f007415e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:29.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.500+0000 7f0079c23700 1 --2- 172.21.15.2:0/2494367947 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f007406d1f0 0x7f00740cb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:29.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.500+0000 7f007a424700 1 -- 172.21.15.2:0/2494367947 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00740b11d0 msgr2=0x7f007415e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:29.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.500+0000 7f007a424700 1 --2- 172.21.15.2:0/2494367947 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00740b11d0 0x7f007415e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:29.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.500+0000 7f007a424700 1 -- 172.21.15.2:0/2494367947 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f007406d1f0 msgr2=0x7f00740cb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:29.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.500+0000 7f007a424700 1 --2- 172.21.15.2:0/2494367947 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f007406d1f0 0x7f00740cb680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:29.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.500+0000 7f007a424700 1 -- 172.21.15.2:0/2494367947 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006c009a70 con 0x7f00740ce5b0 2023-11-26T07:17:29.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.500+0000 7f0079422700 1 --2- 172.21.15.2:0/2494367947 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00740b11d0 0x7f007415e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:29.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.500+0000 7f0079c23700 1 --2- 172.21.15.2:0/2494367947 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f007406d1f0 0x7f00740cb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:29.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.500+0000 7f007a424700 1 --2- 172.21.15.2:0/2494367947 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00740ce5b0 0x7f0074155f80 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f006c014040 tx=0x7f006c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:29.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.500+0000 7f006a7fc700 1 -- 172.21.15.2:0/2494367947 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c004960 con 0x7f00740ce5b0 2023-11-26T07:17:29.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.500+0000 7f006a7fc700 1 -- 172.21.15.2:0/2494367947 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006c020070 con 0x7f00740ce5b0 2023-11-26T07:17:29.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.500+0000 7f007be87700 1 -- 172.21.15.2:0/2494367947 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f007415eb30 con 0x7f00740ce5b0 2023-11-26T07:17:29.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.500+0000 7f006a7fc700 1 -- 172.21.15.2:0/2494367947 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c0276c0 con 0x7f00740ce5b0 2023-11-26T07:17:29.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.500+0000 7f007be87700 1 -- 172.21.15.2:0/2494367947 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00741e69f0 con 0x7f00740ce5b0 2023-11-26T07:17:29.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.501+0000 7f007be87700 1 -- 172.21.15.2:0/2494367947 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00741e6b80 con 0x7f00740ce5b0 2023-11-26T07:17:29.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.502+0000 7f006a7fc700 1 -- 172.21.15.2:0/2494367947 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f006c012430 con 0x7f00740ce5b0 2023-11-26T07:17:29.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.502+0000 7f006a7fc700 1 --2- 172.21.15.2:0/2494367947 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f005806b980 0x7f005806de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:29.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.502+0000 7f006a7fc700 1 -- 172.21.15.2:0/2494367947 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f006c022070 con 0x7f00740ce5b0 2023-11-26T07:17:29.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.503+0000 7f0079c23700 1 --2- 172.21.15.2:0/2494367947 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f005806b980 0x7f005806de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:29.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.503+0000 7f0079c23700 1 --2- 172.21.15.2:0/2494367947 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f005806b980 0x7f005806de40 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0064005910 tx=0x7f0064009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:29.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.507+0000 7f006a7fc700 1 -- 172.21.15.2:0/2494367947 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f006c056860 con 0x7f00740ce5b0 2023-11-26T07:17:29.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.708+0000 7f007be87700 1 -- 172.21.15.2:0/2494367947 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f007406bc40 con 0x7f00740ce5b0 2023-11-26T07:17:29.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.708+0000 7f006a7fc700 1 -- 172.21.15.2:0/2494367947 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7f006c02c020 con 0x7f00740ce5b0 2023-11-26T07:17:29.710 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-26T07:17:29.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.710+0000 7f007be87700 1 -- 172.21.15.2:0/2494367947 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f005806b980 msgr2=0x7f005806de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:29.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.710+0000 7f007be87700 1 --2- 172.21.15.2:0/2494367947 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f005806b980 0x7f005806de40 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0064005910 tx=0x7f0064009040 comp rx=0 tx=0).stop 2023-11-26T07:17:29.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.710+0000 7f007be87700 1 -- 172.21.15.2:0/2494367947 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00740ce5b0 msgr2=0x7f0074155f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:29.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.710+0000 7f007be87700 1 --2- 172.21.15.2:0/2494367947 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00740ce5b0 0x7f0074155f80 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f006c014040 tx=0x7f006c004ad0 comp rx=0 tx=0).stop 2023-11-26T07:17:29.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.710+0000 7f007be87700 1 -- 172.21.15.2:0/2494367947 shutdown_connections 2023-11-26T07:17:29.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.710+0000 7f007be87700 1 --2- 172.21.15.2:0/2494367947 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f005806b980 0x7f005806de40 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:29.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.710+0000 7f007be87700 1 --2- 172.21.15.2:0/2494367947 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00740ce5b0 0x7f0074155f80 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:29.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.710+0000 7f007be87700 1 --2- 172.21.15.2:0/2494367947 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f007406d1f0 0x7f00740cb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:29.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.710+0000 7f007be87700 1 --2- 172.21.15.2:0/2494367947 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00740b11d0 0x7f007415e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:29.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.710+0000 7f007be87700 1 -- 172.21.15.2:0/2494367947 >> 172.21.15.2:0/2494367947 conn(0x7f00740b3700 msgr2=0x7f00741610c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:29.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.710+0000 7f007be87700 1 -- 172.21.15.2:0/2494367947 shutdown_connections 2023-11-26T07:17:29.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.710+0000 7f007be87700 1 -- 172.21.15.2:0/2494367947 wait complete. 2023-11-26T07:17:29.724 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:17:29.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.850+0000 7fdf2e0aa700 1 Processor -- start 2023-11-26T07:17:29.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.850+0000 7fdf2e0aa700 1 -- start start 2023-11-26T07:17:29.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.850+0000 7fdf2e0aa700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf281472f0 0x7fdf280b5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:29.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.850+0000 7fdf2e0aa700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf28147120 con 0x7fdf2806f680 2023-11-26T07:17:29.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.850+0000 7fdf2e0aa700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf28071b30 con 0x7fdf2806b6e0 2023-11-26T07:17:29.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.850+0000 7fdf2e0aa700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf28071e10 con 0x7fdf281472f0 2023-11-26T07:17:29.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.851+0000 7fdf277fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fdf2806f680 0x7fdf2806afd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36032/0 (socket says 172.21.15.2:36032) 2023-11-26T07:17:29.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.851+0000 7fdf277fe700 1 -- 172.21.15.2:0/4246212866 learned_addr learned my addr 172.21.15.2:0/4246212866 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:29.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.851+0000 7fdf267fc700 1 -- 172.21.15.2:0/4246212866 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1026898679 0 0) 0x7fdf28147120 con 0x7fdf2806f680 2023-11-26T07:17:29.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.851+0000 7fdf267fc700 1 -- 172.21.15.2:0/4246212866 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf100035b0 con 0x7fdf2806f680 2023-11-26T07:17:29.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.851+0000 7fdf27fff700 1 --2- 172.21.15.2:0/4246212866 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf281472f0 0x7fdf280b5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:29.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.851+0000 7fdf267fc700 1 -- 172.21.15.2:0/4246212866 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1815117080 0 0) 0x7fdf100035b0 con 0x7fdf2806f680 2023-11-26T07:17:29.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.851+0000 7fdf267fc700 1 -- 172.21.15.2:0/4246212866 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf281472f0 msgr2=0x7fdf280b5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:29.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.851+0000 7fdf267fc700 1 --2- 172.21.15.2:0/4246212866 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf281472f0 0x7fdf280b5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:29.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.851+0000 7fdf267fc700 1 -- 172.21.15.2:0/4246212866 >> v1:172.21.15.192:6789/0 conn(0x7fdf2806b6e0 legacy=0x7fdf2806daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:29.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.851+0000 7fdf267fc700 1 -- 172.21.15.2:0/4246212866 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf280720f0 con 0x7fdf2806f680 2023-11-26T07:17:29.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.851+0000 7fdf267fc700 1 -- 172.21.15.2:0/4246212866 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7fdf18001670 con 0x7fdf2806f680 2023-11-26T07:17:29.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.851+0000 7fdf267fc700 1 -- 172.21.15.2:0/4246212866 >> v1:172.21.15.2:6789/0 conn(0x7fdf2806f680 legacy=0x7fdf2806afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:29.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.851+0000 7fdf267fc700 1 --2- 172.21.15.2:0/4246212866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf10003a30 0x7fdf10003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:29.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.851+0000 7fdf267fc700 1 --2- 172.21.15.2:0/4246212866 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf10004850 0x7fdf10004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:29.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.851+0000 7fdf267fc700 1 --2- 172.21.15.2:0/4246212866 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf281472f0 0x7fdf10005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:29.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.851+0000 7fdf267fc700 1 -- 172.21.15.2:0/4246212866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf28071e10 con 0x7fdf10003a30 2023-11-26T07:17:29.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.851+0000 7fdf267fc700 1 -- 172.21.15.2:0/4246212866 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1000bac0 con 0x7fdf10004850 2023-11-26T07:17:29.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.851+0000 7fdf267fc700 1 -- 172.21.15.2:0/4246212866 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1000bc80 con 0x7fdf281472f0 2023-11-26T07:17:29.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.851+0000 7fdf277fe700 1 --2- 172.21.15.2:0/4246212866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf10003a30 0x7fdf10003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:29.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.851+0000 7fdf26ffd700 1 --2- 172.21.15.2:0/4246212866 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf10004850 0x7fdf10004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:29.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.851+0000 7fdf27fff700 1 --2- 172.21.15.2:0/4246212866 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf281472f0 0x7fdf10005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:29.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.852+0000 7fdf277fe700 1 -- 172.21.15.2:0/4246212866 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf281472f0 msgr2=0x7fdf10005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:29.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.852+0000 7fdf277fe700 1 --2- 172.21.15.2:0/4246212866 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf281472f0 0x7fdf10005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:29.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.852+0000 7fdf277fe700 1 -- 172.21.15.2:0/4246212866 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf10004850 msgr2=0x7fdf10004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:29.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.852+0000 7fdf277fe700 1 --2- 172.21.15.2:0/4246212866 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf10004850 0x7fdf10004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:29.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.852+0000 7fdf277fe700 1 -- 172.21.15.2:0/4246212866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf100035b0 con 0x7fdf10003a30 2023-11-26T07:17:29.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.852+0000 7fdf277fe700 1 --2- 172.21.15.2:0/4246212866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf10003a30 0x7fdf10003e50 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fdf1800c210 tx=0x7fdf10005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c4f56bd6853c29f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:29.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.852+0000 7fdf267fc700 1 -- 172.21.15.2:0/4246212866 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf18007c10 con 0x7fdf10003a30 2023-11-26T07:17:29.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.852+0000 7fdf267fc700 1 -- 172.21.15.2:0/4246212866 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf1800cdd0 con 0x7fdf10003a30 2023-11-26T07:17:29.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.852+0000 7fdf267fc700 1 -- 172.21.15.2:0/4246212866 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf18005ba0 con 0x7fdf10003a30 2023-11-26T07:17:29.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.852+0000 7fdf2e0aa700 1 -- 172.21.15.2:0/4246212866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf10003a30 msgr2=0x7fdf10003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:29.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.852+0000 7fdf2e0aa700 1 --2- 172.21.15.2:0/4246212866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf10003a30 0x7fdf10003e50 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fdf1800c210 tx=0x7fdf10005880 comp rx=0 tx=0).stop 2023-11-26T07:17:29.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.852+0000 7fdf27fff700 1 -- 172.21.15.2:0/4246212866 reap_dead start 2023-11-26T07:17:29.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.852+0000 7fdf2e0aa700 1 -- 172.21.15.2:0/4246212866 shutdown_connections 2023-11-26T07:17:29.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.852+0000 7fdf2e0aa700 1 -- 172.21.15.2:0/4246212866 >> 172.21.15.2:0/4246212866 conn(0x7fdf280b27b0 msgr2=0x7fdf280b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:29.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.852+0000 7fdf2e0aa700 1 -- 172.21.15.2:0/4246212866 shutdown_connections 2023-11-26T07:17:29.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.853+0000 7fdf2e0aa700 1 -- 172.21.15.2:0/4246212866 wait complete. 2023-11-26T07:17:29.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.854+0000 7fdf2e0aa700 1 Processor -- start 2023-11-26T07:17:29.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.854+0000 7fdf2e0aa700 1 -- start start 2023-11-26T07:17:29.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.855+0000 7fdf2e0aa700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf10003a30 0x7fdf28160cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:29.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.855+0000 7fdf2e0aa700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf28141600 0x7fdf2815db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:29.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.855+0000 7fdf2e0aa700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf28162530 0x7fdf280c6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:29.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.855+0000 7fdf2e0aa700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf281620a0 con 0x7fdf28141600 2023-11-26T07:17:29.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.855+0000 7fdf2e0aa700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf281611f0 con 0x7fdf28162530 2023-11-26T07:17:29.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.855+0000 7fdf2e0aa700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf28161490 con 0x7fdf10003a30 2023-11-26T07:17:29.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.855+0000 7fdf26ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf28141600 0x7fdf2815db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:29.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.855+0000 7fdf26ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf28141600 0x7fdf2815db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44836/0 (socket says 172.21.15.2:44836) 2023-11-26T07:17:29.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.855+0000 7fdf26ffd700 1 -- 172.21.15.2:0/978843414 learned_addr learned my addr 172.21.15.2:0/978843414 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:29.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.855+0000 7fdf277fe700 1 --2- 172.21.15.2:0/978843414 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf10003a30 0x7fdf28160cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:29.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.855+0000 7fdf27fff700 1 --2- 172.21.15.2:0/978843414 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf28162530 0x7fdf280c6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:29.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.855+0000 7fdf26ffd700 1 -- 172.21.15.2:0/978843414 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf10003a30 msgr2=0x7fdf28160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:29.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.855+0000 7fdf26ffd700 1 --2- 172.21.15.2:0/978843414 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf10003a30 0x7fdf28160cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:29.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.855+0000 7fdf26ffd700 1 -- 172.21.15.2:0/978843414 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf28162530 msgr2=0x7fdf280c6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:29.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.855+0000 7fdf26ffd700 1 --2- 172.21.15.2:0/978843414 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf28162530 0x7fdf280c6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:29.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.855+0000 7fdf26ffd700 1 -- 172.21.15.2:0/978843414 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf28161770 con 0x7fdf28141600 2023-11-26T07:17:29.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.855+0000 7fdf27fff700 1 --2- 172.21.15.2:0/978843414 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf28162530 0x7fdf280c6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:29.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.855+0000 7fdf26ffd700 1 --2- 172.21.15.2:0/978843414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf28141600 0x7fdf2815db90 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c00f820 tx=0x7fdf1c00fbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:29.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.855+0000 7fdf0ffff700 1 -- 172.21.15.2:0/978843414 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c0052e0 con 0x7fdf28141600 2023-11-26T07:17:29.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.855+0000 7fdf0ffff700 1 -- 172.21.15.2:0/978843414 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf1c005460 con 0x7fdf28141600 2023-11-26T07:17:29.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.855+0000 7fdf2e0aa700 1 -- 172.21.15.2:0/978843414 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf28161a50 con 0x7fdf28141600 2023-11-26T07:17:29.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.855+0000 7fdf0ffff700 1 -- 172.21.15.2:0/978843414 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c0038c0 con 0x7fdf28141600 2023-11-26T07:17:29.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.855+0000 7fdf2e0aa700 1 -- 172.21.15.2:0/978843414 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf2815e0d0 con 0x7fdf28141600 2023-11-26T07:17:29.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.856+0000 7fdf2e0aa700 1 -- 172.21.15.2:0/978843414 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf28075480 con 0x7fdf28141600 2023-11-26T07:17:29.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.857+0000 7fdf0ffff700 1 -- 172.21.15.2:0/978843414 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7fdf1c003a20 con 0x7fdf28141600 2023-11-26T07:17:29.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.857+0000 7fdf0ffff700 1 --2- 172.21.15.2:0/978843414 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fdf1406b980 0x7fdf1406de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:29.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.857+0000 7fdf0ffff700 1 -- 172.21.15.2:0/978843414 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fdf1c087d50 con 0x7fdf28141600 2023-11-26T07:17:29.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.857+0000 7fdf277fe700 1 --2- 172.21.15.2:0/978843414 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fdf1406b980 0x7fdf1406de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:29.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.858+0000 7fdf277fe700 1 --2- 172.21.15.2:0/978843414 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fdf1406b980 0x7fdf1406de40 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fdf18015040 tx=0x7fdf18007000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:29.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:29.862+0000 7fdf0ffff700 1 -- 172.21.15.2:0/978843414 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdf1c054820 con 0x7fdf28141600 2023-11-26T07:17:30.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.064+0000 7fdf2e0aa700 1 -- 172.21.15.2:0/978843414 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdf280b42c0 con 0x7fdf28141600 2023-11-26T07:17:30.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.064+0000 7fdf0ffff700 1 -- 172.21.15.2:0/978843414 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v75) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdf1c057e40 con 0x7fdf28141600 2023-11-26T07:17:30.067 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-26T07:17:30.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.066+0000 7fdf2e0aa700 1 -- 172.21.15.2:0/978843414 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fdf1406b980 msgr2=0x7fdf1406de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:30.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.066+0000 7fdf2e0aa700 1 --2- 172.21.15.2:0/978843414 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fdf1406b980 0x7fdf1406de40 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fdf18015040 tx=0x7fdf18007000 comp rx=0 tx=0).stop 2023-11-26T07:17:30.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.066+0000 7fdf2e0aa700 1 -- 172.21.15.2:0/978843414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf28141600 msgr2=0x7fdf2815db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:30.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.066+0000 7fdf2e0aa700 1 --2- 172.21.15.2:0/978843414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf28141600 0x7fdf2815db90 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c00f820 tx=0x7fdf1c00fbe0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.066+0000 7fdf2e0aa700 1 -- 172.21.15.2:0/978843414 shutdown_connections 2023-11-26T07:17:30.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.066+0000 7fdf2e0aa700 1 --2- 172.21.15.2:0/978843414 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fdf1406b980 0x7fdf1406de40 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.066+0000 7fdf2e0aa700 1 --2- 172.21.15.2:0/978843414 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf28162530 0x7fdf280c6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.066+0000 7fdf2e0aa700 1 --2- 172.21.15.2:0/978843414 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf10003a30 0x7fdf28160cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.066+0000 7fdf2e0aa700 1 --2- 172.21.15.2:0/978843414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf28141600 0x7fdf2815db90 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.066+0000 7fdf2e0aa700 1 -- 172.21.15.2:0/978843414 >> 172.21.15.2:0/978843414 conn(0x7fdf280b27b0 msgr2=0x7fdf281464c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:30.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.067+0000 7fdf2e0aa700 1 -- 172.21.15.2:0/978843414 shutdown_connections 2023-11-26T07:17:30.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.067+0000 7fdf2e0aa700 1 -- 172.21.15.2:0/978843414 wait complete. 2023-11-26T07:17:30.080 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:17:30.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.207+0000 7f269912f700 1 Processor -- start 2023-11-26T07:17:30.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.207+0000 7f269912f700 1 -- start start 2023-11-26T07:17:30.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.208+0000 7f269912f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f269415bde0 0x7f269415c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:30.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.208+0000 7f269912f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f26940ce5c0 0x7f26940cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:30.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.208+0000 7f269912f700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26940d0a90 con 0x7f26940cf2b0 2023-11-26T07:17:30.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.208+0000 7f269912f700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26940cef70 con 0x7f269415bde0 2023-11-26T07:17:30.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.208+0000 7f269912f700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f269406ee10 con 0x7f26940ce5c0 2023-11-26T07:17:30.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.208+0000 7f2692d9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f269415bde0 0x7f269415c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:30.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.208+0000 7f269259c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f26940cf2b0 0x7f26940d01b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36054/0 (socket says 172.21.15.2:36054) 2023-11-26T07:17:30.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.208+0000 7f269259c700 1 -- 172.21.15.2:0/4069118992 learned_addr learned my addr 172.21.15.2:0/4069118992 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:30.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.208+0000 7f269359e700 1 --2- 172.21.15.2:0/4069118992 >> v2:172.21.15.192:3300/0 conn(0x7f26940ce5c0 0x7f26940cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:30.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.208+0000 7f2692d9d700 1 -- 172.21.15.2:0/4069118992 >> v2:172.21.15.192:3300/0 conn(0x7f26940ce5c0 msgr2=0x7f26940cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:30.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.208+0000 7f2692d9d700 1 --2- 172.21.15.2:0/4069118992 >> v2:172.21.15.192:3300/0 conn(0x7f26940ce5c0 0x7f26940cea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.208+0000 7f2692d9d700 1 -- 172.21.15.2:0/4069118992 >> v1:172.21.15.2:6789/0 conn(0x7f26940cf2b0 legacy=0x7f26940d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:30.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.208+0000 7f2691d9b700 1 -- 172.21.15.2:0/4069118992 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3313653570 0 0) 0x7f26940d0a90 con 0x7f26940cf2b0 2023-11-26T07:17:30.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.208+0000 7f2692d9d700 1 -- 172.21.15.2:0/4069118992 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f269406f0f0 con 0x7f269415bde0 2023-11-26T07:17:30.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.208+0000 7f2692d9d700 1 --2- 172.21.15.2:0/4069118992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f269415bde0 0x7f269415c1c0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f2694068360 tx=0x7f2688009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ea9ebbfb0c381bc server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:30.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.209+0000 7f2691d9b700 1 -- 172.21.15.2:0/4069118992 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2688011830 con 0x7f269415bde0 2023-11-26T07:17:30.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.209+0000 7f2691d9b700 1 -- 172.21.15.2:0/4069118992 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2688011990 con 0x7f269415bde0 2023-11-26T07:17:30.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.209+0000 7f2691d9b700 1 -- 172.21.15.2:0/4069118992 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2688011d20 con 0x7f269415bde0 2023-11-26T07:17:30.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.209+0000 7f269912f700 1 -- 172.21.15.2:0/4069118992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f269415bde0 msgr2=0x7f269415c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:30.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.209+0000 7f269912f700 1 --2- 172.21.15.2:0/4069118992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f269415bde0 0x7f269415c1c0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f2694068360 tx=0x7f2688009b20 comp rx=0 tx=0).stop 2023-11-26T07:17:30.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.209+0000 7f269912f700 1 -- 172.21.15.2:0/4069118992 shutdown_connections 2023-11-26T07:17:30.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.209+0000 7f269912f700 1 --2- 172.21.15.2:0/4069118992 >> v2:172.21.15.192:3300/0 conn(0x7f26940ce5c0 0x7f26940cea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.209+0000 7f269912f700 1 --2- 172.21.15.2:0/4069118992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f269415bde0 0x7f269415c1c0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.209+0000 7f269912f700 1 -- 172.21.15.2:0/4069118992 >> 172.21.15.2:0/4069118992 conn(0x7f26940b3720 msgr2=0x7f26940b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:30.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.209+0000 7f269912f700 1 -- 172.21.15.2:0/4069118992 shutdown_connections 2023-11-26T07:17:30.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.209+0000 7f269912f700 1 -- 172.21.15.2:0/4069118992 wait complete. 2023-11-26T07:17:30.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.211+0000 7f269912f700 1 Processor -- start 2023-11-26T07:17:30.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.211+0000 7f269912f700 1 -- start start 2023-11-26T07:17:30.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.211+0000 7f269912f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26940ce5c0 0x7f2694158160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:30.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.212+0000 7f269912f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26940cf2b0 0x7f26940b4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:30.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.212+0000 7f269912f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f269415bde0 0x7f26940b4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:30.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.212+0000 7f269912f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26940b76a0 con 0x7f269415bde0 2023-11-26T07:17:30.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.212+0000 7f269912f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26941e51f0 con 0x7f26940cf2b0 2023-11-26T07:17:30.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.212+0000 7f269912f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26940b73c0 con 0x7f26940ce5c0 2023-11-26T07:17:30.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.212+0000 7f269359e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f269415bde0 0x7f26940b4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:30.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.212+0000 7f269359e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f269415bde0 0x7f26940b4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44852/0 (socket says 172.21.15.2:44852) 2023-11-26T07:17:30.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.212+0000 7f269359e700 1 -- 172.21.15.2:0/3763952589 learned_addr learned my addr 172.21.15.2:0/3763952589 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:30.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.212+0000 7f269259c700 1 --2- 172.21.15.2:0/3763952589 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26940cf2b0 0x7f26940b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:30.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.212+0000 7f2692d9d700 1 --2- 172.21.15.2:0/3763952589 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26940ce5c0 0x7f2694158160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:30.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.212+0000 7f269359e700 1 -- 172.21.15.2:0/3763952589 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26940ce5c0 msgr2=0x7f2694158160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:30.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.212+0000 7f269359e700 1 --2- 172.21.15.2:0/3763952589 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26940ce5c0 0x7f2694158160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.212+0000 7f269359e700 1 -- 172.21.15.2:0/3763952589 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26940cf2b0 msgr2=0x7f26940b4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:30.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.212+0000 7f269359e700 1 --2- 172.21.15.2:0/3763952589 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26940cf2b0 0x7f26940b4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.212+0000 7f269359e700 1 -- 172.21.15.2:0/3763952589 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26880094a0 con 0x7f269415bde0 2023-11-26T07:17:30.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.212+0000 7f269359e700 1 --2- 172.21.15.2:0/3763952589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f269415bde0 0x7f26940b4d50 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f268c007e40 tx=0x7f268c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:30.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.212+0000 7f267b7fe700 1 -- 172.21.15.2:0/3763952589 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268c00eea0 con 0x7f269415bde0 2023-11-26T07:17:30.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.212+0000 7f267b7fe700 1 -- 172.21.15.2:0/3763952589 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f268c014420 con 0x7f269415bde0 2023-11-26T07:17:30.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.212+0000 7f269912f700 1 -- 172.21.15.2:0/3763952589 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26941e4ba0 con 0x7f269415bde0 2023-11-26T07:17:30.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.212+0000 7f267b7fe700 1 -- 172.21.15.2:0/3763952589 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268c0147b0 con 0x7f269415bde0 2023-11-26T07:17:30.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.212+0000 7f269912f700 1 -- 172.21.15.2:0/3763952589 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26940c7da0 con 0x7f269415bde0 2023-11-26T07:17:30.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.213+0000 7f269912f700 1 -- 172.21.15.2:0/3763952589 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26941e4a00 con 0x7f269415bde0 2023-11-26T07:17:30.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.214+0000 7f267b7fe700 1 -- 172.21.15.2:0/3763952589 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f268c014910 con 0x7f269415bde0 2023-11-26T07:17:30.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.214+0000 7f267b7fe700 1 --2- 172.21.15.2:0/3763952589 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f268006b980 0x7f268006de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:30.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.214+0000 7f267b7fe700 1 -- 172.21.15.2:0/3763952589 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f268c088770 con 0x7f269415bde0 2023-11-26T07:17:30.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.215+0000 7f2692d9d700 1 --2- 172.21.15.2:0/3763952589 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f268006b980 0x7f268006de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:30.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.215+0000 7f2692d9d700 1 --2- 172.21.15.2:0/3763952589 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f268006b980 0x7f268006de40 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f26880090b0 tx=0x7f268801c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:30.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.219+0000 7f267b7fe700 1 -- 172.21.15.2:0/3763952589 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f26941e4a00 con 0x7f269415bde0 2023-11-26T07:17:30.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.418+0000 7f269912f700 1 -- 172.21.15.2:0/3763952589 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f26941e4a00 con 0x7f269415bde0 2023-11-26T07:17:30.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.418+0000 7f267b7fe700 1 -- 172.21.15.2:0/3763952589 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v75) v1 ==== 100+0+11 (secure 0 0 0) 0x7f26941e4a00 con 0x7f269415bde0 2023-11-26T07:17:30.420 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-26T07:17:30.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.421+0000 7f269912f700 1 -- 172.21.15.2:0/3763952589 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f268006b980 msgr2=0x7f268006de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:30.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.421+0000 7f269912f700 1 --2- 172.21.15.2:0/3763952589 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f268006b980 0x7f268006de40 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f26880090b0 tx=0x7f268801c040 comp rx=0 tx=0).stop 2023-11-26T07:17:30.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.421+0000 7f269912f700 1 -- 172.21.15.2:0/3763952589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f269415bde0 msgr2=0x7f26940b4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:30.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.421+0000 7f269912f700 1 --2- 172.21.15.2:0/3763952589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f269415bde0 0x7f26940b4d50 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f268c007e40 tx=0x7f268c00e3c0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.421+0000 7f269912f700 1 -- 172.21.15.2:0/3763952589 shutdown_connections 2023-11-26T07:17:30.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.421+0000 7f269912f700 1 --2- 172.21.15.2:0/3763952589 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f268006b980 0x7f268006de40 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.421+0000 7f269912f700 1 --2- 172.21.15.2:0/3763952589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f269415bde0 0x7f26940b4d50 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.421+0000 7f269912f700 1 --2- 172.21.15.2:0/3763952589 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26940ce5c0 0x7f2694158160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.421+0000 7f269912f700 1 --2- 172.21.15.2:0/3763952589 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26940cf2b0 0x7f26940b4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.421+0000 7f269912f700 1 -- 172.21.15.2:0/3763952589 >> 172.21.15.2:0/3763952589 conn(0x7f26940b3720 msgr2=0x7f26941e7420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:30.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.421+0000 7f269912f700 1 -- 172.21.15.2:0/3763952589 shutdown_connections 2023-11-26T07:17:30.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.421+0000 7f269912f700 1 -- 172.21.15.2:0/3763952589 wait complete. 2023-11-26T07:17:30.435 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-26T07:17:30.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.566+0000 7f388f644700 1 Processor -- start 2023-11-26T07:17:30.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.566+0000 7f388f644700 1 -- start start 2023-11-26T07:17:30.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.567+0000 7f388f644700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f38880722c0 0x7f38880b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:30.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.567+0000 7f388f644700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f38881440f0 0x7f388806e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:30.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.567+0000 7f388f644700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3888143ec0 con 0x7f3888143ae0 2023-11-26T07:17:30.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.567+0000 7f388f644700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38880b40a0 con 0x7f38881440f0 2023-11-26T07:17:30.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.567+0000 7f388f644700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38880b3ae0 con 0x7f38880722c0 2023-11-26T07:17:30.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.567+0000 7f388dbe1700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f38881440f0 0x7f388806e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:30.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.567+0000 7f388dbe1700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f38881440f0 0x7f388806e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44860/0 (socket says 172.21.15.2:44860) 2023-11-26T07:17:30.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.567+0000 7f388dbe1700 1 -- 172.21.15.2:0/4220631791 learned_addr learned my addr 172.21.15.2:0/4220631791 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:30.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.567+0000 7f388cbdf700 1 --2- 172.21.15.2:0/4220631791 >> v2:172.21.15.192:3300/0 conn(0x7f38880722c0 0x7f38880b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:30.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.567+0000 7f388dbe1700 1 -- 172.21.15.2:0/4220631791 >> v2:172.21.15.192:3300/0 conn(0x7f38880722c0 msgr2=0x7f38880b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:30.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.567+0000 7f388dbe1700 1 --2- 172.21.15.2:0/4220631791 >> v2:172.21.15.192:3300/0 conn(0x7f38880722c0 0x7f38880b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.567+0000 7f388dbe1700 1 -- 172.21.15.2:0/4220631791 >> v1:172.21.15.192:6789/0 conn(0x7f3888143ae0 legacy=0x7f3888071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:30.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.567+0000 7f388dbe1700 1 -- 172.21.15.2:0/4220631791 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38880b3dc0 con 0x7f38881440f0 2023-11-26T07:17:30.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.567+0000 7f388cbdf700 1 --2- 172.21.15.2:0/4220631791 >> v2:172.21.15.192:3300/0 conn(0x7f38880722c0 0x7f38880b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:30.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.567+0000 7f388dbe1700 1 --2- 172.21.15.2:0/4220631791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38881440f0 0x7f388806e510 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f38880d1b00 tx=0x7f388000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2f232ed8a14f57c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:30.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.568+0000 7f387ffff700 1 -- 172.21.15.2:0/4220631791 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388000e070 con 0x7f38881440f0 2023-11-26T07:17:30.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.568+0000 7f387ffff700 1 -- 172.21.15.2:0/4220631791 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3880003a20 con 0x7f38881440f0 2023-11-26T07:17:30.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.568+0000 7f387ffff700 1 -- 172.21.15.2:0/4220631791 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3880003dd0 con 0x7f38881440f0 2023-11-26T07:17:30.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.568+0000 7f388f644700 1 -- 172.21.15.2:0/4220631791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38881440f0 msgr2=0x7f388806e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:30.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.568+0000 7f388f644700 1 --2- 172.21.15.2:0/4220631791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38881440f0 0x7f388806e510 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f38880d1b00 tx=0x7f388000b330 comp rx=0 tx=0).stop 2023-11-26T07:17:30.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.568+0000 7f388f644700 1 -- 172.21.15.2:0/4220631791 shutdown_connections 2023-11-26T07:17:30.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.568+0000 7f388f644700 1 --2- 172.21.15.2:0/4220631791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38881440f0 0x7f388806e510 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.568+0000 7f388f644700 1 --2- 172.21.15.2:0/4220631791 >> v2:172.21.15.192:3300/0 conn(0x7f38880722c0 0x7f38880b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.568+0000 7f388f644700 1 -- 172.21.15.2:0/4220631791 >> 172.21.15.2:0/4220631791 conn(0x7f38880b2740 msgr2=0x7f38880b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:30.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.568+0000 7f388f644700 1 -- 172.21.15.2:0/4220631791 shutdown_connections 2023-11-26T07:17:30.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.568+0000 7f388f644700 1 -- 172.21.15.2:0/4220631791 wait complete. 2023-11-26T07:17:30.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.570+0000 7f388f644700 1 Processor -- start 2023-11-26T07:17:30.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.570+0000 7f388f644700 1 -- start start 2023-11-26T07:17:30.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.570+0000 7f388f644700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f38880722c0 0x7f38881f6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:30.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.570+0000 7f388f644700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3888143ae0 0x7f38880cc160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:30.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.570+0000 7f388f644700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38881440f0 0x7f38880cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:30.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.570+0000 7f388f644700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38880cb8e0 con 0x7f38881440f0 2023-11-26T07:17:30.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.570+0000 7f388f644700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38880cad60 con 0x7f3888143ae0 2023-11-26T07:17:30.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.570+0000 7f388f644700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38880cb040 con 0x7f38880722c0 2023-11-26T07:17:30.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.570+0000 7f388dbe1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38881440f0 0x7f38880cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:30.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.570+0000 7f388dbe1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38881440f0 0x7f38880cc6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44866/0 (socket says 172.21.15.2:44866) 2023-11-26T07:17:30.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.570+0000 7f388dbe1700 1 -- 172.21.15.2:0/2181667052 learned_addr learned my addr 172.21.15.2:0/2181667052 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:30.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.571+0000 7f388cbdf700 1 --2- 172.21.15.2:0/2181667052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3888143ae0 0x7f38880cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:30.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.571+0000 7f388d3e0700 1 --2- 172.21.15.2:0/2181667052 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f38880722c0 0x7f38881f6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:30.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.571+0000 7f388dbe1700 1 -- 172.21.15.2:0/2181667052 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f38880722c0 msgr2=0x7f38881f6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:30.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.571+0000 7f388dbe1700 1 --2- 172.21.15.2:0/2181667052 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f38880722c0 0x7f38881f6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.571+0000 7f388dbe1700 1 -- 172.21.15.2:0/2181667052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3888143ae0 msgr2=0x7f38880cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:30.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.571+0000 7f388dbe1700 1 --2- 172.21.15.2:0/2181667052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3888143ae0 0x7f38880cc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.571+0000 7f388dbe1700 1 -- 172.21.15.2:0/2181667052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3880009b30 con 0x7f38881440f0 2023-11-26T07:17:30.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.571+0000 7f388d3e0700 1 --2- 172.21.15.2:0/2181667052 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f38880722c0 0x7f38881f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:30.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.571+0000 7f388dbe1700 1 --2- 172.21.15.2:0/2181667052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38881440f0 0x7f38880cc6a0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f3880015040 tx=0x7f3880004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:30.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.571+0000 7f387dffb700 1 -- 172.21.15.2:0/2181667052 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3880004440 con 0x7f38881440f0 2023-11-26T07:17:30.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.571+0000 7f387dffb700 1 -- 172.21.15.2:0/2181667052 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38800045c0 con 0x7f38881440f0 2023-11-26T07:17:30.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.571+0000 7f388f644700 1 -- 172.21.15.2:0/2181667052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38880cb320 con 0x7f38881440f0 2023-11-26T07:17:30.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.571+0000 7f387dffb700 1 -- 172.21.15.2:0/2181667052 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3880004970 con 0x7f38881440f0 2023-11-26T07:17:30.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.571+0000 7f388f644700 1 -- 172.21.15.2:0/2181667052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38881f6e90 con 0x7f38881440f0 2023-11-26T07:17:30.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.572+0000 7f388f644700 1 -- 172.21.15.2:0/2181667052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3888155620 con 0x7f38881440f0 2023-11-26T07:17:30.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.573+0000 7f387dffb700 1 -- 172.21.15.2:0/2181667052 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f388002e430 con 0x7f38881440f0 2023-11-26T07:17:30.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.574+0000 7f387dffb700 1 --2- 172.21.15.2:0/2181667052 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f386c06b980 0x7f386c06de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:30.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.574+0000 7f387dffb700 1 -- 172.21.15.2:0/2181667052 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3880089a50 con 0x7f38881440f0 2023-11-26T07:17:30.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.574+0000 7f388d3e0700 1 --2- 172.21.15.2:0/2181667052 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f386c06b980 0x7f386c06de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:30.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.575+0000 7f388d3e0700 1 --2- 172.21.15.2:0/2181667052 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f386c06b980 0x7f386c06de40 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3888142d80 tx=0x7f3884009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:30.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.577+0000 7f387dffb700 1 -- 172.21.15.2:0/2181667052 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3880056360 con 0x7f38881440f0 2023-11-26T07:17:30.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.793+0000 7f388f644700 1 -- 172.21.15.2:0/2181667052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3888068670 con 0x7f38881440f0 2023-11-26T07:17:30.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.794+0000 7f387dffb700 1 -- 172.21.15.2:0/2181667052 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v75) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3880017080 con 0x7f38881440f0 2023-11-26T07:17:30.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.796+0000 7f388f644700 1 -- 172.21.15.2:0/2181667052 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f386c06b980 msgr2=0x7f386c06de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:30.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.796+0000 7f388f644700 1 --2- 172.21.15.2:0/2181667052 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f386c06b980 0x7f386c06de40 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3888142d80 tx=0x7f3884009040 comp rx=0 tx=0).stop 2023-11-26T07:17:30.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.796+0000 7f388f644700 1 -- 172.21.15.2:0/2181667052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38881440f0 msgr2=0x7f38880cc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:30.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.796+0000 7f388f644700 1 --2- 172.21.15.2:0/2181667052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38881440f0 0x7f38880cc6a0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f3880015040 tx=0x7f3880004ad0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.796+0000 7f388f644700 1 -- 172.21.15.2:0/2181667052 shutdown_connections 2023-11-26T07:17:30.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.796+0000 7f388f644700 1 --2- 172.21.15.2:0/2181667052 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f386c06b980 0x7f386c06de40 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.796+0000 7f388f644700 1 --2- 172.21.15.2:0/2181667052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38881440f0 0x7f38880cc6a0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.796+0000 7f388f644700 1 --2- 172.21.15.2:0/2181667052 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f38880722c0 0x7f38881f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.796+0000 7f388f644700 1 --2- 172.21.15.2:0/2181667052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3888143ae0 0x7f38880cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:30.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.796+0000 7f388f644700 1 -- 172.21.15.2:0/2181667052 >> 172.21.15.2:0/2181667052 conn(0x7f38880b2740 msgr2=0x7f38880b51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:30.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.796+0000 7f388f644700 1 -- 172.21.15.2:0/2181667052 shutdown_connections 2023-11-26T07:17:30.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:30.796+0000 7f388f644700 1 -- 172.21.15.2:0/2181667052 wait complete. 2023-11-26T07:17:30.799 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2023-11-26T07:17:30.810 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-26T07:17:30.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:30.810 DEBUG:teuthology.orchestra.run.smithi002:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-26T07:17:30.900 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2023-11-26T07:17:30.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:30.900 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-26T07:17:30.923 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:17:30.923 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:30.942 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:17:30.942 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:31.001 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:17:31.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.124+0000 7f007a27d700 1 Processor -- start 2023-11-26T07:17:31.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.124+0000 7f007a27d700 1 -- start start 2023-11-26T07:17:31.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.125+0000 7f007a27d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00740722c0 0x7f00740b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:31.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.125+0000 7f007a27d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f00741440f0 0x7f007406e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:31.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.125+0000 7f007a27d700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0074143ec0 con 0x7f0074143ae0 2023-11-26T07:17:31.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.125+0000 7f007a27d700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00740b40a0 con 0x7f00741440f0 2023-11-26T07:17:31.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.125+0000 7f007a27d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00740b3ae0 con 0x7f00740722c0 2023-11-26T07:17:31.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.125+0000 7f007881a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f00741440f0 0x7f007406e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:31.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.125+0000 7f007881a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f00741440f0 0x7f007406e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44876/0 (socket says 172.21.15.2:44876) 2023-11-26T07:17:31.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.125+0000 7f007881a700 1 -- 172.21.15.2:0/2146109070 learned_addr learned my addr 172.21.15.2:0/2146109070 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:31.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.125+0000 7f00737fe700 1 --2- 172.21.15.2:0/2146109070 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00740722c0 0x7f00740b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:31.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.126+0000 7f007881a700 1 -- 172.21.15.2:0/2146109070 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00740722c0 msgr2=0x7f00740b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:31.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.126+0000 7f007881a700 1 --2- 172.21.15.2:0/2146109070 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00740722c0 0x7f00740b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.126+0000 7f007881a700 1 -- 172.21.15.2:0/2146109070 >> v1:172.21.15.192:6789/0 conn(0x7f0074143ae0 legacy=0x7f0074071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:31.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.126+0000 7f007881a700 1 -- 172.21.15.2:0/2146109070 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00740b3dc0 con 0x7f00741440f0 2023-11-26T07:17:31.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.126+0000 7f007881a700 1 --2- 172.21.15.2:0/2146109070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00741440f0 0x7f007406e510 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f006c009e50 tx=0x7f006c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d080c18c2850c21 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:31.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.126+0000 7f0072ffd700 1 -- 172.21.15.2:0/2146109070 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c00e070 con 0x7f00741440f0 2023-11-26T07:17:31.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.126+0000 7f0072ffd700 1 -- 172.21.15.2:0/2146109070 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006c00b910 con 0x7f00741440f0 2023-11-26T07:17:31.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.126+0000 7f0072ffd700 1 -- 172.21.15.2:0/2146109070 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c00bcc0 con 0x7f00741440f0 2023-11-26T07:17:31.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.127+0000 7f007a27d700 1 -- 172.21.15.2:0/2146109070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00741440f0 msgr2=0x7f007406e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:31.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.127+0000 7f007a27d700 1 --2- 172.21.15.2:0/2146109070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00741440f0 0x7f007406e510 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f006c009e50 tx=0x7f006c00b330 comp rx=0 tx=0).stop 2023-11-26T07:17:31.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.127+0000 7f007a27d700 1 -- 172.21.15.2:0/2146109070 shutdown_connections 2023-11-26T07:17:31.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.127+0000 7f007a27d700 1 --2- 172.21.15.2:0/2146109070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00741440f0 0x7f007406e510 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.127+0000 7f007a27d700 1 --2- 172.21.15.2:0/2146109070 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00740722c0 0x7f00740b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.127+0000 7f007a27d700 1 -- 172.21.15.2:0/2146109070 >> 172.21.15.2:0/2146109070 conn(0x7f00740b2740 msgr2=0x7f00740b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:31.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.127+0000 7f007a27d700 1 -- 172.21.15.2:0/2146109070 shutdown_connections 2023-11-26T07:17:31.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.127+0000 7f007a27d700 1 -- 172.21.15.2:0/2146109070 wait complete. 2023-11-26T07:17:31.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.128+0000 7f007a27d700 1 Processor -- start 2023-11-26T07:17:31.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.128+0000 7f007a27d700 1 -- start start 2023-11-26T07:17:31.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.129+0000 7f007a27d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00740722c0 0x7f007415cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:31.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.129+0000 7f007a27d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0074143ae0 0x7f007415b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:31.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.129+0000 7f007a27d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00741440f0 0x7f007415b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:31.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.129+0000 7f007a27d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007415d250 con 0x7f00740722c0 2023-11-26T07:17:31.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.129+0000 7f007a27d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007415d440 con 0x7f00741440f0 2023-11-26T07:17:31.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.129+0000 7f007a27d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f007415d720 con 0x7f0074143ae0 2023-11-26T07:17:31.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.129+0000 7f0073fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00740722c0 0x7f007415cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:31.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.129+0000 7f0073fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00740722c0 0x7f007415cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44878/0 (socket says 172.21.15.2:44878) 2023-11-26T07:17:31.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.129+0000 7f0073fff700 1 -- 172.21.15.2:0/2322347488 learned_addr learned my addr 172.21.15.2:0/2322347488 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:31.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.129+0000 7f00737fe700 1 --2- 172.21.15.2:0/2322347488 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0074143ae0 0x7f007415b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:31.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.129+0000 7f007881a700 1 --2- 172.21.15.2:0/2322347488 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00741440f0 0x7f007415b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:31.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.129+0000 7f0073fff700 1 -- 172.21.15.2:0/2322347488 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0074143ae0 msgr2=0x7f007415b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:31.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.129+0000 7f0073fff700 1 --2- 172.21.15.2:0/2322347488 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0074143ae0 0x7f007415b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.129+0000 7f0073fff700 1 -- 172.21.15.2:0/2322347488 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00741440f0 msgr2=0x7f007415b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:31.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.129+0000 7f0073fff700 1 --2- 172.21.15.2:0/2322347488 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00741440f0 0x7f007415b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.129+0000 7f0073fff700 1 -- 172.21.15.2:0/2322347488 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006c009b30 con 0x7f00740722c0 2023-11-26T07:17:31.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.130+0000 7f0073fff700 1 --2- 172.21.15.2:0/2322347488 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00740722c0 0x7f007415cd10 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f006400c4e0 tx=0x7f006400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:31.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.130+0000 7f0070ff9700 1 -- 172.21.15.2:0/2322347488 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00640052d0 con 0x7f00740722c0 2023-11-26T07:17:31.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.130+0000 7f0070ff9700 1 -- 172.21.15.2:0/2322347488 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0064005430 con 0x7f00740722c0 2023-11-26T07:17:31.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.130+0000 7f007a27d700 1 -- 172.21.15.2:0/2322347488 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f007415da00 con 0x7f00740722c0 2023-11-26T07:17:31.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.130+0000 7f0070ff9700 1 -- 172.21.15.2:0/2322347488 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00640038c0 con 0x7f00740722c0 2023-11-26T07:17:31.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.130+0000 7f007a27d700 1 -- 172.21.15.2:0/2322347488 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f007415dfc0 con 0x7f00740722c0 2023-11-26T07:17:31.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.131+0000 7f007a27d700 1 -- 172.21.15.2:0/2322347488 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f007415e180 con 0x7f00740722c0 2023-11-26T07:17:31.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.131+0000 7f0070ff9700 1 -- 172.21.15.2:0/2322347488 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f0064003a20 con 0x7f00740722c0 2023-11-26T07:17:31.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.132+0000 7f0070ff9700 1 --2- 172.21.15.2:0/2322347488 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f006006b980 0x7f006006de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:31.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.132+0000 7f0070ff9700 1 -- 172.21.15.2:0/2322347488 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f00640874d0 con 0x7f00740722c0 2023-11-26T07:17:31.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.132+0000 7f00737fe700 1 --2- 172.21.15.2:0/2322347488 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f006006b980 0x7f006006de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:31.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.133+0000 7f00737fe700 1 --2- 172.21.15.2:0/2322347488 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f006006b980 0x7f006006de40 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f007406f7a0 tx=0x7f0068009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:31.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.136+0000 7f0070ff9700 1 -- 172.21.15.2:0/2322347488 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0064053e00 con 0x7f00740722c0 2023-11-26T07:17:31.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.338+0000 7f007a27d700 1 -- 172.21.15.2:0/2322347488 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0074068670 con 0x7f00740722c0 2023-11-26T07:17:31.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.339+0000 7f0070ff9700 1 -- 172.21.15.2:0/2322347488 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+16617 (secure 0 0 0) 0x7f0064057420 con 0x7f00740722c0 2023-11-26T07:17:31.341 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:17:31.341 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":75,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:17:24.287171+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:16:30.488040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-26T07:16:30.981722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.4","mappings":[{"from":6,"to":0}]},{"pgid":"11.38","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:17:31.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.341+0000 7f007a27d700 1 -- 172.21.15.2:0/2322347488 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f006006b980 msgr2=0x7f006006de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:31.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.341+0000 7f007a27d700 1 --2- 172.21.15.2:0/2322347488 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f006006b980 0x7f006006de40 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f007406f7a0 tx=0x7f0068009210 comp rx=0 tx=0).stop 2023-11-26T07:17:31.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.341+0000 7f007a27d700 1 -- 172.21.15.2:0/2322347488 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00740722c0 msgr2=0x7f007415cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:31.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.341+0000 7f007a27d700 1 --2- 172.21.15.2:0/2322347488 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00740722c0 0x7f007415cd10 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f006400c4e0 tx=0x7f006400c7f0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.341+0000 7f007a27d700 1 -- 172.21.15.2:0/2322347488 shutdown_connections 2023-11-26T07:17:31.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.341+0000 7f007a27d700 1 --2- 172.21.15.2:0/2322347488 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f006006b980 0x7f006006de40 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.341+0000 7f007a27d700 1 --2- 172.21.15.2:0/2322347488 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00741440f0 0x7f007415b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.341+0000 7f007a27d700 1 --2- 172.21.15.2:0/2322347488 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00740722c0 0x7f007415cd10 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.341+0000 7f007a27d700 1 --2- 172.21.15.2:0/2322347488 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0074143ae0 0x7f007415b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.341+0000 7f007a27d700 1 -- 172.21.15.2:0/2322347488 >> 172.21.15.2:0/2322347488 conn(0x7f00740b2740 msgr2=0x7f007406edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:31.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.341+0000 7f007a27d700 1 -- 172.21.15.2:0/2322347488 shutdown_connections 2023-11-26T07:17:31.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.341+0000 7f007a27d700 1 -- 172.21.15.2:0/2322347488 wait complete. 2023-11-26T07:17:31.355 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:11:28.205739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:16:30.488040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:16:30.981722+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:17:31.356 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:17:31.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.482+0000 7f390b2d1700 1 Processor -- start 2023-11-26T07:17:31.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.482+0000 7f390b2d1700 1 -- start start 2023-11-26T07:17:31.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.483+0000 7f390b2d1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f390406b6e0 0x7f3904161cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:31.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.483+0000 7f390b2d1700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3904162200 0x7f39040cb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:31.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.483+0000 7f390b2d1700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f390415e470 con 0x7f390415e090 2023-11-26T07:17:31.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.483+0000 7f390b2d1700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39040c6900 con 0x7f3904162200 2023-11-26T07:17:31.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.483+0000 7f390b2d1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39041629f0 con 0x7f390406b6e0 2023-11-26T07:17:31.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.483+0000 7f390906d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f390415e090 0x7f390406afd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36096/0 (socket says 172.21.15.2:36096) 2023-11-26T07:17:31.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.483+0000 7f390906d700 1 -- 172.21.15.2:0/3514236603 learned_addr learned my addr 172.21.15.2:0/3514236603 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:31.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.483+0000 7f38fbfff700 1 -- 172.21.15.2:0/3514236603 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1818674235 0 0) 0x7f390415e470 con 0x7f390415e090 2023-11-26T07:17:31.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.483+0000 7f38fbfff700 1 -- 172.21.15.2:0/3514236603 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38f00035b0 con 0x7f390415e090 2023-11-26T07:17:31.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.483+0000 7f390986e700 1 --2- 172.21.15.2:0/3514236603 >> v2:172.21.15.192:3300/0 conn(0x7f3904162200 0x7f39040cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:31.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.483+0000 7f390886c700 1 --2- 172.21.15.2:0/3514236603 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f390406b6e0 0x7f3904161cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:31.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.484+0000 7f38fbfff700 1 -- 172.21.15.2:0/3514236603 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2023920980 0 0) 0x7f38f00035b0 con 0x7f390415e090 2023-11-26T07:17:31.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.484+0000 7f38fbfff700 1 -- 172.21.15.2:0/3514236603 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f390406b6e0 msgr2=0x7f3904161cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:31.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.484+0000 7f38fbfff700 1 --2- 172.21.15.2:0/3514236603 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f390406b6e0 0x7f3904161cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.484+0000 7f38fbfff700 1 -- 172.21.15.2:0/3514236603 >> v2:172.21.15.192:3300/0 conn(0x7f3904162200 msgr2=0x7f39040cb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:31.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.484+0000 7f38fbfff700 1 --2- 172.21.15.2:0/3514236603 >> v2:172.21.15.192:3300/0 conn(0x7f3904162200 0x7f39040cb160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.484+0000 7f38fbfff700 1 -- 172.21.15.2:0/3514236603 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39040c5f60 con 0x7f390415e090 2023-11-26T07:17:31.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.484+0000 7f38fbfff700 1 -- 172.21.15.2:0/3514236603 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f38f4001670 con 0x7f390415e090 2023-11-26T07:17:31.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.484+0000 7f38fbfff700 1 -- 172.21.15.2:0/3514236603 >> v1:172.21.15.2:6789/0 conn(0x7f390415e090 legacy=0x7f390406afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:31.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.484+0000 7f38fbfff700 1 --2- 172.21.15.2:0/3514236603 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38f0003a00 0x7f38f0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:31.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.484+0000 7f38fbfff700 1 --2- 172.21.15.2:0/3514236603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38f0004850 0x7f38f0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:31.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.484+0000 7f38fbfff700 1 --2- 172.21.15.2:0/3514236603 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f390406b6e0 0x7f38f0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:31.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.484+0000 7f38fbfff700 1 -- 172.21.15.2:0/3514236603 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39040c6900 con 0x7f38f0004850 2023-11-26T07:17:31.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.484+0000 7f38fbfff700 1 -- 172.21.15.2:0/3514236603 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39041629f0 con 0x7f38f0003a00 2023-11-26T07:17:31.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.484+0000 7f38fbfff700 1 -- 172.21.15.2:0/3514236603 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38f000ba10 con 0x7f390406b6e0 2023-11-26T07:17:31.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.484+0000 7f390886c700 1 --2- 172.21.15.2:0/3514236603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38f0004850 0x7f38f0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:31.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.484+0000 7f390906d700 1 --2- 172.21.15.2:0/3514236603 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38f0003a00 0x7f38f0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:31.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.484+0000 7f390986e700 1 --2- 172.21.15.2:0/3514236603 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f390406b6e0 0x7f38f0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:31.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.484+0000 7f390886c700 1 -- 172.21.15.2:0/3514236603 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f390406b6e0 msgr2=0x7f38f0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:31.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.484+0000 7f390886c700 1 --2- 172.21.15.2:0/3514236603 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f390406b6e0 0x7f38f0005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.484+0000 7f390886c700 1 -- 172.21.15.2:0/3514236603 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38f0003a00 msgr2=0x7f38f0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:31.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.484+0000 7f390886c700 1 --2- 172.21.15.2:0/3514236603 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38f0003a00 0x7f38f0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.484+0000 7f390886c700 1 -- 172.21.15.2:0/3514236603 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f00035b0 con 0x7f38f0004850 2023-11-26T07:17:31.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.484+0000 7f390986e700 1 --2- 172.21.15.2:0/3514236603 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f390406b6e0 0x7f38f0005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:31.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.484+0000 7f390886c700 1 --2- 172.21.15.2:0/3514236603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38f0004850 0x7f38f0004cd0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f3900009b60 tx=0x7f38f0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a0ff789b4498847 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:31.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.485+0000 7f38fbfff700 1 -- 172.21.15.2:0/3514236603 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390000e6c0 con 0x7f38f0004850 2023-11-26T07:17:31.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.485+0000 7f38fbfff700 1 -- 172.21.15.2:0/3514236603 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f390000e820 con 0x7f38f0004850 2023-11-26T07:17:31.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.485+0000 7f38fbfff700 1 -- 172.21.15.2:0/3514236603 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390000eb90 con 0x7f38f0004850 2023-11-26T07:17:31.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.485+0000 7f390b2d1700 1 -- 172.21.15.2:0/3514236603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38f0004850 msgr2=0x7f38f0004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:31.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.485+0000 7f390b2d1700 1 --2- 172.21.15.2:0/3514236603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38f0004850 0x7f38f0004cd0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f3900009b60 tx=0x7f38f0005880 comp rx=0 tx=0).stop 2023-11-26T07:17:31.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.485+0000 7f390986e700 1 -- 172.21.15.2:0/3514236603 reap_dead start 2023-11-26T07:17:31.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.485+0000 7f390b2d1700 1 -- 172.21.15.2:0/3514236603 shutdown_connections 2023-11-26T07:17:31.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.485+0000 7f390b2d1700 1 -- 172.21.15.2:0/3514236603 >> 172.21.15.2:0/3514236603 conn(0x7f39040d0b10 msgr2=0x7f39040d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:31.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.485+0000 7f390b2d1700 1 -- 172.21.15.2:0/3514236603 shutdown_connections 2023-11-26T07:17:31.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.485+0000 7f390b2d1700 1 -- 172.21.15.2:0/3514236603 wait complete. 2023-11-26T07:17:31.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.487+0000 7f390b2d1700 1 Processor -- start 2023-11-26T07:17:31.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.487+0000 7f390b2d1700 1 -- start start 2023-11-26T07:17:31.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.487+0000 7f390b2d1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39041528e0 0x7f39040b5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:31.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.487+0000 7f390b2d1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39040b5f50 0x7f3904155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:31.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.487+0000 7f390b2d1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3904152cc0 0x7f390415ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:31.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.487+0000 7f390b2d1700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39040b5580 con 0x7f39041528e0 2023-11-26T07:17:31.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.487+0000 7f390b2d1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39040b4970 con 0x7f3904152cc0 2023-11-26T07:17:31.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.487+0000 7f390b2d1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39040b4c50 con 0x7f39040b5f50 2023-11-26T07:17:31.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.488+0000 7f390906d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39041528e0 0x7f39040b5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:31.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.488+0000 7f390906d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39041528e0 0x7f39040b5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44898/0 (socket says 172.21.15.2:44898) 2023-11-26T07:17:31.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.488+0000 7f390906d700 1 -- 172.21.15.2:0/1314539613 learned_addr learned my addr 172.21.15.2:0/1314539613 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:31.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.488+0000 7f390886c700 1 --2- 172.21.15.2:0/1314539613 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39040b5f50 0x7f3904155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:31.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.488+0000 7f390986e700 1 --2- 172.21.15.2:0/1314539613 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3904152cc0 0x7f390415ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:31.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.488+0000 7f390906d700 1 -- 172.21.15.2:0/1314539613 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39040b5f50 msgr2=0x7f3904155ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:31.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.488+0000 7f390906d700 1 --2- 172.21.15.2:0/1314539613 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39040b5f50 0x7f3904155ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.488+0000 7f390906d700 1 -- 172.21.15.2:0/1314539613 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3904152cc0 msgr2=0x7f390415ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:31.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.488+0000 7f390906d700 1 --2- 172.21.15.2:0/1314539613 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3904152cc0 0x7f390415ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.488+0000 7f390906d700 1 -- 172.21.15.2:0/1314539613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39040b4f30 con 0x7f39041528e0 2023-11-26T07:17:31.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.488+0000 7f390906d700 1 --2- 172.21.15.2:0/1314539613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39041528e0 0x7f39040b5a10 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f38f40048d0 tx=0x7f38f40075f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:31.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.488+0000 7f38f9ffb700 1 -- 172.21.15.2:0/1314539613 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f4012560 con 0x7f39041528e0 2023-11-26T07:17:31.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.488+0000 7f38f9ffb700 1 -- 172.21.15.2:0/1314539613 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f40126e0 con 0x7f39041528e0 2023-11-26T07:17:31.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.488+0000 7f390b2d1700 1 -- 172.21.15.2:0/1314539613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39040b5210 con 0x7f39041528e0 2023-11-26T07:17:31.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.488+0000 7f38f9ffb700 1 -- 172.21.15.2:0/1314539613 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f4012a90 con 0x7f39041528e0 2023-11-26T07:17:31.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.489+0000 7f390b2d1700 1 -- 172.21.15.2:0/1314539613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3904156430 con 0x7f39041528e0 2023-11-26T07:17:31.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.490+0000 7f390b2d1700 1 -- 172.21.15.2:0/1314539613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39040b5860 con 0x7f39041528e0 2023-11-26T07:17:31.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.490+0000 7f38f9ffb700 1 -- 172.21.15.2:0/1314539613 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f38f4012bf0 con 0x7f39041528e0 2023-11-26T07:17:31.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.490+0000 7f38f9ffb700 1 --2- 172.21.15.2:0/1314539613 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f38e806b980 0x7f38e806de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:31.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.490+0000 7f38f9ffb700 1 -- 172.21.15.2:0/1314539613 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f38f4087e40 con 0x7f39041528e0 2023-11-26T07:17:31.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.491+0000 7f390886c700 1 --2- 172.21.15.2:0/1314539613 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f38e806b980 0x7f38e806de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:31.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.491+0000 7f390886c700 1 --2- 172.21.15.2:0/1314539613 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f38e806b980 0x7f38e806de40 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f390406a6a0 tx=0x7f390001f040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:31.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.495+0000 7f38f9ffb700 1 -- 172.21.15.2:0/1314539613 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f38f40549a0 con 0x7f39041528e0 2023-11-26T07:17:31.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.698+0000 7f390b2d1700 1 -- 172.21.15.2:0/1314539613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3904075480 con 0x7f39041528e0 2023-11-26T07:17:31.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.698+0000 7f38f9ffb700 1 -- 172.21.15.2:0/1314539613 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7f38f4057fc0 con 0x7f39041528e0 2023-11-26T07:17:31.701 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-26T07:17:31.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.700+0000 7f390b2d1700 1 -- 172.21.15.2:0/1314539613 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f38e806b980 msgr2=0x7f38e806de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:31.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.700+0000 7f390b2d1700 1 --2- 172.21.15.2:0/1314539613 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f38e806b980 0x7f38e806de40 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f390406a6a0 tx=0x7f390001f040 comp rx=0 tx=0).stop 2023-11-26T07:17:31.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.700+0000 7f390b2d1700 1 -- 172.21.15.2:0/1314539613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39041528e0 msgr2=0x7f39040b5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:31.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.700+0000 7f390b2d1700 1 --2- 172.21.15.2:0/1314539613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39041528e0 0x7f39040b5a10 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f38f40048d0 tx=0x7f38f40075f0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.700+0000 7f390b2d1700 1 -- 172.21.15.2:0/1314539613 shutdown_connections 2023-11-26T07:17:31.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.700+0000 7f390b2d1700 1 --2- 172.21.15.2:0/1314539613 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f38e806b980 0x7f38e806de40 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.700+0000 7f390b2d1700 1 --2- 172.21.15.2:0/1314539613 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3904152cc0 0x7f390415ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.700+0000 7f390b2d1700 1 --2- 172.21.15.2:0/1314539613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39041528e0 0x7f39040b5a10 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.700+0000 7f390b2d1700 1 --2- 172.21.15.2:0/1314539613 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39040b5f50 0x7f3904155ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.700+0000 7f390b2d1700 1 -- 172.21.15.2:0/1314539613 >> 172.21.15.2:0/1314539613 conn(0x7f39040d0b10 msgr2=0x7f39040aed10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:31.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.700+0000 7f390b2d1700 1 -- 172.21.15.2:0/1314539613 shutdown_connections 2023-11-26T07:17:31.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.700+0000 7f390b2d1700 1 -- 172.21.15.2:0/1314539613 wait complete. 2023-11-26T07:17:31.714 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:17:31.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.841+0000 7f9e5255b700 1 Processor -- start 2023-11-26T07:17:31.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.841+0000 7f9e5255b700 1 -- start start 2023-11-26T07:17:31.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.841+0000 7f9e5255b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9e4c06fc50 0x7f9e4c06eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:31.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.841+0000 7f9e5255b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9e4c0b0e90 0x7f9e4c06ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:31.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.841+0000 7f9e5255b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e4c0d1230 con 0x7f9e4c15e1c0 2023-11-26T07:17:31.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.841+0000 7f9e5255b700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e4c0d0c70 con 0x7f9e4c0b0e90 2023-11-26T07:17:31.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.841+0000 7f9e5255b700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e4c0d0f50 con 0x7f9e4c06fc50 2023-11-26T07:17:31.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.842+0000 7f9e50af8700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9e4c0b0e90 0x7f9e4c06ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:31.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.842+0000 7f9e50af8700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9e4c0b0e90 0x7f9e4c06ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44910/0 (socket says 172.21.15.2:44910) 2023-11-26T07:17:31.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.842+0000 7f9e50af8700 1 -- 172.21.15.2:0/2693943445 learned_addr learned my addr 172.21.15.2:0/2693943445 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:31.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.842+0000 7f9e4b7fe700 1 --2- 172.21.15.2:0/2693943445 >> v2:172.21.15.192:3300/0 conn(0x7f9e4c06fc50 0x7f9e4c06eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:31.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.842+0000 7f9e50af8700 1 -- 172.21.15.2:0/2693943445 >> v2:172.21.15.192:3300/0 conn(0x7f9e4c06fc50 msgr2=0x7f9e4c06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:31.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.842+0000 7f9e50af8700 1 --2- 172.21.15.2:0/2693943445 >> v2:172.21.15.192:3300/0 conn(0x7f9e4c06fc50 0x7f9e4c06eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.842+0000 7f9e50af8700 1 -- 172.21.15.2:0/2693943445 >> v1:172.21.15.192:6789/0 conn(0x7f9e4c15e1c0 legacy=0x7f9e4c06f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:31.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.842+0000 7f9e50af8700 1 -- 172.21.15.2:0/2693943445 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e4c06c210 con 0x7f9e4c0b0e90 2023-11-26T07:17:31.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.842+0000 7f9e50af8700 1 --2- 172.21.15.2:0/2693943445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e4c0b0e90 0x7f9e4c06ca10 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c071ba0 tx=0x7f9e4400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a753442bf9fd192 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:31.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.842+0000 7f9e4affd700 1 -- 172.21.15.2:0/2693943445 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4400e070 con 0x7f9e4c0b0e90 2023-11-26T07:17:31.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.842+0000 7f9e4affd700 1 -- 172.21.15.2:0/2693943445 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e44003a20 con 0x7f9e4c0b0e90 2023-11-26T07:17:31.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.842+0000 7f9e4affd700 1 -- 172.21.15.2:0/2693943445 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e44003dd0 con 0x7f9e4c0b0e90 2023-11-26T07:17:31.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.843+0000 7f9e5255b700 1 -- 172.21.15.2:0/2693943445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e4c0b0e90 msgr2=0x7f9e4c06ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:31.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.843+0000 7f9e5255b700 1 --2- 172.21.15.2:0/2693943445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e4c0b0e90 0x7f9e4c06ca10 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c071ba0 tx=0x7f9e4400b330 comp rx=0 tx=0).stop 2023-11-26T07:17:31.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.843+0000 7f9e5255b700 1 -- 172.21.15.2:0/2693943445 shutdown_connections 2023-11-26T07:17:31.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.843+0000 7f9e5255b700 1 --2- 172.21.15.2:0/2693943445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e4c0b0e90 0x7f9e4c06ca10 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.843+0000 7f9e5255b700 1 --2- 172.21.15.2:0/2693943445 >> v2:172.21.15.192:3300/0 conn(0x7f9e4c06fc50 0x7f9e4c06eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.843+0000 7f9e5255b700 1 -- 172.21.15.2:0/2693943445 >> 172.21.15.2:0/2693943445 conn(0x7f9e4c0b3720 msgr2=0x7f9e4c0b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:31.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.843+0000 7f9e5255b700 1 -- 172.21.15.2:0/2693943445 shutdown_connections 2023-11-26T07:17:31.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.843+0000 7f9e5255b700 1 -- 172.21.15.2:0/2693943445 wait complete. 2023-11-26T07:17:31.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.844+0000 7f9e5255b700 1 Processor -- start 2023-11-26T07:17:31.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.844+0000 7f9e5255b700 1 -- start start 2023-11-26T07:17:31.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.845+0000 7f9e5255b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e4c06fc50 0x7f9e4c150300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:31.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.845+0000 7f9e5255b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e4c0b0e90 0x7f9e4c0b5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:31.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.845+0000 7f9e5255b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e4c15e1c0 0x7f9e4c0b6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:31.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.845+0000 7f9e5255b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4c0cbc00 con 0x7f9e4c06fc50 2023-11-26T07:17:31.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.845+0000 7f9e5255b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4c0cab60 con 0x7f9e4c15e1c0 2023-11-26T07:17:31.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.845+0000 7f9e5255b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4c0cae40 con 0x7f9e4c0b0e90 2023-11-26T07:17:31.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.845+0000 7f9e4bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e4c06fc50 0x7f9e4c150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:31.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.845+0000 7f9e4bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e4c06fc50 0x7f9e4c150300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44912/0 (socket says 172.21.15.2:44912) 2023-11-26T07:17:31.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.845+0000 7f9e4bfff700 1 -- 172.21.15.2:0/1480862201 learned_addr learned my addr 172.21.15.2:0/1480862201 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:31.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.845+0000 7f9e4b7fe700 1 --2- 172.21.15.2:0/1480862201 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e4c0b0e90 0x7f9e4c0b5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:31.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.845+0000 7f9e4bfff700 1 -- 172.21.15.2:0/1480862201 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e4c0b0e90 msgr2=0x7f9e4c0b5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:31.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.845+0000 7f9e50af8700 1 --2- 172.21.15.2:0/1480862201 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e4c15e1c0 0x7f9e4c0b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:31.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.845+0000 7f9e4bfff700 1 --2- 172.21.15.2:0/1480862201 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e4c0b0e90 0x7f9e4c0b5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.845+0000 7f9e4bfff700 1 -- 172.21.15.2:0/1480862201 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e4c15e1c0 msgr2=0x7f9e4c0b6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:31.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.845+0000 7f9e4bfff700 1 --2- 172.21.15.2:0/1480862201 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e4c15e1c0 0x7f9e4c0b6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:31.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.845+0000 7f9e4bfff700 1 -- 172.21.15.2:0/1480862201 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e44009b30 con 0x7f9e4c06fc50 2023-11-26T07:17:31.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.845+0000 7f9e50af8700 1 --2- 172.21.15.2:0/1480862201 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e4c15e1c0 0x7f9e4c0b6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:31.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.845+0000 7f9e4b7fe700 1 --2- 172.21.15.2:0/1480862201 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e4c0b0e90 0x7f9e4c0b5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:31.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.846+0000 7f9e4bfff700 1 --2- 172.21.15.2:0/1480862201 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e4c06fc50 0x7f9e4c150300 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c00b4a0 tx=0x7f9e3c00b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:31.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.846+0000 7f9e48ff9700 1 -- 172.21.15.2:0/1480862201 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c011830 con 0x7f9e4c06fc50 2023-11-26T07:17:31.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.846+0000 7f9e48ff9700 1 -- 172.21.15.2:0/1480862201 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3c011990 con 0x7f9e4c06fc50 2023-11-26T07:17:31.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.846+0000 7f9e5255b700 1 -- 172.21.15.2:0/1480862201 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e4c0cb120 con 0x7f9e4c06fc50 2023-11-26T07:17:31.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.846+0000 7f9e48ff9700 1 -- 172.21.15.2:0/1480862201 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c011d40 con 0x7f9e4c06fc50 2023-11-26T07:17:31.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.846+0000 7f9e5255b700 1 -- 172.21.15.2:0/1480862201 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e4c0cb6e0 con 0x7f9e4c06fc50 2023-11-26T07:17:31.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.847+0000 7f9e5255b700 1 -- 172.21.15.2:0/1480862201 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e4c075480 con 0x7f9e4c06fc50 2023-11-26T07:17:31.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.847+0000 7f9e48ff9700 1 -- 172.21.15.2:0/1480862201 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f9e3c01a400 con 0x7f9e4c06fc50 2023-11-26T07:17:31.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.848+0000 7f9e48ff9700 1 --2- 172.21.15.2:0/1480862201 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9e3806b980 0x7f9e3806de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:31.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.848+0000 7f9e48ff9700 1 -- 172.21.15.2:0/1480862201 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f9e3c087e70 con 0x7f9e4c06fc50 2023-11-26T07:17:31.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.848+0000 7f9e4b7fe700 1 --2- 172.21.15.2:0/1480862201 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9e3806b980 0x7f9e3806de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:31.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.848+0000 7f9e4b7fe700 1 --2- 172.21.15.2:0/1480862201 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9e3806b980 0x7f9e3806de40 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c0cfb30 tx=0x7f9e40008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:31.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:31.852+0000 7f9e48ff9700 1 -- 172.21.15.2:0/1480862201 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9e3c0547a0 con 0x7f9e4c06fc50 2023-11-26T07:17:32.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.053+0000 7f9e5255b700 1 -- 172.21.15.2:0/1480862201 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9e4c0b4240 con 0x7f9e4c06fc50 2023-11-26T07:17:32.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.054+0000 7f9e48ff9700 1 -- 172.21.15.2:0/1480862201 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v75) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9e3c015020 con 0x7f9e4c06fc50 2023-11-26T07:17:32.057 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-26T07:17:32.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.056+0000 7f9e5255b700 1 -- 172.21.15.2:0/1480862201 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9e3806b980 msgr2=0x7f9e3806de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:32.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.056+0000 7f9e5255b700 1 --2- 172.21.15.2:0/1480862201 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9e3806b980 0x7f9e3806de40 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c0cfb30 tx=0x7f9e40008040 comp rx=0 tx=0).stop 2023-11-26T07:17:32.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.056+0000 7f9e5255b700 1 -- 172.21.15.2:0/1480862201 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e4c06fc50 msgr2=0x7f9e4c150300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:32.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.056+0000 7f9e5255b700 1 --2- 172.21.15.2:0/1480862201 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e4c06fc50 0x7f9e4c150300 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c00b4a0 tx=0x7f9e3c00b860 comp rx=0 tx=0).stop 2023-11-26T07:17:32.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.056+0000 7f9e5255b700 1 -- 172.21.15.2:0/1480862201 shutdown_connections 2023-11-26T07:17:32.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.056+0000 7f9e5255b700 1 --2- 172.21.15.2:0/1480862201 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f9e3806b980 0x7f9e3806de40 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.056+0000 7f9e5255b700 1 --2- 172.21.15.2:0/1480862201 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e4c15e1c0 0x7f9e4c0b6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.056+0000 7f9e5255b700 1 --2- 172.21.15.2:0/1480862201 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e4c06fc50 0x7f9e4c150300 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.056+0000 7f9e5255b700 1 --2- 172.21.15.2:0/1480862201 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e4c0b0e90 0x7f9e4c0b5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.056+0000 7f9e5255b700 1 -- 172.21.15.2:0/1480862201 >> 172.21.15.2:0/1480862201 conn(0x7f9e4c0b3720 msgr2=0x7f9e4c06f430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:32.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.056+0000 7f9e5255b700 1 -- 172.21.15.2:0/1480862201 shutdown_connections 2023-11-26T07:17:32.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.056+0000 7f9e5255b700 1 -- 172.21.15.2:0/1480862201 wait complete. 2023-11-26T07:17:32.070 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:17:32.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.198+0000 7fb38bd17700 1 Processor -- start 2023-11-26T07:17:32.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.198+0000 7fb38bd17700 1 -- start start 2023-11-26T07:17:32.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.198+0000 7fb38bd17700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb38415ace0 0x7fb38415e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:32.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.199+0000 7fb38bd17700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb38406e300 0x7fb38406afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:32.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.199+0000 7fb38bd17700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb384072710 con 0x7fb38406c6b0 2023-11-26T07:17:32.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.199+0000 7fb38bd17700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb384073300 con 0x7fb38406e300 2023-11-26T07:17:32.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.199+0000 7fb38bd17700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb38415c0d0 con 0x7fb38415ace0 2023-11-26T07:17:32.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.199+0000 7fb38a2b4700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb38406e300 0x7fb38406afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:32.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.199+0000 7fb38a2b4700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb38406e300 0x7fb38406afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44922/0 (socket says 172.21.15.2:44922) 2023-11-26T07:17:32.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.199+0000 7fb38a2b4700 1 -- 172.21.15.2:0/895349097 learned_addr learned my addr 172.21.15.2:0/895349097 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:32.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.199+0000 7fb389ab3700 1 --2- 172.21.15.2:0/895349097 >> v2:172.21.15.192:3300/0 conn(0x7fb38415ace0 0x7fb38415e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:32.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.199+0000 7fb38a2b4700 1 -- 172.21.15.2:0/895349097 >> v2:172.21.15.192:3300/0 conn(0x7fb38415ace0 msgr2=0x7fb38415e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:32.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.199+0000 7fb38a2b4700 1 --2- 172.21.15.2:0/895349097 >> v2:172.21.15.192:3300/0 conn(0x7fb38415ace0 0x7fb38415e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.199+0000 7fb38a2b4700 1 -- 172.21.15.2:0/895349097 >> v1:172.21.15.192:6789/0 conn(0x7fb38406c6b0 legacy=0x7fb38415edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:32.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.199+0000 7fb38a2b4700 1 -- 172.21.15.2:0/895349097 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb384072960 con 0x7fb38406e300 2023-11-26T07:17:32.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.199+0000 7fb38a2b4700 1 --2- 172.21.15.2:0/895349097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb38406e300 0x7fb38406afd0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fb38406f610 tx=0x7fb37c00d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4167a365709333e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:32.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.199+0000 7fb388ab1700 1 -- 172.21.15.2:0/895349097 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37c010070 con 0x7fb38406e300 2023-11-26T07:17:32.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.199+0000 7fb388ab1700 1 -- 172.21.15.2:0/895349097 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb37c00dd40 con 0x7fb38406e300 2023-11-26T07:17:32.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.199+0000 7fb388ab1700 1 -- 172.21.15.2:0/895349097 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37c00b310 con 0x7fb38406e300 2023-11-26T07:17:32.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.200+0000 7fb38bd17700 1 -- 172.21.15.2:0/895349097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb38406e300 msgr2=0x7fb38406afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:32.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.200+0000 7fb38bd17700 1 --2- 172.21.15.2:0/895349097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb38406e300 0x7fb38406afd0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fb38406f610 tx=0x7fb37c00d460 comp rx=0 tx=0).stop 2023-11-26T07:17:32.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.200+0000 7fb38bd17700 1 -- 172.21.15.2:0/895349097 shutdown_connections 2023-11-26T07:17:32.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.200+0000 7fb38bd17700 1 --2- 172.21.15.2:0/895349097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb38406e300 0x7fb38406afd0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.200+0000 7fb38bd17700 1 --2- 172.21.15.2:0/895349097 >> v2:172.21.15.192:3300/0 conn(0x7fb38415ace0 0x7fb38415e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.200+0000 7fb38bd17700 1 -- 172.21.15.2:0/895349097 >> 172.21.15.2:0/895349097 conn(0x7fb3840b5070 msgr2=0x7fb3840b5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:32.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.200+0000 7fb38bd17700 1 -- 172.21.15.2:0/895349097 shutdown_connections 2023-11-26T07:17:32.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.200+0000 7fb38bd17700 1 -- 172.21.15.2:0/895349097 wait complete. 2023-11-26T07:17:32.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.201+0000 7fb38bd17700 1 Processor -- start 2023-11-26T07:17:32.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.201+0000 7fb38bd17700 1 -- start start 2023-11-26T07:17:32.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.202+0000 7fb38bd17700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb38406c6b0 0x7fb384150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:32.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.202+0000 7fb38bd17700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb38406e300 0x7fb38415ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:32.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.202+0000 7fb38bd17700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb38415ace0 0x7fb3840b1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:32.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.202+0000 7fb38bd17700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38415d6d0 con 0x7fb38406e300 2023-11-26T07:17:32.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.202+0000 7fb38bd17700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3840b0d10 con 0x7fb38415ace0 2023-11-26T07:17:32.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.202+0000 7fb38bd17700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3840b0ff0 con 0x7fb38406c6b0 2023-11-26T07:17:32.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.202+0000 7fb3892b2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb38406e300 0x7fb38415ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:32.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.202+0000 7fb3892b2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb38406e300 0x7fb38415ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44926/0 (socket says 172.21.15.2:44926) 2023-11-26T07:17:32.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.202+0000 7fb3892b2700 1 -- 172.21.15.2:0/3333458292 learned_addr learned my addr 172.21.15.2:0/3333458292 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:32.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.202+0000 7fb3892b2700 1 -- 172.21.15.2:0/3333458292 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb38406c6b0 msgr2=0x7fb384150710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:32.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.202+0000 7fb3892b2700 1 --2- 172.21.15.2:0/3333458292 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb38406c6b0 0x7fb384150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.202+0000 7fb3892b2700 1 -- 172.21.15.2:0/3333458292 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb38415ace0 msgr2=0x7fb3840b1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:32.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.202+0000 7fb38a2b4700 1 --2- 172.21.15.2:0/3333458292 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb38415ace0 0x7fb3840b1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:32.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.202+0000 7fb3892b2700 1 --2- 172.21.15.2:0/3333458292 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb38415ace0 0x7fb3840b1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.202+0000 7fb3892b2700 1 -- 172.21.15.2:0/3333458292 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb37c00bd40 con 0x7fb38406e300 2023-11-26T07:17:32.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.203+0000 7fb3892b2700 1 --2- 172.21.15.2:0/3333458292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb38406e300 0x7fb38415ea90 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fb38000c520 tx=0x7fb38000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:32.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.203+0000 7fb3767fc700 1 -- 172.21.15.2:0/3333458292 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb380016070 con 0x7fb38406e300 2023-11-26T07:17:32.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.203+0000 7fb3767fc700 1 -- 172.21.15.2:0/3333458292 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb380006860 con 0x7fb38406e300 2023-11-26T07:17:32.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.203+0000 7fb38bd17700 1 -- 172.21.15.2:0/3333458292 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3840b12d0 con 0x7fb38406e300 2023-11-26T07:17:32.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.203+0000 7fb3767fc700 1 -- 172.21.15.2:0/3333458292 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb380006bf0 con 0x7fb38406e300 2023-11-26T07:17:32.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.203+0000 7fb38bd17700 1 -- 172.21.15.2:0/3333458292 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb384150c50 con 0x7fb38406e300 2023-11-26T07:17:32.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.204+0000 7fb38bd17700 1 -- 172.21.15.2:0/3333458292 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3840d0080 con 0x7fb38406e300 2023-11-26T07:17:32.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.204+0000 7fb3767fc700 1 -- 172.21.15.2:0/3333458292 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7fb380006d50 con 0x7fb38406e300 2023-11-26T07:17:32.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.205+0000 7fb3767fc700 1 --2- 172.21.15.2:0/3333458292 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb36806b980 0x7fb36806de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:32.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.205+0000 7fb3767fc700 1 -- 172.21.15.2:0/3333458292 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fb380087640 con 0x7fb38406e300 2023-11-26T07:17:32.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.205+0000 7fb389ab3700 1 --2- 172.21.15.2:0/3333458292 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb36806b980 0x7fb36806de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:32.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.205+0000 7fb389ab3700 1 --2- 172.21.15.2:0/3333458292 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb36806b980 0x7fb36806de40 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb37800a890 tx=0x7fb378008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:32.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.209+0000 7fb3767fc700 1 -- 172.21.15.2:0/3333458292 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb3800541a0 con 0x7fb38406e300 2023-11-26T07:17:32.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.411+0000 7fb38bd17700 1 -- 172.21.15.2:0/3333458292 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb384075480 con 0x7fb38406e300 2023-11-26T07:17:32.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.411+0000 7fb3767fc700 1 -- 172.21.15.2:0/3333458292 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v75) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb3800577c0 con 0x7fb38406e300 2023-11-26T07:17:32.413 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-26T07:17:32.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.413+0000 7fb38bd17700 1 -- 172.21.15.2:0/3333458292 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb36806b980 msgr2=0x7fb36806de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:32.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.413+0000 7fb38bd17700 1 --2- 172.21.15.2:0/3333458292 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb36806b980 0x7fb36806de40 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb37800a890 tx=0x7fb378008040 comp rx=0 tx=0).stop 2023-11-26T07:17:32.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.413+0000 7fb38bd17700 1 -- 172.21.15.2:0/3333458292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb38406e300 msgr2=0x7fb38415ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:32.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.413+0000 7fb38bd17700 1 --2- 172.21.15.2:0/3333458292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb38406e300 0x7fb38415ea90 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fb38000c520 tx=0x7fb38000c8e0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.413+0000 7fb38bd17700 1 -- 172.21.15.2:0/3333458292 shutdown_connections 2023-11-26T07:17:32.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.413+0000 7fb38bd17700 1 --2- 172.21.15.2:0/3333458292 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb36806b980 0x7fb36806de40 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.413+0000 7fb38bd17700 1 --2- 172.21.15.2:0/3333458292 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb38415ace0 0x7fb3840b1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.413+0000 7fb38bd17700 1 --2- 172.21.15.2:0/3333458292 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb38406c6b0 0x7fb384150710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.413+0000 7fb38bd17700 1 --2- 172.21.15.2:0/3333458292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb38406e300 0x7fb38415ea90 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.413+0000 7fb38bd17700 1 -- 172.21.15.2:0/3333458292 >> 172.21.15.2:0/3333458292 conn(0x7fb3840b5070 msgr2=0x7fb3841597f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:32.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.413+0000 7fb38bd17700 1 -- 172.21.15.2:0/3333458292 shutdown_connections 2023-11-26T07:17:32.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.413+0000 7fb38bd17700 1 -- 172.21.15.2:0/3333458292 wait complete. 2023-11-26T07:17:32.428 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-26T07:17:32.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.559+0000 7ff399fb3700 1 Processor -- start 2023-11-26T07:17:32.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.559+0000 7ff399fb3700 1 -- start start 2023-11-26T07:17:32.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.560+0000 7ff399fb3700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff3940b4150 0x7ff39406de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:32.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.560+0000 7ff399fb3700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff3940b5ab0 0x7ff39406e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:32.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.560+0000 7ff399fb3700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff394071f50 con 0x7ff39406b620 2023-11-26T07:17:32.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.560+0000 7ff399fb3700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff394072230 con 0x7ff3940b5ab0 2023-11-26T07:17:32.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.560+0000 7ff399fb3700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff394072510 con 0x7ff3940b4150 2023-11-26T07:17:32.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.560+0000 7ff3937fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff39406b620 0x7ff3940b3a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36142/0 (socket says 172.21.15.2:36142) 2023-11-26T07:17:32.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.560+0000 7ff3937fe700 1 -- 172.21.15.2:0/3542911588 learned_addr learned my addr 172.21.15.2:0/3542911588 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:32.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.560+0000 7ff393fff700 1 --2- 172.21.15.2:0/3542911588 >> v2:172.21.15.2:3300/0 conn(0x7ff3940b5ab0 0x7ff39406e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:32.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.561+0000 7ff392ffd700 1 --2- 172.21.15.2:0/3542911588 >> v2:172.21.15.192:3300/0 conn(0x7ff3940b4150 0x7ff39406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:32.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.561+0000 7ff3927fc700 1 -- 172.21.15.2:0/3542911588 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1906017809 0 0) 0x7ff394071f50 con 0x7ff39406b620 2023-11-26T07:17:32.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.561+0000 7ff3927fc700 1 -- 172.21.15.2:0/3542911588 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3800035b0 con 0x7ff39406b620 2023-11-26T07:17:32.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.561+0000 7ff393fff700 1 -- 172.21.15.2:0/3542911588 >> v2:172.21.15.192:3300/0 conn(0x7ff3940b4150 msgr2=0x7ff39406de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:32.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.561+0000 7ff393fff700 1 --2- 172.21.15.2:0/3542911588 >> v2:172.21.15.192:3300/0 conn(0x7ff3940b4150 0x7ff39406de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.561+0000 7ff393fff700 1 -- 172.21.15.2:0/3542911588 >> v1:172.21.15.2:6789/0 conn(0x7ff39406b620 legacy=0x7ff3940b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:32.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.561+0000 7ff393fff700 1 -- 172.21.15.2:0/3542911588 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3940727f0 con 0x7ff3940b5ab0 2023-11-26T07:17:32.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.561+0000 7ff392ffd700 1 --2- 172.21.15.2:0/3542911588 >> v2:172.21.15.192:3300/0 conn(0x7ff3940b4150 0x7ff39406de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:32.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.561+0000 7ff393fff700 1 --2- 172.21.15.2:0/3542911588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3940b5ab0 0x7ff39406e390 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7ff39406d6f0 tx=0x7ff38c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2db2f26dc7f5aed server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:32.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.561+0000 7ff3927fc700 1 -- 172.21.15.2:0/3542911588 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c00e070 con 0x7ff3940b5ab0 2023-11-26T07:17:32.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.561+0000 7ff3927fc700 1 -- 172.21.15.2:0/3542911588 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38c00bb20 con 0x7ff3940b5ab0 2023-11-26T07:17:32.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.561+0000 7ff3927fc700 1 -- 172.21.15.2:0/3542911588 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c012430 con 0x7ff3940b5ab0 2023-11-26T07:17:32.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.562+0000 7ff399fb3700 1 -- 172.21.15.2:0/3542911588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3940b5ab0 msgr2=0x7ff39406e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:32.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.562+0000 7ff399fb3700 1 --2- 172.21.15.2:0/3542911588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3940b5ab0 0x7ff39406e390 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7ff39406d6f0 tx=0x7ff38c00b330 comp rx=0 tx=0).stop 2023-11-26T07:17:32.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.562+0000 7ff399fb3700 1 -- 172.21.15.2:0/3542911588 shutdown_connections 2023-11-26T07:17:32.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.562+0000 7ff399fb3700 1 --2- 172.21.15.2:0/3542911588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3940b5ab0 0x7ff39406e390 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.562+0000 7ff399fb3700 1 --2- 172.21.15.2:0/3542911588 >> v2:172.21.15.192:3300/0 conn(0x7ff3940b4150 0x7ff39406de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.562+0000 7ff399fb3700 1 -- 172.21.15.2:0/3542911588 >> 172.21.15.2:0/3542911588 conn(0x7ff3940b2740 msgr2=0x7ff3940b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:32.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.562+0000 7ff399fb3700 1 -- 172.21.15.2:0/3542911588 shutdown_connections 2023-11-26T07:17:32.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.562+0000 7ff399fb3700 1 -- 172.21.15.2:0/3542911588 wait complete. 2023-11-26T07:17:32.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.563+0000 7ff399fb3700 1 Processor -- start 2023-11-26T07:17:32.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.563+0000 7ff399fb3700 1 -- start start 2023-11-26T07:17:32.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.564+0000 7ff399fb3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff39406b620 0x7ff3941e2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:32.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.564+0000 7ff399fb3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff3940b4150 0x7ff3940c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:32.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.564+0000 7ff399fb3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3940b5ab0 0x7ff3940c8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:32.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.564+0000 7ff399fb3700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3940c5a50 con 0x7ff3940b5ab0 2023-11-26T07:17:32.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.564+0000 7ff399fb3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3940c5cf0 con 0x7ff39406b620 2023-11-26T07:17:32.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.564+0000 7ff399fb3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3940c5fd0 con 0x7ff3940b4150 2023-11-26T07:17:32.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.564+0000 7ff393fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3940b5ab0 0x7ff3940c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:32.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.564+0000 7ff393fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3940b5ab0 0x7ff3940c8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44942/0 (socket says 172.21.15.2:44942) 2023-11-26T07:17:32.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.564+0000 7ff393fff700 1 -- 172.21.15.2:0/2630374981 learned_addr learned my addr 172.21.15.2:0/2630374981 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:32.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.564+0000 7ff392ffd700 1 --2- 172.21.15.2:0/2630374981 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff3940b4150 0x7ff3940c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:32.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.564+0000 7ff3937fe700 1 --2- 172.21.15.2:0/2630374981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff39406b620 0x7ff3941e2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:32.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.564+0000 7ff393fff700 1 -- 172.21.15.2:0/2630374981 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff3940b4150 msgr2=0x7ff3940c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:32.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.564+0000 7ff393fff700 1 --2- 172.21.15.2:0/2630374981 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff3940b4150 0x7ff3940c7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.564+0000 7ff393fff700 1 -- 172.21.15.2:0/2630374981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff39406b620 msgr2=0x7ff3941e2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:32.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.564+0000 7ff393fff700 1 --2- 172.21.15.2:0/2630374981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff39406b620 0x7ff3941e2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.564+0000 7ff393fff700 1 -- 172.21.15.2:0/2630374981 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff38c009a70 con 0x7ff3940b5ab0 2023-11-26T07:17:32.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.564+0000 7ff393fff700 1 --2- 172.21.15.2:0/2630374981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3940b5ab0 0x7ff3940c8480 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7ff38c014040 tx=0x7ff38c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:32.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.564+0000 7ff38bfff700 1 -- 172.21.15.2:0/2630374981 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c012430 con 0x7ff3940b5ab0 2023-11-26T07:17:32.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.565+0000 7ff38bfff700 1 -- 172.21.15.2:0/2630374981 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38c020070 con 0x7ff3940b5ab0 2023-11-26T07:17:32.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.565+0000 7ff399fb3700 1 -- 172.21.15.2:0/2630374981 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3940c62b0 con 0x7ff3940b5ab0 2023-11-26T07:17:32.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.565+0000 7ff38bfff700 1 -- 172.21.15.2:0/2630374981 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c004280 con 0x7ff3940b5ab0 2023-11-26T07:17:32.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.565+0000 7ff399fb3700 1 -- 172.21.15.2:0/2630374981 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3941e31c0 con 0x7ff3940b5ab0 2023-11-26T07:17:32.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.565+0000 7ff399fb3700 1 -- 172.21.15.2:0/2630374981 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff394068670 con 0x7ff3940b5ab0 2023-11-26T07:17:32.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.566+0000 7ff38bfff700 1 -- 172.21.15.2:0/2630374981 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7ff38c0043e0 con 0x7ff3940b5ab0 2023-11-26T07:17:32.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.566+0000 7ff38bfff700 1 --2- 172.21.15.2:0/2630374981 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff37406b980 0x7ff37406de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:32.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.567+0000 7ff38bfff700 1 -- 172.21.15.2:0/2630374981 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ff38c022070 con 0x7ff3940b5ab0 2023-11-26T07:17:32.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.567+0000 7ff3937fe700 1 --2- 172.21.15.2:0/2630374981 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff37406b980 0x7ff37406de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:32.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.567+0000 7ff3937fe700 1 --2- 172.21.15.2:0/2630374981 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff37406b980 0x7ff37406de40 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff3840011e0 tx=0x7ff384009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:32.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.571+0000 7ff38bfff700 1 -- 172.21.15.2:0/2630374981 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff38c056820 con 0x7ff3940b5ab0 2023-11-26T07:17:32.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.799+0000 7ff399fb3700 1 -- 172.21.15.2:0/2630374981 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff39406bd40 con 0x7ff3940b5ab0 2023-11-26T07:17:32.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.800+0000 7ff38bfff700 1 -- 172.21.15.2:0/2630374981 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v75) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff38c02c020 con 0x7ff3940b5ab0 2023-11-26T07:17:32.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.802+0000 7ff399fb3700 1 -- 172.21.15.2:0/2630374981 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff37406b980 msgr2=0x7ff37406de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:32.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.802+0000 7ff399fb3700 1 --2- 172.21.15.2:0/2630374981 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff37406b980 0x7ff37406de40 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff3840011e0 tx=0x7ff384009040 comp rx=0 tx=0).stop 2023-11-26T07:17:32.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.802+0000 7ff399fb3700 1 -- 172.21.15.2:0/2630374981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3940b5ab0 msgr2=0x7ff3940c8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:32.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.802+0000 7ff399fb3700 1 --2- 172.21.15.2:0/2630374981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3940b5ab0 0x7ff3940c8480 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7ff38c014040 tx=0x7ff38c004ad0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.802+0000 7ff399fb3700 1 -- 172.21.15.2:0/2630374981 shutdown_connections 2023-11-26T07:17:32.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.802+0000 7ff399fb3700 1 --2- 172.21.15.2:0/2630374981 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7ff37406b980 0x7ff37406de40 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.802+0000 7ff399fb3700 1 --2- 172.21.15.2:0/2630374981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3940b5ab0 0x7ff3940c8480 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.802+0000 7ff399fb3700 1 --2- 172.21.15.2:0/2630374981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff39406b620 0x7ff3941e2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.802+0000 7ff399fb3700 1 --2- 172.21.15.2:0/2630374981 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff3940b4150 0x7ff3940c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:32.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.802+0000 7ff399fb3700 1 -- 172.21.15.2:0/2630374981 >> 172.21.15.2:0/2630374981 conn(0x7ff3940b2740 msgr2=0x7ff3940b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:32.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.802+0000 7ff399fb3700 1 -- 172.21.15.2:0/2630374981 shutdown_connections 2023-11-26T07:17:32.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:32.802+0000 7ff399fb3700 1 -- 172.21.15.2:0/2630374981 wait complete. 2023-11-26T07:17:32.805 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2023-11-26T07:17:32.816 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-26T07:17:32.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:32.816 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-26T07:17:32.860 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2023-11-26T07:17:32.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:32.860 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-26T07:17:32.920 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:32.920 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:32.938 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19704 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-26T07:17:32.938 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:17:32.938 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:32.979 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284224k,nr_inodes=4071056,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3837 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260544k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-26T07:17:32.979 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:17:33.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.102+0000 7fb7143a7700 1 Processor -- start 2023-11-26T07:17:33.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.103+0000 7fb7143a7700 1 -- start start 2023-11-26T07:17:33.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.103+0000 7fb7143a7700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb70c0b4150 0x7fb70c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:33.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.103+0000 7fb7143a7700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb70c071f50 con 0x7fb70c0b5ab0 2023-11-26T07:17:33.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.103+0000 7fb7143a7700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb70c072230 con 0x7fb70c06b620 2023-11-26T07:17:33.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.103+0000 7fb7143a7700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb70c072510 con 0x7fb70c0b4150 2023-11-26T07:17:33.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.104+0000 7fb711942700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb70c0b4150 0x7fb70c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:33.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.104+0000 7fb712944700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb70c0b5ab0 0x7fb70c06e390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36160/0 (socket says 172.21.15.2:36160) 2023-11-26T07:17:33.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.104+0000 7fb712944700 1 -- 172.21.15.2:0/893275849 learned_addr learned my addr 172.21.15.2:0/893275849 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:33.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.104+0000 7fb711942700 1 -- 172.21.15.2:0/893275849 >> v1:172.21.15.192:6789/0 conn(0x7fb70c06b620 legacy=0x7fb70c0b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:33.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.104+0000 7fb711942700 1 -- 172.21.15.2:0/893275849 >> v1:172.21.15.2:6789/0 conn(0x7fb70c0b5ab0 legacy=0x7fb70c06e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:33.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.104+0000 7fb711942700 1 -- 172.21.15.2:0/893275849 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb70c0727f0 con 0x7fb70c0b4150 2023-11-26T07:17:33.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.104+0000 7fb711141700 1 -- 172.21.15.2:0/893275849 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 520453692 0 0) 0x7fb70c071f50 con 0x7fb70c0b5ab0 2023-11-26T07:17:33.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.104+0000 7fb711942700 1 --2- 172.21.15.2:0/893275849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb70c0b4150 0x7fb70c06de50 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fb700009840 tx=0x7fb700009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c0f3ff38a22c761 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:33.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.104+0000 7fb711141700 1 -- 172.21.15.2:0/893275849 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb700011830 con 0x7fb70c0b4150 2023-11-26T07:17:33.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.104+0000 7fb711141700 1 -- 172.21.15.2:0/893275849 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb700011990 con 0x7fb70c0b4150 2023-11-26T07:17:33.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.104+0000 7fb711141700 1 -- 172.21.15.2:0/893275849 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb700011d20 con 0x7fb70c0b4150 2023-11-26T07:17:33.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.105+0000 7fb7143a7700 1 -- 172.21.15.2:0/893275849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb70c0b4150 msgr2=0x7fb70c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:33.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.105+0000 7fb7143a7700 1 --2- 172.21.15.2:0/893275849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb70c0b4150 0x7fb70c06de50 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fb700009840 tx=0x7fb700009b50 comp rx=0 tx=0).stop 2023-11-26T07:17:33.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.105+0000 7fb7143a7700 1 -- 172.21.15.2:0/893275849 shutdown_connections 2023-11-26T07:17:33.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.105+0000 7fb7143a7700 1 --2- 172.21.15.2:0/893275849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb70c0b4150 0x7fb70c06de50 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:33.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.105+0000 7fb7143a7700 1 -- 172.21.15.2:0/893275849 >> 172.21.15.2:0/893275849 conn(0x7fb70c0b2740 msgr2=0x7fb70c0b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:33.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.105+0000 7fb7143a7700 1 -- 172.21.15.2:0/893275849 shutdown_connections 2023-11-26T07:17:33.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.105+0000 7fb7143a7700 1 -- 172.21.15.2:0/893275849 wait complete. 2023-11-26T07:17:33.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.106+0000 7fb7143a7700 1 Processor -- start 2023-11-26T07:17:33.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.106+0000 7fb7143a7700 1 -- start start 2023-11-26T07:17:33.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.107+0000 7fb7143a7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb70c06b620 0x7fb70c13b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:33.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.107+0000 7fb7143a7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb70c0b4150 0x7fb70c06db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:33.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.107+0000 7fb7143a7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb70c0b5ab0 0x7fb70c1d5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:33.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.107+0000 7fb7143a7700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb70c06e550 con 0x7fb70c0b5ab0 2023-11-26T07:17:33.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.107+0000 7fb7143a7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb70c06e830 con 0x7fb70c0b4150 2023-11-26T07:17:33.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.107+0000 7fb7143a7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb70c06eb10 con 0x7fb70c06b620 2023-11-26T07:17:33.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.107+0000 7fb712944700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb70c0b5ab0 0x7fb70c1d5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:33.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.107+0000 7fb712944700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb70c0b5ab0 0x7fb70c1d5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44956/0 (socket says 172.21.15.2:44956) 2023-11-26T07:17:33.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.107+0000 7fb712944700 1 -- 172.21.15.2:0/245269145 learned_addr learned my addr 172.21.15.2:0/245269145 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:33.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.107+0000 7fb712143700 1 --2- 172.21.15.2:0/245269145 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb70c06b620 0x7fb70c13b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:33.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.107+0000 7fb711942700 1 --2- 172.21.15.2:0/245269145 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb70c0b4150 0x7fb70c06db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:33.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.107+0000 7fb712944700 1 -- 172.21.15.2:0/245269145 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb70c06b620 msgr2=0x7fb70c13b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:33.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.107+0000 7fb712944700 1 --2- 172.21.15.2:0/245269145 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb70c06b620 0x7fb70c13b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:33.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.107+0000 7fb712944700 1 -- 172.21.15.2:0/245269145 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb70c0b4150 msgr2=0x7fb70c06db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:33.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.107+0000 7fb712944700 1 --2- 172.21.15.2:0/245269145 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb70c0b4150 0x7fb70c06db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:33.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.107+0000 7fb712944700 1 -- 172.21.15.2:0/245269145 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7000094a0 con 0x7fb70c0b5ab0 2023-11-26T07:17:33.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.108+0000 7fb712944700 1 --2- 172.21.15.2:0/245269145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb70c0b5ab0 0x7fb70c1d5760 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fb70400cba0 tx=0x7fb70400ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:33.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.108+0000 7fb6feffd700 1 -- 172.21.15.2:0/245269145 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70400aaa0 con 0x7fb70c0b5ab0 2023-11-26T07:17:33.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.108+0000 7fb6feffd700 1 -- 172.21.15.2:0/245269145 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70400ac20 con 0x7fb70c0b5ab0 2023-11-26T07:17:33.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.108+0000 7fb7143a7700 1 -- 172.21.15.2:0/245269145 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb70c06edf0 con 0x7fb70c0b5ab0 2023-11-26T07:17:33.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.108+0000 7fb6feffd700 1 -- 172.21.15.2:0/245269145 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7040070d0 con 0x7fb70c0b5ab0 2023-11-26T07:17:33.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.108+0000 7fb7143a7700 1 -- 172.21.15.2:0/245269145 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb70c13b7b0 con 0x7fb70c0b5ab0 2023-11-26T07:17:33.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.109+0000 7fb7143a7700 1 -- 172.21.15.2:0/245269145 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb70c068670 con 0x7fb70c0b5ab0 2023-11-26T07:17:33.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.109+0000 7fb6feffd700 1 -- 172.21.15.2:0/245269145 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7fb704007230 con 0x7fb70c0b5ab0 2023-11-26T07:17:33.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.110+0000 7fb6feffd700 1 --2- 172.21.15.2:0/245269145 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb6f006b980 0x7fb6f006de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:33.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.110+0000 7fb6feffd700 1 -- 172.21.15.2:0/245269145 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fb704087ee0 con 0x7fb70c0b5ab0 2023-11-26T07:17:33.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.110+0000 7fb712143700 1 --2- 172.21.15.2:0/245269145 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb6f006b980 0x7fb6f006de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:33.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.110+0000 7fb712143700 1 --2- 172.21.15.2:0/245269145 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb6f006b980 0x7fb6f006de40 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb708007fd0 tx=0x7fb708009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:33.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.114+0000 7fb6feffd700 1 -- 172.21.15.2:0/245269145 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb704054770 con 0x7fb70c0b5ab0 2023-11-26T07:17:33.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.368+0000 7fb7143a7700 1 -- 172.21.15.2:0/245269145 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb70c06bd40 con 0x7fb70c0b5ab0 2023-11-26T07:17:33.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.369+0000 7fb6feffd700 1 -- 172.21.15.2:0/245269145 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4912 (secure 0 0 0) 0x7fb704018020 con 0x7fb70c0b5ab0 2023-11-26T07:17:33.371 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:17:33.371 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":47,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5678,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3437634953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3437634953},{"type":"v1","addr":"172.21.15.192:6835","nonce":3437634953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":5684,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2624944008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2624944008},{"type":"v1","addr":"172.21.15.192:6837","nonce":2624944008}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6711,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/1847794001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1847794001},{"type":"v1","addr":"172.21.15.2:6834","nonce":1847794001}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:16:32.014651+0000","modified":"2023-11-26T07:16:35.045399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6714},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6714":{"gid":6714,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6835/177641343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":177641343},{"type":"v1","addr":"172.21.15.2:6835","nonce":177641343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-26T07:17:33.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.371+0000 7fb7143a7700 1 -- 172.21.15.2:0/245269145 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb6f006b980 msgr2=0x7fb6f006de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:33.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.371+0000 7fb7143a7700 1 --2- 172.21.15.2:0/245269145 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb6f006b980 0x7fb6f006de40 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb708007fd0 tx=0x7fb708009040 comp rx=0 tx=0).stop 2023-11-26T07:17:33.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.371+0000 7fb7143a7700 1 -- 172.21.15.2:0/245269145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb70c0b5ab0 msgr2=0x7fb70c1d5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:33.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.371+0000 7fb7143a7700 1 --2- 172.21.15.2:0/245269145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb70c0b5ab0 0x7fb70c1d5760 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fb70400cba0 tx=0x7fb70400ceb0 comp rx=0 tx=0).stop 2023-11-26T07:17:33.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.371+0000 7fb7143a7700 1 -- 172.21.15.2:0/245269145 shutdown_connections 2023-11-26T07:17:33.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.371+0000 7fb7143a7700 1 --2- 172.21.15.2:0/245269145 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fb6f006b980 0x7fb6f006de40 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:33.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.371+0000 7fb7143a7700 1 --2- 172.21.15.2:0/245269145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb70c0b5ab0 0x7fb70c1d5760 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:33.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.371+0000 7fb7143a7700 1 --2- 172.21.15.2:0/245269145 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb70c06b620 0x7fb70c13b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:33.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.371+0000 7fb7143a7700 1 --2- 172.21.15.2:0/245269145 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb70c0b4150 0x7fb70c06db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:33.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.371+0000 7fb7143a7700 1 -- 172.21.15.2:0/245269145 >> 172.21.15.2:0/245269145 conn(0x7fb70c0b2740 msgr2=0x7fb70c0af070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:33.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.371+0000 7fb7143a7700 1 -- 172.21.15.2:0/245269145 shutdown_connections 2023-11-26T07:17:33.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.371+0000 7fb7143a7700 1 -- 172.21.15.2:0/245269145 wait complete. 2023-11-26T07:17:33.375 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 47 2023-11-26T07:17:33.385 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:17:33.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.508+0000 7f8b4976c700 1 Processor -- start 2023-11-26T07:17:33.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.509+0000 7f8b4976c700 1 -- start start 2023-11-26T07:17:33.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.509+0000 7f8b4976c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8b440d49d0 0x7f8b440d2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:33.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.509+0000 7f8b4976c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8b440d29d0 0x7f8b440b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:33.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.509+0000 7f8b4976c700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b440d4e50 con 0x7f8b4415e460 2023-11-26T07:17:33.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.509+0000 7f8b4976c700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b440d2e60 con 0x7f8b440d49d0 2023-11-26T07:17:33.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.509+0000 7f8b4976c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b440b3370 con 0x7f8b440d29d0 2023-11-26T07:17:33.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.510+0000 7f8b42ffd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f8b4415e460 0x7f8b440cf480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36170/0 (socket says 172.21.15.2:36170) 2023-11-26T07:17:33.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.510+0000 7f8b42ffd700 1 -- 172.21.15.2:0/579187515 learned_addr learned my addr 172.21.15.2:0/579187515 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:33.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.510+0000 7f8b427fc700 1 --2- 172.21.15.2:0/579187515 >> v2:172.21.15.192:3300/0 conn(0x7f8b440d49d0 0x7f8b440d2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:33.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.510+0000 7f8b41ffb700 1 -- 172.21.15.2:0/579187515 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2827586120 0 0) 0x7f8b440d4e50 con 0x7f8b4415e460 2023-11-26T07:17:33.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.510+0000 7f8b437fe700 1 --2- 172.21.15.2:0/579187515 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8b440d29d0 0x7f8b440b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:33.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.510+0000 7f8b41ffb700 1 -- 172.21.15.2:0/579187515 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b2c0035b0 con 0x7f8b4415e460 2023-11-26T07:17:33.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.510+0000 7f8b41ffb700 1 -- 172.21.15.2:0/579187515 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1853432759 0 0) 0x7f8b2c0035b0 con 0x7f8b4415e460 2023-11-26T07:17:33.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.510+0000 7f8b41ffb700 1 -- 172.21.15.2:0/579187515 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8b440d29d0 msgr2=0x7f8b440b40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:33.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.510+0000 7f8b41ffb700 1 --2- 172.21.15.2:0/579187515 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8b440d29d0 0x7f8b440b40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:33.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.510+0000 7f8b41ffb700 1 -- 172.21.15.2:0/579187515 >> v2:172.21.15.192:3300/0 conn(0x7f8b440d49d0 msgr2=0x7f8b440d2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:33.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.510+0000 7f8b41ffb700 1 --2- 172.21.15.2:0/579187515 >> v2:172.21.15.192:3300/0 conn(0x7f8b440d49d0 0x7f8b440d2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:33.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.510+0000 7f8b41ffb700 1 -- 172.21.15.2:0/579187515 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b440cfc40 con 0x7f8b4415e460 2023-11-26T07:17:33.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.510+0000 7f8b41ffb700 1 -- 172.21.15.2:0/579187515 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f8b34001670 con 0x7f8b4415e460 2023-11-26T07:17:33.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.510+0000 7f8b41ffb700 1 -- 172.21.15.2:0/579187515 >> v1:172.21.15.2:6789/0 conn(0x7f8b4415e460 legacy=0x7f8b440cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:33.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.510+0000 7f8b41ffb700 1 --2- 172.21.15.2:0/579187515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b2c003a00 0x7f8b2c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:33.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.510+0000 7f8b41ffb700 1 --2- 172.21.15.2:0/579187515 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8b440d29d0 0x7f8b2c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:33.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.510+0000 7f8b41ffb700 1 --2- 172.21.15.2:0/579187515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b2c004d90 0x7f8b2c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:33.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.510+0000 7f8b41ffb700 1 -- 172.21.15.2:0/579187515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b440d2e60 con 0x7f8b2c004d90 2023-11-26T07:17:33.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.510+0000 7f8b41ffb700 1 -- 172.21.15.2:0/579187515 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b440b3370 con 0x7f8b2c003a00 2023-11-26T07:17:33.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.510+0000 7f8b41ffb700 1 -- 172.21.15.2:0/579187515 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2c00ba10 con 0x7f8b440d29d0 2023-11-26T07:17:33.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.510+0000 7f8b437fe700 1 --2- 172.21.15.2:0/579187515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b2c004d90 0x7f8b2c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:33.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.510+0000 7f8b42ffd700 1 --2- 172.21.15.2:0/579187515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b2c003a00 0x7f8b2c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:33.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.510+0000 7f8b427fc700 1 --2- 172.21.15.2:0/579187515 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8b440d29d0 0x7f8b2c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:33.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.511+0000 7f8b437fe700 1 -- 172.21.15.2:0/579187515 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8b440d29d0 msgr2=0x7f8b2c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:33.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.511+0000 7f8b437fe700 1 --2- 172.21.15.2:0/579187515 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8b440d29d0 0x7f8b2c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:33.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.511+0000 7f8b437fe700 1 -- 172.21.15.2:0/579187515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b2c003a00 msgr2=0x7f8b2c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:33.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.511+0000 7f8b437fe700 1 --2- 172.21.15.2:0/579187515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b2c003a00 0x7f8b2c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:33.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.511+0000 7f8b437fe700 1 -- 172.21.15.2:0/579187515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b2c0035b0 con 0x7f8b2c004d90 2023-11-26T07:17:33.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.511+0000 7f8b437fe700 1 --2- 172.21.15.2:0/579187515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b2c004d90 0x7f8b2c005210 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c009fc0 tx=0x7f8b2c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0ed940c577245da server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:33.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.511+0000 7f8b41ffb700 1 -- 172.21.15.2:0/579187515 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c00ec30 con 0x7f8b2c004d90 2023-11-26T07:17:33.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.511+0000 7f8b41ffb700 1 -- 172.21.15.2:0/579187515 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3c00f040 con 0x7f8b2c004d90 2023-11-26T07:17:33.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.511+0000 7f8b41ffb700 1 -- 172.21.15.2:0/579187515 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c014480 con 0x7f8b2c004d90 2023-11-26T07:17:33.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.511+0000 7f8b4976c700 1 -- 172.21.15.2:0/579187515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b2c004d90 msgr2=0x7f8b2c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:33.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.511+0000 7f8b4976c700 1 --2- 172.21.15.2:0/579187515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b2c004d90 0x7f8b2c005210 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c009fc0 tx=0x7f8b2c005880 comp rx=0 tx=0).stop 2023-11-26T07:17:33.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.511+0000 7f8b437fe700 1 -- 172.21.15.2:0/579187515 reap_dead start 2023-11-26T07:17:33.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.511+0000 7f8b4976c700 1 -- 172.21.15.2:0/579187515 shutdown_connections 2023-11-26T07:17:33.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.511+0000 7f8b4976c700 1 -- 172.21.15.2:0/579187515 >> 172.21.15.2:0/579187515 conn(0x7f8b440d3eb0 msgr2=0x7f8b440d42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:33.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.512+0000 7f8b4976c700 1 -- 172.21.15.2:0/579187515 shutdown_connections 2023-11-26T07:17:33.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.512+0000 7f8b4976c700 1 -- 172.21.15.2:0/579187515 wait complete. 2023-11-26T07:17:33.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.513+0000 7f8b4976c700 1 Processor -- start 2023-11-26T07:17:33.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.513+0000 7f8b4976c700 1 -- start start 2023-11-26T07:17:33.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.514+0000 7f8b4976c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8b440b8d60 0x7f8b4415c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:33.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.514+0000 7f8b4976c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b440ca3a0 0x7f8b4415c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:33.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.514+0000 7f8b4976c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b440b9140 0x7f8b4409ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:33.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.514+0000 7f8b4976c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4415d720 con 0x7f8b440ca3a0 2023-11-26T07:17:33.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.514+0000 7f8b4976c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b440ca830 con 0x7f8b440b9140 2023-11-26T07:17:33.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.514+0000 7f8b4976c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b440c8590 con 0x7f8b440b8d60 2023-11-26T07:17:33.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.514+0000 7f8b427fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b440ca3a0 0x7f8b4415c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:33.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.514+0000 7f8b427fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b440ca3a0 0x7f8b4415c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44974/0 (socket says 172.21.15.2:44974) 2023-11-26T07:17:33.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.514+0000 7f8b427fc700 1 -- 172.21.15.2:0/128948778 learned_addr learned my addr 172.21.15.2:0/128948778 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:33.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.515+0000 7f8b42ffd700 1 --2- 172.21.15.2:0/128948778 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8b440b8d60 0x7f8b4415c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:33.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.515+0000 7f8b437fe700 1 --2- 172.21.15.2:0/128948778 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b440b9140 0x7f8b4409ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:33.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.515+0000 7f8b427fc700 1 -- 172.21.15.2:0/128948778 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8b440b8d60 msgr2=0x7f8b4415c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:33.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.515+0000 7f8b427fc700 1 --2- 172.21.15.2:0/128948778 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8b440b8d60 0x7f8b4415c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:33.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.515+0000 7f8b427fc700 1 -- 172.21.15.2:0/128948778 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b440b9140 msgr2=0x7f8b4409ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:33.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.515+0000 7f8b427fc700 1 --2- 172.21.15.2:0/128948778 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b440b9140 0x7f8b4409ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:33.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.515+0000 7f8b427fc700 1 -- 172.21.15.2:0/128948778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b440c8870 con 0x7f8b440ca3a0 2023-11-26T07:17:33.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.515+0000 7f8b427fc700 1 --2- 172.21.15.2:0/128948778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b440ca3a0 0x7f8b4415c8c0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f8b38011aa0 tx=0x7f8b38011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:33.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.515+0000 7f8b2b7fe700 1 -- 172.21.15.2:0/128948778 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3800f9e0 con 0x7f8b440ca3a0 2023-11-26T07:17:33.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.515+0000 7f8b2b7fe700 1 -- 172.21.15.2:0/128948778 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3800fb40 con 0x7f8b440ca3a0 2023-11-26T07:17:33.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.515+0000 7f8b4976c700 1 -- 172.21.15.2:0/128948778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b440c8b50 con 0x7f8b440ca3a0 2023-11-26T07:17:33.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.515+0000 7f8b2b7fe700 1 -- 172.21.15.2:0/128948778 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b38014440 con 0x7f8b440ca3a0 2023-11-26T07:17:33.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.515+0000 7f8b4976c700 1 -- 172.21.15.2:0/128948778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b440c9250 con 0x7f8b440ca3a0 2023-11-26T07:17:33.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.516+0000 7f8b4976c700 1 -- 172.21.15.2:0/128948778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b440b99e0 con 0x7f8b440ca3a0 2023-11-26T07:17:33.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.517+0000 7f8b2b7fe700 1 -- 172.21.15.2:0/128948778 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f8b380145a0 con 0x7f8b440ca3a0 2023-11-26T07:17:33.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.517+0000 7f8b2b7fe700 1 --2- 172.21.15.2:0/128948778 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8b3006b980 0x7f8b3006de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:33.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.517+0000 7f8b2b7fe700 1 -- 172.21.15.2:0/128948778 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8b38088990 con 0x7f8b440ca3a0 2023-11-26T07:17:33.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.517+0000 7f8b42ffd700 1 --2- 172.21.15.2:0/128948778 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8b3006b980 0x7f8b3006de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:33.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.518+0000 7f8b42ffd700 1 --2- 172.21.15.2:0/128948778 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8b3006b980 0x7f8b3006de40 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f8b340048d0 tx=0x7f8b34009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:33.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.522+0000 7f8b2b7fe700 1 -- 172.21.15.2:0/128948778 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8b380552c0 con 0x7f8b440ca3a0 2023-11-26T07:17:33.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.724+0000 7f8b4976c700 1 -- 172.21.15.2:0/128948778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b440c83f0 con 0x7f8b440ca3a0 2023-11-26T07:17:33.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.725+0000 7f8b2b7fe700 1 -- 172.21.15.2:0/128948778 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+16617 (secure 0 0 0) 0x7f8b440c83f0 con 0x7f8b440ca3a0 2023-11-26T07:17:33.727 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:17:33.727 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":75,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:17:24.287171+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:16:30.488040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-26T07:16:30.981722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.4","mappings":[{"from":6,"to":0}]},{"pgid":"11.38","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:17:33.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.727+0000 7f8b4976c700 1 -- 172.21.15.2:0/128948778 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8b3006b980 msgr2=0x7f8b3006de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:33.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.727+0000 7f8b4976c700 1 --2- 172.21.15.2:0/128948778 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8b3006b980 0x7f8b3006de40 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f8b340048d0 tx=0x7f8b34009040 comp rx=0 tx=0).stop 2023-11-26T07:17:33.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.727+0000 7f8b4976c700 1 -- 172.21.15.2:0/128948778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b440ca3a0 msgr2=0x7f8b4415c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:33.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.727+0000 7f8b4976c700 1 --2- 172.21.15.2:0/128948778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b440ca3a0 0x7f8b4415c8c0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f8b38011aa0 tx=0x7f8b38011e60 comp rx=0 tx=0).stop 2023-11-26T07:17:33.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.727+0000 7f8b4976c700 1 -- 172.21.15.2:0/128948778 shutdown_connections 2023-11-26T07:17:33.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.727+0000 7f8b4976c700 1 --2- 172.21.15.2:0/128948778 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8b3006b980 0x7f8b3006de40 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:33.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.727+0000 7f8b4976c700 1 --2- 172.21.15.2:0/128948778 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b440b9140 0x7f8b4409ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:33.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.727+0000 7f8b4976c700 1 --2- 172.21.15.2:0/128948778 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8b440b8d60 0x7f8b4415c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:33.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.727+0000 7f8b4976c700 1 --2- 172.21.15.2:0/128948778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b440ca3a0 0x7f8b4415c8c0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:33.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.727+0000 7f8b4976c700 1 -- 172.21.15.2:0/128948778 >> 172.21.15.2:0/128948778 conn(0x7f8b440d3eb0 msgr2=0x7f8b440cf410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:33.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.727+0000 7f8b4976c700 1 -- 172.21.15.2:0/128948778 shutdown_connections 2023-11-26T07:17:33.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.727+0000 7f8b4976c700 1 -- 172.21.15.2:0/128948778 wait complete. 2023-11-26T07:17:33.742 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:11:28.205739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:16:30.488040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:16:30.981722+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:17:33.742 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:17:33.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.869+0000 7f059ccba700 1 Processor -- start 2023-11-26T07:17:33.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.869+0000 7f059ccba700 1 -- start start 2023-11-26T07:17:33.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.870+0000 7f059ccba700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f05980722c0 0x7f05980b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:33.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.870+0000 7f059ccba700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05981440f0 0x7f059806e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:33.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.870+0000 7f059ccba700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0598143ec0 con 0x7f0598143ae0 2023-11-26T07:17:33.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.870+0000 7f059ccba700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05980b40a0 con 0x7f05980722c0 2023-11-26T07:17:33.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.870+0000 7f059ccba700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05980b3ae0 con 0x7f05981440f0 2023-11-26T07:17:33.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.870+0000 7f0595d9b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f05980722c0 0x7f05980b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:33.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.870+0000 7f0595d9b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f05980722c0 0x7f05980b51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44982/0 (socket says 172.21.15.2:44982) 2023-11-26T07:17:33.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.870+0000 7f0595d9b700 1 -- 172.21.15.2:0/2174823511 learned_addr learned my addr 172.21.15.2:0/2174823511 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:33.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.870+0000 7f0596d9d700 1 --2- 172.21.15.2:0/2174823511 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05981440f0 0x7f059806e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:33.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.870+0000 7f0595d9b700 1 -- 172.21.15.2:0/2174823511 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05981440f0 msgr2=0x7f059806e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:33.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.870+0000 7f0595d9b700 1 --2- 172.21.15.2:0/2174823511 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05981440f0 0x7f059806e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:33.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.870+0000 7f0595d9b700 1 -- 172.21.15.2:0/2174823511 >> v1:172.21.15.192:6789/0 conn(0x7f0598143ae0 legacy=0x7f0598071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:33.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.870+0000 7f0595d9b700 1 -- 172.21.15.2:0/2174823511 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05980b3dc0 con 0x7f05980722c0 2023-11-26T07:17:33.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.870+0000 7f0595d9b700 1 --2- 172.21.15.2:0/2174823511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05980722c0 0x7f05980b51b0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f058c0098f0 tx=0x7f058c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f95486d653728f64 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:33.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.870+0000 7f059559a700 1 -- 172.21.15.2:0/2174823511 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c00b8a0 con 0x7f05980722c0 2023-11-26T07:17:33.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.871+0000 7f059559a700 1 -- 172.21.15.2:0/2174823511 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058c00ba00 con 0x7f05980722c0 2023-11-26T07:17:33.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.871+0000 7f059559a700 1 -- 172.21.15.2:0/2174823511 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c00bd90 con 0x7f05980722c0 2023-11-26T07:17:33.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.871+0000 7f059ccba700 1 -- 172.21.15.2:0/2174823511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05980722c0 msgr2=0x7f05980b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:33.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.871+0000 7f059ccba700 1 --2- 172.21.15.2:0/2174823511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05980722c0 0x7f05980b51b0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f058c0098f0 tx=0x7f058c009c00 comp rx=0 tx=0).stop 2023-11-26T07:17:33.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.871+0000 7f059ccba700 1 -- 172.21.15.2:0/2174823511 shutdown_connections 2023-11-26T07:17:33.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.871+0000 7f059ccba700 1 --2- 172.21.15.2:0/2174823511 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05981440f0 0x7f059806e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:33.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.871+0000 7f059ccba700 1 --2- 172.21.15.2:0/2174823511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05980722c0 0x7f05980b51b0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:33.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.871+0000 7f059ccba700 1 -- 172.21.15.2:0/2174823511 >> 172.21.15.2:0/2174823511 conn(0x7f05980b2740 msgr2=0x7f05980b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:33.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.871+0000 7f059ccba700 1 -- 172.21.15.2:0/2174823511 shutdown_connections 2023-11-26T07:17:33.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.871+0000 7f059ccba700 1 -- 172.21.15.2:0/2174823511 wait complete. 2023-11-26T07:17:33.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.872+0000 7f059ccba700 1 Processor -- start 2023-11-26T07:17:33.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.873+0000 7f059ccba700 1 -- start start 2023-11-26T07:17:33.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.873+0000 7f059ccba700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05980722c0 0x7f059815ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:33.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.873+0000 7f059ccba700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0598143ae0 0x7f0598154e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:33.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.873+0000 7f059ccba700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05981440f0 0x7f059813a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:33.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.873+0000 7f059ccba700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059813c0f0 con 0x7f05981440f0 2023-11-26T07:17:33.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.873+0000 7f059ccba700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059813b4e0 con 0x7f0598143ae0 2023-11-26T07:17:33.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.873+0000 7f059ccba700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f059813b7c0 con 0x7f05980722c0 2023-11-26T07:17:33.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.873+0000 7f0596d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05981440f0 0x7f059813a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:33.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.873+0000 7f0596d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05981440f0 0x7f059813a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44990/0 (socket says 172.21.15.2:44990) 2023-11-26T07:17:33.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.873+0000 7f0596d9d700 1 -- 172.21.15.2:0/3129422984 learned_addr learned my addr 172.21.15.2:0/3129422984 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:33.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.874+0000 7f0595d9b700 1 --2- 172.21.15.2:0/3129422984 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0598143ae0 0x7f0598154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:33.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.874+0000 7f059659c700 1 --2- 172.21.15.2:0/3129422984 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05980722c0 0x7f059815ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:33.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.874+0000 7f0596d9d700 1 -- 172.21.15.2:0/3129422984 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05980722c0 msgr2=0x7f059815ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:33.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.874+0000 7f0596d9d700 1 --2- 172.21.15.2:0/3129422984 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05980722c0 0x7f059815ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:33.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.874+0000 7f0596d9d700 1 -- 172.21.15.2:0/3129422984 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0598143ae0 msgr2=0x7f0598154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:33.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.874+0000 7f0596d9d700 1 --2- 172.21.15.2:0/3129422984 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0598143ae0 0x7f0598154e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:33.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.874+0000 7f0596d9d700 1 -- 172.21.15.2:0/3129422984 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f058c009550 con 0x7f05981440f0 2023-11-26T07:17:33.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.874+0000 7f0595d9b700 1 --2- 172.21.15.2:0/3129422984 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0598143ae0 0x7f0598154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:33.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.874+0000 7f0596d9d700 1 --2- 172.21.15.2:0/3129422984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05981440f0 0x7f059813a2d0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f0590007e60 tx=0x7f059000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:33.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.874+0000 7f0586ffd700 1 -- 172.21.15.2:0/3129422984 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059000ede0 con 0x7f05981440f0 2023-11-26T07:17:33.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.874+0000 7f0586ffd700 1 -- 172.21.15.2:0/3129422984 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0590014420 con 0x7f05981440f0 2023-11-26T07:17:33.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.874+0000 7f0586ffd700 1 -- 172.21.15.2:0/3129422984 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05900147d0 con 0x7f05981440f0 2023-11-26T07:17:33.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.874+0000 7f059ccba700 1 -- 172.21.15.2:0/3129422984 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f059813baa0 con 0x7f05981440f0 2023-11-26T07:17:33.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.874+0000 7f059ccba700 1 -- 172.21.15.2:0/3129422984 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0598157cf0 con 0x7f05981440f0 2023-11-26T07:17:33.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.875+0000 7f059ccba700 1 -- 172.21.15.2:0/3129422984 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0598140890 con 0x7f05981440f0 2023-11-26T07:17:33.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.875+0000 7f0586ffd700 1 -- 172.21.15.2:0/3129422984 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f0590014930 con 0x7f05981440f0 2023-11-26T07:17:33.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.876+0000 7f0586ffd700 1 --2- 172.21.15.2:0/3129422984 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f057806b980 0x7f057806de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:33.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.876+0000 7f0586ffd700 1 -- 172.21.15.2:0/3129422984 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f05900886b0 con 0x7f05981440f0 2023-11-26T07:17:33.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.876+0000 7f059659c700 1 --2- 172.21.15.2:0/3129422984 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f057806b980 0x7f057806de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:33.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.877+0000 7f059659c700 1 --2- 172.21.15.2:0/3129422984 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f057806b980 0x7f057806de40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f0588000f60 tx=0x7f0588009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:33.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:33.881+0000 7f0586ffd700 1 -- 172.21.15.2:0/3129422984 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0590055180 con 0x7f05981440f0 2023-11-26T07:17:34.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.085+0000 7f059ccba700 1 -- 172.21.15.2:0/3129422984 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f05980ccce0 con 0x7f05981440f0 2023-11-26T07:17:34.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.085+0000 7f0586ffd700 1 -- 172.21.15.2:0/3129422984 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7f05900587a0 con 0x7f05981440f0 2023-11-26T07:17:34.088 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-26T07:17:34.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.087+0000 7f059ccba700 1 -- 172.21.15.2:0/3129422984 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f057806b980 msgr2=0x7f057806de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:34.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.087+0000 7f059ccba700 1 --2- 172.21.15.2:0/3129422984 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f057806b980 0x7f057806de40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f0588000f60 tx=0x7f0588009040 comp rx=0 tx=0).stop 2023-11-26T07:17:34.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.087+0000 7f059ccba700 1 -- 172.21.15.2:0/3129422984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05981440f0 msgr2=0x7f059813a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:34.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.087+0000 7f059ccba700 1 --2- 172.21.15.2:0/3129422984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05981440f0 0x7f059813a2d0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f0590007e60 tx=0x7f059000e3c0 comp rx=0 tx=0).stop 2023-11-26T07:17:34.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.087+0000 7f059ccba700 1 -- 172.21.15.2:0/3129422984 shutdown_connections 2023-11-26T07:17:34.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.087+0000 7f059ccba700 1 --2- 172.21.15.2:0/3129422984 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f057806b980 0x7f057806de40 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:34.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.087+0000 7f059ccba700 1 --2- 172.21.15.2:0/3129422984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05981440f0 0x7f059813a2d0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:34.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.087+0000 7f059ccba700 1 --2- 172.21.15.2:0/3129422984 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05980722c0 0x7f059815ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:34.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.087+0000 7f059ccba700 1 --2- 172.21.15.2:0/3129422984 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0598143ae0 0x7f0598154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:34.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.088+0000 7f059ccba700 1 -- 172.21.15.2:0/3129422984 >> 172.21.15.2:0/3129422984 conn(0x7f05980b2740 msgr2=0x7f05980b51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:34.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.088+0000 7f059ccba700 1 -- 172.21.15.2:0/3129422984 shutdown_connections 2023-11-26T07:17:34.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.088+0000 7f059ccba700 1 -- 172.21.15.2:0/3129422984 wait complete. 2023-11-26T07:17:34.102 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:17:34.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.228+0000 7f962b342700 1 Processor -- start 2023-11-26T07:17:34.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.228+0000 7f962b342700 1 -- start start 2023-11-26T07:17:34.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.229+0000 7f962b342700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f962415add0 0x7f96240b4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:34.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.229+0000 7f962b342700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f96240b3ab0 0x7f962406ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:34.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.229+0000 7f962b342700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96240ce5b0 con 0x7f962406f370 2023-11-26T07:17:34.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.229+0000 7f962b342700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f962406f800 con 0x7f96240b3ab0 2023-11-26T07:17:34.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.229+0000 7f962b342700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9624072d70 con 0x7f962415add0 2023-11-26T07:17:34.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.229+0000 7f96288dd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f96240b3ab0 0x7f962406ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:34.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.229+0000 7f96288dd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f96240b3ab0 0x7f962406ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44994/0 (socket says 172.21.15.2:44994) 2023-11-26T07:17:34.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.229+0000 7f96288dd700 1 -- 172.21.15.2:0/4267377729 learned_addr learned my addr 172.21.15.2:0/4267377729 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:34.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.230+0000 7f96290de700 1 --2- 172.21.15.2:0/4267377729 >> v2:172.21.15.192:3300/0 conn(0x7f962415add0 0x7f96240b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:34.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.230+0000 7f96288dd700 1 -- 172.21.15.2:0/4267377729 >> v2:172.21.15.192:3300/0 conn(0x7f962415add0 msgr2=0x7f96240b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:34.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.230+0000 7f96288dd700 1 --2- 172.21.15.2:0/4267377729 >> v2:172.21.15.192:3300/0 conn(0x7f962415add0 0x7f96240b4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:34.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.230+0000 7f96288dd700 1 -- 172.21.15.2:0/4267377729 >> v1:172.21.15.192:6789/0 conn(0x7f962406f370 legacy=0x7f962406daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:34.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.230+0000 7f96288dd700 1 -- 172.21.15.2:0/4267377729 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96240b4f10 con 0x7f96240b3ab0 2023-11-26T07:17:34.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.230+0000 7f96290de700 1 --2- 172.21.15.2:0/4267377729 >> v2:172.21.15.192:3300/0 conn(0x7f962415add0 0x7f96240b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:34.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.230+0000 7f96288dd700 1 --2- 172.21.15.2:0/4267377729 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96240b3ab0 0x7f962406ee30 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f962406da40 tx=0x7f962000be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7be7f4778362104 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:34.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.230+0000 7f961bfff700 1 -- 172.21.15.2:0/4267377729 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962000dcf0 con 0x7f96240b3ab0 2023-11-26T07:17:34.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.230+0000 7f961bfff700 1 -- 172.21.15.2:0/4267377729 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962000de50 con 0x7f96240b3ab0 2023-11-26T07:17:34.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.230+0000 7f961bfff700 1 -- 172.21.15.2:0/4267377729 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9620004250 con 0x7f96240b3ab0 2023-11-26T07:17:34.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.231+0000 7f962b342700 1 -- 172.21.15.2:0/4267377729 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96240b3ab0 msgr2=0x7f962406ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:34.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.231+0000 7f962b342700 1 --2- 172.21.15.2:0/4267377729 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96240b3ab0 0x7f962406ee30 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f962406da40 tx=0x7f962000be70 comp rx=0 tx=0).stop 2023-11-26T07:17:34.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.231+0000 7f962b342700 1 -- 172.21.15.2:0/4267377729 shutdown_connections 2023-11-26T07:17:34.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.231+0000 7f962b342700 1 --2- 172.21.15.2:0/4267377729 >> v2:172.21.15.192:3300/0 conn(0x7f962415add0 0x7f96240b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:34.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.231+0000 7f962b342700 1 --2- 172.21.15.2:0/4267377729 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96240b3ab0 0x7f962406ee30 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:34.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.231+0000 7f962b342700 1 -- 172.21.15.2:0/4267377729 >> 172.21.15.2:0/4267377729 conn(0x7f96240b27b0 msgr2=0x7f96240b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:34.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.231+0000 7f962b342700 1 -- 172.21.15.2:0/4267377729 shutdown_connections 2023-11-26T07:17:34.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.231+0000 7f962b342700 1 -- 172.21.15.2:0/4267377729 wait complete. 2023-11-26T07:17:34.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.232+0000 7f962b342700 1 Processor -- start 2023-11-26T07:17:34.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.232+0000 7f962b342700 1 -- start start 2023-11-26T07:17:34.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.233+0000 7f962b342700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f962406f370 0x7f9624156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:34.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.233+0000 7f962b342700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96240b3ab0 0x7f962415df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:34.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.233+0000 7f962b342700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f962415add0 0x7f962413e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:34.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.233+0000 7f962b342700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9624156a70 con 0x7f96240b3ab0 2023-11-26T07:17:34.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.233+0000 7f962b342700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96241560a0 con 0x7f962406f370 2023-11-26T07:17:34.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.233+0000 7f962b342700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f962415e4a0 con 0x7f962415add0 2023-11-26T07:17:34.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.233+0000 7f96288dd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96240b3ab0 0x7f962415df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:34.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.233+0000 7f96288dd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96240b3ab0 0x7f962415df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45002/0 (socket says 172.21.15.2:45002) 2023-11-26T07:17:34.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.233+0000 7f96288dd700 1 -- 172.21.15.2:0/1201982971 learned_addr learned my addr 172.21.15.2:0/1201982971 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:34.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.233+0000 7f96290de700 1 --2- 172.21.15.2:0/1201982971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f962406f370 0x7f9624156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:34.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.233+0000 7f96298df700 1 --2- 172.21.15.2:0/1201982971 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f962415add0 0x7f962413e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:34.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.233+0000 7f96288dd700 1 -- 172.21.15.2:0/1201982971 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f962415add0 msgr2=0x7f962413e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:34.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.233+0000 7f96288dd700 1 --2- 172.21.15.2:0/1201982971 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f962415add0 0x7f962413e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:34.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.233+0000 7f96288dd700 1 -- 172.21.15.2:0/1201982971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f962406f370 msgr2=0x7f9624156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:34.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.233+0000 7f96288dd700 1 --2- 172.21.15.2:0/1201982971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f962406f370 0x7f9624156530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:34.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.233+0000 7f96288dd700 1 -- 172.21.15.2:0/1201982971 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f962000b7f0 con 0x7f96240b3ab0 2023-11-26T07:17:34.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.233+0000 7f96288dd700 1 --2- 172.21.15.2:0/1201982971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96240b3ab0 0x7f962415df60 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f9624070640 tx=0x7f9620004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:34.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.233+0000 7f9619ffb700 1 -- 172.21.15.2:0/1201982971 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9620020070 con 0x7f96240b3ab0 2023-11-26T07:17:34.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.233+0000 7f9619ffb700 1 -- 172.21.15.2:0/1201982971 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9620004030 con 0x7f96240b3ab0 2023-11-26T07:17:34.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.233+0000 7f962b342700 1 -- 172.21.15.2:0/1201982971 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9624155490 con 0x7f96240b3ab0 2023-11-26T07:17:34.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.233+0000 7f9619ffb700 1 -- 172.21.15.2:0/1201982971 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9620010470 con 0x7f96240b3ab0 2023-11-26T07:17:34.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.234+0000 7f962b342700 1 -- 172.21.15.2:0/1201982971 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9624155a50 con 0x7f96240b3ab0 2023-11-26T07:17:34.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.235+0000 7f962b342700 1 -- 172.21.15.2:0/1201982971 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9624075480 con 0x7f96240b3ab0 2023-11-26T07:17:34.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.235+0000 7f9619ffb700 1 -- 172.21.15.2:0/1201982971 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f96200193f0 con 0x7f96240b3ab0 2023-11-26T07:17:34.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.235+0000 7f9619ffb700 1 --2- 172.21.15.2:0/1201982971 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f960806b980 0x7f960806de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:34.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.236+0000 7f9619ffb700 1 -- 172.21.15.2:0/1201982971 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f962008b6c0 con 0x7f96240b3ab0 2023-11-26T07:17:34.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.236+0000 7f96290de700 1 --2- 172.21.15.2:0/1201982971 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f960806b980 0x7f960806de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:34.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.236+0000 7f96290de700 1 --2- 172.21.15.2:0/1201982971 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f960806b980 0x7f960806de40 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f9614006fd0 tx=0x7f9614008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:34.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.240+0000 7f9619ffb700 1 -- 172.21.15.2:0/1201982971 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9620057ff0 con 0x7f96240b3ab0 2023-11-26T07:17:34.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.441+0000 7f962b342700 1 -- 172.21.15.2:0/1201982971 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f96240cf510 con 0x7f96240b3ab0 2023-11-26T07:17:34.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.441+0000 7f9619ffb700 1 -- 172.21.15.2:0/1201982971 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v75) v1 ==== 104+0+11 (secure 0 0 0) 0x7f962005b610 con 0x7f96240b3ab0 2023-11-26T07:17:34.443 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-26T07:17:34.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.443+0000 7f962b342700 1 -- 172.21.15.2:0/1201982971 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f960806b980 msgr2=0x7f960806de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:34.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.443+0000 7f962b342700 1 --2- 172.21.15.2:0/1201982971 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f960806b980 0x7f960806de40 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f9614006fd0 tx=0x7f9614008040 comp rx=0 tx=0).stop 2023-11-26T07:17:34.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.444+0000 7f962b342700 1 -- 172.21.15.2:0/1201982971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96240b3ab0 msgr2=0x7f962415df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:34.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.444+0000 7f962b342700 1 --2- 172.21.15.2:0/1201982971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96240b3ab0 0x7f962415df60 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f9624070640 tx=0x7f9620004750 comp rx=0 tx=0).stop 2023-11-26T07:17:34.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.444+0000 7f962b342700 1 -- 172.21.15.2:0/1201982971 shutdown_connections 2023-11-26T07:17:34.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.444+0000 7f962b342700 1 --2- 172.21.15.2:0/1201982971 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f960806b980 0x7f960806de40 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:34.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.444+0000 7f962b342700 1 --2- 172.21.15.2:0/1201982971 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f962415add0 0x7f962413e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:34.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.444+0000 7f962b342700 1 --2- 172.21.15.2:0/1201982971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f962406f370 0x7f9624156530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:34.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.444+0000 7f962b342700 1 --2- 172.21.15.2:0/1201982971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96240b3ab0 0x7f962415df60 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:34.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.444+0000 7f962b342700 1 -- 172.21.15.2:0/1201982971 >> 172.21.15.2:0/1201982971 conn(0x7f96240b27b0 msgr2=0x7f962406afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:34.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.444+0000 7f962b342700 1 -- 172.21.15.2:0/1201982971 shutdown_connections 2023-11-26T07:17:34.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.444+0000 7f962b342700 1 -- 172.21.15.2:0/1201982971 wait complete. 2023-11-26T07:17:34.457 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:17:34.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.584+0000 7f12d4c29700 1 Processor -- start 2023-11-26T07:17:34.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.584+0000 7f12d4c29700 1 -- start start 2023-11-26T07:17:34.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.585+0000 7f12d4c29700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f12d01459c0 0x7f12d015c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:34.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.585+0000 7f12d4c29700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12d006daf0 con 0x7f12d006b6e0 2023-11-26T07:17:34.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.585+0000 7f12d4c29700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12d00cfe60 con 0x7f12d00cd5d0 2023-11-26T07:17:34.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.585+0000 7f12d4c29700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12d00d0140 con 0x7f12d01459c0 2023-11-26T07:17:34.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.585+0000 7f12ced9d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f12d006b6e0 0x7f12d006e260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36218/0 (socket says 172.21.15.2:36218) 2023-11-26T07:17:34.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.585+0000 7f12ced9d700 1 -- 172.21.15.2:0/3608941361 learned_addr learned my addr 172.21.15.2:0/3608941361 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:34.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.585+0000 7f12ce59c700 1 --2- 172.21.15.2:0/3608941361 >> v2:172.21.15.192:3300/0 conn(0x7f12d01459c0 0x7f12d015c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:34.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.585+0000 7f12cd59a700 1 -- 172.21.15.2:0/3608941361 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1630329745 0 0) 0x7f12d006daf0 con 0x7f12d006b6e0 2023-11-26T07:17:34.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.585+0000 7f12cd59a700 1 -- 172.21.15.2:0/3608941361 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12b80035b0 con 0x7f12d006b6e0 2023-11-26T07:17:34.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.586+0000 7f12cd59a700 1 -- 172.21.15.2:0/3608941361 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1596014757 0 0) 0x7f12b80035b0 con 0x7f12d006b6e0 2023-11-26T07:17:34.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.586+0000 7f12cd59a700 1 -- 172.21.15.2:0/3608941361 >> v2:172.21.15.192:3300/0 conn(0x7f12d01459c0 msgr2=0x7f12d015c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:34.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.586+0000 7f12cd59a700 1 --2- 172.21.15.2:0/3608941361 >> v2:172.21.15.192:3300/0 conn(0x7f12d01459c0 0x7f12d015c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:34.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.586+0000 7f12cd59a700 1 -- 172.21.15.2:0/3608941361 >> v1:172.21.15.192:6789/0 conn(0x7f12d00cd5d0 legacy=0x7f12d006afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:34.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.586+0000 7f12cd59a700 1 -- 172.21.15.2:0/3608941361 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d00d0420 con 0x7f12d006b6e0 2023-11-26T07:17:34.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.586+0000 7f12cd59a700 1 -- 172.21.15.2:0/3608941361 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f12c80019f0 con 0x7f12d006b6e0 2023-11-26T07:17:34.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.586+0000 7f12cd59a700 1 -- 172.21.15.2:0/3608941361 >> v1:172.21.15.2:6789/0 conn(0x7f12d006b6e0 legacy=0x7f12d006e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:34.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.586+0000 7f12cd59a700 1 --2- 172.21.15.2:0/3608941361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12b8003a00 0x7f12b8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:34.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.586+0000 7f12cd59a700 1 --2- 172.21.15.2:0/3608941361 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12b8004850 0x7f12b8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:34.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.586+0000 7f12cd59a700 1 --2- 172.21.15.2:0/3608941361 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12b8005210 0x7f12b800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:34.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.586+0000 7f12cd59a700 1 -- 172.21.15.2:0/3608941361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d00d0140 con 0x7f12b8003a00 2023-11-26T07:17:34.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.586+0000 7f12cd59a700 1 -- 172.21.15.2:0/3608941361 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b800c0b0 con 0x7f12b8005210 2023-11-26T07:17:34.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.586+0000 7f12cd59a700 1 -- 172.21.15.2:0/3608941361 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b800c270 con 0x7f12b8004850 2023-11-26T07:17:34.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.586+0000 7f12ce59c700 1 --2- 172.21.15.2:0/3608941361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12b8003a00 0x7f12b8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:34.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.586+0000 7f12cdd9b700 1 --2- 172.21.15.2:0/3608941361 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12b8004850 0x7f12b8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:34.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.586+0000 7f12ced9d700 1 --2- 172.21.15.2:0/3608941361 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12b8005210 0x7f12b800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:34.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.586+0000 7f12ce59c700 1 -- 172.21.15.2:0/3608941361 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12b8004850 msgr2=0x7f12b8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:34.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.586+0000 7f12ce59c700 1 --2- 172.21.15.2:0/3608941361 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12b8004850 0x7f12b8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:34.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.586+0000 7f12ce59c700 1 -- 172.21.15.2:0/3608941361 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12b8005210 msgr2=0x7f12b800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:34.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.586+0000 7f12ce59c700 1 --2- 172.21.15.2:0/3608941361 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12b8005210 0x7f12b800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:34.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.586+0000 7f12ced9d700 1 -- 172.21.15.2:0/3608941361 reap_dead start 2023-11-26T07:17:34.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.586+0000 7f12ce59c700 1 -- 172.21.15.2:0/3608941361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b80035b0 con 0x7f12b8003a00 2023-11-26T07:17:34.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.586+0000 7f12ce59c700 1 --2- 172.21.15.2:0/3608941361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12b8003a00 0x7f12b8003e20 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f12c0009b60 tx=0x7f12b8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c18bc04475d0546 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:34.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.586+0000 7f12cd59a700 1 -- 172.21.15.2:0/3608941361 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c000e6c0 con 0x7f12b8003a00 2023-11-26T07:17:34.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.586+0000 7f12cd59a700 1 -- 172.21.15.2:0/3608941361 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c000e820 con 0x7f12b8003a00 2023-11-26T07:17:34.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.586+0000 7f12cd59a700 1 -- 172.21.15.2:0/3608941361 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c000eb90 con 0x7f12b8003a00 2023-11-26T07:17:34.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.587+0000 7f12d4c29700 1 -- 172.21.15.2:0/3608941361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12b8003a00 msgr2=0x7f12b8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:34.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.587+0000 7f12d4c29700 1 --2- 172.21.15.2:0/3608941361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12b8003a00 0x7f12b8003e20 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f12c0009b60 tx=0x7f12b8005880 comp rx=0 tx=0).stop 2023-11-26T07:17:34.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.587+0000 7f12d4c29700 1 -- 172.21.15.2:0/3608941361 shutdown_connections 2023-11-26T07:17:34.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.587+0000 7f12d4c29700 1 --2- 172.21.15.2:0/3608941361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12b8003a00 0x7f12b8003e20 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:34.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.587+0000 7f12d4c29700 1 -- 172.21.15.2:0/3608941361 >> 172.21.15.2:0/3608941361 conn(0x7f12d00b27b0 msgr2=0x7f12d00b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:34.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.587+0000 7f12d4c29700 1 -- 172.21.15.2:0/3608941361 shutdown_connections 2023-11-26T07:17:34.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.587+0000 7f12d4c29700 1 -- 172.21.15.2:0/3608941361 wait complete. 2023-11-26T07:17:34.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.588+0000 7f12d4c29700 1 Processor -- start 2023-11-26T07:17:34.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.588+0000 7f12d4c29700 1 -- start start 2023-11-26T07:17:34.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.589+0000 7f12d4c29700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12b8003a00 0x7f12d013e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:34.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.589+0000 7f12d4c29700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12d01e6650 0x7f12d01e6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:34.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.589+0000 7f12d4c29700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12d01e2020 0x7f12d01e2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:34.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.589+0000 7f12d4c29700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d01e4b50 con 0x7f12d01e2020 2023-11-26T07:17:34.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.589+0000 7f12d4c29700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d01e7010 con 0x7f12d01e6650 2023-11-26T07:17:34.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.589+0000 7f12d4c29700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d015c090 con 0x7f12b8003a00 2023-11-26T07:17:34.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.589+0000 7f12ced9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12d01e2020 0x7f12d01e2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:34.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.589+0000 7f12ced9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12d01e2020 0x7f12d01e2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45024/0 (socket says 172.21.15.2:45024) 2023-11-26T07:17:34.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.589+0000 7f12ced9d700 1 -- 172.21.15.2:0/3900998860 learned_addr learned my addr 172.21.15.2:0/3900998860 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:34.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.589+0000 7f12cdd9b700 1 --2- 172.21.15.2:0/3900998860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12d01e6650 0x7f12d01e6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:34.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.590+0000 7f12ce59c700 1 --2- 172.21.15.2:0/3900998860 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12b8003a00 0x7f12d013e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:34.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.590+0000 7f12ced9d700 1 -- 172.21.15.2:0/3900998860 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12b8003a00 msgr2=0x7f12d013e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:34.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.590+0000 7f12ced9d700 1 --2- 172.21.15.2:0/3900998860 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12b8003a00 0x7f12d013e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:34.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.590+0000 7f12ced9d700 1 -- 172.21.15.2:0/3900998860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12d01e6650 msgr2=0x7f12d01e6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:34.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.590+0000 7f12ced9d700 1 --2- 172.21.15.2:0/3900998860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12d01e6650 0x7f12d01e6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:34.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.590+0000 7f12ced9d700 1 -- 172.21.15.2:0/3900998860 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d01e2df0 con 0x7f12d01e2020 2023-11-26T07:17:34.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.590+0000 7f12ced9d700 1 --2- 172.21.15.2:0/3900998860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12d01e2020 0x7f12d01e2480 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f12d0069170 tx=0x7f12c800e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:34.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.590+0000 7f12beffd700 1 -- 172.21.15.2:0/3900998860 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c800ebb0 con 0x7f12d01e2020 2023-11-26T07:17:34.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.590+0000 7f12beffd700 1 -- 172.21.15.2:0/3900998860 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c800ed10 con 0x7f12d01e2020 2023-11-26T07:17:34.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.590+0000 7f12d4c29700 1 -- 172.21.15.2:0/3900998860 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12d01e41b0 con 0x7f12d01e2020 2023-11-26T07:17:34.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.590+0000 7f12beffd700 1 -- 172.21.15.2:0/3900998860 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c8013660 con 0x7f12d01e2020 2023-11-26T07:17:34.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.590+0000 7f12d4c29700 1 -- 172.21.15.2:0/3900998860 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12d01e4770 con 0x7f12d01e2020 2023-11-26T07:17:34.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.591+0000 7f12d4c29700 1 -- 172.21.15.2:0/3900998860 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12d01e4c90 con 0x7f12d01e2020 2023-11-26T07:17:34.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.592+0000 7f12beffd700 1 -- 172.21.15.2:0/3900998860 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f12c80137c0 con 0x7f12d01e2020 2023-11-26T07:17:34.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.592+0000 7f12beffd700 1 --2- 172.21.15.2:0/3900998860 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f12b006b980 0x7f12b006de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:34.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.592+0000 7f12beffd700 1 -- 172.21.15.2:0/3900998860 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f12c80884c0 con 0x7f12d01e2020 2023-11-26T07:17:34.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.592+0000 7f12ce59c700 1 --2- 172.21.15.2:0/3900998860 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f12b006b980 0x7f12b006de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:34.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.593+0000 7f12ce59c700 1 --2- 172.21.15.2:0/3900998860 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f12b006b980 0x7f12b006de40 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f12c00090b0 tx=0x7f12c0008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:34.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.597+0000 7f12beffd700 1 -- 172.21.15.2:0/3900998860 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f12d01e4c90 con 0x7f12d01e2020 2023-11-26T07:17:34.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.797+0000 7f12d4c29700 1 -- 172.21.15.2:0/3900998860 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f12d0067c70 con 0x7f12d01e2020 2023-11-26T07:17:34.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.797+0000 7f12beffd700 1 -- 172.21.15.2:0/3900998860 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v75) v1 ==== 100+0+11 (secure 0 0 0) 0x7f12c8058ab0 con 0x7f12d01e2020 2023-11-26T07:17:34.799 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-26T07:17:34.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.799+0000 7f12d4c29700 1 -- 172.21.15.2:0/3900998860 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f12b006b980 msgr2=0x7f12b006de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:34.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.799+0000 7f12d4c29700 1 --2- 172.21.15.2:0/3900998860 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f12b006b980 0x7f12b006de40 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f12c00090b0 tx=0x7f12c0008030 comp rx=0 tx=0).stop 2023-11-26T07:17:34.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.799+0000 7f12d4c29700 1 -- 172.21.15.2:0/3900998860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12d01e2020 msgr2=0x7f12d01e2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:34.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.799+0000 7f12d4c29700 1 --2- 172.21.15.2:0/3900998860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12d01e2020 0x7f12d01e2480 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f12d0069170 tx=0x7f12c800e440 comp rx=0 tx=0).stop 2023-11-26T07:17:34.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.799+0000 7f12d4c29700 1 -- 172.21.15.2:0/3900998860 shutdown_connections 2023-11-26T07:17:34.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.799+0000 7f12d4c29700 1 --2- 172.21.15.2:0/3900998860 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f12b006b980 0x7f12b006de40 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:34.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.799+0000 7f12d4c29700 1 --2- 172.21.15.2:0/3900998860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12d01e2020 0x7f12d01e2480 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:34.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.799+0000 7f12d4c29700 1 --2- 172.21.15.2:0/3900998860 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12b8003a00 0x7f12d013e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:34.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.799+0000 7f12d4c29700 1 --2- 172.21.15.2:0/3900998860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12d01e6650 0x7f12d01e6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:34.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.799+0000 7f12d4c29700 1 -- 172.21.15.2:0/3900998860 >> 172.21.15.2:0/3900998860 conn(0x7f12d00b27b0 msgr2=0x7f12d0144a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:34.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.799+0000 7f12d4c29700 1 -- 172.21.15.2:0/3900998860 shutdown_connections 2023-11-26T07:17:34.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.799+0000 7f12d4c29700 1 -- 172.21.15.2:0/3900998860 wait complete. 2023-11-26T07:17:34.813 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:17:34.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.936+0000 7f326b251700 1 Processor -- start 2023-11-26T07:17:34.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.936+0000 7f326b251700 1 -- start start 2023-11-26T07:17:34.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.937+0000 7f326b251700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f326415ae50 0x7f32640b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:34.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.937+0000 7f326b251700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f326406ea50 0x7f3264071ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:34.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.937+0000 7f326b251700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f326415b230 con 0x7f326406db30 2023-11-26T07:17:34.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.937+0000 7f326b251700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32640b4110 con 0x7f326406ea50 2023-11-26T07:17:34.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.937+0000 7f326b251700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32640b43f0 con 0x7f326415ae50 2023-11-26T07:17:34.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.937+0000 7f3263fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f326406ea50 0x7f3264071ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:34.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.937+0000 7f32697ee700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f326406db30 0x7f326415e8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36242/0 (socket says 172.21.15.2:36242) 2023-11-26T07:17:34.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.937+0000 7f32697ee700 1 -- 172.21.15.2:0/1012759266 learned_addr learned my addr 172.21.15.2:0/1012759266 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:34.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.938+0000 7f3263fff700 1 -- 172.21.15.2:0/1012759266 >> v2:172.21.15.192:3300/0 conn(0x7f326415ae50 msgr2=0x7f32640b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:34.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.938+0000 7f3268fed700 1 --2- 172.21.15.2:0/1012759266 >> v2:172.21.15.192:3300/0 conn(0x7f326415ae50 0x7f32640b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:34.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.938+0000 7f32637fe700 1 -- 172.21.15.2:0/1012759266 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3466709782 0 0) 0x7f325c001490 con 0x7f326406db30 2023-11-26T07:17:34.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.938+0000 7f3263fff700 1 --2- 172.21.15.2:0/1012759266 >> v2:172.21.15.192:3300/0 conn(0x7f326415ae50 0x7f32640b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:34.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.938+0000 7f3263fff700 1 -- 172.21.15.2:0/1012759266 >> v1:172.21.15.2:6789/0 conn(0x7f326406db30 legacy=0x7f326415e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:34.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.938+0000 7f3263fff700 1 -- 172.21.15.2:0/1012759266 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32640b46d0 con 0x7f326406ea50 2023-11-26T07:17:34.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.938+0000 7f3268fed700 1 --2- 172.21.15.2:0/1012759266 >> v2:172.21.15.192:3300/0 conn(0x7f326415ae50 0x7f32640b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:34.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.938+0000 7f3263fff700 1 --2- 172.21.15.2:0/1012759266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f326406ea50 0x7f3264071ad0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f32640d1b50 tx=0x7f3250009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f4a024deaca18c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:34.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.938+0000 7f32637fe700 1 -- 172.21.15.2:0/1012759266 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3250011830 con 0x7f326406ea50 2023-11-26T07:17:34.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.938+0000 7f32637fe700 1 -- 172.21.15.2:0/1012759266 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3250011990 con 0x7f326406ea50 2023-11-26T07:17:34.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.938+0000 7f32637fe700 1 -- 172.21.15.2:0/1012759266 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3250011d20 con 0x7f326406ea50 2023-11-26T07:17:34.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.938+0000 7f326b251700 1 -- 172.21.15.2:0/1012759266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f326406ea50 msgr2=0x7f3264071ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:34.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.938+0000 7f326b251700 1 --2- 172.21.15.2:0/1012759266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f326406ea50 0x7f3264071ad0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f32640d1b50 tx=0x7f3250009b20 comp rx=0 tx=0).stop 2023-11-26T07:17:34.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.939+0000 7f326b251700 1 -- 172.21.15.2:0/1012759266 shutdown_connections 2023-11-26T07:17:34.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.939+0000 7f326b251700 1 --2- 172.21.15.2:0/1012759266 >> v2:172.21.15.192:3300/0 conn(0x7f326415ae50 0x7f32640b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:34.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.939+0000 7f326b251700 1 --2- 172.21.15.2:0/1012759266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f326406ea50 0x7f3264071ad0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:34.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.939+0000 7f326b251700 1 -- 172.21.15.2:0/1012759266 >> 172.21.15.2:0/1012759266 conn(0x7f32640b27b0 msgr2=0x7f32640b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:34.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.939+0000 7f326b251700 1 -- 172.21.15.2:0/1012759266 shutdown_connections 2023-11-26T07:17:34.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.939+0000 7f326b251700 1 -- 172.21.15.2:0/1012759266 wait complete. 2023-11-26T07:17:34.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.940+0000 7f326b251700 1 Processor -- start 2023-11-26T07:17:34.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.940+0000 7f326b251700 1 -- start start 2023-11-26T07:17:34.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.941+0000 7f326b251700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f326406db30 0x7f326414bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:34.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.941+0000 7f326b251700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f326406ea50 0x7f3264156450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:34.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.941+0000 7f326b251700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f326415ae50 0x7f326414e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:34.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.941+0000 7f326b251700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f326414e440 con 0x7f326406db30 2023-11-26T07:17:34.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.941+0000 7f326b251700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3264155fc0 con 0x7f326415ae50 2023-11-26T07:17:34.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.941+0000 7f326b251700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f326414d4a0 con 0x7f326406ea50 2023-11-26T07:17:34.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.941+0000 7f3268fed700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f326406db30 0x7f326414bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:34.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.941+0000 7f3268fed700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f326406db30 0x7f326414bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45034/0 (socket says 172.21.15.2:45034) 2023-11-26T07:17:34.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.941+0000 7f3268fed700 1 -- 172.21.15.2:0/2106090299 learned_addr learned my addr 172.21.15.2:0/2106090299 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:34.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.941+0000 7f32697ee700 1 --2- 172.21.15.2:0/2106090299 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f326415ae50 0x7f326414e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:34.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.941+0000 7f3263fff700 1 --2- 172.21.15.2:0/2106090299 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f326406ea50 0x7f3264156450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:34.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.941+0000 7f3268fed700 1 -- 172.21.15.2:0/2106090299 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f326406ea50 msgr2=0x7f3264156450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:34.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.941+0000 7f3268fed700 1 --2- 172.21.15.2:0/2106090299 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f326406ea50 0x7f3264156450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:34.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.941+0000 7f3268fed700 1 -- 172.21.15.2:0/2106090299 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f326415ae50 msgr2=0x7f326414e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:34.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.941+0000 7f3268fed700 1 --2- 172.21.15.2:0/2106090299 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f326415ae50 0x7f326414e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:34.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.941+0000 7f3268fed700 1 -- 172.21.15.2:0/2106090299 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32500094a0 con 0x7f326406db30 2023-11-26T07:17:34.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.941+0000 7f32697ee700 1 --2- 172.21.15.2:0/2106090299 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f326415ae50 0x7f326414e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:34.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.941+0000 7f3268fed700 1 --2- 172.21.15.2:0/2106090299 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f326406db30 0x7f326414bb60 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f325800c7f0 tx=0x7f325800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:34.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.941+0000 7f32617fa700 1 -- 172.21.15.2:0/2106090299 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3258011800 con 0x7f326406db30 2023-11-26T07:17:34.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.941+0000 7f32617fa700 1 -- 172.21.15.2:0/2106090299 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3258011960 con 0x7f326406db30 2023-11-26T07:17:34.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.941+0000 7f326b251700 1 -- 172.21.15.2:0/2106090299 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3264155970 con 0x7f326406db30 2023-11-26T07:17:34.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.941+0000 7f32617fa700 1 -- 172.21.15.2:0/2106090299 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3258011d10 con 0x7f326406db30 2023-11-26T07:17:34.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.941+0000 7f326b251700 1 -- 172.21.15.2:0/2106090299 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f326414d780 con 0x7f326406db30 2023-11-26T07:17:34.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.942+0000 7f326b251700 1 -- 172.21.15.2:0/2106090299 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3264075480 con 0x7f326406db30 2023-11-26T07:17:34.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.943+0000 7f32617fa700 1 -- 172.21.15.2:0/2106090299 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f3258018360 con 0x7f326406db30 2023-11-26T07:17:34.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.943+0000 7f32617fa700 1 --2- 172.21.15.2:0/2106090299 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f324806b980 0x7f324806de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:34.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.943+0000 7f32617fa700 1 -- 172.21.15.2:0/2106090299 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3258087ef0 con 0x7f326406db30 2023-11-26T07:17:34.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.944+0000 7f3263fff700 1 --2- 172.21.15.2:0/2106090299 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f324806b980 0x7f324806de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:34.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.944+0000 7f3263fff700 1 --2- 172.21.15.2:0/2106090299 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f324806b980 0x7f324806de40 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f326415a1a0 tx=0x7f3250008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:34.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:34.948+0000 7f32617fa700 1 -- 172.21.15.2:0/2106090299 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3258054a50 con 0x7f326406db30 2023-11-26T07:17:35.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.191+0000 7f326b251700 1 -- 172.21.15.2:0/2106090299 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f32640b5520 con 0x7f326406db30 2023-11-26T07:17:35.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.191+0000 7f32617fa700 1 -- 172.21.15.2:0/2106090299 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4912 (secure 0 0 0) 0x7f325801f090 con 0x7f326406db30 2023-11-26T07:17:35.193 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:17:35.193 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":47,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5678,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3437634953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3437634953},{"type":"v1","addr":"172.21.15.192:6835","nonce":3437634953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":5684,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2624944008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2624944008},{"type":"v1","addr":"172.21.15.192:6837","nonce":2624944008}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6711,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/1847794001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1847794001},{"type":"v1","addr":"172.21.15.2:6834","nonce":1847794001}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:16:32.014651+0000","modified":"2023-11-26T07:16:35.045399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6714},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6714":{"gid":6714,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6835/177641343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":177641343},{"type":"v1","addr":"172.21.15.2:6835","nonce":177641343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-26T07:17:35.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.193+0000 7f326b251700 1 -- 172.21.15.2:0/2106090299 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f324806b980 msgr2=0x7f324806de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:35.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.193+0000 7f326b251700 1 --2- 172.21.15.2:0/2106090299 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f324806b980 0x7f324806de40 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f326415a1a0 tx=0x7f3250008030 comp rx=0 tx=0).stop 2023-11-26T07:17:35.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.193+0000 7f326b251700 1 -- 172.21.15.2:0/2106090299 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f326406db30 msgr2=0x7f326414bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:35.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.193+0000 7f326b251700 1 --2- 172.21.15.2:0/2106090299 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f326406db30 0x7f326414bb60 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f325800c7f0 tx=0x7f325800cbb0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.193+0000 7f326b251700 1 -- 172.21.15.2:0/2106090299 shutdown_connections 2023-11-26T07:17:35.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.193+0000 7f326b251700 1 --2- 172.21.15.2:0/2106090299 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f324806b980 0x7f324806de40 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.193+0000 7f326b251700 1 --2- 172.21.15.2:0/2106090299 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f326415ae50 0x7f326414e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.193+0000 7f326b251700 1 --2- 172.21.15.2:0/2106090299 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f326406db30 0x7f326414bb60 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.193+0000 7f326b251700 1 --2- 172.21.15.2:0/2106090299 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f326406ea50 0x7f3264156450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.193+0000 7f326b251700 1 -- 172.21.15.2:0/2106090299 >> 172.21.15.2:0/2106090299 conn(0x7f32640b27b0 msgr2=0x7f326406afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:35.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.193+0000 7f326b251700 1 -- 172.21.15.2:0/2106090299 shutdown_connections 2023-11-26T07:17:35.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.193+0000 7f326b251700 1 -- 172.21.15.2:0/2106090299 wait complete. 2023-11-26T07:17:35.196 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 47 2023-11-26T07:17:35.207 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:17:35.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.330+0000 7f40f753a700 1 Processor -- start 2023-11-26T07:17:35.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.330+0000 7f40f753a700 1 -- start start 2023-11-26T07:17:35.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.331+0000 7f40f753a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f40f00b57b0 0x7f40f006afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:35.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.331+0000 7f40f753a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40f006b510 0x7f40f006e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:35.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.331+0000 7f40f753a700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40f006b970 con 0x7f40f01478c0 2023-11-26T07:17:35.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.331+0000 7f40f753a700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40f0147ca0 con 0x7f40f00b57b0 2023-11-26T07:17:35.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.331+0000 7f40f753a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f006dbe0 con 0x7f40f006b510 2023-11-26T07:17:35.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.331+0000 7f40f4ad5700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f40f00b57b0 0x7f40f006afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:35.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.331+0000 7f40f4ad5700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f40f00b57b0 0x7f40f006afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45044/0 (socket says 172.21.15.2:45044) 2023-11-26T07:17:35.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.331+0000 7f40f4ad5700 1 -- 172.21.15.2:0/1017923419 learned_addr learned my addr 172.21.15.2:0/1017923419 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:35.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.331+0000 7f40f4ad5700 1 -- 172.21.15.2:0/1017923419 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40f006b510 msgr2=0x7f40f006e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:35.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.331+0000 7f40f5ad7700 1 --2- 172.21.15.2:0/1017923419 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40f006b510 0x7f40f006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:35.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.331+0000 7f40f4ad5700 1 --2- 172.21.15.2:0/1017923419 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40f006b510 0x7f40f006e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.331+0000 7f40f4ad5700 1 -- 172.21.15.2:0/1017923419 >> v1:172.21.15.192:6789/0 conn(0x7f40f01478c0 legacy=0x7f40f0161a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:35.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.331+0000 7f40f4ad5700 1 -- 172.21.15.2:0/1017923419 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f01622e0 con 0x7f40f00b57b0 2023-11-26T07:17:35.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.331+0000 7f40f5ad7700 1 --2- 172.21.15.2:0/1017923419 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40f006b510 0x7f40f006e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:35.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.332+0000 7f40f4ad5700 1 --2- 172.21.15.2:0/1017923419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40f00b57b0 0x7f40f006afd0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f40ec0098f0 tx=0x7f40ec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c700dabb76308951 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:35.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.332+0000 7f40e7fff700 1 -- 172.21.15.2:0/1017923419 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ec004230 con 0x7f40f00b57b0 2023-11-26T07:17:35.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.332+0000 7f40e7fff700 1 -- 172.21.15.2:0/1017923419 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40ec004390 con 0x7f40f00b57b0 2023-11-26T07:17:35.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.332+0000 7f40e7fff700 1 -- 172.21.15.2:0/1017923419 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ec0036a0 con 0x7f40f00b57b0 2023-11-26T07:17:35.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.332+0000 7f40f753a700 1 -- 172.21.15.2:0/1017923419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40f00b57b0 msgr2=0x7f40f006afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:35.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.332+0000 7f40f753a700 1 --2- 172.21.15.2:0/1017923419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40f00b57b0 0x7f40f006afd0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f40ec0098f0 tx=0x7f40ec009c00 comp rx=0 tx=0).stop 2023-11-26T07:17:35.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.332+0000 7f40f753a700 1 -- 172.21.15.2:0/1017923419 shutdown_connections 2023-11-26T07:17:35.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.332+0000 7f40f753a700 1 --2- 172.21.15.2:0/1017923419 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40f006b510 0x7f40f006e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.332+0000 7f40f753a700 1 --2- 172.21.15.2:0/1017923419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40f00b57b0 0x7f40f006afd0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.332+0000 7f40f753a700 1 -- 172.21.15.2:0/1017923419 >> 172.21.15.2:0/1017923419 conn(0x7f40f00d0aa0 msgr2=0x7f40f00d0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:35.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.332+0000 7f40f753a700 1 -- 172.21.15.2:0/1017923419 shutdown_connections 2023-11-26T07:17:35.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.332+0000 7f40f753a700 1 -- 172.21.15.2:0/1017923419 wait complete. 2023-11-26T07:17:35.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.334+0000 7f40f753a700 1 Processor -- start 2023-11-26T07:17:35.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.334+0000 7f40f753a700 1 -- start start 2023-11-26T07:17:35.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.335+0000 7f40f753a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40f006b510 0x7f40f0160ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:35.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.335+0000 7f40f753a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40f00b57b0 0x7f40f0140f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:35.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.335+0000 7f40f753a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40f01478c0 0x7f40f01f44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:35.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.335+0000 7f40f753a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f0141460 con 0x7f40f01478c0 2023-11-26T07:17:35.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.335+0000 7f40f753a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f0141650 con 0x7f40f006b510 2023-11-26T07:17:35.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.335+0000 7f40f753a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f0141930 con 0x7f40f00b57b0 2023-11-26T07:17:35.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.335+0000 7f40f5ad7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40f01478c0 0x7f40f01f44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:35.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.335+0000 7f40f5ad7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40f01478c0 0x7f40f01f44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45052/0 (socket says 172.21.15.2:45052) 2023-11-26T07:17:35.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.335+0000 7f40f5ad7700 1 -- 172.21.15.2:0/3686260572 learned_addr learned my addr 172.21.15.2:0/3686260572 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:35.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.335+0000 7f40f4ad5700 1 --2- 172.21.15.2:0/3686260572 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40f00b57b0 0x7f40f0140f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:35.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.335+0000 7f40f52d6700 1 --2- 172.21.15.2:0/3686260572 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40f006b510 0x7f40f0160ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:35.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.335+0000 7f40f5ad7700 1 -- 172.21.15.2:0/3686260572 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40f00b57b0 msgr2=0x7f40f0140f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:35.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.335+0000 7f40f5ad7700 1 --2- 172.21.15.2:0/3686260572 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40f00b57b0 0x7f40f0140f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.335+0000 7f40f5ad7700 1 -- 172.21.15.2:0/3686260572 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40f006b510 msgr2=0x7f40f0160ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:35.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.335+0000 7f40f5ad7700 1 --2- 172.21.15.2:0/3686260572 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40f006b510 0x7f40f0160ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.335+0000 7f40f5ad7700 1 -- 172.21.15.2:0/3686260572 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ec009550 con 0x7f40f01478c0 2023-11-26T07:17:35.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.335+0000 7f40f4ad5700 1 --2- 172.21.15.2:0/3686260572 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40f00b57b0 0x7f40f0140f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:35.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.336+0000 7f40f5ad7700 1 --2- 172.21.15.2:0/3686260572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40f01478c0 0x7f40f01f44d0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f40e800cef0 tx=0x7f40e800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:35.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.336+0000 7f40e5ffb700 1 -- 172.21.15.2:0/3686260572 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e800ae50 con 0x7f40f01478c0 2023-11-26T07:17:35.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.336+0000 7f40e5ffb700 1 -- 172.21.15.2:0/3686260572 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e8015440 con 0x7f40f01478c0 2023-11-26T07:17:35.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.336+0000 7f40f753a700 1 -- 172.21.15.2:0/3686260572 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40f01f4e60 con 0x7f40f01478c0 2023-11-26T07:17:35.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.336+0000 7f40e5ffb700 1 -- 172.21.15.2:0/3686260572 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e80157f0 con 0x7f40f01478c0 2023-11-26T07:17:35.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.336+0000 7f40f753a700 1 -- 172.21.15.2:0/3686260572 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40f01f4a10 con 0x7f40f01478c0 2023-11-26T07:17:35.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.337+0000 7f40f753a700 1 -- 172.21.15.2:0/3686260572 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40f013fcd0 con 0x7f40f01478c0 2023-11-26T07:17:35.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.337+0000 7f40e5ffb700 1 -- 172.21.15.2:0/3686260572 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f40e800d430 con 0x7f40f01478c0 2023-11-26T07:17:35.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.338+0000 7f40e5ffb700 1 --2- 172.21.15.2:0/3686260572 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f40d406b980 0x7f40d406de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:35.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.338+0000 7f40e5ffb700 1 -- 172.21.15.2:0/3686260572 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f40e8088560 con 0x7f40f01478c0 2023-11-26T07:17:35.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.338+0000 7f40f52d6700 1 --2- 172.21.15.2:0/3686260572 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f40d406b980 0x7f40d406de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:35.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.339+0000 7f40f52d6700 1 --2- 172.21.15.2:0/3686260572 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f40d406b980 0x7f40d406de40 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f40f0142250 tx=0x7f40e0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:35.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.343+0000 7f40e5ffb700 1 -- 172.21.15.2:0/3686260572 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f40e80550c0 con 0x7f40f01478c0 2023-11-26T07:17:35.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.543+0000 7f40f753a700 1 -- 172.21.15.2:0/3686260572 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40f01f4c60 con 0x7f40f01478c0 2023-11-26T07:17:35.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.544+0000 7f40e5ffb700 1 -- 172.21.15.2:0/3686260572 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+16617 (secure 0 0 0) 0x7f40e80586e0 con 0x7f40f01478c0 2023-11-26T07:17:35.546 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:17:35.546 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":75,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:17:24.287171+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:16:30.488040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-26T07:16:30.981722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.4","mappings":[{"from":6,"to":0}]},{"pgid":"11.38","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:17:35.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.546+0000 7f40f753a700 1 -- 172.21.15.2:0/3686260572 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f40d406b980 msgr2=0x7f40d406de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:35.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.546+0000 7f40f753a700 1 --2- 172.21.15.2:0/3686260572 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f40d406b980 0x7f40d406de40 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f40f0142250 tx=0x7f40e0008040 comp rx=0 tx=0).stop 2023-11-26T07:17:35.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.546+0000 7f40f753a700 1 -- 172.21.15.2:0/3686260572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40f01478c0 msgr2=0x7f40f01f44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:35.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.546+0000 7f40f753a700 1 --2- 172.21.15.2:0/3686260572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40f01478c0 0x7f40f01f44d0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f40e800cef0 tx=0x7f40e800a340 comp rx=0 tx=0).stop 2023-11-26T07:17:35.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.546+0000 7f40f753a700 1 -- 172.21.15.2:0/3686260572 shutdown_connections 2023-11-26T07:17:35.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.546+0000 7f40f753a700 1 --2- 172.21.15.2:0/3686260572 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f40d406b980 0x7f40d406de40 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.546+0000 7f40f753a700 1 --2- 172.21.15.2:0/3686260572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40f01478c0 0x7f40f01f44d0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.546+0000 7f40f753a700 1 --2- 172.21.15.2:0/3686260572 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40f006b510 0x7f40f0160ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.546+0000 7f40f753a700 1 --2- 172.21.15.2:0/3686260572 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40f00b57b0 0x7f40f0140f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.546+0000 7f40f753a700 1 -- 172.21.15.2:0/3686260572 >> 172.21.15.2:0/3686260572 conn(0x7f40f00d0aa0 msgr2=0x7f40f0071b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:35.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.546+0000 7f40f753a700 1 -- 172.21.15.2:0/3686260572 shutdown_connections 2023-11-26T07:17:35.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.546+0000 7f40f753a700 1 -- 172.21.15.2:0/3686260572 wait complete. 2023-11-26T07:17:35.560 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-26T07:17:35.561 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:17:35.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.684+0000 7f545096b700 1 Processor -- start 2023-11-26T07:17:35.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.684+0000 7f545096b700 1 -- start start 2023-11-26T07:17:35.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.685+0000 7f545096b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f544c06afd0 0x7f544c0b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:35.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.685+0000 7f545096b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f544c06edc0 0x7f544c06b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:35.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.685+0000 7f545096b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f544c0ad860 con 0x7f544c06dba0 2023-11-26T07:17:35.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.685+0000 7f545096b700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f544c06f830 con 0x7f544c06afd0 2023-11-26T07:17:35.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.685+0000 7f545096b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f544c0d0a20 con 0x7f544c06edc0 2023-11-26T07:17:35.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.685+0000 7f544a59c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f544c06afd0 0x7f544c0b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:35.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.685+0000 7f544a59c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f544c06afd0 0x7f544c0b5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45056/0 (socket says 172.21.15.2:45056) 2023-11-26T07:17:35.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.685+0000 7f544a59c700 1 -- 172.21.15.2:0/1454029548 learned_addr learned my addr 172.21.15.2:0/1454029548 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:35.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.685+0000 7f5449d9b700 1 --2- 172.21.15.2:0/1454029548 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f544c06edc0 0x7f544c06b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:35.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.686+0000 7f544a59c700 1 -- 172.21.15.2:0/1454029548 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f544c06edc0 msgr2=0x7f544c06b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:35.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.686+0000 7f544a59c700 1 --2- 172.21.15.2:0/1454029548 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f544c06edc0 0x7f544c06b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.686+0000 7f544a59c700 1 -- 172.21.15.2:0/1454029548 >> v1:172.21.15.192:6789/0 conn(0x7f544c06dba0 legacy=0x7f544c06e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:35.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.686+0000 7f544a59c700 1 -- 172.21.15.2:0/1454029548 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f544c072b50 con 0x7f544c06afd0 2023-11-26T07:17:35.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.686+0000 7f544a59c700 1 --2- 172.21.15.2:0/1454029548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f544c06afd0 0x7f544c0b5a70 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f54400098f0 tx=0x7f5440009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e483dfa389b87d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:35.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.686+0000 7f544959a700 1 -- 172.21.15.2:0/1454029548 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5440004230 con 0x7f544c06afd0 2023-11-26T07:17:35.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.686+0000 7f544959a700 1 -- 172.21.15.2:0/1454029548 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5440004390 con 0x7f544c06afd0 2023-11-26T07:17:35.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.686+0000 7f544959a700 1 -- 172.21.15.2:0/1454029548 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54400036a0 con 0x7f544c06afd0 2023-11-26T07:17:35.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.686+0000 7f545096b700 1 -- 172.21.15.2:0/1454029548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f544c06afd0 msgr2=0x7f544c0b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:35.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.686+0000 7f545096b700 1 --2- 172.21.15.2:0/1454029548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f544c06afd0 0x7f544c0b5a70 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f54400098f0 tx=0x7f5440009c00 comp rx=0 tx=0).stop 2023-11-26T07:17:35.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.686+0000 7f545096b700 1 -- 172.21.15.2:0/1454029548 shutdown_connections 2023-11-26T07:17:35.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.686+0000 7f545096b700 1 --2- 172.21.15.2:0/1454029548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f544c06afd0 0x7f544c0b5a70 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.686+0000 7f545096b700 1 --2- 172.21.15.2:0/1454029548 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f544c06edc0 0x7f544c06b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.686+0000 7f545096b700 1 -- 172.21.15.2:0/1454029548 >> 172.21.15.2:0/1454029548 conn(0x7f544c0b2840 msgr2=0x7f544c0b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:35.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.687+0000 7f545096b700 1 -- 172.21.15.2:0/1454029548 shutdown_connections 2023-11-26T07:17:35.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.687+0000 7f545096b700 1 -- 172.21.15.2:0/1454029548 wait complete. 2023-11-26T07:17:35.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.688+0000 7f545096b700 1 Processor -- start 2023-11-26T07:17:35.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.688+0000 7f545096b700 1 -- start start 2023-11-26T07:17:35.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.689+0000 7f545096b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f544c06afd0 0x7f544c145b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:35.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.689+0000 7f545096b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f544c06dba0 0x7f544c1e9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:35.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.689+0000 7f545096b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f544c06edc0 0x7f544c15ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:35.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.689+0000 7f545096b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544c1463d0 con 0x7f544c06dba0 2023-11-26T07:17:35.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.689+0000 7f545096b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544c146990 con 0x7f544c06afd0 2023-11-26T07:17:35.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.689+0000 7f545096b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f544c1e9de0 con 0x7f544c06edc0 2023-11-26T07:17:35.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.689+0000 7f5449d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f544c06dba0 0x7f544c1e9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:35.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.689+0000 7f5449d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f544c06dba0 0x7f544c1e9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45062/0 (socket says 172.21.15.2:45062) 2023-11-26T07:17:35.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.689+0000 7f5449d9b700 1 -- 172.21.15.2:0/3876902460 learned_addr learned my addr 172.21.15.2:0/3876902460 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:35.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.689+0000 7f544a59c700 1 --2- 172.21.15.2:0/3876902460 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f544c06afd0 0x7f544c145b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:35.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.689+0000 7f544ad9d700 1 --2- 172.21.15.2:0/3876902460 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f544c06edc0 0x7f544c15ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:35.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.689+0000 7f5449d9b700 1 -- 172.21.15.2:0/3876902460 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f544c06edc0 msgr2=0x7f544c15ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:35.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.689+0000 7f5449d9b700 1 --2- 172.21.15.2:0/3876902460 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f544c06edc0 0x7f544c15ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.689+0000 7f5449d9b700 1 -- 172.21.15.2:0/3876902460 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f544c06afd0 msgr2=0x7f544c145b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:35.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.689+0000 7f5449d9b700 1 --2- 172.21.15.2:0/3876902460 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f544c06afd0 0x7f544c145b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.689+0000 7f5449d9b700 1 -- 172.21.15.2:0/3876902460 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5440009550 con 0x7f544c06dba0 2023-11-26T07:17:35.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.689+0000 7f544ad9d700 1 --2- 172.21.15.2:0/3876902460 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f544c06edc0 0x7f544c15ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:35.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.689+0000 7f544a59c700 1 --2- 172.21.15.2:0/3876902460 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f544c06afd0 0x7f544c145b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:35.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.689+0000 7f5449d9b700 1 --2- 172.21.15.2:0/3876902460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f544c06dba0 0x7f544c1e9360 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f543c00d830 tx=0x7f543c00dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:35.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.689+0000 7f543affd700 1 -- 172.21.15.2:0/3876902460 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543c0125f0 con 0x7f544c06dba0 2023-11-26T07:17:35.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.690+0000 7f543affd700 1 -- 172.21.15.2:0/3876902460 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f543c012750 con 0x7f544c06dba0 2023-11-26T07:17:35.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.690+0000 7f545096b700 1 -- 172.21.15.2:0/3876902460 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f544c1ea0c0 con 0x7f544c06dba0 2023-11-26T07:17:35.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.690+0000 7f543affd700 1 -- 172.21.15.2:0/3876902460 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543c012ae0 con 0x7f544c06dba0 2023-11-26T07:17:35.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.690+0000 7f545096b700 1 -- 172.21.15.2:0/3876902460 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f544c146060 con 0x7f544c06dba0 2023-11-26T07:17:35.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.691+0000 7f545096b700 1 -- 172.21.15.2:0/3876902460 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f544c1ea2b0 con 0x7f544c06dba0 2023-11-26T07:17:35.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.691+0000 7f543affd700 1 -- 172.21.15.2:0/3876902460 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f543c012c40 con 0x7f544c06dba0 2023-11-26T07:17:35.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.691+0000 7f543affd700 1 --2- 172.21.15.2:0/3876902460 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f542c06b980 0x7f542c06de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:35.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.691+0000 7f543affd700 1 -- 172.21.15.2:0/3876902460 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f543c0882a0 con 0x7f544c06dba0 2023-11-26T07:17:35.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.692+0000 7f544a59c700 1 --2- 172.21.15.2:0/3876902460 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f542c06b980 0x7f542c06de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:35.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.692+0000 7f544a59c700 1 --2- 172.21.15.2:0/3876902460 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f542c06b980 0x7f542c06de40 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5440009c40 tx=0x7f5440008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:35.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.696+0000 7f543affd700 1 -- 172.21.15.2:0/3876902460 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f543c054e00 con 0x7f544c06dba0 2023-11-26T07:17:35.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.943+0000 7f545096b700 1 -- 172.21.15.2:0/3876902460 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f544c068670 con 0x7f544c06dba0 2023-11-26T07:17:35.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.943+0000 7f543affd700 1 -- 172.21.15.2:0/3876902460 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4912 (secure 0 0 0) 0x7f543c058420 con 0x7f544c06dba0 2023-11-26T07:17:35.945 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:17:35.945 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":47,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5678,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3437634953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3437634953},{"type":"v1","addr":"172.21.15.192:6835","nonce":3437634953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":5684,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2624944008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2624944008},{"type":"v1","addr":"172.21.15.192:6837","nonce":2624944008}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6711,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/1847794001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1847794001},{"type":"v1","addr":"172.21.15.2:6834","nonce":1847794001}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:16:32.014651+0000","modified":"2023-11-26T07:16:35.045399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6714},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6714":{"gid":6714,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6835/177641343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":177641343},{"type":"v1","addr":"172.21.15.2:6835","nonce":177641343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-26T07:17:35.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.946+0000 7f545096b700 1 -- 172.21.15.2:0/3876902460 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f542c06b980 msgr2=0x7f542c06de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:35.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.946+0000 7f545096b700 1 --2- 172.21.15.2:0/3876902460 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f542c06b980 0x7f542c06de40 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5440009c40 tx=0x7f5440008030 comp rx=0 tx=0).stop 2023-11-26T07:17:35.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.946+0000 7f545096b700 1 -- 172.21.15.2:0/3876902460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f544c06dba0 msgr2=0x7f544c1e9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:35.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.946+0000 7f545096b700 1 --2- 172.21.15.2:0/3876902460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f544c06dba0 0x7f544c1e9360 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f543c00d830 tx=0x7f543c00dbf0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.946+0000 7f545096b700 1 -- 172.21.15.2:0/3876902460 shutdown_connections 2023-11-26T07:17:35.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.946+0000 7f545096b700 1 --2- 172.21.15.2:0/3876902460 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f542c06b980 0x7f542c06de40 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.946+0000 7f545096b700 1 --2- 172.21.15.2:0/3876902460 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f544c06edc0 0x7f544c15ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.946+0000 7f545096b700 1 --2- 172.21.15.2:0/3876902460 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f544c06afd0 0x7f544c145b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.946+0000 7f545096b700 1 --2- 172.21.15.2:0/3876902460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f544c06dba0 0x7f544c1e9360 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:35.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.946+0000 7f545096b700 1 -- 172.21.15.2:0/3876902460 >> 172.21.15.2:0/3876902460 conn(0x7f544c0b2840 msgr2=0x7f544c0b1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:35.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.946+0000 7f545096b700 1 -- 172.21.15.2:0/3876902460 shutdown_connections 2023-11-26T07:17:35.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:35.946+0000 7f545096b700 1 -- 172.21.15.2:0/3876902460 wait complete. 2023-11-26T07:17:35.949 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 47 2023-11-26T07:17:35.960 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:17:36.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.082+0000 7f60e8ff8700 1 Processor -- start 2023-11-26T07:17:36.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.082+0000 7f60e8ff8700 1 -- start start 2023-11-26T07:17:36.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.083+0000 7f60e8ff8700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f60e40b0e90 0x7f60e406eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:36.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.083+0000 7f60e8ff8700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60e40d1230 con 0x7f60e406fc50 2023-11-26T07:17:36.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.083+0000 7f60e8ff8700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60e40d0c70 con 0x7f60e415e1c0 2023-11-26T07:17:36.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.083+0000 7f60e8ff8700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e40d0f50 con 0x7f60e40b0e90 2023-11-26T07:17:36.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.083+0000 7f60e1d9b700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f60e406fc50 0x7f60e406ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36278/0 (socket says 172.21.15.2:36278) 2023-11-26T07:17:36.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.083+0000 7f60e1d9b700 1 -- 172.21.15.2:0/4266049719 learned_addr learned my addr 172.21.15.2:0/4266049719 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:36.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.084+0000 7f60e2d9d700 1 --2- 172.21.15.2:0/4266049719 >> v2:172.21.15.192:3300/0 conn(0x7f60e40b0e90 0x7f60e406eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:36.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.084+0000 7f60e159a700 1 -- 172.21.15.2:0/4266049719 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 704281947 0 0) 0x7f60e40d1230 con 0x7f60e406fc50 2023-11-26T07:17:36.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.084+0000 7f60e159a700 1 -- 172.21.15.2:0/4266049719 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60cc0035b0 con 0x7f60e406fc50 2023-11-26T07:17:36.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.084+0000 7f60e159a700 1 -- 172.21.15.2:0/4266049719 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1586632726 0 0) 0x7f60cc0035b0 con 0x7f60e406fc50 2023-11-26T07:17:36.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.084+0000 7f60e159a700 1 -- 172.21.15.2:0/4266049719 >> v2:172.21.15.192:3300/0 conn(0x7f60e40b0e90 msgr2=0x7f60e406eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:36.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.084+0000 7f60e159a700 1 --2- 172.21.15.2:0/4266049719 >> v2:172.21.15.192:3300/0 conn(0x7f60e40b0e90 0x7f60e406eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:36.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.084+0000 7f60e159a700 1 -- 172.21.15.2:0/4266049719 >> v1:172.21.15.192:6789/0 conn(0x7f60e415e1c0 legacy=0x7f60e406f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:36.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.084+0000 7f60e159a700 1 -- 172.21.15.2:0/4266049719 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e406c210 con 0x7f60e406fc50 2023-11-26T07:17:36.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.084+0000 7f60e159a700 1 -- 172.21.15.2:0/4266049719 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f60d4001670 con 0x7f60e406fc50 2023-11-26T07:17:36.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.084+0000 7f60e159a700 1 -- 172.21.15.2:0/4266049719 >> v1:172.21.15.2:6789/0 conn(0x7f60e406fc50 legacy=0x7f60e406ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:36.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.084+0000 7f60e159a700 1 --2- 172.21.15.2:0/4266049719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60cc003a00 0x7f60cc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:36.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.084+0000 7f60e159a700 1 --2- 172.21.15.2:0/4266049719 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f60cc004850 0x7f60cc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:36.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.084+0000 7f60e159a700 1 --2- 172.21.15.2:0/4266049719 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60cc005210 0x7f60cc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:36.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.084+0000 7f60e159a700 1 -- 172.21.15.2:0/4266049719 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e40d0f50 con 0x7f60cc003a00 2023-11-26T07:17:36.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.084+0000 7f60e159a700 1 -- 172.21.15.2:0/4266049719 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc00c1b0 con 0x7f60cc005210 2023-11-26T07:17:36.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.084+0000 7f60e159a700 1 -- 172.21.15.2:0/4266049719 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc00c370 con 0x7f60cc004850 2023-11-26T07:17:36.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.084+0000 7f60e259c700 1 --2- 172.21.15.2:0/4266049719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60cc003a00 0x7f60cc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:36.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.084+0000 7f60e2d9d700 1 --2- 172.21.15.2:0/4266049719 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60cc005210 0x7f60cc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:36.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.084+0000 7f60e1d9b700 1 --2- 172.21.15.2:0/4266049719 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f60cc004850 0x7f60cc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:36.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.084+0000 7f60e259c700 1 -- 172.21.15.2:0/4266049719 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f60cc004850 msgr2=0x7f60cc004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:36.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.084+0000 7f60e259c700 1 --2- 172.21.15.2:0/4266049719 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f60cc004850 0x7f60cc004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:36.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.084+0000 7f60e259c700 1 -- 172.21.15.2:0/4266049719 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60cc005210 msgr2=0x7f60cc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:36.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.084+0000 7f60e259c700 1 --2- 172.21.15.2:0/4266049719 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60cc005210 0x7f60cc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:36.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.084+0000 7f60e2d9d700 1 -- 172.21.15.2:0/4266049719 reap_dead start 2023-11-26T07:17:36.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.084+0000 7f60e259c700 1 -- 172.21.15.2:0/4266049719 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60cc0035b0 con 0x7f60cc003a00 2023-11-26T07:17:36.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.084+0000 7f60e1d9b700 1 --2- 172.21.15.2:0/4266049719 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f60cc004850 0x7f60cc004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:36.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.084+0000 7f60e259c700 1 --2- 172.21.15.2:0/4266049719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60cc003a00 0x7f60cc003e20 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f60d80017c0 tx=0x7f60cc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab90cd24b0d775a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:36.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.085+0000 7f60e159a700 1 -- 172.21.15.2:0/4266049719 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d80052d0 con 0x7f60cc003a00 2023-11-26T07:17:36.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.085+0000 7f60e159a700 1 -- 172.21.15.2:0/4266049719 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d8005450 con 0x7f60cc003a00 2023-11-26T07:17:36.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.085+0000 7f60e159a700 1 -- 172.21.15.2:0/4266049719 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d80038c0 con 0x7f60cc003a00 2023-11-26T07:17:36.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.085+0000 7f60e8ff8700 1 -- 172.21.15.2:0/4266049719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60cc003a00 msgr2=0x7f60cc003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:36.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.085+0000 7f60e8ff8700 1 --2- 172.21.15.2:0/4266049719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60cc003a00 0x7f60cc003e20 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f60d80017c0 tx=0x7f60cc005880 comp rx=0 tx=0).stop 2023-11-26T07:17:36.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.085+0000 7f60e8ff8700 1 -- 172.21.15.2:0/4266049719 shutdown_connections 2023-11-26T07:17:36.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.085+0000 7f60e8ff8700 1 --2- 172.21.15.2:0/4266049719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60cc003a00 0x7f60cc003e20 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:36.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.085+0000 7f60e8ff8700 1 -- 172.21.15.2:0/4266049719 >> 172.21.15.2:0/4266049719 conn(0x7f60e40b3720 msgr2=0x7f60e40b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:36.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.085+0000 7f60e8ff8700 1 -- 172.21.15.2:0/4266049719 shutdown_connections 2023-11-26T07:17:36.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.085+0000 7f60e8ff8700 1 -- 172.21.15.2:0/4266049719 wait complete. 2023-11-26T07:17:36.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.087+0000 7f60e8ff8700 1 Processor -- start 2023-11-26T07:17:36.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.087+0000 7f60e8ff8700 1 -- start start 2023-11-26T07:17:36.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.087+0000 7f60e8ff8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f60cc003a00 0x7f60e4153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:36.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.087+0000 7f60e8ff8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60e4156020 0x7f60e4153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:36.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.087+0000 7f60e8ff8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60e415ccd0 0x7f60e415d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:36.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.087+0000 7f60e8ff8700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e40b4a20 con 0x7f60e4156020 2023-11-26T07:17:36.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.087+0000 7f60e8ff8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e415d690 con 0x7f60e415ccd0 2023-11-26T07:17:36.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.087+0000 7f60e8ff8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e4156800 con 0x7f60cc003a00 2023-11-26T07:17:36.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.087+0000 7f60e1d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60e4156020 0x7f60e4153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:36.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.088+0000 7f60e1d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60e4156020 0x7f60e4153110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45082/0 (socket says 172.21.15.2:45082) 2023-11-26T07:17:36.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.088+0000 7f60e1d9b700 1 -- 172.21.15.2:0/2915771913 learned_addr learned my addr 172.21.15.2:0/2915771913 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:36.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.088+0000 7f60e259c700 1 --2- 172.21.15.2:0/2915771913 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f60cc003a00 0x7f60e4153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:36.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.088+0000 7f60e2d9d700 1 --2- 172.21.15.2:0/2915771913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60e415ccd0 0x7f60e415d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:36.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.088+0000 7f60e1d9b700 1 -- 172.21.15.2:0/2915771913 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f60cc003a00 msgr2=0x7f60e4153c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:36.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.088+0000 7f60e1d9b700 1 --2- 172.21.15.2:0/2915771913 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f60cc003a00 0x7f60e4153c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:36.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.088+0000 7f60e1d9b700 1 -- 172.21.15.2:0/2915771913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60e415ccd0 msgr2=0x7f60e415d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:36.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.088+0000 7f60e1d9b700 1 --2- 172.21.15.2:0/2915771913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60e415ccd0 0x7f60e415d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:36.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.088+0000 7f60e1d9b700 1 -- 172.21.15.2:0/2915771913 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e4156ae0 con 0x7f60e4156020 2023-11-26T07:17:36.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.088+0000 7f60e1d9b700 1 --2- 172.21.15.2:0/2915771913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60e4156020 0x7f60e4153110 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f60d400e730 tx=0x7f60d400ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:36.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.088+0000 7f60d2ffd700 1 -- 172.21.15.2:0/2915771913 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d4010510 con 0x7f60e4156020 2023-11-26T07:17:36.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.088+0000 7f60d2ffd700 1 -- 172.21.15.2:0/2915771913 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d4010670 con 0x7f60e4156020 2023-11-26T07:17:36.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.088+0000 7f60e8ff8700 1 -- 172.21.15.2:0/2915771913 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e40b4c30 con 0x7f60e4156020 2023-11-26T07:17:36.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.088+0000 7f60d2ffd700 1 -- 172.21.15.2:0/2915771913 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d4010a20 con 0x7f60e4156020 2023-11-26T07:17:36.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.088+0000 7f60e8ff8700 1 -- 172.21.15.2:0/2915771913 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e41564a0 con 0x7f60e4156020 2023-11-26T07:17:36.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.089+0000 7f60e8ff8700 1 -- 172.21.15.2:0/2915771913 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e40b5280 con 0x7f60e4156020 2023-11-26T07:17:36.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.090+0000 7f60d2ffd700 1 -- 172.21.15.2:0/2915771913 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f60d4010b80 con 0x7f60e4156020 2023-11-26T07:17:36.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.090+0000 7f60d2ffd700 1 --2- 172.21.15.2:0/2915771913 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f60c406b980 0x7f60c406de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:36.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.090+0000 7f60d2ffd700 1 -- 172.21.15.2:0/2915771913 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f60d4087800 con 0x7f60e4156020 2023-11-26T07:17:36.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.090+0000 7f60e259c700 1 --2- 172.21.15.2:0/2915771913 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f60c406b980 0x7f60c406de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:36.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.091+0000 7f60e259c700 1 --2- 172.21.15.2:0/2915771913 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f60c406b980 0x7f60c406de40 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f60d8005040 tx=0x7f60d8009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:36.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.095+0000 7f60d2ffd700 1 -- 172.21.15.2:0/2915771913 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f60d40541e0 con 0x7f60e4156020 2023-11-26T07:17:36.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.343+0000 7f60e8ff8700 1 -- 172.21.15.2:0/2915771913 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60e4068670 con 0x7f60e4156020 2023-11-26T07:17:36.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.343+0000 7f60d2ffd700 1 -- 172.21.15.2:0/2915771913 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4912 (secure 0 0 0) 0x7f60d4019090 con 0x7f60e4156020 2023-11-26T07:17:36.346 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:17:36.346 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":47,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5678,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3437634953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3437634953},{"type":"v1","addr":"172.21.15.192:6835","nonce":3437634953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":5684,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2624944008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2624944008},{"type":"v1","addr":"172.21.15.192:6837","nonce":2624944008}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6711,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/1847794001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1847794001},{"type":"v1","addr":"172.21.15.2:6834","nonce":1847794001}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:16:32.014651+0000","modified":"2023-11-26T07:16:35.045399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6714},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6714":{"gid":6714,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6835/177641343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":177641343},{"type":"v1","addr":"172.21.15.2:6835","nonce":177641343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-26T07:17:36.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.346+0000 7f60e8ff8700 1 -- 172.21.15.2:0/2915771913 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f60c406b980 msgr2=0x7f60c406de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:36.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.346+0000 7f60e8ff8700 1 --2- 172.21.15.2:0/2915771913 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f60c406b980 0x7f60c406de40 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f60d8005040 tx=0x7f60d8009030 comp rx=0 tx=0).stop 2023-11-26T07:17:36.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.346+0000 7f60e8ff8700 1 -- 172.21.15.2:0/2915771913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60e4156020 msgr2=0x7f60e4153110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:36.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.346+0000 7f60e8ff8700 1 --2- 172.21.15.2:0/2915771913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60e4156020 0x7f60e4153110 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f60d400e730 tx=0x7f60d400ea40 comp rx=0 tx=0).stop 2023-11-26T07:17:36.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.346+0000 7f60e8ff8700 1 -- 172.21.15.2:0/2915771913 shutdown_connections 2023-11-26T07:17:36.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.346+0000 7f60e8ff8700 1 --2- 172.21.15.2:0/2915771913 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f60c406b980 0x7f60c406de40 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:36.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.346+0000 7f60e8ff8700 1 --2- 172.21.15.2:0/2915771913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60e415ccd0 0x7f60e415d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:36.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.346+0000 7f60e8ff8700 1 --2- 172.21.15.2:0/2915771913 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f60cc003a00 0x7f60e4153c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:36.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.346+0000 7f60e8ff8700 1 --2- 172.21.15.2:0/2915771913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60e4156020 0x7f60e4153110 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:36.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.346+0000 7f60e8ff8700 1 -- 172.21.15.2:0/2915771913 >> 172.21.15.2:0/2915771913 conn(0x7f60e40b3720 msgr2=0x7f60e40b2b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:36.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.346+0000 7f60e8ff8700 1 -- 172.21.15.2:0/2915771913 shutdown_connections 2023-11-26T07:17:36.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.346+0000 7f60e8ff8700 1 -- 172.21.15.2:0/2915771913 wait complete. 2023-11-26T07:17:36.349 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 47 2023-11-26T07:17:36.360 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:17:36.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.483+0000 7f3c44b95700 1 Processor -- start 2023-11-26T07:17:36.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.483+0000 7f3c44b95700 1 -- start start 2023-11-26T07:17:36.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.484+0000 7f3c44b95700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c4006b6e0 0x7f3c4006db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:36.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.484+0000 7f3c44b95700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3c40145100 0x7f3c4006e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:36.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.484+0000 7f3c44b95700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c40160720 con 0x7f3c40144c10 2023-11-26T07:17:36.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.484+0000 7f3c44b95700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c4006f500 con 0x7f3c40145100 2023-11-26T07:17:36.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.484+0000 7f3c44b95700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c400cd610 con 0x7f3c4006b6e0 2023-11-26T07:17:36.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.484+0000 7f3c3e59c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f3c40144c10 0x7f3c4006afd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36298/0 (socket says 172.21.15.2:36298) 2023-11-26T07:17:36.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.484+0000 7f3c3e59c700 1 -- 172.21.15.2:0/4162516109 learned_addr learned my addr 172.21.15.2:0/4162516109 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:36.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.484+0000 7f3c3ed9d700 1 --2- 172.21.15.2:0/4162516109 >> v2:172.21.15.2:3300/0 conn(0x7f3c40145100 0x7f3c4006e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:36.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.484+0000 7f3c3dd9b700 1 --2- 172.21.15.2:0/4162516109 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c4006b6e0 0x7f3c4006db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:36.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.484+0000 7f3c3d59a700 1 -- 172.21.15.2:0/4162516109 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1274957108 0 0) 0x7f3c40160720 con 0x7f3c40144c10 2023-11-26T07:17:36.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.484+0000 7f3c3d59a700 1 -- 172.21.15.2:0/4162516109 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c280035b0 con 0x7f3c40144c10 2023-11-26T07:17:36.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.484+0000 7f3c3ed9d700 1 -- 172.21.15.2:0/4162516109 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c4006b6e0 msgr2=0x7f3c4006db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:36.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.484+0000 7f3c3ed9d700 1 --2- 172.21.15.2:0/4162516109 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c4006b6e0 0x7f3c4006db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:36.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.484+0000 7f3c3ed9d700 1 -- 172.21.15.2:0/4162516109 >> v1:172.21.15.2:6789/0 conn(0x7f3c40144c10 legacy=0x7f3c4006afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:36.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.484+0000 7f3c3ed9d700 1 -- 172.21.15.2:0/4162516109 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c4006f710 con 0x7f3c40145100 2023-11-26T07:17:36.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.484+0000 7f3c3dd9b700 1 --2- 172.21.15.2:0/4162516109 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c4006b6e0 0x7f3c4006db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:36.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.484+0000 7f3c3ed9d700 1 --2- 172.21.15.2:0/4162516109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c40145100 0x7f3c4006e0b0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f3c38009d90 tx=0x7f3c3800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=840f60ee0b0e21cd server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:36.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.484+0000 7f3c3d59a700 1 -- 172.21.15.2:0/4162516109 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3800e070 con 0x7f3c40145100 2023-11-26T07:17:36.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.485+0000 7f3c3d59a700 1 -- 172.21.15.2:0/4162516109 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3800bb20 con 0x7f3c40145100 2023-11-26T07:17:36.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.485+0000 7f3c3d59a700 1 -- 172.21.15.2:0/4162516109 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3800be90 con 0x7f3c40145100 2023-11-26T07:17:36.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.485+0000 7f3c44b95700 1 -- 172.21.15.2:0/4162516109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c40145100 msgr2=0x7f3c4006e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:36.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.485+0000 7f3c44b95700 1 --2- 172.21.15.2:0/4162516109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c40145100 0x7f3c4006e0b0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f3c38009d90 tx=0x7f3c3800b330 comp rx=0 tx=0).stop 2023-11-26T07:17:36.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.485+0000 7f3c44b95700 1 -- 172.21.15.2:0/4162516109 shutdown_connections 2023-11-26T07:17:36.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.485+0000 7f3c44b95700 1 --2- 172.21.15.2:0/4162516109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c40145100 0x7f3c4006e0b0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:36.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.485+0000 7f3c44b95700 1 --2- 172.21.15.2:0/4162516109 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c4006b6e0 0x7f3c4006db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:36.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.485+0000 7f3c44b95700 1 -- 172.21.15.2:0/4162516109 >> 172.21.15.2:0/4162516109 conn(0x7f3c400b2740 msgr2=0x7f3c400b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:36.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.485+0000 7f3c44b95700 1 -- 172.21.15.2:0/4162516109 shutdown_connections 2023-11-26T07:17:36.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.485+0000 7f3c44b95700 1 -- 172.21.15.2:0/4162516109 wait complete. 2023-11-26T07:17:36.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.486+0000 7f3c44b95700 1 Processor -- start 2023-11-26T07:17:36.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.487+0000 7f3c44b95700 1 -- start start 2023-11-26T07:17:36.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.487+0000 7f3c44b95700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c4006b6e0 0x7f3c401f2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:36.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.487+0000 7f3c44b95700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c40144c10 0x7f3c4015b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:36.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.487+0000 7f3c44b95700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c40145100 0x7f3c400cf140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:36.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.487+0000 7f3c44b95700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4015e170 con 0x7f3c4006b6e0 2023-11-26T07:17:36.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.487+0000 7f3c44b95700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4015d5a0 con 0x7f3c40144c10 2023-11-26T07:17:36.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.487+0000 7f3c44b95700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4015d840 con 0x7f3c40145100 2023-11-26T07:17:36.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.487+0000 7f3c3e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c4006b6e0 0x7f3c401f2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:36.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.487+0000 7f3c3e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c4006b6e0 0x7f3c401f2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45094/0 (socket says 172.21.15.2:45094) 2023-11-26T07:17:36.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.487+0000 7f3c3e59c700 1 -- 172.21.15.2:0/2420016134 learned_addr learned my addr 172.21.15.2:0/2420016134 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:36.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.488+0000 7f3c3ed9d700 1 --2- 172.21.15.2:0/2420016134 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c40145100 0x7f3c400cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:36.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.488+0000 7f3c3e59c700 1 -- 172.21.15.2:0/2420016134 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c40145100 msgr2=0x7f3c400cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:36.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.488+0000 7f3c3e59c700 1 --2- 172.21.15.2:0/2420016134 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c40145100 0x7f3c400cf140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:36.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.488+0000 7f3c3e59c700 1 -- 172.21.15.2:0/2420016134 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c40144c10 msgr2=0x7f3c4015b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:36.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.488+0000 7f3c3e59c700 1 --2- 172.21.15.2:0/2420016134 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c40144c10 0x7f3c4015b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:36.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.488+0000 7f3c3e59c700 1 -- 172.21.15.2:0/2420016134 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c38009a70 con 0x7f3c4006b6e0 2023-11-26T07:17:36.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.488+0000 7f3c3e59c700 1 --2- 172.21.15.2:0/2420016134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c4006b6e0 0x7f3c401f2a80 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f3c3000c4d0 tx=0x7f3c3000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:36.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.488+0000 7f3c2effd700 1 -- 172.21.15.2:0/2420016134 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c30005d70 con 0x7f3c4006b6e0 2023-11-26T07:17:36.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.488+0000 7f3c2effd700 1 -- 172.21.15.2:0/2420016134 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c300070d0 con 0x7f3c4006b6e0 2023-11-26T07:17:36.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.488+0000 7f3c2effd700 1 -- 172.21.15.2:0/2420016134 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c30007440 con 0x7f3c4006b6e0 2023-11-26T07:17:36.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.488+0000 7f3c44b95700 1 -- 172.21.15.2:0/2420016134 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c4015db20 con 0x7f3c4006b6e0 2023-11-26T07:17:36.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.488+0000 7f3c44b95700 1 -- 172.21.15.2:0/2420016134 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c4015bc50 con 0x7f3c4006b6e0 2023-11-26T07:17:36.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.489+0000 7f3c44b95700 1 -- 172.21.15.2:0/2420016134 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c40068670 con 0x7f3c4006b6e0 2023-11-26T07:17:36.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.490+0000 7f3c2effd700 1 -- 172.21.15.2:0/2420016134 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f3c300075a0 con 0x7f3c4006b6e0 2023-11-26T07:17:36.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.490+0000 7f3c2effd700 1 --2- 172.21.15.2:0/2420016134 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3c2006b980 0x7f3c2006de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:36.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.490+0000 7f3c2effd700 1 -- 172.21.15.2:0/2420016134 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3c30087550 con 0x7f3c4006b6e0 2023-11-26T07:17:36.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.490+0000 7f3c3dd9b700 1 --2- 172.21.15.2:0/2420016134 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3c2006b980 0x7f3c2006de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:36.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.491+0000 7f3c3dd9b700 1 --2- 172.21.15.2:0/2420016134 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3c2006b980 0x7f3c2006de40 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f3c34006fd0 tx=0x7f3c34008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:36.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.495+0000 7f3c2effd700 1 -- 172.21.15.2:0/2420016134 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3c30053f30 con 0x7f3c4006b6e0 2023-11-26T07:17:36.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.700+0000 7f3c44b95700 1 -- 172.21.15.2:0/2420016134 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c400d0840 con 0x7f3c4006b6e0 2023-11-26T07:17:36.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.701+0000 7f3c2effd700 1 -- 172.21.15.2:0/2420016134 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+16617 (secure 0 0 0) 0x7f3c30017090 con 0x7f3c4006b6e0 2023-11-26T07:17:36.703 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:17:36.703 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":75,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:17:24.287171+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:16:30.488040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-26T07:16:30.981722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.4","mappings":[{"from":6,"to":0}]},{"pgid":"11.38","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:17:36.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.703+0000 7f3c44b95700 1 -- 172.21.15.2:0/2420016134 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3c2006b980 msgr2=0x7f3c2006de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:36.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.703+0000 7f3c44b95700 1 --2- 172.21.15.2:0/2420016134 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3c2006b980 0x7f3c2006de40 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f3c34006fd0 tx=0x7f3c34008040 comp rx=0 tx=0).stop 2023-11-26T07:17:36.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.703+0000 7f3c44b95700 1 -- 172.21.15.2:0/2420016134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c4006b6e0 msgr2=0x7f3c401f2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:36.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.703+0000 7f3c44b95700 1 --2- 172.21.15.2:0/2420016134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c4006b6e0 0x7f3c401f2a80 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f3c3000c4d0 tx=0x7f3c3000c890 comp rx=0 tx=0).stop 2023-11-26T07:17:36.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.704+0000 7f3c44b95700 1 -- 172.21.15.2:0/2420016134 shutdown_connections 2023-11-26T07:17:36.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.704+0000 7f3c44b95700 1 --2- 172.21.15.2:0/2420016134 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3c2006b980 0x7f3c2006de40 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:36.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.704+0000 7f3c44b95700 1 --2- 172.21.15.2:0/2420016134 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c40145100 0x7f3c400cf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:36.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.704+0000 7f3c44b95700 1 --2- 172.21.15.2:0/2420016134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c4006b6e0 0x7f3c401f2a80 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:36.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.704+0000 7f3c44b95700 1 --2- 172.21.15.2:0/2420016134 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c40144c10 0x7f3c4015b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:36.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.704+0000 7f3c44b95700 1 -- 172.21.15.2:0/2420016134 >> 172.21.15.2:0/2420016134 conn(0x7f3c400b2740 msgr2=0x7f3c400cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:36.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.704+0000 7f3c44b95700 1 -- 172.21.15.2:0/2420016134 shutdown_connections 2023-11-26T07:17:36.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.704+0000 7f3c44b95700 1 -- 172.21.15.2:0/2420016134 wait complete. 2023-11-26T07:17:36.718 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-26T07:17:36.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.842+0000 7f238b3a9700 1 Processor -- start 2023-11-26T07:17:36.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.843+0000 7f238b3a9700 1 -- start start 2023-11-26T07:17:36.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.843+0000 7f238b3a9700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f23841440f0 0x7f23840b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:36.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.843+0000 7f238b3a9700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2384143ec0 con 0x7f23840722c0 2023-11-26T07:17:36.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.843+0000 7f238b3a9700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23840b3ae0 con 0x7f2384143ae0 2023-11-26T07:17:36.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.843+0000 7f238b3a9700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23840b40a0 con 0x7f23841440f0 2023-11-26T07:17:36.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.844+0000 7f2388944700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f23840722c0 0x7f238406e510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36312/0 (socket says 172.21.15.2:36312) 2023-11-26T07:17:36.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.844+0000 7f2388944700 1 -- 172.21.15.2:0/2294441623 learned_addr learned my addr 172.21.15.2:0/2294441623 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:36.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.844+0000 7f2389946700 1 --2- 172.21.15.2:0/2294441623 >> v2:172.21.15.2:3300/0 conn(0x7f23841440f0 0x7f23840b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:36.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.844+0000 7f2377fff700 1 -- 172.21.15.2:0/2294441623 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 729146414 0 0) 0x7f2384143ec0 con 0x7f23840722c0 2023-11-26T07:17:36.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.844+0000 7f2377fff700 1 -- 172.21.15.2:0/2294441623 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23700035b0 con 0x7f23840722c0 2023-11-26T07:17:36.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.844+0000 7f2389946700 1 -- 172.21.15.2:0/2294441623 >> v1:172.21.15.192:6789/0 conn(0x7f2384143ae0 legacy=0x7f2384071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:36.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.844+0000 7f2389946700 1 -- 172.21.15.2:0/2294441623 >> v1:172.21.15.2:6789/0 conn(0x7f23840722c0 legacy=0x7f238406e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:36.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.844+0000 7f2389946700 1 -- 172.21.15.2:0/2294441623 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23840b3dc0 con 0x7f23841440f0 2023-11-26T07:17:36.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.844+0000 7f2389946700 1 --2- 172.21.15.2:0/2294441623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23841440f0 0x7f23840b51b0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f237c009d90 tx=0x7f237c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16776ee81c471fc2 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:36.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.844+0000 7f2377fff700 1 -- 172.21.15.2:0/2294441623 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c00e070 con 0x7f23841440f0 2023-11-26T07:17:36.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.844+0000 7f2377fff700 1 -- 172.21.15.2:0/2294441623 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237c00bb20 con 0x7f23841440f0 2023-11-26T07:17:36.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.844+0000 7f2377fff700 1 -- 172.21.15.2:0/2294441623 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c012430 con 0x7f23841440f0 2023-11-26T07:17:36.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.845+0000 7f238b3a9700 1 -- 172.21.15.2:0/2294441623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23841440f0 msgr2=0x7f23840b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:36.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.845+0000 7f238b3a9700 1 --2- 172.21.15.2:0/2294441623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23841440f0 0x7f23840b51b0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f237c009d90 tx=0x7f237c00b330 comp rx=0 tx=0).stop 2023-11-26T07:17:36.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.845+0000 7f238b3a9700 1 -- 172.21.15.2:0/2294441623 shutdown_connections 2023-11-26T07:17:36.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.845+0000 7f238b3a9700 1 --2- 172.21.15.2:0/2294441623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23841440f0 0x7f23840b51b0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:36.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.845+0000 7f238b3a9700 1 -- 172.21.15.2:0/2294441623 >> 172.21.15.2:0/2294441623 conn(0x7f23840b2740 msgr2=0x7f23840b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:36.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.845+0000 7f238b3a9700 1 -- 172.21.15.2:0/2294441623 shutdown_connections 2023-11-26T07:17:36.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.845+0000 7f238b3a9700 1 -- 172.21.15.2:0/2294441623 wait complete. 2023-11-26T07:17:36.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.846+0000 7f238b3a9700 1 Processor -- start 2023-11-26T07:17:36.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.846+0000 7f238b3a9700 1 -- start start 2023-11-26T07:17:36.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.847+0000 7f238b3a9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23840722c0 0x7f23841597c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:36.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.847+0000 7f238b3a9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2384143ae0 0x7f23840ca340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:36.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.847+0000 7f238b3a9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23841440f0 0x7f238406afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:36.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.847+0000 7f238b3a9700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23840c92a0 con 0x7f2384143ae0 2023-11-26T07:17:36.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.847+0000 7f238b3a9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23840c9580 con 0x7f23841440f0 2023-11-26T07:17:36.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.847+0000 7f238b3a9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23840c9860 con 0x7f23840722c0 2023-11-26T07:17:36.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.847+0000 7f2388944700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2384143ae0 0x7f23840ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:36.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.847+0000 7f2388944700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2384143ae0 0x7f23840ca340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45110/0 (socket says 172.21.15.2:45110) 2023-11-26T07:17:36.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.847+0000 7f2388944700 1 -- 172.21.15.2:0/3254238106 learned_addr learned my addr 172.21.15.2:0/3254238106 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:36.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.847+0000 7f2388944700 1 -- 172.21.15.2:0/3254238106 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23840722c0 msgr2=0x7f23841597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:36.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.847+0000 7f2388944700 1 --2- 172.21.15.2:0/3254238106 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23840722c0 0x7f23841597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:36.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.847+0000 7f2388944700 1 -- 172.21.15.2:0/3254238106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23841440f0 msgr2=0x7f238406afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:36.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.847+0000 7f2388944700 1 --2- 172.21.15.2:0/3254238106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23841440f0 0x7f238406afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:36.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.847+0000 7f2388944700 1 -- 172.21.15.2:0/3254238106 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f237c009a70 con 0x7f2384143ae0 2023-11-26T07:17:36.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.847+0000 7f2388944700 1 --2- 172.21.15.2:0/3254238106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2384143ae0 0x7f23840ca340 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f238000c700 tx=0x7f238000cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:36.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.848+0000 7f2375ffb700 1 -- 172.21.15.2:0/3254238106 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2380005d70 con 0x7f2384143ae0 2023-11-26T07:17:36.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.848+0000 7f2375ffb700 1 -- 172.21.15.2:0/3254238106 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23800070d0 con 0x7f2384143ae0 2023-11-26T07:17:36.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.848+0000 7f238b3a9700 1 -- 172.21.15.2:0/3254238106 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23840c9b40 con 0x7f2384143ae0 2023-11-26T07:17:36.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.848+0000 7f2375ffb700 1 -- 172.21.15.2:0/3254238106 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2380007460 con 0x7f2384143ae0 2023-11-26T07:17:36.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.848+0000 7f238b3a9700 1 -- 172.21.15.2:0/3254238106 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2384159d00 con 0x7f2384143ae0 2023-11-26T07:17:36.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.849+0000 7f238b3a9700 1 -- 172.21.15.2:0/3254238106 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23840b57f0 con 0x7f2384143ae0 2023-11-26T07:17:36.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.849+0000 7f2375ffb700 1 -- 172.21.15.2:0/3254238106 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f23800075c0 con 0x7f2384143ae0 2023-11-26T07:17:36.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.849+0000 7f2375ffb700 1 --2- 172.21.15.2:0/3254238106 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f236806b980 0x7f236806de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:36.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.850+0000 7f2375ffb700 1 -- 172.21.15.2:0/3254238106 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f2380087790 con 0x7f2384143ae0 2023-11-26T07:17:36.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.850+0000 7f2389145700 1 --2- 172.21.15.2:0/3254238106 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f236806b980 0x7f236806de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:36.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.850+0000 7f2389145700 1 --2- 172.21.15.2:0/3254238106 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f236806b980 0x7f236806de40 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f2378000f60 tx=0x7f2378007a40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:36.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:36.854+0000 7f2375ffb700 1 -- 172.21.15.2:0/3254238106 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2380054040 con 0x7f2384143ae0 2023-11-26T07:17:37.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.103+0000 7f238b3a9700 1 -- 172.21.15.2:0/3254238106 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f2384068670 con 0x7f2384143ae0 2023-11-26T07:17:37.106 INFO:tasks.ceph.mon.a.smithi002.stderr:2023-11-26T07:17:37.104+0000 7f35cd3c3700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-26T07:17:37.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.105+0000 7f2375ffb700 1 -- 172.21.15.2:0/3254238106 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v48) v1 ==== 161+0+0 (secure 0 0 0) 0x7f2380057660 con 0x7f2384143ae0 2023-11-26T07:17:37.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.108+0000 7f238b3a9700 1 -- 172.21.15.2:0/3254238106 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f236806b980 msgr2=0x7f236806de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:37.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.108+0000 7f238b3a9700 1 --2- 172.21.15.2:0/3254238106 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f236806b980 0x7f236806de40 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f2378000f60 tx=0x7f2378007a40 comp rx=0 tx=0).stop 2023-11-26T07:17:37.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.108+0000 7f238b3a9700 1 -- 172.21.15.2:0/3254238106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2384143ae0 msgr2=0x7f23840ca340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:37.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.108+0000 7f238b3a9700 1 --2- 172.21.15.2:0/3254238106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2384143ae0 0x7f23840ca340 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f238000c700 tx=0x7f238000cac0 comp rx=0 tx=0).stop 2023-11-26T07:17:37.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.108+0000 7f238b3a9700 1 -- 172.21.15.2:0/3254238106 shutdown_connections 2023-11-26T07:17:37.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.108+0000 7f238b3a9700 1 --2- 172.21.15.2:0/3254238106 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f236806b980 0x7f236806de40 secure :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f2378000f60 tx=0x7f2378007a40 comp rx=0 tx=0).stop 2023-11-26T07:17:37.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.108+0000 7f238b3a9700 1 --2- 172.21.15.2:0/3254238106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23841440f0 0x7f238406afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:37.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.108+0000 7f238b3a9700 1 --2- 172.21.15.2:0/3254238106 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23840722c0 0x7f23841597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:37.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.108+0000 7f238b3a9700 1 --2- 172.21.15.2:0/3254238106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2384143ae0 0x7f23840ca340 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:37.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.108+0000 7f238b3a9700 1 -- 172.21.15.2:0/3254238106 >> 172.21.15.2:0/3254238106 conn(0x7f23840b2740 msgr2=0x7f238415b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:37.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.109+0000 7f238b3a9700 1 -- 172.21.15.2:0/3254238106 shutdown_connections 2023-11-26T07:17:37.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.109+0000 7f238b3a9700 1 -- 172.21.15.2:0/3254238106 wait complete. 2023-11-26T07:17:37.112 INFO:teuthology.orchestra.run.smithi002.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-26T07:17:37.123 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-26T07:17:37.149 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2023-11-26T07:17:37.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.250+0000 7f4fa3557700 1 Processor -- start 2023-11-26T07:17:37.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.250+0000 7f4fa3557700 1 -- start start 2023-11-26T07:17:37.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.251+0000 7f4fa3557700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f9c143ae0 0x7f4f9c0b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:37.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.251+0000 7f4fa3557700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4f9c0722c0 0x7f4f9c06e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:37.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.251+0000 7f4fa3557700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f9c143ec0 con 0x7f4f9c1440f0 2023-11-26T07:17:37.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.251+0000 7f4fa3557700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f9c0b40a0 con 0x7f4f9c0722c0 2023-11-26T07:17:37.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.251+0000 7f4fa3557700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9c0b3ae0 con 0x7f4f9c143ae0 2023-11-26T07:17:37.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.251+0000 7f4fa1af4700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4f9c0722c0 0x7f4f9c06e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:37.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.251+0000 7f4fa1af4700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4f9c0722c0 0x7f4f9c06e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45130/0 (socket says 172.21.15.2:45130) 2023-11-26T07:17:37.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.251+0000 7f4fa1af4700 1 -- 172.21.15.2:0/3237555927 learned_addr learned my addr 172.21.15.2:0/3237555927 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:37.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.251+0000 7f4fa12f3700 1 --2- 172.21.15.2:0/3237555927 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f9c143ae0 0x7f4f9c0b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:37.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.251+0000 7f4fa1af4700 1 -- 172.21.15.2:0/3237555927 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f9c143ae0 msgr2=0x7f4f9c0b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:37.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.251+0000 7f4fa1af4700 1 --2- 172.21.15.2:0/3237555927 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f9c143ae0 0x7f4f9c0b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:37.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.251+0000 7f4fa1af4700 1 -- 172.21.15.2:0/3237555927 >> v1:172.21.15.192:6789/0 conn(0x7f4f9c1440f0 legacy=0x7f4f9c071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:37.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.251+0000 7f4fa1af4700 1 -- 172.21.15.2:0/3237555927 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f9c0b3dc0 con 0x7f4f9c0722c0 2023-11-26T07:17:37.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.251+0000 7f4fa12f3700 1 --2- 172.21.15.2:0/3237555927 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f9c143ae0 0x7f4f9c0b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:37.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.252+0000 7f4fa1af4700 1 --2- 172.21.15.2:0/3237555927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f9c0722c0 0x7f4f9c06e510 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f4f94009e50 tx=0x7f4f9400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=200a6e39196baba4 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:37.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.252+0000 7f4f93fff700 1 -- 172.21.15.2:0/3237555927 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9400e070 con 0x7f4f9c0722c0 2023-11-26T07:17:37.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.252+0000 7f4f93fff700 1 -- 172.21.15.2:0/3237555927 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f94003a20 con 0x7f4f9c0722c0 2023-11-26T07:17:37.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.252+0000 7f4f93fff700 1 -- 172.21.15.2:0/3237555927 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f94003dd0 con 0x7f4f9c0722c0 2023-11-26T07:17:37.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.252+0000 7f4fa3557700 1 -- 172.21.15.2:0/3237555927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f9c0722c0 msgr2=0x7f4f9c06e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:37.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.252+0000 7f4fa3557700 1 --2- 172.21.15.2:0/3237555927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f9c0722c0 0x7f4f9c06e510 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f4f94009e50 tx=0x7f4f9400b330 comp rx=0 tx=0).stop 2023-11-26T07:17:37.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.252+0000 7f4fa3557700 1 -- 172.21.15.2:0/3237555927 shutdown_connections 2023-11-26T07:17:37.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.252+0000 7f4fa3557700 1 --2- 172.21.15.2:0/3237555927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f9c0722c0 0x7f4f9c06e510 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:37.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.252+0000 7f4fa3557700 1 --2- 172.21.15.2:0/3237555927 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f9c143ae0 0x7f4f9c0b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:37.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.252+0000 7f4fa3557700 1 -- 172.21.15.2:0/3237555927 >> 172.21.15.2:0/3237555927 conn(0x7f4f9c0b2740 msgr2=0x7f4f9c0b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:37.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.252+0000 7f4fa3557700 1 -- 172.21.15.2:0/3237555927 shutdown_connections 2023-11-26T07:17:37.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.252+0000 7f4fa3557700 1 -- 172.21.15.2:0/3237555927 wait complete. 2023-11-26T07:17:37.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.254+0000 7f4fa3557700 1 Processor -- start 2023-11-26T07:17:37.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.254+0000 7f4fa3557700 1 -- start start 2023-11-26T07:17:37.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.254+0000 7f4fa3557700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f9c0722c0 0x7f4f9c0cc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:37.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.254+0000 7f4fa3557700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f9c143ae0 0x7f4f9c141ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:37.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.254+0000 7f4fa3557700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f9c1440f0 0x7f4f9c0c6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:37.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.254+0000 7f4fa3557700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9c141ff0 con 0x7f4f9c0722c0 2023-11-26T07:17:37.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.254+0000 7f4fa3557700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9c136f10 con 0x7f4f9c143ae0 2023-11-26T07:17:37.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.254+0000 7f4fa3557700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9c0c6b90 con 0x7f4f9c1440f0 2023-11-26T07:17:37.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.254+0000 7f4fa12f3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f9c0722c0 0x7f4f9c0cc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:37.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.254+0000 7f4fa12f3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f9c0722c0 0x7f4f9c0cc5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45132/0 (socket says 172.21.15.2:45132) 2023-11-26T07:17:37.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.254+0000 7f4fa12f3700 1 -- 172.21.15.2:0/120339017 learned_addr learned my addr 172.21.15.2:0/120339017 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:37.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.255+0000 7f4fa0af2700 1 --2- 172.21.15.2:0/120339017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f9c143ae0 0x7f4f9c141ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:37.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.255+0000 7f4fa1af4700 1 --2- 172.21.15.2:0/120339017 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f9c1440f0 0x7f4f9c0c6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:37.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.255+0000 7f4fa12f3700 1 -- 172.21.15.2:0/120339017 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f9c1440f0 msgr2=0x7f4f9c0c6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:37.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.255+0000 7f4fa12f3700 1 --2- 172.21.15.2:0/120339017 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f9c1440f0 0x7f4f9c0c6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:37.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.255+0000 7f4fa12f3700 1 -- 172.21.15.2:0/120339017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f9c143ae0 msgr2=0x7f4f9c141ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:37.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.255+0000 7f4fa12f3700 1 --2- 172.21.15.2:0/120339017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f9c143ae0 0x7f4f9c141ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:37.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.255+0000 7f4fa12f3700 1 -- 172.21.15.2:0/120339017 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f94009b30 con 0x7f4f9c0722c0 2023-11-26T07:17:37.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.255+0000 7f4fa0af2700 1 --2- 172.21.15.2:0/120339017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f9c143ae0 0x7f4f9c141ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:37.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.255+0000 7f4fa12f3700 1 --2- 172.21.15.2:0/120339017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f9c0722c0 0x7f4f9c0cc5a0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c00c750 tx=0x7f4f8c00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:37.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.255+0000 7f4f91ffb700 1 -- 172.21.15.2:0/120339017 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c011800 con 0x7f4f9c0722c0 2023-11-26T07:17:37.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.255+0000 7f4f91ffb700 1 -- 172.21.15.2:0/120339017 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8c011960 con 0x7f4f9c0722c0 2023-11-26T07:17:37.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.255+0000 7f4fa3557700 1 -- 172.21.15.2:0/120339017 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f9c142220 con 0x7f4f9c0722c0 2023-11-26T07:17:37.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.255+0000 7f4f91ffb700 1 -- 172.21.15.2:0/120339017 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c011cd0 con 0x7f4f9c0722c0 2023-11-26T07:17:37.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.255+0000 7f4fa3557700 1 -- 172.21.15.2:0/120339017 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f9c1427e0 con 0x7f4f9c0722c0 2023-11-26T07:17:37.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.256+0000 7f4fa3557700 1 -- 172.21.15.2:0/120339017 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f9c1371f0 con 0x7f4f9c0722c0 2023-11-26T07:17:37.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.257+0000 7f4f91ffb700 1 -- 172.21.15.2:0/120339017 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f4f8c021350 con 0x7f4f9c0722c0 2023-11-26T07:17:37.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.257+0000 7f4f91ffb700 1 --2- 172.21.15.2:0/120339017 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4f8006b980 0x7f4f8006de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:37.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.257+0000 7f4f91ffb700 1 -- 172.21.15.2:0/120339017 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f4f8c087f20 con 0x7f4f9c0722c0 2023-11-26T07:17:37.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.257+0000 7f4fa0af2700 1 --2- 172.21.15.2:0/120339017 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4f8006b980 0x7f4f8006de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:37.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.258+0000 7f4fa0af2700 1 --2- 172.21.15.2:0/120339017 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4f8006b980 0x7f4f8006de40 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f4f98006fd0 tx=0x7f4f98008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:37.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.261+0000 7f4f91ffb700 1 -- 172.21.15.2:0/120339017 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4f8c054a00 con 0x7f4f9c0722c0 2023-11-26T07:17:37.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:37.511+0000 7f4fa3557700 1 -- 172.21.15.2:0/120339017 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4f9c075480 con 0x7f4f9c0722c0 2023-11-26T07:17:38.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.107+0000 7f4f91ffb700 1 -- 172.21.15.2:0/120339017 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v49) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4f8c058020 con 0x7f4f9c0722c0 2023-11-26T07:17:38.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.110+0000 7f4fa3557700 1 -- 172.21.15.2:0/120339017 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4f8006b980 msgr2=0x7f4f8006de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:38.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.110+0000 7f4fa3557700 1 --2- 172.21.15.2:0/120339017 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4f8006b980 0x7f4f8006de40 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f4f98006fd0 tx=0x7f4f98008040 comp rx=0 tx=0).stop 2023-11-26T07:17:38.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.110+0000 7f4fa3557700 1 -- 172.21.15.2:0/120339017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f9c0722c0 msgr2=0x7f4f9c0cc5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:38.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.110+0000 7f4fa3557700 1 --2- 172.21.15.2:0/120339017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f9c0722c0 0x7f4f9c0cc5a0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c00c750 tx=0x7f4f8c00cb10 comp rx=0 tx=0).stop 2023-11-26T07:17:38.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.110+0000 7f4fa3557700 1 -- 172.21.15.2:0/120339017 shutdown_connections 2023-11-26T07:17:38.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.110+0000 7f4fa3557700 1 --2- 172.21.15.2:0/120339017 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4f8006b980 0x7f4f8006de40 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:38.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.110+0000 7f4fa3557700 1 --2- 172.21.15.2:0/120339017 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f9c1440f0 0x7f4f9c0c6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:38.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.110+0000 7f4fa3557700 1 --2- 172.21.15.2:0/120339017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f9c0722c0 0x7f4f9c0cc5a0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:38.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.110+0000 7f4fa3557700 1 --2- 172.21.15.2:0/120339017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f9c143ae0 0x7f4f9c141ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:38.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.110+0000 7f4fa3557700 1 -- 172.21.15.2:0/120339017 >> 172.21.15.2:0/120339017 conn(0x7f4f9c0b2740 msgr2=0x7f4f9c071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:38.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.110+0000 7f4fa3557700 1 -- 172.21.15.2:0/120339017 shutdown_connections 2023-11-26T07:17:38.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.110+0000 7f4fa3557700 1 -- 172.21.15.2:0/120339017 wait complete. 2023-11-26T07:17:38.127 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-26T07:17:38.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.305+0000 7fb00907c700 1 Processor -- start 2023-11-26T07:17:38.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.305+0000 7fb00907c700 1 -- start start 2023-11-26T07:17:38.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.306+0000 7fb00907c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb0040722a0 0x7fb00406e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:38.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.306+0000 7fb00907c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb004072ab0 0x7fb00406e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:38.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.306+0000 7fb00907c700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb00406dbd0 con 0x7fb0041447a0 2023-11-26T07:17:38.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.306+0000 7fb00907c700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb00415b700 con 0x7fb0040722a0 2023-11-26T07:17:38.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.306+0000 7fb00907c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb00415b9e0 con 0x7fb004072ab0 2023-11-26T07:17:38.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.306+0000 7fb00259c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb0040722a0 0x7fb00406e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:38.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.306+0000 7fb00259c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb0040722a0 0x7fb00406e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45144/0 (socket says 172.21.15.2:45144) 2023-11-26T07:17:38.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.306+0000 7fb00259c700 1 -- 172.21.15.2:0/172071802 learned_addr learned my addr 172.21.15.2:0/172071802 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:38.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.306+0000 7fb00359e700 1 --2- 172.21.15.2:0/172071802 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb004072ab0 0x7fb00406e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:38.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.306+0000 7fb00259c700 1 -- 172.21.15.2:0/172071802 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb004072ab0 msgr2=0x7fb00406e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:38.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.306+0000 7fb00259c700 1 --2- 172.21.15.2:0/172071802 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb004072ab0 0x7fb00406e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:38.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.306+0000 7fb00259c700 1 -- 172.21.15.2:0/172071802 >> v1:172.21.15.192:6789/0 conn(0x7fb0041447a0 legacy=0x7fb004071b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:38.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.306+0000 7fb00259c700 1 -- 172.21.15.2:0/172071802 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb00415bcc0 con 0x7fb0040722a0 2023-11-26T07:17:38.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.307+0000 7fb00259c700 1 --2- 172.21.15.2:0/172071802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0040722a0 0x7fb00406e060 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7faff400bb90 tx=0x7faff400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b522322edb96ecb server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:38.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.307+0000 7fb001d9b700 1 -- 172.21.15.2:0/172071802 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff400dd50 con 0x7fb0040722a0 2023-11-26T07:17:38.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.307+0000 7fb001d9b700 1 -- 172.21.15.2:0/172071802 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff4010470 con 0x7fb0040722a0 2023-11-26T07:17:38.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.307+0000 7fb001d9b700 1 -- 172.21.15.2:0/172071802 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff4010800 con 0x7fb0040722a0 2023-11-26T07:17:38.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.307+0000 7fb00907c700 1 -- 172.21.15.2:0/172071802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0040722a0 msgr2=0x7fb00406e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:38.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.307+0000 7fb00907c700 1 --2- 172.21.15.2:0/172071802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0040722a0 0x7fb00406e060 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7faff400bb90 tx=0x7faff400bea0 comp rx=0 tx=0).stop 2023-11-26T07:17:38.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.307+0000 7fb00907c700 1 -- 172.21.15.2:0/172071802 shutdown_connections 2023-11-26T07:17:38.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.307+0000 7fb00907c700 1 --2- 172.21.15.2:0/172071802 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb004072ab0 0x7fb00406e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:38.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.307+0000 7fb00907c700 1 --2- 172.21.15.2:0/172071802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0040722a0 0x7fb00406e060 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:38.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.307+0000 7fb00907c700 1 -- 172.21.15.2:0/172071802 >> 172.21.15.2:0/172071802 conn(0x7fb0040b2760 msgr2=0x7fb0040b2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:38.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.307+0000 7fb00907c700 1 -- 172.21.15.2:0/172071802 shutdown_connections 2023-11-26T07:17:38.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.307+0000 7fb00907c700 1 -- 172.21.15.2:0/172071802 wait complete. 2023-11-26T07:17:38.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.309+0000 7fb00907c700 1 Processor -- start 2023-11-26T07:17:38.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.309+0000 7fb00907c700 1 -- start start 2023-11-26T07:17:38.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.310+0000 7fb00907c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0040722a0 0x7fb00414b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:38.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.310+0000 7fb00907c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb004072ab0 0x7fb004143a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:38.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.310+0000 7fb00907c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0041447a0 0x7fb00413b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:38.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.310+0000 7fb00907c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb004143f80 con 0x7fb0040722a0 2023-11-26T07:17:38.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.310+0000 7fb00907c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00415c280 con 0x7fb004072ab0 2023-11-26T07:17:38.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.310+0000 7fb00907c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb00414ba30 con 0x7fb0041447a0 2023-11-26T07:17:38.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.310+0000 7fb002d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0040722a0 0x7fb00414b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:38.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.310+0000 7fb002d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0040722a0 0x7fb00414b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45148/0 (socket says 172.21.15.2:45148) 2023-11-26T07:17:38.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.310+0000 7fb002d9d700 1 -- 172.21.15.2:0/3463597677 learned_addr learned my addr 172.21.15.2:0/3463597677 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:38.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.310+0000 7fb00359e700 1 --2- 172.21.15.2:0/3463597677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0041447a0 0x7fb00413b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:38.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.310+0000 7fb00259c700 1 --2- 172.21.15.2:0/3463597677 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb004072ab0 0x7fb004143a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:38.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.310+0000 7fb002d9d700 1 -- 172.21.15.2:0/3463597677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0041447a0 msgr2=0x7fb00413b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:38.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.310+0000 7fb002d9d700 1 --2- 172.21.15.2:0/3463597677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0041447a0 0x7fb00413b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:38.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.310+0000 7fb002d9d700 1 -- 172.21.15.2:0/3463597677 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb004072ab0 msgr2=0x7fb004143a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:38.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.310+0000 7fb002d9d700 1 --2- 172.21.15.2:0/3463597677 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb004072ab0 0x7fb004143a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:38.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.310+0000 7fb002d9d700 1 -- 172.21.15.2:0/3463597677 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff400b7f0 con 0x7fb0040722a0 2023-11-26T07:17:38.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.310+0000 7fb00359e700 1 --2- 172.21.15.2:0/3463597677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0041447a0 0x7fb00413b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:38.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.310+0000 7fb002d9d700 1 --2- 172.21.15.2:0/3463597677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0040722a0 0x7fb00414b400 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7faff800c450 tx=0x7faff800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:38.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.310+0000 7fafeb7fe700 1 -- 172.21.15.2:0/3463597677 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff80052d0 con 0x7fb0040722a0 2023-11-26T07:17:38.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.310+0000 7fafeb7fe700 1 -- 172.21.15.2:0/3463597677 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff8005430 con 0x7fb0040722a0 2023-11-26T07:17:38.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.310+0000 7fb00907c700 1 -- 172.21.15.2:0/3463597677 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb00414bd10 con 0x7fb0040722a0 2023-11-26T07:17:38.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.310+0000 7fafeb7fe700 1 -- 172.21.15.2:0/3463597677 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff80038c0 con 0x7fb0040722a0 2023-11-26T07:17:38.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.310+0000 7fb00907c700 1 -- 172.21.15.2:0/3463597677 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb00414c2d0 con 0x7fb0040722a0 2023-11-26T07:17:38.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.312+0000 7fb00907c700 1 -- 172.21.15.2:0/3463597677 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb004068670 con 0x7fb0040722a0 2023-11-26T07:17:38.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.312+0000 7fafeb7fe700 1 -- 172.21.15.2:0/3463597677 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7faff8003a20 con 0x7fb0040722a0 2023-11-26T07:17:38.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.312+0000 7fafeb7fe700 1 --2- 172.21.15.2:0/3463597677 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7faff006b980 0x7faff006de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:38.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.313+0000 7fafeb7fe700 1 -- 172.21.15.2:0/3463597677 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5853+0+0 (secure 0 0 0) 0x7faff8087560 con 0x7fb0040722a0 2023-11-26T07:17:38.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.313+0000 7fb00259c700 1 --2- 172.21.15.2:0/3463597677 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7faff006b980 0x7faff006de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:38.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.313+0000 7fb00259c700 1 --2- 172.21.15.2:0/3463597677 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7faff006b980 0x7faff006de40 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7faff400bee0 tx=0x7faff4013000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:38.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.317+0000 7fafeb7fe700 1 -- 172.21.15.2:0/3463597677 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faff80bce90 con 0x7fb0040722a0 2023-11-26T07:17:38.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:38.520+0000 7fb00907c700 1 -- 172.21.15.2:0/3463597677 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb0040726c0 con 0x7fb0040722a0 2023-11-26T07:17:38.594 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:17:38.596 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:17:39.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.328+0000 7fafeb7fe700 1 -- 172.21.15.2:0/3463597677 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v77) v1 ==== 181+0+0 (secure 0 0 0) 0x7faff80170d0 con 0x7fb0040722a0 2023-11-26T07:17:39.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.332+0000 7fb00907c700 1 -- 172.21.15.2:0/3463597677 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7faff006b980 msgr2=0x7faff006de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:39.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.332+0000 7fb00907c700 1 --2- 172.21.15.2:0/3463597677 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7faff006b980 0x7faff006de40 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7faff400bee0 tx=0x7faff4013000 comp rx=0 tx=0).stop 2023-11-26T07:17:39.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.332+0000 7fb00907c700 1 -- 172.21.15.2:0/3463597677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0040722a0 msgr2=0x7fb00414b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:39.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.332+0000 7fb00907c700 1 --2- 172.21.15.2:0/3463597677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0040722a0 0x7fb00414b400 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7faff800c450 tx=0x7faff800c760 comp rx=0 tx=0).stop 2023-11-26T07:17:39.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.332+0000 7fb00907c700 1 -- 172.21.15.2:0/3463597677 shutdown_connections 2023-11-26T07:17:39.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.332+0000 7fb00907c700 1 --2- 172.21.15.2:0/3463597677 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7faff006b980 0x7faff006de40 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.332+0000 7fb00907c700 1 --2- 172.21.15.2:0/3463597677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0041447a0 0x7fb00413b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.332+0000 7fb00907c700 1 --2- 172.21.15.2:0/3463597677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0040722a0 0x7fb00414b400 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.332+0000 7fb00907c700 1 --2- 172.21.15.2:0/3463597677 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb004072ab0 0x7fb004143a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.332+0000 7fb00907c700 1 -- 172.21.15.2:0/3463597677 >> 172.21.15.2:0/3463597677 conn(0x7fb0040b2760 msgr2=0x7fb00413fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:39.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.332+0000 7fb00907c700 1 -- 172.21.15.2:0/3463597677 shutdown_connections 2023-11-26T07:17:39.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.333+0000 7fb00907c700 1 -- 172.21.15.2:0/3463597677 wait complete. 2023-11-26T07:17:39.336 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' removed 2023-11-26T07:17:39.351 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-26T07:17:39.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.484+0000 7f5015274700 1 Processor -- start 2023-11-26T07:17:39.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.484+0000 7f5015274700 1 -- start start 2023-11-26T07:17:39.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.485+0000 7f5015274700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f501015e010 0x7f50100b4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:39.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.485+0000 7f5015274700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f501006caf0 0x7f50100ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:39.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.485+0000 7f5015274700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50100cc2a0 con 0x7f50100cea10 2023-11-26T07:17:39.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.485+0000 7f5015274700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50100cee80 con 0x7f501015e010 2023-11-26T07:17:39.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.485+0000 7f5015274700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f501006d2d0 con 0x7f501006caf0 2023-11-26T07:17:39.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.486+0000 7f500e7fc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f501006caf0 0x7f50100ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:39.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.486+0000 7f500effd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f501015e010 0x7f50100b4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:39.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.486+0000 7f500e7fc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f501006caf0 0x7f50100ce4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.2:43236/0 (socket says 172.21.15.2:43236) 2023-11-26T07:17:39.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.486+0000 7f500e7fc700 1 -- 172.21.15.2:0/1428974829 learned_addr learned my addr 172.21.15.2:0/1428974829 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:39.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.486+0000 7f500f7fe700 1 --1- 172.21.15.2:0/1428974829 >> v1:172.21.15.192:6789/0 conn(0x7f50100cea10 0x7f50100b6d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.2:43740/0 (socket says 172.21.15.2:43740) 2023-11-26T07:17:39.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.486+0000 7f500e7fc700 1 -- 172.21.15.2:0/1428974829 >> v2:172.21.15.192:3300/0 conn(0x7f501015e010 msgr2=0x7f50100b4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:39.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.486+0000 7f500e7fc700 1 --2- 172.21.15.2:0/1428974829 >> v2:172.21.15.192:3300/0 conn(0x7f501015e010 0x7f50100b4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.486+0000 7f500e7fc700 1 -- 172.21.15.2:0/1428974829 >> v1:172.21.15.192:6789/0 conn(0x7f50100cea10 legacy=0x7f50100b6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:39.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.486+0000 7f500e7fc700 1 -- 172.21.15.2:0/1428974829 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50100cc560 con 0x7f501006caf0 2023-11-26T07:17:39.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.486+0000 7f500effd700 1 --2- 172.21.15.2:0/1428974829 >> v2:172.21.15.192:3300/0 conn(0x7f501015e010 0x7f50100b4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:17:39.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.486+0000 7f500e7fc700 1 --2- 172.21.15.2:0/1428974829 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f501006caf0 0x7f50100ce4d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f50000098f0 tx=0x7f5000009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=230a0f6046c738fd server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:39.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.486+0000 7f500dffb700 1 -- 172.21.15.2:0/1428974829 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5000011830 con 0x7f501006caf0 2023-11-26T07:17:39.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.486+0000 7f500dffb700 1 -- 172.21.15.2:0/1428974829 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5000011990 con 0x7f501006caf0 2023-11-26T07:17:39.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.486+0000 7f500dffb700 1 -- 172.21.15.2:0/1428974829 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5000011d20 con 0x7f501006caf0 2023-11-26T07:17:39.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.487+0000 7f5015274700 1 -- 172.21.15.2:0/1428974829 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f501006caf0 msgr2=0x7f50100ce4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:39.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.487+0000 7f5015274700 1 --2- 172.21.15.2:0/1428974829 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f501006caf0 0x7f50100ce4d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f50000098f0 tx=0x7f5000009c00 comp rx=0 tx=0).stop 2023-11-26T07:17:39.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.487+0000 7f5015274700 1 -- 172.21.15.2:0/1428974829 shutdown_connections 2023-11-26T07:17:39.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.487+0000 7f5015274700 1 --2- 172.21.15.2:0/1428974829 >> v2:172.21.15.192:3300/0 conn(0x7f501015e010 0x7f50100b4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.487+0000 7f5015274700 1 --2- 172.21.15.2:0/1428974829 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f501006caf0 0x7f50100ce4d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.487+0000 7f5015274700 1 -- 172.21.15.2:0/1428974829 >> 172.21.15.2:0/1428974829 conn(0x7f50100b3800 msgr2=0x7f50100b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:39.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.487+0000 7f5015274700 1 -- 172.21.15.2:0/1428974829 shutdown_connections 2023-11-26T07:17:39.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.487+0000 7f5015274700 1 -- 172.21.15.2:0/1428974829 wait complete. 2023-11-26T07:17:39.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.488+0000 7f5015274700 1 Processor -- start 2023-11-26T07:17:39.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.488+0000 7f5015274700 1 -- start start 2023-11-26T07:17:39.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.489+0000 7f5015274700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f501006caf0 0x7f50100c9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:39.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.489+0000 7f5015274700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50100cea10 0x7f50101603c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:39.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.489+0000 7f5015274700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f501015e010 0x7f5010153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:39.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.489+0000 7f5015274700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5010160900 con 0x7f50100cea10 2023-11-26T07:17:39.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.489+0000 7f5015274700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50100c9e30 con 0x7f501015e010 2023-11-26T07:17:39.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.489+0000 7f5015274700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50100ca110 con 0x7f501006caf0 2023-11-26T07:17:39.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.489+0000 7f500e7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50100cea10 0x7f50101603c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:39.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.489+0000 7f500e7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50100cea10 0x7f50101603c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45164/0 (socket says 172.21.15.2:45164) 2023-11-26T07:17:39.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.489+0000 7f500e7fc700 1 -- 172.21.15.2:0/3214059333 learned_addr learned my addr 172.21.15.2:0/3214059333 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:39.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.489+0000 7f500effd700 1 --2- 172.21.15.2:0/3214059333 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f501006caf0 0x7f50100c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:39.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.490+0000 7f500f7fe700 1 --2- 172.21.15.2:0/3214059333 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f501015e010 0x7f5010153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:39.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.490+0000 7f500e7fc700 1 -- 172.21.15.2:0/3214059333 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f501006caf0 msgr2=0x7f50100c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:39.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.490+0000 7f500e7fc700 1 --2- 172.21.15.2:0/3214059333 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f501006caf0 0x7f50100c9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.490+0000 7f500e7fc700 1 -- 172.21.15.2:0/3214059333 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f501015e010 msgr2=0x7f5010153190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:39.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.490+0000 7f500e7fc700 1 --2- 172.21.15.2:0/3214059333 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f501015e010 0x7f5010153190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.490+0000 7f500e7fc700 1 -- 172.21.15.2:0/3214059333 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50040094a0 con 0x7f50100cea10 2023-11-26T07:17:39.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.490+0000 7f500e7fc700 1 --2- 172.21.15.2:0/3214059333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50100cea10 0x7f50101603c0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f5000000c00 tx=0x7f5000004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:39.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.490+0000 7f4ff77fe700 1 -- 172.21.15.2:0/3214059333 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5000004570 con 0x7f50100cea10 2023-11-26T07:17:39.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.490+0000 7f4ff77fe700 1 -- 172.21.15.2:0/3214059333 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f500001f070 con 0x7f50100cea10 2023-11-26T07:17:39.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.490+0000 7f5015274700 1 -- 172.21.15.2:0/3214059333 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5000009550 con 0x7f50100cea10 2023-11-26T07:17:39.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.490+0000 7f4ff77fe700 1 -- 172.21.15.2:0/3214059333 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50000038a0 con 0x7f50100cea10 2023-11-26T07:17:39.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.490+0000 7f5015274700 1 -- 172.21.15.2:0/3214059333 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50100ca6d0 con 0x7f50100cea10 2023-11-26T07:17:39.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.491+0000 7f5015274700 1 -- 172.21.15.2:0/3214059333 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5010068670 con 0x7f50100cea10 2023-11-26T07:17:39.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.491+0000 7f4ff77fe700 1 -- 172.21.15.2:0/3214059333 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f5000021030 con 0x7f50100cea10 2023-11-26T07:17:39.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.492+0000 7f4ff77fe700 1 --2- 172.21.15.2:0/3214059333 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4ffc06b980 0x7f4ffc06de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:39.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.492+0000 7f4ff77fe700 1 -- 172.21.15.2:0/3214059333 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5415+0+0 (secure 0 0 0) 0x7f5000089690 con 0x7f50100cea10 2023-11-26T07:17:39.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.492+0000 7f500effd700 1 --2- 172.21.15.2:0/3214059333 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4ffc06b980 0x7f4ffc06de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:39.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.493+0000 7f500effd700 1 --2- 172.21.15.2:0/3214059333 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4ffc06b980 0x7f4ffc06de40 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f5004009c60 tx=0x7f5004008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:39.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.497+0000 7f4ff77fe700 1 -- 172.21.15.2:0/3214059333 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5000056110 con 0x7f50100cea10 2023-11-26T07:17:39.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:39.698+0000 7f5015274700 1 -- 172.21.15.2:0/3214059333 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f50100d2600 con 0x7f50100cea10 2023-11-26T07:17:40.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.333+0000 7f4ff77fe700 1 -- 172.21.15.2:0/3214059333 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v78) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5000059730 con 0x7f50100cea10 2023-11-26T07:17:40.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.335+0000 7f5015274700 1 -- 172.21.15.2:0/3214059333 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4ffc06b980 msgr2=0x7f4ffc06de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.335+0000 7f5015274700 1 --2- 172.21.15.2:0/3214059333 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4ffc06b980 0x7f4ffc06de40 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f5004009c60 tx=0x7f5004008040 comp rx=0 tx=0).stop 2023-11-26T07:17:40.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.335+0000 7f5015274700 1 -- 172.21.15.2:0/3214059333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50100cea10 msgr2=0x7f50101603c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.335+0000 7f5015274700 1 --2- 172.21.15.2:0/3214059333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50100cea10 0x7f50101603c0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f5000000c00 tx=0x7f5000004750 comp rx=0 tx=0).stop 2023-11-26T07:17:40.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.335+0000 7f5015274700 1 -- 172.21.15.2:0/3214059333 shutdown_connections 2023-11-26T07:17:40.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.335+0000 7f5015274700 1 --2- 172.21.15.2:0/3214059333 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f4ffc06b980 0x7f4ffc06de40 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.335+0000 7f5015274700 1 --2- 172.21.15.2:0/3214059333 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f501015e010 0x7f5010153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.335+0000 7f5015274700 1 --2- 172.21.15.2:0/3214059333 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f501006caf0 0x7f50100c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.335+0000 7f5015274700 1 --2- 172.21.15.2:0/3214059333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50100cea10 0x7f50101603c0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.335+0000 7f5015274700 1 -- 172.21.15.2:0/3214059333 >> 172.21.15.2:0/3214059333 conn(0x7f50100b3800 msgr2=0x7f50100cf210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:40.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.335+0000 7f5015274700 1 -- 172.21.15.2:0/3214059333 shutdown_connections 2023-11-26T07:17:40.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.335+0000 7f5015274700 1 -- 172.21.15.2:0/3214059333 wait complete. 2023-11-26T07:17:40.339 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' removed 2023-11-26T07:17:40.354 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/volumes/snapshot_clone_delay 2023-11-26T07:17:40.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.485+0000 7f0bfa22c700 1 Processor -- start 2023-11-26T07:17:40.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.485+0000 7f0bfa22c700 1 -- start start 2023-11-26T07:17:40.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.486+0000 7f0bfa22c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0bf415bde0 0x7f0bf415c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:40.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.486+0000 7f0bfa22c700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bf40d0a90 con 0x7f0bf40cf2b0 2023-11-26T07:17:40.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.486+0000 7f0bfa22c700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bf406ee10 con 0x7f0bf40ce5c0 2023-11-26T07:17:40.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.486+0000 7f0bfa22c700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bf406f0f0 con 0x7f0bf415bde0 2023-11-26T07:17:40.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.486+0000 7f0bf37fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0bf415bde0 0x7f0bf415c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:40.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.486+0000 7f0bf2ffd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f0bf40cf2b0 0x7f0bf40d01b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36380/0 (socket says 172.21.15.2:36380) 2023-11-26T07:17:40.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.486+0000 7f0bf2ffd700 1 -- 172.21.15.2:0/3636589338 learned_addr learned my addr 172.21.15.2:0/3636589338 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:40.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.487+0000 7f0bf37fe700 1 -- 172.21.15.2:0/3636589338 >> v1:172.21.15.192:6789/0 conn(0x7f0bf40ce5c0 legacy=0x7f0bf406fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:40.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.487+0000 7f0bf37fe700 1 -- 172.21.15.2:0/3636589338 >> v1:172.21.15.2:6789/0 conn(0x7f0bf40cf2b0 legacy=0x7f0bf40d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.487+0000 7f0bf27fc700 1 -- 172.21.15.2:0/3636589338 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3865253656 0 0) 0x7f0bf40d0a90 con 0x7f0bf40cf2b0 2023-11-26T07:17:40.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.487+0000 7f0bf37fe700 1 -- 172.21.15.2:0/3636589338 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf406f3d0 con 0x7f0bf415bde0 2023-11-26T07:17:40.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.487+0000 7f0bf37fe700 1 --2- 172.21.15.2:0/3636589338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bf415bde0 0x7f0bf415c1c0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f0be4009840 tx=0x7f0be4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf98159fd50a85ae server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:40.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.487+0000 7f0bf27fc700 1 -- 172.21.15.2:0/3636589338 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be4004230 con 0x7f0bf415bde0 2023-11-26T07:17:40.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.487+0000 7f0bf27fc700 1 -- 172.21.15.2:0/3636589338 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be4004390 con 0x7f0bf415bde0 2023-11-26T07:17:40.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.487+0000 7f0bf27fc700 1 -- 172.21.15.2:0/3636589338 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be40036a0 con 0x7f0bf415bde0 2023-11-26T07:17:40.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.487+0000 7f0bfa22c700 1 -- 172.21.15.2:0/3636589338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bf415bde0 msgr2=0x7f0bf415c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.487+0000 7f0bfa22c700 1 --2- 172.21.15.2:0/3636589338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bf415bde0 0x7f0bf415c1c0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f0be4009840 tx=0x7f0be4009b50 comp rx=0 tx=0).stop 2023-11-26T07:17:40.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.488+0000 7f0bfa22c700 1 -- 172.21.15.2:0/3636589338 shutdown_connections 2023-11-26T07:17:40.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.488+0000 7f0bfa22c700 1 --2- 172.21.15.2:0/3636589338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bf415bde0 0x7f0bf415c1c0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.488+0000 7f0bfa22c700 1 -- 172.21.15.2:0/3636589338 >> 172.21.15.2:0/3636589338 conn(0x7f0bf40b3720 msgr2=0x7f0bf40b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:40.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.488+0000 7f0bfa22c700 1 -- 172.21.15.2:0/3636589338 shutdown_connections 2023-11-26T07:17:40.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.488+0000 7f0bfa22c700 1 -- 172.21.15.2:0/3636589338 wait complete. 2023-11-26T07:17:40.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.489+0000 7f0bfa22c700 1 Processor -- start 2023-11-26T07:17:40.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.489+0000 7f0bfa22c700 1 -- start start 2023-11-26T07:17:40.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.490+0000 7f0bfa22c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bf40ce5c0 0x7f0bf40b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:40.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.490+0000 7f0bfa22c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bf40cf2b0 0x7f0bf4159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:40.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.490+0000 7f0bfa22c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0bf415bde0 0x7f0bf4158c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:40.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.490+0000 7f0bfa22c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf40b5d50 con 0x7f0bf40ce5c0 2023-11-26T07:17:40.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.490+0000 7f0bfa22c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf40cbf40 con 0x7f0bf40cf2b0 2023-11-26T07:17:40.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.490+0000 7f0bfa22c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf40b5ff0 con 0x7f0bf415bde0 2023-11-26T07:17:40.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.490+0000 7f0bf37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bf40ce5c0 0x7f0bf40b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:40.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.490+0000 7f0bf37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bf40ce5c0 0x7f0bf40b7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45176/0 (socket says 172.21.15.2:45176) 2023-11-26T07:17:40.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.490+0000 7f0bf37fe700 1 -- 172.21.15.2:0/2499019478 learned_addr learned my addr 172.21.15.2:0/2499019478 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:40.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.490+0000 7f0bf2ffd700 1 --2- 172.21.15.2:0/2499019478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bf40cf2b0 0x7f0bf4159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:40.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.490+0000 7f0bf3fff700 1 --2- 172.21.15.2:0/2499019478 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0bf415bde0 0x7f0bf4158c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:40.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.490+0000 7f0bf37fe700 1 -- 172.21.15.2:0/2499019478 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0bf415bde0 msgr2=0x7f0bf4158c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.490+0000 7f0bf37fe700 1 --2- 172.21.15.2:0/2499019478 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0bf415bde0 0x7f0bf4158c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.490+0000 7f0bf37fe700 1 -- 172.21.15.2:0/2499019478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bf40cf2b0 msgr2=0x7f0bf4159540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.490+0000 7f0bf37fe700 1 --2- 172.21.15.2:0/2499019478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bf40cf2b0 0x7f0bf4159540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.490+0000 7f0bf37fe700 1 -- 172.21.15.2:0/2499019478 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be40094a0 con 0x7f0bf40ce5c0 2023-11-26T07:17:40.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.490+0000 7f0bf2ffd700 1 --2- 172.21.15.2:0/2499019478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bf40cf2b0 0x7f0bf4159540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:40.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.490+0000 7f0bf3fff700 1 --2- 172.21.15.2:0/2499019478 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0bf415bde0 0x7f0bf4158c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:40.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.490+0000 7f0bf37fe700 1 --2- 172.21.15.2:0/2499019478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bf40ce5c0 0x7f0bf40b7090 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f0be40090b0 tx=0x7f0be40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:40.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.491+0000 7f0bdbfff700 1 -- 172.21.15.2:0/2499019478 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be4011830 con 0x7f0bf40ce5c0 2023-11-26T07:17:40.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.491+0000 7f0bdbfff700 1 -- 172.21.15.2:0/2499019478 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be4011990 con 0x7f0bf40ce5c0 2023-11-26T07:17:40.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.491+0000 7f0bfa22c700 1 -- 172.21.15.2:0/2499019478 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bf40b62d0 con 0x7f0bf40ce5c0 2023-11-26T07:17:40.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.491+0000 7f0bdbfff700 1 -- 172.21.15.2:0/2499019478 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be4011d40 con 0x7f0bf40ce5c0 2023-11-26T07:17:40.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.491+0000 7f0bfa22c700 1 -- 172.21.15.2:0/2499019478 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bf40b6890 con 0x7f0bf40ce5c0 2023-11-26T07:17:40.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.492+0000 7f0bfa22c700 1 -- 172.21.15.2:0/2499019478 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bf4075480 con 0x7f0bf40ce5c0 2023-11-26T07:17:40.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.492+0000 7f0bdbfff700 1 -- 172.21.15.2:0/2499019478 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f0be401b440 con 0x7f0bf40ce5c0 2023-11-26T07:17:40.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.492+0000 7f0bdbfff700 1 --2- 172.21.15.2:0/2499019478 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0be006b980 0x7f0be006de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:40.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.492+0000 7f0bdbfff700 1 -- 172.21.15.2:0/2499019478 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0be4089bb0 con 0x7f0bf40ce5c0 2023-11-26T07:17:40.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.493+0000 7f0bf2ffd700 1 --2- 172.21.15.2:0/2499019478 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0be006b980 0x7f0be006de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:40.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.493+0000 7f0bf2ffd700 1 --2- 172.21.15.2:0/2499019478 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0be006b980 0x7f0be006de40 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f0bf40b3460 tx=0x7f0be8007ca0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:40.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.497+0000 7f0bdbfff700 1 -- 172.21.15.2:0/2499019478 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0be4056560 con 0x7f0bf40ce5c0 2023-11-26T07:17:40.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.726+0000 7f0bfa22c700 1 -- 172.21.15.2:0/2499019478 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_delay"} v 0) v1 -- 0x7f0bf40ce180 con 0x7f0bf40ce5c0 2023-11-26T07:17:40.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.729+0000 7f0bdbfff700 1 -- 172.21.15.2:0/2499019478 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_delay"}]=0 v24) v1 ==== 115+0+0 (secure 0 0 0) 0x7f0be4059b80 con 0x7f0bf40ce5c0 2023-11-26T07:17:40.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.732+0000 7f0bfa22c700 1 -- 172.21.15.2:0/2499019478 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0be006b980 msgr2=0x7f0be006de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.732+0000 7f0bfa22c700 1 --2- 172.21.15.2:0/2499019478 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0be006b980 0x7f0be006de40 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f0bf40b3460 tx=0x7f0be8007ca0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.732+0000 7f0bfa22c700 1 -- 172.21.15.2:0/2499019478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bf40ce5c0 msgr2=0x7f0bf40b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.732+0000 7f0bfa22c700 1 --2- 172.21.15.2:0/2499019478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bf40ce5c0 0x7f0bf40b7090 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f0be40090b0 tx=0x7f0be40047c0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.732+0000 7f0bfa22c700 1 -- 172.21.15.2:0/2499019478 shutdown_connections 2023-11-26T07:17:40.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.732+0000 7f0bfa22c700 1 --2- 172.21.15.2:0/2499019478 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0be006b980 0x7f0be006de40 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.732+0000 7f0bfa22c700 1 --2- 172.21.15.2:0/2499019478 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0bf415bde0 0x7f0bf4158c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.732+0000 7f0bfa22c700 1 --2- 172.21.15.2:0/2499019478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bf40ce5c0 0x7f0bf40b7090 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.732+0000 7f0bfa22c700 1 --2- 172.21.15.2:0/2499019478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bf40cf2b0 0x7f0bf4159540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.732+0000 7f0bfa22c700 1 -- 172.21.15.2:0/2499019478 >> 172.21.15.2:0/2499019478 conn(0x7f0bf40b3720 msgr2=0x7f0bf415a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:40.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.732+0000 7f0bfa22c700 1 -- 172.21.15.2:0/2499019478 shutdown_connections 2023-11-26T07:17:40.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.732+0000 7f0bfa22c700 1 -- 172.21.15.2:0/2499019478 wait complete. 2023-11-26T07:17:40.746 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-26T07:17:40.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.871+0000 7f79a984f700 1 Processor -- start 2023-11-26T07:17:40.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.871+0000 7f79a984f700 1 -- start start 2023-11-26T07:17:40.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.871+0000 7f79a984f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f79a40d0870 0x7f79a40d26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:40.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.871+0000 7f79a984f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f79a40d49f0 0x7f79a40b6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:40.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.871+0000 7f79a984f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a40b5370 con 0x7f79a40d0c50 2023-11-26T07:17:40.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.871+0000 7f79a984f700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a40d2f80 con 0x7f79a40d49f0 2023-11-26T07:17:40.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.871+0000 7f79a984f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a40cff70 con 0x7f79a40d0870 2023-11-26T07:17:40.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.872+0000 7f79a37fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f79a40d49f0 0x7f79a40b6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:40.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.872+0000 7f79a37fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f79a40d49f0 0x7f79a40b6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45188/0 (socket says 172.21.15.2:45188) 2023-11-26T07:17:40.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.872+0000 7f79a37fe700 1 -- 172.21.15.2:0/3761264830 learned_addr learned my addr 172.21.15.2:0/3761264830 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:40.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.872+0000 7f79a2ffd700 1 --2- 172.21.15.2:0/3761264830 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f79a40d0870 0x7f79a40d26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:40.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.872+0000 7f79a37fe700 1 -- 172.21.15.2:0/3761264830 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f79a40d0870 msgr2=0x7f79a40d26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:40.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.872+0000 7f79a37fe700 1 --2- 172.21.15.2:0/3761264830 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f79a40d0870 0x7f79a40d26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.872+0000 7f79a37fe700 1 -- 172.21.15.2:0/3761264830 >> v1:172.21.15.192:6789/0 conn(0x7f79a40d0c50 legacy=0x7f79a40cf860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.872+0000 7f79a37fe700 1 -- 172.21.15.2:0/3761264830 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a40ceae0 con 0x7f79a40d49f0 2023-11-26T07:17:40.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.872+0000 7f79a2ffd700 1 --2- 172.21.15.2:0/3761264830 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f79a40d0870 0x7f79a40d26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:40.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.872+0000 7f79a37fe700 1 --2- 172.21.15.2:0/3761264830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79a40d49f0 0x7f79a40b6d20 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f799c009e50 tx=0x7f799c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d45542b701dfd58 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:40.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.872+0000 7f79a1ffb700 1 -- 172.21.15.2:0/3761264830 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c00e070 con 0x7f79a40d49f0 2023-11-26T07:17:40.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.872+0000 7f79a1ffb700 1 -- 172.21.15.2:0/3761264830 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799c00b9c0 con 0x7f79a40d49f0 2023-11-26T07:17:40.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.872+0000 7f79a1ffb700 1 -- 172.21.15.2:0/3761264830 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c00bd70 con 0x7f79a40d49f0 2023-11-26T07:17:40.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.873+0000 7f79a984f700 1 -- 172.21.15.2:0/3761264830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79a40d49f0 msgr2=0x7f79a40b6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.873+0000 7f79a984f700 1 --2- 172.21.15.2:0/3761264830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79a40d49f0 0x7f79a40b6d20 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f799c009e50 tx=0x7f799c00b330 comp rx=0 tx=0).stop 2023-11-26T07:17:40.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.873+0000 7f79a984f700 1 -- 172.21.15.2:0/3761264830 shutdown_connections 2023-11-26T07:17:40.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.873+0000 7f79a984f700 1 --2- 172.21.15.2:0/3761264830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79a40d49f0 0x7f79a40b6d20 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.873+0000 7f79a984f700 1 --2- 172.21.15.2:0/3761264830 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f79a40d0870 0x7f79a40d26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.873+0000 7f79a984f700 1 -- 172.21.15.2:0/3761264830 >> 172.21.15.2:0/3761264830 conn(0x7f79a40d3ed0 msgr2=0x7f79a40d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:40.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.873+0000 7f79a984f700 1 -- 172.21.15.2:0/3761264830 shutdown_connections 2023-11-26T07:17:40.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.873+0000 7f79a984f700 1 -- 172.21.15.2:0/3761264830 wait complete. 2023-11-26T07:17:40.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.874+0000 7f79a984f700 1 Processor -- start 2023-11-26T07:17:40.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.874+0000 7f79a984f700 1 -- start start 2023-11-26T07:17:40.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.875+0000 7f79a984f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79a40d0870 0x7f79a40b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:40.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.875+0000 7f79a984f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79a40d0c50 0x7f79a40b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:40.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.875+0000 7f79a984f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f79a40d49f0 0x7f79a40b0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:40.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.875+0000 7f79a984f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a40b49d0 con 0x7f79a40d0c50 2023-11-26T07:17:40.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.875+0000 7f79a984f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a40b4490 con 0x7f79a40d0870 2023-11-26T07:17:40.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.875+0000 7f79a984f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a40b46f0 con 0x7f79a40d49f0 2023-11-26T07:17:40.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.875+0000 7f79a27fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79a40d0c50 0x7f79a40b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:40.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.875+0000 7f79a27fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79a40d0c50 0x7f79a40b2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45192/0 (socket says 172.21.15.2:45192) 2023-11-26T07:17:40.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.875+0000 7f79a27fc700 1 -- 172.21.15.2:0/1381501407 learned_addr learned my addr 172.21.15.2:0/1381501407 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:40.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.875+0000 7f79a37fe700 1 --2- 172.21.15.2:0/1381501407 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f79a40d49f0 0x7f79a40b0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:40.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.875+0000 7f79a2ffd700 1 --2- 172.21.15.2:0/1381501407 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79a40d0870 0x7f79a40b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:40.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.875+0000 7f79a27fc700 1 -- 172.21.15.2:0/1381501407 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f79a40d49f0 msgr2=0x7f79a40b0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.875+0000 7f79a27fc700 1 --2- 172.21.15.2:0/1381501407 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f79a40d49f0 0x7f79a40b0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.875+0000 7f79a27fc700 1 -- 172.21.15.2:0/1381501407 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79a40d0870 msgr2=0x7f79a40b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.875+0000 7f79a27fc700 1 --2- 172.21.15.2:0/1381501407 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79a40d0870 0x7f79a40b3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.875+0000 7f79a27fc700 1 -- 172.21.15.2:0/1381501407 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799c009b30 con 0x7f79a40d0c50 2023-11-26T07:17:40.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.875+0000 7f79a37fe700 1 --2- 172.21.15.2:0/1381501407 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f79a40d49f0 0x7f79a40b0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:40.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.875+0000 7f79a2ffd700 1 --2- 172.21.15.2:0/1381501407 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79a40d0870 0x7f79a40b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:40.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.876+0000 7f79a27fc700 1 --2- 172.21.15.2:0/1381501407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79a40d0c50 0x7f79a40b2f20 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f799800c4e0 tx=0x7f799800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:40.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.876+0000 7f798bfff700 1 -- 172.21.15.2:0/1381501407 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79980052d0 con 0x7f79a40d0c50 2023-11-26T07:17:40.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.876+0000 7f798bfff700 1 -- 172.21.15.2:0/1381501407 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7998005430 con 0x7f79a40d0c50 2023-11-26T07:17:40.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.876+0000 7f79a984f700 1 -- 172.21.15.2:0/1381501407 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79a40b2440 con 0x7f79a40d0c50 2023-11-26T07:17:40.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.876+0000 7f798bfff700 1 -- 172.21.15.2:0/1381501407 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79980038c0 con 0x7f79a40d0c50 2023-11-26T07:17:40.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.876+0000 7f79a984f700 1 -- 172.21.15.2:0/1381501407 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79a40b2a00 con 0x7f79a40d0c50 2023-11-26T07:17:40.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.877+0000 7f79a984f700 1 -- 172.21.15.2:0/1381501407 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79a40b57c0 con 0x7f79a40d0c50 2023-11-26T07:17:40.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.877+0000 7f798bfff700 1 -- 172.21.15.2:0/1381501407 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f7998003a20 con 0x7f79a40d0c50 2023-11-26T07:17:40.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.878+0000 7f798bfff700 1 --2- 172.21.15.2:0/1381501407 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f799006b980 0x7f799006de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:40.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.878+0000 7f798bfff700 1 -- 172.21.15.2:0/1381501407 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7998087600 con 0x7f79a40d0c50 2023-11-26T07:17:40.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.878+0000 7f79a2ffd700 1 --2- 172.21.15.2:0/1381501407 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f799006b980 0x7f799006de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:40.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.878+0000 7f79a2ffd700 1 --2- 172.21.15.2:0/1381501407 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f799006b980 0x7f799006de40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f7994009a00 tx=0x7f7994008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:40.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:40.882+0000 7f798bfff700 1 -- 172.21.15.2:0/1381501407 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7998053f30 con 0x7f79a40d0c50 2023-11-26T07:17:41.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.084+0000 7f79a984f700 1 -- 172.21.15.2:0/1381501407 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f79a4067a20 con 0x7f79a40d0c50 2023-11-26T07:17:41.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.088+0000 7f798bfff700 1 -- 172.21.15.2:0/1381501407 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7998057550 con 0x7f79a40d0c50 2023-11-26T07:17:41.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.090+0000 7f79a984f700 1 -- 172.21.15.2:0/1381501407 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f799006b980 msgr2=0x7f799006de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.090+0000 7f79a984f700 1 --2- 172.21.15.2:0/1381501407 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f799006b980 0x7f799006de40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f7994009a00 tx=0x7f7994008040 comp rx=0 tx=0).stop 2023-11-26T07:17:41.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.090+0000 7f79a984f700 1 -- 172.21.15.2:0/1381501407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79a40d0c50 msgr2=0x7f79a40b2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.090+0000 7f79a984f700 1 --2- 172.21.15.2:0/1381501407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79a40d0c50 0x7f79a40b2f20 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f799800c4e0 tx=0x7f799800c8a0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.090+0000 7f79a984f700 1 -- 172.21.15.2:0/1381501407 shutdown_connections 2023-11-26T07:17:41.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.090+0000 7f79a984f700 1 --2- 172.21.15.2:0/1381501407 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f799006b980 0x7f799006de40 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.090+0000 7f79a984f700 1 --2- 172.21.15.2:0/1381501407 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f79a40d49f0 0x7f79a40b0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.090+0000 7f79a984f700 1 --2- 172.21.15.2:0/1381501407 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79a40d0870 0x7f79a40b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.090+0000 7f79a984f700 1 --2- 172.21.15.2:0/1381501407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79a40d0c50 0x7f79a40b2f20 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.090+0000 7f79a984f700 1 -- 172.21.15.2:0/1381501407 >> 172.21.15.2:0/1381501407 conn(0x7f79a40d3ed0 msgr2=0x7f79a40cf760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:41.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.090+0000 7f79a984f700 1 -- 172.21.15.2:0/1381501407 shutdown_connections 2023-11-26T07:17:41.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.090+0000 7f79a984f700 1 -- 172.21.15.2:0/1381501407 wait complete. 2023-11-26T07:17:41.104 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_in_progress_complete' 2023-11-26T07:17:41.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.227+0000 7f570f041700 1 Processor -- start 2023-11-26T07:17:41.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.227+0000 7f570f041700 1 -- start start 2023-11-26T07:17:41.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.228+0000 7f570f041700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5708143ae0 0x7f57080b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.228+0000 7f570f041700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5708143ec0 con 0x7f57080722c0 2023-11-26T07:17:41.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.228+0000 7f570f041700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57080b3ae0 con 0x7f57081440f0 2023-11-26T07:17:41.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.228+0000 7f570f041700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57080b40a0 con 0x7f5708143ae0 2023-11-26T07:17:41.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.228+0000 7f570cddd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5708143ae0 0x7f57080b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.228+0000 7f570d5de700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f57080722c0 0x7f570806e510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36410/0 (socket says 172.21.15.2:36410) 2023-11-26T07:17:41.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.228+0000 7f570d5de700 1 -- 172.21.15.2:0/2827866609 learned_addr learned my addr 172.21.15.2:0/2827866609 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:41.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.229+0000 7f570cddd700 1 -- 172.21.15.2:0/2827866609 >> v1:172.21.15.192:6789/0 conn(0x7f57081440f0 legacy=0x7f5708071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:41.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.229+0000 7f570cddd700 1 -- 172.21.15.2:0/2827866609 >> v1:172.21.15.2:6789/0 conn(0x7f57080722c0 legacy=0x7f570806e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.229+0000 7f570cddd700 1 -- 172.21.15.2:0/2827866609 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57080b3dc0 con 0x7f5708143ae0 2023-11-26T07:17:41.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.229+0000 7f57077fe700 1 -- 172.21.15.2:0/2827866609 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4088516551 0 0) 0x7f5708143ec0 con 0x7f57080722c0 2023-11-26T07:17:41.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.229+0000 7f570cddd700 1 --2- 172.21.15.2:0/2827866609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5708143ae0 0x7f57080b51b0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f56fc009840 tx=0x7f56fc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aa50e3549fceff4 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:41.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.229+0000 7f57077fe700 1 -- 172.21.15.2:0/2827866609 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56fc004230 con 0x7f5708143ae0 2023-11-26T07:17:41.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.229+0000 7f57077fe700 1 -- 172.21.15.2:0/2827866609 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56fc004390 con 0x7f5708143ae0 2023-11-26T07:17:41.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.229+0000 7f57077fe700 1 -- 172.21.15.2:0/2827866609 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56fc0036a0 con 0x7f5708143ae0 2023-11-26T07:17:41.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.230+0000 7f570f041700 1 -- 172.21.15.2:0/2827866609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5708143ae0 msgr2=0x7f57080b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.230+0000 7f570f041700 1 --2- 172.21.15.2:0/2827866609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5708143ae0 0x7f57080b51b0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f56fc009840 tx=0x7f56fc009b50 comp rx=0 tx=0).stop 2023-11-26T07:17:41.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.230+0000 7f570f041700 1 -- 172.21.15.2:0/2827866609 shutdown_connections 2023-11-26T07:17:41.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.230+0000 7f570f041700 1 --2- 172.21.15.2:0/2827866609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5708143ae0 0x7f57080b51b0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.230+0000 7f570f041700 1 -- 172.21.15.2:0/2827866609 >> 172.21.15.2:0/2827866609 conn(0x7f57080b2740 msgr2=0x7f57080b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:41.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.230+0000 7f570f041700 1 -- 172.21.15.2:0/2827866609 shutdown_connections 2023-11-26T07:17:41.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.230+0000 7f570f041700 1 -- 172.21.15.2:0/2827866609 wait complete. 2023-11-26T07:17:41.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.231+0000 7f570f041700 1 Processor -- start 2023-11-26T07:17:41.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.231+0000 7f570f041700 1 -- start start 2023-11-26T07:17:41.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.232+0000 7f570f041700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57080722c0 0x7f5708142b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.232+0000 7f570f041700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5708143ae0 0x7f570813bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.232+0000 7f570f041700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57081440f0 0x7f570813d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.232+0000 7f570f041700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f570813d2b0 con 0x7f57081440f0 2023-11-26T07:17:41.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.232+0000 7f570f041700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f570813c6a0 con 0x7f5708143ae0 2023-11-26T07:17:41.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.232+0000 7f570f041700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f570813c980 con 0x7f57080722c0 2023-11-26T07:17:41.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.232+0000 7f570d5de700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57081440f0 0x7f570813d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.232+0000 7f570d5de700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57081440f0 0x7f570813d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45206/0 (socket says 172.21.15.2:45206) 2023-11-26T07:17:41.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.232+0000 7f570d5de700 1 -- 172.21.15.2:0/4190181010 learned_addr learned my addr 172.21.15.2:0/4190181010 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:41.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.232+0000 7f570cddd700 1 --2- 172.21.15.2:0/4190181010 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57080722c0 0x7f5708142b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.232+0000 7f5707fff700 1 --2- 172.21.15.2:0/4190181010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5708143ae0 0x7f570813bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.232+0000 7f570d5de700 1 -- 172.21.15.2:0/4190181010 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57080722c0 msgr2=0x7f5708142b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.232+0000 7f570d5de700 1 --2- 172.21.15.2:0/4190181010 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57080722c0 0x7f5708142b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.232+0000 7f570d5de700 1 -- 172.21.15.2:0/4190181010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5708143ae0 msgr2=0x7f570813bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.232+0000 7f570d5de700 1 --2- 172.21.15.2:0/4190181010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5708143ae0 0x7f570813bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.232+0000 7f570d5de700 1 -- 172.21.15.2:0/4190181010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56fc0094a0 con 0x7f57081440f0 2023-11-26T07:17:41.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.232+0000 7f570cddd700 1 --2- 172.21.15.2:0/4190181010 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57080722c0 0x7f5708142b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:41.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.233+0000 7f570d5de700 1 --2- 172.21.15.2:0/4190181010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57081440f0 0x7f570813d740 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f570000cba0 tx=0x7f570000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:41.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.233+0000 7f57057fa700 1 -- 172.21.15.2:0/4190181010 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570000ab80 con 0x7f57081440f0 2023-11-26T07:17:41.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.233+0000 7f57057fa700 1 -- 172.21.15.2:0/4190181010 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f570000ace0 con 0x7f57081440f0 2023-11-26T07:17:41.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.233+0000 7f570f041700 1 -- 172.21.15.2:0/4190181010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f570813cc60 con 0x7f57081440f0 2023-11-26T07:17:41.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.233+0000 7f57057fa700 1 -- 172.21.15.2:0/4190181010 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5700007310 con 0x7f57081440f0 2023-11-26T07:17:41.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.233+0000 7f570f041700 1 -- 172.21.15.2:0/4190181010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57081430d0 con 0x7f57081440f0 2023-11-26T07:17:41.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.234+0000 7f570f041700 1 -- 172.21.15.2:0/4190181010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5708144620 con 0x7f57081440f0 2023-11-26T07:17:41.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.234+0000 7f57057fa700 1 -- 172.21.15.2:0/4190181010 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f5700007470 con 0x7f57081440f0 2023-11-26T07:17:41.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.235+0000 7f57057fa700 1 --2- 172.21.15.2:0/4190181010 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f56ec06b980 0x7f56ec06de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.235+0000 7f57057fa700 1 -- 172.21.15.2:0/4190181010 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f570008a370 con 0x7f57081440f0 2023-11-26T07:17:41.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.235+0000 7f570cddd700 1 --2- 172.21.15.2:0/4190181010 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f56ec06b980 0x7f56ec06de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.235+0000 7f570cddd700 1 --2- 172.21.15.2:0/4190181010 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f56ec06b980 0x7f56ec06de40 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f56fc000c00 tx=0x7f56fc008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:41.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.239+0000 7f57057fa700 1 -- 172.21.15.2:0/4190181010 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5700054870 con 0x7f57081440f0 2023-11-26T07:17:41.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:41.521+0000 7f570f041700 1 -- 172.21.15.2:0/4190181010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_in_progress_complete"]} v 0) v1 -- 0x7f57081432c0 con 0x7f57081440f0 2023-11-26T07:17:42.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:42.339+0000 7f57057fa700 1 -- 172.21.15.2:0/4190181010 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_in_progress_complete"]}]=0 v310) v1 ==== 187+0+0 (secure 0 0 0) 0x7f5700018100 con 0x7f57081440f0 2023-11-26T07:17:42.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:42.343+0000 7f570f041700 1 -- 172.21.15.2:0/4190181010 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f56ec06b980 msgr2=0x7f56ec06de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:42.343+0000 7f570f041700 1 --2- 172.21.15.2:0/4190181010 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f56ec06b980 0x7f56ec06de40 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f56fc000c00 tx=0x7f56fc008030 comp rx=0 tx=0).stop 2023-11-26T07:17:42.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:42.343+0000 7f570f041700 1 -- 172.21.15.2:0/4190181010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57081440f0 msgr2=0x7f570813d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:42.343+0000 7f570f041700 1 --2- 172.21.15.2:0/4190181010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57081440f0 0x7f570813d740 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f570000cba0 tx=0x7f570000cf60 comp rx=0 tx=0).stop 2023-11-26T07:17:42.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:42.343+0000 7f570f041700 1 -- 172.21.15.2:0/4190181010 shutdown_connections 2023-11-26T07:17:42.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:42.343+0000 7f570f041700 1 --2- 172.21.15.2:0/4190181010 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f56ec06b980 0x7f56ec06de40 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:42.343+0000 7f570f041700 1 --2- 172.21.15.2:0/4190181010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57081440f0 0x7f570813d740 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:42.343+0000 7f570f041700 1 --2- 172.21.15.2:0/4190181010 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57080722c0 0x7f5708142b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:42.343+0000 7f570f041700 1 --2- 172.21.15.2:0/4190181010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5708143ae0 0x7f570813bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:42.343+0000 7f570f041700 1 -- 172.21.15.2:0/4190181010 >> 172.21.15.2:0/4190181010 conn(0x7f57080b2740 msgr2=0x7f570806e410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:42.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:42.343+0000 7f570f041700 1 -- 172.21.15.2:0/4190181010 shutdown_connections 2023-11-26T07:17:42.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:42.343+0000 7f570f041700 1 -- 172.21.15.2:0/4190181010 wait complete. 2023-11-26T07:17:42.364 INFO:tasks.cephfs_test_runner:ensure failure status is not shown when clone is not in failed/cancelled state ... ERROR 2023-11-26T07:17:42.365 INFO:tasks.cephfs_test_runner: 2023-11-26T07:17:42.365 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-26T07:17:42.365 INFO:tasks.cephfs_test_runner:ERROR: test_clone_failure_status_pending_in_progress_complete (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2023-11-26T07:17:42.365 INFO:tasks.cephfs_test_runner:ensure failure status is not shown when clone is not in failed/cancelled state 2023-11-26T07:17:42.365 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-26T07:17:42.365 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-26T07:17:42.365 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa/tasks/cephfs/test_volumes.py", line 6589, in test_clone_failure_status_pending_in_progress_complete 2023-11-26T07:17:42.366 INFO:tasks.cephfs_test_runner: self._fs_cmd("subvolume", "snapshot", "rm", self.volname, subvolume, snapshot) 2023-11-26T07:17:42.366 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa/tasks/cephfs/test_volumes.py", line 33, in _fs_cmd 2023-11-26T07:17:42.366 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2023-11-26T07:17:42.366 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2023-11-26T07:17:42.366 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2023-11-26T07:17:42.366 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2023-11-26T07:17:42.366 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2023-11-26T07:17:42.366 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd 2023-11-26T07:17:42.366 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-11-26T07:17:42.366 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/remote.py", line 522, in run 2023-11-26T07:17:42.366 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-11-26T07:17:42.366 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 455, in run 2023-11-26T07:17:42.367 INFO:tasks.cephfs_test_runner: r.wait() 2023-11-26T07:17:42.367 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 161, in wait 2023-11-26T07:17:42.367 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-26T07:17:42.367 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-26T07:17:42.367 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-26T07:17:42.367 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi002 with status 11: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvol83060 subvol_snap31270' 2023-11-26T07:17:42.367 INFO:tasks.cephfs_test_runner: 2023-11-26T07:17:42.367 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-26T07:17:42.367 INFO:tasks.cephfs_test_runner:Ran 4 tests in 338.325s 2023-11-26T07:17:42.367 INFO:tasks.cephfs_test_runner: 2023-11-26T07:17:42.367 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-11-26T07:17:42.367 INFO:tasks.cephfs_test_runner: 2023-11-26T07:17:42.368 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-26T07:17:42.368 INFO:tasks.cephfs_test_runner:ERROR: test_clone_failure_status_pending_in_progress_complete (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2023-11-26T07:17:42.368 INFO:tasks.cephfs_test_runner:ensure failure status is not shown when clone is not in failed/cancelled state 2023-11-26T07:17:42.368 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-26T07:17:42.368 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-26T07:17:42.368 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa/tasks/cephfs/test_volumes.py", line 6589, in test_clone_failure_status_pending_in_progress_complete 2023-11-26T07:17:42.368 INFO:tasks.cephfs_test_runner: self._fs_cmd("subvolume", "snapshot", "rm", self.volname, subvolume, snapshot) 2023-11-26T07:17:42.368 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa/tasks/cephfs/test_volumes.py", line 33, in _fs_cmd 2023-11-26T07:17:42.368 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2023-11-26T07:17:42.368 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2023-11-26T07:17:42.368 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2023-11-26T07:17:42.368 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2023-11-26T07:17:42.368 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2023-11-26T07:17:42.368 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd 2023-11-26T07:17:42.368 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-11-26T07:17:42.368 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/remote.py", line 522, in run 2023-11-26T07:17:42.369 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-11-26T07:17:42.369 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 455, in run 2023-11-26T07:17:42.369 INFO:tasks.cephfs_test_runner: r.wait() 2023-11-26T07:17:42.369 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 161, in wait 2023-11-26T07:17:42.369 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-26T07:17:42.369 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-26T07:17:42.369 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-26T07:17:42.369 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi002 with status 11: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvol83060 subvol_snap31270' 2023-11-26T07:17:42.369 INFO:tasks.cephfs_test_runner: 2023-11-26T07:17:42.369 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_clone_failure_status_pending_in_progress_complete (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2023-11-26T07:17:43.739 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=6ab0bd228ed6448e850f06f0a18b6cf5 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_clone_failure_status_pending_in_progress_complete (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2023-11-26T07:17:43.741 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-11-26T07:17:43.751 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-11-26T07:17:43.818 INFO:tasks.kclient:Unmounting kernel clients... 2023-11-26T07:17:43.819 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:43.819 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:43.855 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19704 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-26T07:17:43.855 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-26T07:17:43.856 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:43.917 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19704 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-26T07:17:43.918 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:17:43.918 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:43.939 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284224k,nr_inodes=4071056,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3837 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260544k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-26T07:17:43.939 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-11-26T07:17:43.939 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:17:43.999 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284224k,nr_inodes=4071056,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3837 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260544k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-26T07:17:43.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:43.999 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2023-11-26T07:17:44.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-26T07:17:44.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-26T07:17:44.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:44.021 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-26T07:17:44.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:44.108 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:17:44.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:44.201 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link delete ceph-brx 2023-11-26T07:17:44.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:44.302 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2023-11-26T07:17:44.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:44.320 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link delete ceph-brx 2023-11-26T07:17:44.390 INFO:teuthology.orchestra.run.smithi002.stderr:Cannot find device "ceph-brx" 2023-11-26T07:17:44.391 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T07:17:44.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:44.392 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2023-11-26T07:17:44.412 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-26T07:17:44.413 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-26T07:17:44.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:44.413 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-26T07:17:44.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:44.497 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:17:44.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:44.570 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link delete ceph-brx 2023-11-26T07:17:44.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:44.663 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2023-11-26T07:17:44.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:17:44.681 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link delete ceph-brx 2023-11-26T07:17:44.752 INFO:teuthology.orchestra.run.smithi192.stderr:Cannot find device "ceph-brx" 2023-11-26T07:17:44.753 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T07:17:44.753 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-26T07:17:44.764 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-26T07:17:44.764 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:17:44.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.892+0000 7f438e4b5700 1 Processor -- start 2023-11-26T07:17:44.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.892+0000 7f438e4b5700 1 -- start start 2023-11-26T07:17:44.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.893+0000 7f438e4b5700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f43880cf1e0 0x7f438815b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.893+0000 7f438e4b5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4388070a80 0x7f43880c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.893+0000 7f438e4b5700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4388072d20 con 0x7f43880ca510 2023-11-26T07:17:44.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.893+0000 7f438e4b5700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f438815ba10 con 0x7f43880cf1e0 2023-11-26T07:17:44.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.893+0000 7f438e4b5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43880ca980 con 0x7f4388070a80 2023-11-26T07:17:44.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.893+0000 7f4387fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f43880cf1e0 0x7f438815b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.893+0000 7f438ca52700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f43880ca510 0x7f438815e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36424/0 (socket says 172.21.15.2:36424) 2023-11-26T07:17:44.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.893+0000 7f438ca52700 1 -- 172.21.15.2:0/862488711 learned_addr learned my addr 172.21.15.2:0/862488711 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:44.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.893+0000 7f43877fe700 1 --2- 172.21.15.2:0/862488711 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4388070a80 0x7f43880c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.893+0000 7f4387fff700 1 -- 172.21.15.2:0/862488711 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4388070a80 msgr2=0x7f43880c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:44.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.893+0000 7f4387fff700 1 --2- 172.21.15.2:0/862488711 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4388070a80 0x7f43880c9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.893+0000 7f4387fff700 1 -- 172.21.15.2:0/862488711 >> v1:172.21.15.2:6789/0 conn(0x7f43880ca510 legacy=0x7f438815e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.893+0000 7f4386ffd700 1 -- 172.21.15.2:0/862488711 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3777016525 0 0) 0x7f4388072d20 con 0x7f43880ca510 2023-11-26T07:17:44.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.893+0000 7f4387fff700 1 -- 172.21.15.2:0/862488711 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4388071020 con 0x7f43880cf1e0 2023-11-26T07:17:44.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.894+0000 7f4387fff700 1 --2- 172.21.15.2:0/862488711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43880cf1e0 0x7f438815b4d0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f437c00a9e0 tx=0x7f437c00acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f9801ce6ade99d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:44.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.894+0000 7f4386ffd700 1 -- 172.21.15.2:0/862488711 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437c00cb70 con 0x7f43880cf1e0 2023-11-26T07:17:44.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.894+0000 7f4386ffd700 1 -- 172.21.15.2:0/862488711 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f437c00ccd0 con 0x7f43880cf1e0 2023-11-26T07:17:44.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.894+0000 7f4386ffd700 1 -- 172.21.15.2:0/862488711 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437c018620 con 0x7f43880cf1e0 2023-11-26T07:17:44.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.894+0000 7f438e4b5700 1 -- 172.21.15.2:0/862488711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43880cf1e0 msgr2=0x7f438815b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.894+0000 7f438e4b5700 1 --2- 172.21.15.2:0/862488711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43880cf1e0 0x7f438815b4d0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f437c00a9e0 tx=0x7f437c00acf0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.894+0000 7f438e4b5700 1 -- 172.21.15.2:0/862488711 shutdown_connections 2023-11-26T07:17:44.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.894+0000 7f438e4b5700 1 --2- 172.21.15.2:0/862488711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43880cf1e0 0x7f438815b4d0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.894+0000 7f438e4b5700 1 --2- 172.21.15.2:0/862488711 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4388070a80 0x7f43880c9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.894+0000 7f438e4b5700 1 -- 172.21.15.2:0/862488711 >> 172.21.15.2:0/862488711 conn(0x7f43880cf980 msgr2=0x7f43880cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:44.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.894+0000 7f438e4b5700 1 -- 172.21.15.2:0/862488711 shutdown_connections 2023-11-26T07:17:44.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.894+0000 7f438e4b5700 1 -- 172.21.15.2:0/862488711 wait complete. 2023-11-26T07:17:44.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.896+0000 7f438e4b5700 1 Processor -- start 2023-11-26T07:17:44.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.896+0000 7f438e4b5700 1 -- start start 2023-11-26T07:17:44.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.896+0000 7f438e4b5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4388070a80 0x7f438814d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.897+0000 7f438e4b5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43880ca510 0x7f43881f2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.897+0000 7f438e4b5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43880cf1e0 0x7f43881500f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.897+0000 7f438e4b5700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4388150d60 con 0x7f43880ca510 2023-11-26T07:17:44.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.897+0000 7f438e4b5700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43881f28b0 con 0x7f43880cf1e0 2023-11-26T07:17:44.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.897+0000 7f438e4b5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43880b53b0 con 0x7f4388070a80 2023-11-26T07:17:44.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.897+0000 7f43877fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43880ca510 0x7f43881f2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.897+0000 7f43877fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43880ca510 0x7f43881f2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45218/0 (socket says 172.21.15.2:45218) 2023-11-26T07:17:44.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.897+0000 7f43877fe700 1 -- 172.21.15.2:0/3359278617 learned_addr learned my addr 172.21.15.2:0/3359278617 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:44.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.897+0000 7f4387fff700 1 --2- 172.21.15.2:0/3359278617 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4388070a80 0x7f438814d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.897+0000 7f43877fe700 1 -- 172.21.15.2:0/3359278617 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4388070a80 msgr2=0x7f438814d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.897+0000 7f43877fe700 1 --2- 172.21.15.2:0/3359278617 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4388070a80 0x7f438814d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.897+0000 7f438ca52700 1 --2- 172.21.15.2:0/3359278617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43880cf1e0 0x7f43881500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.897+0000 7f43877fe700 1 -- 172.21.15.2:0/3359278617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43880cf1e0 msgr2=0x7f43881500f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:44.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.897+0000 7f43877fe700 1 --2- 172.21.15.2:0/3359278617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43880cf1e0 0x7f43881500f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:44.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.897+0000 7f43877fe700 1 -- 172.21.15.2:0/3359278617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f437c00a640 con 0x7f43880ca510 2023-11-26T07:17:44.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.897+0000 7f43877fe700 1 --2- 172.21.15.2:0/3359278617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43880ca510 0x7f43881f2370 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f437800e810 tx=0x7f437800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:44.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.897+0000 7f4384ff9700 1 -- 172.21.15.2:0/3359278617 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4378013610 con 0x7f43880ca510 2023-11-26T07:17:44.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.897+0000 7f4384ff9700 1 -- 172.21.15.2:0/3359278617 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4378013770 con 0x7f43880ca510 2023-11-26T07:17:44.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.897+0000 7f438e4b5700 1 -- 172.21.15.2:0/3359278617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43880b50d0 con 0x7f43880ca510 2023-11-26T07:17:44.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.897+0000 7f4384ff9700 1 -- 172.21.15.2:0/3359278617 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4378013b20 con 0x7f43880ca510 2023-11-26T07:17:44.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.897+0000 7f438e4b5700 1 -- 172.21.15.2:0/3359278617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43881f52d0 con 0x7f43880ca510 2023-11-26T07:17:44.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.898+0000 7f438e4b5700 1 -- 172.21.15.2:0/3359278617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4388067f60 con 0x7f43880ca510 2023-11-26T07:17:44.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.899+0000 7f4384ff9700 1 -- 172.21.15.2:0/3359278617 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f4378013c80 con 0x7f43880ca510 2023-11-26T07:17:44.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.899+0000 7f4384ff9700 1 --2- 172.21.15.2:0/3359278617 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f437406b980 0x7f437406de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:44.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.899+0000 7f4384ff9700 1 -- 172.21.15.2:0/3359278617 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4378087cc0 con 0x7f43880ca510 2023-11-26T07:17:44.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.900+0000 7f4387fff700 1 --2- 172.21.15.2:0/3359278617 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f437406b980 0x7f437406de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:44.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.900+0000 7f4387fff700 1 --2- 172.21.15.2:0/3359278617 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f437406b980 0x7f437406de40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f437c00a1c0 tx=0x7f437c01a040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:44.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:44.904+0000 7f4384ff9700 1 -- 172.21.15.2:0/3359278617 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f43780547c0 con 0x7f43880ca510 2023-11-26T07:17:45.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.098+0000 7f438e4b5700 1 -- 172.21.15.2:0/3359278617 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f43880718c0 con 0x7f437406b980 2023-11-26T07:17:45.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.100+0000 7f4384ff9700 1 -- 172.21.15.2:0/3359278617 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50625 (secure 0 0 0) 0x7f437c00caf0 con 0x7f437406b980 2023-11-26T07:17:45.103 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:17:45.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.102+0000 7f438e4b5700 1 -- 172.21.15.2:0/3359278617 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f437406b980 msgr2=0x7f437406de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:45.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.102+0000 7f438e4b5700 1 --2- 172.21.15.2:0/3359278617 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f437406b980 0x7f437406de40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f437c00a1c0 tx=0x7f437c01a040 comp rx=0 tx=0).stop 2023-11-26T07:17:45.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.102+0000 7f438e4b5700 1 -- 172.21.15.2:0/3359278617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43880ca510 msgr2=0x7f43881f2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:45.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.102+0000 7f438e4b5700 1 --2- 172.21.15.2:0/3359278617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43880ca510 0x7f43881f2370 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f437800e810 tx=0x7f437800ebd0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.102+0000 7f438e4b5700 1 -- 172.21.15.2:0/3359278617 shutdown_connections 2023-11-26T07:17:45.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.102+0000 7f438e4b5700 1 --2- 172.21.15.2:0/3359278617 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f437406b980 0x7f437406de40 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.102+0000 7f438e4b5700 1 --2- 172.21.15.2:0/3359278617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43880cf1e0 0x7f43881500f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.102+0000 7f438e4b5700 1 --2- 172.21.15.2:0/3359278617 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4388070a80 0x7f438814d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.102+0000 7f438e4b5700 1 --2- 172.21.15.2:0/3359278617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43880ca510 0x7f43881f2370 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.102+0000 7f438e4b5700 1 -- 172.21.15.2:0/3359278617 >> 172.21.15.2:0/3359278617 conn(0x7f43880cf980 msgr2=0x7f438806cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:45.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.102+0000 7f438e4b5700 1 -- 172.21.15.2:0/3359278617 shutdown_connections 2023-11-26T07:17:45.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.103+0000 7f438e4b5700 1 -- 172.21.15.2:0/3359278617 wait complete. 2023-11-26T07:17:45.107 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-26T07:17:45.117 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":260,"stamp":"2023-11-26T07:17:44.248132+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":128,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":262264,"kb_used_data":8648,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754712456,"statfs":{"total":773094113280,"available":772825554944,"internally_reserved":0,"allocated":8855552,"data_stored":4440616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-422261476,"num_objects":-427,"num_object_clones":-1,"num_object_copies":-854,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-427,"num_whiteouts":-1,"num_read":-209,"num_read_kb":-204809,"num_write":-940,"num_write_kb":-412672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-7,"num_bytes_recovered":-7340032,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.139626"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":217,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-26T07:17:39.385054+0000","last_change":"2023-11-26T07:11:29.855919+0000","last_active":"2023-11-26T07:17:39.385054+0000","last_peered":"2023-11-26T07:17:39.385054+0000","last_clean":"2023-11-26T07:17:39.385054+0000","last_became_active":"2023-11-26T07:11:29.854903+0000","last_became_peered":"2023-11-26T07:11:29.854903+0000","last_unstale":"2023-11-26T07:17:39.385054+0000","last_undegraded":"2023-11-26T07:17:39.385054+0000","last_fullsized":"2023-11-26T07:17:39.385054+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:28.594252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:28.594252+0000","last_clean_scrub_stamp":"2023-11-26T07:11:28.594252+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:33:34.642696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574928,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32704,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339136,"statfs":{"total":96636764160,"available":96603275264,"internally_reserved":0,"allocated":1552384,"data_stored":997853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.53200000000000003,"15min":0.53400000000000003},"min":{"1min":0.33800000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.72099999999999997,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.51700000000000002,"15min":0.50700000000000001},"min":{"1min":0.35399999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.57899999999999996}]},{"osd":1,"last update":"Sun Nov 26 07:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.65300000000000002,"15min":0.91500000000000004},"min":{"1min":0.44600000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76600000000000001,"5min":9.5600000000000005,"15min":9.5600000000000005},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.55100000000000005,"15min":0.57399999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.71799999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.628}]},{"osd":2,"last update":"Sun Nov 26 07:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58399999999999996,"15min":0.59799999999999998},"min":{"1min":0.42599999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.68100000000000005,"5min":1.569,"15min":1.569},"last":0.5},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61399999999999999,"15min":0.64100000000000001},"min":{"1min":0.44900000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84599999999999997,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.80300000000000005}]},{"osd":3,"last update":"Sun Nov 26 07:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.56499999999999995,"15min":0.59399999999999997},"min":{"1min":0.33900000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70599999999999996,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58399999999999996,"15min":0.56799999999999995},"min":{"1min":0.42899999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.80900000000000005,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.753}]},{"osd":4,"last update":"Sun Nov 26 07:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.34799999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.61799999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.53100000000000003,"15min":0.51300000000000001},"min":{"1min":0.39600000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.66500000000000004,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.60499999999999998}]},{"osd":5,"last update":"Sun Nov 26 07:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.55000000000000004,"15min":0.53300000000000003},"min":{"1min":0.378,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70899999999999996,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61399999999999999,"15min":0.628},"min":{"1min":0.44,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79900000000000004,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.69899999999999995}]},{"osd":6,"last update":"Sun Nov 26 07:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58699999999999997,"15min":0.58799999999999997},"min":{"1min":0.45400000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.75900000000000001,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.40699999999999997,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.73999999999999999,"5min":1.552,"15min":1.552},"last":0.64600000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574928,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339720,"statfs":{"total":96636764160,"available":96603873280,"internally_reserved":0,"allocated":958464,"data_stored":407485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52500000000000002,"15min":0.49099999999999999},"min":{"1min":0.312,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.73599999999999999,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.56899999999999995,"15min":0.498},"min":{"1min":0.34799999999999998,"5min":0.33400000000000002,"15min":0.317},"max":{"1min":2.1000000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":0.56499999999999995}]},{"osd":1,"last update":"Sun Nov 26 07:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54000000000000004,"15min":0.51700000000000002},"min":{"1min":0.33800000000000002,"5min":0.315,"15min":0.315},"max":{"1min":1.079,"5min":1.079,"15min":1.1080000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54400000000000004,"15min":0.54200000000000004},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.78500000000000003,"5min":0.83599999999999997,"15min":1.198},"last":0.63300000000000001}]},{"osd":2,"last update":"Sun Nov 26 07:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.56499999999999995,"15min":0.51100000000000001},"min":{"1min":0.375,"5min":0.307,"15min":0.307},"max":{"1min":2.2210000000000001,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57999999999999996,"15min":0.53400000000000003},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.68300000000000005}]},{"osd":3,"last update":"Sun Nov 26 07:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61099999999999999,"15min":0.56299999999999994},"min":{"1min":0.41999999999999998,"5min":0.40999999999999998,"15min":0.373},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.64200000000000002,"15min":0.59699999999999998},"min":{"1min":0.45100000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":0.70099999999999996}]},{"osd":4,"last update":"Sun Nov 26 07:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48899999999999999,"15min":0.51900000000000002},"min":{"1min":0.32200000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.58699999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56100000000000005,"15min":0.56699999999999995},"min":{"1min":0.375,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.78500000000000003}]},{"osd":5,"last update":"Sun Nov 26 07:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55700000000000005,"15min":0.55800000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.754},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.57399999999999995,"15min":0.58399999999999996},"min":{"1min":0.38500000000000001,"5min":0.311,"15min":0.311},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.72299999999999998}]},{"osd":7,"last update":"Sun Nov 26 07:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.59999999999999998,"15min":0.59399999999999997},"min":{"1min":0.371,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":2.1499999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61799999999999999,"15min":0.622},"min":{"1min":0.39700000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.81399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36276,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335564,"statfs":{"total":96636764160,"available":96599617536,"internally_reserved":0,"allocated":958464,"data_stored":407485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33800000000000002,"15min":0.35799999999999998},"min":{"1min":0.23300000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.47899999999999998,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":1.1200000000000001},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35999999999999999,"15min":0.72599999999999998},"min":{"1min":0.26800000000000002,"5min":0.214,"15min":0.214},"max":{"1min":0.45200000000000001,"5min":0.60399999999999998,"15min":11.922000000000001},"last":1.1870000000000001}]},{"osd":2,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.33500000000000002,"15min":0.36399999999999999},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.47899999999999998,"5min":0.66500000000000004,"15min":0.80300000000000005},"last":0.875},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.39400000000000002,"15min":0.40500000000000003},"min":{"1min":0.28399999999999997,"5min":0.254,"15min":0.254},"max":{"1min":0.54300000000000004,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":1.2450000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.436,"15min":0.45400000000000001},"min":{"1min":0.31,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.623,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":2.4369999999999998},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.41199999999999998,"15min":0.434},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.56799999999999995,"5min":0.62,"15min":1.101},"last":2.4809999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.60899999999999999,"15min":0.82099999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.73599999999999999,"5min":0.97299999999999998,"15min":6.8979999999999997},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64400000000000002,"15min":0.66000000000000003},"min":{"1min":0.42999999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.77100000000000002,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":1.159}]},{"osd":5,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.61099999999999999,"15min":0.624},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78500000000000003,"5min":1.2090000000000001,"15min":1.3160000000000001},"last":1.093},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60099999999999998,"15min":0.82299999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.73799999999999999,"5min":1.087,"15min":6.9480000000000004},"last":0.91700000000000004}]},{"osd":6,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.624,"15min":0.65300000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.72799999999999998,"5min":0.93100000000000005,"15min":1.194},"last":1.139},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.61299999999999999,"15min":0.84699999999999998},"min":{"1min":0.41199999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.77800000000000002,"5min":1.222,"15min":6.9800000000000004},"last":0.94999999999999996}]},{"osd":7,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.66700000000000004,"15min":0.66300000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.75600000000000001,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":1.2110000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.66700000000000004,"15min":0.68300000000000005},"min":{"1min":0.48299999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.754,"5min":3.548,"15min":3.548},"last":1.054}]}]},{"osd":0,"up_from":13,"seq":55834574926,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32696,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339144,"statfs":{"total":96636764160,"available":96603283456,"internally_reserved":0,"allocated":1552384,"data_stored":997853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.36099999999999999},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.46700000000000003,"5min":0.52600000000000002,"15min":1.5820000000000001},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.35699999999999998,"15min":0.745},"min":{"1min":0.28199999999999997,"5min":0.216,"15min":0.216},"max":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":11.987},"last":0.317}]},{"osd":2,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35899999999999999,"15min":0.41899999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.48299999999999998,"5min":0.57099999999999995,"15min":1.607},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38200000000000001,"15min":0.40799999999999997},"min":{"1min":0.27800000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.55200000000000005,"5min":0.64900000000000002,"15min":0.89600000000000002},"last":0.36799999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36299999999999999,"15min":0.38300000000000001},"min":{"1min":0.26500000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.49099999999999999,"5min":0.58899999999999997,"15min":0.752},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41199999999999998,"15min":0.46000000000000002},"min":{"1min":0.32400000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.57199999999999995,"5min":0.71699999999999997,"15min":1.6339999999999999},"last":0.39500000000000002}]},{"osd":4,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.59199999999999997,"15min":0.64200000000000002},"min":{"1min":0.36699999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.92600000000000005},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59699999999999998,"15min":0.83299999999999996},"min":{"1min":0.39900000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.81499999999999995,"5min":0.82199999999999995,"15min":6.5279999999999996},"last":0.63}]},{"osd":5,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59499999999999997,"15min":0.63800000000000001},"min":{"1min":0.42999999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83599999999999997,"5min":0.878,"15min":1.1000000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.625,"15min":0.68100000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83499999999999996,"5min":0.88400000000000001,"15min":1.508},"last":0.47999999999999998}]},{"osd":6,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.624,"15min":0.86799999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.88700000000000001,"5min":0.93400000000000005,"15min":6.5419999999999998},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61099999999999999,"15min":0.66300000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.82099999999999995,"5min":0.84399999999999997,"15min":1.3759999999999999},"last":0.56200000000000006}]},{"osd":7,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.68600000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.878,"5min":0.91000000000000003,"15min":1.1180000000000001},"last":0.497},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.61899999999999999,"15min":0.65500000000000003},"min":{"1min":0.51900000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77400000000000002,"5min":0.872,"15min":1.155},"last":0.60899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574927,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32116,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":958464,"data_stored":407485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.33300000000000002,"15min":0.34399999999999997},"min":{"1min":0.20999999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.45500000000000002,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.25},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.38600000000000001,"15min":0.39600000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.499,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.36899999999999999}]},{"osd":1,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.33300000000000002,"15min":0.34499999999999997},"min":{"1min":0.23799999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.39900000000000002,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.372,"15min":0.376},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.54800000000000004,"5min":0.58999999999999997,"15min":0.59599999999999997},"last":0.32600000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.38200000000000001,"15min":0.40600000000000003},"min":{"1min":0.29199999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.47999999999999998,"5min":0.59699999999999998,"15min":0.64700000000000002},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.375,"15min":0.38300000000000001},"min":{"1min":0.26700000000000002,"5min":0.224,"15min":0.224},"max":{"1min":0.56599999999999995,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.40899999999999997}]},{"osd":4,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.39600000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.86499999999999999,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58299999999999996},"min":{"1min":0.44,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.58599999999999997}]},{"osd":5,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59199999999999997,"15min":0.57999999999999996},"min":{"1min":0.45300000000000001,"5min":0.39500000000000002,"15min":0.36899999999999999},"max":{"1min":0.85099999999999998,"5min":0.87,"15min":0.87},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59099999999999997,"15min":0.623},"min":{"1min":0.41999999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78200000000000003,"5min":0.86299999999999999,"15min":1.002},"last":0.75}]},{"osd":6,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.61699999999999999,"15min":0.61399999999999999},"min":{"1min":0.432,"5min":0.40999999999999998,"15min":0.38800000000000001},"max":{"1min":0.75700000000000001,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.629,"15min":0.63500000000000001},"min":{"1min":0.48999999999999999,"5min":0.44400000000000001,"15min":0.439},"max":{"1min":0.91700000000000004,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.61299999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61099999999999999,"15min":0.626},"min":{"1min":0.44,"5min":0.41999999999999998,"15min":0.40600000000000003},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.621,"15min":0.623},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85199999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.63}]}]},{"osd":3,"up_from":13,"seq":55834574927,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32116,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":958464,"data_stored":407485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.32900000000000001,"15min":0.36099999999999999},"min":{"1min":0.23300000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":1.3500000000000001},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35899999999999999,"15min":0.40699999999999997},"min":{"1min":0.25900000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.54900000000000004,"5min":0.61299999999999999,"15min":1.6619999999999999},"last":0.26100000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.33800000000000002,"15min":0.39100000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.41599999999999998,"5min":0.58799999999999997,"15min":1.2010000000000001},"last":0.314},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.38700000000000001,"15min":0.48299999999999998},"min":{"1min":0.30499999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.56599999999999995,"5min":0.629,"15min":2.903},"last":0.38}]},{"osd":2,"last update":"Sun Nov 26 07:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.375,"15min":0.39800000000000002},"min":{"1min":0.26100000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.52000000000000002,"5min":0.57399999999999995,"15min":1.1240000000000001},"last":0.437},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.39300000000000002,"15min":0.41399999999999998},"min":{"1min":0.28799999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.51900000000000002,"5min":0.63700000000000001,"15min":1.2290000000000001},"last":0.36499999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.60799999999999998,"15min":0.69199999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.82699999999999996,"5min":0.96799999999999997,"15min":2.9609999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60899999999999999,"15min":0.63600000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.85899999999999999,"5min":1.1499999999999999,"15min":1.163},"last":0.74099999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.621,"15min":0.66300000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.88800000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.624,"15min":0.65800000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.877,"5min":0.93999999999999995,"15min":1.2829999999999999},"last":0.78700000000000003}]},{"osd":6,"last update":"Sun Nov 26 07:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.64300000000000002,"15min":0.67100000000000004},"min":{"1min":0.39400000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":2.6040000000000001,"5min":2.6040000000000001,"15min":2.6040000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.63800000000000001,"15min":0.67400000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.258},"last":0.71899999999999997}]},{"osd":7,"last update":"Sun Nov 26 07:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63200000000000001,"15min":0.67600000000000005},"min":{"1min":0.438,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.875,"5min":1.014,"15min":1.3069999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.65300000000000002,"15min":0.73699999999999999},"min":{"1min":0.44800000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90100000000000002,"5min":1.0780000000000001,"15min":2.9969999999999999},"last":0.755}]}]},{"osd":4,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32116,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":958464,"data_stored":407485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.55100000000000005,"15min":0.85099999999999998},"min":{"1min":0.32900000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.68899999999999995,"5min":0.87,"15min":8.7539999999999996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59199999999999997,"15min":0.875},"min":{"1min":0.35299999999999998,"5min":0.316,"15min":0.316},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":8.7390000000000008},"last":0.623}]},{"osd":1,"last update":"Sun Nov 26 07:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.56100000000000005,"15min":0.89300000000000002},"min":{"1min":0.32700000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.68300000000000005,"5min":0.81200000000000006,"15min":9.7720000000000002},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.55000000000000004,"15min":0.56399999999999995},"min":{"1min":0.33600000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.72899999999999998,"5min":0.80000000000000004,"15min":0.88700000000000001},"last":0.40100000000000002}]},{"osd":2,"last update":"Sun Nov 26 07:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54100000000000004,"15min":0.85099999999999998},"min":{"1min":0.39900000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.78600000000000003,"5min":0.80100000000000005,"15min":9.8119999999999994},"last":0.498},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58599999999999997,"15min":0.78300000000000003},"min":{"1min":0.36899999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67600000000000005,"5min":0.85499999999999998,"15min":3.645},"last":0.54400000000000004}]},{"osd":3,"last update":"Sun Nov 26 07:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59599999999999997,"15min":0.89800000000000002},"min":{"1min":0.41899999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.69999999999999996,"5min":0.81299999999999994,"15min":8.8089999999999993},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.59799999999999998,"15min":0.60199999999999998},"min":{"1min":0.371,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82099999999999995,"5min":0.83899999999999997,"15min":1.0720000000000001},"last":0.44500000000000001}]},{"osd":5,"last update":"Sun Nov 26 07:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55600000000000005,"15min":0.51600000000000001},"min":{"1min":0.32800000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72099999999999997,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55900000000000005,"15min":0.55300000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.60599999999999998}]},{"osd":6,"last update":"Sun Nov 26 07:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.58499999999999996},"min":{"1min":0.375,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.78800000000000003,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56399999999999995,"15min":0.57199999999999995},"min":{"1min":0.36199999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.57599999999999996}]},{"osd":7,"last update":"Sun Nov 26 07:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60599999999999998,"15min":0.59799999999999998},"min":{"1min":0.41299999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61699999999999999,"15min":0.60799999999999998},"min":{"1min":0.40899999999999997,"5min":0.38300000000000001,"15min":0.38200000000000001},"max":{"1min":0.89500000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.52700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574928,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339720,"statfs":{"total":96636764160,"available":96603873280,"internally_reserved":0,"allocated":958464,"data_stored":407485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.58599999999999997,"15min":0.54000000000000004},"min":{"1min":0.40200000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.65300000000000002,"5min":7.1500000000000004,"15min":7.1500000000000004},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.58999999999999997,"15min":0.56999999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78500000000000003,"5min":6.8470000000000004,"15min":6.8470000000000004},"last":0.56699999999999995}]},{"osd":1,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.58299999999999996,"15min":0.55500000000000005},"min":{"1min":0.32300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69599999999999995,"5min":7.1269999999999998,"15min":7.1269999999999998},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73499999999999999,"5min":1.514,"15min":1.514},"last":0.68100000000000005}]},{"osd":2,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.63200000000000001,"15min":0.59399999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.71499999999999997,"5min":7.2000000000000002,"15min":7.2000000000000002},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.65500000000000003,"15min":0.61799999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73699999999999999,"5min":7.8259999999999996,"15min":7.8259999999999996},"last":0.66800000000000004}]},{"osd":3,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.59899999999999998,"15min":0.57099999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79800000000000004,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.65000000000000002,"15min":0.60799999999999998},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72899999999999998,"5min":6.9240000000000004,"15min":6.9240000000000004},"last":0.53300000000000003}]},{"osd":4,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.56799999999999995,"15min":0.51400000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.68700000000000006,"5min":7.2830000000000004,"15min":7.2830000000000004},"last":0.442},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.83399999999999996,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.54600000000000004}]},{"osd":6,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.61899999999999999,"15min":0.57099999999999995},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.75600000000000001,"5min":6.8890000000000002,"15min":6.8890000000000002},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.63,"15min":0.58899999999999997},"min":{"1min":0.40300000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.72899999999999998,"5min":7.2430000000000003,"15min":7.2430000000000003},"last":0.503}]},{"osd":7,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.65900000000000003,"15min":0.60899999999999999},"min":{"1min":0.41299999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.86699999999999999,"5min":6.9880000000000004,"15min":6.9880000000000004},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.72399999999999998,"15min":0.65600000000000003},"min":{"1min":0.40300000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.77100000000000002,"5min":11.874000000000001,"15min":11.874000000000001},"last":0.48399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:17:45.118 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:17:45.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.242+0000 7f8d12a39700 1 Processor -- start 2023-11-26T07:17:45.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.242+0000 7f8d12a39700 1 -- start start 2023-11-26T07:17:45.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.242+0000 7f8d12a39700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8d0c0d16e0 0x7f8d0c0affb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:45.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.243+0000 7f8d12a39700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d0c0d1b40 con 0x7f8d0c0ada10 2023-11-26T07:17:45.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.243+0000 7f8d12a39700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d0c070490 con 0x7f8d0c06afd0 2023-11-26T07:17:45.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.243+0000 7f8d12a39700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d0c0b04f0 con 0x7f8d0c0d16e0 2023-11-26T07:17:45.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.243+0000 7f8d0b7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8d0c0d16e0 0x7f8d0c0affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:45.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.243+0000 7f8d10fd6700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f8d0c0ada10 0x7f8d0c0adea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36438/0 (socket says 172.21.15.2:36438) 2023-11-26T07:17:45.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.243+0000 7f8d10fd6700 1 -- 172.21.15.2:0/2111440264 learned_addr learned my addr 172.21.15.2:0/2111440264 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:45.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.243+0000 7f8d0b7fe700 1 -- 172.21.15.2:0/2111440264 >> v1:172.21.15.192:6789/0 conn(0x7f8d0c06afd0 legacy=0x7f8d0c06b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:45.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.243+0000 7f8d0b7fe700 1 -- 172.21.15.2:0/2111440264 >> v1:172.21.15.2:6789/0 conn(0x7f8d0c0ada10 legacy=0x7f8d0c0adea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:45.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.243+0000 7f8d0affd700 1 -- 172.21.15.2:0/2111440264 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3373431754 0 0) 0x7f8d0c0d1b40 con 0x7f8d0c0ada10 2023-11-26T07:17:45.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.243+0000 7f8d0b7fe700 1 -- 172.21.15.2:0/2111440264 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d0c0af9f0 con 0x7f8d0c0d16e0 2023-11-26T07:17:45.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.243+0000 7f8d0b7fe700 1 --2- 172.21.15.2:0/2111440264 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d0c0d16e0 0x7f8d0c0affb0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f8d00009840 tx=0x7f8d00009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1123f2aa5991b805 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:45.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.243+0000 7f8d0affd700 1 -- 172.21.15.2:0/2111440264 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d00011830 con 0x7f8d0c0d16e0 2023-11-26T07:17:45.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.243+0000 7f8d0affd700 1 -- 172.21.15.2:0/2111440264 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d00011990 con 0x7f8d0c0d16e0 2023-11-26T07:17:45.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.243+0000 7f8d0affd700 1 -- 172.21.15.2:0/2111440264 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d00011d20 con 0x7f8d0c0d16e0 2023-11-26T07:17:45.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.244+0000 7f8d12a39700 1 -- 172.21.15.2:0/2111440264 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d0c0d16e0 msgr2=0x7f8d0c0affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:45.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.244+0000 7f8d12a39700 1 --2- 172.21.15.2:0/2111440264 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d0c0d16e0 0x7f8d0c0affb0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f8d00009840 tx=0x7f8d00009b50 comp rx=0 tx=0).stop 2023-11-26T07:17:45.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.244+0000 7f8d12a39700 1 -- 172.21.15.2:0/2111440264 shutdown_connections 2023-11-26T07:17:45.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.244+0000 7f8d12a39700 1 --2- 172.21.15.2:0/2111440264 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d0c0d16e0 0x7f8d0c0affb0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.244+0000 7f8d12a39700 1 -- 172.21.15.2:0/2111440264 >> 172.21.15.2:0/2111440264 conn(0x7f8d0c0d0bc0 msgr2=0x7f8d0c0d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:45.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.244+0000 7f8d12a39700 1 -- 172.21.15.2:0/2111440264 shutdown_connections 2023-11-26T07:17:45.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.244+0000 7f8d12a39700 1 -- 172.21.15.2:0/2111440264 wait complete. 2023-11-26T07:17:45.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.245+0000 7f8d12a39700 1 Processor -- start 2023-11-26T07:17:45.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.245+0000 7f8d12a39700 1 -- start start 2023-11-26T07:17:45.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.246+0000 7f8d12a39700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d0c06afd0 0x7f8d0c1596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:45.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.246+0000 7f8d12a39700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d0c0ada10 0x7f8d0c159be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:45.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.246+0000 7f8d12a39700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d0c0d16e0 0x7f8d0c15a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:45.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.246+0000 7f8d12a39700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0c153920 con 0x7f8d0c06afd0 2023-11-26T07:17:45.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.246+0000 7f8d12a39700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0c1464d0 con 0x7f8d0c0ada10 2023-11-26T07:17:45.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.246+0000 7f8d12a39700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0c156820 con 0x7f8d0c0d16e0 2023-11-26T07:17:45.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.246+0000 7f8d0bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d0c06afd0 0x7f8d0c1596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:45.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.246+0000 7f8d0bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d0c06afd0 0x7f8d0c1596a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45230/0 (socket says 172.21.15.2:45230) 2023-11-26T07:17:45.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.246+0000 7f8d0bfff700 1 -- 172.21.15.2:0/1425129148 learned_addr learned my addr 172.21.15.2:0/1425129148 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:45.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.246+0000 7f8d0b7fe700 1 --2- 172.21.15.2:0/1425129148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d0c0ada10 0x7f8d0c159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:45.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.246+0000 7f8d10fd6700 1 --2- 172.21.15.2:0/1425129148 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d0c0d16e0 0x7f8d0c15a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:45.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.247+0000 7f8d0bfff700 1 -- 172.21.15.2:0/1425129148 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d0c0d16e0 msgr2=0x7f8d0c15a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:45.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.247+0000 7f8d0bfff700 1 --2- 172.21.15.2:0/1425129148 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d0c0d16e0 0x7f8d0c15a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.247+0000 7f8d0bfff700 1 -- 172.21.15.2:0/1425129148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d0c0ada10 msgr2=0x7f8d0c159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:45.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.247+0000 7f8d0bfff700 1 --2- 172.21.15.2:0/1425129148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d0c0ada10 0x7f8d0c159be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.247+0000 7f8d0bfff700 1 -- 172.21.15.2:0/1425129148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d000094a0 con 0x7f8d0c06afd0 2023-11-26T07:17:45.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.247+0000 7f8d0bfff700 1 --2- 172.21.15.2:0/1425129148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d0c06afd0 0x7f8d0c1596a0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc00c450 tx=0x7f8cfc00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:45.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.247+0000 7f8d08ff9700 1 -- 172.21.15.2:0/1425129148 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc0052d0 con 0x7f8d0c06afd0 2023-11-26T07:17:45.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.247+0000 7f8d08ff9700 1 -- 172.21.15.2:0/1425129148 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cfc005430 con 0x7f8d0c06afd0 2023-11-26T07:17:45.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.247+0000 7f8d08ff9700 1 -- 172.21.15.2:0/1425129148 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc0038c0 con 0x7f8d0c06afd0 2023-11-26T07:17:45.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.247+0000 7f8d12a39700 1 -- 172.21.15.2:0/1425129148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d0c156540 con 0x7f8d0c06afd0 2023-11-26T07:17:45.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.247+0000 7f8d12a39700 1 -- 172.21.15.2:0/1425129148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d0c158ea0 con 0x7f8d0c06afd0 2023-11-26T07:17:45.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.248+0000 7f8d12a39700 1 -- 172.21.15.2:0/1425129148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d0c068670 con 0x7f8d0c06afd0 2023-11-26T07:17:45.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.248+0000 7f8d08ff9700 1 -- 172.21.15.2:0/1425129148 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f8cfc003a20 con 0x7f8d0c06afd0 2023-11-26T07:17:45.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.249+0000 7f8d08ff9700 1 --2- 172.21.15.2:0/1425129148 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8cf806b980 0x7f8cf806de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:45.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.249+0000 7f8d08ff9700 1 -- 172.21.15.2:0/1425129148 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8cfc0874e0 con 0x7f8d0c06afd0 2023-11-26T07:17:45.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.249+0000 7f8d0b7fe700 1 --2- 172.21.15.2:0/1425129148 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8cf806b980 0x7f8cf806de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:45.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.249+0000 7f8d0b7fe700 1 --2- 172.21.15.2:0/1425129148 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8cf806b980 0x7f8cf806de40 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c0af2c0 tx=0x7f8d0001c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:45.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.253+0000 7f8d08ff9700 1 -- 172.21.15.2:0/1425129148 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8cfc053db0 con 0x7f8d0c06afd0 2023-11-26T07:17:45.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.448+0000 7f8d12a39700 1 -- 172.21.15.2:0/1425129148 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8d0c06e980 con 0x7f8cf806b980 2023-11-26T07:17:45.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.451+0000 7f8d08ff9700 1 -- 172.21.15.2:0/1425129148 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50625 (secure 0 0 0) 0x7f8d00011b80 con 0x7f8cf806b980 2023-11-26T07:17:45.453 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:17:45.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.452+0000 7f8d12a39700 1 -- 172.21.15.2:0/1425129148 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8cf806b980 msgr2=0x7f8cf806de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:45.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.452+0000 7f8d12a39700 1 --2- 172.21.15.2:0/1425129148 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8cf806b980 0x7f8cf806de40 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c0af2c0 tx=0x7f8d0001c040 comp rx=0 tx=0).stop 2023-11-26T07:17:45.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.453+0000 7f8d12a39700 1 -- 172.21.15.2:0/1425129148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d0c06afd0 msgr2=0x7f8d0c1596a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:45.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.453+0000 7f8d12a39700 1 --2- 172.21.15.2:0/1425129148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d0c06afd0 0x7f8d0c1596a0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc00c450 tx=0x7f8cfc00c810 comp rx=0 tx=0).stop 2023-11-26T07:17:45.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.453+0000 7f8d12a39700 1 -- 172.21.15.2:0/1425129148 shutdown_connections 2023-11-26T07:17:45.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.453+0000 7f8d12a39700 1 --2- 172.21.15.2:0/1425129148 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f8cf806b980 0x7f8cf806de40 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.453+0000 7f8d12a39700 1 --2- 172.21.15.2:0/1425129148 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d0c0d16e0 0x7f8d0c15a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.453+0000 7f8d12a39700 1 --2- 172.21.15.2:0/1425129148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d0c06afd0 0x7f8d0c1596a0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.453+0000 7f8d12a39700 1 --2- 172.21.15.2:0/1425129148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d0c0ada10 0x7f8d0c159be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.453+0000 7f8d12a39700 1 -- 172.21.15.2:0/1425129148 >> 172.21.15.2:0/1425129148 conn(0x7f8d0c0d0bc0 msgr2=0x7f8d0c15d470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:45.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.453+0000 7f8d12a39700 1 -- 172.21.15.2:0/1425129148 shutdown_connections 2023-11-26T07:17:45.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.453+0000 7f8d12a39700 1 -- 172.21.15.2:0/1425129148 wait complete. 2023-11-26T07:17:45.456 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-26T07:17:45.467 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":260,"stamp":"2023-11-26T07:17:44.248132+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":128,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":262264,"kb_used_data":8648,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754712456,"statfs":{"total":773094113280,"available":772825554944,"internally_reserved":0,"allocated":8855552,"data_stored":4440616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-422261476,"num_objects":-427,"num_object_clones":-1,"num_object_copies":-854,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-427,"num_whiteouts":-1,"num_read":-209,"num_read_kb":-204809,"num_write":-940,"num_write_kb":-412672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-7,"num_bytes_recovered":-7340032,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.139626"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":217,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-26T07:17:39.385054+0000","last_change":"2023-11-26T07:11:29.855919+0000","last_active":"2023-11-26T07:17:39.385054+0000","last_peered":"2023-11-26T07:17:39.385054+0000","last_clean":"2023-11-26T07:17:39.385054+0000","last_became_active":"2023-11-26T07:11:29.854903+0000","last_became_peered":"2023-11-26T07:11:29.854903+0000","last_unstale":"2023-11-26T07:17:39.385054+0000","last_undegraded":"2023-11-26T07:17:39.385054+0000","last_fullsized":"2023-11-26T07:17:39.385054+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:28.594252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:28.594252+0000","last_clean_scrub_stamp":"2023-11-26T07:11:28.594252+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:33:34.642696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574928,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32704,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339136,"statfs":{"total":96636764160,"available":96603275264,"internally_reserved":0,"allocated":1552384,"data_stored":997853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.53200000000000003,"15min":0.53400000000000003},"min":{"1min":0.33800000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.72099999999999997,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.51700000000000002,"15min":0.50700000000000001},"min":{"1min":0.35399999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.57899999999999996}]},{"osd":1,"last update":"Sun Nov 26 07:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.65300000000000002,"15min":0.91500000000000004},"min":{"1min":0.44600000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76600000000000001,"5min":9.5600000000000005,"15min":9.5600000000000005},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.55100000000000005,"15min":0.57399999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.71799999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.628}]},{"osd":2,"last update":"Sun Nov 26 07:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58399999999999996,"15min":0.59799999999999998},"min":{"1min":0.42599999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.68100000000000005,"5min":1.569,"15min":1.569},"last":0.5},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61399999999999999,"15min":0.64100000000000001},"min":{"1min":0.44900000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84599999999999997,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.80300000000000005}]},{"osd":3,"last update":"Sun Nov 26 07:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.56499999999999995,"15min":0.59399999999999997},"min":{"1min":0.33900000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70599999999999996,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58399999999999996,"15min":0.56799999999999995},"min":{"1min":0.42899999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.80900000000000005,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.753}]},{"osd":4,"last update":"Sun Nov 26 07:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.34799999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.61799999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.53100000000000003,"15min":0.51300000000000001},"min":{"1min":0.39600000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.66500000000000004,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.60499999999999998}]},{"osd":5,"last update":"Sun Nov 26 07:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.55000000000000004,"15min":0.53300000000000003},"min":{"1min":0.378,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70899999999999996,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61399999999999999,"15min":0.628},"min":{"1min":0.44,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79900000000000004,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.69899999999999995}]},{"osd":6,"last update":"Sun Nov 26 07:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58699999999999997,"15min":0.58799999999999997},"min":{"1min":0.45400000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.75900000000000001,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.40699999999999997,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.73999999999999999,"5min":1.552,"15min":1.552},"last":0.64600000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574928,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339720,"statfs":{"total":96636764160,"available":96603873280,"internally_reserved":0,"allocated":958464,"data_stored":407485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52500000000000002,"15min":0.49099999999999999},"min":{"1min":0.312,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.73599999999999999,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.56899999999999995,"15min":0.498},"min":{"1min":0.34799999999999998,"5min":0.33400000000000002,"15min":0.317},"max":{"1min":2.1000000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":0.56499999999999995}]},{"osd":1,"last update":"Sun Nov 26 07:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54000000000000004,"15min":0.51700000000000002},"min":{"1min":0.33800000000000002,"5min":0.315,"15min":0.315},"max":{"1min":1.079,"5min":1.079,"15min":1.1080000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54400000000000004,"15min":0.54200000000000004},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.78500000000000003,"5min":0.83599999999999997,"15min":1.198},"last":0.63300000000000001}]},{"osd":2,"last update":"Sun Nov 26 07:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.56499999999999995,"15min":0.51100000000000001},"min":{"1min":0.375,"5min":0.307,"15min":0.307},"max":{"1min":2.2210000000000001,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57999999999999996,"15min":0.53400000000000003},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.68300000000000005}]},{"osd":3,"last update":"Sun Nov 26 07:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61099999999999999,"15min":0.56299999999999994},"min":{"1min":0.41999999999999998,"5min":0.40999999999999998,"15min":0.373},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.64200000000000002,"15min":0.59699999999999998},"min":{"1min":0.45100000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":0.70099999999999996}]},{"osd":4,"last update":"Sun Nov 26 07:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48899999999999999,"15min":0.51900000000000002},"min":{"1min":0.32200000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.58699999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56100000000000005,"15min":0.56699999999999995},"min":{"1min":0.375,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.78500000000000003}]},{"osd":5,"last update":"Sun Nov 26 07:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55700000000000005,"15min":0.55800000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.754},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.57399999999999995,"15min":0.58399999999999996},"min":{"1min":0.38500000000000001,"5min":0.311,"15min":0.311},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.72299999999999998}]},{"osd":7,"last update":"Sun Nov 26 07:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.59999999999999998,"15min":0.59399999999999997},"min":{"1min":0.371,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":2.1499999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61799999999999999,"15min":0.622},"min":{"1min":0.39700000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.81399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36276,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335564,"statfs":{"total":96636764160,"available":96599617536,"internally_reserved":0,"allocated":958464,"data_stored":407485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33800000000000002,"15min":0.35799999999999998},"min":{"1min":0.23300000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.47899999999999998,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":1.1200000000000001},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35999999999999999,"15min":0.72599999999999998},"min":{"1min":0.26800000000000002,"5min":0.214,"15min":0.214},"max":{"1min":0.45200000000000001,"5min":0.60399999999999998,"15min":11.922000000000001},"last":1.1870000000000001}]},{"osd":2,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.33500000000000002,"15min":0.36399999999999999},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.47899999999999998,"5min":0.66500000000000004,"15min":0.80300000000000005},"last":0.875},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.39400000000000002,"15min":0.40500000000000003},"min":{"1min":0.28399999999999997,"5min":0.254,"15min":0.254},"max":{"1min":0.54300000000000004,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":1.2450000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.436,"15min":0.45400000000000001},"min":{"1min":0.31,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.623,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":2.4369999999999998},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.41199999999999998,"15min":0.434},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.56799999999999995,"5min":0.62,"15min":1.101},"last":2.4809999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.60899999999999999,"15min":0.82099999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.73599999999999999,"5min":0.97299999999999998,"15min":6.8979999999999997},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64400000000000002,"15min":0.66000000000000003},"min":{"1min":0.42999999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.77100000000000002,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":1.159}]},{"osd":5,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.61099999999999999,"15min":0.624},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78500000000000003,"5min":1.2090000000000001,"15min":1.3160000000000001},"last":1.093},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60099999999999998,"15min":0.82299999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.73799999999999999,"5min":1.087,"15min":6.9480000000000004},"last":0.91700000000000004}]},{"osd":6,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.624,"15min":0.65300000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.72799999999999998,"5min":0.93100000000000005,"15min":1.194},"last":1.139},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.61299999999999999,"15min":0.84699999999999998},"min":{"1min":0.41199999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.77800000000000002,"5min":1.222,"15min":6.9800000000000004},"last":0.94999999999999996}]},{"osd":7,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.66700000000000004,"15min":0.66300000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.75600000000000001,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":1.2110000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.66700000000000004,"15min":0.68300000000000005},"min":{"1min":0.48299999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.754,"5min":3.548,"15min":3.548},"last":1.054}]}]},{"osd":0,"up_from":13,"seq":55834574926,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32696,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339144,"statfs":{"total":96636764160,"available":96603283456,"internally_reserved":0,"allocated":1552384,"data_stored":997853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.36099999999999999},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.46700000000000003,"5min":0.52600000000000002,"15min":1.5820000000000001},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.35699999999999998,"15min":0.745},"min":{"1min":0.28199999999999997,"5min":0.216,"15min":0.216},"max":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":11.987},"last":0.317}]},{"osd":2,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35899999999999999,"15min":0.41899999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.48299999999999998,"5min":0.57099999999999995,"15min":1.607},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38200000000000001,"15min":0.40799999999999997},"min":{"1min":0.27800000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.55200000000000005,"5min":0.64900000000000002,"15min":0.89600000000000002},"last":0.36799999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36299999999999999,"15min":0.38300000000000001},"min":{"1min":0.26500000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.49099999999999999,"5min":0.58899999999999997,"15min":0.752},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41199999999999998,"15min":0.46000000000000002},"min":{"1min":0.32400000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.57199999999999995,"5min":0.71699999999999997,"15min":1.6339999999999999},"last":0.39500000000000002}]},{"osd":4,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.59199999999999997,"15min":0.64200000000000002},"min":{"1min":0.36699999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.92600000000000005},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59699999999999998,"15min":0.83299999999999996},"min":{"1min":0.39900000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.81499999999999995,"5min":0.82199999999999995,"15min":6.5279999999999996},"last":0.63}]},{"osd":5,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59499999999999997,"15min":0.63800000000000001},"min":{"1min":0.42999999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83599999999999997,"5min":0.878,"15min":1.1000000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.625,"15min":0.68100000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83499999999999996,"5min":0.88400000000000001,"15min":1.508},"last":0.47999999999999998}]},{"osd":6,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.624,"15min":0.86799999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.88700000000000001,"5min":0.93400000000000005,"15min":6.5419999999999998},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61099999999999999,"15min":0.66300000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.82099999999999995,"5min":0.84399999999999997,"15min":1.3759999999999999},"last":0.56200000000000006}]},{"osd":7,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.68600000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.878,"5min":0.91000000000000003,"15min":1.1180000000000001},"last":0.497},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.61899999999999999,"15min":0.65500000000000003},"min":{"1min":0.51900000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77400000000000002,"5min":0.872,"15min":1.155},"last":0.60899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574927,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32116,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":958464,"data_stored":407485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.33300000000000002,"15min":0.34399999999999997},"min":{"1min":0.20999999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.45500000000000002,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.25},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.38600000000000001,"15min":0.39600000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.499,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.36899999999999999}]},{"osd":1,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.33300000000000002,"15min":0.34499999999999997},"min":{"1min":0.23799999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.39900000000000002,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.372,"15min":0.376},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.54800000000000004,"5min":0.58999999999999997,"15min":0.59599999999999997},"last":0.32600000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.38200000000000001,"15min":0.40600000000000003},"min":{"1min":0.29199999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.47999999999999998,"5min":0.59699999999999998,"15min":0.64700000000000002},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.375,"15min":0.38300000000000001},"min":{"1min":0.26700000000000002,"5min":0.224,"15min":0.224},"max":{"1min":0.56599999999999995,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.40899999999999997}]},{"osd":4,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.39600000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.86499999999999999,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58299999999999996},"min":{"1min":0.44,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.58599999999999997}]},{"osd":5,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59199999999999997,"15min":0.57999999999999996},"min":{"1min":0.45300000000000001,"5min":0.39500000000000002,"15min":0.36899999999999999},"max":{"1min":0.85099999999999998,"5min":0.87,"15min":0.87},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59099999999999997,"15min":0.623},"min":{"1min":0.41999999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78200000000000003,"5min":0.86299999999999999,"15min":1.002},"last":0.75}]},{"osd":6,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.61699999999999999,"15min":0.61399999999999999},"min":{"1min":0.432,"5min":0.40999999999999998,"15min":0.38800000000000001},"max":{"1min":0.75700000000000001,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.629,"15min":0.63500000000000001},"min":{"1min":0.48999999999999999,"5min":0.44400000000000001,"15min":0.439},"max":{"1min":0.91700000000000004,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.61299999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61099999999999999,"15min":0.626},"min":{"1min":0.44,"5min":0.41999999999999998,"15min":0.40600000000000003},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.621,"15min":0.623},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85199999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.63}]}]},{"osd":3,"up_from":13,"seq":55834574927,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32116,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":958464,"data_stored":407485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.32900000000000001,"15min":0.36099999999999999},"min":{"1min":0.23300000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":1.3500000000000001},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35899999999999999,"15min":0.40699999999999997},"min":{"1min":0.25900000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.54900000000000004,"5min":0.61299999999999999,"15min":1.6619999999999999},"last":0.26100000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.33800000000000002,"15min":0.39100000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.41599999999999998,"5min":0.58799999999999997,"15min":1.2010000000000001},"last":0.314},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.38700000000000001,"15min":0.48299999999999998},"min":{"1min":0.30499999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.56599999999999995,"5min":0.629,"15min":2.903},"last":0.38}]},{"osd":2,"last update":"Sun Nov 26 07:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.375,"15min":0.39800000000000002},"min":{"1min":0.26100000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.52000000000000002,"5min":0.57399999999999995,"15min":1.1240000000000001},"last":0.437},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.39300000000000002,"15min":0.41399999999999998},"min":{"1min":0.28799999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.51900000000000002,"5min":0.63700000000000001,"15min":1.2290000000000001},"last":0.36499999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.60799999999999998,"15min":0.69199999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.82699999999999996,"5min":0.96799999999999997,"15min":2.9609999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60899999999999999,"15min":0.63600000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.85899999999999999,"5min":1.1499999999999999,"15min":1.163},"last":0.74099999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.621,"15min":0.66300000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.88800000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.624,"15min":0.65800000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.877,"5min":0.93999999999999995,"15min":1.2829999999999999},"last":0.78700000000000003}]},{"osd":6,"last update":"Sun Nov 26 07:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.64300000000000002,"15min":0.67100000000000004},"min":{"1min":0.39400000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":2.6040000000000001,"5min":2.6040000000000001,"15min":2.6040000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.63800000000000001,"15min":0.67400000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.258},"last":0.71899999999999997}]},{"osd":7,"last update":"Sun Nov 26 07:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63200000000000001,"15min":0.67600000000000005},"min":{"1min":0.438,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.875,"5min":1.014,"15min":1.3069999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.65300000000000002,"15min":0.73699999999999999},"min":{"1min":0.44800000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90100000000000002,"5min":1.0780000000000001,"15min":2.9969999999999999},"last":0.755}]}]},{"osd":4,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32116,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":958464,"data_stored":407485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.55100000000000005,"15min":0.85099999999999998},"min":{"1min":0.32900000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.68899999999999995,"5min":0.87,"15min":8.7539999999999996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59199999999999997,"15min":0.875},"min":{"1min":0.35299999999999998,"5min":0.316,"15min":0.316},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":8.7390000000000008},"last":0.623}]},{"osd":1,"last update":"Sun Nov 26 07:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.56100000000000005,"15min":0.89300000000000002},"min":{"1min":0.32700000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.68300000000000005,"5min":0.81200000000000006,"15min":9.7720000000000002},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.55000000000000004,"15min":0.56399999999999995},"min":{"1min":0.33600000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.72899999999999998,"5min":0.80000000000000004,"15min":0.88700000000000001},"last":0.40100000000000002}]},{"osd":2,"last update":"Sun Nov 26 07:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54100000000000004,"15min":0.85099999999999998},"min":{"1min":0.39900000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.78600000000000003,"5min":0.80100000000000005,"15min":9.8119999999999994},"last":0.498},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58599999999999997,"15min":0.78300000000000003},"min":{"1min":0.36899999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67600000000000005,"5min":0.85499999999999998,"15min":3.645},"last":0.54400000000000004}]},{"osd":3,"last update":"Sun Nov 26 07:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59599999999999997,"15min":0.89800000000000002},"min":{"1min":0.41899999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.69999999999999996,"5min":0.81299999999999994,"15min":8.8089999999999993},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.59799999999999998,"15min":0.60199999999999998},"min":{"1min":0.371,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82099999999999995,"5min":0.83899999999999997,"15min":1.0720000000000001},"last":0.44500000000000001}]},{"osd":5,"last update":"Sun Nov 26 07:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55600000000000005,"15min":0.51600000000000001},"min":{"1min":0.32800000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72099999999999997,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55900000000000005,"15min":0.55300000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.60599999999999998}]},{"osd":6,"last update":"Sun Nov 26 07:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.58499999999999996},"min":{"1min":0.375,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.78800000000000003,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56399999999999995,"15min":0.57199999999999995},"min":{"1min":0.36199999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.57599999999999996}]},{"osd":7,"last update":"Sun Nov 26 07:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60599999999999998,"15min":0.59799999999999998},"min":{"1min":0.41299999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61699999999999999,"15min":0.60799999999999998},"min":{"1min":0.40899999999999997,"5min":0.38300000000000001,"15min":0.38200000000000001},"max":{"1min":0.89500000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.52700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574928,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339720,"statfs":{"total":96636764160,"available":96603873280,"internally_reserved":0,"allocated":958464,"data_stored":407485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.58599999999999997,"15min":0.54000000000000004},"min":{"1min":0.40200000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.65300000000000002,"5min":7.1500000000000004,"15min":7.1500000000000004},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.58999999999999997,"15min":0.56999999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78500000000000003,"5min":6.8470000000000004,"15min":6.8470000000000004},"last":0.56699999999999995}]},{"osd":1,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.58299999999999996,"15min":0.55500000000000005},"min":{"1min":0.32300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69599999999999995,"5min":7.1269999999999998,"15min":7.1269999999999998},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73499999999999999,"5min":1.514,"15min":1.514},"last":0.68100000000000005}]},{"osd":2,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.63200000000000001,"15min":0.59399999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.71499999999999997,"5min":7.2000000000000002,"15min":7.2000000000000002},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.65500000000000003,"15min":0.61799999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73699999999999999,"5min":7.8259999999999996,"15min":7.8259999999999996},"last":0.66800000000000004}]},{"osd":3,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.59899999999999998,"15min":0.57099999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79800000000000004,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.65000000000000002,"15min":0.60799999999999998},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72899999999999998,"5min":6.9240000000000004,"15min":6.9240000000000004},"last":0.53300000000000003}]},{"osd":4,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.56799999999999995,"15min":0.51400000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.68700000000000006,"5min":7.2830000000000004,"15min":7.2830000000000004},"last":0.442},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.83399999999999996,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.54600000000000004}]},{"osd":6,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.61899999999999999,"15min":0.57099999999999995},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.75600000000000001,"5min":6.8890000000000002,"15min":6.8890000000000002},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.63,"15min":0.58899999999999997},"min":{"1min":0.40300000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.72899999999999998,"5min":7.2430000000000003,"15min":7.2430000000000003},"last":0.503}]},{"osd":7,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.65900000000000003,"15min":0.60899999999999999},"min":{"1min":0.41299999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.86699999999999999,"5min":6.9880000000000004,"15min":6.9880000000000004},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.72399999999999998,"15min":0.65600000000000003},"min":{"1min":0.40300000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.77100000000000002,"5min":11.874000000000001,"15min":11.874000000000001},"last":0.48399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:17:45.469 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-26T07:17:45.469 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:17:45.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.592+0000 7f3fb56b0700 1 Processor -- start 2023-11-26T07:17:45.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.592+0000 7f3fb56b0700 1 -- start start 2023-11-26T07:17:45.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.593+0000 7f3fb56b0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fb015e460 0x7f3fb00d49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:45.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.593+0000 7f3fb56b0700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3fb00d2ba0 0x7f3fb00b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:45.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.593+0000 7f3fb56b0700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fb00b3370 con 0x7f3fb00cf480 2023-11-26T07:17:45.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.593+0000 7f3fb56b0700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb00cfc40 con 0x7f3fb00d2ba0 2023-11-26T07:17:45.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.593+0000 7f3fb56b0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb00b35c0 con 0x7f3fb015e460 2023-11-26T07:17:45.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.593+0000 7f3faf7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3fb00d2ba0 0x7f3fb00b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:45.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.593+0000 7f3faf7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3fb00d2ba0 0x7f3fb00b40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45240/0 (socket says 172.21.15.2:45240) 2023-11-26T07:17:45.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.593+0000 7f3faf7fe700 1 -- 172.21.15.2:0/2711017051 learned_addr learned my addr 172.21.15.2:0/2711017051 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:45.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.593+0000 7f3faeffd700 1 --2- 172.21.15.2:0/2711017051 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fb015e460 0x7f3fb00d49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:45.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.593+0000 7f3faf7fe700 1 -- 172.21.15.2:0/2711017051 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fb015e460 msgr2=0x7f3fb00d49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:45.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.593+0000 7f3faf7fe700 1 --2- 172.21.15.2:0/2711017051 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fb015e460 0x7f3fb00d49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.593+0000 7f3faf7fe700 1 -- 172.21.15.2:0/2711017051 >> v1:172.21.15.192:6789/0 conn(0x7f3fb00cf480 legacy=0x7f3fb00d2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:45.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.593+0000 7f3faf7fe700 1 -- 172.21.15.2:0/2711017051 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb00b38a0 con 0x7f3fb00d2ba0 2023-11-26T07:17:45.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.593+0000 7f3faf7fe700 1 --2- 172.21.15.2:0/2711017051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fb00d2ba0 0x7f3fb00b40a0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8009e50 tx=0x7f3fa800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b37213843ef9370f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:45.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.594+0000 7f3fadffb700 1 -- 172.21.15.2:0/2711017051 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa800e070 con 0x7f3fb00d2ba0 2023-11-26T07:17:45.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.594+0000 7f3fadffb700 1 -- 172.21.15.2:0/2711017051 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa8003a20 con 0x7f3fb00d2ba0 2023-11-26T07:17:45.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.594+0000 7f3fadffb700 1 -- 172.21.15.2:0/2711017051 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa8003dd0 con 0x7f3fb00d2ba0 2023-11-26T07:17:45.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.594+0000 7f3fb56b0700 1 -- 172.21.15.2:0/2711017051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fb00d2ba0 msgr2=0x7f3fb00b40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:45.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.594+0000 7f3fb56b0700 1 --2- 172.21.15.2:0/2711017051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fb00d2ba0 0x7f3fb00b40a0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8009e50 tx=0x7f3fa800b330 comp rx=0 tx=0).stop 2023-11-26T07:17:45.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.594+0000 7f3fb56b0700 1 -- 172.21.15.2:0/2711017051 shutdown_connections 2023-11-26T07:17:45.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.594+0000 7f3fb56b0700 1 --2- 172.21.15.2:0/2711017051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fb00d2ba0 0x7f3fb00b40a0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.594+0000 7f3fb56b0700 1 --2- 172.21.15.2:0/2711017051 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fb015e460 0x7f3fb00d49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.594+0000 7f3fb56b0700 1 -- 172.21.15.2:0/2711017051 >> 172.21.15.2:0/2711017051 conn(0x7f3fb00d3eb0 msgr2=0x7f3fb00d42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:45.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.594+0000 7f3fb56b0700 1 -- 172.21.15.2:0/2711017051 shutdown_connections 2023-11-26T07:17:45.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.594+0000 7f3fb56b0700 1 -- 172.21.15.2:0/2711017051 wait complete. 2023-11-26T07:17:45.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.596+0000 7f3fb56b0700 1 Processor -- start 2023-11-26T07:17:45.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.596+0000 7f3fb56b0700 1 -- start start 2023-11-26T07:17:45.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.596+0000 7f3fb56b0700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fb00cf480 0x7f3fb0158520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:45.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.596+0000 7f3fb56b0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fb00d2ba0 0x7f3fb00cd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:45.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.596+0000 7f3fb56b0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fb015e460 0x7f3fb00b1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:45.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.597+0000 7f3fb56b0700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb015a540 con 0x7f3fb00d2ba0 2023-11-26T07:17:45.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.597+0000 7f3fb56b0700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb0158a60 con 0x7f3fb00cf480 2023-11-26T07:17:45.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.597+0000 7f3fb56b0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb0159930 con 0x7f3fb015e460 2023-11-26T07:17:45.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.597+0000 7f3fae7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fb00d2ba0 0x7f3fb00cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:45.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.597+0000 7f3fae7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fb00d2ba0 0x7f3fb00cd900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45242/0 (socket says 172.21.15.2:45242) 2023-11-26T07:17:45.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.597+0000 7f3fae7fc700 1 -- 172.21.15.2:0/3738834763 learned_addr learned my addr 172.21.15.2:0/3738834763 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:45.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.597+0000 7f3faeffd700 1 --2- 172.21.15.2:0/3738834763 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fb00cf480 0x7f3fb0158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:45.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.597+0000 7f3faf7fe700 1 --2- 172.21.15.2:0/3738834763 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fb015e460 0x7f3fb00b1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:45.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.597+0000 7f3fae7fc700 1 -- 172.21.15.2:0/3738834763 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fb015e460 msgr2=0x7f3fb00b1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:45.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.597+0000 7f3fae7fc700 1 --2- 172.21.15.2:0/3738834763 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fb015e460 0x7f3fb00b1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.597+0000 7f3fae7fc700 1 -- 172.21.15.2:0/3738834763 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fb00cf480 msgr2=0x7f3fb0158520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:45.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.597+0000 7f3fae7fc700 1 --2- 172.21.15.2:0/3738834763 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fb00cf480 0x7f3fb0158520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.597+0000 7f3fae7fc700 1 -- 172.21.15.2:0/3738834763 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa8009b30 con 0x7f3fb00d2ba0 2023-11-26T07:17:45.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.597+0000 7f3fae7fc700 1 --2- 172.21.15.2:0/3738834763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fb00d2ba0 0x7f3fb00cd900 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f3fa000c4d0 tx=0x7f3fa000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:45.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.597+0000 7f3f977fe700 1 -- 172.21.15.2:0/3738834763 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa0011790 con 0x7f3fb00d2ba0 2023-11-26T07:17:45.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.597+0000 7f3f977fe700 1 -- 172.21.15.2:0/3738834763 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa00118f0 con 0x7f3fb00d2ba0 2023-11-26T07:17:45.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.597+0000 7f3fb56b0700 1 -- 172.21.15.2:0/3738834763 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb0159c10 con 0x7f3fb00d2ba0 2023-11-26T07:17:45.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.597+0000 7f3f977fe700 1 -- 172.21.15.2:0/3738834763 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa0011ca0 con 0x7f3fb00d2ba0 2023-11-26T07:17:45.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.597+0000 7f3fb56b0700 1 -- 172.21.15.2:0/3738834763 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fb015a1d0 con 0x7f3fb00d2ba0 2023-11-26T07:17:45.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.598+0000 7f3fb56b0700 1 -- 172.21.15.2:0/3738834763 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fb00cf010 con 0x7f3fb00d2ba0 2023-11-26T07:17:45.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.599+0000 7f3f977fe700 1 -- 172.21.15.2:0/3738834763 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f3fa001c460 con 0x7f3fb00d2ba0 2023-11-26T07:17:45.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.599+0000 7f3f977fe700 1 --2- 172.21.15.2:0/3738834763 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3f9c06b980 0x7f3f9c06de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:45.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.599+0000 7f3f977fe700 1 -- 172.21.15.2:0/3738834763 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3fa0087c20 con 0x7f3fb00d2ba0 2023-11-26T07:17:45.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.600+0000 7f3faeffd700 1 --2- 172.21.15.2:0/3738834763 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3f9c06b980 0x7f3f9c06de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:45.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.600+0000 7f3faeffd700 1 --2- 172.21.15.2:0/3738834763 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3f9c06b980 0x7f3f9c06de40 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4006fd0 tx=0x7f3fa4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:45.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.604+0000 7f3f977fe700 1 -- 172.21.15.2:0/3738834763 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3fa0054780 con 0x7f3fb00d2ba0 2023-11-26T07:17:45.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.801+0000 7f3fb56b0700 1 -- 172.21.15.2:0/3738834763 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3fb00cf900 con 0x7f3f9c06b980 2023-11-26T07:17:45.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.804+0000 7f3f977fe700 1 -- 172.21.15.2:0/3738834763 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50625 (secure 0 0 0) 0x7f3fa400c040 con 0x7f3f9c06b980 2023-11-26T07:17:45.807 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:17:45.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.806+0000 7f3fb56b0700 1 -- 172.21.15.2:0/3738834763 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3f9c06b980 msgr2=0x7f3f9c06de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:45.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.806+0000 7f3fb56b0700 1 --2- 172.21.15.2:0/3738834763 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3f9c06b980 0x7f3f9c06de40 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4006fd0 tx=0x7f3fa4008040 comp rx=0 tx=0).stop 2023-11-26T07:17:45.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.806+0000 7f3fb56b0700 1 -- 172.21.15.2:0/3738834763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fb00d2ba0 msgr2=0x7f3fb00cd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:45.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.806+0000 7f3fb56b0700 1 --2- 172.21.15.2:0/3738834763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fb00d2ba0 0x7f3fb00cd900 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f3fa000c4d0 tx=0x7f3fa000c7e0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.806+0000 7f3fb56b0700 1 -- 172.21.15.2:0/3738834763 shutdown_connections 2023-11-26T07:17:45.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.806+0000 7f3fb56b0700 1 --2- 172.21.15.2:0/3738834763 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f3f9c06b980 0x7f3f9c06de40 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.806+0000 7f3fb56b0700 1 --2- 172.21.15.2:0/3738834763 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fb015e460 0x7f3fb00b1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.806+0000 7f3fb56b0700 1 --2- 172.21.15.2:0/3738834763 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fb00cf480 0x7f3fb0158520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.806+0000 7f3fb56b0700 1 --2- 172.21.15.2:0/3738834763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fb00d2ba0 0x7f3fb00cd900 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.806+0000 7f3fb56b0700 1 -- 172.21.15.2:0/3738834763 >> 172.21.15.2:0/3738834763 conn(0x7f3fb00d3eb0 msgr2=0x7f3fb006c960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:45.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.806+0000 7f3fb56b0700 1 -- 172.21.15.2:0/3738834763 shutdown_connections 2023-11-26T07:17:45.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.806+0000 7f3fb56b0700 1 -- 172.21.15.2:0/3738834763 wait complete. 2023-11-26T07:17:45.810 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-26T07:17:45.820 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":260,"stamp":"2023-11-26T07:17:44.248132+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":128,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":262264,"kb_used_data":8648,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754712456,"statfs":{"total":773094113280,"available":772825554944,"internally_reserved":0,"allocated":8855552,"data_stored":4440616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-422261476,"num_objects":-427,"num_object_clones":-1,"num_object_copies":-854,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-427,"num_whiteouts":-1,"num_read":-209,"num_read_kb":-204809,"num_write":-940,"num_write_kb":-412672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-7,"num_bytes_recovered":-7340032,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.139626"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":217,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-26T07:17:39.385054+0000","last_change":"2023-11-26T07:11:29.855919+0000","last_active":"2023-11-26T07:17:39.385054+0000","last_peered":"2023-11-26T07:17:39.385054+0000","last_clean":"2023-11-26T07:17:39.385054+0000","last_became_active":"2023-11-26T07:11:29.854903+0000","last_became_peered":"2023-11-26T07:11:29.854903+0000","last_unstale":"2023-11-26T07:17:39.385054+0000","last_undegraded":"2023-11-26T07:17:39.385054+0000","last_fullsized":"2023-11-26T07:17:39.385054+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:28.594252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:28.594252+0000","last_clean_scrub_stamp":"2023-11-26T07:11:28.594252+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:33:34.642696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574928,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32704,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339136,"statfs":{"total":96636764160,"available":96603275264,"internally_reserved":0,"allocated":1552384,"data_stored":997853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.53200000000000003,"15min":0.53400000000000003},"min":{"1min":0.33800000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.72099999999999997,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.51700000000000002,"15min":0.50700000000000001},"min":{"1min":0.35399999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.57899999999999996}]},{"osd":1,"last update":"Sun Nov 26 07:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.65300000000000002,"15min":0.91500000000000004},"min":{"1min":0.44600000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76600000000000001,"5min":9.5600000000000005,"15min":9.5600000000000005},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.55100000000000005,"15min":0.57399999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.71799999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.628}]},{"osd":2,"last update":"Sun Nov 26 07:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58399999999999996,"15min":0.59799999999999998},"min":{"1min":0.42599999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.68100000000000005,"5min":1.569,"15min":1.569},"last":0.5},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61399999999999999,"15min":0.64100000000000001},"min":{"1min":0.44900000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84599999999999997,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.80300000000000005}]},{"osd":3,"last update":"Sun Nov 26 07:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.56499999999999995,"15min":0.59399999999999997},"min":{"1min":0.33900000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70599999999999996,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58399999999999996,"15min":0.56799999999999995},"min":{"1min":0.42899999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.80900000000000005,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.753}]},{"osd":4,"last update":"Sun Nov 26 07:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.34799999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.61799999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.53100000000000003,"15min":0.51300000000000001},"min":{"1min":0.39600000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.66500000000000004,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.60499999999999998}]},{"osd":5,"last update":"Sun Nov 26 07:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.55000000000000004,"15min":0.53300000000000003},"min":{"1min":0.378,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70899999999999996,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61399999999999999,"15min":0.628},"min":{"1min":0.44,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79900000000000004,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.69899999999999995}]},{"osd":6,"last update":"Sun Nov 26 07:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58699999999999997,"15min":0.58799999999999997},"min":{"1min":0.45400000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.75900000000000001,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.40699999999999997,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.73999999999999999,"5min":1.552,"15min":1.552},"last":0.64600000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574928,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339720,"statfs":{"total":96636764160,"available":96603873280,"internally_reserved":0,"allocated":958464,"data_stored":407485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52500000000000002,"15min":0.49099999999999999},"min":{"1min":0.312,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.73599999999999999,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.56899999999999995,"15min":0.498},"min":{"1min":0.34799999999999998,"5min":0.33400000000000002,"15min":0.317},"max":{"1min":2.1000000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":0.56499999999999995}]},{"osd":1,"last update":"Sun Nov 26 07:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54000000000000004,"15min":0.51700000000000002},"min":{"1min":0.33800000000000002,"5min":0.315,"15min":0.315},"max":{"1min":1.079,"5min":1.079,"15min":1.1080000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54400000000000004,"15min":0.54200000000000004},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.78500000000000003,"5min":0.83599999999999997,"15min":1.198},"last":0.63300000000000001}]},{"osd":2,"last update":"Sun Nov 26 07:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.56499999999999995,"15min":0.51100000000000001},"min":{"1min":0.375,"5min":0.307,"15min":0.307},"max":{"1min":2.2210000000000001,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57999999999999996,"15min":0.53400000000000003},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.68300000000000005}]},{"osd":3,"last update":"Sun Nov 26 07:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61099999999999999,"15min":0.56299999999999994},"min":{"1min":0.41999999999999998,"5min":0.40999999999999998,"15min":0.373},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.64200000000000002,"15min":0.59699999999999998},"min":{"1min":0.45100000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":0.70099999999999996}]},{"osd":4,"last update":"Sun Nov 26 07:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48899999999999999,"15min":0.51900000000000002},"min":{"1min":0.32200000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.58699999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56100000000000005,"15min":0.56699999999999995},"min":{"1min":0.375,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.78500000000000003}]},{"osd":5,"last update":"Sun Nov 26 07:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55700000000000005,"15min":0.55800000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.754},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.57399999999999995,"15min":0.58399999999999996},"min":{"1min":0.38500000000000001,"5min":0.311,"15min":0.311},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.72299999999999998}]},{"osd":7,"last update":"Sun Nov 26 07:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.59999999999999998,"15min":0.59399999999999997},"min":{"1min":0.371,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":2.1499999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61799999999999999,"15min":0.622},"min":{"1min":0.39700000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.81399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36276,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335564,"statfs":{"total":96636764160,"available":96599617536,"internally_reserved":0,"allocated":958464,"data_stored":407485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33800000000000002,"15min":0.35799999999999998},"min":{"1min":0.23300000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.47899999999999998,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":1.1200000000000001},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35999999999999999,"15min":0.72599999999999998},"min":{"1min":0.26800000000000002,"5min":0.214,"15min":0.214},"max":{"1min":0.45200000000000001,"5min":0.60399999999999998,"15min":11.922000000000001},"last":1.1870000000000001}]},{"osd":2,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.33500000000000002,"15min":0.36399999999999999},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.47899999999999998,"5min":0.66500000000000004,"15min":0.80300000000000005},"last":0.875},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.39400000000000002,"15min":0.40500000000000003},"min":{"1min":0.28399999999999997,"5min":0.254,"15min":0.254},"max":{"1min":0.54300000000000004,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":1.2450000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.436,"15min":0.45400000000000001},"min":{"1min":0.31,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.623,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":2.4369999999999998},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.41199999999999998,"15min":0.434},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.56799999999999995,"5min":0.62,"15min":1.101},"last":2.4809999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.60899999999999999,"15min":0.82099999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.73599999999999999,"5min":0.97299999999999998,"15min":6.8979999999999997},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64400000000000002,"15min":0.66000000000000003},"min":{"1min":0.42999999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.77100000000000002,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":1.159}]},{"osd":5,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.61099999999999999,"15min":0.624},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78500000000000003,"5min":1.2090000000000001,"15min":1.3160000000000001},"last":1.093},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60099999999999998,"15min":0.82299999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.73799999999999999,"5min":1.087,"15min":6.9480000000000004},"last":0.91700000000000004}]},{"osd":6,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.624,"15min":0.65300000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.72799999999999998,"5min":0.93100000000000005,"15min":1.194},"last":1.139},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.61299999999999999,"15min":0.84699999999999998},"min":{"1min":0.41199999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.77800000000000002,"5min":1.222,"15min":6.9800000000000004},"last":0.94999999999999996}]},{"osd":7,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.66700000000000004,"15min":0.66300000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.75600000000000001,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":1.2110000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.66700000000000004,"15min":0.68300000000000005},"min":{"1min":0.48299999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.754,"5min":3.548,"15min":3.548},"last":1.054}]}]},{"osd":0,"up_from":13,"seq":55834574926,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32696,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339144,"statfs":{"total":96636764160,"available":96603283456,"internally_reserved":0,"allocated":1552384,"data_stored":997853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.36099999999999999},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.46700000000000003,"5min":0.52600000000000002,"15min":1.5820000000000001},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.35699999999999998,"15min":0.745},"min":{"1min":0.28199999999999997,"5min":0.216,"15min":0.216},"max":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":11.987},"last":0.317}]},{"osd":2,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35899999999999999,"15min":0.41899999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.48299999999999998,"5min":0.57099999999999995,"15min":1.607},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38200000000000001,"15min":0.40799999999999997},"min":{"1min":0.27800000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.55200000000000005,"5min":0.64900000000000002,"15min":0.89600000000000002},"last":0.36799999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36299999999999999,"15min":0.38300000000000001},"min":{"1min":0.26500000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.49099999999999999,"5min":0.58899999999999997,"15min":0.752},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41199999999999998,"15min":0.46000000000000002},"min":{"1min":0.32400000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.57199999999999995,"5min":0.71699999999999997,"15min":1.6339999999999999},"last":0.39500000000000002}]},{"osd":4,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.59199999999999997,"15min":0.64200000000000002},"min":{"1min":0.36699999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.92600000000000005},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59699999999999998,"15min":0.83299999999999996},"min":{"1min":0.39900000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.81499999999999995,"5min":0.82199999999999995,"15min":6.5279999999999996},"last":0.63}]},{"osd":5,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59499999999999997,"15min":0.63800000000000001},"min":{"1min":0.42999999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83599999999999997,"5min":0.878,"15min":1.1000000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.625,"15min":0.68100000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83499999999999996,"5min":0.88400000000000001,"15min":1.508},"last":0.47999999999999998}]},{"osd":6,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.624,"15min":0.86799999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.88700000000000001,"5min":0.93400000000000005,"15min":6.5419999999999998},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61099999999999999,"15min":0.66300000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.82099999999999995,"5min":0.84399999999999997,"15min":1.3759999999999999},"last":0.56200000000000006}]},{"osd":7,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.68600000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.878,"5min":0.91000000000000003,"15min":1.1180000000000001},"last":0.497},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.61899999999999999,"15min":0.65500000000000003},"min":{"1min":0.51900000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77400000000000002,"5min":0.872,"15min":1.155},"last":0.60899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574927,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32116,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":958464,"data_stored":407485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.33300000000000002,"15min":0.34399999999999997},"min":{"1min":0.20999999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.45500000000000002,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.25},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.38600000000000001,"15min":0.39600000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.499,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.36899999999999999}]},{"osd":1,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.33300000000000002,"15min":0.34499999999999997},"min":{"1min":0.23799999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.39900000000000002,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.372,"15min":0.376},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.54800000000000004,"5min":0.58999999999999997,"15min":0.59599999999999997},"last":0.32600000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.38200000000000001,"15min":0.40600000000000003},"min":{"1min":0.29199999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.47999999999999998,"5min":0.59699999999999998,"15min":0.64700000000000002},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.375,"15min":0.38300000000000001},"min":{"1min":0.26700000000000002,"5min":0.224,"15min":0.224},"max":{"1min":0.56599999999999995,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.40899999999999997}]},{"osd":4,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.39600000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.86499999999999999,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58299999999999996},"min":{"1min":0.44,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.58599999999999997}]},{"osd":5,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59199999999999997,"15min":0.57999999999999996},"min":{"1min":0.45300000000000001,"5min":0.39500000000000002,"15min":0.36899999999999999},"max":{"1min":0.85099999999999998,"5min":0.87,"15min":0.87},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59099999999999997,"15min":0.623},"min":{"1min":0.41999999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78200000000000003,"5min":0.86299999999999999,"15min":1.002},"last":0.75}]},{"osd":6,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.61699999999999999,"15min":0.61399999999999999},"min":{"1min":0.432,"5min":0.40999999999999998,"15min":0.38800000000000001},"max":{"1min":0.75700000000000001,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.629,"15min":0.63500000000000001},"min":{"1min":0.48999999999999999,"5min":0.44400000000000001,"15min":0.439},"max":{"1min":0.91700000000000004,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.61299999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61099999999999999,"15min":0.626},"min":{"1min":0.44,"5min":0.41999999999999998,"15min":0.40600000000000003},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.621,"15min":0.623},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85199999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.63}]}]},{"osd":3,"up_from":13,"seq":55834574927,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32116,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":958464,"data_stored":407485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.32900000000000001,"15min":0.36099999999999999},"min":{"1min":0.23300000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":1.3500000000000001},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35899999999999999,"15min":0.40699999999999997},"min":{"1min":0.25900000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.54900000000000004,"5min":0.61299999999999999,"15min":1.6619999999999999},"last":0.26100000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.33800000000000002,"15min":0.39100000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.41599999999999998,"5min":0.58799999999999997,"15min":1.2010000000000001},"last":0.314},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.38700000000000001,"15min":0.48299999999999998},"min":{"1min":0.30499999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.56599999999999995,"5min":0.629,"15min":2.903},"last":0.38}]},{"osd":2,"last update":"Sun Nov 26 07:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.375,"15min":0.39800000000000002},"min":{"1min":0.26100000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.52000000000000002,"5min":0.57399999999999995,"15min":1.1240000000000001},"last":0.437},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.39300000000000002,"15min":0.41399999999999998},"min":{"1min":0.28799999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.51900000000000002,"5min":0.63700000000000001,"15min":1.2290000000000001},"last":0.36499999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.60799999999999998,"15min":0.69199999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.82699999999999996,"5min":0.96799999999999997,"15min":2.9609999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60899999999999999,"15min":0.63600000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.85899999999999999,"5min":1.1499999999999999,"15min":1.163},"last":0.74099999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.621,"15min":0.66300000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.88800000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.624,"15min":0.65800000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.877,"5min":0.93999999999999995,"15min":1.2829999999999999},"last":0.78700000000000003}]},{"osd":6,"last update":"Sun Nov 26 07:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.64300000000000002,"15min":0.67100000000000004},"min":{"1min":0.39400000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":2.6040000000000001,"5min":2.6040000000000001,"15min":2.6040000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.63800000000000001,"15min":0.67400000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.258},"last":0.71899999999999997}]},{"osd":7,"last update":"Sun Nov 26 07:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63200000000000001,"15min":0.67600000000000005},"min":{"1min":0.438,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.875,"5min":1.014,"15min":1.3069999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.65300000000000002,"15min":0.73699999999999999},"min":{"1min":0.44800000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90100000000000002,"5min":1.0780000000000001,"15min":2.9969999999999999},"last":0.755}]}]},{"osd":4,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32116,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":958464,"data_stored":407485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.55100000000000005,"15min":0.85099999999999998},"min":{"1min":0.32900000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.68899999999999995,"5min":0.87,"15min":8.7539999999999996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59199999999999997,"15min":0.875},"min":{"1min":0.35299999999999998,"5min":0.316,"15min":0.316},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":8.7390000000000008},"last":0.623}]},{"osd":1,"last update":"Sun Nov 26 07:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.56100000000000005,"15min":0.89300000000000002},"min":{"1min":0.32700000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.68300000000000005,"5min":0.81200000000000006,"15min":9.7720000000000002},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.55000000000000004,"15min":0.56399999999999995},"min":{"1min":0.33600000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.72899999999999998,"5min":0.80000000000000004,"15min":0.88700000000000001},"last":0.40100000000000002}]},{"osd":2,"last update":"Sun Nov 26 07:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54100000000000004,"15min":0.85099999999999998},"min":{"1min":0.39900000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.78600000000000003,"5min":0.80100000000000005,"15min":9.8119999999999994},"last":0.498},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58599999999999997,"15min":0.78300000000000003},"min":{"1min":0.36899999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67600000000000005,"5min":0.85499999999999998,"15min":3.645},"last":0.54400000000000004}]},{"osd":3,"last update":"Sun Nov 26 07:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59599999999999997,"15min":0.89800000000000002},"min":{"1min":0.41899999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.69999999999999996,"5min":0.81299999999999994,"15min":8.8089999999999993},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.59799999999999998,"15min":0.60199999999999998},"min":{"1min":0.371,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82099999999999995,"5min":0.83899999999999997,"15min":1.0720000000000001},"last":0.44500000000000001}]},{"osd":5,"last update":"Sun Nov 26 07:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55600000000000005,"15min":0.51600000000000001},"min":{"1min":0.32800000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72099999999999997,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55900000000000005,"15min":0.55300000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.60599999999999998}]},{"osd":6,"last update":"Sun Nov 26 07:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.58499999999999996},"min":{"1min":0.375,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.78800000000000003,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56399999999999995,"15min":0.57199999999999995},"min":{"1min":0.36199999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.57599999999999996}]},{"osd":7,"last update":"Sun Nov 26 07:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60599999999999998,"15min":0.59799999999999998},"min":{"1min":0.41299999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61699999999999999,"15min":0.60799999999999998},"min":{"1min":0.40899999999999997,"5min":0.38300000000000001,"15min":0.38200000000000001},"max":{"1min":0.89500000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.52700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574928,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339720,"statfs":{"total":96636764160,"available":96603873280,"internally_reserved":0,"allocated":958464,"data_stored":407485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.58599999999999997,"15min":0.54000000000000004},"min":{"1min":0.40200000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.65300000000000002,"5min":7.1500000000000004,"15min":7.1500000000000004},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.58999999999999997,"15min":0.56999999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78500000000000003,"5min":6.8470000000000004,"15min":6.8470000000000004},"last":0.56699999999999995}]},{"osd":1,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.58299999999999996,"15min":0.55500000000000005},"min":{"1min":0.32300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69599999999999995,"5min":7.1269999999999998,"15min":7.1269999999999998},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73499999999999999,"5min":1.514,"15min":1.514},"last":0.68100000000000005}]},{"osd":2,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.63200000000000001,"15min":0.59399999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.71499999999999997,"5min":7.2000000000000002,"15min":7.2000000000000002},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.65500000000000003,"15min":0.61799999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73699999999999999,"5min":7.8259999999999996,"15min":7.8259999999999996},"last":0.66800000000000004}]},{"osd":3,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.59899999999999998,"15min":0.57099999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79800000000000004,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.65000000000000002,"15min":0.60799999999999998},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72899999999999998,"5min":6.9240000000000004,"15min":6.9240000000000004},"last":0.53300000000000003}]},{"osd":4,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.56799999999999995,"15min":0.51400000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.68700000000000006,"5min":7.2830000000000004,"15min":7.2830000000000004},"last":0.442},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.83399999999999996,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.54600000000000004}]},{"osd":6,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.61899999999999999,"15min":0.57099999999999995},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.75600000000000001,"5min":6.8890000000000002,"15min":6.8890000000000002},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.63,"15min":0.58899999999999997},"min":{"1min":0.40300000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.72899999999999998,"5min":7.2430000000000003,"15min":7.2430000000000003},"last":0.503}]},{"osd":7,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.65900000000000003,"15min":0.60899999999999999},"min":{"1min":0.41299999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.86699999999999999,"5min":6.9880000000000004,"15min":6.9880000000000004},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.72399999999999998,"15min":0.65600000000000003},"min":{"1min":0.40300000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.77100000000000002,"5min":11.874000000000001,"15min":11.874000000000001},"last":0.48399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:17:45.822 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:17:45.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.945+0000 7fea756a9700 1 Processor -- start 2023-11-26T07:17:45.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.945+0000 7fea756a9700 1 -- start start 2023-11-26T07:17:45.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.946+0000 7fea756a9700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fea700d2b50 0x7fea700cfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:45.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.946+0000 7fea756a9700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fea700d0740 0x7fea700d0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:45.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.946+0000 7fea756a9700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea700ce9a0 con 0x7fea7015e080 2023-11-26T07:17:45.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.946+0000 7fea756a9700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea700d14b0 con 0x7fea700d0740 2023-11-26T07:17:45.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.946+0000 7fea756a9700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea700cec40 con 0x7fea700d2b50 2023-11-26T07:17:45.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.946+0000 7fea6f7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fea700d0740 0x7fea700d0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:45.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.946+0000 7fea6effd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fea7015e080 0x7fea700d2440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36460/0 (socket says 172.21.15.2:36460) 2023-11-26T07:17:45.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.946+0000 7fea6effd700 1 -- 172.21.15.2:0/2830413750 learned_addr learned my addr 172.21.15.2:0/2830413750 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:45.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.946+0000 7fea6e7fc700 1 --2- 172.21.15.2:0/2830413750 >> v2:172.21.15.192:3300/0 conn(0x7fea700d2b50 0x7fea700cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:45.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.946+0000 7fea6f7fe700 1 -- 172.21.15.2:0/2830413750 >> v2:172.21.15.192:3300/0 conn(0x7fea700d2b50 msgr2=0x7fea700cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:45.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.946+0000 7fea6f7fe700 1 --2- 172.21.15.2:0/2830413750 >> v2:172.21.15.192:3300/0 conn(0x7fea700d2b50 0x7fea700cfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.946+0000 7fea6f7fe700 1 -- 172.21.15.2:0/2830413750 >> v1:172.21.15.2:6789/0 conn(0x7fea7015e080 legacy=0x7fea700d2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:45.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.946+0000 7fea6dffb700 1 -- 172.21.15.2:0/2830413750 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2168606080 0 0) 0x7fea700ce9a0 con 0x7fea7015e080 2023-11-26T07:17:45.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.946+0000 7fea6f7fe700 1 -- 172.21.15.2:0/2830413750 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea700cef20 con 0x7fea700d0740 2023-11-26T07:17:45.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.946+0000 7fea6e7fc700 1 --2- 172.21.15.2:0/2830413750 >> v2:172.21.15.192:3300/0 conn(0x7fea700d2b50 0x7fea700cfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:45.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.946+0000 7fea6f7fe700 1 --2- 172.21.15.2:0/2830413750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea700d0740 0x7fea700d0b90 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fea7008c080 tx=0x7fea6800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4912f93755048073 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:45.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.947+0000 7fea6dffb700 1 -- 172.21.15.2:0/2830413750 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6800e070 con 0x7fea700d0740 2023-11-26T07:17:45.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.947+0000 7fea6dffb700 1 -- 172.21.15.2:0/2830413750 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea6800bbd0 con 0x7fea700d0740 2023-11-26T07:17:45.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.947+0000 7fea6dffb700 1 -- 172.21.15.2:0/2830413750 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea68012430 con 0x7fea700d0740 2023-11-26T07:17:45.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.947+0000 7fea756a9700 1 -- 172.21.15.2:0/2830413750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea700d0740 msgr2=0x7fea700d0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:45.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.947+0000 7fea756a9700 1 --2- 172.21.15.2:0/2830413750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea700d0740 0x7fea700d0b90 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fea7008c080 tx=0x7fea6800b330 comp rx=0 tx=0).stop 2023-11-26T07:17:45.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.947+0000 7fea756a9700 1 -- 172.21.15.2:0/2830413750 shutdown_connections 2023-11-26T07:17:45.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.947+0000 7fea756a9700 1 --2- 172.21.15.2:0/2830413750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea700d0740 0x7fea700d0b90 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.947+0000 7fea756a9700 1 --2- 172.21.15.2:0/2830413750 >> v2:172.21.15.192:3300/0 conn(0x7fea700d2b50 0x7fea700cfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.947+0000 7fea756a9700 1 -- 172.21.15.2:0/2830413750 >> 172.21.15.2:0/2830413750 conn(0x7fea7009d180 msgr2=0x7fea700d3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:45.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.947+0000 7fea756a9700 1 -- 172.21.15.2:0/2830413750 shutdown_connections 2023-11-26T07:17:45.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.947+0000 7fea756a9700 1 -- 172.21.15.2:0/2830413750 wait complete. 2023-11-26T07:17:45.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.949+0000 7fea756a9700 1 Processor -- start 2023-11-26T07:17:45.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.949+0000 7fea756a9700 1 -- start start 2023-11-26T07:17:45.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.949+0000 7fea756a9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea700d0740 0x7fea7014d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:45.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.949+0000 7fea756a9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fea700d2b50 0x7fea701f77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:45.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.949+0000 7fea756a9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea7015e080 0x7fea7006bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:45.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.949+0000 7fea756a9700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea701f73d0 con 0x7fea700d0740 2023-11-26T07:17:45.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.949+0000 7fea756a9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea701f7030 con 0x7fea7015e080 2023-11-26T07:17:45.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.949+0000 7fea756a9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea7014d8e0 con 0x7fea700d2b50 2023-11-26T07:17:45.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.949+0000 7fea6effd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea700d0740 0x7fea7014d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:45.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.949+0000 7fea6effd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea700d0740 0x7fea7014d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45256/0 (socket says 172.21.15.2:45256) 2023-11-26T07:17:45.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.949+0000 7fea6effd700 1 -- 172.21.15.2:0/3154996334 learned_addr learned my addr 172.21.15.2:0/3154996334 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:45.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.950+0000 7fea6f7fe700 1 --2- 172.21.15.2:0/3154996334 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea7015e080 0x7fea7006bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:45.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.950+0000 7fea6e7fc700 1 --2- 172.21.15.2:0/3154996334 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fea700d2b50 0x7fea701f77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:45.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.950+0000 7fea6effd700 1 -- 172.21.15.2:0/3154996334 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fea700d2b50 msgr2=0x7fea701f77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:45.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.950+0000 7fea6effd700 1 --2- 172.21.15.2:0/3154996334 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fea700d2b50 0x7fea701f77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.950+0000 7fea6effd700 1 -- 172.21.15.2:0/3154996334 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea7015e080 msgr2=0x7fea7006bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:45.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.950+0000 7fea6effd700 1 --2- 172.21.15.2:0/3154996334 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea7015e080 0x7fea7006bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:45.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.950+0000 7fea6effd700 1 -- 172.21.15.2:0/3154996334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea68009a70 con 0x7fea700d0740 2023-11-26T07:17:45.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.950+0000 7fea6e7fc700 1 --2- 172.21.15.2:0/3154996334 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fea700d2b50 0x7fea701f77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:45.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.950+0000 7fea6effd700 1 --2- 172.21.15.2:0/3154996334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea700d0740 0x7fea7014d090 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fea6400c550 tx=0x7fea6400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:45.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.950+0000 7fea577fe700 1 -- 172.21.15.2:0/3154996334 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea64004c80 con 0x7fea700d0740 2023-11-26T07:17:45.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.950+0000 7fea577fe700 1 -- 172.21.15.2:0/3154996334 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea64004e00 con 0x7fea700d0740 2023-11-26T07:17:45.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.950+0000 7fea577fe700 1 -- 172.21.15.2:0/3154996334 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea64007310 con 0x7fea700d0740 2023-11-26T07:17:45.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.950+0000 7fea756a9700 1 -- 172.21.15.2:0/3154996334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea7014dbc0 con 0x7fea700d0740 2023-11-26T07:17:45.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.950+0000 7fea756a9700 1 -- 172.21.15.2:0/3154996334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea7014d5d0 con 0x7fea700d0740 2023-11-26T07:17:45.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.951+0000 7fea756a9700 1 -- 172.21.15.2:0/3154996334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea70067f60 con 0x7fea700d0740 2023-11-26T07:17:45.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.952+0000 7fea577fe700 1 -- 172.21.15.2:0/3154996334 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7fea64007470 con 0x7fea700d0740 2023-11-26T07:17:45.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.952+0000 7fea577fe700 1 --2- 172.21.15.2:0/3154996334 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fea5c06b980 0x7fea5c06de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:45.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.952+0000 7fea577fe700 1 -- 172.21.15.2:0/3154996334 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fea640884c0 con 0x7fea700d0740 2023-11-26T07:17:45.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.953+0000 7fea6e7fc700 1 --2- 172.21.15.2:0/3154996334 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fea5c06b980 0x7fea5c06de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:45.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.953+0000 7fea6e7fc700 1 --2- 172.21.15.2:0/3154996334 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fea5c06b980 0x7fea5c06de40 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fea60006fd0 tx=0x7fea60008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:45.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:45.956+0000 7fea577fe700 1 -- 172.21.15.2:0/3154996334 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fea64054d90 con 0x7fea700d0740 2023-11-26T07:17:46.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:46.158+0000 7fea756a9700 1 -- 172.21.15.2:0/3154996334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fea7015d710 con 0x7fea700d0740 2023-11-26T07:17:46.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:46.159+0000 7fea577fe700 1 -- 172.21.15.2:0/3154996334 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+12935 (secure 0 0 0) 0x7fea640583b0 con 0x7fea700d0740 2023-11-26T07:17:46.161 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:17:46.161 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":78,"fsid":"cb9817c7-f1ed-4745-9395-2760a3bb9712","created":"2023-11-26T07:11:16.464176+0000","modified":"2023-11-26T07:17:40.329354+0000","last_up_change":"2023-11-26T07:11:26.583110+0000","last_in_change":"2023-11-26T07:11:18.950310+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:11:28.205739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7863edba-a3b9-4ba9-bed1-3990aad97f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6817","nonce":2852728003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6819","nonce":2852728003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6823","nonce":2852728003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2852728003},{"type":"v1","addr":"172.21.15.2:6821","nonce":2852728003}]},"public_addr":"172.21.15.2:6817/2852728003","cluster_addr":"172.21.15.2:6819/2852728003","heartbeat_back_addr":"172.21.15.2:6823/2852728003","heartbeat_front_addr":"172.21.15.2:6821/2852728003","state":["exists","up"]},{"osd":1,"uuid":"9cdfa5be-c35c-45f7-971a-72fc638dcbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6801","nonce":3414405195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6803","nonce":3414405195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6807","nonce":3414405195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3414405195},{"type":"v1","addr":"172.21.15.2:6805","nonce":3414405195}]},"public_addr":"172.21.15.2:6801/3414405195","cluster_addr":"172.21.15.2:6803/3414405195","heartbeat_back_addr":"172.21.15.2:6807/3414405195","heartbeat_front_addr":"172.21.15.2:6805/3414405195","state":["exists","up"]},{"osd":2,"uuid":"6fa77818-2fc2-41c1-9e88-8806f025944c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6809","nonce":1275933713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6811","nonce":1275933713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6815","nonce":1275933713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1275933713},{"type":"v1","addr":"172.21.15.2:6813","nonce":1275933713}]},"public_addr":"172.21.15.2:6809/1275933713","cluster_addr":"172.21.15.2:6811/1275933713","heartbeat_back_addr":"172.21.15.2:6815/1275933713","heartbeat_front_addr":"172.21.15.2:6813/1275933713","state":["exists","up"]},{"osd":3,"uuid":"941db088-aa06-421b-8a75-10beef13de2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6825","nonce":3168701171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6827","nonce":3168701171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6831","nonce":3168701171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3168701171},{"type":"v1","addr":"172.21.15.2:6829","nonce":3168701171}]},"public_addr":"172.21.15.2:6825/3168701171","cluster_addr":"172.21.15.2:6827/3168701171","heartbeat_back_addr":"172.21.15.2:6831/3168701171","heartbeat_front_addr":"172.21.15.2:6829/3168701171","state":["exists","up"]},{"osd":4,"uuid":"4149f273-5910-417d-84e3-ed20681df1fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6801","nonce":1194580107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6803","nonce":1194580107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6807","nonce":1194580107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1194580107},{"type":"v1","addr":"172.21.15.192:6805","nonce":1194580107}]},"public_addr":"172.21.15.192:6801/1194580107","cluster_addr":"172.21.15.192:6803/1194580107","heartbeat_back_addr":"172.21.15.192:6807/1194580107","heartbeat_front_addr":"172.21.15.192:6805/1194580107","state":["exists","up"]},{"osd":5,"uuid":"f72b407a-33b3-4562-a5c9-0f611f286b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6817","nonce":1249076734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6819","nonce":1249076734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6823","nonce":1249076734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1249076734},{"type":"v1","addr":"172.21.15.192:6821","nonce":1249076734}]},"public_addr":"172.21.15.192:6817/1249076734","cluster_addr":"172.21.15.192:6819/1249076734","heartbeat_back_addr":"172.21.15.192:6823/1249076734","heartbeat_front_addr":"172.21.15.192:6821/1249076734","state":["exists","up"]},{"osd":6,"uuid":"99c3d197-5913-4211-b3e1-89be841f56f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6825","nonce":610652339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6827","nonce":610652339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6831","nonce":610652339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":610652339},{"type":"v1","addr":"172.21.15.192:6829","nonce":610652339}]},"public_addr":"172.21.15.192:6825/610652339","cluster_addr":"172.21.15.192:6827/610652339","heartbeat_back_addr":"172.21.15.192:6831/610652339","heartbeat_front_addr":"172.21.15.192:6829/610652339","state":["exists","up"]},{"osd":7,"uuid":"ae5da2f4-aaf5-48f2-93ed-c8bc000f4f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6809","nonce":2129584711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6811","nonce":2129584711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6815","nonce":2129584711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2129584711},{"type":"v1","addr":"172.21.15.192:6813","nonce":2129584711}]},"public_addr":"172.21.15.192:6809/2129584711","cluster_addr":"172.21.15.192:6811/2129584711","heartbeat_back_addr":"172.21.15.192:6815/2129584711","heartbeat_front_addr":"172.21.15.192:6813/2129584711","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.130651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:23.900466+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.136644+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.134690+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.176204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.100863+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:11:24.116621+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6835/177641343":"2023-11-27T07:17:37.104984+0000","172.21.15.2:6833/177641343":"2023-11-27T07:17:37.104984+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:17:46.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:46.161+0000 7fea756a9700 1 -- 172.21.15.2:0/3154996334 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fea5c06b980 msgr2=0x7fea5c06de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:46.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:46.161+0000 7fea756a9700 1 --2- 172.21.15.2:0/3154996334 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fea5c06b980 0x7fea5c06de40 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fea60006fd0 tx=0x7fea60008040 comp rx=0 tx=0).stop 2023-11-26T07:17:46.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:46.161+0000 7fea756a9700 1 -- 172.21.15.2:0/3154996334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea700d0740 msgr2=0x7fea7014d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:46.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:46.161+0000 7fea756a9700 1 --2- 172.21.15.2:0/3154996334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea700d0740 0x7fea7014d090 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fea6400c550 tx=0x7fea6400c860 comp rx=0 tx=0).stop 2023-11-26T07:17:46.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:46.161+0000 7fea756a9700 1 -- 172.21.15.2:0/3154996334 shutdown_connections 2023-11-26T07:17:46.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:46.161+0000 7fea756a9700 1 --2- 172.21.15.2:0/3154996334 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fea5c06b980 0x7fea5c06de40 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:46.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:46.161+0000 7fea756a9700 1 --2- 172.21.15.2:0/3154996334 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea7015e080 0x7fea7006bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:46.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:46.161+0000 7fea756a9700 1 --2- 172.21.15.2:0/3154996334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea700d0740 0x7fea7014d090 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:46.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:46.161+0000 7fea756a9700 1 --2- 172.21.15.2:0/3154996334 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fea700d2b50 0x7fea701f77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:46.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:46.161+0000 7fea756a9700 1 -- 172.21.15.2:0/3154996334 >> 172.21.15.2:0/3154996334 conn(0x7fea7009d180 msgr2=0x7fea700cf900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:46.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:46.161+0000 7fea756a9700 1 -- 172.21.15.2:0/3154996334 shutdown_connections 2023-11-26T07:17:46.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:46.161+0000 7fea756a9700 1 -- 172.21.15.2:0/3154996334 wait complete. 2023-11-26T07:17:47.176 INFO:tasks.ceph:Scrubbing osd.0 2023-11-26T07:17:47.177 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-26T07:17:47.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.318+0000 7fcf4a78b700 1 Processor -- start 2023-11-26T07:17:47.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.318+0000 7fcf4a78b700 1 -- start start 2023-11-26T07:17:47.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.319+0000 7fcf4a78b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcf4415a440 0x7fcf440b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:47.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.319+0000 7fcf4a78b700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf4406bd80 con 0x7fcf440d0980 2023-11-26T07:17:47.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.319+0000 7fcf4a78b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf4406b170 con 0x7fcf440ad1f0 2023-11-26T07:17:47.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.319+0000 7fcf4a78b700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf440b6380 con 0x7fcf4415a440 2023-11-26T07:17:47.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.319+0000 7fcf43fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcf4415a440 0x7fcf440b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:47.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.319+0000 7fcf48d28700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fcf440d0980 0x7fcf4415e1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36478/0 (socket says 172.21.15.2:36478) 2023-11-26T07:17:47.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.319+0000 7fcf48d28700 1 -- 172.21.15.2:0/3230573705 learned_addr learned my addr 172.21.15.2:0/3230573705 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:47.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.320+0000 7fcf43fff700 1 -- 172.21.15.2:0/3230573705 >> v1:172.21.15.192:6789/0 conn(0x7fcf440ad1f0 legacy=0x7fcf440d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:47.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.320+0000 7fcf43fff700 1 -- 172.21.15.2:0/3230573705 >> v1:172.21.15.2:6789/0 conn(0x7fcf440d0980 legacy=0x7fcf4415e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:47.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.320+0000 7fcf43fff700 1 -- 172.21.15.2:0/3230573705 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf4406b450 con 0x7fcf4415a440 2023-11-26T07:17:47.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.320+0000 7fcf43fff700 1 --2- 172.21.15.2:0/3230573705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf4415a440 0x7fcf440b5e40 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fcf34009840 tx=0x7fcf34009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59be701264673f80 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:47.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.320+0000 7fcf42ffd700 1 -- 172.21.15.2:0/3230573705 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf34011830 con 0x7fcf4415a440 2023-11-26T07:17:47.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.320+0000 7fcf42ffd700 1 -- 172.21.15.2:0/3230573705 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf34011990 con 0x7fcf4415a440 2023-11-26T07:17:47.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.320+0000 7fcf42ffd700 1 -- 172.21.15.2:0/3230573705 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf34011d20 con 0x7fcf4415a440 2023-11-26T07:17:47.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.321+0000 7fcf4a78b700 1 -- 172.21.15.2:0/3230573705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf4415a440 msgr2=0x7fcf440b5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:47.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.321+0000 7fcf4a78b700 1 --2- 172.21.15.2:0/3230573705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf4415a440 0x7fcf440b5e40 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fcf34009840 tx=0x7fcf34009b50 comp rx=0 tx=0).stop 2023-11-26T07:17:47.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.321+0000 7fcf4a78b700 1 -- 172.21.15.2:0/3230573705 shutdown_connections 2023-11-26T07:17:47.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.321+0000 7fcf4a78b700 1 --2- 172.21.15.2:0/3230573705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf4415a440 0x7fcf440b5e40 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.321+0000 7fcf4a78b700 1 -- 172.21.15.2:0/3230573705 >> 172.21.15.2:0/3230573705 conn(0x7fcf440b5070 msgr2=0x7fcf440b5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:47.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.321+0000 7fcf4a78b700 1 -- 172.21.15.2:0/3230573705 shutdown_connections 2023-11-26T07:17:47.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.321+0000 7fcf4a78b700 1 -- 172.21.15.2:0/3230573705 wait complete. 2023-11-26T07:17:47.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.322+0000 7fcf4a78b700 1 Processor -- start 2023-11-26T07:17:47.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.323+0000 7fcf4a78b700 1 -- start start 2023-11-26T07:17:47.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.323+0000 7fcf4a78b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf440ad1f0 0x7fcf44168710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:47.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.323+0000 7fcf4a78b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcf440d0980 0x7fcf44144ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:47.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.323+0000 7fcf4a78b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf4415a440 0x7fcf44145430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:47.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.324+0000 7fcf4a78b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf44149000 con 0x7fcf440ad1f0 2023-11-26T07:17:47.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.324+0000 7fcf4a78b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4415d970 con 0x7fcf4415a440 2023-11-26T07:17:47.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.324+0000 7fcf4a78b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4409a810 con 0x7fcf440d0980 2023-11-26T07:17:47.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.324+0000 7fcf43fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf440ad1f0 0x7fcf44168710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:47.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.324+0000 7fcf43fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf440ad1f0 0x7fcf44168710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45270/0 (socket says 172.21.15.2:45270) 2023-11-26T07:17:47.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.324+0000 7fcf43fff700 1 -- 172.21.15.2:0/3570949019 learned_addr learned my addr 172.21.15.2:0/3570949019 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:47.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.324+0000 7fcf48d28700 1 --2- 172.21.15.2:0/3570949019 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf4415a440 0x7fcf44145430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:47.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.324+0000 7fcf437fe700 1 --2- 172.21.15.2:0/3570949019 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcf440d0980 0x7fcf44144ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:47.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.324+0000 7fcf43fff700 1 -- 172.21.15.2:0/3570949019 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcf440d0980 msgr2=0x7fcf44144ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:47.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.324+0000 7fcf43fff700 1 --2- 172.21.15.2:0/3570949019 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcf440d0980 0x7fcf44144ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.324+0000 7fcf43fff700 1 -- 172.21.15.2:0/3570949019 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf4415a440 msgr2=0x7fcf44145430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:47.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.324+0000 7fcf43fff700 1 --2- 172.21.15.2:0/3570949019 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf4415a440 0x7fcf44145430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.324+0000 7fcf43fff700 1 -- 172.21.15.2:0/3570949019 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf340094a0 con 0x7fcf440ad1f0 2023-11-26T07:17:47.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.324+0000 7fcf43fff700 1 --2- 172.21.15.2:0/3570949019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf440ad1f0 0x7fcf44168710 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fcf340090b0 tx=0x7fcf34004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:47.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.324+0000 7fcf40ff9700 1 -- 172.21.15.2:0/3570949019 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf340045f0 con 0x7fcf440ad1f0 2023-11-26T07:17:47.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.324+0000 7fcf40ff9700 1 -- 172.21.15.2:0/3570949019 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3401e070 con 0x7fcf440ad1f0 2023-11-26T07:17:47.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.324+0000 7fcf40ff9700 1 -- 172.21.15.2:0/3570949019 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf34003b00 con 0x7fcf440ad1f0 2023-11-26T07:17:47.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.324+0000 7fcf4a78b700 1 -- 172.21.15.2:0/3570949019 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf44159c20 con 0x7fcf440ad1f0 2023-11-26T07:17:47.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.324+0000 7fcf4a78b700 1 -- 172.21.15.2:0/3570949019 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf4409a4a0 con 0x7fcf440ad1f0 2023-11-26T07:17:47.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.325+0000 7fcf4a78b700 1 -- 172.21.15.2:0/3570949019 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcf4406ba10 con 0x7fcf440ad1f0 2023-11-26T07:17:47.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.326+0000 7fcf40ff9700 1 -- 172.21.15.2:0/3570949019 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7fcf34003c60 con 0x7fcf440ad1f0 2023-11-26T07:17:47.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.326+0000 7fcf40ff9700 1 --2- 172.21.15.2:0/3570949019 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fcf3006b980 0x7fcf3006de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:47.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.326+0000 7fcf40ff9700 1 -- 172.21.15.2:0/3570949019 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fcf340892c0 con 0x7fcf440ad1f0 2023-11-26T07:17:47.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.326+0000 7fcf40ff9700 1 --2- 172.21.15.2:0/3570949019 >> [v2:172.21.15.2:6816/2852728003,v1:172.21.15.2:6817/2852728003] conn(0x7fcf300717e0 0x7fcf30073c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:47.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.326+0000 7fcf40ff9700 1 -- 172.21.15.2:0/3570949019 --> [v2:172.21.15.2:6816/2852728003,v1:172.21.15.2:6817/2852728003] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcf300742d0 con 0x7fcf300717e0 2023-11-26T07:17:47.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.326+0000 7fcf40ff9700 1 -- 172.21.15.2:0/3570949019 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf340902a0 con 0x7fcf440ad1f0 2023-11-26T07:17:47.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.326+0000 7fcf437fe700 1 --2- 172.21.15.2:0/3570949019 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fcf3006b980 0x7fcf3006de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:47.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.327+0000 7fcf48d28700 1 --2- 172.21.15.2:0/3570949019 >> [v2:172.21.15.2:6816/2852728003,v1:172.21.15.2:6817/2852728003] conn(0x7fcf300717e0 0x7fcf30073c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:47.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.327+0000 7fcf48d28700 1 --2- 172.21.15.2:0/3570949019 >> [v2:172.21.15.2:6816/2852728003,v1:172.21.15.2:6817/2852728003] conn(0x7fcf300717e0 0x7fcf30073c00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:47.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.327+0000 7fcf437fe700 1 --2- 172.21.15.2:0/3570949019 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fcf3006b980 0x7fcf3006de40 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fcf4414aa80 tx=0x7fcf38009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:47.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.328+0000 7fcf40ff9700 1 -- 172.21.15.2:0/3570949019 <== osd.0 v2:172.21.15.2:6816/2852728003 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fcf300742d0 con 0x7fcf300717e0 2023-11-26T07:17:47.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.343+0000 7fcf4a78b700 1 -- 172.21.15.2:0/3570949019 --> [v2:172.21.15.2:6816/2852728003,v1:172.21.15.2:6817/2852728003] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcf4409a950 con 0x7fcf300717e0 2023-11-26T07:17:47.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.343+0000 7fcf40ff9700 1 -- 172.21.15.2:0/3570949019 <== osd.0 v2:172.21.15.2:6816/2852728003 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fcf3c0070e0 con 0x7fcf300717e0 2023-11-26T07:17:47.345 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-26T07:17:47.345 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-26T07:17:47.345 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-26T07:17:47.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.343+0000 7fcf4a78b700 1 -- 172.21.15.2:0/3570949019 >> [v2:172.21.15.2:6816/2852728003,v1:172.21.15.2:6817/2852728003] conn(0x7fcf300717e0 msgr2=0x7fcf30073c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:47.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.343+0000 7fcf4a78b700 1 --2- 172.21.15.2:0/3570949019 >> [v2:172.21.15.2:6816/2852728003,v1:172.21.15.2:6817/2852728003] conn(0x7fcf300717e0 0x7fcf30073c00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.343+0000 7fcf4a78b700 1 -- 172.21.15.2:0/3570949019 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fcf3006b980 msgr2=0x7fcf3006de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:47.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.343+0000 7fcf4a78b700 1 --2- 172.21.15.2:0/3570949019 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fcf3006b980 0x7fcf3006de40 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fcf4414aa80 tx=0x7fcf38009040 comp rx=0 tx=0).stop 2023-11-26T07:17:47.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.343+0000 7fcf4a78b700 1 -- 172.21.15.2:0/3570949019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf440ad1f0 msgr2=0x7fcf44168710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:47.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.343+0000 7fcf4a78b700 1 --2- 172.21.15.2:0/3570949019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf440ad1f0 0x7fcf44168710 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fcf340090b0 tx=0x7fcf34004750 comp rx=0 tx=0).stop 2023-11-26T07:17:47.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.343+0000 7fcf48d28700 1 -- 172.21.15.2:0/3570949019 reap_dead start 2023-11-26T07:17:47.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.343+0000 7fcf4a78b700 1 -- 172.21.15.2:0/3570949019 shutdown_connections 2023-11-26T07:17:47.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.343+0000 7fcf4a78b700 1 -- 172.21.15.2:0/3570949019 >> 172.21.15.2:0/3570949019 conn(0x7fcf440b5070 msgr2=0x7fcf4414b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:47.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.343+0000 7fcf4a78b700 1 -- 172.21.15.2:0/3570949019 shutdown_connections 2023-11-26T07:17:47.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.343+0000 7fcf4a78b700 1 -- 172.21.15.2:0/3570949019 wait complete. 2023-11-26T07:17:47.358 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-26T07:17:47.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.483+0000 7fa9e1012700 1 Processor -- start 2023-11-26T07:17:47.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.483+0000 7fa9e1012700 1 -- start start 2023-11-26T07:17:47.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.484+0000 7fa9e1012700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa9dc0cf2b0 0x7fa9dc15c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:47.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.484+0000 7fa9e1012700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa9dc0ce5c0 0x7fa9dc0cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:47.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.484+0000 7fa9e1012700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9dc0d0a90 con 0x7fa9dc15bde0 2023-11-26T07:17:47.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.484+0000 7fa9e1012700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9dc0cefb0 con 0x7fa9dc0ce5c0 2023-11-26T07:17:47.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.484+0000 7fa9e1012700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc06ee10 con 0x7fa9dc0cf2b0 2023-11-26T07:17:47.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.484+0000 7fa9db59e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa9dc0ce5c0 0x7fa9dc0cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:47.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.484+0000 7fa9db59e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa9dc0ce5c0 0x7fa9dc0cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45282/0 (socket says 172.21.15.2:45282) 2023-11-26T07:17:47.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.484+0000 7fa9db59e700 1 -- 172.21.15.2:0/2615460223 learned_addr learned my addr 172.21.15.2:0/2615460223 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:47.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.485+0000 7fa9da59c700 1 --2- 172.21.15.2:0/2615460223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa9dc0cf2b0 0x7fa9dc15c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:47.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.485+0000 7fa9db59e700 1 -- 172.21.15.2:0/2615460223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa9dc0cf2b0 msgr2=0x7fa9dc15c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:47.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.485+0000 7fa9db59e700 1 --2- 172.21.15.2:0/2615460223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa9dc0cf2b0 0x7fa9dc15c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.485+0000 7fa9db59e700 1 -- 172.21.15.2:0/2615460223 >> v1:172.21.15.192:6789/0 conn(0x7fa9dc15bde0 legacy=0x7fa9dc0d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:47.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.485+0000 7fa9db59e700 1 -- 172.21.15.2:0/2615460223 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9dc06f0f0 con 0x7fa9dc0ce5c0 2023-11-26T07:17:47.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.485+0000 7fa9db59e700 1 --2- 172.21.15.2:0/2615460223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9dc0ce5c0 0x7fa9dc0cea70 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4009e50 tx=0x7fa9d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3866050a823ce1b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:47.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.485+0000 7fa9d9d9b700 1 -- 172.21.15.2:0/2615460223 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d400e070 con 0x7fa9dc0ce5c0 2023-11-26T07:17:47.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.485+0000 7fa9d9d9b700 1 -- 172.21.15.2:0/2615460223 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d4003a20 con 0x7fa9dc0ce5c0 2023-11-26T07:17:47.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.485+0000 7fa9d9d9b700 1 -- 172.21.15.2:0/2615460223 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d4003dd0 con 0x7fa9dc0ce5c0 2023-11-26T07:17:47.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.485+0000 7fa9e1012700 1 -- 172.21.15.2:0/2615460223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9dc0ce5c0 msgr2=0x7fa9dc0cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:47.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.485+0000 7fa9e1012700 1 --2- 172.21.15.2:0/2615460223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9dc0ce5c0 0x7fa9dc0cea70 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4009e50 tx=0x7fa9d400b330 comp rx=0 tx=0).stop 2023-11-26T07:17:47.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.486+0000 7fa9e1012700 1 -- 172.21.15.2:0/2615460223 shutdown_connections 2023-11-26T07:17:47.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.486+0000 7fa9e1012700 1 --2- 172.21.15.2:0/2615460223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9dc0ce5c0 0x7fa9dc0cea70 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.486+0000 7fa9e1012700 1 --2- 172.21.15.2:0/2615460223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa9dc0cf2b0 0x7fa9dc15c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.486+0000 7fa9e1012700 1 -- 172.21.15.2:0/2615460223 >> 172.21.15.2:0/2615460223 conn(0x7fa9dc0b3720 msgr2=0x7fa9dc0b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:47.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.486+0000 7fa9e1012700 1 -- 172.21.15.2:0/2615460223 shutdown_connections 2023-11-26T07:17:47.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.486+0000 7fa9e1012700 1 -- 172.21.15.2:0/2615460223 wait complete. 2023-11-26T07:17:47.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.487+0000 7fa9e1012700 1 Processor -- start 2023-11-26T07:17:47.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.488+0000 7fa9e1012700 1 -- start start 2023-11-26T07:17:47.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.488+0000 7fa9e1012700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9dc0ce5c0 0x7fa9dc1f4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:47.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.488+0000 7fa9e1012700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9dc0cf2b0 0x7fa9dc0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:47.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.488+0000 7fa9e1012700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa9dc15bde0 0x7fa9dc15d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:47.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.488+0000 7fa9e1012700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc1f7d60 con 0x7fa9dc0cf2b0 2023-11-26T07:17:47.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.488+0000 7fa9e1012700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc0cb260 con 0x7fa9dc0ce5c0 2023-11-26T07:17:47.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.488+0000 7fa9e1012700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc1f4860 con 0x7fa9dc15bde0 2023-11-26T07:17:47.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.489+0000 7fa9da59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9dc0cf2b0 0x7fa9dc0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:47.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.489+0000 7fa9da59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9dc0cf2b0 0x7fa9dc0cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45286/0 (socket says 172.21.15.2:45286) 2023-11-26T07:17:47.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.489+0000 7fa9da59c700 1 -- 172.21.15.2:0/3099604630 learned_addr learned my addr 172.21.15.2:0/3099604630 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:47.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.489+0000 7fa9db59e700 1 --2- 172.21.15.2:0/3099604630 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa9dc15bde0 0x7fa9dc15d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:47.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.489+0000 7fa9dad9d700 1 --2- 172.21.15.2:0/3099604630 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9dc0ce5c0 0x7fa9dc1f4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:47.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.489+0000 7fa9da59c700 1 -- 172.21.15.2:0/3099604630 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa9dc15bde0 msgr2=0x7fa9dc15d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:47.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.489+0000 7fa9da59c700 1 --2- 172.21.15.2:0/3099604630 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa9dc15bde0 0x7fa9dc15d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.489+0000 7fa9da59c700 1 -- 172.21.15.2:0/3099604630 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9dc0ce5c0 msgr2=0x7fa9dc1f4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:47.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.489+0000 7fa9da59c700 1 --2- 172.21.15.2:0/3099604630 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9dc0ce5c0 0x7fa9dc1f4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.489+0000 7fa9da59c700 1 -- 172.21.15.2:0/3099604630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d4009b30 con 0x7fa9dc0cf2b0 2023-11-26T07:17:47.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.489+0000 7fa9db59e700 1 --2- 172.21.15.2:0/3099604630 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa9dc15bde0 0x7fa9dc15d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:47.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.489+0000 7fa9dad9d700 1 --2- 172.21.15.2:0/3099604630 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9dc0ce5c0 0x7fa9dc1f4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:47.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.489+0000 7fa9da59c700 1 --2- 172.21.15.2:0/3099604630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9dc0cf2b0 0x7fa9dc0cb6f0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc00e7e0 tx=0x7fa9cc00eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:47.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.489+0000 7fa9c37fe700 1 -- 172.21.15.2:0/3099604630 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc013610 con 0x7fa9dc0cf2b0 2023-11-26T07:17:47.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.489+0000 7fa9c37fe700 1 -- 172.21.15.2:0/3099604630 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9cc013770 con 0x7fa9dc0cf2b0 2023-11-26T07:17:47.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.489+0000 7fa9e1012700 1 -- 172.21.15.2:0/3099604630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9dc0ca930 con 0x7fa9dc0cf2b0 2023-11-26T07:17:47.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.489+0000 7fa9c37fe700 1 -- 172.21.15.2:0/3099604630 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc013ae0 con 0x7fa9dc0cf2b0 2023-11-26T07:17:47.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.489+0000 7fa9e1012700 1 -- 172.21.15.2:0/3099604630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9dc0caef0 con 0x7fa9dc0cf2b0 2023-11-26T07:17:47.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.490+0000 7fa9e1012700 1 -- 172.21.15.2:0/3099604630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9dc068670 con 0x7fa9dc0cf2b0 2023-11-26T07:17:47.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.491+0000 7fa9c37fe700 1 -- 172.21.15.2:0/3099604630 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7fa9cc013c40 con 0x7fa9dc0cf2b0 2023-11-26T07:17:47.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.491+0000 7fa9c37fe700 1 --2- 172.21.15.2:0/3099604630 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa9c806b980 0x7fa9c806de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:47.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.491+0000 7fa9c37fe700 1 -- 172.21.15.2:0/3099604630 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa9cc087b50 con 0x7fa9dc0cf2b0 2023-11-26T07:17:47.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.492+0000 7fa9dad9d700 1 --2- 172.21.15.2:0/3099604630 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa9c806b980 0x7fa9c806de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:47.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.492+0000 7fa9dad9d700 1 --2- 172.21.15.2:0/3099604630 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa9c806b980 0x7fa9c806de40 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc14fd80 tx=0x7fa9d0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:47.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.496+0000 7fa9c37fe700 1 -- 172.21.15.2:0/3099604630 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa9cc0546b0 con 0x7fa9dc0cf2b0 2023-11-26T07:17:47.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.700+0000 7fa9e1012700 1 -- 172.21.15.2:0/3099604630 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fa9dc06f6b0 con 0x7fa9c806b980 2023-11-26T07:17:47.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.700+0000 7fa9c37fe700 1 -- 172.21.15.2:0/3099604630 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa9d0009540 con 0x7fa9c806b980 2023-11-26T07:17:47.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.702+0000 7fa9e1012700 1 -- 172.21.15.2:0/3099604630 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa9c806b980 msgr2=0x7fa9c806de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:47.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.702+0000 7fa9e1012700 1 --2- 172.21.15.2:0/3099604630 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa9c806b980 0x7fa9c806de40 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc14fd80 tx=0x7fa9d0008040 comp rx=0 tx=0).stop 2023-11-26T07:17:47.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.702+0000 7fa9e1012700 1 -- 172.21.15.2:0/3099604630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9dc0cf2b0 msgr2=0x7fa9dc0cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:47.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.702+0000 7fa9e1012700 1 --2- 172.21.15.2:0/3099604630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9dc0cf2b0 0x7fa9dc0cb6f0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc00e7e0 tx=0x7fa9cc00eba0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.702+0000 7fa9e1012700 1 -- 172.21.15.2:0/3099604630 shutdown_connections 2023-11-26T07:17:47.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.702+0000 7fa9e1012700 1 --2- 172.21.15.2:0/3099604630 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa9c806b980 0x7fa9c806de40 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.702+0000 7fa9e1012700 1 --2- 172.21.15.2:0/3099604630 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa9dc15bde0 0x7fa9dc15d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.702+0000 7fa9e1012700 1 --2- 172.21.15.2:0/3099604630 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9dc0ce5c0 0x7fa9dc1f4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.702+0000 7fa9e1012700 1 --2- 172.21.15.2:0/3099604630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9dc0cf2b0 0x7fa9dc0cb6f0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.702+0000 7fa9e1012700 1 -- 172.21.15.2:0/3099604630 >> 172.21.15.2:0/3099604630 conn(0x7fa9dc0b3720 msgr2=0x7fa9dc06c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:47.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.702+0000 7fa9e1012700 1 -- 172.21.15.2:0/3099604630 shutdown_connections 2023-11-26T07:17:47.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.702+0000 7fa9e1012700 1 -- 172.21.15.2:0/3099604630 wait complete. 2023-11-26T07:17:47.706 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 0 to deep-scrub 2023-11-26T07:17:47.717 INFO:tasks.ceph:Scrubbing osd.1 2023-11-26T07:17:47.717 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-26T07:17:47.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.845+0000 7f30ce83a700 1 Processor -- start 2023-11-26T07:17:47.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.845+0000 7f30ce83a700 1 -- start start 2023-11-26T07:17:47.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.846+0000 7f30ce83a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f30c81457b0 0x7f30c80725a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:47.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.846+0000 7f30ce83a700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30c80cd490 con 0x7f30c80cf020 2023-11-26T07:17:47.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.846+0000 7f30ce83a700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30c806fa00 con 0x7f30c806f580 2023-11-26T07:17:47.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.846+0000 7f30ce83a700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30c80cd6e0 con 0x7f30c81457b0 2023-11-26T07:17:47.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.846+0000 7f30ccdd7700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f30c80cf020 0x7f30c806afd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36506/0 (socket says 172.21.15.2:36506) 2023-11-26T07:17:47.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.846+0000 7f30ccdd7700 1 -- 172.21.15.2:0/1656323586 learned_addr learned my addr 172.21.15.2:0/1656323586 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:47.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.847+0000 7f30c6ffd700 1 -- 172.21.15.2:0/1656323586 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2859741885 0 0) 0x7f30c80cd490 con 0x7f30c80cf020 2023-11-26T07:17:47.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.847+0000 7f30c7fff700 1 --2- 172.21.15.2:0/1656323586 >> v2:172.21.15.192:3300/0 conn(0x7f30c81457b0 0x7f30c80725a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:47.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.847+0000 7f30c6ffd700 1 -- 172.21.15.2:0/1656323586 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30b40035b0 con 0x7f30c80cf020 2023-11-26T07:17:47.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.847+0000 7f30c6ffd700 1 -- 172.21.15.2:0/1656323586 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4231965331 0 0) 0x7f30b40035b0 con 0x7f30c80cf020 2023-11-26T07:17:47.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.847+0000 7f30c6ffd700 1 -- 172.21.15.2:0/1656323586 >> v2:172.21.15.192:3300/0 conn(0x7f30c81457b0 msgr2=0x7f30c80725a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:47.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.847+0000 7f30c6ffd700 1 --2- 172.21.15.2:0/1656323586 >> v2:172.21.15.192:3300/0 conn(0x7f30c81457b0 0x7f30c80725a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.847+0000 7f30c6ffd700 1 -- 172.21.15.2:0/1656323586 >> v1:172.21.15.192:6789/0 conn(0x7f30c806f580 legacy=0x7f30c806e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:47.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.847+0000 7f30c6ffd700 1 -- 172.21.15.2:0/1656323586 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c80cd9c0 con 0x7f30c80cf020 2023-11-26T07:17:47.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.847+0000 7f30c6ffd700 1 -- 172.21.15.2:0/1656323586 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f30c00019f0 con 0x7f30c80cf020 2023-11-26T07:17:47.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.847+0000 7f30c6ffd700 1 -- 172.21.15.2:0/1656323586 >> v1:172.21.15.2:6789/0 conn(0x7f30c80cf020 legacy=0x7f30c806afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:47.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.847+0000 7f30c6ffd700 1 --2- 172.21.15.2:0/1656323586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30b4003a00 0x7f30b4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:47.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.847+0000 7f30c6ffd700 1 --2- 172.21.15.2:0/1656323586 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30b4004850 0x7f30b4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:47.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.847+0000 7f30c6ffd700 1 --2- 172.21.15.2:0/1656323586 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f30b4005210 0x7f30b400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:47.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.847+0000 7f30c6ffd700 1 -- 172.21.15.2:0/1656323586 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c80cd6e0 con 0x7f30b4003a00 2023-11-26T07:17:47.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.847+0000 7f30c6ffd700 1 -- 172.21.15.2:0/1656323586 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30b400c1b0 con 0x7f30b4004850 2023-11-26T07:17:47.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.847+0000 7f30c6ffd700 1 -- 172.21.15.2:0/1656323586 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30b400c370 con 0x7f30b4005210 2023-11-26T07:17:47.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.847+0000 7f30c7fff700 1 --2- 172.21.15.2:0/1656323586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30b4003a00 0x7f30b4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:47.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.847+0000 7f30c77fe700 1 --2- 172.21.15.2:0/1656323586 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30b4004850 0x7f30b4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:47.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.847+0000 7f30ccdd7700 1 --2- 172.21.15.2:0/1656323586 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f30b4005210 0x7f30b400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:47.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.847+0000 7f30c7fff700 1 -- 172.21.15.2:0/1656323586 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f30b4005210 msgr2=0x7f30b400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:47.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.847+0000 7f30c7fff700 1 --2- 172.21.15.2:0/1656323586 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f30b4005210 0x7f30b400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.847+0000 7f30c7fff700 1 -- 172.21.15.2:0/1656323586 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30b4004850 msgr2=0x7f30b4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:47.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.847+0000 7f30c7fff700 1 --2- 172.21.15.2:0/1656323586 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30b4004850 0x7f30b4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.847+0000 7f30c7fff700 1 -- 172.21.15.2:0/1656323586 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b40035b0 con 0x7f30b4003a00 2023-11-26T07:17:47.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.848+0000 7f30ccdd7700 1 --2- 172.21.15.2:0/1656323586 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f30b4005210 0x7f30b400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:47.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.848+0000 7f30ccdd7700 1 -- 172.21.15.2:0/1656323586 reap_dead start 2023-11-26T07:17:47.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.848+0000 7f30c7fff700 1 --2- 172.21.15.2:0/1656323586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30b4003a00 0x7f30b4003e20 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f30b0009b60 tx=0x7f30b4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a6861da4c3fd7df server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:47.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.848+0000 7f30c6ffd700 1 -- 172.21.15.2:0/1656323586 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b000e6c0 con 0x7f30b4003a00 2023-11-26T07:17:47.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.848+0000 7f30c6ffd700 1 -- 172.21.15.2:0/1656323586 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b000e820 con 0x7f30b4003a00 2023-11-26T07:17:47.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.848+0000 7f30c6ffd700 1 -- 172.21.15.2:0/1656323586 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b000eb90 con 0x7f30b4003a00 2023-11-26T07:17:47.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.848+0000 7f30ce83a700 1 -- 172.21.15.2:0/1656323586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30b4003a00 msgr2=0x7f30b4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:47.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.848+0000 7f30ce83a700 1 --2- 172.21.15.2:0/1656323586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30b4003a00 0x7f30b4003e20 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f30b0009b60 tx=0x7f30b4005880 comp rx=0 tx=0).stop 2023-11-26T07:17:47.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.848+0000 7f30ce83a700 1 -- 172.21.15.2:0/1656323586 shutdown_connections 2023-11-26T07:17:47.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.848+0000 7f30ce83a700 1 --2- 172.21.15.2:0/1656323586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30b4003a00 0x7f30b4003e20 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.848+0000 7f30ce83a700 1 -- 172.21.15.2:0/1656323586 >> 172.21.15.2:0/1656323586 conn(0x7f30c80b2760 msgr2=0x7f30c80b2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:47.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.848+0000 7f30ce83a700 1 -- 172.21.15.2:0/1656323586 shutdown_connections 2023-11-26T07:17:47.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.849+0000 7f30ce83a700 1 -- 172.21.15.2:0/1656323586 wait complete. 2023-11-26T07:17:47.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.850+0000 7f30ce83a700 1 Processor -- start 2023-11-26T07:17:47.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.850+0000 7f30ce83a700 1 -- start start 2023-11-26T07:17:47.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.851+0000 7f30ce83a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30b4003a00 0x7f30c80cc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:47.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.851+0000 7f30ce83a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f30c8140350 0x7f30c81407d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:47.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.851+0000 7f30ce83a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30c815cee0 0x7f30c815d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:47.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.851+0000 7f30ce83a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c8148f80 con 0x7f30b4003a00 2023-11-26T07:17:47.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.851+0000 7f30ce83a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c8149820 con 0x7f30c815cee0 2023-11-26T07:17:47.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.851+0000 7f30ce83a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c813dba0 con 0x7f30c8140350 2023-11-26T07:17:47.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.851+0000 7f30c7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30b4003a00 0x7f30c80cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:47.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.851+0000 7f30c7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30b4003a00 0x7f30c80cc470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45304/0 (socket says 172.21.15.2:45304) 2023-11-26T07:17:47.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.851+0000 7f30c7fff700 1 -- 172.21.15.2:0/2797547588 learned_addr learned my addr 172.21.15.2:0/2797547588 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:47.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.851+0000 7f30ccdd7700 1 --2- 172.21.15.2:0/2797547588 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30c815cee0 0x7f30c815d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:47.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.851+0000 7f30c77fe700 1 --2- 172.21.15.2:0/2797547588 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f30c8140350 0x7f30c81407d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:47.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.851+0000 7f30c7fff700 1 -- 172.21.15.2:0/2797547588 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f30c8140350 msgr2=0x7f30c81407d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:47.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.851+0000 7f30c7fff700 1 --2- 172.21.15.2:0/2797547588 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f30c8140350 0x7f30c81407d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.851+0000 7f30c7fff700 1 -- 172.21.15.2:0/2797547588 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30c815cee0 msgr2=0x7f30c815d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:47.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.851+0000 7f30c7fff700 1 --2- 172.21.15.2:0/2797547588 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30c815cee0 0x7f30c815d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.851+0000 7f30c7fff700 1 -- 172.21.15.2:0/2797547588 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c8140d10 con 0x7f30b4003a00 2023-11-26T07:17:47.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.851+0000 7f30ccdd7700 1 --2- 172.21.15.2:0/2797547588 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30c815cee0 0x7f30c815d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:47.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.851+0000 7f30c7fff700 1 --2- 172.21.15.2:0/2797547588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30b4003a00 0x7f30c80cc470 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f30b000e4b0 tx=0x7f30b00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:47.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.851+0000 7f30c4ff9700 1 -- 172.21.15.2:0/2797547588 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b000e6c0 con 0x7f30b4003a00 2023-11-26T07:17:47.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.851+0000 7f30c4ff9700 1 -- 172.21.15.2:0/2797547588 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b0003ad0 con 0x7f30b4003a00 2023-11-26T07:17:47.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.851+0000 7f30ce83a700 1 -- 172.21.15.2:0/2797547588 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30c815dc60 con 0x7f30b4003a00 2023-11-26T07:17:47.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.851+0000 7f30c4ff9700 1 -- 172.21.15.2:0/2797547588 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b0003e80 con 0x7f30b4003a00 2023-11-26T07:17:47.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.851+0000 7f30ce83a700 1 -- 172.21.15.2:0/2797547588 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c81494b0 con 0x7f30b4003a00 2023-11-26T07:17:47.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.852+0000 7f30ce83a700 1 -- 172.21.15.2:0/2797547588 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f30c8073340 con 0x7f30b4003a00 2023-11-26T07:17:47.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.853+0000 7f30c4ff9700 1 -- 172.21.15.2:0/2797547588 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f30b0013470 con 0x7f30b4003a00 2023-11-26T07:17:47.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.853+0000 7f30c4ff9700 1 --2- 172.21.15.2:0/2797547588 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f30a806b980 0x7f30a806de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:47.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.853+0000 7f30c4ff9700 1 -- 172.21.15.2:0/2797547588 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f30b00898f0 con 0x7f30b4003a00 2023-11-26T07:17:47.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.853+0000 7f30c4ff9700 1 --2- 172.21.15.2:0/2797547588 >> [v2:172.21.15.2:6800/3414405195,v1:172.21.15.2:6801/3414405195] conn(0x7f30a80717e0 0x7f30a8073c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:47.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.853+0000 7f30c4ff9700 1 -- 172.21.15.2:0/2797547588 --> [v2:172.21.15.2:6800/3414405195,v1:172.21.15.2:6801/3414405195] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f30a80742d0 con 0x7f30a80717e0 2023-11-26T07:17:47.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.853+0000 7f30c4ff9700 1 -- 172.21.15.2:0/2797547588 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f30b008e520 con 0x7f30b4003a00 2023-11-26T07:17:47.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.853+0000 7f30ccdd7700 1 --2- 172.21.15.2:0/2797547588 >> [v2:172.21.15.2:6800/3414405195,v1:172.21.15.2:6801/3414405195] conn(0x7f30a80717e0 0x7f30a8073c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:47.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.854+0000 7f30c77fe700 1 --2- 172.21.15.2:0/2797547588 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f30a806b980 0x7f30a806de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:47.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.854+0000 7f30ccdd7700 1 --2- 172.21.15.2:0/2797547588 >> [v2:172.21.15.2:6800/3414405195,v1:172.21.15.2:6801/3414405195] conn(0x7f30a80717e0 0x7f30a8073c00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:47.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.854+0000 7f30c77fe700 1 --2- 172.21.15.2:0/2797547588 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f30a806b980 0x7f30a806de40 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f30b8000c00 tx=0x7f30b8007d10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:47.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.854+0000 7f30c4ff9700 1 -- 172.21.15.2:0/2797547588 <== osd.1 v2:172.21.15.2:6800/3414405195 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f30a80742d0 con 0x7f30a80717e0 2023-11-26T07:17:47.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.870+0000 7f30ce83a700 1 -- 172.21.15.2:0/2797547588 --> [v2:172.21.15.2:6800/3414405195,v1:172.21.15.2:6801/3414405195] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f30c80741c0 con 0x7f30a80717e0 2023-11-26T07:17:47.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.870+0000 7f30c4ff9700 1 -- 172.21.15.2:0/2797547588 <== osd.1 v2:172.21.15.2:6800/3414405195 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f30c80741c0 con 0x7f30a80717e0 2023-11-26T07:17:47.872 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-26T07:17:47.872 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-26T07:17:47.872 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-26T07:17:47.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.870+0000 7f30ce83a700 1 -- 172.21.15.2:0/2797547588 >> [v2:172.21.15.2:6800/3414405195,v1:172.21.15.2:6801/3414405195] conn(0x7f30a80717e0 msgr2=0x7f30a8073c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:47.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.870+0000 7f30ce83a700 1 --2- 172.21.15.2:0/2797547588 >> [v2:172.21.15.2:6800/3414405195,v1:172.21.15.2:6801/3414405195] conn(0x7f30a80717e0 0x7f30a8073c00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.870+0000 7f30ce83a700 1 -- 172.21.15.2:0/2797547588 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f30a806b980 msgr2=0x7f30a806de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:47.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.870+0000 7f30ce83a700 1 --2- 172.21.15.2:0/2797547588 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f30a806b980 0x7f30a806de40 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f30b8000c00 tx=0x7f30b8007d10 comp rx=0 tx=0).stop 2023-11-26T07:17:47.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.870+0000 7f30ce83a700 1 -- 172.21.15.2:0/2797547588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30b4003a00 msgr2=0x7f30c80cc470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:47.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.870+0000 7f30ce83a700 1 --2- 172.21.15.2:0/2797547588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30b4003a00 0x7f30c80cc470 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f30b000e4b0 tx=0x7f30b00047c0 comp rx=0 tx=0).stop 2023-11-26T07:17:47.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.870+0000 7f30ccdd7700 1 -- 172.21.15.2:0/2797547588 reap_dead start 2023-11-26T07:17:47.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.870+0000 7f30ce83a700 1 -- 172.21.15.2:0/2797547588 shutdown_connections 2023-11-26T07:17:47.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.870+0000 7f30ce83a700 1 -- 172.21.15.2:0/2797547588 >> 172.21.15.2:0/2797547588 conn(0x7f30c80b2760 msgr2=0x7f30c815fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:47.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.870+0000 7f30ce83a700 1 -- 172.21.15.2:0/2797547588 shutdown_connections 2023-11-26T07:17:47.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:47.870+0000 7f30ce83a700 1 -- 172.21.15.2:0/2797547588 wait complete. 2023-11-26T07:17:47.884 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-26T07:17:48.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.007+0000 7f7081f12700 1 Processor -- start 2023-11-26T07:17:48.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.008+0000 7f7081f12700 1 -- start start 2023-11-26T07:17:48.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.008+0000 7f7081f12700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f707c06b9e0 0x7f707c066ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:48.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.008+0000 7f7081f12700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f707c06d350 0x7f707c06d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:48.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.008+0000 7f7081f12700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f707c06be70 con 0x7f707c15aac0 2023-11-26T07:17:48.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.008+0000 7f7081f12700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f707c15aea0 con 0x7f707c06b9e0 2023-11-26T07:17:48.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.008+0000 7f7081f12700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f707c06dd00 con 0x7f707c06d350 2023-11-26T07:17:48.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.008+0000 7f707b7fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f707c15aac0 0x7f707c0af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36524/0 (socket says 172.21.15.2:36524) 2023-11-26T07:17:48.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.008+0000 7f707b7fe700 1 -- 172.21.15.2:0/148824593 learned_addr learned my addr 172.21.15.2:0/148824593 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:48.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.009+0000 7f707affd700 1 --2- 172.21.15.2:0/148824593 >> v2:172.21.15.192:3300/0 conn(0x7f707c06b9e0 0x7f707c066ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:48.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.009+0000 7f707bfff700 1 --2- 172.21.15.2:0/148824593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f707c06d350 0x7f707c06d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:48.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.009+0000 7f707a7fc700 1 -- 172.21.15.2:0/148824593 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 511772185 0 0) 0x7f707c06be70 con 0x7f707c15aac0 2023-11-26T07:17:48.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.009+0000 7f707a7fc700 1 -- 172.21.15.2:0/148824593 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70680035b0 con 0x7f707c15aac0 2023-11-26T07:17:48.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.009+0000 7f707a7fc700 1 -- 172.21.15.2:0/148824593 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1713278212 0 0) 0x7f70680035b0 con 0x7f707c15aac0 2023-11-26T07:17:48.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.009+0000 7f707affd700 1 -- 172.21.15.2:0/148824593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f707c06d350 msgr2=0x7f707c06d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:48.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.009+0000 7f707affd700 1 --2- 172.21.15.2:0/148824593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f707c06d350 0x7f707c06d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.009+0000 7f707affd700 1 -- 172.21.15.2:0/148824593 >> v1:172.21.15.2:6789/0 conn(0x7f707c15aac0 legacy=0x7f707c0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:48.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.009+0000 7f707affd700 1 -- 172.21.15.2:0/148824593 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f707c15b090 con 0x7f707c06b9e0 2023-11-26T07:17:48.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.009+0000 7f707affd700 1 --2- 172.21.15.2:0/148824593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f707c06b9e0 0x7f707c066ce0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f70640098a0 tx=0x7f7064009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a59ec1e41d1e6efb server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:48.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.009+0000 7f707a7fc700 1 -- 172.21.15.2:0/148824593 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706c001670 con 0x7f707c06b9e0 2023-11-26T07:17:48.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.009+0000 7f707a7fc700 1 -- 172.21.15.2:0/148824593 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7064004030 con 0x7f707c06b9e0 2023-11-26T07:17:48.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.009+0000 7f707a7fc700 1 -- 172.21.15.2:0/148824593 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70640043c0 con 0x7f707c06b9e0 2023-11-26T07:17:48.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.010+0000 7f7081f12700 1 -- 172.21.15.2:0/148824593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f707c06b9e0 msgr2=0x7f707c066ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:48.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.010+0000 7f7081f12700 1 --2- 172.21.15.2:0/148824593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f707c06b9e0 0x7f707c066ce0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f70640098a0 tx=0x7f7064009bb0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.010+0000 7f7081f12700 1 -- 172.21.15.2:0/148824593 shutdown_connections 2023-11-26T07:17:48.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.010+0000 7f7081f12700 1 --2- 172.21.15.2:0/148824593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f707c06d350 0x7f707c06d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.010+0000 7f7081f12700 1 --2- 172.21.15.2:0/148824593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f707c06b9e0 0x7f707c066ce0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.010+0000 7f7081f12700 1 -- 172.21.15.2:0/148824593 >> 172.21.15.2:0/148824593 conn(0x7f707c0717f0 msgr2=0x7f707c0b50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:48.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.010+0000 7f7081f12700 1 -- 172.21.15.2:0/148824593 shutdown_connections 2023-11-26T07:17:48.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.010+0000 7f7081f12700 1 -- 172.21.15.2:0/148824593 wait complete. 2023-11-26T07:17:48.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.011+0000 7f7081f12700 1 Processor -- start 2023-11-26T07:17:48.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.011+0000 7f7081f12700 1 -- start start 2023-11-26T07:17:48.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.012+0000 7f7081f12700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f707c06b9e0 0x7f707c0cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:48.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.012+0000 7f7081f12700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f707c06d350 0x7f707c0cd610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:48.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.012+0000 7f7081f12700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f707c15aac0 0x7f707c149390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:48.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.012+0000 7f7081f12700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707c0cec30 con 0x7f707c15aac0 2023-11-26T07:17:48.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.012+0000 7f7081f12700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707c0ce020 con 0x7f707c06d350 2023-11-26T07:17:48.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.012+0000 7f7081f12700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f707c0ce300 con 0x7f707c06b9e0 2023-11-26T07:17:48.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.012+0000 7f707bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f707c15aac0 0x7f707c149390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:48.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.012+0000 7f707bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f707c15aac0 0x7f707c149390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45322/0 (socket says 172.21.15.2:45322) 2023-11-26T07:17:48.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.012+0000 7f707bfff700 1 -- 172.21.15.2:0/2074115260 learned_addr learned my addr 172.21.15.2:0/2074115260 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:48.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.012+0000 7f707bfff700 1 -- 172.21.15.2:0/2074115260 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f707c06b9e0 msgr2=0x7f707c0cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:48.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.012+0000 7f707b7fe700 1 --2- 172.21.15.2:0/2074115260 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f707c06b9e0 0x7f707c0cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:48.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.013+0000 7f707affd700 1 --2- 172.21.15.2:0/2074115260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f707c06d350 0x7f707c0cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:48.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.013+0000 7f707bfff700 1 --2- 172.21.15.2:0/2074115260 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f707c06b9e0 0x7f707c0cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.013+0000 7f707bfff700 1 -- 172.21.15.2:0/2074115260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f707c06d350 msgr2=0x7f707c0cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:48.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.013+0000 7f707bfff700 1 --2- 172.21.15.2:0/2074115260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f707c06d350 0x7f707c0cd610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.013+0000 7f707bfff700 1 -- 172.21.15.2:0/2074115260 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70640094a0 con 0x7f707c15aac0 2023-11-26T07:17:48.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.013+0000 7f707b7fe700 1 --2- 172.21.15.2:0/2074115260 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f707c06b9e0 0x7f707c0cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:48.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.013+0000 7f707affd700 1 --2- 172.21.15.2:0/2074115260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f707c06d350 0x7f707c0cd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:48.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.013+0000 7f707bfff700 1 --2- 172.21.15.2:0/2074115260 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f707c15aac0 0x7f707c149390 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f707400efc0 tx=0x7f707400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:48.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.013+0000 7f7073fff700 1 -- 172.21.15.2:0/2074115260 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707400cd40 con 0x7f707c15aac0 2023-11-26T07:17:48.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.013+0000 7f7073fff700 1 -- 172.21.15.2:0/2074115260 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f707400f040 con 0x7f707c15aac0 2023-11-26T07:17:48.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.013+0000 7f7073fff700 1 -- 172.21.15.2:0/2074115260 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70740146c0 con 0x7f707c15aac0 2023-11-26T07:17:48.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.013+0000 7f7081f12700 1 -- 172.21.15.2:0/2074115260 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f707c0ce5e0 con 0x7f707c15aac0 2023-11-26T07:17:48.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.013+0000 7f7081f12700 1 -- 172.21.15.2:0/2074115260 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f707c0cfd10 con 0x7f707c15aac0 2023-11-26T07:17:48.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.014+0000 7f7081f12700 1 -- 172.21.15.2:0/2074115260 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f707c068670 con 0x7f707c15aac0 2023-11-26T07:17:48.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.014+0000 7f7073fff700 1 -- 172.21.15.2:0/2074115260 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f7074014820 con 0x7f707c15aac0 2023-11-26T07:17:48.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.015+0000 7f7073fff700 1 --2- 172.21.15.2:0/2074115260 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f705c06b980 0x7f705c06de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:48.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.015+0000 7f7073fff700 1 -- 172.21.15.2:0/2074115260 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7074088af0 con 0x7f707c15aac0 2023-11-26T07:17:48.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.015+0000 7f707b7fe700 1 --2- 172.21.15.2:0/2074115260 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f705c06b980 0x7f705c06de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:48.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.016+0000 7f707b7fe700 1 --2- 172.21.15.2:0/2074115260 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f705c06b980 0x7f705c06de40 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f706c0011e0 tx=0x7f706c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:48.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.019+0000 7f7073fff700 1 -- 172.21.15.2:0/2074115260 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7074055390 con 0x7f707c15aac0 2023-11-26T07:17:48.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.222+0000 7f7081f12700 1 -- 172.21.15.2:0/2074115260 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f707c15b930 con 0x7f705c06b980 2023-11-26T07:17:48.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.223+0000 7f7073fff700 1 -- 172.21.15.2:0/2074115260 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f706c007df0 con 0x7f705c06b980 2023-11-26T07:17:48.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.225+0000 7f7081f12700 1 -- 172.21.15.2:0/2074115260 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f705c06b980 msgr2=0x7f705c06de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:48.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.225+0000 7f7081f12700 1 --2- 172.21.15.2:0/2074115260 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f705c06b980 0x7f705c06de40 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f706c0011e0 tx=0x7f706c009040 comp rx=0 tx=0).stop 2023-11-26T07:17:48.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.225+0000 7f7081f12700 1 -- 172.21.15.2:0/2074115260 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f707c15aac0 msgr2=0x7f707c149390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:48.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.225+0000 7f7081f12700 1 --2- 172.21.15.2:0/2074115260 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f707c15aac0 0x7f707c149390 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f707400efc0 tx=0x7f707400c3a0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.225+0000 7f7081f12700 1 -- 172.21.15.2:0/2074115260 shutdown_connections 2023-11-26T07:17:48.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.225+0000 7f7081f12700 1 --2- 172.21.15.2:0/2074115260 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f705c06b980 0x7f705c06de40 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.225+0000 7f7081f12700 1 --2- 172.21.15.2:0/2074115260 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f707c15aac0 0x7f707c149390 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.225+0000 7f7081f12700 1 --2- 172.21.15.2:0/2074115260 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f707c06b9e0 0x7f707c0cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.225+0000 7f7081f12700 1 --2- 172.21.15.2:0/2074115260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f707c06d350 0x7f707c0cd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.225+0000 7f7081f12700 1 -- 172.21.15.2:0/2074115260 >> 172.21.15.2:0/2074115260 conn(0x7f707c0717f0 msgr2=0x7f707c0b50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:48.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.225+0000 7f7081f12700 1 -- 172.21.15.2:0/2074115260 shutdown_connections 2023-11-26T07:17:48.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.225+0000 7f7081f12700 1 -- 172.21.15.2:0/2074115260 wait complete. 2023-11-26T07:17:48.229 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 1 to deep-scrub 2023-11-26T07:17:48.239 INFO:tasks.ceph:Scrubbing osd.2 2023-11-26T07:17:48.239 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-26T07:17:48.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.368+0000 7efcfa7b1700 1 Processor -- start 2023-11-26T07:17:48.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.368+0000 7efcfa7b1700 1 -- start start 2023-11-26T07:17:48.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.368+0000 7efcfa7b1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efcf406afd0 0x7efcf40b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:48.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.369+0000 7efcfa7b1700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf4071ec0 con 0x7efcf406b3b0 2023-11-26T07:17:48.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.369+0000 7efcfa7b1700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf4071b90 con 0x7efcf4072350 2023-11-26T07:17:48.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.369+0000 7efcfa7b1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf415ed30 con 0x7efcf406afd0 2023-11-26T07:17:48.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.369+0000 7efcf37fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7efcf406b3b0 0x7efcf415e470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36540/0 (socket says 172.21.15.2:36540) 2023-11-26T07:17:48.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.369+0000 7efcf37fe700 1 -- 172.21.15.2:0/2574058197 learned_addr learned my addr 172.21.15.2:0/2574058197 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:48.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.369+0000 7efcf3fff700 1 --2- 172.21.15.2:0/2574058197 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efcf406afd0 0x7efcf40b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:48.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.369+0000 7efcf2ffd700 1 -- 172.21.15.2:0/2574058197 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 245360902 0 0) 0x7efcf4071ec0 con 0x7efcf406b3b0 2023-11-26T07:17:48.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.369+0000 7efcf2ffd700 1 -- 172.21.15.2:0/2574058197 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcdc0035b0 con 0x7efcf406b3b0 2023-11-26T07:17:48.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.369+0000 7efcf2ffd700 1 -- 172.21.15.2:0/2574058197 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1035865467 0 0) 0x7efcdc0035b0 con 0x7efcf406b3b0 2023-11-26T07:17:48.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.369+0000 7efcf2ffd700 1 -- 172.21.15.2:0/2574058197 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efcf406afd0 msgr2=0x7efcf40b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:48.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.369+0000 7efcf2ffd700 1 --2- 172.21.15.2:0/2574058197 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efcf406afd0 0x7efcf40b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.369+0000 7efcf2ffd700 1 -- 172.21.15.2:0/2574058197 >> v1:172.21.15.192:6789/0 conn(0x7efcf4072350 legacy=0x7efcf406dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:48.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.369+0000 7efcf2ffd700 1 -- 172.21.15.2:0/2574058197 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf415f010 con 0x7efcf406b3b0 2023-11-26T07:17:48.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.369+0000 7efcf2ffd700 1 -- 172.21.15.2:0/2574058197 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7efce8001670 con 0x7efcf406b3b0 2023-11-26T07:17:48.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.369+0000 7efcf2ffd700 1 -- 172.21.15.2:0/2574058197 >> v1:172.21.15.2:6789/0 conn(0x7efcf406b3b0 legacy=0x7efcf415e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:48.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.369+0000 7efcf2ffd700 1 --2- 172.21.15.2:0/2574058197 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efcf406afd0 0x7efcdc003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:48.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.369+0000 7efcf2ffd700 1 --2- 172.21.15.2:0/2574058197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcdc003fb0 0x7efcdc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:48.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.369+0000 7efcf2ffd700 1 --2- 172.21.15.2:0/2574058197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efcdc004d90 0x7efcdc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:48.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.369+0000 7efcf2ffd700 1 -- 172.21.15.2:0/2574058197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf415ed30 con 0x7efcdc003fb0 2023-11-26T07:17:48.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.369+0000 7efcf2ffd700 1 -- 172.21.15.2:0/2574058197 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc00baf0 con 0x7efcdc004d90 2023-11-26T07:17:48.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.369+0000 7efcf2ffd700 1 -- 172.21.15.2:0/2574058197 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc00bcb0 con 0x7efcf406afd0 2023-11-26T07:17:48.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.369+0000 7efcf37fe700 1 --2- 172.21.15.2:0/2574058197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcdc003fb0 0x7efcdc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:48.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.369+0000 7efcf3fff700 1 --2- 172.21.15.2:0/2574058197 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efcf406afd0 0x7efcdc003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:48.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.370+0000 7efcf8d4e700 1 --2- 172.21.15.2:0/2574058197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efcdc004d90 0x7efcdc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:48.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.370+0000 7efcf37fe700 1 -- 172.21.15.2:0/2574058197 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efcf406afd0 msgr2=0x7efcdc003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:48.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.370+0000 7efcf37fe700 1 --2- 172.21.15.2:0/2574058197 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efcf406afd0 0x7efcdc003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.370+0000 7efcf37fe700 1 -- 172.21.15.2:0/2574058197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efcdc004d90 msgr2=0x7efcdc005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:48.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.370+0000 7efcf37fe700 1 --2- 172.21.15.2:0/2574058197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efcdc004d90 0x7efcdc005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.370+0000 7efcf37fe700 1 -- 172.21.15.2:0/2574058197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcdc0035b0 con 0x7efcdc003fb0 2023-11-26T07:17:48.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.370+0000 7efcf8d4e700 1 --2- 172.21.15.2:0/2574058197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efcdc004d90 0x7efcdc005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:48.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.370+0000 7efcf37fe700 1 --2- 172.21.15.2:0/2574058197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcdc003fb0 0x7efcdc004850 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7efce800c240 tx=0x7efcdc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71f980f09f1c142c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:48.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.370+0000 7efcf2ffd700 1 -- 172.21.15.2:0/2574058197 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce8007c10 con 0x7efcdc003fb0 2023-11-26T07:17:48.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.370+0000 7efcf2ffd700 1 -- 172.21.15.2:0/2574058197 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce800ce00 con 0x7efcdc003fb0 2023-11-26T07:17:48.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.370+0000 7efcf2ffd700 1 -- 172.21.15.2:0/2574058197 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce8005ba0 con 0x7efcdc003fb0 2023-11-26T07:17:48.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.370+0000 7efcfa7b1700 1 -- 172.21.15.2:0/2574058197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcdc003fb0 msgr2=0x7efcdc004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:48.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.370+0000 7efcfa7b1700 1 --2- 172.21.15.2:0/2574058197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcdc003fb0 0x7efcdc004850 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7efce800c240 tx=0x7efcdc005880 comp rx=0 tx=0).stop 2023-11-26T07:17:48.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.371+0000 7efcf8d4e700 1 -- 172.21.15.2:0/2574058197 reap_dead start 2023-11-26T07:17:48.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.371+0000 7efcfa7b1700 1 -- 172.21.15.2:0/2574058197 shutdown_connections 2023-11-26T07:17:48.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.371+0000 7efcfa7b1700 1 -- 172.21.15.2:0/2574058197 >> 172.21.15.2:0/2574058197 conn(0x7efcf40b2760 msgr2=0x7efcf40b2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:48.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.371+0000 7efcfa7b1700 1 -- 172.21.15.2:0/2574058197 shutdown_connections 2023-11-26T07:17:48.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.371+0000 7efcfa7b1700 1 -- 172.21.15.2:0/2574058197 wait complete. 2023-11-26T07:17:48.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.372+0000 7efcfa7b1700 1 Processor -- start 2023-11-26T07:17:48.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.372+0000 7efcfa7b1700 1 -- start start 2023-11-26T07:17:48.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.373+0000 7efcfa7b1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcdc003fb0 0x7efcf41401c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:48.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.373+0000 7efcfa7b1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efcf4140cf0 0x7efcf413f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:48.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.373+0000 7efcfa7b1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efcf40af070 0x7efcf4160580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:48.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.373+0000 7efcfa7b1700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf40aebe0 con 0x7efcdc003fb0 2023-11-26T07:17:48.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.373+0000 7efcfa7b1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf41411b0 con 0x7efcf4140cf0 2023-11-26T07:17:48.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.373+0000 7efcfa7b1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf4141490 con 0x7efcf40af070 2023-11-26T07:17:48.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.373+0000 7efcf3fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcdc003fb0 0x7efcf41401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:48.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.373+0000 7efcf3fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcdc003fb0 0x7efcf41401c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45340/0 (socket says 172.21.15.2:45340) 2023-11-26T07:17:48.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.373+0000 7efcf3fff700 1 -- 172.21.15.2:0/56125239 learned_addr learned my addr 172.21.15.2:0/56125239 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:48.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.373+0000 7efcf37fe700 1 --2- 172.21.15.2:0/56125239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efcf4140cf0 0x7efcf413f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:48.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.373+0000 7efcf3fff700 1 -- 172.21.15.2:0/56125239 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efcf40af070 msgr2=0x7efcf4160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:48.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.373+0000 7efcf8d4e700 1 --2- 172.21.15.2:0/56125239 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efcf40af070 0x7efcf4160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:48.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.373+0000 7efcf3fff700 1 --2- 172.21.15.2:0/56125239 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efcf40af070 0x7efcf4160580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.373+0000 7efcf3fff700 1 -- 172.21.15.2:0/56125239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efcf4140cf0 msgr2=0x7efcf413f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:48.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.373+0000 7efcf3fff700 1 --2- 172.21.15.2:0/56125239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efcf4140cf0 0x7efcf413f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.373+0000 7efcf3fff700 1 -- 172.21.15.2:0/56125239 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf4141770 con 0x7efcdc003fb0 2023-11-26T07:17:48.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.373+0000 7efcf37fe700 1 --2- 172.21.15.2:0/56125239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efcf4140cf0 0x7efcf413f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:48.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.373+0000 7efcf8d4e700 1 --2- 172.21.15.2:0/56125239 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efcf40af070 0x7efcf4160580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:48.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.373+0000 7efcf3fff700 1 --2- 172.21.15.2:0/56125239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcdc003fb0 0x7efcf41401c0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7efce4011aa0 tx=0x7efce4011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:48.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.374+0000 7efcf0ff9700 1 -- 172.21.15.2:0/56125239 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce400f980 con 0x7efcdc003fb0 2023-11-26T07:17:48.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.374+0000 7efcf0ff9700 1 -- 172.21.15.2:0/56125239 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce400fae0 con 0x7efcdc003fb0 2023-11-26T07:17:48.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.374+0000 7efcfa7b1700 1 -- 172.21.15.2:0/56125239 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf413fed0 con 0x7efcdc003fb0 2023-11-26T07:17:48.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.374+0000 7efcf0ff9700 1 -- 172.21.15.2:0/56125239 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce400fe90 con 0x7efcdc003fb0 2023-11-26T07:17:48.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.374+0000 7efcfa7b1700 1 -- 172.21.15.2:0/56125239 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf4153c70 con 0x7efcdc003fb0 2023-11-26T07:17:48.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.374+0000 7efcfa7b1700 1 -- 172.21.15.2:0/56125239 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efcf406b830 con 0x7efcdc003fb0 2023-11-26T07:17:48.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.375+0000 7efcf0ff9700 1 -- 172.21.15.2:0/56125239 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7efce40263a0 con 0x7efcdc003fb0 2023-11-26T07:17:48.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.375+0000 7efcf0ff9700 1 --2- 172.21.15.2:0/56125239 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7efce006b9b0 0x7efce006de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:48.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.376+0000 7efcf0ff9700 1 -- 172.21.15.2:0/56125239 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 4943+0+0 (secure 0 0 0) 0x7efce4088b40 con 0x7efcdc003fb0 2023-11-26T07:17:48.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.376+0000 7efcf37fe700 1 --2- 172.21.15.2:0/56125239 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7efce006b9b0 0x7efce006de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:48.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.376+0000 7efcf0ff9700 1 --2- 172.21.15.2:0/56125239 >> [v2:172.21.15.2:6808/1275933713,v1:172.21.15.2:6809/1275933713] conn(0x7efce0071810 0x7efce0073c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:48.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.376+0000 7efcf0ff9700 1 -- 172.21.15.2:0/56125239 --> [v2:172.21.15.2:6808/1275933713,v1:172.21.15.2:6809/1275933713] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efce0074300 con 0x7efce0071810 2023-11-26T07:17:48.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.376+0000 7efcf0ff9700 1 -- 172.21.15.2:0/56125239 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7efce408b630 con 0x7efcdc003fb0 2023-11-26T07:17:48.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.376+0000 7efcf8d4e700 1 --2- 172.21.15.2:0/56125239 >> [v2:172.21.15.2:6808/1275933713,v1:172.21.15.2:6809/1275933713] conn(0x7efce0071810 0x7efce0073c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:48.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.376+0000 7efcf8d4e700 1 --2- 172.21.15.2:0/56125239 >> [v2:172.21.15.2:6808/1275933713,v1:172.21.15.2:6809/1275933713] conn(0x7efce0071810 0x7efce0073c30 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:48.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.376+0000 7efcf37fe700 1 --2- 172.21.15.2:0/56125239 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7efce006b9b0 0x7efce006de70 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7efce8015040 tx=0x7efce8007000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:48.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.377+0000 7efcf0ff9700 1 -- 172.21.15.2:0/56125239 <== osd.2 v2:172.21.15.2:6808/1275933713 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7efce0074300 con 0x7efce0071810 2023-11-26T07:17:48.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.392+0000 7efcfa7b1700 1 -- 172.21.15.2:0/56125239 --> [v2:172.21.15.2:6808/1275933713,v1:172.21.15.2:6809/1275933713] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7efcf40aed20 con 0x7efce0071810 2023-11-26T07:17:48.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.392+0000 7efcf0ff9700 1 -- 172.21.15.2:0/56125239 <== osd.2 v2:172.21.15.2:6808/1275933713 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7efcec00d040 con 0x7efce0071810 2023-11-26T07:17:48.394 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-26T07:17:48.394 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-26T07:17:48.395 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-26T07:17:48.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.392+0000 7efcfa7b1700 1 -- 172.21.15.2:0/56125239 >> [v2:172.21.15.2:6808/1275933713,v1:172.21.15.2:6809/1275933713] conn(0x7efce0071810 msgr2=0x7efce0073c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:48.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.392+0000 7efcfa7b1700 1 --2- 172.21.15.2:0/56125239 >> [v2:172.21.15.2:6808/1275933713,v1:172.21.15.2:6809/1275933713] conn(0x7efce0071810 0x7efce0073c30 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.392+0000 7efcfa7b1700 1 -- 172.21.15.2:0/56125239 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7efce006b9b0 msgr2=0x7efce006de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:48.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.392+0000 7efcfa7b1700 1 --2- 172.21.15.2:0/56125239 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7efce006b9b0 0x7efce006de70 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7efce8015040 tx=0x7efce8007000 comp rx=0 tx=0).stop 2023-11-26T07:17:48.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.392+0000 7efcfa7b1700 1 -- 172.21.15.2:0/56125239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcdc003fb0 msgr2=0x7efcf41401c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:48.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.392+0000 7efcfa7b1700 1 --2- 172.21.15.2:0/56125239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcdc003fb0 0x7efcf41401c0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7efce4011aa0 tx=0x7efce4011e60 comp rx=0 tx=0).stop 2023-11-26T07:17:48.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.392+0000 7efcf8d4e700 1 -- 172.21.15.2:0/56125239 reap_dead start 2023-11-26T07:17:48.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.393+0000 7efcfa7b1700 1 -- 172.21.15.2:0/56125239 shutdown_connections 2023-11-26T07:17:48.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.393+0000 7efcfa7b1700 1 -- 172.21.15.2:0/56125239 >> 172.21.15.2:0/56125239 conn(0x7efcf40b2760 msgr2=0x7efcf40b3850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:48.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.393+0000 7efcfa7b1700 1 -- 172.21.15.2:0/56125239 shutdown_connections 2023-11-26T07:17:48.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.393+0000 7efcfa7b1700 1 -- 172.21.15.2:0/56125239 wait complete. 2023-11-26T07:17:48.406 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-26T07:17:48.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.530+0000 7fe7cc62d700 1 Processor -- start 2023-11-26T07:17:48.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.530+0000 7fe7cc62d700 1 -- start start 2023-11-26T07:17:48.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.531+0000 7fe7cc62d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe7c415e260 0x7fe7c406eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:48.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.531+0000 7fe7cc62d700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7c40d0f50 con 0x7fe7c40ccdd0 2023-11-26T07:17:48.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.531+0000 7fe7cc62d700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7c40d1230 con 0x7fe7c40d09e0 2023-11-26T07:17:48.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.531+0000 7fe7cc62d700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7c40cc2f0 con 0x7fe7c415e260 2023-11-26T07:17:48.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.532+0000 7fe7cabca700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe7c40ccdd0 0x7fe7c40cd220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36560/0 (socket says 172.21.15.2:36560) 2023-11-26T07:17:48.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.532+0000 7fe7cabca700 1 -- 172.21.15.2:0/3994007092 learned_addr learned my addr 172.21.15.2:0/3994007092 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:48.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.532+0000 7fe7ca3c9700 1 --2- 172.21.15.2:0/3994007092 >> v2:172.21.15.192:3300/0 conn(0x7fe7c415e260 0x7fe7c406eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:48.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.532+0000 7fe7c93c7700 1 -- 172.21.15.2:0/3994007092 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1825539707 0 0) 0x7fe7c40d0f50 con 0x7fe7c40ccdd0 2023-11-26T07:17:48.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.532+0000 7fe7c93c7700 1 -- 172.21.15.2:0/3994007092 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7b00035b0 con 0x7fe7c40ccdd0 2023-11-26T07:17:48.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.532+0000 7fe7c93c7700 1 -- 172.21.15.2:0/3994007092 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3453961108 0 0) 0x7fe7b00035b0 con 0x7fe7c40ccdd0 2023-11-26T07:17:48.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.532+0000 7fe7c93c7700 1 -- 172.21.15.2:0/3994007092 >> v2:172.21.15.192:3300/0 conn(0x7fe7c415e260 msgr2=0x7fe7c406eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:48.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.532+0000 7fe7c93c7700 1 --2- 172.21.15.2:0/3994007092 >> v2:172.21.15.192:3300/0 conn(0x7fe7c415e260 0x7fe7c406eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.532+0000 7fe7c93c7700 1 -- 172.21.15.2:0/3994007092 >> v1:172.21.15.192:6789/0 conn(0x7fe7c40d09e0 legacy=0x7fe7c406f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:48.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.532+0000 7fe7c93c7700 1 -- 172.21.15.2:0/3994007092 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c40cc5d0 con 0x7fe7c40ccdd0 2023-11-26T07:17:48.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.532+0000 7fe7c93c7700 1 -- 172.21.15.2:0/3994007092 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7fe7bc0019f0 con 0x7fe7c40ccdd0 2023-11-26T07:17:48.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.532+0000 7fe7c93c7700 1 -- 172.21.15.2:0/3994007092 >> v1:172.21.15.2:6789/0 conn(0x7fe7c40ccdd0 legacy=0x7fe7c40cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:48.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.532+0000 7fe7c93c7700 1 --2- 172.21.15.2:0/3994007092 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7b0003a00 0x7fe7b0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:48.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.532+0000 7fe7c93c7700 1 --2- 172.21.15.2:0/3994007092 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7b0004850 0x7fe7b0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:48.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.532+0000 7fe7c93c7700 1 --2- 172.21.15.2:0/3994007092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7b0005210 0x7fe7b000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:48.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.532+0000 7fe7c93c7700 1 -- 172.21.15.2:0/3994007092 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c40cc2f0 con 0x7fe7b0005210 2023-11-26T07:17:48.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.532+0000 7fe7c93c7700 1 -- 172.21.15.2:0/3994007092 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b000c0c0 con 0x7fe7b0004850 2023-11-26T07:17:48.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.532+0000 7fe7c93c7700 1 -- 172.21.15.2:0/3994007092 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b000c280 con 0x7fe7b0003a00 2023-11-26T07:17:48.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.532+0000 7fe7cabca700 1 --2- 172.21.15.2:0/3994007092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7b0005210 0x7fe7b000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:48.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.532+0000 7fe7ca3c9700 1 --2- 172.21.15.2:0/3994007092 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7b0003a00 0x7fe7b0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:48.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.532+0000 7fe7c9bc8700 1 --2- 172.21.15.2:0/3994007092 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7b0004850 0x7fe7b0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:48.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.533+0000 7fe7cabca700 1 -- 172.21.15.2:0/3994007092 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7b0003a00 msgr2=0x7fe7b0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:48.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.533+0000 7fe7cabca700 1 --2- 172.21.15.2:0/3994007092 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7b0003a00 0x7fe7b0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.533+0000 7fe7cabca700 1 -- 172.21.15.2:0/3994007092 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7b0004850 msgr2=0x7fe7b0004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:48.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.533+0000 7fe7cabca700 1 --2- 172.21.15.2:0/3994007092 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7b0004850 0x7fe7b0004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.533+0000 7fe7cabca700 1 -- 172.21.15.2:0/3994007092 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b00035b0 con 0x7fe7b0005210 2023-11-26T07:17:48.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.533+0000 7fe7cabca700 1 -- 172.21.15.2:0/3994007092 reap_dead start 2023-11-26T07:17:48.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.533+0000 7fe7cabca700 1 --2- 172.21.15.2:0/3994007092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7b0005210 0x7fe7b000ba10 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc00a830 tx=0x7fe7b0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bf30e73d4a8de09 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:48.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.533+0000 7fe7c93c7700 1 -- 172.21.15.2:0/3994007092 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7bc00a2f0 con 0x7fe7b0005210 2023-11-26T07:17:48.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.533+0000 7fe7c93c7700 1 -- 172.21.15.2:0/3994007092 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7bc012600 con 0x7fe7b0005210 2023-11-26T07:17:48.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.533+0000 7fe7c93c7700 1 -- 172.21.15.2:0/3994007092 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7bc0129b0 con 0x7fe7b0005210 2023-11-26T07:17:48.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.533+0000 7fe7cc62d700 1 -- 172.21.15.2:0/3994007092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7b0005210 msgr2=0x7fe7b000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:48.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.533+0000 7fe7cc62d700 1 --2- 172.21.15.2:0/3994007092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7b0005210 0x7fe7b000ba10 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc00a830 tx=0x7fe7b0005880 comp rx=0 tx=0).stop 2023-11-26T07:17:48.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.534+0000 7fe7cc62d700 1 -- 172.21.15.2:0/3994007092 shutdown_connections 2023-11-26T07:17:48.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.534+0000 7fe7cc62d700 1 --2- 172.21.15.2:0/3994007092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7b0005210 0x7fe7b000ba10 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.534+0000 7fe7cc62d700 1 -- 172.21.15.2:0/3994007092 >> 172.21.15.2:0/3994007092 conn(0x7fe7c40b3790 msgr2=0x7fe7c40b3ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:48.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.534+0000 7fe7cc62d700 1 -- 172.21.15.2:0/3994007092 shutdown_connections 2023-11-26T07:17:48.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.534+0000 7fe7cc62d700 1 -- 172.21.15.2:0/3994007092 wait complete. 2023-11-26T07:17:48.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.535+0000 7fe7cc62d700 1 Processor -- start 2023-11-26T07:17:48.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.535+0000 7fe7cc62d700 1 -- start start 2023-11-26T07:17:48.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.536+0000 7fe7cc62d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7b0005210 0x7fe7c40d1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:48.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.536+0000 7fe7cc62d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7c41f3480 0x7fe7c41f3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:48.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.536+0000 7fe7cc62d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7c40c57a0 0x7fe7c40c5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:48.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.536+0000 7fe7cc62d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c40c6510 con 0x7fe7c40c57a0 2023-11-26T07:17:48.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.536+0000 7fe7cc62d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c41f8520 con 0x7fe7b0005210 2023-11-26T07:17:48.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.536+0000 7fe7cc62d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c41f7780 con 0x7fe7c41f3480 2023-11-26T07:17:48.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.536+0000 7fe7cabca700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7c40c57a0 0x7fe7c40c5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:48.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.536+0000 7fe7cabca700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7c40c57a0 0x7fe7c40c5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45366/0 (socket says 172.21.15.2:45366) 2023-11-26T07:17:48.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.536+0000 7fe7cabca700 1 -- 172.21.15.2:0/103856444 learned_addr learned my addr 172.21.15.2:0/103856444 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:48.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.536+0000 7fe7c9bc8700 1 --2- 172.21.15.2:0/103856444 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7c41f3480 0x7fe7c41f3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:48.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.536+0000 7fe7ca3c9700 1 --2- 172.21.15.2:0/103856444 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7b0005210 0x7fe7c40d1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:48.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.536+0000 7fe7cabca700 1 -- 172.21.15.2:0/103856444 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7c41f3480 msgr2=0x7fe7c41f3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:48.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.536+0000 7fe7cabca700 1 --2- 172.21.15.2:0/103856444 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7c41f3480 0x7fe7c41f3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.536+0000 7fe7cabca700 1 -- 172.21.15.2:0/103856444 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7b0005210 msgr2=0x7fe7c40d1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:48.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.536+0000 7fe7cabca700 1 --2- 172.21.15.2:0/103856444 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7b0005210 0x7fe7c40d1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.536+0000 7fe7cabca700 1 -- 172.21.15.2:0/103856444 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c41f7a40 con 0x7fe7c40c57a0 2023-11-26T07:17:48.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.536+0000 7fe7c9bc8700 1 --2- 172.21.15.2:0/103856444 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7c41f3480 0x7fe7c41f3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:48.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.536+0000 7fe7ca3c9700 1 --2- 172.21.15.2:0/103856444 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7b0005210 0x7fe7c40d1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:48.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.536+0000 7fe7cabca700 1 --2- 172.21.15.2:0/103856444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7c40c57a0 0x7fe7c40c5c50 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fe7c40d1bd0 tx=0x7fe7bc001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:48.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.537+0000 7fe7b6ffd700 1 -- 172.21.15.2:0/103856444 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7bc0019b0 con 0x7fe7c40c57a0 2023-11-26T07:17:48.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.537+0000 7fe7b6ffd700 1 -- 172.21.15.2:0/103856444 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7bc01e430 con 0x7fe7c40c57a0 2023-11-26T07:17:48.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.537+0000 7fe7b6ffd700 1 -- 172.21.15.2:0/103856444 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7bc01e7e0 con 0x7fe7c40c57a0 2023-11-26T07:17:48.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.537+0000 7fe7cc62d700 1 -- 172.21.15.2:0/103856444 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7c41f7d20 con 0x7fe7c40c57a0 2023-11-26T07:17:48.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.537+0000 7fe7cc62d700 1 -- 172.21.15.2:0/103856444 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7c41f3e40 con 0x7fe7c40c57a0 2023-11-26T07:17:48.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.538+0000 7fe7cc62d700 1 -- 172.21.15.2:0/103856444 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7c41f8370 con 0x7fe7c40c57a0 2023-11-26T07:17:48.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.538+0000 7fe7b6ffd700 1 -- 172.21.15.2:0/103856444 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7fe7bc01e940 con 0x7fe7c40c57a0 2023-11-26T07:17:48.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.538+0000 7fe7b6ffd700 1 --2- 172.21.15.2:0/103856444 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe7a806b980 0x7fe7a806de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:48.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.539+0000 7fe7b6ffd700 1 -- 172.21.15.2:0/103856444 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe7bc08a070 con 0x7fe7c40c57a0 2023-11-26T07:17:48.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.539+0000 7fe7ca3c9700 1 --2- 172.21.15.2:0/103856444 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe7a806b980 0x7fe7a806de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:48.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.539+0000 7fe7ca3c9700 1 --2- 172.21.15.2:0/103856444 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe7a806b980 0x7fe7a806de40 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe7b8009be0 tx=0x7fe7b8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:48.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.543+0000 7fe7b6ffd700 1 -- 172.21.15.2:0/103856444 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe7bc056bd0 con 0x7fe7c40c57a0 2023-11-26T07:17:48.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.744+0000 7fe7cc62d700 1 -- 172.21.15.2:0/103856444 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7c40b4550 con 0x7fe7a806b980 2023-11-26T07:17:48.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.745+0000 7fe7b6ffd700 1 -- 172.21.15.2:0/103856444 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe7b8009830 con 0x7fe7a806b980 2023-11-26T07:17:48.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.747+0000 7fe7cc62d700 1 -- 172.21.15.2:0/103856444 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe7a806b980 msgr2=0x7fe7a806de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:48.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.747+0000 7fe7cc62d700 1 --2- 172.21.15.2:0/103856444 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe7a806b980 0x7fe7a806de40 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe7b8009be0 tx=0x7fe7b8008040 comp rx=0 tx=0).stop 2023-11-26T07:17:48.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.747+0000 7fe7cc62d700 1 -- 172.21.15.2:0/103856444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7c40c57a0 msgr2=0x7fe7c40c5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:48.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.747+0000 7fe7cc62d700 1 --2- 172.21.15.2:0/103856444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7c40c57a0 0x7fe7c40c5c50 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fe7c40d1bd0 tx=0x7fe7bc001d80 comp rx=0 tx=0).stop 2023-11-26T07:17:48.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.747+0000 7fe7cc62d700 1 -- 172.21.15.2:0/103856444 shutdown_connections 2023-11-26T07:17:48.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.747+0000 7fe7cc62d700 1 --2- 172.21.15.2:0/103856444 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fe7a806b980 0x7fe7a806de40 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.747+0000 7fe7cc62d700 1 --2- 172.21.15.2:0/103856444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7c40c57a0 0x7fe7c40c5c50 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.747+0000 7fe7cc62d700 1 --2- 172.21.15.2:0/103856444 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7b0005210 0x7fe7c40d1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.747+0000 7fe7cc62d700 1 --2- 172.21.15.2:0/103856444 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7c41f3480 0x7fe7c41f3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.747+0000 7fe7cc62d700 1 -- 172.21.15.2:0/103856444 >> 172.21.15.2:0/103856444 conn(0x7fe7c40b3790 msgr2=0x7fe7c40b2ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:48.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.747+0000 7fe7cc62d700 1 -- 172.21.15.2:0/103856444 shutdown_connections 2023-11-26T07:17:48.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.747+0000 7fe7cc62d700 1 -- 172.21.15.2:0/103856444 wait complete. 2023-11-26T07:17:48.751 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 2 to deep-scrub 2023-11-26T07:17:48.761 INFO:tasks.ceph:Scrubbing osd.3 2023-11-26T07:17:48.761 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-11-26T07:17:48.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.888+0000 7fa366d14700 1 Processor -- start 2023-11-26T07:17:48.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.888+0000 7fa366d14700 1 -- start start 2023-11-26T07:17:48.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.889+0000 7fa366d14700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa360144c10 0x7fa36006afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:48.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.889+0000 7fa366d14700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa360145650 0x7fa36006b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:48.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.889+0000 7fa366d14700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa36006eb80 con 0x7fa360145100 2023-11-26T07:17:48.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.889+0000 7fa366d14700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa36006f500 con 0x7fa360145650 2023-11-26T07:17:48.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.889+0000 7fa366d14700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3600cd610 con 0x7fa360144c10 2023-11-26T07:17:48.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.889+0000 7fa3652b1700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa360145650 0x7fa36006b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:48.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.889+0000 7fa35ffff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa360145100 0x7fa360071bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36582/0 (socket says 172.21.15.2:36582) 2023-11-26T07:17:48.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.889+0000 7fa35ffff700 1 -- 172.21.15.2:0/1971646278 learned_addr learned my addr 172.21.15.2:0/1971646278 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:48.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.889+0000 7fa364ab0700 1 --2- 172.21.15.2:0/1971646278 >> v2:172.21.15.192:3300/0 conn(0x7fa360144c10 0x7fa36006afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:48.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.890+0000 7fa3652b1700 1 -- 172.21.15.2:0/1971646278 >> v2:172.21.15.192:3300/0 conn(0x7fa360144c10 msgr2=0x7fa36006afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:48.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.890+0000 7fa3652b1700 1 --2- 172.21.15.2:0/1971646278 >> v2:172.21.15.192:3300/0 conn(0x7fa360144c10 0x7fa36006afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.890+0000 7fa3652b1700 1 -- 172.21.15.2:0/1971646278 >> v1:172.21.15.2:6789/0 conn(0x7fa360145100 legacy=0x7fa360071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:48.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.890+0000 7fa3652b1700 1 -- 172.21.15.2:0/1971646278 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa360160720 con 0x7fa360145650 2023-11-26T07:17:48.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.890+0000 7fa364ab0700 1 --2- 172.21.15.2:0/1971646278 >> v2:172.21.15.192:3300/0 conn(0x7fa360144c10 0x7fa36006afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:48.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.890+0000 7fa35f7fe700 1 -- 172.21.15.2:0/1971646278 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4257367565 0 0) 0x7fa36006eb80 con 0x7fa360145100 2023-11-26T07:17:48.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.890+0000 7fa3652b1700 1 --2- 172.21.15.2:0/1971646278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa360145650 0x7fa36006b510 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fa3600706e0 tx=0x7fa35800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68aa252552325f4c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:48.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.890+0000 7fa35f7fe700 1 -- 172.21.15.2:0/1971646278 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35800e070 con 0x7fa360145650 2023-11-26T07:17:48.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.890+0000 7fa35f7fe700 1 -- 172.21.15.2:0/1971646278 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa35800bbd0 con 0x7fa360145650 2023-11-26T07:17:48.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.890+0000 7fa35f7fe700 1 -- 172.21.15.2:0/1971646278 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa358012430 con 0x7fa360145650 2023-11-26T07:17:48.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.890+0000 7fa366d14700 1 -- 172.21.15.2:0/1971646278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa360145650 msgr2=0x7fa36006b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:48.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.890+0000 7fa366d14700 1 --2- 172.21.15.2:0/1971646278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa360145650 0x7fa36006b510 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fa3600706e0 tx=0x7fa35800b330 comp rx=0 tx=0).stop 2023-11-26T07:17:48.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.890+0000 7fa366d14700 1 -- 172.21.15.2:0/1971646278 shutdown_connections 2023-11-26T07:17:48.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.890+0000 7fa366d14700 1 --2- 172.21.15.2:0/1971646278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa360145650 0x7fa36006b510 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.890+0000 7fa366d14700 1 --2- 172.21.15.2:0/1971646278 >> v2:172.21.15.192:3300/0 conn(0x7fa360144c10 0x7fa36006afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.890+0000 7fa366d14700 1 -- 172.21.15.2:0/1971646278 >> 172.21.15.2:0/1971646278 conn(0x7fa3600b2740 msgr2=0x7fa3600b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:48.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.891+0000 7fa366d14700 1 -- 172.21.15.2:0/1971646278 shutdown_connections 2023-11-26T07:17:48.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.891+0000 7fa366d14700 1 -- 172.21.15.2:0/1971646278 wait complete. 2023-11-26T07:17:48.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.892+0000 7fa366d14700 1 Processor -- start 2023-11-26T07:17:48.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.892+0000 7fa366d14700 1 -- start start 2023-11-26T07:17:48.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.893+0000 7fa366d14700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa360144c10 0x7fa3600afd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:48.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.893+0000 7fa366d14700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa360145100 0x7fa36015ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:48.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.893+0000 7fa366d14700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa360145650 0x7fa36015cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:48.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.893+0000 7fa366d14700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36015f9a0 con 0x7fa360145650 2023-11-26T07:17:48.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.893+0000 7fa366d14700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36015fc80 con 0x7fa360145100 2023-11-26T07:17:48.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.893+0000 7fa366d14700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa36015ff60 con 0x7fa360144c10 2023-11-26T07:17:48.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.893+0000 7fa3652b1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa360145650 0x7fa36015cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:48.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.893+0000 7fa3652b1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa360145650 0x7fa36015cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45380/0 (socket says 172.21.15.2:45380) 2023-11-26T07:17:48.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.893+0000 7fa3652b1700 1 -- 172.21.15.2:0/1211940017 learned_addr learned my addr 172.21.15.2:0/1211940017 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:48.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.893+0000 7fa35ffff700 1 --2- 172.21.15.2:0/1211940017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa360145100 0x7fa36015ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:48.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.893+0000 7fa364ab0700 1 --2- 172.21.15.2:0/1211940017 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa360144c10 0x7fa3600afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:48.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.893+0000 7fa3652b1700 1 -- 172.21.15.2:0/1211940017 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa360144c10 msgr2=0x7fa3600afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:48.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.893+0000 7fa3652b1700 1 --2- 172.21.15.2:0/1211940017 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa360144c10 0x7fa3600afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.893+0000 7fa3652b1700 1 -- 172.21.15.2:0/1211940017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa360145100 msgr2=0x7fa36015ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:48.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.893+0000 7fa3652b1700 1 --2- 172.21.15.2:0/1211940017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa360145100 0x7fa36015ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.893+0000 7fa3652b1700 1 -- 172.21.15.2:0/1211940017 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa358009a70 con 0x7fa360145650 2023-11-26T07:17:48.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.893+0000 7fa3652b1700 1 --2- 172.21.15.2:0/1211940017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa360145650 0x7fa36015cfd0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fa358013000 tx=0x7fa358004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:48.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.893+0000 7fa35d7fa700 1 -- 172.21.15.2:0/1211940017 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa358012430 con 0x7fa360145650 2023-11-26T07:17:48.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.893+0000 7fa35d7fa700 1 -- 172.21.15.2:0/1211940017 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa358020070 con 0x7fa360145650 2023-11-26T07:17:48.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.893+0000 7fa366d14700 1 -- 172.21.15.2:0/1211940017 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3600b3be0 con 0x7fa360145650 2023-11-26T07:17:48.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.893+0000 7fa35d7fa700 1 -- 172.21.15.2:0/1211940017 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa358004280 con 0x7fa360145650 2023-11-26T07:17:48.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.894+0000 7fa366d14700 1 -- 172.21.15.2:0/1211940017 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3600b02c0 con 0x7fa360145650 2023-11-26T07:17:48.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.894+0000 7fa366d14700 1 -- 172.21.15.2:0/1211940017 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa36015fdf0 con 0x7fa360145650 2023-11-26T07:17:48.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.895+0000 7fa35d7fa700 1 -- 172.21.15.2:0/1211940017 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7fa3580043e0 con 0x7fa360145650 2023-11-26T07:17:48.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.895+0000 7fa35d7fa700 1 --2- 172.21.15.2:0/1211940017 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa34406b980 0x7fa34406de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:48.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.895+0000 7fa35d7fa700 1 -- 172.21.15.2:0/1211940017 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa358022070 con 0x7fa360145650 2023-11-26T07:17:48.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.896+0000 7fa364ab0700 1 --2- 172.21.15.2:0/1211940017 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa34406b980 0x7fa34406de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:48.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.896+0000 7fa35d7fa700 1 --2- 172.21.15.2:0/1211940017 >> [v2:172.21.15.2:6824/3168701171,v1:172.21.15.2:6825/3168701171] conn(0x7fa3440717e0 0x7fa344073c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:48.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.896+0000 7fa35d7fa700 1 -- 172.21.15.2:0/1211940017 --> [v2:172.21.15.2:6824/3168701171,v1:172.21.15.2:6825/3168701171] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa3440742d0 con 0x7fa3440717e0 2023-11-26T07:17:48.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.896+0000 7fa35d7fa700 1 -- 172.21.15.2:0/1211940017 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa35808d040 con 0x7fa360145650 2023-11-26T07:17:48.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.896+0000 7fa35ffff700 1 --2- 172.21.15.2:0/1211940017 >> [v2:172.21.15.2:6824/3168701171,v1:172.21.15.2:6825/3168701171] conn(0x7fa3440717e0 0x7fa344073c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:48.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.896+0000 7fa364ab0700 1 --2- 172.21.15.2:0/1211940017 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa34406b980 0x7fa34406de40 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa354009930 tx=0x7fa354008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:48.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.896+0000 7fa35ffff700 1 --2- 172.21.15.2:0/1211940017 >> [v2:172.21.15.2:6824/3168701171,v1:172.21.15.2:6825/3168701171] conn(0x7fa3440717e0 0x7fa344073c00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:48.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.897+0000 7fa35d7fa700 1 -- 172.21.15.2:0/1211940017 <== osd.3 v2:172.21.15.2:6824/3168701171 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fa3440742d0 con 0x7fa3440717e0 2023-11-26T07:17:48.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.912+0000 7fa366d14700 1 -- 172.21.15.2:0/1211940017 --> [v2:172.21.15.2:6824/3168701171,v1:172.21.15.2:6825/3168701171] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa360075440 con 0x7fa3440717e0 2023-11-26T07:17:48.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.912+0000 7fa35d7fa700 1 -- 172.21.15.2:0/1211940017 <== osd.3 v2:172.21.15.2:6824/3168701171 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fa360075440 con 0x7fa3440717e0 2023-11-26T07:17:48.914 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-26T07:17:48.915 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-26T07:17:48.915 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-26T07:17:48.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.912+0000 7fa366d14700 1 -- 172.21.15.2:0/1211940017 >> [v2:172.21.15.2:6824/3168701171,v1:172.21.15.2:6825/3168701171] conn(0x7fa3440717e0 msgr2=0x7fa344073c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:48.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.912+0000 7fa366d14700 1 --2- 172.21.15.2:0/1211940017 >> [v2:172.21.15.2:6824/3168701171,v1:172.21.15.2:6825/3168701171] conn(0x7fa3440717e0 0x7fa344073c00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.912+0000 7fa366d14700 1 -- 172.21.15.2:0/1211940017 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa34406b980 msgr2=0x7fa34406de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:48.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.912+0000 7fa366d14700 1 --2- 172.21.15.2:0/1211940017 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa34406b980 0x7fa34406de40 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa354009930 tx=0x7fa354008040 comp rx=0 tx=0).stop 2023-11-26T07:17:48.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.912+0000 7fa366d14700 1 -- 172.21.15.2:0/1211940017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa360145650 msgr2=0x7fa36015cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:48.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.912+0000 7fa366d14700 1 --2- 172.21.15.2:0/1211940017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa360145650 0x7fa36015cfd0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fa358013000 tx=0x7fa358004ad0 comp rx=0 tx=0).stop 2023-11-26T07:17:48.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.912+0000 7fa3652b1700 1 -- 172.21.15.2:0/1211940017 reap_dead start 2023-11-26T07:17:48.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.913+0000 7fa366d14700 1 -- 172.21.15.2:0/1211940017 shutdown_connections 2023-11-26T07:17:48.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.913+0000 7fa366d14700 1 -- 172.21.15.2:0/1211940017 >> 172.21.15.2:0/1211940017 conn(0x7fa3600b2740 msgr2=0x7fa3600cf140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:48.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.913+0000 7fa366d14700 1 -- 172.21.15.2:0/1211940017 shutdown_connections 2023-11-26T07:17:48.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:48.913+0000 7fa366d14700 1 -- 172.21.15.2:0/1211940017 wait complete. 2023-11-26T07:17:48.926 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-11-26T07:17:49.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.050+0000 7f73dd109700 1 Processor -- start 2023-11-26T07:17:49.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.050+0000 7f73dd109700 1 -- start start 2023-11-26T07:17:49.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.051+0000 7f73dd109700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f73d815bde0 0x7f73d815c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.051+0000 7f73dd109700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f73d80cf2b0 0x7f73d80d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.051+0000 7f73dd109700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73d80d0a90 con 0x7f73d80ce5c0 2023-11-26T07:17:49.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.051+0000 7f73dd109700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73d806ee10 con 0x7f73d80cf2b0 2023-11-26T07:17:49.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.051+0000 7f73dd109700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73d806f0f0 con 0x7f73d815bde0 2023-11-26T07:17:49.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.051+0000 7f73d659c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f73d80cf2b0 0x7f73d80d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.051+0000 7f73d759e700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f73d80ce5c0 0x7f73d80cc670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36600/0 (socket says 172.21.15.2:36600) 2023-11-26T07:17:49.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.051+0000 7f73d759e700 1 -- 172.21.15.2:0/2753811487 learned_addr learned my addr 172.21.15.2:0/2753811487 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:49.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.051+0000 7f73d5d9b700 1 -- 172.21.15.2:0/2753811487 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 340901278 0 0) 0x7f73d80d0a90 con 0x7f73d80ce5c0 2023-11-26T07:17:49.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.052+0000 7f73d6d9d700 1 --2- 172.21.15.2:0/2753811487 >> v2:172.21.15.192:3300/0 conn(0x7f73d815bde0 0x7f73d815c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.052+0000 7f73d5d9b700 1 -- 172.21.15.2:0/2753811487 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73c00035b0 con 0x7f73d80ce5c0 2023-11-26T07:17:49.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.052+0000 7f73d659c700 1 -- 172.21.15.2:0/2753811487 >> v2:172.21.15.192:3300/0 conn(0x7f73d815bde0 msgr2=0x7f73d815c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:49.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.052+0000 7f73d659c700 1 --2- 172.21.15.2:0/2753811487 >> v2:172.21.15.192:3300/0 conn(0x7f73d815bde0 0x7f73d815c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.052+0000 7f73d659c700 1 -- 172.21.15.2:0/2753811487 >> v1:172.21.15.2:6789/0 conn(0x7f73d80ce5c0 legacy=0x7f73d80cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:49.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.052+0000 7f73d659c700 1 -- 172.21.15.2:0/2753811487 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d806f3d0 con 0x7f73d80cf2b0 2023-11-26T07:17:49.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.052+0000 7f73d659c700 1 --2- 172.21.15.2:0/2753811487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73d80cf2b0 0x7f73d80d01b0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f73d8072370 tx=0x7f73c8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ef033d19bf43490 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:49.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.052+0000 7f73d5d9b700 1 -- 172.21.15.2:0/2753811487 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c8011830 con 0x7f73d80cf2b0 2023-11-26T07:17:49.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.052+0000 7f73d5d9b700 1 -- 172.21.15.2:0/2753811487 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c8011990 con 0x7f73d80cf2b0 2023-11-26T07:17:49.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.052+0000 7f73d5d9b700 1 -- 172.21.15.2:0/2753811487 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c8011d20 con 0x7f73d80cf2b0 2023-11-26T07:17:49.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.052+0000 7f73dd109700 1 -- 172.21.15.2:0/2753811487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73d80cf2b0 msgr2=0x7f73d80d01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:49.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.052+0000 7f73dd109700 1 --2- 172.21.15.2:0/2753811487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73d80cf2b0 0x7f73d80d01b0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f73d8072370 tx=0x7f73c8009b20 comp rx=0 tx=0).stop 2023-11-26T07:17:49.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.052+0000 7f73dd109700 1 -- 172.21.15.2:0/2753811487 shutdown_connections 2023-11-26T07:17:49.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.052+0000 7f73dd109700 1 --2- 172.21.15.2:0/2753811487 >> v2:172.21.15.192:3300/0 conn(0x7f73d815bde0 0x7f73d815c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.052+0000 7f73dd109700 1 --2- 172.21.15.2:0/2753811487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73d80cf2b0 0x7f73d80d01b0 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.053+0000 7f73dd109700 1 -- 172.21.15.2:0/2753811487 >> 172.21.15.2:0/2753811487 conn(0x7f73d80b3720 msgr2=0x7f73d80b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:49.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.053+0000 7f73dd109700 1 -- 172.21.15.2:0/2753811487 shutdown_connections 2023-11-26T07:17:49.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.053+0000 7f73dd109700 1 -- 172.21.15.2:0/2753811487 wait complete. 2023-11-26T07:17:49.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.054+0000 7f73dd109700 1 Processor -- start 2023-11-26T07:17:49.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.054+0000 7f73dd109700 1 -- start start 2023-11-26T07:17:49.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.055+0000 7f73dd109700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73d80ce5c0 0x7f73d815ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.055+0000 7f73dd109700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f73d80cf2b0 0x7f73d815e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.055+0000 7f73dd109700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73d815bde0 0x7f73d806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.055+0000 7f73dd109700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d806c260 con 0x7f73d80ce5c0 2023-11-26T07:17:49.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.055+0000 7f73dd109700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d806c540 con 0x7f73d815bde0 2023-11-26T07:17:49.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.055+0000 7f73dd109700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d806c820 con 0x7f73d80cf2b0 2023-11-26T07:17:49.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.055+0000 7f73d6d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73d80ce5c0 0x7f73d815ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.055+0000 7f73d6d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73d80ce5c0 0x7f73d815ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45392/0 (socket says 172.21.15.2:45392) 2023-11-26T07:17:49.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.055+0000 7f73d6d9d700 1 -- 172.21.15.2:0/4227156118 learned_addr learned my addr 172.21.15.2:0/4227156118 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:49.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.055+0000 7f73d659c700 1 --2- 172.21.15.2:0/4227156118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f73d80cf2b0 0x7f73d815e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.055+0000 7f73d759e700 1 --2- 172.21.15.2:0/4227156118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73d815bde0 0x7f73d806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.055+0000 7f73d6d9d700 1 -- 172.21.15.2:0/4227156118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f73d80cf2b0 msgr2=0x7f73d815e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:49.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.055+0000 7f73d6d9d700 1 --2- 172.21.15.2:0/4227156118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f73d80cf2b0 0x7f73d815e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.055+0000 7f73d6d9d700 1 -- 172.21.15.2:0/4227156118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73d815bde0 msgr2=0x7f73d806d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:49.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.055+0000 7f73d6d9d700 1 --2- 172.21.15.2:0/4227156118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73d815bde0 0x7f73d806d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.055+0000 7f73d6d9d700 1 -- 172.21.15.2:0/4227156118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c80094a0 con 0x7f73d80ce5c0 2023-11-26T07:17:49.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.055+0000 7f73d759e700 1 --2- 172.21.15.2:0/4227156118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73d815bde0 0x7f73d806d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:49.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.055+0000 7f73d659c700 1 --2- 172.21.15.2:0/4227156118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f73d80cf2b0 0x7f73d815e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:49.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.055+0000 7f73d6d9d700 1 --2- 172.21.15.2:0/4227156118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73d80ce5c0 0x7f73d815ca40 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f73cc00d800 tx=0x7f73cc00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:49.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.056+0000 7f73bf7fe700 1 -- 172.21.15.2:0/4227156118 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc0125f0 con 0x7f73d80ce5c0 2023-11-26T07:17:49.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.056+0000 7f73bf7fe700 1 -- 172.21.15.2:0/4227156118 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73cc012750 con 0x7f73d80ce5c0 2023-11-26T07:17:49.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.056+0000 7f73bf7fe700 1 -- 172.21.15.2:0/4227156118 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc012b00 con 0x7f73d80ce5c0 2023-11-26T07:17:49.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.056+0000 7f73dd109700 1 -- 172.21.15.2:0/4227156118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73d806cb00 con 0x7f73d80ce5c0 2023-11-26T07:17:49.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.056+0000 7f73dd109700 1 -- 172.21.15.2:0/4227156118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73d815cf80 con 0x7f73d80ce5c0 2023-11-26T07:17:49.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.057+0000 7f73dd109700 1 -- 172.21.15.2:0/4227156118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73d815d110 con 0x7f73d80ce5c0 2023-11-26T07:17:49.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.057+0000 7f73bf7fe700 1 -- 172.21.15.2:0/4227156118 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f73cc012c60 con 0x7f73d80ce5c0 2023-11-26T07:17:49.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.057+0000 7f73bf7fe700 1 --2- 172.21.15.2:0/4227156118 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f73c406b980 0x7f73c406de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.058+0000 7f73bf7fe700 1 -- 172.21.15.2:0/4227156118 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f73cc0882c0 con 0x7f73d80ce5c0 2023-11-26T07:17:49.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.058+0000 7f73d659c700 1 --2- 172.21.15.2:0/4227156118 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f73c406b980 0x7f73c406de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.058+0000 7f73d659c700 1 --2- 172.21.15.2:0/4227156118 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f73c406b980 0x7f73c406de40 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f73d8072370 tx=0x7f73c8008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:49.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.062+0000 7f73bf7fe700 1 -- 172.21.15.2:0/4227156118 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f73cc054e20 con 0x7f73d80ce5c0 2023-11-26T07:17:49.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.266+0000 7f73dd109700 1 -- 172.21.15.2:0/4227156118 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f73d806c6b0 con 0x7f73c406b980 2023-11-26T07:17:49.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.267+0000 7f73bf7fe700 1 -- 172.21.15.2:0/4227156118 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f73d806c6b0 con 0x7f73c406b980 2023-11-26T07:17:49.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.269+0000 7f73dd109700 1 -- 172.21.15.2:0/4227156118 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f73c406b980 msgr2=0x7f73c406de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:49.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.269+0000 7f73dd109700 1 --2- 172.21.15.2:0/4227156118 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f73c406b980 0x7f73c406de40 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f73d8072370 tx=0x7f73c8008030 comp rx=0 tx=0).stop 2023-11-26T07:17:49.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.269+0000 7f73dd109700 1 -- 172.21.15.2:0/4227156118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73d80ce5c0 msgr2=0x7f73d815ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:49.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.269+0000 7f73dd109700 1 --2- 172.21.15.2:0/4227156118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73d80ce5c0 0x7f73d815ca40 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f73cc00d800 tx=0x7f73cc00dbc0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.269+0000 7f73dd109700 1 -- 172.21.15.2:0/4227156118 shutdown_connections 2023-11-26T07:17:49.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.269+0000 7f73dd109700 1 --2- 172.21.15.2:0/4227156118 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f73c406b980 0x7f73c406de40 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.269+0000 7f73dd109700 1 --2- 172.21.15.2:0/4227156118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73d815bde0 0x7f73d806d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.269+0000 7f73dd109700 1 --2- 172.21.15.2:0/4227156118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73d80ce5c0 0x7f73d815ca40 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.269+0000 7f73dd109700 1 --2- 172.21.15.2:0/4227156118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f73d80cf2b0 0x7f73d815e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.269+0000 7f73dd109700 1 -- 172.21.15.2:0/4227156118 >> 172.21.15.2:0/4227156118 conn(0x7f73d80b3720 msgr2=0x7f73d80b7380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:49.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.269+0000 7f73dd109700 1 -- 172.21.15.2:0/4227156118 shutdown_connections 2023-11-26T07:17:49.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.269+0000 7f73dd109700 1 -- 172.21.15.2:0/4227156118 wait complete. 2023-11-26T07:17:49.273 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 3 to deep-scrub 2023-11-26T07:17:49.283 INFO:tasks.ceph:Scrubbing osd.4 2023-11-26T07:17:49.284 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-11-26T07:17:49.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.411+0000 7f66ada9b700 1 Processor -- start 2023-11-26T07:17:49.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.411+0000 7f66ada9b700 1 -- start start 2023-11-26T07:17:49.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.412+0000 7f66ada9b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f66a8144c50 0x7f66a80cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.412+0000 7f66ada9b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f66a80d0630 0x7f66a806afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.412+0000 7f66ada9b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a80cf590 con 0x7f66a80cd9f0 2023-11-26T07:17:49.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.412+0000 7f66ada9b700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a80cf870 con 0x7f66a8144c50 2023-11-26T07:17:49.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.412+0000 7f66ada9b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a80cfb50 con 0x7f66a80d0630 2023-11-26T07:17:49.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.412+0000 7f66a77fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f66a8144c50 0x7f66a80cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.412+0000 7f66a77fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f66a8144c50 0x7f66a80cd4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45400/0 (socket says 172.21.15.2:45400) 2023-11-26T07:17:49.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.412+0000 7f66a77fe700 1 -- 172.21.15.2:0/3508945216 learned_addr learned my addr 172.21.15.2:0/3508945216 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:49.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.412+0000 7f66a6ffd700 1 --2- 172.21.15.2:0/3508945216 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f66a80d0630 0x7f66a806afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.413+0000 7f66a77fe700 1 -- 172.21.15.2:0/3508945216 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f66a80d0630 msgr2=0x7f66a806afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:49.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.413+0000 7f66a77fe700 1 --2- 172.21.15.2:0/3508945216 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f66a80d0630 0x7f66a806afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.413+0000 7f66a77fe700 1 -- 172.21.15.2:0/3508945216 >> v1:172.21.15.192:6789/0 conn(0x7f66a80cd9f0 legacy=0x7f66a815f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:49.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.413+0000 7f66a77fe700 1 -- 172.21.15.2:0/3508945216 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a80cfe30 con 0x7f66a8144c50 2023-11-26T07:17:49.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.413+0000 7f66a6ffd700 1 --2- 172.21.15.2:0/3508945216 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f66a80d0630 0x7f66a806afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:49.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.413+0000 7f66a77fe700 1 --2- 172.21.15.2:0/3508945216 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66a8144c50 0x7f66a80cd4b0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f66980098f0 tx=0x7f6698009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=503784e5190ef213 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:49.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.413+0000 7f66a67fc700 1 -- 172.21.15.2:0/3508945216 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669800b8a0 con 0x7f66a8144c50 2023-11-26T07:17:49.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.413+0000 7f66a67fc700 1 -- 172.21.15.2:0/3508945216 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669800ba00 con 0x7f66a8144c50 2023-11-26T07:17:49.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.413+0000 7f66a67fc700 1 -- 172.21.15.2:0/3508945216 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669800bd90 con 0x7f66a8144c50 2023-11-26T07:17:49.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.413+0000 7f66ada9b700 1 -- 172.21.15.2:0/3508945216 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66a8144c50 msgr2=0x7f66a80cd4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:49.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.413+0000 7f66ada9b700 1 --2- 172.21.15.2:0/3508945216 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66a8144c50 0x7f66a80cd4b0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f66980098f0 tx=0x7f6698009c00 comp rx=0 tx=0).stop 2023-11-26T07:17:49.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.414+0000 7f66ada9b700 1 -- 172.21.15.2:0/3508945216 shutdown_connections 2023-11-26T07:17:49.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.414+0000 7f66ada9b700 1 --2- 172.21.15.2:0/3508945216 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66a8144c50 0x7f66a80cd4b0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.414+0000 7f66ada9b700 1 --2- 172.21.15.2:0/3508945216 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f66a80d0630 0x7f66a806afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.414+0000 7f66ada9b700 1 -- 172.21.15.2:0/3508945216 >> 172.21.15.2:0/3508945216 conn(0x7f66a80d0aa0 msgr2=0x7f66a80d0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:49.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.414+0000 7f66ada9b700 1 -- 172.21.15.2:0/3508945216 shutdown_connections 2023-11-26T07:17:49.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.414+0000 7f66ada9b700 1 -- 172.21.15.2:0/3508945216 wait complete. 2023-11-26T07:17:49.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.415+0000 7f66ada9b700 1 Processor -- start 2023-11-26T07:17:49.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.415+0000 7f66ada9b700 1 -- start start 2023-11-26T07:17:49.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.416+0000 7f66ada9b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f66a80cd9f0 0x7f66a81533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.416+0000 7f66ada9b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66a80d0630 0x7f66a8157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.416+0000 7f66ada9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66a8144c50 0x7f66a8157f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.416+0000 7f66ada9b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a8140860 con 0x7f66a8144c50 2023-11-26T07:17:49.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.416+0000 7f66ada9b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a8143560 con 0x7f66a80d0630 2023-11-26T07:17:49.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.416+0000 7f66ada9b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a8143280 con 0x7f66a80cd9f0 2023-11-26T07:17:49.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.416+0000 7f66a7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66a8144c50 0x7f66a8157f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.416+0000 7f66a7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66a8144c50 0x7f66a8157f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45410/0 (socket says 172.21.15.2:45410) 2023-11-26T07:17:49.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.416+0000 7f66a7fff700 1 -- 172.21.15.2:0/4127304554 learned_addr learned my addr 172.21.15.2:0/4127304554 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:49.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.417+0000 7f66a77fe700 1 --2- 172.21.15.2:0/4127304554 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f66a80cd9f0 0x7f66a81533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.417+0000 7f66a6ffd700 1 --2- 172.21.15.2:0/4127304554 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66a80d0630 0x7f66a8157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.417+0000 7f66a7fff700 1 -- 172.21.15.2:0/4127304554 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f66a80cd9f0 msgr2=0x7f66a81533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:49.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.417+0000 7f66a7fff700 1 --2- 172.21.15.2:0/4127304554 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f66a80cd9f0 0x7f66a81533e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.417+0000 7f66a7fff700 1 -- 172.21.15.2:0/4127304554 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66a80d0630 msgr2=0x7f66a8157a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:49.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.417+0000 7f66a7fff700 1 --2- 172.21.15.2:0/4127304554 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66a80d0630 0x7f66a8157a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.417+0000 7f66a7fff700 1 -- 172.21.15.2:0/4127304554 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6698009550 con 0x7f66a8144c50 2023-11-26T07:17:49.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.417+0000 7f66a6ffd700 1 --2- 172.21.15.2:0/4127304554 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66a80d0630 0x7f66a8157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:49.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.417+0000 7f66a77fe700 1 --2- 172.21.15.2:0/4127304554 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f66a80cd9f0 0x7f66a81533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:49.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.417+0000 7f66a7fff700 1 --2- 172.21.15.2:0/4127304554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66a8144c50 0x7f66a8157f60 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f66a000cb90 tx=0x7f66a000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:49.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.417+0000 7f669ffff700 1 -- 172.21.15.2:0/4127304554 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a0003c00 con 0x7f66a8144c50 2023-11-26T07:17:49.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.417+0000 7f669ffff700 1 -- 172.21.15.2:0/4127304554 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a0003d60 con 0x7f66a8144c50 2023-11-26T07:17:49.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.417+0000 7f66ada9b700 1 -- 172.21.15.2:0/4127304554 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a81f1e40 con 0x7f66a8144c50 2023-11-26T07:17:49.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.417+0000 7f669ffff700 1 -- 172.21.15.2:0/4127304554 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a000abb0 con 0x7f66a8144c50 2023-11-26T07:17:49.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.417+0000 7f66ada9b700 1 -- 172.21.15.2:0/4127304554 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a81f2400 con 0x7f66a8144c50 2023-11-26T07:17:49.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.418+0000 7f66ada9b700 1 -- 172.21.15.2:0/4127304554 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f66a806b510 con 0x7f66a8144c50 2023-11-26T07:17:49.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.419+0000 7f669ffff700 1 -- 172.21.15.2:0/4127304554 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f66a000ad10 con 0x7f66a8144c50 2023-11-26T07:17:49.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.419+0000 7f669ffff700 1 --2- 172.21.15.2:0/4127304554 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f668806b980 0x7f668806de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.419+0000 7f669ffff700 1 -- 172.21.15.2:0/4127304554 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f66a0087f90 con 0x7f66a8144c50 2023-11-26T07:17:49.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.419+0000 7f669ffff700 1 --2- 172.21.15.2:0/4127304554 >> [v2:172.21.15.192:6800/1194580107,v1:172.21.15.192:6801/1194580107] conn(0x7f66880717e0 0x7f6688073c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.419+0000 7f669ffff700 1 -- 172.21.15.2:0/4127304554 --> [v2:172.21.15.192:6800/1194580107,v1:172.21.15.192:6801/1194580107] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f66880742d0 con 0x7f66880717e0 2023-11-26T07:17:49.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.419+0000 7f669ffff700 1 -- 172.21.15.2:0/4127304554 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66a008c8c0 con 0x7f66a8144c50 2023-11-26T07:17:49.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.419+0000 7f66a77fe700 1 --2- 172.21.15.2:0/4127304554 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f668806b980 0x7f668806de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.419+0000 7f66a6ffd700 1 --2- 172.21.15.2:0/4127304554 >> [v2:172.21.15.192:6800/1194580107,v1:172.21.15.192:6801/1194580107] conn(0x7f66880717e0 0x7f6688073c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.420+0000 7f66a77fe700 1 --2- 172.21.15.2:0/4127304554 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f668806b980 0x7f668806de40 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f6698014040 tx=0x7f6698008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:49.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.420+0000 7f66a6ffd700 1 --2- 172.21.15.2:0/4127304554 >> [v2:172.21.15.192:6800/1194580107,v1:172.21.15.192:6801/1194580107] conn(0x7f66880717e0 0x7f6688073c00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:49.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.421+0000 7f669ffff700 1 -- 172.21.15.2:0/4127304554 <== osd.4 v2:172.21.15.192:6800/1194580107 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f66880742d0 con 0x7f66880717e0 2023-11-26T07:17:49.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.436+0000 7f66ada9b700 1 -- 172.21.15.2:0/4127304554 --> [v2:172.21.15.192:6800/1194580107,v1:172.21.15.192:6801/1194580107] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f66a81f2770 con 0x7f66880717e0 2023-11-26T07:17:49.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.436+0000 7f669ffff700 1 -- 172.21.15.2:0/4127304554 <== osd.4 v2:172.21.15.192:6800/1194580107 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f66a81f2770 con 0x7f66880717e0 2023-11-26T07:17:49.438 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-26T07:17:49.439 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-26T07:17:49.439 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-26T07:17:49.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.437+0000 7f66ada9b700 1 -- 172.21.15.2:0/4127304554 >> [v2:172.21.15.192:6800/1194580107,v1:172.21.15.192:6801/1194580107] conn(0x7f66880717e0 msgr2=0x7f6688073c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:49.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.437+0000 7f66ada9b700 1 --2- 172.21.15.2:0/4127304554 >> [v2:172.21.15.192:6800/1194580107,v1:172.21.15.192:6801/1194580107] conn(0x7f66880717e0 0x7f6688073c00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.437+0000 7f66ada9b700 1 -- 172.21.15.2:0/4127304554 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f668806b980 msgr2=0x7f668806de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:49.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.437+0000 7f66ada9b700 1 --2- 172.21.15.2:0/4127304554 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f668806b980 0x7f668806de40 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f6698014040 tx=0x7f6698008030 comp rx=0 tx=0).stop 2023-11-26T07:17:49.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.437+0000 7f66ada9b700 1 -- 172.21.15.2:0/4127304554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66a8144c50 msgr2=0x7f66a8157f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:49.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.437+0000 7f66ada9b700 1 --2- 172.21.15.2:0/4127304554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66a8144c50 0x7f66a8157f60 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f66a000cb90 tx=0x7f66a000cf50 comp rx=0 tx=0).stop 2023-11-26T07:17:49.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.437+0000 7f66a7fff700 1 -- 172.21.15.2:0/4127304554 reap_dead start 2023-11-26T07:17:49.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.437+0000 7f66ada9b700 1 -- 172.21.15.2:0/4127304554 shutdown_connections 2023-11-26T07:17:49.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.437+0000 7f66ada9b700 1 -- 172.21.15.2:0/4127304554 >> 172.21.15.2:0/4127304554 conn(0x7f66a80d0aa0 msgr2=0x7f66a806fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:49.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.437+0000 7f66ada9b700 1 -- 172.21.15.2:0/4127304554 shutdown_connections 2023-11-26T07:17:49.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.437+0000 7f66ada9b700 1 -- 172.21.15.2:0/4127304554 wait complete. 2023-11-26T07:17:49.451 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-11-26T07:17:49.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.575+0000 7f98dcba4700 1 Processor -- start 2023-11-26T07:17:49.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.575+0000 7f98dcba4700 1 -- start start 2023-11-26T07:17:49.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.576+0000 7f98dcba4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f98d80cf2b0 0x7f98d815c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.576+0000 7f98dcba4700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f98d80ce5c0 0x7f98d80cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.576+0000 7f98dcba4700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98d80d0a90 con 0x7f98d815bde0 2023-11-26T07:17:49.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.576+0000 7f98dcba4700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98d80cefb0 con 0x7f98d80ce5c0 2023-11-26T07:17:49.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.576+0000 7f98dcba4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d806ee10 con 0x7f98d80cf2b0 2023-11-26T07:17:49.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.576+0000 7f98d6d9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f98d80ce5c0 0x7f98d80cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.576+0000 7f98d659c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f98d815bde0 0x7f98d80d01b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36626/0 (socket says 172.21.15.2:36626) 2023-11-26T07:17:49.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.576+0000 7f98d659c700 1 -- 172.21.15.2:0/722011835 learned_addr learned my addr 172.21.15.2:0/722011835 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:49.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.576+0000 7f98d5d9b700 1 --2- 172.21.15.2:0/722011835 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f98d80cf2b0 0x7f98d815c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.576+0000 7f98d6d9d700 1 -- 172.21.15.2:0/722011835 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f98d80cf2b0 msgr2=0x7f98d815c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:49.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.576+0000 7f98d6d9d700 1 --2- 172.21.15.2:0/722011835 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f98d80cf2b0 0x7f98d815c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.576+0000 7f98d6d9d700 1 -- 172.21.15.2:0/722011835 >> v1:172.21.15.2:6789/0 conn(0x7f98d815bde0 legacy=0x7f98d80d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:49.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.576+0000 7f98d6d9d700 1 -- 172.21.15.2:0/722011835 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d806f0f0 con 0x7f98d80ce5c0 2023-11-26T07:17:49.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.576+0000 7f98d6d9d700 1 --2- 172.21.15.2:0/722011835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98d80ce5c0 0x7f98d80cea70 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f98d0009d90 tx=0x7f98d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e46d687e841cac83 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:49.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.577+0000 7f98d559a700 1 -- 172.21.15.2:0/722011835 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d000e070 con 0x7f98d80ce5c0 2023-11-26T07:17:49.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.577+0000 7f98d559a700 1 -- 172.21.15.2:0/722011835 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d000bbd0 con 0x7f98d80ce5c0 2023-11-26T07:17:49.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.577+0000 7f98d559a700 1 -- 172.21.15.2:0/722011835 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d0012430 con 0x7f98d80ce5c0 2023-11-26T07:17:49.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.577+0000 7f98dcba4700 1 -- 172.21.15.2:0/722011835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98d80ce5c0 msgr2=0x7f98d80cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:49.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.577+0000 7f98dcba4700 1 --2- 172.21.15.2:0/722011835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98d80ce5c0 0x7f98d80cea70 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f98d0009d90 tx=0x7f98d000b330 comp rx=0 tx=0).stop 2023-11-26T07:17:49.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.577+0000 7f98dcba4700 1 -- 172.21.15.2:0/722011835 shutdown_connections 2023-11-26T07:17:49.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.577+0000 7f98dcba4700 1 --2- 172.21.15.2:0/722011835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98d80ce5c0 0x7f98d80cea70 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.577+0000 7f98dcba4700 1 --2- 172.21.15.2:0/722011835 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f98d80cf2b0 0x7f98d815c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.577+0000 7f98dcba4700 1 -- 172.21.15.2:0/722011835 >> 172.21.15.2:0/722011835 conn(0x7f98d80b3720 msgr2=0x7f98d80b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:49.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.577+0000 7f98dcba4700 1 -- 172.21.15.2:0/722011835 shutdown_connections 2023-11-26T07:17:49.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.577+0000 7f98dcba4700 1 -- 172.21.15.2:0/722011835 wait complete. 2023-11-26T07:17:49.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.579+0000 7f98dcba4700 1 Processor -- start 2023-11-26T07:17:49.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.579+0000 7f98dcba4700 1 -- start start 2023-11-26T07:17:49.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.579+0000 7f98dcba4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98d80ce5c0 0x7f98d81578c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.579+0000 7f98dcba4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f98d80cf2b0 0x7f98d80b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.579+0000 7f98dcba4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98d815bde0 0x7f98d80affc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.579+0000 7f98dcba4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d80ca630 con 0x7f98d80ce5c0 2023-11-26T07:17:49.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.579+0000 7f98dcba4700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d80caac0 con 0x7f98d815bde0 2023-11-26T07:17:49.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.579+0000 7f98dcba4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d8157e00 con 0x7f98d80cf2b0 2023-11-26T07:17:49.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.579+0000 7f98d659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98d80ce5c0 0x7f98d81578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.579+0000 7f98d659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98d80ce5c0 0x7f98d81578c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45422/0 (socket says 172.21.15.2:45422) 2023-11-26T07:17:49.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.579+0000 7f98d659c700 1 -- 172.21.15.2:0/801718822 learned_addr learned my addr 172.21.15.2:0/801718822 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:49.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.580+0000 7f98d5d9b700 1 --2- 172.21.15.2:0/801718822 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f98d80cf2b0 0x7f98d80b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.580+0000 7f98d6d9d700 1 --2- 172.21.15.2:0/801718822 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98d815bde0 0x7f98d80affc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.580+0000 7f98d659c700 1 -- 172.21.15.2:0/801718822 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f98d80cf2b0 msgr2=0x7f98d80b6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:49.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.580+0000 7f98d659c700 1 --2- 172.21.15.2:0/801718822 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f98d80cf2b0 0x7f98d80b6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.580+0000 7f98d659c700 1 -- 172.21.15.2:0/801718822 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98d815bde0 msgr2=0x7f98d80affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:49.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.580+0000 7f98d659c700 1 --2- 172.21.15.2:0/801718822 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98d815bde0 0x7f98d80affc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.580+0000 7f98d659c700 1 -- 172.21.15.2:0/801718822 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d0009a70 con 0x7f98d80ce5c0 2023-11-26T07:17:49.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.580+0000 7f98d6d9d700 1 --2- 172.21.15.2:0/801718822 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98d815bde0 0x7f98d80affc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:49.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.580+0000 7f98d5d9b700 1 --2- 172.21.15.2:0/801718822 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f98d80cf2b0 0x7f98d80b6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:49.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.580+0000 7f98d659c700 1 --2- 172.21.15.2:0/801718822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98d80ce5c0 0x7f98d81578c0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f98c800c480 tx=0x7f98c800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:49.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.580+0000 7f98c6ffd700 1 -- 172.21.15.2:0/801718822 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c8005d70 con 0x7f98d80ce5c0 2023-11-26T07:17:49.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.580+0000 7f98c6ffd700 1 -- 172.21.15.2:0/801718822 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c80070d0 con 0x7f98d80ce5c0 2023-11-26T07:17:49.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.580+0000 7f98dcba4700 1 -- 172.21.15.2:0/801718822 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98d80c9a20 con 0x7f98d80ce5c0 2023-11-26T07:17:49.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.580+0000 7f98c6ffd700 1 -- 172.21.15.2:0/801718822 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c8007440 con 0x7f98d80ce5c0 2023-11-26T07:17:49.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.580+0000 7f98dcba4700 1 -- 172.21.15.2:0/801718822 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98d80c9fe0 con 0x7f98d80ce5c0 2023-11-26T07:17:49.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.581+0000 7f98dcba4700 1 -- 172.21.15.2:0/801718822 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98d8068670 con 0x7f98d80ce5c0 2023-11-26T07:17:49.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.581+0000 7f98c6ffd700 1 -- 172.21.15.2:0/801718822 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f98c80075a0 con 0x7f98d80ce5c0 2023-11-26T07:17:49.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.582+0000 7f98c6ffd700 1 --2- 172.21.15.2:0/801718822 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f98b806b980 0x7f98b806de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.582+0000 7f98c6ffd700 1 -- 172.21.15.2:0/801718822 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f98c80875c0 con 0x7f98d80ce5c0 2023-11-26T07:17:49.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.582+0000 7f98d5d9b700 1 --2- 172.21.15.2:0/801718822 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f98b806b980 0x7f98b806de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.583+0000 7f98d5d9b700 1 --2- 172.21.15.2:0/801718822 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f98b806b980 0x7f98b806de40 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f98d815a570 tx=0x7f98cc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:49.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.586+0000 7f98c6ffd700 1 -- 172.21.15.2:0/801718822 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f98c8053f40 con 0x7f98d80ce5c0 2023-11-26T07:17:49.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.785+0000 7f98dcba4700 1 -- 172.21.15.2:0/801718822 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f98d806f6b0 con 0x7f98b806b980 2023-11-26T07:17:49.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.786+0000 7f98c6ffd700 1 -- 172.21.15.2:0/801718822 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f98cc00a720 con 0x7f98b806b980 2023-11-26T07:17:49.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.788+0000 7f98dcba4700 1 -- 172.21.15.2:0/801718822 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f98b806b980 msgr2=0x7f98b806de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:49.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.788+0000 7f98dcba4700 1 --2- 172.21.15.2:0/801718822 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f98b806b980 0x7f98b806de40 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f98d815a570 tx=0x7f98cc008040 comp rx=0 tx=0).stop 2023-11-26T07:17:49.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.788+0000 7f98dcba4700 1 -- 172.21.15.2:0/801718822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98d80ce5c0 msgr2=0x7f98d81578c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:49.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.788+0000 7f98dcba4700 1 --2- 172.21.15.2:0/801718822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98d80ce5c0 0x7f98d81578c0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f98c800c480 tx=0x7f98c800c840 comp rx=0 tx=0).stop 2023-11-26T07:17:49.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.788+0000 7f98dcba4700 1 -- 172.21.15.2:0/801718822 shutdown_connections 2023-11-26T07:17:49.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.788+0000 7f98dcba4700 1 --2- 172.21.15.2:0/801718822 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f98b806b980 0x7f98b806de40 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.788+0000 7f98dcba4700 1 --2- 172.21.15.2:0/801718822 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98d815bde0 0x7f98d80affc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.788+0000 7f98dcba4700 1 --2- 172.21.15.2:0/801718822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98d80ce5c0 0x7f98d81578c0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.788+0000 7f98dcba4700 1 --2- 172.21.15.2:0/801718822 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f98d80cf2b0 0x7f98d80b6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.788+0000 7f98dcba4700 1 -- 172.21.15.2:0/801718822 >> 172.21.15.2:0/801718822 conn(0x7f98d80b3720 msgr2=0x7f98d80b3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:49.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.788+0000 7f98dcba4700 1 -- 172.21.15.2:0/801718822 shutdown_connections 2023-11-26T07:17:49.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.788+0000 7f98dcba4700 1 -- 172.21.15.2:0/801718822 wait complete. 2023-11-26T07:17:49.793 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 4 to deep-scrub 2023-11-26T07:17:49.802 INFO:tasks.ceph:Scrubbing osd.5 2023-11-26T07:17:49.802 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-11-26T07:17:49.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.929+0000 7fa6f3f2b700 1 Processor -- start 2023-11-26T07:17:49.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.929+0000 7fa6f3f2b700 1 -- start start 2023-11-26T07:17:49.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.930+0000 7fa6f3f2b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa6ec06f330 0x7fa6ec0aff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.930+0000 7fa6f3f2b700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6ec06f710 con 0x7fa6ec06b6e0 2023-11-26T07:17:49.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.930+0000 7fa6f3f2b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6ec0b05c0 con 0x7fa6ec06ffa0 2023-11-26T07:17:49.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.930+0000 7fa6f3f2b700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6ec0b44c0 con 0x7fa6ec06f330 2023-11-26T07:17:49.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.930+0000 7fa6f24c8700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa6ec06b6e0 0x7fa6ec15e4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36644/0 (socket says 172.21.15.2:36644) 2023-11-26T07:17:49.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.930+0000 7fa6f24c8700 1 -- 172.21.15.2:0/987952110 learned_addr learned my addr 172.21.15.2:0/987952110 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:49.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.931+0000 7fa6f1cc7700 1 --2- 172.21.15.2:0/987952110 >> v2:172.21.15.192:3300/0 conn(0x7fa6ec06f330 0x7fa6ec0aff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.931+0000 7fa6f0cc5700 1 -- 172.21.15.2:0/987952110 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1760470163 0 0) 0x7fa6ec06f710 con 0x7fa6ec06b6e0 2023-11-26T07:17:49.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.931+0000 7fa6f0cc5700 1 -- 172.21.15.2:0/987952110 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6d80035b0 con 0x7fa6ec06b6e0 2023-11-26T07:17:49.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.931+0000 7fa6f0cc5700 1 -- 172.21.15.2:0/987952110 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 816666308 0 0) 0x7fa6d80035b0 con 0x7fa6ec06b6e0 2023-11-26T07:17:49.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.931+0000 7fa6f0cc5700 1 -- 172.21.15.2:0/987952110 >> v2:172.21.15.192:3300/0 conn(0x7fa6ec06f330 msgr2=0x7fa6ec0aff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:49.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.931+0000 7fa6f0cc5700 1 --2- 172.21.15.2:0/987952110 >> v2:172.21.15.192:3300/0 conn(0x7fa6ec06f330 0x7fa6ec0aff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.931+0000 7fa6f0cc5700 1 -- 172.21.15.2:0/987952110 >> v1:172.21.15.192:6789/0 conn(0x7fa6ec06ffa0 legacy=0x7fa6ec06afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:49.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.931+0000 7fa6f0cc5700 1 -- 172.21.15.2:0/987952110 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6ec161be0 con 0x7fa6ec06b6e0 2023-11-26T07:17:49.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.931+0000 7fa6f0cc5700 1 -- 172.21.15.2:0/987952110 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7fa6e40019f0 con 0x7fa6ec06b6e0 2023-11-26T07:17:49.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.931+0000 7fa6f0cc5700 1 -- 172.21.15.2:0/987952110 >> v1:172.21.15.2:6789/0 conn(0x7fa6ec06b6e0 legacy=0x7fa6ec15e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:49.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.931+0000 7fa6f0cc5700 1 --2- 172.21.15.2:0/987952110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6d8003a00 0x7fa6d8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.931+0000 7fa6f0cc5700 1 --2- 172.21.15.2:0/987952110 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa6d8004400 0x7fa6d80048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.931+0000 7fa6f0cc5700 1 --2- 172.21.15.2:0/987952110 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa6d8005170 0x7fa6d800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.931+0000 7fa6f0cc5700 1 -- 172.21.15.2:0/987952110 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d800c080 con 0x7fa6d8003a00 2023-11-26T07:17:49.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.931+0000 7fa6f0cc5700 1 -- 172.21.15.2:0/987952110 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d800c1f0 con 0x7fa6d8004400 2023-11-26T07:17:49.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.931+0000 7fa6f0cc5700 1 -- 172.21.15.2:0/987952110 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d800c3b0 con 0x7fa6d8005170 2023-11-26T07:17:49.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.931+0000 7fa6f1cc7700 1 --2- 172.21.15.2:0/987952110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6d8003a00 0x7fa6d8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.931+0000 7fa6f14c6700 1 --2- 172.21.15.2:0/987952110 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa6d8004400 0x7fa6d80048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.931+0000 7fa6f24c8700 1 --2- 172.21.15.2:0/987952110 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa6d8005170 0x7fa6d800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.931+0000 7fa6f1cc7700 1 -- 172.21.15.2:0/987952110 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa6d8005170 msgr2=0x7fa6d800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:49.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.931+0000 7fa6f1cc7700 1 --2- 172.21.15.2:0/987952110 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa6d8005170 0x7fa6d800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.931+0000 7fa6f1cc7700 1 -- 172.21.15.2:0/987952110 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa6d8004400 msgr2=0x7fa6d80048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:49.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.931+0000 7fa6f1cc7700 1 --2- 172.21.15.2:0/987952110 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa6d8004400 0x7fa6d80048d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.931+0000 7fa6f1cc7700 1 -- 172.21.15.2:0/987952110 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d80035b0 con 0x7fa6d8003a00 2023-11-26T07:17:49.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.931+0000 7fa6f14c6700 1 --2- 172.21.15.2:0/987952110 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa6d8004400 0x7fa6d80048d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:49.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.931+0000 7fa6f24c8700 1 -- 172.21.15.2:0/987952110 reap_dead start 2023-11-26T07:17:49.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.932+0000 7fa6f1cc7700 1 --2- 172.21.15.2:0/987952110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6d8003a00 0x7fa6d8003de0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc009b60 tx=0x7fa6d8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c5fe9c8e85c1feb server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:49.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.932+0000 7fa6f0cc5700 1 -- 172.21.15.2:0/987952110 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc00e6c0 con 0x7fa6d8003a00 2023-11-26T07:17:49.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.932+0000 7fa6f0cc5700 1 -- 172.21.15.2:0/987952110 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6dc00e820 con 0x7fa6d8003a00 2023-11-26T07:17:49.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.932+0000 7fa6f0cc5700 1 -- 172.21.15.2:0/987952110 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc00eb90 con 0x7fa6d8003a00 2023-11-26T07:17:49.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.932+0000 7fa6f3f2b700 1 -- 172.21.15.2:0/987952110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6d8003a00 msgr2=0x7fa6d8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:49.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.932+0000 7fa6f3f2b700 1 --2- 172.21.15.2:0/987952110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6d8003a00 0x7fa6d8003de0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc009b60 tx=0x7fa6d8005880 comp rx=0 tx=0).stop 2023-11-26T07:17:49.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.932+0000 7fa6f3f2b700 1 -- 172.21.15.2:0/987952110 shutdown_connections 2023-11-26T07:17:49.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.932+0000 7fa6f3f2b700 1 --2- 172.21.15.2:0/987952110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6d8003a00 0x7fa6d8003de0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.932+0000 7fa6f3f2b700 1 -- 172.21.15.2:0/987952110 >> 172.21.15.2:0/987952110 conn(0x7fa6ec0b2840 msgr2=0x7fa6ec0b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:49.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.932+0000 7fa6f3f2b700 1 -- 172.21.15.2:0/987952110 shutdown_connections 2023-11-26T07:17:49.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.932+0000 7fa6f3f2b700 1 -- 172.21.15.2:0/987952110 wait complete. 2023-11-26T07:17:49.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.933+0000 7fa6f3f2b700 1 Processor -- start 2023-11-26T07:17:49.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.934+0000 7fa6f3f2b700 1 -- start start 2023-11-26T07:17:49.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.934+0000 7fa6f3f2b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6d8003a00 0x7fa6ec15dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.934+0000 7fa6f3f2b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa6ec14d650 0x7fa6ec0c7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.934+0000 7fa6f3f2b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa6ec0c8400 0x7fa6ec149d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.934+0000 7fa6f3f2b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ec0c8880 con 0x7fa6d8003a00 2023-11-26T07:17:49.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.934+0000 7fa6f3f2b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ec160190 con 0x7fa6ec14d650 2023-11-26T07:17:49.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.934+0000 7fa6f3f2b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ec160470 con 0x7fa6ec0c8400 2023-11-26T07:17:49.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.934+0000 7fa6f1cc7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6d8003a00 0x7fa6ec15dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.934+0000 7fa6f1cc7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6d8003a00 0x7fa6ec15dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45442/0 (socket says 172.21.15.2:45442) 2023-11-26T07:17:49.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.934+0000 7fa6f1cc7700 1 -- 172.21.15.2:0/3937968950 learned_addr learned my addr 172.21.15.2:0/3937968950 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:49.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.935+0000 7fa6f14c6700 1 --2- 172.21.15.2:0/3937968950 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa6ec14d650 0x7fa6ec0c7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.935+0000 7fa6f24c8700 1 --2- 172.21.15.2:0/3937968950 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa6ec0c8400 0x7fa6ec149d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.935+0000 7fa6f1cc7700 1 -- 172.21.15.2:0/3937968950 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa6ec0c8400 msgr2=0x7fa6ec149d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:49.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.935+0000 7fa6f1cc7700 1 --2- 172.21.15.2:0/3937968950 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa6ec0c8400 0x7fa6ec149d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.935+0000 7fa6f1cc7700 1 -- 172.21.15.2:0/3937968950 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa6ec14d650 msgr2=0x7fa6ec0c7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:49.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.935+0000 7fa6f1cc7700 1 --2- 172.21.15.2:0/3937968950 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa6ec14d650 0x7fa6ec0c7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.935+0000 7fa6f1cc7700 1 -- 172.21.15.2:0/3937968950 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6ec160750 con 0x7fa6d8003a00 2023-11-26T07:17:49.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.935+0000 7fa6f14c6700 1 --2- 172.21.15.2:0/3937968950 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa6ec14d650 0x7fa6ec0c7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:49.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.935+0000 7fa6f1cc7700 1 --2- 172.21.15.2:0/3937968950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6d8003a00 0x7fa6ec15dac0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fa6d800c1c0 tx=0x7fa6dc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:49.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.935+0000 7fa6e27fc700 1 -- 172.21.15.2:0/3937968950 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc00e6c0 con 0x7fa6d8003a00 2023-11-26T07:17:49.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.935+0000 7fa6e27fc700 1 -- 172.21.15.2:0/3937968950 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6dc003ad0 con 0x7fa6d8003a00 2023-11-26T07:17:49.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.935+0000 7fa6f3f2b700 1 -- 172.21.15.2:0/3937968950 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6ec160a30 con 0x7fa6d8003a00 2023-11-26T07:17:49.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.935+0000 7fa6e27fc700 1 -- 172.21.15.2:0/3937968950 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc003e80 con 0x7fa6d8003a00 2023-11-26T07:17:49.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.935+0000 7fa6f3f2b700 1 -- 172.21.15.2:0/3937968950 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6ec160d10 con 0x7fa6d8003a00 2023-11-26T07:17:49.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.936+0000 7fa6f3f2b700 1 -- 172.21.15.2:0/3937968950 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa6ec162160 con 0x7fa6d8003a00 2023-11-26T07:17:49.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.937+0000 7fa6e27fc700 1 -- 172.21.15.2:0/3937968950 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7fa6dc013470 con 0x7fa6d8003a00 2023-11-26T07:17:49.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.937+0000 7fa6e27fc700 1 --2- 172.21.15.2:0/3937968950 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa6d006b980 0x7fa6d006de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.937+0000 7fa6e27fc700 1 -- 172.21.15.2:0/3937968950 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa6dc08a2b0 con 0x7fa6d8003a00 2023-11-26T07:17:49.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.937+0000 7fa6e27fc700 1 --2- 172.21.15.2:0/3937968950 >> [v2:172.21.15.192:6816/1249076734,v1:172.21.15.192:6817/1249076734] conn(0x7fa6d00717e0 0x7fa6d0073c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.937+0000 7fa6e27fc700 1 -- 172.21.15.2:0/3937968950 --> [v2:172.21.15.192:6816/1249076734,v1:172.21.15.192:6817/1249076734] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa6d00742d0 con 0x7fa6d00717e0 2023-11-26T07:17:49.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.937+0000 7fa6e27fc700 1 -- 172.21.15.2:0/3937968950 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6dc08cd10 con 0x7fa6d8003a00 2023-11-26T07:17:49.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.937+0000 7fa6f14c6700 1 --2- 172.21.15.2:0/3937968950 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa6d006b980 0x7fa6d006de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.937+0000 7fa6f24c8700 1 --2- 172.21.15.2:0/3937968950 >> [v2:172.21.15.192:6816/1249076734,v1:172.21.15.192:6817/1249076734] conn(0x7fa6d00717e0 0x7fa6d0073c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.938+0000 7fa6f14c6700 1 --2- 172.21.15.2:0/3937968950 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa6d006b980 0x7fa6d006de40 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec0c8aa0 tx=0x7fa6e8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:49.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.938+0000 7fa6f24c8700 1 --2- 172.21.15.2:0/3937968950 >> [v2:172.21.15.192:6816/1249076734,v1:172.21.15.192:6817/1249076734] conn(0x7fa6d00717e0 0x7fa6d0073c00 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:49.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.939+0000 7fa6e27fc700 1 -- 172.21.15.2:0/3937968950 <== osd.5 v2:172.21.15.192:6816/1249076734 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fa6d00742d0 con 0x7fa6d00717e0 2023-11-26T07:17:49.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.954+0000 7fa6f3f2b700 1 -- 172.21.15.2:0/3937968950 --> [v2:172.21.15.192:6816/1249076734,v1:172.21.15.192:6817/1249076734] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa6ec0c8880 con 0x7fa6d00717e0 2023-11-26T07:17:49.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.954+0000 7fa6e27fc700 1 -- 172.21.15.2:0/3937968950 <== osd.5 v2:172.21.15.192:6816/1249076734 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fa6ec0c8880 con 0x7fa6d00717e0 2023-11-26T07:17:49.956 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-26T07:17:49.957 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-26T07:17:49.957 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-26T07:17:49.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.954+0000 7fa6f3f2b700 1 -- 172.21.15.2:0/3937968950 >> [v2:172.21.15.192:6816/1249076734,v1:172.21.15.192:6817/1249076734] conn(0x7fa6d00717e0 msgr2=0x7fa6d0073c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:49.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.954+0000 7fa6f3f2b700 1 --2- 172.21.15.2:0/3937968950 >> [v2:172.21.15.192:6816/1249076734,v1:172.21.15.192:6817/1249076734] conn(0x7fa6d00717e0 0x7fa6d0073c00 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.955+0000 7fa6f3f2b700 1 -- 172.21.15.2:0/3937968950 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa6d006b980 msgr2=0x7fa6d006de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:49.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.955+0000 7fa6f3f2b700 1 --2- 172.21.15.2:0/3937968950 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7fa6d006b980 0x7fa6d006de40 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec0c8aa0 tx=0x7fa6e8009040 comp rx=0 tx=0).stop 2023-11-26T07:17:49.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.955+0000 7fa6f3f2b700 1 -- 172.21.15.2:0/3937968950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6d8003a00 msgr2=0x7fa6ec15dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:49.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.955+0000 7fa6f3f2b700 1 --2- 172.21.15.2:0/3937968950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6d8003a00 0x7fa6ec15dac0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fa6d800c1c0 tx=0x7fa6dc0047c0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.955+0000 7fa6f24c8700 1 -- 172.21.15.2:0/3937968950 reap_dead start 2023-11-26T07:17:49.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.955+0000 7fa6f3f2b700 1 -- 172.21.15.2:0/3937968950 shutdown_connections 2023-11-26T07:17:49.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.955+0000 7fa6f3f2b700 1 -- 172.21.15.2:0/3937968950 >> 172.21.15.2:0/3937968950 conn(0x7fa6ec0b2840 msgr2=0x7fa6ec0b4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:49.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.955+0000 7fa6f3f2b700 1 -- 172.21.15.2:0/3937968950 shutdown_connections 2023-11-26T07:17:49.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:49.955+0000 7fa6f3f2b700 1 -- 172.21.15.2:0/3937968950 wait complete. 2023-11-26T07:17:49.968 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-11-26T07:17:50.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.092+0000 7f80d5e1e700 1 Processor -- start 2023-11-26T07:17:50.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.092+0000 7f80d5e1e700 1 -- start start 2023-11-26T07:17:50.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.093+0000 7f80d5e1e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80d006b620 0x7f80d00b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:50.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.093+0000 7f80d5e1e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d01629c0 con 0x7f80d00b5ab0 2023-11-26T07:17:50.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.093+0000 7f80d5e1e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d0071f50 con 0x7f80d006ee60 2023-11-26T07:17:50.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.093+0000 7f80d5e1e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d0072230 con 0x7f80d006b620 2023-11-26T07:17:50.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.093+0000 7f80ceffd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f80d00b5ab0 0x7f80d0161ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36664/0 (socket says 172.21.15.2:36664) 2023-11-26T07:17:50.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.093+0000 7f80ceffd700 1 -- 172.21.15.2:0/3264587548 learned_addr learned my addr 172.21.15.2:0/3264587548 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:50.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.093+0000 7f80cf7fe700 1 --2- 172.21.15.2:0/3264587548 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80d006b620 0x7f80d00b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:50.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.093+0000 7f80ce7fc700 1 -- 172.21.15.2:0/3264587548 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4137851427 0 0) 0x7f80d01629c0 con 0x7f80d00b5ab0 2023-11-26T07:17:50.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.093+0000 7f80ce7fc700 1 -- 172.21.15.2:0/3264587548 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80b80035b0 con 0x7f80d00b5ab0 2023-11-26T07:17:50.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.093+0000 7f80ce7fc700 1 -- 172.21.15.2:0/3264587548 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1536574497 0 0) 0x7f80b80035b0 con 0x7f80d00b5ab0 2023-11-26T07:17:50.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.093+0000 7f80ce7fc700 1 -- 172.21.15.2:0/3264587548 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80d006b620 msgr2=0x7f80d00b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:50.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.093+0000 7f80ce7fc700 1 --2- 172.21.15.2:0/3264587548 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80d006b620 0x7f80d00b3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.093+0000 7f80ce7fc700 1 -- 172.21.15.2:0/3264587548 >> v1:172.21.15.192:6789/0 conn(0x7f80d006ee60 legacy=0x7f80d01622b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:50.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.093+0000 7f80ce7fc700 1 -- 172.21.15.2:0/3264587548 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d0072510 con 0x7f80d00b5ab0 2023-11-26T07:17:50.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.093+0000 7f80ce7fc700 1 -- 172.21.15.2:0/3264587548 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f80c4001670 con 0x7f80d00b5ab0 2023-11-26T07:17:50.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.093+0000 7f80ce7fc700 1 -- 172.21.15.2:0/3264587548 >> v1:172.21.15.2:6789/0 conn(0x7f80d00b5ab0 legacy=0x7f80d0161ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:50.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.094+0000 7f80ce7fc700 1 --2- 172.21.15.2:0/3264587548 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80b8003a30 0x7f80b8003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:50.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.094+0000 7f80ce7fc700 1 --2- 172.21.15.2:0/3264587548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80b8004850 0x7f80b8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:50.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.094+0000 7f80ce7fc700 1 --2- 172.21.15.2:0/3264587548 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80d006b620 0x7f80b8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:50.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.094+0000 7f80ce7fc700 1 -- 172.21.15.2:0/3264587548 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d0072230 con 0x7f80b8004850 2023-11-26T07:17:50.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.094+0000 7f80ce7fc700 1 -- 172.21.15.2:0/3264587548 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b800bac0 con 0x7f80b8003a30 2023-11-26T07:17:50.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.094+0000 7f80ce7fc700 1 -- 172.21.15.2:0/3264587548 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b800bc80 con 0x7f80d006b620 2023-11-26T07:17:50.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.094+0000 7f80ceffd700 1 --2- 172.21.15.2:0/3264587548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80b8004850 0x7f80b8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:50.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.094+0000 7f80cf7fe700 1 --2- 172.21.15.2:0/3264587548 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80b8003a30 0x7f80b8003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:50.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.094+0000 7f80cffff700 1 --2- 172.21.15.2:0/3264587548 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80d006b620 0x7f80b8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:50.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.094+0000 7f80ceffd700 1 -- 172.21.15.2:0/3264587548 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80d006b620 msgr2=0x7f80b8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:50.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.094+0000 7f80ceffd700 1 --2- 172.21.15.2:0/3264587548 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80d006b620 0x7f80b8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.094+0000 7f80ceffd700 1 -- 172.21.15.2:0/3264587548 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80b8003a30 msgr2=0x7f80b8003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:50.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.094+0000 7f80ceffd700 1 --2- 172.21.15.2:0/3264587548 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80b8003a30 0x7f80b8003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.094+0000 7f80ceffd700 1 -- 172.21.15.2:0/3264587548 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b80035b0 con 0x7f80b8004850 2023-11-26T07:17:50.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.094+0000 7f80cffff700 1 --2- 172.21.15.2:0/3264587548 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80d006b620 0x7f80b8005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:50.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.094+0000 7f80cf7fe700 1 --2- 172.21.15.2:0/3264587548 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80b8003a30 0x7f80b8003e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:50.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.094+0000 7f80ceffd700 1 --2- 172.21.15.2:0/3264587548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80b8004850 0x7f80b8004cd0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f80d00b5f10 tx=0x7f80b8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=166e38ca62ec62b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:50.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.094+0000 7f80ce7fc700 1 -- 172.21.15.2:0/3264587548 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c4007c10 con 0x7f80b8004850 2023-11-26T07:17:50.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.094+0000 7f80ce7fc700 1 -- 172.21.15.2:0/3264587548 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c400cd80 con 0x7f80b8004850 2023-11-26T07:17:50.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.094+0000 7f80ce7fc700 1 -- 172.21.15.2:0/3264587548 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c4005ba0 con 0x7f80b8004850 2023-11-26T07:17:50.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.095+0000 7f80d5e1e700 1 -- 172.21.15.2:0/3264587548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80b8004850 msgr2=0x7f80b8004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:50.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.095+0000 7f80d5e1e700 1 --2- 172.21.15.2:0/3264587548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80b8004850 0x7f80b8004cd0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f80d00b5f10 tx=0x7f80b8005880 comp rx=0 tx=0).stop 2023-11-26T07:17:50.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.095+0000 7f80cffff700 1 -- 172.21.15.2:0/3264587548 reap_dead start 2023-11-26T07:17:50.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.095+0000 7f80d5e1e700 1 -- 172.21.15.2:0/3264587548 shutdown_connections 2023-11-26T07:17:50.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.095+0000 7f80d5e1e700 1 -- 172.21.15.2:0/3264587548 >> 172.21.15.2:0/3264587548 conn(0x7f80d00b2740 msgr2=0x7f80d00b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:50.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.095+0000 7f80d5e1e700 1 -- 172.21.15.2:0/3264587548 shutdown_connections 2023-11-26T07:17:50.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.095+0000 7f80d5e1e700 1 -- 172.21.15.2:0/3264587548 wait complete. 2023-11-26T07:17:50.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.096+0000 7f80d5e1e700 1 Processor -- start 2023-11-26T07:17:50.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.096+0000 7f80d5e1e700 1 -- start start 2023-11-26T07:17:50.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.097+0000 7f80d5e1e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80b8004850 0x7f80d01624e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:50.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.097+0000 7f80d5e1e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80d0136fa0 0x7f80d0137420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:50.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.097+0000 7f80d5e1e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80d00cdd20 0x7f80d00ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:50.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.097+0000 7f80d5e1e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d00c8a10 con 0x7f80b8004850 2023-11-26T07:17:50.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.097+0000 7f80d5e1e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d00ce6e0 con 0x7f80d00cdd20 2023-11-26T07:17:50.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.097+0000 7f80d5e1e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d00c8f90 con 0x7f80d0136fa0 2023-11-26T07:17:50.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.097+0000 7f80cf7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80b8004850 0x7f80d01624e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:50.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.097+0000 7f80cf7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80b8004850 0x7f80d01624e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45464/0 (socket says 172.21.15.2:45464) 2023-11-26T07:17:50.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.097+0000 7f80cf7fe700 1 -- 172.21.15.2:0/3760665316 learned_addr learned my addr 172.21.15.2:0/3760665316 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:50.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.097+0000 7f80cf7fe700 1 -- 172.21.15.2:0/3760665316 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80d0136fa0 msgr2=0x7f80d0137420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:50.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.097+0000 7f80cf7fe700 1 --2- 172.21.15.2:0/3760665316 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80d0136fa0 0x7f80d0137420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.097+0000 7f80cf7fe700 1 -- 172.21.15.2:0/3760665316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80d00cdd20 msgr2=0x7f80d00ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:50.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.097+0000 7f80cf7fe700 1 --2- 172.21.15.2:0/3760665316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80d00cdd20 0x7f80d00ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.097+0000 7f80cf7fe700 1 -- 172.21.15.2:0/3760665316 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d0137a60 con 0x7f80b8004850 2023-11-26T07:17:50.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.098+0000 7f80cf7fe700 1 --2- 172.21.15.2:0/3760665316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80b8004850 0x7f80d01624e0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f80c0011900 tx=0x7f80c0011cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:50.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.098+0000 7f80b7fff700 1 -- 172.21.15.2:0/3760665316 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c0004220 con 0x7f80b8004850 2023-11-26T07:17:50.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.098+0000 7f80b7fff700 1 -- 172.21.15.2:0/3760665316 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c0004380 con 0x7f80b8004850 2023-11-26T07:17:50.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.098+0000 7f80b7fff700 1 -- 172.21.15.2:0/3760665316 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c00036a0 con 0x7f80b8004850 2023-11-26T07:17:50.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.098+0000 7f80d5e1e700 1 -- 172.21.15.2:0/3760665316 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80d0137d40 con 0x7f80b8004850 2023-11-26T07:17:50.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.098+0000 7f80d5e1e700 1 -- 172.21.15.2:0/3760665316 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80d00cb530 con 0x7f80b8004850 2023-11-26T07:17:50.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.099+0000 7f80d5e1e700 1 -- 172.21.15.2:0/3760665316 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80d0137f30 con 0x7f80b8004850 2023-11-26T07:17:50.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.099+0000 7f80b7fff700 1 -- 172.21.15.2:0/3760665316 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f80c0003800 con 0x7f80b8004850 2023-11-26T07:17:50.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.100+0000 7f80b7fff700 1 --2- 172.21.15.2:0/3760665316 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f80bc06b980 0x7f80bc06de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:50.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.100+0000 7f80b7fff700 1 -- 172.21.15.2:0/3760665316 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f80c00882d0 con 0x7f80b8004850 2023-11-26T07:17:50.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.100+0000 7f80ceffd700 1 --2- 172.21.15.2:0/3760665316 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f80bc06b980 0x7f80bc06de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:50.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.101+0000 7f80ceffd700 1 --2- 172.21.15.2:0/3760665316 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f80bc06b980 0x7f80bc06de40 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f80d00cb280 tx=0x7f80c400a000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:50.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.105+0000 7f80b7fff700 1 -- 172.21.15.2:0/3760665316 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f80d0137f30 con 0x7f80b8004850 2023-11-26T07:17:50.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.304+0000 7f80d5e1e700 1 -- 172.21.15.2:0/3760665316 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f80d0072ad0 con 0x7f80bc06b980 2023-11-26T07:17:50.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.304+0000 7f80b7fff700 1 -- 172.21.15.2:0/3760665316 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f80c400cc00 con 0x7f80bc06b980 2023-11-26T07:17:50.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.306+0000 7f80d5e1e700 1 -- 172.21.15.2:0/3760665316 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f80bc06b980 msgr2=0x7f80bc06de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:50.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.306+0000 7f80d5e1e700 1 --2- 172.21.15.2:0/3760665316 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f80bc06b980 0x7f80bc06de40 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f80d00cb280 tx=0x7f80c400a000 comp rx=0 tx=0).stop 2023-11-26T07:17:50.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.306+0000 7f80d5e1e700 1 -- 172.21.15.2:0/3760665316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80b8004850 msgr2=0x7f80d01624e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:50.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.306+0000 7f80d5e1e700 1 --2- 172.21.15.2:0/3760665316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80b8004850 0x7f80d01624e0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f80c0011900 tx=0x7f80c0011cc0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.306+0000 7f80d5e1e700 1 -- 172.21.15.2:0/3760665316 shutdown_connections 2023-11-26T07:17:50.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.306+0000 7f80d5e1e700 1 --2- 172.21.15.2:0/3760665316 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f80bc06b980 0x7f80bc06de40 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.306+0000 7f80d5e1e700 1 --2- 172.21.15.2:0/3760665316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80d00cdd20 0x7f80d00ce1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.306+0000 7f80d5e1e700 1 --2- 172.21.15.2:0/3760665316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80b8004850 0x7f80d01624e0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.306+0000 7f80d5e1e700 1 --2- 172.21.15.2:0/3760665316 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80d0136fa0 0x7f80d0137420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.306+0000 7f80d5e1e700 1 -- 172.21.15.2:0/3760665316 >> 172.21.15.2:0/3760665316 conn(0x7f80d00b2740 msgr2=0x7f80d0147510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:50.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.306+0000 7f80d5e1e700 1 -- 172.21.15.2:0/3760665316 shutdown_connections 2023-11-26T07:17:50.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.307+0000 7f80d5e1e700 1 -- 172.21.15.2:0/3760665316 wait complete. 2023-11-26T07:17:50.315 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 5 to deep-scrub 2023-11-26T07:17:50.321 INFO:tasks.ceph:Scrubbing osd.6 2023-11-26T07:17:50.321 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-11-26T07:17:50.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.449+0000 7f406a599700 1 Processor -- start 2023-11-26T07:17:50.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.449+0000 7f406a599700 1 -- start start 2023-11-26T07:17:50.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.450+0000 7f406a599700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f406406d4d0 0x7f406415e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:50.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.450+0000 7f406a599700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f40640b5530 0x7f4064167ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:50.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.450+0000 7f406a599700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40640b5e10 con 0x7f406406f6d0 2023-11-26T07:17:50.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.450+0000 7f406a599700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40640b6990 con 0x7f40640b5530 2023-11-26T07:17:50.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.450+0000 7f406a599700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40640b60f0 con 0x7f406406d4d0 2023-11-26T07:17:50.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.450+0000 7f4068b36700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f40640b5530 0x7f4064167ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:50.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.450+0000 7f4063fff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f406406f6d0 0x7f406406fab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36680/0 (socket says 172.21.15.2:36680) 2023-11-26T07:17:50.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.450+0000 7f4063fff700 1 -- 172.21.15.2:0/2053029818 learned_addr learned my addr 172.21.15.2:0/2053029818 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:50.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.450+0000 7f4068b36700 1 -- 172.21.15.2:0/2053029818 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f406406d4d0 msgr2=0x7f406415e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:50.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.450+0000 7f4068b36700 1 --2- 172.21.15.2:0/2053029818 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f406406d4d0 0x7f406415e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.450+0000 7f4068b36700 1 -- 172.21.15.2:0/2053029818 >> v1:172.21.15.2:6789/0 conn(0x7f406406f6d0 legacy=0x7f406406fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:50.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.450+0000 7f4068b36700 1 -- 172.21.15.2:0/2053029818 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40640b63d0 con 0x7f40640b5530 2023-11-26T07:17:50.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.450+0000 7f4068b36700 1 --2- 172.21.15.2:0/2053029818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40640b5530 0x7f4064167ba0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f405c009d90 tx=0x7f405c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aee87f4f885d3c15 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:50.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.450+0000 7f4062ffd700 1 -- 172.21.15.2:0/2053029818 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405c00e070 con 0x7f40640b5530 2023-11-26T07:17:50.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.451+0000 7f4062ffd700 1 -- 172.21.15.2:0/2053029818 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f405c00bbd0 con 0x7f40640b5530 2023-11-26T07:17:50.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.451+0000 7f4062ffd700 1 -- 172.21.15.2:0/2053029818 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405c012430 con 0x7f40640b5530 2023-11-26T07:17:50.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.451+0000 7f406a599700 1 -- 172.21.15.2:0/2053029818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40640b5530 msgr2=0x7f4064167ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:50.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.451+0000 7f406a599700 1 --2- 172.21.15.2:0/2053029818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40640b5530 0x7f4064167ba0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f405c009d90 tx=0x7f405c00b330 comp rx=0 tx=0).stop 2023-11-26T07:17:50.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.451+0000 7f406a599700 1 -- 172.21.15.2:0/2053029818 shutdown_connections 2023-11-26T07:17:50.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.451+0000 7f406a599700 1 --2- 172.21.15.2:0/2053029818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40640b5530 0x7f4064167ba0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.451+0000 7f406a599700 1 --2- 172.21.15.2:0/2053029818 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f406406d4d0 0x7f406415e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.451+0000 7f406a599700 1 -- 172.21.15.2:0/2053029818 >> 172.21.15.2:0/2053029818 conn(0x7f406409a9f0 msgr2=0x7f406409ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:50.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.451+0000 7f406a599700 1 -- 172.21.15.2:0/2053029818 shutdown_connections 2023-11-26T07:17:50.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.451+0000 7f406a599700 1 -- 172.21.15.2:0/2053029818 wait complete. 2023-11-26T07:17:50.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.452+0000 7f406a599700 1 Processor -- start 2023-11-26T07:17:50.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.453+0000 7f406a599700 1 -- start start 2023-11-26T07:17:50.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.453+0000 7f406a599700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f406406d4d0 0x7f40640cae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:50.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.453+0000 7f406a599700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f406406f6d0 0x7f40640b3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:50.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.453+0000 7f406a599700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40640b5530 0x7f406414a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:50.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.453+0000 7f406a599700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40640cb9b0 con 0x7f406406d4d0 2023-11-26T07:17:50.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.453+0000 7f406a599700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406414a800 con 0x7f406406f6d0 2023-11-26T07:17:50.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.453+0000 7f406a599700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40640b1440 con 0x7f40640b5530 2023-11-26T07:17:50.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.453+0000 7f4063fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f406406d4d0 0x7f40640cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:50.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.453+0000 7f4063fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f406406d4d0 0x7f40640cae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45476/0 (socket says 172.21.15.2:45476) 2023-11-26T07:17:50.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.453+0000 7f4063fff700 1 -- 172.21.15.2:0/3804955762 learned_addr learned my addr 172.21.15.2:0/3804955762 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:50.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.454+0000 7f4068b36700 1 --2- 172.21.15.2:0/3804955762 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40640b5530 0x7f406414a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:50.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.454+0000 7f40637fe700 1 --2- 172.21.15.2:0/3804955762 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f406406f6d0 0x7f40640b3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:50.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.454+0000 7f4063fff700 1 -- 172.21.15.2:0/3804955762 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40640b5530 msgr2=0x7f406414a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:50.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.454+0000 7f4063fff700 1 --2- 172.21.15.2:0/3804955762 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40640b5530 0x7f406414a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.454+0000 7f4063fff700 1 -- 172.21.15.2:0/3804955762 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f406406f6d0 msgr2=0x7f40640b3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:50.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.454+0000 7f4063fff700 1 --2- 172.21.15.2:0/3804955762 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f406406f6d0 0x7f40640b3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.454+0000 7f4063fff700 1 -- 172.21.15.2:0/3804955762 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f405c009a70 con 0x7f406406d4d0 2023-11-26T07:17:50.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.454+0000 7f4063fff700 1 --2- 172.21.15.2:0/3804955762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f406406d4d0 0x7f40640cae10 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f404c00c520 tx=0x7f404c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:50.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.454+0000 7f4060ff9700 1 -- 172.21.15.2:0/3804955762 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c005d70 con 0x7f406406d4d0 2023-11-26T07:17:50.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.454+0000 7f4060ff9700 1 -- 172.21.15.2:0/3804955762 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404c0070d0 con 0x7f406406d4d0 2023-11-26T07:17:50.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.454+0000 7f406a599700 1 -- 172.21.15.2:0/3804955762 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40640b1720 con 0x7f406406d4d0 2023-11-26T07:17:50.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.454+0000 7f4060ff9700 1 -- 172.21.15.2:0/3804955762 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c007440 con 0x7f406406d4d0 2023-11-26T07:17:50.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.454+0000 7f406a599700 1 -- 172.21.15.2:0/3804955762 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40640af8e0 con 0x7f406406d4d0 2023-11-26T07:17:50.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.455+0000 7f406a599700 1 -- 172.21.15.2:0/3804955762 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f406415e820 con 0x7f406406d4d0 2023-11-26T07:17:50.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.456+0000 7f4060ff9700 1 -- 172.21.15.2:0/3804955762 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f404c0075a0 con 0x7f406406d4d0 2023-11-26T07:17:50.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.456+0000 7f4060ff9700 1 --2- 172.21.15.2:0/3804955762 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f404406b980 0x7f404406de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:50.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.456+0000 7f4060ff9700 1 -- 172.21.15.2:0/3804955762 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f404c087530 con 0x7f406406d4d0 2023-11-26T07:17:50.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.456+0000 7f4060ff9700 1 --2- 172.21.15.2:0/3804955762 >> [v2:172.21.15.192:6824/610652339,v1:172.21.15.192:6825/610652339] conn(0x7f40440717e0 0x7f4044073c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:50.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.456+0000 7f4060ff9700 1 -- 172.21.15.2:0/3804955762 --> [v2:172.21.15.192:6824/610652339,v1:172.21.15.192:6825/610652339] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f40440742d0 con 0x7f40440717e0 2023-11-26T07:17:50.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.456+0000 7f40637fe700 1 --2- 172.21.15.2:0/3804955762 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f404406b980 0x7f404406de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:50.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.456+0000 7f4060ff9700 1 -- 172.21.15.2:0/3804955762 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f404c08f280 con 0x7f406406d4d0 2023-11-26T07:17:50.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.456+0000 7f4068b36700 1 --2- 172.21.15.2:0/3804955762 >> [v2:172.21.15.192:6824/610652339,v1:172.21.15.192:6825/610652339] conn(0x7f40440717e0 0x7f4044073c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:50.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.457+0000 7f40637fe700 1 --2- 172.21.15.2:0/3804955762 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f404406b980 0x7f404406de40 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4054006fd0 tx=0x7f4054008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:50.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.457+0000 7f4068b36700 1 --2- 172.21.15.2:0/3804955762 >> [v2:172.21.15.192:6824/610652339,v1:172.21.15.192:6825/610652339] conn(0x7f40440717e0 0x7f4044073c00 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:50.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.458+0000 7f4060ff9700 1 -- 172.21.15.2:0/3804955762 <== osd.6 v2:172.21.15.192:6824/610652339 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f40440742d0 con 0x7f40440717e0 2023-11-26T07:17:50.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.473+0000 7f406a599700 1 -- 172.21.15.2:0/3804955762 --> [v2:172.21.15.192:6824/610652339,v1:172.21.15.192:6825/610652339] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f40640afa70 con 0x7f40440717e0 2023-11-26T07:17:50.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.473+0000 7f4060ff9700 1 -- 172.21.15.2:0/3804955762 <== osd.6 v2:172.21.15.192:6824/610652339 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f40640afa70 con 0x7f40440717e0 2023-11-26T07:17:50.475 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-26T07:17:50.475 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-26T07:17:50.476 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-26T07:17:50.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.473+0000 7f406a599700 1 -- 172.21.15.2:0/3804955762 >> [v2:172.21.15.192:6824/610652339,v1:172.21.15.192:6825/610652339] conn(0x7f40440717e0 msgr2=0x7f4044073c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:50.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.473+0000 7f406a599700 1 --2- 172.21.15.2:0/3804955762 >> [v2:172.21.15.192:6824/610652339,v1:172.21.15.192:6825/610652339] conn(0x7f40440717e0 0x7f4044073c00 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.474+0000 7f406a599700 1 -- 172.21.15.2:0/3804955762 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f404406b980 msgr2=0x7f404406de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:50.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.474+0000 7f406a599700 1 --2- 172.21.15.2:0/3804955762 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f404406b980 0x7f404406de40 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4054006fd0 tx=0x7f4054008040 comp rx=0 tx=0).stop 2023-11-26T07:17:50.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.474+0000 7f406a599700 1 -- 172.21.15.2:0/3804955762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f406406d4d0 msgr2=0x7f40640cae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:50.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.474+0000 7f406a599700 1 --2- 172.21.15.2:0/3804955762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f406406d4d0 0x7f40640cae10 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f404c00c520 tx=0x7f404c00c8e0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.474+0000 7f4068b36700 1 -- 172.21.15.2:0/3804955762 reap_dead start 2023-11-26T07:17:50.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.474+0000 7f406a599700 1 -- 172.21.15.2:0/3804955762 shutdown_connections 2023-11-26T07:17:50.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.474+0000 7f406a599700 1 -- 172.21.15.2:0/3804955762 >> 172.21.15.2:0/3804955762 conn(0x7f406409a9f0 msgr2=0x7f406415e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:50.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.474+0000 7f406a599700 1 -- 172.21.15.2:0/3804955762 shutdown_connections 2023-11-26T07:17:50.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.474+0000 7f406a599700 1 -- 172.21.15.2:0/3804955762 wait complete. 2023-11-26T07:17:50.487 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-11-26T07:17:50.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.612+0000 7f0a837c9700 1 Processor -- start 2023-11-26T07:17:50.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.612+0000 7f0a837c9700 1 -- start start 2023-11-26T07:17:50.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.613+0000 7f0a837c9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a7c15a440 0x7f0a7c0cffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:50.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.613+0000 7f0a837c9700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0a7c15a820 0x7f0a7c0d04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:50.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.613+0000 7f0a837c9700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a7c0b05f0 con 0x7f0a7c15eb80 2023-11-26T07:17:50.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.613+0000 7f0a837c9700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a7c15f080 con 0x7f0a7c15a820 2023-11-26T07:17:50.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.613+0000 7f0a837c9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7c0afd50 con 0x7f0a7c15a440 2023-11-26T07:17:50.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.613+0000 7f0a81565700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a7c15a440 0x7f0a7c0cffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:50.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.613+0000 7f0a80d64700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0a7c15a820 0x7f0a7c0d04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:50.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.614+0000 7f0a81d66700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f0a7c15eb80 0x7f0a7c0726a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.2:44070/0 (socket says 172.21.15.2:44070) 2023-11-26T07:17:50.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.614+0000 7f0a81d66700 1 -- 172.21.15.2:0/1837179940 learned_addr learned my addr 172.21.15.2:0/1837179940 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:50.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.614+0000 7f0a6ffff700 1 -- 172.21.15.2:0/1837179940 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1991192080 0 0) 0x7f0a7c0b05f0 con 0x7f0a7c15eb80 2023-11-26T07:17:50.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.614+0000 7f0a6ffff700 1 -- 172.21.15.2:0/1837179940 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a680035b0 con 0x7f0a7c15eb80 2023-11-26T07:17:50.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.614+0000 7f0a81565700 1 -- 172.21.15.2:0/1837179940 >> v2:172.21.15.192:3300/0 conn(0x7f0a7c15a820 msgr2=0x7f0a7c0d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:50.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.614+0000 7f0a81565700 1 --2- 172.21.15.2:0/1837179940 >> v2:172.21.15.192:3300/0 conn(0x7f0a7c15a820 0x7f0a7c0d04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.614+0000 7f0a81565700 1 -- 172.21.15.2:0/1837179940 >> v1:172.21.15.192:6789/0 conn(0x7f0a7c15eb80 legacy=0x7f0a7c0726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:50.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.614+0000 7f0a81565700 1 -- 172.21.15.2:0/1837179940 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a7c0b0030 con 0x7f0a7c15a440 2023-11-26T07:17:50.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.614+0000 7f0a80d64700 1 --2- 172.21.15.2:0/1837179940 >> v2:172.21.15.192:3300/0 conn(0x7f0a7c15a820 0x7f0a7c0d04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:17:50.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.614+0000 7f0a81565700 1 --2- 172.21.15.2:0/1837179940 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a7c15a440 0x7f0a7c0cffa0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0a78009840 tx=0x7f0a78009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8492eb6200ed83dc server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:50.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.614+0000 7f0a6ffff700 1 -- 172.21.15.2:0/1837179940 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a78011830 con 0x7f0a7c15a440 2023-11-26T07:17:50.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.614+0000 7f0a6ffff700 1 -- 172.21.15.2:0/1837179940 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a78011990 con 0x7f0a7c15a440 2023-11-26T07:17:50.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.614+0000 7f0a6ffff700 1 -- 172.21.15.2:0/1837179940 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a78011d20 con 0x7f0a7c15a440 2023-11-26T07:17:50.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.615+0000 7f0a837c9700 1 -- 172.21.15.2:0/1837179940 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a7c15a440 msgr2=0x7f0a7c0cffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:50.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.615+0000 7f0a837c9700 1 --2- 172.21.15.2:0/1837179940 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a7c15a440 0x7f0a7c0cffa0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0a78009840 tx=0x7f0a78009b50 comp rx=0 tx=0).stop 2023-11-26T07:17:50.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.615+0000 7f0a837c9700 1 -- 172.21.15.2:0/1837179940 shutdown_connections 2023-11-26T07:17:50.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.615+0000 7f0a837c9700 1 --2- 172.21.15.2:0/1837179940 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a7c15a440 0x7f0a7c0cffa0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.615+0000 7f0a837c9700 1 --2- 172.21.15.2:0/1837179940 >> v2:172.21.15.192:3300/0 conn(0x7f0a7c15a820 0x7f0a7c0d04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.615+0000 7f0a837c9700 1 -- 172.21.15.2:0/1837179940 >> 172.21.15.2:0/1837179940 conn(0x7f0a7c0b5070 msgr2=0x7f0a7c0b5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:50.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.615+0000 7f0a837c9700 1 -- 172.21.15.2:0/1837179940 shutdown_connections 2023-11-26T07:17:50.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.615+0000 7f0a837c9700 1 -- 172.21.15.2:0/1837179940 wait complete. 2023-11-26T07:17:50.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.616+0000 7f0a837c9700 1 Processor -- start 2023-11-26T07:17:50.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.616+0000 7f0a837c9700 1 -- start start 2023-11-26T07:17:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.617+0000 7f0a837c9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a7c15a440 0x7f0a7c156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.617+0000 7f0a837c9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a7c15eb80 0x7f0a7c158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.617+0000 7f0a837c9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a7c1478f0 0x7f0a7c1592f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.617+0000 7f0a837c9700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7c0cdbe0 con 0x7f0a7c15a440 2023-11-26T07:17:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.617+0000 7f0a837c9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7c156a60 con 0x7f0a7c1478f0 2023-11-26T07:17:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.617+0000 7f0a837c9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7c0cccf0 con 0x7f0a7c15eb80 2023-11-26T07:17:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.617+0000 7f0a81565700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a7c15a440 0x7f0a7c156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.617+0000 7f0a81565700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a7c15a440 0x7f0a7c156520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45492/0 (socket says 172.21.15.2:45492) 2023-11-26T07:17:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.617+0000 7f0a81565700 1 -- 172.21.15.2:0/487770517 learned_addr learned my addr 172.21.15.2:0/487770517 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.617+0000 7f0a80d64700 1 --2- 172.21.15.2:0/487770517 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a7c15eb80 0x7f0a7c158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.617+0000 7f0a81d66700 1 --2- 172.21.15.2:0/487770517 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a7c1478f0 0x7f0a7c1592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.617+0000 7f0a81565700 1 -- 172.21.15.2:0/487770517 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a7c15eb80 msgr2=0x7f0a7c158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.617+0000 7f0a81565700 1 --2- 172.21.15.2:0/487770517 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a7c15eb80 0x7f0a7c158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.617+0000 7f0a81565700 1 -- 172.21.15.2:0/487770517 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a7c1478f0 msgr2=0x7f0a7c1592f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.617+0000 7f0a81565700 1 --2- 172.21.15.2:0/487770517 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a7c1478f0 0x7f0a7c1592f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.617+0000 7f0a81565700 1 -- 172.21.15.2:0/487770517 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a700094a0 con 0x7f0a7c15a440 2023-11-26T07:17:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.618+0000 7f0a81565700 1 --2- 172.21.15.2:0/487770517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a7c15a440 0x7f0a7c156520 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f0a780090b0 tx=0x7f0a78004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.618+0000 7f0a6dffb700 1 -- 172.21.15.2:0/487770517 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a780036a0 con 0x7f0a7c15a440 2023-11-26T07:17:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.618+0000 7f0a6dffb700 1 -- 172.21.15.2:0/487770517 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a7801f070 con 0x7f0a7c15a440 2023-11-26T07:17:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.618+0000 7f0a837c9700 1 -- 172.21.15.2:0/487770517 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a780094a0 con 0x7f0a7c15a440 2023-11-26T07:17:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.618+0000 7f0a6dffb700 1 -- 172.21.15.2:0/487770517 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a78003a40 con 0x7f0a7c15a440 2023-11-26T07:17:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.618+0000 7f0a837c9700 1 -- 172.21.15.2:0/487770517 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a7c0cd2b0 con 0x7f0a7c15a440 2023-11-26T07:17:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.619+0000 7f0a837c9700 1 -- 172.21.15.2:0/487770517 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a7c068670 con 0x7f0a7c15a440 2023-11-26T07:17:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.619+0000 7f0a6dffb700 1 -- 172.21.15.2:0/487770517 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f0a78003ba0 con 0x7f0a7c15a440 2023-11-26T07:17:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.620+0000 7f0a6dffb700 1 --2- 172.21.15.2:0/487770517 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0a6006b980 0x7f0a6006de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.620+0000 7f0a6dffb700 1 -- 172.21.15.2:0/487770517 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0a78021070 con 0x7f0a7c15a440 2023-11-26T07:17:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.620+0000 7f0a80d64700 1 --2- 172.21.15.2:0/487770517 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0a6006b980 0x7f0a6006de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:50.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.621+0000 7f0a80d64700 1 --2- 172.21.15.2:0/487770517 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0a6006b980 0x7f0a6006de40 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c1564b0 tx=0x7f0a70008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:50.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.625+0000 7f0a6dffb700 1 -- 172.21.15.2:0/487770517 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0a78056330 con 0x7f0a7c15a440 2023-11-26T07:17:50.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.824+0000 7f0a837c9700 1 -- 172.21.15.2:0/487770517 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a7c0cc6b0 con 0x7f0a6006b980 2023-11-26T07:17:50.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.825+0000 7f0a6dffb700 1 -- 172.21.15.2:0/487770517 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0a70009e10 con 0x7f0a6006b980 2023-11-26T07:17:50.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.827+0000 7f0a837c9700 1 -- 172.21.15.2:0/487770517 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0a6006b980 msgr2=0x7f0a6006de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:50.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.827+0000 7f0a837c9700 1 --2- 172.21.15.2:0/487770517 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0a6006b980 0x7f0a6006de40 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c1564b0 tx=0x7f0a70008040 comp rx=0 tx=0).stop 2023-11-26T07:17:50.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.827+0000 7f0a837c9700 1 -- 172.21.15.2:0/487770517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a7c15a440 msgr2=0x7f0a7c156520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:50.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.827+0000 7f0a837c9700 1 --2- 172.21.15.2:0/487770517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a7c15a440 0x7f0a7c156520 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f0a780090b0 tx=0x7f0a78004750 comp rx=0 tx=0).stop 2023-11-26T07:17:50.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.828+0000 7f0a837c9700 1 -- 172.21.15.2:0/487770517 shutdown_connections 2023-11-26T07:17:50.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.828+0000 7f0a837c9700 1 --2- 172.21.15.2:0/487770517 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f0a6006b980 0x7f0a6006de40 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.828+0000 7f0a837c9700 1 --2- 172.21.15.2:0/487770517 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a7c1478f0 0x7f0a7c1592f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.828+0000 7f0a837c9700 1 --2- 172.21.15.2:0/487770517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a7c15a440 0x7f0a7c156520 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.828+0000 7f0a837c9700 1 --2- 172.21.15.2:0/487770517 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a7c15eb80 0x7f0a7c158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.828+0000 7f0a837c9700 1 -- 172.21.15.2:0/487770517 >> 172.21.15.2:0/487770517 conn(0x7f0a7c0b5070 msgr2=0x7f0a7c0b1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:50.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.828+0000 7f0a837c9700 1 -- 172.21.15.2:0/487770517 shutdown_connections 2023-11-26T07:17:50.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.828+0000 7f0a837c9700 1 -- 172.21.15.2:0/487770517 wait complete. 2023-11-26T07:17:50.832 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 6 to deep-scrub 2023-11-26T07:17:50.842 INFO:tasks.ceph:Scrubbing osd.7 2023-11-26T07:17:50.842 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-11-26T07:17:50.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.969+0000 7f2a5caa0700 1 Processor -- start 2023-11-26T07:17:50.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.970+0000 7f2a5caa0700 1 -- start start 2023-11-26T07:17:50.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.970+0000 7f2a5caa0700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2a5815ace0 0x7f2a5815e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:50.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.970+0000 7f2a5caa0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a5806e300 0x7f2a5806afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:50.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.970+0000 7f2a5caa0700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a58072710 con 0x7f2a5806c6b0 2023-11-26T07:17:50.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.970+0000 7f2a5caa0700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a58073300 con 0x7f2a5815ace0 2023-11-26T07:17:50.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.971+0000 7f2a5caa0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5815c0d0 con 0x7f2a5806e300 2023-11-26T07:17:50.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.971+0000 7f2a55d9b700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2a5806c6b0 0x7f2a5815edd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36710/0 (socket says 172.21.15.2:36710) 2023-11-26T07:17:50.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.971+0000 7f2a55d9b700 1 -- 172.21.15.2:0/2562351864 learned_addr learned my addr 172.21.15.2:0/2562351864 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:50.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.971+0000 7f2a56d9d700 1 --2- 172.21.15.2:0/2562351864 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a5806e300 0x7f2a5806afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:50.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.971+0000 7f2a5659c700 1 --2- 172.21.15.2:0/2562351864 >> v2:172.21.15.192:3300/0 conn(0x7f2a5815ace0 0x7f2a5815e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:50.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.971+0000 7f2a5559a700 1 -- 172.21.15.2:0/2562351864 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1872862577 0 0) 0x7f2a58072710 con 0x7f2a5806c6b0 2023-11-26T07:17:50.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.971+0000 7f2a5559a700 1 -- 172.21.15.2:0/2562351864 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a440035b0 con 0x7f2a5806c6b0 2023-11-26T07:17:50.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.971+0000 7f2a5559a700 1 -- 172.21.15.2:0/2562351864 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 598717981 0 0) 0x7f2a440035b0 con 0x7f2a5806c6b0 2023-11-26T07:17:50.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.971+0000 7f2a5559a700 1 -- 172.21.15.2:0/2562351864 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a5806e300 msgr2=0x7f2a5806afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:50.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.971+0000 7f2a5559a700 1 --2- 172.21.15.2:0/2562351864 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a5806e300 0x7f2a5806afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.971+0000 7f2a5559a700 1 -- 172.21.15.2:0/2562351864 >> v2:172.21.15.192:3300/0 conn(0x7f2a5815ace0 msgr2=0x7f2a5815e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:50.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.971+0000 7f2a5559a700 1 --2- 172.21.15.2:0/2562351864 >> v2:172.21.15.192:3300/0 conn(0x7f2a5815ace0 0x7f2a5815e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.971+0000 7f2a5559a700 1 -- 172.21.15.2:0/2562351864 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a58072960 con 0x7f2a5806c6b0 2023-11-26T07:17:50.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.971+0000 7f2a5559a700 1 -- 172.21.15.2:0/2562351864 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f2a40001670 con 0x7f2a5806c6b0 2023-11-26T07:17:50.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.971+0000 7f2a5559a700 1 -- 172.21.15.2:0/2562351864 >> v1:172.21.15.2:6789/0 conn(0x7f2a5806c6b0 legacy=0x7f2a5815edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:50.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.971+0000 7f2a5559a700 1 --2- 172.21.15.2:0/2562351864 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a44003a00 0x7f2a44003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:50.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.971+0000 7f2a5559a700 1 --2- 172.21.15.2:0/2562351864 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a5806e300 0x7f2a44004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:50.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.971+0000 7f2a5559a700 1 --2- 172.21.15.2:0/2562351864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a44004d90 0x7f2a44005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:50.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.971+0000 7f2a5559a700 1 -- 172.21.15.2:0/2562351864 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a58073300 con 0x7f2a44003a00 2023-11-26T07:17:50.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.971+0000 7f2a5559a700 1 -- 172.21.15.2:0/2562351864 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5815c0d0 con 0x7f2a44004d90 2023-11-26T07:17:50.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.971+0000 7f2a5559a700 1 -- 172.21.15.2:0/2562351864 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4400dc50 con 0x7f2a5806e300 2023-11-26T07:17:50.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.971+0000 7f2a5659c700 1 --2- 172.21.15.2:0/2562351864 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a44003a00 0x7f2a44003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:50.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.972+0000 7f2a56d9d700 1 --2- 172.21.15.2:0/2562351864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a44004d90 0x7f2a44005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:50.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.972+0000 7f2a55d9b700 1 --2- 172.21.15.2:0/2562351864 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a5806e300 0x7f2a44004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:50.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.972+0000 7f2a5659c700 1 -- 172.21.15.2:0/2562351864 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a5806e300 msgr2=0x7f2a44004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:50.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.972+0000 7f2a5659c700 1 --2- 172.21.15.2:0/2562351864 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a5806e300 0x7f2a44004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.972+0000 7f2a5659c700 1 -- 172.21.15.2:0/2562351864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a44004d90 msgr2=0x7f2a44005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:50.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.972+0000 7f2a5659c700 1 --2- 172.21.15.2:0/2562351864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a44004d90 0x7f2a44005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.972+0000 7f2a5659c700 1 -- 172.21.15.2:0/2562351864 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a440035b0 con 0x7f2a44003a00 2023-11-26T07:17:50.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.972+0000 7f2a56d9d700 1 --2- 172.21.15.2:0/2562351864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a44004d90 0x7f2a44005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:50.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.972+0000 7f2a5659c700 1 --2- 172.21.15.2:0/2562351864 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a44003a00 0x7f2a44003e20 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f2a48009b60 tx=0x7f2a44005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8be0c1baf21d0c14 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:50.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.972+0000 7f2a5559a700 1 -- 172.21.15.2:0/2562351864 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4800e6c0 con 0x7f2a44003a00 2023-11-26T07:17:50.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.972+0000 7f2a5559a700 1 -- 172.21.15.2:0/2562351864 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4800e820 con 0x7f2a44003a00 2023-11-26T07:17:50.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.972+0000 7f2a5559a700 1 -- 172.21.15.2:0/2562351864 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4800eb90 con 0x7f2a44003a00 2023-11-26T07:17:50.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.972+0000 7f2a5caa0700 1 -- 172.21.15.2:0/2562351864 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a44003a00 msgr2=0x7f2a44003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:50.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.972+0000 7f2a5caa0700 1 --2- 172.21.15.2:0/2562351864 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a44003a00 0x7f2a44003e20 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f2a48009b60 tx=0x7f2a44005880 comp rx=0 tx=0).stop 2023-11-26T07:17:50.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.973+0000 7f2a56d9d700 1 -- 172.21.15.2:0/2562351864 reap_dead start 2023-11-26T07:17:50.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.973+0000 7f2a5caa0700 1 -- 172.21.15.2:0/2562351864 shutdown_connections 2023-11-26T07:17:50.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.973+0000 7f2a5caa0700 1 -- 172.21.15.2:0/2562351864 >> 172.21.15.2:0/2562351864 conn(0x7f2a580b5070 msgr2=0x7f2a580b5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:50.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.973+0000 7f2a5caa0700 1 -- 172.21.15.2:0/2562351864 shutdown_connections 2023-11-26T07:17:50.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.973+0000 7f2a5caa0700 1 -- 172.21.15.2:0/2562351864 wait complete. 2023-11-26T07:17:50.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.974+0000 7f2a5caa0700 1 Processor -- start 2023-11-26T07:17:50.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.974+0000 7f2a5caa0700 1 -- start start 2023-11-26T07:17:50.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.975+0000 7f2a5caa0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a44003a00 0x7f2a58098e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:50.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.975+0000 7f2a5caa0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a58099730 0x7f2a580b2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:50.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.975+0000 7f2a5caa0700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a580b2640 0x7f2a58151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:50.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.975+0000 7f2a5caa0700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a580b1060 con 0x7f2a58099730 2023-11-26T07:17:50.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.975+0000 7f2a5caa0700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a580b1340 con 0x7f2a580b2640 2023-11-26T07:17:50.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.975+0000 7f2a5caa0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a580b1620 con 0x7f2a44003a00 2023-11-26T07:17:50.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.975+0000 7f2a55d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a58099730 0x7f2a580b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:50.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.975+0000 7f2a55d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a58099730 0x7f2a580b2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45512/0 (socket says 172.21.15.2:45512) 2023-11-26T07:17:50.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.975+0000 7f2a55d9b700 1 -- 172.21.15.2:0/3293230523 learned_addr learned my addr 172.21.15.2:0/3293230523 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:50.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.975+0000 7f2a55d9b700 1 -- 172.21.15.2:0/3293230523 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a44003a00 msgr2=0x7f2a58098e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:50.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.975+0000 7f2a55d9b700 1 --2- 172.21.15.2:0/3293230523 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a44003a00 0x7f2a58098e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.975+0000 7f2a55d9b700 1 -- 172.21.15.2:0/3293230523 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a580b2640 msgr2=0x7f2a58151ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:50.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.975+0000 7f2a55d9b700 1 --2- 172.21.15.2:0/3293230523 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a580b2640 0x7f2a58151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.975+0000 7f2a55d9b700 1 -- 172.21.15.2:0/3293230523 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a580b1900 con 0x7f2a58099730 2023-11-26T07:17:50.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.975+0000 7f2a55d9b700 1 --2- 172.21.15.2:0/3293230523 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a58099730 0x7f2a580b2100 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f2a40001a30 tx=0x7f2a4000eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:50.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.975+0000 7f2a4effd700 1 -- 172.21.15.2:0/3293230523 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a40012590 con 0x7f2a58099730 2023-11-26T07:17:50.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.976+0000 7f2a4effd700 1 -- 172.21.15.2:0/3293230523 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a40012710 con 0x7f2a58099730 2023-11-26T07:17:50.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.976+0000 7f2a5caa0700 1 -- 172.21.15.2:0/3293230523 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a580b1be0 con 0x7f2a58099730 2023-11-26T07:17:50.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.976+0000 7f2a4effd700 1 -- 172.21.15.2:0/3293230523 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a40012ac0 con 0x7f2a58099730 2023-11-26T07:17:50.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.976+0000 7f2a5caa0700 1 -- 172.21.15.2:0/3293230523 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a581523e0 con 0x7f2a58099730 2023-11-26T07:17:50.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.976+0000 7f2a5caa0700 1 -- 172.21.15.2:0/3293230523 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2a58072f20 con 0x7f2a58099730 2023-11-26T07:17:50.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.977+0000 7f2a4effd700 1 -- 172.21.15.2:0/3293230523 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f2a40012c20 con 0x7f2a58099730 2023-11-26T07:17:50.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.977+0000 7f2a4effd700 1 --2- 172.21.15.2:0/3293230523 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f2a3806b980 0x7f2a3806de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:50.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.977+0000 7f2a4effd700 1 -- 172.21.15.2:0/3293230523 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2a40088730 con 0x7f2a58099730 2023-11-26T07:17:50.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.978+0000 7f2a4effd700 1 --2- 172.21.15.2:0/3293230523 >> [v2:172.21.15.192:6808/2129584711,v1:172.21.15.192:6809/2129584711] conn(0x7f2a380717e0 0x7f2a38073c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:50.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.978+0000 7f2a4effd700 1 -- 172.21.15.2:0/3293230523 --> [v2:172.21.15.192:6808/2129584711,v1:172.21.15.192:6809/2129584711] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2a380742d0 con 0x7f2a380717e0 2023-11-26T07:17:50.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.978+0000 7f2a4effd700 1 -- 172.21.15.2:0/3293230523 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a4008b220 con 0x7f2a58099730 2023-11-26T07:17:50.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.978+0000 7f2a5659c700 1 --2- 172.21.15.2:0/3293230523 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f2a3806b980 0x7f2a3806de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:50.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.978+0000 7f2a56d9d700 1 --2- 172.21.15.2:0/3293230523 >> [v2:172.21.15.192:6808/2129584711,v1:172.21.15.192:6809/2129584711] conn(0x7f2a380717e0 0x7f2a38073c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:50.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.978+0000 7f2a5659c700 1 --2- 172.21.15.2:0/3293230523 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f2a3806b980 0x7f2a3806de40 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f2a4800a010 tx=0x7f2a48013000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:50.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.978+0000 7f2a56d9d700 1 --2- 172.21.15.2:0/3293230523 >> [v2:172.21.15.192:6808/2129584711,v1:172.21.15.192:6809/2129584711] conn(0x7f2a380717e0 0x7f2a38073c00 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:50.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.979+0000 7f2a4effd700 1 -- 172.21.15.2:0/3293230523 <== osd.7 v2:172.21.15.192:6808/2129584711 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f2a380742d0 con 0x7f2a380717e0 2023-11-26T07:17:50.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.994+0000 7f2a5caa0700 1 -- 172.21.15.2:0/3293230523 --> [v2:172.21.15.192:6808/2129584711,v1:172.21.15.192:6809/2129584711] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2a580b1f50 con 0x7f2a380717e0 2023-11-26T07:17:50.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.995+0000 7f2a4effd700 1 -- 172.21.15.2:0/3293230523 <== osd.7 v2:172.21.15.192:6808/2129584711 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f2a580b1f50 con 0x7f2a380717e0 2023-11-26T07:17:50.997 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-26T07:17:50.997 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-26T07:17:50.997 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-26T07:17:50.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.995+0000 7f2a5caa0700 1 -- 172.21.15.2:0/3293230523 >> [v2:172.21.15.192:6808/2129584711,v1:172.21.15.192:6809/2129584711] conn(0x7f2a380717e0 msgr2=0x7f2a38073c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:50.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.995+0000 7f2a5caa0700 1 --2- 172.21.15.2:0/3293230523 >> [v2:172.21.15.192:6808/2129584711,v1:172.21.15.192:6809/2129584711] conn(0x7f2a380717e0 0x7f2a38073c00 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.995+0000 7f2a5caa0700 1 -- 172.21.15.2:0/3293230523 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f2a3806b980 msgr2=0x7f2a3806de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:50.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.995+0000 7f2a5caa0700 1 --2- 172.21.15.2:0/3293230523 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f2a3806b980 0x7f2a3806de40 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f2a4800a010 tx=0x7f2a48013000 comp rx=0 tx=0).stop 2023-11-26T07:17:50.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.995+0000 7f2a5caa0700 1 -- 172.21.15.2:0/3293230523 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a58099730 msgr2=0x7f2a580b2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:50.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.995+0000 7f2a5caa0700 1 --2- 172.21.15.2:0/3293230523 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a58099730 0x7f2a580b2100 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f2a40001a30 tx=0x7f2a4000eba0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.995+0000 7f2a56d9d700 1 -- 172.21.15.2:0/3293230523 reap_dead start 2023-11-26T07:17:50.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.995+0000 7f2a5caa0700 1 -- 172.21.15.2:0/3293230523 shutdown_connections 2023-11-26T07:17:50.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.995+0000 7f2a5caa0700 1 -- 172.21.15.2:0/3293230523 >> 172.21.15.2:0/3293230523 conn(0x7f2a580b5070 msgr2=0x7f2a58159fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:50.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.995+0000 7f2a5caa0700 1 -- 172.21.15.2:0/3293230523 shutdown_connections 2023-11-26T07:17:50.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:50.995+0000 7f2a5caa0700 1 -- 172.21.15.2:0/3293230523 wait complete. 2023-11-26T07:17:51.009 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-11-26T07:17:51.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.133+0000 7f6e5628f700 1 Processor -- start 2023-11-26T07:17:51.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.133+0000 7f6e5628f700 1 -- start start 2023-11-26T07:17:51.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.134+0000 7f6e5628f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6e5006b620 0x7f6e500b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:51.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.134+0000 7f6e5628f700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e501629c0 con 0x7f6e5006ee60 2023-11-26T07:17:51.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.134+0000 7f6e5628f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e50071f50 con 0x7f6e500b5ab0 2023-11-26T07:17:51.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.134+0000 7f6e5628f700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e50072230 con 0x7f6e5006b620 2023-11-26T07:17:51.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.134+0000 7f6e5482c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f6e5006ee60 0x7f6e501622b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36734/0 (socket says 172.21.15.2:36734) 2023-11-26T07:17:51.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.134+0000 7f6e5482c700 1 -- 172.21.15.2:0/1779573010 learned_addr learned my addr 172.21.15.2:0/1779573010 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:51.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.134+0000 7f6e4effd700 1 -- 172.21.15.2:0/1779573010 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2650990207 0 0) 0x7f6e501629c0 con 0x7f6e5006ee60 2023-11-26T07:17:51.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.134+0000 7f6e4ffff700 1 --2- 172.21.15.2:0/1779573010 >> v2:172.21.15.192:3300/0 conn(0x7f6e5006b620 0x7f6e500b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:51.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.134+0000 7f6e4effd700 1 -- 172.21.15.2:0/1779573010 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e3c0035b0 con 0x7f6e5006ee60 2023-11-26T07:17:51.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.135+0000 7f6e4effd700 1 -- 172.21.15.2:0/1779573010 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2183646159 0 0) 0x7f6e3c0035b0 con 0x7f6e5006ee60 2023-11-26T07:17:51.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.135+0000 7f6e4effd700 1 -- 172.21.15.2:0/1779573010 >> v2:172.21.15.192:3300/0 conn(0x7f6e5006b620 msgr2=0x7f6e500b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:51.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.135+0000 7f6e4effd700 1 --2- 172.21.15.2:0/1779573010 >> v2:172.21.15.192:3300/0 conn(0x7f6e5006b620 0x7f6e500b3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:51.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.135+0000 7f6e4effd700 1 -- 172.21.15.2:0/1779573010 >> v1:172.21.15.192:6789/0 conn(0x7f6e500b5ab0 legacy=0x7f6e50161ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:51.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.135+0000 7f6e4effd700 1 -- 172.21.15.2:0/1779573010 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e50072510 con 0x7f6e5006ee60 2023-11-26T07:17:51.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.135+0000 7f6e4effd700 1 -- 172.21.15.2:0/1779573010 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f6e480019f0 con 0x7f6e5006ee60 2023-11-26T07:17:51.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.135+0000 7f6e4effd700 1 -- 172.21.15.2:0/1779573010 >> v1:172.21.15.2:6789/0 conn(0x7f6e5006ee60 legacy=0x7f6e501622b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:51.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.135+0000 7f6e4effd700 1 --2- 172.21.15.2:0/1779573010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e3c003a00 0x7f6e3c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:51.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.135+0000 7f6e4effd700 1 --2- 172.21.15.2:0/1779573010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e3c004850 0x7f6e3c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:51.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.135+0000 7f6e4effd700 1 --2- 172.21.15.2:0/1779573010 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6e3c005210 0x7f6e3c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:51.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.135+0000 7f6e4effd700 1 -- 172.21.15.2:0/1779573010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e50072230 con 0x7f6e3c004850 2023-11-26T07:17:51.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.135+0000 7f6e4effd700 1 -- 172.21.15.2:0/1779573010 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3c00c0b0 con 0x7f6e3c003a00 2023-11-26T07:17:51.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.135+0000 7f6e4effd700 1 -- 172.21.15.2:0/1779573010 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3c00c270 con 0x7f6e3c005210 2023-11-26T07:17:51.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.135+0000 7f6e4f7fe700 1 --2- 172.21.15.2:0/1779573010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e3c004850 0x7f6e3c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:51.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.135+0000 7f6e4ffff700 1 --2- 172.21.15.2:0/1779573010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e3c003a00 0x7f6e3c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:51.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.135+0000 7f6e5482c700 1 --2- 172.21.15.2:0/1779573010 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6e3c005210 0x7f6e3c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:51.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.135+0000 7f6e4f7fe700 1 -- 172.21.15.2:0/1779573010 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6e3c005210 msgr2=0x7f6e3c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:51.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.135+0000 7f6e4f7fe700 1 --2- 172.21.15.2:0/1779573010 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6e3c005210 0x7f6e3c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:51.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.135+0000 7f6e4f7fe700 1 -- 172.21.15.2:0/1779573010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e3c003a00 msgr2=0x7f6e3c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:51.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.135+0000 7f6e4f7fe700 1 --2- 172.21.15.2:0/1779573010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e3c003a00 0x7f6e3c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:51.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.135+0000 7f6e4f7fe700 1 -- 172.21.15.2:0/1779573010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e3c0035b0 con 0x7f6e3c004850 2023-11-26T07:17:51.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.135+0000 7f6e5482c700 1 --2- 172.21.15.2:0/1779573010 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6e3c005210 0x7f6e3c00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:51.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.135+0000 7f6e5482c700 1 -- 172.21.15.2:0/1779573010 reap_dead start 2023-11-26T07:17:51.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.135+0000 7f6e4f7fe700 1 --2- 172.21.15.2:0/1779573010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e3c004850 0x7f6e3c004cd0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f6e500b5f10 tx=0x7f6e3c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7495b61ccf793b37 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:51.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.136+0000 7f6e4effd700 1 -- 172.21.15.2:0/1779573010 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e380052d0 con 0x7f6e3c004850 2023-11-26T07:17:51.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.136+0000 7f6e4effd700 1 -- 172.21.15.2:0/1779573010 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e38005430 con 0x7f6e3c004850 2023-11-26T07:17:51.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.136+0000 7f6e4effd700 1 -- 172.21.15.2:0/1779573010 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e380038c0 con 0x7f6e3c004850 2023-11-26T07:17:51.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.136+0000 7f6e5628f700 1 -- 172.21.15.2:0/1779573010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e3c004850 msgr2=0x7f6e3c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:51.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.136+0000 7f6e5628f700 1 --2- 172.21.15.2:0/1779573010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e3c004850 0x7f6e3c004cd0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f6e500b5f10 tx=0x7f6e3c005880 comp rx=0 tx=0).stop 2023-11-26T07:17:51.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.136+0000 7f6e5628f700 1 -- 172.21.15.2:0/1779573010 shutdown_connections 2023-11-26T07:17:51.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.136+0000 7f6e5628f700 1 --2- 172.21.15.2:0/1779573010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e3c004850 0x7f6e3c004cd0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:51.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.136+0000 7f6e5628f700 1 -- 172.21.15.2:0/1779573010 >> 172.21.15.2:0/1779573010 conn(0x7f6e500b2740 msgr2=0x7f6e500b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:51.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.136+0000 7f6e5628f700 1 -- 172.21.15.2:0/1779573010 shutdown_connections 2023-11-26T07:17:51.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.136+0000 7f6e5628f700 1 -- 172.21.15.2:0/1779573010 wait complete. 2023-11-26T07:17:51.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.137+0000 7f6e5628f700 1 Processor -- start 2023-11-26T07:17:51.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.138+0000 7f6e5628f700 1 -- start start 2023-11-26T07:17:51.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.138+0000 7f6e5628f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e3c004850 0x7f6e500b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:51.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.138+0000 7f6e5628f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e501572b0 0x7f6e50157730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:51.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.138+0000 7f6e5628f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6e50151870 0x7f6e50151cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:51.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.138+0000 7f6e5628f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e50157c70 con 0x7f6e501572b0 2023-11-26T07:17:51.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.138+0000 7f6e5628f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e501531b0 con 0x7f6e3c004850 2023-11-26T07:17:51.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.138+0000 7f6e5628f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e501525a0 con 0x7f6e50151870 2023-11-26T07:17:51.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.138+0000 7f6e4f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e501572b0 0x7f6e50157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:51.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.138+0000 7f6e4f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e501572b0 0x7f6e50157730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45534/0 (socket says 172.21.15.2:45534) 2023-11-26T07:17:51.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.138+0000 7f6e4f7fe700 1 -- 172.21.15.2:0/122413346 learned_addr learned my addr 172.21.15.2:0/122413346 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:51.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.139+0000 7f6e4ffff700 1 --2- 172.21.15.2:0/122413346 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e3c004850 0x7f6e500b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:51.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.139+0000 7f6e5482c700 1 --2- 172.21.15.2:0/122413346 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6e50151870 0x7f6e50151cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:51.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.139+0000 7f6e4f7fe700 1 -- 172.21.15.2:0/122413346 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6e50151870 msgr2=0x7f6e50151cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:51.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.139+0000 7f6e4f7fe700 1 --2- 172.21.15.2:0/122413346 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6e50151870 0x7f6e50151cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:51.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.139+0000 7f6e4f7fe700 1 -- 172.21.15.2:0/122413346 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e3c004850 msgr2=0x7f6e500b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:51.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.139+0000 7f6e4f7fe700 1 --2- 172.21.15.2:0/122413346 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e3c004850 0x7f6e500b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:51.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.139+0000 7f6e4f7fe700 1 -- 172.21.15.2:0/122413346 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e50152880 con 0x7f6e501572b0 2023-11-26T07:17:51.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.139+0000 7f6e4ffff700 1 --2- 172.21.15.2:0/122413346 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e3c004850 0x7f6e500b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:51.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.139+0000 7f6e4f7fe700 1 --2- 172.21.15.2:0/122413346 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e501572b0 0x7f6e50157730 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f6e38015040 tx=0x7f6e38001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:51.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.139+0000 7f6e4cff9700 1 -- 172.21.15.2:0/122413346 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e38003e40 con 0x7f6e501572b0 2023-11-26T07:17:51.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.139+0000 7f6e4cff9700 1 -- 172.21.15.2:0/122413346 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e38001290 con 0x7f6e501572b0 2023-11-26T07:17:51.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.139+0000 7f6e5628f700 1 -- 172.21.15.2:0/122413346 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e50152b60 con 0x7f6e501572b0 2023-11-26T07:17:51.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.139+0000 7f6e4cff9700 1 -- 172.21.15.2:0/122413346 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3801d6c0 con 0x7f6e501572b0 2023-11-26T07:17:51.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.139+0000 7f6e5628f700 1 -- 172.21.15.2:0/122413346 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e50152230 con 0x7f6e501572b0 2023-11-26T07:17:51.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.140+0000 7f6e5628f700 1 -- 172.21.15.2:0/122413346 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e50068670 con 0x7f6e501572b0 2023-11-26T07:17:51.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.141+0000 7f6e4cff9700 1 -- 172.21.15.2:0/122413346 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f6e38019040 con 0x7f6e501572b0 2023-11-26T07:17:51.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.141+0000 7f6e4cff9700 1 --2- 172.21.15.2:0/122413346 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6e3006b980 0x7f6e3006de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:51.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.141+0000 7f6e4cff9700 1 -- 172.21.15.2:0/122413346 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6e38088b10 con 0x7f6e501572b0 2023-11-26T07:17:51.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.141+0000 7f6e4ffff700 1 --2- 172.21.15.2:0/122413346 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6e3006b980 0x7f6e3006de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:51.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.142+0000 7f6e4ffff700 1 --2- 172.21.15.2:0/122413346 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6e3006b980 0x7f6e3006de40 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f6e50140510 tx=0x7f6e40008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:51.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.145+0000 7f6e4cff9700 1 -- 172.21.15.2:0/122413346 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6e38055790 con 0x7f6e501572b0 2023-11-26T07:17:51.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.348+0000 7f6e5628f700 1 -- 172.21.15.2:0/122413346 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e50072ad0 con 0x7f6e3006b980 2023-11-26T07:17:51.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.348+0000 7f6e4cff9700 1 -- 172.21.15.2:0/122413346 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6e40009950 con 0x7f6e3006b980 2023-11-26T07:17:51.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.350+0000 7f6e5628f700 1 -- 172.21.15.2:0/122413346 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6e3006b980 msgr2=0x7f6e3006de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:51.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.350+0000 7f6e5628f700 1 --2- 172.21.15.2:0/122413346 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6e3006b980 0x7f6e3006de40 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f6e50140510 tx=0x7f6e40008040 comp rx=0 tx=0).stop 2023-11-26T07:17:51.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.350+0000 7f6e5628f700 1 -- 172.21.15.2:0/122413346 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e501572b0 msgr2=0x7f6e50157730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:51.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.350+0000 7f6e5628f700 1 --2- 172.21.15.2:0/122413346 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e501572b0 0x7f6e50157730 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f6e38015040 tx=0x7f6e38001120 comp rx=0 tx=0).stop 2023-11-26T07:17:51.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.351+0000 7f6e5628f700 1 -- 172.21.15.2:0/122413346 shutdown_connections 2023-11-26T07:17:51.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.351+0000 7f6e5628f700 1 --2- 172.21.15.2:0/122413346 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f6e3006b980 0x7f6e3006de40 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:51.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.351+0000 7f6e5628f700 1 --2- 172.21.15.2:0/122413346 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6e50151870 0x7f6e50151cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:51.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.351+0000 7f6e5628f700 1 --2- 172.21.15.2:0/122413346 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e3c004850 0x7f6e500b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:51.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.351+0000 7f6e5628f700 1 --2- 172.21.15.2:0/122413346 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e501572b0 0x7f6e50157730 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:51.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.351+0000 7f6e5628f700 1 -- 172.21.15.2:0/122413346 >> 172.21.15.2:0/122413346 conn(0x7f6e500b2740 msgr2=0x7f6e50147680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:51.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.351+0000 7f6e5628f700 1 -- 172.21.15.2:0/122413346 shutdown_connections 2023-11-26T07:17:51.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.351+0000 7f6e5628f700 1 -- 172.21.15.2:0/122413346 wait complete. 2023-11-26T07:17:51.354 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 7 to deep-scrub 2023-11-26T07:17:51.365 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:17:51.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.489+0000 7f77eb8f5700 1 Processor -- start 2023-11-26T07:17:51.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.489+0000 7f77eb8f5700 1 -- start start 2023-11-26T07:17:51.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.490+0000 7f77eb8f5700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f77e40b0e90 0x7f77e406eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:51.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.490+0000 7f77eb8f5700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77e40d1230 con 0x7f77e415e1c0 2023-11-26T07:17:51.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.490+0000 7f77eb8f5700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77e40d0c70 con 0x7f77e406fc50 2023-11-26T07:17:51.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.490+0000 7f77eb8f5700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77e40d0f50 con 0x7f77e40b0e90 2023-11-26T07:17:51.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.490+0000 7f77e9691700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f77e415e1c0 0x7f77e406f540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36750/0 (socket says 172.21.15.2:36750) 2023-11-26T07:17:51.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.490+0000 7f77e9691700 1 -- 172.21.15.2:0/2092694861 learned_addr learned my addr 172.21.15.2:0/2092694861 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:17:51.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.490+0000 7f77e9e92700 1 --2- 172.21.15.2:0/2092694861 >> v2:172.21.15.192:3300/0 conn(0x7f77e40b0e90 0x7f77e406eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:51.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.490+0000 7f77dbfff700 1 -- 172.21.15.2:0/2092694861 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 713030683 0 0) 0x7f77e40d1230 con 0x7f77e415e1c0 2023-11-26T07:17:51.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.490+0000 7f77dbfff700 1 -- 172.21.15.2:0/2092694861 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77d00035b0 con 0x7f77e415e1c0 2023-11-26T07:17:51.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.490+0000 7f77dbfff700 1 -- 172.21.15.2:0/2092694861 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1125805788 0 0) 0x7f77d00035b0 con 0x7f77e415e1c0 2023-11-26T07:17:51.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.491+0000 7f77dbfff700 1 -- 172.21.15.2:0/2092694861 >> v2:172.21.15.192:3300/0 conn(0x7f77e40b0e90 msgr2=0x7f77e406eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:51.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.491+0000 7f77dbfff700 1 --2- 172.21.15.2:0/2092694861 >> v2:172.21.15.192:3300/0 conn(0x7f77e40b0e90 0x7f77e406eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:51.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.491+0000 7f77dbfff700 1 -- 172.21.15.2:0/2092694861 >> v1:172.21.15.192:6789/0 conn(0x7f77e406fc50 legacy=0x7f77e406ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:51.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.491+0000 7f77dbfff700 1 -- 172.21.15.2:0/2092694861 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e406c210 con 0x7f77e415e1c0 2023-11-26T07:17:51.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.491+0000 7f77dbfff700 1 -- 172.21.15.2:0/2092694861 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763045638 0 0) 0x7f77d4001670 con 0x7f77e415e1c0 2023-11-26T07:17:51.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.491+0000 7f77dbfff700 1 -- 172.21.15.2:0/2092694861 >> v1:172.21.15.2:6789/0 conn(0x7f77e415e1c0 legacy=0x7f77e406f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:51.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.491+0000 7f77dbfff700 1 --2- 172.21.15.2:0/2092694861 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77d0003a00 0x7f77d0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:51.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.491+0000 7f77dbfff700 1 --2- 172.21.15.2:0/2092694861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77d0004850 0x7f77d0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:51.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.491+0000 7f77dbfff700 1 --2- 172.21.15.2:0/2092694861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77d0005210 0x7f77d000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:51.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.491+0000 7f77dbfff700 1 -- 172.21.15.2:0/2092694861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e40d0f50 con 0x7f77d0004850 2023-11-26T07:17:51.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.491+0000 7f77dbfff700 1 -- 172.21.15.2:0/2092694861 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d000c1b0 con 0x7f77d0005210 2023-11-26T07:17:51.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.491+0000 7f77dbfff700 1 -- 172.21.15.2:0/2092694861 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d000c370 con 0x7f77d0003a00 2023-11-26T07:17:51.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.491+0000 7f77e8e90700 1 --2- 172.21.15.2:0/2092694861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77d0004850 0x7f77d0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:51.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.491+0000 7f77e9e92700 1 --2- 172.21.15.2:0/2092694861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77d0005210 0x7f77d000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:51.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.491+0000 7f77e9691700 1 --2- 172.21.15.2:0/2092694861 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77d0003a00 0x7f77d0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:51.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.491+0000 7f77e8e90700 1 -- 172.21.15.2:0/2092694861 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77d0003a00 msgr2=0x7f77d0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:51.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.491+0000 7f77e8e90700 1 --2- 172.21.15.2:0/2092694861 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77d0003a00 0x7f77d0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:51.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.491+0000 7f77e8e90700 1 -- 172.21.15.2:0/2092694861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77d0005210 msgr2=0x7f77d000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:51.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.491+0000 7f77e8e90700 1 --2- 172.21.15.2:0/2092694861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77d0005210 0x7f77d000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:51.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.491+0000 7f77e9e92700 1 -- 172.21.15.2:0/2092694861 reap_dead start 2023-11-26T07:17:51.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.491+0000 7f77e8e90700 1 -- 172.21.15.2:0/2092694861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d00035b0 con 0x7f77d0004850 2023-11-26T07:17:51.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.491+0000 7f77e9691700 1 --2- 172.21.15.2:0/2092694861 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77d0003a00 0x7f77d0003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:51.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.491+0000 7f77e8e90700 1 --2- 172.21.15.2:0/2092694861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77d0004850 0x7f77d0004cd0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f77e00017c0 tx=0x7f77d0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d34669a21a6c5b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:51.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.491+0000 7f77dbfff700 1 -- 172.21.15.2:0/2092694861 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e00052d0 con 0x7f77d0004850 2023-11-26T07:17:51.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.491+0000 7f77dbfff700 1 -- 172.21.15.2:0/2092694861 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e0005450 con 0x7f77d0004850 2023-11-26T07:17:51.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.491+0000 7f77dbfff700 1 -- 172.21.15.2:0/2092694861 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e00038c0 con 0x7f77d0004850 2023-11-26T07:17:51.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.492+0000 7f77eb8f5700 1 -- 172.21.15.2:0/2092694861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77d0004850 msgr2=0x7f77d0004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:51.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.492+0000 7f77eb8f5700 1 --2- 172.21.15.2:0/2092694861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77d0004850 0x7f77d0004cd0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f77e00017c0 tx=0x7f77d0005880 comp rx=0 tx=0).stop 2023-11-26T07:17:51.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.492+0000 7f77eb8f5700 1 -- 172.21.15.2:0/2092694861 shutdown_connections 2023-11-26T07:17:51.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.492+0000 7f77eb8f5700 1 --2- 172.21.15.2:0/2092694861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77d0004850 0x7f77d0004cd0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:51.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.492+0000 7f77eb8f5700 1 -- 172.21.15.2:0/2092694861 >> 172.21.15.2:0/2092694861 conn(0x7f77e40b3720 msgr2=0x7f77e40b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:51.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.492+0000 7f77eb8f5700 1 -- 172.21.15.2:0/2092694861 shutdown_connections 2023-11-26T07:17:51.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.492+0000 7f77eb8f5700 1 -- 172.21.15.2:0/2092694861 wait complete. 2023-11-26T07:17:51.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.493+0000 7f77eb8f5700 1 Processor -- start 2023-11-26T07:17:51.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.493+0000 7f77eb8f5700 1 -- start start 2023-11-26T07:17:51.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.494+0000 7f77eb8f5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77d0004850 0x7f77e40c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:51.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.494+0000 7f77eb8f5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77e41f7e60 0x7f77e414ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:51.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.494+0000 7f77eb8f5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77e40b72d0 0x7f77e41f72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:51.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.494+0000 7f77eb8f5700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e414f120 con 0x7f77e40b72d0 2023-11-26T07:17:51.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.494+0000 7f77eb8f5700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e4148880 con 0x7f77e41f7e60 2023-11-26T07:17:51.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.494+0000 7f77eb8f5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e415e8c0 con 0x7f77d0004850 2023-11-26T07:17:51.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.494+0000 7f77e9e92700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77e40b72d0 0x7f77e41f72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:51.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.494+0000 7f77e9e92700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77e40b72d0 0x7f77e41f72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45556/0 (socket says 172.21.15.2:45556) 2023-11-26T07:17:51.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.494+0000 7f77e9e92700 1 -- 172.21.15.2:0/2508611688 learned_addr learned my addr 172.21.15.2:0/2508611688 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:17:51.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.495+0000 7f77e8e90700 1 --2- 172.21.15.2:0/2508611688 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77e41f7e60 0x7f77e414ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:51.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.495+0000 7f77e9e92700 1 -- 172.21.15.2:0/2508611688 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77d0004850 msgr2=0x7f77e40c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:51.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.495+0000 7f77e9691700 1 --2- 172.21.15.2:0/2508611688 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77d0004850 0x7f77e40c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:51.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.495+0000 7f77e9e92700 1 --2- 172.21.15.2:0/2508611688 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77d0004850 0x7f77e40c8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:51.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.495+0000 7f77e9e92700 1 -- 172.21.15.2:0/2508611688 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77e41f7e60 msgr2=0x7f77e414ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:51.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.495+0000 7f77e9e92700 1 --2- 172.21.15.2:0/2508611688 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77e41f7e60 0x7f77e414ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:51.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.495+0000 7f77e9e92700 1 -- 172.21.15.2:0/2508611688 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e415eba0 con 0x7f77e40b72d0 2023-11-26T07:17:51.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.495+0000 7f77e9691700 1 --2- 172.21.15.2:0/2508611688 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77d0004850 0x7f77e40c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:51.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.495+0000 7f77e8e90700 1 --2- 172.21.15.2:0/2508611688 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77e41f7e60 0x7f77e414ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:51.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.495+0000 7f77e9e92700 1 --2- 172.21.15.2:0/2508611688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77e40b72d0 0x7f77e41f72a0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f77e4072010 tx=0x7f77dc011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:51.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.495+0000 7f77d9ffb700 1 -- 172.21.15.2:0/2508611688 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77dc00e040 con 0x7f77e40b72d0 2023-11-26T07:17:51.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.495+0000 7f77d9ffb700 1 -- 172.21.15.2:0/2508611688 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77dc00f040 con 0x7f77e40b72d0 2023-11-26T07:17:51.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.495+0000 7f77eb8f5700 1 -- 172.21.15.2:0/2508611688 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77e40b67f0 con 0x7f77e40b72d0 2023-11-26T07:17:51.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.495+0000 7f77d9ffb700 1 -- 172.21.15.2:0/2508611688 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77dc00f9a0 con 0x7f77e40b72d0 2023-11-26T07:17:51.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.495+0000 7f77eb8f5700 1 -- 172.21.15.2:0/2508611688 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e40b6db0 con 0x7f77e40b72d0 2023-11-26T07:17:51.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.496+0000 7f77eb8f5700 1 -- 172.21.15.2:0/2508611688 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77e415d5d0 con 0x7f77e40b72d0 2023-11-26T07:17:51.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.497+0000 7f77d9ffb700 1 -- 172.21.15.2:0/2508611688 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f77dc00fb00 con 0x7f77e40b72d0 2023-11-26T07:17:51.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.497+0000 7f77d9ffb700 1 --2- 172.21.15.2:0/2508611688 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f77c806b980 0x7f77c806de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:51.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.497+0000 7f77d9ffb700 1 -- 172.21.15.2:0/2508611688 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f77dc0887c0 con 0x7f77e40b72d0 2023-11-26T07:17:51.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.497+0000 7f77e9691700 1 --2- 172.21.15.2:0/2508611688 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f77c806b980 0x7f77c806de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:51.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.498+0000 7f77e9691700 1 --2- 172.21.15.2:0/2508611688 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f77c806b980 0x7f77c806de40 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f77d4001c90 tx=0x7f77d4000ed0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:51.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.502+0000 7f77d9ffb700 1 -- 172.21.15.2:0/2508611688 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f77dc055320 con 0x7f77e40b72d0 2023-11-26T07:17:51.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.697+0000 7f77eb8f5700 1 -- 172.21.15.2:0/2508611688 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f77e40d0920 con 0x7f77c806b980 2023-11-26T07:17:51.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.699+0000 7f77d9ffb700 1 -- 172.21.15.2:0/2508611688 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50608 (secure 0 0 0) 0x7f77d400f5b0 con 0x7f77c806b980 2023-11-26T07:17:51.702 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:17:51.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.702+0000 7f77eb8f5700 1 -- 172.21.15.2:0/2508611688 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f77c806b980 msgr2=0x7f77c806de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:51.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.702+0000 7f77eb8f5700 1 --2- 172.21.15.2:0/2508611688 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f77c806b980 0x7f77c806de40 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f77d4001c90 tx=0x7f77d4000ed0 comp rx=0 tx=0).stop 2023-11-26T07:17:51.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.702+0000 7f77eb8f5700 1 -- 172.21.15.2:0/2508611688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77e40b72d0 msgr2=0x7f77e41f72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:51.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.702+0000 7f77eb8f5700 1 --2- 172.21.15.2:0/2508611688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77e40b72d0 0x7f77e41f72a0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f77e4072010 tx=0x7f77dc011f80 comp rx=0 tx=0).stop 2023-11-26T07:17:51.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.702+0000 7f77eb8f5700 1 -- 172.21.15.2:0/2508611688 shutdown_connections 2023-11-26T07:17:51.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.702+0000 7f77eb8f5700 1 --2- 172.21.15.2:0/2508611688 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f77c806b980 0x7f77c806de40 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:51.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.702+0000 7f77eb8f5700 1 --2- 172.21.15.2:0/2508611688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77e40b72d0 0x7f77e41f72a0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:51.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.702+0000 7f77eb8f5700 1 --2- 172.21.15.2:0/2508611688 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77d0004850 0x7f77e40c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:51.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.702+0000 7f77eb8f5700 1 --2- 172.21.15.2:0/2508611688 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77e41f7e60 0x7f77e414ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:51.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.702+0000 7f77eb8f5700 1 -- 172.21.15.2:0/2508611688 >> 172.21.15.2:0/2508611688 conn(0x7f77e40b3720 msgr2=0x7f77e40b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:51.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.702+0000 7f77eb8f5700 1 -- 172.21.15.2:0/2508611688 shutdown_connections 2023-11-26T07:17:51.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:17:51.702+0000 7f77eb8f5700 1 -- 172.21.15.2:0/2508611688 wait complete. 2023-11-26T07:17:51.706 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-26T07:17:51.716 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":263,"stamp":"2023-11-26T07:17:50.249368+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":262264,"kb_used_data":8648,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754712456,"statfs":{"total":773094113280,"available":772825554944,"internally_reserved":0,"allocated":8855552,"data_stored":4440616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-419430941,"num_objects":-404,"num_object_clones":-1,"num_object_copies":-808,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-404,"num_whiteouts":-1,"num_read":-206,"num_read_kb":-204806,"num_write":-408,"num_write_kb":-409605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-7,"num_bytes_recovered":-7340032,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001974"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":217,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-26T07:17:39.385054+0000","last_change":"2023-11-26T07:11:29.855919+0000","last_active":"2023-11-26T07:17:39.385054+0000","last_peered":"2023-11-26T07:17:39.385054+0000","last_clean":"2023-11-26T07:17:39.385054+0000","last_became_active":"2023-11-26T07:11:29.854903+0000","last_became_peered":"2023-11-26T07:11:29.854903+0000","last_unstale":"2023-11-26T07:17:39.385054+0000","last_undegraded":"2023-11-26T07:17:39.385054+0000","last_fullsized":"2023-11-26T07:17:39.385054+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:11:28.594252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:11:28.594252+0000","last_clean_scrub_stamp":"2023-11-26T07:11:28.594252+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:33:34.642696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574929,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32704,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339136,"statfs":{"total":96636764160,"available":96603275264,"internally_reserved":0,"allocated":1552384,"data_stored":997853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.52000000000000002,"15min":0.53000000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.68200000000000005,"5min":0.73699999999999999,"15min":1.4139999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.53900000000000003,"15min":0.51400000000000001},"min":{"1min":0.34699999999999998,"5min":0.313,"15min":0.313},"max":{"1min":2.8690000000000002,"5min":2.8690000000000002,"15min":2.8690000000000002},"last":0.85099999999999998}]},{"osd":1,"last update":"Sun Nov 26 07:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.54500000000000004,"15min":0.879},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":9.5600000000000005},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.56499999999999995,"15min":0.57899999999999996},"min":{"1min":0.40600000000000003,"5min":0.372,"15min":0.372},"max":{"1min":2.9289999999999998,"5min":2.9289999999999998,"15min":2.9289999999999998},"last":0.72099999999999997}]},{"osd":2,"last update":"Sun Nov 26 07:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.57199999999999995,"15min":0.59399999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34200000000000003},"max":{"1min":0.871,"5min":1.3979999999999999,"15min":1.569},"last":0.871},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.62,"15min":0.64300000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":2.8969999999999998,"5min":2.8969999999999998,"15min":2.8969999999999998},"last":0.83799999999999997}]},{"osd":3,"last update":"Sun Nov 26 07:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54800000000000004,"15min":0.58799999999999997},"min":{"1min":0.36499999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.75600000000000001,"5min":1.494,"15min":1.6639999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58799999999999997,"15min":0.56999999999999995},"min":{"1min":0.45700000000000002,"5min":0.42899999999999999,"15min":0.36399999999999999},"max":{"1min":0.753,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.74299999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.504,"15min":0.51600000000000001},"min":{"1min":0.33000000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.71499999999999997,"5min":0.73699999999999999,"15min":0.85899999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.58299999999999996,"15min":0.53100000000000003},"min":{"1min":0.39300000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":4.9109999999999996,"5min":4.9109999999999996,"15min":4.9109999999999996},"last":0.621}]},{"osd":5,"last update":"Sun Nov 26 07:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55600000000000005,"15min":0.53500000000000003},"min":{"1min":0.35299999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.86899999999999999,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.62,"5min":0.61099999999999999,"15min":0.627},"min":{"1min":0.46000000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77000000000000002,"5min":0.83199999999999996,"15min":0.89800000000000002},"last":0.77000000000000002}]},{"osd":6,"last update":"Sun Nov 26 07:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.746,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59499999999999997,"15min":0.59099999999999997},"min":{"1min":0.41999999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.77700000000000002,"5min":1.552,"15min":1.552},"last":0.70299999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574929,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339720,"statfs":{"total":96636764160,"available":96603873280,"internally_reserved":0,"allocated":958464,"data_stored":407485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52500000000000002,"15min":0.49099999999999999},"min":{"1min":0.312,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.73599999999999999,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.621,"5min":0.56899999999999995,"15min":0.498},"min":{"1min":0.34799999999999998,"5min":0.33400000000000002,"15min":0.317},"max":{"1min":2.1000000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":0.71099999999999997}]},{"osd":1,"last update":"Sun Nov 26 07:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54000000000000004,"15min":0.51700000000000002},"min":{"1min":0.33800000000000002,"5min":0.315,"15min":0.315},"max":{"1min":1.079,"5min":1.079,"15min":1.1080000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54400000000000004,"15min":0.54200000000000004},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.78500000000000003,"5min":0.83599999999999997,"15min":1.198},"last":0.65800000000000003}]},{"osd":2,"last update":"Sun Nov 26 07:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.56499999999999995,"15min":0.51100000000000001},"min":{"1min":0.375,"5min":0.307,"15min":0.307},"max":{"1min":2.2210000000000001,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57999999999999996,"15min":0.53400000000000003},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.69899999999999995}]},{"osd":3,"last update":"Sun Nov 26 07:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61099999999999999,"15min":0.56299999999999994},"min":{"1min":0.41999999999999998,"5min":0.40999999999999998,"15min":0.373},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.64200000000000002,"15min":0.59699999999999998},"min":{"1min":0.45100000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":0.752}]},{"osd":4,"last update":"Sun Nov 26 07:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48899999999999999,"15min":0.51900000000000002},"min":{"1min":0.32200000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.58699999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56100000000000005,"15min":0.56699999999999995},"min":{"1min":0.375,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.44700000000000001}]},{"osd":5,"last update":"Sun Nov 26 07:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55700000000000005,"15min":0.55800000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.57399999999999995,"15min":0.58399999999999996},"min":{"1min":0.38500000000000001,"5min":0.311,"15min":0.311},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.49199999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.59999999999999998,"15min":0.59399999999999997},"min":{"1min":0.371,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":2.1499999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61799999999999999,"15min":0.622},"min":{"1min":0.39700000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.56299999999999994}]}]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36276,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335564,"statfs":{"total":96636764160,"available":96599617536,"internally_reserved":0,"allocated":958464,"data_stored":407485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33800000000000002,"15min":0.35799999999999998},"min":{"1min":0.23300000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.47899999999999998,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35999999999999999,"15min":0.72599999999999998},"min":{"1min":0.26800000000000002,"5min":0.214,"15min":0.214},"max":{"1min":0.45200000000000001,"5min":0.60399999999999998,"15min":11.922000000000001},"last":0.40999999999999998}]},{"osd":2,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.33500000000000002,"15min":0.36399999999999999},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.47899999999999998,"5min":0.66500000000000004,"15min":0.80300000000000005},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.39400000000000002,"15min":0.40500000000000003},"min":{"1min":0.28399999999999997,"5min":0.254,"15min":0.254},"max":{"1min":0.54300000000000004,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.51400000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.436,"15min":0.45400000000000001},"min":{"1min":0.31,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.623,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.41199999999999998,"15min":0.434},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.56799999999999995,"5min":0.62,"15min":1.101},"last":0.52900000000000003}]},{"osd":4,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.60899999999999999,"15min":0.82099999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.73599999999999999,"5min":0.97299999999999998,"15min":6.8979999999999997},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64400000000000002,"15min":0.66000000000000003},"min":{"1min":0.42999999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.77100000000000002,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.68999999999999995}]},{"osd":5,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.61099999999999999,"15min":0.624},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78500000000000003,"5min":1.2090000000000001,"15min":1.3160000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60099999999999998,"15min":0.82299999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.73799999999999999,"5min":1.087,"15min":6.9480000000000004},"last":0.76400000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.624,"15min":0.65300000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.72799999999999998,"5min":0.93100000000000005,"15min":1.194},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.61299999999999999,"15min":0.84699999999999998},"min":{"1min":0.41199999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.77800000000000002,"5min":1.222,"15min":6.9800000000000004},"last":0.72899999999999998}]},{"osd":7,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.66700000000000004,"15min":0.66300000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.75600000000000001,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.62,"5min":0.66700000000000004,"15min":0.68300000000000005},"min":{"1min":0.48299999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.754,"5min":3.548,"15min":3.548},"last":0.74399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574927,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32696,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339144,"statfs":{"total":96636764160,"available":96603283456,"internally_reserved":0,"allocated":1552384,"data_stored":997853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.36099999999999999},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.46700000000000003,"5min":0.52600000000000002,"15min":1.5820000000000001},"last":0.435},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.35699999999999998,"15min":0.745},"min":{"1min":0.28199999999999997,"5min":0.216,"15min":0.216},"max":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":11.987},"last":0.48499999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35899999999999999,"15min":0.41899999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.48299999999999998,"5min":0.57099999999999995,"15min":1.607},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38200000000000001,"15min":0.40799999999999997},"min":{"1min":0.27800000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.55200000000000005,"5min":0.64900000000000002,"15min":0.89600000000000002},"last":0.51900000000000002}]},{"osd":3,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36299999999999999,"15min":0.38300000000000001},"min":{"1min":0.26500000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.49099999999999999,"5min":0.58899999999999997,"15min":0.752},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41199999999999998,"15min":0.46000000000000002},"min":{"1min":0.32400000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.57199999999999995,"5min":0.71699999999999997,"15min":1.6339999999999999},"last":0.55000000000000004}]},{"osd":4,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.59199999999999997,"15min":0.64200000000000002},"min":{"1min":0.36699999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.92600000000000005},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59699999999999998,"15min":0.83299999999999996},"min":{"1min":0.39900000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.81499999999999995,"5min":0.82199999999999995,"15min":6.5279999999999996},"last":0.86499999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59499999999999997,"15min":0.63800000000000001},"min":{"1min":0.42999999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83599999999999997,"5min":0.878,"15min":1.1000000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.625,"15min":0.68100000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83499999999999996,"5min":0.88400000000000001,"15min":1.508},"last":0.91400000000000003}]},{"osd":6,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.624,"15min":0.86799999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.88700000000000001,"5min":0.93400000000000005,"15min":6.5419999999999998},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61099999999999999,"15min":0.66300000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.82099999999999995,"5min":0.84399999999999997,"15min":1.3759999999999999},"last":0.72599999999999998}]},{"osd":7,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.68600000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.878,"5min":0.91000000000000003,"15min":1.1180000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.61899999999999999,"15min":0.65500000000000003},"min":{"1min":0.51900000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77400000000000002,"5min":0.872,"15min":1.155},"last":0.76800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32116,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":958464,"data_stored":407485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.33300000000000002,"15min":0.34399999999999997},"min":{"1min":0.20999999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.45500000000000002,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.38600000000000001,"15min":0.39600000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.499,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.34200000000000003}]},{"osd":1,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.33300000000000002,"15min":0.34499999999999997},"min":{"1min":0.23799999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.39900000000000002,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.372,"15min":0.376},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.54800000000000004,"5min":0.58999999999999997,"15min":0.59599999999999997},"last":0.40500000000000003}]},{"osd":3,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.38200000000000001,"15min":0.40600000000000003},"min":{"1min":0.29199999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.47999999999999998,"5min":0.59699999999999998,"15min":0.64700000000000002},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.375,"15min":0.38300000000000001},"min":{"1min":0.26700000000000002,"5min":0.224,"15min":0.224},"max":{"1min":0.56599999999999995,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.32200000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.39600000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.86499999999999999,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58299999999999996},"min":{"1min":0.44,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.47199999999999998}]},{"osd":5,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59199999999999997,"15min":0.57999999999999996},"min":{"1min":0.45300000000000001,"5min":0.39500000000000002,"15min":0.36899999999999999},"max":{"1min":0.85099999999999998,"5min":0.87,"15min":0.87},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59099999999999997,"15min":0.623},"min":{"1min":0.41999999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78200000000000003,"5min":0.86299999999999999,"15min":1.002},"last":0.44600000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.61699999999999999,"15min":0.61399999999999999},"min":{"1min":0.432,"5min":0.40999999999999998,"15min":0.38800000000000001},"max":{"1min":0.75700000000000001,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.629,"15min":0.63500000000000001},"min":{"1min":0.48999999999999999,"5min":0.44400000000000001,"15min":0.439},"max":{"1min":0.91700000000000004,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.50800000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61099999999999999,"15min":0.626},"min":{"1min":0.44,"5min":0.41999999999999998,"15min":0.40600000000000003},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.621,"15min":0.623},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85199999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.499}]}]},{"osd":3,"up_from":13,"seq":55834574928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32116,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":958464,"data_stored":407485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.32900000000000001,"15min":0.36099999999999999},"min":{"1min":0.23300000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":1.3500000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35899999999999999,"15min":0.40699999999999997},"min":{"1min":0.25900000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.54900000000000004,"5min":0.61299999999999999,"15min":1.6619999999999999},"last":0.52200000000000002}]},{"osd":1,"last update":"Sun Nov 26 07:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.33800000000000002,"15min":0.39100000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.41599999999999998,"5min":0.58799999999999997,"15min":1.2010000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.38700000000000001,"15min":0.48299999999999998},"min":{"1min":0.30499999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.56599999999999995,"5min":0.629,"15min":2.903},"last":0.47899999999999998}]},{"osd":2,"last update":"Sun Nov 26 07:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.375,"15min":0.39800000000000002},"min":{"1min":0.26100000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.52000000000000002,"5min":0.57399999999999995,"15min":1.1240000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.39300000000000002,"15min":0.41399999999999998},"min":{"1min":0.28799999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.51900000000000002,"5min":0.63700000000000001,"15min":1.2290000000000001},"last":0.59999999999999998}]},{"osd":4,"last update":"Sun Nov 26 07:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.60799999999999998,"15min":0.69199999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.82699999999999996,"5min":0.96799999999999997,"15min":2.9609999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60899999999999999,"15min":0.63600000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.85899999999999999,"5min":1.1499999999999999,"15min":1.163},"last":0.89600000000000002}]},{"osd":5,"last update":"Sun Nov 26 07:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.621,"15min":0.66300000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.88800000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.624,"15min":0.65800000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.877,"5min":0.93999999999999995,"15min":1.2829999999999999},"last":0.77600000000000002}]},{"osd":6,"last update":"Sun Nov 26 07:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.64300000000000002,"15min":0.67100000000000004},"min":{"1min":0.39400000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":2.6040000000000001,"5min":2.6040000000000001,"15min":2.6040000000000001},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.63800000000000001,"15min":0.67400000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.258},"last":0.80600000000000005}]},{"osd":7,"last update":"Sun Nov 26 07:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63200000000000001,"15min":0.67600000000000005},"min":{"1min":0.438,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.875,"5min":1.014,"15min":1.3069999999999999},"last":0.745},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.65300000000000002,"15min":0.73699999999999999},"min":{"1min":0.44800000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90100000000000002,"5min":1.0780000000000001,"15min":2.9969999999999999},"last":0.79300000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32116,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":958464,"data_stored":407485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.55100000000000005,"15min":0.85099999999999998},"min":{"1min":0.32900000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.68899999999999995,"5min":0.87,"15min":8.7539999999999996},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59199999999999997,"15min":0.875},"min":{"1min":0.35299999999999998,"5min":0.316,"15min":0.316},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":8.7390000000000008},"last":0.625}]},{"osd":1,"last update":"Sun Nov 26 07:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.56100000000000005,"15min":0.89300000000000002},"min":{"1min":0.32700000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.68300000000000005,"5min":0.81200000000000006,"15min":9.7720000000000002},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.55000000000000004,"15min":0.56399999999999995},"min":{"1min":0.33600000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.72899999999999998,"5min":0.80000000000000004,"15min":0.88700000000000001},"last":0.55900000000000005}]},{"osd":2,"last update":"Sun Nov 26 07:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54100000000000004,"15min":0.85099999999999998},"min":{"1min":0.39900000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.78600000000000003,"5min":0.80100000000000005,"15min":9.8119999999999994},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58599999999999997,"15min":0.78300000000000003},"min":{"1min":0.36899999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67600000000000005,"5min":0.85499999999999998,"15min":3.645},"last":0.60399999999999998}]},{"osd":3,"last update":"Sun Nov 26 07:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59599999999999997,"15min":0.89800000000000002},"min":{"1min":0.41899999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.69999999999999996,"5min":0.81299999999999994,"15min":8.8089999999999993},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.59799999999999998,"15min":0.60199999999999998},"min":{"1min":0.371,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82099999999999995,"5min":0.83899999999999997,"15min":1.0720000000000001},"last":0.59099999999999997}]},{"osd":5,"last update":"Sun Nov 26 07:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55600000000000005,"15min":0.51600000000000001},"min":{"1min":0.32800000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72099999999999997,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55900000000000005,"15min":0.55300000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.50900000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.58499999999999996},"min":{"1min":0.375,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.78800000000000003,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56399999999999995,"15min":0.57199999999999995},"min":{"1min":0.36199999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.41299999999999998}]},{"osd":7,"last update":"Sun Nov 26 07:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60599999999999998,"15min":0.59799999999999998},"min":{"1min":0.41299999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61699999999999999,"15min":0.60799999999999998},"min":{"1min":0.40899999999999997,"5min":0.38300000000000001,"15min":0.38200000000000001},"max":{"1min":0.89500000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.48999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574929,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339720,"statfs":{"total":96636764160,"available":96603873280,"internally_reserved":0,"allocated":958464,"data_stored":407485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.58599999999999997,"15min":0.54000000000000004},"min":{"1min":0.40200000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.65300000000000002,"5min":7.1500000000000004,"15min":7.1500000000000004},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.58999999999999997,"15min":0.56999999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78500000000000003,"5min":6.8470000000000004,"15min":6.8470000000000004},"last":0.38}]},{"osd":1,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.58299999999999996,"15min":0.55500000000000005},"min":{"1min":0.32300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69599999999999995,"5min":7.1269999999999998,"15min":7.1269999999999998},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73499999999999999,"5min":1.514,"15min":1.514},"last":0.36799999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.63200000000000001,"15min":0.59399999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.71499999999999997,"5min":7.2000000000000002,"15min":7.2000000000000002},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.65500000000000003,"15min":0.61799999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73699999999999999,"5min":7.8259999999999996,"15min":7.8259999999999996},"last":0.45500000000000002}]},{"osd":3,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.59899999999999998,"15min":0.57099999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79800000000000004,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.432},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.65000000000000002,"15min":0.60799999999999998},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72899999999999998,"5min":6.9240000000000004,"15min":6.9240000000000004},"last":0.51400000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.56799999999999995,"15min":0.51400000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.68700000000000006,"5min":7.2830000000000004,"15min":7.2830000000000004},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.83399999999999996,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.46700000000000003}]},{"osd":6,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.61899999999999999,"15min":0.57099999999999995},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.75600000000000001,"5min":6.8890000000000002,"15min":6.8890000000000002},"last":0.443},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.63,"15min":0.58899999999999997},"min":{"1min":0.40300000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.72899999999999998,"5min":7.2430000000000003,"15min":7.2430000000000003},"last":0.41099999999999998}]},{"osd":7,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.65900000000000003,"15min":0.60899999999999999},"min":{"1min":0.41299999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.86699999999999999,"5min":6.9880000000000004,"15min":6.9880000000000004},"last":0.503},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.72399999999999998,"15min":0.65600000000000003},"min":{"1min":0.40300000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.77100000000000002,"5min":11.874000000000001,"15min":11.874000000000001},"last":0.47899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:17:51.720 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-26T07:11:28.594252+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=26, tm_hour=7, tm_min=11, tm_sec=28, tm_wday=6, tm_yday=330, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=26, tm_hour=7, tm_min=17, tm_sec=46, tm_wday=6, tm_yday=330, tm_isdst=0) 2023-11-26T07:17:51.721 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-26T07:18:08.659 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:18:08.663 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:18:11.722 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:18:11.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.861+0000 7f1132495700 1 Processor -- start 2023-11-26T07:18:11.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.861+0000 7f1132495700 1 -- start start 2023-11-26T07:18:11.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.862+0000 7f1132495700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f112c1617a0 0x7f112c0d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.862+0000 7f1132495700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f112c0ce9b0 0x7f112c0d2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.862+0000 7f1132495700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f112c0d4930 con 0x7f112c161d20 2023-11-26T07:18:11.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.862+0000 7f1132495700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f112c0d4c10 con 0x7f112c1617a0 2023-11-26T07:18:11.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.862+0000 7f1132495700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f112c0d19e0 con 0x7f112c0ce9b0 2023-11-26T07:18:11.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.862+0000 7f1130a32700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f112c161d20 0x7f112c1621b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36770/0 (socket says 172.21.15.2:36770) 2023-11-26T07:18:11.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.862+0000 7f1130a32700 1 -- 172.21.15.2:0/3822342114 learned_addr learned my addr 172.21.15.2:0/3822342114 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:18:11.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.862+0000 7f112bfff700 1 --2- 172.21.15.2:0/3822342114 >> v2:172.21.15.2:3300/0 conn(0x7f112c1617a0 0x7f112c0d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.863+0000 7f112b7fe700 1 --2- 172.21.15.2:0/3822342114 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f112c0ce9b0 0x7f112c0d2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.863+0000 7f112bfff700 1 -- 172.21.15.2:0/3822342114 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f112c0ce9b0 msgr2=0x7f112c0d2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:11.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.863+0000 7f112bfff700 1 --2- 172.21.15.2:0/3822342114 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f112c0ce9b0 0x7f112c0d2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.863+0000 7f112bfff700 1 -- 172.21.15.2:0/3822342114 >> v1:172.21.15.2:6789/0 conn(0x7f112c161d20 legacy=0x7f112c1621b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.863+0000 7f112bfff700 1 -- 172.21.15.2:0/3822342114 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f112c0d1cc0 con 0x7f112c1617a0 2023-11-26T07:18:11.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.863+0000 7f112affd700 1 -- 172.21.15.2:0/3822342114 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3515075375 0 0) 0x7f112c0d4930 con 0x7f112c161d20 2023-11-26T07:18:11.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.863+0000 7f112b7fe700 1 --2- 172.21.15.2:0/3822342114 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f112c0ce9b0 0x7f112c0d2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:11.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.863+0000 7f112bfff700 1 --2- 172.21.15.2:0/3822342114 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f112c1617a0 0x7f112c0d23f0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f111c009840 tx=0x7f111c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84f2ae2f1d4aba80 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:11.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.863+0000 7f112affd700 1 -- 172.21.15.2:0/3822342114 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111c011830 con 0x7f112c1617a0 2023-11-26T07:18:11.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.863+0000 7f112affd700 1 -- 172.21.15.2:0/3822342114 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f111c011990 con 0x7f112c1617a0 2023-11-26T07:18:11.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.863+0000 7f112affd700 1 -- 172.21.15.2:0/3822342114 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111c011d20 con 0x7f112c1617a0 2023-11-26T07:18:11.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.864+0000 7f1132495700 1 -- 172.21.15.2:0/3822342114 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f112c1617a0 msgr2=0x7f112c0d23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.864+0000 7f1132495700 1 --2- 172.21.15.2:0/3822342114 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f112c1617a0 0x7f112c0d23f0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f111c009840 tx=0x7f111c009b50 comp rx=0 tx=0).stop 2023-11-26T07:18:11.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.864+0000 7f1132495700 1 -- 172.21.15.2:0/3822342114 shutdown_connections 2023-11-26T07:18:11.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.864+0000 7f1132495700 1 --2- 172.21.15.2:0/3822342114 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f112c1617a0 0x7f112c0d23f0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.864+0000 7f1132495700 1 --2- 172.21.15.2:0/3822342114 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f112c0ce9b0 0x7f112c0d2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.864+0000 7f1132495700 1 -- 172.21.15.2:0/3822342114 >> 172.21.15.2:0/3822342114 conn(0x7f112c0d3e10 msgr2=0x7f112c0d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:11.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.864+0000 7f1132495700 1 -- 172.21.15.2:0/3822342114 shutdown_connections 2023-11-26T07:18:11.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.864+0000 7f1132495700 1 -- 172.21.15.2:0/3822342114 wait complete. 2023-11-26T07:18:11.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.866+0000 7f1132495700 1 Processor -- start 2023-11-26T07:18:11.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.866+0000 7f1132495700 1 -- start start 2023-11-26T07:18:11.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.867+0000 7f1132495700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f112c0ce9b0 0x7f112c156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.867+0000 7f1132495700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f112c1617a0 0x7f112c0c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.867+0000 7f1132495700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f112c161d20 0x7f112c0ca190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.867+0000 7f1132495700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112c0c8870 con 0x7f112c1617a0 2023-11-26T07:18:11.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.867+0000 7f1132495700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112c0c8b50 con 0x7f112c161d20 2023-11-26T07:18:11.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.867+0000 7f1132495700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f112c0c8e30 con 0x7f112c0ce9b0 2023-11-26T07:18:11.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.867+0000 7f112b7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f112c1617a0 0x7f112c0c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.867+0000 7f112b7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f112c1617a0 0x7f112c0c9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45566/0 (socket says 172.21.15.2:45566) 2023-11-26T07:18:11.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.867+0000 7f112b7fe700 1 -- 172.21.15.2:0/2790391232 learned_addr learned my addr 172.21.15.2:0/2790391232 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:18:11.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.867+0000 7f112bfff700 1 --2- 172.21.15.2:0/2790391232 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f112c0ce9b0 0x7f112c156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.867+0000 7f1130a32700 1 --2- 172.21.15.2:0/2790391232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f112c161d20 0x7f112c0ca190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.867+0000 7f112b7fe700 1 -- 172.21.15.2:0/2790391232 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f112c0ce9b0 msgr2=0x7f112c156560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.867+0000 7f112b7fe700 1 --2- 172.21.15.2:0/2790391232 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f112c0ce9b0 0x7f112c156560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.867+0000 7f112b7fe700 1 -- 172.21.15.2:0/2790391232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f112c161d20 msgr2=0x7f112c0ca190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.867+0000 7f112b7fe700 1 --2- 172.21.15.2:0/2790391232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f112c161d20 0x7f112c0ca190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.867+0000 7f112b7fe700 1 -- 172.21.15.2:0/2790391232 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f111c0094a0 con 0x7f112c1617a0 2023-11-26T07:18:11.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.867+0000 7f1130a32700 1 --2- 172.21.15.2:0/2790391232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f112c161d20 0x7f112c0ca190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:11.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.867+0000 7f112b7fe700 1 --2- 172.21.15.2:0/2790391232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f112c1617a0 0x7f112c0c9c50 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f112000e760 tx=0x7f112000ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:11.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.867+0000 7f1128ff9700 1 -- 172.21.15.2:0/2790391232 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1120013610 con 0x7f112c1617a0 2023-11-26T07:18:11.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.867+0000 7f1128ff9700 1 -- 172.21.15.2:0/2790391232 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1120013770 con 0x7f112c1617a0 2023-11-26T07:18:11.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.867+0000 7f1132495700 1 -- 172.21.15.2:0/2790391232 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f112c0c9110 con 0x7f112c1617a0 2023-11-26T07:18:11.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.867+0000 7f1128ff9700 1 -- 172.21.15.2:0/2790391232 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1120013b20 con 0x7f112c1617a0 2023-11-26T07:18:11.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.868+0000 7f1132495700 1 -- 172.21.15.2:0/2790391232 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f112c0c7ce0 con 0x7f112c1617a0 2023-11-26T07:18:11.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.869+0000 7f1132495700 1 -- 172.21.15.2:0/2790391232 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f112c0678e0 con 0x7f112c1617a0 2023-11-26T07:18:11.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.869+0000 7f1128ff9700 1 -- 172.21.15.2:0/2790391232 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f1120013c80 con 0x7f112c1617a0 2023-11-26T07:18:11.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.869+0000 7f1128ff9700 1 --2- 172.21.15.2:0/2790391232 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f111806b980 0x7f111806de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.870+0000 7f1128ff9700 1 -- 172.21.15.2:0/2790391232 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1120087a40 con 0x7f112c1617a0 2023-11-26T07:18:11.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.870+0000 7f112bfff700 1 --2- 172.21.15.2:0/2790391232 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f111806b980 0x7f111806de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.870+0000 7f112bfff700 1 --2- 172.21.15.2:0/2790391232 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f111806b980 0x7f111806de40 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f111c0090b0 tx=0x7f111c01c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:11.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:11.874+0000 7f1128ff9700 1 -- 172.21.15.2:0/2790391232 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f11200545a0 con 0x7f112c1617a0 2023-11-26T07:18:12.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.070+0000 7f1132495700 1 -- 172.21.15.2:0/2790391232 --> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f112c0c8cc0 con 0x7f111806b980 2023-11-26T07:18:12.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.072+0000 7f1128ff9700 1 -- 172.21.15.2:0/2790391232 <== mgr.4106 v2:172.21.15.192:6832/1147935632 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50559 (secure 0 0 0) 0x7f112c0c8cc0 con 0x7f111806b980 2023-11-26T07:18:12.075 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:18:12.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.075+0000 7f1132495700 1 -- 172.21.15.2:0/2790391232 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f111806b980 msgr2=0x7f111806de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.075+0000 7f1132495700 1 --2- 172.21.15.2:0/2790391232 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f111806b980 0x7f111806de40 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f111c0090b0 tx=0x7f111c01c040 comp rx=0 tx=0).stop 2023-11-26T07:18:12.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.075+0000 7f1132495700 1 -- 172.21.15.2:0/2790391232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f112c1617a0 msgr2=0x7f112c0c9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.075+0000 7f1132495700 1 --2- 172.21.15.2:0/2790391232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f112c1617a0 0x7f112c0c9c50 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f112000e760 tx=0x7f112000ea70 comp rx=0 tx=0).stop 2023-11-26T07:18:12.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.075+0000 7f1132495700 1 -- 172.21.15.2:0/2790391232 shutdown_connections 2023-11-26T07:18:12.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.075+0000 7f1132495700 1 --2- 172.21.15.2:0/2790391232 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f111806b980 0x7f111806de40 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.075+0000 7f1132495700 1 --2- 172.21.15.2:0/2790391232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f112c161d20 0x7f112c0ca190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.075+0000 7f1132495700 1 --2- 172.21.15.2:0/2790391232 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f112c0ce9b0 0x7f112c156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.075+0000 7f1132495700 1 --2- 172.21.15.2:0/2790391232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f112c1617a0 0x7f112c0c9c50 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.075+0000 7f1132495700 1 -- 172.21.15.2:0/2790391232 >> 172.21.15.2:0/2790391232 conn(0x7f112c0d3e10 msgr2=0x7f112c0d00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:12.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.075+0000 7f1132495700 1 -- 172.21.15.2:0/2790391232 shutdown_connections 2023-11-26T07:18:12.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.075+0000 7f1132495700 1 -- 172.21.15.2:0/2790391232 wait complete. 2023-11-26T07:18:12.079 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-26T07:18:12.089 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":273,"stamp":"2023-11-26T07:18:10.253787+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":262248,"kb_used_data":8648,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754712472,"statfs":{"total":773094113280,"available":772825571328,"internally_reserved":0,"allocated":8855552,"data_stored":4440616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002784"},"pg_stats":[{"pgid":"1.0","version":"78'119","reported_seq":228,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:17:53.106613+0000","last_change":"2023-11-26T07:17:53.106656+0000","last_active":"2023-11-26T07:17:53.106613+0000","last_peered":"2023-11-26T07:17:53.106613+0000","last_clean":"2023-11-26T07:17:53.106613+0000","last_became_active":"2023-11-26T07:11:29.854903+0000","last_became_peered":"2023-11-26T07:11:29.854903+0000","last_unstale":"2023-11-26T07:17:53.106613+0000","last_undegraded":"2023-11-26T07:17:53.106613+0000","last_fullsized":"2023-11-26T07:17:53.106613+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"78'119","last_scrub_stamp":"2023-11-26T07:17:53.106502+0000","last_deep_scrub":"78'119","last_deep_scrub_stamp":"2023-11-26T07:17:53.106502+0000","last_clean_scrub_stamp":"2023-11-26T07:17:53.106502+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:56:28.893327+0000","scrub_duration":0.0058787570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574933,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32692,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339148,"statfs":{"total":96636764160,"available":96603287552,"internally_reserved":0,"allocated":1552384,"data_stored":997853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.52000000000000002,"15min":0.53000000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.68200000000000005,"5min":0.73699999999999999,"15min":1.4139999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.53900000000000003,"15min":0.51400000000000001},"min":{"1min":0.34699999999999998,"5min":0.313,"15min":0.313},"max":{"1min":2.8690000000000002,"5min":2.8690000000000002,"15min":2.8690000000000002},"last":0.73199999999999998}]},{"osd":1,"last update":"Sun Nov 26 07:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.54500000000000004,"15min":0.879},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":9.5600000000000005},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.56499999999999995,"15min":0.57899999999999996},"min":{"1min":0.40600000000000003,"5min":0.372,"15min":0.372},"max":{"1min":2.9289999999999998,"5min":2.9289999999999998,"15min":2.9289999999999998},"last":0.65400000000000003}]},{"osd":2,"last update":"Sun Nov 26 07:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.57199999999999995,"15min":0.59399999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34200000000000003},"max":{"1min":0.871,"5min":1.3979999999999999,"15min":1.569},"last":0.746},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.62,"15min":0.64300000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":2.8969999999999998,"5min":2.8969999999999998,"15min":2.8969999999999998},"last":0.67800000000000005}]},{"osd":3,"last update":"Sun Nov 26 07:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54800000000000004,"15min":0.58799999999999997},"min":{"1min":0.36499999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.75600000000000001,"5min":1.494,"15min":1.6639999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58799999999999997,"15min":0.56999999999999995},"min":{"1min":0.45700000000000002,"5min":0.42899999999999999,"15min":0.36399999999999999},"max":{"1min":0.753,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.76300000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.504,"15min":0.51600000000000001},"min":{"1min":0.33000000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.71499999999999997,"5min":0.73699999999999999,"15min":0.85899999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.58299999999999996,"15min":0.53100000000000003},"min":{"1min":0.39300000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":4.9109999999999996,"5min":4.9109999999999996,"15min":4.9109999999999996},"last":0.46200000000000002}]},{"osd":5,"last update":"Sun Nov 26 07:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55600000000000005,"15min":0.53500000000000003},"min":{"1min":0.35299999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.86899999999999999,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.503},{"interface":"front","average":{"1min":0.62,"5min":0.61099999999999999,"15min":0.627},"min":{"1min":0.46000000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77000000000000002,"5min":0.83199999999999996,"15min":0.89800000000000002},"last":0.48999999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.746,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59499999999999997,"15min":0.59099999999999997},"min":{"1min":0.41999999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.77700000000000002,"5min":1.552,"15min":1.552},"last":0.54200000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574933,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339720,"statfs":{"total":96636764160,"available":96603873280,"internally_reserved":0,"allocated":958464,"data_stored":407485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52500000000000002,"15min":0.49099999999999999},"min":{"1min":0.312,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.73599999999999999,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.621,"5min":0.56899999999999995,"15min":0.498},"min":{"1min":0.34799999999999998,"5min":0.33400000000000002,"15min":0.317},"max":{"1min":2.1000000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":0.63100000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54000000000000004,"15min":0.51700000000000002},"min":{"1min":0.33800000000000002,"5min":0.315,"15min":0.315},"max":{"1min":1.079,"5min":1.079,"15min":1.1080000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54400000000000004,"15min":0.54200000000000004},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.78500000000000003,"5min":0.83599999999999997,"15min":1.198},"last":0.64300000000000002}]},{"osd":2,"last update":"Sun Nov 26 07:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.56499999999999995,"15min":0.51100000000000001},"min":{"1min":0.375,"5min":0.307,"15min":0.307},"max":{"1min":2.2210000000000001,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57999999999999996,"15min":0.53400000000000003},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.61799999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61099999999999999,"15min":0.56299999999999994},"min":{"1min":0.41999999999999998,"5min":0.40999999999999998,"15min":0.373},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.64200000000000002,"15min":0.59699999999999998},"min":{"1min":0.45100000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":0.67200000000000004}]},{"osd":4,"last update":"Sun Nov 26 07:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48899999999999999,"15min":0.51900000000000002},"min":{"1min":0.32200000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.58699999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.442},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56100000000000005,"15min":0.56699999999999995},"min":{"1min":0.375,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.47399999999999998}]},{"osd":5,"last update":"Sun Nov 26 07:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55700000000000005,"15min":0.55800000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.57399999999999995,"15min":0.58399999999999996},"min":{"1min":0.38500000000000001,"5min":0.311,"15min":0.311},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.54700000000000004}]},{"osd":7,"last update":"Sun Nov 26 07:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.59999999999999998,"15min":0.59399999999999997},"min":{"1min":0.371,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":2.1499999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61799999999999999,"15min":0.622},"min":{"1min":0.39700000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.65700000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36276,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335564,"statfs":{"total":96636764160,"available":96599617536,"internally_reserved":0,"allocated":958464,"data_stored":407485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33800000000000002,"15min":0.35799999999999998},"min":{"1min":0.23300000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.47899999999999998,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35999999999999999,"15min":0.72599999999999998},"min":{"1min":0.26800000000000002,"5min":0.214,"15min":0.214},"max":{"1min":0.45200000000000001,"5min":0.60399999999999998,"15min":11.922000000000001},"last":0.52500000000000002}]},{"osd":2,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.33500000000000002,"15min":0.36399999999999999},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.47899999999999998,"5min":0.66500000000000004,"15min":0.80300000000000005},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.39400000000000002,"15min":0.40500000000000003},"min":{"1min":0.28399999999999997,"5min":0.254,"15min":0.254},"max":{"1min":0.54300000000000004,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.54400000000000004}]},{"osd":3,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.436,"15min":0.45400000000000001},"min":{"1min":0.31,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.623,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.41199999999999998,"15min":0.434},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.56799999999999995,"5min":0.62,"15min":1.101},"last":0.66600000000000004}]},{"osd":4,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.60899999999999999,"15min":0.82099999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.73599999999999999,"5min":0.97299999999999998,"15min":6.8979999999999997},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64400000000000002,"15min":0.66000000000000003},"min":{"1min":0.42999999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.77100000000000002,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.80500000000000005}]},{"osd":5,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.61099999999999999,"15min":0.624},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78500000000000003,"5min":1.2090000000000001,"15min":1.3160000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60099999999999998,"15min":0.82299999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.73799999999999999,"5min":1.087,"15min":6.9480000000000004},"last":0.78700000000000003}]},{"osd":6,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.624,"15min":0.65300000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.72799999999999998,"5min":0.93100000000000005,"15min":1.194},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.61299999999999999,"15min":0.84699999999999998},"min":{"1min":0.41199999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.77800000000000002,"5min":1.222,"15min":6.9800000000000004},"last":0.70399999999999996}]},{"osd":7,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.66700000000000004,"15min":0.66300000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.75600000000000001,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.66700000000000004,"15min":0.68300000000000005},"min":{"1min":0.48299999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.754,"5min":3.548,"15min":3.548},"last":0.82899999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574931,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32692,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339148,"statfs":{"total":96636764160,"available":96603287552,"internally_reserved":0,"allocated":1552384,"data_stored":997853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.36099999999999999},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.46700000000000003,"5min":0.52600000000000002,"15min":1.5820000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.35699999999999998,"15min":0.745},"min":{"1min":0.28199999999999997,"5min":0.216,"15min":0.216},"max":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":11.987},"last":0.58599999999999997}]},{"osd":2,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35899999999999999,"15min":0.41899999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.48299999999999998,"5min":0.57099999999999995,"15min":1.607},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38200000000000001,"15min":0.40799999999999997},"min":{"1min":0.27800000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.55200000000000005,"5min":0.64900000000000002,"15min":0.89600000000000002},"last":0.70099999999999996}]},{"osd":3,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36299999999999999,"15min":0.38300000000000001},"min":{"1min":0.26500000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.49099999999999999,"5min":0.58899999999999997,"15min":0.752},"last":0.622},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41199999999999998,"15min":0.46000000000000002},"min":{"1min":0.32400000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.57199999999999995,"5min":0.71699999999999997,"15min":1.6339999999999999},"last":0.68400000000000005}]},{"osd":4,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.59199999999999997,"15min":0.64200000000000002},"min":{"1min":0.36699999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.92600000000000005},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59699999999999998,"15min":0.83299999999999996},"min":{"1min":0.39900000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.81499999999999995,"5min":0.82199999999999995,"15min":6.5279999999999996},"last":0.89700000000000002}]},{"osd":5,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59499999999999997,"15min":0.63800000000000001},"min":{"1min":0.42999999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83599999999999997,"5min":0.878,"15min":1.1000000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.625,"15min":0.68100000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83499999999999996,"5min":0.88400000000000001,"15min":1.508},"last":0.76300000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.624,"15min":0.86799999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.88700000000000001,"5min":0.93400000000000005,"15min":6.5419999999999998},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61099999999999999,"15min":0.66300000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.82099999999999995,"5min":0.84399999999999997,"15min":1.3759999999999999},"last":0.91300000000000003}]},{"osd":7,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.68600000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.878,"5min":0.91000000000000003,"15min":1.1180000000000001},"last":0.879},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.61899999999999999,"15min":0.65500000000000003},"min":{"1min":0.51900000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77400000000000002,"5min":0.872,"15min":1.155},"last":0.84899999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574932,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32116,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":958464,"data_stored":407485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.33300000000000002,"15min":0.34399999999999997},"min":{"1min":0.20999999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.45500000000000002,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.438},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.38600000000000001,"15min":0.39600000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.499,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.625}]},{"osd":1,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.33300000000000002,"15min":0.34499999999999997},"min":{"1min":0.23799999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.39900000000000002,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.372,"15min":0.376},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.54800000000000004,"5min":0.58999999999999997,"15min":0.59599999999999997},"last":0.47199999999999998}]},{"osd":3,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.38200000000000001,"15min":0.40600000000000003},"min":{"1min":0.29199999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.47999999999999998,"5min":0.59699999999999998,"15min":0.64700000000000002},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.375,"15min":0.38300000000000001},"min":{"1min":0.26700000000000002,"5min":0.224,"15min":0.224},"max":{"1min":0.56599999999999995,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.53400000000000003}]},{"osd":4,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.39600000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.86499999999999999,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58299999999999996},"min":{"1min":0.44,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.61099999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59199999999999997,"15min":0.57999999999999996},"min":{"1min":0.45300000000000001,"5min":0.39500000000000002,"15min":0.36899999999999999},"max":{"1min":0.85099999999999998,"5min":0.87,"15min":0.87},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59099999999999997,"15min":0.623},"min":{"1min":0.41999999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78200000000000003,"5min":0.86299999999999999,"15min":1.002},"last":0.74399999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.61699999999999999,"15min":0.61399999999999999},"min":{"1min":0.432,"5min":0.40999999999999998,"15min":0.38800000000000001},"max":{"1min":0.75700000000000001,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.629,"15min":0.63500000000000001},"min":{"1min":0.48999999999999999,"5min":0.44400000000000001,"15min":0.439},"max":{"1min":0.91700000000000004,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.71499999999999997}]},{"osd":7,"last update":"Sun Nov 26 07:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61099999999999999,"15min":0.626},"min":{"1min":0.44,"5min":0.41999999999999998,"15min":0.40600000000000003},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.621,"15min":0.623},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85199999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.72999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574932,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32116,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":958464,"data_stored":407485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.32900000000000001,"15min":0.36099999999999999},"min":{"1min":0.23300000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":1.3500000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35899999999999999,"15min":0.40699999999999997},"min":{"1min":0.25900000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.54900000000000004,"5min":0.61299999999999999,"15min":1.6619999999999999},"last":0.441}]},{"osd":1,"last update":"Sun Nov 26 07:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.33800000000000002,"15min":0.39100000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.41599999999999998,"5min":0.58799999999999997,"15min":1.2010000000000001},"last":0.621},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.38700000000000001,"15min":0.48299999999999998},"min":{"1min":0.30499999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.56599999999999995,"5min":0.629,"15min":2.903},"last":0.5}]},{"osd":2,"last update":"Sun Nov 26 07:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.375,"15min":0.39800000000000002},"min":{"1min":0.26100000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.52000000000000002,"5min":0.57399999999999995,"15min":1.1240000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.39300000000000002,"15min":0.41399999999999998},"min":{"1min":0.28799999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.51900000000000002,"5min":0.63700000000000001,"15min":1.2290000000000001},"last":0.55200000000000005}]},{"osd":4,"last update":"Sun Nov 26 07:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.60799999999999998,"15min":0.69199999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.82699999999999996,"5min":0.96799999999999997,"15min":2.9609999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60899999999999999,"15min":0.63600000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.85899999999999999,"5min":1.1499999999999999,"15min":1.163},"last":0.91400000000000003}]},{"osd":5,"last update":"Sun Nov 26 07:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.621,"15min":0.66300000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.88800000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.624,"15min":0.65800000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.877,"5min":0.93999999999999995,"15min":1.2829999999999999},"last":0.89700000000000002}]},{"osd":6,"last update":"Sun Nov 26 07:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.64300000000000002,"15min":0.67100000000000004},"min":{"1min":0.39400000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":2.6040000000000001,"5min":2.6040000000000001,"15min":2.6040000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.63800000000000001,"15min":0.67400000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.258},"last":0.78500000000000003}]},{"osd":7,"last update":"Sun Nov 26 07:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63200000000000001,"15min":0.67600000000000005},"min":{"1min":0.438,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.875,"5min":1.014,"15min":1.3069999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.65300000000000002,"15min":0.73699999999999999},"min":{"1min":0.44800000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90100000000000002,"5min":1.0780000000000001,"15min":2.9969999999999999},"last":0.98099999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574931,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32116,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":958464,"data_stored":407485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.55100000000000005,"15min":0.85099999999999998},"min":{"1min":0.32900000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.68899999999999995,"5min":0.87,"15min":8.7539999999999996},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59199999999999997,"15min":0.875},"min":{"1min":0.35299999999999998,"5min":0.316,"15min":0.316},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":8.7390000000000008},"last":0.66100000000000003}]},{"osd":1,"last update":"Sun Nov 26 07:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.56100000000000005,"15min":0.89300000000000002},"min":{"1min":0.32700000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.68300000000000005,"5min":0.81200000000000006,"15min":9.7720000000000002},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.55000000000000004,"15min":0.56399999999999995},"min":{"1min":0.33600000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.72899999999999998,"5min":0.80000000000000004,"15min":0.88700000000000001},"last":0.505}]},{"osd":2,"last update":"Sun Nov 26 07:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54100000000000004,"15min":0.85099999999999998},"min":{"1min":0.39900000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.78600000000000003,"5min":0.80100000000000005,"15min":9.8119999999999994},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58599999999999997,"15min":0.78300000000000003},"min":{"1min":0.36899999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67600000000000005,"5min":0.85499999999999998,"15min":3.645},"last":0.77600000000000002}]},{"osd":3,"last update":"Sun Nov 26 07:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59599999999999997,"15min":0.89800000000000002},"min":{"1min":0.41899999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.69999999999999996,"5min":0.81299999999999994,"15min":8.8089999999999993},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.59799999999999998,"15min":0.60199999999999998},"min":{"1min":0.371,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82099999999999995,"5min":0.83899999999999997,"15min":1.0720000000000001},"last":0.60299999999999998}]},{"osd":5,"last update":"Sun Nov 26 07:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55600000000000005,"15min":0.51600000000000001},"min":{"1min":0.32800000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72099999999999997,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55900000000000005,"15min":0.55300000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.64100000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.58499999999999996},"min":{"1min":0.375,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.78800000000000003,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56399999999999995,"15min":0.57199999999999995},"min":{"1min":0.36199999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.76300000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60599999999999998,"15min":0.59799999999999998},"min":{"1min":0.41299999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61699999999999999,"15min":0.60799999999999998},"min":{"1min":0.40899999999999997,"5min":0.38300000000000001,"15min":0.38200000000000001},"max":{"1min":0.89500000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.72899999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574933,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339720,"statfs":{"total":96636764160,"available":96603873280,"internally_reserved":0,"allocated":958464,"data_stored":407485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.58599999999999997,"15min":0.54000000000000004},"min":{"1min":0.40200000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.65300000000000002,"5min":7.1500000000000004,"15min":7.1500000000000004},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.58999999999999997,"15min":0.56999999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78500000000000003,"5min":6.8470000000000004,"15min":6.8470000000000004},"last":0.58399999999999996}]},{"osd":1,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.58299999999999996,"15min":0.55500000000000005},"min":{"1min":0.32300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69599999999999995,"5min":7.1269999999999998,"15min":7.1269999999999998},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73499999999999999,"5min":1.514,"15min":1.514},"last":0.43099999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.63200000000000001,"15min":0.59399999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.71499999999999997,"5min":7.2000000000000002,"15min":7.2000000000000002},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.65500000000000003,"15min":0.61799999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73699999999999999,"5min":7.8259999999999996,"15min":7.8259999999999996},"last":0.61799999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.59899999999999998,"15min":0.57099999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79800000000000004,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.495},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.65000000000000002,"15min":0.60799999999999998},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72899999999999998,"5min":6.9240000000000004,"15min":6.9240000000000004},"last":0.629}]},{"osd":4,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.56799999999999995,"15min":0.51400000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.68700000000000006,"5min":7.2830000000000004,"15min":7.2830000000000004},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.83399999999999996,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.53700000000000003}]},{"osd":6,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.61899999999999999,"15min":0.57099999999999995},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.75600000000000001,"5min":6.8890000000000002,"15min":6.8890000000000002},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.63,"15min":0.58899999999999997},"min":{"1min":0.40300000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.72899999999999998,"5min":7.2430000000000003,"15min":7.2430000000000003},"last":0.64300000000000002}]},{"osd":7,"last update":"Sun Nov 26 07:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.65900000000000003,"15min":0.60899999999999999},"min":{"1min":0.41299999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.86699999999999999,"5min":6.9880000000000004,"15min":6.9880000000000004},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.72399999999999998,"15min":0.65600000000000003},"min":{"1min":0.40300000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.77100000000000002,"5min":11.874000000000001,"15min":11.874000000000001},"last":0.67700000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:18:12.123 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-26T07:18:12.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.246+0000 7f051d8c8700 1 Processor -- start 2023-11-26T07:18:12.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.246+0000 7f051d8c8700 1 -- start start 2023-11-26T07:18:12.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.247+0000 7f051d8c8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f051806b620 0x7f05180b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.247+0000 7f051d8c8700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f05180b5ab0 0x7f05180b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.247+0000 7f051d8c8700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0518071f50 con 0x7f05181478c0 2023-11-26T07:18:12.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.247+0000 7f051d8c8700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0518072230 con 0x7f05180b5ab0 2023-11-26T07:18:12.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.247+0000 7f051d8c8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0518072510 con 0x7f051806b620 2023-11-26T07:18:12.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.247+0000 7f05167fc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f05180b5ab0 0x7f05180b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:12.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.247+0000 7f05167fc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f05180b5ab0 0x7f05180b3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45572/0 (socket says 172.21.15.2:45572) 2023-11-26T07:18:12.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.247+0000 7f05167fc700 1 -- 172.21.15.2:0/3663144361 learned_addr learned my addr 172.21.15.2:0/3663144361 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:18:12.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.247+0000 7f0516ffd700 1 --2- 172.21.15.2:0/3663144361 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f051806b620 0x7f05180b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:12.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.248+0000 7f05167fc700 1 -- 172.21.15.2:0/3663144361 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f051806b620 msgr2=0x7f05180b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:12.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.248+0000 7f05167fc700 1 --2- 172.21.15.2:0/3663144361 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f051806b620 0x7f05180b3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.248+0000 7f05167fc700 1 -- 172.21.15.2:0/3663144361 >> v1:172.21.15.192:6789/0 conn(0x7f05181478c0 legacy=0x7f0518161ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.248+0000 7f05167fc700 1 -- 172.21.15.2:0/3663144361 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05180727f0 con 0x7f05180b5ab0 2023-11-26T07:18:12.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.248+0000 7f05167fc700 1 --2- 172.21.15.2:0/3663144361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05180b5ab0 0x7f05180b3f80 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f05080098f0 tx=0x7f0508009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecc3036dbb23cb25 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:12.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.248+0000 7f0515ffb700 1 -- 172.21.15.2:0/3663144361 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0508011830 con 0x7f05180b5ab0 2023-11-26T07:18:12.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.248+0000 7f0515ffb700 1 -- 172.21.15.2:0/3663144361 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0508011990 con 0x7f05180b5ab0 2023-11-26T07:18:12.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.248+0000 7f0515ffb700 1 -- 172.21.15.2:0/3663144361 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0508011d20 con 0x7f05180b5ab0 2023-11-26T07:18:12.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.249+0000 7f051d8c8700 1 -- 172.21.15.2:0/3663144361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05180b5ab0 msgr2=0x7f05180b3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.249+0000 7f051d8c8700 1 --2- 172.21.15.2:0/3663144361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05180b5ab0 0x7f05180b3f80 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f05080098f0 tx=0x7f0508009c00 comp rx=0 tx=0).stop 2023-11-26T07:18:12.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.249+0000 7f051d8c8700 1 -- 172.21.15.2:0/3663144361 shutdown_connections 2023-11-26T07:18:12.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.249+0000 7f051d8c8700 1 --2- 172.21.15.2:0/3663144361 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f051806b620 0x7f05180b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.249+0000 7f051d8c8700 1 --2- 172.21.15.2:0/3663144361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05180b5ab0 0x7f05180b3f80 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.249+0000 7f051d8c8700 1 -- 172.21.15.2:0/3663144361 >> 172.21.15.2:0/3663144361 conn(0x7f05180b2740 msgr2=0x7f05180b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:12.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.249+0000 7f051d8c8700 1 -- 172.21.15.2:0/3663144361 shutdown_connections 2023-11-26T07:18:12.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.249+0000 7f051d8c8700 1 -- 172.21.15.2:0/3663144361 wait complete. 2023-11-26T07:18:12.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.250+0000 7f051d8c8700 1 Processor -- start 2023-11-26T07:18:12.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.250+0000 7f051d8c8700 1 -- start start 2023-11-26T07:18:12.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.251+0000 7f051d8c8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f051806b620 0x7f05181e1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.251+0000 7f051d8c8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05180b5ab0 0x7f05181e4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.251+0000 7f051d8c8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05181478c0 0x7f05181e4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.251+0000 7f051d8c8700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05181dcae0 con 0x7f05180b5ab0 2023-11-26T07:18:12.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.251+0000 7f051d8c8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05181e26e0 con 0x7f05181478c0 2023-11-26T07:18:12.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.251+0000 7f051d8c8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05181e29c0 con 0x7f051806b620 2023-11-26T07:18:12.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.251+0000 7f05167fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05180b5ab0 0x7f05181e4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:12.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.251+0000 7f05167fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05180b5ab0 0x7f05181e4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45580/0 (socket says 172.21.15.2:45580) 2023-11-26T07:18:12.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.251+0000 7f05167fc700 1 -- 172.21.15.2:0/2400678034 learned_addr learned my addr 172.21.15.2:0/2400678034 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:18:12.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.251+0000 7f05177fe700 1 --2- 172.21.15.2:0/2400678034 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05181478c0 0x7f05181e4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:12.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.251+0000 7f0516ffd700 1 --2- 172.21.15.2:0/2400678034 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f051806b620 0x7f05181e1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:12.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.251+0000 7f05167fc700 1 -- 172.21.15.2:0/2400678034 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f051806b620 msgr2=0x7f05181e1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.251+0000 7f05167fc700 1 --2- 172.21.15.2:0/2400678034 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f051806b620 0x7f05181e1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.251+0000 7f05167fc700 1 -- 172.21.15.2:0/2400678034 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05181478c0 msgr2=0x7f05181e4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.251+0000 7f05167fc700 1 --2- 172.21.15.2:0/2400678034 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05181478c0 0x7f05181e4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.251+0000 7f05167fc700 1 -- 172.21.15.2:0/2400678034 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0508009550 con 0x7f05180b5ab0 2023-11-26T07:18:12.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.252+0000 7f05167fc700 1 --2- 172.21.15.2:0/2400678034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05180b5ab0 0x7f05181e4630 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f0508009c40 tx=0x7f0508004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:12.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.252+0000 7f04fffff700 1 -- 172.21.15.2:0/2400678034 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05080045b0 con 0x7f05180b5ab0 2023-11-26T07:18:12.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.252+0000 7f04fffff700 1 -- 172.21.15.2:0/2400678034 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f050801f070 con 0x7f05180b5ab0 2023-11-26T07:18:12.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.252+0000 7f051d8c8700 1 -- 172.21.15.2:0/2400678034 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05181e2ca0 con 0x7f05180b5ab0 2023-11-26T07:18:12.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.252+0000 7f04fffff700 1 -- 172.21.15.2:0/2400678034 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05080038e0 con 0x7f05180b5ab0 2023-11-26T07:18:12.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.252+0000 7f051d8c8700 1 -- 172.21.15.2:0/2400678034 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05181e23d0 con 0x7f05180b5ab0 2023-11-26T07:18:12.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.253+0000 7f051d8c8700 1 -- 172.21.15.2:0/2400678034 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05181dcc90 con 0x7f05180b5ab0 2023-11-26T07:18:12.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.253+0000 7f04fffff700 1 -- 172.21.15.2:0/2400678034 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f0508021030 con 0x7f05180b5ab0 2023-11-26T07:18:12.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.254+0000 7f04fffff700 1 --2- 172.21.15.2:0/2400678034 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f050406b980 0x7f050406de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.254+0000 7f04fffff700 1 -- 172.21.15.2:0/2400678034 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0508089580 con 0x7f05180b5ab0 2023-11-26T07:18:12.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.254+0000 7f0516ffd700 1 --2- 172.21.15.2:0/2400678034 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f050406b980 0x7f050406de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:12.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.254+0000 7f0516ffd700 1 --2- 172.21.15.2:0/2400678034 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f050406b980 0x7f050406de40 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f050c009b70 tx=0x7f050c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:12.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.258+0000 7f04fffff700 1 -- 172.21.15.2:0/2400678034 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f05181dcc90 con 0x7f05180b5ab0 2023-11-26T07:18:12.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.461+0000 7f051d8c8700 1 -- 172.21.15.2:0/2400678034 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f0518075480 con 0x7f05180b5ab0 2023-11-26T07:18:12.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.466+0000 7f04fffff700 1 -- 172.21.15.2:0/2400678034 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v26)=0 v26) v1 ==== 123+0+0 (secure 0 0 0) 0x7f0508015020 con 0x7f05180b5ab0 2023-11-26T07:18:12.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.467+0000 7f04fffff700 1 -- 172.21.15.2:0/2400678034 <== mon.0 v2:172.21.15.2:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0508055eb0 con 0x7f05180b5ab0 2023-11-26T07:18:12.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.469+0000 7f051d8c8700 1 -- 172.21.15.2:0/2400678034 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f050406b980 msgr2=0x7f050406de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.469+0000 7f051d8c8700 1 --2- 172.21.15.2:0/2400678034 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f050406b980 0x7f050406de40 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f050c009b70 tx=0x7f050c008040 comp rx=0 tx=0).stop 2023-11-26T07:18:12.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.469+0000 7f051d8c8700 1 -- 172.21.15.2:0/2400678034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05180b5ab0 msgr2=0x7f05181e4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.469+0000 7f051d8c8700 1 --2- 172.21.15.2:0/2400678034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05180b5ab0 0x7f05181e4630 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f0508009c40 tx=0x7f0508004750 comp rx=0 tx=0).stop 2023-11-26T07:18:12.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.469+0000 7f051d8c8700 1 -- 172.21.15.2:0/2400678034 shutdown_connections 2023-11-26T07:18:12.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.469+0000 7f051d8c8700 1 --2- 172.21.15.2:0/2400678034 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f050406b980 0x7f050406de40 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.469+0000 7f051d8c8700 1 --2- 172.21.15.2:0/2400678034 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05181478c0 0x7f05181e4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.469+0000 7f051d8c8700 1 --2- 172.21.15.2:0/2400678034 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f051806b620 0x7f05181e1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.469+0000 7f051d8c8700 1 --2- 172.21.15.2:0/2400678034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05180b5ab0 0x7f05181e4630 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.469+0000 7f051d8c8700 1 -- 172.21.15.2:0/2400678034 >> 172.21.15.2:0/2400678034 conn(0x7f05180b2740 msgr2=0x7f05181dbe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:12.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.469+0000 7f051d8c8700 1 -- 172.21.15.2:0/2400678034 shutdown_connections 2023-11-26T07:18:12.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.469+0000 7f051d8c8700 1 -- 172.21.15.2:0/2400678034 wait complete. 2023-11-26T07:18:12.483 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-26T07:18:12.484 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:18:12.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.606+0000 7f5c48774700 1 Processor -- start 2023-11-26T07:18:12.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.607+0000 7f5c48774700 1 -- start start 2023-11-26T07:18:12.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.607+0000 7f5c48774700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5c40143ae0 0x7f5c400b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.607+0000 7f5c48774700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5c400722c0 0x7f5c4006e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.608+0000 7f5c48774700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c40143ec0 con 0x7f5c401440f0 2023-11-26T07:18:12.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.608+0000 7f5c48774700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c400b40a0 con 0x7f5c400722c0 2023-11-26T07:18:12.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.608+0000 7f5c48774700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c400b3ae0 con 0x7f5c40143ae0 2023-11-26T07:18:12.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.608+0000 7f5c46d11700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5c400722c0 0x7f5c4006e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:12.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.608+0000 7f5c45d0f700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f5c401440f0 0x7f5c40071bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36798/0 (socket says 172.21.15.2:36798) 2023-11-26T07:18:12.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.608+0000 7f5c45d0f700 1 -- 172.21.15.2:0/738877544 learned_addr learned my addr 172.21.15.2:0/738877544 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-26T07:18:12.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.608+0000 7f5c46d11700 1 -- 172.21.15.2:0/738877544 >> v2:172.21.15.192:3300/0 conn(0x7f5c40143ae0 msgr2=0x7f5c400b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:12.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.608+0000 7f5c46510700 1 --2- 172.21.15.2:0/738877544 >> v2:172.21.15.192:3300/0 conn(0x7f5c40143ae0 0x7f5c400b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:12.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.608+0000 7f5c46d11700 1 --2- 172.21.15.2:0/738877544 >> v2:172.21.15.192:3300/0 conn(0x7f5c40143ae0 0x7f5c400b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.608+0000 7f5c46d11700 1 -- 172.21.15.2:0/738877544 >> v1:172.21.15.2:6789/0 conn(0x7f5c401440f0 legacy=0x7f5c40071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.608+0000 7f5c4550e700 1 -- 172.21.15.2:0/738877544 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 14827238 0 0) 0x7f5c40143ec0 con 0x7f5c401440f0 2023-11-26T07:18:12.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.608+0000 7f5c46d11700 1 -- 172.21.15.2:0/738877544 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c400b3dc0 con 0x7f5c400722c0 2023-11-26T07:18:12.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.608+0000 7f5c46510700 1 --2- 172.21.15.2:0/738877544 >> v2:172.21.15.192:3300/0 conn(0x7f5c40143ae0 0x7f5c400b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:12.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.608+0000 7f5c46d11700 1 --2- 172.21.15.2:0/738877544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c400722c0 0x7f5c4006e510 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f5c4006d2e0 tx=0x7f5c3800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b181db7ac3029d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:12.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.608+0000 7f5c4550e700 1 -- 172.21.15.2:0/738877544 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3800e070 con 0x7f5c400722c0 2023-11-26T07:18:12.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.608+0000 7f5c4550e700 1 -- 172.21.15.2:0/738877544 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5c3800bbd0 con 0x7f5c400722c0 2023-11-26T07:18:12.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.608+0000 7f5c4550e700 1 -- 172.21.15.2:0/738877544 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c38012430 con 0x7f5c400722c0 2023-11-26T07:18:12.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.609+0000 7f5c48774700 1 -- 172.21.15.2:0/738877544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c400722c0 msgr2=0x7f5c4006e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.609+0000 7f5c48774700 1 --2- 172.21.15.2:0/738877544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c400722c0 0x7f5c4006e510 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f5c4006d2e0 tx=0x7f5c3800b330 comp rx=0 tx=0).stop 2023-11-26T07:18:12.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.609+0000 7f5c48774700 1 -- 172.21.15.2:0/738877544 shutdown_connections 2023-11-26T07:18:12.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.609+0000 7f5c48774700 1 --2- 172.21.15.2:0/738877544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c400722c0 0x7f5c4006e510 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.609+0000 7f5c48774700 1 --2- 172.21.15.2:0/738877544 >> v2:172.21.15.192:3300/0 conn(0x7f5c40143ae0 0x7f5c400b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.609+0000 7f5c48774700 1 -- 172.21.15.2:0/738877544 >> 172.21.15.2:0/738877544 conn(0x7f5c400b2740 msgr2=0x7f5c400b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:12.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.609+0000 7f5c48774700 1 -- 172.21.15.2:0/738877544 shutdown_connections 2023-11-26T07:18:12.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.609+0000 7f5c48774700 1 -- 172.21.15.2:0/738877544 wait complete. 2023-11-26T07:18:12.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.611+0000 7f5c48774700 1 Processor -- start 2023-11-26T07:18:12.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.611+0000 7f5c48774700 1 -- start start 2023-11-26T07:18:12.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.612+0000 7f5c48774700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c400722c0 0x7f5c400cc720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.612+0000 7f5c48774700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5c40143ae0 0x7f5c4015eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.612+0000 7f5c48774700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c401440f0 0x7f5c40151530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.612+0000 7f5c48774700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4015dad0 con 0x7f5c401440f0 2023-11-26T07:18:12.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.612+0000 7f5c48774700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4015ddb0 con 0x7f5c400722c0 2023-11-26T07:18:12.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.612+0000 7f5c48774700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4015e090 con 0x7f5c40143ae0 2023-11-26T07:18:12.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.612+0000 7f5c46d11700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c401440f0 0x7f5c40151530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:12.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.612+0000 7f5c46d11700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c401440f0 0x7f5c40151530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45596/0 (socket says 172.21.15.2:45596) 2023-11-26T07:18:12.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.612+0000 7f5c46d11700 1 -- 172.21.15.2:0/4168672749 learned_addr learned my addr 172.21.15.2:0/4168672749 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-26T07:18:12.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.612+0000 7f5c45d0f700 1 --2- 172.21.15.2:0/4168672749 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5c40143ae0 0x7f5c4015eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:12.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.612+0000 7f5c46510700 1 --2- 172.21.15.2:0/4168672749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c400722c0 0x7f5c400cc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:12.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.612+0000 7f5c46d11700 1 -- 172.21.15.2:0/4168672749 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5c40143ae0 msgr2=0x7f5c4015eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.612+0000 7f5c46d11700 1 --2- 172.21.15.2:0/4168672749 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5c40143ae0 0x7f5c4015eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.612+0000 7f5c46d11700 1 -- 172.21.15.2:0/4168672749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c400722c0 msgr2=0x7f5c400cc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.612+0000 7f5c46d11700 1 --2- 172.21.15.2:0/4168672749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c400722c0 0x7f5c400cc720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.612+0000 7f5c46d11700 1 -- 172.21.15.2:0/4168672749 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c38009a70 con 0x7f5c401440f0 2023-11-26T07:18:12.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.612+0000 7f5c46510700 1 --2- 172.21.15.2:0/4168672749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c400722c0 0x7f5c400cc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:12.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.612+0000 7f5c46d11700 1 --2- 172.21.15.2:0/4168672749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c401440f0 0x7f5c40151530 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f5c38013000 tx=0x7f5c38004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:12.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.612+0000 7f5c36ffd700 1 -- 172.21.15.2:0/4168672749 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c38012430 con 0x7f5c401440f0 2023-11-26T07:18:12.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.612+0000 7f5c36ffd700 1 -- 172.21.15.2:0/4168672749 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5c38020070 con 0x7f5c401440f0 2023-11-26T07:18:12.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.612+0000 7f5c48774700 1 -- 172.21.15.2:0/4168672749 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c4015e370 con 0x7f5c401440f0 2023-11-26T07:18:12.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.612+0000 7f5c36ffd700 1 -- 172.21.15.2:0/4168672749 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c380042a0 con 0x7f5c401440f0 2023-11-26T07:18:12.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.613+0000 7f5c48774700 1 -- 172.21.15.2:0/4168672749 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c40158980 con 0x7f5c401440f0 2023-11-26T07:18:12.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.613+0000 7f5c48774700 1 -- 172.21.15.2:0/4168672749 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c40068670 con 0x7f5c401440f0 2023-11-26T07:18:12.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.614+0000 7f5c36ffd700 1 -- 172.21.15.2:0/4168672749 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90200+0+0 (secure 0 0 0) 0x7f5c38004400 con 0x7f5c401440f0 2023-11-26T07:18:12.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.614+0000 7f5c36ffd700 1 --2- 172.21.15.2:0/4168672749 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5c2406b980 0x7f5c2406de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.614+0000 7f5c36ffd700 1 -- 172.21.15.2:0/4168672749 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5c38022070 con 0x7f5c401440f0 2023-11-26T07:18:12.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.615+0000 7f5c46510700 1 --2- 172.21.15.2:0/4168672749 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5c2406b980 0x7f5c2406de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:12.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.615+0000 7f5c46510700 1 --2- 172.21.15.2:0/4168672749 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5c2406b980 0x7f5c2406de40 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c006fd0 tx=0x7f5c3c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:12.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.619+0000 7f5c36ffd700 1 -- 172.21.15.2:0/4168672749 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5c380570a0 con 0x7f5c401440f0 2023-11-26T07:18:12.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.869+0000 7f5c48774700 1 -- 172.21.15.2:0/4168672749 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c40072c30 con 0x7f5c401440f0 2023-11-26T07:18:12.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.870+0000 7f5c36ffd700 1 -- 172.21.15.2:0/4168672749 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+3699 (secure 0 0 0) 0x7f5c38058fd0 con 0x7f5c401440f0 2023-11-26T07:18:12.872 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-26T07:18:12.872 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":49,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5678,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3437634953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3437634953},{"type":"v1","addr":"172.21.15.192:6835","nonce":3437634953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":5684,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2624944008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2624944008},{"type":"v1","addr":"172.21.15.192:6837","nonce":2624944008}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6711,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/1847794001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1847794001},{"type":"v1","addr":"172.21.15.2:6834","nonce":1847794001}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":7218,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/1195577180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":1195577180},{"type":"v1","addr":"172.21.15.2:6835","nonce":1195577180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49}],"filesystems":[]} 2023-11-26T07:18:12.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.872+0000 7f5c48774700 1 -- 172.21.15.2:0/4168672749 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5c2406b980 msgr2=0x7f5c2406de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.872+0000 7f5c48774700 1 --2- 172.21.15.2:0/4168672749 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5c2406b980 0x7f5c2406de40 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c006fd0 tx=0x7f5c3c008040 comp rx=0 tx=0).stop 2023-11-26T07:18:12.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.872+0000 7f5c48774700 1 -- 172.21.15.2:0/4168672749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c401440f0 msgr2=0x7f5c40151530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.872+0000 7f5c48774700 1 --2- 172.21.15.2:0/4168672749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c401440f0 0x7f5c40151530 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f5c38013000 tx=0x7f5c38004ad0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.872+0000 7f5c48774700 1 -- 172.21.15.2:0/4168672749 shutdown_connections 2023-11-26T07:18:12.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.872+0000 7f5c48774700 1 --2- 172.21.15.2:0/4168672749 >> [v2:172.21.15.192:6832/1147935632,v1:172.21.15.192:6833/1147935632] conn(0x7f5c2406b980 0x7f5c2406de40 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.872+0000 7f5c48774700 1 --2- 172.21.15.2:0/4168672749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c401440f0 0x7f5c40151530 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.872+0000 7f5c48774700 1 --2- 172.21.15.2:0/4168672749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c400722c0 0x7f5c400cc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.872+0000 7f5c48774700 1 --2- 172.21.15.2:0/4168672749 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5c40143ae0 0x7f5c4015eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.872+0000 7f5c48774700 1 -- 172.21.15.2:0/4168672749 >> 172.21.15.2:0/4168672749 conn(0x7f5c400b2740 msgr2=0x7f5c401410d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:12.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.872+0000 7f5c48774700 1 -- 172.21.15.2:0/4168672749 shutdown_connections 2023-11-26T07:18:12.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-26T07:18:12.872+0000 7f5c48774700 1 -- 172.21.15.2:0/4168672749 wait complete. 2023-11-26T07:18:12.876 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 49 2023-11-26T07:18:12.886 DEBUG:tasks.cephfs.filesystem:already dead... 2023-11-26T07:18:12.886 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-26T07:18:12.886 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-26T07:18:12.887 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:18:12.895 INFO:tasks.ceph.mds.a:Stopped 2023-11-26T07:18:12.895 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-26T07:18:12.895 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:18:12.943 INFO:tasks.ceph.mds.c:Stopped 2023-11-26T07:18:12.944 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-26T07:18:12.944 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:18:12.954 INFO:tasks.ceph.mds.b:Stopped 2023-11-26T07:18:12.955 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-26T07:18:12.955 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:18:13.005 INFO:tasks.ceph.mds.d:Stopped 2023-11-26T07:18:13.006 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-26T07:18:13.006 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-26T07:18:13.006 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:18:13.040 INFO:tasks.ceph.osd.0:Stopped 2023-11-26T07:18:13.040 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-26T07:18:13.041 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:18:13.121 INFO:tasks.ceph.osd.1:Stopped 2023-11-26T07:18:13.121 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-26T07:18:13.121 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:18:13.201 INFO:tasks.ceph.osd.2:Stopped 2023-11-26T07:18:13.201 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-26T07:18:13.201 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:18:13.280 INFO:tasks.ceph.osd.3:Stopped 2023-11-26T07:18:13.281 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-26T07:18:13.281 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:18:13.324 INFO:tasks.ceph.osd.4:Stopped 2023-11-26T07:18:13.325 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-26T07:18:13.325 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:18:13.367 INFO:tasks.ceph.osd.5:Stopped 2023-11-26T07:18:13.368 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-26T07:18:13.368 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:18:13.400 INFO:tasks.ceph.osd.6:Stopped 2023-11-26T07:18:13.400 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-26T07:18:13.401 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:18:13.483 INFO:tasks.ceph.osd.7:Stopped 2023-11-26T07:18:13.484 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-26T07:18:13.484 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-26T07:18:13.484 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:18:13.508 INFO:tasks.ceph.mgr.y:Stopped 2023-11-26T07:18:13.509 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-26T07:18:13.509 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:18:13.543 INFO:tasks.ceph.mgr.x:Stopped 2023-11-26T07:18:13.543 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-26T07:18:13.544 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-26T07:18:13.544 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:18:13.560 INFO:tasks.ceph.mon.a:Stopped 2023-11-26T07:18:13.561 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-26T07:18:13.561 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:18:13.595 INFO:tasks.ceph.mon.b:Stopped 2023-11-26T07:18:13.595 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-26T07:18:13.595 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:18:13.645 INFO:tasks.ceph.mon.c:Stopped 2023-11-26T07:18:13.645 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-26T07:18:13.646 DEBUG:teuthology.orchestra.run.smithi002:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2023-11-26T07:18:13.683 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi002.front.sepia.ceph.com 2023-11-26T07:18:13.684 DEBUG:teuthology.orchestra.run.smithi002:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-26T07:18:13.938 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi002.front.sepia.ceph.com 2023-11-26T07:18:13.938 DEBUG:teuthology.orchestra.run.smithi002:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-26T07:18:14.077 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi002.front.sepia.ceph.com 2023-11-26T07:18:14.078 DEBUG:teuthology.orchestra.run.smithi002:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-26T07:18:14.162 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi002.front.sepia.ceph.com 2023-11-26T07:18:14.162 DEBUG:teuthology.orchestra.run.smithi002:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-26T07:18:14.261 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi192.front.sepia.ceph.com 2023-11-26T07:18:14.261 DEBUG:teuthology.orchestra.run.smithi192:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-26T07:18:14.468 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi192.front.sepia.ceph.com 2023-11-26T07:18:14.469 DEBUG:teuthology.orchestra.run.smithi192:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-26T07:18:14.601 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi192.front.sepia.ceph.com 2023-11-26T07:18:14.602 DEBUG:teuthology.orchestra.run.smithi192:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-26T07:18:14.691 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi192.front.sepia.ceph.com 2023-11-26T07:18:14.692 DEBUG:teuthology.orchestra.run.smithi192:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-26T07:18:14.759 INFO:tasks.ceph:Archiving mon data... 2023-11-26T07:18:14.761 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467341/data/mon.a.tgz 2023-11-26T07:18:14.761 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2023-11-26T07:18:14.781 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.N1VY02Bcro 2023-11-26T07:18:14.781 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.N1VY02Bcro 2023-11-26T07:18:14.987 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0666 /tmp/tmp.N1VY02Bcro 2023-11-26T07:18:15.074 DEBUG:teuthology.orchestra.remote:smithi002:/tmp/tmp.N1VY02Bcro is 746KB 2023-11-26T07:18:15.148 DEBUG:teuthology.orchestra.run.smithi002:> rm -fr /tmp/tmp.N1VY02Bcro 2023-11-26T07:18:15.164 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467341/data/mon.b.tgz 2023-11-26T07:18:15.164 DEBUG:teuthology.orchestra.run.smithi192:> mktemp 2023-11-26T07:18:15.184 INFO:teuthology.orchestra.run.smithi192.stdout:/tmp/tmp.xNHTwcbEIN 2023-11-26T07:18:15.184 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.xNHTwcbEIN 2023-11-26T07:18:15.388 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0666 /tmp/tmp.xNHTwcbEIN 2023-11-26T07:18:15.473 DEBUG:teuthology.orchestra.remote:smithi192:/tmp/tmp.xNHTwcbEIN is 747KB 2023-11-26T07:18:15.574 DEBUG:teuthology.orchestra.run.smithi192:> rm -fr /tmp/tmp.xNHTwcbEIN 2023-11-26T07:18:15.590 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467341/data/mon.c.tgz 2023-11-26T07:18:15.590 DEBUG:teuthology.orchestra.run.smithi192:> mktemp 2023-11-26T07:18:15.645 INFO:teuthology.orchestra.run.smithi192.stdout:/tmp/tmp.fL3mBv3wML 2023-11-26T07:18:15.646 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.fL3mBv3wML 2023-11-26T07:18:15.827 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0666 /tmp/tmp.fL3mBv3wML 2023-11-26T07:18:15.912 DEBUG:teuthology.orchestra.remote:smithi192:/tmp/tmp.fL3mBv3wML is 747KB 2023-11-26T07:18:16.012 DEBUG:teuthology.orchestra.run.smithi192:> rm -fr /tmp/tmp.fL3mBv3wML 2023-11-26T07:18:16.028 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-26T07:18:16.029 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-26T07:18:16.031 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-26T07:18:16.095 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-26T07:18:16.096 DEBUG:teuthology.orchestra.run.smithi002:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-26T07:18:16.104 DEBUG:teuthology.orchestra.run.smithi192:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-26T07:18:16.145 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-26T07:18:16.169 INFO:teuthology.orchestra.run.smithi192.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-26T07:18:16.174 INFO:tasks.ceph:Archiving crash dumps... 2023-11-26T07:18:16.176 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467341/remote/smithi002/crash 2023-11-26T07:18:16.177 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-26T07:18:16.208 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467341/remote/smithi192/crash 2023-11-26T07:18:16.209 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-26T07:18:16.240 INFO:tasks.ceph:Shutting down logrotate 2023-11-26T07:18:16.240 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:18:16.253 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:18:16.367 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-26T07:18:16.396 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-26T07:18:16.422 INFO:tasks.ceph:Compressing logs... 2023-11-26T07:18:16.423 DEBUG:teuthology.orchestra.run.smithi002:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-26T07:18:16.439 DEBUG:teuthology.orchestra.run.smithi192:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-26T07:18:16.505 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-11-26T07:18:16.505 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-26T07:18:16.506 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103624.log 2023-11-26T07:18:16.506 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.112934.log 2023-11-26T07:18:16.506 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.103624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103677.log 2023-11-26T07:18:16.506 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.112934.log: gzip -5 --verbose -- 88.1%/var/log/ceph/ceph-osd.6.log 2023-11-26T07:18:16.506 INFO:teuthology.orchestra.run.smithi192.stderr: -- replaced with /var/log/ceph/ceph-client.admin.103624.log.gz 2023-11-26T07:18:16.506 INFO:teuthology.orchestra.run.smithi192.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.112934.log.gz 2023-11-26T07:18:16.507 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.103677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.112930.log 2023-11-26T07:18:16.507 INFO:teuthology.orchestra.run.smithi192.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.103677.log.gz 2023-11-26T07:18:16.507 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103397.log 2023-11-26T07:18:16.507 INFO:teuthology.orchestra.run.smithi192.stderr:gzip /var/log/ceph/ceph-client.1.112930.log: -5 --verbose -- /var/log/ceph/ceph-client.1.111516.log 2023-11-26T07:18:16.507 INFO:teuthology.orchestra.run.smithi192.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.112930.log.gz 2023-11-26T07:18:16.507 INFO:teuthology.orchestra.run.smithi192.stderr: 92.4% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-26T07:18:16.507 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.103397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103579.log 2023-11-26T07:18:16.508 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.111516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.110112.log 2023-11-26T07:18:16.508 INFO:teuthology.orchestra.run.smithi192.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.103397.log.gz 2023-11-26T07:18:16.508 INFO:teuthology.orchestra.run.smithi192.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.111516.log.gz 2023-11-26T07:18:16.508 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.103579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.113632.log 2023-11-26T07:18:16.508 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.110112.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.103579.log.gz 2023-11-26T07:18:16.508 INFO:teuthology.orchestra.run.smithi192.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.110112.log.gz 2023-11-26T07:18:16.508 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.111520.log 2023-11-26T07:18:16.509 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.113632.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-11-26T07:18:16.509 INFO:teuthology.orchestra.run.smithi192.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.113632.log.gz 2023-11-26T07:18:16.509 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.111520.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-26T07:18:16.509 INFO:teuthology.orchestra.run.smithi192.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.111520.log.gz 2023-11-26T07:18:16.509 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-11-26T07:18:16.509 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103489.log 2023-11-26T07:18:16.509 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103442.log 2023-11-26T07:18:16.509 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.103489.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.103489.log.gz 2023-11-26T07:18:16.510 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.103442.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.103442.log.gz 2023-11-26T07:18:16.510 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-26T07:18:16.510 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.110120.log 2023-11-26T07:18:16.510 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.1.110120.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.110120.log.gz 2023-11-26T07:18:16.510 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.112210.log 2023-11-26T07:18:16.510 INFO:teuthology.orchestra.run.smithi192.stderr: 93.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-26T07:18:16.511 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.112210.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.112210.log.gz 2023-11-26T07:18:16.511 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-11-26T07:18:16.511 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.112206.log 2023-11-26T07:18:16.511 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-client.1.112206.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.112206.log.gz 2023-11-26T07:18:16.511 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.110731.log 2023-11-26T07:18:16.511 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.3.110731.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.110731.log.gz 2023-11-26T07:18:16.512 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-11-26T07:18:16.512 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103534.log 2023-11-26T07:18:16.512 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.103534.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.103534.log.gz 2023-11-26T07:18:16.512 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-11-26T07:18:16.518 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.113628.log 2023-11-26T07:18:16.541 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.113628.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.113628.log.gz 2023-11-26T07:18:16.541 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.110727.log 2023-11-26T07:18:16.545 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128640.log 2023-11-26T07:18:16.545 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162915.log 2023-11-26T07:18:16.545 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.128640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162072.log 2023-11-26T07:18:16.545 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.162915.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.128640.log.gz 2023-11-26T07:18:16.546 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161412.log 2023-11-26T07:18:16.546 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.162915.log.gz 2023-11-26T07:18:16.546 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.162072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126126.log 2023-11-26T07:18:16.546 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.161412.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.162072.log.gz 2023-11-26T07:18:16.546 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114244.log 2023-11-26T07:18:16.546 INFO:teuthology.orchestra.run.smithi002.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.161412.log.gz 2023-11-26T07:18:16.547 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.126126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109618.log 2023-11-26T07:18:16.547 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.114244.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.126126.log.gz 2023-11-26T07:18:16.547 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139072.log 2023-11-26T07:18:16.547 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.109618.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.114244.log.gz 2023-11-26T07:18:16.547 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115351.log 2023-11-26T07:18:16.547 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.109618.log.gz 2023-11-26T07:18:16.547 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.139072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127359.log 2023-11-26T07:18:16.548 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.139072.log.gz 2023-11-26T07:18:16.548 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.115351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115259.log 2023-11-26T07:18:16.548 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.127359.log: gzip -5 88.9%--verbose -- /var/log/ceph/ceph-client.admin.108838.log -- replaced with /var/log/ceph/ceph-client.admin.115351.log.gz 2023-11-26T07:18:16.548 INFO:teuthology.orchestra.run.smithi002.stderr: 2023-11-26T07:18:16.548 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.127359.log.gz 2023-11-26T07:18:16.548 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.115259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125988.log 2023-11-26T07:18:16.548 INFO:teuthology.orchestra.run.smithi002.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.115259.log.gz 2023-11-26T07:18:16.548 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139982.log 2023-11-26T07:18:16.549 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.108838.log: /var/log/ceph/ceph-client.admin.125988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117769.log 2023-11-26T07:18:16.549 INFO:teuthology.orchestra.run.smithi002.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.108838.log.gz 2023-11-26T07:18:16.549 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.139982.log: 87.3%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.125988.log.gz--verbose 2023-11-26T07:18:16.549 INFO:teuthology.orchestra.run.smithi002.stderr:-- /var/log/ceph/ceph-client.admin.150418.log 2023-11-26T07:18:16.549 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.139982.log.gz 2023-11-26T07:18:16.549 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.117769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150759.log 2023-11-26T07:18:16.550 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.150418.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.117769.log.gz 2023-11-26T07:18:16.550 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115719.log 2023-11-26T07:18:16.550 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.150759.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.150418.log.gz 2023-11-26T07:18:16.550 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163071.log 2023-11-26T07:18:16.550 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.150759.log.gz 2023-11-26T07:18:16.550 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.115719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126924.log 2023-11-26T07:18:16.550 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.163071.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.115719.log.gz 2023-11-26T07:18:16.551 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138685.log 2023-11-26T07:18:16.551 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.163071.log.gz 2023-11-26T07:18:16.551 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.126924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115213.log 2023-11-26T07:18:16.551 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.126924.log.gz 2023-11-26T07:18:16.551 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.138685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129032.log 2023-11-26T07:18:16.551 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.115213.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.138685.log.gz 2023-11-26T07:18:16.551 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127516.log 2023-11-26T07:18:16.552 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.115213.log.gz/var/log/ceph/ceph-client.admin.129032.log: 2023-11-26T07:18:16.552 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163683.log 2023-11-26T07:18:16.552 INFO:teuthology.orchestra.run.smithi002.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.129032.log.gz 2023-11-26T07:18:16.552 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.127516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114050.log 2023-11-26T07:18:16.552 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.163683.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.127516.log.gz 2023-11-26T07:18:16.552 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152549.log 2023-11-26T07:18:16.552 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.114050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139264.log 2023-11-26T07:18:16.553 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.163683.log.gz 2023-11-26T07:18:16.553 INFO:teuthology.orchestra.run.smithi002.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.114050.log.gz 2023-11-26T07:18:16.553 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.152549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149573.log 2023-11-26T07:18:16.553 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.152549.log.gz 2023-11-26T07:18:16.553 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.139264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111460.log 2023-11-26T07:18:16.553 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.149573.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.139264.log.gz 2023-11-26T07:18:16.553 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126675.log 2023-11-26T07:18:16.554 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.149573.log.gz 2023-11-26T07:18:16.554 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.111460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116263.log 2023-11-26T07:18:16.554 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.141270.log 2023-11-26T07:18:16.554 INFO:teuthology.orchestra.run.smithi002.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.111460.log.gz 2023-11-26T07:18:16.554 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.126675.log: /var/log/ceph/ceph-client.admin.116263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109321.log 2023-11-26T07:18:16.554 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.126675.log.gz 2023-11-26T07:18:16.554 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.141270.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.116263.log.gz 2023-11-26T07:18:16.555 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-26T07:18:16.555 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.141270.log.gz 2023-11-26T07:18:16.555 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.109321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.112150.log 2023-11-26T07:18:16.555 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129559.log 2023-11-26T07:18:16.555 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.109321.log.gz 2023-11-26T07:18:16.555 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.112150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113958.log 2023-11-26T07:18:16.556 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.112150.log.gz 2023-11-26T07:18:16.556 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.129559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140963.log 2023-11-26T07:18:16.556 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.113958.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.129559.log.gz 2023-11-26T07:18:16.556 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150192.log 2023-11-26T07:18:16.556 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.113958.log.gz 2023-11-26T07:18:16.556 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.140963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103525.log 2023-11-26T07:18:16.556 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111136.log 2023-11-26T07:18:16.557 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.150192.log: /var/log/ceph/ceph-client.admin.103525.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.140963.log.gz 2023-11-26T07:18:16.557 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127405.log 2023-11-26T07:18:16.557 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.150192.log.gz 2023-11-26T07:18:16.557 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.103525.log.gz 2023-11-26T07:18:16.557 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.111136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149519.log 2023-11-26T07:18:16.557 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.127405.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.111136.log.gz 2023-11-26T07:18:16.557 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149665.log 2023-11-26T07:18:16.558 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.127405.log.gz 2023-11-26T07:18:16.558 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.149519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116493.log 2023-11-26T07:18:16.558 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.149665.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.149519.log.gz 2023-11-26T07:18:16.558 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161642.log 2023-11-26T07:18:16.558 INFO:teuthology.orchestra.run.smithi002.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.149665.log.gz 2023-11-26T07:18:16.558 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.153057.log 2023-11-26T07:18:16.558 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.116493.log: /var/log/ceph/ceph-client.admin.161642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110814.log 2023-11-26T07:18:16.559 INFO:teuthology.orchestra.run.smithi002.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.116493.log.gz 2023-11-26T07:18:16.559 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.153057.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.153057.log.gz 2023-11-26T07:18:16.559 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- 87.1%/var/log/ceph/ceph-client.admin.110185.log 2023-11-26T07:18:16.559 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.161642.log.gz 2023-11-26T07:18:16.559 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.110814.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-26T07:18:16.559 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.110185.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.110814.log.gz 2023-11-26T07:18:16.560 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141033.log 2023-11-26T07:18:16.560 INFO:teuthology.orchestra.run.smithi002.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.110185.log.gz 2023-11-26T07:18:16.560 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139897.log 2023-11-26T07:18:16.560 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.141033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137564.log 2023-11-26T07:18:16.560 INFO:teuthology.orchestra.run.smithi002.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.141033.log.gz 2023-11-26T07:18:16.560 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.139897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115535.log 2023-11-26T07:18:16.560 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.139897.log.gz 2023-11-26T07:18:16.561 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 /var/log/ceph/ceph-client.admin.137564.log: --verbose -- /var/log/ceph/ceph-client.admin.125669.log 2023-11-26T07:18:16.561 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.115535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138934.log 2023-11-26T07:18:16.561 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.137564.log.gz 2023-11-26T07:18:16.561 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.125669.log: gzip -5 --verbose -- 87.7%/var/log/ceph/ceph-client.admin.113498.log 2023-11-26T07:18:16.561 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.115535.log.gz 2023-11-26T07:18:16.561 INFO:teuthology.orchestra.run.smithi002.stderr: 86.1% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-26T07:18:16.562 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.138934.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.125669.log.gz 2023-11-26T07:18:16.562 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139632.log 2023-11-26T07:18:16.562 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.113498.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.138934.log.gz 2023-11-26T07:18:16.562 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108995.log 2023-11-26T07:18:16.562 INFO:teuthology.orchestra.run.smithi002.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.113498.log.gz 2023-11-26T07:18:16.562 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.139632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103217.log 2023-11-26T07:18:16.562 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110193.log 2023-11-26T07:18:16.563 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.108995.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.139632.log.gz 2023-11-26T07:18:16.563 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.103217.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.108995.log.gz 2023-11-26T07:18:16.563 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161872.log 2023-11-26T07:18:16.563 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.110193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114336.log 2023-11-26T07:18:16.563 INFO:teuthology.orchestra.run.smithi002.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.103217.log.gz 2023-11-26T07:18:16.563 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.161872.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110193.log.gz 2023-11-26T07:18:16.563 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108949.log 2023-11-26T07:18:16.564 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.114336.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.161872.log.gz 2023-11-26T07:18:16.564 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152457.log 2023-11-26T07:18:16.564 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.114336.log.gz 2023-11-26T07:18:16.564 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.108949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151667.log 2023-11-26T07:18:16.564 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.152457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103658.log 2023-11-26T07:18:16.564 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.108949.log.gz 2023-11-26T07:18:16.564 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.151667.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.152457.log.gz 2023-11-26T07:18:16.564 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163775.log 2023-11-26T07:18:16.565 INFO:teuthology.orchestra.run.smithi002.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.151667.log.gz 2023-11-26T07:18:16.565 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.103658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139402.log 2023-11-26T07:18:16.565 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.163775.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.103658.log.gz 2023-11-26T07:18:16.565 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137861.log 2023-11-26T07:18:16.565 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.139402.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.163775.log.gz 2023-11-26T07:18:16.565 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110184.log 2023-11-26T07:18:16.565 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.139402.log.gz 2023-11-26T07:18:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111414.log 2023-11-26T07:18:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.137861.log: /var/log/ceph/ceph-client.admin.110184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128212.log 2023-11-26T07:18:16.566 INFO:teuthology.orchestra.run.smithi002.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.137861.log.gz 2023-11-26T07:18:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.111414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164189.log 2023-11-26T07:18:16.566 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110184.log.gz 2023-11-26T07:18:16.566 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.111414.log.gz 2023-11-26T07:18:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.128212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152754.log 2023-11-26T07:18:16.567 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.128212.log.gz 2023-11-26T07:18:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111660.log 2023-11-26T07:18:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.164189.log: /var/log/ceph/ceph-client.admin.152754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150464.log 2023-11-26T07:18:16.567 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.164189.log.gz 2023-11-26T07:18:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.111660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149711.log 2023-11-26T07:18:16.567 INFO:teuthology.orchestra.run.smithi002.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.152754.log.gz 2023-11-26T07:18:16.567 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.111660.log.gz 2023-11-26T07:18:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.150464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115305.log 2023-11-26T07:18:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 88.6%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.150464.log.gz/var/log/ceph/ceph-client.admin.162685.log 2023-11-26T07:18:16.568 INFO:teuthology.orchestra.run.smithi002.stderr: 2023-11-26T07:18:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.149711.log: /var/log/ceph/ceph-client.admin.115305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116587.log 2023-11-26T07:18:16.568 INFO:teuthology.orchestra.run.smithi002.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.149711.log.gz 2023-11-26T07:18:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.162685.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.115305.log.gz 2023-11-26T07:18:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162298.log 2023-11-26T07:18:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose 88.6%-- /var/log/ceph/ceph-client.admin.109871.log -- replaced with /var/log/ceph/ceph-client.admin.162685.log.gz 2023-11-26T07:18:16.569 INFO:teuthology.orchestra.run.smithi002.stderr: 2023-11-26T07:18:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.116587.log: /var/log/ceph/ceph-client.admin.162298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114941.log 2023-11-26T07:18:16.569 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.116587.log.gz 2023-11-26T07:18:16.569 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.162298.log.gz 2023-11-26T07:18:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.109871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139807.log 2023-11-26T07:18:16.570 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.109871.log.gz 2023-11-26T07:18:16.570 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.114941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163118.log 2023-11-26T07:18:16.570 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.114941.log.gz 2023-11-26T07:18:16.570 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.139807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.112142.log 2023-11-26T07:18:16.570 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.139807.log.gz 2023-11-26T07:18:16.570 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138796.log 2023-11-26T07:18:16.571 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.163118.log: /var/log/ceph/ceph-client.0.112142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113083.log 2023-11-26T07:18:16.571 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.112142.log.gz 2023-11-26T07:18:16.571 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.163118.log.gz 2023-11-26T07:18:16.571 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.138796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161458.log 2023-11-26T07:18:16.571 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.138796.log.gz 2023-11-26T07:18:16.571 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.113083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126034.log 2023-11-26T07:18:16.572 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.113083.log.gz 2023-11-26T07:18:16.572 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.161458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128494.log 2023-11-26T07:18:16.572 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.161458.log.gz 2023-11-26T07:18:16.572 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.126034.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-11-26T07:18:16.572 INFO:teuthology.orchestra.run.smithi002.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.126034.log.gz 2023-11-26T07:18:16.572 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151422.log 2023-11-26T07:18:16.572 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.128494.log: /var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152273.log 2023-11-26T07:18:16.573 INFO:teuthology.orchestra.run.smithi002.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.128494.log.gz 2023-11-26T07:18:16.573 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.151422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115903.log 2023-11-26T07:18:16.573 INFO:teuthology.orchestra.run.smithi002.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.151422.log.gz 2023-11-26T07:18:16.573 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.152273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115765.log 2023-11-26T07:18:16.573 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128824.log 2023-11-26T07:18:16.573 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.115903.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.152273.log.gz 2023-11-26T07:18:16.573 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.115765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141514.log 2023-11-26T07:18:16.574 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.115903.log.gz 2023-11-26T07:18:16.574 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.128824.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.115765.log.gz 2023-11-26T07:18:16.574 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.128824.log.gz 2023-11-26T07:18:16.574 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.141514.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.141514.log.gz 2023-11-26T07:18:16.574 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128686.log 2023-11-26T07:18:16.574 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116689.log 2023-11-26T07:18:16.574 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.128686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109526.log 2023-11-26T07:18:16.575 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.128686.log.gz 2023-11-26T07:18:16.575 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.116689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115993.log 2023-11-26T07:18:16.575 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126218.log 2023-11-26T07:18:16.575 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.109526.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.116689.log.gz 2023-11-26T07:18:16.575 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.115993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138321.log 2023-11-26T07:18:16.575 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.109526.log.gz 2023-11-26T07:18:16.575 INFO:teuthology.orchestra.run.smithi002.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.115993.log.gz 2023-11-26T07:18:16.576 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.126218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150621.log 2023-11-26T07:18:16.576 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose 87.2%-- /var/log/ceph/ceph-client.admin.151192.log -- replaced with /var/log/ceph/ceph-client.admin.126218.log.gz 2023-11-26T07:18:16.576 INFO:teuthology.orchestra.run.smithi002.stderr: 2023-11-26T07:18:16.576 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.138321.log: /var/log/ceph/ceph-client.admin.150621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125715.log 2023-11-26T07:18:16.576 INFO:teuthology.orchestra.run.smithi002.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.138321.log.gz 2023-11-26T07:18:16.576 INFO:teuthology.orchestra.run.smithi002.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.150621.log.gz 2023-11-26T07:18:16.576 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.151192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151798.log 2023-11-26T07:18:16.577 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.125715.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.151192.log.gz 2023-11-26T07:18:16.577 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115443.log 2023-11-26T07:18:16.577 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.125715.log.gz 2023-11-26T07:18:16.577 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.151798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109041.log 2023-11-26T07:18:16.577 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-11-26T07:18:16.577 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.115443.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.151798.log.gz 2023-11-26T07:18:16.577 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.109041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127175.log 2023-11-26T07:18:16.578 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.115443.log.gz 2023-11-26T07:18:16.578 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116735.log 2023-11-26T07:18:16.578 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.109041.log.gz 2023-11-26T07:18:16.578 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.127175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161320.log 2023-11-26T07:18:16.578 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.116735.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.127175.log.gz 2023-11-26T07:18:16.578 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.161320.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.116735.log.gz 2023-11-26T07:18:16.579 INFO:teuthology.orchestra.run.smithi002.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.161320.log.gz 2023-11-26T07:18:16.579 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163913.log 2023-11-26T07:18:16.579 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114849.log 2023-11-26T07:18:16.579 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.163913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140641.log 2023-11-26T07:18:16.579 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.114849.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.163913.log.gz 2023-11-26T07:18:16.579 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.140641.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.114849.log.gz 2023-11-26T07:18:16.579 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.140641.log.gz 2023-11-26T07:18:16.580 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110560.log 2023-11-26T07:18:16.580 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153352.log 2023-11-26T07:18:16.580 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.110560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161504.log 2023-11-26T07:18:16.580 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.153352.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.110560.log.gz 2023-11-26T07:18:16.580 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.161504.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.153352.log.gz 2023-11-26T07:18:16.581 INFO:teuthology.orchestra.run.smithi002.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.161504.log.gz 2023-11-26T07:18:16.581 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161550.log 2023-11-26T07:18:16.581 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117631.log 2023-11-26T07:18:16.581 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.161550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150713.log 2023-11-26T07:18:16.581 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.117631.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.161550.log.gz 2023-11-26T07:18:16.581 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.150713.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.117631.log.gz 2023-11-26T07:18:16.581 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.150713.log.gz 2023-11-26T07:18:16.582 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163545.log 2023-11-26T07:18:16.582 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114654.log 2023-11-26T07:18:16.582 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.163545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127746.log 2023-11-26T07:18:16.582 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.114654.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.163545.log.gz 2023-11-26T07:18:16.582 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.127746.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.114654.log.gz 2023-11-26T07:18:16.582 INFO:teuthology.orchestra.run.smithi002.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.127746.log.gz 2023-11-26T07:18:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126991.log 2023-11-26T07:18:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137518.log 2023-11-26T07:18:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.126991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127313.log 2023-11-26T07:18:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.137518.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.126991.log.gz 2023-11-26T07:18:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.127313.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.137518.log.gz 2023-11-26T07:18:16.583 INFO:teuthology.orchestra.run.smithi002.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.127313.log.gz 2023-11-26T07:18:16.583 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-11-26T07:18:16.584 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128258.log 2023-11-26T07:18:16.584 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126587.log 2023-11-26T07:18:16.584 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.128258.log: /var/log/ceph/ceph-client.admin.126587.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.128258.log.gz 2023-11-26T07:18:16.584 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.126587.log.gz 2023-11-26T07:18:16.584 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161366.log 2023-11-26T07:18:16.584 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128540.log 2023-11-26T07:18:16.584 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.161366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164281.log 2023-11-26T07:18:16.585 INFO:teuthology.orchestra.run.smithi002.stderr: 87.4%/var/log/ceph/ceph-client.admin.128540.log: -- replaced with /var/log/ceph/ceph-client.admin.161366.log.gz 2023-11-26T07:18:16.585 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.128540.log.gz 2023-11-26T07:18:16.585 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.164281.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.164281.log.gz 2023-11-26T07:18:16.585 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117059.log 2023-11-26T07:18:16.585 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117105.log 2023-11-26T07:18:16.585 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.117059.log: /var/log/ceph/ceph-client.admin.117105.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.117059.log.gz 2023-11-26T07:18:16.585 INFO:teuthology.orchestra.run.smithi002.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.117105.log.gz 2023-11-26T07:18:16.586 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137702.log 2023-11-26T07:18:16.586 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128448.log 2023-11-26T07:18:16.586 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.137702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.112807.log 2023-11-26T07:18:16.586 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.128448.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.137702.log.gz 2023-11-26T07:18:16.586 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.2.112807.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.128448.log.gz 2023-11-26T07:18:16.586 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.112807.log.gz 2023-11-26T07:18:16.587 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110860.log 2023-11-26T07:18:16.587 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127267.log 2023-11-26T07:18:16.587 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.110860.log: /var/log/ceph/ceph-client.admin.127267.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110860.log.gz 2023-11-26T07:18:16.587 INFO:teuthology.orchestra.run.smithi002.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.127267.log.gz 2023-11-26T07:18:16.587 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137815.log 2023-11-26T07:18:16.587 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127037.log 2023-11-26T07:18:16.587 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.137815.log: /var/log/ceph/ceph-client.admin.127037.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.137815.log.gz 2023-11-26T07:18:16.588 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.127037.log.gz 2023-11-26T07:18:16.588 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111230.log 2023-11-26T07:18:16.588 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113405.log 2023-11-26T07:18:16.588 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.111230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139448.log 2023-11-26T07:18:16.588 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.113405.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.111230.log.gz 2023-11-26T07:18:16.588 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.139448.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.113405.log.gz 2023-11-26T07:18:16.589 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.139448.log.gz 2023-11-26T07:18:16.589 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128732.log 2023-11-26T07:18:16.589 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117585.log 2023-11-26T07:18:16.589 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.128732.log: /var/log/ceph/ceph-client.admin.117585.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.128732.log.gz 2023-11-26T07:18:16.589 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151937.log 2023-11-26T07:18:16.589 INFO:teuthology.orchestra.run.smithi002.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.117585.log.gz 2023-11-26T07:18:16.589 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150008.log 2023-11-26T07:18:16.590 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.151937.log: /var/log/ceph/ceph-client.admin.150008.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.151937.log.gz 2023-11-26T07:18:16.590 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.150008.log.gz 2023-11-26T07:18:16.590 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138888.log 2023-11-26T07:18:16.590 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139540.log 2023-11-26T07:18:16.590 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.138888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126172.log 2023-11-26T07:18:16.591 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.139540.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.138888.log.gz 2023-11-26T07:18:16.591 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.139540.log.gz 2023-11-26T07:18:16.591 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.126172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113221.log 2023-11-26T07:18:16.591 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.126172.log.gz 2023-11-26T07:18:16.591 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152319.log 2023-11-26T07:18:16.591 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.113221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140263.log 2023-11-26T07:18:16.591 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.152319.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.113221.log.gz 2023-11-26T07:18:16.592 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.152319.log.gz 2023-11-26T07:18:16.592 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.140263.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.140263.log.gz 2023-11-26T07:18:16.592 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138229.log 2023-11-26T07:18:16.592 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128870.log 2023-11-26T07:18:16.592 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.138229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109275.log 2023-11-26T07:18:16.592 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.128870.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.138229.log.gz 2023-11-26T07:18:16.592 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.109275.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.128870.log.gz 2023-11-26T07:18:16.593 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.109275.log.gz 2023-11-26T07:18:16.593 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137953.log 2023-11-26T07:18:16.593 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116635.log 2023-11-26T07:18:16.593 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.137953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127838.log 2023-11-26T07:18:16.593 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.116635.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.137953.log.gz 2023-11-26T07:18:16.593 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.127838.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.116635.log.gz 2023-11-26T07:18:16.593 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.127838.log.gz 2023-11-26T07:18:16.594 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161826.log 2023-11-26T07:18:16.594 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153214.log 2023-11-26T07:18:16.594 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.161826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128594.log 2023-11-26T07:18:16.594 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.153214.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.161826.log.gz 2023-11-26T07:18:16.594 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.128594.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.153214.log.gz 2023-11-26T07:18:16.594 INFO:teuthology.orchestra.run.smithi002.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.128594.log.gz 2023-11-26T07:18:16.594 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151891.log 2023-11-26T07:18:16.595 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139026.log 2023-11-26T07:18:16.595 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.151891.log: /var/log/ceph/ceph-client.admin.139026.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.151891.log.gz 2023-11-26T07:18:16.595 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139494.log 2023-11-26T07:18:16.595 INFO:teuthology.orchestra.run.smithi002.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.139026.log.gz 2023-11-26T07:18:16.595 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161273.log 2023-11-26T07:18:16.595 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.139494.log: /var/log/ceph/ceph-client.admin.161273.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.139494.log.gz 2023-11-26T07:18:16.595 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.161273.log.gz 2023-11-26T07:18:16.596 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110491.log 2023-11-26T07:18:16.596 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109865.log 2023-11-26T07:18:16.596 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.110491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138413.log 2023-11-26T07:18:16.596 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.109865.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.110491.log.gz 2023-11-26T07:18:16.596 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.138413.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.109865.log.gz 2023-11-26T07:18:16.596 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150100.log 2023-11-26T07:18:16.597 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.138413.log.gz 2023-11-26T07:18:16.597 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110561.log 2023-11-26T07:18:16.597 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.150100.log: /var/log/ceph/ceph-client.admin.110561.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.150100.log.gz 2023-11-26T07:18:16.597 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.110561.log.gz 2023-11-26T07:18:16.597 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114562.log 2023-11-26T07:18:16.597 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116829.log 2023-11-26T07:18:16.597 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.114562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125942.log 2023-11-26T07:18:16.598 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.116829.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.114562.log.gz 2023-11-26T07:18:16.598 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.125942.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.116829.log.gz 2023-11-26T07:18:16.598 INFO:teuthology.orchestra.run.smithi002.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.125942.log.gz 2023-11-26T07:18:16.598 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114428.log 2023-11-26T07:18:16.598 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127884.log 2023-11-26T07:18:16.598 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.114428.log: /var/log/ceph/ceph-client.admin.127884.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.114428.log.gz 2023-11-26T07:18:16.598 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.127884.log.gz 2023-11-26T07:18:16.599 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127221.log 2023-11-26T07:18:16.599 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111090.log 2023-11-26T07:18:16.599 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.127221.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-11-26T07:18:16.599 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.111090.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.127221.log.gz 2023-11-26T07:18:16.599 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-mds.c.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.111090.log.gz 2023-11-26T07:18:16.599 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138842.log 2023-11-26T07:18:16.599 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111322.log 2023-11-26T07:18:16.600 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.138842.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.138842.log.gz 2023-11-26T07:18:16.600 INFO:teuthology.orchestra.run.smithi002.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-11-26T07:18:16.600 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.141266.log 2023-11-26T07:18:16.601 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-11-26T07:18:16.601 INFO:teuthology.orchestra.run.smithi192.stderr: 95.5% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-11-26T07:18:16.602 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-mds.b.log: /var/log/ceph/ceph-client.3.110727.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.110727.log.gz 2023-11-26T07:18:16.602 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103350.log 2023-11-26T07:18:16.602 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.103350.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.103350.log.gz 2023-11-26T07:18:16.638 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.111322.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.111322.log.gz 2023-11-26T07:18:16.638 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.141266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114987.log 2023-11-26T07:18:16.638 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.141266.log.gz 2023-11-26T07:18:16.638 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162344.log 2023-11-26T07:18:16.638 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.114987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140595.log 2023-11-26T07:18:16.638 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.162344.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.114987.log.gz 2023-11-26T07:18:16.639 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.140595.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.162344.log.gz 2023-11-26T07:18:16.639 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.140595.log.gz 2023-11-26T07:18:16.639 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163959.log 2023-11-26T07:18:16.639 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113452.log 2023-11-26T07:18:16.639 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.163959.log: /var/log/ceph/ceph-client.admin.113452.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.163959.log.gz 2023-11-26T07:18:16.639 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161596.log 2023-11-26T07:18:16.639 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.113452.log.gz 2023-11-26T07:18:16.640 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149473.log 2023-11-26T07:18:16.640 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.161596.log: /var/log/ceph/ceph-client.admin.149473.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.161596.log.gz 2023-11-26T07:18:16.640 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.149473.log.gz 2023-11-26T07:18:16.640 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115397.log 2023-11-26T07:18:16.640 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126813.log 2023-11-26T07:18:16.640 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.115397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150054.log 2023-11-26T07:18:16.640 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.126813.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.115397.log.gz 2023-11-26T07:18:16.641 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.150054.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.126813.log.gz 2023-11-26T07:18:16.641 INFO:teuthology.orchestra.run.smithi002.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.150054.log.gz 2023-11-26T07:18:16.641 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127792.log 2023-11-26T07:18:16.641 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111183.log 2023-11-26T07:18:16.641 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.127792.log: /var/log/ceph/ceph-client.admin.111183.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.127792.log.gz 2023-11-26T07:18:16.641 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.111183.log.gz 2023-11-26T07:18:16.641 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127700.log 2023-11-26T07:18:16.642 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141376.log 2023-11-26T07:18:16.642 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115489.log 2023-11-26T07:18:16.642 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.127700.log: /var/log/ceph/ceph-client.admin.141376.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.127700.log.gz 2023-11-26T07:18:16.642 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.115489.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.141376.log.gz 2023-11-26T07:18:16.642 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.115489.log.gz 2023-11-26T07:18:16.642 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125896.log 2023-11-26T07:18:16.642 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140363.log 2023-11-26T07:18:16.643 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.125896.log: /var/log/ceph/ceph-client.admin.140363.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.125896.log.gz 2023-11-26T07:18:16.643 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.140363.log.gz 2023-11-26T07:18:16.643 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162639.log 2023-11-26T07:18:16.643 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128306.log 2023-11-26T07:18:16.643 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.162639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137907.log 2023-11-26T07:18:16.643 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.128306.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.162639.log.gz 2023-11-26T07:18:16.644 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.137907.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.128306.log.gz 2023-11-26T07:18:16.644 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.137907.log.gz 2023-11-26T07:18:16.644 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151844.log 2023-11-26T07:18:16.644 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139310.log 2023-11-26T07:18:16.644 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.151844.log: /var/log/ceph/ceph-client.admin.139310.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.151844.log.gz 2023-11-26T07:18:16.644 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110906.log 2023-11-26T07:18:16.644 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.139310.log.gz 2023-11-26T07:18:16.645 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161734.log 2023-11-26T07:18:16.645 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.110906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163591.log 2023-11-26T07:18:16.645 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.161734.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110906.log.gz 2023-11-26T07:18:16.645 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.163591.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.161734.log.gz 2023-11-26T07:18:16.645 INFO:teuthology.orchestra.run.smithi002.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.163591.log.gz 2023-11-26T07:18:16.645 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126449.log 2023-11-26T07:18:16.646 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110492.log 2023-11-26T07:18:16.646 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.126449.log: /var/log/ceph/ceph-client.admin.110492.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.126449.log.gz 2023-11-26T07:18:16.646 INFO:teuthology.orchestra.run.smithi002.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.110492.log.gz 2023-11-26T07:18:16.646 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138275.log 2023-11-26T07:18:16.646 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163637.log 2023-11-26T07:18:16.646 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.138275.log: /var/log/ceph/ceph-client.admin.163637.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.138275.log.gz 2023-11-26T07:18:16.646 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.163637.log.gz 2023-11-26T07:18:16.647 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152365.log 2023-11-26T07:18:16.647 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109858.log 2023-11-26T07:18:16.647 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.152365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112372.log 2023-11-26T07:18:16.647 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.109858.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.152365.log.gz 2023-11-26T07:18:16.647 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.112372.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.109858.log.gz 2023-11-26T07:18:16.647 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.112372.log.gz 2023-11-26T07:18:16.647 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152087.log 2023-11-26T07:18:16.648 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151053.log 2023-11-26T07:18:16.648 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.152087.log: /var/log/ceph/ceph-client.admin.151053.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.152087.log.gz 2023-11-26T07:18:16.648 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.151053.log.gz 2023-11-26T07:18:16.648 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151238.log 2023-11-26T07:18:16.648 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162210.log 2023-11-26T07:18:16.648 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.151238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110191.log 2023-11-26T07:18:16.648 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.162210.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.151238.log.gz 2023-11-26T07:18:16.649 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.110191.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.162210.log.gz 2023-11-26T07:18:16.649 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.110191.log.gz 2023-11-26T07:18:16.649 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149619.log 2023-11-26T07:18:16.649 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116447.log 2023-11-26T07:18:16.649 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.149619.log: /var/log/ceph/ceph-client.admin.116447.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.149619.log.gz 2023-11-26T07:18:16.649 INFO:teuthology.orchestra.run.smithi002.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.116447.log.gz 2023-11-26T07:18:16.649 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140121.log 2023-11-26T07:18:16.650 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151985.log 2023-11-26T07:18:16.650 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.140121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151376.log 2023-11-26T07:18:16.650 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.151985.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.140121.log.gz 2023-11-26T07:18:16.650 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.151376.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.151985.log.gz 2023-11-26T07:18:16.650 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.151376.log.gz 2023-11-26T07:18:16.650 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116875.log 2023-11-26T07:18:16.651 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.129269.log 2023-11-26T07:18:16.651 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.116875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115167.log 2023-11-26T07:18:16.651 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.129269.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.116875.log.gz 2023-11-26T07:18:16.651 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.129269.log.gz 2023-11-26T07:18:16.651 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.115167.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.115167.log.gz 2023-11-26T07:18:16.651 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163821.log 2023-11-26T07:18:16.651 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150146.log 2023-11-26T07:18:16.652 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.163821.log: /var/log/ceph/ceph-client.admin.150146.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.163821.log.gz 2023-11-26T07:18:16.652 INFO:teuthology.orchestra.run.smithi002.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.150146.log.gz 2023-11-26T07:18:16.652 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113175.log 2023-11-26T07:18:16.652 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149757.log 2023-11-26T07:18:16.652 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.113175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152179.log 2023-11-26T07:18:16.652 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.149757.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.113175.log.gz 2023-11-26T07:18:16.652 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.152179.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.149757.log.gz 2023-11-26T07:18:16.653 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.152179.log.gz 2023-11-26T07:18:16.653 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116967.log 2023-11-26T07:18:16.653 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152616.log 2023-11-26T07:18:16.653 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.116967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164544.log 2023-11-26T07:18:16.653 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.152616.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.116967.log.gz 2023-11-26T07:18:16.653 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.164544.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.152616.log.gz 2023-11-26T07:18:16.654 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109572.log 2023-11-26T07:18:16.654 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.164544.log.gz 2023-11-26T07:18:16.654 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139172.log 2023-11-26T07:18:16.654 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.109572.log: /var/log/ceph/ceph-client.admin.139172.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.109572.log.gz 2023-11-26T07:18:16.654 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.139172.log.gz 2023-11-26T07:18:16.654 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.129265.log 2023-11-26T07:18:16.654 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117815.log 2023-11-26T07:18:16.655 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.129265.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.129265.log.gz 2023-11-26T07:18:16.655 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.117815.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.117815.log.gz 2023-11-26T07:18:16.655 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-26T07:18:16.655 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150372.log 2023-11-26T07:18:16.655 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140779.log 2023-11-26T07:18:16.655 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.150372.log: /var/log/ceph/ceph-client.admin.140779.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.150372.log.gz 2023-11-26T07:18:16.656 INFO:teuthology.orchestra.run.smithi002.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.140779.log.gz 2023-11-26T07:18:16.656 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150805.log 2023-11-26T07:18:16.656 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109869.log 2023-11-26T07:18:16.656 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.150805.log: /var/log/ceph/ceph-client.admin.109869.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.150805.log.gz 2023-11-26T07:18:16.656 INFO:teuthology.orchestra.run.smithi002.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.109869.log.gz 2023-11-26T07:18:16.656 INFO:teuthology.orchestra.run.smithi002.stderr: 89.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-26T07:18:16.656 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162547.log 2023-11-26T07:18:16.657 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151284.log 2023-11-26T07:18:16.657 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.162547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150667.log 2023-11-26T07:18:16.657 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.151284.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.162547.log.gz 2023-11-26T07:18:16.657 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.150667.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.151284.log.gz 2023-11-26T07:18:16.657 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.150667.log.gz 2023-11-26T07:18:16.657 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116355.log 2023-11-26T07:18:16.657 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129421.log 2023-11-26T07:18:16.658 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.116355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137656.log 2023-11-26T07:18:16.658 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.129421.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.116355.log.gz 2023-11-26T07:18:16.658 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.137656.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.129421.log.gz 2023-11-26T07:18:16.658 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.137656.log.gz 2023-11-26T07:18:16.658 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116169.log 2023-11-26T07:18:16.658 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113728.log 2023-11-26T07:18:16.659 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.116169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113774.log 2023-11-26T07:18:16.659 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.113728.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.116169.log.gz 2023-11-26T07:18:16.659 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.113774.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.113728.log.gz 2023-11-26T07:18:16.659 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.113774.log.gz 2023-11-26T07:18:16.659 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117221.log 2023-11-26T07:18:16.659 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141468.log 2023-11-26T07:18:16.659 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.117221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109870.log 2023-11-26T07:18:16.660 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.141468.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.117221.log.gz 2023-11-26T07:18:16.660 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.109870.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.141468.log.gz 2023-11-26T07:18:16.660 INFO:teuthology.orchestra.run.smithi002.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.109870.log.gz 2023-11-26T07:18:16.660 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140825.log 2023-11-26T07:18:16.660 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153398.log 2023-11-26T07:18:16.660 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.140825.log: /var/log/ceph/ceph-client.admin.153398.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.140825.log.gz 2023-11-26T07:18:16.660 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.153398.log.gz 2023-11-26T07:18:16.660 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110669.log 2023-11-26T07:18:16.661 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126767.log 2023-11-26T07:18:16.661 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.110669.log: /var/log/ceph/ceph-client.admin.126767.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.110669.log.gz 2023-11-26T07:18:16.661 INFO:teuthology.orchestra.run.smithi002.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.126767.log.gz 2023-11-26T07:18:16.661 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113682.log 2023-11-26T07:18:16.661 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109861.log 2023-11-26T07:18:16.661 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.113682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152227.log 2023-11-26T07:18:16.661 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.109861.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.113682.log.gz 2023-11-26T07:18:16.662 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.152227.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.109861.log.gz 2023-11-26T07:18:16.662 INFO:teuthology.orchestra.run.smithi002.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.152227.log.gz 2023-11-26T07:18:16.662 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110559.log 2023-11-26T07:18:16.662 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140733.log 2023-11-26T07:18:16.662 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.110559.log: /var/log/ceph/ceph-client.admin.140733.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.110559.log.gz 2023-11-26T07:18:16.662 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.140733.log.gz 2023-11-26T07:18:16.663 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109137.log 2023-11-26T07:18:16.663 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140457.log 2023-11-26T07:18:16.663 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.109137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161688.log 2023-11-26T07:18:16.663 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.140457.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.109137.log.gz 2023-11-26T07:18:16.663 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.140457.log.gz 2023-11-26T07:18:16.663 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.161688.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.161688.log.gz 2023-11-26T07:18:16.663 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138501.log 2023-11-26T07:18:16.664 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150280.log 2023-11-26T07:18:16.664 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.138501.log: /var/log/ceph/ceph-client.admin.150280.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.138501.log.gz 2023-11-26T07:18:16.664 INFO:teuthology.orchestra.run.smithi002.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.150280.log.gz 2023-11-26T07:18:16.664 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141560.log 2023-11-26T07:18:16.664 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163231.log 2023-11-26T07:18:16.664 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.141560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126080.log 2023-11-26T07:18:16.664 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.163231.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.141560.log.gz 2023-11-26T07:18:16.665 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.126080.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.163231.log.gz 2023-11-26T07:18:16.665 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.126080.log.gz 2023-11-26T07:18:16.665 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164634.log 2023-11-26T07:18:16.665 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114895.log 2023-11-26T07:18:16.665 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.164634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138639.log 2023-11-26T07:18:16.665 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.114895.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.164634.log.gz 2023-11-26T07:18:16.666 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.138639.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.114895.log.gz 2023-11-26T07:18:16.666 INFO:teuthology.orchestra.run.smithi002.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.138639.log.gz 2023-11-26T07:18:16.666 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110240.log 2023-11-26T07:18:16.666 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164051.log 2023-11-26T07:18:16.666 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.110240.log: /var/log/ceph/ceph-client.admin.164051.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.110240.log.gz 2023-11-26T07:18:16.666 INFO:teuthology.orchestra.run.smithi002.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.164051.log.gz 2023-11-26T07:18:16.666 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149803.log 2023-11-26T07:18:16.667 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152824.log 2023-11-26T07:18:16.667 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109868.log 2023-11-26T07:18:16.667 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.149803.log: /var/log/ceph/ceph-client.admin.152824.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.149803.log.gz 2023-11-26T07:18:16.667 INFO:teuthology.orchestra.run.smithi002.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.152824.log.gz 2023-11-26T07:18:16.667 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.109868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151100.log 2023-11-26T07:18:16.667 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.109868.log.gz 2023-11-26T07:18:16.667 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150851.log 2023-11-26T07:18:16.668 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.151100.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.151100.log.gz 2023-11-26T07:18:16.668 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128400.log 2023-11-26T07:18:16.668 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.150851.log: /var/log/ceph/ceph-client.admin.128400.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.150851.log.gz 2023-11-26T07:18:16.668 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164373.log 2023-11-26T07:18:16.668 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.128400.log.gz 2023-11-26T07:18:16.668 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114004.log 2023-11-26T07:18:16.669 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.164373.log: /var/log/ceph/ceph-client.admin.114004.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.164373.log.gz 2023-11-26T07:18:16.669 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140549.log 2023-11-26T07:18:16.669 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.114004.log.gz 2023-11-26T07:18:16.669 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127562.log 2023-11-26T07:18:16.669 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.140549.log: /var/log/ceph/ceph-client.admin.127562.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.140549.log.gz 2023-11-26T07:18:16.669 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.127562.log.gz 2023-11-26T07:18:16.669 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126403.log 2023-11-26T07:18:16.670 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138980.log 2023-11-26T07:18:16.670 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.126403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110952.log 2023-11-26T07:18:16.670 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.138980.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.126403.log.gz 2023-11-26T07:18:16.670 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.110952.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.138980.log.gz 2023-11-26T07:18:16.670 INFO:teuthology.orchestra.run.smithi002.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.110952.log.gz 2023-11-26T07:18:16.670 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.153061.log 2023-11-26T07:18:16.670 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163867.log 2023-11-26T07:18:16.671 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.153061.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.153061.log.gz 2023-11-26T07:18:16.671 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.163867.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.163867.log.gz 2023-11-26T07:18:16.671 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116781.log 2023-11-26T07:18:16.671 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128916.log 2023-11-26T07:18:16.671 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.116781.log: /var/log/ceph/ceph-client.admin.128916.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.116781.log.gz 2023-11-26T07:18:16.671 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.128916.log.gz 2023-11-26T07:18:16.671 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114608.log 2023-11-26T07:18:16.672 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138547.log 2023-11-26T07:18:16.672 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.114608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117151.log 2023-11-26T07:18:16.672 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.138547.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.114608.log.gz 2023-11-26T07:18:16.672 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.117151.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.138547.log.gz 2023-11-26T07:18:16.672 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115121.log 2023-11-26T07:18:16.672 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150943.log 2023-11-26T07:18:16.672 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.115121.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.117151.log.gz 2023-11-26T07:18:16.673 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.150943.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.115121.log.gz 2023-11-26T07:18:16.673 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139356.log 2023-11-26T07:18:16.673 INFO:teuthology.orchestra.run.smithi002.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.150943.log.gz 2023-11-26T07:18:16.673 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.139356.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.139356.log.gz 2023-11-26T07:18:16.673 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162390.log 2023-11-26T07:18:16.673 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127654.log 2023-11-26T07:18:16.673 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.162390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111368.log 2023-11-26T07:18:16.674 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.127654.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.162390.log.gz 2023-11-26T07:18:16.674 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.111368.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.127654.log.gz 2023-11-26T07:18:16.674 INFO:teuthology.orchestra.run.smithi002.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.111368.log.gz 2023-11-26T07:18:16.674 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141422.log 2023-11-26T07:18:16.674 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-26T07:18:16.674 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.141422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162026.log 2023-11-26T07:18:16.674 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-osd.1.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.141422.log.gz 2023-11-26T07:18:16.675 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.162026.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.162026.log.gz 2023-11-26T07:18:16.675 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162593.log 2023-11-26T07:18:16.675 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151577.log 2023-11-26T07:18:16.675 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.162593.log: /var/log/ceph/ceph-client.admin.151577.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.162593.log.gz 2023-11-26T07:18:16.675 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.151577.log.gz 2023-11-26T07:18:16.675 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140317.log 2023-11-26T07:18:16.675 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116123.log 2023-11-26T07:18:16.676 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.140317.log: /var/log/ceph/ceph-client.admin.116123.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.140317.log.gz 2023-11-26T07:18:16.676 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.116123.log.gz 2023-11-26T07:18:16.676 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163007.log 2023-11-26T07:18:16.676 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110998.log 2023-11-26T07:18:16.676 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.163007.log: /var/log/ceph/ceph-client.admin.110998.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.163007.log.gz 2023-11-26T07:18:16.676 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140028.log 2023-11-26T07:18:16.677 INFO:teuthology.orchestra.run.smithi002.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.110998.log.gz 2023-11-26T07:18:16.677 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113359.log 2023-11-26T07:18:16.677 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.140028.log: /var/log/ceph/ceph-client.admin.113359.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.140028.log.gz 2023-11-26T07:18:16.677 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113359.log.gz 2023-11-26T07:18:16.677 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127992.log 2023-11-26T07:18:16.677 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140871.log 2023-11-26T07:18:16.677 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.127992.log: /var/log/ceph/ceph-client.admin.140871.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.127992.log.gz 2023-11-26T07:18:16.678 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.140871.log.gz 2023-11-26T07:18:16.678 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113820.log 2023-11-26T07:18:16.678 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127129.log 2023-11-26T07:18:16.678 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.113820.log: /var/log/ceph/ceph-client.admin.127129.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.113820.log.gz 2023-11-26T07:18:16.678 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.127129.log.gz 2023-11-26T07:18:16.678 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164143.log 2023-11-26T07:18:16.678 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109434.log 2023-11-26T07:18:16.679 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.164143.log: /var/log/ceph/ceph-client.admin.109434.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.164143.log.gz 2023-11-26T07:18:16.679 INFO:teuthology.orchestra.run.smithi002.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.109434.log.gz 2023-11-26T07:18:16.679 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108895.log 2023-11-26T07:18:16.679 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140917.log 2023-11-26T07:18:16.679 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.108895.log: /var/log/ceph/ceph-client.admin.140917.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.108895.log.gz 2023-11-26T07:18:16.679 INFO:teuthology.orchestra.run.smithi002.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.140917.log.gz 2023-11-26T07:18:16.679 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125782.log 2023-11-26T07:18:16.680 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116309.log 2023-11-26T07:18:16.680 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.125782.log: /var/log/ceph/ceph-client.admin.116309.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.125782.log.gz 2023-11-26T07:18:16.680 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.116309.log.gz 2023-11-26T07:18:16.680 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116077.log 2023-11-26T07:18:16.680 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109183.log 2023-11-26T07:18:16.680 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.116077.log: /var/log/ceph/ceph-client.admin.109183.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.116077.log.gz 2023-11-26T07:18:16.680 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.109183.log.gz 2023-11-26T07:18:16.681 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126859.log 2023-11-26T07:18:16.681 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109229.log 2023-11-26T07:18:16.681 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.126859.log: /var/log/ceph/ceph-client.admin.109229.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.126859.log.gz 2023-11-26T07:18:16.681 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.109229.log.gz 2023-11-26T07:18:16.681 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162777.log 2023-11-26T07:18:16.681 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109089.log 2023-11-26T07:18:16.681 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.162777.log: /var/log/ceph/ceph-client.admin.109089.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.162777.log.gz 2023-11-26T07:18:16.682 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.109089.log.gz 2023-11-26T07:18:16.682 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152133.log 2023-11-26T07:18:16.682 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162869.log 2023-11-26T07:18:16.682 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.152133.log: /var/log/ceph/ceph-client.admin.162869.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.152133.log.gz 2023-11-26T07:18:16.682 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.162869.log.gz 2023-11-26T07:18:16.682 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127608.log 2023-11-26T07:18:16.682 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.112803.log 2023-11-26T07:18:16.683 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.127608.log: /var/log/ceph/ceph-client.2.112803.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.127608.log.gz 2023-11-26T07:18:16.683 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.112803.log.gz 2023-11-26T07:18:16.683 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162164.log 2023-11-26T07:18:16.708 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115581.log 2023-11-26T07:18:16.708 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.162164.log: /var/log/ceph/ceph-client.admin.115581.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.162164.log.gz 2023-11-26T07:18:16.708 INFO:teuthology.orchestra.run.smithi002.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.115581.log.gz 2023-11-26T07:18:16.708 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139586.log 2023-11-26T07:18:16.709 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116401.log 2023-11-26T07:18:16.709 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.139586.log: /var/log/ceph/ceph-client.admin.116401.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.139586.log.gz 2023-11-26T07:18:16.709 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.116401.log.gz 2023-11-26T07:18:16.709 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151468.log 2023-11-26T07:18:16.709 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115673.log 2023-11-26T07:18:16.709 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.151468.log: /var/log/ceph/ceph-client.admin.115673.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.151468.log.gz 2023-11-26T07:18:16.709 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.115673.log.gz 2023-11-26T07:18:16.709 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164005.log 2023-11-26T07:18:16.710 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161918.log 2023-11-26T07:18:16.710 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.164005.log: /var/log/ceph/ceph-client.admin.161918.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.164005.log.gz 2023-11-26T07:18:16.710 INFO:teuthology.orchestra.run.smithi002.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.161918.log.gz 2023-11-26T07:18:16.710 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116921.log 2023-11-26T07:18:16.710 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162731.log 2023-11-26T07:18:16.710 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.116921.log: /var/log/ceph/ceph-client.admin.162731.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.116921.log.gz 2023-11-26T07:18:16.711 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.162731.log.gz 2023-11-26T07:18:16.711 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162961.log 2023-11-26T07:18:16.711 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129605.log 2023-11-26T07:18:16.711 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.162961.log: /var/log/ceph/ceph-client.admin.129605.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.162961.log.gz 2023-11-26T07:18:16.711 INFO:teuthology.orchestra.run.smithi002.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.129605.log.gz 2023-11-26T07:18:16.711 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108683.log 2023-11-26T07:18:16.711 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113866.log 2023-11-26T07:18:16.712 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.108683.log: /var/log/ceph/ceph-client.admin.113866.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.108683.log.gz 2023-11-26T07:18:16.712 INFO:teuthology.orchestra.run.smithi002.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.113866.log.gz 2023-11-26T07:18:16.712 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162482.log 2023-11-26T07:18:16.712 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114803.log 2023-11-26T07:18:16.712 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.162482.log: /var/log/ceph/ceph-client.admin.114803.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.162482.log.gz 2023-11-26T07:18:16.712 INFO:teuthology.orchestra.run.smithi002.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.114803.log.gz 2023-11-26T07:18:16.712 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141606.log 2023-11-26T07:18:16.713 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114382.log 2023-11-26T07:18:16.713 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.141606.log: /var/log/ceph/ceph-client.admin.114382.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.141606.log.gz 2023-11-26T07:18:16.713 INFO:teuthology.orchestra.run.smithi002.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.114382.log.gz 2023-11-26T07:18:16.713 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150575.log 2023-11-26T07:18:16.713 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114290.log 2023-11-26T07:18:16.713 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.150575.log: /var/log/ceph/ceph-client.admin.114290.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.150575.log.gz 2023-11-26T07:18:16.713 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.114290.log.gz 2023-11-26T07:18:16.714 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150529.log 2023-11-26T07:18:16.714 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126541.log 2023-11-26T07:18:16.714 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.150529.log: /var/log/ceph/ceph-client.admin.126541.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.150529.log.gz 2023-11-26T07:18:16.714 INFO:teuthology.orchestra.run.smithi002.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.126541.log.gz 2023-11-26T07:18:16.714 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151330.log 2023-11-26T07:18:16.714 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114096.log 2023-11-26T07:18:16.714 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.151330.log: /var/log/ceph/ceph-client.admin.114096.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.151330.log.gz 2023-11-26T07:18:16.715 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.114096.log.gz 2023-11-26T07:18:16.715 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151752.log 2023-11-26T07:18:16.715 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125850.log 2023-11-26T07:18:16.715 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.151752.log: /var/log/ceph/ceph-client.admin.125850.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.151752.log.gz 2023-11-26T07:18:16.715 INFO:teuthology.orchestra.run.smithi002.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.125850.log.gz 2023-11-26T07:18:16.715 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117723.log 2023-11-26T07:18:16.715 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138367.log 2023-11-26T07:18:16.716 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.117723.log: /var/log/ceph/ceph-client.admin.138367.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.117723.log.gz 2023-11-26T07:18:16.716 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.138367.log.gz 2023-11-26T07:18:16.716 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127469.log 2023-11-26T07:18:16.716 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110621.log 2023-11-26T07:18:16.716 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.127469.log: /var/log/ceph/ceph-client.admin.110621.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.127469.log.gz 2023-11-26T07:18:16.716 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110621.log.gz 2023-11-26T07:18:16.716 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162118.log 2023-11-26T07:18:16.717 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138593.log 2023-11-26T07:18:16.717 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.162118.log: /var/log/ceph/ceph-client.admin.138593.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.162118.log.gz 2023-11-26T07:18:16.717 INFO:teuthology.orchestra.run.smithi002.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.138593.log.gz 2023-11-26T07:18:16.717 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128962.log 2023-11-26T07:18:16.717 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163185.log 2023-11-26T07:18:16.717 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.128962.log: /var/log/ceph/ceph-client.admin.163185.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.163185.log.gz 2023-11-26T07:18:16.717 INFO:teuthology.orchestra.run.smithi002.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.128962.log.gz 2023-11-26T07:18:16.718 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126495.log 2023-11-26T07:18:16.718 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164465.log 2023-11-26T07:18:16.718 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.126495.log: /var/log/ceph/ceph-client.admin.164465.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.126495.log.gz 2023-11-26T07:18:16.718 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.164465.log.gz 2023-11-26T07:18:16.718 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115075.log 2023-11-26T07:18:16.718 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128778.log 2023-11-26T07:18:16.719 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.115075.log: /var/log/ceph/ceph-client.admin.128778.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.115075.log.gz 2023-11-26T07:18:16.719 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.128778.log.gz 2023-11-26T07:18:16.719 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113029.log 2023-11-26T07:18:16.719 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113544.log 2023-11-26T07:18:16.719 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.113029.log: /var/log/ceph/ceph-client.admin.113544.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.113029.log.gz 2023-11-26T07:18:16.719 INFO:teuthology.orchestra.run.smithi002.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.113544.log.gz 2023-11-26T07:18:16.719 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140167.log 2023-11-26T07:18:16.720 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113590.log 2023-11-26T07:18:16.720 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.140167.log: /var/log/ceph/ceph-client.admin.113590.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.140167.log.gz 2023-11-26T07:18:16.720 INFO:teuthology.orchestra.run.smithi002.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.113590.log.gz 2023-11-26T07:18:16.720 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115857.log 2023-11-26T07:18:16.720 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110446.log 2023-11-26T07:18:16.720 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.115857.log: /var/log/ceph/ceph-client.admin.110446.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.115857.log.gz 2023-11-26T07:18:16.720 INFO:teuthology.orchestra.run.smithi002.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.110446.log.gz 2023-11-26T07:18:16.721 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137748.log 2023-11-26T07:18:16.721 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114516.log 2023-11-26T07:18:16.721 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.137748.log: /var/log/ceph/ceph-client.admin.114516.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.137748.log.gz 2023-11-26T07:18:16.721 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.114516.log.gz 2023-11-26T07:18:16.721 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139218.log 2023-11-26T07:18:16.721 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164327.log 2023-11-26T07:18:16.721 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.139218.log: /var/log/ceph/ceph-client.admin.164327.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.139218.log.gz 2023-11-26T07:18:16.722 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.164327.log.gz 2023-11-26T07:18:16.722 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153260.log 2023-11-26T07:18:16.722 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164235.log 2023-11-26T07:18:16.722 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.153260.log: /var/log/ceph/ceph-client.admin.164235.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.153260.log.gz 2023-11-26T07:18:16.722 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.164235.log.gz 2023-11-26T07:18:16.722 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162823.log 2023-11-26T07:18:16.723 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138045.log 2023-11-26T07:18:16.723 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.162823.log: /var/log/ceph/ceph-client.admin.138045.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.162823.log.gz 2023-11-26T07:18:16.723 INFO:teuthology.orchestra.run.smithi002.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.138045.log.gz 2023-11-26T07:18:16.723 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140215.log 2023-11-26T07:18:16.723 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152662.log 2023-11-26T07:18:16.723 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.140215.log: /var/log/ceph/ceph-client.admin.152662.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.140215.log.gz 2023-11-26T07:18:16.723 INFO:teuthology.orchestra.run.smithi002.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.152662.log.gz 2023-11-26T07:18:16.724 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126721.log 2023-11-26T07:18:16.724 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117013.log 2023-11-26T07:18:16.724 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.126721.log: /var/log/ceph/ceph-client.admin.117013.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.126721.log.gz 2023-11-26T07:18:16.724 INFO:teuthology.orchestra.run.smithi002.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.117013.log.gz 2023-11-26T07:18:16.724 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110238.log 2023-11-26T07:18:16.724 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140409.log 2023-11-26T07:18:16.724 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.110238.log: /var/log/ceph/ceph-client.admin.140409.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.110238.log.gz 2023-11-26T07:18:16.725 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.140409.log.gz 2023-11-26T07:18:16.725 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.117479.log 2023-11-26T07:18:16.725 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109480.log 2023-11-26T07:18:16.725 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.117479.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.117479.log.gz 2023-11-26T07:18:16.725 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.109480.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.109480.log.gz 2023-11-26T07:18:16.725 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163323.log 2023-11-26T07:18:16.725 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110172.log 2023-11-26T07:18:16.726 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.163323.log: /var/log/ceph/ceph-client.admin.110172.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.163323.log.gz 2023-11-26T07:18:16.726 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.110172.log.gz 2023-11-26T07:18:16.726 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137610.log 2023-11-26T07:18:16.726 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163277.log 2023-11-26T07:18:16.726 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.137610.log: /var/log/ceph/ceph-client.admin.163277.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.137610.log.gz 2023-11-26T07:18:16.726 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.163277.log.gz 2023-11-26T07:18:16.726 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114700.log 2023-11-26T07:18:16.727 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.117475.log 2023-11-26T07:18:16.727 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.114700.log: /var/log/ceph/ceph-client.0.117475.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.114700.log.gz 2023-11-26T07:18:16.727 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.117475.log.gz 2023-11-26T07:18:16.727 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113267.log 2023-11-26T07:18:16.727 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.96926.log 2023-11-26T07:18:16.727 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.113267.log: /var/log/ceph/ceph.tmp-client.admin.96926.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.113267.log.gz 2023-11-26T07:18:16.727 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.96926.log.gz 2023-11-26T07:18:16.728 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109664.log 2023-11-26T07:18:16.728 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111506.log 2023-11-26T07:18:16.728 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.109664.log: /var/log/ceph/ceph-client.admin.111506.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.109664.log.gz 2023-11-26T07:18:16.728 INFO:teuthology.orchestra.run.smithi002.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.111506.log.gz 2023-11-26T07:18:16.728 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128082.log 2023-11-26T07:18:16.728 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129513.log 2023-11-26T07:18:16.728 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.128082.log: /var/log/ceph/ceph-client.admin.129513.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.128082.log.gz 2023-11-26T07:18:16.729 INFO:teuthology.orchestra.run.smithi002.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.129513.log.gz 2023-11-26T07:18:16.729 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150989.log 2023-11-26T07:18:16.729 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108768.log 2023-11-26T07:18:16.729 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.150989.log: /var/log/ceph/ceph-client.admin.108768.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.150989.log.gz 2023-11-26T07:18:16.729 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.108768.log.gz 2023-11-26T07:18:16.729 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152411.log 2023-11-26T07:18:16.729 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164419.log 2023-11-26T07:18:16.730 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.152411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113313.log 2023-11-26T07:18:16.730 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.152411.log.gz 2023-11-26T07:18:16.730 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.164419.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.164419.log.gz 2023-11-26T07:18:16.730 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110183.log 2023-11-26T07:18:16.730 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.113313.log: /var/log/ceph/ceph-client.admin.110183.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.113313.log.gz 2023-11-26T07:18:16.730 INFO:teuthology.orchestra.run.smithi002.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.110183.log.gz 2023-11-26T07:18:16.730 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152033.log 2023-11-26T07:18:16.731 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129375.log 2023-11-26T07:18:16.731 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.152033.log: /var/log/ceph/ceph-client.admin.129375.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.152033.log.gz 2023-11-26T07:18:16.731 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.129375.log.gz 2023-11-26T07:18:16.731 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113912.log 2023-11-26T07:18:16.731 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153306.log 2023-11-26T07:18:16.731 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.113912.log: /var/log/ceph/ceph-client.admin.153306.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.113912.log.gz 2023-11-26T07:18:16.731 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.153306.log.gz 2023-11-26T07:18:16.732 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152503.log 2023-11-26T07:18:16.732 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151146.log 2023-11-26T07:18:16.732 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.152503.log: /var/log/ceph/ceph-client.admin.151146.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.152503.log.gz 2023-11-26T07:18:16.732 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.151146.log.gz 2023-11-26T07:18:16.732 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111044.log 2023-11-26T07:18:16.732 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140687.log 2023-11-26T07:18:16.732 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.111044.log: /var/log/ceph/ceph-client.admin.140687.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111044.log.gz 2023-11-26T07:18:16.733 INFO:teuthology.orchestra.run.smithi002.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.140687.log.gz 2023-11-26T07:18:16.733 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140074.log 2023-11-26T07:18:16.733 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164588.log 2023-11-26T07:18:16.733 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.140074.log: 88.7%/var/log/ceph/ceph-client.admin.164588.log: -- replaced with /var/log/ceph/ceph-client.admin.140074.log.gz 2023-11-26T07:18:16.733 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.164588.log.gz 2023-11-26T07:18:16.733 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128352.log 2023-11-26T07:18:16.733 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113129.log 2023-11-26T07:18:16.734 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.128352.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.128352.log.gz 2023-11-26T07:18:16.734 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140503.log 2023-11-26T07:18:16.734 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.113129.log: /var/log/ceph/ceph-client.admin.140503.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.113129.log.gz 2023-11-26T07:18:16.734 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.140503.log.gz 2023-11-26T07:18:16.734 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108574.log 2023-11-26T07:18:16.734 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163729.log 2023-11-26T07:18:16.734 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.108574.log: /var/log/ceph/ceph-client.admin.163729.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.108574.log.gz 2023-11-26T07:18:16.735 INFO:teuthology.orchestra.run.smithi002.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.163729.log.gz 2023-11-26T07:18:16.735 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115811.log 2023-11-26T07:18:16.735 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139118.log 2023-11-26T07:18:16.735 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.115811.log: /var/log/ceph/ceph-client.admin.139118.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.115811.log.gz 2023-11-26T07:18:16.735 INFO:teuthology.orchestra.run.smithi002.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.139118.log.gz 2023-11-26T07:18:16.735 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111276.log 2023-11-26T07:18:16.736 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139678.log 2023-11-26T07:18:16.736 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.111276.log: /var/log/ceph/ceph-client.admin.139678.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.111276.log.gz 2023-11-26T07:18:16.736 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.139678.log.gz 2023-11-26T07:18:16.736 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161780.log 2023-11-26T07:18:16.736 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-26T07:18:16.736 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.161780.log: /var/log/ceph/ceph-mon.a.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.161780.log.gz 2023-11-26T07:18:16.737 INFO:teuthology.orchestra.run.smithi192.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-11-26T07:18:16.742 INFO:teuthology.orchestra.run.smithi192.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-11-26T07:18:16.742 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109856.log 2023-11-26T07:18:16.742 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117677.log 2023-11-26T07:18:16.742 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.109856.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.109856.log.gz 2023-11-26T07:18:16.743 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.117677.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.117677.log.gz 2023-11-26T07:18:16.743 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138750.log 2023-11-26T07:18:16.743 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.138750.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.138750.log.gz 2023-11-26T07:18:16.743 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137472.log 2023-11-26T07:18:16.743 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.137472.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.137472.log.gz 2023-11-26T07:18:16.743 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150326.log 2023-11-26T07:18:16.744 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.150326.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.150326.log.gz 2023-11-26T07:18:16.744 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113636.log 2023-11-26T07:18:16.744 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.113636.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.113636.log.gz 2023-11-26T07:18:16.744 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115627.log 2023-11-26T07:18:16.744 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.115627.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.115627.log.gz 2023-11-26T07:18:16.744 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152708.log 2023-11-26T07:18:16.744 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.152708.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.152708.log.gz 2023-11-26T07:18:16.745 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137999.log 2023-11-26T07:18:16.745 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.137999.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.137999.log.gz 2023-11-26T07:18:16.745 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116217.log 2023-11-26T07:18:16.745 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.116217.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.116217.log.gz 2023-11-26T07:18:16.745 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-11-26T07:18:16.745 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127083.log 2023-11-26T07:18:16.746 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.127083.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.127083.log.gz 2023-11-26T07:18:16.746 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164097.log 2023-11-26T07:18:16.746 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.164097.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.164097.log.gz 2023-11-26T07:18:16.746 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153168.log 2023-11-26T07:18:16.746 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.153168.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.153168.log.gz 2023-11-26T07:18:16.746 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109388.log 2023-11-26T07:18:16.746 INFO:teuthology.orchestra.run.smithi002.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-11-26T07:18:16.747 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.109388.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.109388.log.gz 2023-11-26T07:18:16.747 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162436.log 2023-11-26T07:18:16.747 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.162436.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.162436.log.gz 2023-11-26T07:18:16.747 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128166.log 2023-11-26T07:18:16.747 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.128166.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.128166.log.gz 2023-11-26T07:18:16.747 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150897.log 2023-11-26T07:18:16.747 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.150897.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.150897.log.gz 2023-11-26T07:18:16.748 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116539.log 2023-11-26T07:18:16.748 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.116539.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.116539.log.gz 2023-11-26T07:18:16.748 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129467.log 2023-11-26T07:18:16.748 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.129467.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.129467.log.gz 2023-11-26T07:18:16.898 INFO:teuthology.orchestra.run.smithi002.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-26T07:18:16.963 INFO:teuthology.orchestra.run.smithi192.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-11-26T07:18:17.003 INFO:teuthology.orchestra.run.smithi002.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-11-26T07:18:17.018 INFO:teuthology.orchestra.run.smithi192.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-11-26T07:18:17.037 INFO:teuthology.orchestra.run.smithi192.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-11-26T07:18:17.066 INFO:teuthology.orchestra.run.smithi002.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-26T07:18:17.107 INFO:teuthology.orchestra.run.smithi192.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-11-26T07:18:17.189 INFO:teuthology.orchestra.run.smithi002.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-26T07:18:17.197 INFO:teuthology.orchestra.run.smithi002.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-11-26T07:18:17.517 INFO:teuthology.orchestra.run.smithi192.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-26T07:18:17.548 INFO:teuthology.orchestra.run.smithi192.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-11-26T07:18:17.550 INFO:teuthology.orchestra.run.smithi192.stderr: 2023-11-26T07:18:17.550 INFO:teuthology.orchestra.run.smithi192.stderr:real 0m1.071s 2023-11-26T07:18:17.550 INFO:teuthology.orchestra.run.smithi192.stderr:user 0m4.570s 2023-11-26T07:18:17.550 INFO:teuthology.orchestra.run.smithi192.stderr:sys 0m0.163s 2023-11-26T07:18:19.055 INFO:teuthology.orchestra.run.smithi002.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-11-26T07:18:19.056 INFO:teuthology.orchestra.run.smithi002.stderr: 2023-11-26T07:18:19.057 INFO:teuthology.orchestra.run.smithi002.stderr:real 0m2.603s 2023-11-26T07:18:19.057 INFO:teuthology.orchestra.run.smithi002.stderr:user 0m5.160s 2023-11-26T07:18:19.057 INFO:teuthology.orchestra.run.smithi002.stderr:sys 0m0.430s 2023-11-26T07:18:19.057 INFO:tasks.ceph:Archiving logs... 2023-11-26T07:18:19.057 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467341/remote/smithi002/log 2023-11-26T07:18:19.059 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-26T07:18:20.086 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467341/remote/smithi192/log 2023-11-26T07:18:20.087 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-26T07:18:20.667 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-26T07:18:20.676 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-26T07:18:20.677 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-26T07:18:20.679 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-26T07:18:20.773 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-26T07:18:20.781 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-26T07:18:20.782 DEBUG:teuthology.orchestra.run.smithi002:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-26T07:18:20.784 DEBUG:teuthology.orchestra.run.smithi192:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-26T07:18:20.800 INFO:teuthology.orchestra.run.smithi002.stderr:bash: ntpq: command not found 2023-11-26T07:18:20.802 INFO:teuthology.orchestra.run.smithi192.stderr:bash: ntpq: command not found 2023-11-26T07:18:20.805 INFO:teuthology.orchestra.run.smithi002.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-26T07:18:20.806 INFO:teuthology.orchestra.run.smithi002.stdout:=============================================================================== 2023-11-26T07:18:20.806 INFO:teuthology.orchestra.run.smithi002.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 31 +1460us[+1459us] +/- 87ms 2023-11-26T07:18:20.806 INFO:teuthology.orchestra.run.smithi002.stdout:^* hv02.front.sepia.ceph.com 3 6 377 30 -888us[ -888us] +/- 62ms 2023-11-26T07:18:20.806 INFO:teuthology.orchestra.run.smithi002.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 32 -146us[ -146us] +/- 91ms 2023-11-26T07:18:20.806 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-11-26T07:18:20.807 INFO:teuthology.orchestra.run.smithi192.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-26T07:18:20.807 INFO:teuthology.orchestra.run.smithi192.stdout:=============================================================================== 2023-11-26T07:18:20.807 INFO:teuthology.orchestra.run.smithi192.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 31 +1455us[+1450us] +/- 87ms 2023-11-26T07:18:20.808 INFO:teuthology.orchestra.run.smithi192.stdout:^* hv02.front.sepia.ceph.com 3 6 377 31 -892us[ -897us] +/- 62ms 2023-11-26T07:18:20.808 INFO:teuthology.orchestra.run.smithi192.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 32 -167us[ -173us] +/- 91ms 2023-11-26T07:18:20.808 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-11-26T07:18:20.808 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-26T07:18:20.855 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-26T07:18:20.855 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-26T07:18:20.945 DEBUG:teuthology.orchestra.run.smithi002:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-26T07:18:21.069 DEBUG:teuthology.orchestra.run.smithi192:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-26T07:18:21.172 DEBUG:teuthology.orchestra.run.smithi002:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-26T07:18:21.207 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T07:18:21.207 DEBUG:teuthology.orchestra.run.smithi192:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-26T07:18:21.239 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T07:18:21.240 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-26T07:18:21.250 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-26T07:18:21.303 INFO:teuthology.task.internal:Duration was 1182.689883 seconds 2023-11-26T07:18:21.304 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-26T07:18:21.321 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-26T07:18:21.321 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-26T07:18:21.324 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-26T07:18:21.371 INFO:teuthology.orchestra.run.smithi002.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-26T07:18:21.371 INFO:teuthology.orchestra.run.smithi192.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-26T07:18:21.673 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-26T07:18:21.673 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi002.front.sepia.ceph.com 2023-11-26T07:18:21.673 DEBUG:teuthology.orchestra.run.smithi002:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-26T07:18:21.696 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi192.front.sepia.ceph.com 2023-11-26T07:18:21.697 DEBUG:teuthology.orchestra.run.smithi192:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-26T07:18:21.717 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-26T07:18:21.717 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-26T07:18:21.739 DEBUG:teuthology.orchestra.run.smithi192:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-26T07:18:21.798 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-26T07:18:21.799 DEBUG:teuthology.orchestra.run.smithi002:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-26T07:18:21.801 DEBUG:teuthology.orchestra.run.smithi192:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-26T07:18:21.913 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-26T07:18:21.925 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-26T07:18:21.925 DEBUG:teuthology.orchestra.run.smithi002:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-26T07:18:21.952 DEBUG:teuthology.orchestra.run.smithi192:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-26T07:18:21.978 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-26T07:18:22.002 DEBUG:teuthology.orchestra.run.smithi002:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-26T07:18:22.005 DEBUG:teuthology.orchestra.run.smithi192:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-26T07:18:22.029 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = core 2023-11-26T07:18:22.044 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern = core 2023-11-26T07:18:22.058 DEBUG:teuthology.orchestra.run.smithi002:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-26T07:18:22.098 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T07:18:22.098 DEBUG:teuthology.orchestra.run.smithi192:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-26T07:18:22.113 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T07:18:22.114 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-26T07:18:22.126 INFO:teuthology.task.internal:Transferring archived files... 2023-11-26T07:18:22.127 DEBUG:teuthology.misc:Transferring archived files from smithi002:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467341/remote/smithi002 2023-11-26T07:18:22.127 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-26T07:18:22.178 DEBUG:teuthology.misc:Transferring archived files from smithi192:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467341/remote/smithi192 2023-11-26T07:18:22.179 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-26T07:18:22.215 INFO:teuthology.task.internal:Removing archive directory... 2023-11-26T07:18:22.215 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-26T07:18:22.218 DEBUG:teuthology.orchestra.run.smithi192:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-26T07:18:22.266 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-26T07:18:22.278 INFO:teuthology.task.internal:Not uploading archives. 2023-11-26T07:18:22.278 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-26T07:18:22.298 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-26T07:18:22.299 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-26T07:18:22.301 DEBUG:teuthology.orchestra.run.smithi192:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-26T07:18:22.316 INFO:teuthology.orchestra.run.smithi002.stdout: 262307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 26 07:18 /home/ubuntu/cephtest 2023-11-26T07:18:22.322 INFO:teuthology.orchestra.run.smithi192.stdout: 262320 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 26 07:18 /home/ubuntu/cephtest 2023-11-26T07:18:22.324 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-26T07:18:22.337 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-26T07:18:22.449 INFO:teuthology.nuke:Checking targets against current locks 2023-11-26T07:18:22.476 DEBUG:teuthology.nuke:shortname: smithi002 2023-11-26T07:18:22.477 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-26T07:18:22.500 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi002.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467341', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-26 06:52:33.739348', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-26T07:18:22.504 DEBUG:teuthology.nuke:shortname: smithi192 2023-11-26T07:18:22.504 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-26T07:18:22.524 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi192.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467341', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-26 06:52:33.737605', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-26T07:18:22.556 INFO:teuthology.orchestra.console.smithi002:Power off 2023-11-26T07:18:22.556 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-26T07:18:22.573 INFO:teuthology.orchestra.console.smithi192:Power off 2023-11-26T07:18:22.573 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-26T07:18:22.583 DEBUG:teuthology.orchestra.console.smithi002:power off output: Chassis Power Control: Down/Off 2023-11-26T07:18:22.584 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-26T07:18:22.597 DEBUG:teuthology.orchestra.console.smithi192:power off output: Chassis Power Control: Down/Off 2023-11-26T07:18:22.597 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-26T07:18:22.609 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on 2023-11-26T07:18:22.624 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2023-11-26T07:18:26.611 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-26T07:18:26.624 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-26T07:18:26.722 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on 2023-11-26T07:18:26.734 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2023-11-26T07:18:30.724 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-26T07:18:30.734 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-26T07:18:30.837 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off 2023-11-26T07:18:30.844 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2023-11-26T07:18:30.938 INFO:teuthology.orchestra.console.smithi002:Power off completed 2023-11-26T07:18:34.847 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-26T07:18:34.957 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2023-11-26T07:18:35.057 INFO:teuthology.orchestra.console.smithi192:Power off completed 2023-11-26T07:18:35.163 INFO:teuthology.run:Summary data: description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone}} duration: 1182.689882516861 failure_reason: 'Test failure: test_clone_failure_status_pending_in_progress_complete (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones)' flavor: default owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=6ab0bd228ed6448e850f06f0a18b6cf5 status: fail success: false 2023-11-26T07:18:35.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-26T07:18:35.252 INFO:teuthology.run:FAIL